2023-10-25T15:59:05.190 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-25T15:59:05.191 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235 --verbose --name pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/orig.config.yaml 2023-10-25T15:59:05.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T15:59:05.337 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235 branch: wip-batrick-testing-20231024.144545 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: pdonnell@redhat.com first_in_suite: false job_id: '7436235' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-batrick-testing-20231024.144545 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 384993681abceb8cb8affea10538d607052db4b4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 384993681abceb8cb8affea10538d607052db4b4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231024.144545 sha1: 384993681abceb8cb8affea10538d607052db4b4 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7595 sha1: 384993681abceb8cb8affea10538d607052db4b4 sleep_before_teardown: 0 subset: 66/256 suite: fs suite_branch: wip-batrick-testing-20231024.144545 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 384993681abceb8cb8affea10538d607052db4b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMA7OsvM43FbQ7tmP9uXbzxtHcjG+Lv7PEIn6ndC3+2O3Hw/UIV4nU4KQRcld9CBTZXOjqdzrMvR4CnhWnxonYo= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNq8bOfXnbynahfr4oiAsMkeZb4xAanGNQEOrecAResV89sIVyaEHaPUb2SU+0TZJWc7gzGae345vkj+FRuRfQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-24_19:52:40 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.770726 2023-10-25T15:59:05.337 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa; will attempt to use it 2023-10-25T15:59:05.338 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks 2023-10-25T15:59:05.338 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-25T15:59:05.340 INFO:teuthology.task.internal:Checking packages... 2023-10-25T15:59:05.365 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '384993681abceb8cb8affea10538d607052db4b4' 2023-10-25T15:59:05.365 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-25T15:59:05.366 INFO:teuthology.packaging:ref: None 2023-10-25T15:59:05.366 INFO:teuthology.packaging:tag: None 2023-10-25T15:59:05.366 INFO:teuthology.packaging:branch: wip-batrick-testing-20231024.144545 2023-10-25T15:59:05.367 INFO:teuthology.packaging:sha1: 384993681abceb8cb8affea10538d607052db4b4 2023-10-25T15:59:05.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-batrick-testing-20231024.144545 2023-10-25T15:59:05.515 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6863-g38499368-1jammy 2023-10-25T15:59:05.515 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-25T15:59:05.522 INFO:teuthology.task.internal:no buildpackages task found 2023-10-25T15:59:05.523 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-25T15:59:05.559 INFO:teuthology.task.internal:Saving configuration 2023-10-25T15:59:05.576 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-25T15:59:05.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T15:59:05.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 15:53:38.701574', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILktByugcA/5lxjfxFl0iGvFFAWk+nvCogZRZal9V9Sz'} 2023-10-25T15:59:05.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 15:53:38.699784', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILK+9UDHyYexpmaT4Z6QWO58VCZn02MZ3Pj6uVtS+DTM'} 2023-10-25T15:59:05.644 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-25T15:59:05.650 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-25T15:59:05.651 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-25T15:59:05.651 INFO:teuthology.run_tasks:Running task console_log... 2023-10-25T15:59:05.751 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc8cc646b80>, signals=[15]) 2023-10-25T15:59:05.752 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-25T15:59:05.759 INFO:teuthology.task.internal:Opening connections... 2023-10-25T15:59:05.759 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T15:59:05.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T15:59:05.842 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T15:59:05.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T15:59:05.917 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-25T15:59:05.925 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-10-25T15:59:05.931 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-10-25T15:59:05.931 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-10-25T15:59:05.976 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-25T15:59:05.976 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2023-10-25T15:59:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="22.04" 2023-10-25T15:59:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-25T15:59:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=jammy 2023-10-25T15:59:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2023-10-25T15:59:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2023-10-25T15:59:05.978 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T15:59:05.978 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T15:59:05.978 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T15:59:05.978 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T15:59:05.978 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=jammy 2023-10-25T15:59:05.979 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-10-25T15:59:05.999 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-10-25T15:59:06.005 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-10-25T15:59:06.005 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-10-25T15:59:06.051 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-25T15:59:06.051 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-10-25T15:59:06.051 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2023-10-25T15:59:06.052 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-25T15:59:06.052 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2023-10-25T15:59:06.052 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-10-25T15:59:06.052 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-10-25T15:59:06.052 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-25T15:59:06.053 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-25T15:59:06.053 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-25T15:59:06.053 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-25T15:59:06.053 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2023-10-25T15:59:06.054 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-10-25T15:59:06.073 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-25T15:59:06.083 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-25T15:59:06.119 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-25T15:59:06.120 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2023-10-25T15:59:06.123 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-10-25T15:59:06.127 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-25T15:59:06.151 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-25T15:59:06.151 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2023-10-25T15:59:06.170 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-10-25T15:59:06.271 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-25T15:59:06.329 INFO:teuthology.run_tasks:Running task kernel... 2023-10-25T15:59:06.344 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-25T15:59:06.345 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-25T15:59:06.345 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-25T15:59:06.346 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-25T15:59:06.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T15:59:06.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T15:59:06.355 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-25T15:59:06.355 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-10-25T15:59:06.401 INFO:teuthology.orchestra.run.smithi177.stdout:5.15.0-56-generic 2023-10-25T15:59:06.401 INFO:teuthology.task.kernel:Running kernel on smithi177: 5.15.0-56-generic 2023-10-25T15:59:06.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get clean 2023-10-25T15:59:06.403 INFO:teuthology.orchestra.run.smithi184.stdout:5.15.0-56-generic 2023-10-25T15:59:06.403 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.15.0-56-generic 2023-10-25T15:59:06.403 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2023-10-25T15:59:06.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2023-10-25T15:59:06.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2023-10-25T15:59:06.658 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-25T15:59:06.672 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-25T15:59:06.681 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-25T15:59:06.681 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-25T15:59:06.743 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-25T15:59:06.869 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [353 kB] 2023-10-25T15:59:06.912 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [515 kB] 2023-10-25T15:59:06.958 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [896 kB] 2023-10-25T15:59:06.975 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,103 kB] 2023-10-25T15:59:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [896 kB] 2023-10-25T15:59:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [239 kB] 2023-10-25T15:59:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-25T15:59:07.008 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.4 kB] 2023-10-25T15:59:07.009 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [180 kB] 2023-10-25T15:59:07.024 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-25T15:59:07.025 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-25T15:59:07.026 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,016 kB] 2023-10-25T15:59:07.026 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,036 kB] 2023-10-25T15:59:07.034 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [167 kB] 2023-10-25T15:59:07.035 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [536 B] 2023-10-25T15:59:07.035 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [995 kB] 2023-10-25T15:59:07.042 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [660 kB] 2023-10-25T15:59:07.047 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [218 kB] 2023-10-25T15:59:07.048 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-25T15:59:07.048 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-25T15:59:07.054 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-25T15:59:07.055 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-25T15:59:07.056 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-25T15:59:07.067 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [164 kB] 2023-10-25T15:59:07.073 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [536 B] 2023-10-25T15:59:07.073 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [562 kB] 2023-10-25T15:59:07.073 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-10-25T15:59:07.074 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-10-25T15:59:07.075 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-25T15:59:07.075 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-25T15:59:07.076 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-10-25T15:59:07.076 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-10-25T15:59:07.076 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-25T15:59:07.077 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-10-25T15:59:07.087 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [793 kB] 2023-10-25T15:59:07.142 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-25T15:59:07.145 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-25T15:59:07.145 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-25T15:59:07.147 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-25T15:59:07.147 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-25T15:59:07.161 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-25T15:59:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [353 kB] 2023-10-25T15:59:07.248 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [180 kB] 2023-10-25T15:59:07.260 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-25T15:59:07.261 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,016 kB] 2023-10-25T15:59:07.289 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-25T15:59:07.290 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [164 kB] 2023-10-25T15:59:07.294 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [536 B] 2023-10-25T15:59:07.295 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [793 kB] 2023-10-25T15:59:07.309 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [562 kB] 2023-10-25T15:59:07.316 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-25T15:59:07.318 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-10-25T15:59:07.319 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-25T15:59:07.319 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-25T15:59:07.374 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-25T15:59:07.374 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-25T15:59:12.537 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 9,805 kB in 1s (7,005 kB/s) 2023-10-25T15:59:13.796 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T15:59:13.812 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-25T15:59:13.876 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T15:59:14.063 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-10-25T15:59:14.064 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-10-25T15:59:14.222 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T15:59:14.222 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T15:59:14.222 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T15:59:14.223 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T15:59:14.223 INFO:teuthology.orchestra.run.smithi184.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-25T15:59:14.223 INFO:teuthology.orchestra.run.smithi184.stdout: python2.7-minimal 2023-10-25T15:59:14.223 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T15:59:14.224 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-10-25T15:59:14.224 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-5.15.0-87 linux-headers-5.15.0-87-generic 2023-10-25T15:59:14.224 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-generic linux-image-5.15.0-87-generic 2023-10-25T15:59:14.225 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-5.15.0-87-generic linux-modules-extra-5.15.0-87-generic 2023-10-25T15:59:14.225 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-10-25T15:59:14.225 INFO:teuthology.orchestra.run.smithi184.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-25T15:59:14.225 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2023-10-25T15:59:14.226 INFO:teuthology.orchestra.run.smithi184.stdout: thermald 2023-10-25T15:59:14.283 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-10-25T15:59:14.283 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-5.15.0-87 linux-headers-5.15.0-87-generic 2023-10-25T15:59:14.283 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.15.0-87-generic linux-modules-5.15.0-87-generic 2023-10-25T15:59:14.284 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-extra-5.15.0-87-generic 2023-10-25T15:59:14.284 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2023-10-25T15:59:14.285 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-25T15:59:14.340 INFO:teuthology.orchestra.run.smithi184.stdout:3 upgraded, 5 newly installed, 0 to remove and 269 not upgraded. 2023-10-25T15:59:14.340 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 113 MB of archives. 2023-10-25T15:59:14.340 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-25T15:59:14.340 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-87-generic amd64 5.15.0-87.97 [22.4 MB] 2023-10-25T15:59:14.822 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-87-generic amd64 5.15.0-87.97 [11.5 MB] 2023-10-25T15:59:14.944 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-87-generic amd64 5.15.0-87.97 [64.0 MB] 2023-10-25T15:59:15.951 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.87.84 [1,698 B] 2023-10-25T15:59:15.952 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.87.84 [2,482 B] 2023-10-25T15:59:15.952 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-87 all 5.15.0-87.97 [12.3 MB] 2023-10-25T15:59:16.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-87-generic amd64 5.15.0-87.97 [2,888 kB] 2023-10-25T15:59:16.225 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.87.84 [2,322 B] 2023-10-25T15:59:16.603 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 113 MB in 2s (58.5 MB/s) 2023-10-25T15:59:16.779 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-5.15.0-87-generic. 2023-10-25T15:59:18.098 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:18 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-25T15:59:18.117 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-25T15:59:18.201 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-25T15:59:18.290 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [515 kB] 2023-10-25T15:59:18.358 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,103 kB] 2023-10-25T15:59:18.392 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [239 kB] 2023-10-25T15:59:18.395 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-25T15:59:18.395 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,036 kB] 2023-10-25T15:59:18.410 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.4 kB] 2023-10-25T15:59:18.410 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [167 kB] 2023-10-25T15:59:18.411 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [536 B] 2023-10-25T15:59:18.412 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [995 kB] 2023-10-25T15:59:18.423 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [660 kB] 2023-10-25T15:59:18.431 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [218 kB] 2023-10-25T15:59:18.433 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-25T15:59:18.433 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-25T15:59:18.434 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-25T15:59:18.434 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-25T15:59:18.435 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-25T15:59:18.435 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-10-25T15:59:18.436 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-10-25T15:59:18.454 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-25T15:59:18.454 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-25T15:59:18.455 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-10-25T15:59:18.455 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-10-25T15:59:18.474 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-25T15:59:18.475 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-10-25T15:59:18.771 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-25T15:59:18.774 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../0-linux-modules-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:18.932 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:21.062 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-image-5.15.0-87-generic. 2023-10-25T15:59:21.083 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../1-linux-image-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:21.175 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:21.565 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-87-generic. 2023-10-25T15:59:21.585 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:21.623 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-extra-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:23.325 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 9,805 kB in 12s (795 kB/s) 2023-10-25T15:59:24.516 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T15:59:24.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-25T15:59:24.593 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T15:59:24.786 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2023-10-25T15:59:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2023-10-25T15:59:24.954 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T15:59:24.955 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T15:59:24.955 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T15:59:24.955 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T15:59:24.956 INFO:teuthology.orchestra.run.smithi177.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-25T15:59:24.956 INFO:teuthology.orchestra.run.smithi177.stdout: python2.7-minimal 2023-10-25T15:59:24.956 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T15:59:24.957 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2023-10-25T15:59:24.957 INFO:teuthology.orchestra.run.smithi177.stdout: linux-generic linux-headers-5.15.0-87 linux-headers-5.15.0-87-generic 2023-10-25T15:59:24.957 INFO:teuthology.orchestra.run.smithi177.stdout: linux-headers-generic linux-image-5.15.0-87-generic 2023-10-25T15:59:24.958 INFO:teuthology.orchestra.run.smithi177.stdout: linux-modules-5.15.0-87-generic linux-modules-extra-5.15.0-87-generic 2023-10-25T15:59:24.958 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2023-10-25T15:59:24.959 INFO:teuthology.orchestra.run.smithi177.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-25T15:59:24.959 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2023-10-25T15:59:24.959 INFO:teuthology.orchestra.run.smithi177.stdout: thermald 2023-10-25T15:59:25.001 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2023-10-25T15:59:25.001 INFO:teuthology.orchestra.run.smithi177.stdout: linux-headers-5.15.0-87 linux-headers-5.15.0-87-generic 2023-10-25T15:59:25.002 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.15.0-87-generic linux-modules-5.15.0-87-generic 2023-10-25T15:59:25.002 INFO:teuthology.orchestra.run.smithi177.stdout: linux-modules-extra-5.15.0-87-generic 2023-10-25T15:59:25.003 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2023-10-25T15:59:25.004 INFO:teuthology.orchestra.run.smithi177.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-25T15:59:25.180 INFO:teuthology.orchestra.run.smithi177.stdout:3 upgraded, 5 newly installed, 0 to remove and 269 not upgraded. 2023-10-25T15:59:25.180 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 113 MB of archives. 2023-10-25T15:59:25.180 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-25T15:59:25.181 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-87-generic amd64 5.15.0-87.97 [22.4 MB] 2023-10-25T15:59:26.674 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-87-generic amd64 5.15.0-87.97 [11.5 MB] 2023-10-25T15:59:27.021 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-87-generic amd64 5.15.0-87.97 [64.0 MB] 2023-10-25T15:59:28.316 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../3-linux-generic_5.15.0.87.84_amd64.deb ... 2023-10-25T15:59:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-generic (5.15.0.87.84) over (5.15.0.56.54) ... 2023-10-25T15:59:28.793 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.87.84_amd64.deb ... 2023-10-25T15:59:28.922 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-generic (5.15.0.87.84) over (5.15.0.56.54) ... 2023-10-25T15:59:29.193 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.87.84 [1,698 B] 2023-10-25T15:59:29.194 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.87.84 [2,482 B] 2023-10-25T15:59:29.194 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-87 all 5.15.0-87.97 [12.3 MB] 2023-10-25T15:59:29.225 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.15.0-87. 2023-10-25T15:59:29.248 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../5-linux-headers-5.15.0-87_5.15.0-87.97_all.deb ... 2023-10-25T15:59:29.292 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.15.0-87 (5.15.0-87.97) ... 2023-10-25T15:59:29.525 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-87-generic amd64 5.15.0-87.97 [2,888 kB] 2023-10-25T15:59:29.605 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.87.84 [2,322 B] 2023-10-25T15:59:29.987 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2023-10-25T15:59:30.173 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-modules-5.15.0-87-generic. 2023-10-25T15:59:32.187 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-25T15:59:32.191 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../0-linux-modules-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:32.252 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-modules-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:34.394 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-image-5.15.0-87-generic. 2023-10-25T15:59:34.416 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../1-linux-image-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:34.505 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:34.956 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-87-generic. 2023-10-25T15:59:34.976 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:35.014 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-modules-extra-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:35.083 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.15.0-87-generic. 2023-10-25T15:59:35.120 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../6-linux-headers-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:35.158 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:37.787 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.87.84_amd64.deb ... 2023-10-25T15:59:37.910 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-generic (5.15.0.87.84) over (5.15.0.56.54) ... 2023-10-25T15:59:38.242 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.15.0-87 (5.15.0-87.97) ... 2023-10-25T15:59:38.356 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:38.482 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-generic (5.15.0.87.84) ... 2023-10-25T15:59:38.609 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:40.012 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:41.374 INFO:teuthology.orchestra.run.smithi184.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-25T15:59:41.374 INFO:teuthology.orchestra.run.smithi184.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-25T15:59:41.374 INFO:teuthology.orchestra.run.smithi184.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-87-generic 2023-10-25T15:59:41.374 INFO:teuthology.orchestra.run.smithi184.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-87-generic 2023-10-25T15:59:41.513 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-extra-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:41.570 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../3-linux-generic_5.15.0.87.84_amd64.deb ... 2023-10-25T15:59:41.697 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-generic (5.15.0.87.84) over (5.15.0.56.54) ... 2023-10-25T15:59:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.87.84_amd64.deb ... 2023-10-25T15:59:42.434 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-generic (5.15.0.87.84) over (5.15.0.56.54) ... 2023-10-25T15:59:42.736 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-headers-5.15.0-87. 2023-10-25T15:59:42.759 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../5-linux-headers-5.15.0-87_5.15.0-87.97_all.deb ... 2023-10-25T15:59:42.803 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-headers-5.15.0-87 (5.15.0-87.97) ... 2023-10-25T15:59:43.106 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-generic (5.15.0.87.84) ... 2023-10-25T15:59:43.232 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-generic (5.15.0.87.84) ... 2023-10-25T15:59:43.358 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for linux-image-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:43.422 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-25T15:59:43.423 INFO:teuthology.orchestra.run.smithi184.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-87-generic 2023-10-25T15:59:48.190 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-headers-5.15.0-87-generic. 2023-10-25T15:59:48.226 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../6-linux-headers-5.15.0-87-generic_5.15.0-87.97_amd64.deb ... 2023-10-25T15:59:48.265 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-headers-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:51.337 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.87.84_amd64.deb ... 2023-10-25T15:59:51.460 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-headers-generic (5.15.0.87.84) over (5.15.0.56.54) ... 2023-10-25T15:59:51.793 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-headers-5.15.0-87 (5.15.0-87.97) ... 2023-10-25T15:59:51.915 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-headers-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:52.041 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-headers-generic (5.15.0.87.84) ... 2023-10-25T15:59:52.168 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-modules-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:53.605 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:55.002 INFO:teuthology.orchestra.run.smithi177.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-25T15:59:55.002 INFO:teuthology.orchestra.run.smithi177.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-25T15:59:55.003 INFO:teuthology.orchestra.run.smithi177.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-87-generic 2023-10-25T15:59:55.003 INFO:teuthology.orchestra.run.smithi177.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-87-generic 2023-10-25T15:59:55.139 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-modules-extra-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:56.516 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-generic (5.15.0.87.84) ... 2023-10-25T15:59:56.642 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-generic (5.15.0.87.84) ... 2023-10-25T15:59:56.768 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for linux-image-5.15.0-87-generic (5.15.0-87.97) ... 2023-10-25T15:59:56.830 INFO:teuthology.orchestra.run.smithi177.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-25T15:59:56.830 INFO:teuthology.orchestra.run.smithi177.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-87-generic 2023-10-25T15:59:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-25T15:59:58.201 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub' 2023-10-25T15:59:58.221 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-25T15:59:58.235 INFO:teuthology.orchestra.run.smithi184.stdout:Generating grub configuration file ... 2023-10-25T15:59:58.485 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.15.0-87-generic 2023-10-25T15:59:58.500 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.15.0-87-generic 2023-10-25T15:59:58.786 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-25T15:59:58.792 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-25T15:59:58.854 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-25T15:59:58.860 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-25T15:59:59.007 INFO:teuthology.orchestra.run.smithi184.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-25T15:59:59.007 INFO:teuthology.orchestra.run.smithi184.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-25T15:59:59.008 INFO:teuthology.orchestra.run.smithi184.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-25T15:59:59.044 INFO:teuthology.orchestra.run.smithi184.stdout:done 2023-10-25T15:59:59.543 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2023-10-25T15:59:59.563 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2023-10-25T15:59:59.563 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2023-10-25T15:59:59.563 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2023-10-25T15:59:59.564 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2023-10-25T15:59:59.564 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 20 2023-10-25T15:59:59.564 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2023-10-25T15:59:59.564 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2023-10-25T15:59:59.564 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2023-10-25T15:59:59.565 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.15.0.87.84 2023-10-25T15:59:59.565 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-87), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-25T15:59:59.565 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.15.0-87-generic, linux-modules-extra-5.15.0-87-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-25T15:59:59.566 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2023-10-25T15:59:59.566 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2023-10-25T15:59:59.566 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2023-10-25T15:59:59.566 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2023-10-25T15:59:59.567 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-87-generic 2023-10-25T15:59:59.567 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-25T15:59:59.567 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-25T15:59:59.567 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-25T15:59:59.568 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2023-10-25T15:59:59.568 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2023-10-25T15:59:59.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2023-10-25T15:59:59.926 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-25T15:59:59.927 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-25T15:59:59.927 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-25T15:59:59.943 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-25T16:00:01.243 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T16:00:01.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-25T16:00:01.319 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T16:00:01.505 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-10-25T16:00:01.505 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-10-25T16:00:01.664 INFO:teuthology.orchestra.run.smithi184.stdout:linux-image-generic is already the newest version (5.15.0.87.84). 2023-10-25T16:00:01.665 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T16:00:01.665 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T16:00:01.665 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T16:00:01.665 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T16:00:01.665 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-25T16:00:01.666 INFO:teuthology.orchestra.run.smithi184.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-25T16:00:01.666 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T16:00:01.705 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 0 newly installed, 0 to remove and 269 not upgraded. 2023-10-25T16:00:01.707 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2023-10-25T16:00:01.722 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2023-10-25T16:00:01.723 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2023-10-25T16:00:01.723 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2023-10-25T16:00:01.723 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2023-10-25T16:00:01.723 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 20 2023-10-25T16:00:01.724 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2023-10-25T16:00:01.724 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2023-10-25T16:00:01.724 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2023-10-25T16:00:01.724 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.15.0.87.84 2023-10-25T16:00:01.724 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-87), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-25T16:00:01.725 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.15.0-87-generic, linux-modules-extra-5.15.0-87-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-25T16:00:01.725 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2023-10-25T16:00:01.725 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2023-10-25T16:00:01.725 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2023-10-25T16:00:01.725 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2023-10-25T16:00:01.726 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-25T16:00:01.769 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.6EBfpgeDq9 2023-10-25T16:00:01.769 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6EBfpgeDq9 2023-10-25T16:00:01.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.6EBfpgeDq9 2023-10-25T16:00:01.946 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.6EBfpgeDq9 is 10KB 2023-10-25T16:00:01.962 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.6EBfpgeDq9 2023-10-25T16:00:01.968 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-25T16:00:02.021 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:00:02.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-25T16:00:02.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-25T16:00:02.105 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-87-generic 2023-10-25T16:00:02.105 DEBUG:teuthology.orchestra.run.smithi184:> sudo update-grub 2023-10-25T16:00:03.238 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2023-10-25T16:00:03.240 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-25T16:00:03.243 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-10-25T16:00:03.435 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.15.0-87-generic 2023-10-25T16:00:03.441 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.15.0-87-generic 2023-10-25T16:00:03.675 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-25T16:00:03.680 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-25T16:00:03.723 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-25T16:00:03.730 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-25T16:00:03.859 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-25T16:00:03.860 INFO:teuthology.orchestra.run.smithi184.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-25T16:00:03.860 INFO:teuthology.orchestra.run.smithi184.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-25T16:00:03.871 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-10-25T16:00:03.890 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2023-10-25T16:00:10.895 INFO:teuthology.orchestra.run.smithi177.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-25T16:00:10.895 INFO:teuthology.orchestra.run.smithi177.stdout:Sourcing file `/etc/default/grub' 2023-10-25T16:00:10.925 INFO:teuthology.orchestra.run.smithi177.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-25T16:00:10.950 INFO:teuthology.orchestra.run.smithi177.stdout:Generating grub configuration file ... 2023-10-25T16:00:11.223 INFO:teuthology.orchestra.run.smithi177.stdout:Found linux image: /boot/vmlinuz-5.15.0-87-generic 2023-10-25T16:00:11.242 INFO:teuthology.orchestra.run.smithi177.stdout:Found initrd image: /boot/initrd.img-5.15.0-87-generic 2023-10-25T16:00:11.526 INFO:teuthology.orchestra.run.smithi177.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-25T16:00:11.532 INFO:teuthology.orchestra.run.smithi177.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-25T16:00:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-25T16:00:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-25T16:00:11.780 INFO:teuthology.orchestra.run.smithi177.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-25T16:00:11.780 INFO:teuthology.orchestra.run.smithi177.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-25T16:00:11.781 INFO:teuthology.orchestra.run.smithi177.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-25T16:00:11.813 INFO:teuthology.orchestra.run.smithi177.stdout:done 2023-10-25T16:00:12.313 DEBUG:teuthology.orchestra.run.smithi177:> dpkg -s linux-image-generic 2023-10-25T16:00:12.336 INFO:teuthology.orchestra.run.smithi177.stdout:Package: linux-image-generic 2023-10-25T16:00:12.336 INFO:teuthology.orchestra.run.smithi177.stdout:Status: install ok installed 2023-10-25T16:00:12.336 INFO:teuthology.orchestra.run.smithi177.stdout:Priority: optional 2023-10-25T16:00:12.337 INFO:teuthology.orchestra.run.smithi177.stdout:Section: kernel 2023-10-25T16:00:12.337 INFO:teuthology.orchestra.run.smithi177.stdout:Installed-Size: 20 2023-10-25T16:00:12.337 INFO:teuthology.orchestra.run.smithi177.stdout:Maintainer: Ubuntu Kernel Team 2023-10-25T16:00:12.337 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: amd64 2023-10-25T16:00:12.337 INFO:teuthology.orchestra.run.smithi177.stdout:Source: linux-meta 2023-10-25T16:00:12.338 INFO:teuthology.orchestra.run.smithi177.stdout:Version: 5.15.0.87.84 2023-10-25T16:00:12.338 INFO:teuthology.orchestra.run.smithi177.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-87), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-25T16:00:12.338 INFO:teuthology.orchestra.run.smithi177.stdout:Depends: linux-image-5.15.0-87-generic, linux-modules-extra-5.15.0-87-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-25T16:00:12.338 INFO:teuthology.orchestra.run.smithi177.stdout:Recommends: thermald 2023-10-25T16:00:12.339 INFO:teuthology.orchestra.run.smithi177.stdout:Description: Generic Linux kernel image 2023-10-25T16:00:12.339 INFO:teuthology.orchestra.run.smithi177.stdout: This package will always depend on the latest generic kernel image 2023-10-25T16:00:12.339 INFO:teuthology.orchestra.run.smithi177.stdout: available. 2023-10-25T16:00:12.339 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-87-generic 2023-10-25T16:00:12.340 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-25T16:00:12.340 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-25T16:00:12.340 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-25T16:00:12.341 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2023-10-25T16:00:12.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get clean 2023-10-25T16:00:12.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2023-10-25T16:00:12.609 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-25T16:00:12.609 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-25T16:00:12.624 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-25T16:00:12.644 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-25T16:00:13.883 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T16:00:13.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-25T16:00:13.953 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T16:00:14.119 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2023-10-25T16:00:14.119 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2023-10-25T16:00:14.265 INFO:teuthology.orchestra.run.smithi177.stdout:linux-image-generic is already the newest version (5.15.0.87.84). 2023-10-25T16:00:14.265 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T16:00:14.265 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T16:00:14.265 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T16:00:14.266 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T16:00:14.266 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-25T16:00:14.266 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-25T16:00:14.270 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T16:00:14.304 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 0 newly installed, 0 to remove and 269 not upgraded. 2023-10-25T16:00:14.306 DEBUG:teuthology.orchestra.run.smithi177:> dpkg -s linux-image-generic 2023-10-25T16:00:14.362 INFO:teuthology.orchestra.run.smithi177.stdout:Package: linux-image-generic 2023-10-25T16:00:14.363 INFO:teuthology.orchestra.run.smithi177.stdout:Status: install ok installed 2023-10-25T16:00:14.363 INFO:teuthology.orchestra.run.smithi177.stdout:Priority: optional 2023-10-25T16:00:14.363 INFO:teuthology.orchestra.run.smithi177.stdout:Section: kernel 2023-10-25T16:00:14.364 INFO:teuthology.orchestra.run.smithi177.stdout:Installed-Size: 20 2023-10-25T16:00:14.364 INFO:teuthology.orchestra.run.smithi177.stdout:Maintainer: Ubuntu Kernel Team 2023-10-25T16:00:14.365 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: amd64 2023-10-25T16:00:14.365 INFO:teuthology.orchestra.run.smithi177.stdout:Source: linux-meta 2023-10-25T16:00:14.365 INFO:teuthology.orchestra.run.smithi177.stdout:Version: 5.15.0.87.84 2023-10-25T16:00:14.366 INFO:teuthology.orchestra.run.smithi177.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-87), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-25T16:00:14.366 INFO:teuthology.orchestra.run.smithi177.stdout:Depends: linux-image-5.15.0-87-generic, linux-modules-extra-5.15.0-87-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-25T16:00:14.366 INFO:teuthology.orchestra.run.smithi177.stdout:Recommends: thermald 2023-10-25T16:00:14.367 INFO:teuthology.orchestra.run.smithi177.stdout:Description: Generic Linux kernel image 2023-10-25T16:00:14.367 INFO:teuthology.orchestra.run.smithi177.stdout: This package will always depend on the latest generic kernel image 2023-10-25T16:00:14.368 INFO:teuthology.orchestra.run.smithi177.stdout: available. 2023-10-25T16:00:14.369 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2023-10-25T16:00:14.407 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.PxUnuggr6x 2023-10-25T16:00:14.408 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub/grub.cfg /tmp/tmp.PxUnuggr6x 2023-10-25T16:00:14.463 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.PxUnuggr6x 2023-10-25T16:00:14.597 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.PxUnuggr6x is 10KB 2023-10-25T16:00:14.609 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.PxUnuggr6x 2023-10-25T16:00:14.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-25T16:00:14.666 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:00:14.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-25T16:00:14.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-25T16:00:14.729 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-87-generic 2023-10-25T16:00:14.729 DEBUG:teuthology.orchestra.run.smithi177:> sudo update-grub 2023-10-25T16:00:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2023-10-25T16:00:15.885 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-25T16:00:15.889 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2023-10-25T16:00:16.065 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-87-generic 2023-10-25T16:00:16.071 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-87-generic 2023-10-25T16:00:16.299 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-25T16:00:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-25T16:00:16.344 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-25T16:00:16.349 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-25T16:00:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-25T16:00:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-25T16:00:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-25T16:00:16.505 INFO:teuthology.orchestra.run.smithi177.stderr:done 2023-10-25T16:00:16.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2023-10-25T16:00:33.910 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-25T16:00:33.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-25T16:00:33.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:00:46.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-25T16:00:46.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:00:46.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:00:52.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-25T16:01:01.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-25T16:01:01.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:01:04.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-25T16:01:04.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-25T16:01:13.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:01:13.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:01:16.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-25T16:01:16.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:01:16.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-25T16:01:28.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:01:28.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:01:47.386 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-25T16:01:48.108 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-25T16:01:48.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-25T16:01:48.735 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-87-generic"... 2023-10-25T16:01:48.735 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-25T16:01:48.779 INFO:teuthology.orchestra.run.smithi184.stdout:5.15.0-87-generic 2023-10-25T16:01:48.780 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-87-generic vs 5.15.0-87-generic 2023-10-25T16:01:48.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-25T16:01:48.780 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-25T16:01:49.782 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-25T16:01:49.782 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-25T16:01:50.131 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2023-10-25T16:01:50.149 DEBUG:teuthology.parallel:result is None 2023-10-25T16:02:02.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:02:02.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:02:02.701 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-10-25T16:02:03.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:02:03.340 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-87-generic"... 2023-10-25T16:02:03.340 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-10-25T16:02:03.384 INFO:teuthology.orchestra.run.smithi177.stdout:5.15.0-87-generic 2023-10-25T16:02:03.385 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-87-generic vs 5.15.0-87-generic 2023-10-25T16:02:03.385 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-25T16:02:03.385 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-25T16:02:04.386 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-25T16:02:04.386 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-25T16:02:04.475 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2023-10-25T16:02:04.494 DEBUG:teuthology.parallel:result is None 2023-10-25T16:02:04.495 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-25T16:02:04.507 INFO:teuthology.task.internal:Creating test directory... 2023-10-25T16:02:04.507 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-25T16:02:04.510 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-25T16:02:04.516 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-25T16:02:04.556 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-25T16:02:04.586 INFO:teuthology.task.internal:Creating archive directory... 2023-10-25T16:02:04.587 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-25T16:02:04.589 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-25T16:02:04.611 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-25T16:02:04.619 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-25T16:02:04.619 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-25T16:02:04.650 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-25T16:02:04.674 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T16:02:04.682 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T16:02:04.684 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T16:02:04.689 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T16:02:04.691 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-25T16:02:04.698 INFO:teuthology.task.internal:Configuring sudo... 2023-10-25T16:02:04.698 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-25T16:02:04.734 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-25T16:02:04.748 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-25T16:02:04.757 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-25T16:02:04.757 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-25T16:02:04.790 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-25T16:02:04.795 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-25T16:02:04.841 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-25T16:02:04.889 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:02:04.890 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-25T16:02:04.953 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-25T16:02:04.959 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-25T16:02:05.007 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:02:05.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-25T16:02:05.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2023-10-25T16:02:05.069 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-10-25T16:02:05.191 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-25T16:02:05.199 INFO:teuthology.task.internal:Starting timer... 2023-10-25T16:02:05.199 INFO:teuthology.run_tasks:Running task pcp... 2023-10-25T16:02:05.231 INFO:teuthology.run_tasks:Running task selinux... 2023-10-25T16:02:05.264 DEBUG:teuthology.task.selinux:Excluding smithi177: OS 'ubuntu' does not support SELinux 2023-10-25T16:02:05.264 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2023-10-25T16:02:05.265 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-25T16:02:05.265 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-25T16:02:05.265 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-25T16:02:05.265 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-25T16:02:05.299 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-25T16:02:05.304 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-25T16:02:05.459 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-25T16:02:05.473 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-25T16:02:05.475 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi177.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-25T16:09:46.697 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi177.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-10-25T16:09:46.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:09:46.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:09:46.777 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-10-25T16:09:46.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-25T16:09:46.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-25T16:09:46.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T16:09:46.954 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-25T16:09:47.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-25T16:09:47.057 INFO:teuthology.run_tasks:Running task clock... 2023-10-25T16:09:47.070 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-25T16:09:47.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-25T16:09:47.071 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T16:09:47.074 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-25T16:09:47.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T16:09:47.099 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-25T16:09:47.099 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Command line: ntpd -gq 2023-10-25T16:09:47.100 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: ---------------------------------------------------- 2023-10-25T16:09:47.100 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: ntp-4 is maintained by Network Time Foundation, 2023-10-25T16:09:47.100 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-25T16:09:47.100 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: corporation. Support and training for ntp-4 are 2023-10-25T16:09:47.100 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: available at https://www.nwtime.org/support 2023-10-25T16:09:47.101 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: ---------------------------------------------------- 2023-10-25T16:09:47.102 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: proto: precision = 0.043 usec (-24) 2023-10-25T16:09:47.102 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: basedate set to 2022-02-04 2023-10-25T16:09:47.102 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: gps base set to 2022-02-06 (week 2196) 2023-10-25T16:09:47.103 INFO:teuthology.orchestra.run.smithi177.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-25T16:09:47.103 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-25T16:09:47.103 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: restrict ::: KOD does nothing without LIMITED. 2023-10-25T16:09:47.104 INFO:teuthology.orchestra.run.smithi177.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-25T16:09:47.105 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listen and drop on 0 v6wildcard [::]:123 2023-10-25T16:09:47.105 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-25T16:09:47.105 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listen normally on 2 lo 127.0.0.1:123 2023-10-25T16:09:47.106 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listen normally on 3 enp3s0f1 172.21.15.177:123 2023-10-25T16:09:47.106 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listen normally on 4 lo [::1]:123 2023-10-25T16:09:47.106 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feea:b04b%5]:123 2023-10-25T16:09:47.106 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:47 ntpd[27360]: Listening on routing socket on fd #22 for interface updates 2023-10-25T16:09:47.122 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-25T16:09:47.123 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Command line: ntpd -gq 2023-10-25T16:09:47.123 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: ---------------------------------------------------- 2023-10-25T16:09:47.123 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: ntp-4 is maintained by Network Time Foundation, 2023-10-25T16:09:47.123 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-25T16:09:47.123 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: corporation. Support and training for ntp-4 are 2023-10-25T16:09:47.124 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: available at https://www.nwtime.org/support 2023-10-25T16:09:47.124 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: ---------------------------------------------------- 2023-10-25T16:09:47.124 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: proto: precision = 0.043 usec (-24) 2023-10-25T16:09:47.125 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: basedate set to 2022-02-04 2023-10-25T16:09:47.125 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: gps base set to 2022-02-06 (week 2196) 2023-10-25T16:09:47.125 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-25T16:09:47.126 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-25T16:09:47.126 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: restrict ::: KOD does nothing without LIMITED. 2023-10-25T16:09:47.126 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-25T16:09:47.127 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listen and drop on 0 v6wildcard [::]:123 2023-10-25T16:09:47.128 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-25T16:09:47.128 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listen normally on 2 lo 127.0.0.1:123 2023-10-25T16:09:47.128 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2023-10-25T16:09:47.128 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listen normally on 4 lo [::1]:123 2023-10-25T16:09:47.128 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2023-10-25T16:09:47.129 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:47 ntpd[27324]: Listening on routing socket on fd #22 for interface updates 2023-10-25T16:09:48.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:48 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:48.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:48 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:48.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:48 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:48 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:48 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:48 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:48.123 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:48 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:48.123 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:48 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:50.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:50 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:50.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:50 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:50.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:50 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:50.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:50 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:50.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:50 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:50.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:50 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:51 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:51 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:51 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:51 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:51 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:51 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:51.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:51.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:51.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:51.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:51.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:51.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:51.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:51.128 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:51 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:52.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:52.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:52.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:52.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:52.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:52.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:52.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:52.104 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:52 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:53.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:53 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:53 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.100 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:53 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:53 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:53 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:53.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:53 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:53.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:53.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:53.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:53.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:53.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:53.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:53.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:53.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:53 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:54.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:54.101 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:54.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:54.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:54.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:54.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:54.102 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:54.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:54.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:54.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:54.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:54.103 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:54.104 INFO:teuthology.orchestra.run.smithi177.stdout:25 Oct 16:09:54 ntpd[27360]: ntpd: time slew -0.001392 s 2023-10-25T16:09:54.104 INFO:teuthology.orchestra.run.smithi177.stdout:ntpd: time slew -0.001392s 2023-10-25T16:09:54.104 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-25T16:09:54.105 INFO:teuthology.orchestra.run.smithi177.stderr:25 Oct 16:09:54 ntpd[27360]: can't open /var/log/ntpstats/loopstats.20231025: Permission denied 2023-10-25T16:09:54.170 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2023-10-25T16:09:54.171 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2023-10-25T16:09:54.171 INFO:teuthology.orchestra.run.smithi177.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:54.171 INFO:teuthology.orchestra.run.smithi177.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:54.171 INFO:teuthology.orchestra.run.smithi177.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:54.172 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:55.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:55.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:55.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:55.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:55.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:55.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:55.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:55.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:55.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:55.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:55.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:55.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:55.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:55.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:55.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:55.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:55.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:55.128 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:55 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:57.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:57.124 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:57.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:57.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:57.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:57.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:57.125 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-25T16:09:57.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20231025: Permission denied 2023-10-25T16:09:57.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-25T16:09:57.126 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20231025: Permission denied 2023-10-25T16:09:57.127 INFO:teuthology.orchestra.run.smithi184.stdout:25 Oct 16:09:57 ntpd[27324]: ntpd: time slew -0.000492 s 2023-10-25T16:09:57.127 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew -0.000492s 2023-10-25T16:09:57.127 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-25T16:09:57.128 INFO:teuthology.orchestra.run.smithi184.stderr:25 Oct 16:09:57 ntpd[27324]: can't open /var/log/ntpstats/loopstats.20231025: Permission denied 2023-10-25T16:09:57.209 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2023-10-25T16:09:57.209 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2023-10-25T16:09:57.210 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:57.210 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:57.210 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:57.210 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-25T16:09:57.211 INFO:teuthology.run_tasks:Running task install... 2023-10-25T16:09:57.220 DEBUG:teuthology.task.install:project ceph 2023-10-25T16:09:57.221 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}} 2023-10-25T16:09:57.221 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'} 2023-10-25T16:09:57.221 INFO:teuthology.task.install:Using flavor: default 2023-10-25T16:09:57.227 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-25T16:09:57.228 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-25T16:09:57.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-key list | grep Ceph 2023-10-25T16:09:57.229 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2023-10-25T16:09:57.291 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-25T16:09:57.310 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-25T16:09:57.321 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-25T16:09:57.321 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph.com (release key) 2023-10-25T16:09:57.321 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-25T16:09:57.321 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-25T16:09:57.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T16:09:57.338 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-25T16:09:57.339 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2023-10-25T16:09:57.340 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-25T16:09:57.340 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-25T16:09:57.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T16:09:57.476 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default/ 2023-10-25T16:09:57.477 INFO:teuthology.task.install.deb:Package version is 18.0.0-6863-g38499368-1jammy 2023-10-25T16:09:57.558 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default/ 2023-10-25T16:09:57.558 INFO:teuthology.task.install.deb:Package version is 18.0.0-6863-g38499368-1jammy 2023-10-25T16:09:57.646 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:09:57.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-25T16:09:57.661 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2023-10-25T16:09:57.664 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:09:57.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-25T16:09:57.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2023-10-25T16:09:57.848 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-25T16:09:57.945 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy InRelease 2023-10-25T16:09:57.959 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-25T16:09:57.959 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-25T16:09:57.963 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy InRelease 2023-10-25T16:09:57.968 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-25T16:09:57.991 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-25T16:09:58.007 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-25T16:09:58.032 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-25T16:09:58.050 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-25T16:09:58.056 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-25T16:09:58.072 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-25T16:09:58.114 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-25T16:09:58.123 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-25T16:09:58.131 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-25T16:09:58.140 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-25T16:09:58.200 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-10-25T16:09:58.218 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2023-10-25T16:09:58.289 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 28.5 kB in 0s (66.4 kB/s) 2023-10-25T16:09:58.321 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 28.5 kB in 0s (58.9 kB/s) 2023-10-25T16:09:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T16:09:59.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6863-g38499368-1jammy cephadm=18.0.0-6863-g38499368-1jammy ceph-mds=18.0.0-6863-g38499368-1jammy ceph-mgr=18.0.0-6863-g38499368-1jammy ceph-common=18.0.0-6863-g38499368-1jammy ceph-fuse=18.0.0-6863-g38499368-1jammy ceph-test=18.0.0-6863-g38499368-1jammy ceph-volume=18.0.0-6863-g38499368-1jammy radosgw=18.0.0-6863-g38499368-1jammy python3-rados=18.0.0-6863-g38499368-1jammy python3-rgw=18.0.0-6863-g38499368-1jammy python3-cephfs=18.0.0-6863-g38499368-1jammy python3-rbd=18.0.0-6863-g38499368-1jammy libcephfs2=18.0.0-6863-g38499368-1jammy libcephfs-dev=18.0.0-6863-g38499368-1jammy librados2=18.0.0-6863-g38499368-1jammy librbd1=18.0.0-6863-g38499368-1jammy rbd-fuse=18.0.0-6863-g38499368-1jammy python3-cephfs=18.0.0-6863-g38499368-1jammy cephfs-shell=18.0.0-6863-g38499368-1jammy cephfs-top=18.0.0-6863-g38499368-1jammy cephfs-mirror=18.0.0-6863-g38499368-1jammy 2023-10-25T16:09:59.195 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T16:09:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T16:09:59.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6863-g38499368-1jammy cephadm=18.0.0-6863-g38499368-1jammy ceph-mds=18.0.0-6863-g38499368-1jammy ceph-mgr=18.0.0-6863-g38499368-1jammy ceph-common=18.0.0-6863-g38499368-1jammy ceph-fuse=18.0.0-6863-g38499368-1jammy ceph-test=18.0.0-6863-g38499368-1jammy ceph-volume=18.0.0-6863-g38499368-1jammy radosgw=18.0.0-6863-g38499368-1jammy python3-rados=18.0.0-6863-g38499368-1jammy python3-rgw=18.0.0-6863-g38499368-1jammy python3-cephfs=18.0.0-6863-g38499368-1jammy python3-rbd=18.0.0-6863-g38499368-1jammy libcephfs2=18.0.0-6863-g38499368-1jammy libcephfs-dev=18.0.0-6863-g38499368-1jammy librados2=18.0.0-6863-g38499368-1jammy librbd1=18.0.0-6863-g38499368-1jammy rbd-fuse=18.0.0-6863-g38499368-1jammy python3-cephfs=18.0.0-6863-g38499368-1jammy cephfs-shell=18.0.0-6863-g38499368-1jammy cephfs-top=18.0.0-6863-g38499368-1jammy cephfs-mirror=18.0.0-6863-g38499368-1jammy 2023-10-25T16:09:59.264 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T16:09:59.369 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-10-25T16:09:59.370 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-10-25T16:09:59.431 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2023-10-25T16:09:59.432 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2023-10-25T16:09:59.516 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T16:09:59.517 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T16:09:59.517 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T16:09:59.517 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T16:09:59.518 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-25T16:09:59.518 INFO:teuthology.orchestra.run.smithi184.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-25T16:09:59.518 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T16:09:59.519 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-10-25T16:09:59.520 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-25T16:09:59.520 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-25T16:09:59.520 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-25T16:09:59.520 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-25T16:09:59.521 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-25T16:09:59.521 INFO:teuthology.orchestra.run.smithi184.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-25T16:09:59.521 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-25T16:09:59.521 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-25T16:09:59.522 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-25T16:09:59.522 INFO:teuthology.orchestra.run.smithi184.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-25T16:09:59.522 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-25T16:09:59.522 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-25T16:09:59.523 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-25T16:09:59.523 INFO:teuthology.orchestra.run.smithi184.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-25T16:09:59.523 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-25T16:09:59.523 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-25T16:09:59.523 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-25T16:09:59.524 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-25T16:09:59.524 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-25T16:09:59.524 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-25T16:09:59.524 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-25T16:09:59.524 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-25T16:09:59.525 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-25T16:09:59.525 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-10-25T16:09:59.525 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-25T16:09:59.525 INFO:teuthology.orchestra.run.smithi184.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-25T16:09:59.526 INFO:teuthology.orchestra.run.smithi184.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-25T16:09:59.526 INFO:teuthology.orchestra.run.smithi184.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-25T16:09:59.526 INFO:teuthology.orchestra.run.smithi184.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-25T16:09:59.526 INFO:teuthology.orchestra.run.smithi184.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-25T16:09:59.527 INFO:teuthology.orchestra.run.smithi184.stdout: python3-watchdog 2023-10-25T16:09:59.527 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2023-10-25T16:09:59.527 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2023-10-25T16:09:59.583 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T16:09:59.583 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T16:09:59.583 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T16:09:59.583 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T16:09:59.584 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-25T16:09:59.585 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-25T16:09:59.585 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T16:09:59.586 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2023-10-25T16:09:59.586 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-25T16:09:59.586 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-25T16:09:59.586 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-25T16:09:59.587 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-25T16:09:59.587 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-25T16:09:59.587 INFO:teuthology.orchestra.run.smithi177.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-25T16:09:59.587 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-25T16:09:59.587 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-25T16:09:59.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-10-25T16:09:59.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-25T16:09:59.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-25T16:09:59.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-25T16:09:59.588 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-25T16:09:59.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-25T16:09:59.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-25T16:09:59.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-25T16:09:59.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-10-25T16:09:59.589 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-10-25T16:09:59.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-10-25T16:09:59.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-10-25T16:09:59.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-10-25T16:09:59.590 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-10-25T16:09:59.591 INFO:teuthology.orchestra.run.smithi177.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-25T16:09:59.591 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2023-10-25T16:09:59.591 INFO:teuthology.orchestra.run.smithi177.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-25T16:09:59.592 INFO:teuthology.orchestra.run.smithi177.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-25T16:09:59.592 INFO:teuthology.orchestra.run.smithi177.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-25T16:09:59.592 INFO:teuthology.orchestra.run.smithi177.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-25T16:09:59.592 INFO:teuthology.orchestra.run.smithi177.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-25T16:09:59.592 INFO:teuthology.orchestra.run.smithi177.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-25T16:09:59.593 INFO:teuthology.orchestra.run.smithi177.stdout: python3-watchdog 2023-10-25T16:09:59.593 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2023-10-25T16:09:59.593 INFO:teuthology.orchestra.run.smithi177.stdout: btrfs-tools 2023-10-25T16:09:59.618 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-10-25T16:09:59.619 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-25T16:09:59.619 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-25T16:09:59.619 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-25T16:09:59.620 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-25T16:09:59.620 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-25T16:09:59.620 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-25T16:09:59.620 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-25T16:09:59.621 INFO:teuthology.orchestra.run.smithi184.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-25T16:09:59.621 INFO:teuthology.orchestra.run.smithi184.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-25T16:09:59.622 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-25T16:09:59.622 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-25T16:09:59.622 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-25T16:09:59.622 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-25T16:09:59.623 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-25T16:09:59.623 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-25T16:09:59.623 INFO:teuthology.orchestra.run.smithi184.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-25T16:09:59.623 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-25T16:09:59.623 INFO:teuthology.orchestra.run.smithi184.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-25T16:09:59.624 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-25T16:09:59.624 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-25T16:09:59.624 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-25T16:09:59.624 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-25T16:09:59.624 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-25T16:09:59.625 INFO:teuthology.orchestra.run.smithi184.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-25T16:09:59.625 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-25T16:09:59.625 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-25T16:09:59.625 INFO:teuthology.orchestra.run.smithi184.stdout: socat xmlstarlet 2023-10-25T16:09:59.684 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2023-10-25T16:09:59.685 INFO:teuthology.orchestra.run.smithi177.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-25T16:09:59.685 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-25T16:09:59.685 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-25T16:09:59.685 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-10-25T16:09:59.685 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-25T16:09:59.686 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-10-25T16:09:59.686 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-25T16:09:59.687 INFO:teuthology.orchestra.run.smithi177.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-25T16:09:59.687 INFO:teuthology.orchestra.run.smithi177.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-25T16:09:59.687 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-25T16:09:59.688 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-10-25T16:09:59.688 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-10-25T16:09:59.688 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-25T16:09:59.688 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-25T16:09:59.689 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-25T16:09:59.689 INFO:teuthology.orchestra.run.smithi177.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-25T16:09:59.689 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-25T16:09:59.689 INFO:teuthology.orchestra.run.smithi177.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-25T16:09:59.689 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-10-25T16:09:59.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-25T16:09:59.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-25T16:09:59.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-25T16:09:59.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-25T16:09:59.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-25T16:09:59.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-25T16:09:59.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-25T16:09:59.691 INFO:teuthology.orchestra.run.smithi177.stdout: socat xmlstarlet 2023-10-25T16:09:59.754 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 115 newly installed, 0 to remove and 257 not upgraded. 2023-10-25T16:09:59.755 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 184 MB of archives. 2023-10-25T16:09:59.755 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 826 MB of additional disk space will be used. 2023-10-25T16:09:59.755 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-25T16:09:59.775 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-25T16:09:59.787 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-25T16:09:59.834 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-25T16:09:59.845 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-25T16:09:59.864 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-25T16:09:59.870 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-25T16:09:59.878 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-25T16:09:59.931 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-25T16:09:59.935 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-25T16:09:59.946 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-25T16:09:59.950 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-25T16:09:59.951 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-25T16:09:59.958 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-25T16:09:59.959 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-25T16:09:59.959 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-25T16:09:59.960 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-25T16:09:59.961 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-25T16:09:59.975 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-25T16:09:59.976 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-25T16:09:59.976 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-25T16:09:59.976 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-25T16:09:59.983 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 115 newly installed, 0 to remove and 257 not upgraded. 2023-10-25T16:09:59.983 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 184 MB of archives. 2023-10-25T16:09:59.984 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 826 MB of additional disk space will be used. 2023-10-25T16:09:59.984 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6863-g38499368-1jammy [3,437 kB] 2023-10-25T16:09:59.994 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-25T16:09:59.998 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-25T16:09:59.998 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-25T16:09:59.999 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-25T16:09:59.999 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-25T16:09:59.999 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-25T16:10:00.014 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-25T16:10:00.014 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-25T16:10:00.015 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-25T16:10:00.016 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-25T16:10:00.034 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-25T16:10:00.039 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-25T16:10:00.040 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-25T16:10:00.040 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-25T16:10:00.041 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-25T16:10:00.042 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-25T16:10:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-25T16:10:00.054 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-25T16:10:00.056 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-25T16:10:00.056 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-25T16:10:00.073 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-25T16:10:00.074 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-25T16:10:00.076 INFO:teuthology.orchestra.run.smithi177.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-25T16:10:00.135 INFO:teuthology.orchestra.run.smithi177.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-25T16:10:00.136 INFO:teuthology.orchestra.run.smithi177.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-25T16:10:00.138 INFO:teuthology.orchestra.run.smithi177.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-25T16:10:00.139 INFO:teuthology.orchestra.run.smithi177.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-25T16:10:00.139 INFO:teuthology.orchestra.run.smithi177.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-25T16:10:00.140 INFO:teuthology.orchestra.run.smithi177.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-25T16:10:00.148 INFO:teuthology.orchestra.run.smithi177.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6863-g38499368-1jammy [3,437 kB] 2023-10-25T16:10:00.165 INFO:teuthology.orchestra.run.smithi177.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-25T16:10:00.169 INFO:teuthology.orchestra.run.smithi177.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-25T16:10:00.170 INFO:teuthology.orchestra.run.smithi177.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-25T16:10:00.190 INFO:teuthology.orchestra.run.smithi177.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-25T16:10:00.191 INFO:teuthology.orchestra.run.smithi177.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-25T16:10:00.191 INFO:teuthology.orchestra.run.smithi177.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-25T16:10:00.192 INFO:teuthology.orchestra.run.smithi177.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-25T16:10:00.192 INFO:teuthology.orchestra.run.smithi177.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-25T16:10:00.202 INFO:teuthology.orchestra.run.smithi177.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-25T16:10:00.203 INFO:teuthology.orchestra.run.smithi177.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-25T16:10:00.203 INFO:teuthology.orchestra.run.smithi177.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-25T16:10:00.207 INFO:teuthology.orchestra.run.smithi177.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-25T16:10:00.222 INFO:teuthology.orchestra.run.smithi177.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-25T16:10:00.224 INFO:teuthology.orchestra.run.smithi177.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-25T16:10:00.225 INFO:teuthology.orchestra.run.smithi177.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-25T16:10:00.228 INFO:teuthology.orchestra.run.smithi177.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-25T16:10:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-25T16:10:00.232 INFO:teuthology.orchestra.run.smithi177.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-25T16:10:00.244 INFO:teuthology.orchestra.run.smithi177.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-25T16:10:00.248 INFO:teuthology.orchestra.run.smithi177.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-25T16:10:00.248 INFO:teuthology.orchestra.run.smithi177.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-25T16:10:00.249 INFO:teuthology.orchestra.run.smithi177.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-25T16:10:00.264 INFO:teuthology.orchestra.run.smithi177.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-25T16:10:00.266 INFO:teuthology.orchestra.run.smithi177.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-25T16:10:00.267 INFO:teuthology.orchestra.run.smithi177.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-25T16:10:00.275 INFO:teuthology.orchestra.run.smithi177.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-25T16:10:00.275 INFO:teuthology.orchestra.run.smithi177.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-25T16:10:00.276 INFO:teuthology.orchestra.run.smithi177.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-25T16:10:00.284 INFO:teuthology.orchestra.run.smithi177.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-25T16:10:00.284 INFO:teuthology.orchestra.run.smithi177.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-25T16:10:00.522 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6863-g38499368-1jammy [3,129 kB] 2023-10-25T16:10:00.678 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6863-g38499368-1jammy [689 kB] 2023-10-25T16:10:00.734 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6863-g38499368-1jammy [356 kB] 2023-10-25T16:10:00.745 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6863-g38499368-1jammy [32.8 kB] 2023-10-25T16:10:00.746 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6863-g38499368-1jammy [180 kB] 2023-10-25T16:10:00.752 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6863-g38499368-1jammy [62.3 kB] 2023-10-25T16:10:00.754 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6863-g38499368-1jammy [330 kB] 2023-10-25T16:10:00.765 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6863-g38499368-1jammy [6,222 kB] 2023-10-25T16:10:01.010 INFO:teuthology.orchestra.run.smithi177.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6863-g38499368-1jammy [3,129 kB] 2023-10-25T16:10:01.052 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6863-g38499368-1jammy [112 kB] 2023-10-25T16:10:01.055 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6863-g38499368-1jammy [439 kB] 2023-10-25T16:10:01.089 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6863-g38499368-1jammy [22.6 MB] 2023-10-25T16:10:01.487 INFO:teuthology.orchestra.run.smithi177.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6863-g38499368-1jammy [689 kB] 2023-10-25T16:10:01.503 INFO:teuthology.orchestra.run.smithi177.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6863-g38499368-1jammy [356 kB] 2023-10-25T16:10:01.565 INFO:teuthology.orchestra.run.smithi177.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6863-g38499368-1jammy [32.8 kB] 2023-10-25T16:10:01.566 INFO:teuthology.orchestra.run.smithi177.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6863-g38499368-1jammy [180 kB] 2023-10-25T16:10:01.595 INFO:teuthology.orchestra.run.smithi177.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6863-g38499368-1jammy [62.3 kB] 2023-10-25T16:10:01.602 INFO:teuthology.orchestra.run.smithi177.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6863-g38499368-1jammy [330 kB] 2023-10-25T16:10:01.659 INFO:teuthology.orchestra.run.smithi177.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6863-g38499368-1jammy [6,222 kB] 2023-10-25T16:10:02.211 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6863-g38499368-1jammy [6,859 kB] 2023-10-25T16:10:02.460 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6863-g38499368-1jammy [238 kB] 2023-10-25T16:10:02.469 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6863-g38499368-1jammy [129 kB] 2023-10-25T16:10:02.474 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6863-g38499368-1jammy [1,497 kB] 2023-10-25T16:10:02.540 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6863-g38499368-1jammy [9,892 kB] 2023-10-25T16:10:02.659 INFO:teuthology.orchestra.run.smithi177.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6863-g38499368-1jammy [112 kB] 2023-10-25T16:10:02.663 INFO:teuthology.orchestra.run.smithi177.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6863-g38499368-1jammy [439 kB] 2023-10-25T16:10:02.734 INFO:teuthology.orchestra.run.smithi177.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6863-g38499368-1jammy [22.6 MB] 2023-10-25T16:10:02.982 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6863-g38499368-1jammy [31.7 MB] 2023-10-25T16:10:04.504 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6863-g38499368-1jammy [14.0 kB] 2023-10-25T16:10:04.504 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6863-g38499368-1jammy [840 kB] 2023-10-25T16:10:04.520 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6863-g38499368-1jammy [2,150 kB] 2023-10-25T16:10:04.559 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6863-g38499368-1jammy [284 kB] 2023-10-25T16:10:04.563 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6863-g38499368-1jammy [138 kB] 2023-10-25T16:10:04.566 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6863-g38499368-1jammy [1,907 kB] 2023-10-25T16:10:04.592 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6863-g38499368-1jammy [8,625 kB] 2023-10-25T16:10:04.987 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6863-g38499368-1jammy [14.2 kB] 2023-10-25T16:10:04.988 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6863-g38499368-1jammy [47.8 MB] 2023-10-25T16:10:05.742 INFO:teuthology.orchestra.run.smithi177.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6863-g38499368-1jammy [6,859 kB] 2023-10-25T16:10:06.482 INFO:teuthology.orchestra.run.smithi177.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6863-g38499368-1jammy [238 kB] 2023-10-25T16:10:06.510 INFO:teuthology.orchestra.run.smithi177.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6863-g38499368-1jammy [129 kB] 2023-10-25T16:10:06.520 INFO:teuthology.orchestra.run.smithi177.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6863-g38499368-1jammy [1,497 kB] 2023-10-25T16:10:06.695 INFO:teuthology.orchestra.run.smithi177.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6863-g38499368-1jammy [9,892 kB] 2023-10-25T16:10:07.417 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6863-g38499368-1jammy [120 kB] 2023-10-25T16:10:07.420 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6863-g38499368-1jammy [227 kB] 2023-10-25T16:10:07.424 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6863-g38499368-1jammy [34.0 kB] 2023-10-25T16:10:07.425 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6863-g38499368-1jammy [23.4 kB] 2023-10-25T16:10:07.426 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6863-g38499368-1jammy [38.3 kB] 2023-10-25T16:10:07.427 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6863-g38499368-1jammy [12.3 MB] 2023-10-25T16:10:07.523 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-10-25T16:10:07.542 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-25T16:10:07.552 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-10-25T16:10:07.593 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-25T16:10:07.602 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-25T16:10:07.618 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-25T16:10:07.621 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-25T16:10:07.631 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-25T16:10:07.686 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-25T16:10:07.690 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-25T16:10:07.701 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-25T16:10:07.704 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-25T16:10:07.705 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-25T16:10:07.712 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-25T16:10:07.713 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-25T16:10:07.713 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-25T16:10:07.714 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-25T16:10:07.715 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-25T16:10:07.720 INFO:teuthology.orchestra.run.smithi177.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6863-g38499368-1jammy [31.7 MB] 2023-10-25T16:10:07.723 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-25T16:10:07.724 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-25T16:10:07.740 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-25T16:10:07.741 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-25T16:10:07.741 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-25T16:10:07.747 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-25T16:10:07.747 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-25T16:10:07.747 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-25T16:10:07.747 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-25T16:10:07.748 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-25T16:10:07.757 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-25T16:10:07.757 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-25T16:10:07.774 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-25T16:10:07.775 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-25T16:10:07.775 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-25T16:10:07.781 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-25T16:10:07.781 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-25T16:10:07.781 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-25T16:10:07.782 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-25T16:10:07.783 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-25T16:10:07.790 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-25T16:10:07.791 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-25T16:10:07.802 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-25T16:10:07.802 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-25T16:10:07.805 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-25T16:10:07.806 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-25T16:10:07.809 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-25T16:10:07.827 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6863-g38499368-1jammy [92.2 kB] 2023-10-25T16:10:07.860 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-25T16:10:07.913 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-25T16:10:07.913 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-25T16:10:07.914 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-25T16:10:07.915 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-25T16:10:07.915 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-25T16:10:07.932 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-25T16:10:07.934 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-25T16:10:07.934 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-25T16:10:07.949 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-25T16:10:07.950 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-25T16:10:07.950 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-25T16:10:07.951 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-25T16:10:07.951 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-25T16:10:07.951 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-25T16:10:07.964 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-25T16:10:07.964 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-25T16:10:07.967 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-25T16:10:07.981 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-25T16:10:07.982 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-25T16:10:07.982 INFO:teuthology.orchestra.run.smithi184.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-25T16:10:07.986 INFO:teuthology.orchestra.run.smithi184.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-25T16:10:07.989 INFO:teuthology.orchestra.run.smithi184.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-10-25T16:10:07.989 INFO:teuthology.orchestra.run.smithi184.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-25T16:10:07.993 INFO:teuthology.orchestra.run.smithi184.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-25T16:10:07.997 INFO:teuthology.orchestra.run.smithi184.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-25T16:10:07.998 INFO:teuthology.orchestra.run.smithi184.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-25T16:10:07.998 INFO:teuthology.orchestra.run.smithi184.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-25T16:10:08.014 INFO:teuthology.orchestra.run.smithi184.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-25T16:10:08.016 INFO:teuthology.orchestra.run.smithi184.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-25T16:10:08.017 INFO:teuthology.orchestra.run.smithi184.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-25T16:10:08.023 INFO:teuthology.orchestra.run.smithi184.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-25T16:10:08.023 INFO:teuthology.orchestra.run.smithi184.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-25T16:10:08.024 INFO:teuthology.orchestra.run.smithi184.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-25T16:10:08.025 INFO:teuthology.orchestra.run.smithi184.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-25T16:10:08.031 INFO:teuthology.orchestra.run.smithi184.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-25T16:10:08.596 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 184 MB in 8s (21.9 MB/s) 2023-10-25T16:10:08.707 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-25T16:10:08.777 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165984 files and directories currently installed.) 2023-10-25T16:10:08.782 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-25T16:10:08.823 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-25T16:10:09.084 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-25T16:10:09.099 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-25T16:10:09.134 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-25T16:10:09.445 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cmd2. 2023-10-25T16:10:09.471 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-25T16:10:09.511 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-25T16:10:09.646 INFO:teuthology.orchestra.run.smithi177.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6863-g38499368-1jammy [14.0 kB] 2023-10-25T16:10:09.647 INFO:teuthology.orchestra.run.smithi177.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6863-g38499368-1jammy [840 kB] 2023-10-25T16:10:09.664 INFO:teuthology.orchestra.run.smithi177.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6863-g38499368-1jammy [2,150 kB] 2023-10-25T16:10:09.831 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-25T16:10:09.857 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-25T16:10:09.940 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-25T16:10:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6863-g38499368-1jammy [284 kB] 2023-10-25T16:10:09.978 INFO:teuthology.orchestra.run.smithi177.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6863-g38499368-1jammy [138 kB] 2023-10-25T16:10:09.985 INFO:teuthology.orchestra.run.smithi177.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6863-g38499368-1jammy [1,907 kB] 2023-10-25T16:10:10.259 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-25T16:10:10.264 INFO:teuthology.orchestra.run.smithi177.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6863-g38499368-1jammy [8,625 kB] 2023-10-25T16:10:10.285 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-25T16:10:10.325 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-25T16:10:10.654 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-25T16:10:10.680 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-25T16:10:10.712 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-25T16:10:11.031 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-25T16:10:11.058 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-25T16:10:11.098 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-25T16:10:11.113 INFO:teuthology.orchestra.run.smithi177.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6863-g38499368-1jammy [14.2 kB] 2023-10-25T16:10:11.114 INFO:teuthology.orchestra.run.smithi177.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6863-g38499368-1jammy [47.8 MB] 2023-10-25T16:10:11.535 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-25T16:10:11.561 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-25T16:10:11.610 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:10:11.946 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-25T16:10:11.972 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-25T16:10:12.004 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:10:12.326 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-25T16:10:12.352 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-25T16:10:12.487 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:10:12.879 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-25T16:10:12.905 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-25T16:10:12.945 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-25T16:10:13.215 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librados2. 2023-10-25T16:10:13.230 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../011-librados2_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:13.282 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:13.726 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librbd1. 2023-10-25T16:10:13.752 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../012-librbd1_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:13.793 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:14.271 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2023-10-25T16:10:14.297 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:14.337 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:14.467 INFO:teuthology.orchestra.run.smithi177.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6863-g38499368-1jammy [120 kB] 2023-10-25T16:10:14.537 INFO:teuthology.orchestra.run.smithi177.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6863-g38499368-1jammy [227 kB] 2023-10-25T16:10:14.542 INFO:teuthology.orchestra.run.smithi177.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6863-g38499368-1jammy [34.0 kB] 2023-10-25T16:10:14.543 INFO:teuthology.orchestra.run.smithi177.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6863-g38499368-1jammy [23.4 kB] 2023-10-25T16:10:14.544 INFO:teuthology.orchestra.run.smithi177.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6863-g38499368-1jammy [38.3 kB] 2023-10-25T16:10:14.545 INFO:teuthology.orchestra.run.smithi177.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6863-g38499368-1jammy [12.3 MB] 2023-10-25T16:10:14.606 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2023-10-25T16:10:14.633 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:14.665 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:14.976 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-25T16:10:15.002 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:15.043 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:15.295 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2023-10-25T16:10:15.310 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:15.353 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:15.530 INFO:teuthology.orchestra.run.smithi177.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6863-g38499368-1jammy [92.2 kB] 2023-10-25T16:10:15.664 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-25T16:10:15.690 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:15.731 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:16.034 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2023-10-25T16:10:16.061 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-25T16:10:16.093 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-25T16:10:16.125 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 184 MB in 16s (11.6 MB/s) 2023-10-25T16:10:16.257 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-25T16:10:16.328 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2023-10-25T16:10:16.354 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165984 files and directories currently installed.) 2023-10-25T16:10:16.355 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:16.360 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-10-25T16:10:16.395 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:16.414 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-10-25T16:10:16.708 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-25T16:10:16.734 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-25T16:10:16.740 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-25T16:10:16.766 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-25T16:10:16.775 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-25T16:10:16.806 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-25T16:10:17.061 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cmd2. 2023-10-25T16:10:17.083 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-10-25T16:10:17.119 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-10-25T16:10:17.143 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2023-10-25T16:10:17.169 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../021-librgw2_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:17.209 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:17.405 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-25T16:10:17.420 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-25T16:10:17.488 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-25T16:10:17.825 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-25T16:10:17.851 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-25T16:10:17.853 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2023-10-25T16:10:17.880 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:17.891 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-25T16:10:17.912 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:18.236 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-25T16:10:18.256 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-25T16:10:18.262 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-25T16:10:18.283 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-25T16:10:18.303 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-25T16:10:18.323 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-25T16:10:18.618 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2023-10-25T16:10:18.622 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-25T16:10:18.644 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:18.648 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-25T16:10:18.684 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:18.689 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-25T16:10:19.037 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2023-10-25T16:10:19.064 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:19.096 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:19.101 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-25T16:10:19.127 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-25T16:10:19.176 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:10:19.570 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-25T16:10:19.596 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-25T16:10:19.637 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:10:19.948 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-25T16:10:19.974 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-25T16:10:20.015 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:10:20.351 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-25T16:10:20.378 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-25T16:10:20.385 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2023-10-25T16:10:20.411 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:20.417 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-25T16:10:20.461 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:20.737 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librados2. 2023-10-25T16:10:20.764 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../011-librados2_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:20.804 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librados2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:21.114 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-25T16:10:21.141 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-25T16:10:21.182 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-25T16:10:21.423 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librbd1. 2023-10-25T16:10:21.449 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../012-librbd1_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:21.489 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librbd1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:21.509 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cheroot. 2023-10-25T16:10:21.535 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-25T16:10:21.575 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-25T16:10:21.887 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-25T16:10:21.913 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-25T16:10:21.917 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs2. 2023-10-25T16:10:21.944 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:21.953 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-25T16:10:21.984 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:22.228 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rados. 2023-10-25T16:10:22.243 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:22.256 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-25T16:10:22.277 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rados (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:22.282 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-25T16:10:22.323 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-25T16:10:22.564 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-25T16:10:22.590 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:22.600 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-25T16:10:22.616 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-25T16:10:22.630 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-argparse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:22.650 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-25T16:10:22.866 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cephfs. 2023-10-25T16:10:22.881 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:22.924 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cephfs (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:22.937 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempora. 2023-10-25T16:10:22.963 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-25T16:10:23.003 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-25T16:10:23.235 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-25T16:10:23.262 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:23.301 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:23.306 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-portend. 2023-10-25T16:10:23.333 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-25T16:10:23.373 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-25T16:10:23.629 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-prettytable. 2023-10-25T16:10:23.634 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-25T16:10:23.656 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-10-25T16:10:23.660 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-25T16:10:23.696 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-25T16:10:23.701 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-25T16:10:23.949 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rbd. 2023-10-25T16:10:23.964 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:23.978 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-25T16:10:24.005 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-25T16:10:24.007 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rbd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:24.046 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-25T16:10:24.335 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-25T16:10:24.361 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-25T16:10:24.390 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-natsort. 2023-10-25T16:10:24.417 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-25T16:10:24.426 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-25T16:10:24.457 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-25T16:10:24.670 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librgw2. 2023-10-25T16:10:24.686 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../021-librgw2_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:24.720 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librgw2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:24.769 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2023-10-25T16:10:24.795 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-25T16:10:24.835 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-25T16:10:25.163 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-25T16:10:25.178 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-25T16:10:25.221 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-25T16:10:25.256 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rgw. 2023-10-25T16:10:25.283 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:25.323 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:25.474 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2023-10-25T16:10:25.486 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-25T16:10:25.532 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-25T16:10:25.659 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-25T16:10:25.685 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-25T16:10:25.725 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-25T16:10:25.852 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-25T16:10:25.879 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-25T16:10:25.919 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-25T16:10:26.011 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libradosstriper1. 2023-10-25T16:10:26.038 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:26.069 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libradosstriper1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:26.205 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-25T16:10:26.232 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-25T16:10:26.271 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-25T16:10:26.514 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-common. 2023-10-25T16:10:26.541 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:26.566 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2023-10-25T16:10:26.581 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:26.592 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-25T16:10:26.633 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-25T16:10:26.944 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2023-10-25T16:10:26.971 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-25T16:10:27.006 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-25T16:10:27.297 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2023-10-25T16:10:27.323 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-25T16:10:27.363 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-25T16:10:27.675 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2023-10-25T16:10:27.701 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-25T16:10:27.787 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-25T16:10:27.879 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-base. 2023-10-25T16:10:27.905 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:27.954 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-base (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:28.228 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-25T16:10:28.244 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-25T16:10:28.303 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-25T16:10:28.589 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-25T16:10:28.615 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-25T16:10:28.616 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-25T16:10:28.631 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-25T16:10:28.649 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-25T16:10:28.665 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-25T16:10:28.951 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2023-10-25T16:10:28.951 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cheroot. 2023-10-25T16:10:28.977 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-25T16:10:28.978 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-25T16:10:29.017 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-25T16:10:29.018 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-25T16:10:29.312 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-25T16:10:29.328 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-25T16:10:29.345 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2023-10-25T16:10:29.370 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-25T16:10:29.371 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-25T16:10:29.412 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-25T16:10:29.682 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-25T16:10:29.708 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-25T16:10:29.748 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-25T16:10:29.750 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-certifi. 2023-10-25T16:10:29.777 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-25T16:10:29.816 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-25T16:10:30.034 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-25T16:10:30.061 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-25T16:10:30.101 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-25T16:10:30.119 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-idna. 2023-10-25T16:10:30.146 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-25T16:10:30.186 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-25T16:10:30.370 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempora. 2023-10-25T16:10:30.386 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-10-25T16:10:30.420 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-25T16:10:30.497 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-urllib3. 2023-10-25T16:10:30.523 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-25T16:10:30.563 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-25T16:10:30.723 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-portend. 2023-10-25T16:10:30.750 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-10-25T16:10:30.790 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-25T16:10:30.892 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests. 2023-10-25T16:10:30.918 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-25T16:10:30.958 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-25T16:10:31.092 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-25T16:10:31.119 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-25T16:10:31.159 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-25T16:10:31.236 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-25T16:10:31.260 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-25T16:10:31.294 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-25T16:10:31.436 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-25T16:10:31.452 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-25T16:10:31.486 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-25T16:10:31.589 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-25T16:10:31.616 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:31.656 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:31.840 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-natsort. 2023-10-25T16:10:31.867 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-10-25T16:10:31.906 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-25T16:10:32.044 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-25T16:10:32.071 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:32.136 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:32.217 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-logutils. 2023-10-25T16:10:32.233 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-10-25T16:10:32.276 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-25T16:10:32.438 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2023-10-25T16:10:32.465 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-25T16:10:32.505 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-25T16:10:32.553 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-25T16:10:32.569 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-25T16:10:32.603 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-25T16:10:32.816 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2023-10-25T16:10:32.839 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-mako. 2023-10-25T16:10:32.843 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:32.854 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-25T16:10:32.875 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-25T16:10:33.209 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-25T16:10:33.235 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-25T16:10:33.276 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-25T16:10:33.528 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-25T16:10:33.555 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-25T16:10:33.595 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-25T16:10:33.897 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webob. 2023-10-25T16:10:33.924 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-25T16:10:33.964 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-25T16:10:33.987 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2023-10-25T16:10:34.014 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:34.053 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:34.292 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-waitress. 2023-10-25T16:10:34.318 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-25T16:10:34.361 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-25T16:10:34.670 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempita. 2023-10-25T16:10:34.696 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-25T16:10:34.736 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-25T16:10:34.965 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2023-10-25T16:10:34.994 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:35.030 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-paste. 2023-10-25T16:10:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:35.057 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-25T16:10:35.097 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-25T16:10:35.442 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-25T16:10:35.469 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-25T16:10:35.508 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-25T16:10:35.811 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-25T16:10:35.838 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-25T16:10:35.878 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-25T16:10:36.139 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webtest. 2023-10-25T16:10:36.165 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-10-25T16:10:36.197 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-25T16:10:36.633 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pecan. 2023-10-25T16:10:36.660 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-25T16:10:36.700 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-25T16:10:36.835 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2023-10-25T16:10:36.850 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../061-ceph_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:36.885 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:37.046 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-certifi. 2023-10-25T16:10:37.072 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-10-25T16:10:37.112 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-25T16:10:37.204 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2023-10-25T16:10:37.231 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:37.271 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:37.447 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-idna. 2023-10-25T16:10:37.473 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-10-25T16:10:37.515 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-25T16:10:37.633 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2023-10-25T16:10:37.659 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:37.708 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:37.818 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-urllib3. 2023-10-25T16:10:37.844 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-25T16:10:37.884 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-25T16:10:38.186 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2023-10-25T16:10:38.212 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests. 2023-10-25T16:10:38.213 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../064-cephadm_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:38.239 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-25T16:10:38.244 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:38.279 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-25T16:10:38.555 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-25T16:10:38.574 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-25T16:10:38.581 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-25T16:10:38.600 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-25T16:10:38.621 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-25T16:10:38.640 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-25T16:10:38.899 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-25T16:10:38.915 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-25T16:10:38.917 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-25T16:10:38.933 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:38.966 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-25T16:10:38.976 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:39.339 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-25T16:10:39.365 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:39.405 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:39.725 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-openssl. 2023-10-25T16:10:39.751 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-10-25T16:10:39.794 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-25T16:10:40.013 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-babel. 2023-10-25T16:10:40.041 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-25T16:10:40.079 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-25T16:10:40.119 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr. 2023-10-25T16:10:40.146 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:40.185 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:40.399 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2023-10-25T16:10:40.426 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-25T16:10:40.466 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-25T16:10:40.505 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mon. 2023-10-25T16:10:40.532 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:40.563 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mon (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:40.794 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-25T16:10:40.821 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:40.861 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:41.181 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-25T16:10:41.196 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-25T16:10:41.231 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-25T16:10:41.450 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-osd. 2023-10-25T16:10:41.477 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:41.500 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-25T16:10:41.516 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-osd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:41.527 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-25T16:10:41.567 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-25T16:10:41.853 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2023-10-25T16:10:41.880 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-25T16:10:41.920 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-25T16:10:42.257 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-25T16:10:42.283 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:42.323 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:42.727 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-25T16:10:42.753 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-25T16:10:42.793 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-25T16:10:43.298 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2023-10-25T16:10:43.320 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph. 2023-10-25T16:10:43.324 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-25T16:10:43.347 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../061-ceph_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:43.363 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-25T16:10:43.378 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:43.672 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-fuse. 2023-10-25T16:10:43.675 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-25T16:10:43.691 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-25T16:10:43.699 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:43.725 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-25T16:10:43.738 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:44.012 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2023-10-25T16:10:44.038 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-25T16:10:44.078 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-25T16:10:44.109 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mds. 2023-10-25T16:10:44.136 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:44.175 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mds (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:44.545 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephadm. 2023-10-25T16:10:44.572 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../064-cephadm_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:44.611 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:44.754 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-25T16:10:44.782 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:44.820 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:44.880 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-25T16:10:44.896 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-25T16:10:44.930 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-25T16:10:45.250 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-25T16:10:45.266 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-25T16:10:45.308 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-25T16:10:45.757 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2023-10-25T16:10:45.784 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-25T16:10:45.815 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-25T16:10:46.101 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-25T16:10:46.128 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-25T16:10:46.168 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-25T16:10:46.371 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-babel. 2023-10-25T16:10:46.387 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-25T16:10:46.421 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-25T16:10:46.513 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-25T16:10:46.540 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-25T16:10:46.587 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-25T16:10:46.716 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jinja2. 2023-10-25T16:10:46.731 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-10-25T16:10:46.766 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-25T16:10:46.882 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2023-10-25T16:10:46.910 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-25T16:10:46.949 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-25T16:10:47.244 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-25T16:10:47.271 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:47.302 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:47.354 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2023-10-25T16:10:47.382 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-25T16:10:47.421 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-25T16:10:47.589 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-25T16:10:47.604 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-25T16:10:47.638 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-25T16:10:47.732 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-25T16:10:47.760 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-25T16:10:47.790 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-25T16:10:47.925 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-25T16:10:47.951 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-10-25T16:10:47.991 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-25T16:10:48.085 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2023-10-25T16:10:48.113 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-25T16:10:48.152 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-25T16:10:48.278 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-routes. 2023-10-25T16:10:48.304 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-25T16:10:48.344 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-25T16:10:48.689 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-25T16:10:48.714 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-25T16:10:48.715 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:48.740 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-25T16:10:48.755 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:48.780 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-25T16:10:49.219 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-25T16:10:49.246 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-25T16:10:49.286 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-25T16:10:49.444 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-25T16:10:49.472 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:49.502 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:49.747 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-joblib. 2023-10-25T16:10:49.774 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-25T16:10:49.813 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-25T16:10:49.814 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-25T16:10:49.841 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-25T16:10:49.880 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-25T16:10:50.159 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-25T16:10:50.187 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-25T16:10:50.225 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-25T16:10:50.226 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-25T16:10:50.252 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-25T16:10:50.291 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-25T16:10:50.528 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn. 2023-10-25T16:10:50.544 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2023-10-25T16:10:50.555 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-25T16:10:50.560 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-25T16:10:50.594 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-25T16:10:50.594 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-25T16:10:50.796 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2023-10-25T16:10:50.812 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-25T16:10:50.854 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-25T16:10:51.149 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2023-10-25T16:10:51.165 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-25T16:10:51.207 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-25T16:10:51.228 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-25T16:10:51.244 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:51.278 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:51.683 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2023-10-25T16:10:51.710 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:51.789 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:52.206 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cachetools. 2023-10-25T16:10:52.233 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-10-25T16:10:52.272 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-25T16:10:52.583 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-25T16:10:52.611 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-25T16:10:52.649 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-25T16:10:52.986 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-25T16:10:53.013 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-25T16:10:53.053 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-25T16:10:53.364 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rsa. 2023-10-25T16:10:53.391 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-10-25T16:10:53.430 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-25T16:10:53.811 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-google-auth. 2023-10-25T16:10:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-10-25T16:10:53.868 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-25T16:10:54.051 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-volume. 2023-10-25T16:10:54.079 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:54.118 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-volume (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:54.172 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-25T16:10:54.199 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-25T16:10:54.238 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-25T16:10:54.447 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-25T16:10:54.475 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:54.513 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-mirror (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:54.532 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-websocket. 2023-10-25T16:10:54.560 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-10-25T16:10:54.599 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-25T16:10:54.800 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-colorama. 2023-10-25T16:10:54.828 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-25T16:10:54.867 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-25T16:10:54.911 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-25T16:10:54.938 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-25T16:10:54.969 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-25T16:10:55.119 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-shell. 2023-10-25T16:10:55.147 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:55.186 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-shell (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:55.439 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-top. 2023-10-25T16:10:55.467 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:55.505 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-top (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:55.624 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-25T16:10:55.652 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:10:55.690 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:55.750 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-25T16:10:55.777 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:55.816 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:56.027 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-25T16:10:56.054 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-25T16:10:56.094 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-25T16:10:56.187 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2023-10-25T16:10:56.214 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-25T16:10:56.253 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-25T16:10:56.379 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-25T16:10:56.395 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-25T16:10:56.429 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-25T16:10:56.574 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-25T16:10:56.590 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-25T16:10:56.632 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-25T16:10:56.828 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package jq. 2023-10-25T16:10:56.855 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-25T16:10:56.898 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-25T16:10:57.044 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-25T16:10:57.072 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-25T16:10:57.111 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-25T16:10:57.151 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package socat. 2023-10-25T16:10:57.178 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-25T16:10:57.217 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-25T16:10:57.430 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2023-10-25T16:10:57.457 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-25T16:10:57.488 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-25T16:10:57.537 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package xmlstarlet. 2023-10-25T16:10:57.554 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-25T16:10:57.595 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-25T16:10:57.792 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2023-10-25T16:10:57.819 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-25T16:10:57.858 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-25T16:10:57.932 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-test. 2023-10-25T16:10:57.960 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:10:57.999 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-test (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:10:58.178 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2023-10-25T16:10:58.205 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-25T16:10:58.244 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-25T16:10:58.564 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2023-10-25T16:10:58.592 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-25T16:10:58.630 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-25T16:10:58.942 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pygments. 2023-10-25T16:10:58.970 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-25T16:10:59.009 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-25T16:10:59.430 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-25T16:10:59.457 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-25T16:10:59.488 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-25T16:10:59.766 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-toml. 2023-10-25T16:10:59.793 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-25T16:10:59.832 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-25T16:11:00.135 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2023-10-25T16:11:00.162 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-25T16:11:00.201 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-25T16:11:00.253 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-volume. 2023-10-25T16:11:00.281 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:11:00.319 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-volume (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:00.513 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2023-10-25T16:11:00.541 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-25T16:11:00.579 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-25T16:11:00.690 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-25T16:11:00.718 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:11:00.756 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-mirror (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:00.874 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-25T16:11:00.898 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-25T16:11:00.932 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-25T16:11:01.060 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-colorama. 2023-10-25T16:11:01.087 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-10-25T16:11:01.126 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-10-25T16:11:01.345 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-shell. 2023-10-25T16:11:01.362 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:11:01.395 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-shell (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:01.640 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-top. 2023-10-25T16:11:01.653 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2023-10-25T16:11:01.655 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6863-g38499368-1jammy_all.deb ... 2023-10-25T16:11:01.681 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../113-radosgw_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:11:01.697 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-top (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:01.719 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:01.951 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-25T16:11:01.966 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:11:02.009 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs-dev (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:02.379 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package nvme-cli. 2023-10-25T16:11:02.406 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-25T16:11:02.431 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2023-10-25T16:11:02.444 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:11:02.445 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-25T16:11:02.481 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:02.776 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-25T16:11:03.033 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-25T16:11:03.035 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-25T16:11:03.061 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-25T16:11:03.099 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-25T16:11:03.162 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-25T16:11:03.427 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-25T16:11:03.511 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-25T16:11:03.538 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-25T16:11:03.594 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-25T16:11:03.784 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-25T16:11:03.896 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastescript. 2023-10-25T16:11:03.912 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-10-25T16:11:03.954 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-25T16:11:04.247 INFO:teuthology.orchestra.run.smithi184.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-25T16:11:04.257 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pluggy. 2023-10-25T16:11:04.274 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-25T16:11:04.308 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-25T16:11:04.364 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:04.552 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-psutil. 2023-10-25T16:11:04.568 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-25T16:11:04.610 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-25T16:11:04.856 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2023-10-25T16:11:04.913 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-py. 2023-10-25T16:11:04.940 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-10-25T16:11:04.979 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-25T16:11:05.020 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-25T16:11:05.266 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pygments. 2023-10-25T16:11:05.281 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-25T16:11:05.296 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-25T16:11:05.315 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-25T16:11:05.548 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-25T16:11:05.674 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-25T16:11:05.745 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-25T16:11:05.761 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-25T16:11:05.803 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-25T16:11:05.925 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-25T16:11:06.114 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-toml. 2023-10-25T16:11:06.141 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-10-25T16:11:06.180 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-25T16:11:06.184 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-25T16:11:06.319 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-25T16:11:06.483 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pytest. 2023-10-25T16:11:06.510 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-25T16:11:06.549 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-25T16:11:06.613 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-25T16:11:06.886 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplejson. 2023-10-25T16:11:06.913 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-25T16:11:06.952 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-25T16:11:06.973 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-25T16:11:07.205 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-25T16:11:07.221 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-25T16:11:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-25T16:11:07.263 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-25T16:11:07.458 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-25T16:11:07.726 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-25T16:11:07.994 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-25T16:11:08.250 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package radosgw. 2023-10-25T16:11:08.262 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-25T16:11:08.279 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../113-radosgw_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:11:08.319 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking radosgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:08.588 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:08.856 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-25T16:11:08.957 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-25T16:11:09.053 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-fuse. 2023-10-25T16:11:09.069 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6863-g38499368-1jammy_amd64.deb ... 2023-10-25T16:11:09.111 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:09.191 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-25T16:11:09.415 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-25T16:11:09.442 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-25T16:11:09.568 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-25T16:11:09.666 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-25T16:11:09.775 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-25T16:11:09.961 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-25T16:11:10.024 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-25T16:11:10.070 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-25T16:11:10.322 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-25T16:11:10.400 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-25T16:11:10.589 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-25T16:11:10.860 INFO:teuthology.orchestra.run.smithi177.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-25T16:11:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-25T16:11:10.927 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user cephadm....done 2023-10-25T16:11:11.551 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-25T16:11:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-25T16:11:11.802 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-25T16:11:11.901 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-25T16:11:11.928 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-25T16:11:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-25T16:11:12.143 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-25T16:11:12.261 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-25T16:11:12.347 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-25T16:11:12.520 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-25T16:11:12.740 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-25T16:11:12.771 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-25T16:11:12.889 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-25T16:11:12.966 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-25T16:11:13.199 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-25T16:11:13.342 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-25T16:11:13.551 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-25T16:11:13.644 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-25T16:11:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-10-25T16:11:13.945 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-25T16:11:14.053 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-25T16:11:14.296 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-25T16:11:14.312 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-25T16:11:14.546 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-25T16:11:14.547 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-25T16:11:14.665 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:14.797 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-25T16:11:14.941 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-idna (3.3-1) ... 2023-10-25T16:11:15.049 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-argparse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:15.259 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-25T16:11:15.458 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-25T16:11:15.584 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-10-25T16:11:15.835 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-25T16:11:16.078 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-25T16:11:16.212 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-25T16:11:16.440 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:11:16.572 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-25T16:11:16.574 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-25T16:11:16.731 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-25T16:11:16.825 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-25T16:11:16.951 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-25T16:11:16.991 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-25T16:11:17.086 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-25T16:11:17.258 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-25T16:11:17.371 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-25T16:11:17.551 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-25T16:11:17.622 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-25T16:11:17.856 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:11:17.982 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-25T16:11:18.108 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-25T16:11:18.245 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-25T16:11:18.418 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-25T16:11:18.496 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-25T16:11:18.605 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-25T16:11:18.669 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-25T16:11:18.722 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-25T16:11:18.929 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-25T16:11:19.015 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-25T16:11:19.163 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-25T16:11:19.400 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-25T16:11:19.414 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-25T16:11:19.643 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-25T16:11:19.682 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-25T16:11:19.816 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-25T16:11:20.011 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-25T16:11:20.101 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-25T16:11:20.235 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-25T16:11:20.295 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-10-25T16:11:20.520 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-25T16:11:20.588 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-25T16:11:20.813 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-25T16:11:20.931 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-25T16:11:21.055 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-25T16:11:21.198 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-25T16:11:21.324 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:21.436 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-25T16:11:21.617 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-idna (3.3-1) ... 2023-10-25T16:11:21.683 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-25T16:11:21.809 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-25T16:11:21.918 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-25T16:11:22.211 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-25T16:11:22.479 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-25T16:11:22.713 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:11:22.839 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-25T16:11:23.090 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:11:23.173 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-25T16:11:23.233 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-25T16:11:23.466 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-25T16:11:23.476 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-25T16:11:23.751 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-25T16:11:23.844 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-25T16:11:23.885 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-25T16:11:23.961 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-25T16:11:24.153 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-25T16:11:24.246 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-25T16:11:24.396 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-25T16:11:24.488 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-25T16:11:24.647 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-25T16:11:24.731 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:11:24.857 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-25T16:11:24.983 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-25T16:11:25.032 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-25T16:11:25.268 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-25T16:11:25.333 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-25T16:11:25.519 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-25T16:11:25.677 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-25T16:11:25.762 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-25T16:11:25.803 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:25.946 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:26.013 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-25T16:11:26.157 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:26.263 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-25T16:11:26.283 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:26.409 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:26.523 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-25T16:11:26.544 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-25T16:11:26.649 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-25T16:11:26.804 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:26.922 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:26.950 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-25T16:11:27.048 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:27.051 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-25T16:11:27.260 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-25T16:11:27.260 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-25T16:11:27.336 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-25T16:11:27.637 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-25T16:11:27.816 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:27.871 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-25T16:11:27.942 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-top (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:28.186 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-25T16:11:28.277 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-25T16:11:28.524 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-25T16:11:28.642 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-25T16:11:29.018 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-25T16:11:29.269 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-25T16:11:29.324 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:29.475 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:29.520 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-25T16:11:29.601 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:29.629 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-25T16:11:29.735 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:29.836 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-shell (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:29.937 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:29.980 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-25T16:11:30.282 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-25T16:11:30.489 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2023-10-25T16:11:30.558 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-25T16:11:30.684 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-25T16:11:30.840 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2023-10-25T16:11:30.943 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-25T16:11:31.027 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2023-10-25T16:11:31.039 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-25T16:11:31.178 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-25T16:11:31.202 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-25T16:11:31.445 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-25T16:11:31.547 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-25T16:11:31.813 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-25T16:11:32.097 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-mirror (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:32.098 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-25T16:11:32.303 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-25T16:11:32.304 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-25T16:11:32.433 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-25T16:11:32.534 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librados2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:32.635 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librgw2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:32.846 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:32.972 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs2 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.000 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.098 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libradosstriper1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.143 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.233 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-25T16:11:33.501 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librbd1 (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.602 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-modules-core (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.631 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-25T16:11:33.632 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-25T16:11:33.719 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:33.929 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-25T16:11:33.930 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-25T16:11:34.120 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:34.432 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-25T16:11:34.471 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs-dev (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:34.597 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rados (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:34.722 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-top (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:34.848 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-25T16:11:34.930 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:35.164 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-25T16:11:35.164 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-25T16:11:35.673 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:35.892 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-25T16:11:35.893 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-25T16:11:36.061 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rbd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.170 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-fuse (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.296 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.399 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.422 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cephfs (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.549 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-shell (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.674 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-common (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:36.707 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-25T16:11:36.707 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-25T16:11:37.143 INFO:teuthology.orchestra.run.smithi177.stdout:Adding group ceph....done 2023-10-25T16:11:37.251 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:37.352 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:37.478 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:37.502 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user ceph....done 2023-10-25T16:11:37.663 INFO:teuthology.orchestra.run.smithi177.stdout:Setting system user ceph properties....done 2023-10-25T16:11:37.675 INFO:teuthology.orchestra.run.smithi177.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-25T16:11:37.696 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-25T16:11:37.697 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-25T16:11:37.811 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-25T16:11:38.155 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-25T16:11:38.196 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:38.347 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:38.473 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:38.624 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-volume (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:38.668 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-mirror (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:38.861 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-25T16:11:38.861 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-25T16:11:38.986 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-25T16:11:39.478 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-test (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:39.579 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up radosgw (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:40.068 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-25T16:11:40.069 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-25T16:11:40.073 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-25T16:11:40.538 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-base (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:40.541 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-25T16:11:40.543 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-25T16:11:40.642 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-25T16:11:40.830 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-10-25T16:11:40.831 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-10-25T16:11:40.882 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-25T16:11:40.997 INFO:teuthology.orchestra.run.smithi184.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-25T16:11:40.998 INFO:teuthology.orchestra.run.smithi184.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-25T16:11:40.998 INFO:teuthology.orchestra.run.smithi184.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-25T16:11:40.998 INFO:teuthology.orchestra.run.smithi184.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-25T16:11:40.998 INFO:teuthology.orchestra.run.smithi184.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-25T16:11:40.998 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T16:11:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T16:11:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T16:11:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T16:11:40.999 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-25T16:11:41.000 INFO:teuthology.orchestra.run.smithi184.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-25T16:11:41.000 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T16:11:41.001 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-10-25T16:11:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-25T16:11:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-25T16:11:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-25T16:11:41.001 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-25T16:11:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-25T16:11:41.002 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-10-25T16:11:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-25T16:11:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-25T16:11:41.002 INFO:teuthology.orchestra.run.smithi184.stdout: libengine-pkcs11-openssl 2023-10-25T16:11:41.037 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-10-25T16:11:41.037 INFO:teuthology.orchestra.run.smithi184.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-25T16:11:41.038 INFO:teuthology.orchestra.run.smithi184.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-25T16:11:41.038 INFO:teuthology.orchestra.run.smithi184.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-25T16:11:41.038 INFO:teuthology.orchestra.run.smithi184.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-25T16:11:41.038 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-25T16:11:41.039 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-25T16:11:41.039 INFO:teuthology.orchestra.run.smithi184.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-25T16:11:41.039 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2023-10-25T16:11:41.040 INFO:teuthology.orchestra.run.smithi184.stdout: libssl3 2023-10-25T16:11:41.390 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mds (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:41.611 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-25T16:11:41.611 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-25T16:11:42.167 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:42.425 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-25T16:11:42.426 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-25T16:11:42.935 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-osd (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:43.219 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-25T16:11:43.220 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-25T16:11:43.803 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:43.929 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:44.080 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mon (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:44.294 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-25T16:11:44.294 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-25T16:11:44.790 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-cephadm (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:44.916 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:45.017 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-dashboard (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:45.151 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-volume (18.0.0-6863-g38499368-1jammy) ... 2023-10-25T16:11:45.479 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-25T16:11:46.597 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-25T16:11:47.043 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-25T16:11:47.046 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-25T16:11:47.148 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2023-10-25T16:11:47.334 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2023-10-25T16:11:47.335 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2023-10-25T16:11:47.419 INFO:teuthology.orchestra.run.smithi184.stdout:1 upgraded, 39 newly installed, 0 to remove and 256 not upgraded. 2023-10-25T16:11:47.420 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 54.6 MB of archives. 2023-10-25T16:11:47.420 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-25T16:11:47.420 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-25T16:11:47.491 INFO:teuthology.orchestra.run.smithi177.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-10-25T16:11:47.491 INFO:teuthology.orchestra.run.smithi177.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-10-25T16:11:47.491 INFO:teuthology.orchestra.run.smithi177.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-10-25T16:11:47.492 INFO:teuthology.orchestra.run.smithi177.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-10-25T16:11:47.492 INFO:teuthology.orchestra.run.smithi177.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-10-25T16:11:47.492 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2023-10-25T16:11:47.492 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-25T16:11:47.492 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-25T16:11:47.493 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-25T16:11:47.493 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-25T16:11:47.493 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-25T16:11:47.493 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-25T16:11:47.494 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2023-10-25T16:11:47.495 INFO:teuthology.orchestra.run.smithi177.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-10-25T16:11:47.495 INFO:teuthology.orchestra.run.smithi177.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-10-25T16:11:47.495 INFO:teuthology.orchestra.run.smithi177.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-10-25T16:11:47.495 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-10-25T16:11:47.495 INFO:teuthology.orchestra.run.smithi177.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-25T16:11:47.496 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2023-10-25T16:11:47.496 INFO:teuthology.orchestra.run.smithi177.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-10-25T16:11:47.496 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-10-25T16:11:47.496 INFO:teuthology.orchestra.run.smithi177.stdout: libengine-pkcs11-openssl 2023-10-25T16:11:47.518 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-10-25T16:11:47.529 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2023-10-25T16:11:47.530 INFO:teuthology.orchestra.run.smithi177.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-10-25T16:11:47.530 INFO:teuthology.orchestra.run.smithi177.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-10-25T16:11:47.530 INFO:teuthology.orchestra.run.smithi177.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-10-25T16:11:47.531 INFO:teuthology.orchestra.run.smithi177.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-10-25T16:11:47.531 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-10-25T16:11:47.531 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-10-25T16:11:47.532 INFO:teuthology.orchestra.run.smithi177.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-25T16:11:47.532 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2023-10-25T16:11:47.533 INFO:teuthology.orchestra.run.smithi177.stdout: libssl3 2023-10-25T16:11:47.579 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-25T16:11:47.585 INFO:teuthology.orchestra.run.smithi177.stdout:1 upgraded, 39 newly installed, 0 to remove and 256 not upgraded. 2023-10-25T16:11:47.585 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 54.6 MB of archives. 2023-10-25T16:11:47.586 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 202 MB of additional disk space will be used. 2023-10-25T16:11:47.586 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-10-25T16:11:47.593 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-25T16:11:47.594 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-25T16:11:47.596 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-25T16:11:47.598 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-25T16:11:47.599 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-25T16:11:47.600 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-25T16:11:47.602 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-25T16:11:47.603 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-25T16:11:47.603 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-25T16:11:47.616 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-25T16:11:47.701 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-10-25T16:11:47.767 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-10-25T16:11:47.781 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-10-25T16:11:47.782 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-10-25T16:11:47.785 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-10-25T16:11:47.787 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-10-25T16:11:47.787 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-10-25T16:11:47.789 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-10-25T16:11:47.790 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-10-25T16:11:47.791 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-10-25T16:11:47.792 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-10-25T16:11:47.811 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-10-25T16:11:47.912 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-25T16:11:47.914 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-25T16:11:47.914 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-25T16:11:47.917 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-25T16:11:47.917 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-25T16:11:47.920 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-25T16:11:47.922 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-25T16:11:47.928 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-25T16:11:47.929 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-10-25T16:11:47.948 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-25T16:11:47.948 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-25T16:11:47.957 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-25T16:11:47.977 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-25T16:11:47.980 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-25T16:11:47.981 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-25T16:11:47.981 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-25T16:11:47.982 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-25T16:11:47.991 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-25T16:11:47.993 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-25T16:11:48.196 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-25T16:11:48.196 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-25T16:11:48.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-25T16:11:48.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-25T16:11:48.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-25T16:11:48.197 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-25T16:11:48.208 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-25T16:11:48.208 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-25T16:11:48.280 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-10-25T16:11:48.283 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-10-25T16:11:48.284 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-10-25T16:11:48.289 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-10-25T16:11:48.289 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-10-25T16:11:48.297 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-10-25T16:11:48.300 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-10-25T16:11:48.314 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-10-25T16:11:48.314 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-10-25T16:11:48.347 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-10-25T16:11:48.347 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-10-25T16:11:48.358 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-10-25T16:11:48.389 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-10-25T16:11:48.395 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-10-25T16:11:48.396 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-10-25T16:11:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-10-25T16:11:48.397 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-10-25T16:11:48.420 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-10-25T16:11:48.423 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-10-25T16:11:48.610 INFO:teuthology.orchestra.run.smithi184.stdout:Preconfiguring packages ... 2023-10-25T16:11:48.754 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-10-25T16:11:48.754 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-10-25T16:11:48.754 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-10-25T16:11:48.755 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-10-25T16:11:48.755 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-10-25T16:11:48.755 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-10-25T16:11:48.770 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-10-25T16:11:48.770 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-10-25T16:11:48.774 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 54.6 MB in 7s (7,621 kB/s) 2023-10-25T16:11:48.863 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package flex. 2023-10-25T16:11:48.926 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172903 files and directories currently installed.) 2023-10-25T16:11:48.931 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-25T16:11:48.970 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-25T16:11:49.135 INFO:teuthology.orchestra.run.smithi177.stdout:Preconfiguring packages ... 2023-10-25T16:11:49.269 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 54.6 MB in 1s (44.3 MB/s) 2023-10-25T16:11:49.487 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package flex. 2023-10-25T16:11:49.527 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-10-25T16:11:49.592 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172903 files and directories currently installed.) 2023-10-25T16:11:49.597 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-10-25T16:11:49.643 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking flex (2.6.4-8build2) ... 2023-10-25T16:11:49.701 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-10-25T16:11:50.102 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-10-25T16:11:50.175 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-10-25T16:11:50.315 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-10-25T16:11:50.568 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package bison. 2023-10-25T16:11:50.631 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172976 files and directories currently installed.) 2023-10-25T16:11:50.637 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-25T16:11:50.687 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-25T16:11:50.699 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-10-25T16:11:51.199 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-25T16:11:51.209 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package bison. 2023-10-25T16:11:51.227 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-25T16:11:51.265 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-25T16:11:51.310 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172976 files and directories currently installed.) 2023-10-25T16:11:51.316 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-10-25T16:11:51.360 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-10-25T16:11:51.601 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package dump. 2023-10-25T16:11:51.629 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-25T16:11:51.667 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking dump (0.4b47-3) ... 2023-10-25T16:11:51.761 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-25T16:11:51.788 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-10-25T16:11:51.827 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-10-25T16:11:51.938 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package indent. 2023-10-25T16:11:51.954 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:51.988 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-25T16:11:52.105 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package dump. 2023-10-25T16:11:52.132 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-10-25T16:11:52.171 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking dump (0.4b47-3) ... 2023-10-25T16:11:52.198 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-25T16:11:52.214 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-25T16:11:52.257 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-25T16:11:52.450 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package indent. 2023-10-25T16:11:52.466 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:52.508 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-25T16:11:52.577 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-25T16:11:52.605 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-25T16:11:52.645 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-25T16:11:52.769 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-25T16:11:52.785 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-10-25T16:11:52.827 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-25T16:11:52.904 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-25T16:11:52.920 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-25T16:11:52.963 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-25T16:11:53.155 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-25T16:11:53.183 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-10-25T16:11:53.222 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-25T16:11:53.241 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-25T16:11:53.269 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-25T16:11:53.299 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-25T16:11:53.441 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-25T16:11:53.454 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-10-25T16:11:53.483 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-10-25T16:11:53.535 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-25T16:11:53.551 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-25T16:11:53.594 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-25T16:11:53.811 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl2:amd64. 2023-10-25T16:11:53.838 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-10-25T16:11:53.846 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjson-perl. 2023-10-25T16:11:53.862 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-25T16:11:53.877 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-10-25T16:11:53.904 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-25T16:11:54.129 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-10-25T16:11:54.145 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-10-25T16:11:54.188 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-25T16:11:54.199 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-25T16:11:54.227 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-25T16:11:54.266 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-25T16:11:54.432 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjson-perl. 2023-10-25T16:11:54.448 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-10-25T16:11:54.482 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-10-25T16:11:54.837 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libllvm14:amd64. 2023-10-25T16:11:54.852 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-10-25T16:11:54.894 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-25T16:11:55.902 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-25T16:11:55.929 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-25T16:11:55.968 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:11:56.331 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-25T16:11:56.355 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-25T16:11:56.397 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:11:56.547 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-25T16:11:56.563 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-25T16:11:56.596 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:11:56.700 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-25T16:11:56.728 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-25T16:11:56.758 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:11:56.807 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-25T16:11:56.824 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-10-25T16:11:56.865 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:11:57.103 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-25T16:11:57.131 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-25T16:11:57.169 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-25T16:11:57.202 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-25T16:11:57.229 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-25T16:11:57.268 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:11:57.497 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-25T16:11:57.525 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-25T16:11:57.565 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-25T16:11:57.613 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-25T16:11:57.640 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-10-25T16:11:57.679 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-25T16:11:57.858 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-25T16:11:57.886 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:57.916 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:11:57.973 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-25T16:11:58.001 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-10-25T16:11:58.031 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-25T16:11:58.261 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-25T16:11:58.289 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:58.328 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:11:58.351 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-25T16:11:58.378 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:58.417 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:11:58.630 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-25T16:11:58.658 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:58.697 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:11:58.753 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-25T16:11:58.781 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:58.820 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:11:58.949 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-25T16:11:58.977 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-10-25T16:11:59.016 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-10-25T16:11:59.122 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-25T16:11:59.150 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:11:59.189 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:11:59.408 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-25T16:11:59.424 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-10-25T16:11:59.457 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-10-25T16:11:59.503 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-25T16:11:59.530 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-25T16:11:59.561 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-25T16:11:59.914 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package modemmanager. 2023-10-25T16:11:59.942 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-25T16:11:59.981 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:11:59.987 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-25T16:12:00.014 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-10-25T16:12:00.053 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-10-25T16:12:00.422 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package modemmanager. 2023-10-25T16:12:00.450 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-10-25T16:12:00.489 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:12:00.579 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager. 2023-10-25T16:12:00.606 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-25T16:12:00.654 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-25T16:12:01.078 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager. 2023-10-25T16:12:01.106 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-10-25T16:12:01.153 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-10-25T16:12:01.387 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ppp. 2023-10-25T16:12:01.415 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-25T16:12:01.704 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-25T16:12:01.718 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ppp. 2023-10-25T16:12:01.746 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-10-25T16:12:02.019 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package pptp-linux. 2023-10-25T16:12:02.046 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-10-25T16:12:02.047 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-25T16:12:02.085 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-25T16:12:02.305 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-25T16:12:02.314 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pptp-linux. 2023-10-25T16:12:02.321 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-25T16:12:02.341 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-10-25T16:12:02.363 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-25T16:12:02.380 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-10-25T16:12:02.633 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-25T16:12:02.649 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-10-25T16:12:02.649 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-25T16:12:02.677 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-25T16:12:02.691 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-10-25T16:12:02.725 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-common (238) ... 2023-10-25T16:12:02.994 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-25T16:12:03.020 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-25T16:12:03.022 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-10-25T16:12:03.048 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:12:03.061 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-common (238) ... 2023-10-25T16:12:03.087 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:03.339 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-14. 2023-10-25T16:12:03.367 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:12:03.406 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:03.834 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-common. 2023-10-25T16:12:03.862 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-25T16:12:03.918 INFO:teuthology.orchestra.run.smithi184.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-25T16:12:03.927 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-common. 2023-10-25T16:12:03.948 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-common (238) ... 2023-10-25T16:12:03.955 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-10-25T16:12:04.004 INFO:teuthology.orchestra.run.smithi177.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-25T16:12:04.033 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-common (238) ... 2023-10-25T16:12:04.391 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-14. 2023-10-25T16:12:04.419 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:12:04.461 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:04.517 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-14. 2023-10-25T16:12:04.545 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-10-25T16:12:04.587 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:05.744 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql. 2023-10-25T16:12:05.761 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-25T16:12:05.803 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql (14+238) ... 2023-10-25T16:12:05.812 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql. 2023-10-25T16:12:05.841 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-10-25T16:12:05.879 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql (14+238) ... 2023-10-25T16:12:06.005 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client. 2023-10-25T16:12:06.022 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-25T16:12:06.063 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client (14+238) ... 2023-10-25T16:12:06.123 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client. 2023-10-25T16:12:06.150 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-10-25T16:12:06.189 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client (14+238) ... 2023-10-25T16:12:06.307 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-25T16:12:06.324 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-25T16:12:06.366 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-25T16:12:06.433 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-25T16:12:06.449 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-10-25T16:12:06.491 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-contrib (14+238) ... 2023-10-25T16:12:06.777 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl8.6. 2023-10-25T16:12:06.805 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-25T16:12:06.843 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-25T16:12:07.079 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl. 2023-10-25T16:12:07.085 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package tcl8.6. 2023-10-25T16:12:07.095 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-25T16:12:07.113 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-10-25T16:12:07.132 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-25T16:12:07.151 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-25T16:12:07.421 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package tcl. 2023-10-25T16:12:07.450 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-10-25T16:12:07.482 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package wpasupplicant. 2023-10-25T16:12:07.484 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-10-25T16:12:07.510 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-25T16:12:07.548 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-25T16:12:07.807 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package wpasupplicant. 2023-10-25T16:12:07.836 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-10-25T16:12:07.874 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-25T16:12:08.153 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-25T16:12:08.169 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-25T16:12:08.211 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-25T16:12:08.255 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-25T16:12:08.282 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-10-25T16:12:08.320 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-10-25T16:12:08.514 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-25T16:12:08.542 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-25T16:12:08.581 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-25T16:12:08.640 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-25T16:12:08.669 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-10-25T16:12:08.707 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-25T16:12:08.893 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-common (238) ... 2023-10-25T16:12:09.018 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-common (238) ... 2023-10-25T16:12:09.078 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-25T16:12:09.204 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-25T16:12:09.255 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up flex (2.6.4-8build2) ... 2023-10-25T16:12:09.330 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:09.381 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-10-25T16:12:09.456 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-25T16:12:09.490 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:09.582 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-25T16:12:09.591 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-10-25T16:12:09.708 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:09.717 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-10-25T16:12:09.843 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:10.216 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-25T16:12:10.309 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-25T16:12:10.399 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-25T16:12:10.504 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-10-25T16:12:10.762 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-25T16:12:10.762 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-25T16:12:10.889 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-25T16:12:10.889 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-25T16:12:11.285 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-25T16:12:11.386 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-10-25T16:12:11.451 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-10-25T16:12:11.520 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-25T16:12:11.560 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-10-25T16:12:11.646 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-25T16:12:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-10-25T16:12:11.772 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-25T16:12:11.787 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-10-25T16:12:11.898 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-25T16:12:11.913 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-10-25T16:12:12.024 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-25T16:12:12.039 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-10-25T16:12:12.165 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-10-25T16:12:12.778 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-25T16:12:12.904 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up dump (0.4b47-3) ... 2023-10-25T16:12:12.998 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-25T16:12:13.005 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-10-25T16:12:13.064 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:12:13.131 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up dump (0.4b47-3) ... 2023-10-25T16:12:13.215 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-25T16:12:13.225 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-25T16:12:13.291 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:12:13.341 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-25T16:12:13.425 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-10-25T16:12:13.467 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-25T16:12:13.568 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up tcl (8.6.11+1build2) ... 2023-10-25T16:12:13.592 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-25T16:12:13.684 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-25T16:12:13.694 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjson-perl (4.04000-1) ... 2023-10-25T16:12:13.744 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-25T16:12:13.829 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-10-25T16:12:13.845 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-25T16:12:13.919 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-10-25T16:12:13.989 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-10-25T16:12:14.013 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-25T16:12:14.115 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-10-25T16:12:14.139 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:12:14.265 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-25T16:12:14.291 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-10-25T16:12:14.417 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:12:14.434 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client (14+238) ... 2023-10-25T16:12:14.535 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-10-25T16:12:14.558 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-25T16:12:14.703 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client (14+238) ... 2023-10-25T16:12:14.837 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-10-25T16:12:15.053 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:15.053 INFO:teuthology.orchestra.run.smithi177.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-25T16:12:15.053 INFO:teuthology.orchestra.run.smithi177.stdout:which means they are currently configured by ifupdown: 2023-10-25T16:12:15.053 INFO:teuthology.orchestra.run.smithi177.stdout:- enp3s0f1 2023-10-25T16:12:15.054 INFO:teuthology.orchestra.run.smithi177.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-25T16:12:15.054 INFO:teuthology.orchestra.run.smithi177.stdout:remove their configuration from /etc/network/interfaces. 2023-10-25T16:12:15.054 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:15.176 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-25T16:12:15.323 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:15.323 INFO:teuthology.orchestra.run.smithi184.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-25T16:12:15.323 INFO:teuthology.orchestra.run.smithi184.stdout:which means they are currently configured by ifupdown: 2023-10-25T16:12:15.323 INFO:teuthology.orchestra.run.smithi184.stdout:- enp3s0f1 2023-10-25T16:12:15.323 INFO:teuthology.orchestra.run.smithi184.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-25T16:12:15.324 INFO:teuthology.orchestra.run.smithi184.stdout:remove their configuration from /etc/network/interfaces. 2023-10-25T16:12:15.324 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:15.433 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-25T16:12:15.518 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-25T16:12:15.758 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-25T16:12:15.869 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-25T16:12:16.069 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-25T16:12:16.361 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:12:16.504 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-25T16:12:16.615 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-10-25T16:12:16.630 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-25T16:12:16.748 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-common (238) ... 2023-10-25T16:12:16.758 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-10-25T16:12:16.867 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-10-25T16:12:17.001 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-common (238) ... 2023-10-25T16:12:17.565 INFO:teuthology.orchestra.run.smithi177.stdout:Adding user postgres to group ssl-cert 2023-10-25T16:12:17.807 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:17.807 INFO:teuthology.orchestra.run.smithi177.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-25T16:12:17.895 INFO:teuthology.orchestra.run.smithi184.stdout:Adding user postgres to group ssl-cert 2023-10-25T16:12:18.005 INFO:teuthology.orchestra.run.smithi177.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-25T16:12:18.005 INFO:teuthology.orchestra.run.smithi177.stdout:Removing obsolete dictionary files: 2023-10-25T16:12:18.134 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:18.134 INFO:teuthology.orchestra.run.smithi184.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-25T16:12:18.332 INFO:teuthology.orchestra.run.smithi184.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-25T16:12:18.332 INFO:teuthology.orchestra.run.smithi184.stdout:Removing obsolete dictionary files: 2023-10-25T16:12:18.628 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-25T16:12:18.904 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-25T16:12:19.040 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:19.304 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-10-25T16:12:19.367 INFO:teuthology.orchestra.run.smithi177.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-25T16:12:19.382 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-25T16:12:19.428 INFO:teuthology.orchestra.run.smithi177.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-25T16:12:19.428 INFO:teuthology.orchestra.run.smithi177.stdout:This user must also own the server process. 2023-10-25T16:12:19.428 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:19.428 INFO:teuthology.orchestra.run.smithi177.stdout:The database cluster will be initialized with locale "en_US". 2023-10-25T16:12:19.428 INFO:teuthology.orchestra.run.smithi177.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-25T16:12:19.429 INFO:teuthology.orchestra.run.smithi177.stdout:The default text search configuration will be set to "english". 2023-10-25T16:12:19.429 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:19.429 INFO:teuthology.orchestra.run.smithi177.stdout:Data page checksums are disabled. 2023-10-25T16:12:19.429 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:19.429 INFO:teuthology.orchestra.run.smithi177.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-25T16:12:19.430 INFO:teuthology.orchestra.run.smithi177.stdout:creating subdirectories ... ok 2023-10-25T16:12:19.430 INFO:teuthology.orchestra.run.smithi177.stdout:selecting dynamic shared memory implementation ... posix 2023-10-25T16:12:19.440 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default max_connections ... 100 2023-10-25T16:12:19.461 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default shared_buffers ... 128MB 2023-10-25T16:12:19.471 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default time zone ... Etc/UTC 2023-10-25T16:12:19.471 INFO:teuthology.orchestra.run.smithi177.stdout:creating configuration files ... ok 2023-10-25T16:12:19.583 INFO:teuthology.orchestra.run.smithi177.stdout:running bootstrap script ... ok 2023-10-25T16:12:19.630 INFO:teuthology.orchestra.run.smithi184.stdout:Creating new PostgreSQL cluster 14/main ... 2023-10-25T16:12:19.644 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-10-25T16:12:19.681 INFO:teuthology.orchestra.run.smithi184.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-25T16:12:19.682 INFO:teuthology.orchestra.run.smithi184.stdout:This user must also own the server process. 2023-10-25T16:12:19.682 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:19.682 INFO:teuthology.orchestra.run.smithi184.stdout:The database cluster will be initialized with locale "en_US". 2023-10-25T16:12:19.682 INFO:teuthology.orchestra.run.smithi184.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-25T16:12:19.683 INFO:teuthology.orchestra.run.smithi184.stdout:The default text search configuration will be set to "english". 2023-10-25T16:12:19.683 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:19.683 INFO:teuthology.orchestra.run.smithi184.stdout:Data page checksums are disabled. 2023-10-25T16:12:19.683 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:19.683 INFO:teuthology.orchestra.run.smithi184.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-10-25T16:12:19.684 INFO:teuthology.orchestra.run.smithi184.stdout:creating subdirectories ... ok 2023-10-25T16:12:19.684 INFO:teuthology.orchestra.run.smithi184.stdout:selecting dynamic shared memory implementation ... posix 2023-10-25T16:12:19.693 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default max_connections ... 100 2023-10-25T16:12:19.712 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default shared_buffers ... 128MB 2023-10-25T16:12:19.719 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default time zone ... Etc/UTC 2023-10-25T16:12:19.719 INFO:teuthology.orchestra.run.smithi184.stdout:creating configuration files ... ok 2023-10-25T16:12:19.823 INFO:teuthology.orchestra.run.smithi184.stdout:running bootstrap script ... ok 2023-10-25T16:12:20.197 INFO:teuthology.orchestra.run.smithi177.stdout:performing post-bootstrap initialization ... ok 2023-10-25T16:12:20.827 INFO:teuthology.orchestra.run.smithi177.stdout:syncing data to disk ... ok 2023-10-25T16:12:20.855 INFO:teuthology.orchestra.run.smithi184.stdout:performing post-bootstrap initialization ... ok 2023-10-25T16:12:21.258 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-25T16:12:21.421 INFO:teuthology.orchestra.run.smithi184.stdout:syncing data to disk ... ok 2023-10-25T16:12:21.824 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-25T16:12:24.055 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:12:24.173 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-25T16:12:24.273 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql (14+238) ... 2023-10-25T16:12:24.383 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:12:24.517 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:12:24.633 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:12:24.734 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-contrib (14+238) ... 2023-10-25T16:12:24.770 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-25T16:12:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-25T16:12:24.835 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql (14+238) ... 2023-10-25T16:12:24.961 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-10-25T16:12:25.095 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-10-25T16:12:25.347 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-25T16:12:25.348 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-25T16:12:25.352 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-25T16:12:25.672 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-25T16:12:25.822 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-25T16:12:25.940 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-25T16:12:26.425 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-25T16:12:26.568 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-25T16:12:27.036 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-25T16:12:27.127 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-25T16:12:27.656 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-10-25T16:12:27.747 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-10-25T16:12:27.764 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-25T16:12:27.767 DEBUG:teuthology.parallel:result is None 2023-10-25T16:12:28.356 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-25T16:12:28.359 DEBUG:teuthology.parallel:result is None 2023-10-25T16:12:28.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T16:12:28.583 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-query -W -f '${Version}' ceph 2023-10-25T16:12:28.603 INFO:teuthology.orchestra.run.smithi177.stdout:18.0.0-6863-g38499368-1jammy 2023-10-25T16:12:28.604 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863-g38499368-1jammy 2023-10-25T16:12:28.604 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863-g38499368-1jammy is installed. 2023-10-25T16:12:28.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T16:12:28.819 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2023-10-25T16:12:28.839 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-6863-g38499368-1jammy 2023-10-25T16:12:28.839 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863-g38499368-1jammy 2023-10-25T16:12:28.840 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863-g38499368-1jammy is installed. 2023-10-25T16:12:28.840 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-25T16:12:28.841 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:28.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-25T16:12:28.857 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:28.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-25T16:12:28.894 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-25T16:12:28.895 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:28.895 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2023-10-25T16:12:28.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-25T16:12:28.964 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:28.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-10-25T16:12:28.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-25T16:12:29.033 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-25T16:12:29.034 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:29.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-25T16:12:29.047 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-25T16:12:29.101 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:29.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-25T16:12:29.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-25T16:12:29.168 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-25T16:12:29.169 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:29.169 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2023-10-25T16:12:29.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-25T16:12:29.237 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:29.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-10-25T16:12:29.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-25T16:12:29.305 INFO:teuthology.run_tasks:Running task ceph... 2023-10-25T16:12:29.373 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-25T16:12:29.374 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2023-10-25T16:12:29.377 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-10-25T16:12:29.390 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-25T16:12:29.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-25T16:12:29.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-25T16:12:29.445 INFO:tasks.ceph:Creating extra log directories... 2023-10-25T16:12:29.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-25T16:12:29.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-25T16:12:29.508 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-25T16:12:29.508 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-25T16:12:29.508 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-25T16:12:29.509 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:29.509 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-25T16:12:29.546 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-25T16:12:29.622 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:29.622 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-25T16:12:29.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-25T16:12:29.708 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-25T16:12:29.709 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-25T16:12:29.709 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235', 'branch': 'wip-batrick-testing-20231024.144545', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7436235', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20231024.144545'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231024.144545', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7595, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'sleep_before_teardown': 0, 'subset': '66/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20231024.144545', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '384993681abceb8cb8affea10538d607052db4b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMA7OsvM43FbQ7tmP9uXbzxtHcjG+Lv7PEIn6ndC3+2O3Hw/UIV4nU4KQRcld9CBTZXOjqdzrMvR4CnhWnxonYo=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNq8bOfXnbynahfr4oiAsMkeZb4xAanGNQEOrecAResV89sIVyaEHaPUb2SU+0TZJWc7gzGae345vkj+FRuRfQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-24_19:52:40', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.770726'} 2023-10-25T16:12:29.710 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-25T16:12:29.713 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-25T16:12:29.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2023-10-25T16:12:29.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-10-25T16:12:29.805 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:29.806 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2023-10-25T16:12:29.818 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-25T16:12:29.818 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2023-10-25T16:12:29.866 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-25T16:12:29.866 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:29.866 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 888 Links: 1 2023-10-25T16:12:29.867 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:29.867 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-25 16:06:27.996044480 +0000 2023-10-25T16:12:29.867 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-25 16:06:27.616047873 +0000 2023-10-25T16:12:29.867 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-25 16:06:27.616047873 +0000 2023-10-25T16:12:29.867 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-10-25T16:12:29.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-25T16:12:29.920 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-25T16:12:29.920 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-25T16:12:29.920 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000449756 s, 1.1 MB/s 2023-10-25T16:12:29.921 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-25T16:12:29.971 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2023-10-25T16:12:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-25T16:12:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.018 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-10-25T16:12:30.019 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.019 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-25 16:06:28.604039049 +0000 2023-10-25T16:12:30.019 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-25 16:06:28.236042336 +0000 2023-10-25T16:12:30.019 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-25 16:06:28.236042336 +0000 2023-10-25T16:12:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-10-25T16:12:30.020 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-25T16:12:30.073 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-25T16:12:30.073 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-25T16:12:30.073 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000335835 s, 1.5 MB/s 2023-10-25T16:12:30.074 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-25T16:12:30.124 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2023-10-25T16:12:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-25T16:12:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.171 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-10-25T16:12:30.171 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.171 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-25 16:06:29.192033796 +0000 2023-10-25T16:12:30.171 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-25 16:06:28.844036905 +0000 2023-10-25T16:12:30.171 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-25 16:06:28.844036905 +0000 2023-10-25T16:12:30.171 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-10-25T16:12:30.172 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-25T16:12:30.224 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-25T16:12:30.224 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-25T16:12:30.225 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000430984 s, 1.2 MB/s 2023-10-25T16:12:30.225 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-25T16:12:30.275 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2023-10-25T16:12:30.322 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-25T16:12:30.322 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.322 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-10-25T16:12:30.322 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.323 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-25 16:06:29.784028508 +0000 2023-10-25T16:12:30.323 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-25 16:06:29.472031296 +0000 2023-10-25T16:12:30.323 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-25 16:06:29.472031296 +0000 2023-10-25T16:12:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2023-10-25T16:12:30.324 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-25T16:12:30.376 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-25T16:12:30.377 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-25T16:12:30.377 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000353342 s, 1.4 MB/s 2023-10-25T16:12:30.378 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-25T16:12:30.427 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:30.428 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:30.428 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-10-25T16:12:30.434 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-25T16:12:30.435 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-10-25T16:12:30.482 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-25T16:12:30.482 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.483 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 893 Links: 1 2023-10-25T16:12:30.483 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.483 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-25 16:06:19.084337903 +0000 2023-10-25T16:12:30.483 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-25 16:06:18.724341119 +0000 2023-10-25T16:12:30.483 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-25 16:06:18.724341119 +0000 2023-10-25T16:12:30.484 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-25T16:12:30.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-25T16:12:30.536 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-25T16:12:30.537 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-25T16:12:30.537 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000439397 s, 1.2 MB/s 2023-10-25T16:12:30.538 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-25T16:12:30.587 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-10-25T16:12:30.634 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-25T16:12:30.634 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.634 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-10-25T16:12:30.635 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.635 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-25 16:06:19.684332543 +0000 2023-10-25T16:12:30.635 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-25 16:06:19.308335902 +0000 2023-10-25T16:12:30.635 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-25 16:06:19.308335902 +0000 2023-10-25T16:12:30.635 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-25T16:12:30.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-25T16:12:30.688 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-25T16:12:30.689 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-25T16:12:30.689 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000437794 s, 1.2 MB/s 2023-10-25T16:12:30.690 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-25T16:12:30.739 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-10-25T16:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-25T16:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-10-25T16:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-25 16:06:20.272327292 +0000 2023-10-25T16:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-25 16:06:19.928330364 +0000 2023-10-25T16:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-25 16:06:19.928330364 +0000 2023-10-25T16:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-25T16:12:30.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-25T16:12:30.840 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-25T16:12:30.840 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-25T16:12:30.840 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00041751 s, 1.2 MB/s 2023-10-25T16:12:30.841 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-25T16:12:30.891 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-10-25T16:12:30.938 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-25T16:12:30.938 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T16:12:30.939 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 942 Links: 1 2023-10-25T16:12:30.939 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T16:12:30.939 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-25 16:06:20.848322147 +0000 2023-10-25T16:12:30.939 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-25 16:06:20.500325256 +0000 2023-10-25T16:12:30.939 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-25 16:06:20.500325256 +0000 2023-10-25T16:12:30.939 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-25T16:12:30.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-25T16:12:30.992 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-25T16:12:30.992 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-25T16:12:30.992 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000421487 s, 1.2 MB/s 2023-10-25T16:12:30.993 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-25T16:12:31.045 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:31.045 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-25T16:12:31.045 INFO:tasks.ceph:Generating config... 2023-10-25T16:12:31.047 INFO:tasks.ceph:[client] pid file = 2023-10-25T16:12:31.047 INFO:tasks.ceph:[client.0] debug client = 20 2023-10-25T16:12:31.048 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-10-25T16:12:31.048 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-10-25T16:12:31.048 INFO:tasks.ceph:[client.1] debug client = 20 2023-10-25T16:12:31.049 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-10-25T16:12:31.049 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-10-25T16:12:31.049 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-25T16:12:31.049 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-25T16:12:31.050 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-25T16:12:31.050 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-25T16:12:31.050 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-25T16:12:31.051 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-10-25T16:12:31.051 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-10-25T16:12:31.051 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-10-25T16:12:31.051 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-25T16:12:31.052 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-25T16:12:31.052 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-25T16:12:31.052 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-25T16:12:31.053 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-25T16:12:31.053 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-25T16:12:31.053 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-25T16:12:31.053 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-10-25T16:12:31.054 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-25T16:12:31.054 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-25T16:12:31.054 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-25T16:12:31.055 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-10-25T16:12:31.055 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-10-25T16:12:31.055 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-10-25T16:12:31.056 INFO:tasks.ceph:Setting up mon.a... 2023-10-25T16:12:31.056 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-25T16:12:31.091 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.keyring 2023-10-25T16:12:31.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-25T16:12:31.175 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-25T16:12:31.229 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.177'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-10-25T16:12:31.229 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.177,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}} 2023-10-25T16:12:31.230 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:31.231 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-25T16:12:31.274 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.177 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:31.359 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:31.361 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: generated fsid da778784-be7e-4dcd-bc5a-18ed17fb00e4 2023-10-25T16:12:31.361 INFO:teuthology.orchestra.run.smithi177.stdout:setting min_mon_release = pacific 2023-10-25T16:12:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:epoch 0 2023-10-25T16:12:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:fsid da778784-be7e-4dcd-bc5a-18ed17fb00e4 2023-10-25T16:12:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:last_changed 2023-10-25T16:12:31.359670+0000 2023-10-25T16:12:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:created 2023-10-25T16:12:31.359670+0000 2023-10-25T16:12:31.363 INFO:teuthology.orchestra.run.smithi177.stdout:min_mon_release 16 (pacific) 2023-10-25T16:12:31.363 INFO:teuthology.orchestra.run.smithi177.stdout:election_strategy: 1 2023-10-25T16:12:31.363 INFO:teuthology.orchestra.run.smithi177.stdout:0: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.a 2023-10-25T16:12:31.363 INFO:teuthology.orchestra.run.smithi177.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-10-25T16:12:31.363 INFO:teuthology.orchestra.run.smithi177.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-10-25T16:12:31.364 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-25T16:12:31.365 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-25T16:12:31.410 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID da778784-be7e-4dcd-bc5a-18ed17fb00e4... 2023-10-25T16:12:31.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-25T16:12:31.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-25T16:12:31.483 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2023-10-25T16:12:31.483 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2023-10-25T16:12:31.483 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-25T16:12:31.483 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2023-10-25T16:12:31.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.484 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2023-10-25T16:12:31.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.484 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2023-10-25T16:12:31.484 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.485 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2023-10-25T16:12:31.485 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2023-10-25T16:12:31.485 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.485 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2023-10-25T16:12:31.485 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2023-10-25T16:12:31.486 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.486 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-25T16:12:31.486 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2023-10-25T16:12:31.486 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.486 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2023-10-25T16:12:31.486 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-25T16:12:31.487 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.487 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2023-10-25T16:12:31.487 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.487 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2023-10-25T16:12:31.487 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2023-10-25T16:12:31.488 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2023-10-25T16:12:31.488 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2023-10-25T16:12:31.488 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2023-10-25T16:12:31.488 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2023-10-25T16:12:31.489 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2023-10-25T16:12:31.489 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-25T16:12:31.490 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-25T16:12:31.490 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2023-10-25T16:12:31.490 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.490 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-25T16:12:31.491 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.491 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2023-10-25T16:12:31.491 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.491 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2023-10-25T16:12:31.492 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.492 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2023-10-25T16:12:31.492 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2023-10-25T16:12:31.492 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2023-10-25T16:12:31.492 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.177,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-25T16:12:31.493 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = da778784-be7e-4dcd-bc5a-18ed17fb00e4 2023-10-25T16:12:31.493 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.494 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2023-10-25T16:12:31.494 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2023-10-25T16:12:31.494 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.495 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2023-10-25T16:12:31.495 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2023-10-25T16:12:31.495 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2023-10-25T16:12:31.495 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.495 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2023-10-25T16:12:31.496 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2023-10-25T16:12:31.496 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.496 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2023-10-25T16:12:31.496 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2023-10-25T16:12:31.496 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2023-10-25T16:12:31.497 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.497 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2023-10-25T16:12:31.497 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2023-10-25T16:12:31.497 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.497 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2023-10-25T16:12:31.497 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.498 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2023-10-25T16:12:31.498 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.498 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2023-10-25T16:12:31.498 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.498 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2023-10-25T16:12:31.499 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2023-10-25T16:12:31.499 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.499 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2023-10-25T16:12:31.500 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2023-10-25T16:12:31.500 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2023-10-25T16:12:31.500 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2023-10-25T16:12:31.501 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 20 2023-10-25T16:12:31.501 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 20 2023-10-25T16:12:31.501 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-25T16:12:31.501 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2023-10-25T16:12:31.501 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 10 2023-10-25T16:12:31.502 INFO:teuthology.orchestra.run.smithi177.stdout: memstore device bytes = 200000000 2023-10-25T16:12:31.502 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2023-10-25T16:12:31.502 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2023-10-25T16:12:31.502 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2023-10-25T16:12:31.502 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 1.0 2023-10-25T16:12:31.503 INFO:teuthology.orchestra.run.smithi177.stdout: osd mon report interval = 5 2023-10-25T16:12:31.503 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = memstore 2023-10-25T16:12:31.503 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.503 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2023-10-25T16:12:31.503 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-25T16:12:31.504 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2023-10-25T16:12:31.504 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-10-25T16:12:31.504 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-10-25T16:12:31.504 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-10-25T16:12:31.504 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-10-25T16:12:31.505 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2023-10-25T16:12:31.505 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.505 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2023-10-25T16:12:31.505 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-25T16:12:31.505 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-10-25T16:12:31.505 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2023-10-25T16:12:31.506 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-10-25T16:12:31.506 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2023-10-25T16:12:31.506 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2023-10-25T16:12:31.506 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-10-25T16:12:31.506 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2023-10-25T16:12:31.507 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2023-10-25T16:12:31.507 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-10-25T16:12:31.507 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.507 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-25T16:12:31.507 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2023-10-25T16:12:31.508 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2023-10-25T16:12:31.508 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.508 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2023-10-25T16:12:31.508 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-25T16:12:31.508 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-25T16:12:31.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.509 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2023-10-25T16:12:31.509 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2023-10-25T16:12:31.509 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.510 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2023-10-25T16:12:31.510 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull ratio = 0.6 2023-10-25T16:12:31.510 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.7 2023-10-25T16:12:31.511 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.6 2023-10-25T16:12:31.511 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:31.511 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2023-10-25T16:12:31.511 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2023-10-25T16:12:31.511 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2023-10-25T16:12:31.512 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2023-10-25T16:12:31.512 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-25T16:12:31.512 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-25T16:12:31.512 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2023-10-25T16:12:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2023-10-25T16:12:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2023-10-25T16:12:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2023-10-25T16:12:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-10-25T16:12:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-10-25T16:12:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-10-25T16:12:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-10-25T16:12:31.514 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:12:31.514 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2023-10-25T16:12:31.514 INFO:teuthology.orchestra.run.smithi177.stdout: debug objectcacher = 20 2023-10-25T16:12:31.514 INFO:teuthology.orchestra.run.smithi177.stdout: debug objecter = 20 2023-10-25T16:12:31.514 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2023-10-25T16:12:31.515 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2023-10-25T16:12:31.515 INFO:teuthology.orchestra.run.smithi177.stdout: debug objectcacher = 20 2023-10-25T16:12:31.515 INFO:teuthology.orchestra.run.smithi177.stdout: debug objecter = 20 2023-10-25T16:12:31.516 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-10-25T16:12:31.517 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-10-25T16:12:31.517 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-25T16:12:31.517 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-10-25T16:12:31.517 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.518 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-10-25T16:12:31.518 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.518 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-10-25T16:12:31.518 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.518 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-10-25T16:12:31.519 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-10-25T16:12:31.519 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.519 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-10-25T16:12:31.519 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-10-25T16:12:31.519 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.520 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-25T16:12:31.520 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-10-25T16:12:31.520 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.520 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-10-25T16:12:31.521 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-25T16:12:31.521 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.521 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-10-25T16:12:31.521 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.522 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-10-25T16:12:31.522 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-10-25T16:12:31.522 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-10-25T16:12:31.522 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-10-25T16:12:31.522 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-10-25T16:12:31.522 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-10-25T16:12:31.523 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-10-25T16:12:31.523 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-25T16:12:31.523 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-25T16:12:31.523 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-10-25T16:12:31.523 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.524 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-25T16:12:31.524 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.524 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-10-25T16:12:31.524 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.524 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-10-25T16:12:31.525 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.525 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-10-25T16:12:31.525 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-10-25T16:12:31.525 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-10-25T16:12:31.525 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.177,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-25T16:12:31.525 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = da778784-be7e-4dcd-bc5a-18ed17fb00e4 2023-10-25T16:12:31.526 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.526 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-10-25T16:12:31.526 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-10-25T16:12:31.526 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.527 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-10-25T16:12:31.527 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-10-25T16:12:31.527 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-10-25T16:12:31.527 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.527 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-10-25T16:12:31.528 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-10-25T16:12:31.528 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.528 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-10-25T16:12:31.528 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-10-25T16:12:31.528 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-10-25T16:12:31.529 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.529 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-10-25T16:12:31.529 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-10-25T16:12:31.529 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.529 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-10-25T16:12:31.530 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.530 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-10-25T16:12:31.530 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.530 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-10-25T16:12:31.530 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.531 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-10-25T16:12:31.531 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-10-25T16:12:31.531 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.532 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-10-25T16:12:31.532 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-10-25T16:12:31.532 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-10-25T16:12:31.532 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-10-25T16:12:31.532 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-10-25T16:12:31.532 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-10-25T16:12:31.533 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-25T16:12:31.533 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-10-25T16:12:31.533 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-10-25T16:12:31.533 INFO:teuthology.orchestra.run.smithi184.stdout: memstore device bytes = 200000000 2023-10-25T16:12:31.533 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-10-25T16:12:31.534 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-10-25T16:12:31.534 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-10-25T16:12:31.534 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 1.0 2023-10-25T16:12:31.534 INFO:teuthology.orchestra.run.smithi184.stdout: osd mon report interval = 5 2023-10-25T16:12:31.534 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = memstore 2023-10-25T16:12:31.535 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.535 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-10-25T16:12:31.535 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-25T16:12:31.535 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-10-25T16:12:31.535 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-25T16:12:31.536 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-25T16:12:31.536 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-25T16:12:31.536 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-25T16:12:31.536 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-10-25T16:12:31.536 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.537 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-10-25T16:12:31.537 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-25T16:12:31.537 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-25T16:12:31.537 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-10-25T16:12:31.538 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-25T16:12:31.538 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-10-25T16:12:31.538 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-10-25T16:12:31.538 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-25T16:12:31.538 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-10-25T16:12:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-10-25T16:12:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-25T16:12:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-25T16:12:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-10-25T16:12:31.540 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-10-25T16:12:31.540 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.540 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-10-25T16:12:31.540 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-25T16:12:31.540 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-25T16:12:31.540 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.541 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-10-25T16:12:31.541 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-10-25T16:12:31.541 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.542 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-10-25T16:12:31.542 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull ratio = 0.6 2023-10-25T16:12:31.542 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.7 2023-10-25T16:12:31.542 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.6 2023-10-25T16:12:31.542 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-25T16:12:31.543 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-10-25T16:12:31.543 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-10-25T16:12:31.543 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-10-25T16:12:31.543 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-10-25T16:12:31.544 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-25T16:12:31.544 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-25T16:12:31.544 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-10-25T16:12:31.544 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-10-25T16:12:31.545 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-10-25T16:12:31.545 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-10-25T16:12:31.545 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-25T16:12:31.545 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-25T16:12:31.545 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-25T16:12:31.546 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-25T16:12:31.546 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-10-25T16:12:31.546 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-25T16:12:31.546 INFO:teuthology.orchestra.run.smithi184.stdout: debug objectcacher = 20 2023-10-25T16:12:31.546 INFO:teuthology.orchestra.run.smithi184.stdout: debug objecter = 20 2023-10-25T16:12:31.547 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-10-25T16:12:31.547 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-25T16:12:31.547 INFO:teuthology.orchestra.run.smithi184.stdout: debug objectcacher = 20 2023-10-25T16:12:31.547 INFO:teuthology.orchestra.run.smithi184.stdout: debug objecter = 20 2023-10-25T16:12:31.547 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-25T16:12:31.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-25T16:12:31.609 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-25T16:12:31.610 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:31.610 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-25T16:12:31.615 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:31.616 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-25T16:12:31.662 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:12:31.663 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:31.663 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-25T16:12:31.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-25T16:12:31.727 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:31.727 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:31.774 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:12:31.774 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:31.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-25T16:12:31.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-25T16:12:31.798 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:31.798 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:31.846 INFO:tasks.ceph:Setting up mon nodes... 2023-10-25T16:12:31.847 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-25T16:12:31.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-25T16:12:31.891 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-25T16:12:31.895 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-25T16:12:31.938 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-25T16:12:31.952 INFO:tasks.ceph:Setting up mds nodes... 2023-10-25T16:12:31.953 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-25T16:12:31.998 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-25T16:12:32.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-25T16:12:32.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-25T16:12:32.096 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-25T16:12:32.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-25T16:12:32.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-25T16:12:32.201 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-25T16:12:32.204 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-25T16:12:32.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-25T16:12:32.305 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-25T16:12:32.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-25T16:12:32.361 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-25T16:12:32.362 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-25T16:12:32.398 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-25T16:12:32.409 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-25T16:12:32.480 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-25T16:12:32.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-25T16:12:32.527 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-25T16:12:32.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-25T16:12:32.612 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-25T16:12:32.621 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-25T16:12:32.621 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-25T16:12:32.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-25T16:12:32.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:32.636 INFO:tasks.ceph:role: osd.0 2023-10-25T16:12:32.636 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:12:32.636 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-25T16:12:32.698 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:32.699 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:32.699 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:32.700 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:32.700 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:32.700 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:33.141 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-25T16:12:33.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-25T16:12:33.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-25T16:12:33.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-25T16:12:33.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:33.250 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:33.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-25T16:12:33.305 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:33.305 INFO:tasks.ceph:role: osd.1 2023-10-25T16:12:33.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:12:33.306 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-25T16:12:33.367 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:33.367 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:33.367 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:33.367 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:33.367 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:33.368 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:33.368 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:33.368 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:33.368 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:33.368 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:33.832 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-25T16:12:33.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-25T16:12:33.835 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-25T16:12:33.962 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-25T16:12:33.973 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:33.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:33.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-25T16:12:34.029 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:34.030 INFO:tasks.ceph:role: osd.2 2023-10-25T16:12:34.030 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:12:34.030 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-25T16:12:34.094 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:34.095 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:34.095 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:34.095 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:34.095 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:34.095 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:34.095 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:34.096 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:34.096 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:34.096 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:34.569 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-25T16:12:34.571 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-25T16:12:34.572 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-25T16:12:34.718 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-25T16:12:34.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:34.731 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-25T16:12:34.785 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:34.785 INFO:tasks.ceph:role: osd.3 2023-10-25T16:12:34.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:12:34.786 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-25T16:12:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:34.849 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:34.850 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:34.850 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:34.850 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:34.850 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:34.850 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:34.851 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:34.851 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:34.851 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:35.271 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-25T16:12:35.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-25T16:12:35.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-25T16:12:35.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-25T16:12:35.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:35.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:35.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.495+0000 7fceff40f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-25T16:12:35.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.499+0000 7fceff40f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-25T16:12:35.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.499+0000 7fceff40f640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-10-25T16:12:35.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-25T16:12:35.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.607+0000 7f78c6026640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-25T16:12:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.607+0000 7f78c6026640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-25T16:12:35.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.615+0000 7f78c6026640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-10-25T16:12:35.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-25T16:12:35.684 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:35.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.759+0000 7f44be86a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-25T16:12:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.767+0000 7f44be86a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-25T16:12:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.771+0000 7f44be86a640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-10-25T16:12:35.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-25T16:12:35.854 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:35.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.931+0000 7f489a08b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-25T16:12:35.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.935+0000 7f489a08b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-25T16:12:35.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:35.939+0000 7f489a08b640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-10-25T16:12:35.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-25T16:12:36.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-25T16:12:36.037 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:36.037 INFO:tasks.ceph:role: osd.4 2023-10-25T16:12:36.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:12:36.038 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-25T16:12:36.102 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:36.102 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:36.102 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:36.102 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:36.103 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:36.103 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:36.103 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:36.103 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:36.103 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:36.104 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:36.560 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-25T16:12:36.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-25T16:12:36.563 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-25T16:12:36.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-25T16:12:36.707 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:36.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:36.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-25T16:12:36.765 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:36.765 INFO:tasks.ceph:role: osd.5 2023-10-25T16:12:36.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:12:36.766 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-25T16:12:36.829 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:36.829 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:36.830 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:36.830 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:36.830 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:36.830 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:36.830 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:36.831 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:36.831 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:36.831 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:37.309 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-25T16:12:37.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-25T16:12:37.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-25T16:12:37.482 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-25T16:12:37.493 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:37.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:37.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-25T16:12:37.553 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:37.553 INFO:tasks.ceph:role: osd.6 2023-10-25T16:12:37.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:12:37.554 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-25T16:12:37.617 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:37.618 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:37.619 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:37.619 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:37.620 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:37.620 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:37.620 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:37.621 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:38.101 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-25T16:12:38.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-25T16:12:38.103 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-25T16:12:38.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-25T16:12:38.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:38.261 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:38.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-25T16:12:38.317 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T16:12:38.318 INFO:tasks.ceph:role: osd.7 2023-10-25T16:12:38.318 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:12:38.318 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-25T16:12:38.382 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T16:12:38.382 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T16:12:38.382 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T16:12:38.383 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T16:12:38.383 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T16:12:38.383 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-25T16:12:38.383 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T16:12:38.383 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T16:12:38.383 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T16:12:38.384 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T16:12:38.806 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-10-25T16:12:38.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-25T16:12:38.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-25T16:12:38.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-25T16:12:38.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:12:38.952 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-25T16:12:38.952 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:39.063 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.059+0000 7efe096e6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-25T16:12:39.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.063+0000 7efe096e6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-25T16:12:39.072 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.067+0000 7efe096e6640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-10-25T16:12:39.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-25T16:12:39.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:39.185 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.179+0000 7f6dac59a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-25T16:12:39.186 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.183+0000 7f6dac59a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-25T16:12:39.192 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.187+0000 7f6dac59a640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-10-25T16:12:39.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-25T16:12:39.264 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:39.343 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.339+0000 7fd111ede640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-25T16:12:39.349 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.343+0000 7fd111ede640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-25T16:12:39.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.351+0000 7fd111ede640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-10-25T16:12:39.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-25T16:12:39.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:39.516 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.511+0000 7effada16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-25T16:12:39.523 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.519+0000 7effada16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-25T16:12:39.531 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:39.527+0000 7effada16640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-10-25T16:12:39.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-25T16:12:39.614 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-25T16:12:39.615 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-25T16:12:39.630 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-25T16:12:39.685 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-25T16:12:39.741 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.742 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-25T16:12:39.796 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.797 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-25T16:12:39.849 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-25T16:12:39.905 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:39.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-25T16:12:39.960 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:39.961 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-25T16:12:39.975 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:39.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-25T16:12:40.030 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.030 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-25T16:12:40.085 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-25T16:12:40.141 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-25T16:12:40.197 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.198 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-25T16:12:40.252 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-25T16:12:40.305 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:40.305 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-25T16:12:40.311 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:40.312 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-25T16:12:40.358 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.358 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-25T16:12:40.363 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:40.364 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-25T16:12:40.410 INFO:tasks.ceph:Adding keys to all mons... 2023-10-25T16:12:40.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-25T16:12:40.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-25T16:12:40.459 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2023-10-25T16:12:40.460 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg== 2023-10-25T16:12:40.460 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-10-25T16:12:40.460 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw== 2023-10-25T16:12:40.460 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-10-25T16:12:40.461 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w== 2023-10-25T16:12:40.461 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2023-10-25T16:12:40.461 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ== 2023-10-25T16:12:40.461 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2023-10-25T16:12:40.461 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw== 2023-10-25T16:12:40.462 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2023-10-25T16:12:40.462 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w== 2023-10-25T16:12:40.462 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2023-10-25T16:12:40.462 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA== 2023-10-25T16:12:40.463 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2023-10-25T16:12:40.463 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug== 2023-10-25T16:12:40.463 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-10-25T16:12:40.463 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw== 2023-10-25T16:12:40.463 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-10-25T16:12:40.463 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA== 2023-10-25T16:12:40.464 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2023-10-25T16:12:40.464 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg== 2023-10-25T16:12:40.464 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2023-10-25T16:12:40.464 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw== 2023-10-25T16:12:40.464 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2023-10-25T16:12:40.465 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ== 2023-10-25T16:12:40.465 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2023-10-25T16:12:40.465 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w== 2023-10-25T16:12:40.465 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:12:40.465 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:12:40.466 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2023-10-25T16:12:40.466 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg== 2023-10-25T16:12:40.466 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2023-10-25T16:12:40.466 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA== 2023-10-25T16:12:40.466 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2023-10-25T16:12:40.466 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q== 2023-10-25T16:12:40.468 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-10-25T16:12:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg== 2023-10-25T16:12:40.468 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-25T16:12:40.468 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw== 2023-10-25T16:12:40.468 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-25T16:12:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w== 2023-10-25T16:12:40.469 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-10-25T16:12:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ== 2023-10-25T16:12:40.469 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-10-25T16:12:40.469 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw== 2023-10-25T16:12:40.470 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-10-25T16:12:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w== 2023-10-25T16:12:40.470 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-10-25T16:12:40.470 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA== 2023-10-25T16:12:40.471 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-10-25T16:12:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug== 2023-10-25T16:12:40.471 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-25T16:12:40.471 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw== 2023-10-25T16:12:40.472 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-25T16:12:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA== 2023-10-25T16:12:40.472 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-10-25T16:12:40.472 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg== 2023-10-25T16:12:40.472 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-10-25T16:12:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw== 2023-10-25T16:12:40.473 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-10-25T16:12:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ== 2023-10-25T16:12:40.473 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-10-25T16:12:40.473 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w== 2023-10-25T16:12:40.473 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-10-25T16:12:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:12:40.474 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-10-25T16:12:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg== 2023-10-25T16:12:40.474 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-10-25T16:12:40.474 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA== 2023-10-25T16:12:40.475 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-10-25T16:12:40.475 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q== 2023-10-25T16:12:40.476 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T16:12:40.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T16:12:40.561 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:40.563 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:40.650 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:40.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:40.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.871 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:40.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.045 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T16:12:41.083 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T16:12:41.135 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:41.166 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:41.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:41.226 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T16:12:41.306 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.394 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.472 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.475 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.551 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T16:12:41.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.639 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.723 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.801 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T16:12:41.978 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-25T16:12:41.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-25T16:12:41.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-25T16:12:42.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-25T16:12:42.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-25T16:12:42.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-25T16:12:42.207 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-25T16:12:42.218 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-25T16:12:42.275 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-25T16:12:42.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-25T16:12:42.383 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:42.386 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-25T16:12:42.429 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-25T16:12:42.430 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-25T16:12:42.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-25T16:12:42.435 INFO:tasks.ceph.mon.a:Started 2023-10-25T16:12:42.436 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-25T16:12:42.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-25T16:12:42.475 INFO:tasks.ceph.mon.b:Started 2023-10-25T16:12:42.475 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-25T16:12:42.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-25T16:12:42.478 INFO:tasks.ceph.mon.c:Started 2023-10-25T16:12:42.478 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-25T16:12:42.478 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-25T16:12:42.479 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-25T16:12:42.482 INFO:tasks.ceph.mgr.y:Started 2023-10-25T16:12:42.482 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-25T16:12:42.482 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-25T16:12:42.485 INFO:tasks.ceph.mgr.x:Started 2023-10-25T16:12:42.485 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2023-10-25T16:12:42.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-10-25T16:12:42.487 INFO:tasks.ceph:setting config [client] debug_client = 20 2023-10-25T16:12:42.488 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set client debug_client 20 2023-10-25T16:12:42.534 INFO:tasks.ceph:setting config [client] debug_ms = 1 2023-10-25T16:12:42.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set client debug_ms 1 2023-10-25T16:12:42.578 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2023-10-25T16:12:42.578 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-10-25T16:12:42.626 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2023-10-25T16:12:42.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-10-25T16:12:42.670 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2023-10-25T16:12:42.671 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-10-25T16:12:42.714 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2023-10-25T16:12:42.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-10-25T16:12:42.758 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2023-10-25T16:12:42.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-10-25T16:12:42.804 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2023-10-25T16:12:42.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-10-25T16:12:42.850 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2023-10-25T16:12:42.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-10-25T16:12:42.894 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2023-10-25T16:12:42.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-10-25T16:12:42.938 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2023-10-25T16:12:42.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-10-25T16:12:42.982 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2023-10-25T16:12:42.983 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-10-25T16:12:43.030 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2023-10-25T16:12:43.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-10-25T16:12:43.074 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2023-10-25T16:12:43.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-10-25T16:12:43.118 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2023-10-25T16:12:43.119 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-10-25T16:12:43.162 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2023-10-25T16:12:43.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-10-25T16:12:43.206 DEBUG:tasks.ceph:set 17 configs 2023-10-25T16:12:43.207 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.035+0000 7fd8ddffb640 1 -- 172.21.15.177:0/1566938202 <== mon.1 v2:172.21.15.184:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v2)=0 v2) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd8e4003d40 con 0x7fd8cc003bb0 2023-10-25T16:12:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.051+0000 7fd8ef42a640 1 -- 172.21.15.177:0/1566938202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8cc003bb0 msgr2=0x7fd8e8200d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.051+0000 7fd8ef42a640 1 --2- 172.21.15.177:0/1566938202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8cc003bb0 0x7fd8e8200d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4013880 tx=0x7fd8e4013d40 comp rx=0 tx=0).stop 2023-10-25T16:12:48.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 -- 172.21.15.177:0/1566938202 shutdown_connections 2023-10-25T16:12:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 --2- 172.21.15.177:0/1566938202 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8cc009980 0x7fd8e8140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 --2- 172.21.15.177:0/1566938202 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8cc0047d0 0x7fd8e81408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 --2- 172.21.15.177:0/1566938202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8cc003bb0 0x7fd8e8200d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 -- 172.21.15.177:0/1566938202 >> 172.21.15.177:0/1566938202 conn(0x7fd8e80cdf10 msgr2=0x7fd8e80cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 -- 172.21.15.177:0/1566938202 shutdown_connections 2023-10-25T16:12:48.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.059+0000 7fd8ef42a640 1 -- 172.21.15.177:0/1566938202 wait complete. 2023-10-25T16:12:48.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.079+0000 7f3e77cad640 1 -- 172.21.15.177:0/3109740717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f3e4c0050d0 con 0x7f3e7015bc40 2023-10-25T16:12:48.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7fa4eb1dd640 1 -- 172.21.15.177:0/1053378925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7fa4e404daf0 con 0x7fa4d4003980 2023-10-25T16:12:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7fa93d7fa640 1 -- 172.21.15.177:0/1858461328 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fa93801c7b0 con 0x7fa940159210 2023-10-25T16:12:48.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7f73f2ffd640 1 -- 172.21.15.177:0/740004872 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f73f4011d40 con 0x7f73fc0ce630 2023-10-25T16:12:48.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7fe67d7fa640 1 -- 172.21.15.177:0/1816354036 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fe670005410 con 0x7fe68014d2c0 2023-10-25T16:12:48.088 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:48.083+0000 7f7d2c388180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-25T16:12:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7f3e667fc640 1 -- 172.21.15.177:0/3109740717 <== mon.0 v2:172.21.15.177:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v3)=0 v3) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3e6801b9c0 con 0x7f3e7015bc40 2023-10-25T16:12:48.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7f3e667fc640 1 -- 172.21.15.177:0/3109740717 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f3e6801bbe0 con 0x7f3e7015bc40 2023-10-25T16:12:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7f5ba2ffd640 1 -- 172.21.15.177:0/465154470 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f5ba80b6780 con 0x7f5b9c004d60 2023-10-25T16:12:48.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7ff4fe7fc640 1 -- 172.21.15.177:0/368195054 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7ff4f801ec10 con 0x7ff4f4004d60 2023-10-25T16:12:48.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7fd5dcff9640 1 -- 172.21.15.177:0/1652860126 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fd5d8006820 con 0x7fd5e0158090 2023-10-25T16:12:48.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.083+0000 7fdebaffd640 1 -- 172.21.15.177:0/2919999033 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fdec00047b0 con 0x7fdeb0003980 2023-10-25T16:12:48.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.087+0000 7f24d5ffb640 1 -- 172.21.15.177:0/2534693857 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f24d001dc60 con 0x7f24c40047d0 2023-10-25T16:12:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.087+0000 7ff8a37fe640 1 -- 172.21.15.177:0/273669317 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7ff8b00279f0 con 0x7ff8a40047d0 2023-10-25T16:12:48.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.087+0000 7fe0777fe640 1 -- 172.21.15.177:0/281676789 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fe084004ae0 con 0x7fe0780047d0 2023-10-25T16:12:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.087+0000 7f8e50ff9640 1 -- 172.21.15.177:0/2502438168 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7f8e440275f0 con 0x7f8e40004d60 2023-10-25T16:12:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.087+0000 7fa4e17fa640 1 -- 172.21.15.177:0/1053378925 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fa4d8003e20 con 0x7fa4d4003980 2023-10-25T16:12:48.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.087+0000 7fdae5ffb640 1 -- 172.21.15.177:0/1152222434 <== mon.1 v2:172.21.15.184:3300/0 8 ==== config(2 keys) v1 ==== 54+0+0 (secure 0 0 0) 0x7fdaec012de0 con 0x7fdadc003980 2023-10-25T16:12:48.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.095+0000 7f5bb8fe4640 1 -- 172.21.15.177:0/465154470 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f5b8c0052c0 con 0x7f5b9c004d60 2023-10-25T16:12:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.095+0000 7f3e53fff640 1 -- 172.21.15.177:0/3109740717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e7015bc40 msgr2=0x7f3e701407b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.095+0000 7f3e53fff640 1 --2- 172.21.15.177:0/3109740717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e7015bc40 0x7f3e701407b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006db30 tx=0x7f3e68009e40 comp rx=0 tx=0).stop 2023-10-25T16:12:48.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.099+0000 7fa4e17fa640 1 -- 172.21.15.177:0/1053378925 <== mon.1 v2:172.21.15.184:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v4)=0 v4) v1 ==== 108+0+0 (secure 0 0 0) 0x7fa4d8029750 con 0x7fa4d4003980 2023-10-25T16:12:48.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 -- 172.21.15.177:0/3109740717 shutdown_connections 2023-10-25T16:12:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 --2- 172.21.15.177:0/3109740717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e7015bc40 0x7f3e701407b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 --2- 172.21.15.177:0/3109740717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e70142130 0x7f3e7015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 --2- 172.21.15.177:0/3109740717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c004d10 0x7f3e700b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 -- 172.21.15.177:0/3109740717 >> 172.21.15.177:0/3109740717 conn(0x7f3e700ce000 msgr2=0x7f3e70071310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 -- 172.21.15.177:0/3109740717 shutdown_connections 2023-10-25T16:12:48.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f5ba2ffd640 1 -- 172.21.15.177:0/465154470 <== mon.0 v2:172.21.15.177:3300/0 9 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v5)=0 v5) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5ba8012950 con 0x7f5b9c004d60 2023-10-25T16:12:48.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7f3e53fff640 1 -- 172.21.15.177:0/3109740717 wait complete. 2023-10-25T16:12:48.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.103+0000 7fdaf7941640 1 -- 172.21.15.177:0/1152222434 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7fdac80052c0 con 0x7fdadc003980 2023-10-25T16:12:48.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.115+0000 7fdae5ffb640 1 -- 172.21.15.177:0/1152222434 <== mon.1 v2:172.21.15.184:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v6)=0 v6) v1 ==== 106+0+0 (secure 0 0 0) 0x7fdaec02a030 con 0x7fdadc003980 2023-10-25T16:12:48.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.119+0000 7fdaf7941640 1 -- 172.21.15.177:0/1152222434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdadc003980 msgr2=0x7fdaf00c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.119+0000 7fdaf7941640 1 --2- 172.21.15.177:0/1152222434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdadc003980 0x7fdaf00c6170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdaec010fc0 tx=0x7fdaec00e700 comp rx=0 tx=0).stop 2023-10-25T16:12:48.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 -- 172.21.15.177:0/465154470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9c004d60 msgr2=0x7f5bb40c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 --2- 172.21.15.177:0/465154470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9c004d60 0x7f5bb40c7630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000c10 tx=0x7f5b9c005800 comp rx=0 tx=0).stop 2023-10-25T16:12:48.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 -- 172.21.15.177:0/1053378925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4d4003980 msgr2=0x7fa4e4141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 --2- 172.21.15.177:0/1053378925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4d4003980 0x7fa4e4141a10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8005fd0 tx=0x7fa4d8011e90 comp rx=0 tx=0).stop 2023-10-25T16:12:48.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 -- 172.21.15.177:0/1152222434 shutdown_connections 2023-10-25T16:12:48.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 -- 172.21.15.177:0/1053378925 shutdown_connections 2023-10-25T16:12:48.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 --2- 172.21.15.177:0/1053378925 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4d4005260 0x7fa4e40b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 --2- 172.21.15.177:0/1053378925 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4d40047d0 0x7fa4e41fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 --2- 172.21.15.177:0/1053378925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4d4003980 0x7fa4e4141a10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 -- 172.21.15.177:0/1053378925 >> 172.21.15.177:0/1053378925 conn(0x7fa4e40cdf10 msgr2=0x7fa4e40cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 -- 172.21.15.177:0/1053378925 shutdown_connections 2023-10-25T16:12:48.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 --2- 172.21.15.177:0/1152222434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdaf00cdcf0 0x7fdaf0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fa4eb1dd640 1 -- 172.21.15.177:0/1053378925 wait complete. 2023-10-25T16:12:48.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 -- 172.21.15.177:0/465154470 shutdown_connections 2023-10-25T16:12:48.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 --2- 172.21.15.177:0/1152222434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdadc004d60 0x7fdaf015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 --2- 172.21.15.177:0/1152222434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdadc003980 0x7fdaf00c6170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 -- 172.21.15.177:0/1152222434 >> 172.21.15.177:0/1152222434 conn(0x7fdaf0097a40 msgr2=0x7fdaf00abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 --2- 172.21.15.177:0/465154470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bb40ccdd0 0x7f5bb40b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 -- 172.21.15.177:0/1152222434 shutdown_connections 2023-10-25T16:12:48.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7fdaf7941640 1 -- 172.21.15.177:0/1152222434 wait complete. 2023-10-25T16:12:48.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 --2- 172.21.15.177:0/465154470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b9c004d60 0x7f5bb40c7630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 --2- 172.21.15.177:0/465154470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b9c003fe0 0x7f5bb4158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 -- 172.21.15.177:0/465154470 >> 172.21.15.177:0/465154470 conn(0x7f5bb40b0ae0 msgr2=0x7f5bb4159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 -- 172.21.15.177:0/465154470 shutdown_connections 2023-10-25T16:12:48.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.123+0000 7f5ba0ff9640 1 -- 172.21.15.177:0/465154470 wait complete. 2023-10-25T16:12:48.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.135+0000 7f8e5a56d640 1 -- 172.21.15.177:0/2502438168 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) v1 -- 0x7f8e2c0052c0 con 0x7f8e40004d60 2023-10-25T16:12:48.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7ff4fe7fc640 1 -- 172.21.15.177:0/368195054 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7ff4f801eda0 con 0x7ff4f4004d60 2023-10-25T16:12:48.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7f73f2ffd640 1 -- 172.21.15.177:0/740004872 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f73f40103d0 con 0x7f73fc0ce630 2023-10-25T16:12:48.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7fe67d7fa640 1 -- 172.21.15.177:0/1816354036 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7fe67001c410 con 0x7fe68014d2c0 2023-10-25T16:12:48.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7fdebaffd640 1 -- 172.21.15.177:0/2919999033 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7fdec0004a00 con 0x7fdeb0003980 2023-10-25T16:12:48.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7fa93d7fa640 1 -- 172.21.15.177:0/1858461328 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7fa93801c970 con 0x7fa940159210 2023-10-25T16:12:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7fd5dcff9640 1 -- 172.21.15.177:0/1652860126 <== mon.0 v2:172.21.15.177:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7fd5d80b0450 con 0x7fd5e0158090 2023-10-25T16:12:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7f7400cd5640 1 -- 172.21.15.177:0/740004872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7f73d40052e0 con 0x7f73fc0ce630 2023-10-25T16:12:48.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.143+0000 7f24e791b640 1 -- 172.21.15.177:0/2534693857 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f24bc0052c0 con 0x7f24c40047d0 2023-10-25T16:12:48.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.147+0000 7f24d5ffb640 1 -- 172.21.15.177:0/2534693857 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f24d001ddd0 con 0x7f24c40047d0 2023-10-25T16:12:48.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.147+0000 7ff8a37fe640 1 -- 172.21.15.177:0/273669317 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7ff8b0027bb0 con 0x7ff8a40047d0 2023-10-25T16:12:48.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.147+0000 7f8e50ff9640 1 -- 172.21.15.177:0/2502438168 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7f8e4401c430 con 0x7f8e40004d60 2023-10-25T16:12:48.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.147+0000 7fe0777fe640 1 -- 172.21.15.177:0/281676789 <== mon.1 v2:172.21.15.184:3300/0 9 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7fe084026440 con 0x7fe0780047d0 2023-10-25T16:12:48.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7f8e50ff9640 1 -- 172.21.15.177:0/2502438168 <== mon.1 v2:172.21.15.184:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v7)=0 v7) v1 ==== 114+0+0 (secure 0 0 0) 0x7f8e4401c620 con 0x7f8e40004d60 2023-10-25T16:12:48.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7f73f2ffd640 1 -- 172.21.15.177:0/740004872 <== mon.0 v2:172.21.15.177:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v8)=0 v8) v1 ==== 123+0+0 (secure 0 0 0) 0x7f73f40105c0 con 0x7f73fc0ce630 2023-10-25T16:12:48.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7ff8c127d640 1 -- 172.21.15.177:0/273669317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7ff8940052c0 con 0x7ff8a40047d0 2023-10-25T16:12:48.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7f73f2ffd640 1 -- 172.21.15.177:0/740004872 <== mon.0 v2:172.21.15.177:3300/0 11 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f73f4010970 con 0x7f73fc0ce630 2023-10-25T16:12:48.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7f8e5a56d640 1 -- 172.21.15.177:0/2502438168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e40004d60 msgr2=0x7f8e540c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7f8e5a56d640 1 --2- 172.21.15.177:0/2502438168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e40004d60 0x7f8e540c2310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400cdb0 tx=0x7f8e4400e7c0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7fe67d7fa640 1 -- 172.21.15.177:0/1816354036 <== mon.0 v2:172.21.15.177:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fe67001c6d0 con 0x7fe68014d2c0 2023-10-25T16:12:48.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7ff4fe7fc640 1 -- 172.21.15.177:0/368195054 <== mon.0 v2:172.21.15.177:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7ff4f801d3d0 con 0x7ff4f4004d60 2023-10-25T16:12:48.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7fa93d7fa640 1 -- 172.21.15.177:0/1858461328 <== mon.0 v2:172.21.15.177:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fa93801b3d0 con 0x7fa940159210 2023-10-25T16:12:48.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7fd5dcff9640 1 -- 172.21.15.177:0/1652860126 <== mon.0 v2:172.21.15.177:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fd5d80b0640 con 0x7fd5e0158090 2023-10-25T16:12:48.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.151+0000 7fdebaffd640 1 -- 172.21.15.177:0/2919999033 <== mon.0 v2:172.21.15.177:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fdec00264c0 con 0x7fdeb0003980 2023-10-25T16:12:48.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 -- 172.21.15.177:0/740004872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73fc0ce630 msgr2=0x7f73fc0caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 --2- 172.21.15.177:0/740004872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73fc0ce630 0x7f73fc0caa20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0cbd60 tx=0x7f73f40139c0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 -- 172.21.15.177:0/2502438168 shutdown_connections 2023-10-25T16:12:48.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 --2- 172.21.15.177:0/2502438168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e540c8b30 0x7f8e54154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 --2- 172.21.15.177:0/2502438168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e540cdcf0 0x7f8e540c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 --2- 172.21.15.177:0/2502438168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e40004d60 0x7f8e540c2310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 -- 172.21.15.177:0/2502438168 >> 172.21.15.177:0/2502438168 conn(0x7f8e54097a40 msgr2=0x7f8e54158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 -- 172.21.15.177:0/2502438168 shutdown_connections 2023-10-25T16:12:48.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7fe09578d640 1 -- 172.21.15.177:0/281676789 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7fe0680052c0 con 0x7fe0780047d0 2023-10-25T16:12:48.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f8e5a56d640 1 -- 172.21.15.177:0/2502438168 wait complete. 2023-10-25T16:12:48.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 -- 172.21.15.177:0/740004872 shutdown_connections 2023-10-25T16:12:48.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 --2- 172.21.15.177:0/740004872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73fc0ce630 0x7f73fc0caa20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 --2- 172.21.15.177:0/740004872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73e8004e30 0x7f73fc0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 --2- 172.21.15.177:0/740004872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73e80039d0 0x7f73fc15aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 -- 172.21.15.177:0/740004872 >> 172.21.15.177:0/740004872 conn(0x7f73fc06a830 msgr2=0x7f73fc0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 -- 172.21.15.177:0/740004872 shutdown_connections 2023-10-25T16:12:48.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f73f0ff9640 1 -- 172.21.15.177:0/740004872 wait complete. 2023-10-25T16:12:48.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.163+0000 7fe68722e640 1 -- 172.21.15.177:0/1816354036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7fe6580052e0 con 0x7fe68014d2c0 2023-10-25T16:12:48.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7fe0777fe640 1 -- 172.21.15.177:0/281676789 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fe08401dbb0 con 0x7fe0780047d0 2023-10-25T16:12:48.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.163+0000 7fa946ccc640 1 -- 172.21.15.177:0/1858461328 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7fa9180052c0 con 0x7fa940159210 2023-10-25T16:12:48.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7f24d5ffb640 1 -- 172.21.15.177:0/2534693857 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f24d002f4c0 con 0x7f24c40047d0 2023-10-25T16:12:48.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.155+0000 7ff8a37fe640 1 -- 172.21.15.177:0/273669317 <== mon.1 v2:172.21.15.184:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7ff8b001d8e0 con 0x7ff8a40047d0 2023-10-25T16:12:48.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.167+0000 7f24d5ffb640 1 -- 172.21.15.177:0/2534693857 <== mon.1 v2:172.21.15.184:3300/0 11 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v9)=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7f24d002f790 con 0x7f24c40047d0 2023-10-25T16:12:48.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 -- 172.21.15.177:0/2534693857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c40047d0 msgr2=0x7f24e00c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 --2- 172.21.15.177:0/2534693857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c40047d0 0x7f24e00c6aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00b050 tx=0x7f24d0013d00 comp rx=0 tx=0).stop 2023-10-25T16:12:48.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 -- 172.21.15.177:0/2534693857 shutdown_connections 2023-10-25T16:12:48.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 --2- 172.21.15.177:0/2534693857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c4009980 0x7f24e00c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 --2- 172.21.15.177:0/2534693857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24c40047d0 0x7f24e00c6aa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 --2- 172.21.15.177:0/2534693857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24c4003bb0 0x7f24e014c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 -- 172.21.15.177:0/2534693857 >> 172.21.15.177:0/2534693857 conn(0x7f24e00b0ae0 msgr2=0x7f24e015b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 -- 172.21.15.177:0/2534693857 shutdown_connections 2023-10-25T16:12:48.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7f24e791b640 1 -- 172.21.15.177:0/2534693857 wait complete. 2023-10-25T16:12:48.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.171+0000 7fdecc666640 1 -- 172.21.15.177:0/2919999033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7fdea00052c0 con 0x7fdeb0003980 2023-10-25T16:12:48.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.175+0000 7ff8a37fe640 1 -- 172.21.15.177:0/273669317 <== mon.1 v2:172.21.15.184:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v10)=0 v10) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff8b002c0b0 con 0x7ff8a40047d0 2023-10-25T16:12:48.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.179+0000 7ff50ffa7640 1 -- 172.21.15.177:0/368195054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7ff4e40052e0 con 0x7ff4f4004d60 2023-10-25T16:12:48.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.179+0000 7fe0777fe640 1 -- 172.21.15.177:0/281676789 <== mon.1 v2:172.21.15.184:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v11)=0 v11) v1 ==== 117+0+0 (secure 0 0 0) 0x7fe084026630 con 0x7fe0780047d0 2023-10-25T16:12:48.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 -- 172.21.15.177:0/281676789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780047d0 msgr2=0x7fe0900a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 --2- 172.21.15.177:0/281676789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780047d0 0x7fe0900a84b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0840058d0 tx=0x7fe084013ec0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 -- 172.21.15.177:0/281676789 shutdown_connections 2023-10-25T16:12:48.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 --2- 172.21.15.177:0/281676789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0780052b0 0x7fe0900a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 --2- 172.21.15.177:0/281676789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0780047d0 0x7fe0900a84b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 --2- 172.21.15.177:0/281676789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe078003980 0x7fe0901461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 -- 172.21.15.177:0/281676789 >> 172.21.15.177:0/281676789 conn(0x7fe0900af5b0 msgr2=0x7fe0900ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 -- 172.21.15.177:0/281676789 shutdown_connections 2023-10-25T16:12:48.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fe09578d640 1 -- 172.21.15.177:0/281676789 wait complete. 2023-10-25T16:12:48.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa93d7fa640 1 -- 172.21.15.177:0/1858461328 <== mon.0 v2:172.21.15.177:3300/0 11 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa938021060 con 0x7fa940159210 2023-10-25T16:12:48.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 -- 172.21.15.177:0/1858461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa940159210 msgr2=0x7fa9400c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 --2- 172.21.15.177:0/1858461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa940159210 0x7fa9400c8790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9400cd9c0 tx=0x7fa9380019c0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 -- 172.21.15.177:0/1858461328 shutdown_connections 2023-10-25T16:12:48.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 --2- 172.21.15.177:0/1858461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa940159210 0x7fa9400c8790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 --2- 172.21.15.177:0/1858461328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9300047d0 0x7fa9400c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 --2- 172.21.15.177:0/1858461328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9300039d0 0x7fa940157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 -- 172.21.15.177:0/1858461328 >> 172.21.15.177:0/1858461328 conn(0x7fa940097a40 msgr2=0x7fa9400ac3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 -- 172.21.15.177:0/1858461328 shutdown_connections 2023-10-25T16:12:48.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.183+0000 7fa946ccc640 1 -- 172.21.15.177:0/1858461328 wait complete. 2023-10-25T16:12:48.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.191+0000 7fd5e5c16640 1 -- 172.21.15.177:0/1652860126 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fd5b80052c0 con 0x7fd5e0158090 2023-10-25T16:12:48.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.191+0000 7fe67d7fa640 1 -- 172.21.15.177:0/1816354036 <== mon.0 v2:172.21.15.177:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe670004740 con 0x7fe68014d2c0 2023-10-25T16:12:48.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff4fe7fc640 1 -- 172.21.15.177:0/368195054 <== mon.0 v2:172.21.15.177:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4f8005080 con 0x7ff4f4004d60 2023-10-25T16:12:48.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fd5dcff9640 1 -- 172.21.15.177:0/1652860126 <== mon.0 v2:172.21.15.177:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5d80b0900 con 0x7fd5e0158090 2023-10-25T16:12:48.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fdebaffd640 1 -- 172.21.15.177:0/2919999033 <== mon.0 v2:172.21.15.177:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdec0026780 con 0x7fdeb0003980 2023-10-25T16:12:48.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe67d7fa640 1 -- 172.21.15.177:0/1816354036 <== mon.0 v2:172.21.15.177:3300/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe670000e90 con 0x7fe68014d2c0 2023-10-25T16:12:48.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8a37fe640 1 -- 172.21.15.177:0/273669317 <== mon.1 v2:172.21.15.184:3300/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff8b001ddc0 con 0x7ff8a40047d0 2023-10-25T16:12:48.200 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.201 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.201 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.201 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 -- 172.21.15.177:0/1816354036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe68014d2c0 msgr2=0x7fe6801581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 --2- 172.21.15.177:0/1816354036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe68014d2c0 0x7fe6801581d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe680070c40 tx=0x7fe670011c40 comp rx=0 tx=0).stop 2023-10-25T16:12:48.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 -- 172.21.15.177:0/1816354036 shutdown_connections 2023-10-25T16:12:48.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 --2- 172.21.15.177:0/1816354036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe68014d2c0 0x7fe6801581d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 --2- 172.21.15.177:0/1816354036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66c0053c0 0x7fe6800b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 --2- 172.21.15.177:0/1816354036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe66c003b60 0x7fe6801f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 -- 172.21.15.177:0/1816354036 >> 172.21.15.177:0/1816354036 conn(0x7fe6800b0ae0 msgr2=0x7fe6800cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 -- 172.21.15.177:0/273669317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a40047d0 msgr2=0x7ff8bc14c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 --2- 172.21.15.177:0/273669317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a40047d0 0x7ff8bc14c710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0000f70 tx=0x7ff8b0014830 comp rx=0 tx=0).stop 2023-10-25T16:12:48.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 -- 172.21.15.177:0/1816354036 shutdown_connections 2023-10-25T16:12:48.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7fe68722e640 1 -- 172.21.15.177:0/1816354036 wait complete. 2023-10-25T16:12:48.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 -- 172.21.15.177:0/273669317 shutdown_connections 2023-10-25T16:12:48.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 --2- 172.21.15.177:0/273669317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8a4005390 0x7ff8bc0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 --2- 172.21.15.177:0/273669317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8a40047d0 0x7ff8bc14c710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 --2- 172.21.15.177:0/273669317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8a40039d0 0x7ff8bc0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.195+0000 7ff8c127d640 1 -- 172.21.15.177:0/273669317 >> 172.21.15.177:0/273669317 conn(0x7ff8bc097a40 msgr2=0x7ff8bc0ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.199+0000 7ff8c127d640 1 -- 172.21.15.177:0/273669317 shutdown_connections 2023-10-25T16:12:48.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.199+0000 7ff8c127d640 1 -- 172.21.15.177:0/273669317 wait complete. 2023-10-25T16:12:48.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdebaffd640 1 -- 172.21.15.177:0/2919999033 <== mon.0 v2:172.21.15.177:3300/0 12 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v14)=0 v14) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdec0026b40 con 0x7fdeb0003980 2023-10-25T16:12:48.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 -- 172.21.15.177:0/2919999033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb0003980 msgr2=0x7fdec41ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 --2- 172.21.15.177:0/2919999033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb0003980 0x7fdec41ffa70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdea8007360 tx=0x7fdec000d7e0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 -- 172.21.15.177:0/2919999033 shutdown_connections 2023-10-25T16:12:48.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 --2- 172.21.15.177:0/2919999033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdec40ccdd0 0x7fdec40b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 --2- 172.21.15.177:0/2919999033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdeb0004d60 0x7fdec40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 --2- 172.21.15.177:0/2919999033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb0003980 0x7fdec41ffa70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 -- 172.21.15.177:0/2919999033 >> 172.21.15.177:0/2919999033 conn(0x7fdec40b0ae0 msgr2=0x7fdec406d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 -- 172.21.15.177:0/2919999033 shutdown_connections 2023-10-25T16:12:48.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.203+0000 7fdecc666640 1 -- 172.21.15.177:0/2919999033 wait complete. 2023-10-25T16:12:48.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.207+0000 7ff4fe7fc640 1 -- 172.21.15.177:0/368195054 <== mon.0 v2:172.21.15.177:3300/0 12 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4f8023070 con 0x7ff4f4004d60 2023-10-25T16:12:48.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 -- 172.21.15.177:0/368195054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f4004d60 msgr2=0x7ff5080c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 --2- 172.21.15.177:0/368195054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f4004d60 0x7ff5080c2f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80127f0 tx=0x7ff4f8012cb0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 -- 172.21.15.177:0/368195054 shutdown_connections 2023-10-25T16:12:48.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 --2- 172.21.15.177:0/368195054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5080af630 0x7ff5080c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 --2- 172.21.15.177:0/368195054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f4004d60 0x7ff5080c2f10 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80127f0 tx=0x7ff4f8012cb0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 --2- 172.21.15.177:0/368195054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4f4003fe0 0x7ff5080c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 -- 172.21.15.177:0/368195054 >> 172.21.15.177:0/368195054 conn(0x7ff5080b0ae0 msgr2=0x7ff5080cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 -- 172.21.15.177:0/368195054 shutdown_connections 2023-10-25T16:12:48.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.211+0000 7ff50ffa7640 1 -- 172.21.15.177:0/368195054 wait complete. 2023-10-25T16:12:48.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.219+0000 7fd5dcff9640 1 -- 172.21.15.177:0/1652860126 <== mon.0 v2:172.21.15.177:3300/0 12 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) v1 ==== 120+0+0 (secure 0 0 0) 0x7fd5d80b0c80 con 0x7fd5e0158090 2023-10-25T16:12:48.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 -- 172.21.15.177:0/1652860126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e0158090 msgr2=0x7fd5e014dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:48.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 --2- 172.21.15.177:0/1652860126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e0158090 0x7fd5e014dde0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8004000 tx=0x7fd5cc005800 comp rx=0 tx=0).stop 2023-10-25T16:12:48.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 -- 172.21.15.177:0/1652860126 shutdown_connections 2023-10-25T16:12:48.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 --2- 172.21.15.177:0/1652860126 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e0158090 0x7fd5e014dde0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 --2- 172.21.15.177:0/1652860126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5cc004d10 0x7fd5e014d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 --2- 172.21.15.177:0/1652860126 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5cc0039d0 0x7fd5e014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:48.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 -- 172.21.15.177:0/1652860126 >> 172.21.15.177:0/1652860126 conn(0x7fd5e00af3f0 msgr2=0x7fd5e006fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:48.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 -- 172.21.15.177:0/1652860126 shutdown_connections 2023-10-25T16:12:48.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:48.223+0000 7fd5e5c16640 1 -- 172.21.15.177:0/1652860126 wait complete. 2023-10-25T16:12:48.240 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.241 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.241 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.241 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.242 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.243 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.244 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi177') 2023-10-25T16:12:48.274 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:48.271+0000 7fb5ed969180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-25T16:12:48.676 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:48.671+0000 7f7d2c388180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-25T16:12:48.809 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:48.807+0000 7fb5ed969180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-25T16:12:48.859 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:48.855+0000 7f7d2c388180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-25T16:12:48.979 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:48.975+0000 7fb5ed969180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-25T16:12:49.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 -- 172.21.15.177:0/2410789135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88003b30 msgr2=0x7f7d880090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 --2- 172.21.15.177:0/2410789135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88003b30 0x7f7d880090f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7da40ca050 tx=0x7f7d9401e470 comp rx=0 tx=0).stop 2023-10-25T16:12:49.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 -- 172.21.15.177:0/2410789135 shutdown_connections 2023-10-25T16:12:49.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 --2- 172.21.15.177:0/2410789135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88009630 0x7f7d8800ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 --2- 172.21.15.177:0/2410789135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88003b30 0x7f7d880090f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 --2- 172.21.15.177:0/2410789135 >> v2:172.21.15.184:3300/0 conn(0x7f7d880061d0 0x7f7d88008610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 -- 172.21.15.177:0/2410789135 >> 172.21.15.177:0/2410789135 conn(0x7f7da40af5b0 msgr2=0x7f7da40af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:49.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 -- 172.21.15.177:0/2410789135 shutdown_connections 2023-10-25T16:12:49.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 -- 172.21.15.177:0/2410789135 wait complete. 2023-10-25T16:12:49.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 Processor -- start 2023-10-25T16:12:49.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.095+0000 7f7dab690640 1 -- start start 2023-10-25T16:12:49.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 0x7f7da4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d880061d0 0x7f7da41e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 0x7f7da41e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4156240 con 0x7f7d88009630 2023-10-25T16:12:49.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4151e80 con 0x7f7d880061d0 2023-10-25T16:12:49.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4155630 con 0x7f7d88003b30 2023-10-25T16:12:49.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 0x7f7da41e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 0x7f7da41e6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56946/0 (socket says 172.21.15.177:56946) 2023-10-25T16:12:49.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 -- 172.21.15.177:0/1780574232 learned_addr learned my addr 172.21.15.177:0/1780574232 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:12:49.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da8c2b640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d880061d0 0x7f7da41e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da942c640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 0x7f7da4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 -- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 msgr2=0x7f7da4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da942c640 1 -- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 msgr2=0x7f7da4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-25T16:12:49.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da942c640 1 -- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 msgr2=0x7f7da4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:49.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da942c640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 0x7f7da4151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:49.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da942c640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 0x7f7da4151940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:49.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 0x7f7da4151940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 -- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d880061d0 msgr2=0x7f7da41e5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d880061d0 0x7f7da41e5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 -- 172.21.15.177:0/1780574232 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94012970 con 0x7f7d88009630 2023-10-25T16:12:49.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7da9c2d640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 0x7f7da41e6380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7da406f5c0 tx=0x7f7d9c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:49.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c011870 con 0x7f7d88009630 2023-10-25T16:12:49.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d9c011ac0 con 0x7f7d88009630 2023-10-25T16:12:49.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da4155910 con 0x7f7d88009630 2023-10-25T16:12:49.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0103c0 con 0x7f7d88009630 2023-10-25T16:12:49.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da4155ed0 con 0x7f7d88009630 2023-10-25T16:12:49.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7d9c010520 con 0x7f7d88009630 2023-10-25T16:12:49.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7d9c01c530 con 0x7f7d88009630 2023-10-25T16:12:49.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.099+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da404daf0 con 0x7f7d88009630 2023-10-25T16:12:49.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.103+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7d9c0108c0 con 0x7f7d88009630 2023-10-25T16:12:49.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.163+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f7da415a190 con 0x7f7d88009630 2023-10-25T16:12:49.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7d99ffb640 1 -- 172.21.15.177:0/1780574232 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v17)=0 v17) v1 ==== 119+0+0 (secure 0 0 0) 0x7f7d9c010a60 con 0x7f7d88009630 2023-10-25T16:12:49.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 msgr2=0x7f7da41e6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 0x7f7da41e6380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7da406f5c0 tx=0x7f7d9c001a20 comp rx=0 tx=0).stop 2023-10-25T16:12:49.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 shutdown_connections 2023-10-25T16:12:49.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d88009630 0x7f7da41e6380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d880061d0 0x7f7da41e5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 --2- 172.21.15.177:0/1780574232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d88003b30 0x7f7da4151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 >> 172.21.15.177:0/1780574232 conn(0x7f7da40af5b0 msgr2=0x7f7da4156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:49.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 shutdown_connections 2023-10-25T16:12:49.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.167+0000 7f7dab690640 1 -- 172.21.15.177:0/1780574232 wait complete. 2023-10-25T16:12:49.188 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi177') 2023-10-25T16:12:49.189 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi177') 2023-10-25T16:12:49.189 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi177') 2023-10-25T16:12:49.189 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi177') 2023-10-25T16:12:49.190 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi177') 2023-10-25T16:12:49.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1650760815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 msgr2=0x7fe69000e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 --2- 172.21.15.177:0/1650760815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe69000e540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4061510 tx=0x7fe69c01c310 comp rx=0 tx=0).stop 2023-10-25T16:12:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1650760815 shutdown_connections 2023-10-25T16:12:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 --2- 172.21.15.177:0/1650760815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe69000e540 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1650760815 >> 172.21.15.177:0/1650760815 conn(0x7fe6a40cdf10 msgr2=0x7fe6a40ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1650760815 shutdown_connections 2023-10-25T16:12:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.315+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1650760815 wait complete. 2023-10-25T16:12:49.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 Processor -- start 2023-10-25T16:12:49.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- start start 2023-10-25T16:12:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe690003b70 0x7fe6a41f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe690007d80 0x7fe6a413cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe6a414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4151780 con 0x7fe69000c150 2023-10-25T16:12:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a415c7c0 con 0x7fe690007d80 2023-10-25T16:12:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a415c4e0 con 0x7fe690003b70 2023-10-25T16:12:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe6a414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe6a414e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56954/0 (socket says 172.21.15.177:56954) 2023-10-25T16:12:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 -- 172.21.15.177:0/1994920864 learned_addr learned my addr 172.21.15.177:0/1994920864 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:12:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a3fff640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe690007d80 0x7fe6a413cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a8e4a640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe690003b70 0x7fe6a41f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 -- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe690003b70 msgr2=0x7fe6a41f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe690003b70 0x7fe6a41f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 -- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe690007d80 msgr2=0x7fe6a413cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe690007d80 0x7fe6a413cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 -- 172.21.15.177:0/1994920864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a415d400 con 0x7fe69000c150 2023-10-25T16:12:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a964b640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe6a414e800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe69c019f40 tx=0x7fe69c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0b4070 con 0x7fe69000c150 2023-10-25T16:12:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe69c003e30 con 0x7fe69000c150 2023-10-25T16:12:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a413c790 con 0x7fe69000c150 2023-10-25T16:12:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0ad430 con 0x7fe69000c150 2023-10-25T16:12:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a41f1830 con 0x7fe69000c150 2023-10-25T16:12:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe69c0b7020 con 0x7fe69000c150 2023-10-25T16:12:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe69c0b93d0 con 0x7fe69000c150 2023-10-25T16:12:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.319+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a41f1a20 con 0x7fe69000c150 2023-10-25T16:12:49.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.323+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe69c0bf060 con 0x7fe69000c150 2023-10-25T16:12:49.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.383+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fe6a404daf0 con 0x7fe69000c150 2023-10-25T16:12:49.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6a17fa640 1 -- 172.21.15.177:0/1994920864 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe69c0b1030 con 0x7fe69000c150 2023-10-25T16:12:49.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 msgr2=0x7fe6a414e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe6a414e800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe69c019f40 tx=0x7fe69c003c40 comp rx=0 tx=0).stop 2023-10-25T16:12:49.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 shutdown_connections 2023-10-25T16:12:49.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69000c150 0x7fe6a414e800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe690007d80 0x7fe6a413cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 --2- 172.21.15.177:0/1994920864 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe690003b70 0x7fe6a41f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 >> 172.21.15.177:0/1994920864 conn(0x7fe6a40cdf10 msgr2=0x7fe6a40aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:49.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 shutdown_connections 2023-10-25T16:12:49.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.391+0000 7fe6ab0ae640 1 -- 172.21.15.177:0/1994920864 wait complete. 2023-10-25T16:12:49.416 INFO:tasks.ceph:Setting crush tunables to default 2023-10-25T16:12:49.417 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd crush tunables default 2023-10-25T16:12:49.430 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.427+0000 7f7d2c388180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-25T16:12:49.490 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.487+0000 7f7d2c388180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-25T16:12:49.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2013045190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c0acbc0 msgr2=0x7f7e4c159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2013045190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c0acbc0 0x7f7e4c159140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c06fb80 tx=0x7f7e4001c830 comp rx=0 tx=0).stop 2023-10-25T16:12:49.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2013045190 shutdown_connections 2023-10-25T16:12:49.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2013045190 >> v2:172.21.15.184:3300/0 conn(0x7f7e4c072ad0 0x7f7e4c0cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2013045190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c0acbc0 0x7f7e4c159140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2013045190 >> 172.21.15.177:0/2013045190 conn(0x7f7e4c069b20 msgr2=0x7f7e4c069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:49.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2013045190 shutdown_connections 2023-10-25T16:12:49.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2013045190 wait complete. 2023-10-25T16:12:49.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 Processor -- start 2023-10-25T16:12:49.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- start start 2023-10-25T16:12:49.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 0x7f7e4c136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e4c0acbc0 0x7f7e4c0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e4c157dc0 0x7f7e4c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:49.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c14d450 con 0x7f7e4c072ad0 2023-10-25T16:12:49.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c14d730 con 0x7f7e4c157dc0 2023-10-25T16:12:49.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c14da10 con 0x7f7e4c0acbc0 2023-10-25T16:12:49.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 0x7f7e4c136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 0x7f7e4c136f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56966/0 (socket says 172.21.15.177:56966) 2023-10-25T16:12:49.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 -- 172.21.15.177:0/2349077874 learned_addr learned my addr 172.21.15.177:0/2349077874 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:12:49.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4bfff640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e4c157dc0 0x7f7e4c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4affd640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e4c0acbc0 0x7f7e4c0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:49.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 -- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e4c0acbc0 msgr2=0x7f7e4c0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e4c0acbc0 0x7f7e4c0cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 -- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e4c157dc0 msgr2=0x7f7e4c14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e4c157dc0 0x7f7e4c14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 -- 172.21.15.177:0/2349077874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009560 con 0x7f7e4c072ad0 2023-10-25T16:12:49.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4bfff640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e4c157dc0 0x7f7e4c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:12:49.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e4b7fe640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 0x7f7e4c136f80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00b3e0 tx=0x7f7e3c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:49.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c011830 con 0x7f7e4c072ad0 2023-10-25T16:12:49.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e3c011aa0 con 0x7f7e4c072ad0 2023-10-25T16:12:49.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c14dcf0 con 0x7f7e4c072ad0 2023-10-25T16:12:49.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c010380 con 0x7f7e4c072ad0 2023-10-25T16:12:49.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c1374c0 con 0x7f7e4c072ad0 2023-10-25T16:12:49.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e3c0107e0 con 0x7f7e4c072ad0 2023-10-25T16:12:49.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.535+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7e3c01a890 con 0x7f7e4c072ad0 2023-10-25T16:12:49.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.539+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c04daf0 con 0x7f7e4c072ad0 2023-10-25T16:12:49.551 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.539+0000 7f7d2c388180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-25T16:12:49.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.539+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7e3c039b40 con 0x7f7e4c072ad0 2023-10-25T16:12:49.568 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.563+0000 7fb5ed969180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-25T16:12:49.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.595+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7e4c070d30 con 0x7f7e4c072ad0 2023-10-25T16:12:49.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.599+0000 7f7e33fff640 1 -- 172.21.15.177:0/2349077874 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7e3c028070 con 0x7f7e4c072ad0 2023-10-25T16:12:49.605 INFO:teuthology.orchestra.run.smithi177.stderr:adjusted tunables profile to default 2023-10-25T16:12:49.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 msgr2=0x7f7e4c136f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:49.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 0x7f7e4c136f80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00b3e0 tx=0x7f7e3c00b8a0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 shutdown_connections 2023-10-25T16:12:49.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e4c157dc0 0x7f7e4c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e4c0acbc0 0x7f7e4c0cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 --2- 172.21.15.177:0/2349077874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e4c072ad0 0x7f7e4c136f80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:49.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 >> 172.21.15.177:0/2349077874 conn(0x7f7e4c069b20 msgr2=0x7f7e4c0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:49.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 shutdown_connections 2023-10-25T16:12:49.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:49.603+0000 7f7e51d1e640 1 -- 172.21.15.177:0/2349077874 wait complete. 2023-10-25T16:12:49.619 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.615+0000 7f7d2c388180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-25T16:12:49.622 INFO:tasks.ceph:check_enable_crimson: False 2023-10-25T16:12:49.623 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-25T16:12:49.623 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:49.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-25T16:12:49.624 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.619+0000 7fb5ed969180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-25T16:12:49.635 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:49.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-25T16:12:49.671 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.667+0000 7f7d2c388180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-25T16:12:49.677 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.675+0000 7fb5ed969180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-25T16:12:49.687 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:49.688 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-25T16:12:49.739 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:12:49.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-25T16:12:49.747 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.743+0000 7f7d2c388180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-25T16:12:49.756 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.751+0000 7fb5ed969180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-25T16:12:49.766 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:49.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-25T16:12:49.780 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:49.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-25T16:12:49.799 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.795+0000 7f7d2c388180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-25T16:12:49.809 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.803+0000 7fb5ed969180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-25T16:12:49.811 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:49.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-25T16:12:49.864 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:12:49.864 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-25T16:12:49.885 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.883+0000 7fb5ed969180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-25T16:12:49.916 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-10-25T16:12:49.936 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:49.931+0000 7fb5ed969180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-25T16:12:49.940 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.935+0000 7f7d2c388180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-25T16:12:50.002 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:49.999+0000 7f7d2c388180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-25T16:12:50.060 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 -- 172.21.15.184:0/214722357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 msgr2=0x7f08f80cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.061 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 --2- 172.21.15.184:0/214722357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f80cbdb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08f806fad0 tx=0x7f08e801c870 comp rx=0 tx=0).stop 2023-10-25T16:12:50.061 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 -- 172.21.15.184:0/214722357 shutdown_connections 2023-10-25T16:12:50.061 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 --2- 172.21.15.184:0/214722357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f80cbdb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.061 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 --2- 172.21.15.184:0/214722357 >> v2:172.21.15.177:3300/0 conn(0x7f08f8151db0 0x7f08f80b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 -- 172.21.15.184:0/214722357 >> 172.21.15.184:0/214722357 conn(0x7f08f80af5b0 msgr2=0x7f08f80af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 -- 172.21.15.184:0/214722357 shutdown_connections 2023-10-25T16:12:50.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 -- 172.21.15.184:0/214722357 wait complete. 2023-10-25T16:12:50.064 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.055+0000 7f08fce10640 1 Processor -- start 2023-10-25T16:12:50.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- start start 2023-10-25T16:12:50.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f813b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08f806ce50 0x7f08f814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.065 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 0x7f08f814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f814a080 con 0x7f08f806ce50 2023-10-25T16:12:50.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8149da0 con 0x7f08f806c4f0 2023-10-25T16:12:50.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80b0d60 con 0x7f08f8151db0 2023-10-25T16:12:50.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.066 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f6d9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 0x7f08f814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.067 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f813b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39640/0 (socket says 172.21.15.184:39640) 2023-10-25T16:12:50.067 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 -- 172.21.15.184:0/450606532 learned_addr learned my addr 172.21.15.184:0/450606532 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:50.067 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f6d9d640 1 -- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 msgr2=0x7f08f814ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-10-25T16:12:50.067 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f6d9d640 1 -- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 msgr2=0x7f08f814ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:50.067 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f6d9d640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 0x7f08f814ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:50.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f6d9d640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 0x7f08f814ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:50.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f5d9b640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08f806ce50 0x7f08f814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 -- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 msgr2=0x7f08f814ad20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:50.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 0x7f08f814ad20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 -- 172.21.15.184:0/450606532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08f806ce50 msgr2=0x7f08f814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08f806ce50 0x7f08f814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 -- 172.21.15.184:0/450606532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8009560 con 0x7f08f806c4f0 2023-10-25T16:12:50.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08f659c640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f813b290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08f000ddf0 tx=0x7f08f000b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:50.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004d30 con 0x7f08f806c4f0 2023-10-25T16:12:50.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f08f000be40 con 0x7f08f806c4f0 2023-10-25T16:12:50.069 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f80b1040 con 0x7f08f806c4f0 2023-10-25T16:12:50.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000e8c0 con 0x7f08f806c4f0 2023-10-25T16:12:50.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f81498c0 con 0x7f08f806c4f0 2023-10-25T16:12:50.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08f000ed20 con 0x7f08f806c4f0 2023-10-25T16:12:50.070 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f08f0016780 con 0x7f08f806c4f0 2023-10-25T16:12:50.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.059+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f804daf0 con 0x7f08f806c4f0 2023-10-25T16:12:50.071 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.063+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f08f001f720 con 0x7f08f806c4f0 2023-10-25T16:12:50.074 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:50.071+0000 7fb5ed969180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-25T16:12:50.133 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.127+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f08f80b14f0 con 0x7f08f806c4f0 2023-10-25T16:12:50.134 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:50.131+0000 7fb5ed969180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-25T16:12:50.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08e6ffd640 1 -- 172.21.15.184:0/450606532 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f08f001f990 con 0x7f08f806c4f0 2023-10-25T16:12:50.139 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-10-25T16:12:50.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 msgr2=0x7f08f813b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f813b290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08f000ddf0 tx=0x7f08f000b730 comp rx=0 tx=0).stop 2023-10-25T16:12:50.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 shutdown_connections 2023-10-25T16:12:50.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08f8151db0 0x7f08f814ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08f806ce50 0x7f08f814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 --2- 172.21.15.184:0/450606532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08f806c4f0 0x7f08f813b290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 >> 172.21.15.184:0/450606532 conn(0x7f08f80af5b0 msgr2=0x7f08f814e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 shutdown_connections 2023-10-25T16:12:50.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.135+0000 7f08fce10640 1 -- 172.21.15.184:0/450606532 wait complete. 2023-10-25T16:12:50.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-10-25T16:12:50.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 -- 172.21.15.184:0/3782429546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2406bec0 msgr2=0x7f0f240aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/3782429546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2406bec0 0x7f0f240aff30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0f240b1750 tx=0x7f0f1c01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.265 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 -- 172.21.15.184:0/3782429546 shutdown_connections 2023-10-25T16:12:50.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/3782429546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f2406bec0 0x7f0f240aff30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/3782429546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406f570 0x7f0f2406b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/3782429546 >> v2:172.21.15.177:3300/0 conn(0x7f0f24140e90 0x7f0f240af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 -- 172.21.15.184:0/3782429546 >> 172.21.15.184:0/3782429546 conn(0x7f0f240b2450 msgr2=0x7f0f240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 -- 172.21.15.184:0/3782429546 shutdown_connections 2023-10-25T16:12:50.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.259+0000 7f0f2aa87640 1 -- 172.21.15.184:0/3782429546 wait complete. 2023-10-25T16:12:50.269 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 Processor -- start 2023-10-25T16:12:50.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- start start 2023-10-25T16:12:50.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 0x7f0f241f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f2406f570 0x7f0f2413a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 0x7f0f2413ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2413fda0 con 0x7f0f2406f570 2023-10-25T16:12:50.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241391d0 con 0x7f0f24140e90 2023-10-25T16:12:50.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2413eeb0 con 0x7f0f2406bec0 2023-10-25T16:12:50.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 0x7f0f2413ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f28823640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 0x7f0f241f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 0x7f0f2413ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39658/0 (socket says 172.21.15.184:39658) 2023-10-25T16:12:50.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 -- 172.21.15.184:0/1590213105 learned_addr learned my addr 172.21.15.184:0/1590213105 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:50.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f28823640 1 -- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 msgr2=0x7f0f241f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-10-25T16:12:50.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f28823640 1 -- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 msgr2=0x7f0f241f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:50.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f28823640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 0x7f0f241f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:50.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f28823640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 0x7f0f241f2480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:50.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f23fff640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f2406f570 0x7f0f2413a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 -- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 msgr2=0x7f0f241f2480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:50.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 0x7f0f241f2480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 -- 172.21.15.184:0/1590213105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f2406f570 msgr2=0x7f0f2413a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f2406f570 0x7f0f2413a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 -- 172.21.15.184:0/1590213105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c009820 con 0x7f0f24140e90 2023-10-25T16:12:50.274 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f29024640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 0x7f0f2413ac40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c01d090 tx=0x7f0f1c0a56c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:50.275 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0ba070 con 0x7f0f24140e90 2023-10-25T16:12:50.275 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f1c003af0 con 0x7f0f24140e90 2023-10-25T16:12:50.275 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c003f00 con 0x7f0f24140e90 2023-10-25T16:12:50.275 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2413f190 con 0x7f0f24140e90 2023-10-25T16:12:50.275 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2413f750 con 0x7f0f24140e90 2023-10-25T16:12:50.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f1c0b4040 con 0x7f0f24140e90 2023-10-25T16:12:50.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0f1c0053d0 con 0x7f0f24140e90 2023-10-25T16:12:50.276 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.263+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2404daf0 con 0x7f0f24140e90 2023-10-25T16:12:50.277 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.267+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0f1c0b2070 con 0x7f0f24140e90 2023-10-25T16:12:50.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.379+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f0f240ca670 con 0x7f0f24140e90 2023-10-25T16:12:50.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f217fa640 1 -- 172.21.15.184:0/1590213105 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0f1c0046e0 con 0x7f0f24140e90 2023-10-25T16:12:50.390 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:12:50.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 msgr2=0x7f0f2413ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 0x7f0f2413ac40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c01d090 tx=0x7f0f1c0a56c0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 shutdown_connections 2023-10-25T16:12:50.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f24140e90 0x7f0f2413ac40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f2406f570 0x7f0f2413a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 --2- 172.21.15.184:0/1590213105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0f2406bec0 0x7f0f241f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 >> 172.21.15.184:0/1590213105 conn(0x7f0f240b2450 msgr2=0x7f0f2413d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 shutdown_connections 2023-10-25T16:12:50.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.387+0000 7f0f2aa87640 1 -- 172.21.15.184:0/1590213105 wait complete. 2023-10-25T16:12:50.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-10-25T16:12:50.525 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 -- 172.21.15.184:0/2240900926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 msgr2=0x7f6be406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.525 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 --2- 172.21.15.184:0/2240900926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be406e010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009900 tx=0x7f6be001c890 comp rx=0 tx=0).stop 2023-10-25T16:12:50.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 -- 172.21.15.184:0/2240900926 shutdown_connections 2023-10-25T16:12:50.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 --2- 172.21.15.184:0/2240900926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be406e010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 -- 172.21.15.184:0/2240900926 >> 172.21.15.184:0/2240900926 conn(0x7f6be40cd6c0 msgr2=0x7f6be40cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 -- 172.21.15.184:0/2240900926 shutdown_connections 2023-10-25T16:12:50.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 -- 172.21.15.184:0/2240900926 wait complete. 2023-10-25T16:12:50.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 Processor -- start 2023-10-25T16:12:50.528 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.519+0000 7f6beb312640 1 -- start start 2023-10-25T16:12:50.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.533 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be406fda0 0x7f6be40aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40abda0 con 0x7f6be406fda0 2023-10-25T16:12:50.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40ac230 con 0x7f6be4159420 2023-10-25T16:12:50.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40ab190 con 0x7f6be406e550 2023-10-25T16:12:50.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54062/0 (socket says 172.21.15.184:54062) 2023-10-25T16:12:50.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 -- 172.21.15.184:0/1853919367 learned_addr learned my addr 172.21.15.184:0/1853919367 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:50.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 -- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 msgr2=0x7f6be4140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-25T16:12:50.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 -- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 msgr2=0x7f6be4140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:50.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:50.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be90ae640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:50.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be88ad640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be406fda0 0x7f6be40aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 -- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 msgr2=0x7f6be4140170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:50.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 -- 172.21.15.184:0/1853919367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be406fda0 msgr2=0x7f6be40aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be406fda0 0x7f6be40aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 -- 172.21.15.184:0/1853919367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009560 con 0x7f6be4159420 2023-10-25T16:12:50.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be88ad640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be406fda0 0x7f6be40aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:12:50.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6be98af640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be4154190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00c700 tx=0x7f6bdc00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:50.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc003b80 con 0x7f6be4159420 2023-10-25T16:12:50.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6bdc003ce0 con 0x7f6be4159420 2023-10-25T16:12:50.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be40ab470 con 0x7f6be4159420 2023-10-25T16:12:50.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00aa50 con 0x7f6be4159420 2023-10-25T16:12:50.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be40aba30 con 0x7f6be4159420 2023-10-25T16:12:50.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6bdc0050d0 con 0x7f6be4159420 2023-10-25T16:12:50.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6bdc012840 con 0x7f6be4159420 2023-10-25T16:12:50.544 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.523+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be404daf0 con 0x7f6be4159420 2023-10-25T16:12:50.544 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.527+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6bdc0124d0 con 0x7f6be4159420 2023-10-25T16:12:50.596 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.591+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f6be4073120 con 0x7f6be4159420 2023-10-25T16:12:50.603 INFO:tasks.ceph.mgr.x.smithi184.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-25T16:12:50.603 INFO:tasks.ceph.mgr.x.smithi184.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-25T16:12:50.603 INFO:tasks.ceph.mgr.x.smithi184.stderr: from numpy import show_config as show_numpy_config 2023-10-25T16:12:50.604 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.599+0000 7f6bd9ffb640 1 -- 172.21.15.184:0/1853919367 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6bdc012a00 con 0x7f6be4159420 2023-10-25T16:12:50.604 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-10-25T16:12:50.605 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.599+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 msgr2=0x7f6be4154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.599+0000 7f6beb312640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be4154190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00c700 tx=0x7f6bdc00cbc0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 shutdown_connections 2023-10-25T16:12:50.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be4159420 0x7f6be4154190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.606 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be406fda0 0x7f6be40aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.607 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 --2- 172.21.15.184:0/1853919367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6be406e550 0x7f6be4140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.607 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 >> 172.21.15.184:0/1853919367 conn(0x7f6be40cd6c0 msgr2=0x7f6be41511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.607 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 shutdown_connections 2023-10-25T16:12:50.607 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.603+0000 7f6beb312640 1 -- 172.21.15.184:0/1853919367 wait complete. 2023-10-25T16:12:50.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-10-25T16:12:50.674 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:50.671+0000 7f7d2c388180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-25T16:12:50.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 -- 172.21.15.184:0/823031416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c0afd80 msgr2=0x7f062c0ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 --2- 172.21.15.184:0/823031416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c0afd80 0x7f062c0ae700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0624009c80 tx=0x7f062401cc80 comp rx=0 tx=0).stop 2023-10-25T16:12:50.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 -- 172.21.15.184:0/823031416 shutdown_connections 2023-10-25T16:12:50.738 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 --2- 172.21.15.184:0/823031416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c0afd80 0x7f062c0ae700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.738 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 -- 172.21.15.184:0/823031416 >> 172.21.15.184:0/823031416 conn(0x7f062c097a40 msgr2=0x7f062c097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.738 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 -- 172.21.15.184:0/823031416 shutdown_connections 2023-10-25T16:12:50.738 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.731+0000 7f0632ee0640 1 -- 172.21.15.184:0/823031416 wait complete. 2023-10-25T16:12:50.741 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 Processor -- start 2023-10-25T16:12:50.741 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- start start 2023-10-25T16:12:50.742 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f062c0afd80 0x7f062c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.742 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.742 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 0x7f062c159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.742 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c153310 con 0x7f062c0afd80 2023-10-25T16:12:50.743 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c152690 con 0x7f062c159210 2023-10-25T16:12:50.743 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c152970 con 0x7f062c0cdcf0 2023-10-25T16:12:50.743 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 0x7f062c159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.743 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.744 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54068/0 (socket says 172.21.15.184:54068) 2023-10-25T16:12:50.744 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 0x7f062c159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39706/0 (socket says 172.21.15.184:39706) 2023-10-25T16:12:50.744 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 -- 172.21.15.184:0/1995516101 learned_addr learned my addr 172.21.15.184:0/1995516101 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:50.744 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 -- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 msgr2=0x7f062c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-25T16:12:50.744 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 -- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 msgr2=0x7f062c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:50.745 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:50.745 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0630c7c640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f062c0afd80 0x7f062c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.745 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f062bfff640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:50.745 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 -- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 msgr2=0x7f062c159800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:50.746 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.746 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 -- 172.21.15.184:0/1995516101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f062c0afd80 msgr2=0x7f062c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.746 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f062c0afd80 0x7f062c153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.746 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 -- 172.21.15.184:0/1995516101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240098e0 con 0x7f062c159210 2023-10-25T16:12:50.746 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0630c7c640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f062c0afd80 0x7f062c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:12:50.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f063147d640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 0x7f062c159d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06240ac000 tx=0x7f06240a5af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:50.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624004e60 con 0x7f062c159210 2023-10-25T16:12:50.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06240ad5b0 con 0x7f062c159210 2023-10-25T16:12:50.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c152c50 con 0x7f062c159210 2023-10-25T16:12:50.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240ad9a0 con 0x7f062c159210 2023-10-25T16:12:50.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c153c70 con 0x7f062c159210 2023-10-25T16:12:50.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f06240b4040 con 0x7f062c159210 2023-10-25T16:12:50.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0624004650 con 0x7f062c159210 2023-10-25T16:12:50.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.735+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c153450 con 0x7f062c159210 2023-10-25T16:12:50.749 INFO:tasks.ceph.mgr.y.smithi177.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-25T16:12:50.749 INFO:tasks.ceph.mgr.y.smithi177.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-25T16:12:50.750 INFO:tasks.ceph.mgr.y.smithi177.stderr: from numpy import show_config as show_numpy_config 2023-10-25T16:12:50.750 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.739+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f062c153450 con 0x7f062c159210 2023-10-25T16:12:50.809 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.807+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f062c153f20 con 0x7f062c159210 2023-10-25T16:12:50.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.811+0000 7f06297fa640 1 -- 172.21.15.184:0/1995516101 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f06240b2070 con 0x7f062c159210 2023-10-25T16:12:50.817 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-10-25T16:12:50.819 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 msgr2=0x7f062c159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.820 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 0x7f062c159d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06240ac000 tx=0x7f06240a5af0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.820 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 shutdown_connections 2023-10-25T16:12:50.820 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f062c159210 0x7f062c159d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.820 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f062c0cdcf0 0x7f062c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 --2- 172.21.15.184:0/1995516101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f062c0afd80 0x7f062c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 >> 172.21.15.184:0/1995516101 conn(0x7f062c097a40 msgr2=0x7f062c06d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 shutdown_connections 2023-10-25T16:12:50.821 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.815+0000 7f0632ee0640 1 -- 172.21.15.184:0/1995516101 wait complete. 2023-10-25T16:12:50.824 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:50.819+0000 7fb5ed969180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-25T16:12:50.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-10-25T16:12:50.837 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:50.831+0000 7f7d2c388180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-25T16:12:50.943 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- 172.21.15.184:0/3103871820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142130 msgr2=0x7f811c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.943 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 --2- 172.21.15.184:0/3103871820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142130 0x7f811c142510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8118009840 tx=0x7f811801c800 comp rx=0 tx=0).stop 2023-10-25T16:12:50.943 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- 172.21.15.184:0/3103871820 shutdown_connections 2023-10-25T16:12:50.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 --2- 172.21.15.184:0/3103871820 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142ba0 0x7f811c069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 --2- 172.21.15.184:0/3103871820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142130 0x7f811c142510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- 172.21.15.184:0/3103871820 >> 172.21.15.184:0/3103871820 conn(0x7f811c0ce000 msgr2=0x7f811c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:50.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- 172.21.15.184:0/3103871820 shutdown_connections 2023-10-25T16:12:50.944 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- 172.21.15.184:0/3103871820 wait complete. 2023-10-25T16:12:50.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 Processor -- start 2023-10-25T16:12:50.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- start start 2023-10-25T16:12:50.947 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f811c069c60 0x7f811c139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142ba0 0x7f811c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:50.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c13c120 con 0x7f811c142ba0 2023-10-25T16:12:50.948 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0b2580 con 0x7f811c069c60 2023-10-25T16:12:50.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812426d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0b2860 con 0x7f811c142130 2023-10-25T16:12:50.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54092/0 (socket says 172.21.15.184:54092) 2023-10-25T16:12:50.949 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8122009640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f811c069c60 0x7f811c139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 -- 172.21.15.184:0/2725380831 learned_addr learned my addr 172.21.15.184:0/2725380831 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:50.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 -- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 msgr2=0x7f811c13b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-25T16:12:50.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 -- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 msgr2=0x7f811c13b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:50.950 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:50.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f8121808640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:50.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.939+0000 7f812280a640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142ba0 0x7f811c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:50.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8122009640 1 -- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 msgr2=0x7f811c13b840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:50.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8122009640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.951 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8122009640 1 -- 172.21.15.184:0/2725380831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142ba0 msgr2=0x7f811c0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:50.952 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8122009640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142ba0 0x7f811c0b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:50.952 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8122009640 1 -- 172.21.15.184:0/2725380831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81180094a0 con 0x7f811c069c60 2023-10-25T16:12:50.952 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8122009640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f811c069c60 0x7f811c139f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81180ac000 tx=0x7f81180a6550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:50.952 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81180a6ba0 con 0x7f811c069c60 2023-10-25T16:12:50.952 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f81180a6e30 con 0x7f811c069c60 2023-10-25T16:12:50.953 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118003860 con 0x7f811c069c60 2023-10-25T16:12:50.953 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c0b2b40 con 0x7f811c069c60 2023-10-25T16:12:50.953 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c13bd80 con 0x7f811c069c60 2023-10-25T16:12:50.953 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c04daf0 con 0x7f811c069c60 2023-10-25T16:12:50.953 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f81180039c0 con 0x7f811c069c60 2023-10-25T16:12:50.954 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f81180aa070 con 0x7f811c069c60 2023-10-25T16:12:50.954 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:50.943+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f81180bc070 con 0x7f811c069c60 2023-10-25T16:12:50.990 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:50.987+0000 7fb5ed969180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-25T16:12:51.012 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.007+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f811c0b2ff0 con 0x7f811c069c60 2023-10-25T16:12:51.018 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f7d2c388180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-25T16:12:51.020 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f8112ffd640 1 -- 172.21.15.184:0/2725380831 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81180b8460 con 0x7f811c069c60 2023-10-25T16:12:51.020 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-10-25T16:12:51.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f811c069c60 msgr2=0x7f811c139f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f811c069c60 0x7f811c139f40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81180ac000 tx=0x7f81180a6550 comp rx=0 tx=0).stop 2023-10-25T16:12:51.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 shutdown_connections 2023-10-25T16:12:51.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f811c142ba0 0x7f811c0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f811c142130 0x7f811c13b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 --2- 172.21.15.184:0/2725380831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f811c069c60 0x7f811c139f40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 >> 172.21.15.184:0/2725380831 conn(0x7f811c0ce000 msgr2=0x7f811c159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 shutdown_connections 2023-10-25T16:12:51.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.015+0000 7f812426d640 1 -- 172.21.15.184:0/2725380831 wait complete. 2023-10-25T16:12:51.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-10-25T16:12:51.086 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:51.083+0000 7f7d2c388180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-25T16:12:51.144 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:51.139+0000 7fb5ed969180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-25T16:12:51.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/1837584013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 msgr2=0x7f9a8c0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/1837584013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 0x7f9a8c0cca30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009840 tx=0x7f9a8001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/1837584013 shutdown_connections 2023-10-25T16:12:51.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/1837584013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 0x7f9a8c0cca30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/1837584013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c155db0 0x7f9a8c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/1837584013 >> 172.21.15.184:0/1837584013 conn(0x7f9a8c0ce000 msgr2=0x7f9a8c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/1837584013 shutdown_connections 2023-10-25T16:12:51.191 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/1837584013 wait complete. 2023-10-25T16:12:51.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 Processor -- start 2023-10-25T16:12:51.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- start start 2023-10-25T16:12:51.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 0x7f9a8c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.195 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.195 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8c155db0 0x7f9a8c150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.195 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c1f2f10 con 0x7f9a8c0cc440 2023-10-25T16:12:51.195 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c1f6970 con 0x7f9a8c155db0 2023-10-25T16:12:51.195 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c1f6c50 con 0x7f9a8c0ccf70 2023-10-25T16:12:51.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54112/0 (socket says 172.21.15.184:54112) 2023-10-25T16:12:51.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 -- 172.21.15.184:0/865133611 learned_addr learned my addr 172.21.15.184:0/865133611 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:51.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8c155db0 0x7f9a8c150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8a59c640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 0x7f9a8c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 -- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 msgr2=0x7f9a8c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-25T16:12:51.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 -- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 msgr2=0x7f9a8c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:51.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:51.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a89d9b640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:51.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 -- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 msgr2=0x7f9a8c151fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:51.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 -- 172.21.15.184:0/865133611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 msgr2=0x7f9a8c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 0x7f9a8c15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 -- 172.21.15.184:0/865133611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800094a0 con 0x7f9a8c155db0 2023-10-25T16:12:51.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a8ad9d640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8c155db0 0x7f9a8c150b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c390 tx=0x7f9a8400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:51.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a840052d0 con 0x7f9a8c155db0 2023-10-25T16:12:51.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9a84003600 con 0x7f9a8c155db0 2023-10-25T16:12:51.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8c0ca610 con 0x7f9a8c155db0 2023-10-25T16:12:51.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a84003a10 con 0x7f9a8c155db0 2023-10-25T16:12:51.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c1f7210 con 0x7f9a8c155db0 2023-10-25T16:12:51.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9a84011590 con 0x7f9a8c155db0 2023-10-25T16:12:51.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f9a840129a0 con 0x7f9a8c155db0 2023-10-25T16:12:51.201 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.187+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c06fe60 con 0x7f9a8c155db0 2023-10-25T16:12:51.201 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.191+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9a84017070 con 0x7f9a8c155db0 2023-10-25T16:12:51.206 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:51.203+0000 7fb5ed969180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-25T16:12:51.222 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:51.219+0000 7f7d2c388180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-25T16:12:51.263 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.259+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f9a8c04daf0 con 0x7f9a8c155db0 2023-10-25T16:12:51.270 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a7affd640 1 -- 172.21.15.184:0/865133611 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a84012b60 con 0x7f9a8c155db0 2023-10-25T16:12:51.270 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-10-25T16:12:51.271 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8c155db0 msgr2=0x7f9a8c150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8c155db0 0x7f9a8c150b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c390 tx=0x7f9a8400c850 comp rx=0 tx=0).stop 2023-10-25T16:12:51.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 shutdown_connections 2023-10-25T16:12:51.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8c155db0 0x7f9a8c150b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a8c0ccf70 0x7f9a8c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 --2- 172.21.15.184:0/865133611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a8c0cc440 0x7f9a8c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 >> 172.21.15.184:0/865133611 conn(0x7f9a8c0ce000 msgr2=0x7f9a8c14c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 shutdown_connections 2023-10-25T16:12:51.273 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.267+0000 7f9a90dc4640 1 -- 172.21.15.184:0/865133611 wait complete. 2023-10-25T16:12:51.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-10-25T16:12:51.328 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:51.323+0000 7fb5ed969180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-25T16:12:51.453 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 -- 172.21.15.184:0/2359800020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 msgr2=0x7fb2d80cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.453 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2359800020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d80cca30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009840 tx=0x7fb2cc01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.453 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 -- 172.21.15.184:0/2359800020 shutdown_connections 2023-10-25T16:12:51.453 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2359800020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d80cca30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2359800020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d80cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 -- 172.21.15.184:0/2359800020 >> 172.21.15.184:0/2359800020 conn(0x7fb2d80ce000 msgr2=0x7fb2d80ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.454 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 -- 172.21.15.184:0/2359800020 shutdown_connections 2023-10-25T16:12:51.455 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.447+0000 7fb2dd536640 1 -- 172.21.15.184:0/2359800020 wait complete. 2023-10-25T16:12:51.459 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 Processor -- start 2023-10-25T16:12:51.459 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- start start 2023-10-25T16:12:51.459 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d8138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.459 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2d80ccf70 0x7fb2d8135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.460 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d8134ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.460 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d814fe60 con 0x7fb2d80ccf70 2023-10-25T16:12:51.460 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d814f570 con 0x7fb2d80cc440 2023-10-25T16:12:51.460 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8138590 con 0x7fb2d8155db0 2023-10-25T16:12:51.460 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d8138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d8138050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:39752/0 (socket says 172.21.15.184:39752) 2023-10-25T16:12:51.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d77fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d8134ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 -- 172.21.15.184:0/2150853028 learned_addr learned my addr 172.21.15.184:0/2150853028 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:51.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d77fe640 1 -- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 msgr2=0x7fb2d8134ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-10-25T16:12:51.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d77fe640 1 -- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 msgr2=0x7fb2d8134ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:51.462 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d77fe640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d8134ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:51.462 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d77fe640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d8134ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:51.462 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d67fc640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2d80ccf70 0x7fb2d8135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.462 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 -- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 msgr2=0x7fb2d8134ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:51.463 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d8134ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.463 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 -- 172.21.15.184:0/2150853028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2d80ccf70 msgr2=0x7fb2d8135600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.463 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2d80ccf70 0x7fb2d8135600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.463 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 -- 172.21.15.184:0/2150853028 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0094a0 con 0x7fb2d80cc440 2023-10-25T16:12:51.464 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2d6ffd640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d8138050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000d980 tx=0x7fb2d000de40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:51.464 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0009c30 con 0x7fb2d80cc440 2023-10-25T16:12:51.464 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb2d0009ec0 con 0x7fb2d80cc440 2023-10-25T16:12:51.465 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d80ca610 con 0x7fb2d80cc440 2023-10-25T16:12:51.465 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0004280 con 0x7fb2d80cc440 2023-10-25T16:12:51.465 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d814f7a0 con 0x7fb2d80cc440 2023-10-25T16:12:51.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb2d0003900 con 0x7fb2d80cc440 2023-10-25T16:12:51.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb2d0010dc0 con 0x7fb2d80cc440 2023-10-25T16:12:51.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.451+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d806fe60 con 0x7fb2d80cc440 2023-10-25T16:12:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.455+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb2d0020060 con 0x7fb2d80cc440 2023-10-25T16:12:51.526 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.523+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fb2d804daf0 con 0x7fb2d80cc440 2023-10-25T16:12:51.532 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.527+0000 7fb2bf7fe640 1 -- 172.21.15.184:0/2150853028 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb2d0017070 con 0x7fb2d80cc440 2023-10-25T16:12:51.533 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-10-25T16:12:51.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 msgr2=0x7fb2d8138050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d8138050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000d980 tx=0x7fb2d000de40 comp rx=0 tx=0).stop 2023-10-25T16:12:51.534 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 shutdown_connections 2023-10-25T16:12:51.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2d8155db0 0x7fb2d8134ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2d80ccf70 0x7fb2d8135600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 --2- 172.21.15.184:0/2150853028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2d80cc440 0x7fb2d8138050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 >> 172.21.15.184:0/2150853028 conn(0x7fb2d80ce000 msgr2=0x7fb2d806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.535 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 shutdown_connections 2023-10-25T16:12:51.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.531+0000 7fb2dd536640 1 -- 172.21.15.184:0/2150853028 wait complete. 2023-10-25T16:12:51.549 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-10-25T16:12:51.665 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 -- 172.21.15.184:0/4167759344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d140c9880 msgr2=0x7f2d140c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.665 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 --2- 172.21.15.184:0/4167759344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d140c9880 0x7f2d140c9d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d140b1d60 tx=0x7f2cfc01c7e0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 -- 172.21.15.184:0/4167759344 shutdown_connections 2023-10-25T16:12:51.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 --2- 172.21.15.184:0/4167759344 >> v2:172.21.15.177:3300/0 conn(0x7f2d1415b1f0 0x7f2d1415b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 --2- 172.21.15.184:0/4167759344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d140c9880 0x7f2d140c9d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 -- 172.21.15.184:0/4167759344 >> 172.21.15.184:0/4167759344 conn(0x7f2d140b0de0 msgr2=0x7f2d140b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.666 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 -- 172.21.15.184:0/4167759344 shutdown_connections 2023-10-25T16:12:51.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.659+0000 7f2d1a000640 1 -- 172.21.15.184:0/4167759344 wait complete. 2023-10-25T16:12:51.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 Processor -- start 2023-10-25T16:12:51.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- start start 2023-10-25T16:12:51.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d140c9880 0x7f2d140c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d1415b1f0 0x7f2d140ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c3160 con 0x7f2d140c9880 2023-10-25T16:12:51.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140c6840 con 0x7f2d1415b1f0 2023-10-25T16:12:51.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140cdaf0 con 0x7f2d14156e60 2023-10-25T16:12:51.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d1415b1f0 0x7f2d140ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54140/0 (socket says 172.21.15.184:54140) 2023-10-25T16:12:51.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 -- 172.21.15.184:0/1380449265 learned_addr learned my addr 172.21.15.184:0/1380449265 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-25T16:12:51.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 -- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 msgr2=0x7f2d14144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-25T16:12:51.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 -- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 msgr2=0x7f2d14144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:51.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:51.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d12ffd640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:51.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d137fe640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d140c9880 0x7f2d140c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 -- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 msgr2=0x7f2d14144450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:51.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 -- 172.21.15.184:0/1380449265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d140c9880 msgr2=0x7f2d140c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d140c9880 0x7f2d140c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 -- 172.21.15.184:0/1380449265 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc0094a0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.673 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d13fff640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d1415b1f0 0x7f2d140ce2b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00cab0 tx=0x7f2d0c00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:51.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c007d30 con 0x7f2d1415b1f0 2023-10-25T16:12:51.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2d0c00f450 con 0x7f2d1415b1f0 2023-10-25T16:12:51.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d140c8df0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00f860 con 0x7f2d1415b1f0 2023-10-25T16:12:51.674 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d140c8ac0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d0c00f9c0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2d0c018a90 con 0x7f2d1415b1f0 2023-10-25T16:12:51.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.663+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d140cdfd0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.675 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.667+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2d140cdfd0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.735+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7f2d140c91e0 con 0x7f2d1415b1f0 2023-10-25T16:12:51.745 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.739+0000 7f2d0bfff640 1 -- 172.21.15.184:0/1380449265 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d0c018d30 con 0x7f2d1415b1f0 2023-10-25T16:12:51.745 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-10-25T16:12:51.746 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d1415b1f0 msgr2=0x7f2d140ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d1415b1f0 0x7f2d140ce2b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00cab0 tx=0x7f2d0c00cf70 comp rx=0 tx=0).stop 2023-10-25T16:12:51.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 shutdown_connections 2023-10-25T16:12:51.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d1415b1f0 0x7f2d140ce2b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d14156e60 0x7f2d14144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.747 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 --2- 172.21.15.184:0/1380449265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d140c9880 0x7f2d140c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 >> 172.21.15.184:0/1380449265 conn(0x7f2d140b0de0 msgr2=0x7f2d140af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 shutdown_connections 2023-10-25T16:12:51.748 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:12:51.743+0000 7f2d1a000640 1 -- 172.21.15.184:0/1380449265 wait complete. 2023-10-25T16:12:51.761 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-25T16:12:51.762 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-25T16:12:51.764 INFO:tasks.ceph.osd.0:Started 2023-10-25T16:12:51.765 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-25T16:12:51.765 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-25T16:12:51.767 INFO:tasks.ceph.osd.1:Started 2023-10-25T16:12:51.768 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-25T16:12:51.768 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-25T16:12:51.771 INFO:tasks.ceph.osd.2:Started 2023-10-25T16:12:51.771 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-25T16:12:51.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-25T16:12:51.773 INFO:tasks.ceph.osd.3:Started 2023-10-25T16:12:51.774 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-25T16:12:51.774 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-25T16:12:51.776 INFO:tasks.ceph.osd.4:Started 2023-10-25T16:12:51.776 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-25T16:12:51.777 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-25T16:12:51.779 INFO:tasks.ceph.osd.5:Started 2023-10-25T16:12:51.779 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-25T16:12:51.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-25T16:12:51.782 INFO:tasks.ceph.osd.6:Started 2023-10-25T16:12:51.782 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-25T16:12:51.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-25T16:12:51.784 INFO:tasks.ceph.osd.7:Started 2023-10-25T16:12:51.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:12:51.830 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-10-25T16:12:51.827+0000 7f53ee04e640 -1 Falling back to public interface 2023-10-25T16:12:51.842 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-25T16:12:51.839+0000 7fee60311640 -1 Falling back to public interface 2023-10-25T16:12:51.847 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-25T16:12:51.843+0000 7fcb48cf7640 -1 Falling back to public interface 2023-10-25T16:12:51.848 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-10-25T16:12:51.843+0000 7f53ee04e640 -1 osd.0 0 log_to_monitors true 2023-10-25T16:12:51.849 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-10-25T16:12:51.843+0000 7f7bd2e54640 -1 Falling back to public interface 2023-10-25T16:12:51.849 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-10-25T16:12:51.843+0000 7f607f5ae640 -1 Falling back to public interface 2023-10-25T16:12:51.853 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-10-25T16:12:51.847+0000 7f2cdc93e640 -1 Falling back to public interface 2023-10-25T16:12:51.856 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-25T16:12:51.851+0000 7f6a97a22640 -1 Falling back to public interface 2023-10-25T16:12:51.858 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-25T16:12:51.855+0000 7fee60311640 -1 osd.6 0 log_to_monitors true 2023-10-25T16:12:51.862 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-10-25T16:12:51.855+0000 7f607f5ae640 -1 osd.1 0 log_to_monitors true 2023-10-25T16:12:51.866 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-25T16:12:51.863+0000 7fe61d325640 -1 Falling back to public interface 2023-10-25T16:12:51.867 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-10-25T16:12:51.863+0000 7f7bd2e54640 -1 osd.2 0 log_to_monitors true 2023-10-25T16:12:51.869 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-25T16:12:51.867+0000 7f6a97a22640 -1 osd.5 0 log_to_monitors true 2023-10-25T16:12:51.870 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-25T16:12:51.867+0000 7fcb48cf7640 -1 osd.7 0 log_to_monitors true 2023-10-25T16:12:51.875 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-10-25T16:12:51.871+0000 7f2cdc93e640 -1 osd.3 0 log_to_monitors true 2023-10-25T16:12:51.879 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-25T16:12:51.875+0000 7fe61d325640 -1 osd.4 0 log_to_monitors true 2023-10-25T16:12:51.884 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:51.879+0000 7f7d2c388180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-25T16:12:51.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497e5f7640 1 -- 172.21.15.177:0/1359850596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4964004d10 msgr2=0x7f4964005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497e5f7640 1 --2- 172.21.15.177:0/1359850596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4964004d10 0x7f4964005190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4968005fd0 tx=0x7f496801cd00 comp rx=0 tx=0).stop 2023-10-25T16:12:51.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497cb94640 1 -- 172.21.15.177:0/1359850596 reap_dead start 2023-10-25T16:12:51.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497e5f7640 1 -- 172.21.15.177:0/1359850596 shutdown_connections 2023-10-25T16:12:51.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497e5f7640 1 -- 172.21.15.177:0/1359850596 >> 172.21.15.177:0/1359850596 conn(0x7f49780cf040 msgr2=0x7f49780cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497e5f7640 1 -- 172.21.15.177:0/1359850596 shutdown_connections 2023-10-25T16:12:51.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.911+0000 7f497e5f7640 1 -- 172.21.15.177:0/1359850596 wait complete. 2023-10-25T16:12:51.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 Processor -- start 2023-10-25T16:12:51.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- start start 2023-10-25T16:12:51.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49780c2b70 0x7f49780c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 0x7f49780c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 0x7f49780b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:51.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b3960 con 0x7f49780c2f50 2023-10-25T16:12:51.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b2ce0 con 0x7f49780c2b70 2023-10-25T16:12:51.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b2fc0 con 0x7f49780b3d80 2023-10-25T16:12:51.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 0x7f49780c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 0x7f49780c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54260/0 (socket says 172.21.15.177:54260) 2023-10-25T16:12:51.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 -- 172.21.15.177:0/2140052161 learned_addr learned my addr 172.21.15.177:0/2140052161 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:12:51.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4977fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49780c2b70 0x7f49780c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497cb94640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 0x7f49780b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:51.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497cb94640 1 -- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 msgr2=0x7f49780b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-25T16:12:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497cb94640 1 -- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 msgr2=0x7f49780b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-25T16:12:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497cb94640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 0x7f49780b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-25T16:12:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497cb94640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 0x7f49780b4200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-25T16:12:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 -- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 msgr2=0x7f49780b4200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:12:51.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 0x7f49780b4200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 -- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49780c2b70 msgr2=0x7f49780c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49780c2b70 0x7f49780c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 -- 172.21.15.177:0/2140052161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780b32a0 con 0x7f49780c2f50 2023-10-25T16:12:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4977fff640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49780c2b70 0x7f49780c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T16:12:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f49777fe640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 0x7f49780c33d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49600063d0 tx=0x7f4960003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:51.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960011840 con 0x7f49780c2f50 2023-10-25T16:12:51.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f49600119e0 con 0x7f49780c2f50 2023-10-25T16:12:51.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960011df0 con 0x7f49780c2f50 2023-10-25T16:12:51.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780b3580 con 0x7f49780c2f50 2023-10-25T16:12:51.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780b4740 con 0x7f49780c2f50 2023-10-25T16:12:51.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f49600103c0 con 0x7f49780c2f50 2023-10-25T16:12:51.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4960010d40 con 0x7f49780c2f50 2023-10-25T16:12:51.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.915+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49780cae60 con 0x7f49780c2f50 2023-10-25T16:12:51.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.919+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f496001f060 con 0x7f49780c2f50 2023-10-25T16:12:51.961 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:51.959+0000 7f7d2c388180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-25T16:12:51.972 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:51.967+0000 7fb5ed969180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-25T16:12:51.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.975+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49780cfd80 con 0x7f49780c2f50 2023-10-25T16:12:51.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.975+0000 7f4974ff9640 1 -- 172.21.15.177:0/2140052161 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4960015070 con 0x7f49780c2f50 2023-10-25T16:12:51.981 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:12:51.981 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":10,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:12:51.738823+0000","last_up_change":"0.000000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:12:51.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 msgr2=0x7f49780c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:51.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 0x7f49780c33d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49600063d0 tx=0x7f4960003ab0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 shutdown_connections 2023-10-25T16:12:51.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49780b3d80 0x7f49780b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49780c2f50 0x7f49780c33d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 --2- 172.21.15.177:0/2140052161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49780c2b70 0x7f49780c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:51.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 >> 172.21.15.177:0/2140052161 conn(0x7f49780cf040 msgr2=0x7f4978158190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:51.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 shutdown_connections 2023-10-25T16:12:51.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:12:51.979+0000 7f497e5f7640 1 -- 172.21.15.177:0/2140052161 wait complete. 2023-10-25T16:12:51.998 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-25T16:12:51.999 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-25T16:12:52.049 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:52.047+0000 7fb5ed969180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-25T16:12:52.130 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:52.127+0000 7f7d2c388180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-25T16:12:52.203 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:52.199+0000 7f7d2c388180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-25T16:12:52.217 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:52.211+0000 7fb5ed969180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-25T16:12:52.289 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:52.283+0000 7fb5ed969180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-25T16:12:52.491 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:52.487+0000 7f7d2c388180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-25T16:12:52.550 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:52.547+0000 7f7d2c388180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-25T16:12:52.577 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:52.575+0000 7fb5ed969180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-25T16:12:52.640 INFO:tasks.ceph.mgr.y.smithi177.stderr:2023-10-25T16:12:52.635+0000 7fb5ed969180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-25T16:12:52.804 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-25T16:12:52.930 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/871173806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e0003980 msgr2=0x7f54e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:52.930 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 --2- 172.21.15.177:0/871173806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e0003980 0x7f54e0003da0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009b60 tx=0x7f54e401d270 comp rx=0 tx=0).stop 2023-10-25T16:12:52.930 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/871173806 shutdown_connections 2023-10-25T16:12:52.930 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 --2- 172.21.15.177:0/871173806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e0003980 0x7f54e0003da0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:52.931 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/871173806 >> 172.21.15.177:0/871173806 conn(0x7f54f4065f40 msgr2=0x7f54f409a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:52.931 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/871173806 shutdown_connections 2023-10-25T16:12:52.931 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/871173806 wait complete. 2023-10-25T16:12:52.933 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 Processor -- start 2023-10-25T16:12:52.933 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- start start 2023-10-25T16:12:52.934 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54e0003980 0x7f54f4148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:52.934 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 0x7f54f40c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:52.934 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54f40c6280 0x7f54f4146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:52.934 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4146670 con 0x7f54f40c7de0 2023-10-25T16:12:52.935 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f41485a0 con 0x7f54f40c6280 2023-10-25T16:12:52.935 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f4145a60 con 0x7f54e0003980 2023-10-25T16:12:52.935 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 0x7f54f40c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:52.935 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 0x7f54f40c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54276/0 (socket says 172.21.15.177:54276) 2023-10-25T16:12:52.935 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 -- 172.21.15.177:0/1272334159 learned_addr learned my addr 172.21.15.177:0/1272334159 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:12:52.936 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f37fe640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54e0003980 0x7f54f4148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:52.936 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f3fff640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54f40c6280 0x7f54f4146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:52.936 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 -- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54e0003980 msgr2=0x7f54f4148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:52.936 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54e0003980 0x7f54f4148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:52.936 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 -- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54f40c6280 msgr2=0x7f54f4146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:52.937 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54f40c6280 0x7f54f4146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:52.937 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 -- 172.21.15.177:0/1272334159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4145d40 con 0x7f54f40c7de0 2023-10-25T16:12:52.937 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f3fff640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54f40c6280 0x7f54f4146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:12:52.937 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54eaffd640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 0x7f54f40c5d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00d580 tx=0x7f54dc00da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:52.937 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc012630 con 0x7f54f40c7de0 2023-10-25T16:12:52.937 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f54dc012790 con 0x7f54f40c7de0 2023-10-25T16:12:52.938 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc012b60 con 0x7f54f40c7de0 2023-10-25T16:12:52.938 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f4146020 con 0x7f54f40c7de0 2023-10-25T16:12:52.938 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.927+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f415e660 con 0x7f54f40c7de0 2023-10-25T16:12:52.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.931+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 2) v1 ==== 42893+0+0 (secure 0 0 0) 0x7f54dc01b400 con 0x7f54f40c7de0 2023-10-25T16:12:52.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.931+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f404daf0 con 0x7f54f40c7de0 2023-10-25T16:12:52.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.931+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7f54dc046c40 con 0x7f54f40c7de0 2023-10-25T16:12:52.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.931+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f54dc00f6f0 con 0x7f54f40c7de0 2023-10-25T16:12:52.989 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.983+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54f4071220 con 0x7f54f40c7de0 2023-10-25T16:12:52.990 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f0ff9640 1 -- 172.21.15.177:0/1272334159 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f54dc01be60 con 0x7f54f40c7de0 2023-10-25T16:12:52.991 INFO:teuthology.misc.health.smithi177.stdout: 2023-10-25T16:12:52.991 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":11,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:12:52.741086+0000","last_up_change":"0.000000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:12:52.992 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 msgr2=0x7f54f40c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:52.992 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 0x7f54f40c5d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00d580 tx=0x7f54dc00da40 comp rx=0 tx=0).stop 2023-10-25T16:12:52.992 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 shutdown_connections 2023-10-25T16:12:52.992 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54f40c6280 0x7f54f4146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:52.993 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54f40c7de0 0x7f54f40c5d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:52.993 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 --2- 172.21.15.177:0/1272334159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54e0003980 0x7f54f4148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:52.993 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 >> 172.21.15.177:0/1272334159 conn(0x7f54f4065f40 msgr2=0x7f54f40aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:52.993 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 shutdown_connections 2023-10-25T16:12:52.993 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:52.987+0000 7f54f9b83640 1 -- 172.21.15.177:0/1272334159 wait complete. 2023-10-25T16:12:53.004 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-25T16:12:53.602 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:53.599+0000 7f7cd3bfa640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-25T16:12:53.602 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-25T16:12:53.599+0000 7f7cd3bfa640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-25T16:12:53.778 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-10-25T16:12:53.775+0000 7f2cd90fa640 -1 osd.3 0 waiting for initial osdmap 2023-10-25T16:12:53.780 INFO:tasks.ceph.osd.3.smithi177.stderr:2023-10-25T16:12:53.775+0000 7f2cd1f2f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.782 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-25T16:12:53.779+0000 7fe6192cd640 -1 osd.4 0 waiting for initial osdmap 2023-10-25T16:12:53.782 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-25T16:12:53.779+0000 7fcb454b3640 -1 osd.7 0 waiting for initial osdmap 2023-10-25T16:12:53.783 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-10-25T16:12:53.779+0000 7f607b556640 -1 osd.1 0 waiting for initial osdmap 2023-10-25T16:12:53.784 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-25T16:12:53.779+0000 7fe612916640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.784 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-25T16:12:53.779+0000 7fcb3e2e8640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.786 INFO:tasks.ceph.osd.1.smithi177.stderr:2023-10-25T16:12:53.783+0000 7f6074b9f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.787 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-25T16:12:53.783+0000 7fee5c2b9640 -1 osd.6 0 waiting for initial osdmap 2023-10-25T16:12:53.789 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-25T16:12:53.787+0000 7f6a939ca640 -1 osd.5 0 waiting for initial osdmap 2023-10-25T16:12:53.789 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-25T16:12:53.787+0000 7fee55902640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.791 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-25T16:12:53.787+0000 7f6a8d013640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.791 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-10-25T16:12:53.787+0000 7f53e9ff6640 -1 osd.0 0 waiting for initial osdmap 2023-10-25T16:12:53.794 INFO:tasks.ceph.osd.0.smithi177.stderr:2023-10-25T16:12:53.791+0000 7f53e363f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:53.798 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-10-25T16:12:53.795+0000 7f7bcedfc640 -1 osd.2 0 waiting for initial osdmap 2023-10-25T16:12:53.800 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-10-25T16:12:53.795+0000 7f7bc7c44640 -1 osd.2 12 osdmap fullness state needs update 2023-10-25T16:12:54.758 INFO:tasks.ceph.osd.2.smithi177.stderr:2023-10-25T16:12:54.755+0000 7f7bc8445640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T16:12:55.753 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:12:55.751+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-25T16:12:59.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:12:59.715 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:12:59.811 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-25T16:12:59.938 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- 172.21.15.177:0/664736209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3980c9e50 msgr2=0x7fd39806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:59.938 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- 172.21.15.177:0/664736209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3980c9e50 0x7fd39806b9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd39815dd70 tx=0x7fd38c01c590 comp rx=0 tx=0).stop 2023-10-25T16:12:59.938 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- 172.21.15.177:0/664736209 shutdown_connections 2023-10-25T16:12:59.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- 172.21.15.177:0/664736209 >> v2:172.21.15.184:3300/0 conn(0x7fd39806bf20 0x7fd3980aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:59.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- 172.21.15.177:0/664736209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3980c9e50 0x7fd39806b9e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:59.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- 172.21.15.177:0/664736209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3981500f0 0x7fd3980c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:59.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- 172.21.15.177:0/664736209 >> 172.21.15.177:0/664736209 conn(0x7fd3980b2450 msgr2=0x7fd3980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:12:59.939 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- 172.21.15.177:0/664736209 shutdown_connections 2023-10-25T16:12:59.940 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- 172.21.15.177:0/664736209 wait complete. 2023-10-25T16:12:59.942 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 Processor -- start 2023-10-25T16:12:59.942 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- start start 2023-10-25T16:12:59.942 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 0x7fd3980acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:59.942 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3980c9e50 0x7fd39814ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:59.943 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3981500f0 0x7fd39814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:59.943 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ae710 con 0x7fd39806bf20 2023-10-25T16:12:59.943 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39814b580 con 0x7fd3981500f0 2023-10-25T16:12:59.943 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39e357640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ae9b0 con 0x7fd3980c9e50 2023-10-25T16:12:59.943 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 0x7fd3980acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:59.944 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 0x7fd3980acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54290/0 (socket says 172.21.15.177:54290) 2023-10-25T16:12:59.944 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 -- 172.21.15.177:0/1857443016 learned_addr learned my addr 172.21.15.177:0/1857443016 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:12:59.944 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd3977fe640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3980c9e50 0x7fd39814ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:59.944 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39c8f4640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3981500f0 0x7fd39814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:59.945 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 -- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3980c9e50 msgr2=0x7fd39814ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:59.945 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3980c9e50 0x7fd39814ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:59.945 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 -- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3981500f0 msgr2=0x7fd39814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:12:59.945 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3981500f0 0x7fd39814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:12:59.945 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 -- 172.21.15.177:0/1857443016 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c009500 con 0x7fd39806bf20 2023-10-25T16:12:59.945 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd39c8f4640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3981500f0 0x7fd39814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:12:59.946 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd397fff640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 0x7fd3980acef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd39000ccb0 tx=0x7fd39000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:59.946 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390004b30 con 0x7fd39806bf20 2023-10-25T16:12:59.946 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd390004da0 con 0x7fd39806bf20 2023-10-25T16:12:59.946 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.935+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390005280 con 0x7fd39806bf20 2023-10-25T16:12:59.947 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980aec90 con 0x7fd39806bf20 2023-10-25T16:12:59.947 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39814b2c0 con 0x7fd39806bf20 2023-10-25T16:12:59.947 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39804daf0 con 0x7fd39806bf20 2023-10-25T16:12:59.948 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3900053e0 con 0x7fd39806bf20 2023-10-25T16:12:59.948 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd394ff9640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd384066470 0x7fd384068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:12:59.948 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd390084410 con 0x7fd39806bf20 2023-10-25T16:12:59.949 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd3977fe640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd384066470 0x7fd384068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:12:59.949 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.939+0000 7fd3977fe640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd384066470 0x7fd384068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0ae000 tx=0x7fd38c01add0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:12:59.949 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:12:59.943+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd390051be0 con 0x7fd39806bf20 2023-10-25T16:13:00.102 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.099+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3980acb10 con 0x7fd39806bf20 2023-10-25T16:13:00.103 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.099+0000 7fd394ff9640 1 -- 172.21.15.177:0/1857443016 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7fd39001d020 con 0x7fd39806bf20 2023-10-25T16:13:00.104 INFO:teuthology.misc.health.smithi177.stdout: 2023-10-25T16:13:00.104 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":17,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:12:58.792091+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:00.106 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd384066470 msgr2=0x7fd384068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.107 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd384066470 0x7fd384068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0ae000 tx=0x7fd38c01add0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.107 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 msgr2=0x7fd3980acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.107 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 0x7fd3980acef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd39000ccb0 tx=0x7fd39000a620 comp rx=0 tx=0).stop 2023-10-25T16:13:00.107 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 shutdown_connections 2023-10-25T16:13:00.107 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd384066470 0x7fd384068930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.108 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3981500f0 0x7fd39814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.108 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3980c9e50 0x7fd39814ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.108 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 --2- 172.21.15.177:0/1857443016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd39806bf20 0x7fd3980acef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.108 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 >> 172.21.15.177:0/1857443016 conn(0x7fd3980b2450 msgr2=0x7fd39815bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:00.108 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 shutdown_connections 2023-10-25T16:13:00.109 INFO:teuthology.misc.health.smithi177.stderr:2023-10-25T16:13:00.103+0000 7fd39e357640 1 -- 172.21.15.177:0/1857443016 wait complete. 2023-10-25T16:13:00.122 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-25T16:13:00.122 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-25T16:13:00.123 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:13:00.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:13:00.125 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:13:00.126 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:13:00.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:13:00.128 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:13:00.129 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:13:00.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:13:00.132 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:13:00.133 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:13:00.133 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:13:00.136 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:13:00.136 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-25T16:13:00.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:00.201 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:13:00.202 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:13:00.213 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:13:00.214 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:13:00.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 -- 172.21.15.177:0/3586544320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 msgr2=0x7fac4c0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 --2- 172.21.15.177:0/3586544320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0cca30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac40009840 tx=0x7fac4001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 -- 172.21.15.177:0/3586544320 shutdown_connections 2023-10-25T16:13:00.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 --2- 172.21.15.177:0/3586544320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0cca30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 --2- 172.21.15.177:0/3586544320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac4c155db0 0x7fac4c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 -- 172.21.15.177:0/3586544320 >> 172.21.15.177:0/3586544320 conn(0x7fac4c0ce000 msgr2=0x7fac4c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 -- 172.21.15.177:0/3586544320 shutdown_connections 2023-10-25T16:13:00.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.259+0000 7fac50990640 1 -- 172.21.15.177:0/3586544320 wait complete. 2023-10-25T16:13:00.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 Processor -- start 2023-10-25T16:13:00.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- start start 2023-10-25T16:13:00.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac4c0ccf70 0x7fac4c148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac4c155db0 0x7fac4c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c14f7f0 con 0x7fac4c0cc440 2023-10-25T16:13:00.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c154c70 con 0x7fac4c0ccf70 2023-10-25T16:13:00.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c14f510 con 0x7fac4c155db0 2023-10-25T16:13:00.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54322/0 (socket says 172.21.15.177:54322) 2023-10-25T16:13:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 -- 172.21.15.177:0/2986465145 learned_addr learned my addr 172.21.15.177:0/2986465145 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac49d9b640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac4c0ccf70 0x7fac4c148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4ad9d640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac4c155db0 0x7fac4c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 -- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac4c155db0 msgr2=0x7fac4c15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac4c155db0 0x7fac4c15a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 -- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac4c0ccf70 msgr2=0x7fac4c148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac4c0ccf70 0x7fac4c148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 -- 172.21.15.177:0/2986465145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400094a0 con 0x7fac4c0cc440 2023-10-25T16:13:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac4a59c640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0b0d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac4400eaa0 tx=0x7fac4400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4400ce10 con 0x7fac4c0cc440 2023-10-25T16:13:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac44011470 con 0x7fac4c0cc440 2023-10-25T16:13:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c0ca610 con 0x7fac4c0cc440 2023-10-25T16:13:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44011860 con 0x7fac4c0cc440 2023-10-25T16:13:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c154890 con 0x7fac4c0cc440 2023-10-25T16:13:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c06fe60 con 0x7fac4c0cc440 2023-10-25T16:13:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.263+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac4401a400 con 0x7fac4c0cc440 2023-10-25T16:13:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.267+0000 7fac3affd640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac2c066470 0x7fac2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.267+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac44084a10 con 0x7fac4c0cc440 2023-10-25T16:13:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.267+0000 7fac49d9b640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac2c066470 0x7fac2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.267+0000 7fac49d9b640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac2c066470 0x7fac2c068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fac400af000 tx=0x7fac4001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.267+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac44052400 con 0x7fac4c0cc440 2023-10-25T16:13:00.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.415+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac4c154410 con 0x7fac4c0cc440 2023-10-25T16:13:00.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac3affd640 1 -- 172.21.15.177:0/2986465145 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7fac4c154410 con 0x7fac4c0cc440 2023-10-25T16:13:00.422 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:00.423 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":17,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:12:58.792091+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:00.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac2c066470 msgr2=0x7fac2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac2c066470 0x7fac2c068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fac400af000 tx=0x7fac4001b010 comp rx=0 tx=0).stop 2023-10-25T16:13:00.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 msgr2=0x7fac4c0b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0b0d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac4400eaa0 tx=0x7fac4400ef60 comp rx=0 tx=0).stop 2023-10-25T16:13:00.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 shutdown_connections 2023-10-25T16:13:00.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac2c066470 0x7fac2c068930 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac4c155db0 0x7fac4c15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac4c0ccf70 0x7fac4c148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 --2- 172.21.15.177:0/2986465145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac4c0cc440 0x7fac4c0b0d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 >> 172.21.15.177:0/2986465145 conn(0x7fac4c0ce000 msgr2=0x7fac4c0add20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:00.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 shutdown_connections 2023-10-25T16:13:00.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.419+0000 7fac50990640 1 -- 172.21.15.177:0/2986465145 wait complete. 2023-10-25T16:13:00.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:00.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:00.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/3544405187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 msgr2=0x7f5eac0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/3544405187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0b4100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009840 tx=0x7f5e9c01c730 comp rx=0 tx=0).stop 2023-10-25T16:13:00.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/3544405187 shutdown_connections 2023-10-25T16:13:00.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/3544405187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0b4100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/3544405187 >> 172.21.15.177:0/3544405187 conn(0x7f5eac09a5c0 msgr2=0x7f5eac0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:00.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/3544405187 shutdown_connections 2023-10-25T16:13:00.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/3544405187 wait complete. 2023-10-25T16:13:00.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 Processor -- start 2023-10-25T16:13:00.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- start start 2023-10-25T16:13:00.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5eac0cdb10 0x7f5eac0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac15eba0 0x7f5eac0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0c9690 con 0x7f5eac0b2120 2023-10-25T16:13:00.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0c9970 con 0x7f5eac15eba0 2023-10-25T16:13:00.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0c9c50 con 0x7f5eac0cdb10 2023-10-25T16:13:00.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47076/0 (socket says 172.21.15.177:47076) 2023-10-25T16:13:00.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 -- 172.21.15.177:0/38616882 learned_addr learned my addr 172.21.15.177:0/38616882 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:00.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 -- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5eac0cdb10 msgr2=0x7f5eac0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5eac0cdb10 0x7f5eac0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 -- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac15eba0 msgr2=0x7f5eac0b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac15eba0 0x7f5eac0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 -- 172.21.15.177:0/38616882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0094a0 con 0x7f5eac0b2120 2023-10-25T16:13:00.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eab7fe640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0c8d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c3d0 tx=0x7f5ea000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:00.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0011790 con 0x7f5eac0b2120 2023-10-25T16:13:00.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ea00119e0 con 0x7f5eac0b2120 2023-10-25T16:13:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac0c9f30 con 0x7f5eac0b2120 2023-10-25T16:13:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0011e10 con 0x7f5eac0b2120 2023-10-25T16:13:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac0c92d0 con 0x7f5eac0b2120 2023-10-25T16:13:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.555+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac04daf0 con 0x7f5eac0b2120 2023-10-25T16:13:00.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.559+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5ea001c460 con 0x7f5eac0b2120 2023-10-25T16:13:00.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.559+0000 7f5e93fff640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e98066470 0x7f5e98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.559+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ea0083c90 con 0x7f5eac0b2120 2023-10-25T16:13:00.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.559+0000 7f5eaaffd640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e98066470 0x7f5e98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.559+0000 7f5eaaffd640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e98066470 0x7f5e98068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0af000 tx=0x7f5e9c0194d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:00.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.567+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ea00513e0 con 0x7f5eac0b2120 2023-10-25T16:13:00.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.707+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5eac0ce930 con 0x7f5eac0b2120 2023-10-25T16:13:00.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5e93fff640 1 -- 172.21.15.177:0/38616882 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ea0054a00 con 0x7f5eac0b2120 2023-10-25T16:13:00.714 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:00.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e98066470 msgr2=0x7f5e98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e98066470 0x7f5e98068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0af000 tx=0x7f5e9c0194d0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 msgr2=0x7f5eac0c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0c8d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c3d0 tx=0x7f5ea000c890 comp rx=0 tx=0).stop 2023-10-25T16:13:00.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 shutdown_connections 2023-10-25T16:13:00.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e98066470 0x7f5e98068930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac15eba0 0x7f5eac0b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5eac0cdb10 0x7f5eac0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 --2- 172.21.15.177:0/38616882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5eac0b2120 0x7f5eac0c8d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 >> 172.21.15.177:0/38616882 conn(0x7f5eac09a5c0 msgr2=0x7f5eac0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:00.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 shutdown_connections 2023-10-25T16:13:00.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.711+0000 7f5eb1bdf640 1 -- 172.21.15.177:0/38616882 wait complete. 2023-10-25T16:13:00.730 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:00.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- 172.21.15.177:0/1149960819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 msgr2=0x7f4ff40b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 --2- 172.21.15.177:0/1149960819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff40b4100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009900 tx=0x7f4ff001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- 172.21.15.177:0/1149960819 shutdown_connections 2023-10-25T16:13:00.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 --2- 172.21.15.177:0/1149960819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff40cdb10 0x7f4ff40cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 --2- 172.21.15.177:0/1149960819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff40b4100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- 172.21.15.177:0/1149960819 >> 172.21.15.177:0/1149960819 conn(0x7f4ff409a5c0 msgr2=0x7f4ff40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:00.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- 172.21.15.177:0/1149960819 shutdown_connections 2023-10-25T16:13:00.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- 172.21.15.177:0/1149960819 wait complete. 2023-10-25T16:13:00.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 Processor -- start 2023-10-25T16:13:00.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- start start 2023-10-25T16:13:00.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff40b2120 0x7f4ff4151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff40cdb10 0x7f4ff4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff415d9e0 con 0x7f4ff415eba0 2023-10-25T16:13:00.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4156df0 con 0x7f4ff40cdb10 2023-10-25T16:13:00.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ffb955640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40c4c60 con 0x7f4ff40b2120 2023-10-25T16:13:00.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.839+0000 7f4ff9ef2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff41568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47098/0 (socket says 172.21.15.177:47098) 2023-10-25T16:13:00.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 -- 172.21.15.177:0/4048743959 learned_addr learned my addr 172.21.15.177:0/4048743959 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:00.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff96f1640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff40b2120 0x7f4ff4151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff8ef0640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff40cdb10 0x7f4ff4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 -- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff40b2120 msgr2=0x7f4ff4151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff40b2120 0x7f4ff4151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 -- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff40cdb10 msgr2=0x7f4ff4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:00.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff40cdb10 0x7f4ff4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:00.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 -- 172.21.15.177:0/4048743959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0009560 con 0x7f4ff415eba0 2023-10-25T16:13:00.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff8ef0640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff40cdb10 0x7f4ff4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:00.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff9ef2640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff41568b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00ccb0 tx=0x7f4fec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:00.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec004b30 con 0x7f4ff415eba0 2023-10-25T16:13:00.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4fec004da0 con 0x7f4ff415eba0 2023-10-25T16:13:00.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff40c4f40 con 0x7f4ff415eba0 2023-10-25T16:13:00.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec005280 con 0x7f4ff415eba0 2023-10-25T16:13:00.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff40c5500 con 0x7f4ff415eba0 2023-10-25T16:13:00.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff40c5720 con 0x7f4ff415eba0 2023-10-25T16:13:00.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4fec0053e0 con 0x7f4ff415eba0 2023-10-25T16:13:00.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4fe9ffb640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd8066470 0x7f4fd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:00.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4fec084380 con 0x7f4ff415eba0 2023-10-25T16:13:00.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff96f1640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd8066470 0x7f4fd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:00.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.843+0000 7f4ff96f1640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd8066470 0x7f4fd8068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00ae000 tx=0x7f4ff001b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:00.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:00.847+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4fec051b50 con 0x7f4ff415eba0 2023-10-25T16:13:01.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ff404daf0 con 0x7f4ff415eba0 2023-10-25T16:13:01.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4fe9ffb640 1 -- 172.21.15.177:0/4048743959 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1326 (secure 0 0 0) 0x7f4fec01d090 con 0x7f4ff415eba0 2023-10-25T16:13:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:01.035 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-25T16:13:01.036 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 2 2023-10-25T16:13:01.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd8066470 msgr2=0x7f4fd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:01.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd8066470 0x7f4fd8068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00ae000 tx=0x7f4ff001b030 comp rx=0 tx=0).stop 2023-10-25T16:13:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 msgr2=0x7f4ff41568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff41568b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00ccb0 tx=0x7f4fec00a620 comp rx=0 tx=0).stop 2023-10-25T16:13:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 shutdown_connections 2023-10-25T16:13:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd8066470 0x7f4fd8068930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ff415eba0 0x7f4ff41568b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff40cdb10 0x7f4ff4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 --2- 172.21.15.177:0/4048743959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ff40b2120 0x7f4ff4151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.031+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 >> 172.21.15.177:0/4048743959 conn(0x7f4ff409a5c0 msgr2=0x7f4ff40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.035+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 shutdown_connections 2023-10-25T16:13:01.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:01.035+0000 7f4ffb955640 1 -- 172.21.15.177:0/4048743959 wait complete. 2023-10-25T16:13:03.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:03.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- 172.21.15.177:0/861600507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 msgr2=0x7f44b4158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/861600507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b4158eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f44b406d860 tx=0x7f44ac01cca0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- 172.21.15.177:0/861600507 shutdown_connections 2023-10-25T16:13:03.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/861600507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b4158eb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/861600507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b406c130 0x7f44b4155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/861600507 >> v2:172.21.15.184:3300/0 conn(0x7f44b406bd50 0x7f44b4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- 172.21.15.177:0/861600507 >> 172.21.15.177:0/861600507 conn(0x7f44b40b2450 msgr2=0x7f44b40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:03.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- 172.21.15.177:0/861600507 shutdown_connections 2023-10-25T16:13:03.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- 172.21.15.177:0/861600507 wait complete. 2023-10-25T16:13:03.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 Processor -- start 2023-10-25T16:13:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- start start 2023-10-25T16:13:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b406bd50 0x7f44b413c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b406c130 0x7f44b41f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b41612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41f4cd0 con 0x7f44b4158a70 2023-10-25T16:13:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41f4fb0 con 0x7f44b406c130 2023-10-25T16:13:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bc5ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41f5290 con 0x7f44b406bd50 2023-10-25T16:13:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bab8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b41612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bab8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b41612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47114/0 (socket says 172.21.15.177:47114) 2023-10-25T16:13:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44bab8b640 1 -- 172.21.15.177:0/3019150978 learned_addr learned my addr 172.21.15.177:0/3019150978 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44ba38a640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b406bd50 0x7f44b413c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.183+0000 7f44b9b89640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b406c130 0x7f44b41f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bab8b640 1 -- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b406bd50 msgr2=0x7f44b413c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bab8b640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b406bd50 0x7f44b413c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bab8b640 1 -- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b406c130 msgr2=0x7f44b41f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bab8b640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b406c130 0x7f44b41f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bab8b640 1 -- 172.21.15.177:0/3019150978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0098e0 con 0x7f44b4158a70 2023-10-25T16:13:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bab8b640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b41612e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f44ac01b350 tx=0x7f44ac0a5b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0bb070 con 0x7f44b4158a70 2023-10-25T16:13:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f44ac003b90 con 0x7f44b4158a70 2023-10-25T16:13:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b41f5570 con 0x7f44b4158a70 2023-10-25T16:13:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac004030 con 0x7f44b4158a70 2023-10-25T16:13:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b413c830 con 0x7f44b4158a70 2023-10-25T16:13:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b404daf0 con 0x7f44b4158a70 2023-10-25T16:13:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f44ac0b4040 con 0x7f44b4158a70 2023-10-25T16:13:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44aaffd640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4498066470 0x7f4498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44ac11e0c0 con 0x7f44b4158a70 2023-10-25T16:13:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44ba38a640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4498066470 0x7f4498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.187+0000 7f44ba38a640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4498066470 0x7f4498068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44b000bb70 tx=0x7f44b000b2e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.191+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44ac0eb8b0 con 0x7f44b4158a70 2023-10-25T16:13:03.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b40aedb0 con 0x7f44b4158a70 2023-10-25T16:13:03.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44aaffd640 1 -- 172.21.15.177:0/3019150978 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3704 (secure 0 0 0) 0x7f44ac0b2090 con 0x7f44b4158a70 2023-10-25T16:13:03.383 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:03.383 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":154145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-25T16:13:03.384 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 3 2023-10-25T16:13:03.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4498066470 msgr2=0x7f4498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4498066470 0x7f4498068930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44b000bb70 tx=0x7f44b000b2e0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 msgr2=0x7f44b41612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b41612e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f44ac01b350 tx=0x7f44ac0a5b30 comp rx=0 tx=0).stop 2023-10-25T16:13:03.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 shutdown_connections 2023-10-25T16:13:03.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4498066470 0x7f4498068930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44b4158a70 0x7f44b41612e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.379+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44b406c130 0x7f44b41f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.383+0000 7f44bc5ee640 1 --2- 172.21.15.177:0/3019150978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44b406bd50 0x7f44b413c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.383+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 >> 172.21.15.177:0/3019150978 conn(0x7f44b40b2450 msgr2=0x7f44b4159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.383+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 shutdown_connections 2023-10-25T16:13:03.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.383+0000 7f44bc5ee640 1 -- 172.21.15.177:0/3019150978 wait complete. 2023-10-25T16:13:03.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- 172.21.15.177:0/3769239341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f40058e0 msgr2=0x7fa1f4005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 --2- 172.21.15.177:0/3769239341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f40058e0 0x7fa1f4005d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c740 tx=0x7fa20001c680 comp rx=0 tx=0).stop 2023-10-25T16:13:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- 172.21.15.177:0/3769239341 shutdown_connections 2023-10-25T16:13:03.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 --2- 172.21.15.177:0/3769239341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f40058e0 0x7fa1f4005d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- 172.21.15.177:0/3769239341 >> 172.21.15.177:0/3769239341 conn(0x7fa20c0b2450 msgr2=0x7fa20c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:03.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- 172.21.15.177:0/3769239341 shutdown_connections 2023-10-25T16:13:03.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- 172.21.15.177:0/3769239341 wait complete. 2023-10-25T16:13:03.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 Processor -- start 2023-10-25T16:13:03.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- start start 2023-10-25T16:13:03.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1f40058e0 0x7fa20c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 0x7fa20c1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa20c0add50 0x7fa20c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0ae710 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0ab930 con 0x7fa20c0add50 2023-10-25T16:13:03.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa212cca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0ab090 con 0x7fa1f40058e0 2023-10-25T16:13:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa20bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 0x7fa20c1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa20bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 0x7fa20c1468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47134/0 (socket says 172.21.15.177:47134) 2023-10-25T16:13:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.511+0000 7fa20bfff640 1 -- 172.21.15.177:0/853114636 learned_addr learned my addr 172.21.15.177:0/853114636 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa210a66640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1f40058e0 0x7fa20c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa211267640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa20c0add50 0x7fa20c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa20bfff640 1 -- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1f40058e0 msgr2=0x7fa20c15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa20bfff640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1f40058e0 0x7fa20c15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa20bfff640 1 -- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa20c0add50 msgr2=0x7fa20c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa20bfff640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa20c0add50 0x7fa20c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa20bfff640 1 -- 172.21.15.177:0/853114636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0ab370 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa210a66640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1f40058e0 0x7fa20c15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa20bfff640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 0x7fa20c1468a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa200001f10 tx=0x7fa200005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200006390 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c0ab650 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c146de0 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa200006980 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000a7690 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c04daf0 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2000a77f0 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa2097fa640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1f8066470 0x7fa1f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa20011ea10 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa210a66640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1f8066470 0x7fa1f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.515+0000 7fa210a66640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1f8066470 0x7fa1f8068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa204000c10 tx=0x7fa204001540 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:03.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.519+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2000ec160 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.671+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa20c0acdc0 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.671+0000 7fa2097fa640 1 -- 172.21.15.177:0/853114636 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7fa2000afe60 con 0x7fa20c0aa8b0 2023-10-25T16:13:03.677 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:03.678 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":17,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:12:58.792091+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:03.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1f8066470 msgr2=0x7fa1f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1f8066470 0x7fa1f8068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa204000c10 tx=0x7fa204001540 comp rx=0 tx=0).stop 2023-10-25T16:13:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 msgr2=0x7fa20c1468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 0x7fa20c1468a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa200001f10 tx=0x7fa200005d50 comp rx=0 tx=0).stop 2023-10-25T16:13:03.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 shutdown_connections 2023-10-25T16:13:03.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1f8066470 0x7fa1f8068930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa20c0add50 0x7fa20c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa20c0aa8b0 0x7fa20c1468a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 --2- 172.21.15.177:0/853114636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1f40058e0 0x7fa20c15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 >> 172.21.15.177:0/853114636 conn(0x7fa20c0b2450 msgr2=0x7fa20c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:03.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 shutdown_connections 2023-10-25T16:13:03.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.675+0000 7fa212cca640 1 -- 172.21.15.177:0/853114636 wait complete. 2023-10-25T16:13:03.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:03.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:03.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/93805275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa21806b980 msgr2=0x7fa21806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 --2- 172.21.15.177:0/93805275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa21806b980 0x7fa21806be10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa210009c80 tx=0x7fa21001cd50 comp rx=0 tx=0).stop 2023-10-25T16:13:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/93805275 shutdown_connections 2023-10-25T16:13:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 --2- 172.21.15.177:0/93805275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa21806b980 0x7fa21806be10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 --2- 172.21.15.177:0/93805275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa218071500 0x7fa218070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/93805275 >> 172.21.15.177:0/93805275 conn(0x7fa2180b2450 msgr2=0x7fa2180b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/93805275 shutdown_connections 2023-10-25T16:13:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/93805275 wait complete. 2023-10-25T16:13:03.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 Processor -- start 2023-10-25T16:13:03.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- start start 2023-10-25T16:13:03.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa21806b980 0x7fa218154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 0x7fa2181534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa218159230 0x7fa21814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21814c4c0 con 0x7fa218071500 2023-10-25T16:13:03.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21814bbd0 con 0x7fa21806b980 2023-10-25T16:13:03.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180b1230 con 0x7fa218159230 2023-10-25T16:13:03.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 0x7fa2181534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 0x7fa2181534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47150/0 (socket says 172.21.15.177:47150) 2023-10-25T16:13:03.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 -- 172.21.15.177:0/514367006 learned_addr learned my addr 172.21.15.177:0/514367006 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:03.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 -- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa218159230 msgr2=0x7fa21814c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2177fe640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa218159230 0x7fa21814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa216ffd640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa21806b980 0x7fa218154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa218159230 0x7fa21814c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 -- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa21806b980 msgr2=0x7fa218154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa21806b980 0x7fa218154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 -- 172.21.15.177:0/514367006 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100098e0 con 0x7fa218071500 2023-10-25T16:13:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa2167fc640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 0x7fa2181534c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00c890 tx=0x7fa20c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:03.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c004220 con 0x7fa218071500 2023-10-25T16:13:03.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa20c004470 con 0x7fa218071500 2023-10-25T16:13:03.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c007c10 con 0x7fa218071500 2023-10-25T16:13:03.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180b0f50 con 0x7fa218071500 2023-10-25T16:13:03.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.811+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21814c150 con 0x7fa218071500 2023-10-25T16:13:03.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.815+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21804daf0 con 0x7fa218071500 2023-10-25T16:13:03.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.815+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa20c005030 con 0x7fa218071500 2023-10-25T16:13:03.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.815+0000 7fa1fffff640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa204066470 0x7fa204068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:03.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.815+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa20c084480 con 0x7fa218071500 2023-10-25T16:13:03.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.815+0000 7fa216ffd640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa204066470 0x7fa204068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:03.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.815+0000 7fa216ffd640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa204066470 0x7fa204068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa208007fd0 tx=0x7fa208009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:03.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.819+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa20c051c50 con 0x7fa218071500 2023-10-25T16:13:03.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.959+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa218153ed0 con 0x7fa218071500 2023-10-25T16:13:03.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.959+0000 7fa1fffff640 1 -- 172.21.15.177:0/514367006 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa20c01d020 con 0x7fa218071500 2023-10-25T16:13:03.965 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:03.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa204066470 msgr2=0x7fa204068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa204066470 0x7fa204068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa208007fd0 tx=0x7fa208009040 comp rx=0 tx=0).stop 2023-10-25T16:13:03.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 msgr2=0x7fa2181534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:03.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 0x7fa2181534c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00c890 tx=0x7fa20c00cd50 comp rx=0 tx=0).stop 2023-10-25T16:13:03.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 shutdown_connections 2023-10-25T16:13:03.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa204066470 0x7fa204068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa218159230 0x7fa21814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071500 0x7fa2181534c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 --2- 172.21.15.177:0/514367006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa21806b980 0x7fa218154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:03.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 >> 172.21.15.177:0/514367006 conn(0x7fa2180b2450 msgr2=0x7fa218069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:03.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 shutdown_connections 2023-10-25T16:13:03.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:03.963+0000 7fa21d92e640 1 -- 172.21.15.177:0/514367006 wait complete. 2023-10-25T16:13:03.982 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:13:04.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.095+0000 7f98d7615640 1 -- 172.21.15.177:0/111267894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc004d10 msgr2=0x7f98bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.095+0000 7f98d7615640 1 --2- 172.21.15.177:0/111267894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc004d10 0x7f98bc005190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f98c800c5c0 tx=0x7f98c801d2e0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.095+0000 7f98d5bb2640 1 -- 172.21.15.177:0/111267894 reap_dead start 2023-10-25T16:13:04.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.095+0000 7f98d7615640 1 -- 172.21.15.177:0/111267894 shutdown_connections 2023-10-25T16:13:04.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.095+0000 7f98d7615640 1 -- 172.21.15.177:0/111267894 >> 172.21.15.177:0/111267894 conn(0x7f98d00b2450 msgr2=0x7f98d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:04.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- 172.21.15.177:0/111267894 shutdown_connections 2023-10-25T16:13:04.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- 172.21.15.177:0/111267894 wait complete. 2023-10-25T16:13:04.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 Processor -- start 2023-10-25T16:13:04.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- start start 2023-10-25T16:13:04.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 0x7f98d00ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d00acec0 0x7f98d00af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d00af9d0 0x7f98d00a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00afe30 con 0x7f98d0150d80 2023-10-25T16:13:04.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00ad440 con 0x7f98d00acec0 2023-10-25T16:13:04.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d00ad720 con 0x7f98d00af9d0 2023-10-25T16:13:04.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 0x7f98d00ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 0x7f98d00ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47178/0 (socket says 172.21.15.177:47178) 2023-10-25T16:13:04.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 -- 172.21.15.177:0/2304171834 learned_addr learned my addr 172.21.15.177:0/2304171834 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:04.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d4bb0640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d00acec0 0x7f98d00af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d5bb2640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d00af9d0 0x7f98d00a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 -- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d00af9d0 msgr2=0x7f98d00a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d00af9d0 0x7f98d00a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 -- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d00acec0 msgr2=0x7f98d00af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d00acec0 0x7f98d00af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 -- 172.21.15.177:0/2304171834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d00ada00 con 0x7f98d0150d80 2023-10-25T16:13:04.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d5bb2640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d00af9d0 0x7f98d00a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:04.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d53b1640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 0x7f98d00ac980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00e970 tx=0x7f98cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:04.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00ccc0 con 0x7f98d0150d80 2023-10-25T16:13:04.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98cc00ce20 con 0x7f98d0150d80 2023-10-25T16:13:04.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d00adce0 con 0x7f98d0150d80 2023-10-25T16:13:04.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc005280 con 0x7f98d0150d80 2023-10-25T16:13:04.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d01516c0 con 0x7f98d0150d80 2023-10-25T16:13:04.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.099+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d004daf0 con 0x7f98d0150d80 2023-10-25T16:13:04.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.103+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98cc0053e0 con 0x7f98d0150d80 2023-10-25T16:13:04.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.103+0000 7f98c5ffb640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f98b4066470 0x7f98b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.103+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98cc014070 con 0x7f98d0150d80 2023-10-25T16:13:04.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.103+0000 7f98d4bb0640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f98b4066470 0x7f98b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.103+0000 7f98d4bb0640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f98b4066470 0x7f98b4068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98d00a81a0 tx=0x7f98c0005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:04.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.107+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f98cc051d50 con 0x7f98d0150d80 2023-10-25T16:13:04.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.263+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98d006c2a0 con 0x7f98d0150d80 2023-10-25T16:13:04.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.263+0000 7f98c5ffb640 1 -- 172.21.15.177:0/2304171834 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f98cc055370 con 0x7f98d0150d80 2023-10-25T16:13:04.269 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:04.269 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:13:04.269 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:13:04.270 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:13:04.270 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:13:04.270 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:13:04.270 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:13:04.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f98b4066470 msgr2=0x7f98b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f98b4066470 0x7f98b4068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98d00a81a0 tx=0x7f98c0005f40 comp rx=0 tx=0).stop 2023-10-25T16:13:04.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 msgr2=0x7f98d00ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 0x7f98d00ac980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00e970 tx=0x7f98cc00ee30 comp rx=0 tx=0).stop 2023-10-25T16:13:04.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 shutdown_connections 2023-10-25T16:13:04.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f98b4066470 0x7f98b4068930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98d00af9d0 0x7f98d00a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98d00acec0 0x7f98d00af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 --2- 172.21.15.177:0/2304171834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98d0150d80 0x7f98d00ac980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 >> 172.21.15.177:0/2304171834 conn(0x7f98d00b2450 msgr2=0x7f98d01585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:04.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 shutdown_connections 2023-10-25T16:13:04.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.267+0000 7f98d7615640 1 -- 172.21.15.177:0/2304171834 wait complete. 2023-10-25T16:13:04.287 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:13:04.288 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:13:04.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- 172.21.15.177:0/2623177771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 msgr2=0x7fdf68097ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 --2- 172.21.15.177:0/2623177771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf68097ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009c80 tx=0x7fdf6001cd50 comp rx=0 tx=0).stop 2023-10-25T16:13:04.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- 172.21.15.177:0/2623177771 shutdown_connections 2023-10-25T16:13:04.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 --2- 172.21.15.177:0/2623177771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf68097ef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 --2- 172.21.15.177:0/2623177771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf680cd970 0x7fdf680b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- 172.21.15.177:0/2623177771 >> 172.21.15.177:0/2623177771 conn(0x7fdf680b0b50 msgr2=0x7fdf680b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:04.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- 172.21.15.177:0/2623177771 shutdown_connections 2023-10-25T16:13:04.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- 172.21.15.177:0/2623177771 wait complete. 2023-10-25T16:13:04.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 Processor -- start 2023-10-25T16:13:04.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- start start 2023-10-25T16:13:04.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf680b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf68159690 0x7fdf680b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf681511e0 0x7fdf680b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680b35e0 con 0x7fdf68097a40 2023-10-25T16:13:04.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680b2cd0 con 0x7fdf681511e0 2023-10-25T16:13:04.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf6e321640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf681567b0 con 0x7fdf68159690 2023-10-25T16:13:04.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf67fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf680b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf67fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf680b3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47188/0 (socket says 172.21.15.177:47188) 2023-10-25T16:13:04.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.411+0000 7fdf67fff640 1 -- 172.21.15.177:0/542947384 learned_addr learned my addr 172.21.15.177:0/542947384 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:04.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf67fff640 1 -- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf68159690 msgr2=0x7fdf680b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf677fe640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf68159690 0x7fdf680b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf6c8be640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf681511e0 0x7fdf680b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf67fff640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf68159690 0x7fdf680b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf67fff640 1 -- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf681511e0 msgr2=0x7fdf680b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:04.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf67fff640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf681511e0 0x7fdf680b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:04.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf67fff640 1 -- 172.21.15.177:0/542947384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600098e0 con 0x7fdf68097a40 2023-10-25T16:13:04.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf67fff640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf680b3d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c3c0 tx=0x7fdf5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:04.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf580052d0 con 0x7fdf68097a40 2023-10-25T16:13:04.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf58003600 con 0x7fdf68097a40 2023-10-25T16:13:04.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf680b4370 con 0x7fdf68097a40 2023-10-25T16:13:04.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58003a10 con 0x7fdf68097a40 2023-10-25T16:13:04.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf680b3200 con 0x7fdf68097a40 2023-10-25T16:13:04.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf68073360 con 0x7fdf68097a40 2023-10-25T16:13:04.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf58003b70 con 0x7fdf68097a40 2023-10-25T16:13:04.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf64ff9640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf54066470 0x7fdf54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:04.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf580832d0 con 0x7fdf68097a40 2023-10-25T16:13:04.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf677fe640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf54066470 0x7fdf54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:04.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.415+0000 7fdf677fe640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf54066470 0x7fdf54068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0058d0 tx=0x7fdf5c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:04.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.419+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf58050aa0 con 0x7fdf68097a40 2023-10-25T16:13:04.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:04.563+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdf680661e0 con 0x7fdf68097a40 2023-10-25T16:13:05.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.551+0000 7fdf64ff9640 1 -- 172.21.15.177:0/542947384 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdf580540c0 con 0x7fdf68097a40 2023-10-25T16:13:05.556 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:13:05.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf54066470 msgr2=0x7fdf54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:05.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf54066470 0x7fdf54068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0058d0 tx=0x7fdf5c005860 comp rx=0 tx=0).stop 2023-10-25T16:13:05.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 msgr2=0x7fdf680b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:05.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf680b3d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c3c0 tx=0x7fdf5800c880 comp rx=0 tx=0).stop 2023-10-25T16:13:05.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 shutdown_connections 2023-10-25T16:13:05.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf54066470 0x7fdf54068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf681511e0 0x7fdf680b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf68159690 0x7fdf680b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 --2- 172.21.15.177:0/542947384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf68097a40 0x7fdf680b3d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 >> 172.21.15.177:0/542947384 conn(0x7fdf680b0b50 msgr2=0x7fdf680ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:05.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 shutdown_connections 2023-10-25T16:13:05.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.555+0000 7fdf6e321640 1 -- 172.21.15.177:0/542947384 wait complete. 2023-10-25T16:13:05.581 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:13:05.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 -- 172.21.15.177:0/1119975209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7815b780 msgr2=0x7f5b780cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:05.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/1119975209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7815b780 0x7f5b780cf250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009840 tx=0x7f5b6c01c7c0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 -- 172.21.15.177:0/1119975209 shutdown_connections 2023-10-25T16:13:05.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/1119975209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b7815b780 0x7f5b780cf250 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 -- 172.21.15.177:0/1119975209 >> 172.21.15.177:0/1119975209 conn(0x7f5b7808ac90 msgr2=0x7f5b7809a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:05.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 -- 172.21.15.177:0/1119975209 shutdown_connections 2023-10-25T16:13:05.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.711+0000 7f5b7ec04640 1 -- 172.21.15.177:0/1119975209 wait complete. 2023-10-25T16:13:05.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 Processor -- start 2023-10-25T16:13:05.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- start start 2023-10-25T16:13:05.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 0x7f5b78150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:05.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b7815b3a0 0x7f5b780ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:05.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b7815b780 0x7f5b780b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:05.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780ca240 con 0x7f5b780ccbe0 2023-10-25T16:13:05.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c9370 con 0x7f5b7815b780 2023-10-25T16:13:05.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c95c0 con 0x7f5b7815b3a0 2023-10-25T16:13:05.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 0x7f5b78150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:05.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 0x7f5b78150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47212/0 (socket says 172.21.15.177:47212) 2023-10-25T16:13:05.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 -- 172.21.15.177:0/291379244 learned_addr learned my addr 172.21.15.177:0/291379244 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:05.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7d1a1640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b7815b780 0x7f5b780b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:05.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b77fff640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b7815b3a0 0x7f5b780ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:05.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 -- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b7815b3a0 msgr2=0x7f5b780ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:05.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b7815b3a0 0x7f5b780ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 -- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b7815b780 msgr2=0x7f5b780b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:05.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b7815b780 0x7f5b780b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:05.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 -- 172.21.15.177:0/291379244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0094a0 con 0x7f5b780ccbe0 2023-10-25T16:13:05.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7d1a1640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b7815b780 0x7f5b780b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:05.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7c9a0640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 0x7f5b78150280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c480 tx=0x7f5b6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:05.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68012830 con 0x7f5b780ccbe0 2023-10-25T16:13:05.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780c98a0 con 0x7f5b780ccbe0 2023-10-25T16:13:05.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b68012a80 con 0x7f5b780ccbe0 2023-10-25T16:13:05.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68011380 con 0x7f5b780ccbe0 2023-10-25T16:13:05.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780c9e60 con 0x7f5b780ccbe0 2023-10-25T16:13:05.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b780ca380 con 0x7f5b780ccbe0 2023-10-25T16:13:05.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b680114e0 con 0x7f5b780ccbe0 2023-10-25T16:13:05.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.715+0000 7f5b757fa640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b64066470 0x7f5b64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:05.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.719+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5b68083e10 con 0x7f5b780ccbe0 2023-10-25T16:13:05.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.719+0000 7f5b77fff640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b64066470 0x7f5b64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:05.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.719+0000 7f5b77fff640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b64066470 0x7f5b64068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0af000 tx=0x7f5b6c01b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:05.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.723+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b780ca380 con 0x7f5b780ccbe0 2023-10-25T16:13:05.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:05.875+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5b7804db20 con 0x7f5b780ccbe0 2023-10-25T16:13:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b757fa640 1 -- 172.21.15.177:0/291379244 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5b68051480 con 0x7f5b780ccbe0 2023-10-25T16:13:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:13:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b64066470 msgr2=0x7f5b64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b64066470 0x7f5b64068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0af000 tx=0x7f5b6c01b000 comp rx=0 tx=0).stop 2023-10-25T16:13:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 msgr2=0x7f5b78150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 0x7f5b78150280 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c480 tx=0x7f5b6800c940 comp rx=0 tx=0).stop 2023-10-25T16:13:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 shutdown_connections 2023-10-25T16:13:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b64066470 0x7f5b64068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b7815b780 0x7f5b780b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b7815b3a0 0x7f5b780ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 --2- 172.21.15.177:0/291379244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b780ccbe0 0x7f5b78150280 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 >> 172.21.15.177:0/291379244 conn(0x7f5b7808ac90 msgr2=0x7f5b781590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 shutdown_connections 2023-10-25T16:13:06.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.559+0000 7f5b7ec04640 1 -- 172.21.15.177:0/291379244 wait complete. 2023-10-25T16:13:06.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:13:06.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- 172.21.15.177:0/2864177485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c0cb550 msgr2=0x7f817c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:06.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 --2- 172.21.15.177:0/2864177485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c0cb550 0x7f817c06ca30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8164009900 tx=0x7f816401c8c0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- 172.21.15.177:0/2864177485 shutdown_connections 2023-10-25T16:13:06.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 --2- 172.21.15.177:0/2864177485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c0cb550 0x7f817c06ca30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 --2- 172.21.15.177:0/2864177485 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c06c650 0x7f817c0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- 172.21.15.177:0/2864177485 >> 172.21.15.177:0/2864177485 conn(0x7f817c0caa30 msgr2=0x7f817c0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:06.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- 172.21.15.177:0/2864177485 shutdown_connections 2023-10-25T16:13:06.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- 172.21.15.177:0/2864177485 wait complete. 2023-10-25T16:13:06.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 Processor -- start 2023-10-25T16:13:06.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- start start 2023-10-25T16:13:06.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 0x7f817c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:06.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c06cf70 0x7f817c06aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:06.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c0cb550 0x7f817c06b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:06.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0ab730 con 0x7f817c06c650 2023-10-25T16:13:06.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0aba10 con 0x7f817c06cf70 2023-10-25T16:13:06.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8180811640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0abcf0 con 0x7f817c0cb550 2023-10-25T16:13:06.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f817a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 0x7f817c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:06.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f817a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 0x7f817c14e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47222/0 (socket says 172.21.15.177:47222) 2023-10-25T16:13:06.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f817a59c640 1 -- 172.21.15.177:0/188866238 learned_addr learned my addr 172.21.15.177:0/188866238 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:06.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f817ad9d640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c0cb550 0x7f817c06b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:06.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.727+0000 7f8171d9b640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c06cf70 0x7f817c06aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:06.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817a59c640 1 -- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c0cb550 msgr2=0x7f817c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:06.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817a59c640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c0cb550 0x7f817c06b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817a59c640 1 -- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c06cf70 msgr2=0x7f817c06aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:06.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817a59c640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c06cf70 0x7f817c06aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:06.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817a59c640 1 -- 172.21.15.177:0/188866238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164009560 con 0x7f817c06c650 2023-10-25T16:13:06.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817ad9d640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c0cb550 0x7f817c06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:06.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f817a59c640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 0x7f817c14e5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e9f0 tx=0x7f816c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:06.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c009710 con 0x7f817c06c650 2023-10-25T16:13:06.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f816c00ce70 con 0x7f817c06c650 2023-10-25T16:13:06.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0abfd0 con 0x7f817c06c650 2023-10-25T16:13:06.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c010690 con 0x7f817c06c650 2023-10-25T16:13:06.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c14eb10 con 0x7f817c06c650 2023-10-25T16:13:06.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c04daf0 con 0x7f817c06c650 2023-10-25T16:13:06.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f816c0107f0 con 0x7f817c06c650 2023-10-25T16:13:06.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f81737fe640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f815c066470 0x7f815c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:06.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f816c014070 con 0x7f817c06c650 2023-10-25T16:13:06.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f8171d9b640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f815c066470 0x7f815c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:06.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.731+0000 7f8171d9b640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f815c066470 0x7f815c068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81640af000 tx=0x7f816401b100 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:06.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.735+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f816c050090 con 0x7f817c06c650 2023-10-25T16:13:06.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:06.923+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f817c0af8f0 con 0x7f817c06c650 2023-10-25T16:13:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.591+0000 7f81737fe640 1 -- 172.21.15.177:0/188866238 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f816c0557e0 con 0x7f817c06c650 2023-10-25T16:13:07.597 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 2 and data pool 3 2023-10-25T16:13:07.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f815c066470 msgr2=0x7f815c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f815c066470 0x7f815c068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81640af000 tx=0x7f816401b100 comp rx=0 tx=0).stop 2023-10-25T16:13:07.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 msgr2=0x7f817c14e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 0x7f817c14e5d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f816c00e9f0 tx=0x7f816c00eeb0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 shutdown_connections 2023-10-25T16:13:07.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f815c066470 0x7f815c068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f817c0cb550 0x7f817c06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f817c06cf70 0x7f817c06aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 --2- 172.21.15.177:0/188866238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f817c06c650 0x7f817c14e5d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 >> 172.21.15.177:0/188866238 conn(0x7f817c0caa30 msgr2=0x7f817c069720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:07.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 shutdown_connections 2023-10-25T16:13:07.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.595+0000 7f8180811640 1 -- 172.21.15.177:0/188866238 wait complete. 2023-10-25T16:13:07.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:07.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 -- 172.21.15.177:0/1424638653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 msgr2=0x7f8f740b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 --2- 172.21.15.177:0/1424638653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f740b4100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f7409f200 tx=0x7f8f6401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 -- 172.21.15.177:0/1424638653 shutdown_connections 2023-10-25T16:13:07.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 --2- 172.21.15.177:0/1424638653 >> v2:172.21.15.184:3300/0 conn(0x7f8f740b2120 0x7f8f740d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 --2- 172.21.15.177:0/1424638653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f740b4100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 -- 172.21.15.177:0/1424638653 >> 172.21.15.177:0/1424638653 conn(0x7f8f7409a5c0 msgr2=0x7f8f740d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:07.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 -- 172.21.15.177:0/1424638653 shutdown_connections 2023-10-25T16:13:07.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.747+0000 7f8f799db640 1 -- 172.21.15.177:0/1424638653 wait complete. 2023-10-25T16:13:07.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 Processor -- start 2023-10-25T16:13:07.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- start start 2023-10-25T16:13:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f740b2120 0x7f8f7415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f740cdb10 0x7f8f7414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f74151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74150450 con 0x7f8f7415eba0 2023-10-25T16:13:07.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7414f0d0 con 0x7f8f740cdb10 2023-10-25T16:13:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7414f3b0 con 0x7f8f740b2120 2023-10-25T16:13:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f74151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f74151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47236/0 (socket says 172.21.15.177:47236) 2023-10-25T16:13:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 -- 172.21.15.177:0/1870677855 learned_addr learned my addr 172.21.15.177:0/1870677855 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:07.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 -- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f740b2120 msgr2=0x7f8f7415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f740b2120 0x7f8f7415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 -- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f740cdb10 msgr2=0x7f8f7414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f727fc640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f740cdb10 0x7f8f7414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f740cdb10 0x7f8f7414e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 -- 172.21.15.177:0/1870677855 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64009560 con 0x7f8f7415eba0 2023-10-25T16:13:07.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f737fe640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f74151490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00c780 tx=0x7f8f6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:07.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c003d90 con 0x7f8f7415eba0 2023-10-25T16:13:07.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f6c00ce90 con 0x7f8f7415eba0 2023-10-25T16:13:07.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7414f690 con 0x7f8f7415eba0 2023-10-25T16:13:07.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0052d0 con 0x7f8f7415eba0 2023-10-25T16:13:07.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7414fc50 con 0x7f8f7415eba0 2023-10-25T16:13:07.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.751+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7404daf0 con 0x7f8f7415eba0 2023-10-25T16:13:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.755+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f6c005430 con 0x7f8f7415eba0 2023-10-25T16:13:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.755+0000 7f8f5bfff640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8f600664a0 0x7f8f60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.755+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f6c083530 con 0x7f8f7415eba0 2023-10-25T16:13:07.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.755+0000 7f8f72ffd640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8f600664a0 0x7f8f60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.755+0000 7f8f72ffd640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8f600664a0 0x7f8f60068960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f640ae000 tx=0x7f8f64019570 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:07.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.759+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f6c0509a0 con 0x7f8f7415eba0 2023-10-25T16:13:07.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f740ce930 con 0x7f8f7415eba0 2023-10-25T16:13:07.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f5bfff640 1 -- 172.21.15.177:0/1870677855 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f8f6c053fc0 con 0x7f8f7415eba0 2023-10-25T16:13:07.919 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:07.919 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:06.928702+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:07.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8f600664a0 msgr2=0x7f8f60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8f600664a0 0x7f8f60068960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f640ae000 tx=0x7f8f64019570 comp rx=0 tx=0).stop 2023-10-25T16:13:07.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 msgr2=0x7f8f74151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:07.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f74151490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00c780 tx=0x7f8f6c00cc40 comp rx=0 tx=0).stop 2023-10-25T16:13:07.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 shutdown_connections 2023-10-25T16:13:07.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8f600664a0 0x7f8f60068960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f7415eba0 0x7f8f74151490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f740cdb10 0x7f8f7414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.915+0000 7f8f799db640 1 --2- 172.21.15.177:0/1870677855 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f740b2120 0x7f8f7415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.919+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 >> 172.21.15.177:0/1870677855 conn(0x7f8f7409a5c0 msgr2=0x7f8f740cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.919+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 shutdown_connections 2023-10-25T16:13:07.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:07.919+0000 7f8f799db640 1 -- 172.21.15.177:0/1870677855 wait complete. 2023-10-25T16:13:07.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:08.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- 172.21.15.177:0/1957710926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4940b2120 msgr2=0x7fa4940d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 --2- 172.21.15.177:0/1957710926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4940b2120 0x7fa4940d1bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4940b3ea0 tx=0x7fa47c01c750 comp rx=0 tx=0).stop 2023-10-25T16:13:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- 172.21.15.177:0/1957710926 shutdown_connections 2023-10-25T16:13:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 --2- 172.21.15.177:0/1957710926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4940b2120 0x7fa4940d1bd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 --2- 172.21.15.177:0/1957710926 >> v2:172.21.15.184:3300/0 conn(0x7fa49415eba0 0x7fa4940b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- 172.21.15.177:0/1957710926 >> 172.21.15.177:0/1957710926 conn(0x7fa49409a5c0 msgr2=0x7fa4940d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- 172.21.15.177:0/1957710926 shutdown_connections 2023-10-25T16:13:08.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- 172.21.15.177:0/1957710926 wait complete. 2023-10-25T16:13:08.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 Processor -- start 2023-10-25T16:13:08.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- start start 2023-10-25T16:13:08.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4940b2120 0x7fa494156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4940cdb10 0x7fa49415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 0x7fa494158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa494157180 con 0x7fa49415eba0 2023-10-25T16:13:08.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940b4d00 con 0x7fa4940b2120 2023-10-25T16:13:08.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4999dc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4940b4fe0 con 0x7fa4940cdb10 2023-10-25T16:13:08.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 0x7fa494158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 0x7fa494158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47260/0 (socket says 172.21.15.177:47260) 2023-10-25T16:13:08.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.055+0000 7fa4937fe640 1 -- 172.21.15.177:0/535499816 learned_addr learned my addr 172.21.15.177:0/535499816 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:08.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4937fe640 1 -- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4940cdb10 msgr2=0x7fa49415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4937fe640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4940cdb10 0x7fa49415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4937fe640 1 -- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4940b2120 msgr2=0x7fa494156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4937fe640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4940b2120 0x7fa494156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4937fe640 1 -- 172.21.15.177:0/535499816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0094a0 con 0x7fa49415eba0 2023-10-25T16:13:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4937fe640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 0x7fa494158a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00cbc0 tx=0x7fa48c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00aa50 con 0x7fa49415eba0 2023-10-25T16:13:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa48c00aca0 con 0x7fa49415eba0 2023-10-25T16:13:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48c012680 con 0x7fa49415eba0 2023-10-25T16:13:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4940b52c0 con 0x7fa49415eba0 2023-10-25T16:13:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4940b5880 con 0x7fa49415eba0 2023-10-25T16:13:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4940b5a70 con 0x7fa49415eba0 2023-10-25T16:13:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa48c01b410 con 0x7fa49415eba0 2023-10-25T16:13:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa490ff9640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa474066470 0x7fa474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa48c084020 con 0x7fa49415eba0 2023-10-25T16:13:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.059+0000 7fa492ffd640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa474066470 0x7fa474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.063+0000 7fa492ffd640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa474066470 0x7fa474068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa4840058d0 tx=0x7fa484005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:08.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.063+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa48c051530 con 0x7fa49415eba0 2023-10-25T16:13:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.219+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa49404daf0 con 0x7fa49415eba0 2023-10-25T16:13:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.219+0000 7fa490ff9640 1 -- 172.21.15.177:0/535499816 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fa48c054b50 con 0x7fa49415eba0 2023-10-25T16:13:08.224 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:08.224 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":20,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:06.928702+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa474066470 msgr2=0x7fa474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa474066470 0x7fa474068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa4840058d0 tx=0x7fa484005860 comp rx=0 tx=0).stop 2023-10-25T16:13:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 msgr2=0x7fa494158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 0x7fa494158a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00cbc0 tx=0x7fa48c00ccb0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 shutdown_connections 2023-10-25T16:13:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa474066470 0x7fa474068930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa49415eba0 0x7fa494158a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4940cdb10 0x7fa49415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 --2- 172.21.15.177:0/535499816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4940b2120 0x7fa494156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 >> 172.21.15.177:0/535499816 conn(0x7fa49409a5c0 msgr2=0x7fa4940b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:08.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 shutdown_connections 2023-10-25T16:13:08.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.223+0000 7fa4999dc640 1 -- 172.21.15.177:0/535499816 wait complete. 2023-10-25T16:13:08.243 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:13:08.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/364961388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 msgr2=0x7fcbec0d1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 --2- 172.21.15.177:0/364961388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec0d1890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd401c730 comp rx=0 tx=0).stop 2023-10-25T16:13:08.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/364961388 shutdown_connections 2023-10-25T16:13:08.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 --2- 172.21.15.177:0/364961388 >> v2:172.21.15.184:3300/0 conn(0x7fcbec0cc9e0 0x7fcbec0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 --2- 172.21.15.177:0/364961388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec0d1890 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/364961388 >> 172.21.15.177:0/364961388 conn(0x7fcbec065f40 msgr2=0x7fcbec09a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:08.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/364961388 shutdown_connections 2023-10-25T16:13:08.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/364961388 wait complete. 2023-10-25T16:13:08.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 Processor -- start 2023-10-25T16:13:08.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- start start 2023-10-25T16:13:08.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbec0cc9e0 0x7fcbec15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbec15b590 0x7fcbec0c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec14fa40 con 0x7fcbec0d1420 2023-10-25T16:13:08.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec15abf0 con 0x7fcbec15b590 2023-10-25T16:13:08.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0cb340 con 0x7fcbec0cc9e0 2023-10-25T16:13:08.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47266/0 (socket says 172.21.15.177:47266) 2023-10-25T16:13:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 -- 172.21.15.177:0/3558972886 learned_addr learned my addr 172.21.15.177:0/3558972886 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbea59c640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbec0cc9e0 0x7fcbec15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 -- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbec0cc9e0 msgr2=0x7fcbec15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbec0cc9e0 0x7fcbec15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 -- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbec15b590 msgr2=0x7fcbec0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbec15b590 0x7fcbec0c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 -- 172.21.15.177:0/3558972886 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40094a0 con 0x7fcbec0d1420 2023-10-25T16:13:08.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe1d9b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec151530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000c10 tx=0x7fcbd40a6700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:08.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40a7e40 con 0x7fcbec0d1420 2023-10-25T16:13:08.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcbd4004130 con 0x7fcbec0d1420 2023-10-25T16:13:08.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec14f0a0 con 0x7fcbec0d1420 2023-10-25T16:13:08.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4004520 con 0x7fcbec0d1420 2023-10-25T16:13:08.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.371+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec14f660 con 0x7fcbec0d1420 2023-10-25T16:13:08.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.375+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec14fb80 con 0x7fcbec0d1420 2023-10-25T16:13:08.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.375+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcbd4005030 con 0x7fcbec0d1420 2023-10-25T16:13:08.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.375+0000 7fcbe37fe640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcbcc0664a0 0x7fcbcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.375+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbd40aa070 con 0x7fcbec0d1420 2023-10-25T16:13:08.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.375+0000 7fcbea59c640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcbcc0664a0 0x7fcbcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.375+0000 7fcbea59c640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcbcc0664a0 0x7fcbcc068960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0011f0 tx=0x7fcbdc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:08.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.379+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcbec14fb80 con 0x7fcbec0d1420 2023-10-25T16:13:08.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.567+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcbec14fb80 con 0x7fcbec0d1420 2023-10-25T16:13:08.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.595+0000 7fcbe37fe640 1 -- 172.21.15.177:0/3558972886 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcbec14fb80 con 0x7fcbec0d1420 2023-10-25T16:13:08.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcbcc0664a0 msgr2=0x7fcbcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcbcc0664a0 0x7fcbcc068960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0011f0 tx=0x7fcbdc009040 comp rx=0 tx=0).stop 2023-10-25T16:13:08.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 msgr2=0x7fcbec151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec151530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000c10 tx=0x7fcbd40a6700 comp rx=0 tx=0).stop 2023-10-25T16:13:08.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 shutdown_connections 2023-10-25T16:13:08.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcbcc0664a0 0x7fcbcc068960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbec15b590 0x7fcbec0c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbec0d1420 0x7fcbec151530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 --2- 172.21.15.177:0/3558972886 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbec0cc9e0 0x7fcbec15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 >> 172.21.15.177:0/3558972886 conn(0x7fcbec065f40 msgr2=0x7fcbec0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:08.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 shutdown_connections 2023-10-25T16:13:08.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.599+0000 7fcbf083b640 1 -- 172.21.15.177:0/3558972886 wait complete. 2023-10-25T16:13:08.620 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2023-10-25T16:13:08.620 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:13:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/3910195670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 msgr2=0x7f7aac0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/3910195670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0cb390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009900 tx=0x7f7aa801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/3910195670 shutdown_connections 2023-10-25T16:13:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/3910195670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7aac0ced60 0x7f7aac0c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/3910195670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0cb390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/3910195670 >> 172.21.15.177:0/3910195670 conn(0x7f7aac069d20 msgr2=0x7f7aac06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.731+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/3910195670 shutdown_connections 2023-10-25T16:13:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/3910195670 wait complete. 2023-10-25T16:13:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 Processor -- start 2023-10-25T16:13:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- start start 2023-10-25T16:13:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7aac0ced60 0x7f7aac1f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7aac158bb0 0x7f7aac1f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac14fab0 con 0x7f7aac0ce980 2023-10-25T16:13:08.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1f5b40 con 0x7f7aac158bb0 2023-10-25T16:13:08.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0c6700 con 0x7f7aac0ced60 2023-10-25T16:13:08.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47288/0 (socket says 172.21.15.177:47288) 2023-10-25T16:13:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 -- 172.21.15.177:0/1537291512 learned_addr learned my addr 172.21.15.177:0/1537291512 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 -- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7aac0ced60 msgr2=0x7f7aac1f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7aac0ced60 0x7f7aac1f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 -- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7aac158bb0 msgr2=0x7f7aac1f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7aac158bb0 0x7f7aac1f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 -- 172.21.15.177:0/1537291512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8009560 con 0x7f7aac0ce980 2023-10-25T16:13:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab1d3d640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0c5d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009850 tx=0x7f7aa80a5800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8004340 con 0x7f7aac0ce980 2023-10-25T16:13:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7aa8005030 con 0x7f7aac0ce980 2023-10-25T16:13:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac0c69e0 con 0x7f7aac0ce980 2023-10-25T16:13:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8005420 con 0x7f7aac0ce980 2023-10-25T16:13:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac0c6fa0 con 0x7f7aac0ce980 2023-10-25T16:13:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac04daf0 con 0x7f7aac0ce980 2023-10-25T16:13:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.735+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7aa80b4070 con 0x7f7aac0ce980 2023-10-25T16:13:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.739+0000 7f7aa27fc640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a900664a0 0x7f7a90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.739+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aa811e250 con 0x7f7aac0ce980 2023-10-25T16:13:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.739+0000 7f7ab153c640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a900664a0 0x7f7a90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.739+0000 7f7ab153c640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a900664a0 0x7f7a90068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7aac14d420 tx=0x7f7a9c006ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.743+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7aa80eb640 con 0x7f7aac0ce980 2023-10-25T16:13:08.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:08.923+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7aac157ef0 con 0x7f7aac0ce980 2023-10-25T16:13:09.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.619+0000 7f7aa27fc640 1 -- 172.21.15.177:0/1537291512 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7aa80eec60 con 0x7f7aac0ce980 2023-10-25T16:13:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a900664a0 msgr2=0x7f7a90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a900664a0 0x7f7a90068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7aac14d420 tx=0x7f7a9c006ca0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 msgr2=0x7f7aac0c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0c5d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009850 tx=0x7f7aa80a5800 comp rx=0 tx=0).stop 2023-10-25T16:13:09.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 shutdown_connections 2023-10-25T16:13:09.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a900664a0 0x7f7a90068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7aac158bb0 0x7f7aac1f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7aac0ced60 0x7f7aac1f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 --2- 172.21.15.177:0/1537291512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7aac0ce980 0x7f7aac0c5d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 >> 172.21.15.177:0/1537291512 conn(0x7f7aac069d20 msgr2=0x7f7aac1570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:09.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 shutdown_connections 2023-10-25T16:13:09.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.623+0000 7f7ab3fa1640 1 -- 172.21.15.177:0/1537291512 wait complete. 2023-10-25T16:13:09.644 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:13:09.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:09.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.767+0000 7f02f6225640 1 -- 172.21.15.177:0/3955817578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006f570 msgr2=0x7f02f00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.767+0000 7f02f6225640 1 --2- 172.21.15.177:0/3955817578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006f570 0x7f02f00cb5c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009c80 tx=0x7f02e801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.767+0000 7f02f6225640 1 -- 172.21.15.177:0/3955817578 shutdown_connections 2023-10-25T16:13:09.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.767+0000 7f02f6225640 1 --2- 172.21.15.177:0/3955817578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006f570 0x7f02f00cb5c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.767+0000 7f02f6225640 1 --2- 172.21.15.177:0/3955817578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02f006c160 0x7f02f00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.767+0000 7f02f6225640 1 -- 172.21.15.177:0/3955817578 >> 172.21.15.177:0/3955817578 conn(0x7f02f00b2450 msgr2=0x7f02f00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:09.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- 172.21.15.177:0/3955817578 shutdown_connections 2023-10-25T16:13:09.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- 172.21.15.177:0/3955817578 wait complete. 2023-10-25T16:13:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 Processor -- start 2023-10-25T16:13:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- start start 2023-10-25T16:13:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 0x7f02f013a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f006f570 0x7f02f01605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02f0140cf0 0x7f02f01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:09.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015d2b0 con 0x7f02f006c160 2023-10-25T16:13:09.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f013ac70 con 0x7f02f006f570 2023-10-25T16:13:09.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015cef0 con 0x7f02f0140cf0 2023-10-25T16:13:09.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 0x7f02f013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:09.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 0x7f02f013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47304/0 (socket says 172.21.15.177:47304) 2023-10-25T16:13:09.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 -- 172.21.15.177:0/1020957396 learned_addr learned my addr 172.21.15.177:0/1020957396 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:09.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02eeffd640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f006f570 0x7f02f01605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:09.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02effff640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02f0140cf0 0x7f02f01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:09.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 -- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02f0140cf0 msgr2=0x7f02f01560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02f0140cf0 0x7f02f01560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 -- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f006f570 msgr2=0x7f02f01605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f006f570 0x7f02f01605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 -- 172.21.15.177:0/1020957396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80098e0 con 0x7f02f006c160 2023-10-25T16:13:09.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02ef7fe640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 0x7f02f013a730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c3c0 tx=0x7f02e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:09.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00052d0 con 0x7f02f006c160 2023-10-25T16:13:09.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f02e0003600 con 0x7f02f006c160 2023-10-25T16:13:09.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f0139c60 con 0x7f02f006c160 2023-10-25T16:13:09.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0003a10 con 0x7f02f006c160 2023-10-25T16:13:09.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.771+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f013a220 con 0x7f02f006c160 2023-10-25T16:13:09.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.775+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f00caaf0 con 0x7f02f006c160 2023-10-25T16:13:09.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.775+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02e0003b70 con 0x7f02f006c160 2023-10-25T16:13:09.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.775+0000 7f02d7fff640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02dc066470 0x7f02dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:09.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.775+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02e0083550 con 0x7f02f006c160 2023-10-25T16:13:09.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.775+0000 7f02eeffd640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02dc066470 0x7f02dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:09.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.775+0000 7f02eeffd640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02dc066470 0x7f02dc068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02f00afae0 tx=0x7f02e4005e70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:09.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.779+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02e0050a60 con 0x7f02f006c160 2023-10-25T16:13:09.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.967+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02f015d060 con 0x7f02f006c160 2023-10-25T16:13:09.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.967+0000 7f02d7fff640 1 -- 172.21.15.177:0/1020957396 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f02e0054080 con 0x7f02f006c160 2023-10-25T16:13:09.971 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:09.972 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:09.972 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:09.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02dc066470 msgr2=0x7f02dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02dc066470 0x7f02dc068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02f00afae0 tx=0x7f02e4005e70 comp rx=0 tx=0).stop 2023-10-25T16:13:09.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 msgr2=0x7f02f013a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:09.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 0x7f02f013a730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c3c0 tx=0x7f02e000c880 comp rx=0 tx=0).stop 2023-10-25T16:13:09.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 shutdown_connections 2023-10-25T16:13:09.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02dc066470 0x7f02dc068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02f0140cf0 0x7f02f01560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02f006f570 0x7f02f01605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 --2- 172.21.15.177:0/1020957396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02f006c160 0x7f02f013a730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:09.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 >> 172.21.15.177:0/1020957396 conn(0x7f02f00b2450 msgr2=0x7f02f0070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:09.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 shutdown_connections 2023-10-25T16:13:09.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:09.971+0000 7f02f6225640 1 -- 172.21.15.177:0/1020957396 wait complete. 2023-10-25T16:13:09.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:10.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/1575702440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cce90 msgr2=0x7f84b40c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 --2- 172.21.15.177:0/1575702440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cce90 0x7f84b40c9b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009bc0 tx=0x7f84ac01cb10 comp rx=0 tx=0).stop 2023-10-25T16:13:10.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/1575702440 shutdown_connections 2023-10-25T16:13:10.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 --2- 172.21.15.177:0/1575702440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cce90 0x7f84b40c9b00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/1575702440 >> 172.21.15.177:0/1575702440 conn(0x7f84b40ce000 msgr2=0x7f84b40ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:10.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/1575702440 shutdown_connections 2023-10-25T16:13:10.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/1575702440 wait complete. 2023-10-25T16:13:10.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 Processor -- start 2023-10-25T16:13:10.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- start start 2023-10-25T16:13:10.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 0x7f84b41580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b40cce90 0x7f84b4145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4155db0 0x7f84b40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41538d0 con 0x7f84b40cca30 2023-10-25T16:13:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b3bd0 con 0x7f84b40cce90 2023-10-25T16:13:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40b3610 con 0x7f84b4155db0 2023-10-25T16:13:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 0x7f84b41580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 0x7f84b41580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47324/0 (socket says 172.21.15.177:47324) 2023-10-25T16:13:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 -- 172.21.15.177:0/3372543100 learned_addr learned my addr 172.21.15.177:0/3372543100 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b1d9b640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b40cce90 0x7f84b4145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 -- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4155db0 msgr2=0x7f84b40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4155db0 0x7f84b40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 -- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b40cce90 msgr2=0x7f84b4145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b40cce90 0x7f84b4145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 -- 172.21.15.177:0/3372543100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac009820 con 0x7f84b40cca30 2023-10-25T16:13:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b259c640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 0x7f84b41580e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c3d0 tx=0x7f84a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011790 con 0x7f84b40cca30 2023-10-25T16:13:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84a40119e0 con 0x7f84b40cca30 2023-10-25T16:13:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b40b38f0 con 0x7f84b40cca30 2023-10-25T16:13:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011e10 con 0x7f84b40cca30 2023-10-25T16:13:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.107+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b40b3290 con 0x7f84b40cca30 2023-10-25T16:13:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.111+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b406fe60 con 0x7f84b40cca30 2023-10-25T16:13:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.111+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f84a401c460 con 0x7f84b40cca30 2023-10-25T16:13:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.111+0000 7f84a2ffd640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84940664a0 0x7f8494068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.111+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84a4083f70 con 0x7f84b40cca30 2023-10-25T16:13:10.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.111+0000 7f84b1d9b640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84940664a0 0x7f8494068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.111+0000 7f84b1d9b640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84940664a0 0x7f8494068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007fd0 tx=0x7f84a8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:10.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.115+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84a40513e0 con 0x7f84b40cca30 2023-10-25T16:13:10.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.267+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84b4153a10 con 0x7f84b40cca30 2023-10-25T16:13:10.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.267+0000 7f84a2ffd640 1 -- 172.21.15.177:0/3372543100 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f84b4153a10 con 0x7f84b40cca30 2023-10-25T16:13:10.273 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:10.273 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:10.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84940664a0 msgr2=0x7f8494068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84940664a0 0x7f8494068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007fd0 tx=0x7f84a8009040 comp rx=0 tx=0).stop 2023-10-25T16:13:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 msgr2=0x7f84b41580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 0x7f84b41580e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c3d0 tx=0x7f84a400c890 comp rx=0 tx=0).stop 2023-10-25T16:13:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 shutdown_connections 2023-10-25T16:13:10.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84940664a0 0x7f8494068960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4155db0 0x7f84b40b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b40cce90 0x7f84b4145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 --2- 172.21.15.177:0/3372543100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84b40cca30 0x7f84b41580e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 >> 172.21.15.177:0/3372543100 conn(0x7f84b40ce000 msgr2=0x7f84b415aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 shutdown_connections 2023-10-25T16:13:10.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.271+0000 7f84b8836640 1 -- 172.21.15.177:0/3372543100 wait complete. 2023-10-25T16:13:10.290 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:13:10.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:10.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.395+0000 7fb752843640 1 -- 172.21.15.177:0/327171278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 msgr2=0x7fb74c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.395+0000 7fb752843640 1 --2- 172.21.15.177:0/327171278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0cdfc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb744009c80 tx=0x7fb74401ccf0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.395+0000 7fb752843640 1 -- 172.21.15.177:0/327171278 shutdown_connections 2023-10-25T16:13:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 --2- 172.21.15.177:0/327171278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0cdfc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 --2- 172.21.15.177:0/327171278 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb74c15eba0 0x7fb74c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- 172.21.15.177:0/327171278 >> 172.21.15.177:0/327171278 conn(0x7fb74c09a5c0 msgr2=0x7fb74c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- 172.21.15.177:0/327171278 shutdown_connections 2023-10-25T16:13:10.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- 172.21.15.177:0/327171278 wait complete. 2023-10-25T16:13:10.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 Processor -- start 2023-10-25T16:13:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- start start 2023-10-25T16:13:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb74c0b2120 0x7fb74c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb74c15eba0 0x7fb74c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c15a6c0 con 0x7fb74c0cdb10 2023-10-25T16:13:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0c4bc0 con 0x7fb74c0b2120 2023-10-25T16:13:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c0c4ea0 con 0x7fb74c15eba0 2023-10-25T16:13:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47346/0 (socket says 172.21.15.177:47346) 2023-10-25T16:13:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 -- 172.21.15.177:0/2038306138 learned_addr learned my addr 172.21.15.177:0/2038306138 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74bfff640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb74c0b2120 0x7fb74c1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb750de0640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb74c15eba0 0x7fb74c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 -- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb74c15eba0 msgr2=0x7fb74c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb74c15eba0 0x7fb74c0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 -- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb74c0b2120 msgr2=0x7fb74c1501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb74c0b2120 0x7fb74c1501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 -- 172.21.15.177:0/2038306138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440098e0 con 0x7fb74c0cdb10 2023-10-25T16:13:10.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74bfff640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb74c0b2120 0x7fb74c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:10.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb74b7fe640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0c6720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb74000c500 tx=0x7fb74000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:10.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740005220 con 0x7fb74c0cdb10 2023-10-25T16:13:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb740005470 con 0x7fb74c0cdb10 2023-10-25T16:13:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c15a960 con 0x7fb74c0cdb10 2023-10-25T16:13:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740007290 con 0x7fb74c0cdb10 2023-10-25T16:13:10.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c0b6ba0 con 0x7fb74c0cdb10 2023-10-25T16:13:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.399+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c04daf0 con 0x7fb74c0cdb10 2023-10-25T16:13:10.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.403+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7400073f0 con 0x7fb74c0cdb10 2023-10-25T16:13:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.403+0000 7fb748ff9640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb738066470 0x7fb738068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.403+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7400839f0 con 0x7fb74c0cdb10 2023-10-25T16:13:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.403+0000 7fb74bfff640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb738066470 0x7fb738068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.403+0000 7fb74bfff640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb738066470 0x7fb738068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0058d0 tx=0x7fb73c005ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:10.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.407+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb740050e80 con 0x7fb74c0cdb10 2023-10-25T16:13:10.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.543+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb74c0d1630 con 0x7fb738066470 2023-10-25T16:13:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.563+0000 7fb748ff9640 1 -- 172.21.15.177:0/2038306138 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249461 (secure 0 0 0) 0x7fb74c0d1630 con 0x7fb738066470 2023-10-25T16:13:10.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:10.572 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:10.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb738066470 msgr2=0x7fb738068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb738066470 0x7fb738068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0058d0 tx=0x7fb73c005ca0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 msgr2=0x7fb74c0c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0c6720 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb74000c500 tx=0x7fb74000c9c0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 shutdown_connections 2023-10-25T16:13:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb738066470 0x7fb738068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb74c15eba0 0x7fb74c0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb74c0cdb10 0x7fb74c0c6720 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 --2- 172.21.15.177:0/2038306138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb74c0b2120 0x7fb74c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 >> 172.21.15.177:0/2038306138 conn(0x7fb74c09a5c0 msgr2=0x7fb74c15d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 shutdown_connections 2023-10-25T16:13:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.567+0000 7fb752843640 1 -- 172.21.15.177:0/2038306138 wait complete. 2023-10-25T16:13:10.588 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-25T16:13:08.592143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":5,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1555,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560944,"statfs":{"total":1600000000,"available":1598407348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001418"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.568213+0000","last_change":"2023-10-25T16:13:06.568213+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.568213+0000","last_undegraded":"2023-10-25T16:13:06.568213+0000","last_fullsized":"2023-10-25T16:13:06.568213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.567411+0000","last_change":"2023-10-25T16:13:06.567411+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.567411+0000","last_undegraded":"2023-10-25T16:13:06.567411+0000","last_fullsized":"2023-10-25T16:13:06.567411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.587348+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:06.587348+0000","last_peered":"2023-10-25T16:13:06.587348+0000","last_clean":"2023-10-25T16:13:06.587348+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:06.587348+0000","last_undegraded":"2023-10-25T16:13:06.587348+0000","last_fullsized":"2023-10-25T16:13:06.587348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:14:25.507113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.574334+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:06.574334+0000","last_peered":"2023-10-25T16:13:06.574334+0000","last_clean":"2023-10-25T16:13:06.574334+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:06.574334+0000","last_undegraded":"2023-10-25T16:13:06.574334+0000","last_fullsized":"2023-10-25T16:13:06.574334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:15.085365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586210+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:06.586210+0000","last_peered":"2023-10-25T16:13:06.586210+0000","last_clean":"2023-10-25T16:13:06.586210+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:06.586210+0000","last_undegraded":"2023-10-25T16:13:06.586210+0000","last_fullsized":"2023-10-25T16:13:06.586210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:13.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-25T16:12:58.798085+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:12:58.798085+0000","last_peered":"2023-10-25T16:12:58.798085+0000","last_clean":"2023-10-25T16:12:58.798085+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:12:58.798085+0000","last_undegraded":"2023-10-25T16:12:58.798085+0000","last_fullsized":"2023-10-25T16:12:58.798085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586156+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:06.586156+0000","last_peered":"2023-10-25T16:13:06.586156+0000","last_clean":"2023-10-25T16:13:06.586156+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:06.586156+0000","last_undegraded":"2023-10-25T16:13:06.586156+0000","last_fullsized":"2023-10-25T16:13:06.586156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:06.555563+0000","last_change":"2023-10-25T16:13:06.555563+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.555563+0000","last_undegraded":"2023-10-25T16:13:06.555563+0000","last_fullsized":"2023-10-25T16:13:06.555563+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:13:05.545075+0000","last_change":"2023-10-25T16:13:05.545075+0000","last_active":"2023-10-25T16:13:05.545075+0000","last_peered":"2023-10-25T16:13:05.545075+0000","last_clean":"2023-10-25T16:13:05.545075+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:05.545075+0000","last_undegraded":"2023-10-25T16:13:05.545075+0000","last_fullsized":"2023-10-25T16:13:05.545075+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937930,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359654,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199950022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199950022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199950022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199950022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":48,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199950022,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194687,"statfs":{"total":200000000,"available":199359654,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:10.593 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:10.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 -- 172.21.15.177:0/3609047521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc38003f00 msgr2=0x7fcc380047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 --2- 172.21.15.177:0/3609047521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc38003f00 0x7fcc380047d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc5006f520 tx=0x7fcc4001ce00 comp rx=0 tx=0).stop 2023-10-25T16:13:10.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc4f7fe640 1 -- 172.21.15.177:0/3609047521 reap_dead start 2023-10-25T16:13:10.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 -- 172.21.15.177:0/3609047521 shutdown_connections 2023-10-25T16:13:10.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 -- 172.21.15.177:0/3609047521 >> 172.21.15.177:0/3609047521 conn(0x7fcc500b2450 msgr2=0x7fcc500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:10.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 -- 172.21.15.177:0/3609047521 shutdown_connections 2023-10-25T16:13:10.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 -- 172.21.15.177:0/3609047521 wait complete. 2023-10-25T16:13:10.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 Processor -- start 2023-10-25T16:13:10.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.751+0000 7fcc55802640 1 -- start start 2023-10-25T16:13:10.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc38003f00 0x7fcc50144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc501529d0 0x7fcc50152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 0x7fcc50150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc50153370 con 0x7fcc50150850 2023-10-25T16:13:10.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc50149490 con 0x7fcc38003f00 2023-10-25T16:13:10.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc501515d0 con 0x7fcc501529d0 2023-10-25T16:13:10.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 0x7fcc50150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 0x7fcc50150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43336/0 (socket says 172.21.15.177:43336) 2023-10-25T16:13:10.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 -- 172.21.15.177:0/1359687209 learned_addr learned my addr 172.21.15.177:0/1359687209 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:10.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4effd640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc38003f00 0x7fcc50144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4e7fc640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc501529d0 0x7fcc50152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 -- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc501529d0 msgr2=0x7fcc50152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc501529d0 0x7fcc50152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 -- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc38003f00 msgr2=0x7fcc50144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc38003f00 0x7fcc50144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 -- 172.21.15.177:0/1359687209 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc501518b0 con 0x7fcc50150850 2023-10-25T16:13:10.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4e7fc640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc501529d0 0x7fcc50152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:10.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4f7fe640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 0x7fcc50150cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc5015cd40 tx=0x7fcc48011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:10.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48013720 con 0x7fcc50150850 2023-10-25T16:13:10.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcc48013880 con 0x7fcc50150850 2023-10-25T16:13:10.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc50151b90 con 0x7fcc50150850 2023-10-25T16:13:10.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48013c70 con 0x7fcc50150850 2023-10-25T16:13:10.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc50151210 con 0x7fcc50150850 2023-10-25T16:13:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5004daf0 con 0x7fcc50150850 2023-10-25T16:13:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcc48020460 con 0x7fcc50150850 2023-10-25T16:13:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc37fff640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc3c066470 0x7fcc3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc480871a0 con 0x7fcc50150850 2023-10-25T16:13:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.755+0000 7fcc4effd640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc3c066470 0x7fcc3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.759+0000 7fcc4effd640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc3c066470 0x7fcc3c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009aa0 tx=0x7fcc44009540 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.759+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc48054640 con 0x7fcc50150850 2023-10-25T16:13:10.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.899+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc50071700 con 0x7fcc3c066470 2023-10-25T16:13:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.919+0000 7fcc37fff640 1 -- 172.21.15.177:0/1359687209 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259944 (secure 0 0 0) 0x7fcc44011b00 con 0x7fcc3c066470 2023-10-25T16:13:10.925 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:10.927 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:10.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc3c066470 msgr2=0x7fcc3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc3c066470 0x7fcc3c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009aa0 tx=0x7fcc44009540 comp rx=0 tx=0).stop 2023-10-25T16:13:10.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 msgr2=0x7fcc50150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:10.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 0x7fcc50150cd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc5015cd40 tx=0x7fcc48011970 comp rx=0 tx=0).stop 2023-10-25T16:13:10.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 shutdown_connections 2023-10-25T16:13:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc3c066470 0x7fcc3c068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc50150850 0x7fcc50150cd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc501529d0 0x7fcc50152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 --2- 172.21.15.177:0/1359687209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc38003f00 0x7fcc50144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 >> 172.21.15.177:0/1359687209 conn(0x7fcc500b2450 msgr2=0x7fcc5014f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 shutdown_connections 2023-10-25T16:13:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:10.923+0000 7fcc55802640 1 -- 172.21.15.177:0/1359687209 wait complete. 2023-10-25T16:13:10.942 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-25T16:13:10.592770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560798,"statfs":{"total":1600000000,"available":1598257859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.034701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541423+0000","last_change":"2023-10-25T16:13:07.579322+0000","last_active":"2023-10-25T16:13:08.541423+0000","last_peered":"2023-10-25T16:13:08.541423+0000","last_clean":"2023-10-25T16:13:08.541423+0000","last_became_active":"2023-10-25T16:13:07.566613+0000","last_became_peered":"2023-10-25T16:13:07.566613+0000","last_unstale":"2023-10-25T16:13:08.541423+0000","last_undegraded":"2023-10-25T16:13:08.541423+0000","last_fullsized":"2023-10-25T16:13:08.541423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477996+0000","last_change":"2023-10-25T16:13:07.553120+0000","last_active":"2023-10-25T16:13:09.477996+0000","last_peered":"2023-10-25T16:13:09.477996+0000","last_clean":"2023-10-25T16:13:09.477996+0000","last_became_active":"2023-10-25T16:13:07.551990+0000","last_became_peered":"2023-10-25T16:13:07.551990+0000","last_unstale":"2023-10-25T16:13:09.477996+0000","last_undegraded":"2023-10-25T16:13:09.477996+0000","last_fullsized":"2023-10-25T16:13:09.477996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478313+0000","last_change":"2023-10-25T16:13:07.563333+0000","last_active":"2023-10-25T16:13:09.478313+0000","last_peered":"2023-10-25T16:13:09.478313+0000","last_clean":"2023-10-25T16:13:09.478313+0000","last_became_active":"2023-10-25T16:13:07.560920+0000","last_became_peered":"2023-10-25T16:13:07.560920+0000","last_unstale":"2023-10-25T16:13:09.478313+0000","last_undegraded":"2023-10-25T16:13:09.478313+0000","last_fullsized":"2023-10-25T16:13:09.478313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544460+0000","last_change":"2023-10-25T16:13:07.567528+0000","last_active":"2023-10-25T16:13:08.544460+0000","last_peered":"2023-10-25T16:13:08.544460+0000","last_clean":"2023-10-25T16:13:08.544460+0000","last_became_active":"2023-10-25T16:13:07.566685+0000","last_became_peered":"2023-10-25T16:13:07.566685+0000","last_unstale":"2023-10-25T16:13:08.544460+0000","last_undegraded":"2023-10-25T16:13:08.544460+0000","last_fullsized":"2023-10-25T16:13:08.544460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541668+0000","last_change":"2023-10-25T16:13:07.579075+0000","last_active":"2023-10-25T16:13:08.541668+0000","last_peered":"2023-10-25T16:13:08.541668+0000","last_clean":"2023-10-25T16:13:08.541668+0000","last_became_active":"2023-10-25T16:13:07.567451+0000","last_became_peered":"2023-10-25T16:13:07.567451+0000","last_unstale":"2023-10-25T16:13:08.541668+0000","last_undegraded":"2023-10-25T16:13:08.541668+0000","last_fullsized":"2023-10-25T16:13:08.541668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545497+0000","last_change":"2023-10-25T16:13:07.585648+0000","last_active":"2023-10-25T16:13:08.545497+0000","last_peered":"2023-10-25T16:13:08.545497+0000","last_clean":"2023-10-25T16:13:08.545497+0000","last_became_active":"2023-10-25T16:13:07.583670+0000","last_became_peered":"2023-10-25T16:13:07.583670+0000","last_unstale":"2023-10-25T16:13:08.545497+0000","last_undegraded":"2023-10-25T16:13:08.545497+0000","last_fullsized":"2023-10-25T16:13:08.545497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541701+0000","last_change":"2023-10-25T16:13:07.581287+0000","last_active":"2023-10-25T16:13:08.541701+0000","last_peered":"2023-10-25T16:13:08.541701+0000","last_clean":"2023-10-25T16:13:08.541701+0000","last_became_active":"2023-10-25T16:13:07.577390+0000","last_became_peered":"2023-10-25T16:13:07.577390+0000","last_unstale":"2023-10-25T16:13:08.541701+0000","last_undegraded":"2023-10-25T16:13:08.541701+0000","last_fullsized":"2023-10-25T16:13:08.541701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477246+0000","last_change":"2023-10-25T16:13:07.569496+0000","last_active":"2023-10-25T16:13:09.477246+0000","last_peered":"2023-10-25T16:13:09.477246+0000","last_clean":"2023-10-25T16:13:09.477246+0000","last_became_active":"2023-10-25T16:13:07.563950+0000","last_became_peered":"2023-10-25T16:13:07.563950+0000","last_unstale":"2023-10-25T16:13:09.477246+0000","last_undegraded":"2023-10-25T16:13:09.477246+0000","last_fullsized":"2023-10-25T16:13:09.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541010+0000","last_change":"2023-10-25T16:13:07.577965+0000","last_active":"2023-10-25T16:13:08.541010+0000","last_peered":"2023-10-25T16:13:08.541010+0000","last_clean":"2023-10-25T16:13:08.541010+0000","last_became_active":"2023-10-25T16:13:07.576892+0000","last_became_peered":"2023-10-25T16:13:07.576892+0000","last_unstale":"2023-10-25T16:13:08.541010+0000","last_undegraded":"2023-10-25T16:13:08.541010+0000","last_fullsized":"2023-10-25T16:13:08.541010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464171+0000","last_change":"2023-10-25T16:13:07.561076+0000","last_active":"2023-10-25T16:13:09.464171+0000","last_peered":"2023-10-25T16:13:09.464171+0000","last_clean":"2023-10-25T16:13:09.464171+0000","last_became_active":"2023-10-25T16:13:07.560340+0000","last_became_peered":"2023-10-25T16:13:07.560340+0000","last_unstale":"2023-10-25T16:13:09.464171+0000","last_undegraded":"2023-10-25T16:13:09.464171+0000","last_fullsized":"2023-10-25T16:13:09.464171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.463985+0000","last_change":"2023-10-25T16:13:07.585838+0000","last_active":"2023-10-25T16:13:09.463985+0000","last_peered":"2023-10-25T16:13:09.463985+0000","last_clean":"2023-10-25T16:13:09.463985+0000","last_became_active":"2023-10-25T16:13:07.585351+0000","last_became_peered":"2023-10-25T16:13:07.585351+0000","last_unstale":"2023-10-25T16:13:09.463985+0000","last_undegraded":"2023-10-25T16:13:09.463985+0000","last_fullsized":"2023-10-25T16:13:09.463985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186012+0000","last_change":"2023-10-25T16:13:07.572936+0000","last_active":"2023-10-25T16:13:09.186012+0000","last_peered":"2023-10-25T16:13:09.186012+0000","last_clean":"2023-10-25T16:13:09.186012+0000","last_became_active":"2023-10-25T16:13:07.572216+0000","last_became_peered":"2023-10-25T16:13:07.572216+0000","last_unstale":"2023-10-25T16:13:09.186012+0000","last_undegraded":"2023-10-25T16:13:09.186012+0000","last_fullsized":"2023-10-25T16:13:09.186012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:56.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480366+0000","last_change":"2023-10-25T16:13:07.567194+0000","last_active":"2023-10-25T16:13:09.480366+0000","last_peered":"2023-10-25T16:13:09.480366+0000","last_clean":"2023-10-25T16:13:09.480366+0000","last_became_active":"2023-10-25T16:13:07.561537+0000","last_became_peered":"2023-10-25T16:13:07.561537+0000","last_unstale":"2023-10-25T16:13:09.480366+0000","last_undegraded":"2023-10-25T16:13:09.480366+0000","last_fullsized":"2023-10-25T16:13:09.480366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477496+0000","last_change":"2023-10-25T16:13:07.567614+0000","last_active":"2023-10-25T16:13:09.477496+0000","last_peered":"2023-10-25T16:13:09.477496+0000","last_clean":"2023-10-25T16:13:09.477496+0000","last_became_active":"2023-10-25T16:13:07.564979+0000","last_became_peered":"2023-10-25T16:13:07.564979+0000","last_unstale":"2023-10-25T16:13:09.477496+0000","last_undegraded":"2023-10-25T16:13:09.477496+0000","last_fullsized":"2023-10-25T16:13:09.477496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:05.007750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478079+0000","last_change":"2023-10-25T16:13:07.562980+0000","last_active":"2023-10-25T16:13:09.478079+0000","last_peered":"2023-10-25T16:13:09.478079+0000","last_clean":"2023-10-25T16:13:09.478079+0000","last_became_active":"2023-10-25T16:13:07.562370+0000","last_became_peered":"2023-10-25T16:13:07.562370+0000","last_unstale":"2023-10-25T16:13:09.478079+0000","last_undegraded":"2023-10-25T16:13:09.478079+0000","last_fullsized":"2023-10-25T16:13:09.478079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545182+0000","last_change":"2023-10-25T16:13:07.587718+0000","last_active":"2023-10-25T16:13:08.545182+0000","last_peered":"2023-10-25T16:13:08.545182+0000","last_clean":"2023-10-25T16:13:08.545182+0000","last_became_active":"2023-10-25T16:13:07.584346+0000","last_became_peered":"2023-10-25T16:13:07.584346+0000","last_unstale":"2023-10-25T16:13:08.545182+0000","last_undegraded":"2023-10-25T16:13:08.545182+0000","last_fullsized":"2023-10-25T16:13:08.545182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544311+0000","last_change":"2023-10-25T16:13:07.590347+0000","last_active":"2023-10-25T16:13:08.544311+0000","last_peered":"2023-10-25T16:13:08.544311+0000","last_clean":"2023-10-25T16:13:08.544311+0000","last_became_active":"2023-10-25T16:13:07.589306+0000","last_became_peered":"2023-10-25T16:13:07.589306+0000","last_unstale":"2023-10-25T16:13:08.544311+0000","last_undegraded":"2023-10-25T16:13:08.544311+0000","last_fullsized":"2023-10-25T16:13:08.544311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.568213+0000","last_change":"2023-10-25T16:13:06.568213+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.568213+0000","last_undegraded":"2023-10-25T16:13:06.568213+0000","last_fullsized":"2023-10-25T16:13:06.568213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541426+0000","last_change":"2023-10-25T16:13:07.565774+0000","last_active":"2023-10-25T16:13:08.541426+0000","last_peered":"2023-10-25T16:13:08.541426+0000","last_clean":"2023-10-25T16:13:08.541426+0000","last_became_active":"2023-10-25T16:13:07.564671+0000","last_became_peered":"2023-10-25T16:13:07.564671+0000","last_unstale":"2023-10-25T16:13:08.541426+0000","last_undegraded":"2023-10-25T16:13:08.541426+0000","last_fullsized":"2023-10-25T16:13:08.541426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464359+0000","last_change":"2023-10-25T16:13:07.569779+0000","last_active":"2023-10-25T16:13:09.464359+0000","last_peered":"2023-10-25T16:13:09.464359+0000","last_clean":"2023-10-25T16:13:09.464359+0000","last_became_active":"2023-10-25T16:13:07.568943+0000","last_became_peered":"2023-10-25T16:13:07.568943+0000","last_unstale":"2023-10-25T16:13:09.464359+0000","last_undegraded":"2023-10-25T16:13:09.464359+0000","last_fullsized":"2023-10-25T16:13:09.464359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478818+0000","last_change":"2023-10-25T16:13:07.588566+0000","last_active":"2023-10-25T16:13:09.478818+0000","last_peered":"2023-10-25T16:13:09.478818+0000","last_clean":"2023-10-25T16:13:09.478818+0000","last_became_active":"2023-10-25T16:13:07.586975+0000","last_became_peered":"2023-10-25T16:13:07.586975+0000","last_unstale":"2023-10-25T16:13:09.478818+0000","last_undegraded":"2023-10-25T16:13:09.478818+0000","last_fullsized":"2023-10-25T16:13:09.478818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544961+0000","last_change":"2023-10-25T16:13:07.589720+0000","last_active":"2023-10-25T16:13:08.544961+0000","last_peered":"2023-10-25T16:13:08.544961+0000","last_clean":"2023-10-25T16:13:08.544961+0000","last_became_active":"2023-10-25T16:13:07.587901+0000","last_became_peered":"2023-10-25T16:13:07.587901+0000","last_unstale":"2023-10-25T16:13:08.544961+0000","last_undegraded":"2023-10-25T16:13:08.544961+0000","last_fullsized":"2023-10-25T16:13:08.544961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481296+0000","last_change":"2023-10-25T16:13:07.564523+0000","last_active":"2023-10-25T16:13:09.481296+0000","last_peered":"2023-10-25T16:13:09.481296+0000","last_clean":"2023-10-25T16:13:09.481296+0000","last_became_active":"2023-10-25T16:13:07.558883+0000","last_became_peered":"2023-10-25T16:13:07.558883+0000","last_unstale":"2023-10-25T16:13:09.481296+0000","last_undegraded":"2023-10-25T16:13:09.481296+0000","last_fullsized":"2023-10-25T16:13:09.481296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544854+0000","last_change":"2023-10-25T16:13:07.565692+0000","last_active":"2023-10-25T16:13:08.544854+0000","last_peered":"2023-10-25T16:13:08.544854+0000","last_clean":"2023-10-25T16:13:08.544854+0000","last_became_active":"2023-10-25T16:13:07.565063+0000","last_became_peered":"2023-10-25T16:13:07.565063+0000","last_unstale":"2023-10-25T16:13:08.544854+0000","last_undegraded":"2023-10-25T16:13:08.544854+0000","last_fullsized":"2023-10-25T16:13:08.544854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478118+0000","last_change":"2023-10-25T16:13:07.567029+0000","last_active":"2023-10-25T16:13:09.478118+0000","last_peered":"2023-10-25T16:13:09.478118+0000","last_clean":"2023-10-25T16:13:09.478118+0000","last_became_active":"2023-10-25T16:13:07.563753+0000","last_became_peered":"2023-10-25T16:13:07.563753+0000","last_unstale":"2023-10-25T16:13:09.478118+0000","last_undegraded":"2023-10-25T16:13:09.478118+0000","last_fullsized":"2023-10-25T16:13:09.478118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464243+0000","last_change":"2023-10-25T16:13:07.571465+0000","last_active":"2023-10-25T16:13:09.464243+0000","last_peered":"2023-10-25T16:13:09.464243+0000","last_clean":"2023-10-25T16:13:09.464243+0000","last_became_active":"2023-10-25T16:13:07.570569+0000","last_became_peered":"2023-10-25T16:13:07.570569+0000","last_unstale":"2023-10-25T16:13:09.464243+0000","last_undegraded":"2023-10-25T16:13:09.464243+0000","last_fullsized":"2023-10-25T16:13:09.464243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478333+0000","last_change":"2023-10-25T16:13:07.552675+0000","last_active":"2023-10-25T16:13:09.478333+0000","last_peered":"2023-10-25T16:13:09.478333+0000","last_clean":"2023-10-25T16:13:09.478333+0000","last_became_active":"2023-10-25T16:13:07.551113+0000","last_became_peered":"2023-10-25T16:13:07.551113+0000","last_unstale":"2023-10-25T16:13:09.478333+0000","last_undegraded":"2023-10-25T16:13:09.478333+0000","last_fullsized":"2023-10-25T16:13:09.478333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480684+0000","last_change":"2023-10-25T16:13:07.563309+0000","last_active":"2023-10-25T16:13:09.480684+0000","last_peered":"2023-10-25T16:13:09.480684+0000","last_clean":"2023-10-25T16:13:09.480684+0000","last_became_active":"2023-10-25T16:13:07.556854+0000","last_became_peered":"2023-10-25T16:13:07.556854+0000","last_unstale":"2023-10-25T16:13:09.480684+0000","last_undegraded":"2023-10-25T16:13:09.480684+0000","last_fullsized":"2023-10-25T16:13:09.480684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481261+0000","last_change":"2023-10-25T16:13:07.563614+0000","last_active":"2023-10-25T16:13:09.481261+0000","last_peered":"2023-10-25T16:13:09.481261+0000","last_clean":"2023-10-25T16:13:09.481261+0000","last_became_active":"2023-10-25T16:13:07.562379+0000","last_became_peered":"2023-10-25T16:13:07.562379+0000","last_unstale":"2023-10-25T16:13:09.481261+0000","last_undegraded":"2023-10-25T16:13:09.481261+0000","last_fullsized":"2023-10-25T16:13:09.481261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544963+0000","last_change":"2023-10-25T16:13:07.575589+0000","last_active":"2023-10-25T16:13:08.544963+0000","last_peered":"2023-10-25T16:13:08.544963+0000","last_clean":"2023-10-25T16:13:08.544963+0000","last_became_active":"2023-10-25T16:13:07.569050+0000","last_became_peered":"2023-10-25T16:13:07.569050+0000","last_unstale":"2023-10-25T16:13:08.544963+0000","last_undegraded":"2023-10-25T16:13:08.544963+0000","last_fullsized":"2023-10-25T16:13:08.544963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.567411+0000","last_change":"2023-10-25T16:13:06.567411+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.567411+0000","last_undegraded":"2023-10-25T16:13:06.567411+0000","last_fullsized":"2023-10-25T16:13:06.567411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464294+0000","last_change":"2023-10-25T16:13:07.571634+0000","last_active":"2023-10-25T16:13:09.464294+0000","last_peered":"2023-10-25T16:13:09.464294+0000","last_clean":"2023-10-25T16:13:09.464294+0000","last_became_active":"2023-10-25T16:13:07.570373+0000","last_became_peered":"2023-10-25T16:13:07.570373+0000","last_unstale":"2023-10-25T16:13:09.464294+0000","last_undegraded":"2023-10-25T16:13:09.464294+0000","last_fullsized":"2023-10-25T16:13:09.464294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185835+0000","last_change":"2023-10-25T16:13:07.554976+0000","last_active":"2023-10-25T16:13:09.185835+0000","last_peered":"2023-10-25T16:13:09.185835+0000","last_clean":"2023-10-25T16:13:09.185835+0000","last_became_active":"2023-10-25T16:13:07.554311+0000","last_became_peered":"2023-10-25T16:13:07.554311+0000","last_unstale":"2023-10-25T16:13:09.185835+0000","last_undegraded":"2023-10-25T16:13:09.185835+0000","last_fullsized":"2023-10-25T16:13:09.185835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479939+0000","last_change":"2023-10-25T16:13:06.604007+0000","last_active":"2023-10-25T16:13:09.479939+0000","last_peered":"2023-10-25T16:13:09.479939+0000","last_clean":"2023-10-25T16:13:09.479939+0000","last_became_active":"2023-10-25T16:13:06.603266+0000","last_became_peered":"2023-10-25T16:13:06.603266+0000","last_unstale":"2023-10-25T16:13:09.479939+0000","last_undegraded":"2023-10-25T16:13:09.479939+0000","last_fullsized":"2023-10-25T16:13:09.479939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478778+0000","last_change":"2023-10-25T16:13:07.559020+0000","last_active":"2023-10-25T16:13:09.478778+0000","last_peered":"2023-10-25T16:13:09.478778+0000","last_clean":"2023-10-25T16:13:09.478778+0000","last_became_active":"2023-10-25T16:13:07.558319+0000","last_became_peered":"2023-10-25T16:13:07.558319+0000","last_unstale":"2023-10-25T16:13:09.478778+0000","last_undegraded":"2023-10-25T16:13:09.478778+0000","last_fullsized":"2023-10-25T16:13:09.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464815+0000","last_change":"2023-10-25T16:13:06.598258+0000","last_active":"2023-10-25T16:13:09.464815+0000","last_peered":"2023-10-25T16:13:09.464815+0000","last_clean":"2023-10-25T16:13:09.464815+0000","last_became_active":"2023-10-25T16:13:06.597739+0000","last_became_peered":"2023-10-25T16:13:06.597739+0000","last_unstale":"2023-10-25T16:13:09.464815+0000","last_undegraded":"2023-10-25T16:13:09.464815+0000","last_fullsized":"2023-10-25T16:13:09.464815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480678+0000","last_change":"2023-10-25T16:13:06.593802+0000","last_active":"2023-10-25T16:13:09.480678+0000","last_peered":"2023-10-25T16:13:09.480678+0000","last_clean":"2023-10-25T16:13:09.480678+0000","last_became_active":"2023-10-25T16:13:06.591848+0000","last_became_peered":"2023-10-25T16:13:06.591848+0000","last_unstale":"2023-10-25T16:13:09.480678+0000","last_undegraded":"2023-10-25T16:13:09.480678+0000","last_fullsized":"2023-10-25T16:13:09.480678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478429+0000","last_change":"2023-10-25T16:13:07.564400+0000","last_active":"2023-10-25T16:13:09.478429+0000","last_peered":"2023-10-25T16:13:09.478429+0000","last_clean":"2023-10-25T16:13:09.478429+0000","last_became_active":"2023-10-25T16:13:07.560990+0000","last_became_peered":"2023-10-25T16:13:07.560990+0000","last_unstale":"2023-10-25T16:13:09.478429+0000","last_undegraded":"2023-10-25T16:13:09.478429+0000","last_fullsized":"2023-10-25T16:13:09.478429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545533+0000","last_change":"2023-10-25T16:13:06.585016+0000","last_active":"2023-10-25T16:13:08.545533+0000","last_peered":"2023-10-25T16:13:08.545533+0000","last_clean":"2023-10-25T16:13:08.545533+0000","last_became_active":"2023-10-25T16:13:06.584376+0000","last_became_peered":"2023-10-25T16:13:06.584376+0000","last_unstale":"2023-10-25T16:13:08.545533+0000","last_undegraded":"2023-10-25T16:13:08.545533+0000","last_fullsized":"2023-10-25T16:13:08.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479516+0000","last_change":"2023-10-25T16:13:07.559199+0000","last_active":"2023-10-25T16:13:09.479516+0000","last_peered":"2023-10-25T16:13:09.479516+0000","last_clean":"2023-10-25T16:13:09.479516+0000","last_became_active":"2023-10-25T16:13:07.556631+0000","last_became_peered":"2023-10-25T16:13:07.556631+0000","last_unstale":"2023-10-25T16:13:09.479516+0000","last_undegraded":"2023-10-25T16:13:09.479516+0000","last_fullsized":"2023-10-25T16:13:09.479516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464487+0000","last_change":"2023-10-25T16:13:06.584038+0000","last_active":"2023-10-25T16:13:09.464487+0000","last_peered":"2023-10-25T16:13:09.464487+0000","last_clean":"2023-10-25T16:13:09.464487+0000","last_became_active":"2023-10-25T16:13:06.583589+0000","last_became_peered":"2023-10-25T16:13:06.583589+0000","last_unstale":"2023-10-25T16:13:09.464487+0000","last_undegraded":"2023-10-25T16:13:09.464487+0000","last_fullsized":"2023-10-25T16:13:09.464487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544608+0000","last_change":"2023-10-25T16:13:07.590063+0000","last_active":"2023-10-25T16:13:08.544608+0000","last_peered":"2023-10-25T16:13:08.544608+0000","last_clean":"2023-10-25T16:13:08.544608+0000","last_became_active":"2023-10-25T16:13:07.588495+0000","last_became_peered":"2023-10-25T16:13:07.588495+0000","last_unstale":"2023-10-25T16:13:08.544608+0000","last_undegraded":"2023-10-25T16:13:08.544608+0000","last_fullsized":"2023-10-25T16:13:08.544608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546034+0000","last_change":"2023-10-25T16:13:06.590184+0000","last_active":"2023-10-25T16:13:08.546034+0000","last_peered":"2023-10-25T16:13:08.546034+0000","last_clean":"2023-10-25T16:13:08.546034+0000","last_became_active":"2023-10-25T16:13:06.588948+0000","last_became_peered":"2023-10-25T16:13:06.588948+0000","last_unstale":"2023-10-25T16:13:08.546034+0000","last_undegraded":"2023-10-25T16:13:08.546034+0000","last_fullsized":"2023-10-25T16:13:08.546034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479144+0000","last_change":"2023-10-25T16:13:07.586291+0000","last_active":"2023-10-25T16:13:09.479144+0000","last_peered":"2023-10-25T16:13:09.479144+0000","last_clean":"2023-10-25T16:13:09.479144+0000","last_became_active":"2023-10-25T16:13:07.585591+0000","last_became_peered":"2023-10-25T16:13:07.585591+0000","last_unstale":"2023-10-25T16:13:09.479144+0000","last_undegraded":"2023-10-25T16:13:09.479144+0000","last_fullsized":"2023-10-25T16:13:09.479144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480345+0000","last_change":"2023-10-25T16:13:06.583823+0000","last_active":"2023-10-25T16:13:09.480345+0000","last_peered":"2023-10-25T16:13:09.480345+0000","last_clean":"2023-10-25T16:13:09.480345+0000","last_became_active":"2023-10-25T16:13:06.583486+0000","last_became_peered":"2023-10-25T16:13:06.583486+0000","last_unstale":"2023-10-25T16:13:09.480345+0000","last_undegraded":"2023-10-25T16:13:09.480345+0000","last_fullsized":"2023-10-25T16:13:09.480345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:19.848515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185623+0000","last_change":"2023-10-25T16:13:07.568365+0000","last_active":"2023-10-25T16:13:09.185623+0000","last_peered":"2023-10-25T16:13:09.185623+0000","last_clean":"2023-10-25T16:13:09.185623+0000","last_became_active":"2023-10-25T16:13:07.567142+0000","last_became_peered":"2023-10-25T16:13:07.567142+0000","last_unstale":"2023-10-25T16:13:09.185623+0000","last_undegraded":"2023-10-25T16:13:09.185623+0000","last_fullsized":"2023-10-25T16:13:09.185623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464438+0000","last_change":"2023-10-25T16:13:06.595459+0000","last_active":"2023-10-25T16:13:09.464438+0000","last_peered":"2023-10-25T16:13:09.464438+0000","last_clean":"2023-10-25T16:13:09.464438+0000","last_became_active":"2023-10-25T16:13:06.594824+0000","last_became_peered":"2023-10-25T16:13:06.594824+0000","last_unstale":"2023-10-25T16:13:09.464438+0000","last_undegraded":"2023-10-25T16:13:09.464438+0000","last_fullsized":"2023-10-25T16:13:09.464438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541328+0000","last_change":"2023-10-25T16:13:07.577436+0000","last_active":"2023-10-25T16:13:08.541328+0000","last_peered":"2023-10-25T16:13:08.541328+0000","last_clean":"2023-10-25T16:13:08.541328+0000","last_became_active":"2023-10-25T16:13:07.567759+0000","last_became_peered":"2023-10-25T16:13:07.567759+0000","last_unstale":"2023-10-25T16:13:08.541328+0000","last_undegraded":"2023-10-25T16:13:08.541328+0000","last_fullsized":"2023-10-25T16:13:08.541328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480167+0000","last_change":"2023-10-25T16:13:06.591408+0000","last_active":"2023-10-25T16:13:09.480167+0000","last_peered":"2023-10-25T16:13:09.480167+0000","last_clean":"2023-10-25T16:13:09.480167+0000","last_became_active":"2023-10-25T16:13:06.591012+0000","last_became_peered":"2023-10-25T16:13:06.591012+0000","last_unstale":"2023-10-25T16:13:09.480167+0000","last_undegraded":"2023-10-25T16:13:09.480167+0000","last_fullsized":"2023-10-25T16:13:09.480167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479460+0000","last_change":"2023-10-25T16:13:07.589102+0000","last_active":"2023-10-25T16:13:09.479460+0000","last_peered":"2023-10-25T16:13:09.479460+0000","last_clean":"2023-10-25T16:13:09.479460+0000","last_became_active":"2023-10-25T16:13:07.587838+0000","last_became_peered":"2023-10-25T16:13:07.587838+0000","last_unstale":"2023-10-25T16:13:09.479460+0000","last_undegraded":"2023-10-25T16:13:09.479460+0000","last_fullsized":"2023-10-25T16:13:09.479460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546334+0000","last_change":"2023-10-25T16:13:06.589759+0000","last_active":"2023-10-25T16:13:08.546334+0000","last_peered":"2023-10-25T16:13:08.546334+0000","last_clean":"2023-10-25T16:13:08.546334+0000","last_became_active":"2023-10-25T16:13:06.589100+0000","last_became_peered":"2023-10-25T16:13:06.589100+0000","last_unstale":"2023-10-25T16:13:08.546334+0000","last_undegraded":"2023-10-25T16:13:08.546334+0000","last_fullsized":"2023-10-25T16:13:08.546334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542048+0000","last_change":"2023-10-25T16:13:07.577105+0000","last_active":"2023-10-25T16:13:08.542048+0000","last_peered":"2023-10-25T16:13:08.542048+0000","last_clean":"2023-10-25T16:13:08.542048+0000","last_became_active":"2023-10-25T16:13:07.565017+0000","last_became_peered":"2023-10-25T16:13:07.565017+0000","last_unstale":"2023-10-25T16:13:08.542048+0000","last_undegraded":"2023-10-25T16:13:08.542048+0000","last_fullsized":"2023-10-25T16:13:08.542048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464495+0000","last_change":"2023-10-25T16:13:06.598452+0000","last_active":"2023-10-25T16:13:09.464495+0000","last_peered":"2023-10-25T16:13:09.464495+0000","last_clean":"2023-10-25T16:13:09.464495+0000","last_became_active":"2023-10-25T16:13:06.597797+0000","last_became_peered":"2023-10-25T16:13:06.597797+0000","last_unstale":"2023-10-25T16:13:09.464495+0000","last_undegraded":"2023-10-25T16:13:09.464495+0000","last_fullsized":"2023-10-25T16:13:09.464495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464575+0000","last_change":"2023-10-25T16:13:07.569409+0000","last_active":"2023-10-25T16:13:09.464575+0000","last_peered":"2023-10-25T16:13:09.464575+0000","last_clean":"2023-10-25T16:13:09.464575+0000","last_became_active":"2023-10-25T16:13:07.561141+0000","last_became_peered":"2023-10-25T16:13:07.561141+0000","last_unstale":"2023-10-25T16:13:09.464575+0000","last_undegraded":"2023-10-25T16:13:09.464575+0000","last_fullsized":"2023-10-25T16:13:09.464575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.587348+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:06.587348+0000","last_peered":"2023-10-25T16:13:06.587348+0000","last_clean":"2023-10-25T16:13:06.587348+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:06.587348+0000","last_undegraded":"2023-10-25T16:13:06.587348+0000","last_fullsized":"2023-10-25T16:13:06.587348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:14:25.507113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542401+0000","last_change":"2023-10-25T16:13:07.586802+0000","last_active":"2023-10-25T16:13:08.542401+0000","last_peered":"2023-10-25T16:13:08.542401+0000","last_clean":"2023-10-25T16:13:08.542401+0000","last_became_active":"2023-10-25T16:13:07.586067+0000","last_became_peered":"2023-10-25T16:13:07.586067+0000","last_unstale":"2023-10-25T16:13:08.542401+0000","last_undegraded":"2023-10-25T16:13:08.542401+0000","last_fullsized":"2023-10-25T16:13:08.542401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185909+0000","last_change":"2023-10-25T16:13:06.576987+0000","last_active":"2023-10-25T16:13:09.185909+0000","last_peered":"2023-10-25T16:13:09.185909+0000","last_clean":"2023-10-25T16:13:09.185909+0000","last_became_active":"2023-10-25T16:13:06.576204+0000","last_became_peered":"2023-10-25T16:13:06.576204+0000","last_unstale":"2023-10-25T16:13:09.185909+0000","last_undegraded":"2023-10-25T16:13:09.185909+0000","last_fullsized":"2023-10-25T16:13:09.185909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:27.980983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542364+0000","last_change":"2023-10-25T16:13:07.577484+0000","last_active":"2023-10-25T16:13:08.542364+0000","last_peered":"2023-10-25T16:13:08.542364+0000","last_clean":"2023-10-25T16:13:08.542364+0000","last_became_active":"2023-10-25T16:13:07.566477+0000","last_became_peered":"2023-10-25T16:13:07.566477+0000","last_unstale":"2023-10-25T16:13:08.542364+0000","last_undegraded":"2023-10-25T16:13:08.542364+0000","last_fullsized":"2023-10-25T16:13:08.542364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.574334+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:06.574334+0000","last_peered":"2023-10-25T16:13:06.574334+0000","last_clean":"2023-10-25T16:13:06.574334+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:06.574334+0000","last_undegraded":"2023-10-25T16:13:06.574334+0000","last_fullsized":"2023-10-25T16:13:06.574334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:15.085365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541203+0000","last_change":"2023-10-25T16:13:07.565301+0000","last_active":"2023-10-25T16:13:08.541203+0000","last_peered":"2023-10-25T16:13:08.541203+0000","last_clean":"2023-10-25T16:13:08.541203+0000","last_became_active":"2023-10-25T16:13:07.563812+0000","last_became_peered":"2023-10-25T16:13:07.563812+0000","last_unstale":"2023-10-25T16:13:08.541203+0000","last_undegraded":"2023-10-25T16:13:08.541203+0000","last_fullsized":"2023-10-25T16:13:08.541203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478001+0000","last_change":"2023-10-25T16:13:06.583997+0000","last_active":"2023-10-25T16:13:09.478001+0000","last_peered":"2023-10-25T16:13:09.478001+0000","last_clean":"2023-10-25T16:13:09.478001+0000","last_became_active":"2023-10-25T16:13:06.583355+0000","last_became_peered":"2023-10-25T16:13:06.583355+0000","last_unstale":"2023-10-25T16:13:09.478001+0000","last_undegraded":"2023-10-25T16:13:09.478001+0000","last_fullsized":"2023-10-25T16:13:09.478001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545728+0000","last_change":"2023-10-25T16:13:07.576400+0000","last_active":"2023-10-25T16:13:08.545728+0000","last_peered":"2023-10-25T16:13:08.545728+0000","last_clean":"2023-10-25T16:13:08.545728+0000","last_became_active":"2023-10-25T16:13:07.575767+0000","last_became_peered":"2023-10-25T16:13:07.575767+0000","last_unstale":"2023-10-25T16:13:08.545728+0000","last_undegraded":"2023-10-25T16:13:08.545728+0000","last_fullsized":"2023-10-25T16:13:08.545728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586210+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:06.586210+0000","last_peered":"2023-10-25T16:13:06.586210+0000","last_clean":"2023-10-25T16:13:06.586210+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:06.586210+0000","last_undegraded":"2023-10-25T16:13:06.586210+0000","last_fullsized":"2023-10-25T16:13:06.586210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:13.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541794+0000","last_change":"2023-10-25T16:13:07.587447+0000","last_active":"2023-10-25T16:13:08.541794+0000","last_peered":"2023-10-25T16:13:08.541794+0000","last_clean":"2023-10-25T16:13:08.541794+0000","last_became_active":"2023-10-25T16:13:07.586850+0000","last_became_peered":"2023-10-25T16:13:07.586850+0000","last_unstale":"2023-10-25T16:13:08.541794+0000","last_undegraded":"2023-10-25T16:13:08.541794+0000","last_fullsized":"2023-10-25T16:13:08.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.549368+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:13:07.549368+0000","last_peered":"2023-10-25T16:13:07.549368+0000","last_clean":"2023-10-25T16:13:07.549368+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:13:07.549368+0000","last_undegraded":"2023-10-25T16:13:07.549368+0000","last_fullsized":"2023-10-25T16:13:07.549368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546669+0000","last_change":"2023-10-25T16:13:06.587408+0000","last_active":"2023-10-25T16:13:08.546669+0000","last_peered":"2023-10-25T16:13:08.546669+0000","last_clean":"2023-10-25T16:13:08.546669+0000","last_became_active":"2023-10-25T16:13:06.586522+0000","last_became_peered":"2023-10-25T16:13:06.586522+0000","last_unstale":"2023-10-25T16:13:08.546669+0000","last_undegraded":"2023-10-25T16:13:08.546669+0000","last_fullsized":"2023-10-25T16:13:08.546669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:38.279671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479511+0000","last_change":"2023-10-25T16:13:07.576734+0000","last_active":"2023-10-25T16:13:09.479511+0000","last_peered":"2023-10-25T16:13:09.479511+0000","last_clean":"2023-10-25T16:13:09.479511+0000","last_became_active":"2023-10-25T16:13:07.575887+0000","last_became_peered":"2023-10-25T16:13:07.575887+0000","last_unstale":"2023-10-25T16:13:09.479511+0000","last_undegraded":"2023-10-25T16:13:09.479511+0000","last_fullsized":"2023-10-25T16:13:09.479511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541705+0000","last_change":"2023-10-25T16:13:06.603271+0000","last_active":"2023-10-25T16:13:08.541705+0000","last_peered":"2023-10-25T16:13:08.541705+0000","last_clean":"2023-10-25T16:13:08.541705+0000","last_became_active":"2023-10-25T16:13:06.602179+0000","last_became_peered":"2023-10-25T16:13:06.602179+0000","last_unstale":"2023-10-25T16:13:08.541705+0000","last_undegraded":"2023-10-25T16:13:08.541705+0000","last_fullsized":"2023-10-25T16:13:08.541705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479260+0000","last_change":"2023-10-25T16:13:07.563801+0000","last_active":"2023-10-25T16:13:09.479260+0000","last_peered":"2023-10-25T16:13:09.479260+0000","last_clean":"2023-10-25T16:13:09.479260+0000","last_became_active":"2023-10-25T16:13:07.561818+0000","last_became_peered":"2023-10-25T16:13:07.561818+0000","last_unstale":"2023-10-25T16:13:09.479260+0000","last_undegraded":"2023-10-25T16:13:09.479260+0000","last_fullsized":"2023-10-25T16:13:09.479260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586156+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:06.586156+0000","last_peered":"2023-10-25T16:13:06.586156+0000","last_clean":"2023-10-25T16:13:06.586156+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:06.586156+0000","last_undegraded":"2023-10-25T16:13:06.586156+0000","last_fullsized":"2023-10-25T16:13:06.586156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479843+0000","last_change":"2023-10-25T16:13:07.559564+0000","last_active":"2023-10-25T16:13:09.479843+0000","last_peered":"2023-10-25T16:13:09.479843+0000","last_clean":"2023-10-25T16:13:09.479843+0000","last_became_active":"2023-10-25T16:13:07.558584+0000","last_became_peered":"2023-10-25T16:13:07.558584+0000","last_unstale":"2023-10-25T16:13:09.479843+0000","last_undegraded":"2023-10-25T16:13:09.479843+0000","last_fullsized":"2023-10-25T16:13:09.479843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546149+0000","last_change":"2023-10-25T16:13:06.583922+0000","last_active":"2023-10-25T16:13:08.546149+0000","last_peered":"2023-10-25T16:13:08.546149+0000","last_clean":"2023-10-25T16:13:08.546149+0000","last_became_active":"2023-10-25T16:13:06.581997+0000","last_became_peered":"2023-10-25T16:13:06.581997+0000","last_unstale":"2023-10-25T16:13:08.546149+0000","last_undegraded":"2023-10-25T16:13:08.546149+0000","last_fullsized":"2023-10-25T16:13:08.546149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185545+0000","last_change":"2023-10-25T16:13:07.560270+0000","last_active":"2023-10-25T16:13:09.185545+0000","last_peered":"2023-10-25T16:13:09.185545+0000","last_clean":"2023-10-25T16:13:09.185545+0000","last_became_active":"2023-10-25T16:13:07.559551+0000","last_became_peered":"2023-10-25T16:13:07.559551+0000","last_unstale":"2023-10-25T16:13:09.185545+0000","last_undegraded":"2023-10-25T16:13:09.185545+0000","last_fullsized":"2023-10-25T16:13:09.185545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:19.572019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478513+0000","last_change":"2023-10-25T16:13:06.588392+0000","last_active":"2023-10-25T16:13:09.478513+0000","last_peered":"2023-10-25T16:13:09.478513+0000","last_clean":"2023-10-25T16:13:09.478513+0000","last_became_active":"2023-10-25T16:13:06.588114+0000","last_became_peered":"2023-10-25T16:13:06.588114+0000","last_unstale":"2023-10-25T16:13:09.478513+0000","last_undegraded":"2023-10-25T16:13:09.478513+0000","last_fullsized":"2023-10-25T16:13:09.478513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545216+0000","last_change":"2023-10-25T16:13:07.563744+0000","last_active":"2023-10-25T16:13:08.545216+0000","last_peered":"2023-10-25T16:13:08.545216+0000","last_clean":"2023-10-25T16:13:08.545216+0000","last_became_active":"2023-10-25T16:13:07.563027+0000","last_became_peered":"2023-10-25T16:13:07.563027+0000","last_unstale":"2023-10-25T16:13:08.545216+0000","last_undegraded":"2023-10-25T16:13:08.545216+0000","last_fullsized":"2023-10-25T16:13:08.545216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541562+0000","last_change":"2023-10-25T16:13:06.604452+0000","last_active":"2023-10-25T16:13:08.541562+0000","last_peered":"2023-10-25T16:13:08.541562+0000","last_clean":"2023-10-25T16:13:08.541562+0000","last_became_active":"2023-10-25T16:13:06.603857+0000","last_became_peered":"2023-10-25T16:13:06.603857+0000","last_unstale":"2023-10-25T16:13:08.541562+0000","last_undegraded":"2023-10-25T16:13:08.541562+0000","last_fullsized":"2023-10-25T16:13:08.541562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477752+0000","last_change":"2023-10-25T16:13:07.555525+0000","last_active":"2023-10-25T16:13:09.477752+0000","last_peered":"2023-10-25T16:13:09.477752+0000","last_clean":"2023-10-25T16:13:09.477752+0000","last_became_active":"2023-10-25T16:13:07.554924+0000","last_became_peered":"2023-10-25T16:13:07.554924+0000","last_unstale":"2023-10-25T16:13:09.477752+0000","last_undegraded":"2023-10-25T16:13:09.477752+0000","last_fullsized":"2023-10-25T16:13:09.477752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480571+0000","last_change":"2023-10-25T16:13:06.588519+0000","last_active":"2023-10-25T16:13:09.480571+0000","last_peered":"2023-10-25T16:13:09.480571+0000","last_clean":"2023-10-25T16:13:09.480571+0000","last_became_active":"2023-10-25T16:13:06.587754+0000","last_became_peered":"2023-10-25T16:13:06.587754+0000","last_unstale":"2023-10-25T16:13:09.480571+0000","last_undegraded":"2023-10-25T16:13:09.480571+0000","last_fullsized":"2023-10-25T16:13:09.480571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479179+0000","last_change":"2023-10-25T16:13:07.577983+0000","last_active":"2023-10-25T16:13:09.479179+0000","last_peered":"2023-10-25T16:13:09.479179+0000","last_clean":"2023-10-25T16:13:09.479179+0000","last_became_active":"2023-10-25T16:13:07.577344+0000","last_became_peered":"2023-10-25T16:13:07.577344+0000","last_unstale":"2023-10-25T16:13:09.479179+0000","last_undegraded":"2023-10-25T16:13:09.479179+0000","last_fullsized":"2023-10-25T16:13:09.479179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464626+0000","last_change":"2023-10-25T16:13:06.595499+0000","last_active":"2023-10-25T16:13:09.464626+0000","last_peered":"2023-10-25T16:13:09.464626+0000","last_clean":"2023-10-25T16:13:09.464626+0000","last_became_active":"2023-10-25T16:13:06.594639+0000","last_became_peered":"2023-10-25T16:13:06.594639+0000","last_unstale":"2023-10-25T16:13:09.464626+0000","last_undegraded":"2023-10-25T16:13:09.464626+0000","last_fullsized":"2023-10-25T16:13:09.464626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478650+0000","last_change":"2023-10-25T16:13:07.568153+0000","last_active":"2023-10-25T16:13:09.478650+0000","last_peered":"2023-10-25T16:13:09.478650+0000","last_clean":"2023-10-25T16:13:09.478650+0000","last_became_active":"2023-10-25T16:13:07.567204+0000","last_became_peered":"2023-10-25T16:13:07.567204+0000","last_unstale":"2023-10-25T16:13:09.478650+0000","last_undegraded":"2023-10-25T16:13:09.478650+0000","last_fullsized":"2023-10-25T16:13:09.478650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542227+0000","last_change":"2023-10-25T16:13:06.605135+0000","last_active":"2023-10-25T16:13:08.542227+0000","last_peered":"2023-10-25T16:13:08.542227+0000","last_clean":"2023-10-25T16:13:08.542227+0000","last_became_active":"2023-10-25T16:13:06.604117+0000","last_became_peered":"2023-10-25T16:13:06.604117+0000","last_unstale":"2023-10-25T16:13:08.542227+0000","last_undegraded":"2023-10-25T16:13:08.542227+0000","last_fullsized":"2023-10-25T16:13:08.542227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186211+0000","last_change":"2023-10-25T16:13:07.570460+0000","last_active":"2023-10-25T16:13:09.186211+0000","last_peered":"2023-10-25T16:13:09.186211+0000","last_clean":"2023-10-25T16:13:09.186211+0000","last_became_active":"2023-10-25T16:13:07.565363+0000","last_became_peered":"2023-10-25T16:13:07.565363+0000","last_unstale":"2023-10-25T16:13:09.186211+0000","last_undegraded":"2023-10-25T16:13:09.186211+0000","last_fullsized":"2023-10-25T16:13:09.186211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:45.620922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478298+0000","last_change":"2023-10-25T16:13:06.607078+0000","last_active":"2023-10-25T16:13:09.478298+0000","last_peered":"2023-10-25T16:13:09.478298+0000","last_clean":"2023-10-25T16:13:09.478298+0000","last_became_active":"2023-10-25T16:13:06.606881+0000","last_became_peered":"2023-10-25T16:13:06.606881+0000","last_unstale":"2023-10-25T16:13:09.478298+0000","last_undegraded":"2023-10-25T16:13:09.478298+0000","last_fullsized":"2023-10-25T16:13:09.478298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480464+0000","last_change":"2023-10-25T16:13:07.546555+0000","last_active":"2023-10-25T16:13:09.480464+0000","last_peered":"2023-10-25T16:13:09.480464+0000","last_clean":"2023-10-25T16:13:09.480464+0000","last_became_active":"2023-10-25T16:13:07.545944+0000","last_became_peered":"2023-10-25T16:13:07.545944+0000","last_unstale":"2023-10-25T16:13:09.480464+0000","last_undegraded":"2023-10-25T16:13:09.480464+0000","last_fullsized":"2023-10-25T16:13:09.480464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480051+0000","last_change":"2023-10-25T16:13:06.589243+0000","last_active":"2023-10-25T16:13:09.480051+0000","last_peered":"2023-10-25T16:13:09.480051+0000","last_clean":"2023-10-25T16:13:09.480051+0000","last_became_active":"2023-10-25T16:13:06.588343+0000","last_became_peered":"2023-10-25T16:13:06.588343+0000","last_unstale":"2023-10-25T16:13:09.480051+0000","last_undegraded":"2023-10-25T16:13:09.480051+0000","last_fullsized":"2023-10-25T16:13:09.480051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480990+0000","last_change":"2023-10-25T16:13:07.569083+0000","last_active":"2023-10-25T16:13:09.480990+0000","last_peered":"2023-10-25T16:13:09.480990+0000","last_clean":"2023-10-25T16:13:09.480990+0000","last_became_active":"2023-10-25T16:13:07.562504+0000","last_became_peered":"2023-10-25T16:13:07.562504+0000","last_unstale":"2023-10-25T16:13:09.480990+0000","last_undegraded":"2023-10-25T16:13:09.480990+0000","last_fullsized":"2023-10-25T16:13:09.480990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541587+0000","last_change":"2023-10-25T16:13:06.603385+0000","last_active":"2023-10-25T16:13:08.541587+0000","last_peered":"2023-10-25T16:13:08.541587+0000","last_clean":"2023-10-25T16:13:08.541587+0000","last_became_active":"2023-10-25T16:13:06.602760+0000","last_became_peered":"2023-10-25T16:13:06.602760+0000","last_unstale":"2023-10-25T16:13:08.541587+0000","last_undegraded":"2023-10-25T16:13:08.541587+0000","last_fullsized":"2023-10-25T16:13:08.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:55.025836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464180+0000","last_change":"2023-10-25T16:13:07.569746+0000","last_active":"2023-10-25T16:13:09.464180+0000","last_peered":"2023-10-25T16:13:09.464180+0000","last_clean":"2023-10-25T16:13:09.464180+0000","last_became_active":"2023-10-25T16:13:07.568518+0000","last_became_peered":"2023-10-25T16:13:07.568518+0000","last_unstale":"2023-10-25T16:13:09.464180+0000","last_undegraded":"2023-10-25T16:13:09.464180+0000","last_fullsized":"2023-10-25T16:13:09.464180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545306+0000","last_change":"2023-10-25T16:13:07.576112+0000","last_active":"2023-10-25T16:13:08.545306+0000","last_peered":"2023-10-25T16:13:08.545306+0000","last_clean":"2023-10-25T16:13:08.545306+0000","last_became_active":"2023-10-25T16:13:07.574201+0000","last_became_peered":"2023-10-25T16:13:07.574201+0000","last_unstale":"2023-10-25T16:13:08.545306+0000","last_undegraded":"2023-10-25T16:13:08.545306+0000","last_fullsized":"2023-10-25T16:13:08.545306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542101+0000","last_change":"2023-10-25T16:13:06.604712+0000","last_active":"2023-10-25T16:13:08.542101+0000","last_peered":"2023-10-25T16:13:08.542101+0000","last_clean":"2023-10-25T16:13:08.542101+0000","last_became_active":"2023-10-25T16:13:06.602850+0000","last_became_peered":"2023-10-25T16:13:06.602850+0000","last_unstale":"2023-10-25T16:13:08.542101+0000","last_undegraded":"2023-10-25T16:13:08.542101+0000","last_fullsized":"2023-10-25T16:13:08.542101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545831+0000","last_change":"2023-10-25T16:13:07.585084+0000","last_active":"2023-10-25T16:13:08.545831+0000","last_peered":"2023-10-25T16:13:08.545831+0000","last_clean":"2023-10-25T16:13:08.545831+0000","last_became_active":"2023-10-25T16:13:07.582955+0000","last_became_peered":"2023-10-25T16:13:07.582955+0000","last_unstale":"2023-10-25T16:13:08.545831+0000","last_undegraded":"2023-10-25T16:13:08.545831+0000","last_fullsized":"2023-10-25T16:13:08.545831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542584+0000","last_change":"2023-10-25T16:13:06.606358+0000","last_active":"2023-10-25T16:13:08.542584+0000","last_peered":"2023-10-25T16:13:08.542584+0000","last_clean":"2023-10-25T16:13:08.542584+0000","last_became_active":"2023-10-25T16:13:06.602334+0000","last_became_peered":"2023-10-25T16:13:06.602334+0000","last_unstale":"2023-10-25T16:13:08.542584+0000","last_undegraded":"2023-10-25T16:13:08.542584+0000","last_fullsized":"2023-10-25T16:13:08.542584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478959+0000","last_change":"2023-10-25T16:13:07.566273+0000","last_active":"2023-10-25T16:13:09.478959+0000","last_peered":"2023-10-25T16:13:09.478959+0000","last_clean":"2023-10-25T16:13:09.478959+0000","last_became_active":"2023-10-25T16:13:07.562676+0000","last_became_peered":"2023-10-25T16:13:07.562676+0000","last_unstale":"2023-10-25T16:13:09.478959+0000","last_undegraded":"2023-10-25T16:13:09.478959+0000","last_fullsized":"2023-10-25T16:13:09.478959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480470+0000","last_change":"2023-10-25T16:13:06.594182+0000","last_active":"2023-10-25T16:13:09.480470+0000","last_peered":"2023-10-25T16:13:09.480470+0000","last_clean":"2023-10-25T16:13:09.480470+0000","last_became_active":"2023-10-25T16:13:06.592991+0000","last_became_peered":"2023-10-25T16:13:06.592991+0000","last_unstale":"2023-10-25T16:13:09.480470+0000","last_undegraded":"2023-10-25T16:13:09.480470+0000","last_fullsized":"2023-10-25T16:13:09.480470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480226+0000","last_change":"2023-10-25T16:13:07.564149+0000","last_active":"2023-10-25T16:13:09.480226+0000","last_peered":"2023-10-25T16:13:09.480226+0000","last_clean":"2023-10-25T16:13:09.480226+0000","last_became_active":"2023-10-25T16:13:07.561630+0000","last_became_peered":"2023-10-25T16:13:07.561630+0000","last_unstale":"2023-10-25T16:13:09.480226+0000","last_undegraded":"2023-10-25T16:13:09.480226+0000","last_fullsized":"2023-10-25T16:13:09.480226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479489+0000","last_change":"2023-10-25T16:13:06.603850+0000","last_active":"2023-10-25T16:13:09.479489+0000","last_peered":"2023-10-25T16:13:09.479489+0000","last_clean":"2023-10-25T16:13:09.479489+0000","last_became_active":"2023-10-25T16:13:06.603106+0000","last_became_peered":"2023-10-25T16:13:06.603106+0000","last_unstale":"2023-10-25T16:13:09.479489+0000","last_undegraded":"2023-10-25T16:13:09.479489+0000","last_fullsized":"2023-10-25T16:13:09.479489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937930,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3919999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931029,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199930995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340149,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1029999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2320000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1219999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1349999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.891999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:10.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 -- 172.21.15.177:0/983475583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac815ca70 msgr2=0x7f8ac80adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/983475583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac815ca70 0x7f8ac80adeb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ac806a700 tx=0x7f8ac401cb30 comp rx=0 tx=0).stop 2023-10-25T16:13:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 -- 172.21.15.177:0/983475583 shutdown_connections 2023-10-25T16:13:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/983475583 >> v2:172.21.15.184:3300/0 conn(0x7f8ac80b0280 0x7f8ac80cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/983475583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac815ca70 0x7f8ac80adeb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 -- 172.21.15.177:0/983475583 >> 172.21.15.177:0/983475583 conn(0x7f8ac80983a0 msgr2=0x7f8ac80cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 -- 172.21.15.177:0/983475583 shutdown_connections 2023-10-25T16:13:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 -- 172.21.15.177:0/983475583 wait complete. 2023-10-25T16:13:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 Processor -- start 2023-10-25T16:13:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.091+0000 7f8ad00b7640 1 -- start start 2023-10-25T16:13:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 0x7f8ac8150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac80cbed0 0x7f8ac8151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac815ca70 0x7f8ac815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814e440 con 0x7f8ac80b0280 2023-10-25T16:13:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814e690 con 0x7f8ac80cbed0 2023-10-25T16:13:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac814e970 con 0x7f8ac815ca70 2023-10-25T16:13:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 0x7f8ac8150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 0x7f8ac8150ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43350/0 (socket says 172.21.15.177:43350) 2023-10-25T16:13:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 -- 172.21.15.177:0/2641471918 learned_addr learned my addr 172.21.15.177:0/2641471918 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ace654640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac815ca70 0x7f8ac815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acd652640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac80cbed0 0x7f8ac8151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 -- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac815ca70 msgr2=0x7f8ac815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac815ca70 0x7f8ac815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 -- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac80cbed0 msgr2=0x7f8ac8151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac80cbed0 0x7f8ac8151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 -- 172.21.15.177:0/2641471918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4009820 con 0x7f8ac80b0280 2023-10-25T16:13:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ace654640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac815ca70 0x7f8ac815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acde53640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 0x7f8ac8150ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000f90 tx=0x7f8ac40a5a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004d10 con 0x7f8ac80b0280 2023-10-25T16:13:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8ac4003fe0 con 0x7f8ac80b0280 2023-10-25T16:13:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac80cb360 con 0x7f8ac80b0280 2023-10-25T16:13:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004370 con 0x7f8ac80b0280 2023-10-25T16:13:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac814ef30 con 0x7f8ac80b0280 2023-10-25T16:13:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac80c2990 con 0x7f8ac80b0280 2023-10-25T16:13:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ac40b4040 con 0x7f8ac80b0280 2023-10-25T16:13:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8abe7fc640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aac0664a0 0x7f8aac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ac411e100 con 0x7f8ac80b0280 2023-10-25T16:13:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.095+0000 7f8acd652640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aac0664a0 0x7f8aac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.099+0000 7f8acd652640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aac0664a0 0x7f8aac068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ac815c7e0 tx=0x7f8ab8005bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.099+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ac40eb590 con 0x7f8ac80b0280 2023-10-25T16:13:11.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.239+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ac80cb1e0 con 0x7f8aac0664a0 2023-10-25T16:13:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.259+0000 7f8abe7fc640 1 -- 172.21.15.177:0/2641471918 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259944 (secure 0 0 0) 0x7f8ab800b570 con 0x7f8aac0664a0 2023-10-25T16:13:11.264 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aac0664a0 msgr2=0x7f8aac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aac0664a0 0x7f8aac068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8ac815c7e0 tx=0x7f8ab8005bd0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 msgr2=0x7f8ac8150ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 0x7f8ac8150ed0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4000f90 tx=0x7f8ac40a5a10 comp rx=0 tx=0).stop 2023-10-25T16:13:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 shutdown_connections 2023-10-25T16:13:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aac0664a0 0x7f8aac068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac815ca70 0x7f8ac815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac80cbed0 0x7f8ac8151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 --2- 172.21.15.177:0/2641471918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac80b0280 0x7f8ac8150ed0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 >> 172.21.15.177:0/2641471918 conn(0x7f8ac80983a0 msgr2=0x7f8ac80ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 shutdown_connections 2023-10-25T16:13:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.263+0000 7f8ad00b7640 1 -- 172.21.15.177:0/2641471918 wait complete. 2023-10-25T16:13:11.280 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-25T16:13:10.592770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560798,"statfs":{"total":1600000000,"available":1598257859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.034701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541423+0000","last_change":"2023-10-25T16:13:07.579322+0000","last_active":"2023-10-25T16:13:08.541423+0000","last_peered":"2023-10-25T16:13:08.541423+0000","last_clean":"2023-10-25T16:13:08.541423+0000","last_became_active":"2023-10-25T16:13:07.566613+0000","last_became_peered":"2023-10-25T16:13:07.566613+0000","last_unstale":"2023-10-25T16:13:08.541423+0000","last_undegraded":"2023-10-25T16:13:08.541423+0000","last_fullsized":"2023-10-25T16:13:08.541423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477996+0000","last_change":"2023-10-25T16:13:07.553120+0000","last_active":"2023-10-25T16:13:09.477996+0000","last_peered":"2023-10-25T16:13:09.477996+0000","last_clean":"2023-10-25T16:13:09.477996+0000","last_became_active":"2023-10-25T16:13:07.551990+0000","last_became_peered":"2023-10-25T16:13:07.551990+0000","last_unstale":"2023-10-25T16:13:09.477996+0000","last_undegraded":"2023-10-25T16:13:09.477996+0000","last_fullsized":"2023-10-25T16:13:09.477996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478313+0000","last_change":"2023-10-25T16:13:07.563333+0000","last_active":"2023-10-25T16:13:09.478313+0000","last_peered":"2023-10-25T16:13:09.478313+0000","last_clean":"2023-10-25T16:13:09.478313+0000","last_became_active":"2023-10-25T16:13:07.560920+0000","last_became_peered":"2023-10-25T16:13:07.560920+0000","last_unstale":"2023-10-25T16:13:09.478313+0000","last_undegraded":"2023-10-25T16:13:09.478313+0000","last_fullsized":"2023-10-25T16:13:09.478313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544460+0000","last_change":"2023-10-25T16:13:07.567528+0000","last_active":"2023-10-25T16:13:08.544460+0000","last_peered":"2023-10-25T16:13:08.544460+0000","last_clean":"2023-10-25T16:13:08.544460+0000","last_became_active":"2023-10-25T16:13:07.566685+0000","last_became_peered":"2023-10-25T16:13:07.566685+0000","last_unstale":"2023-10-25T16:13:08.544460+0000","last_undegraded":"2023-10-25T16:13:08.544460+0000","last_fullsized":"2023-10-25T16:13:08.544460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541668+0000","last_change":"2023-10-25T16:13:07.579075+0000","last_active":"2023-10-25T16:13:08.541668+0000","last_peered":"2023-10-25T16:13:08.541668+0000","last_clean":"2023-10-25T16:13:08.541668+0000","last_became_active":"2023-10-25T16:13:07.567451+0000","last_became_peered":"2023-10-25T16:13:07.567451+0000","last_unstale":"2023-10-25T16:13:08.541668+0000","last_undegraded":"2023-10-25T16:13:08.541668+0000","last_fullsized":"2023-10-25T16:13:08.541668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545497+0000","last_change":"2023-10-25T16:13:07.585648+0000","last_active":"2023-10-25T16:13:08.545497+0000","last_peered":"2023-10-25T16:13:08.545497+0000","last_clean":"2023-10-25T16:13:08.545497+0000","last_became_active":"2023-10-25T16:13:07.583670+0000","last_became_peered":"2023-10-25T16:13:07.583670+0000","last_unstale":"2023-10-25T16:13:08.545497+0000","last_undegraded":"2023-10-25T16:13:08.545497+0000","last_fullsized":"2023-10-25T16:13:08.545497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541701+0000","last_change":"2023-10-25T16:13:07.581287+0000","last_active":"2023-10-25T16:13:08.541701+0000","last_peered":"2023-10-25T16:13:08.541701+0000","last_clean":"2023-10-25T16:13:08.541701+0000","last_became_active":"2023-10-25T16:13:07.577390+0000","last_became_peered":"2023-10-25T16:13:07.577390+0000","last_unstale":"2023-10-25T16:13:08.541701+0000","last_undegraded":"2023-10-25T16:13:08.541701+0000","last_fullsized":"2023-10-25T16:13:08.541701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477246+0000","last_change":"2023-10-25T16:13:07.569496+0000","last_active":"2023-10-25T16:13:09.477246+0000","last_peered":"2023-10-25T16:13:09.477246+0000","last_clean":"2023-10-25T16:13:09.477246+0000","last_became_active":"2023-10-25T16:13:07.563950+0000","last_became_peered":"2023-10-25T16:13:07.563950+0000","last_unstale":"2023-10-25T16:13:09.477246+0000","last_undegraded":"2023-10-25T16:13:09.477246+0000","last_fullsized":"2023-10-25T16:13:09.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541010+0000","last_change":"2023-10-25T16:13:07.577965+0000","last_active":"2023-10-25T16:13:08.541010+0000","last_peered":"2023-10-25T16:13:08.541010+0000","last_clean":"2023-10-25T16:13:08.541010+0000","last_became_active":"2023-10-25T16:13:07.576892+0000","last_became_peered":"2023-10-25T16:13:07.576892+0000","last_unstale":"2023-10-25T16:13:08.541010+0000","last_undegraded":"2023-10-25T16:13:08.541010+0000","last_fullsized":"2023-10-25T16:13:08.541010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464171+0000","last_change":"2023-10-25T16:13:07.561076+0000","last_active":"2023-10-25T16:13:09.464171+0000","last_peered":"2023-10-25T16:13:09.464171+0000","last_clean":"2023-10-25T16:13:09.464171+0000","last_became_active":"2023-10-25T16:13:07.560340+0000","last_became_peered":"2023-10-25T16:13:07.560340+0000","last_unstale":"2023-10-25T16:13:09.464171+0000","last_undegraded":"2023-10-25T16:13:09.464171+0000","last_fullsized":"2023-10-25T16:13:09.464171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.463985+0000","last_change":"2023-10-25T16:13:07.585838+0000","last_active":"2023-10-25T16:13:09.463985+0000","last_peered":"2023-10-25T16:13:09.463985+0000","last_clean":"2023-10-25T16:13:09.463985+0000","last_became_active":"2023-10-25T16:13:07.585351+0000","last_became_peered":"2023-10-25T16:13:07.585351+0000","last_unstale":"2023-10-25T16:13:09.463985+0000","last_undegraded":"2023-10-25T16:13:09.463985+0000","last_fullsized":"2023-10-25T16:13:09.463985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186012+0000","last_change":"2023-10-25T16:13:07.572936+0000","last_active":"2023-10-25T16:13:09.186012+0000","last_peered":"2023-10-25T16:13:09.186012+0000","last_clean":"2023-10-25T16:13:09.186012+0000","last_became_active":"2023-10-25T16:13:07.572216+0000","last_became_peered":"2023-10-25T16:13:07.572216+0000","last_unstale":"2023-10-25T16:13:09.186012+0000","last_undegraded":"2023-10-25T16:13:09.186012+0000","last_fullsized":"2023-10-25T16:13:09.186012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:56.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480366+0000","last_change":"2023-10-25T16:13:07.567194+0000","last_active":"2023-10-25T16:13:09.480366+0000","last_peered":"2023-10-25T16:13:09.480366+0000","last_clean":"2023-10-25T16:13:09.480366+0000","last_became_active":"2023-10-25T16:13:07.561537+0000","last_became_peered":"2023-10-25T16:13:07.561537+0000","last_unstale":"2023-10-25T16:13:09.480366+0000","last_undegraded":"2023-10-25T16:13:09.480366+0000","last_fullsized":"2023-10-25T16:13:09.480366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477496+0000","last_change":"2023-10-25T16:13:07.567614+0000","last_active":"2023-10-25T16:13:09.477496+0000","last_peered":"2023-10-25T16:13:09.477496+0000","last_clean":"2023-10-25T16:13:09.477496+0000","last_became_active":"2023-10-25T16:13:07.564979+0000","last_became_peered":"2023-10-25T16:13:07.564979+0000","last_unstale":"2023-10-25T16:13:09.477496+0000","last_undegraded":"2023-10-25T16:13:09.477496+0000","last_fullsized":"2023-10-25T16:13:09.477496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:05.007750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478079+0000","last_change":"2023-10-25T16:13:07.562980+0000","last_active":"2023-10-25T16:13:09.478079+0000","last_peered":"2023-10-25T16:13:09.478079+0000","last_clean":"2023-10-25T16:13:09.478079+0000","last_became_active":"2023-10-25T16:13:07.562370+0000","last_became_peered":"2023-10-25T16:13:07.562370+0000","last_unstale":"2023-10-25T16:13:09.478079+0000","last_undegraded":"2023-10-25T16:13:09.478079+0000","last_fullsized":"2023-10-25T16:13:09.478079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545182+0000","last_change":"2023-10-25T16:13:07.587718+0000","last_active":"2023-10-25T16:13:08.545182+0000","last_peered":"2023-10-25T16:13:08.545182+0000","last_clean":"2023-10-25T16:13:08.545182+0000","last_became_active":"2023-10-25T16:13:07.584346+0000","last_became_peered":"2023-10-25T16:13:07.584346+0000","last_unstale":"2023-10-25T16:13:08.545182+0000","last_undegraded":"2023-10-25T16:13:08.545182+0000","last_fullsized":"2023-10-25T16:13:08.545182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544311+0000","last_change":"2023-10-25T16:13:07.590347+0000","last_active":"2023-10-25T16:13:08.544311+0000","last_peered":"2023-10-25T16:13:08.544311+0000","last_clean":"2023-10-25T16:13:08.544311+0000","last_became_active":"2023-10-25T16:13:07.589306+0000","last_became_peered":"2023-10-25T16:13:07.589306+0000","last_unstale":"2023-10-25T16:13:08.544311+0000","last_undegraded":"2023-10-25T16:13:08.544311+0000","last_fullsized":"2023-10-25T16:13:08.544311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.568213+0000","last_change":"2023-10-25T16:13:06.568213+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.568213+0000","last_undegraded":"2023-10-25T16:13:06.568213+0000","last_fullsized":"2023-10-25T16:13:06.568213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541426+0000","last_change":"2023-10-25T16:13:07.565774+0000","last_active":"2023-10-25T16:13:08.541426+0000","last_peered":"2023-10-25T16:13:08.541426+0000","last_clean":"2023-10-25T16:13:08.541426+0000","last_became_active":"2023-10-25T16:13:07.564671+0000","last_became_peered":"2023-10-25T16:13:07.564671+0000","last_unstale":"2023-10-25T16:13:08.541426+0000","last_undegraded":"2023-10-25T16:13:08.541426+0000","last_fullsized":"2023-10-25T16:13:08.541426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464359+0000","last_change":"2023-10-25T16:13:07.569779+0000","last_active":"2023-10-25T16:13:09.464359+0000","last_peered":"2023-10-25T16:13:09.464359+0000","last_clean":"2023-10-25T16:13:09.464359+0000","last_became_active":"2023-10-25T16:13:07.568943+0000","last_became_peered":"2023-10-25T16:13:07.568943+0000","last_unstale":"2023-10-25T16:13:09.464359+0000","last_undegraded":"2023-10-25T16:13:09.464359+0000","last_fullsized":"2023-10-25T16:13:09.464359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478818+0000","last_change":"2023-10-25T16:13:07.588566+0000","last_active":"2023-10-25T16:13:09.478818+0000","last_peered":"2023-10-25T16:13:09.478818+0000","last_clean":"2023-10-25T16:13:09.478818+0000","last_became_active":"2023-10-25T16:13:07.586975+0000","last_became_peered":"2023-10-25T16:13:07.586975+0000","last_unstale":"2023-10-25T16:13:09.478818+0000","last_undegraded":"2023-10-25T16:13:09.478818+0000","last_fullsized":"2023-10-25T16:13:09.478818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544961+0000","last_change":"2023-10-25T16:13:07.589720+0000","last_active":"2023-10-25T16:13:08.544961+0000","last_peered":"2023-10-25T16:13:08.544961+0000","last_clean":"2023-10-25T16:13:08.544961+0000","last_became_active":"2023-10-25T16:13:07.587901+0000","last_became_peered":"2023-10-25T16:13:07.587901+0000","last_unstale":"2023-10-25T16:13:08.544961+0000","last_undegraded":"2023-10-25T16:13:08.544961+0000","last_fullsized":"2023-10-25T16:13:08.544961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481296+0000","last_change":"2023-10-25T16:13:07.564523+0000","last_active":"2023-10-25T16:13:09.481296+0000","last_peered":"2023-10-25T16:13:09.481296+0000","last_clean":"2023-10-25T16:13:09.481296+0000","last_became_active":"2023-10-25T16:13:07.558883+0000","last_became_peered":"2023-10-25T16:13:07.558883+0000","last_unstale":"2023-10-25T16:13:09.481296+0000","last_undegraded":"2023-10-25T16:13:09.481296+0000","last_fullsized":"2023-10-25T16:13:09.481296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544854+0000","last_change":"2023-10-25T16:13:07.565692+0000","last_active":"2023-10-25T16:13:08.544854+0000","last_peered":"2023-10-25T16:13:08.544854+0000","last_clean":"2023-10-25T16:13:08.544854+0000","last_became_active":"2023-10-25T16:13:07.565063+0000","last_became_peered":"2023-10-25T16:13:07.565063+0000","last_unstale":"2023-10-25T16:13:08.544854+0000","last_undegraded":"2023-10-25T16:13:08.544854+0000","last_fullsized":"2023-10-25T16:13:08.544854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478118+0000","last_change":"2023-10-25T16:13:07.567029+0000","last_active":"2023-10-25T16:13:09.478118+0000","last_peered":"2023-10-25T16:13:09.478118+0000","last_clean":"2023-10-25T16:13:09.478118+0000","last_became_active":"2023-10-25T16:13:07.563753+0000","last_became_peered":"2023-10-25T16:13:07.563753+0000","last_unstale":"2023-10-25T16:13:09.478118+0000","last_undegraded":"2023-10-25T16:13:09.478118+0000","last_fullsized":"2023-10-25T16:13:09.478118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464243+0000","last_change":"2023-10-25T16:13:07.571465+0000","last_active":"2023-10-25T16:13:09.464243+0000","last_peered":"2023-10-25T16:13:09.464243+0000","last_clean":"2023-10-25T16:13:09.464243+0000","last_became_active":"2023-10-25T16:13:07.570569+0000","last_became_peered":"2023-10-25T16:13:07.570569+0000","last_unstale":"2023-10-25T16:13:09.464243+0000","last_undegraded":"2023-10-25T16:13:09.464243+0000","last_fullsized":"2023-10-25T16:13:09.464243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478333+0000","last_change":"2023-10-25T16:13:07.552675+0000","last_active":"2023-10-25T16:13:09.478333+0000","last_peered":"2023-10-25T16:13:09.478333+0000","last_clean":"2023-10-25T16:13:09.478333+0000","last_became_active":"2023-10-25T16:13:07.551113+0000","last_became_peered":"2023-10-25T16:13:07.551113+0000","last_unstale":"2023-10-25T16:13:09.478333+0000","last_undegraded":"2023-10-25T16:13:09.478333+0000","last_fullsized":"2023-10-25T16:13:09.478333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480684+0000","last_change":"2023-10-25T16:13:07.563309+0000","last_active":"2023-10-25T16:13:09.480684+0000","last_peered":"2023-10-25T16:13:09.480684+0000","last_clean":"2023-10-25T16:13:09.480684+0000","last_became_active":"2023-10-25T16:13:07.556854+0000","last_became_peered":"2023-10-25T16:13:07.556854+0000","last_unstale":"2023-10-25T16:13:09.480684+0000","last_undegraded":"2023-10-25T16:13:09.480684+0000","last_fullsized":"2023-10-25T16:13:09.480684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481261+0000","last_change":"2023-10-25T16:13:07.563614+0000","last_active":"2023-10-25T16:13:09.481261+0000","last_peered":"2023-10-25T16:13:09.481261+0000","last_clean":"2023-10-25T16:13:09.481261+0000","last_became_active":"2023-10-25T16:13:07.562379+0000","last_became_peered":"2023-10-25T16:13:07.562379+0000","last_unstale":"2023-10-25T16:13:09.481261+0000","last_undegraded":"2023-10-25T16:13:09.481261+0000","last_fullsized":"2023-10-25T16:13:09.481261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544963+0000","last_change":"2023-10-25T16:13:07.575589+0000","last_active":"2023-10-25T16:13:08.544963+0000","last_peered":"2023-10-25T16:13:08.544963+0000","last_clean":"2023-10-25T16:13:08.544963+0000","last_became_active":"2023-10-25T16:13:07.569050+0000","last_became_peered":"2023-10-25T16:13:07.569050+0000","last_unstale":"2023-10-25T16:13:08.544963+0000","last_undegraded":"2023-10-25T16:13:08.544963+0000","last_fullsized":"2023-10-25T16:13:08.544963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.567411+0000","last_change":"2023-10-25T16:13:06.567411+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.567411+0000","last_undegraded":"2023-10-25T16:13:06.567411+0000","last_fullsized":"2023-10-25T16:13:06.567411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464294+0000","last_change":"2023-10-25T16:13:07.571634+0000","last_active":"2023-10-25T16:13:09.464294+0000","last_peered":"2023-10-25T16:13:09.464294+0000","last_clean":"2023-10-25T16:13:09.464294+0000","last_became_active":"2023-10-25T16:13:07.570373+0000","last_became_peered":"2023-10-25T16:13:07.570373+0000","last_unstale":"2023-10-25T16:13:09.464294+0000","last_undegraded":"2023-10-25T16:13:09.464294+0000","last_fullsized":"2023-10-25T16:13:09.464294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185835+0000","last_change":"2023-10-25T16:13:07.554976+0000","last_active":"2023-10-25T16:13:09.185835+0000","last_peered":"2023-10-25T16:13:09.185835+0000","last_clean":"2023-10-25T16:13:09.185835+0000","last_became_active":"2023-10-25T16:13:07.554311+0000","last_became_peered":"2023-10-25T16:13:07.554311+0000","last_unstale":"2023-10-25T16:13:09.185835+0000","last_undegraded":"2023-10-25T16:13:09.185835+0000","last_fullsized":"2023-10-25T16:13:09.185835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479939+0000","last_change":"2023-10-25T16:13:06.604007+0000","last_active":"2023-10-25T16:13:09.479939+0000","last_peered":"2023-10-25T16:13:09.479939+0000","last_clean":"2023-10-25T16:13:09.479939+0000","last_became_active":"2023-10-25T16:13:06.603266+0000","last_became_peered":"2023-10-25T16:13:06.603266+0000","last_unstale":"2023-10-25T16:13:09.479939+0000","last_undegraded":"2023-10-25T16:13:09.479939+0000","last_fullsized":"2023-10-25T16:13:09.479939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478778+0000","last_change":"2023-10-25T16:13:07.559020+0000","last_active":"2023-10-25T16:13:09.478778+0000","last_peered":"2023-10-25T16:13:09.478778+0000","last_clean":"2023-10-25T16:13:09.478778+0000","last_became_active":"2023-10-25T16:13:07.558319+0000","last_became_peered":"2023-10-25T16:13:07.558319+0000","last_unstale":"2023-10-25T16:13:09.478778+0000","last_undegraded":"2023-10-25T16:13:09.478778+0000","last_fullsized":"2023-10-25T16:13:09.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464815+0000","last_change":"2023-10-25T16:13:06.598258+0000","last_active":"2023-10-25T16:13:09.464815+0000","last_peered":"2023-10-25T16:13:09.464815+0000","last_clean":"2023-10-25T16:13:09.464815+0000","last_became_active":"2023-10-25T16:13:06.597739+0000","last_became_peered":"2023-10-25T16:13:06.597739+0000","last_unstale":"2023-10-25T16:13:09.464815+0000","last_undegraded":"2023-10-25T16:13:09.464815+0000","last_fullsized":"2023-10-25T16:13:09.464815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480678+0000","last_change":"2023-10-25T16:13:06.593802+0000","last_active":"2023-10-25T16:13:09.480678+0000","last_peered":"2023-10-25T16:13:09.480678+0000","last_clean":"2023-10-25T16:13:09.480678+0000","last_became_active":"2023-10-25T16:13:06.591848+0000","last_became_peered":"2023-10-25T16:13:06.591848+0000","last_unstale":"2023-10-25T16:13:09.480678+0000","last_undegraded":"2023-10-25T16:13:09.480678+0000","last_fullsized":"2023-10-25T16:13:09.480678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478429+0000","last_change":"2023-10-25T16:13:07.564400+0000","last_active":"2023-10-25T16:13:09.478429+0000","last_peered":"2023-10-25T16:13:09.478429+0000","last_clean":"2023-10-25T16:13:09.478429+0000","last_became_active":"2023-10-25T16:13:07.560990+0000","last_became_peered":"2023-10-25T16:13:07.560990+0000","last_unstale":"2023-10-25T16:13:09.478429+0000","last_undegraded":"2023-10-25T16:13:09.478429+0000","last_fullsized":"2023-10-25T16:13:09.478429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545533+0000","last_change":"2023-10-25T16:13:06.585016+0000","last_active":"2023-10-25T16:13:08.545533+0000","last_peered":"2023-10-25T16:13:08.545533+0000","last_clean":"2023-10-25T16:13:08.545533+0000","last_became_active":"2023-10-25T16:13:06.584376+0000","last_became_peered":"2023-10-25T16:13:06.584376+0000","last_unstale":"2023-10-25T16:13:08.545533+0000","last_undegraded":"2023-10-25T16:13:08.545533+0000","last_fullsized":"2023-10-25T16:13:08.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479516+0000","last_change":"2023-10-25T16:13:07.559199+0000","last_active":"2023-10-25T16:13:09.479516+0000","last_peered":"2023-10-25T16:13:09.479516+0000","last_clean":"2023-10-25T16:13:09.479516+0000","last_became_active":"2023-10-25T16:13:07.556631+0000","last_became_peered":"2023-10-25T16:13:07.556631+0000","last_unstale":"2023-10-25T16:13:09.479516+0000","last_undegraded":"2023-10-25T16:13:09.479516+0000","last_fullsized":"2023-10-25T16:13:09.479516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464487+0000","last_change":"2023-10-25T16:13:06.584038+0000","last_active":"2023-10-25T16:13:09.464487+0000","last_peered":"2023-10-25T16:13:09.464487+0000","last_clean":"2023-10-25T16:13:09.464487+0000","last_became_active":"2023-10-25T16:13:06.583589+0000","last_became_peered":"2023-10-25T16:13:06.583589+0000","last_unstale":"2023-10-25T16:13:09.464487+0000","last_undegraded":"2023-10-25T16:13:09.464487+0000","last_fullsized":"2023-10-25T16:13:09.464487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544608+0000","last_change":"2023-10-25T16:13:07.590063+0000","last_active":"2023-10-25T16:13:08.544608+0000","last_peered":"2023-10-25T16:13:08.544608+0000","last_clean":"2023-10-25T16:13:08.544608+0000","last_became_active":"2023-10-25T16:13:07.588495+0000","last_became_peered":"2023-10-25T16:13:07.588495+0000","last_unstale":"2023-10-25T16:13:08.544608+0000","last_undegraded":"2023-10-25T16:13:08.544608+0000","last_fullsized":"2023-10-25T16:13:08.544608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546034+0000","last_change":"2023-10-25T16:13:06.590184+0000","last_active":"2023-10-25T16:13:08.546034+0000","last_peered":"2023-10-25T16:13:08.546034+0000","last_clean":"2023-10-25T16:13:08.546034+0000","last_became_active":"2023-10-25T16:13:06.588948+0000","last_became_peered":"2023-10-25T16:13:06.588948+0000","last_unstale":"2023-10-25T16:13:08.546034+0000","last_undegraded":"2023-10-25T16:13:08.546034+0000","last_fullsized":"2023-10-25T16:13:08.546034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479144+0000","last_change":"2023-10-25T16:13:07.586291+0000","last_active":"2023-10-25T16:13:09.479144+0000","last_peered":"2023-10-25T16:13:09.479144+0000","last_clean":"2023-10-25T16:13:09.479144+0000","last_became_active":"2023-10-25T16:13:07.585591+0000","last_became_peered":"2023-10-25T16:13:07.585591+0000","last_unstale":"2023-10-25T16:13:09.479144+0000","last_undegraded":"2023-10-25T16:13:09.479144+0000","last_fullsized":"2023-10-25T16:13:09.479144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480345+0000","last_change":"2023-10-25T16:13:06.583823+0000","last_active":"2023-10-25T16:13:09.480345+0000","last_peered":"2023-10-25T16:13:09.480345+0000","last_clean":"2023-10-25T16:13:09.480345+0000","last_became_active":"2023-10-25T16:13:06.583486+0000","last_became_peered":"2023-10-25T16:13:06.583486+0000","last_unstale":"2023-10-25T16:13:09.480345+0000","last_undegraded":"2023-10-25T16:13:09.480345+0000","last_fullsized":"2023-10-25T16:13:09.480345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:19.848515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185623+0000","last_change":"2023-10-25T16:13:07.568365+0000","last_active":"2023-10-25T16:13:09.185623+0000","last_peered":"2023-10-25T16:13:09.185623+0000","last_clean":"2023-10-25T16:13:09.185623+0000","last_became_active":"2023-10-25T16:13:07.567142+0000","last_became_peered":"2023-10-25T16:13:07.567142+0000","last_unstale":"2023-10-25T16:13:09.185623+0000","last_undegraded":"2023-10-25T16:13:09.185623+0000","last_fullsized":"2023-10-25T16:13:09.185623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464438+0000","last_change":"2023-10-25T16:13:06.595459+0000","last_active":"2023-10-25T16:13:09.464438+0000","last_peered":"2023-10-25T16:13:09.464438+0000","last_clean":"2023-10-25T16:13:09.464438+0000","last_became_active":"2023-10-25T16:13:06.594824+0000","last_became_peered":"2023-10-25T16:13:06.594824+0000","last_unstale":"2023-10-25T16:13:09.464438+0000","last_undegraded":"2023-10-25T16:13:09.464438+0000","last_fullsized":"2023-10-25T16:13:09.464438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541328+0000","last_change":"2023-10-25T16:13:07.577436+0000","last_active":"2023-10-25T16:13:08.541328+0000","last_peered":"2023-10-25T16:13:08.541328+0000","last_clean":"2023-10-25T16:13:08.541328+0000","last_became_active":"2023-10-25T16:13:07.567759+0000","last_became_peered":"2023-10-25T16:13:07.567759+0000","last_unstale":"2023-10-25T16:13:08.541328+0000","last_undegraded":"2023-10-25T16:13:08.541328+0000","last_fullsized":"2023-10-25T16:13:08.541328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480167+0000","last_change":"2023-10-25T16:13:06.591408+0000","last_active":"2023-10-25T16:13:09.480167+0000","last_peered":"2023-10-25T16:13:09.480167+0000","last_clean":"2023-10-25T16:13:09.480167+0000","last_became_active":"2023-10-25T16:13:06.591012+0000","last_became_peered":"2023-10-25T16:13:06.591012+0000","last_unstale":"2023-10-25T16:13:09.480167+0000","last_undegraded":"2023-10-25T16:13:09.480167+0000","last_fullsized":"2023-10-25T16:13:09.480167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479460+0000","last_change":"2023-10-25T16:13:07.589102+0000","last_active":"2023-10-25T16:13:09.479460+0000","last_peered":"2023-10-25T16:13:09.479460+0000","last_clean":"2023-10-25T16:13:09.479460+0000","last_became_active":"2023-10-25T16:13:07.587838+0000","last_became_peered":"2023-10-25T16:13:07.587838+0000","last_unstale":"2023-10-25T16:13:09.479460+0000","last_undegraded":"2023-10-25T16:13:09.479460+0000","last_fullsized":"2023-10-25T16:13:09.479460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546334+0000","last_change":"2023-10-25T16:13:06.589759+0000","last_active":"2023-10-25T16:13:08.546334+0000","last_peered":"2023-10-25T16:13:08.546334+0000","last_clean":"2023-10-25T16:13:08.546334+0000","last_became_active":"2023-10-25T16:13:06.589100+0000","last_became_peered":"2023-10-25T16:13:06.589100+0000","last_unstale":"2023-10-25T16:13:08.546334+0000","last_undegraded":"2023-10-25T16:13:08.546334+0000","last_fullsized":"2023-10-25T16:13:08.546334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542048+0000","last_change":"2023-10-25T16:13:07.577105+0000","last_active":"2023-10-25T16:13:08.542048+0000","last_peered":"2023-10-25T16:13:08.542048+0000","last_clean":"2023-10-25T16:13:08.542048+0000","last_became_active":"2023-10-25T16:13:07.565017+0000","last_became_peered":"2023-10-25T16:13:07.565017+0000","last_unstale":"2023-10-25T16:13:08.542048+0000","last_undegraded":"2023-10-25T16:13:08.542048+0000","last_fullsized":"2023-10-25T16:13:08.542048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464495+0000","last_change":"2023-10-25T16:13:06.598452+0000","last_active":"2023-10-25T16:13:09.464495+0000","last_peered":"2023-10-25T16:13:09.464495+0000","last_clean":"2023-10-25T16:13:09.464495+0000","last_became_active":"2023-10-25T16:13:06.597797+0000","last_became_peered":"2023-10-25T16:13:06.597797+0000","last_unstale":"2023-10-25T16:13:09.464495+0000","last_undegraded":"2023-10-25T16:13:09.464495+0000","last_fullsized":"2023-10-25T16:13:09.464495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464575+0000","last_change":"2023-10-25T16:13:07.569409+0000","last_active":"2023-10-25T16:13:09.464575+0000","last_peered":"2023-10-25T16:13:09.464575+0000","last_clean":"2023-10-25T16:13:09.464575+0000","last_became_active":"2023-10-25T16:13:07.561141+0000","last_became_peered":"2023-10-25T16:13:07.561141+0000","last_unstale":"2023-10-25T16:13:09.464575+0000","last_undegraded":"2023-10-25T16:13:09.464575+0000","last_fullsized":"2023-10-25T16:13:09.464575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.587348+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:06.587348+0000","last_peered":"2023-10-25T16:13:06.587348+0000","last_clean":"2023-10-25T16:13:06.587348+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:06.587348+0000","last_undegraded":"2023-10-25T16:13:06.587348+0000","last_fullsized":"2023-10-25T16:13:06.587348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:14:25.507113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542401+0000","last_change":"2023-10-25T16:13:07.586802+0000","last_active":"2023-10-25T16:13:08.542401+0000","last_peered":"2023-10-25T16:13:08.542401+0000","last_clean":"2023-10-25T16:13:08.542401+0000","last_became_active":"2023-10-25T16:13:07.586067+0000","last_became_peered":"2023-10-25T16:13:07.586067+0000","last_unstale":"2023-10-25T16:13:08.542401+0000","last_undegraded":"2023-10-25T16:13:08.542401+0000","last_fullsized":"2023-10-25T16:13:08.542401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185909+0000","last_change":"2023-10-25T16:13:06.576987+0000","last_active":"2023-10-25T16:13:09.185909+0000","last_peered":"2023-10-25T16:13:09.185909+0000","last_clean":"2023-10-25T16:13:09.185909+0000","last_became_active":"2023-10-25T16:13:06.576204+0000","last_became_peered":"2023-10-25T16:13:06.576204+0000","last_unstale":"2023-10-25T16:13:09.185909+0000","last_undegraded":"2023-10-25T16:13:09.185909+0000","last_fullsized":"2023-10-25T16:13:09.185909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:27.980983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542364+0000","last_change":"2023-10-25T16:13:07.577484+0000","last_active":"2023-10-25T16:13:08.542364+0000","last_peered":"2023-10-25T16:13:08.542364+0000","last_clean":"2023-10-25T16:13:08.542364+0000","last_became_active":"2023-10-25T16:13:07.566477+0000","last_became_peered":"2023-10-25T16:13:07.566477+0000","last_unstale":"2023-10-25T16:13:08.542364+0000","last_undegraded":"2023-10-25T16:13:08.542364+0000","last_fullsized":"2023-10-25T16:13:08.542364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.574334+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:06.574334+0000","last_peered":"2023-10-25T16:13:06.574334+0000","last_clean":"2023-10-25T16:13:06.574334+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:06.574334+0000","last_undegraded":"2023-10-25T16:13:06.574334+0000","last_fullsized":"2023-10-25T16:13:06.574334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:15.085365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541203+0000","last_change":"2023-10-25T16:13:07.565301+0000","last_active":"2023-10-25T16:13:08.541203+0000","last_peered":"2023-10-25T16:13:08.541203+0000","last_clean":"2023-10-25T16:13:08.541203+0000","last_became_active":"2023-10-25T16:13:07.563812+0000","last_became_peered":"2023-10-25T16:13:07.563812+0000","last_unstale":"2023-10-25T16:13:08.541203+0000","last_undegraded":"2023-10-25T16:13:08.541203+0000","last_fullsized":"2023-10-25T16:13:08.541203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478001+0000","last_change":"2023-10-25T16:13:06.583997+0000","last_active":"2023-10-25T16:13:09.478001+0000","last_peered":"2023-10-25T16:13:09.478001+0000","last_clean":"2023-10-25T16:13:09.478001+0000","last_became_active":"2023-10-25T16:13:06.583355+0000","last_became_peered":"2023-10-25T16:13:06.583355+0000","last_unstale":"2023-10-25T16:13:09.478001+0000","last_undegraded":"2023-10-25T16:13:09.478001+0000","last_fullsized":"2023-10-25T16:13:09.478001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545728+0000","last_change":"2023-10-25T16:13:07.576400+0000","last_active":"2023-10-25T16:13:08.545728+0000","last_peered":"2023-10-25T16:13:08.545728+0000","last_clean":"2023-10-25T16:13:08.545728+0000","last_became_active":"2023-10-25T16:13:07.575767+0000","last_became_peered":"2023-10-25T16:13:07.575767+0000","last_unstale":"2023-10-25T16:13:08.545728+0000","last_undegraded":"2023-10-25T16:13:08.545728+0000","last_fullsized":"2023-10-25T16:13:08.545728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586210+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:06.586210+0000","last_peered":"2023-10-25T16:13:06.586210+0000","last_clean":"2023-10-25T16:13:06.586210+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:06.586210+0000","last_undegraded":"2023-10-25T16:13:06.586210+0000","last_fullsized":"2023-10-25T16:13:06.586210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:13.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541794+0000","last_change":"2023-10-25T16:13:07.587447+0000","last_active":"2023-10-25T16:13:08.541794+0000","last_peered":"2023-10-25T16:13:08.541794+0000","last_clean":"2023-10-25T16:13:08.541794+0000","last_became_active":"2023-10-25T16:13:07.586850+0000","last_became_peered":"2023-10-25T16:13:07.586850+0000","last_unstale":"2023-10-25T16:13:08.541794+0000","last_undegraded":"2023-10-25T16:13:08.541794+0000","last_fullsized":"2023-10-25T16:13:08.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.549368+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:13:07.549368+0000","last_peered":"2023-10-25T16:13:07.549368+0000","last_clean":"2023-10-25T16:13:07.549368+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:13:07.549368+0000","last_undegraded":"2023-10-25T16:13:07.549368+0000","last_fullsized":"2023-10-25T16:13:07.549368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546669+0000","last_change":"2023-10-25T16:13:06.587408+0000","last_active":"2023-10-25T16:13:08.546669+0000","last_peered":"2023-10-25T16:13:08.546669+0000","last_clean":"2023-10-25T16:13:08.546669+0000","last_became_active":"2023-10-25T16:13:06.586522+0000","last_became_peered":"2023-10-25T16:13:06.586522+0000","last_unstale":"2023-10-25T16:13:08.546669+0000","last_undegraded":"2023-10-25T16:13:08.546669+0000","last_fullsized":"2023-10-25T16:13:08.546669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:38.279671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479511+0000","last_change":"2023-10-25T16:13:07.576734+0000","last_active":"2023-10-25T16:13:09.479511+0000","last_peered":"2023-10-25T16:13:09.479511+0000","last_clean":"2023-10-25T16:13:09.479511+0000","last_became_active":"2023-10-25T16:13:07.575887+0000","last_became_peered":"2023-10-25T16:13:07.575887+0000","last_unstale":"2023-10-25T16:13:09.479511+0000","last_undegraded":"2023-10-25T16:13:09.479511+0000","last_fullsized":"2023-10-25T16:13:09.479511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541705+0000","last_change":"2023-10-25T16:13:06.603271+0000","last_active":"2023-10-25T16:13:08.541705+0000","last_peered":"2023-10-25T16:13:08.541705+0000","last_clean":"2023-10-25T16:13:08.541705+0000","last_became_active":"2023-10-25T16:13:06.602179+0000","last_became_peered":"2023-10-25T16:13:06.602179+0000","last_unstale":"2023-10-25T16:13:08.541705+0000","last_undegraded":"2023-10-25T16:13:08.541705+0000","last_fullsized":"2023-10-25T16:13:08.541705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479260+0000","last_change":"2023-10-25T16:13:07.563801+0000","last_active":"2023-10-25T16:13:09.479260+0000","last_peered":"2023-10-25T16:13:09.479260+0000","last_clean":"2023-10-25T16:13:09.479260+0000","last_became_active":"2023-10-25T16:13:07.561818+0000","last_became_peered":"2023-10-25T16:13:07.561818+0000","last_unstale":"2023-10-25T16:13:09.479260+0000","last_undegraded":"2023-10-25T16:13:09.479260+0000","last_fullsized":"2023-10-25T16:13:09.479260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586156+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:06.586156+0000","last_peered":"2023-10-25T16:13:06.586156+0000","last_clean":"2023-10-25T16:13:06.586156+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:06.586156+0000","last_undegraded":"2023-10-25T16:13:06.586156+0000","last_fullsized":"2023-10-25T16:13:06.586156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479843+0000","last_change":"2023-10-25T16:13:07.559564+0000","last_active":"2023-10-25T16:13:09.479843+0000","last_peered":"2023-10-25T16:13:09.479843+0000","last_clean":"2023-10-25T16:13:09.479843+0000","last_became_active":"2023-10-25T16:13:07.558584+0000","last_became_peered":"2023-10-25T16:13:07.558584+0000","last_unstale":"2023-10-25T16:13:09.479843+0000","last_undegraded":"2023-10-25T16:13:09.479843+0000","last_fullsized":"2023-10-25T16:13:09.479843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546149+0000","last_change":"2023-10-25T16:13:06.583922+0000","last_active":"2023-10-25T16:13:08.546149+0000","last_peered":"2023-10-25T16:13:08.546149+0000","last_clean":"2023-10-25T16:13:08.546149+0000","last_became_active":"2023-10-25T16:13:06.581997+0000","last_became_peered":"2023-10-25T16:13:06.581997+0000","last_unstale":"2023-10-25T16:13:08.546149+0000","last_undegraded":"2023-10-25T16:13:08.546149+0000","last_fullsized":"2023-10-25T16:13:08.546149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185545+0000","last_change":"2023-10-25T16:13:07.560270+0000","last_active":"2023-10-25T16:13:09.185545+0000","last_peered":"2023-10-25T16:13:09.185545+0000","last_clean":"2023-10-25T16:13:09.185545+0000","last_became_active":"2023-10-25T16:13:07.559551+0000","last_became_peered":"2023-10-25T16:13:07.559551+0000","last_unstale":"2023-10-25T16:13:09.185545+0000","last_undegraded":"2023-10-25T16:13:09.185545+0000","last_fullsized":"2023-10-25T16:13:09.185545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:19.572019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478513+0000","last_change":"2023-10-25T16:13:06.588392+0000","last_active":"2023-10-25T16:13:09.478513+0000","last_peered":"2023-10-25T16:13:09.478513+0000","last_clean":"2023-10-25T16:13:09.478513+0000","last_became_active":"2023-10-25T16:13:06.588114+0000","last_became_peered":"2023-10-25T16:13:06.588114+0000","last_unstale":"2023-10-25T16:13:09.478513+0000","last_undegraded":"2023-10-25T16:13:09.478513+0000","last_fullsized":"2023-10-25T16:13:09.478513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545216+0000","last_change":"2023-10-25T16:13:07.563744+0000","last_active":"2023-10-25T16:13:08.545216+0000","last_peered":"2023-10-25T16:13:08.545216+0000","last_clean":"2023-10-25T16:13:08.545216+0000","last_became_active":"2023-10-25T16:13:07.563027+0000","last_became_peered":"2023-10-25T16:13:07.563027+0000","last_unstale":"2023-10-25T16:13:08.545216+0000","last_undegraded":"2023-10-25T16:13:08.545216+0000","last_fullsized":"2023-10-25T16:13:08.545216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541562+0000","last_change":"2023-10-25T16:13:06.604452+0000","last_active":"2023-10-25T16:13:08.541562+0000","last_peered":"2023-10-25T16:13:08.541562+0000","last_clean":"2023-10-25T16:13:08.541562+0000","last_became_active":"2023-10-25T16:13:06.603857+0000","last_became_peered":"2023-10-25T16:13:06.603857+0000","last_unstale":"2023-10-25T16:13:08.541562+0000","last_undegraded":"2023-10-25T16:13:08.541562+0000","last_fullsized":"2023-10-25T16:13:08.541562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477752+0000","last_change":"2023-10-25T16:13:07.555525+0000","last_active":"2023-10-25T16:13:09.477752+0000","last_peered":"2023-10-25T16:13:09.477752+0000","last_clean":"2023-10-25T16:13:09.477752+0000","last_became_active":"2023-10-25T16:13:07.554924+0000","last_became_peered":"2023-10-25T16:13:07.554924+0000","last_unstale":"2023-10-25T16:13:09.477752+0000","last_undegraded":"2023-10-25T16:13:09.477752+0000","last_fullsized":"2023-10-25T16:13:09.477752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480571+0000","last_change":"2023-10-25T16:13:06.588519+0000","last_active":"2023-10-25T16:13:09.480571+0000","last_peered":"2023-10-25T16:13:09.480571+0000","last_clean":"2023-10-25T16:13:09.480571+0000","last_became_active":"2023-10-25T16:13:06.587754+0000","last_became_peered":"2023-10-25T16:13:06.587754+0000","last_unstale":"2023-10-25T16:13:09.480571+0000","last_undegraded":"2023-10-25T16:13:09.480571+0000","last_fullsized":"2023-10-25T16:13:09.480571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479179+0000","last_change":"2023-10-25T16:13:07.577983+0000","last_active":"2023-10-25T16:13:09.479179+0000","last_peered":"2023-10-25T16:13:09.479179+0000","last_clean":"2023-10-25T16:13:09.479179+0000","last_became_active":"2023-10-25T16:13:07.577344+0000","last_became_peered":"2023-10-25T16:13:07.577344+0000","last_unstale":"2023-10-25T16:13:09.479179+0000","last_undegraded":"2023-10-25T16:13:09.479179+0000","last_fullsized":"2023-10-25T16:13:09.479179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464626+0000","last_change":"2023-10-25T16:13:06.595499+0000","last_active":"2023-10-25T16:13:09.464626+0000","last_peered":"2023-10-25T16:13:09.464626+0000","last_clean":"2023-10-25T16:13:09.464626+0000","last_became_active":"2023-10-25T16:13:06.594639+0000","last_became_peered":"2023-10-25T16:13:06.594639+0000","last_unstale":"2023-10-25T16:13:09.464626+0000","last_undegraded":"2023-10-25T16:13:09.464626+0000","last_fullsized":"2023-10-25T16:13:09.464626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478650+0000","last_change":"2023-10-25T16:13:07.568153+0000","last_active":"2023-10-25T16:13:09.478650+0000","last_peered":"2023-10-25T16:13:09.478650+0000","last_clean":"2023-10-25T16:13:09.478650+0000","last_became_active":"2023-10-25T16:13:07.567204+0000","last_became_peered":"2023-10-25T16:13:07.567204+0000","last_unstale":"2023-10-25T16:13:09.478650+0000","last_undegraded":"2023-10-25T16:13:09.478650+0000","last_fullsized":"2023-10-25T16:13:09.478650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542227+0000","last_change":"2023-10-25T16:13:06.605135+0000","last_active":"2023-10-25T16:13:08.542227+0000","last_peered":"2023-10-25T16:13:08.542227+0000","last_clean":"2023-10-25T16:13:08.542227+0000","last_became_active":"2023-10-25T16:13:06.604117+0000","last_became_peered":"2023-10-25T16:13:06.604117+0000","last_unstale":"2023-10-25T16:13:08.542227+0000","last_undegraded":"2023-10-25T16:13:08.542227+0000","last_fullsized":"2023-10-25T16:13:08.542227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186211+0000","last_change":"2023-10-25T16:13:07.570460+0000","last_active":"2023-10-25T16:13:09.186211+0000","last_peered":"2023-10-25T16:13:09.186211+0000","last_clean":"2023-10-25T16:13:09.186211+0000","last_became_active":"2023-10-25T16:13:07.565363+0000","last_became_peered":"2023-10-25T16:13:07.565363+0000","last_unstale":"2023-10-25T16:13:09.186211+0000","last_undegraded":"2023-10-25T16:13:09.186211+0000","last_fullsized":"2023-10-25T16:13:09.186211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:45.620922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478298+0000","last_change":"2023-10-25T16:13:06.607078+0000","last_active":"2023-10-25T16:13:09.478298+0000","last_peered":"2023-10-25T16:13:09.478298+0000","last_clean":"2023-10-25T16:13:09.478298+0000","last_became_active":"2023-10-25T16:13:06.606881+0000","last_became_peered":"2023-10-25T16:13:06.606881+0000","last_unstale":"2023-10-25T16:13:09.478298+0000","last_undegraded":"2023-10-25T16:13:09.478298+0000","last_fullsized":"2023-10-25T16:13:09.478298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480464+0000","last_change":"2023-10-25T16:13:07.546555+0000","last_active":"2023-10-25T16:13:09.480464+0000","last_peered":"2023-10-25T16:13:09.480464+0000","last_clean":"2023-10-25T16:13:09.480464+0000","last_became_active":"2023-10-25T16:13:07.545944+0000","last_became_peered":"2023-10-25T16:13:07.545944+0000","last_unstale":"2023-10-25T16:13:09.480464+0000","last_undegraded":"2023-10-25T16:13:09.480464+0000","last_fullsized":"2023-10-25T16:13:09.480464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480051+0000","last_change":"2023-10-25T16:13:06.589243+0000","last_active":"2023-10-25T16:13:09.480051+0000","last_peered":"2023-10-25T16:13:09.480051+0000","last_clean":"2023-10-25T16:13:09.480051+0000","last_became_active":"2023-10-25T16:13:06.588343+0000","last_became_peered":"2023-10-25T16:13:06.588343+0000","last_unstale":"2023-10-25T16:13:09.480051+0000","last_undegraded":"2023-10-25T16:13:09.480051+0000","last_fullsized":"2023-10-25T16:13:09.480051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480990+0000","last_change":"2023-10-25T16:13:07.569083+0000","last_active":"2023-10-25T16:13:09.480990+0000","last_peered":"2023-10-25T16:13:09.480990+0000","last_clean":"2023-10-25T16:13:09.480990+0000","last_became_active":"2023-10-25T16:13:07.562504+0000","last_became_peered":"2023-10-25T16:13:07.562504+0000","last_unstale":"2023-10-25T16:13:09.480990+0000","last_undegraded":"2023-10-25T16:13:09.480990+0000","last_fullsized":"2023-10-25T16:13:09.480990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541587+0000","last_change":"2023-10-25T16:13:06.603385+0000","last_active":"2023-10-25T16:13:08.541587+0000","last_peered":"2023-10-25T16:13:08.541587+0000","last_clean":"2023-10-25T16:13:08.541587+0000","last_became_active":"2023-10-25T16:13:06.602760+0000","last_became_peered":"2023-10-25T16:13:06.602760+0000","last_unstale":"2023-10-25T16:13:08.541587+0000","last_undegraded":"2023-10-25T16:13:08.541587+0000","last_fullsized":"2023-10-25T16:13:08.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:55.025836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464180+0000","last_change":"2023-10-25T16:13:07.569746+0000","last_active":"2023-10-25T16:13:09.464180+0000","last_peered":"2023-10-25T16:13:09.464180+0000","last_clean":"2023-10-25T16:13:09.464180+0000","last_became_active":"2023-10-25T16:13:07.568518+0000","last_became_peered":"2023-10-25T16:13:07.568518+0000","last_unstale":"2023-10-25T16:13:09.464180+0000","last_undegraded":"2023-10-25T16:13:09.464180+0000","last_fullsized":"2023-10-25T16:13:09.464180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545306+0000","last_change":"2023-10-25T16:13:07.576112+0000","last_active":"2023-10-25T16:13:08.545306+0000","last_peered":"2023-10-25T16:13:08.545306+0000","last_clean":"2023-10-25T16:13:08.545306+0000","last_became_active":"2023-10-25T16:13:07.574201+0000","last_became_peered":"2023-10-25T16:13:07.574201+0000","last_unstale":"2023-10-25T16:13:08.545306+0000","last_undegraded":"2023-10-25T16:13:08.545306+0000","last_fullsized":"2023-10-25T16:13:08.545306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542101+0000","last_change":"2023-10-25T16:13:06.604712+0000","last_active":"2023-10-25T16:13:08.542101+0000","last_peered":"2023-10-25T16:13:08.542101+0000","last_clean":"2023-10-25T16:13:08.542101+0000","last_became_active":"2023-10-25T16:13:06.602850+0000","last_became_peered":"2023-10-25T16:13:06.602850+0000","last_unstale":"2023-10-25T16:13:08.542101+0000","last_undegraded":"2023-10-25T16:13:08.542101+0000","last_fullsized":"2023-10-25T16:13:08.542101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545831+0000","last_change":"2023-10-25T16:13:07.585084+0000","last_active":"2023-10-25T16:13:08.545831+0000","last_peered":"2023-10-25T16:13:08.545831+0000","last_clean":"2023-10-25T16:13:08.545831+0000","last_became_active":"2023-10-25T16:13:07.582955+0000","last_became_peered":"2023-10-25T16:13:07.582955+0000","last_unstale":"2023-10-25T16:13:08.545831+0000","last_undegraded":"2023-10-25T16:13:08.545831+0000","last_fullsized":"2023-10-25T16:13:08.545831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542584+0000","last_change":"2023-10-25T16:13:06.606358+0000","last_active":"2023-10-25T16:13:08.542584+0000","last_peered":"2023-10-25T16:13:08.542584+0000","last_clean":"2023-10-25T16:13:08.542584+0000","last_became_active":"2023-10-25T16:13:06.602334+0000","last_became_peered":"2023-10-25T16:13:06.602334+0000","last_unstale":"2023-10-25T16:13:08.542584+0000","last_undegraded":"2023-10-25T16:13:08.542584+0000","last_fullsized":"2023-10-25T16:13:08.542584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478959+0000","last_change":"2023-10-25T16:13:07.566273+0000","last_active":"2023-10-25T16:13:09.478959+0000","last_peered":"2023-10-25T16:13:09.478959+0000","last_clean":"2023-10-25T16:13:09.478959+0000","last_became_active":"2023-10-25T16:13:07.562676+0000","last_became_peered":"2023-10-25T16:13:07.562676+0000","last_unstale":"2023-10-25T16:13:09.478959+0000","last_undegraded":"2023-10-25T16:13:09.478959+0000","last_fullsized":"2023-10-25T16:13:09.478959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480470+0000","last_change":"2023-10-25T16:13:06.594182+0000","last_active":"2023-10-25T16:13:09.480470+0000","last_peered":"2023-10-25T16:13:09.480470+0000","last_clean":"2023-10-25T16:13:09.480470+0000","last_became_active":"2023-10-25T16:13:06.592991+0000","last_became_peered":"2023-10-25T16:13:06.592991+0000","last_unstale":"2023-10-25T16:13:09.480470+0000","last_undegraded":"2023-10-25T16:13:09.480470+0000","last_fullsized":"2023-10-25T16:13:09.480470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480226+0000","last_change":"2023-10-25T16:13:07.564149+0000","last_active":"2023-10-25T16:13:09.480226+0000","last_peered":"2023-10-25T16:13:09.480226+0000","last_clean":"2023-10-25T16:13:09.480226+0000","last_became_active":"2023-10-25T16:13:07.561630+0000","last_became_peered":"2023-10-25T16:13:07.561630+0000","last_unstale":"2023-10-25T16:13:09.480226+0000","last_undegraded":"2023-10-25T16:13:09.480226+0000","last_fullsized":"2023-10-25T16:13:09.480226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479489+0000","last_change":"2023-10-25T16:13:06.603850+0000","last_active":"2023-10-25T16:13:09.479489+0000","last_peered":"2023-10-25T16:13:09.479489+0000","last_clean":"2023-10-25T16:13:09.479489+0000","last_became_active":"2023-10-25T16:13:06.603106+0000","last_became_peered":"2023-10-25T16:13:06.603106+0000","last_unstale":"2023-10-25T16:13:09.479489+0000","last_undegraded":"2023-10-25T16:13:09.479489+0000","last_fullsized":"2023-10-25T16:13:09.479489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937930,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3919999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931029,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199930995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340149,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1029999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2320000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1219999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1349999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.891999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:11.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-25T16:13:11.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:13:06.568213+0000', 'last_change': '2023-10-25T16:13:06.568213+0000', 'last_active': '2023-10-25T16:13:06.555563+0000', 'last_peered': '2023-10-25T16:13:06.555563+0000', 'last_clean': '2023-10-25T16:13:06.555563+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:13:06.568213+0000', 'last_undegraded': '2023-10-25T16:13:06.568213+0000', 'last_fullsized': '2023-10-25T16:13:06.568213+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:13:06.555563+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:13:06.555563+0000', 'last_clean_scrub_stamp': '2023-10-25T16:13:06.555563+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:13:11.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-25T16:13:11.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:13:06.567411+0000', 'last_change': '2023-10-25T16:13:06.567411+0000', 'last_active': '2023-10-25T16:13:06.555563+0000', 'last_peered': '2023-10-25T16:13:06.555563+0000', 'last_clean': '2023-10-25T16:13:06.555563+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:13:06.567411+0000', 'last_undegraded': '2023-10-25T16:13:06.567411+0000', 'last_fullsized': '2023-10-25T16:13:06.567411+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:13:06.555563+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:13:06.555563+0000', 'last_clean_scrub_stamp': '2023-10-25T16:13:06.555563+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:13:11.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:13:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 -- 172.21.15.177:0/2985281921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 msgr2=0x7f3a200af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 --2- 172.21.15.177:0/2985281921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a200af5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009920 tx=0x7f3a1401c860 comp rx=0 tx=0).stop 2023-10-25T16:13:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 -- 172.21.15.177:0/2985281921 shutdown_connections 2023-10-25T16:13:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 --2- 172.21.15.177:0/2985281921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a200af5d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 -- 172.21.15.177:0/2985281921 >> 172.21.15.177:0/2985281921 conn(0x7f3a200b2450 msgr2=0x7f3a200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 -- 172.21.15.177:0/2985281921 shutdown_connections 2023-10-25T16:13:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 -- 172.21.15.177:0/2985281921 wait complete. 2023-10-25T16:13:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 Processor -- start 2023-10-25T16:13:11.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.439+0000 7f3a2722e640 1 -- start start 2023-10-25T16:13:11.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a20070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a2015b710 0x7f3a200ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a2015c3a0 0x7f3a200acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20126990 con 0x7f3a2013d8f0 2023-10-25T16:13:11.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20125ff0 con 0x7f3a2015b710 2023-10-25T16:13:11.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a201262d0 con 0x7f3a2015c3a0 2023-10-25T16:13:11.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a20070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a20070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43378/0 (socket says 172.21.15.177:43378) 2023-10-25T16:13:11.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 -- 172.21.15.177:0/390279858 learned_addr learned my addr 172.21.15.177:0/390279858 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:11.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1ffff640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a2015b710 0x7f3a200ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 -- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a2015c3a0 msgr2=0x7f3a200acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a2015c3a0 0x7f3a200acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 -- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a2015b710 msgr2=0x7f3a200ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a2015b710 0x7f3a200ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 -- 172.21.15.177:0/390279858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14009500 con 0x7f3a2013d8f0 2023-10-25T16:13:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a24fca640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a20070c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c450 tx=0x7f3a1000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10012830 con 0x7f3a2013d8f0 2023-10-25T16:13:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3a10012aa0 con 0x7f3a2013d8f0 2023-10-25T16:13:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a201265b0 con 0x7f3a2013d8f0 2023-10-25T16:13:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10011380 con 0x7f3a2013d8f0 2023-10-25T16:13:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a20071350 con 0x7f3a2013d8f0 2023-10-25T16:13:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2013d760 con 0x7f3a2013d8f0 2023-10-25T16:13:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a100114e0 con 0x7f3a2013d8f0 2023-10-25T16:13:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1d7fa640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a0c066470 0x7f3a0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a10083f90 con 0x7f3a2013d8f0 2023-10-25T16:13:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.443+0000 7f3a1ffff640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a0c066470 0x7f3a0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.447+0000 7f3a1ffff640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a0c066470 0x7f3a0c068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a140af000 tx=0x7f3a1401b0a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.447+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a100b5090 con 0x7f3a2013d8f0 2023-10-25T16:13:11.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.659+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3a2004daf0 con 0x7f3a2013d8f0 2023-10-25T16:13:11.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.659+0000 7f3a1d7fa640 1 -- 172.21.15.177:0/390279858 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1092 (secure 0 0 0) 0x7f3a100514a0 con 0x7f3a2013d8f0 2023-10-25T16:13:11.663 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":22,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"creating+peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592778,"bytes_used":1742141,"bytes_avail":1598257859,"bytes_total":1600000000,"inactive_pgs_ratio":0.020618556067347527,"write_bytes_sec":2847,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":154145}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-25T16:12:47.822807+0000","services":{}},"progress_events":{}} 2023-10-25T16:13:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.659+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a0c066470 msgr2=0x7f3a0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.659+0000 7f3a2722e640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a0c066470 0x7f3a0c068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a140af000 tx=0x7f3a1401b0a0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 msgr2=0x7f3a20070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a20070c40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c450 tx=0x7f3a1000c910 comp rx=0 tx=0).stop 2023-10-25T16:13:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 shutdown_connections 2023-10-25T16:13:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a0c066470 0x7f3a0c068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a2015c3a0 0x7f3a200acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a2015b710 0x7f3a200ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 --2- 172.21.15.177:0/390279858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a2013d8f0 0x7f3a20070c40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 >> 172.21.15.177:0/390279858 conn(0x7f3a200b2450 msgr2=0x7f3a2013cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:11.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 shutdown_connections 2023-10-25T16:13:11.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.663+0000 7f3a2722e640 1 -- 172.21.15.177:0/390279858 wait complete. 2023-10-25T16:13:11.680 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:13:11.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:11.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- 172.21.15.177:0/1484129291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e580cea30 msgr2=0x7f4e580cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 --2- 172.21.15.177:0/1484129291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e580cea30 0x7f4e580cca00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009c80 tx=0x7f4e4c01cd50 comp rx=0 tx=0).stop 2023-10-25T16:13:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- 172.21.15.177:0/1484129291 shutdown_connections 2023-10-25T16:13:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 --2- 172.21.15.177:0/1484129291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e580cea30 0x7f4e580cca00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 --2- 172.21.15.177:0/1484129291 >> v2:172.21.15.184:3300/0 conn(0x7f4e58142c90 0x7f4e5815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- 172.21.15.177:0/1484129291 >> 172.21.15.177:0/1484129291 conn(0x7f4e580cdf10 msgr2=0x7f4e580ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- 172.21.15.177:0/1484129291 shutdown_connections 2023-10-25T16:13:11.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- 172.21.15.177:0/1484129291 wait complete. 2023-10-25T16:13:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 Processor -- start 2023-10-25T16:13:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- start start 2023-10-25T16:13:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e580ccf40 0x7f4e58141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 0x7f4e58158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e58142c90 0x7f4e58156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581386d0 con 0x7f4e580cea30 2023-10-25T16:13:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581585a0 con 0x7f4e580ccf40 2023-10-25T16:13:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5f713640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58158840 con 0x7f4e58142c90 2023-10-25T16:13:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 0x7f4e58158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 0x7f4e58158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43386/0 (socket says 172.21.15.177:43386) 2023-10-25T16:13:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 -- 172.21.15.177:0/3899624090 learned_addr learned my addr 172.21.15.177:0/3899624090 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5d4af640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e580ccf40 0x7f4e58141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5dcb0640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e58142c90 0x7f4e58156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 -- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e58142c90 msgr2=0x7f4e58156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e58142c90 0x7f4e58156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 -- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e580ccf40 msgr2=0x7f4e58141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e580ccf40 0x7f4e58141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 -- 172.21.15.177:0/3899624090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0098e0 con 0x7f4e580cea30 2023-10-25T16:13:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5d4af640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e580ccf40 0x7f4e58141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.787+0000 7f4e5ccae640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 0x7f4e58158060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c000f90 tx=0x7f4e4c0ae6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c003d90 con 0x7f4e580cea30 2023-10-25T16:13:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e4c0ae8a0 con 0x7f4e580cea30 2023-10-25T16:13:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e58138920 con 0x7f4e580cea30 2023-10-25T16:13:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0aec50 con 0x7f4e580cea30 2023-10-25T16:13:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e58138ee0 con 0x7f4e580cea30 2023-10-25T16:13:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e58139100 con 0x7f4e580cea30 2023-10-25T16:13:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e4c0b4040 con 0x7f4e580cea30 2023-10-25T16:13:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e55ffb640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e44066470 0x7f4e44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e4c11f050 con 0x7f4e580cea30 2023-10-25T16:13:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e5d4af640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e44066470 0x7f4e44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.791+0000 7f4e5d4af640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e44066470 0x7f4e44068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e5813e320 tx=0x7f4e480091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:11.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.795+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e4c0ec6f0 con 0x7f4e580cea30 2023-10-25T16:13:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.935+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e5804daf0 con 0x7f4e44066470 2023-10-25T16:13:11.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.955+0000 7f4e55ffb640 1 -- 172.21.15.177:0/3899624090 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259944 (secure 0 0 0) 0x7f4e5804daf0 con 0x7f4e44066470 2023-10-25T16:13:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:11.964 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:11.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e44066470 msgr2=0x7f4e44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e44066470 0x7f4e44068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4e5813e320 tx=0x7f4e480091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 msgr2=0x7f4e58158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:11.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 0x7f4e58158060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c000f90 tx=0x7f4e4c0ae6b0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 shutdown_connections 2023-10-25T16:13:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e44066470 0x7f4e44068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e58142c90 0x7f4e58156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e580cea30 0x7f4e58158060 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 --2- 172.21.15.177:0/3899624090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e580ccf40 0x7f4e58141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 >> 172.21.15.177:0/3899624090 conn(0x7f4e580cdf10 msgr2=0x7f4e5813e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 shutdown_connections 2023-10-25T16:13:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:11.959+0000 7f4e5f713640 1 -- 172.21.15.177:0/3899624090 wait complete. 2023-10-25T16:13:11.979 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-25T16:13:10.592770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560798,"statfs":{"total":1600000000,"available":1598257859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.034701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541423+0000","last_change":"2023-10-25T16:13:07.579322+0000","last_active":"2023-10-25T16:13:08.541423+0000","last_peered":"2023-10-25T16:13:08.541423+0000","last_clean":"2023-10-25T16:13:08.541423+0000","last_became_active":"2023-10-25T16:13:07.566613+0000","last_became_peered":"2023-10-25T16:13:07.566613+0000","last_unstale":"2023-10-25T16:13:08.541423+0000","last_undegraded":"2023-10-25T16:13:08.541423+0000","last_fullsized":"2023-10-25T16:13:08.541423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477996+0000","last_change":"2023-10-25T16:13:07.553120+0000","last_active":"2023-10-25T16:13:09.477996+0000","last_peered":"2023-10-25T16:13:09.477996+0000","last_clean":"2023-10-25T16:13:09.477996+0000","last_became_active":"2023-10-25T16:13:07.551990+0000","last_became_peered":"2023-10-25T16:13:07.551990+0000","last_unstale":"2023-10-25T16:13:09.477996+0000","last_undegraded":"2023-10-25T16:13:09.477996+0000","last_fullsized":"2023-10-25T16:13:09.477996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478313+0000","last_change":"2023-10-25T16:13:07.563333+0000","last_active":"2023-10-25T16:13:09.478313+0000","last_peered":"2023-10-25T16:13:09.478313+0000","last_clean":"2023-10-25T16:13:09.478313+0000","last_became_active":"2023-10-25T16:13:07.560920+0000","last_became_peered":"2023-10-25T16:13:07.560920+0000","last_unstale":"2023-10-25T16:13:09.478313+0000","last_undegraded":"2023-10-25T16:13:09.478313+0000","last_fullsized":"2023-10-25T16:13:09.478313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544460+0000","last_change":"2023-10-25T16:13:07.567528+0000","last_active":"2023-10-25T16:13:08.544460+0000","last_peered":"2023-10-25T16:13:08.544460+0000","last_clean":"2023-10-25T16:13:08.544460+0000","last_became_active":"2023-10-25T16:13:07.566685+0000","last_became_peered":"2023-10-25T16:13:07.566685+0000","last_unstale":"2023-10-25T16:13:08.544460+0000","last_undegraded":"2023-10-25T16:13:08.544460+0000","last_fullsized":"2023-10-25T16:13:08.544460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541668+0000","last_change":"2023-10-25T16:13:07.579075+0000","last_active":"2023-10-25T16:13:08.541668+0000","last_peered":"2023-10-25T16:13:08.541668+0000","last_clean":"2023-10-25T16:13:08.541668+0000","last_became_active":"2023-10-25T16:13:07.567451+0000","last_became_peered":"2023-10-25T16:13:07.567451+0000","last_unstale":"2023-10-25T16:13:08.541668+0000","last_undegraded":"2023-10-25T16:13:08.541668+0000","last_fullsized":"2023-10-25T16:13:08.541668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545497+0000","last_change":"2023-10-25T16:13:07.585648+0000","last_active":"2023-10-25T16:13:08.545497+0000","last_peered":"2023-10-25T16:13:08.545497+0000","last_clean":"2023-10-25T16:13:08.545497+0000","last_became_active":"2023-10-25T16:13:07.583670+0000","last_became_peered":"2023-10-25T16:13:07.583670+0000","last_unstale":"2023-10-25T16:13:08.545497+0000","last_undegraded":"2023-10-25T16:13:08.545497+0000","last_fullsized":"2023-10-25T16:13:08.545497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541701+0000","last_change":"2023-10-25T16:13:07.581287+0000","last_active":"2023-10-25T16:13:08.541701+0000","last_peered":"2023-10-25T16:13:08.541701+0000","last_clean":"2023-10-25T16:13:08.541701+0000","last_became_active":"2023-10-25T16:13:07.577390+0000","last_became_peered":"2023-10-25T16:13:07.577390+0000","last_unstale":"2023-10-25T16:13:08.541701+0000","last_undegraded":"2023-10-25T16:13:08.541701+0000","last_fullsized":"2023-10-25T16:13:08.541701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477246+0000","last_change":"2023-10-25T16:13:07.569496+0000","last_active":"2023-10-25T16:13:09.477246+0000","last_peered":"2023-10-25T16:13:09.477246+0000","last_clean":"2023-10-25T16:13:09.477246+0000","last_became_active":"2023-10-25T16:13:07.563950+0000","last_became_peered":"2023-10-25T16:13:07.563950+0000","last_unstale":"2023-10-25T16:13:09.477246+0000","last_undegraded":"2023-10-25T16:13:09.477246+0000","last_fullsized":"2023-10-25T16:13:09.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541010+0000","last_change":"2023-10-25T16:13:07.577965+0000","last_active":"2023-10-25T16:13:08.541010+0000","last_peered":"2023-10-25T16:13:08.541010+0000","last_clean":"2023-10-25T16:13:08.541010+0000","last_became_active":"2023-10-25T16:13:07.576892+0000","last_became_peered":"2023-10-25T16:13:07.576892+0000","last_unstale":"2023-10-25T16:13:08.541010+0000","last_undegraded":"2023-10-25T16:13:08.541010+0000","last_fullsized":"2023-10-25T16:13:08.541010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464171+0000","last_change":"2023-10-25T16:13:07.561076+0000","last_active":"2023-10-25T16:13:09.464171+0000","last_peered":"2023-10-25T16:13:09.464171+0000","last_clean":"2023-10-25T16:13:09.464171+0000","last_became_active":"2023-10-25T16:13:07.560340+0000","last_became_peered":"2023-10-25T16:13:07.560340+0000","last_unstale":"2023-10-25T16:13:09.464171+0000","last_undegraded":"2023-10-25T16:13:09.464171+0000","last_fullsized":"2023-10-25T16:13:09.464171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.463985+0000","last_change":"2023-10-25T16:13:07.585838+0000","last_active":"2023-10-25T16:13:09.463985+0000","last_peered":"2023-10-25T16:13:09.463985+0000","last_clean":"2023-10-25T16:13:09.463985+0000","last_became_active":"2023-10-25T16:13:07.585351+0000","last_became_peered":"2023-10-25T16:13:07.585351+0000","last_unstale":"2023-10-25T16:13:09.463985+0000","last_undegraded":"2023-10-25T16:13:09.463985+0000","last_fullsized":"2023-10-25T16:13:09.463985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186012+0000","last_change":"2023-10-25T16:13:07.572936+0000","last_active":"2023-10-25T16:13:09.186012+0000","last_peered":"2023-10-25T16:13:09.186012+0000","last_clean":"2023-10-25T16:13:09.186012+0000","last_became_active":"2023-10-25T16:13:07.572216+0000","last_became_peered":"2023-10-25T16:13:07.572216+0000","last_unstale":"2023-10-25T16:13:09.186012+0000","last_undegraded":"2023-10-25T16:13:09.186012+0000","last_fullsized":"2023-10-25T16:13:09.186012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:56.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480366+0000","last_change":"2023-10-25T16:13:07.567194+0000","last_active":"2023-10-25T16:13:09.480366+0000","last_peered":"2023-10-25T16:13:09.480366+0000","last_clean":"2023-10-25T16:13:09.480366+0000","last_became_active":"2023-10-25T16:13:07.561537+0000","last_became_peered":"2023-10-25T16:13:07.561537+0000","last_unstale":"2023-10-25T16:13:09.480366+0000","last_undegraded":"2023-10-25T16:13:09.480366+0000","last_fullsized":"2023-10-25T16:13:09.480366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477496+0000","last_change":"2023-10-25T16:13:07.567614+0000","last_active":"2023-10-25T16:13:09.477496+0000","last_peered":"2023-10-25T16:13:09.477496+0000","last_clean":"2023-10-25T16:13:09.477496+0000","last_became_active":"2023-10-25T16:13:07.564979+0000","last_became_peered":"2023-10-25T16:13:07.564979+0000","last_unstale":"2023-10-25T16:13:09.477496+0000","last_undegraded":"2023-10-25T16:13:09.477496+0000","last_fullsized":"2023-10-25T16:13:09.477496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:05.007750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478079+0000","last_change":"2023-10-25T16:13:07.562980+0000","last_active":"2023-10-25T16:13:09.478079+0000","last_peered":"2023-10-25T16:13:09.478079+0000","last_clean":"2023-10-25T16:13:09.478079+0000","last_became_active":"2023-10-25T16:13:07.562370+0000","last_became_peered":"2023-10-25T16:13:07.562370+0000","last_unstale":"2023-10-25T16:13:09.478079+0000","last_undegraded":"2023-10-25T16:13:09.478079+0000","last_fullsized":"2023-10-25T16:13:09.478079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545182+0000","last_change":"2023-10-25T16:13:07.587718+0000","last_active":"2023-10-25T16:13:08.545182+0000","last_peered":"2023-10-25T16:13:08.545182+0000","last_clean":"2023-10-25T16:13:08.545182+0000","last_became_active":"2023-10-25T16:13:07.584346+0000","last_became_peered":"2023-10-25T16:13:07.584346+0000","last_unstale":"2023-10-25T16:13:08.545182+0000","last_undegraded":"2023-10-25T16:13:08.545182+0000","last_fullsized":"2023-10-25T16:13:08.545182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544311+0000","last_change":"2023-10-25T16:13:07.590347+0000","last_active":"2023-10-25T16:13:08.544311+0000","last_peered":"2023-10-25T16:13:08.544311+0000","last_clean":"2023-10-25T16:13:08.544311+0000","last_became_active":"2023-10-25T16:13:07.589306+0000","last_became_peered":"2023-10-25T16:13:07.589306+0000","last_unstale":"2023-10-25T16:13:08.544311+0000","last_undegraded":"2023-10-25T16:13:08.544311+0000","last_fullsized":"2023-10-25T16:13:08.544311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.568213+0000","last_change":"2023-10-25T16:13:06.568213+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.568213+0000","last_undegraded":"2023-10-25T16:13:06.568213+0000","last_fullsized":"2023-10-25T16:13:06.568213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541426+0000","last_change":"2023-10-25T16:13:07.565774+0000","last_active":"2023-10-25T16:13:08.541426+0000","last_peered":"2023-10-25T16:13:08.541426+0000","last_clean":"2023-10-25T16:13:08.541426+0000","last_became_active":"2023-10-25T16:13:07.564671+0000","last_became_peered":"2023-10-25T16:13:07.564671+0000","last_unstale":"2023-10-25T16:13:08.541426+0000","last_undegraded":"2023-10-25T16:13:08.541426+0000","last_fullsized":"2023-10-25T16:13:08.541426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464359+0000","last_change":"2023-10-25T16:13:07.569779+0000","last_active":"2023-10-25T16:13:09.464359+0000","last_peered":"2023-10-25T16:13:09.464359+0000","last_clean":"2023-10-25T16:13:09.464359+0000","last_became_active":"2023-10-25T16:13:07.568943+0000","last_became_peered":"2023-10-25T16:13:07.568943+0000","last_unstale":"2023-10-25T16:13:09.464359+0000","last_undegraded":"2023-10-25T16:13:09.464359+0000","last_fullsized":"2023-10-25T16:13:09.464359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478818+0000","last_change":"2023-10-25T16:13:07.588566+0000","last_active":"2023-10-25T16:13:09.478818+0000","last_peered":"2023-10-25T16:13:09.478818+0000","last_clean":"2023-10-25T16:13:09.478818+0000","last_became_active":"2023-10-25T16:13:07.586975+0000","last_became_peered":"2023-10-25T16:13:07.586975+0000","last_unstale":"2023-10-25T16:13:09.478818+0000","last_undegraded":"2023-10-25T16:13:09.478818+0000","last_fullsized":"2023-10-25T16:13:09.478818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544961+0000","last_change":"2023-10-25T16:13:07.589720+0000","last_active":"2023-10-25T16:13:08.544961+0000","last_peered":"2023-10-25T16:13:08.544961+0000","last_clean":"2023-10-25T16:13:08.544961+0000","last_became_active":"2023-10-25T16:13:07.587901+0000","last_became_peered":"2023-10-25T16:13:07.587901+0000","last_unstale":"2023-10-25T16:13:08.544961+0000","last_undegraded":"2023-10-25T16:13:08.544961+0000","last_fullsized":"2023-10-25T16:13:08.544961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481296+0000","last_change":"2023-10-25T16:13:07.564523+0000","last_active":"2023-10-25T16:13:09.481296+0000","last_peered":"2023-10-25T16:13:09.481296+0000","last_clean":"2023-10-25T16:13:09.481296+0000","last_became_active":"2023-10-25T16:13:07.558883+0000","last_became_peered":"2023-10-25T16:13:07.558883+0000","last_unstale":"2023-10-25T16:13:09.481296+0000","last_undegraded":"2023-10-25T16:13:09.481296+0000","last_fullsized":"2023-10-25T16:13:09.481296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544854+0000","last_change":"2023-10-25T16:13:07.565692+0000","last_active":"2023-10-25T16:13:08.544854+0000","last_peered":"2023-10-25T16:13:08.544854+0000","last_clean":"2023-10-25T16:13:08.544854+0000","last_became_active":"2023-10-25T16:13:07.565063+0000","last_became_peered":"2023-10-25T16:13:07.565063+0000","last_unstale":"2023-10-25T16:13:08.544854+0000","last_undegraded":"2023-10-25T16:13:08.544854+0000","last_fullsized":"2023-10-25T16:13:08.544854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478118+0000","last_change":"2023-10-25T16:13:07.567029+0000","last_active":"2023-10-25T16:13:09.478118+0000","last_peered":"2023-10-25T16:13:09.478118+0000","last_clean":"2023-10-25T16:13:09.478118+0000","last_became_active":"2023-10-25T16:13:07.563753+0000","last_became_peered":"2023-10-25T16:13:07.563753+0000","last_unstale":"2023-10-25T16:13:09.478118+0000","last_undegraded":"2023-10-25T16:13:09.478118+0000","last_fullsized":"2023-10-25T16:13:09.478118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464243+0000","last_change":"2023-10-25T16:13:07.571465+0000","last_active":"2023-10-25T16:13:09.464243+0000","last_peered":"2023-10-25T16:13:09.464243+0000","last_clean":"2023-10-25T16:13:09.464243+0000","last_became_active":"2023-10-25T16:13:07.570569+0000","last_became_peered":"2023-10-25T16:13:07.570569+0000","last_unstale":"2023-10-25T16:13:09.464243+0000","last_undegraded":"2023-10-25T16:13:09.464243+0000","last_fullsized":"2023-10-25T16:13:09.464243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478333+0000","last_change":"2023-10-25T16:13:07.552675+0000","last_active":"2023-10-25T16:13:09.478333+0000","last_peered":"2023-10-25T16:13:09.478333+0000","last_clean":"2023-10-25T16:13:09.478333+0000","last_became_active":"2023-10-25T16:13:07.551113+0000","last_became_peered":"2023-10-25T16:13:07.551113+0000","last_unstale":"2023-10-25T16:13:09.478333+0000","last_undegraded":"2023-10-25T16:13:09.478333+0000","last_fullsized":"2023-10-25T16:13:09.478333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480684+0000","last_change":"2023-10-25T16:13:07.563309+0000","last_active":"2023-10-25T16:13:09.480684+0000","last_peered":"2023-10-25T16:13:09.480684+0000","last_clean":"2023-10-25T16:13:09.480684+0000","last_became_active":"2023-10-25T16:13:07.556854+0000","last_became_peered":"2023-10-25T16:13:07.556854+0000","last_unstale":"2023-10-25T16:13:09.480684+0000","last_undegraded":"2023-10-25T16:13:09.480684+0000","last_fullsized":"2023-10-25T16:13:09.480684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481261+0000","last_change":"2023-10-25T16:13:07.563614+0000","last_active":"2023-10-25T16:13:09.481261+0000","last_peered":"2023-10-25T16:13:09.481261+0000","last_clean":"2023-10-25T16:13:09.481261+0000","last_became_active":"2023-10-25T16:13:07.562379+0000","last_became_peered":"2023-10-25T16:13:07.562379+0000","last_unstale":"2023-10-25T16:13:09.481261+0000","last_undegraded":"2023-10-25T16:13:09.481261+0000","last_fullsized":"2023-10-25T16:13:09.481261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544963+0000","last_change":"2023-10-25T16:13:07.575589+0000","last_active":"2023-10-25T16:13:08.544963+0000","last_peered":"2023-10-25T16:13:08.544963+0000","last_clean":"2023-10-25T16:13:08.544963+0000","last_became_active":"2023-10-25T16:13:07.569050+0000","last_became_peered":"2023-10-25T16:13:07.569050+0000","last_unstale":"2023-10-25T16:13:08.544963+0000","last_undegraded":"2023-10-25T16:13:08.544963+0000","last_fullsized":"2023-10-25T16:13:08.544963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2023-10-25T16:13:06.567411+0000","last_change":"2023-10-25T16:13:06.567411+0000","last_active":"2023-10-25T16:13:06.555563+0000","last_peered":"2023-10-25T16:13:06.555563+0000","last_clean":"2023-10-25T16:13:06.555563+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:13:06.567411+0000","last_undegraded":"2023-10-25T16:13:06.567411+0000","last_fullsized":"2023-10-25T16:13:06.567411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464294+0000","last_change":"2023-10-25T16:13:07.571634+0000","last_active":"2023-10-25T16:13:09.464294+0000","last_peered":"2023-10-25T16:13:09.464294+0000","last_clean":"2023-10-25T16:13:09.464294+0000","last_became_active":"2023-10-25T16:13:07.570373+0000","last_became_peered":"2023-10-25T16:13:07.570373+0000","last_unstale":"2023-10-25T16:13:09.464294+0000","last_undegraded":"2023-10-25T16:13:09.464294+0000","last_fullsized":"2023-10-25T16:13:09.464294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185835+0000","last_change":"2023-10-25T16:13:07.554976+0000","last_active":"2023-10-25T16:13:09.185835+0000","last_peered":"2023-10-25T16:13:09.185835+0000","last_clean":"2023-10-25T16:13:09.185835+0000","last_became_active":"2023-10-25T16:13:07.554311+0000","last_became_peered":"2023-10-25T16:13:07.554311+0000","last_unstale":"2023-10-25T16:13:09.185835+0000","last_undegraded":"2023-10-25T16:13:09.185835+0000","last_fullsized":"2023-10-25T16:13:09.185835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479939+0000","last_change":"2023-10-25T16:13:06.604007+0000","last_active":"2023-10-25T16:13:09.479939+0000","last_peered":"2023-10-25T16:13:09.479939+0000","last_clean":"2023-10-25T16:13:09.479939+0000","last_became_active":"2023-10-25T16:13:06.603266+0000","last_became_peered":"2023-10-25T16:13:06.603266+0000","last_unstale":"2023-10-25T16:13:09.479939+0000","last_undegraded":"2023-10-25T16:13:09.479939+0000","last_fullsized":"2023-10-25T16:13:09.479939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478778+0000","last_change":"2023-10-25T16:13:07.559020+0000","last_active":"2023-10-25T16:13:09.478778+0000","last_peered":"2023-10-25T16:13:09.478778+0000","last_clean":"2023-10-25T16:13:09.478778+0000","last_became_active":"2023-10-25T16:13:07.558319+0000","last_became_peered":"2023-10-25T16:13:07.558319+0000","last_unstale":"2023-10-25T16:13:09.478778+0000","last_undegraded":"2023-10-25T16:13:09.478778+0000","last_fullsized":"2023-10-25T16:13:09.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464815+0000","last_change":"2023-10-25T16:13:06.598258+0000","last_active":"2023-10-25T16:13:09.464815+0000","last_peered":"2023-10-25T16:13:09.464815+0000","last_clean":"2023-10-25T16:13:09.464815+0000","last_became_active":"2023-10-25T16:13:06.597739+0000","last_became_peered":"2023-10-25T16:13:06.597739+0000","last_unstale":"2023-10-25T16:13:09.464815+0000","last_undegraded":"2023-10-25T16:13:09.464815+0000","last_fullsized":"2023-10-25T16:13:09.464815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480678+0000","last_change":"2023-10-25T16:13:06.593802+0000","last_active":"2023-10-25T16:13:09.480678+0000","last_peered":"2023-10-25T16:13:09.480678+0000","last_clean":"2023-10-25T16:13:09.480678+0000","last_became_active":"2023-10-25T16:13:06.591848+0000","last_became_peered":"2023-10-25T16:13:06.591848+0000","last_unstale":"2023-10-25T16:13:09.480678+0000","last_undegraded":"2023-10-25T16:13:09.480678+0000","last_fullsized":"2023-10-25T16:13:09.480678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478429+0000","last_change":"2023-10-25T16:13:07.564400+0000","last_active":"2023-10-25T16:13:09.478429+0000","last_peered":"2023-10-25T16:13:09.478429+0000","last_clean":"2023-10-25T16:13:09.478429+0000","last_became_active":"2023-10-25T16:13:07.560990+0000","last_became_peered":"2023-10-25T16:13:07.560990+0000","last_unstale":"2023-10-25T16:13:09.478429+0000","last_undegraded":"2023-10-25T16:13:09.478429+0000","last_fullsized":"2023-10-25T16:13:09.478429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545533+0000","last_change":"2023-10-25T16:13:06.585016+0000","last_active":"2023-10-25T16:13:08.545533+0000","last_peered":"2023-10-25T16:13:08.545533+0000","last_clean":"2023-10-25T16:13:08.545533+0000","last_became_active":"2023-10-25T16:13:06.584376+0000","last_became_peered":"2023-10-25T16:13:06.584376+0000","last_unstale":"2023-10-25T16:13:08.545533+0000","last_undegraded":"2023-10-25T16:13:08.545533+0000","last_fullsized":"2023-10-25T16:13:08.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479516+0000","last_change":"2023-10-25T16:13:07.559199+0000","last_active":"2023-10-25T16:13:09.479516+0000","last_peered":"2023-10-25T16:13:09.479516+0000","last_clean":"2023-10-25T16:13:09.479516+0000","last_became_active":"2023-10-25T16:13:07.556631+0000","last_became_peered":"2023-10-25T16:13:07.556631+0000","last_unstale":"2023-10-25T16:13:09.479516+0000","last_undegraded":"2023-10-25T16:13:09.479516+0000","last_fullsized":"2023-10-25T16:13:09.479516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464487+0000","last_change":"2023-10-25T16:13:06.584038+0000","last_active":"2023-10-25T16:13:09.464487+0000","last_peered":"2023-10-25T16:13:09.464487+0000","last_clean":"2023-10-25T16:13:09.464487+0000","last_became_active":"2023-10-25T16:13:06.583589+0000","last_became_peered":"2023-10-25T16:13:06.583589+0000","last_unstale":"2023-10-25T16:13:09.464487+0000","last_undegraded":"2023-10-25T16:13:09.464487+0000","last_fullsized":"2023-10-25T16:13:09.464487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544608+0000","last_change":"2023-10-25T16:13:07.590063+0000","last_active":"2023-10-25T16:13:08.544608+0000","last_peered":"2023-10-25T16:13:08.544608+0000","last_clean":"2023-10-25T16:13:08.544608+0000","last_became_active":"2023-10-25T16:13:07.588495+0000","last_became_peered":"2023-10-25T16:13:07.588495+0000","last_unstale":"2023-10-25T16:13:08.544608+0000","last_undegraded":"2023-10-25T16:13:08.544608+0000","last_fullsized":"2023-10-25T16:13:08.544608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546034+0000","last_change":"2023-10-25T16:13:06.590184+0000","last_active":"2023-10-25T16:13:08.546034+0000","last_peered":"2023-10-25T16:13:08.546034+0000","last_clean":"2023-10-25T16:13:08.546034+0000","last_became_active":"2023-10-25T16:13:06.588948+0000","last_became_peered":"2023-10-25T16:13:06.588948+0000","last_unstale":"2023-10-25T16:13:08.546034+0000","last_undegraded":"2023-10-25T16:13:08.546034+0000","last_fullsized":"2023-10-25T16:13:08.546034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479144+0000","last_change":"2023-10-25T16:13:07.586291+0000","last_active":"2023-10-25T16:13:09.479144+0000","last_peered":"2023-10-25T16:13:09.479144+0000","last_clean":"2023-10-25T16:13:09.479144+0000","last_became_active":"2023-10-25T16:13:07.585591+0000","last_became_peered":"2023-10-25T16:13:07.585591+0000","last_unstale":"2023-10-25T16:13:09.479144+0000","last_undegraded":"2023-10-25T16:13:09.479144+0000","last_fullsized":"2023-10-25T16:13:09.479144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480345+0000","last_change":"2023-10-25T16:13:06.583823+0000","last_active":"2023-10-25T16:13:09.480345+0000","last_peered":"2023-10-25T16:13:09.480345+0000","last_clean":"2023-10-25T16:13:09.480345+0000","last_became_active":"2023-10-25T16:13:06.583486+0000","last_became_peered":"2023-10-25T16:13:06.583486+0000","last_unstale":"2023-10-25T16:13:09.480345+0000","last_undegraded":"2023-10-25T16:13:09.480345+0000","last_fullsized":"2023-10-25T16:13:09.480345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:19.848515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185623+0000","last_change":"2023-10-25T16:13:07.568365+0000","last_active":"2023-10-25T16:13:09.185623+0000","last_peered":"2023-10-25T16:13:09.185623+0000","last_clean":"2023-10-25T16:13:09.185623+0000","last_became_active":"2023-10-25T16:13:07.567142+0000","last_became_peered":"2023-10-25T16:13:07.567142+0000","last_unstale":"2023-10-25T16:13:09.185623+0000","last_undegraded":"2023-10-25T16:13:09.185623+0000","last_fullsized":"2023-10-25T16:13:09.185623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464438+0000","last_change":"2023-10-25T16:13:06.595459+0000","last_active":"2023-10-25T16:13:09.464438+0000","last_peered":"2023-10-25T16:13:09.464438+0000","last_clean":"2023-10-25T16:13:09.464438+0000","last_became_active":"2023-10-25T16:13:06.594824+0000","last_became_peered":"2023-10-25T16:13:06.594824+0000","last_unstale":"2023-10-25T16:13:09.464438+0000","last_undegraded":"2023-10-25T16:13:09.464438+0000","last_fullsized":"2023-10-25T16:13:09.464438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541328+0000","last_change":"2023-10-25T16:13:07.577436+0000","last_active":"2023-10-25T16:13:08.541328+0000","last_peered":"2023-10-25T16:13:08.541328+0000","last_clean":"2023-10-25T16:13:08.541328+0000","last_became_active":"2023-10-25T16:13:07.567759+0000","last_became_peered":"2023-10-25T16:13:07.567759+0000","last_unstale":"2023-10-25T16:13:08.541328+0000","last_undegraded":"2023-10-25T16:13:08.541328+0000","last_fullsized":"2023-10-25T16:13:08.541328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480167+0000","last_change":"2023-10-25T16:13:06.591408+0000","last_active":"2023-10-25T16:13:09.480167+0000","last_peered":"2023-10-25T16:13:09.480167+0000","last_clean":"2023-10-25T16:13:09.480167+0000","last_became_active":"2023-10-25T16:13:06.591012+0000","last_became_peered":"2023-10-25T16:13:06.591012+0000","last_unstale":"2023-10-25T16:13:09.480167+0000","last_undegraded":"2023-10-25T16:13:09.480167+0000","last_fullsized":"2023-10-25T16:13:09.480167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479460+0000","last_change":"2023-10-25T16:13:07.589102+0000","last_active":"2023-10-25T16:13:09.479460+0000","last_peered":"2023-10-25T16:13:09.479460+0000","last_clean":"2023-10-25T16:13:09.479460+0000","last_became_active":"2023-10-25T16:13:07.587838+0000","last_became_peered":"2023-10-25T16:13:07.587838+0000","last_unstale":"2023-10-25T16:13:09.479460+0000","last_undegraded":"2023-10-25T16:13:09.479460+0000","last_fullsized":"2023-10-25T16:13:09.479460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546334+0000","last_change":"2023-10-25T16:13:06.589759+0000","last_active":"2023-10-25T16:13:08.546334+0000","last_peered":"2023-10-25T16:13:08.546334+0000","last_clean":"2023-10-25T16:13:08.546334+0000","last_became_active":"2023-10-25T16:13:06.589100+0000","last_became_peered":"2023-10-25T16:13:06.589100+0000","last_unstale":"2023-10-25T16:13:08.546334+0000","last_undegraded":"2023-10-25T16:13:08.546334+0000","last_fullsized":"2023-10-25T16:13:08.546334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542048+0000","last_change":"2023-10-25T16:13:07.577105+0000","last_active":"2023-10-25T16:13:08.542048+0000","last_peered":"2023-10-25T16:13:08.542048+0000","last_clean":"2023-10-25T16:13:08.542048+0000","last_became_active":"2023-10-25T16:13:07.565017+0000","last_became_peered":"2023-10-25T16:13:07.565017+0000","last_unstale":"2023-10-25T16:13:08.542048+0000","last_undegraded":"2023-10-25T16:13:08.542048+0000","last_fullsized":"2023-10-25T16:13:08.542048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464495+0000","last_change":"2023-10-25T16:13:06.598452+0000","last_active":"2023-10-25T16:13:09.464495+0000","last_peered":"2023-10-25T16:13:09.464495+0000","last_clean":"2023-10-25T16:13:09.464495+0000","last_became_active":"2023-10-25T16:13:06.597797+0000","last_became_peered":"2023-10-25T16:13:06.597797+0000","last_unstale":"2023-10-25T16:13:09.464495+0000","last_undegraded":"2023-10-25T16:13:09.464495+0000","last_fullsized":"2023-10-25T16:13:09.464495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464575+0000","last_change":"2023-10-25T16:13:07.569409+0000","last_active":"2023-10-25T16:13:09.464575+0000","last_peered":"2023-10-25T16:13:09.464575+0000","last_clean":"2023-10-25T16:13:09.464575+0000","last_became_active":"2023-10-25T16:13:07.561141+0000","last_became_peered":"2023-10-25T16:13:07.561141+0000","last_unstale":"2023-10-25T16:13:09.464575+0000","last_undegraded":"2023-10-25T16:13:09.464575+0000","last_fullsized":"2023-10-25T16:13:09.464575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.587348+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:06.587348+0000","last_peered":"2023-10-25T16:13:06.587348+0000","last_clean":"2023-10-25T16:13:06.587348+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:06.587348+0000","last_undegraded":"2023-10-25T16:13:06.587348+0000","last_fullsized":"2023-10-25T16:13:06.587348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:14:25.507113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542401+0000","last_change":"2023-10-25T16:13:07.586802+0000","last_active":"2023-10-25T16:13:08.542401+0000","last_peered":"2023-10-25T16:13:08.542401+0000","last_clean":"2023-10-25T16:13:08.542401+0000","last_became_active":"2023-10-25T16:13:07.586067+0000","last_became_peered":"2023-10-25T16:13:07.586067+0000","last_unstale":"2023-10-25T16:13:08.542401+0000","last_undegraded":"2023-10-25T16:13:08.542401+0000","last_fullsized":"2023-10-25T16:13:08.542401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185909+0000","last_change":"2023-10-25T16:13:06.576987+0000","last_active":"2023-10-25T16:13:09.185909+0000","last_peered":"2023-10-25T16:13:09.185909+0000","last_clean":"2023-10-25T16:13:09.185909+0000","last_became_active":"2023-10-25T16:13:06.576204+0000","last_became_peered":"2023-10-25T16:13:06.576204+0000","last_unstale":"2023-10-25T16:13:09.185909+0000","last_undegraded":"2023-10-25T16:13:09.185909+0000","last_fullsized":"2023-10-25T16:13:09.185909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:27.980983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542364+0000","last_change":"2023-10-25T16:13:07.577484+0000","last_active":"2023-10-25T16:13:08.542364+0000","last_peered":"2023-10-25T16:13:08.542364+0000","last_clean":"2023-10-25T16:13:08.542364+0000","last_became_active":"2023-10-25T16:13:07.566477+0000","last_became_peered":"2023-10-25T16:13:07.566477+0000","last_unstale":"2023-10-25T16:13:08.542364+0000","last_undegraded":"2023-10-25T16:13:08.542364+0000","last_fullsized":"2023-10-25T16:13:08.542364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.574334+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:06.574334+0000","last_peered":"2023-10-25T16:13:06.574334+0000","last_clean":"2023-10-25T16:13:06.574334+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:06.574334+0000","last_undegraded":"2023-10-25T16:13:06.574334+0000","last_fullsized":"2023-10-25T16:13:06.574334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:15.085365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541203+0000","last_change":"2023-10-25T16:13:07.565301+0000","last_active":"2023-10-25T16:13:08.541203+0000","last_peered":"2023-10-25T16:13:08.541203+0000","last_clean":"2023-10-25T16:13:08.541203+0000","last_became_active":"2023-10-25T16:13:07.563812+0000","last_became_peered":"2023-10-25T16:13:07.563812+0000","last_unstale":"2023-10-25T16:13:08.541203+0000","last_undegraded":"2023-10-25T16:13:08.541203+0000","last_fullsized":"2023-10-25T16:13:08.541203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478001+0000","last_change":"2023-10-25T16:13:06.583997+0000","last_active":"2023-10-25T16:13:09.478001+0000","last_peered":"2023-10-25T16:13:09.478001+0000","last_clean":"2023-10-25T16:13:09.478001+0000","last_became_active":"2023-10-25T16:13:06.583355+0000","last_became_peered":"2023-10-25T16:13:06.583355+0000","last_unstale":"2023-10-25T16:13:09.478001+0000","last_undegraded":"2023-10-25T16:13:09.478001+0000","last_fullsized":"2023-10-25T16:13:09.478001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545728+0000","last_change":"2023-10-25T16:13:07.576400+0000","last_active":"2023-10-25T16:13:08.545728+0000","last_peered":"2023-10-25T16:13:08.545728+0000","last_clean":"2023-10-25T16:13:08.545728+0000","last_became_active":"2023-10-25T16:13:07.575767+0000","last_became_peered":"2023-10-25T16:13:07.575767+0000","last_unstale":"2023-10-25T16:13:08.545728+0000","last_undegraded":"2023-10-25T16:13:08.545728+0000","last_fullsized":"2023-10-25T16:13:08.545728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586210+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:06.586210+0000","last_peered":"2023-10-25T16:13:06.586210+0000","last_clean":"2023-10-25T16:13:06.586210+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:06.586210+0000","last_undegraded":"2023-10-25T16:13:06.586210+0000","last_fullsized":"2023-10-25T16:13:06.586210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:13.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541794+0000","last_change":"2023-10-25T16:13:07.587447+0000","last_active":"2023-10-25T16:13:08.541794+0000","last_peered":"2023-10-25T16:13:08.541794+0000","last_clean":"2023-10-25T16:13:08.541794+0000","last_became_active":"2023-10-25T16:13:07.586850+0000","last_became_peered":"2023-10-25T16:13:07.586850+0000","last_unstale":"2023-10-25T16:13:08.541794+0000","last_undegraded":"2023-10-25T16:13:08.541794+0000","last_fullsized":"2023-10-25T16:13:08.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.549368+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:13:07.549368+0000","last_peered":"2023-10-25T16:13:07.549368+0000","last_clean":"2023-10-25T16:13:07.549368+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:13:07.549368+0000","last_undegraded":"2023-10-25T16:13:07.549368+0000","last_fullsized":"2023-10-25T16:13:07.549368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546669+0000","last_change":"2023-10-25T16:13:06.587408+0000","last_active":"2023-10-25T16:13:08.546669+0000","last_peered":"2023-10-25T16:13:08.546669+0000","last_clean":"2023-10-25T16:13:08.546669+0000","last_became_active":"2023-10-25T16:13:06.586522+0000","last_became_peered":"2023-10-25T16:13:06.586522+0000","last_unstale":"2023-10-25T16:13:08.546669+0000","last_undegraded":"2023-10-25T16:13:08.546669+0000","last_fullsized":"2023-10-25T16:13:08.546669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:38.279671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479511+0000","last_change":"2023-10-25T16:13:07.576734+0000","last_active":"2023-10-25T16:13:09.479511+0000","last_peered":"2023-10-25T16:13:09.479511+0000","last_clean":"2023-10-25T16:13:09.479511+0000","last_became_active":"2023-10-25T16:13:07.575887+0000","last_became_peered":"2023-10-25T16:13:07.575887+0000","last_unstale":"2023-10-25T16:13:09.479511+0000","last_undegraded":"2023-10-25T16:13:09.479511+0000","last_fullsized":"2023-10-25T16:13:09.479511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541705+0000","last_change":"2023-10-25T16:13:06.603271+0000","last_active":"2023-10-25T16:13:08.541705+0000","last_peered":"2023-10-25T16:13:08.541705+0000","last_clean":"2023-10-25T16:13:08.541705+0000","last_became_active":"2023-10-25T16:13:06.602179+0000","last_became_peered":"2023-10-25T16:13:06.602179+0000","last_unstale":"2023-10-25T16:13:08.541705+0000","last_undegraded":"2023-10-25T16:13:08.541705+0000","last_fullsized":"2023-10-25T16:13:08.541705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479260+0000","last_change":"2023-10-25T16:13:07.563801+0000","last_active":"2023-10-25T16:13:09.479260+0000","last_peered":"2023-10-25T16:13:09.479260+0000","last_clean":"2023-10-25T16:13:09.479260+0000","last_became_active":"2023-10-25T16:13:07.561818+0000","last_became_peered":"2023-10-25T16:13:07.561818+0000","last_unstale":"2023-10-25T16:13:09.479260+0000","last_undegraded":"2023-10-25T16:13:09.479260+0000","last_fullsized":"2023-10-25T16:13:09.479260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-25T16:13:06.586156+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:06.586156+0000","last_peered":"2023-10-25T16:13:06.586156+0000","last_clean":"2023-10-25T16:13:06.586156+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:06.586156+0000","last_undegraded":"2023-10-25T16:13:06.586156+0000","last_fullsized":"2023-10-25T16:13:06.586156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479843+0000","last_change":"2023-10-25T16:13:07.559564+0000","last_active":"2023-10-25T16:13:09.479843+0000","last_peered":"2023-10-25T16:13:09.479843+0000","last_clean":"2023-10-25T16:13:09.479843+0000","last_became_active":"2023-10-25T16:13:07.558584+0000","last_became_peered":"2023-10-25T16:13:07.558584+0000","last_unstale":"2023-10-25T16:13:09.479843+0000","last_undegraded":"2023-10-25T16:13:09.479843+0000","last_fullsized":"2023-10-25T16:13:09.479843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546149+0000","last_change":"2023-10-25T16:13:06.583922+0000","last_active":"2023-10-25T16:13:08.546149+0000","last_peered":"2023-10-25T16:13:08.546149+0000","last_clean":"2023-10-25T16:13:08.546149+0000","last_became_active":"2023-10-25T16:13:06.581997+0000","last_became_peered":"2023-10-25T16:13:06.581997+0000","last_unstale":"2023-10-25T16:13:08.546149+0000","last_undegraded":"2023-10-25T16:13:08.546149+0000","last_fullsized":"2023-10-25T16:13:08.546149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185545+0000","last_change":"2023-10-25T16:13:07.560270+0000","last_active":"2023-10-25T16:13:09.185545+0000","last_peered":"2023-10-25T16:13:09.185545+0000","last_clean":"2023-10-25T16:13:09.185545+0000","last_became_active":"2023-10-25T16:13:07.559551+0000","last_became_peered":"2023-10-25T16:13:07.559551+0000","last_unstale":"2023-10-25T16:13:09.185545+0000","last_undegraded":"2023-10-25T16:13:09.185545+0000","last_fullsized":"2023-10-25T16:13:09.185545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:19.572019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478513+0000","last_change":"2023-10-25T16:13:06.588392+0000","last_active":"2023-10-25T16:13:09.478513+0000","last_peered":"2023-10-25T16:13:09.478513+0000","last_clean":"2023-10-25T16:13:09.478513+0000","last_became_active":"2023-10-25T16:13:06.588114+0000","last_became_peered":"2023-10-25T16:13:06.588114+0000","last_unstale":"2023-10-25T16:13:09.478513+0000","last_undegraded":"2023-10-25T16:13:09.478513+0000","last_fullsized":"2023-10-25T16:13:09.478513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545216+0000","last_change":"2023-10-25T16:13:07.563744+0000","last_active":"2023-10-25T16:13:08.545216+0000","last_peered":"2023-10-25T16:13:08.545216+0000","last_clean":"2023-10-25T16:13:08.545216+0000","last_became_active":"2023-10-25T16:13:07.563027+0000","last_became_peered":"2023-10-25T16:13:07.563027+0000","last_unstale":"2023-10-25T16:13:08.545216+0000","last_undegraded":"2023-10-25T16:13:08.545216+0000","last_fullsized":"2023-10-25T16:13:08.545216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541562+0000","last_change":"2023-10-25T16:13:06.604452+0000","last_active":"2023-10-25T16:13:08.541562+0000","last_peered":"2023-10-25T16:13:08.541562+0000","last_clean":"2023-10-25T16:13:08.541562+0000","last_became_active":"2023-10-25T16:13:06.603857+0000","last_became_peered":"2023-10-25T16:13:06.603857+0000","last_unstale":"2023-10-25T16:13:08.541562+0000","last_undegraded":"2023-10-25T16:13:08.541562+0000","last_fullsized":"2023-10-25T16:13:08.541562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477752+0000","last_change":"2023-10-25T16:13:07.555525+0000","last_active":"2023-10-25T16:13:09.477752+0000","last_peered":"2023-10-25T16:13:09.477752+0000","last_clean":"2023-10-25T16:13:09.477752+0000","last_became_active":"2023-10-25T16:13:07.554924+0000","last_became_peered":"2023-10-25T16:13:07.554924+0000","last_unstale":"2023-10-25T16:13:09.477752+0000","last_undegraded":"2023-10-25T16:13:09.477752+0000","last_fullsized":"2023-10-25T16:13:09.477752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480571+0000","last_change":"2023-10-25T16:13:06.588519+0000","last_active":"2023-10-25T16:13:09.480571+0000","last_peered":"2023-10-25T16:13:09.480571+0000","last_clean":"2023-10-25T16:13:09.480571+0000","last_became_active":"2023-10-25T16:13:06.587754+0000","last_became_peered":"2023-10-25T16:13:06.587754+0000","last_unstale":"2023-10-25T16:13:09.480571+0000","last_undegraded":"2023-10-25T16:13:09.480571+0000","last_fullsized":"2023-10-25T16:13:09.480571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479179+0000","last_change":"2023-10-25T16:13:07.577983+0000","last_active":"2023-10-25T16:13:09.479179+0000","last_peered":"2023-10-25T16:13:09.479179+0000","last_clean":"2023-10-25T16:13:09.479179+0000","last_became_active":"2023-10-25T16:13:07.577344+0000","last_became_peered":"2023-10-25T16:13:07.577344+0000","last_unstale":"2023-10-25T16:13:09.479179+0000","last_undegraded":"2023-10-25T16:13:09.479179+0000","last_fullsized":"2023-10-25T16:13:09.479179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464626+0000","last_change":"2023-10-25T16:13:06.595499+0000","last_active":"2023-10-25T16:13:09.464626+0000","last_peered":"2023-10-25T16:13:09.464626+0000","last_clean":"2023-10-25T16:13:09.464626+0000","last_became_active":"2023-10-25T16:13:06.594639+0000","last_became_peered":"2023-10-25T16:13:06.594639+0000","last_unstale":"2023-10-25T16:13:09.464626+0000","last_undegraded":"2023-10-25T16:13:09.464626+0000","last_fullsized":"2023-10-25T16:13:09.464626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478650+0000","last_change":"2023-10-25T16:13:07.568153+0000","last_active":"2023-10-25T16:13:09.478650+0000","last_peered":"2023-10-25T16:13:09.478650+0000","last_clean":"2023-10-25T16:13:09.478650+0000","last_became_active":"2023-10-25T16:13:07.567204+0000","last_became_peered":"2023-10-25T16:13:07.567204+0000","last_unstale":"2023-10-25T16:13:09.478650+0000","last_undegraded":"2023-10-25T16:13:09.478650+0000","last_fullsized":"2023-10-25T16:13:09.478650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542227+0000","last_change":"2023-10-25T16:13:06.605135+0000","last_active":"2023-10-25T16:13:08.542227+0000","last_peered":"2023-10-25T16:13:08.542227+0000","last_clean":"2023-10-25T16:13:08.542227+0000","last_became_active":"2023-10-25T16:13:06.604117+0000","last_became_peered":"2023-10-25T16:13:06.604117+0000","last_unstale":"2023-10-25T16:13:08.542227+0000","last_undegraded":"2023-10-25T16:13:08.542227+0000","last_fullsized":"2023-10-25T16:13:08.542227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186211+0000","last_change":"2023-10-25T16:13:07.570460+0000","last_active":"2023-10-25T16:13:09.186211+0000","last_peered":"2023-10-25T16:13:09.186211+0000","last_clean":"2023-10-25T16:13:09.186211+0000","last_became_active":"2023-10-25T16:13:07.565363+0000","last_became_peered":"2023-10-25T16:13:07.565363+0000","last_unstale":"2023-10-25T16:13:09.186211+0000","last_undegraded":"2023-10-25T16:13:09.186211+0000","last_fullsized":"2023-10-25T16:13:09.186211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:45.620922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478298+0000","last_change":"2023-10-25T16:13:06.607078+0000","last_active":"2023-10-25T16:13:09.478298+0000","last_peered":"2023-10-25T16:13:09.478298+0000","last_clean":"2023-10-25T16:13:09.478298+0000","last_became_active":"2023-10-25T16:13:06.606881+0000","last_became_peered":"2023-10-25T16:13:06.606881+0000","last_unstale":"2023-10-25T16:13:09.478298+0000","last_undegraded":"2023-10-25T16:13:09.478298+0000","last_fullsized":"2023-10-25T16:13:09.478298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480464+0000","last_change":"2023-10-25T16:13:07.546555+0000","last_active":"2023-10-25T16:13:09.480464+0000","last_peered":"2023-10-25T16:13:09.480464+0000","last_clean":"2023-10-25T16:13:09.480464+0000","last_became_active":"2023-10-25T16:13:07.545944+0000","last_became_peered":"2023-10-25T16:13:07.545944+0000","last_unstale":"2023-10-25T16:13:09.480464+0000","last_undegraded":"2023-10-25T16:13:09.480464+0000","last_fullsized":"2023-10-25T16:13:09.480464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480051+0000","last_change":"2023-10-25T16:13:06.589243+0000","last_active":"2023-10-25T16:13:09.480051+0000","last_peered":"2023-10-25T16:13:09.480051+0000","last_clean":"2023-10-25T16:13:09.480051+0000","last_became_active":"2023-10-25T16:13:06.588343+0000","last_became_peered":"2023-10-25T16:13:06.588343+0000","last_unstale":"2023-10-25T16:13:09.480051+0000","last_undegraded":"2023-10-25T16:13:09.480051+0000","last_fullsized":"2023-10-25T16:13:09.480051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480990+0000","last_change":"2023-10-25T16:13:07.569083+0000","last_active":"2023-10-25T16:13:09.480990+0000","last_peered":"2023-10-25T16:13:09.480990+0000","last_clean":"2023-10-25T16:13:09.480990+0000","last_became_active":"2023-10-25T16:13:07.562504+0000","last_became_peered":"2023-10-25T16:13:07.562504+0000","last_unstale":"2023-10-25T16:13:09.480990+0000","last_undegraded":"2023-10-25T16:13:09.480990+0000","last_fullsized":"2023-10-25T16:13:09.480990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541587+0000","last_change":"2023-10-25T16:13:06.603385+0000","last_active":"2023-10-25T16:13:08.541587+0000","last_peered":"2023-10-25T16:13:08.541587+0000","last_clean":"2023-10-25T16:13:08.541587+0000","last_became_active":"2023-10-25T16:13:06.602760+0000","last_became_peered":"2023-10-25T16:13:06.602760+0000","last_unstale":"2023-10-25T16:13:08.541587+0000","last_undegraded":"2023-10-25T16:13:08.541587+0000","last_fullsized":"2023-10-25T16:13:08.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:55.025836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464180+0000","last_change":"2023-10-25T16:13:07.569746+0000","last_active":"2023-10-25T16:13:09.464180+0000","last_peered":"2023-10-25T16:13:09.464180+0000","last_clean":"2023-10-25T16:13:09.464180+0000","last_became_active":"2023-10-25T16:13:07.568518+0000","last_became_peered":"2023-10-25T16:13:07.568518+0000","last_unstale":"2023-10-25T16:13:09.464180+0000","last_undegraded":"2023-10-25T16:13:09.464180+0000","last_fullsized":"2023-10-25T16:13:09.464180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545306+0000","last_change":"2023-10-25T16:13:07.576112+0000","last_active":"2023-10-25T16:13:08.545306+0000","last_peered":"2023-10-25T16:13:08.545306+0000","last_clean":"2023-10-25T16:13:08.545306+0000","last_became_active":"2023-10-25T16:13:07.574201+0000","last_became_peered":"2023-10-25T16:13:07.574201+0000","last_unstale":"2023-10-25T16:13:08.545306+0000","last_undegraded":"2023-10-25T16:13:08.545306+0000","last_fullsized":"2023-10-25T16:13:08.545306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542101+0000","last_change":"2023-10-25T16:13:06.604712+0000","last_active":"2023-10-25T16:13:08.542101+0000","last_peered":"2023-10-25T16:13:08.542101+0000","last_clean":"2023-10-25T16:13:08.542101+0000","last_became_active":"2023-10-25T16:13:06.602850+0000","last_became_peered":"2023-10-25T16:13:06.602850+0000","last_unstale":"2023-10-25T16:13:08.542101+0000","last_undegraded":"2023-10-25T16:13:08.542101+0000","last_fullsized":"2023-10-25T16:13:08.542101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545831+0000","last_change":"2023-10-25T16:13:07.585084+0000","last_active":"2023-10-25T16:13:08.545831+0000","last_peered":"2023-10-25T16:13:08.545831+0000","last_clean":"2023-10-25T16:13:08.545831+0000","last_became_active":"2023-10-25T16:13:07.582955+0000","last_became_peered":"2023-10-25T16:13:07.582955+0000","last_unstale":"2023-10-25T16:13:08.545831+0000","last_undegraded":"2023-10-25T16:13:08.545831+0000","last_fullsized":"2023-10-25T16:13:08.545831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542584+0000","last_change":"2023-10-25T16:13:06.606358+0000","last_active":"2023-10-25T16:13:08.542584+0000","last_peered":"2023-10-25T16:13:08.542584+0000","last_clean":"2023-10-25T16:13:08.542584+0000","last_became_active":"2023-10-25T16:13:06.602334+0000","last_became_peered":"2023-10-25T16:13:06.602334+0000","last_unstale":"2023-10-25T16:13:08.542584+0000","last_undegraded":"2023-10-25T16:13:08.542584+0000","last_fullsized":"2023-10-25T16:13:08.542584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478959+0000","last_change":"2023-10-25T16:13:07.566273+0000","last_active":"2023-10-25T16:13:09.478959+0000","last_peered":"2023-10-25T16:13:09.478959+0000","last_clean":"2023-10-25T16:13:09.478959+0000","last_became_active":"2023-10-25T16:13:07.562676+0000","last_became_peered":"2023-10-25T16:13:07.562676+0000","last_unstale":"2023-10-25T16:13:09.478959+0000","last_undegraded":"2023-10-25T16:13:09.478959+0000","last_fullsized":"2023-10-25T16:13:09.478959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480470+0000","last_change":"2023-10-25T16:13:06.594182+0000","last_active":"2023-10-25T16:13:09.480470+0000","last_peered":"2023-10-25T16:13:09.480470+0000","last_clean":"2023-10-25T16:13:09.480470+0000","last_became_active":"2023-10-25T16:13:06.592991+0000","last_became_peered":"2023-10-25T16:13:06.592991+0000","last_unstale":"2023-10-25T16:13:09.480470+0000","last_undegraded":"2023-10-25T16:13:09.480470+0000","last_fullsized":"2023-10-25T16:13:09.480470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480226+0000","last_change":"2023-10-25T16:13:07.564149+0000","last_active":"2023-10-25T16:13:09.480226+0000","last_peered":"2023-10-25T16:13:09.480226+0000","last_clean":"2023-10-25T16:13:09.480226+0000","last_became_active":"2023-10-25T16:13:07.561630+0000","last_became_peered":"2023-10-25T16:13:07.561630+0000","last_unstale":"2023-10-25T16:13:09.480226+0000","last_undegraded":"2023-10-25T16:13:09.480226+0000","last_fullsized":"2023-10-25T16:13:09.480226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479489+0000","last_change":"2023-10-25T16:13:06.603850+0000","last_active":"2023-10-25T16:13:09.479489+0000","last_peered":"2023-10-25T16:13:09.479489+0000","last_clean":"2023-10-25T16:13:09.479489+0000","last_became_active":"2023-10-25T16:13:06.603106+0000","last_became_peered":"2023-10-25T16:13:06.603106+0000","last_unstale":"2023-10-25T16:13:09.479489+0000","last_undegraded":"2023-10-25T16:13:09.479489+0000","last_fullsized":"2023-10-25T16:13:09.479489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937930,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3919999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931029,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199930995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340149,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1029999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2320000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1219999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1349999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.891999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:12.252 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-25T16:13:12.246+0000 7faa1f25d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:13:14.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:15.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/3476976379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf9806b9e0 msgr2=0x7fbf9806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/3476976379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf9806b9e0 0x7fbf9806be90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005fd0 tx=0x7fbf8801c7c0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/3476976379 shutdown_connections 2023-10-25T16:13:15.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/3476976379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf9806b9e0 0x7fbf9806be90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/3476976379 >> 172.21.15.177:0/3476976379 conn(0x7fbf980b2450 msgr2=0x7fbf980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:15.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/3476976379 shutdown_connections 2023-10-25T16:13:15.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/3476976379 wait complete. 2023-10-25T16:13:15.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 Processor -- start 2023-10-25T16:13:15.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- start start 2023-10-25T16:13:15.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf9806b9e0 0x7fbf981510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf980706f0 0x7fbf98142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 0x7fbf980ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf981517c0 con 0x7fbf981500f0 2023-10-25T16:13:15.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf981427b0 con 0x7fbf980706f0 2023-10-25T16:13:15.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9f6d8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf980ada30 con 0x7fbf9806b9e0 2023-10-25T16:13:15.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 0x7fbf980ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 0x7fbf980ad4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43410/0 (socket says 172.21.15.177:43410) 2023-10-25T16:13:15.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 -- 172.21.15.177:0/835147284 learned_addr learned my addr 172.21.15.177:0/835147284 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:15.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9d474640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf9806b9e0 0x7fbf981510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9cc73640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf980706f0 0x7fbf98142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 -- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf9806b9e0 msgr2=0x7fbf981510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf9806b9e0 0x7fbf981510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 -- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf980706f0 msgr2=0x7fbf98142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf980706f0 0x7fbf98142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 -- 172.21.15.177:0/835147284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88009450 con 0x7fbf981500f0 2023-10-25T16:13:15.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9cc73640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf980706f0 0x7fbf98142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:15.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf9dc75640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 0x7fbf980ad4f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000c7b0 tx=0x7fbf9000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:15.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90003db0 con 0x7fbf981500f0 2023-10-25T16:13:15.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf90005070 con 0x7fbf981500f0 2023-10-25T16:13:15.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.127+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90005480 con 0x7fbf981500f0 2023-10-25T16:13:15.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9815a6b0 con 0x7fbf981500f0 2023-10-25T16:13:15.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf98146f70 con 0x7fbf981500f0 2023-10-25T16:13:15.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf98147100 con 0x7fbf981500f0 2023-10-25T16:13:15.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf900055e0 con 0x7fbf981500f0 2023-10-25T16:13:15.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf8dffb640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf7c066470 0x7fbf7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf90083f10 con 0x7fbf981500f0 2023-10-25T16:13:15.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf9d474640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf7c066470 0x7fbf7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.131+0000 7fbf9d474640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf7c066470 0x7fbf7c068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf980aec00 tx=0x7fbf94009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:15.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.135+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf90051380 con 0x7fbf981500f0 2023-10-25T16:13:15.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.283+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf9804daf0 con 0x7fbf7c066470 2023-10-25T16:13:15.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.303+0000 7fbf8dffb640 1 -- 172.21.15.177:0/835147284 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260118 (secure 0 0 0) 0x7fbf9804daf0 con 0x7fbf7c066470 2023-10-25T16:13:15.310 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf7c066470 msgr2=0x7fbf7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf7c066470 0x7fbf7c068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf980aec00 tx=0x7fbf94009040 comp rx=0 tx=0).stop 2023-10-25T16:13:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 msgr2=0x7fbf980ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 0x7fbf980ad4f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000c7b0 tx=0x7fbf9000cc70 comp rx=0 tx=0).stop 2023-10-25T16:13:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 shutdown_connections 2023-10-25T16:13:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf7c066470 0x7fbf7c068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf981500f0 0x7fbf980ad4f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf980706f0 0x7fbf98142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 --2- 172.21.15.177:0/835147284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf9806b9e0 0x7fbf981510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 >> 172.21.15.177:0/835147284 conn(0x7fbf980b2450 msgr2=0x7fbf9815a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 shutdown_connections 2023-10-25T16:13:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.307+0000 7fbf9f6d8640 1 -- 172.21.15.177:0/835147284 wait complete. 2023-10-25T16:13:15.328 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-25T16:13:14.594204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560785,"statfs":{"total":1600000000,"available":1598244784,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002943"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541423+0000","last_change":"2023-10-25T16:13:07.579322+0000","last_active":"2023-10-25T16:13:08.541423+0000","last_peered":"2023-10-25T16:13:08.541423+0000","last_clean":"2023-10-25T16:13:08.541423+0000","last_became_active":"2023-10-25T16:13:07.566613+0000","last_became_peered":"2023-10-25T16:13:07.566613+0000","last_unstale":"2023-10-25T16:13:08.541423+0000","last_undegraded":"2023-10-25T16:13:08.541423+0000","last_fullsized":"2023-10-25T16:13:08.541423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477996+0000","last_change":"2023-10-25T16:13:07.553120+0000","last_active":"2023-10-25T16:13:09.477996+0000","last_peered":"2023-10-25T16:13:09.477996+0000","last_clean":"2023-10-25T16:13:09.477996+0000","last_became_active":"2023-10-25T16:13:07.551990+0000","last_became_peered":"2023-10-25T16:13:07.551990+0000","last_unstale":"2023-10-25T16:13:09.477996+0000","last_undegraded":"2023-10-25T16:13:09.477996+0000","last_fullsized":"2023-10-25T16:13:09.477996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478313+0000","last_change":"2023-10-25T16:13:07.563333+0000","last_active":"2023-10-25T16:13:09.478313+0000","last_peered":"2023-10-25T16:13:09.478313+0000","last_clean":"2023-10-25T16:13:09.478313+0000","last_became_active":"2023-10-25T16:13:07.560920+0000","last_became_peered":"2023-10-25T16:13:07.560920+0000","last_unstale":"2023-10-25T16:13:09.478313+0000","last_undegraded":"2023-10-25T16:13:09.478313+0000","last_fullsized":"2023-10-25T16:13:09.478313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544460+0000","last_change":"2023-10-25T16:13:07.567528+0000","last_active":"2023-10-25T16:13:08.544460+0000","last_peered":"2023-10-25T16:13:08.544460+0000","last_clean":"2023-10-25T16:13:08.544460+0000","last_became_active":"2023-10-25T16:13:07.566685+0000","last_became_peered":"2023-10-25T16:13:07.566685+0000","last_unstale":"2023-10-25T16:13:08.544460+0000","last_undegraded":"2023-10-25T16:13:08.544460+0000","last_fullsized":"2023-10-25T16:13:08.544460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541668+0000","last_change":"2023-10-25T16:13:07.579075+0000","last_active":"2023-10-25T16:13:08.541668+0000","last_peered":"2023-10-25T16:13:08.541668+0000","last_clean":"2023-10-25T16:13:08.541668+0000","last_became_active":"2023-10-25T16:13:07.567451+0000","last_became_peered":"2023-10-25T16:13:07.567451+0000","last_unstale":"2023-10-25T16:13:08.541668+0000","last_undegraded":"2023-10-25T16:13:08.541668+0000","last_fullsized":"2023-10-25T16:13:08.541668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545497+0000","last_change":"2023-10-25T16:13:07.585648+0000","last_active":"2023-10-25T16:13:08.545497+0000","last_peered":"2023-10-25T16:13:08.545497+0000","last_clean":"2023-10-25T16:13:08.545497+0000","last_became_active":"2023-10-25T16:13:07.583670+0000","last_became_peered":"2023-10-25T16:13:07.583670+0000","last_unstale":"2023-10-25T16:13:08.545497+0000","last_undegraded":"2023-10-25T16:13:08.545497+0000","last_fullsized":"2023-10-25T16:13:08.545497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541701+0000","last_change":"2023-10-25T16:13:07.581287+0000","last_active":"2023-10-25T16:13:08.541701+0000","last_peered":"2023-10-25T16:13:08.541701+0000","last_clean":"2023-10-25T16:13:08.541701+0000","last_became_active":"2023-10-25T16:13:07.577390+0000","last_became_peered":"2023-10-25T16:13:07.577390+0000","last_unstale":"2023-10-25T16:13:08.541701+0000","last_undegraded":"2023-10-25T16:13:08.541701+0000","last_fullsized":"2023-10-25T16:13:08.541701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477246+0000","last_change":"2023-10-25T16:13:07.569496+0000","last_active":"2023-10-25T16:13:09.477246+0000","last_peered":"2023-10-25T16:13:09.477246+0000","last_clean":"2023-10-25T16:13:09.477246+0000","last_became_active":"2023-10-25T16:13:07.563950+0000","last_became_peered":"2023-10-25T16:13:07.563950+0000","last_unstale":"2023-10-25T16:13:09.477246+0000","last_undegraded":"2023-10-25T16:13:09.477246+0000","last_fullsized":"2023-10-25T16:13:09.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541010+0000","last_change":"2023-10-25T16:13:07.577965+0000","last_active":"2023-10-25T16:13:08.541010+0000","last_peered":"2023-10-25T16:13:08.541010+0000","last_clean":"2023-10-25T16:13:08.541010+0000","last_became_active":"2023-10-25T16:13:07.576892+0000","last_became_peered":"2023-10-25T16:13:07.576892+0000","last_unstale":"2023-10-25T16:13:08.541010+0000","last_undegraded":"2023-10-25T16:13:08.541010+0000","last_fullsized":"2023-10-25T16:13:08.541010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464171+0000","last_change":"2023-10-25T16:13:07.561076+0000","last_active":"2023-10-25T16:13:09.464171+0000","last_peered":"2023-10-25T16:13:09.464171+0000","last_clean":"2023-10-25T16:13:09.464171+0000","last_became_active":"2023-10-25T16:13:07.560340+0000","last_became_peered":"2023-10-25T16:13:07.560340+0000","last_unstale":"2023-10-25T16:13:09.464171+0000","last_undegraded":"2023-10-25T16:13:09.464171+0000","last_fullsized":"2023-10-25T16:13:09.464171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.463985+0000","last_change":"2023-10-25T16:13:07.585838+0000","last_active":"2023-10-25T16:13:09.463985+0000","last_peered":"2023-10-25T16:13:09.463985+0000","last_clean":"2023-10-25T16:13:09.463985+0000","last_became_active":"2023-10-25T16:13:07.585351+0000","last_became_peered":"2023-10-25T16:13:07.585351+0000","last_unstale":"2023-10-25T16:13:09.463985+0000","last_undegraded":"2023-10-25T16:13:09.463985+0000","last_fullsized":"2023-10-25T16:13:09.463985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186012+0000","last_change":"2023-10-25T16:13:07.572936+0000","last_active":"2023-10-25T16:13:09.186012+0000","last_peered":"2023-10-25T16:13:09.186012+0000","last_clean":"2023-10-25T16:13:09.186012+0000","last_became_active":"2023-10-25T16:13:07.572216+0000","last_became_peered":"2023-10-25T16:13:07.572216+0000","last_unstale":"2023-10-25T16:13:09.186012+0000","last_undegraded":"2023-10-25T16:13:09.186012+0000","last_fullsized":"2023-10-25T16:13:09.186012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:56.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480366+0000","last_change":"2023-10-25T16:13:07.567194+0000","last_active":"2023-10-25T16:13:09.480366+0000","last_peered":"2023-10-25T16:13:09.480366+0000","last_clean":"2023-10-25T16:13:09.480366+0000","last_became_active":"2023-10-25T16:13:07.561537+0000","last_became_peered":"2023-10-25T16:13:07.561537+0000","last_unstale":"2023-10-25T16:13:09.480366+0000","last_undegraded":"2023-10-25T16:13:09.480366+0000","last_fullsized":"2023-10-25T16:13:09.480366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477496+0000","last_change":"2023-10-25T16:13:07.567614+0000","last_active":"2023-10-25T16:13:09.477496+0000","last_peered":"2023-10-25T16:13:09.477496+0000","last_clean":"2023-10-25T16:13:09.477496+0000","last_became_active":"2023-10-25T16:13:07.564979+0000","last_became_peered":"2023-10-25T16:13:07.564979+0000","last_unstale":"2023-10-25T16:13:09.477496+0000","last_undegraded":"2023-10-25T16:13:09.477496+0000","last_fullsized":"2023-10-25T16:13:09.477496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:05.007750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478079+0000","last_change":"2023-10-25T16:13:07.562980+0000","last_active":"2023-10-25T16:13:09.478079+0000","last_peered":"2023-10-25T16:13:09.478079+0000","last_clean":"2023-10-25T16:13:09.478079+0000","last_became_active":"2023-10-25T16:13:07.562370+0000","last_became_peered":"2023-10-25T16:13:07.562370+0000","last_unstale":"2023-10-25T16:13:09.478079+0000","last_undegraded":"2023-10-25T16:13:09.478079+0000","last_fullsized":"2023-10-25T16:13:09.478079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545182+0000","last_change":"2023-10-25T16:13:07.587718+0000","last_active":"2023-10-25T16:13:08.545182+0000","last_peered":"2023-10-25T16:13:08.545182+0000","last_clean":"2023-10-25T16:13:08.545182+0000","last_became_active":"2023-10-25T16:13:07.584346+0000","last_became_peered":"2023-10-25T16:13:07.584346+0000","last_unstale":"2023-10-25T16:13:08.545182+0000","last_undegraded":"2023-10-25T16:13:08.545182+0000","last_fullsized":"2023-10-25T16:13:08.545182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544311+0000","last_change":"2023-10-25T16:13:07.590347+0000","last_active":"2023-10-25T16:13:08.544311+0000","last_peered":"2023-10-25T16:13:08.544311+0000","last_clean":"2023-10-25T16:13:08.544311+0000","last_became_active":"2023-10-25T16:13:07.589306+0000","last_became_peered":"2023-10-25T16:13:07.589306+0000","last_unstale":"2023-10-25T16:13:08.544311+0000","last_undegraded":"2023-10-25T16:13:08.544311+0000","last_fullsized":"2023-10-25T16:13:08.544311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480257+0000","last_change":"2023-10-25T16:13:07.571462+0000","last_active":"2023-10-25T16:13:09.480257+0000","last_peered":"2023-10-25T16:13:09.480257+0000","last_clean":"2023-10-25T16:13:09.480257+0000","last_became_active":"2023-10-25T16:13:07.571017+0000","last_became_peered":"2023-10-25T16:13:07.571017+0000","last_unstale":"2023-10-25T16:13:09.480257+0000","last_undegraded":"2023-10-25T16:13:09.480257+0000","last_fullsized":"2023-10-25T16:13:09.480257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541426+0000","last_change":"2023-10-25T16:13:07.565774+0000","last_active":"2023-10-25T16:13:08.541426+0000","last_peered":"2023-10-25T16:13:08.541426+0000","last_clean":"2023-10-25T16:13:08.541426+0000","last_became_active":"2023-10-25T16:13:07.564671+0000","last_became_peered":"2023-10-25T16:13:07.564671+0000","last_unstale":"2023-10-25T16:13:08.541426+0000","last_undegraded":"2023-10-25T16:13:08.541426+0000","last_fullsized":"2023-10-25T16:13:08.541426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464359+0000","last_change":"2023-10-25T16:13:07.569779+0000","last_active":"2023-10-25T16:13:09.464359+0000","last_peered":"2023-10-25T16:13:09.464359+0000","last_clean":"2023-10-25T16:13:09.464359+0000","last_became_active":"2023-10-25T16:13:07.568943+0000","last_became_peered":"2023-10-25T16:13:07.568943+0000","last_unstale":"2023-10-25T16:13:09.464359+0000","last_undegraded":"2023-10-25T16:13:09.464359+0000","last_fullsized":"2023-10-25T16:13:09.464359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478818+0000","last_change":"2023-10-25T16:13:07.588566+0000","last_active":"2023-10-25T16:13:09.478818+0000","last_peered":"2023-10-25T16:13:09.478818+0000","last_clean":"2023-10-25T16:13:09.478818+0000","last_became_active":"2023-10-25T16:13:07.586975+0000","last_became_peered":"2023-10-25T16:13:07.586975+0000","last_unstale":"2023-10-25T16:13:09.478818+0000","last_undegraded":"2023-10-25T16:13:09.478818+0000","last_fullsized":"2023-10-25T16:13:09.478818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544961+0000","last_change":"2023-10-25T16:13:07.589720+0000","last_active":"2023-10-25T16:13:08.544961+0000","last_peered":"2023-10-25T16:13:08.544961+0000","last_clean":"2023-10-25T16:13:08.544961+0000","last_became_active":"2023-10-25T16:13:07.587901+0000","last_became_peered":"2023-10-25T16:13:07.587901+0000","last_unstale":"2023-10-25T16:13:08.544961+0000","last_undegraded":"2023-10-25T16:13:08.544961+0000","last_fullsized":"2023-10-25T16:13:08.544961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481296+0000","last_change":"2023-10-25T16:13:07.564523+0000","last_active":"2023-10-25T16:13:09.481296+0000","last_peered":"2023-10-25T16:13:09.481296+0000","last_clean":"2023-10-25T16:13:09.481296+0000","last_became_active":"2023-10-25T16:13:07.558883+0000","last_became_peered":"2023-10-25T16:13:07.558883+0000","last_unstale":"2023-10-25T16:13:09.481296+0000","last_undegraded":"2023-10-25T16:13:09.481296+0000","last_fullsized":"2023-10-25T16:13:09.481296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544854+0000","last_change":"2023-10-25T16:13:07.565692+0000","last_active":"2023-10-25T16:13:08.544854+0000","last_peered":"2023-10-25T16:13:08.544854+0000","last_clean":"2023-10-25T16:13:08.544854+0000","last_became_active":"2023-10-25T16:13:07.565063+0000","last_became_peered":"2023-10-25T16:13:07.565063+0000","last_unstale":"2023-10-25T16:13:08.544854+0000","last_undegraded":"2023-10-25T16:13:08.544854+0000","last_fullsized":"2023-10-25T16:13:08.544854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478118+0000","last_change":"2023-10-25T16:13:07.567029+0000","last_active":"2023-10-25T16:13:09.478118+0000","last_peered":"2023-10-25T16:13:09.478118+0000","last_clean":"2023-10-25T16:13:09.478118+0000","last_became_active":"2023-10-25T16:13:07.563753+0000","last_became_peered":"2023-10-25T16:13:07.563753+0000","last_unstale":"2023-10-25T16:13:09.478118+0000","last_undegraded":"2023-10-25T16:13:09.478118+0000","last_fullsized":"2023-10-25T16:13:09.478118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464243+0000","last_change":"2023-10-25T16:13:07.571465+0000","last_active":"2023-10-25T16:13:09.464243+0000","last_peered":"2023-10-25T16:13:09.464243+0000","last_clean":"2023-10-25T16:13:09.464243+0000","last_became_active":"2023-10-25T16:13:07.570569+0000","last_became_peered":"2023-10-25T16:13:07.570569+0000","last_unstale":"2023-10-25T16:13:09.464243+0000","last_undegraded":"2023-10-25T16:13:09.464243+0000","last_fullsized":"2023-10-25T16:13:09.464243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478333+0000","last_change":"2023-10-25T16:13:07.552675+0000","last_active":"2023-10-25T16:13:09.478333+0000","last_peered":"2023-10-25T16:13:09.478333+0000","last_clean":"2023-10-25T16:13:09.478333+0000","last_became_active":"2023-10-25T16:13:07.551113+0000","last_became_peered":"2023-10-25T16:13:07.551113+0000","last_unstale":"2023-10-25T16:13:09.478333+0000","last_undegraded":"2023-10-25T16:13:09.478333+0000","last_fullsized":"2023-10-25T16:13:09.478333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480684+0000","last_change":"2023-10-25T16:13:07.563309+0000","last_active":"2023-10-25T16:13:09.480684+0000","last_peered":"2023-10-25T16:13:09.480684+0000","last_clean":"2023-10-25T16:13:09.480684+0000","last_became_active":"2023-10-25T16:13:07.556854+0000","last_became_peered":"2023-10-25T16:13:07.556854+0000","last_unstale":"2023-10-25T16:13:09.480684+0000","last_undegraded":"2023-10-25T16:13:09.480684+0000","last_fullsized":"2023-10-25T16:13:09.480684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481261+0000","last_change":"2023-10-25T16:13:07.563614+0000","last_active":"2023-10-25T16:13:09.481261+0000","last_peered":"2023-10-25T16:13:09.481261+0000","last_clean":"2023-10-25T16:13:09.481261+0000","last_became_active":"2023-10-25T16:13:07.562379+0000","last_became_peered":"2023-10-25T16:13:07.562379+0000","last_unstale":"2023-10-25T16:13:09.481261+0000","last_undegraded":"2023-10-25T16:13:09.481261+0000","last_fullsized":"2023-10-25T16:13:09.481261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544963+0000","last_change":"2023-10-25T16:13:07.575589+0000","last_active":"2023-10-25T16:13:08.544963+0000","last_peered":"2023-10-25T16:13:08.544963+0000","last_clean":"2023-10-25T16:13:08.544963+0000","last_became_active":"2023-10-25T16:13:07.569050+0000","last_became_peered":"2023-10-25T16:13:07.569050+0000","last_unstale":"2023-10-25T16:13:08.544963+0000","last_undegraded":"2023-10-25T16:13:08.544963+0000","last_fullsized":"2023-10-25T16:13:08.544963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477456+0000","last_change":"2023-10-25T16:13:07.586185+0000","last_active":"2023-10-25T16:13:09.477456+0000","last_peered":"2023-10-25T16:13:09.477456+0000","last_clean":"2023-10-25T16:13:09.477456+0000","last_became_active":"2023-10-25T16:13:07.585479+0000","last_became_peered":"2023-10-25T16:13:07.585479+0000","last_unstale":"2023-10-25T16:13:09.477456+0000","last_undegraded":"2023-10-25T16:13:09.477456+0000","last_fullsized":"2023-10-25T16:13:09.477456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464294+0000","last_change":"2023-10-25T16:13:07.571634+0000","last_active":"2023-10-25T16:13:09.464294+0000","last_peered":"2023-10-25T16:13:09.464294+0000","last_clean":"2023-10-25T16:13:09.464294+0000","last_became_active":"2023-10-25T16:13:07.570373+0000","last_became_peered":"2023-10-25T16:13:07.570373+0000","last_unstale":"2023-10-25T16:13:09.464294+0000","last_undegraded":"2023-10-25T16:13:09.464294+0000","last_fullsized":"2023-10-25T16:13:09.464294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185835+0000","last_change":"2023-10-25T16:13:07.554976+0000","last_active":"2023-10-25T16:13:09.185835+0000","last_peered":"2023-10-25T16:13:09.185835+0000","last_clean":"2023-10-25T16:13:09.185835+0000","last_became_active":"2023-10-25T16:13:07.554311+0000","last_became_peered":"2023-10-25T16:13:07.554311+0000","last_unstale":"2023-10-25T16:13:09.185835+0000","last_undegraded":"2023-10-25T16:13:09.185835+0000","last_fullsized":"2023-10-25T16:13:09.185835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479939+0000","last_change":"2023-10-25T16:13:06.604007+0000","last_active":"2023-10-25T16:13:09.479939+0000","last_peered":"2023-10-25T16:13:09.479939+0000","last_clean":"2023-10-25T16:13:09.479939+0000","last_became_active":"2023-10-25T16:13:06.603266+0000","last_became_peered":"2023-10-25T16:13:06.603266+0000","last_unstale":"2023-10-25T16:13:09.479939+0000","last_undegraded":"2023-10-25T16:13:09.479939+0000","last_fullsized":"2023-10-25T16:13:09.479939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478778+0000","last_change":"2023-10-25T16:13:07.559020+0000","last_active":"2023-10-25T16:13:09.478778+0000","last_peered":"2023-10-25T16:13:09.478778+0000","last_clean":"2023-10-25T16:13:09.478778+0000","last_became_active":"2023-10-25T16:13:07.558319+0000","last_became_peered":"2023-10-25T16:13:07.558319+0000","last_unstale":"2023-10-25T16:13:09.478778+0000","last_undegraded":"2023-10-25T16:13:09.478778+0000","last_fullsized":"2023-10-25T16:13:09.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464815+0000","last_change":"2023-10-25T16:13:06.598258+0000","last_active":"2023-10-25T16:13:09.464815+0000","last_peered":"2023-10-25T16:13:09.464815+0000","last_clean":"2023-10-25T16:13:09.464815+0000","last_became_active":"2023-10-25T16:13:06.597739+0000","last_became_peered":"2023-10-25T16:13:06.597739+0000","last_unstale":"2023-10-25T16:13:09.464815+0000","last_undegraded":"2023-10-25T16:13:09.464815+0000","last_fullsized":"2023-10-25T16:13:09.464815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480678+0000","last_change":"2023-10-25T16:13:06.593802+0000","last_active":"2023-10-25T16:13:09.480678+0000","last_peered":"2023-10-25T16:13:09.480678+0000","last_clean":"2023-10-25T16:13:09.480678+0000","last_became_active":"2023-10-25T16:13:06.591848+0000","last_became_peered":"2023-10-25T16:13:06.591848+0000","last_unstale":"2023-10-25T16:13:09.480678+0000","last_undegraded":"2023-10-25T16:13:09.480678+0000","last_fullsized":"2023-10-25T16:13:09.480678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478429+0000","last_change":"2023-10-25T16:13:07.564400+0000","last_active":"2023-10-25T16:13:09.478429+0000","last_peered":"2023-10-25T16:13:09.478429+0000","last_clean":"2023-10-25T16:13:09.478429+0000","last_became_active":"2023-10-25T16:13:07.560990+0000","last_became_peered":"2023-10-25T16:13:07.560990+0000","last_unstale":"2023-10-25T16:13:09.478429+0000","last_undegraded":"2023-10-25T16:13:09.478429+0000","last_fullsized":"2023-10-25T16:13:09.478429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545533+0000","last_change":"2023-10-25T16:13:06.585016+0000","last_active":"2023-10-25T16:13:08.545533+0000","last_peered":"2023-10-25T16:13:08.545533+0000","last_clean":"2023-10-25T16:13:08.545533+0000","last_became_active":"2023-10-25T16:13:06.584376+0000","last_became_peered":"2023-10-25T16:13:06.584376+0000","last_unstale":"2023-10-25T16:13:08.545533+0000","last_undegraded":"2023-10-25T16:13:08.545533+0000","last_fullsized":"2023-10-25T16:13:08.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479516+0000","last_change":"2023-10-25T16:13:07.559199+0000","last_active":"2023-10-25T16:13:09.479516+0000","last_peered":"2023-10-25T16:13:09.479516+0000","last_clean":"2023-10-25T16:13:09.479516+0000","last_became_active":"2023-10-25T16:13:07.556631+0000","last_became_peered":"2023-10-25T16:13:07.556631+0000","last_unstale":"2023-10-25T16:13:09.479516+0000","last_undegraded":"2023-10-25T16:13:09.479516+0000","last_fullsized":"2023-10-25T16:13:09.479516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464487+0000","last_change":"2023-10-25T16:13:06.584038+0000","last_active":"2023-10-25T16:13:09.464487+0000","last_peered":"2023-10-25T16:13:09.464487+0000","last_clean":"2023-10-25T16:13:09.464487+0000","last_became_active":"2023-10-25T16:13:06.583589+0000","last_became_peered":"2023-10-25T16:13:06.583589+0000","last_unstale":"2023-10-25T16:13:09.464487+0000","last_undegraded":"2023-10-25T16:13:09.464487+0000","last_fullsized":"2023-10-25T16:13:09.464487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544608+0000","last_change":"2023-10-25T16:13:07.590063+0000","last_active":"2023-10-25T16:13:08.544608+0000","last_peered":"2023-10-25T16:13:08.544608+0000","last_clean":"2023-10-25T16:13:08.544608+0000","last_became_active":"2023-10-25T16:13:07.588495+0000","last_became_peered":"2023-10-25T16:13:07.588495+0000","last_unstale":"2023-10-25T16:13:08.544608+0000","last_undegraded":"2023-10-25T16:13:08.544608+0000","last_fullsized":"2023-10-25T16:13:08.544608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546034+0000","last_change":"2023-10-25T16:13:06.590184+0000","last_active":"2023-10-25T16:13:08.546034+0000","last_peered":"2023-10-25T16:13:08.546034+0000","last_clean":"2023-10-25T16:13:08.546034+0000","last_became_active":"2023-10-25T16:13:06.588948+0000","last_became_peered":"2023-10-25T16:13:06.588948+0000","last_unstale":"2023-10-25T16:13:08.546034+0000","last_undegraded":"2023-10-25T16:13:08.546034+0000","last_fullsized":"2023-10-25T16:13:08.546034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479144+0000","last_change":"2023-10-25T16:13:07.586291+0000","last_active":"2023-10-25T16:13:09.479144+0000","last_peered":"2023-10-25T16:13:09.479144+0000","last_clean":"2023-10-25T16:13:09.479144+0000","last_became_active":"2023-10-25T16:13:07.585591+0000","last_became_peered":"2023-10-25T16:13:07.585591+0000","last_unstale":"2023-10-25T16:13:09.479144+0000","last_undegraded":"2023-10-25T16:13:09.479144+0000","last_fullsized":"2023-10-25T16:13:09.479144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480345+0000","last_change":"2023-10-25T16:13:06.583823+0000","last_active":"2023-10-25T16:13:09.480345+0000","last_peered":"2023-10-25T16:13:09.480345+0000","last_clean":"2023-10-25T16:13:09.480345+0000","last_became_active":"2023-10-25T16:13:06.583486+0000","last_became_peered":"2023-10-25T16:13:06.583486+0000","last_unstale":"2023-10-25T16:13:09.480345+0000","last_undegraded":"2023-10-25T16:13:09.480345+0000","last_fullsized":"2023-10-25T16:13:09.480345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:19.848515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185623+0000","last_change":"2023-10-25T16:13:07.568365+0000","last_active":"2023-10-25T16:13:09.185623+0000","last_peered":"2023-10-25T16:13:09.185623+0000","last_clean":"2023-10-25T16:13:09.185623+0000","last_became_active":"2023-10-25T16:13:07.567142+0000","last_became_peered":"2023-10-25T16:13:07.567142+0000","last_unstale":"2023-10-25T16:13:09.185623+0000","last_undegraded":"2023-10-25T16:13:09.185623+0000","last_fullsized":"2023-10-25T16:13:09.185623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464438+0000","last_change":"2023-10-25T16:13:06.595459+0000","last_active":"2023-10-25T16:13:09.464438+0000","last_peered":"2023-10-25T16:13:09.464438+0000","last_clean":"2023-10-25T16:13:09.464438+0000","last_became_active":"2023-10-25T16:13:06.594824+0000","last_became_peered":"2023-10-25T16:13:06.594824+0000","last_unstale":"2023-10-25T16:13:09.464438+0000","last_undegraded":"2023-10-25T16:13:09.464438+0000","last_fullsized":"2023-10-25T16:13:09.464438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541328+0000","last_change":"2023-10-25T16:13:07.577436+0000","last_active":"2023-10-25T16:13:08.541328+0000","last_peered":"2023-10-25T16:13:08.541328+0000","last_clean":"2023-10-25T16:13:08.541328+0000","last_became_active":"2023-10-25T16:13:07.567759+0000","last_became_peered":"2023-10-25T16:13:07.567759+0000","last_unstale":"2023-10-25T16:13:08.541328+0000","last_undegraded":"2023-10-25T16:13:08.541328+0000","last_fullsized":"2023-10-25T16:13:08.541328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480167+0000","last_change":"2023-10-25T16:13:06.591408+0000","last_active":"2023-10-25T16:13:09.480167+0000","last_peered":"2023-10-25T16:13:09.480167+0000","last_clean":"2023-10-25T16:13:09.480167+0000","last_became_active":"2023-10-25T16:13:06.591012+0000","last_became_peered":"2023-10-25T16:13:06.591012+0000","last_unstale":"2023-10-25T16:13:09.480167+0000","last_undegraded":"2023-10-25T16:13:09.480167+0000","last_fullsized":"2023-10-25T16:13:09.480167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479460+0000","last_change":"2023-10-25T16:13:07.589102+0000","last_active":"2023-10-25T16:13:09.479460+0000","last_peered":"2023-10-25T16:13:09.479460+0000","last_clean":"2023-10-25T16:13:09.479460+0000","last_became_active":"2023-10-25T16:13:07.587838+0000","last_became_peered":"2023-10-25T16:13:07.587838+0000","last_unstale":"2023-10-25T16:13:09.479460+0000","last_undegraded":"2023-10-25T16:13:09.479460+0000","last_fullsized":"2023-10-25T16:13:09.479460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546334+0000","last_change":"2023-10-25T16:13:06.589759+0000","last_active":"2023-10-25T16:13:08.546334+0000","last_peered":"2023-10-25T16:13:08.546334+0000","last_clean":"2023-10-25T16:13:08.546334+0000","last_became_active":"2023-10-25T16:13:06.589100+0000","last_became_peered":"2023-10-25T16:13:06.589100+0000","last_unstale":"2023-10-25T16:13:08.546334+0000","last_undegraded":"2023-10-25T16:13:08.546334+0000","last_fullsized":"2023-10-25T16:13:08.546334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542048+0000","last_change":"2023-10-25T16:13:07.577105+0000","last_active":"2023-10-25T16:13:08.542048+0000","last_peered":"2023-10-25T16:13:08.542048+0000","last_clean":"2023-10-25T16:13:08.542048+0000","last_became_active":"2023-10-25T16:13:07.565017+0000","last_became_peered":"2023-10-25T16:13:07.565017+0000","last_unstale":"2023-10-25T16:13:08.542048+0000","last_undegraded":"2023-10-25T16:13:08.542048+0000","last_fullsized":"2023-10-25T16:13:08.542048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464495+0000","last_change":"2023-10-25T16:13:06.598452+0000","last_active":"2023-10-25T16:13:09.464495+0000","last_peered":"2023-10-25T16:13:09.464495+0000","last_clean":"2023-10-25T16:13:09.464495+0000","last_became_active":"2023-10-25T16:13:06.597797+0000","last_became_peered":"2023-10-25T16:13:06.597797+0000","last_unstale":"2023-10-25T16:13:09.464495+0000","last_undegraded":"2023-10-25T16:13:09.464495+0000","last_fullsized":"2023-10-25T16:13:09.464495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464575+0000","last_change":"2023-10-25T16:13:07.569409+0000","last_active":"2023-10-25T16:13:09.464575+0000","last_peered":"2023-10-25T16:13:09.464575+0000","last_clean":"2023-10-25T16:13:09.464575+0000","last_became_active":"2023-10-25T16:13:07.561141+0000","last_became_peered":"2023-10-25T16:13:07.561141+0000","last_unstale":"2023-10-25T16:13:09.464575+0000","last_undegraded":"2023-10-25T16:13:09.464575+0000","last_fullsized":"2023-10-25T16:13:09.464575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.613385+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:07.613385+0000","last_peered":"2023-10-25T16:13:07.613385+0000","last_clean":"2023-10-25T16:13:07.613385+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:07.613385+0000","last_undegraded":"2023-10-25T16:13:07.613385+0000","last_fullsized":"2023-10-25T16:13:07.613385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:48.892031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542401+0000","last_change":"2023-10-25T16:13:07.586802+0000","last_active":"2023-10-25T16:13:08.542401+0000","last_peered":"2023-10-25T16:13:08.542401+0000","last_clean":"2023-10-25T16:13:08.542401+0000","last_became_active":"2023-10-25T16:13:07.586067+0000","last_became_peered":"2023-10-25T16:13:07.586067+0000","last_unstale":"2023-10-25T16:13:08.542401+0000","last_undegraded":"2023-10-25T16:13:08.542401+0000","last_fullsized":"2023-10-25T16:13:08.542401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185909+0000","last_change":"2023-10-25T16:13:06.576987+0000","last_active":"2023-10-25T16:13:09.185909+0000","last_peered":"2023-10-25T16:13:09.185909+0000","last_clean":"2023-10-25T16:13:09.185909+0000","last_became_active":"2023-10-25T16:13:06.576204+0000","last_became_peered":"2023-10-25T16:13:06.576204+0000","last_unstale":"2023-10-25T16:13:09.185909+0000","last_undegraded":"2023-10-25T16:13:09.185909+0000","last_fullsized":"2023-10-25T16:13:09.185909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:27.980983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542364+0000","last_change":"2023-10-25T16:13:07.577484+0000","last_active":"2023-10-25T16:13:08.542364+0000","last_peered":"2023-10-25T16:13:08.542364+0000","last_clean":"2023-10-25T16:13:08.542364+0000","last_became_active":"2023-10-25T16:13:07.566477+0000","last_became_peered":"2023-10-25T16:13:07.566477+0000","last_unstale":"2023-10-25T16:13:08.542364+0000","last_undegraded":"2023-10-25T16:13:08.542364+0000","last_fullsized":"2023-10-25T16:13:08.542364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.612118+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:07.612118+0000","last_peered":"2023-10-25T16:13:07.612118+0000","last_clean":"2023-10-25T16:13:07.612118+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:07.612118+0000","last_undegraded":"2023-10-25T16:13:07.612118+0000","last_fullsized":"2023-10-25T16:13:07.612118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:47.976238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541203+0000","last_change":"2023-10-25T16:13:07.565301+0000","last_active":"2023-10-25T16:13:08.541203+0000","last_peered":"2023-10-25T16:13:08.541203+0000","last_clean":"2023-10-25T16:13:08.541203+0000","last_became_active":"2023-10-25T16:13:07.563812+0000","last_became_peered":"2023-10-25T16:13:07.563812+0000","last_unstale":"2023-10-25T16:13:08.541203+0000","last_undegraded":"2023-10-25T16:13:08.541203+0000","last_fullsized":"2023-10-25T16:13:08.541203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478001+0000","last_change":"2023-10-25T16:13:06.583997+0000","last_active":"2023-10-25T16:13:09.478001+0000","last_peered":"2023-10-25T16:13:09.478001+0000","last_clean":"2023-10-25T16:13:09.478001+0000","last_became_active":"2023-10-25T16:13:06.583355+0000","last_became_peered":"2023-10-25T16:13:06.583355+0000","last_unstale":"2023-10-25T16:13:09.478001+0000","last_undegraded":"2023-10-25T16:13:09.478001+0000","last_fullsized":"2023-10-25T16:13:09.478001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545728+0000","last_change":"2023-10-25T16:13:07.576400+0000","last_active":"2023-10-25T16:13:08.545728+0000","last_peered":"2023-10-25T16:13:08.545728+0000","last_clean":"2023-10-25T16:13:08.545728+0000","last_became_active":"2023-10-25T16:13:07.575767+0000","last_became_peered":"2023-10-25T16:13:07.575767+0000","last_unstale":"2023-10-25T16:13:08.545728+0000","last_undegraded":"2023-10-25T16:13:08.545728+0000","last_fullsized":"2023-10-25T16:13:08.545728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.548907+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:07.548907+0000","last_peered":"2023-10-25T16:13:07.548907+0000","last_clean":"2023-10-25T16:13:07.548907+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:07.548907+0000","last_undegraded":"2023-10-25T16:13:07.548907+0000","last_fullsized":"2023-10-25T16:13:07.548907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:00.194766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541794+0000","last_change":"2023-10-25T16:13:07.587447+0000","last_active":"2023-10-25T16:13:08.541794+0000","last_peered":"2023-10-25T16:13:08.541794+0000","last_clean":"2023-10-25T16:13:08.541794+0000","last_became_active":"2023-10-25T16:13:07.586850+0000","last_became_peered":"2023-10-25T16:13:07.586850+0000","last_unstale":"2023-10-25T16:13:08.541794+0000","last_undegraded":"2023-10-25T16:13:08.541794+0000","last_fullsized":"2023-10-25T16:13:08.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.549368+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:13:07.549368+0000","last_peered":"2023-10-25T16:13:07.549368+0000","last_clean":"2023-10-25T16:13:07.549368+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:13:07.549368+0000","last_undegraded":"2023-10-25T16:13:07.549368+0000","last_fullsized":"2023-10-25T16:13:07.549368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546669+0000","last_change":"2023-10-25T16:13:06.587408+0000","last_active":"2023-10-25T16:13:08.546669+0000","last_peered":"2023-10-25T16:13:08.546669+0000","last_clean":"2023-10-25T16:13:08.546669+0000","last_became_active":"2023-10-25T16:13:06.586522+0000","last_became_peered":"2023-10-25T16:13:06.586522+0000","last_unstale":"2023-10-25T16:13:08.546669+0000","last_undegraded":"2023-10-25T16:13:08.546669+0000","last_fullsized":"2023-10-25T16:13:08.546669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:38.279671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479511+0000","last_change":"2023-10-25T16:13:07.576734+0000","last_active":"2023-10-25T16:13:09.479511+0000","last_peered":"2023-10-25T16:13:09.479511+0000","last_clean":"2023-10-25T16:13:09.479511+0000","last_became_active":"2023-10-25T16:13:07.575887+0000","last_became_peered":"2023-10-25T16:13:07.575887+0000","last_unstale":"2023-10-25T16:13:09.479511+0000","last_undegraded":"2023-10-25T16:13:09.479511+0000","last_fullsized":"2023-10-25T16:13:09.479511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541705+0000","last_change":"2023-10-25T16:13:06.603271+0000","last_active":"2023-10-25T16:13:08.541705+0000","last_peered":"2023-10-25T16:13:08.541705+0000","last_clean":"2023-10-25T16:13:08.541705+0000","last_became_active":"2023-10-25T16:13:06.602179+0000","last_became_peered":"2023-10-25T16:13:06.602179+0000","last_unstale":"2023-10-25T16:13:08.541705+0000","last_undegraded":"2023-10-25T16:13:08.541705+0000","last_fullsized":"2023-10-25T16:13:08.541705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479260+0000","last_change":"2023-10-25T16:13:07.563801+0000","last_active":"2023-10-25T16:13:09.479260+0000","last_peered":"2023-10-25T16:13:09.479260+0000","last_clean":"2023-10-25T16:13:09.479260+0000","last_became_active":"2023-10-25T16:13:07.561818+0000","last_became_peered":"2023-10-25T16:13:07.561818+0000","last_unstale":"2023-10-25T16:13:09.479260+0000","last_undegraded":"2023-10-25T16:13:09.479260+0000","last_fullsized":"2023-10-25T16:13:09.479260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.551983+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:07.551983+0000","last_peered":"2023-10-25T16:13:07.551983+0000","last_clean":"2023-10-25T16:13:07.551983+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:07.551983+0000","last_undegraded":"2023-10-25T16:13:07.551983+0000","last_fullsized":"2023-10-25T16:13:07.551983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:13:19.127582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479843+0000","last_change":"2023-10-25T16:13:07.559564+0000","last_active":"2023-10-25T16:13:09.479843+0000","last_peered":"2023-10-25T16:13:09.479843+0000","last_clean":"2023-10-25T16:13:09.479843+0000","last_became_active":"2023-10-25T16:13:07.558584+0000","last_became_peered":"2023-10-25T16:13:07.558584+0000","last_unstale":"2023-10-25T16:13:09.479843+0000","last_undegraded":"2023-10-25T16:13:09.479843+0000","last_fullsized":"2023-10-25T16:13:09.479843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546149+0000","last_change":"2023-10-25T16:13:06.583922+0000","last_active":"2023-10-25T16:13:08.546149+0000","last_peered":"2023-10-25T16:13:08.546149+0000","last_clean":"2023-10-25T16:13:08.546149+0000","last_became_active":"2023-10-25T16:13:06.581997+0000","last_became_peered":"2023-10-25T16:13:06.581997+0000","last_unstale":"2023-10-25T16:13:08.546149+0000","last_undegraded":"2023-10-25T16:13:08.546149+0000","last_fullsized":"2023-10-25T16:13:08.546149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185545+0000","last_change":"2023-10-25T16:13:07.560270+0000","last_active":"2023-10-25T16:13:09.185545+0000","last_peered":"2023-10-25T16:13:09.185545+0000","last_clean":"2023-10-25T16:13:09.185545+0000","last_became_active":"2023-10-25T16:13:07.559551+0000","last_became_peered":"2023-10-25T16:13:07.559551+0000","last_unstale":"2023-10-25T16:13:09.185545+0000","last_undegraded":"2023-10-25T16:13:09.185545+0000","last_fullsized":"2023-10-25T16:13:09.185545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:19.572019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478513+0000","last_change":"2023-10-25T16:13:06.588392+0000","last_active":"2023-10-25T16:13:09.478513+0000","last_peered":"2023-10-25T16:13:09.478513+0000","last_clean":"2023-10-25T16:13:09.478513+0000","last_became_active":"2023-10-25T16:13:06.588114+0000","last_became_peered":"2023-10-25T16:13:06.588114+0000","last_unstale":"2023-10-25T16:13:09.478513+0000","last_undegraded":"2023-10-25T16:13:09.478513+0000","last_fullsized":"2023-10-25T16:13:09.478513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545216+0000","last_change":"2023-10-25T16:13:07.563744+0000","last_active":"2023-10-25T16:13:08.545216+0000","last_peered":"2023-10-25T16:13:08.545216+0000","last_clean":"2023-10-25T16:13:08.545216+0000","last_became_active":"2023-10-25T16:13:07.563027+0000","last_became_peered":"2023-10-25T16:13:07.563027+0000","last_unstale":"2023-10-25T16:13:08.545216+0000","last_undegraded":"2023-10-25T16:13:08.545216+0000","last_fullsized":"2023-10-25T16:13:08.545216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541562+0000","last_change":"2023-10-25T16:13:06.604452+0000","last_active":"2023-10-25T16:13:08.541562+0000","last_peered":"2023-10-25T16:13:08.541562+0000","last_clean":"2023-10-25T16:13:08.541562+0000","last_became_active":"2023-10-25T16:13:06.603857+0000","last_became_peered":"2023-10-25T16:13:06.603857+0000","last_unstale":"2023-10-25T16:13:08.541562+0000","last_undegraded":"2023-10-25T16:13:08.541562+0000","last_fullsized":"2023-10-25T16:13:08.541562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477752+0000","last_change":"2023-10-25T16:13:07.555525+0000","last_active":"2023-10-25T16:13:09.477752+0000","last_peered":"2023-10-25T16:13:09.477752+0000","last_clean":"2023-10-25T16:13:09.477752+0000","last_became_active":"2023-10-25T16:13:07.554924+0000","last_became_peered":"2023-10-25T16:13:07.554924+0000","last_unstale":"2023-10-25T16:13:09.477752+0000","last_undegraded":"2023-10-25T16:13:09.477752+0000","last_fullsized":"2023-10-25T16:13:09.477752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480571+0000","last_change":"2023-10-25T16:13:06.588519+0000","last_active":"2023-10-25T16:13:09.480571+0000","last_peered":"2023-10-25T16:13:09.480571+0000","last_clean":"2023-10-25T16:13:09.480571+0000","last_became_active":"2023-10-25T16:13:06.587754+0000","last_became_peered":"2023-10-25T16:13:06.587754+0000","last_unstale":"2023-10-25T16:13:09.480571+0000","last_undegraded":"2023-10-25T16:13:09.480571+0000","last_fullsized":"2023-10-25T16:13:09.480571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479179+0000","last_change":"2023-10-25T16:13:07.577983+0000","last_active":"2023-10-25T16:13:09.479179+0000","last_peered":"2023-10-25T16:13:09.479179+0000","last_clean":"2023-10-25T16:13:09.479179+0000","last_became_active":"2023-10-25T16:13:07.577344+0000","last_became_peered":"2023-10-25T16:13:07.577344+0000","last_unstale":"2023-10-25T16:13:09.479179+0000","last_undegraded":"2023-10-25T16:13:09.479179+0000","last_fullsized":"2023-10-25T16:13:09.479179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464626+0000","last_change":"2023-10-25T16:13:06.595499+0000","last_active":"2023-10-25T16:13:09.464626+0000","last_peered":"2023-10-25T16:13:09.464626+0000","last_clean":"2023-10-25T16:13:09.464626+0000","last_became_active":"2023-10-25T16:13:06.594639+0000","last_became_peered":"2023-10-25T16:13:06.594639+0000","last_unstale":"2023-10-25T16:13:09.464626+0000","last_undegraded":"2023-10-25T16:13:09.464626+0000","last_fullsized":"2023-10-25T16:13:09.464626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478650+0000","last_change":"2023-10-25T16:13:07.568153+0000","last_active":"2023-10-25T16:13:09.478650+0000","last_peered":"2023-10-25T16:13:09.478650+0000","last_clean":"2023-10-25T16:13:09.478650+0000","last_became_active":"2023-10-25T16:13:07.567204+0000","last_became_peered":"2023-10-25T16:13:07.567204+0000","last_unstale":"2023-10-25T16:13:09.478650+0000","last_undegraded":"2023-10-25T16:13:09.478650+0000","last_fullsized":"2023-10-25T16:13:09.478650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542227+0000","last_change":"2023-10-25T16:13:06.605135+0000","last_active":"2023-10-25T16:13:08.542227+0000","last_peered":"2023-10-25T16:13:08.542227+0000","last_clean":"2023-10-25T16:13:08.542227+0000","last_became_active":"2023-10-25T16:13:06.604117+0000","last_became_peered":"2023-10-25T16:13:06.604117+0000","last_unstale":"2023-10-25T16:13:08.542227+0000","last_undegraded":"2023-10-25T16:13:08.542227+0000","last_fullsized":"2023-10-25T16:13:08.542227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186211+0000","last_change":"2023-10-25T16:13:07.570460+0000","last_active":"2023-10-25T16:13:09.186211+0000","last_peered":"2023-10-25T16:13:09.186211+0000","last_clean":"2023-10-25T16:13:09.186211+0000","last_became_active":"2023-10-25T16:13:07.565363+0000","last_became_peered":"2023-10-25T16:13:07.565363+0000","last_unstale":"2023-10-25T16:13:09.186211+0000","last_undegraded":"2023-10-25T16:13:09.186211+0000","last_fullsized":"2023-10-25T16:13:09.186211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:45.620922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478298+0000","last_change":"2023-10-25T16:13:06.607078+0000","last_active":"2023-10-25T16:13:09.478298+0000","last_peered":"2023-10-25T16:13:09.478298+0000","last_clean":"2023-10-25T16:13:09.478298+0000","last_became_active":"2023-10-25T16:13:06.606881+0000","last_became_peered":"2023-10-25T16:13:06.606881+0000","last_unstale":"2023-10-25T16:13:09.478298+0000","last_undegraded":"2023-10-25T16:13:09.478298+0000","last_fullsized":"2023-10-25T16:13:09.478298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480464+0000","last_change":"2023-10-25T16:13:07.546555+0000","last_active":"2023-10-25T16:13:09.480464+0000","last_peered":"2023-10-25T16:13:09.480464+0000","last_clean":"2023-10-25T16:13:09.480464+0000","last_became_active":"2023-10-25T16:13:07.545944+0000","last_became_peered":"2023-10-25T16:13:07.545944+0000","last_unstale":"2023-10-25T16:13:09.480464+0000","last_undegraded":"2023-10-25T16:13:09.480464+0000","last_fullsized":"2023-10-25T16:13:09.480464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480051+0000","last_change":"2023-10-25T16:13:06.589243+0000","last_active":"2023-10-25T16:13:09.480051+0000","last_peered":"2023-10-25T16:13:09.480051+0000","last_clean":"2023-10-25T16:13:09.480051+0000","last_became_active":"2023-10-25T16:13:06.588343+0000","last_became_peered":"2023-10-25T16:13:06.588343+0000","last_unstale":"2023-10-25T16:13:09.480051+0000","last_undegraded":"2023-10-25T16:13:09.480051+0000","last_fullsized":"2023-10-25T16:13:09.480051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480990+0000","last_change":"2023-10-25T16:13:07.569083+0000","last_active":"2023-10-25T16:13:09.480990+0000","last_peered":"2023-10-25T16:13:09.480990+0000","last_clean":"2023-10-25T16:13:09.480990+0000","last_became_active":"2023-10-25T16:13:07.562504+0000","last_became_peered":"2023-10-25T16:13:07.562504+0000","last_unstale":"2023-10-25T16:13:09.480990+0000","last_undegraded":"2023-10-25T16:13:09.480990+0000","last_fullsized":"2023-10-25T16:13:09.480990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541587+0000","last_change":"2023-10-25T16:13:06.603385+0000","last_active":"2023-10-25T16:13:08.541587+0000","last_peered":"2023-10-25T16:13:08.541587+0000","last_clean":"2023-10-25T16:13:08.541587+0000","last_became_active":"2023-10-25T16:13:06.602760+0000","last_became_peered":"2023-10-25T16:13:06.602760+0000","last_unstale":"2023-10-25T16:13:08.541587+0000","last_undegraded":"2023-10-25T16:13:08.541587+0000","last_fullsized":"2023-10-25T16:13:08.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:55.025836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464180+0000","last_change":"2023-10-25T16:13:07.569746+0000","last_active":"2023-10-25T16:13:09.464180+0000","last_peered":"2023-10-25T16:13:09.464180+0000","last_clean":"2023-10-25T16:13:09.464180+0000","last_became_active":"2023-10-25T16:13:07.568518+0000","last_became_peered":"2023-10-25T16:13:07.568518+0000","last_unstale":"2023-10-25T16:13:09.464180+0000","last_undegraded":"2023-10-25T16:13:09.464180+0000","last_fullsized":"2023-10-25T16:13:09.464180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545306+0000","last_change":"2023-10-25T16:13:07.576112+0000","last_active":"2023-10-25T16:13:08.545306+0000","last_peered":"2023-10-25T16:13:08.545306+0000","last_clean":"2023-10-25T16:13:08.545306+0000","last_became_active":"2023-10-25T16:13:07.574201+0000","last_became_peered":"2023-10-25T16:13:07.574201+0000","last_unstale":"2023-10-25T16:13:08.545306+0000","last_undegraded":"2023-10-25T16:13:08.545306+0000","last_fullsized":"2023-10-25T16:13:08.545306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542101+0000","last_change":"2023-10-25T16:13:06.604712+0000","last_active":"2023-10-25T16:13:08.542101+0000","last_peered":"2023-10-25T16:13:08.542101+0000","last_clean":"2023-10-25T16:13:08.542101+0000","last_became_active":"2023-10-25T16:13:06.602850+0000","last_became_peered":"2023-10-25T16:13:06.602850+0000","last_unstale":"2023-10-25T16:13:08.542101+0000","last_undegraded":"2023-10-25T16:13:08.542101+0000","last_fullsized":"2023-10-25T16:13:08.542101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545831+0000","last_change":"2023-10-25T16:13:07.585084+0000","last_active":"2023-10-25T16:13:08.545831+0000","last_peered":"2023-10-25T16:13:08.545831+0000","last_clean":"2023-10-25T16:13:08.545831+0000","last_became_active":"2023-10-25T16:13:07.582955+0000","last_became_peered":"2023-10-25T16:13:07.582955+0000","last_unstale":"2023-10-25T16:13:08.545831+0000","last_undegraded":"2023-10-25T16:13:08.545831+0000","last_fullsized":"2023-10-25T16:13:08.545831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542584+0000","last_change":"2023-10-25T16:13:06.606358+0000","last_active":"2023-10-25T16:13:08.542584+0000","last_peered":"2023-10-25T16:13:08.542584+0000","last_clean":"2023-10-25T16:13:08.542584+0000","last_became_active":"2023-10-25T16:13:06.602334+0000","last_became_peered":"2023-10-25T16:13:06.602334+0000","last_unstale":"2023-10-25T16:13:08.542584+0000","last_undegraded":"2023-10-25T16:13:08.542584+0000","last_fullsized":"2023-10-25T16:13:08.542584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478959+0000","last_change":"2023-10-25T16:13:07.566273+0000","last_active":"2023-10-25T16:13:09.478959+0000","last_peered":"2023-10-25T16:13:09.478959+0000","last_clean":"2023-10-25T16:13:09.478959+0000","last_became_active":"2023-10-25T16:13:07.562676+0000","last_became_peered":"2023-10-25T16:13:07.562676+0000","last_unstale":"2023-10-25T16:13:09.478959+0000","last_undegraded":"2023-10-25T16:13:09.478959+0000","last_fullsized":"2023-10-25T16:13:09.478959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480470+0000","last_change":"2023-10-25T16:13:06.594182+0000","last_active":"2023-10-25T16:13:09.480470+0000","last_peered":"2023-10-25T16:13:09.480470+0000","last_clean":"2023-10-25T16:13:09.480470+0000","last_became_active":"2023-10-25T16:13:06.592991+0000","last_became_peered":"2023-10-25T16:13:06.592991+0000","last_unstale":"2023-10-25T16:13:09.480470+0000","last_undegraded":"2023-10-25T16:13:09.480470+0000","last_fullsized":"2023-10-25T16:13:09.480470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480226+0000","last_change":"2023-10-25T16:13:07.564149+0000","last_active":"2023-10-25T16:13:09.480226+0000","last_peered":"2023-10-25T16:13:09.480226+0000","last_clean":"2023-10-25T16:13:09.480226+0000","last_became_active":"2023-10-25T16:13:07.561630+0000","last_became_peered":"2023-10-25T16:13:07.561630+0000","last_unstale":"2023-10-25T16:13:09.480226+0000","last_undegraded":"2023-10-25T16:13:09.480226+0000","last_fullsized":"2023-10-25T16:13:09.480226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479489+0000","last_change":"2023-10-25T16:13:06.603850+0000","last_active":"2023-10-25T16:13:09.479489+0000","last_peered":"2023-10-25T16:13:09.479489+0000","last_clean":"2023-10-25T16:13:09.479489+0000","last_became_active":"2023-10-25T16:13:06.603106+0000","last_became_peered":"2023-10-25T16:13:06.603106+0000","last_unstale":"2023-10-25T16:13:09.479489+0000","last_undegraded":"2023-10-25T16:13:09.479489+0000","last_fullsized":"2023-10-25T16:13:09.479489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924855,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3919999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199931029,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":67,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195245,"statfs":{"total":200000000,"available":199930995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":644,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194668,"statfs":{"total":200000000,"available":199340149,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1029999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2320000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1219999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1349999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.891999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:15.333 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:13:15.334 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-10-25T16:13:15.334 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-25T16:13:15.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 -- 172.21.15.177:0/861510955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 msgr2=0x7f8abc0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 --2- 172.21.15.177:0/861510955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c9d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009840 tx=0x7f8aac01c7c0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 -- 172.21.15.177:0/861510955 shutdown_connections 2023-10-25T16:13:15.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 --2- 172.21.15.177:0/861510955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c9d10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 -- 172.21.15.177:0/861510955 >> 172.21.15.177:0/861510955 conn(0x7f8abc0b0de0 msgr2=0x7f8abc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:15.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 -- 172.21.15.177:0/861510955 shutdown_connections 2023-10-25T16:13:15.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 -- 172.21.15.177:0/861510955 wait complete. 2023-10-25T16:13:15.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 Processor -- start 2023-10-25T16:13:15.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.491+0000 7f8ac3960640 1 -- start start 2023-10-25T16:13:15.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc156e60 0x7f8abc15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc15b1f0 0x7f8abc1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c4250 con 0x7f8abc0c9880 2023-10-25T16:13:15.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c4530 con 0x7f8abc156e60 2023-10-25T16:13:15.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0c4810 con 0x7f8abc15b1f0 2023-10-25T16:13:15.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43426/0 (socket says 172.21.15.177:43426) 2023-10-25T16:13:15.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 -- 172.21.15.177:0/1082677664 learned_addr learned my addr 172.21.15.177:0/1082677664 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:15.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac0efb640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc156e60 0x7f8abc15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 -- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc15b1f0 msgr2=0x7f8abc1500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac1efd640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc15b1f0 0x7f8abc1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc15b1f0 0x7f8abc1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 -- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc156e60 msgr2=0x7f8abc15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc156e60 0x7f8abc15d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 -- 172.21.15.177:0/1082677664 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0094a0 con 0x7f8abc0c9880 2023-10-25T16:13:15.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac16fc640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c3730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c450 tx=0x7f8ab800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:15.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8012830 con 0x7f8abc0c9880 2023-10-25T16:13:15.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8ab8012aa0 con 0x7f8abc0c9880 2023-10-25T16:13:15.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8011380 con 0x7f8abc0c9880 2023-10-25T16:13:15.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc0c4af0 con 0x7f8abc0c9880 2023-10-25T16:13:15.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc0c3c70 con 0x7f8abc0c9880 2023-10-25T16:13:15.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc04daf0 con 0x7f8abc0c9880 2023-10-25T16:13:15.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ab80114e0 con 0x7f8abc0c9880 2023-10-25T16:13:15.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ab1ffb640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab8083940 con 0x7f8abc0c9880 2023-10-25T16:13:15.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.495+0000 7f8ac0efb640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.499+0000 7f8ac0efb640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0af000 tx=0x7f8aac01b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:15.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.499+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ab8050e50 con 0x7f8abc0c9880 2023-10-25T16:13:15.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.651+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f8abc065cf0 con 0x7f8abc0c9880 2023-10-25T16:13:15.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.651+0000 7f8ab1ffb640 1 -- 172.21.15.177:0/1082677664 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v18) v1 ==== 86+0+146 (secure 0 0 0) 0x7f8ab8054470 con 0x7f8abc0c9880 2023-10-25T16:13:15.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 msgr2=0x7f8aa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0af000 tx=0x7f8aac01b000 comp rx=0 tx=0).stop 2023-10-25T16:13:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 msgr2=0x7f8abc0c3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c3730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c450 tx=0x7f8ab800c910 comp rx=0 tx=0).stop 2023-10-25T16:13:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 shutdown_connections 2023-10-25T16:13:15.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8abc15b1f0 0x7f8abc1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8abc156e60 0x7f8abc15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 --2- 172.21.15.177:0/1082677664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8abc0c9880 0x7f8abc0c3730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 >> 172.21.15.177:0/1082677664 conn(0x7f8abc0b0de0 msgr2=0x7f8abc157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 shutdown_connections 2023-10-25T16:13:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.655+0000 7f8ac3960640 1 -- 172.21.15.177:0/1082677664 wait complete. 2023-10-25T16:13:15.675 INFO:teuthology.orchestra.run.smithi177.stdout:[{"version":18,"timestamp":"2023-10-25T16:12:49.389710+0000","name":"","changes":[{"name":"osd/osd_op_complaint_time","new_value":"180.000000"}]}] 2023-10-25T16:13:15.675 INFO:tasks.ceph_manager:config epoch is 18 2023-10-25T16:13:15.675 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-25T16:13:15.676 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-25T16:13:15.676 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-25T16:13:15.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/876402613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 msgr2=0x7f48f80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 --2- 172.21.15.177:0/876402613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80aebc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0098f0 tx=0x7f48ec01c880 comp rx=0 tx=0).stop 2023-10-25T16:13:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/876402613 shutdown_connections 2023-10-25T16:13:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 --2- 172.21.15.177:0/876402613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80aebc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 --2- 172.21.15.177:0/876402613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f814e810 0x7f48f80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/876402613 >> 172.21.15.177:0/876402613 conn(0x7f48f80b2450 msgr2=0x7f48f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/876402613 shutdown_connections 2023-10-25T16:13:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/876402613 wait complete. 2023-10-25T16:13:15.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 Processor -- start 2023-10-25T16:13:15.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- start start 2023-10-25T16:13:15.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f80af100 0x7f48f815f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f814e810 0x7f48f81488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f815cc40 con 0x7f48f815bdb0 2023-10-25T16:13:15.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80ad4d0 con 0x7f48f814e810 2023-10-25T16:13:15.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80ad7b0 con 0x7f48f80af100 2023-10-25T16:13:15.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43444/0 (socket says 172.21.15.177:43444) 2023-10-25T16:13:15.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 -- 172.21.15.177:0/932768519 learned_addr learned my addr 172.21.15.177:0/932768519 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:15.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fd604640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f80af100 0x7f48f815f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fce03640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f814e810 0x7f48f81488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 -- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f80af100 msgr2=0x7f48f815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f80af100 0x7f48f815f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 -- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f814e810 msgr2=0x7f48f81488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f814e810 0x7f48f81488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 -- 172.21.15.177:0/932768519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec009500 con 0x7f48f815bdb0 2023-10-25T16:13:15.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fce03640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f814e810 0x7f48f81488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:15.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fd604640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f80af100 0x7f48f815f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:15.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48fde05640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80acb60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c410 tx=0x7f48e800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:15.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8003600 con 0x7f48f815bdb0 2023-10-25T16:13:15.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f48e8003760 con 0x7f48f815bdb0 2023-10-25T16:13:15.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f80ada90 con 0x7f48f815bdb0 2023-10-25T16:13:15.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8003bb0 con 0x7f48f815bdb0 2023-10-25T16:13:15.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.787+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f80ad0a0 con 0x7f48f815bdb0 2023-10-25T16:13:15.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.791+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f815cdb0 con 0x7f48f815bdb0 2023-10-25T16:13:15.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.791+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f48e8003d10 con 0x7f48f815bdb0 2023-10-25T16:13:15.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.791+0000 7f48f5ffb640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48e4066470 0x7f48e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:15.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.791+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48e8083510 con 0x7f48f815bdb0 2023-10-25T16:13:15.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.791+0000 7f48fd604640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48e4066470 0x7f48e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:15.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.791+0000 7f48fd604640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48e4066470 0x7f48e4068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48f0005c50 tx=0x7f48f0008310 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:15.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.795+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48e8050a20 con 0x7f48f815bdb0 2023-10-25T16:13:15.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.979+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f48f804daf0 con 0x7f48f815bdb0 2023-10-25T16:13:15.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.983+0000 7f48f5ffb640 1 -- 172.21.15.177:0/932768519 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164437 (secure 0 0 0) 0x7f48e8081e60 con 0x7f48f815bdb0 2023-10-25T16:13:15.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:15.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48e4066470 msgr2=0x7f48e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48e4066470 0x7f48e4068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48f0005c50 tx=0x7f48f0008310 comp rx=0 tx=0).stop 2023-10-25T16:13:15.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 msgr2=0x7f48f80acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:15.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80acb60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c410 tx=0x7f48e800c8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 shutdown_connections 2023-10-25T16:13:15.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48e4066470 0x7f48e4068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48f815bdb0 0x7f48f80acb60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48f814e810 0x7f48f81488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 --2- 172.21.15.177:0/932768519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48f80af100 0x7f48f815f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:15.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 >> 172.21.15.177:0/932768519 conn(0x7f48f80b2450 msgr2=0x7f48f80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:15.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 shutdown_connections 2023-10-25T16:13:15.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:15.987+0000 7f48ff868640 1 -- 172.21.15.177:0/932768519 wait complete. 2023-10-25T16:13:16.005 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":5,"active_gid":4138,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1169577116},{"type":"v1","addr":"172.21.15.184:6833","nonce":1169577116}]},"active_addr":"172.21.15.184:6833/1169577116","active_change":"2023-10-25T16:12:52.572377+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4158,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3376752492}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":2703174020}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1573764419}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":2883178765}]}]} 2023-10-25T16:13:16.010 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-25T16:13:16.010 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-25T16:13:16.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:16.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/2525431697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051015c630 msgr2=0x7f05101585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 --2- 172.21.15.177:0/2525431697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051015c630 0x7f05101585b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0500009840 tx=0x7f050001c7c0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/2525431697 shutdown_connections 2023-10-25T16:13:16.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 --2- 172.21.15.177:0/2525431697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051015c630 0x7f05101585b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/2525431697 >> 172.21.15.177:0/2525431697 conn(0x7f051006c820 msgr2=0x7f051006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/2525431697 shutdown_connections 2023-10-25T16:13:16.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/2525431697 wait complete. 2023-10-25T16:13:16.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 Processor -- start 2023-10-25T16:13:16.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- start start 2023-10-25T16:13:16.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 0x7f0510138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f051015c250 0x7f0510152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f051015c630 0x7f05101394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510139310 con 0x7f051006dbd0 2023-10-25T16:13:16.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510153680 con 0x7f051015c630 2023-10-25T16:13:16.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0510141140 con 0x7f051015c250 2023-10-25T16:13:16.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 0x7f0510138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 0x7f0510138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43460/0 (socket says 172.21.15.177:43460) 2023-10-25T16:13:16.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 -- 172.21.15.177:0/3874054653 learned_addr learned my addr 172.21.15.177:0/3874054653 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0516645640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f051015c630 0x7f05101394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515643640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f051015c250 0x7f0510152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 -- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f051015c250 msgr2=0x7f0510152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f051015c250 0x7f0510152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 -- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f051015c630 msgr2=0x7f05101394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f051015c630 0x7f05101394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 -- 172.21.15.177:0/3874054653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000094a0 con 0x7f051006dbd0 2023-10-25T16:13:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0516645640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f051015c630 0x7f05101394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:16.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515643640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f051015c250 0x7f0510152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:16.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f0515e44640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 0x7f0510138dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f050c00c450 tx=0x7f050c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c012830 con 0x7f051006dbd0 2023-10-25T16:13:16.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f050c012aa0 con 0x7f051006dbd0 2023-10-25T16:13:16.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05101538d0 con 0x7f051006dbd0 2023-10-25T16:13:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c011380 con 0x7f051006dbd0 2023-10-25T16:13:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.131+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0510140dd0 con 0x7f051006dbd0 2023-10-25T16:13:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.135+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051004daf0 con 0x7f051006dbd0 2023-10-25T16:13:16.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.135+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f050c0114e0 con 0x7f051006dbd0 2023-10-25T16:13:16.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.135+0000 7f05067fc640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04f4066470 0x7f04f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.135+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f050c083f90 con 0x7f051006dbd0 2023-10-25T16:13:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.135+0000 7f0515643640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04f4066470 0x7f04f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.135+0000 7f0515643640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04f4066470 0x7f04f4068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05000af000 tx=0x7f050001b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.139+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f050c0b5090 con 0x7f051006dbd0 2023-10-25T16:13:16.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.295+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f051006d050 con 0x7f051006dbd0 2023-10-25T16:13:16.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.295+0000 7f05067fc640 1 -- 172.21.15.177:0/3874054653 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f050c0514a0 con 0x7f051006dbd0 2023-10-25T16:13:16.300 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:16.301 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:16.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04f4066470 msgr2=0x7f04f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04f4066470 0x7f04f4068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05000af000 tx=0x7f050001b000 comp rx=0 tx=0).stop 2023-10-25T16:13:16.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 msgr2=0x7f0510138dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 0x7f0510138dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f050c00c450 tx=0x7f050c00c910 comp rx=0 tx=0).stop 2023-10-25T16:13:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 shutdown_connections 2023-10-25T16:13:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04f4066470 0x7f04f4068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f051015c630 0x7f05101394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f051015c250 0x7f0510152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 --2- 172.21.15.177:0/3874054653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f051006dbd0 0x7f0510138dd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 >> 172.21.15.177:0/3874054653 conn(0x7f051006c820 msgr2=0x7f051013bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 shutdown_connections 2023-10-25T16:13:16.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.299+0000 7f05180a8640 1 -- 172.21.15.177:0/3874054653 wait complete. 2023-10-25T16:13:16.319 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-25T16:13:16.320 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:16.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/4104836111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67940047d0 msgr2=0x7f6794004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/4104836111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67940047d0 0x7f6794004c50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ca230 tx=0x7f67a001d210 comp rx=0 tx=0).stop 2023-10-25T16:13:16.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 -- 172.21.15.177:0/4104836111 reap_dead start 2023-10-25T16:13:16.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/4104836111 shutdown_connections 2023-10-25T16:13:16.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/4104836111 >> 172.21.15.177:0/4104836111 conn(0x7f67ac0b2450 msgr2=0x7f67ac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/4104836111 shutdown_connections 2023-10-25T16:13:16.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/4104836111 wait complete. 2023-10-25T16:13:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 Processor -- start 2023-10-25T16:13:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- start start 2023-10-25T16:13:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67940047d0 0x7f67ac0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67ac0b0030 0x7f67ac155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 0x7f67ac145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0b1120 con 0x7f67ac145490 2023-10-25T16:13:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac145e40 con 0x7f67ac0b0030 2023-10-25T16:13:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0acb10 con 0x7f67940047d0 2023-10-25T16:13:16.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 0x7f67ac145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 0x7f67ac145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43482/0 (socket says 172.21.15.177:43482) 2023-10-25T16:13:16.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 -- 172.21.15.177:0/1977241716 learned_addr learned my addr 172.21.15.177:0/1977241716 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aa59c640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67940047d0 0x7f67ac0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67a9d9b640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67ac0b0030 0x7f67ac155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 -- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67940047d0 msgr2=0x7f67ac0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67940047d0 0x7f67ac0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 -- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67ac0b0030 msgr2=0x7f67ac155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67ac0b0030 0x7f67ac155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 -- 172.21.15.177:0/1977241716 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0b0510 con 0x7f67ac145490 2023-10-25T16:13:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67aad9d640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 0x7f67ac145900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ccde0 tx=0x7f67a400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a400a4e0 con 0x7f67ac145490 2023-10-25T16:13:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f67a400a730 con 0x7f67ac145490 2023-10-25T16:13:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4017420 con 0x7f67ac145490 2023-10-25T16:13:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac0b07f0 con 0x7f67ac145490 2023-10-25T16:13:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.439+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac0b0db0 con 0x7f67ac145490 2023-10-25T16:13:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.443+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac0c9780 con 0x7f67ac145490 2023-10-25T16:13:16.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.443+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f67a40163c0 con 0x7f67ac145490 2023-10-25T16:13:16.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.443+0000 7f679affd640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f678c0664a0 0x7f678c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.443+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67a4086790 con 0x7f67ac145490 2023-10-25T16:13:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.443+0000 7f67aa59c640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f678c0664a0 0x7f678c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.443+0000 7f67aa59c640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f678c0664a0 0x7f678c068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f679c0099f0 tx=0x7f679c0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.447+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f67a4053ca0 con 0x7f67ac145490 2023-10-25T16:13:16.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.603+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67ac06c370 con 0x7f67ac145490 2023-10-25T16:13:16.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f679affd640 1 -- 172.21.15.177:0/1977241716 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f67ac06c370 con 0x7f67ac145490 2023-10-25T16:13:16.611 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:16.611 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:16.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f678c0664a0 msgr2=0x7f678c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f678c0664a0 0x7f678c068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f679c0099f0 tx=0x7f679c0091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 msgr2=0x7f67ac145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 0x7f67ac145900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ccde0 tx=0x7f67a400f740 comp rx=0 tx=0).stop 2023-10-25T16:13:16.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 shutdown_connections 2023-10-25T16:13:16.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f678c0664a0 0x7f678c068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67ac145490 0x7f67ac145900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67ac0b0030 0x7f67ac155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 --2- 172.21.15.177:0/1977241716 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67940047d0 0x7f67ac0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 >> 172.21.15.177:0/1977241716 conn(0x7f67ac0b2450 msgr2=0x7f67ac0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 shutdown_connections 2023-10-25T16:13:16.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.607+0000 7f67b0e6e640 1 -- 172.21.15.177:0/1977241716 wait complete. 2023-10-25T16:13:16.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-25T16:13:16.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-25T16:13:16.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-25T16:13:16.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-25T16:13:16.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-25T16:13:16.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-25T16:13:16.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-25T16:13:16.634 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-25T16:13:16.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.811+0000 7f78b7669640 1 -- 172.21.15.177:0/3724391273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00aa6c0 msgr2=0x7f78b015ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.811+0000 7f78b7669640 1 --2- 172.21.15.177:0/3724391273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00aa6c0 0x7f78b015ed80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009c80 tx=0x7f78a801c860 comp rx=0 tx=0).stop 2023-10-25T16:13:16.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.811+0000 7f78b7669640 1 -- 172.21.15.177:0/3724391273 shutdown_connections 2023-10-25T16:13:16.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.811+0000 7f78b7669640 1 --2- 172.21.15.177:0/3724391273 >> v2:172.21.15.184:3300/0 conn(0x7f78b00ac3f0 0x7f78b015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.811+0000 7f78b7669640 1 --2- 172.21.15.177:0/3724391273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00aa6c0 0x7f78b015ed80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.811+0000 7f78b7669640 1 -- 172.21.15.177:0/3724391273 >> 172.21.15.177:0/3724391273 conn(0x7f78b00ccd00 msgr2=0x7f78b00cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 -- 172.21.15.177:0/913126831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 msgr2=0x7f804c006c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 --2- 172.21.15.177:0/913126831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 0x7f804c006c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f805402caf0 tx=0x7f8054097720 comp rx=0 tx=0).stop 2023-10-25T16:13:16.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 -- 172.21.15.177:0/913126831 shutdown_connections 2023-10-25T16:13:16.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 --2- 172.21.15.177:0/913126831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 0x7f804c006c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 --2- 172.21.15.177:0/913126831 >> v2:172.21.15.177:3300/0 conn(0x7f804c0df740 0x7f804c006700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 -- 172.21.15.177:0/913126831 >> 172.21.15.177:0/913126831 conn(0x7f804c009f90 msgr2=0x7f804c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 -- 172.21.15.177:0/913126831 shutdown_connections 2023-10-25T16:13:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3884746483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 msgr2=0x7fdc080cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 --2- 172.21.15.177:0/3884746483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 0x7fdc080cfb40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc080b1c40 tx=0x7fdc0001ccf0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3884746483 shutdown_connections 2023-10-25T16:13:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 --2- 172.21.15.177:0/3884746483 >> v2:172.21.15.177:3300/0 conn(0x7fdc080aefc0 0x7fdc080cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 --2- 172.21.15.177:0/3884746483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 0x7fdc080cfb40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3884746483 >> 172.21.15.177:0/3884746483 conn(0x7fdc08088fd0 msgr2=0x7fdc080cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3884746483 shutdown_connections 2023-10-25T16:13:16.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 -- 172.21.15.177:0/3724391273 shutdown_connections 2023-10-25T16:13:16.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 -- 172.21.15.177:0/3724391273 wait complete. 2023-10-25T16:13:16.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 Processor -- start 2023-10-25T16:13:16.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 -- start start 2023-10-25T16:13:16.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 -- 172.21.15.177:0/1916720788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a40047d0 msgr2=0x7fe9a4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bcd44640 1 -- 172.21.15.177:0/1916720788 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8006330 con 0x7fe9a40047d0 2023-10-25T16:13:16.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 --2- 172.21.15.177:0/1916720788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a40047d0 0x7fe9a4004c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800c730 tx=0x7fe9a801c6c0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 -- 172.21.15.177:0/913126831 wait complete. 2023-10-25T16:13:16.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 Processor -- start 2023-10-25T16:13:16.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 -- 172.21.15.177:0/1916720788 shutdown_connections 2023-10-25T16:13:16.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 --2- 172.21.15.177:0/1916720788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9a40047d0 0x7fe9a4004c50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 -- 172.21.15.177:0/1916720788 >> 172.21.15.177:0/1916720788 conn(0x7fe9b80afb10 msgr2=0x7fe9b80aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 -- 172.21.15.177:0/1916720788 shutdown_connections 2023-10-25T16:13:16.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b00aa6c0 0x7f78b020abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00ac3f0 0x7f78b014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b015e6f0 0x7f78b00ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b020b110 con 0x7f78b015e6f0 2023-10-25T16:13:16.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0088e80 con 0x7f78b00aa6c0 2023-10-25T16:13:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b7669640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b014c100 con 0x7f78b00ac3f0 2023-10-25T16:13:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b4c04640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00ac3f0 0x7f78b014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b4c04640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00ac3f0 0x7f78b014c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48736/0 (socket says 172.21.15.177:48736) 2023-10-25T16:13:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f78b4c04640 1 -- 172.21.15.177:0/1558750586 learned_addr learned my addr 172.21.15.177:0/1558750586 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7f805933f640 1 -- start start 2023-10-25T16:13:16.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fe9bffaa640 1 -- 172.21.15.177:0/1916720788 wait complete. 2023-10-25T16:13:16.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.815+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3884746483 wait complete. 2023-10-25T16:13:16.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 Processor -- start 2023-10-25T16:13:16.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b5c06640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b015e6f0 0x7f78b00ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b5405640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b00aa6c0 0x7f78b020abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f804c0535f0 0x7f804c0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 0x7f804c04ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f804c0df740 0x7f804c0d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0475c0 con 0x7f804c0535f0 2023-10-25T16:13:16.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0471c0 con 0x7f804c0df740 2023-10-25T16:13:16.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0c8850 con 0x7f804c0543a0 2023-10-25T16:13:16.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b4c04640 1 -- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b00aa6c0 msgr2=0x7f78b020abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b4c04640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b00aa6c0 0x7f78b020abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b4c04640 1 -- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b015e6f0 msgr2=0x7f78b00ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b4c04640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b015e6f0 0x7f78b00ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b4c04640 1 -- 172.21.15.177:0/1558750586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80098e0 con 0x7f78b00ac3f0 2023-10-25T16:13:16.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 -- start start 2023-10-25T16:13:16.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f804c0535f0 0x7f804c0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f80537fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f804c0df740 0x7f804c0d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f804c0535f0 0x7f804c0c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43510/0 (socket says 172.21.15.177:43510) 2023-10-25T16:13:16.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 -- 172.21.15.177:0/1116295219 learned_addr learned my addr 172.21.15.177:0/1116295219 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f80527fc640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 0x7f804c04ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b4c04640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00ac3f0 0x7f78b014c590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c750 tx=0x7f78a000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/2256760463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 msgr2=0x7f7e70009e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 --2- 172.21.15.177:0/2256760463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 0x7f7e70009e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7e7804ed90 tx=0x7f7e78094e60 comp rx=0 tx=0).stop 2023-10-25T16:13:16.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/2256760463 shutdown_connections 2023-10-25T16:13:16.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 --2- 172.21.15.177:0/2256760463 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 0x7f7e70009e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 --2- 172.21.15.177:0/2256760463 >> v2:172.21.15.184:3300/0 conn(0x7f7e700e13b0 0x7f7e70054880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/2256760463 >> 172.21.15.177:0/2256760463 conn(0x7f7e700537c0 msgr2=0x7f7e70053bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b5c06640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b015e6f0 0x7f78b00ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T16:13:16.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 -- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 msgr2=0x7f804c04ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f804c0543a0 0x7f804c04ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 -- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f804c0df740 msgr2=0x7f804c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f804c0df740 0x7f804c0d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 -- 172.21.15.177:0/1116295219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c046c20 con 0x7f804c0535f0 2023-10-25T16:13:16.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 Processor -- start 2023-10-25T16:13:16.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 0x7fdc0806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc080aefc0 0x7fdc080c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc080cd950 0x7fdc0815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0815b8e0 con 0x7fdc080aefc0 2023-10-25T16:13:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0806c8a0 con 0x7fdc080addf0 2023-10-25T16:13:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08154210 con 0x7fdc080cd950 2023-10-25T16:13:16.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 -- 172.21.15.177:0/3826126168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac1518e0 msgr2=0x7ff1ac0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 --2- 172.21.15.177:0/3826126168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac1518e0 0x7ff1ac0b1690 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009870 tx=0x7ff19c01c880 comp rx=0 tx=0).stop 2023-10-25T16:13:16.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0005270 con 0x7f78b00ac3f0 2023-10-25T16:13:16.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78a00054c0 con 0x7f78b00ac3f0 2023-10-25T16:13:16.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b014cad0 con 0x7f78b00ac3f0 2023-10-25T16:13:16.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b014b7d0 con 0x7f78b00ac3f0 2023-10-25T16:13:16.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a000a8a0 con 0x7f78b00ac3f0 2023-10-25T16:13:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0d322640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc080aefc0 0x7fdc080c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0d322640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc080aefc0 0x7fdc080c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43512/0 (socket says 172.21.15.177:43512) 2023-10-25T16:13:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0d322640 1 -- 172.21.15.177:0/3482313588 learned_addr learned my addr 172.21.15.177:0/3482313588 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc080cd950 0x7fdc0815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0db23640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 0x7fdc0806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/2256760463 shutdown_connections 2023-10-25T16:13:16.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 -- 172.21.15.177:0/3826126168 shutdown_connections 2023-10-25T16:13:16.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 --2- 172.21.15.177:0/3826126168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac1518e0 0x7ff1ac0b1690 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 -- 172.21.15.177:0/3826126168 >> 172.21.15.177:0/3826126168 conn(0x7ff1ac0aea90 msgr2=0x7ff1ac0aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f8052ffd640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f804c0535f0 0x7f804c0c89e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f804800b410 tx=0x7f804800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 -- start start 2023-10-25T16:13:16.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b8151fa0 0x7fe9b8097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9b8152380 0x7fe9b80ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b80cade0 0x7fe9b81f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bdd46640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b8151fa0 0x7fe9b8097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bdd46640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b8151fa0 0x7fe9b8097a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48758/0 (socket says 172.21.15.177:48758) 2023-10-25T16:13:16.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 -- 172.21.15.177:0/3826126168 shutdown_connections 2023-10-25T16:13:16.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 -- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 msgr2=0x7fdc0806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc080addf0 0x7fdc0806ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 -- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc080aefc0 msgr2=0x7fdc080c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc080aefc0 0x7fdc080c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 -- 172.21.15.177:0/3482313588 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000098e0 con 0x7fdc080cd950 2023-10-25T16:13:16.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b80cade0 0x7fe9b81f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b80cade0 0x7fe9b81f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43514/0 (socket says 172.21.15.177:43514) 2023-10-25T16:13:16.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/2256760463 wait complete. 2023-10-25T16:13:16.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bdd46640 1 -- 172.21.15.177:0/564786990 learned_addr learned my addr 172.21.15.177:0/564786990 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7890000fd0 con 0x7f78b00ac3f0 2023-10-25T16:13:16.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f78a000aa00 con 0x7f78b00ac3f0 2023-10-25T16:13:16.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78a5ffb640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78940664c0 0x7f7894068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78a0083a20 con 0x7f78b00ac3f0 2023-10-25T16:13:16.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78a5ffb640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f789406e6e0 0x7f7894070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 --> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78940711b0 con 0x7f789406e6e0 2023-10-25T16:13:16.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78a0083d90 con 0x7f78b00ac3f0 2023-10-25T16:13:16.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78b5405640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78940664c0 0x7f7894068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011830 con 0x7f804c0535f0 2023-10-25T16:13:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8048011a80 con 0x7f804c0535f0 2023-10-25T16:13:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048011e90 con 0x7f804c0535f0 2023-10-25T16:13:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c0d5a40 con 0x7f804c0535f0 2023-10-25T16:13:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c04b280 con 0x7f804c0535f0 2023-10-25T16:13:16.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f804c047340 con 0x7f804c0535f0 2023-10-25T16:13:16.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0e324640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc080cd950 0x7fdc0815bd30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b3e0 tx=0x7fdc0400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04011830 con 0x7fdc080cd950 2023-10-25T16:13:16.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc08154a20 con 0x7fdc080cd950 2023-10-25T16:13:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc08154740 con 0x7fdc080cd950 2023-10-25T16:13:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdc04011aa0 con 0x7fdc080cd950 2023-10-25T16:13:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04010380 con 0x7fdc080cd950 2023-10-25T16:13:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80cb230 con 0x7fe9b80cade0 2023-10-25T16:13:16.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8097f80 con 0x7fe9b8152380 2023-10-25T16:13:16.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81f7630 con 0x7fe9b8151fa0 2023-10-25T16:13:16.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 -- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b8151fa0 msgr2=0x7fe9b8097a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b8151fa0 0x7fe9b8097a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 -- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9b8152380 msgr2=0x7fe9b80ca8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:13:16.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9b8152380 0x7fe9b80ca8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b81f7910 con 0x7fe9b80cade0 2023-10-25T16:13:16.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7fe9be547640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b80cade0 0x7fe9b81f69e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe9b815c720 tx=0x7fe9b000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0003d90 con 0x7fe9b80cade0 2023-10-25T16:13:16.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe9b0004030 con 0x7fe9b80cade0 2023-10-25T16:13:16.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0004420 con 0x7fe9b80cade0 2023-10-25T16:13:16.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 Processor -- start 2023-10-25T16:13:16.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7f7e7dd2e640 1 -- start start 2023-10-25T16:13:16.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 0x7f7e7004d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700e0fd0 0x7f7e70009370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700e13b0 0x7f7e700d78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7004db60 con 0x7f7e700e0fd0 2023-10-25T16:13:16.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70184aa0 con 0x7f7e700e13b0 2023-10-25T16:13:16.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70183a00 con 0x7f7e70051730 2023-10-25T16:13:16.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700e13b0 0x7f7e700d78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 0x7f7e7004d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700e13b0 0x7f7e700d78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.177:51638/0 (socket says 172.21.15.177:51638) 2023-10-25T16:13:16.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e77fff640 1 -- 172.21.15.177:0/3163007425 learned_addr learned my addr 172.21.15.177:0/3163007425 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.819+0000 7ff1b3474640 1 -- 172.21.15.177:0/3826126168 wait complete. 2023-10-25T16:13:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 Processor -- start 2023-10-25T16:13:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78b5c06640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f789406e6e0 0x7f7894070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b81f7bf0 con 0x7fe9b80cade0 2023-10-25T16:13:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b81f81b0 con 0x7fe9b80cade0 2023-10-25T16:13:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc040104e0 con 0x7fdc080cd950 2023-10-25T16:13:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 -- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700e13b0 msgr2=0x7f7e700d78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e700e13b0 0x7f7e700d78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 -- 172.21.15.177:0/3163007425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700e0fd0 msgr2=0x7f7e70009370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700e0fd0 0x7f7e70009370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 -- 172.21.15.177:0/3163007425 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7804ea10 con 0x7f7e70051730 2023-10-25T16:13:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 -- start start 2023-10-25T16:13:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1ac06d480 0x7ff1ac098790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac0b1bd0 0x7ff1ac1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1ac1518e0 0x7ff1ac14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac14b770 con 0x7ff1ac06d480 2023-10-25T16:13:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac148710 con 0x7ff1ac1518e0 2023-10-25T16:13:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b3474640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac098e90 con 0x7ff1ac0b1bd0 2023-10-25T16:13:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78b5405640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78940664c0 0x7f7894068980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78a80ad000 tx=0x7f78a801b0a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e777fe640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 0x7f7e7004d620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c3e0 tx=0x7f7e6c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdbfe7fc640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbec066470 0x7fdbec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbf0000fd0 con 0x7fdc080cd950 2023-10-25T16:13:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9b80b1560 con 0x7fe9b80cade0 2023-10-25T16:13:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc04083e80 con 0x7fdc080cd950 2023-10-25T16:13:16.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b0a0f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac0b1bd0 0x7ff1ac1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b0a0f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac0b1bd0 0x7ff1ac1481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48772/0 (socket says 172.21.15.177:48772) 2023-10-25T16:13:16.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b0a0f640 1 -- 172.21.15.177:0/3572708123 learned_addr learned my addr 172.21.15.177:0/3572708123 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1a11640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1ac1518e0 0x7ff1ac14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1210640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1ac06d480 0x7ff1ac098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011790 con 0x7f7e70051730 2023-10-25T16:13:16.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdc0db23640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbec066470 0x7fdbec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f78b5c06640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f789406e6e0 0x7f7894070b00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== osd.0 v2:172.21.15.177:6800/1702384414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f78940711b0 con 0x7f789406e6e0 2023-10-25T16:13:16.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f80480233f0 con 0x7f804c0535f0 2023-10-25T16:13:16.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f803b7fe640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8040066540 0x7f8040068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80480842a0 con 0x7f804c0535f0 2023-10-25T16:13:16.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f803b7fe640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f804006e5f0 0x7f8040070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 --> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80400710c0 con 0x7f804006e5f0 2023-10-25T16:13:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8048084650 con 0x7f804c0535f0 2023-10-25T16:13:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f80527fc640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8040066540 0x7f8040068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f80537fe640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f804006e5f0 0x7f8040070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f80527fc640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8040066540 0x7f8040068a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f804c04edb0 tx=0x7f8044007ec0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f80537fe640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f804006e5f0 0x7f8040070a10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdbfe7fc640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fdbec06e610 0x7fdbec070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 --> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbec0710e0 con 0x7fdbec06e610 2023-10-25T16:13:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc04009100 con 0x7fdc080cd950 2023-10-25T16:13:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7fdc0d322640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fdbec06e610 0x7fdbec070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fdc0d322640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fdbec06e610 0x7fdbec070a30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fdc0db23640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbec066470 0x7fdbec068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc000af000 tx=0x7fdc0001b530 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== osd.3 v2:172.21.15.177:6824/3697255096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fdbec0710e0 con 0x7fdbec06e610 2023-10-25T16:13:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9b0004580 con 0x7fe9b80cade0 2023-10-25T16:13:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9ae7fc640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe99c066540 0x7fe99c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9b00856b0 con 0x7fe9b80cade0 2023-10-25T16:13:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9ae7fc640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7fe99c06e760 0x7fe99c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe99c071230 con 0x7fe99c06e760 2023-10-25T16:13:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9b0085a60 con 0x7fe9b80cade0 2023-10-25T16:13:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9bd545640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7fe99c06e760 0x7fe99c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7fe9bdd46640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe99c066540 0x7fe99c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70183ce0 con 0x7f7e70051730 2023-10-25T16:13:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e701842a0 con 0x7f7e70051730 2023-10-25T16:13:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e6c0119e0 con 0x7f7e70051730 2023-10-25T16:13:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011df0 con 0x7f7e70051730 2023-10-25T16:13:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e70056aa0 con 0x7f7e70051730 2023-10-25T16:13:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e6c01c460 con 0x7f7e70051730 2023-10-25T16:13:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e63fff640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e5c0664a0 0x7f7e5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e6c0849d0 con 0x7f7e70051730 2023-10-25T16:13:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e76ffd640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e5c0664a0 0x7f7e5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e63fff640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f7e5c06e6c0 0x7f7e5c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 --> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e5c071190 con 0x7f7e5c06e6c0 2023-10-25T16:13:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e6c084d80 con 0x7f7e70051730 2023-10-25T16:13:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1210640 1 -- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac0b1bd0 msgr2=0x7ff1ac1481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1210640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1ac0b1bd0 0x7ff1ac1481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1210640 1 -- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1ac1518e0 msgr2=0x7ff1ac14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1210640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1ac1518e0 0x7ff1ac14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.823+0000 7ff1b1210640 1 -- 172.21.15.177:0/3572708123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0094a0 con 0x7ff1ac06d480 2023-10-25T16:13:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1b1210640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1ac06d480 0x7ff1ac098790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8000f70 tx=0x7ff1a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a80052d0 con 0x7ff1ac06d480 2023-10-25T16:13:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac099170 con 0x7ff1ac06d480 2023-10-25T16:13:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac148b00 con 0x7ff1ac06d480 2023-10-25T16:13:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1ac04da80 con 0x7ff1ac06d480 2023-10-25T16:13:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff1ac04da80 con 0x7ff1ac06d480 2023-10-25T16:13:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.827+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8003600 con 0x7ff1ac06d480 2023-10-25T16:13:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7e77fff640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f7e5c06e6c0 0x7f7e5c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== osd.1 v2:172.21.15.177:6808/890639561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f80400710c0 con 0x7f804006e5f0 2023-10-25T16:13:16.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7e76ffd640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e5c0664a0 0x7f7e5c068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e700092a0 tx=0x7f7e640095a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7fe9bdd46640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe99c066540 0x7fe99c068a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40017b0 tx=0x7fe9b4001600 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7fe9bd545640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7fe99c06e760 0x7fe99c070b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7e77fff640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f7e5c06e6c0 0x7f7e5c070ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- 172.21.15.177:0/2373983951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd006d970 msgr2=0x7f2fd00ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 --2- 172.21.15.177:0/2373983951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd006d970 0x7f2fd00ac2e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009840 tx=0x7f2fc401c790 comp rx=0 tx=0).stop 2023-10-25T16:13:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- 172.21.15.177:0/2373983951 shutdown_connections 2023-10-25T16:13:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 --2- 172.21.15.177:0/2373983951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd006d970 0x7f2fd00ac2e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- 172.21.15.177:0/2373983951 >> 172.21.15.177:0/2373983951 conn(0x7f2fd00ccdb0 msgr2=0x7f2fd00cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- 172.21.15.177:0/2373983951 shutdown_connections 2023-10-25T16:13:16.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7a33d91640 1 -- 172.21.15.177:0/2723758942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0af190 msgr2=0x7f7a2c0d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7a33d91640 1 --2- 172.21.15.177:0/2723758942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0af190 0x7f7a2c0d1800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c08b460 tx=0x7f7a1c030080 comp rx=0 tx=0).stop 2023-10-25T16:13:16.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7a33d91640 1 -- 172.21.15.177:0/2723758942 shutdown_connections 2023-10-25T16:13:16.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7a33d91640 1 --2- 172.21.15.177:0/2723758942 >> v2:172.21.15.177:3300/0 conn(0x7f7a2c0cf0e0 0x7f7a2c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7a33d91640 1 --2- 172.21.15.177:0/2723758942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0af190 0x7f7a2c0d1800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f7a33d91640 1 -- 172.21.15.177:0/2723758942 >> 172.21.15.177:0/2723758942 conn(0x7f7a2c065f40 msgr2=0x7f7a2c09a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- 172.21.15.177:0/2373983951 wait complete. 2023-10-25T16:13:16.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff1a8003760 con 0x7ff1ac06d480 2023-10-25T16:13:16.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1a1ffb640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff190066470 0x7ff190068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a8083c80 con 0x7ff1ac06d480 2023-10-25T16:13:16.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1a1ffb640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7ff19006e690 0x7ff190070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 --> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff190071160 con 0x7ff19006e690 2023-10-25T16:13:16.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a8084030 con 0x7ff1ac06d480 2023-10-25T16:13:16.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 Processor -- start 2023-10-25T16:13:16.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- start start 2023-10-25T16:13:16.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1b1a11640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7ff19006e690 0x7ff190070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1b0a0f640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff190066470 0x7ff190068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== osd.4 v2:172.21.15.184:6824/3302258236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fe99c071230 con 0x7fe99c06e760 2023-10-25T16:13:16.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1b1a11640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7ff19006e690 0x7ff190070ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd006d970 0x7f2fd014d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fd00b0e30 0x7f2fd0153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd00b19a0 0x7f2fd01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01fa0a0 con 0x7f2fd00b0e30 2023-10-25T16:13:16.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd014d780 con 0x7f2fd00b19a0 2023-10-25T16:13:16.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7f2fcf59e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01f9420 con 0x7f2fd006d970 2023-10-25T16:13:16.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.831+0000 7ff1b0a0f640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff190066470 0x7ff190068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac156ff0 tx=0x7ff19c01b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f7a33d91640 1 -- 172.21.15.177:0/2723758942 shutdown_connections 2023-10-25T16:13:16.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd006d970 0x7f2fd014d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd006d970 0x7f2fd014d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48778/0 (socket says 172.21.15.177:48778) 2023-10-25T16:13:16.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 -- 172.21.15.177:0/3966645271 learned_addr learned my addr 172.21.15.177:0/3966645271 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fced9d640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd00b19a0 0x7f2fd01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fcdd9b640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fd00b0e30 0x7f2fd0153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 -- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd00b19a0 msgr2=0x7f2fd01542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd00b19a0 0x7f2fd01542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 -- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fd00b0e30 msgr2=0x7f2fd0153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fd00b0e30 0x7f2fd0153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 -- 172.21.15.177:0/3966645271 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40094a0 con 0x7f2fd006d970 2023-10-25T16:13:16.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.835+0000 7f2fce59c640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd006d970 0x7f2fd014d240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c10 tx=0x7f2fc40a56b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40048d0 con 0x7f2fd006d970 2023-10-25T16:13:16.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 -- 172.21.15.177:0/2723758942 wait complete. 2023-10-25T16:13:16.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== osd.6 v2:172.21.15.184:6800/3199176706 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f7e5c071190 con 0x7f7e5c06e6c0 2023-10-25T16:13:16.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2fc4004b20 con 0x7f2fd006d970 2023-10-25T16:13:16.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd01f9700 con 0x7f2fd006d970 2023-10-25T16:13:16.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc40b7440 con 0x7f2fd006d970 2023-10-25T16:13:16.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd01f9cc0 con 0x7f2fd006d970 2023-10-25T16:13:16.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fd0159220 con 0x7f2fd006d970 2023-10-25T16:13:16.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 Processor -- start 2023-10-25T16:13:16.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2fc40b75a0 con 0x7f2fd006d970 2023-10-25T16:13:16.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fbeffd640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fb00664c0 0x7f2fb0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 -- start start 2023-10-25T16:13:16.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0cf0e0 0x7f7a2c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0d1420 0x7f7a2c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a2c1592b0 0x7f7a2c1f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0cb090 con 0x7f7a2c1592b0 2023-10-25T16:13:16.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0ca7f0 con 0x7f7a2c0cf0e0 2023-10-25T16:13:16.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a33d91640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0caad0 con 0x7f7a2c0d1420 2023-10-25T16:13:16.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fc411ed50 con 0x7f2fd006d970 2023-10-25T16:13:16.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a3232e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a2c1592b0 0x7f7a2c1f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f2fcdd9b640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fb00664c0 0x7f2fb0068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a3232e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a2c1592b0 0x7f7a2c1f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43564/0 (socket says 172.21.15.177:43564) 2023-10-25T16:13:16.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a3232e640 1 -- 172.21.15.177:0/3998244472 learned_addr learned my addr 172.21.15.177:0/3998244472 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:16.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a3132c640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0d1420 0x7f7a2c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a31b2d640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0cf0e0 0x7f7a2c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.839+0000 7f7a3232e640 1 -- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0d1420 msgr2=0x7f7a2c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a3232e640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a2c0d1420 0x7f7a2c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a3232e640 1 -- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0cf0e0 msgr2=0x7f7a2c0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a3232e640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a2c0cf0e0 0x7f7a2c0ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a3232e640 1 -- 172.21.15.177:0/3998244472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009560 con 0x7f7a2c1592b0 2023-10-25T16:13:16.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== osd.7 v2:172.21.15.184:6808/435860171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7ff190071160 con 0x7ff19006e690 2023-10-25T16:13:16.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fbeffd640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7f2fb006e570 0x7f2fb0070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 --> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fb0071040 con 0x7f2fb006e570 2023-10-25T16:13:16.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fc4121460 con 0x7f2fd006d970 2023-10-25T16:13:16.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a3232e640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a2c1592b0 0x7f7a2c1f1260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400eab0 tx=0x7f7a2400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fced9d640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7f2fb006e570 0x7f2fb0070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fcdd9b640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fb00664c0 0x7f2fb0068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fd009ad20 tx=0x7f2fc0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400cea0 con 0x7f7a2c1592b0 2023-10-25T16:13:16.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a24004b30 con 0x7f7a2c1592b0 2023-10-25T16:13:16.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24005020 con 0x7f7a2c1592b0 2023-10-25T16:13:16.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c0cadb0 con 0x7f7a2c1592b0 2023-10-25T16:13:16.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c157280 con 0x7f7a2c1592b0 2023-10-25T16:13:16.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fced9d640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7f2fb006e570 0x7f2fb0070990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a24005180 con 0x7f7a2c1592b0 2023-10-25T16:13:16.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== osd.2 v2:172.21.15.177:6813/1075656412 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f2fb0071040 con 0x7f2fb006e570 2023-10-25T16:13:16.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a227fc640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a100664f0 0x7f7a100689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a24014070 con 0x7f7a2c1592b0 2023-10-25T16:13:16.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.843+0000 7f7a31b2d640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a100664f0 0x7f7a100689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f7a31b2d640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a100664f0 0x7f7a100689b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098e0 tx=0x7f7a28009060 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 --> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f804c005370 con 0x7f804006e5f0 2023-10-25T16:13:16.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 --> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdbf0002cc0 con 0x7fdbec06e610 2023-10-25T16:13:16.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f803b7fe640 1 -- 172.21.15.177:0/1116295219 <== osd.1 v2:172.21.15.177:6808/890639561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f804c005370 con 0x7f804006e5f0 2023-10-25T16:13:16.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f7a33d91640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7f7a2c15f890 0x7f7a2c0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:16.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 --> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a2c066b20 con 0x7f7a2c15f890 2023-10-25T16:13:16.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f804006e5f0 msgr2=0x7f8040070a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f804006e5f0 0x7f8040070a10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f7a3132c640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7f7a2c15f890 0x7f7a2c0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:16.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8040066540 msgr2=0x7f8040068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8040066540 0x7f8040068a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f804c04edb0 tx=0x7f8044007ec0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f804c0535f0 msgr2=0x7f804c0c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f805933f640 1 --2- 172.21.15.177:0/1116295219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f804c0535f0 0x7f804c0c89e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f804800b410 tx=0x7f804800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.847+0000 7f80537fe640 1 -- 172.21.15.177:0/1116295219 reap_dead start 2023-10-25T16:13:16.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 shutdown_connections 2023-10-25T16:13:16.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 >> 172.21.15.177:0/1116295219 conn(0x7f804c009f90 msgr2=0x7f804c0d5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 shutdown_connections 2023-10-25T16:13:16.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7f805933f640 1 -- 172.21.15.177:0/1116295219 wait complete. 2023-10-25T16:13:16.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7f7a3132c640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7f7a2c15f890 0x7f7a2c0b0730 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:16.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== osd.5 v2:172.21.15.184:6816/748323378 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f7a2c066b20 con 0x7f7a2c15f890 2023-10-25T16:13:16.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.851+0000 7fdbfe7fc640 1 -- 172.21.15.177:0/3482313588 <== osd.3 v2:172.21.15.177:6824/3697255096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdbf0002cc0 con 0x7fdbec06e610 2023-10-25T16:13:16.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.855+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 --> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7890002cf0 con 0x7f789406e6e0 2023-10-25T16:13:16.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.855+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 --> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9b81f83a0 con 0x7fe99c06e760 2023-10-25T16:13:16.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.855+0000 7f78a5ffb640 1 -- 172.21.15.177:0/1558750586 <== osd.0 v2:172.21.15.177:6800/1702384414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7890002cf0 con 0x7f789406e6e0 2023-10-25T16:13:16.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.855+0000 7fe9ae7fc640 1 -- 172.21.15.177:0/564786990 <== osd.4 v2:172.21.15.184:6824/3302258236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe9b81f83a0 con 0x7fe99c06e760 2023-10-25T16:13:16.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.855+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f789406e6e0 msgr2=0x7f7894070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f789406e6e0 0x7f7894070b00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78940664c0 msgr2=0x7f7894068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78940664c0 0x7f7894068980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78a80ad000 tx=0x7f78a801b0a0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00ac3f0 msgr2=0x7f78b014c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 --2- 172.21.15.177:0/1558750586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78b00ac3f0 0x7f78b014c590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c750 tx=0x7f78a000cc10 comp rx=0 tx=0).stop 2023-10-25T16:13:16.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b5c06640 1 -- 172.21.15.177:0/1558750586 reap_dead start 2023-10-25T16:13:16.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fdbec06e610 msgr2=0x7fdbec070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fdbec06e610 0x7fdbec070a30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 shutdown_connections 2023-10-25T16:13:16.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 >> 172.21.15.177:0/1558750586 conn(0x7f78b00ccd00 msgr2=0x7f78b00adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 shutdown_connections 2023-10-25T16:13:16.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbec066470 msgr2=0x7fdbec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbec066470 0x7fdbec068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc000af000 tx=0x7fdc0001b530 comp rx=0 tx=0).stop 2023-10-25T16:13:16.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc080cd950 msgr2=0x7fdc0815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 --2- 172.21.15.177:0/3482313588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc080cd950 0x7fdc0815bd30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b3e0 tx=0x7fdc0400b8a0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0e324640 1 -- 172.21.15.177:0/3482313588 reap_dead start 2023-10-25T16:13:16.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 shutdown_connections 2023-10-25T16:13:16.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 >> 172.21.15.177:0/3482313588 conn(0x7fdc08088fd0 msgr2=0x7fdc08156660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7f78b7669640 1 -- 172.21.15.177:0/1558750586 wait complete. 2023-10-25T16:13:16.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 shutdown_connections 2023-10-25T16:13:16.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.859+0000 7fdc0eb25640 1 -- 172.21.15.177:0/3482313588 wait complete. 2023-10-25T16:13:16.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 --> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e70056aa0 con 0x7f7e5c06e6c0 2023-10-25T16:13:16.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7fe99c06e760 msgr2=0x7fe99c070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7fe99c06e760 0x7fe99c070b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 --> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fd0150810 con 0x7f2fb006e570 2023-10-25T16:13:16.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe99c066540 msgr2=0x7fe99c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe99c066540 0x7fe99c068a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40017b0 tx=0x7fe9b4001600 comp rx=0 tx=0).stop 2023-10-25T16:13:16.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b80cade0 msgr2=0x7fe9b81f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 --2- 172.21.15.177:0/564786990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b80cade0 0x7fe9b81f69e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe9b815c720 tx=0x7fe9b000f790 comp rx=0 tx=0).stop 2023-10-25T16:13:16.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9be547640 1 -- 172.21.15.177:0/564786990 reap_dead start 2023-10-25T16:13:16.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fbeffd640 1 -- 172.21.15.177:0/3966645271 <== osd.2 v2:172.21.15.177:6813/1075656412 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fd0150810 con 0x7f2fb006e570 2023-10-25T16:13:16.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e63fff640 1 -- 172.21.15.177:0/3163007425 <== osd.6 v2:172.21.15.184:6800/3199176706 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e7811dc40 con 0x7f7e5c06e6c0 2023-10-25T16:13:16.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7f2fb006e570 msgr2=0x7f2fb0070990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7f2fb006e570 0x7f2fb0070990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 shutdown_connections 2023-10-25T16:13:16.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 >> 172.21.15.177:0/564786990 conn(0x7fe9b80afb10 msgr2=0x7fe9b80aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 shutdown_connections 2023-10-25T16:13:16.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7fe9bffaa640 1 -- 172.21.15.177:0/564786990 wait complete. 2023-10-25T16:13:16.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f7e5c06e6c0 msgr2=0x7f7e5c070ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f7e5c06e6c0 0x7f7e5c070ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fb00664c0 msgr2=0x7f2fb0068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fb00664c0 0x7f2fb0068980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2fd009ad20 tx=0x7f2fc0009040 comp rx=0 tx=0).stop 2023-10-25T16:13:16.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e5c0664a0 msgr2=0x7f7e5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.937 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e5c0664a0 0x7f7e5c068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e700092a0 tx=0x7f7e640095a0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-25T16:13:16.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd006d970 msgr2=0x7f2fd014d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 --2- 172.21.15.177:0/3966645271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd006d970 0x7f2fd014d240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c10 tx=0x7f2fc40a56b0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fced9d640 1 -- 172.21.15.177:0/3966645271 reap_dead start 2023-10-25T16:13:16.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 msgr2=0x7f7e7004d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e7dd2e640 1 --2- 172.21.15.177:0/3163007425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e70051730 0x7f7e7004d620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c3e0 tx=0x7f7e6c00c8a0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 shutdown_connections 2023-10-25T16:13:16.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f7e77fff640 1 -- 172.21.15.177:0/3163007425 reap_dead start 2023-10-25T16:13:16.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 >> 172.21.15.177:0/3966645271 conn(0x7f2fd00ccdb0 msgr2=0x7f2fd00b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 shutdown_connections 2023-10-25T16:13:16.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.867+0000 7f2fcf59e640 1 -- 172.21.15.177:0/3966645271 wait complete. 2023-10-25T16:13:16.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 shutdown_connections 2023-10-25T16:13:16.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 >> 172.21.15.177:0/3163007425 conn(0x7f7e700537c0 msgr2=0x7f7e70037df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 --> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1ac14b8b0 con 0x7ff19006e690 2023-10-25T16:13:16.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 shutdown_connections 2023-10-25T16:13:16.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 --> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a2c1f0ba0 con 0x7f7a2c15f890 2023-10-25T16:13:16.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7f7e7dd2e640 1 -- 172.21.15.177:0/3163007425 wait complete. 2023-10-25T16:13:16.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7ff1a1ffb640 1 -- 172.21.15.177:0/3572708123 <== osd.7 v2:172.21.15.184:6808/435860171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1a4001f70 con 0x7ff19006e690 2023-10-25T16:13:16.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.871+0000 7f7a227fc640 1 -- 172.21.15.177:0/3998244472 <== osd.5 v2:172.21.15.184:6816/748323378 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7a2c1f0ba0 con 0x7f7a2c15f890 2023-10-25T16:13:16.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7ff19006e690 msgr2=0x7ff190070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7ff19006e690 0x7ff190070ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff190066470 msgr2=0x7ff190068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff190066470 0x7ff190068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac156ff0 tx=0x7ff19c01b0c0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1ac06d480 msgr2=0x7ff1ac098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 --2- 172.21.15.177:0/3572708123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1ac06d480 0x7ff1ac098790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8000f70 tx=0x7ff1a800c890 comp rx=0 tx=0).stop 2023-10-25T16:13:16.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b1a11640 1 -- 172.21.15.177:0/3572708123 reap_dead start 2023-10-25T16:13:16.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 shutdown_connections 2023-10-25T16:13:16.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 >> 172.21.15.177:0/3572708123 conn(0x7ff1ac0aea90 msgr2=0x7ff1ac0adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 shutdown_connections 2023-10-25T16:13:16.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.875+0000 7ff1b3474640 1 -- 172.21.15.177:0/3572708123 wait complete. 2023-10-25T16:13:16.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7f7a2c15f890 msgr2=0x7f7a2c0b0730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a33d91640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7f7a2c15f890 0x7f7a2c0b0730 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:16.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a100664f0 msgr2=0x7f7a100689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a33d91640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a100664f0 0x7f7a100689b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098e0 tx=0x7f7a28009060 comp rx=0 tx=0).stop 2023-10-25T16:13:16.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a2c1592b0 msgr2=0x7f7a2c1f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:16.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a33d91640 1 --2- 172.21.15.177:0/3998244472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a2c1592b0 0x7f7a2c1f1260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400eab0 tx=0x7f7a2400ef70 comp rx=0 tx=0).stop 2023-10-25T16:13:16.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.879+0000 7f7a3232e640 1 -- 172.21.15.177:0/3998244472 reap_dead start 2023-10-25T16:13:16.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.883+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 shutdown_connections 2023-10-25T16:13:16.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.883+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 >> 172.21.15.177:0/3998244472 conn(0x7f7a2c065f40 msgr2=0x7f7a2c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:16.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.883+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 shutdown_connections 2023-10-25T16:13:16.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:16.883+0000 7f7a33d91640 1 -- 172.21.15.177:0/3998244472 wait complete. 2023-10-25T16:13:16.952 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.953 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-25T16:13:16.954 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-25T16:13:16.955 INFO:teuthology.orchestra.run.smithi177.stdout:60129542151 2023-10-25T16:13:16.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-25T16:13:16.956 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.957 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-25T16:13:16.957 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-25T16:13:16.959 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.959 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-25T16:13:16.960 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:16.961 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-25T16:13:17.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 -- 172.21.15.177:0/1092297846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9140b2180 msgr2=0x7fa9140aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 --2- 172.21.15.177:0/1092297846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9140b2180 0x7fa9140aec10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009bc0 tx=0x7fa90c01cb50 comp rx=0 tx=0).stop 2023-10-25T16:13:17.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 -- 172.21.15.177:0/1092297846 shutdown_connections 2023-10-25T16:13:17.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 --2- 172.21.15.177:0/1092297846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9140b2180 0x7fa9140aec10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 --2- 172.21.15.177:0/1092297846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 -- 172.21.15.177:0/1092297846 >> 172.21.15.177:0/1092297846 conn(0x7fa91409a5f0 msgr2=0x7fa914065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 -- 172.21.15.177:0/2129426806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 msgr2=0x7f5b4013d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/2129426806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4013d8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009900 tx=0x7f5b3001c840 comp rx=0 tx=0).stop 2023-10-25T16:13:17.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 -- 172.21.15.177:0/2129426806 shutdown_connections 2023-10-25T16:13:17.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/2129426806 >> v2:172.21.15.177:3300/0 conn(0x7f5b400af5d0 0x7f5b4013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/2129426806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4013d8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 -- 172.21.15.177:0/2129426806 >> 172.21.15.177:0/2129426806 conn(0x7f5b400b2450 msgr2=0x7f5b400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 -- 172.21.15.177:0/1092297846 shutdown_connections 2023-10-25T16:13:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f5b47c6b640 1 -- 172.21.15.177:0/2129426806 shutdown_connections 2023-10-25T16:13:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 -- 172.21.15.177:0/1257111008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c00b2590 msgr2=0x7f47c0070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 --2- 172.21.15.177:0/1257111008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c00b2590 0x7f47c0070580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47c00cf110 tx=0x7f47b401c510 comp rx=0 tx=0).stop 2023-10-25T16:13:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 -- 172.21.15.177:0/1257111008 shutdown_connections 2023-10-25T16:13:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 --2- 172.21.15.177:0/1257111008 >> v2:172.21.15.177:3300/0 conn(0x7f47c0070ac0 0x7f47c015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 --2- 172.21.15.177:0/1257111008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c00b2590 0x7f47c0070580 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47c00cf110 tx=0x7f47b401c510 comp rx=0 tx=0).stop 2023-10-25T16:13:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 --2- 172.21.15.177:0/1257111008 >> v2:172.21.15.184:3300/0 conn(0x7f47c00ca360 0x7f47c0157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 -- 172.21.15.177:0/1257111008 >> 172.21.15.177:0/1257111008 conn(0x7f47c00afb80 msgr2=0x7f47c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 -- 172.21.15.177:0/828927898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f989806b4b0 msgr2=0x7f989806b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 --2- 172.21.15.177:0/828927898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f989806b4b0 0x7f989806b940 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f988c008570 tx=0x7f988c01e800 comp rx=0 tx=0).stop 2023-10-25T16:13:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 -- 172.21.15.177:0/1257111008 shutdown_connections 2023-10-25T16:13:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f47bffff640 1 -- 172.21.15.177:0/1257111008 wait complete. 2023-10-25T16:13:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f0c7c140640 1 -- 172.21.15.177:0/875539751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 msgr2=0x7f0c6000fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f0c7c140640 1 --2- 172.21.15.177:0/875539751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 0x7f0c6000fda0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009940 tx=0x7f0c6401c740 comp rx=0 tx=0).stop 2023-10-25T16:13:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 -- 172.21.15.177:0/828927898 shutdown_connections 2023-10-25T16:13:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 --2- 172.21.15.177:0/828927898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98980700d0 0x7f98980704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 --2- 172.21.15.177:0/828927898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f989806b4b0 0x7f989806b940 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 -- 172.21.15.177:0/828927898 >> 172.21.15.177:0/828927898 conn(0x7f98980cd060 msgr2=0x7f98980cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 -- 172.21.15.177:0/828927898 shutdown_connections 2023-10-25T16:13:17.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7f9897fff640 1 -- 172.21.15.177:0/828927898 wait complete. 2023-10-25T16:13:17.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 -- 172.21.15.177:0/2631889207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 msgr2=0x7f5c1406b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3134346275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2c0042e0 msgr2=0x7f5a2c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3134346275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a2c0042e0 0x7f5a2c0047d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a30001060 tx=0x7f5a3001f760 comp rx=0 tx=0).stop 2023-10-25T16:13:17.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a46056640 1 -- 172.21.15.177:0/3134346275 reap_dead start 2023-10-25T16:13:17.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 -- 172.21.15.177:0/2129426806 wait complete. 2023-10-25T16:13:17.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 --2- 172.21.15.177:0/2631889207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 0x7f5c1406b5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009c80 tx=0x7f5c0c01cd00 comp rx=0 tx=0).stop 2023-10-25T16:13:17.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 -- 172.21.15.177:0/2631889207 shutdown_connections 2023-10-25T16:13:17.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 --2- 172.21.15.177:0/2631889207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 0x7f5c1406b5b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 -- 172.21.15.177:0/2631889207 >> 172.21.15.177:0/2631889207 conn(0x7f5c140cefe0 msgr2=0x7f5c140cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.175+0000 7fa91359e640 1 -- 172.21.15.177:0/1092297846 wait complete. 2023-10-25T16:13:17.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 Processor -- start 2023-10-25T16:13:17.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 -- 172.21.15.177:0/875539751 shutdown_connections 2023-10-25T16:13:17.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 --2- 172.21.15.177:0/875539751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 0x7f0c6000fda0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 -- 172.21.15.177:0/875539751 >> 172.21.15.177:0/875539751 conn(0x7f0c6c009f90 msgr2=0x7f0c6c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 Processor -- start 2023-10-25T16:13:17.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 -- 172.21.15.177:0/875539751 shutdown_connections 2023-10-25T16:13:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 Processor -- start 2023-10-25T16:13:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 -- start start 2023-10-25T16:13:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 Processor -- start 2023-10-25T16:13:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b400af5d0 0x7f5b400abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b4013bda0 0x7f5b40159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400ae890 con 0x7f5b4013bda0 2023-10-25T16:13:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b400ab650 con 0x7f5b4015b710 2023-10-25T16:13:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b47c6b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4015a260 con 0x7f5b400af5d0 2023-10-25T16:13:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3134346275 shutdown_connections 2023-10-25T16:13:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3134346275 >> 172.21.15.177:0/3134346275 conn(0x7f5a400aea90 msgr2=0x7f5a400aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 -- start start 2023-10-25T16:13:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 0x7f47c014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c00ca360 0x7f47c0153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c0153c80 0x7f47c00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c0154130 con 0x7f47c0070ac0 2023-10-25T16:13:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c0158090 con 0x7f47c00ca360 2023-10-25T16:13:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47bffff640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c014f2f0 con 0x7f47c0153c80 2023-10-25T16:13:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 0x7f47c014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 0x7f47c014edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43652/0 (socket says 172.21.15.177:43652) 2023-10-25T16:13:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 -- 172.21.15.177:0/3605001789 learned_addr learned my addr 172.21.15.177:0/3605001789 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b45a07640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b400af5d0 0x7f5b400abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 -- 172.21.15.177:0/2631889207 shutdown_connections 2023-10-25T16:13:17.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b45a07640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b400af5d0 0x7f5b400abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48868/0 (socket says 172.21.15.177:48868) 2023-10-25T16:13:17.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b45a07640 1 -- 172.21.15.177:0/558122423 learned_addr learned my addr 172.21.15.177:0/558122423 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b45206640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b4013bda0 0x7f5b40159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5c19641640 1 -- 172.21.15.177:0/2631889207 wait complete. 2023-10-25T16:13:17.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3134346275 shutdown_connections 2023-10-25T16:13:17.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3134346275 wait complete. 2023-10-25T16:13:17.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 -- start start 2023-10-25T16:13:17.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 0x7f989814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 -- 172.21.15.177:0/875539751 wait complete. 2023-10-25T16:13:17.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 Processor -- start 2023-10-25T16:13:17.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980700d0 0x7f9898154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 0x7f989814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 0x7f989814bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43670/0 (socket says 172.21.15.177:43670) 2023-10-25T16:13:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 -- start start 2023-10-25T16:13:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 -- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b400af5d0 msgr2=0x7f5b400abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b400af5d0 0x7f5b400abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 -- 172.21.15.177:0/558122423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b4013bda0 msgr2=0x7f5b40159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b4013bda0 0x7f5b40159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 -- 172.21.15.177:0/558122423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30009560 con 0x7f5b4015b710 2023-10-25T16:13:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9140b2180 0x7fa9142010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa91415b370 0x7fa9140cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140ce470 con 0x7fa9140b2180 2023-10-25T16:13:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140ce750 con 0x7fa91415b370 2023-10-25T16:13:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa91359e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140cea30 con 0x7fa9140d17d0 2023-10-25T16:13:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9896ffd640 1 -- 172.21.15.177:0/4007778150 learned_addr learned my addr 172.21.15.177:0/4007778150 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9898157620 0x7f989814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898156260 con 0x7f989806b4b0 2023-10-25T16:13:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa911d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa911d9b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48882/0 (socket says 172.21.15.177:48882) 2023-10-25T16:13:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7fa911d9b640 1 -- 172.21.15.177:0/2817317773 learned_addr learned my addr 172.21.15.177:0/2817317773 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b46208640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4015dfb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c440 tx=0x7f5b3c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f98967fc640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980700d0 0x7f9898154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f98977fe640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9898157620 0x7f989814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c011850 con 0x7f5b4015b710 2023-10-25T16:13:17.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898155650 con 0x7f98980700d0 2023-10-25T16:13:17.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b3c011aa0 con 0x7f5b4015b710 2023-10-25T16:13:17.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c012420 con 0x7f5b4015b710 2023-10-25T16:13:17.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898155930 con 0x7f9898157620 2023-10-25T16:13:17.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 Processor -- start 2023-10-25T16:13:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa911d9b640 1 -- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa91415b370 msgr2=0x7fa9140cee40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:13:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa911d9b640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa91415b370 0x7fa9140cee40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa911d9b640 1 -- 172.21.15.177:0/2817317773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9140b2180 msgr2=0x7fa9142010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa911d9b640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9140b2180 0x7fa9142010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa911d9b640 1 -- 172.21.15.177:0/2817317773 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c009820 con 0x7fa9140d17d0 2023-10-25T16:13:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f0c7c140640 1 -- start start 2023-10-25T16:13:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 0x7f0c6c0d8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 0x7f0c6c0d8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c6c0d8420 0x7f0c6c0d6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c048af0 con 0x7f0c60004fa0 2023-10-25T16:13:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c04adc0 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c048d90 con 0x7f0c6c0d8420 2023-10-25T16:13:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 -- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c0153c80 msgr2=0x7f47c00cb5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T16:13:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c0153c80 0x7f47c00cb5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 -- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c00ca360 msgr2=0x7f47c0153740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T16:13:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c00ca360 0x7f47c0153740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 -- 172.21.15.177:0/3605001789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b40094a0 con 0x7f47c0070ac0 2023-10-25T16:13:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47beffd640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 0x7f47c014edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47b000e7a0 tx=0x7f47b000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ccc0 con 0x7f47c0070ac0 2023-10-25T16:13:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f47b000eeb0 con 0x7f47c0070ac0 2023-10-25T16:13:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.179+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0010670 con 0x7f47c0070ac0 2023-10-25T16:13:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9896ffd640 1 -- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9898157620 msgr2=0x7f989814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9896ffd640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9898157620 0x7f989814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9896ffd640 1 -- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980700d0 msgr2=0x7f9898154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9896ffd640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980700d0 0x7f9898154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9896ffd640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0081d0 con 0x7f989806b4b0 2023-10-25T16:13:17.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9896ffd640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 0x7f989814bc20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f988800b410 tx=0x7f988800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 0x7f0c6c0d8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 0x7f0c6c0d8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.177:51808/0 (socket says 172.21.15.177:51808) 2023-10-25T16:13:17.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 -- 172.21.15.177:0/247566710 learned_addr learned my addr 172.21.15.177:0/247566710 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7a6dd640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c6c0d8420 0x7f0c6c0d6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 -- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c6c0d8420 msgr2=0x7f0c6c0d6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c6c0d8420 0x7f0c6c0d6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 -- 172.21.15.177:0/247566710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 msgr2=0x7f0c6c0d8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 0x7f0c6c0d8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 -- 172.21.15.177:0/247566710 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c049070 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888004020 con 0x7f989806b4b0 2023-10-25T16:13:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9888004270 con 0x7f989806b4b0 2023-10-25T16:13:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888011890 con 0x7f989806b4b0 2023-10-25T16:13:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 -- start start 2023-10-25T16:13:17.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 0x7f5c14151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c140ae550 0x7f5c141501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c1415e860 0x7f5c14150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140adbd0 con 0x7f5c1406b120 2023-10-25T16:13:17.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14159e50 con 0x7f5c1415e860 2023-10-25T16:13:17.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c19641640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14159240 con 0x7f5c140ae550 2023-10-25T16:13:17.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9898155c10 con 0x7f989806b4b0 2023-10-25T16:13:17.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981551b0 con 0x7f989806b4b0 2023-10-25T16:13:17.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b400ae5b0 con 0x7f5b4015b710 2023-10-25T16:13:17.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b400ab270 con 0x7f5b4015b710 2023-10-25T16:13:17.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b400aadf0 con 0x7f5b4015b710 2023-10-25T16:13:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c127fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c140ae550 0x7f5c141501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c127fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c140ae550 0x7f5c141501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48894/0 (socket says 172.21.15.177:48894) 2023-10-25T16:13:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c127fc640 1 -- 172.21.15.177:0/1413883884 learned_addr learned my addr 172.21.15.177:0/1413883884 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c137fe640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c1415e860 0x7f5c14150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c12ffd640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 0x7f5c14151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 Processor -- start 2023-10-25T16:13:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 -- start start 2023-10-25T16:13:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 0x7f5a400b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a40097a40 0x7f5a400b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a40097ec0 0x7f5a400ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40149a10 con 0x7f5a2c0042e0 2023-10-25T16:13:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4015b4f0 con 0x7f5a40097ec0 2023-10-25T16:13:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a47ab9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4015b210 con 0x7f5a40097a40 2023-10-25T16:13:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a46056640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a40097ec0 0x7f5a400ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 0x7f5a400b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 0x7f5a400b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43702/0 (socket says 172.21.15.177:43702) 2023-10-25T16:13:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 -- 172.21.15.177:0/3035903454 learned_addr learned my addr 172.21.15.177:0/3035903454 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa911d9b640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140cd9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e9f0 tx=0x7fa90400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c796db640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 0x7f0c6c0d8eb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000e710 tx=0x7f0c7000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000cab0 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c7000cd00 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70010690 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c049350 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f47bffff640 1 -- 172.21.15.177:0/3605001789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c00ccc10 con 0x7f47c0070ac0 2023-10-25T16:13:17.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f47bffff640 1 -- 172.21.15.177:0/3605001789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c00cc650 con 0x7f47c0070ac0 2023-10-25T16:13:17.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f47bffff640 1 -- 172.21.15.177:0/3605001789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c0066b20 con 0x7f47c0070ac0 2023-10-25T16:13:17.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989804da80 con 0x7f989806b4b0 2023-10-25T16:13:17.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c137fe640 1 -- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c140ae550 msgr2=0x7f5c141501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c137fe640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c140ae550 0x7f5c141501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c137fe640 1 -- 172.21.15.177:0/1413883884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 msgr2=0x7f5c14151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c137fe640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 0x7f5c14151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5c137fe640 1 -- 172.21.15.177:0/1413883884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0098e0 con 0x7f5c1415e860 2023-10-25T16:13:17.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904009710 con 0x7fa9140d17d0 2023-10-25T16:13:17.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa90400ce70 con 0x7fa9140d17d0 2023-10-25T16:13:17.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904010690 con 0x7fa9140d17d0 2023-10-25T16:13:17.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45054640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a40097a40 0x7f5a400b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 -- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a40097a40 msgr2=0x7f5a400b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a40097a40 0x7f5a400b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 -- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a40097ec0 msgr2=0x7f5a400ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a40097ec0 0x7f5a400ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 -- 172.21.15.177:0/3035903454 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400afcb0 con 0x7f5a2c0042e0 2023-10-25T16:13:17.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5a45855640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 0x7f5a400b1ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0107f0 tx=0x7f5a3c010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c049870 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa91359e640 1 -- 172.21.15.177:0/2817317773 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9140c8360 con 0x7fa9140d17d0 2023-10-25T16:13:17.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7fa91359e640 1 -- 172.21.15.177:0/2817317773 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa914201600 con 0x7fa9140d17d0 2023-10-25T16:13:17.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.183+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b3c012580 con 0x7f5b4015b710 2023-10-25T16:13:17.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f5b367fc640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b24066470 0x7f5b24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b3c084b90 con 0x7f5b4015b710 2023-10-25T16:13:17.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c0525c0 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9888003600 con 0x7f989806b4b0 2023-10-25T16:13:17.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f987ffff640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9884066470 0x7f9884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9888084070 con 0x7f989806b4b0 2023-10-25T16:13:17.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f5b45a07640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b24066470 0x7f5b24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7fa91359e640 1 -- 172.21.15.177:0/2817317773 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91404da80 con 0x7fa9140d17d0 2023-10-25T16:13:17.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f98967fc640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9884066470 0x7f9884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f5c137fe640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c1415e860 0x7f5c14150730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c140ccb60 tx=0x7f5c0c0a5b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f5b45a07640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b24066470 0x7f5b24068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009230 tx=0x7f5b3001b080 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9040107f0 con 0x7fa9140d17d0 2023-10-25T16:13:17.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f98967fc640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9884066470 0x7f9884068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f988c0b0000 tx=0x7f988c01d040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7fa902ffd640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8f4066470 0x7fa8f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f47b00107d0 con 0x7f47c0070ac0 2023-10-25T16:13:17.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f47a7fff640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f47ac066540 0x7f47ac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47b0014070 con 0x7f47c0070ac0 2023-10-25T16:13:17.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f47be7fc640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f47ac066540 0x7f47ac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa904014070 con 0x7fa9140d17d0 2023-10-25T16:13:17.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7fa91259c640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8f4066470 0x7fa8f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7f47be7fc640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f47ac066540 0x7f47ac068a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47b40ae000 tx=0x7f47b401ad50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.187+0000 7fa91259c640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8f4066470 0x7fa8f4068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa908000f70 tx=0x7fa9080079c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.191+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00ed40 con 0x7f5a2c0042e0 2023-10-25T16:13:17.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.191+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400aff90 con 0x7f5a2c0042e0 2023-10-25T16:13:17.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.191+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f47b00522c0 con 0x7f47c0070ac0 2023-10-25T16:13:17.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.191+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4015ae30 con 0x7f5a2c0042e0 2023-10-25T16:13:17.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.191+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a40066b20 con 0x7f5a2c0042e0 2023-10-25T16:13:17.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5a3c015070 con 0x7f5a2c0042e0 2023-10-25T16:13:17.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c01c6c0 con 0x7f5a2c0042e0 2023-10-25T16:13:17.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9888051610 con 0x7f989806b4b0 2023-10-25T16:13:17.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f7368cf9640 1 -- 172.21.15.177:0/1742628517 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0a6e20 con 0x7f7350005190 2023-10-25T16:13:17.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b3c051f70 con 0x7f5b4015b710 2023-10-25T16:13:17.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 -- 172.21.15.177:0/1742628517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7350005190 msgr2=0x7f735000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 --2- 172.21.15.177:0/1742628517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7350005190 0x7f735000b990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f735c0044c0 tx=0x7f735c01da60 comp rx=0 tx=0).stop 2023-10-25T16:13:17.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 -- 172.21.15.177:0/1742628517 shutdown_connections 2023-10-25T16:13:17.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 --2- 172.21.15.177:0/1742628517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7350005190 0x7f735000b990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 -- 172.21.15.177:0/1742628517 >> 172.21.15.177:0/1742628517 conn(0x7f73640aea20 msgr2=0x7f73640aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 -- 172.21.15.177:0/1742628517 shutdown_connections 2023-10-25T16:13:17.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c004e60 con 0x7f5c1415e860 2023-10-25T16:13:17.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5a3c011440 con 0x7f5a2c0042e0 2023-10-25T16:13:17.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5a367fc640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c0c0ad5b0 con 0x7f5c1415e860 2023-10-25T16:13:17.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0ad9a0 con 0x7f5c1415e860 2023-10-25T16:13:17.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a3c017070 con 0x7f5a2c0042e0 2023-10-25T16:13:17.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0c70010a00 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f0c6a7fc640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c58066540 0x7f0c58068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c70014070 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f5a45054640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.199+0000 7f736acfd640 1 -- 172.21.15.177:0/1742628517 wait complete. 2023-10-25T16:13:17.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 Processor -- start 2023-10-25T16:13:17.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f0c79edc640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c58066540 0x7f0c58068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9040526c0 con 0x7fa9140d17d0 2023-10-25T16:13:17.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c14159520 con 0x7f5c1415e860 2023-10-25T16:13:17.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c14159ae0 con 0x7f5c1415e860 2023-10-25T16:13:17.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f5a45054640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5a24066470 0x7f5a24068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a300b0000 tx=0x7f5a3001c520 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 -- start start 2023-10-25T16:13:17.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c14159fc0 con 0x7f5c1415e860 2023-10-25T16:13:17.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f0c79edc640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c58066540 0x7f0c58068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c740635f0 tx=0x7f0c740677d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7350005190 0x7f736414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73640cb3d0 0x7f73641f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7364152b10 0x7f7364152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73641534d0 con 0x7f7364152b10 2023-10-25T16:13:17.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f7369cfb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7350005190 0x7f736414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f7369cfb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7350005190 0x7f736414ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48914/0 (socket says 172.21.15.177:48914) 2023-10-25T16:13:17.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f7369cfb640 1 -- 172.21.15.177:0/1690546324 learned_addr learned my addr 172.21.15.177:0/1690546324 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:17.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736415a6d0 con 0x7f73640cb3d0 2023-10-25T16:13:17.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f73694fa640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73640cb3d0 0x7f73641f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736acfd640 1 -- 172.21.15.177:0/1690546324 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364159b50 con 0x7f7350005190 2023-10-25T16:13:17.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f736a4fc640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7364152b10 0x7f7364152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f73694fa640 1 -- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7350005190 msgr2=0x7f736414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f73694fa640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7350005190 0x7f736414ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f73694fa640 1 -- 172.21.15.177:0/1690546324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7364152b10 msgr2=0x7f7364152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f73694fa640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7364152b10 0x7f7364152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.203+0000 7f73694fa640 1 -- 172.21.15.177:0/1690546324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364159e30 con 0x7f73640cb3d0 2023-10-25T16:13:17.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.207+0000 7f736a4fc640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7364152b10 0x7f7364152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:17.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.207+0000 7f73694fa640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73640cb3d0 0x7f73641f5350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f736000b390 tx=0x7f736000b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.207+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5a3c0523d0 con 0x7f5a2c0042e0 2023-10-25T16:13:17.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.211+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c70052690 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c0c0b4040 con 0x7f5c1415e860 2023-10-25T16:13:17.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011830 con 0x7f73640cb3d0 2023-10-25T16:13:17.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7360011aa0 con 0x7f73640cb3d0 2023-10-25T16:13:17.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360010380 con 0x7f73640cb3d0 2023-10-25T16:13:17.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f736acfd640 1 -- 172.21.15.177:0/1690546324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736415a110 con 0x7f73640cb3d0 2023-10-25T16:13:17.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f736acfd640 1 -- 172.21.15.177:0/1690546324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73640cbb90 con 0x7f73640cb3d0 2023-10-25T16:13:17.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f5bfb7fe640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c00066540 0x7f5c00068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c0c11e0b0 con 0x7f5c1415e860 2023-10-25T16:13:17.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7340005260 con 0x7f73640cb3d0 2023-10-25T16:13:17.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.215+0000 7f5c12ffd640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c00066540 0x7f5c00068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.219+0000 7f5c12ffd640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c00066540 0x7f5c00068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400b810 tx=0x7f5c04008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.227+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c0c0eb650 con 0x7f5c1415e860 2023-10-25T16:13:17.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.227+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f73600104e0 con 0x7f73640cb3d0 2023-10-25T16:13:17.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.227+0000 7f735a7fc640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7348066570 0x7f7348068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:17.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.227+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7360084810 con 0x7f73640cb3d0 2023-10-25T16:13:17.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.231+0000 7f7369cfb640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7348066570 0x7f7348068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:17.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.231+0000 7f7369cfb640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7348066570 0x7f7348068a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f735400a8d0 tx=0x7f735400e040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:17.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.235+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7360051c70 con 0x7f73640cb3d0 2023-10-25T16:13:17.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.475+0000 7f47bffff640 1 -- 172.21.15.177:0/3605001789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f47c004da80 con 0x7f47c0070ac0 2023-10-25T16:13:17.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.479+0000 7f47a7fff640 1 -- 172.21.15.177:0/3605001789 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47b00558e0 con 0x7f47c0070ac0 2023-10-25T16:13:17.484 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 -- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f47ac066540 msgr2=0x7f47ac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f47ac066540 0x7f47ac068a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47b40ae000 tx=0x7f47b401ad50 comp rx=0 tx=0).stop 2023-10-25T16:13:17.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 -- 172.21.15.177:0/3605001789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 msgr2=0x7f47c014edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 0x7f47c014edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47b000e7a0 tx=0x7f47b000ec60 comp rx=0 tx=0).stop 2023-10-25T16:13:17.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7fa91359e640 1 -- 172.21.15.177:0/2817317773 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa9140c8810 con 0x7fa9140d17d0 2023-10-25T16:13:17.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 -- 172.21.15.177:0/3605001789 shutdown_connections 2023-10-25T16:13:17.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f47ac066540 0x7f47ac068a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47c0153c80 0x7f47c00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47c00ca360 0x7f47c0153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 --2- 172.21.15.177:0/3605001789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47c0070ac0 0x7f47c014edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 -- 172.21.15.177:0/3605001789 >> 172.21.15.177:0/3605001789 conn(0x7f47c00afb80 msgr2=0x7f47c006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 -- 172.21.15.177:0/3605001789 shutdown_connections 2023-10-25T16:13:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7f47a5ffb640 1 -- 172.21.15.177:0/3605001789 wait complete. 2023-10-25T16:13:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.483+0000 7fa902ffd640 1 -- 172.21.15.177:0/2817317773 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa904055ce0 con 0x7fa9140d17d0 2023-10-25T16:13:17.489 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 -- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8f4066470 msgr2=0x7fa8f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8f4066470 0x7fa8f4068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa908000f70 tx=0x7fa9080079c0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 -- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 msgr2=0x7fa9140cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140cd9b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e9f0 tx=0x7fa90400eeb0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 -- 172.21.15.177:0/2817317773 shutdown_connections 2023-10-25T16:13:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8f4066470 0x7fa8f4068930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa91415b370 0x7fa9140cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9140d17d0 0x7fa9140cd9b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 --2- 172.21.15.177:0/2817317773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9140b2180 0x7fa9142010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 -- 172.21.15.177:0/2817317773 >> 172.21.15.177:0/2817317773 conn(0x7fa91409a5f0 msgr2=0x7fa91415f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 -- 172.21.15.177:0/2817317773 shutdown_connections 2023-10-25T16:13:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.491+0000 7fa900ff9640 1 -- 172.21.15.177:0/2817317773 wait complete. 2023-10-25T16:13:17.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.499+0000 7f9897fff640 1 -- 172.21.15.177:0/4007778150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9898154710 con 0x7f989806b4b0 2023-10-25T16:13:17.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.499+0000 7f987ffff640 1 -- 172.21.15.177:0/4007778150 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9888015020 con 0x7f989806b4b0 2023-10-25T16:13:17.506 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.503+0000 7f987dffb640 1 -- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9884066470 msgr2=0x7f9884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.503+0000 7f987dffb640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9884066470 0x7f9884068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f988c0b0000 tx=0x7f988c01d040 comp rx=0 tx=0).stop 2023-10-25T16:13:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 -- 172.21.15.177:0/4007778150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 msgr2=0x7f989814bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 0x7f989814bc20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f988800b410 tx=0x7f988800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 -- 172.21.15.177:0/4007778150 shutdown_connections 2023-10-25T16:13:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9884066470 0x7f9884068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9898157620 0x7f989814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98980700d0 0x7f9898154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 --2- 172.21.15.177:0/4007778150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f989806b4b0 0x7f989814bc20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 -- 172.21.15.177:0/4007778150 >> 172.21.15.177:0/4007778150 conn(0x7f98980cd060 msgr2=0x7f9898153910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-25T16:13:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 -- 172.21.15.177:0/4007778150 shutdown_connections 2023-10-25T16:13:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.507+0000 7f987dffb640 1 -- 172.21.15.177:0/4007778150 wait complete. 2023-10-25T16:13:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.511+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b400aadf0 con 0x7f5b4015b710 2023-10-25T16:13:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.511+0000 7f5b367fc640 1 -- 172.21.15.177:0/558122423 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b400aadf0 con 0x7f5b4015b710 2023-10-25T16:13:17.516 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-25T16:13:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b24066470 msgr2=0x7f5b24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b24066470 0x7f5b24068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009230 tx=0x7f5b3001b080 comp rx=0 tx=0).stop 2023-10-25T16:13:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 msgr2=0x7f5b4015dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4015dfb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c440 tx=0x7f5b3c00c900 comp rx=0 tx=0).stop 2023-10-25T16:13:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 shutdown_connections 2023-10-25T16:13:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b24066470 0x7f5b24068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b4015b710 0x7f5b4015dfb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b4013bda0 0x7f5b40159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 --2- 172.21.15.177:0/558122423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b400af5d0 0x7f5b400abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 >> 172.21.15.177:0/558122423 conn(0x7f5b400b2450 msgr2=0x7f5b400cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 shutdown_connections 2023-10-25T16:13:17.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.515+0000 7f5b47c6b640 1 -- 172.21.15.177:0/558122423 wait complete. 2023-10-25T16:13:17.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.519+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a4004da80 con 0x7f5a2c0042e0 2023-10-25T16:13:17.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.519+0000 7f5a367fc640 1 -- 172.21.15.177:0/3035903454 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a3c00eea0 con 0x7f5a2c0042e0 2023-10-25T16:13:17.524 INFO:teuthology.orchestra.run.smithi177.stdout:60129542149 2023-10-25T16:13:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5a24066470 msgr2=0x7f5a24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5a24066470 0x7f5a24068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a300b0000 tx=0x7f5a3001c520 comp rx=0 tx=0).stop 2023-10-25T16:13:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 msgr2=0x7f5a400b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 0x7f5a400b1ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0107f0 tx=0x7f5a3c010cb0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 shutdown_connections 2023-10-25T16:13:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5a24066470 0x7f5a24068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a40097ec0 0x7f5a400ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a40097a40 0x7f5a400b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 --2- 172.21.15.177:0/3035903454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a2c0042e0 0x7f5a400b1ae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 >> 172.21.15.177:0/3035903454 conn(0x7f5a400aea90 msgr2=0x7f5a4006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 shutdown_connections 2023-10-25T16:13:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f5a47ab9640 1 -- 172.21.15.177:0/3035903454 wait complete. 2023-10-25T16:13:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0c6c0525c0 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.523+0000 7f0c6a7fc640 1 -- 172.21.15.177:0/247566710 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c6c0525c0 con 0x7f0c6c0d7f40 2023-10-25T16:13:17.531 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f73400050d0 con 0x7f73640cb3d0 2023-10-25T16:13:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c1404daf0 con 0x7f5c1415e860 2023-10-25T16:13:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c58066540 msgr2=0x7f0c58068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c58066540 0x7f0c58068a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c740635f0 tx=0x7f0c740677d0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 msgr2=0x7f0c6c0d8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 0x7f0c6c0d8eb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000e710 tx=0x7f0c7000ebd0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 shutdown_connections 2023-10-25T16:13:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c58066540 0x7f0c58068a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c6c0d8420 0x7f0c6c0d6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c0d7f40 0x7f0c6c0d8eb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 --2- 172.21.15.177:0/247566710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c60004fa0 0x7f0c6c0d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 >> 172.21.15.177:0/247566710 conn(0x7f0c6c009f90 msgr2=0x7f0c6c053a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 shutdown_connections 2023-10-25T16:13:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f0c7c140640 1 -- 172.21.15.177:0/247566710 wait complete. 2023-10-25T16:13:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f735a7fc640 1 -- 172.21.15.177:0/1690546324 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7360015020 con 0x7f73640cb3d0 2023-10-25T16:13:17.536 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.527+0000 7f5bfb7fe640 1 -- 172.21.15.177:0/1413883884 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c0c0eec70 con 0x7f5c1415e860 2023-10-25T16:13:17.537 INFO:teuthology.orchestra.run.smithi177.stdout:55834574853 2023-10-25T16:13:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c00066540 msgr2=0x7f5c00068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c00066540 0x7f5c00068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400b810 tx=0x7f5c04008040 comp rx=0 tx=0).stop 2023-10-25T16:13:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c1415e860 msgr2=0x7f5c14150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c1415e860 0x7f5c14150730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c140ccb60 tx=0x7f5c0c0a5b50 comp rx=0 tx=0).stop 2023-10-25T16:13:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 shutdown_connections 2023-10-25T16:13:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c00066540 0x7f5c00068a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c1415e860 0x7f5c14150730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c140ae550 0x7f5c141501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 --2- 172.21.15.177:0/1413883884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c1406b120 0x7f5c14151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 >> 172.21.15.177:0/1413883884 conn(0x7f5c140cefe0 msgr2=0x7f5c1406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7348066570 msgr2=0x7f7348068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7348066570 0x7f7348068a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f735400a8d0 tx=0x7f735400e040 comp rx=0 tx=0).stop 2023-10-25T16:13:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73640cb3d0 msgr2=0x7f73641f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73640cb3d0 0x7f73641f5350 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f736000b390 tx=0x7f736000b850 comp rx=0 tx=0).stop 2023-10-25T16:13:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 shutdown_connections 2023-10-25T16:13:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f5c19641640 1 -- 172.21.15.177:0/1413883884 wait complete. 2023-10-25T16:13:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 shutdown_connections 2023-10-25T16:13:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7348066570 0x7f7348068a30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7364152b10 0x7f7364152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73640cb3d0 0x7f73641f5350 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 --2- 172.21.15.177:0/1690546324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7350005190 0x7f736414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 >> 172.21.15.177:0/1690546324 conn(0x7f73640aea20 msgr2=0x7f7364154120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 shutdown_connections 2023-10-25T16:13:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:17.531+0000 7f7347fff640 1 -- 172.21.15.177:0/1690546324 wait complete. 2023-10-25T16:13:17.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-25T16:13:17.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-25T16:13:17.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-25T16:13:17.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-25T16:13:17.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2023-10-25T16:13:17.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-25T16:13:18.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-25T16:13:18.521 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-25T16:13:18.546 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-25T16:13:18.556 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-25T16:13:18.559 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-25T16:13:18.561 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-25T16:13:18.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-25T16:13:18.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-25T16:13:18.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 -- 172.21.15.177:0/2430128779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 msgr2=0x7fe36015ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 --2- 172.21.15.177:0/2430128779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 0x7fe36015ed80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe350009840 tx=0x7fe35001c300 comp rx=0 tx=0).stop 2023-10-25T16:13:18.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 -- 172.21.15.177:0/2430128779 shutdown_connections 2023-10-25T16:13:18.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 --2- 172.21.15.177:0/2430128779 >> v2:172.21.15.177:3300/0 conn(0x7fe3600ac3f0 0x7fe36015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 --2- 172.21.15.177:0/2430128779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 0x7fe36015ed80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 -- 172.21.15.177:0/2430128779 >> 172.21.15.177:0/2430128779 conn(0x7fe3600ccd00 msgr2=0x7fe3600cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 -- 172.21.15.177:0/2430128779 shutdown_connections 2023-10-25T16:13:18.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 -- 172.21.15.177:0/2430128779 wait complete. 2023-10-25T16:13:18.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 Processor -- start 2023-10-25T16:13:18.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.694+0000 7fe365c3b640 1 -- start start 2023-10-25T16:13:18.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 0x7fe36014aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3600ac3f0 0x7fe3601fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 0x7fe3600703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601fbcc0 con 0x7fe36006ff10 2023-10-25T16:13:18.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601fb080 con 0x7fe3600ac3f0 2023-10-25T16:13:18.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601fb320 con 0x7fe3600aa6c0 2023-10-25T16:13:18.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 0x7fe3600703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 0x7fe3600703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43746/0 (socket says 172.21.15.177:43746) 2023-10-25T16:13:18.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 -- 172.21.15.177:0/167725851 learned_addr learned my addr 172.21.15.177:0/167725851 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35f7fe640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 0x7fe36014aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35effd640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3600ac3f0 0x7fe3601fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 -- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 msgr2=0x7fe36014aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 0x7fe36014aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 -- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3600ac3f0 msgr2=0x7fe3601fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3600ac3f0 0x7fe3601fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 -- 172.21.15.177:0/167725851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540094a0 con 0x7fe36006ff10 2023-10-25T16:13:18.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe35ffff640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 0x7fe3600703c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe35400e920 tx=0x7fe35400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540097c0 con 0x7fe36006ff10 2023-10-25T16:13:18.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 -- 172.21.15.177:0/167725851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3500094a0 con 0x7fe36006ff10 2023-10-25T16:13:18.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe365c3b640 1 -- 172.21.15.177:0/167725851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3601fb8e0 con 0x7fe36006ff10 2023-10-25T16:13:18.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.698+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe35400cd80 con 0x7fe36006ff10 2023-10-25T16:13:18.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.702+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354004280 con 0x7fe36006ff10 2023-10-25T16:13:18.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.702+0000 7fe365c3b640 1 -- 172.21.15.177:0/167725851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340005260 con 0x7fe36006ff10 2023-10-25T16:13:18.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.706+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe354003600 con 0x7fe36006ff10 2023-10-25T16:13:18.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.710+0000 7fe347fff640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe34c066570 0x7fe34c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.710+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe354014070 con 0x7fe36006ff10 2023-10-25T16:13:18.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.710+0000 7fe35f7fe640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe34c066570 0x7fe34c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.710+0000 7fe35f7fe640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe34c066570 0x7fe34c068a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3500ae000 tx=0x7fe35001ab40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.710+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe354051f00 con 0x7fe36006ff10 2023-10-25T16:13:18.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 -- 172.21.15.177:0/1981869442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 msgr2=0x7fc37415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/1981869442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc37415ed80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc364009840 tx=0x7fc36401c6e0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 -- 172.21.15.177:0/1981869442 shutdown_connections 2023-10-25T16:13:18.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/1981869442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/1981869442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc37415ed80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 -- 172.21.15.177:0/1981869442 >> 172.21.15.177:0/1981869442 conn(0x7fc3740ccd00 msgr2=0x7fc3740cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 -- 172.21.15.177:0/1981869442 shutdown_connections 2023-10-25T16:13:18.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.726+0000 7fc37a1d2640 1 -- 172.21.15.177:0/1981869442 wait complete. 2023-10-25T16:13:18.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 Processor -- start 2023-10-25T16:13:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 -- 172.21.15.177:0/2087527513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 msgr2=0x7f24780061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 --2- 172.21.15.177:0/2087527513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f24780061a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2480063530 tx=0x7f2480094ff0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 -- 172.21.15.177:0/2087527513 shutdown_connections 2023-10-25T16:13:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 --2- 172.21.15.177:0/2087527513 >> v2:172.21.15.184:3300/0 conn(0x7f247803e7e0 0x7f2478054120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 --2- 172.21.15.177:0/2087527513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f24780061a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 -- 172.21.15.177:0/2087527513 >> 172.21.15.177:0/2087527513 conn(0x7f2478058ec0 msgr2=0x7f24780592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 -- 172.21.15.177:0/2087527513 shutdown_connections 2023-10-25T16:13:18.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 -- start start 2023-10-25T16:13:18.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc374155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37415d620 0x7fc3741524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741556f0 con 0x7fc3740aa6c0 2023-10-25T16:13:18.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741559d0 con 0x7fc37415d620 2023-10-25T16:13:18.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37415ce20 con 0x7fc3740ac3f0 2023-10-25T16:13:18.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:48944/0 (socket says 172.21.15.177:48944) 2023-10-25T16:13:18.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 -- 172.21.15.177:0/3778905666 learned_addr learned my addr 172.21.15.177:0/3778905666 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 -- 172.21.15.177:0/2087527513 wait complete. 2023-10-25T16:13:18.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc373fff640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37415d620 0x7fc3741524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc3737fe640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc374155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 -- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37415d620 msgr2=0x7fc3741524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37415d620 0x7fc3741524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 -- 172.21.15.177:0/3778905666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 msgr2=0x7fc374155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc374155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 -- 172.21.15.177:0/3778905666 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640094a0 con 0x7fc3740ac3f0 2023-10-25T16:13:18.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc3737fe640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc374155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:18.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 Processor -- start 2023-10-25T16:13:18.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7f2486500640 1 -- start start 2023-10-25T16:13:18.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc372ffd640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415e730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00cbc0 tx=0x7fc36c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00a840 con 0x7fc3740ac3f0 2023-10-25T16:13:18.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37415d100 con 0x7fc3740ac3f0 2023-10-25T16:13:18.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37415dad0 con 0x7fc3740ac3f0 2023-10-25T16:13:18.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc36c00aab0 con 0x7fc3740ac3f0 2023-10-25T16:13:18.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.730+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c012420 con 0x7fc3740ac3f0 2023-10-25T16:13:18.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f247803e7e0 0x7f24780cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f2478037ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780e3530 0x7f2478038020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478050eb0 con 0x7f24780e3150 2023-10-25T16:13:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f247803e7e0 0x7f24780cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f247803e7e0 0x7f24780cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.177:51874/0 (socket says 172.21.15.177:51874) 2023-10-25T16:13:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247ffff640 1 -- 172.21.15.177:0/3307448602 learned_addr learned my addr 172.21.15.177:0/3307448602 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478052de0 con 0x7f247803e7e0 2023-10-25T16:13:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2478052820 con 0x7f24780e3530 2023-10-25T16:13:18.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f2478037ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc354005260 con 0x7fc3740ac3f0 2023-10-25T16:13:18.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 -- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780e3530 msgr2=0x7f2478038020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780e3530 0x7f2478038020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 -- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f247803e7e0 msgr2=0x7f24780cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f247803e7e0 0x7f24780cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2480067990 con 0x7f24780e3150 2023-10-25T16:13:18.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247f7fe640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f2478037ae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f247400e9f0 tx=0x7f247400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc36c01a5c0 con 0x7fc3740ac3f0 2023-10-25T16:13:18.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7fc35bfff640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc360066470 0x7fc360068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc36c084a90 con 0x7fc3740ac3f0 2023-10-25T16:13:18.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400ccc0 con 0x7f24780e3150 2023-10-25T16:13:18.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2474010430 con 0x7f24780e3150 2023-10-25T16:13:18.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474010820 con 0x7f24780e3150 2023-10-25T16:13:18.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2478052b00 con 0x7f24780e3150 2023-10-25T16:13:18.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247804ce00 con 0x7f24780e3150 2023-10-25T16:13:18.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7fc3737fe640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc360066470 0x7fc360068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.738+0000 7fc3737fe640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc360066470 0x7fc360068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3640af000 tx=0x7fc36401af20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.734+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2460005260 con 0x7f24780e3150 2023-10-25T16:13:18.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.738+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2474010980 con 0x7f24780e3150 2023-10-25T16:13:18.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.738+0000 7f247cff9640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2464066570 0x7f2464068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.738+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2474014070 con 0x7f24780e3150 2023-10-25T16:13:18.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.738+0000 7f247ffff640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2464066570 0x7f2464068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.738+0000 7f247ffff640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2464066570 0x7f2464068a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2480068c30 tx=0x7f2480093880 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/3262189790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f00e32e0 msgr2=0x7fa5f003e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/3262189790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f00e32e0 0x7fa5f003e850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0056900 tx=0x7fa5e801c870 comp rx=0 tx=0).stop 2023-10-25T16:13:18.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/3262189790 shutdown_connections 2023-10-25T16:13:18.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/3262189790 >> v2:172.21.15.177:3300/0 conn(0x7fa5f0053c20 0x7fa5f00540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/3262189790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f00e32e0 0x7fa5f003e850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/3262189790 >> 172.21.15.177:0/3262189790 conn(0x7fa5f00559f0 msgr2=0x7fa5f0055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/3262189790 shutdown_connections 2023-10-25T16:13:18.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/3262189790 wait complete. 2023-10-25T16:13:18.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2474050090 con 0x7f24780e3150 2023-10-25T16:13:18.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc36c051ef0 con 0x7fc3740ac3f0 2023-10-25T16:13:18.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.746+0000 7fa5ffc4f640 1 Processor -- start 2023-10-25T16:13:18.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 -- 172.21.15.177:0/168175983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c840557c0 msgr2=0x7f2c84055c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 -- 172.21.15.177:0/153610589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd88070c80 msgr2=0x7fdd880b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/153610589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd88070c80 0x7fdd880b11f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009bc0 tx=0x7fdd8001ca30 comp rx=0 tx=0).stop 2023-10-25T16:13:18.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c8b7fe640 1 -- 172.21.15.177:0/168175983 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c800a5730 con 0x7f2c840557c0 2023-10-25T16:13:18.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 --2- 172.21.15.177:0/168175983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c840557c0 0x7f2c84055c50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009840 tx=0x7f2c8001c780 comp rx=0 tx=0).stop 2023-10-25T16:13:18.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 -- 172.21.15.177:0/153610589 shutdown_connections 2023-10-25T16:13:18.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/153610589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd88070c80 0x7fdd880b11f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/153610589 >> v2:172.21.15.184:3300/0 conn(0x7fdd880708a0 0x7fdd880ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 -- 172.21.15.177:0/153610589 >> 172.21.15.177:0/153610589 conn(0x7fdd880aea20 msgr2=0x7fdd880aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 -- start start 2023-10-25T16:13:18.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 -- 172.21.15.177:0/153610589 shutdown_connections 2023-10-25T16:13:18.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 -- 172.21.15.177:0/153610589 wait complete. 2023-10-25T16:13:18.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5f0053c20 0x7fa5f0189930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5f00e6c40 0x7fa5f00e0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 0x7fa5f00e2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0189e70 con 0x7fa5f00e6c40 2023-10-25T16:13:18.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00e4160 con 0x7fa5f004cae0 2023-10-25T16:13:18.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5ffc4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00e4400 con 0x7fa5f0053c20 2023-10-25T16:13:18.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5fd9eb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5f0053c20 0x7fa5f0189930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 -- 172.21.15.177:0/168175983 shutdown_connections 2023-10-25T16:13:18.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 --2- 172.21.15.177:0/168175983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c840557c0 0x7f2c84055c50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 --2- 172.21.15.177:0/168175983 >> v2:172.21.15.177:3300/0 conn(0x7f2c84009d50 0x7f2c8400a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 -- 172.21.15.177:0/168175983 >> 172.21.15.177:0/168175983 conn(0x7f2c84056cc0 msgr2=0x7f2c840570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5fe1ec640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 0x7fa5f00e2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5fe1ec640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 0x7fa5f00e2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.177:51912/0 (socket says 172.21.15.177:51912) 2023-10-25T16:13:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fa5fe1ec640 1 -- 172.21.15.177:0/621600321 learned_addr learned my addr 172.21.15.177:0/621600321 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 Processor -- start 2023-10-25T16:13:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 -- 172.21.15.177:0/168175983 shutdown_connections 2023-10-25T16:13:18.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fa5fe1ec640 1 -- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5f0053c20 msgr2=0x7fa5f0189930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fa5fe1ec640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5f0053c20 0x7fa5f0189930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fa5fe1ec640 1 -- 172.21.15.177:0/621600321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5f00e6c40 msgr2=0x7fa5f00e0850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T16:13:18.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fa5fe1ec640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5f00e6c40 0x7fa5f00e0850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fa5fe1ec640 1 -- 172.21.15.177:0/621600321 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009560 con 0x7fa5f004cae0 2023-10-25T16:13:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7fdd8d81b640 1 -- start start 2023-10-25T16:13:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd880708a0 0x7fdd8813c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 0x7fdd881600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd880b0b80 0x7fdd880ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881f4860 con 0x7fdd88070c80 2023-10-25T16:13:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8813cd60 con 0x7fdd880708a0 2023-10-25T16:13:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881541d0 con 0x7fdd880b0b80 2023-10-25T16:13:18.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 0x7fdd881600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 0x7fdd881600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43822/0 (socket says 172.21.15.177:43822) 2023-10-25T16:13:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 -- 172.21.15.177:0/3889337227 learned_addr learned my addr 172.21.15.177:0/3889337227 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8c819640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd880708a0 0x7fdd8813c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 -- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd880b0b80 msgr2=0x7fdd880ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d01a640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd880b0b80 0x7fdd880ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd880b0b80 0x7fdd880ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 -- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd880708a0 msgr2=0x7fdd8813c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd880708a0 0x7fdd8813c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 -- 172.21.15.177:0/3889337227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009820 con 0x7fdd88070c80 2023-10-25T16:13:18.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d01a640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd880b0b80 0x7fdd880ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:18.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.750+0000 7f2c91fef640 1 -- 172.21.15.177:0/168175983 wait complete. 2023-10-25T16:13:18.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7f2c91fef640 1 Processor -- start 2023-10-25T16:13:18.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7f2c91fef640 1 -- start start 2023-10-25T16:13:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7f2c91fef640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c84009d50 0x7f2c840e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd87fff640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 0x7fdd881600f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd80000f90 tx=0x7fdd800a5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800bc070 con 0x7fdd88070c80 2023-10-25T16:13:18.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdd80005130 con 0x7fdd88070c80 2023-10-25T16:13:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd88160bc0 con 0x7fdd88070c80 2023-10-25T16:13:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800054e0 con 0x7fdd88070c80 2023-10-25T16:13:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.754+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd88153b80 con 0x7fdd88070c80 2023-10-25T16:13:18.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fa5fe1ec640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 0x7fa5f00e2450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802caf0 tx=0x7fa5f80668a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c91fef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 0x7f2c840506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c91fef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c840e10c0 0x7f2c84038790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c91fef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84050c20 con 0x7f2c840557c0 2023-10-25T16:13:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c91fef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840e3fa0 con 0x7f2c840e10c0 2023-10-25T16:13:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c91fef640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c840e3390 con 0x7f2c84009d50 2023-10-25T16:13:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd88066b20 con 0x7fdd88070c80 2023-10-25T16:13:18.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd800b4040 con 0x7fdd88070c80 2023-10-25T16:13:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f806acb0 con 0x7fa5f004cae0 2023-10-25T16:13:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa5f80725e0 con 0x7fa5f004cae0 2023-10-25T16:13:18.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 0x7f2c840506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 0x7f2c840506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43824/0 (socket says 172.21.15.177:43824) 2023-10-25T16:13:18.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 -- 172.21.15.177:0/2762844021 learned_addr learned my addr 172.21.15.177:0/2762844021 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c90fed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c84009d50 0x7f2c840e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c917ee640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c840e10c0 0x7f2c84038790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 -- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c84009d50 msgr2=0x7f2c840e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c84009d50 0x7f2c840e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 -- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c840e10c0 msgr2=0x7f2c84038790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c840e10c0 0x7f2c84038790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 -- 172.21.15.177:0/2762844021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800094a0 con 0x7f2c840557c0 2023-10-25T16:13:18.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c917ee640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c840e10c0 0x7f2c84038790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:18.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7f2c8bfff640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 0x7f2c840506e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c000b70 tx=0x7f2c8c067990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8072d30 con 0x7fa5f004cae0 2023-10-25T16:13:18.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fdd857fa640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdd74066470 0x7fdd74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fdd8c819640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdd74066470 0x7fdd74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.758+0000 7fdd8c819640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdd74066470 0x7fdd74068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009b70 tx=0x7fdd7c0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00e1c50 con 0x7fa5f004cae0 2023-10-25T16:13:18.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00e46e0 con 0x7fa5f004cae0 2023-10-25T16:13:18.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f003e4b0 con 0x7fa5f004cae0 2023-10-25T16:13:18.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5f808e020 con 0x7fa5f004cae0 2023-10-25T16:13:18.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5ee7fc640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5dc066440 0x7fa5dc068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c06acb0 con 0x7f2c840557c0 2023-10-25T16:13:18.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5f80fbee0 con 0x7fa5f004cae0 2023-10-25T16:13:18.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c840e3670 con 0x7f2c840557c0 2023-10-25T16:13:18.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd800ef880 con 0x7fdd88070c80 2023-10-25T16:13:18.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd80123060 con 0x7fdd88070c80 2023-10-25T16:13:18.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.762+0000 7fa5fd9eb640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5dc066440 0x7fa5dc068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.766+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c840e3c30 con 0x7f2c840557c0 2023-10-25T16:13:18.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.766+0000 7fa5fd9eb640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5dc066440 0x7fa5dc068900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80af000 tx=0x7fa5e801b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.766+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2c8c06ae10 con 0x7f2c840557c0 2023-10-25T16:13:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.766+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c091620 con 0x7f2c840557c0 2023-10-25T16:13:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.766+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2c8c08e020 con 0x7f2c840557c0 2023-10-25T16:13:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.770+0000 7f2c897fa640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c70066470 0x7f2c70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.770+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c8c0ccb40 con 0x7f2c840557c0 2023-10-25T16:13:18.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.770+0000 7f2c90fed640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c70066470 0x7f2c70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.770+0000 7f2c90fed640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c70066470 0x7f2c70068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007fd0 tx=0x7f2c78009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.774+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c005260 con 0x7f2c840557c0 2023-10-25T16:13:18.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.774+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5f80c93d0 con 0x7fa5f004cae0 2023-10-25T16:13:18.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.782+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c8c0c8780 con 0x7f2c840557c0 2023-10-25T16:13:18.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 -- 172.21.15.177:0/2372388867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac155970 msgr2=0x7fccac0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 --2- 172.21.15.177:0/2372388867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac155970 0x7fccac0b16e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fccac071960 tx=0x7fcc9c01c540 comp rx=0 tx=0).stop 2023-10-25T16:13:18.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 -- 172.21.15.177:0/2372388867 shutdown_connections 2023-10-25T16:13:18.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 --2- 172.21.15.177:0/2372388867 >> v2:172.21.15.177:3300/0 conn(0x7fccac0712c0 0x7fccac0a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 --2- 172.21.15.177:0/2372388867 >> v2:172.21.15.184:3300/0 conn(0x7fccac0b10c0 0x7fccac070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 --2- 172.21.15.177:0/2372388867 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac155970 0x7fccac0b16e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 -- 172.21.15.177:0/2372388867 >> 172.21.15.177:0/2372388867 conn(0x7fccac0aea90 msgr2=0x7fccac0aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 -- 172.21.15.177:0/2372388867 shutdown_connections 2023-10-25T16:13:18.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 -- 172.21.15.177:0/2372388867 wait complete. 2023-10-25T16:13:18.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 Processor -- start 2023-10-25T16:13:18.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.790+0000 7fccab59e640 1 -- start start 2023-10-25T16:13:18.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccab59e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac0712c0 0x7fccac0ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccab59e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccac0b10c0 0x7fccac1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccab59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 0x7fccac14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccab59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0ae8d0 con 0x7fccac155970 2023-10-25T16:13:18.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccab59e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac097a40 con 0x7fccac0b10c0 2023-10-25T16:13:18.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccab59e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0984c0 con 0x7fccac0712c0 2023-10-25T16:13:18.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 0x7fccac14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 0x7fccac14c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43832/0 (socket says 172.21.15.177:43832) 2023-10-25T16:13:18.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 -- 172.21.15.177:0/2168111280 learned_addr learned my addr 172.21.15.177:0/2168111280 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fcca9d9b640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccac0b10c0 0x7fccac1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaa59c640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac0712c0 0x7fccac0ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 -- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac0712c0 msgr2=0x7fccac0ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac0712c0 0x7fccac0ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 -- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccac0b10c0 msgr2=0x7fccac1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccac0b10c0 0x7fccac1546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 -- 172.21.15.177:0/2168111280 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0094a0 con 0x7fccac155970 2023-10-25T16:13:18.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.794+0000 7fccaad9d640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 0x7fccac14c9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e8f0 tx=0x7fcca000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0009730 con 0x7fccac155970 2023-10-25T16:13:18.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac0987a0 con 0x7fccac155970 2023-10-25T16:13:18.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac154c20 con 0x7fccac155970 2023-10-25T16:13:18.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcca000ccc0 con 0x7fccac155970 2023-10-25T16:13:18.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0005280 con 0x7fccac155970 2023-10-25T16:13:18.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcca0005460 con 0x7fccac155970 2023-10-25T16:13:18.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac066b20 con 0x7fccac155970 2023-10-25T16:13:18.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fcc9affd640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc8c066540 0x7fcc8c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcca0014070 con 0x7fccac155970 2023-10-25T16:13:18.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.798+0000 7fccaa59c640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc8c066540 0x7fcc8c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.802+0000 7fccaa59c640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc8c066540 0x7fcc8c068a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0af000 tx=0x7fcc9c01ad80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.806+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcca0089060 con 0x7fccac155970 2023-10-25T16:13:18.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.814+0000 7fbc14842640 1 -- 172.21.15.177:0/585589241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1006c180 msgr2=0x7fbc1015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.814+0000 7fbc0d59a640 1 -- 172.21.15.177:0/585589241 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc000a5840 con 0x7fbc1006c180 2023-10-25T16:13:18.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.814+0000 7fbc14842640 1 --2- 172.21.15.177:0/585589241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1006c180 0x7fbc1015afb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbc1015aef0 tx=0x7fbc0001c760 comp rx=0 tx=0).stop 2023-10-25T16:13:18.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 -- 172.21.15.177:0/585589241 shutdown_connections 2023-10-25T16:13:18.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 --2- 172.21.15.177:0/585589241 >> v2:172.21.15.184:3300/0 conn(0x7fbc100c9df0 0x7fbc100aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 --2- 172.21.15.177:0/585589241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1006c180 0x7fbc1015afb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 -- 172.21.15.177:0/585589241 >> 172.21.15.177:0/585589241 conn(0x7fbc100b2450 msgr2=0x7fbc100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:18.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 -- 172.21.15.177:0/585589241 shutdown_connections 2023-10-25T16:13:18.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 -- 172.21.15.177:0/585589241 wait complete. 2023-10-25T16:13:18.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 Processor -- start 2023-10-25T16:13:18.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.818+0000 7fbc14842640 1 -- start start 2023-10-25T16:13:18.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc1006c180 0x7fbc101f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc100c9df0 0x7fbc101681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 0x7fbc101686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0e59c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc1006c180 0x7fbc101f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0e59c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc1006c180 0x7fbc101f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.177:49024/0 (socket says 172.21.15.177:49024) 2023-10-25T16:13:18.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 0x7fbc101686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 0x7fbc101686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43852/0 (socket says 172.21.15.177:43852) 2023-10-25T16:13:18.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10168c20 con 0x7fbc1015bbe0 2023-10-25T16:13:18.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc101f79b0 con 0x7fbc100c9df0 2023-10-25T16:13:18.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10201fc0 con 0x7fbc1006c180 2023-10-25T16:13:18.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0e59c640 1 -- 172.21.15.177:0/1210529537 learned_addr learned my addr 172.21.15.177:0/1210529537 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:18.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0dd9b640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc100c9df0 0x7fbc101681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 -- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc1006c180 msgr2=0x7fbc101f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc1006c180 0x7fbc101f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 -- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc100c9df0 msgr2=0x7fbc101681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:18.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc100c9df0 0x7fbc101681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:18.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 -- 172.21.15.177:0/1210529537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000094a0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc0ed9d640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 0x7fbc101686e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800ac10 tx=0x7fbc080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:18.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc08004d30 con 0x7fbc1015bbe0 2023-10-25T16:13:18.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc10166280 con 0x7fbc1015bbe0 2023-10-25T16:13:18.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc10166840 con 0x7fbc1015bbe0 2023-10-25T16:13:18.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbc0800a2e0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800eac0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.822+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc102021e0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.826+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc0800ece0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.826+0000 7fbbfeffd640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbf8066950 0x7fbbf8068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:18.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.826+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc080840c0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.826+0000 7fbc0e59c640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbf8066950 0x7fbbf8068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:18.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.834+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc102021e0 con 0x7fbc1015bbe0 2023-10-25T16:13:18.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.834+0000 7fbc0e59c640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbf8066950 0x7fbbf8068e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc04007fd0 tx=0x7fbc04007e00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.998+0000 7fe365c3b640 1 -- 172.21.15.177:0/167725851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe340005510 con 0x7fe36006ff10 2023-10-25T16:13:19.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:18.998+0000 7fe347fff640 1 -- 172.21.15.177:0/167725851 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe354055520 con 0x7fe36006ff10 2023-10-25T16:13:19.007 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 -- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe34c066570 msgr2=0x7fe34c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe34c066570 0x7fe34c068a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3500ae000 tx=0x7fe35001ab40 comp rx=0 tx=0).stop 2023-10-25T16:13:19.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 -- 172.21.15.177:0/167725851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 msgr2=0x7fe3600703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 0x7fe3600703c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe35400e920 tx=0x7fe35400ede0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 -- 172.21.15.177:0/167725851 shutdown_connections 2023-10-25T16:13:19.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe34c066570 0x7fe34c068a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe36006ff10 0x7fe3600703c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3600ac3f0 0x7fe3601fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 --2- 172.21.15.177:0/167725851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3600aa6c0 0x7fe36014aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 -- 172.21.15.177:0/167725851 >> 172.21.15.177:0/167725851 conn(0x7fe3600ccd00 msgr2=0x7fe36016be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 -- 172.21.15.177:0/167725851 shutdown_connections 2023-10-25T16:13:19.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.006+0000 7fe345ffb640 1 -- 172.21.15.177:0/167725851 wait complete. 2023-10-25T16:13:19.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-25T16:13:19.034 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.058+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2c6c0057e0 con 0x7f2c840557c0 2023-10-25T16:13:19.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.058+0000 7f2c897fa640 1 -- 172.21.15.177:0/2762844021 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c8c0cbda0 con 0x7f2c840557c0 2023-10-25T16:13:19.065 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f24600050d0 con 0x7f24780e3150 2023-10-25T16:13:19.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f247cff9640 1 -- 172.21.15.177:0/3307448602 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2474051c90 con 0x7f24780e3150 2023-10-25T16:13:19.066 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3540057e0 con 0x7fc3740ac3f0 2023-10-25T16:13:19.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7fc35bfff640 1 -- 172.21.15.177:0/3778905666 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc36c055510 con 0x7fc3740ac3f0 2023-10-25T16:13:19.067 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c70066470 msgr2=0x7f2c70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c70066470 0x7f2c70068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c78007fd0 tx=0x7f2c78009040 comp rx=0 tx=0).stop 2023-10-25T16:13:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 msgr2=0x7f2c840506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 0x7f2c840506e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c000b70 tx=0x7f2c8c067990 comp rx=0 tx=0).stop 2023-10-25T16:13:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 shutdown_connections 2023-10-25T16:13:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c70066470 0x7f2c70068930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c840e10c0 0x7f2c84038790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c840557c0 0x7f2c840506e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 --2- 172.21.15.177:0/2762844021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c84009d50 0x7f2c840e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 >> 172.21.15.177:0/2762844021 conn(0x7f2c84056cc0 msgr2=0x7f2c84051660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 shutdown_connections 2023-10-25T16:13:19.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2c91fef640 1 -- 172.21.15.177:0/2762844021 wait complete. 2023-10-25T16:13:19.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2464066570 msgr2=0x7f2464068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2464066570 0x7f2464068a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2480068c30 tx=0x7f2480093880 comp rx=0 tx=0).stop 2023-10-25T16:13:19.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 msgr2=0x7f2478037ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f2478037ae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f247400e9f0 tx=0x7f247400eeb0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 shutdown_connections 2023-10-25T16:13:19.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2464066570 0x7f2464068a30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24780e3530 0x7f2478038020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24780e3150 0x7f2478037ae0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 --2- 172.21.15.177:0/3307448602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f247803e7e0 0x7f24780cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.062+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 >> 172.21.15.177:0/3307448602 conn(0x7f2478058ec0 msgr2=0x7f2478007120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 shutdown_connections 2023-10-25T16:13:19.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7f2486500640 1 -- 172.21.15.177:0/3307448602 wait complete. 2023-10-25T16:13:19.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc360066470 msgr2=0x7fc360068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc360066470 0x7fc360068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3640af000 tx=0x7fc36401af20 comp rx=0 tx=0).stop 2023-10-25T16:13:19.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 msgr2=0x7fc37415e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415e730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00cbc0 tx=0x7fc36c00cbf0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdd88153610 con 0x7fdd88070c80 2023-10-25T16:13:19.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.066+0000 7fdd857fa640 1 -- 172.21.15.177:0/3889337227 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd800b2090 con 0x7fdd88070c80 2023-10-25T16:13:19.076 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 shutdown_connections 2023-10-25T16:13:19.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc360066470 0x7fc360068930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc37415d620 0x7fc3741524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3740ac3f0 0x7fc37415e730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 --2- 172.21.15.177:0/3778905666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3740aa6c0 0x7fc374155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 >> 172.21.15.177:0/3778905666 conn(0x7fc3740ccd00 msgr2=0x7fc37406b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 shutdown_connections 2023-10-25T16:13:19.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fc37a1d2640 1 -- 172.21.15.177:0/3778905666 wait complete. 2023-10-25T16:13:19.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdd74066470 msgr2=0x7fdd74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdd74066470 0x7fdd74068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009b70 tx=0x7fdd7c0091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 msgr2=0x7fdd881600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 0x7fdd881600f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd80000f90 tx=0x7fdd800a5a80 comp rx=0 tx=0).stop 2023-10-25T16:13:19.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 shutdown_connections 2023-10-25T16:13:19.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdd74066470 0x7fdd74068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd880b0b80 0x7fdd880ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd88070c80 0x7fdd881600f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 --2- 172.21.15.177:0/3889337227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd880708a0 0x7fdd8813c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 >> 172.21.15.177:0/3889337227 conn(0x7fdd880aea20 msgr2=0x7fdd881573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 shutdown_connections 2023-10-25T16:13:19.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.070+0000 7fdd8d81b640 1 -- 172.21.15.177:0/3889337227 wait complete. 2023-10-25T16:13:19.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-25T16:13:19.091 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.090+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa5f00e2170 con 0x7fa5f004cae0 2023-10-25T16:13:19.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ee7fc640 1 -- 172.21.15.177:0/621600321 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5f80cc9f0 con 0x7fa5f004cae0 2023-10-25T16:13:19.098 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5dc066440 msgr2=0x7fa5dc068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5dc066440 0x7fa5dc068900 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80af000 tx=0x7fa5e801b0b0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 msgr2=0x7fa5f00e2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 0x7fa5f00e2450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802caf0 tx=0x7fa5f80668a0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 shutdown_connections 2023-10-25T16:13:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5dc066440 0x7fa5dc068900 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f004cae0 0x7fa5f00e2450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5f00e6c40 0x7fa5f00e0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 --2- 172.21.15.177:0/621600321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5f0053c20 0x7fa5f0189930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 >> 172.21.15.177:0/621600321 conn(0x7fa5f00559f0 msgr2=0x7fa5f003c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 shutdown_connections 2023-10-25T16:13:19.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.094+0000 7fa5ffc4f640 1 -- 172.21.15.177:0/621600321 wait complete. 2023-10-25T16:13:19.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-25T16:13:19.104 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-25T16:13:19.105 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-25T16:13:19.107 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-25T16:13:19.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.110+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fccac04da80 con 0x7fccac155970 2023-10-25T16:13:19.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fcc9affd640 1 -- 172.21.15.177:0/2168111280 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcca00516b0 con 0x7fccac155970 2023-10-25T16:13:19.118 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.119 INFO:teuthology.orchestra.run.smithi177.stdout:55834574854 2023-10-25T16:13:19.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc8c066540 msgr2=0x7fcc8c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc8c066540 0x7fcc8c068a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0af000 tx=0x7fcc9c01ad80 comp rx=0 tx=0).stop 2023-10-25T16:13:19.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 msgr2=0x7fccac14c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 0x7fccac14c9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e8f0 tx=0x7fcca000edb0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 shutdown_connections 2023-10-25T16:13:19.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc8c066540 0x7fcc8c068a00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac155970 0x7fccac14c9f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccac0b10c0 0x7fccac1546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 --2- 172.21.15.177:0/2168111280 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fccac0712c0 0x7fccac0ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 >> 172.21.15.177:0/2168111280 conn(0x7fccac0aea90 msgr2=0x7fccac1633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 shutdown_connections 2023-10-25T16:13:19.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.114+0000 7fccab59e640 1 -- 172.21.15.177:0/2168111280 wait complete. 2023-10-25T16:13:19.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.118+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbc102021e0 con 0x7fbc1015bbe0 2023-10-25T16:13:19.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.118+0000 7fbbfeffd640 1 -- 172.21.15.177:0/1210529537 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc0801e020 con 0x7fbc1015bbe0 2023-10-25T16:13:19.125 INFO:teuthology.orchestra.run.smithi177.stdout:60129542151 2023-10-25T16:13:19.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbf8066950 msgr2=0x7fbbf8068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbf8066950 0x7fbbf8068e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbc04007fd0 tx=0x7fbc04007e00 comp rx=0 tx=0).stop 2023-10-25T16:13:19.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 msgr2=0x7fbc101686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 0x7fbc101686e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800ac10 tx=0x7fbc080047c0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 shutdown_connections 2023-10-25T16:13:19.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbf8066950 0x7fbbf8068e10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc1015bbe0 0x7fbc101686e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc100c9df0 0x7fbc101681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 --2- 172.21.15.177:0/1210529537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbc1006c180 0x7fbc101f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 >> 172.21.15.177:0/1210529537 conn(0x7fbc100b2450 msgr2=0x7fbc1006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 shutdown_connections 2023-10-25T16:13:19.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.122+0000 7fbc14842640 1 -- 172.21.15.177:0/1210529537 wait complete. 2023-10-25T16:13:19.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-25T16:13:19.136 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-10-25T16:13:19.143 DEBUG:teuthology.parallel:result is None 2023-10-25T16:13:19.144 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-25T16:13:19.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:19.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/1533566183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d6815eba0 msgr2=0x7f3d680b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/1533566183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d6815eba0 0x7f3d680b4100 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d6809f200 tx=0x7f3d6401c810 comp rx=0 tx=0).stop 2023-10-25T16:13:19.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/1533566183 shutdown_connections 2023-10-25T16:13:19.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/1533566183 >> v2:172.21.15.184:3300/0 conn(0x7f3d680b2120 0x7f3d680d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/1533566183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d6815eba0 0x7f3d680b4100 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/1533566183 >> 172.21.15.177:0/1533566183 conn(0x7f3d6809a5c0 msgr2=0x7f3d680d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/1533566183 shutdown_connections 2023-10-25T16:13:19.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/1533566183 wait complete. 2023-10-25T16:13:19.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 Processor -- start 2023-10-25T16:13:19.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- start start 2023-10-25T16:13:19.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 0x7f3d680c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d680cdb10 0x7f3d680c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d6815eba0 0x7f3d6814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c6050 con 0x7f3d680b2120 2023-10-25T16:13:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68158dc0 con 0x7f3d6815eba0 2023-10-25T16:13:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d680c79b0 con 0x7f3d680cdb10 2023-10-25T16:13:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 0x7f3d680c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 0x7f3d680c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43868/0 (socket says 172.21.15.177:43868) 2023-10-25T16:13:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 -- 172.21.15.177:0/503902265 learned_addr learned my addr 172.21.15.177:0/503902265 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:19.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 -- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d680cdb10 msgr2=0x7f3d680c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d680cdb10 0x7f3d680c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 -- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d6815eba0 msgr2=0x7f3d6814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d6815eba0 0x7f3d6814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 -- 172.21.15.177:0/503902265 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64009560 con 0x7f3d680b2120 2023-10-25T16:13:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6d80e640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 0x7f3d680c5b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d640b0040 tx=0x7f3d64004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64004430 con 0x7f3d680b2120 2023-10-25T16:13:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3d64005030 con 0x7f3d680b2120 2023-10-25T16:13:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d68159080 con 0x7f3d680b2120 2023-10-25T16:13:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d68159640 con 0x7f3d680b2120 2023-10-25T16:13:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.286+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64005400 con 0x7f3d680b2120 2023-10-25T16:13:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.290+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d50005260 con 0x7f3d680b2120 2023-10-25T16:13:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.290+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3d64005560 con 0x7f3d680b2120 2023-10-25T16:13:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.290+0000 7f3d5e7fc640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3d4c066470 0x7f3d4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.290+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d640aa070 con 0x7f3d680b2120 2023-10-25T16:13:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.290+0000 7f3d6d00d640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3d4c066470 0x7f3d4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.290+0000 7f3d6d00d640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3d4c066470 0x7f3d4c068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3d680ca540 tx=0x7f3d58006ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.294+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d640ec330 con 0x7f3d680b2120 2023-10-25T16:13:19.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.434+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d50000bd0 con 0x7f3d4c066470 2023-10-25T16:13:19.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.454+0000 7f3d5e7fc640 1 -- 172.21.15.177:0/503902265 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260186 (secure 0 0 0) 0x7f3d50000bd0 con 0x7f3d4c066470 2023-10-25T16:13:19.460 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:19.462 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:19.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3d4c066470 msgr2=0x7f3d4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3d4c066470 0x7f3d4c068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3d680ca540 tx=0x7f3d58006ca0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 msgr2=0x7f3d680c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 0x7f3d680c5b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d640b0040 tx=0x7f3d64004040 comp rx=0 tx=0).stop 2023-10-25T16:13:19.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 shutdown_connections 2023-10-25T16:13:19.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3d4c066470 0x7f3d4c068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d6815eba0 0x7f3d6814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d680cdb10 0x7f3d680c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 --2- 172.21.15.177:0/503902265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d680b2120 0x7f3d680c5b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 >> 172.21.15.177:0/503902265 conn(0x7f3d6809a5c0 msgr2=0x7f3d6806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 shutdown_connections 2023-10-25T16:13:19.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.458+0000 7f3d6fa72640 1 -- 172.21.15.177:0/503902265 wait complete. 2023-10-25T16:13:19.477 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-25T16:13:18.595763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560755,"statfs":{"total":1600000000,"available":1598213284,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.053052"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541423+0000","last_change":"2023-10-25T16:13:07.579322+0000","last_active":"2023-10-25T16:13:08.541423+0000","last_peered":"2023-10-25T16:13:08.541423+0000","last_clean":"2023-10-25T16:13:08.541423+0000","last_became_active":"2023-10-25T16:13:07.566613+0000","last_became_peered":"2023-10-25T16:13:07.566613+0000","last_unstale":"2023-10-25T16:13:08.541423+0000","last_undegraded":"2023-10-25T16:13:08.541423+0000","last_fullsized":"2023-10-25T16:13:08.541423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477996+0000","last_change":"2023-10-25T16:13:07.553120+0000","last_active":"2023-10-25T16:13:09.477996+0000","last_peered":"2023-10-25T16:13:09.477996+0000","last_clean":"2023-10-25T16:13:09.477996+0000","last_became_active":"2023-10-25T16:13:07.551990+0000","last_became_peered":"2023-10-25T16:13:07.551990+0000","last_unstale":"2023-10-25T16:13:09.477996+0000","last_undegraded":"2023-10-25T16:13:09.477996+0000","last_fullsized":"2023-10-25T16:13:09.477996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478313+0000","last_change":"2023-10-25T16:13:07.563333+0000","last_active":"2023-10-25T16:13:09.478313+0000","last_peered":"2023-10-25T16:13:09.478313+0000","last_clean":"2023-10-25T16:13:09.478313+0000","last_became_active":"2023-10-25T16:13:07.560920+0000","last_became_peered":"2023-10-25T16:13:07.560920+0000","last_unstale":"2023-10-25T16:13:09.478313+0000","last_undegraded":"2023-10-25T16:13:09.478313+0000","last_fullsized":"2023-10-25T16:13:09.478313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544460+0000","last_change":"2023-10-25T16:13:07.567528+0000","last_active":"2023-10-25T16:13:08.544460+0000","last_peered":"2023-10-25T16:13:08.544460+0000","last_clean":"2023-10-25T16:13:08.544460+0000","last_became_active":"2023-10-25T16:13:07.566685+0000","last_became_peered":"2023-10-25T16:13:07.566685+0000","last_unstale":"2023-10-25T16:13:08.544460+0000","last_undegraded":"2023-10-25T16:13:08.544460+0000","last_fullsized":"2023-10-25T16:13:08.544460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541668+0000","last_change":"2023-10-25T16:13:07.579075+0000","last_active":"2023-10-25T16:13:08.541668+0000","last_peered":"2023-10-25T16:13:08.541668+0000","last_clean":"2023-10-25T16:13:08.541668+0000","last_became_active":"2023-10-25T16:13:07.567451+0000","last_became_peered":"2023-10-25T16:13:07.567451+0000","last_unstale":"2023-10-25T16:13:08.541668+0000","last_undegraded":"2023-10-25T16:13:08.541668+0000","last_fullsized":"2023-10-25T16:13:08.541668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545497+0000","last_change":"2023-10-25T16:13:07.585648+0000","last_active":"2023-10-25T16:13:08.545497+0000","last_peered":"2023-10-25T16:13:08.545497+0000","last_clean":"2023-10-25T16:13:08.545497+0000","last_became_active":"2023-10-25T16:13:07.583670+0000","last_became_peered":"2023-10-25T16:13:07.583670+0000","last_unstale":"2023-10-25T16:13:08.545497+0000","last_undegraded":"2023-10-25T16:13:08.545497+0000","last_fullsized":"2023-10-25T16:13:08.545497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541701+0000","last_change":"2023-10-25T16:13:07.581287+0000","last_active":"2023-10-25T16:13:08.541701+0000","last_peered":"2023-10-25T16:13:08.541701+0000","last_clean":"2023-10-25T16:13:08.541701+0000","last_became_active":"2023-10-25T16:13:07.577390+0000","last_became_peered":"2023-10-25T16:13:07.577390+0000","last_unstale":"2023-10-25T16:13:08.541701+0000","last_undegraded":"2023-10-25T16:13:08.541701+0000","last_fullsized":"2023-10-25T16:13:08.541701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477246+0000","last_change":"2023-10-25T16:13:07.569496+0000","last_active":"2023-10-25T16:13:09.477246+0000","last_peered":"2023-10-25T16:13:09.477246+0000","last_clean":"2023-10-25T16:13:09.477246+0000","last_became_active":"2023-10-25T16:13:07.563950+0000","last_became_peered":"2023-10-25T16:13:07.563950+0000","last_unstale":"2023-10-25T16:13:09.477246+0000","last_undegraded":"2023-10-25T16:13:09.477246+0000","last_fullsized":"2023-10-25T16:13:09.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541010+0000","last_change":"2023-10-25T16:13:07.577965+0000","last_active":"2023-10-25T16:13:08.541010+0000","last_peered":"2023-10-25T16:13:08.541010+0000","last_clean":"2023-10-25T16:13:08.541010+0000","last_became_active":"2023-10-25T16:13:07.576892+0000","last_became_peered":"2023-10-25T16:13:07.576892+0000","last_unstale":"2023-10-25T16:13:08.541010+0000","last_undegraded":"2023-10-25T16:13:08.541010+0000","last_fullsized":"2023-10-25T16:13:08.541010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464171+0000","last_change":"2023-10-25T16:13:07.561076+0000","last_active":"2023-10-25T16:13:09.464171+0000","last_peered":"2023-10-25T16:13:09.464171+0000","last_clean":"2023-10-25T16:13:09.464171+0000","last_became_active":"2023-10-25T16:13:07.560340+0000","last_became_peered":"2023-10-25T16:13:07.560340+0000","last_unstale":"2023-10-25T16:13:09.464171+0000","last_undegraded":"2023-10-25T16:13:09.464171+0000","last_fullsized":"2023-10-25T16:13:09.464171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.463985+0000","last_change":"2023-10-25T16:13:07.585838+0000","last_active":"2023-10-25T16:13:09.463985+0000","last_peered":"2023-10-25T16:13:09.463985+0000","last_clean":"2023-10-25T16:13:09.463985+0000","last_became_active":"2023-10-25T16:13:07.585351+0000","last_became_peered":"2023-10-25T16:13:07.585351+0000","last_unstale":"2023-10-25T16:13:09.463985+0000","last_undegraded":"2023-10-25T16:13:09.463985+0000","last_fullsized":"2023-10-25T16:13:09.463985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186012+0000","last_change":"2023-10-25T16:13:07.572936+0000","last_active":"2023-10-25T16:13:09.186012+0000","last_peered":"2023-10-25T16:13:09.186012+0000","last_clean":"2023-10-25T16:13:09.186012+0000","last_became_active":"2023-10-25T16:13:07.572216+0000","last_became_peered":"2023-10-25T16:13:07.572216+0000","last_unstale":"2023-10-25T16:13:09.186012+0000","last_undegraded":"2023-10-25T16:13:09.186012+0000","last_fullsized":"2023-10-25T16:13:09.186012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:56.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480366+0000","last_change":"2023-10-25T16:13:07.567194+0000","last_active":"2023-10-25T16:13:09.480366+0000","last_peered":"2023-10-25T16:13:09.480366+0000","last_clean":"2023-10-25T16:13:09.480366+0000","last_became_active":"2023-10-25T16:13:07.561537+0000","last_became_peered":"2023-10-25T16:13:07.561537+0000","last_unstale":"2023-10-25T16:13:09.480366+0000","last_undegraded":"2023-10-25T16:13:09.480366+0000","last_fullsized":"2023-10-25T16:13:09.480366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477496+0000","last_change":"2023-10-25T16:13:07.567614+0000","last_active":"2023-10-25T16:13:09.477496+0000","last_peered":"2023-10-25T16:13:09.477496+0000","last_clean":"2023-10-25T16:13:09.477496+0000","last_became_active":"2023-10-25T16:13:07.564979+0000","last_became_peered":"2023-10-25T16:13:07.564979+0000","last_unstale":"2023-10-25T16:13:09.477496+0000","last_undegraded":"2023-10-25T16:13:09.477496+0000","last_fullsized":"2023-10-25T16:13:09.477496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:05.007750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478079+0000","last_change":"2023-10-25T16:13:07.562980+0000","last_active":"2023-10-25T16:13:09.478079+0000","last_peered":"2023-10-25T16:13:09.478079+0000","last_clean":"2023-10-25T16:13:09.478079+0000","last_became_active":"2023-10-25T16:13:07.562370+0000","last_became_peered":"2023-10-25T16:13:07.562370+0000","last_unstale":"2023-10-25T16:13:09.478079+0000","last_undegraded":"2023-10-25T16:13:09.478079+0000","last_fullsized":"2023-10-25T16:13:09.478079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545182+0000","last_change":"2023-10-25T16:13:07.587718+0000","last_active":"2023-10-25T16:13:08.545182+0000","last_peered":"2023-10-25T16:13:08.545182+0000","last_clean":"2023-10-25T16:13:08.545182+0000","last_became_active":"2023-10-25T16:13:07.584346+0000","last_became_peered":"2023-10-25T16:13:07.584346+0000","last_unstale":"2023-10-25T16:13:08.545182+0000","last_undegraded":"2023-10-25T16:13:08.545182+0000","last_fullsized":"2023-10-25T16:13:08.545182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544311+0000","last_change":"2023-10-25T16:13:07.590347+0000","last_active":"2023-10-25T16:13:08.544311+0000","last_peered":"2023-10-25T16:13:08.544311+0000","last_clean":"2023-10-25T16:13:08.544311+0000","last_became_active":"2023-10-25T16:13:07.589306+0000","last_became_peered":"2023-10-25T16:13:07.589306+0000","last_unstale":"2023-10-25T16:13:08.544311+0000","last_undegraded":"2023-10-25T16:13:08.544311+0000","last_fullsized":"2023-10-25T16:13:08.544311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480257+0000","last_change":"2023-10-25T16:13:07.571462+0000","last_active":"2023-10-25T16:13:09.480257+0000","last_peered":"2023-10-25T16:13:09.480257+0000","last_clean":"2023-10-25T16:13:09.480257+0000","last_became_active":"2023-10-25T16:13:07.571017+0000","last_became_peered":"2023-10-25T16:13:07.571017+0000","last_unstale":"2023-10-25T16:13:09.480257+0000","last_undegraded":"2023-10-25T16:13:09.480257+0000","last_fullsized":"2023-10-25T16:13:09.480257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541426+0000","last_change":"2023-10-25T16:13:07.565774+0000","last_active":"2023-10-25T16:13:08.541426+0000","last_peered":"2023-10-25T16:13:08.541426+0000","last_clean":"2023-10-25T16:13:08.541426+0000","last_became_active":"2023-10-25T16:13:07.564671+0000","last_became_peered":"2023-10-25T16:13:07.564671+0000","last_unstale":"2023-10-25T16:13:08.541426+0000","last_undegraded":"2023-10-25T16:13:08.541426+0000","last_fullsized":"2023-10-25T16:13:08.541426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464359+0000","last_change":"2023-10-25T16:13:07.569779+0000","last_active":"2023-10-25T16:13:09.464359+0000","last_peered":"2023-10-25T16:13:09.464359+0000","last_clean":"2023-10-25T16:13:09.464359+0000","last_became_active":"2023-10-25T16:13:07.568943+0000","last_became_peered":"2023-10-25T16:13:07.568943+0000","last_unstale":"2023-10-25T16:13:09.464359+0000","last_undegraded":"2023-10-25T16:13:09.464359+0000","last_fullsized":"2023-10-25T16:13:09.464359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478818+0000","last_change":"2023-10-25T16:13:07.588566+0000","last_active":"2023-10-25T16:13:09.478818+0000","last_peered":"2023-10-25T16:13:09.478818+0000","last_clean":"2023-10-25T16:13:09.478818+0000","last_became_active":"2023-10-25T16:13:07.586975+0000","last_became_peered":"2023-10-25T16:13:07.586975+0000","last_unstale":"2023-10-25T16:13:09.478818+0000","last_undegraded":"2023-10-25T16:13:09.478818+0000","last_fullsized":"2023-10-25T16:13:09.478818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544961+0000","last_change":"2023-10-25T16:13:07.589720+0000","last_active":"2023-10-25T16:13:08.544961+0000","last_peered":"2023-10-25T16:13:08.544961+0000","last_clean":"2023-10-25T16:13:08.544961+0000","last_became_active":"2023-10-25T16:13:07.587901+0000","last_became_peered":"2023-10-25T16:13:07.587901+0000","last_unstale":"2023-10-25T16:13:08.544961+0000","last_undegraded":"2023-10-25T16:13:08.544961+0000","last_fullsized":"2023-10-25T16:13:08.544961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481296+0000","last_change":"2023-10-25T16:13:07.564523+0000","last_active":"2023-10-25T16:13:09.481296+0000","last_peered":"2023-10-25T16:13:09.481296+0000","last_clean":"2023-10-25T16:13:09.481296+0000","last_became_active":"2023-10-25T16:13:07.558883+0000","last_became_peered":"2023-10-25T16:13:07.558883+0000","last_unstale":"2023-10-25T16:13:09.481296+0000","last_undegraded":"2023-10-25T16:13:09.481296+0000","last_fullsized":"2023-10-25T16:13:09.481296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544854+0000","last_change":"2023-10-25T16:13:07.565692+0000","last_active":"2023-10-25T16:13:08.544854+0000","last_peered":"2023-10-25T16:13:08.544854+0000","last_clean":"2023-10-25T16:13:08.544854+0000","last_became_active":"2023-10-25T16:13:07.565063+0000","last_became_peered":"2023-10-25T16:13:07.565063+0000","last_unstale":"2023-10-25T16:13:08.544854+0000","last_undegraded":"2023-10-25T16:13:08.544854+0000","last_fullsized":"2023-10-25T16:13:08.544854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478118+0000","last_change":"2023-10-25T16:13:07.567029+0000","last_active":"2023-10-25T16:13:09.478118+0000","last_peered":"2023-10-25T16:13:09.478118+0000","last_clean":"2023-10-25T16:13:09.478118+0000","last_became_active":"2023-10-25T16:13:07.563753+0000","last_became_peered":"2023-10-25T16:13:07.563753+0000","last_unstale":"2023-10-25T16:13:09.478118+0000","last_undegraded":"2023-10-25T16:13:09.478118+0000","last_fullsized":"2023-10-25T16:13:09.478118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464243+0000","last_change":"2023-10-25T16:13:07.571465+0000","last_active":"2023-10-25T16:13:09.464243+0000","last_peered":"2023-10-25T16:13:09.464243+0000","last_clean":"2023-10-25T16:13:09.464243+0000","last_became_active":"2023-10-25T16:13:07.570569+0000","last_became_peered":"2023-10-25T16:13:07.570569+0000","last_unstale":"2023-10-25T16:13:09.464243+0000","last_undegraded":"2023-10-25T16:13:09.464243+0000","last_fullsized":"2023-10-25T16:13:09.464243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478333+0000","last_change":"2023-10-25T16:13:07.552675+0000","last_active":"2023-10-25T16:13:09.478333+0000","last_peered":"2023-10-25T16:13:09.478333+0000","last_clean":"2023-10-25T16:13:09.478333+0000","last_became_active":"2023-10-25T16:13:07.551113+0000","last_became_peered":"2023-10-25T16:13:07.551113+0000","last_unstale":"2023-10-25T16:13:09.478333+0000","last_undegraded":"2023-10-25T16:13:09.478333+0000","last_fullsized":"2023-10-25T16:13:09.478333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480684+0000","last_change":"2023-10-25T16:13:07.563309+0000","last_active":"2023-10-25T16:13:09.480684+0000","last_peered":"2023-10-25T16:13:09.480684+0000","last_clean":"2023-10-25T16:13:09.480684+0000","last_became_active":"2023-10-25T16:13:07.556854+0000","last_became_peered":"2023-10-25T16:13:07.556854+0000","last_unstale":"2023-10-25T16:13:09.480684+0000","last_undegraded":"2023-10-25T16:13:09.480684+0000","last_fullsized":"2023-10-25T16:13:09.480684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481261+0000","last_change":"2023-10-25T16:13:07.563614+0000","last_active":"2023-10-25T16:13:09.481261+0000","last_peered":"2023-10-25T16:13:09.481261+0000","last_clean":"2023-10-25T16:13:09.481261+0000","last_became_active":"2023-10-25T16:13:07.562379+0000","last_became_peered":"2023-10-25T16:13:07.562379+0000","last_unstale":"2023-10-25T16:13:09.481261+0000","last_undegraded":"2023-10-25T16:13:09.481261+0000","last_fullsized":"2023-10-25T16:13:09.481261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544963+0000","last_change":"2023-10-25T16:13:07.575589+0000","last_active":"2023-10-25T16:13:08.544963+0000","last_peered":"2023-10-25T16:13:08.544963+0000","last_clean":"2023-10-25T16:13:08.544963+0000","last_became_active":"2023-10-25T16:13:07.569050+0000","last_became_peered":"2023-10-25T16:13:07.569050+0000","last_unstale":"2023-10-25T16:13:08.544963+0000","last_undegraded":"2023-10-25T16:13:08.544963+0000","last_fullsized":"2023-10-25T16:13:08.544963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477456+0000","last_change":"2023-10-25T16:13:07.586185+0000","last_active":"2023-10-25T16:13:09.477456+0000","last_peered":"2023-10-25T16:13:09.477456+0000","last_clean":"2023-10-25T16:13:09.477456+0000","last_became_active":"2023-10-25T16:13:07.585479+0000","last_became_peered":"2023-10-25T16:13:07.585479+0000","last_unstale":"2023-10-25T16:13:09.477456+0000","last_undegraded":"2023-10-25T16:13:09.477456+0000","last_fullsized":"2023-10-25T16:13:09.477456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464294+0000","last_change":"2023-10-25T16:13:07.571634+0000","last_active":"2023-10-25T16:13:09.464294+0000","last_peered":"2023-10-25T16:13:09.464294+0000","last_clean":"2023-10-25T16:13:09.464294+0000","last_became_active":"2023-10-25T16:13:07.570373+0000","last_became_peered":"2023-10-25T16:13:07.570373+0000","last_unstale":"2023-10-25T16:13:09.464294+0000","last_undegraded":"2023-10-25T16:13:09.464294+0000","last_fullsized":"2023-10-25T16:13:09.464294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185835+0000","last_change":"2023-10-25T16:13:07.554976+0000","last_active":"2023-10-25T16:13:09.185835+0000","last_peered":"2023-10-25T16:13:09.185835+0000","last_clean":"2023-10-25T16:13:09.185835+0000","last_became_active":"2023-10-25T16:13:07.554311+0000","last_became_peered":"2023-10-25T16:13:07.554311+0000","last_unstale":"2023-10-25T16:13:09.185835+0000","last_undegraded":"2023-10-25T16:13:09.185835+0000","last_fullsized":"2023-10-25T16:13:09.185835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479939+0000","last_change":"2023-10-25T16:13:06.604007+0000","last_active":"2023-10-25T16:13:09.479939+0000","last_peered":"2023-10-25T16:13:09.479939+0000","last_clean":"2023-10-25T16:13:09.479939+0000","last_became_active":"2023-10-25T16:13:06.603266+0000","last_became_peered":"2023-10-25T16:13:06.603266+0000","last_unstale":"2023-10-25T16:13:09.479939+0000","last_undegraded":"2023-10-25T16:13:09.479939+0000","last_fullsized":"2023-10-25T16:13:09.479939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478778+0000","last_change":"2023-10-25T16:13:07.559020+0000","last_active":"2023-10-25T16:13:09.478778+0000","last_peered":"2023-10-25T16:13:09.478778+0000","last_clean":"2023-10-25T16:13:09.478778+0000","last_became_active":"2023-10-25T16:13:07.558319+0000","last_became_peered":"2023-10-25T16:13:07.558319+0000","last_unstale":"2023-10-25T16:13:09.478778+0000","last_undegraded":"2023-10-25T16:13:09.478778+0000","last_fullsized":"2023-10-25T16:13:09.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464815+0000","last_change":"2023-10-25T16:13:06.598258+0000","last_active":"2023-10-25T16:13:09.464815+0000","last_peered":"2023-10-25T16:13:09.464815+0000","last_clean":"2023-10-25T16:13:09.464815+0000","last_became_active":"2023-10-25T16:13:06.597739+0000","last_became_peered":"2023-10-25T16:13:06.597739+0000","last_unstale":"2023-10-25T16:13:09.464815+0000","last_undegraded":"2023-10-25T16:13:09.464815+0000","last_fullsized":"2023-10-25T16:13:09.464815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480678+0000","last_change":"2023-10-25T16:13:06.593802+0000","last_active":"2023-10-25T16:13:09.480678+0000","last_peered":"2023-10-25T16:13:09.480678+0000","last_clean":"2023-10-25T16:13:09.480678+0000","last_became_active":"2023-10-25T16:13:06.591848+0000","last_became_peered":"2023-10-25T16:13:06.591848+0000","last_unstale":"2023-10-25T16:13:09.480678+0000","last_undegraded":"2023-10-25T16:13:09.480678+0000","last_fullsized":"2023-10-25T16:13:09.480678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478429+0000","last_change":"2023-10-25T16:13:07.564400+0000","last_active":"2023-10-25T16:13:09.478429+0000","last_peered":"2023-10-25T16:13:09.478429+0000","last_clean":"2023-10-25T16:13:09.478429+0000","last_became_active":"2023-10-25T16:13:07.560990+0000","last_became_peered":"2023-10-25T16:13:07.560990+0000","last_unstale":"2023-10-25T16:13:09.478429+0000","last_undegraded":"2023-10-25T16:13:09.478429+0000","last_fullsized":"2023-10-25T16:13:09.478429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545533+0000","last_change":"2023-10-25T16:13:06.585016+0000","last_active":"2023-10-25T16:13:08.545533+0000","last_peered":"2023-10-25T16:13:08.545533+0000","last_clean":"2023-10-25T16:13:08.545533+0000","last_became_active":"2023-10-25T16:13:06.584376+0000","last_became_peered":"2023-10-25T16:13:06.584376+0000","last_unstale":"2023-10-25T16:13:08.545533+0000","last_undegraded":"2023-10-25T16:13:08.545533+0000","last_fullsized":"2023-10-25T16:13:08.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479516+0000","last_change":"2023-10-25T16:13:07.559199+0000","last_active":"2023-10-25T16:13:09.479516+0000","last_peered":"2023-10-25T16:13:09.479516+0000","last_clean":"2023-10-25T16:13:09.479516+0000","last_became_active":"2023-10-25T16:13:07.556631+0000","last_became_peered":"2023-10-25T16:13:07.556631+0000","last_unstale":"2023-10-25T16:13:09.479516+0000","last_undegraded":"2023-10-25T16:13:09.479516+0000","last_fullsized":"2023-10-25T16:13:09.479516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464487+0000","last_change":"2023-10-25T16:13:06.584038+0000","last_active":"2023-10-25T16:13:09.464487+0000","last_peered":"2023-10-25T16:13:09.464487+0000","last_clean":"2023-10-25T16:13:09.464487+0000","last_became_active":"2023-10-25T16:13:06.583589+0000","last_became_peered":"2023-10-25T16:13:06.583589+0000","last_unstale":"2023-10-25T16:13:09.464487+0000","last_undegraded":"2023-10-25T16:13:09.464487+0000","last_fullsized":"2023-10-25T16:13:09.464487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544608+0000","last_change":"2023-10-25T16:13:07.590063+0000","last_active":"2023-10-25T16:13:08.544608+0000","last_peered":"2023-10-25T16:13:08.544608+0000","last_clean":"2023-10-25T16:13:08.544608+0000","last_became_active":"2023-10-25T16:13:07.588495+0000","last_became_peered":"2023-10-25T16:13:07.588495+0000","last_unstale":"2023-10-25T16:13:08.544608+0000","last_undegraded":"2023-10-25T16:13:08.544608+0000","last_fullsized":"2023-10-25T16:13:08.544608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546034+0000","last_change":"2023-10-25T16:13:06.590184+0000","last_active":"2023-10-25T16:13:08.546034+0000","last_peered":"2023-10-25T16:13:08.546034+0000","last_clean":"2023-10-25T16:13:08.546034+0000","last_became_active":"2023-10-25T16:13:06.588948+0000","last_became_peered":"2023-10-25T16:13:06.588948+0000","last_unstale":"2023-10-25T16:13:08.546034+0000","last_undegraded":"2023-10-25T16:13:08.546034+0000","last_fullsized":"2023-10-25T16:13:08.546034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479144+0000","last_change":"2023-10-25T16:13:07.586291+0000","last_active":"2023-10-25T16:13:09.479144+0000","last_peered":"2023-10-25T16:13:09.479144+0000","last_clean":"2023-10-25T16:13:09.479144+0000","last_became_active":"2023-10-25T16:13:07.585591+0000","last_became_peered":"2023-10-25T16:13:07.585591+0000","last_unstale":"2023-10-25T16:13:09.479144+0000","last_undegraded":"2023-10-25T16:13:09.479144+0000","last_fullsized":"2023-10-25T16:13:09.479144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480345+0000","last_change":"2023-10-25T16:13:06.583823+0000","last_active":"2023-10-25T16:13:09.480345+0000","last_peered":"2023-10-25T16:13:09.480345+0000","last_clean":"2023-10-25T16:13:09.480345+0000","last_became_active":"2023-10-25T16:13:06.583486+0000","last_became_peered":"2023-10-25T16:13:06.583486+0000","last_unstale":"2023-10-25T16:13:09.480345+0000","last_undegraded":"2023-10-25T16:13:09.480345+0000","last_fullsized":"2023-10-25T16:13:09.480345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:19.848515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185623+0000","last_change":"2023-10-25T16:13:07.568365+0000","last_active":"2023-10-25T16:13:09.185623+0000","last_peered":"2023-10-25T16:13:09.185623+0000","last_clean":"2023-10-25T16:13:09.185623+0000","last_became_active":"2023-10-25T16:13:07.567142+0000","last_became_peered":"2023-10-25T16:13:07.567142+0000","last_unstale":"2023-10-25T16:13:09.185623+0000","last_undegraded":"2023-10-25T16:13:09.185623+0000","last_fullsized":"2023-10-25T16:13:09.185623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464438+0000","last_change":"2023-10-25T16:13:06.595459+0000","last_active":"2023-10-25T16:13:09.464438+0000","last_peered":"2023-10-25T16:13:09.464438+0000","last_clean":"2023-10-25T16:13:09.464438+0000","last_became_active":"2023-10-25T16:13:06.594824+0000","last_became_peered":"2023-10-25T16:13:06.594824+0000","last_unstale":"2023-10-25T16:13:09.464438+0000","last_undegraded":"2023-10-25T16:13:09.464438+0000","last_fullsized":"2023-10-25T16:13:09.464438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541328+0000","last_change":"2023-10-25T16:13:07.577436+0000","last_active":"2023-10-25T16:13:08.541328+0000","last_peered":"2023-10-25T16:13:08.541328+0000","last_clean":"2023-10-25T16:13:08.541328+0000","last_became_active":"2023-10-25T16:13:07.567759+0000","last_became_peered":"2023-10-25T16:13:07.567759+0000","last_unstale":"2023-10-25T16:13:08.541328+0000","last_undegraded":"2023-10-25T16:13:08.541328+0000","last_fullsized":"2023-10-25T16:13:08.541328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480167+0000","last_change":"2023-10-25T16:13:06.591408+0000","last_active":"2023-10-25T16:13:09.480167+0000","last_peered":"2023-10-25T16:13:09.480167+0000","last_clean":"2023-10-25T16:13:09.480167+0000","last_became_active":"2023-10-25T16:13:06.591012+0000","last_became_peered":"2023-10-25T16:13:06.591012+0000","last_unstale":"2023-10-25T16:13:09.480167+0000","last_undegraded":"2023-10-25T16:13:09.480167+0000","last_fullsized":"2023-10-25T16:13:09.480167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479460+0000","last_change":"2023-10-25T16:13:07.589102+0000","last_active":"2023-10-25T16:13:09.479460+0000","last_peered":"2023-10-25T16:13:09.479460+0000","last_clean":"2023-10-25T16:13:09.479460+0000","last_became_active":"2023-10-25T16:13:07.587838+0000","last_became_peered":"2023-10-25T16:13:07.587838+0000","last_unstale":"2023-10-25T16:13:09.479460+0000","last_undegraded":"2023-10-25T16:13:09.479460+0000","last_fullsized":"2023-10-25T16:13:09.479460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546334+0000","last_change":"2023-10-25T16:13:06.589759+0000","last_active":"2023-10-25T16:13:08.546334+0000","last_peered":"2023-10-25T16:13:08.546334+0000","last_clean":"2023-10-25T16:13:08.546334+0000","last_became_active":"2023-10-25T16:13:06.589100+0000","last_became_peered":"2023-10-25T16:13:06.589100+0000","last_unstale":"2023-10-25T16:13:08.546334+0000","last_undegraded":"2023-10-25T16:13:08.546334+0000","last_fullsized":"2023-10-25T16:13:08.546334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542048+0000","last_change":"2023-10-25T16:13:07.577105+0000","last_active":"2023-10-25T16:13:08.542048+0000","last_peered":"2023-10-25T16:13:08.542048+0000","last_clean":"2023-10-25T16:13:08.542048+0000","last_became_active":"2023-10-25T16:13:07.565017+0000","last_became_peered":"2023-10-25T16:13:07.565017+0000","last_unstale":"2023-10-25T16:13:08.542048+0000","last_undegraded":"2023-10-25T16:13:08.542048+0000","last_fullsized":"2023-10-25T16:13:08.542048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464495+0000","last_change":"2023-10-25T16:13:06.598452+0000","last_active":"2023-10-25T16:13:09.464495+0000","last_peered":"2023-10-25T16:13:09.464495+0000","last_clean":"2023-10-25T16:13:09.464495+0000","last_became_active":"2023-10-25T16:13:06.597797+0000","last_became_peered":"2023-10-25T16:13:06.597797+0000","last_unstale":"2023-10-25T16:13:09.464495+0000","last_undegraded":"2023-10-25T16:13:09.464495+0000","last_fullsized":"2023-10-25T16:13:09.464495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464575+0000","last_change":"2023-10-25T16:13:07.569409+0000","last_active":"2023-10-25T16:13:09.464575+0000","last_peered":"2023-10-25T16:13:09.464575+0000","last_clean":"2023-10-25T16:13:09.464575+0000","last_became_active":"2023-10-25T16:13:07.561141+0000","last_became_peered":"2023-10-25T16:13:07.561141+0000","last_unstale":"2023-10-25T16:13:09.464575+0000","last_undegraded":"2023-10-25T16:13:09.464575+0000","last_fullsized":"2023-10-25T16:13:09.464575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.613385+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:07.613385+0000","last_peered":"2023-10-25T16:13:07.613385+0000","last_clean":"2023-10-25T16:13:07.613385+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:07.613385+0000","last_undegraded":"2023-10-25T16:13:07.613385+0000","last_fullsized":"2023-10-25T16:13:07.613385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:48.892031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542401+0000","last_change":"2023-10-25T16:13:07.586802+0000","last_active":"2023-10-25T16:13:08.542401+0000","last_peered":"2023-10-25T16:13:08.542401+0000","last_clean":"2023-10-25T16:13:08.542401+0000","last_became_active":"2023-10-25T16:13:07.586067+0000","last_became_peered":"2023-10-25T16:13:07.586067+0000","last_unstale":"2023-10-25T16:13:08.542401+0000","last_undegraded":"2023-10-25T16:13:08.542401+0000","last_fullsized":"2023-10-25T16:13:08.542401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185909+0000","last_change":"2023-10-25T16:13:06.576987+0000","last_active":"2023-10-25T16:13:09.185909+0000","last_peered":"2023-10-25T16:13:09.185909+0000","last_clean":"2023-10-25T16:13:09.185909+0000","last_became_active":"2023-10-25T16:13:06.576204+0000","last_became_peered":"2023-10-25T16:13:06.576204+0000","last_unstale":"2023-10-25T16:13:09.185909+0000","last_undegraded":"2023-10-25T16:13:09.185909+0000","last_fullsized":"2023-10-25T16:13:09.185909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:27.980983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542364+0000","last_change":"2023-10-25T16:13:07.577484+0000","last_active":"2023-10-25T16:13:08.542364+0000","last_peered":"2023-10-25T16:13:08.542364+0000","last_clean":"2023-10-25T16:13:08.542364+0000","last_became_active":"2023-10-25T16:13:07.566477+0000","last_became_peered":"2023-10-25T16:13:07.566477+0000","last_unstale":"2023-10-25T16:13:08.542364+0000","last_undegraded":"2023-10-25T16:13:08.542364+0000","last_fullsized":"2023-10-25T16:13:08.542364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.612118+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:07.612118+0000","last_peered":"2023-10-25T16:13:07.612118+0000","last_clean":"2023-10-25T16:13:07.612118+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:07.612118+0000","last_undegraded":"2023-10-25T16:13:07.612118+0000","last_fullsized":"2023-10-25T16:13:07.612118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:47.976238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541203+0000","last_change":"2023-10-25T16:13:07.565301+0000","last_active":"2023-10-25T16:13:08.541203+0000","last_peered":"2023-10-25T16:13:08.541203+0000","last_clean":"2023-10-25T16:13:08.541203+0000","last_became_active":"2023-10-25T16:13:07.563812+0000","last_became_peered":"2023-10-25T16:13:07.563812+0000","last_unstale":"2023-10-25T16:13:08.541203+0000","last_undegraded":"2023-10-25T16:13:08.541203+0000","last_fullsized":"2023-10-25T16:13:08.541203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478001+0000","last_change":"2023-10-25T16:13:06.583997+0000","last_active":"2023-10-25T16:13:09.478001+0000","last_peered":"2023-10-25T16:13:09.478001+0000","last_clean":"2023-10-25T16:13:09.478001+0000","last_became_active":"2023-10-25T16:13:06.583355+0000","last_became_peered":"2023-10-25T16:13:06.583355+0000","last_unstale":"2023-10-25T16:13:09.478001+0000","last_undegraded":"2023-10-25T16:13:09.478001+0000","last_fullsized":"2023-10-25T16:13:09.478001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545728+0000","last_change":"2023-10-25T16:13:07.576400+0000","last_active":"2023-10-25T16:13:08.545728+0000","last_peered":"2023-10-25T16:13:08.545728+0000","last_clean":"2023-10-25T16:13:08.545728+0000","last_became_active":"2023-10-25T16:13:07.575767+0000","last_became_peered":"2023-10-25T16:13:07.575767+0000","last_unstale":"2023-10-25T16:13:08.545728+0000","last_undegraded":"2023-10-25T16:13:08.545728+0000","last_fullsized":"2023-10-25T16:13:08.545728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.548907+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:07.548907+0000","last_peered":"2023-10-25T16:13:07.548907+0000","last_clean":"2023-10-25T16:13:07.548907+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:07.548907+0000","last_undegraded":"2023-10-25T16:13:07.548907+0000","last_fullsized":"2023-10-25T16:13:07.548907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:00.194766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541794+0000","last_change":"2023-10-25T16:13:07.587447+0000","last_active":"2023-10-25T16:13:08.541794+0000","last_peered":"2023-10-25T16:13:08.541794+0000","last_clean":"2023-10-25T16:13:08.541794+0000","last_became_active":"2023-10-25T16:13:07.586850+0000","last_became_peered":"2023-10-25T16:13:07.586850+0000","last_unstale":"2023-10-25T16:13:08.541794+0000","last_undegraded":"2023-10-25T16:13:08.541794+0000","last_fullsized":"2023-10-25T16:13:08.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.549368+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:13:07.549368+0000","last_peered":"2023-10-25T16:13:07.549368+0000","last_clean":"2023-10-25T16:13:07.549368+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:13:07.549368+0000","last_undegraded":"2023-10-25T16:13:07.549368+0000","last_fullsized":"2023-10-25T16:13:07.549368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546669+0000","last_change":"2023-10-25T16:13:06.587408+0000","last_active":"2023-10-25T16:13:08.546669+0000","last_peered":"2023-10-25T16:13:08.546669+0000","last_clean":"2023-10-25T16:13:08.546669+0000","last_became_active":"2023-10-25T16:13:06.586522+0000","last_became_peered":"2023-10-25T16:13:06.586522+0000","last_unstale":"2023-10-25T16:13:08.546669+0000","last_undegraded":"2023-10-25T16:13:08.546669+0000","last_fullsized":"2023-10-25T16:13:08.546669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:38.279671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479511+0000","last_change":"2023-10-25T16:13:07.576734+0000","last_active":"2023-10-25T16:13:09.479511+0000","last_peered":"2023-10-25T16:13:09.479511+0000","last_clean":"2023-10-25T16:13:09.479511+0000","last_became_active":"2023-10-25T16:13:07.575887+0000","last_became_peered":"2023-10-25T16:13:07.575887+0000","last_unstale":"2023-10-25T16:13:09.479511+0000","last_undegraded":"2023-10-25T16:13:09.479511+0000","last_fullsized":"2023-10-25T16:13:09.479511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541705+0000","last_change":"2023-10-25T16:13:06.603271+0000","last_active":"2023-10-25T16:13:08.541705+0000","last_peered":"2023-10-25T16:13:08.541705+0000","last_clean":"2023-10-25T16:13:08.541705+0000","last_became_active":"2023-10-25T16:13:06.602179+0000","last_became_peered":"2023-10-25T16:13:06.602179+0000","last_unstale":"2023-10-25T16:13:08.541705+0000","last_undegraded":"2023-10-25T16:13:08.541705+0000","last_fullsized":"2023-10-25T16:13:08.541705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479260+0000","last_change":"2023-10-25T16:13:07.563801+0000","last_active":"2023-10-25T16:13:09.479260+0000","last_peered":"2023-10-25T16:13:09.479260+0000","last_clean":"2023-10-25T16:13:09.479260+0000","last_became_active":"2023-10-25T16:13:07.561818+0000","last_became_peered":"2023-10-25T16:13:07.561818+0000","last_unstale":"2023-10-25T16:13:09.479260+0000","last_undegraded":"2023-10-25T16:13:09.479260+0000","last_fullsized":"2023-10-25T16:13:09.479260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.551983+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:07.551983+0000","last_peered":"2023-10-25T16:13:07.551983+0000","last_clean":"2023-10-25T16:13:07.551983+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:07.551983+0000","last_undegraded":"2023-10-25T16:13:07.551983+0000","last_fullsized":"2023-10-25T16:13:07.551983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:13:19.127582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479843+0000","last_change":"2023-10-25T16:13:07.559564+0000","last_active":"2023-10-25T16:13:09.479843+0000","last_peered":"2023-10-25T16:13:09.479843+0000","last_clean":"2023-10-25T16:13:09.479843+0000","last_became_active":"2023-10-25T16:13:07.558584+0000","last_became_peered":"2023-10-25T16:13:07.558584+0000","last_unstale":"2023-10-25T16:13:09.479843+0000","last_undegraded":"2023-10-25T16:13:09.479843+0000","last_fullsized":"2023-10-25T16:13:09.479843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546149+0000","last_change":"2023-10-25T16:13:06.583922+0000","last_active":"2023-10-25T16:13:08.546149+0000","last_peered":"2023-10-25T16:13:08.546149+0000","last_clean":"2023-10-25T16:13:08.546149+0000","last_became_active":"2023-10-25T16:13:06.581997+0000","last_became_peered":"2023-10-25T16:13:06.581997+0000","last_unstale":"2023-10-25T16:13:08.546149+0000","last_undegraded":"2023-10-25T16:13:08.546149+0000","last_fullsized":"2023-10-25T16:13:08.546149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185545+0000","last_change":"2023-10-25T16:13:07.560270+0000","last_active":"2023-10-25T16:13:09.185545+0000","last_peered":"2023-10-25T16:13:09.185545+0000","last_clean":"2023-10-25T16:13:09.185545+0000","last_became_active":"2023-10-25T16:13:07.559551+0000","last_became_peered":"2023-10-25T16:13:07.559551+0000","last_unstale":"2023-10-25T16:13:09.185545+0000","last_undegraded":"2023-10-25T16:13:09.185545+0000","last_fullsized":"2023-10-25T16:13:09.185545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:19.572019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478513+0000","last_change":"2023-10-25T16:13:06.588392+0000","last_active":"2023-10-25T16:13:09.478513+0000","last_peered":"2023-10-25T16:13:09.478513+0000","last_clean":"2023-10-25T16:13:09.478513+0000","last_became_active":"2023-10-25T16:13:06.588114+0000","last_became_peered":"2023-10-25T16:13:06.588114+0000","last_unstale":"2023-10-25T16:13:09.478513+0000","last_undegraded":"2023-10-25T16:13:09.478513+0000","last_fullsized":"2023-10-25T16:13:09.478513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545216+0000","last_change":"2023-10-25T16:13:07.563744+0000","last_active":"2023-10-25T16:13:08.545216+0000","last_peered":"2023-10-25T16:13:08.545216+0000","last_clean":"2023-10-25T16:13:08.545216+0000","last_became_active":"2023-10-25T16:13:07.563027+0000","last_became_peered":"2023-10-25T16:13:07.563027+0000","last_unstale":"2023-10-25T16:13:08.545216+0000","last_undegraded":"2023-10-25T16:13:08.545216+0000","last_fullsized":"2023-10-25T16:13:08.545216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541562+0000","last_change":"2023-10-25T16:13:06.604452+0000","last_active":"2023-10-25T16:13:08.541562+0000","last_peered":"2023-10-25T16:13:08.541562+0000","last_clean":"2023-10-25T16:13:08.541562+0000","last_became_active":"2023-10-25T16:13:06.603857+0000","last_became_peered":"2023-10-25T16:13:06.603857+0000","last_unstale":"2023-10-25T16:13:08.541562+0000","last_undegraded":"2023-10-25T16:13:08.541562+0000","last_fullsized":"2023-10-25T16:13:08.541562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477752+0000","last_change":"2023-10-25T16:13:07.555525+0000","last_active":"2023-10-25T16:13:09.477752+0000","last_peered":"2023-10-25T16:13:09.477752+0000","last_clean":"2023-10-25T16:13:09.477752+0000","last_became_active":"2023-10-25T16:13:07.554924+0000","last_became_peered":"2023-10-25T16:13:07.554924+0000","last_unstale":"2023-10-25T16:13:09.477752+0000","last_undegraded":"2023-10-25T16:13:09.477752+0000","last_fullsized":"2023-10-25T16:13:09.477752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.776119+0000","last_change":"2023-10-25T16:13:06.588519+0000","last_active":"2023-10-25T16:13:09.776119+0000","last_peered":"2023-10-25T16:13:09.776119+0000","last_clean":"2023-10-25T16:13:09.776119+0000","last_became_active":"2023-10-25T16:13:06.587754+0000","last_became_peered":"2023-10-25T16:13:06.587754+0000","last_unstale":"2023-10-25T16:13:09.776119+0000","last_undegraded":"2023-10-25T16:13:09.776119+0000","last_fullsized":"2023-10-25T16:13:09.776119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479179+0000","last_change":"2023-10-25T16:13:07.577983+0000","last_active":"2023-10-25T16:13:09.479179+0000","last_peered":"2023-10-25T16:13:09.479179+0000","last_clean":"2023-10-25T16:13:09.479179+0000","last_became_active":"2023-10-25T16:13:07.577344+0000","last_became_peered":"2023-10-25T16:13:07.577344+0000","last_unstale":"2023-10-25T16:13:09.479179+0000","last_undegraded":"2023-10-25T16:13:09.479179+0000","last_fullsized":"2023-10-25T16:13:09.479179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464626+0000","last_change":"2023-10-25T16:13:06.595499+0000","last_active":"2023-10-25T16:13:09.464626+0000","last_peered":"2023-10-25T16:13:09.464626+0000","last_clean":"2023-10-25T16:13:09.464626+0000","last_became_active":"2023-10-25T16:13:06.594639+0000","last_became_peered":"2023-10-25T16:13:06.594639+0000","last_unstale":"2023-10-25T16:13:09.464626+0000","last_undegraded":"2023-10-25T16:13:09.464626+0000","last_fullsized":"2023-10-25T16:13:09.464626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478650+0000","last_change":"2023-10-25T16:13:07.568153+0000","last_active":"2023-10-25T16:13:09.478650+0000","last_peered":"2023-10-25T16:13:09.478650+0000","last_clean":"2023-10-25T16:13:09.478650+0000","last_became_active":"2023-10-25T16:13:07.567204+0000","last_became_peered":"2023-10-25T16:13:07.567204+0000","last_unstale":"2023-10-25T16:13:09.478650+0000","last_undegraded":"2023-10-25T16:13:09.478650+0000","last_fullsized":"2023-10-25T16:13:09.478650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542227+0000","last_change":"2023-10-25T16:13:06.605135+0000","last_active":"2023-10-25T16:13:08.542227+0000","last_peered":"2023-10-25T16:13:08.542227+0000","last_clean":"2023-10-25T16:13:08.542227+0000","last_became_active":"2023-10-25T16:13:06.604117+0000","last_became_peered":"2023-10-25T16:13:06.604117+0000","last_unstale":"2023-10-25T16:13:08.542227+0000","last_undegraded":"2023-10-25T16:13:08.542227+0000","last_fullsized":"2023-10-25T16:13:08.542227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186211+0000","last_change":"2023-10-25T16:13:07.570460+0000","last_active":"2023-10-25T16:13:09.186211+0000","last_peered":"2023-10-25T16:13:09.186211+0000","last_clean":"2023-10-25T16:13:09.186211+0000","last_became_active":"2023-10-25T16:13:07.565363+0000","last_became_peered":"2023-10-25T16:13:07.565363+0000","last_unstale":"2023-10-25T16:13:09.186211+0000","last_undegraded":"2023-10-25T16:13:09.186211+0000","last_fullsized":"2023-10-25T16:13:09.186211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:45.620922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478298+0000","last_change":"2023-10-25T16:13:06.607078+0000","last_active":"2023-10-25T16:13:09.478298+0000","last_peered":"2023-10-25T16:13:09.478298+0000","last_clean":"2023-10-25T16:13:09.478298+0000","last_became_active":"2023-10-25T16:13:06.606881+0000","last_became_peered":"2023-10-25T16:13:06.606881+0000","last_unstale":"2023-10-25T16:13:09.478298+0000","last_undegraded":"2023-10-25T16:13:09.478298+0000","last_fullsized":"2023-10-25T16:13:09.478298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480464+0000","last_change":"2023-10-25T16:13:07.546555+0000","last_active":"2023-10-25T16:13:09.480464+0000","last_peered":"2023-10-25T16:13:09.480464+0000","last_clean":"2023-10-25T16:13:09.480464+0000","last_became_active":"2023-10-25T16:13:07.545944+0000","last_became_peered":"2023-10-25T16:13:07.545944+0000","last_unstale":"2023-10-25T16:13:09.480464+0000","last_undegraded":"2023-10-25T16:13:09.480464+0000","last_fullsized":"2023-10-25T16:13:09.480464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480051+0000","last_change":"2023-10-25T16:13:06.589243+0000","last_active":"2023-10-25T16:13:09.480051+0000","last_peered":"2023-10-25T16:13:09.480051+0000","last_clean":"2023-10-25T16:13:09.480051+0000","last_became_active":"2023-10-25T16:13:06.588343+0000","last_became_peered":"2023-10-25T16:13:06.588343+0000","last_unstale":"2023-10-25T16:13:09.480051+0000","last_undegraded":"2023-10-25T16:13:09.480051+0000","last_fullsized":"2023-10-25T16:13:09.480051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480990+0000","last_change":"2023-10-25T16:13:07.569083+0000","last_active":"2023-10-25T16:13:09.480990+0000","last_peered":"2023-10-25T16:13:09.480990+0000","last_clean":"2023-10-25T16:13:09.480990+0000","last_became_active":"2023-10-25T16:13:07.562504+0000","last_became_peered":"2023-10-25T16:13:07.562504+0000","last_unstale":"2023-10-25T16:13:09.480990+0000","last_undegraded":"2023-10-25T16:13:09.480990+0000","last_fullsized":"2023-10-25T16:13:09.480990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541587+0000","last_change":"2023-10-25T16:13:06.603385+0000","last_active":"2023-10-25T16:13:08.541587+0000","last_peered":"2023-10-25T16:13:08.541587+0000","last_clean":"2023-10-25T16:13:08.541587+0000","last_became_active":"2023-10-25T16:13:06.602760+0000","last_became_peered":"2023-10-25T16:13:06.602760+0000","last_unstale":"2023-10-25T16:13:08.541587+0000","last_undegraded":"2023-10-25T16:13:08.541587+0000","last_fullsized":"2023-10-25T16:13:08.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:55.025836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464180+0000","last_change":"2023-10-25T16:13:07.569746+0000","last_active":"2023-10-25T16:13:09.464180+0000","last_peered":"2023-10-25T16:13:09.464180+0000","last_clean":"2023-10-25T16:13:09.464180+0000","last_became_active":"2023-10-25T16:13:07.568518+0000","last_became_peered":"2023-10-25T16:13:07.568518+0000","last_unstale":"2023-10-25T16:13:09.464180+0000","last_undegraded":"2023-10-25T16:13:09.464180+0000","last_fullsized":"2023-10-25T16:13:09.464180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545306+0000","last_change":"2023-10-25T16:13:07.576112+0000","last_active":"2023-10-25T16:13:08.545306+0000","last_peered":"2023-10-25T16:13:08.545306+0000","last_clean":"2023-10-25T16:13:08.545306+0000","last_became_active":"2023-10-25T16:13:07.574201+0000","last_became_peered":"2023-10-25T16:13:07.574201+0000","last_unstale":"2023-10-25T16:13:08.545306+0000","last_undegraded":"2023-10-25T16:13:08.545306+0000","last_fullsized":"2023-10-25T16:13:08.545306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542101+0000","last_change":"2023-10-25T16:13:06.604712+0000","last_active":"2023-10-25T16:13:08.542101+0000","last_peered":"2023-10-25T16:13:08.542101+0000","last_clean":"2023-10-25T16:13:08.542101+0000","last_became_active":"2023-10-25T16:13:06.602850+0000","last_became_peered":"2023-10-25T16:13:06.602850+0000","last_unstale":"2023-10-25T16:13:08.542101+0000","last_undegraded":"2023-10-25T16:13:08.542101+0000","last_fullsized":"2023-10-25T16:13:08.542101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545831+0000","last_change":"2023-10-25T16:13:07.585084+0000","last_active":"2023-10-25T16:13:08.545831+0000","last_peered":"2023-10-25T16:13:08.545831+0000","last_clean":"2023-10-25T16:13:08.545831+0000","last_became_active":"2023-10-25T16:13:07.582955+0000","last_became_peered":"2023-10-25T16:13:07.582955+0000","last_unstale":"2023-10-25T16:13:08.545831+0000","last_undegraded":"2023-10-25T16:13:08.545831+0000","last_fullsized":"2023-10-25T16:13:08.545831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542584+0000","last_change":"2023-10-25T16:13:06.606358+0000","last_active":"2023-10-25T16:13:08.542584+0000","last_peered":"2023-10-25T16:13:08.542584+0000","last_clean":"2023-10-25T16:13:08.542584+0000","last_became_active":"2023-10-25T16:13:06.602334+0000","last_became_peered":"2023-10-25T16:13:06.602334+0000","last_unstale":"2023-10-25T16:13:08.542584+0000","last_undegraded":"2023-10-25T16:13:08.542584+0000","last_fullsized":"2023-10-25T16:13:08.542584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478959+0000","last_change":"2023-10-25T16:13:07.566273+0000","last_active":"2023-10-25T16:13:09.478959+0000","last_peered":"2023-10-25T16:13:09.478959+0000","last_clean":"2023-10-25T16:13:09.478959+0000","last_became_active":"2023-10-25T16:13:07.562676+0000","last_became_peered":"2023-10-25T16:13:07.562676+0000","last_unstale":"2023-10-25T16:13:09.478959+0000","last_undegraded":"2023-10-25T16:13:09.478959+0000","last_fullsized":"2023-10-25T16:13:09.478959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480470+0000","last_change":"2023-10-25T16:13:06.594182+0000","last_active":"2023-10-25T16:13:09.480470+0000","last_peered":"2023-10-25T16:13:09.480470+0000","last_clean":"2023-10-25T16:13:09.480470+0000","last_became_active":"2023-10-25T16:13:06.592991+0000","last_became_peered":"2023-10-25T16:13:06.592991+0000","last_unstale":"2023-10-25T16:13:09.480470+0000","last_undegraded":"2023-10-25T16:13:09.480470+0000","last_fullsized":"2023-10-25T16:13:09.480470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480226+0000","last_change":"2023-10-25T16:13:07.564149+0000","last_active":"2023-10-25T16:13:09.480226+0000","last_peered":"2023-10-25T16:13:09.480226+0000","last_clean":"2023-10-25T16:13:09.480226+0000","last_became_active":"2023-10-25T16:13:07.561630+0000","last_became_peered":"2023-10-25T16:13:07.561630+0000","last_unstale":"2023-10-25T16:13:09.480226+0000","last_undegraded":"2023-10-25T16:13:09.480226+0000","last_fullsized":"2023-10-25T16:13:09.480226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479489+0000","last_change":"2023-10-25T16:13:06.603850+0000","last_active":"2023-10-25T16:13:09.479489+0000","last_peered":"2023-10-25T16:13:09.479489+0000","last_clean":"2023-10-25T16:13:09.479489+0000","last_became_active":"2023-10-25T16:13:06.603106+0000","last_became_peered":"2023-10-25T16:13:06.603106+0000","last_unstale":"2023-10-25T16:13:09.479489+0000","last_undegraded":"2023-10-25T16:13:09.479489+0000","last_fullsized":"2023-10-25T16:13:09.479489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924855,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924729,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:19.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:13:19.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/3734235027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c64159230 msgr2=0x7f5c64071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/3734235027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c64159230 0x7f5c64071500 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009900 tx=0x7f5c5401c850 comp rx=0 tx=0).stop 2023-10-25T16:13:19.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/3734235027 shutdown_connections 2023-10-25T16:13:19.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/3734235027 >> v2:172.21.15.184:3300/0 conn(0x7f5c640cc610 0x7f5c6406b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/3734235027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c64070510 0x7f5c640cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/3734235027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c64159230 0x7f5c64071500 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/3734235027 >> 172.21.15.177:0/3734235027 conn(0x7f5c640b2450 msgr2=0x7f5c640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/3734235027 shutdown_connections 2023-10-25T16:13:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.626+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/3734235027 wait complete. 2023-10-25T16:13:19.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 Processor -- start 2023-10-25T16:13:19.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 -- start start 2023-10-25T16:13:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c64070510 0x7f5c6414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 0x7f5c640b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c64159230 0x7f5c641558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64152110 con 0x7f5c640cc610 2023-10-25T16:13:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641f4740 con 0x7f5c64159230 2023-10-25T16:13:19.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640ac060 con 0x7f5c64070510 2023-10-25T16:13:19.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 0x7f5c640b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 0x7f5c640b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43884/0 (socket says 172.21.15.177:43884) 2023-10-25T16:13:19.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 -- 172.21.15.177:0/2613708710 learned_addr learned my addr 172.21.15.177:0/2613708710 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:19.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c63fff640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c64070510 0x7f5c6414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 -- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c64070510 msgr2=0x7f5c6414df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c64070510 0x7f5c6414df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 -- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c64159230 msgr2=0x7f5c641558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c64159230 0x7f5c641558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 -- 172.21.15.177:0/2613708710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009560 con 0x7f5c640cc610 2023-10-25T16:13:19.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c5b7fe640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 0x7f5c640b0c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00d750 tx=0x7f5c4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c009c30 con 0x7f5c640cc610 2023-10-25T16:13:19.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c4c009e80 con 0x7f5c640cc610 2023-10-25T16:13:19.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c004280 con 0x7f5c640cc610 2023-10-25T16:13:19.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c641523d0 con 0x7f5c640cc610 2023-10-25T16:13:19.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.630+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c640abaa0 con 0x7f5c640cc610 2023-10-25T16:13:19.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.634+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c64152560 con 0x7f5c640cc610 2023-10-25T16:13:19.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.634+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c4c005030 con 0x7f5c640cc610 2023-10-25T16:13:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.634+0000 7f5c617fa640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c440664a0 0x7f5c44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.634+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c4c084540 con 0x7f5c640cc610 2023-10-25T16:13:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.634+0000 7f5c63fff640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c440664a0 0x7f5c44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.634+0000 7f5c63fff640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c440664a0 0x7f5c44068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5c540af000 tx=0x7f5c5401b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.638+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c4c0519c0 con 0x7f5c640cc610 2023-10-25T16:13:19.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.778+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c6404daf0 con 0x7f5c440664a0 2023-10-25T16:13:19.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.798+0000 7f5c617fa640 1 -- 172.21.15.177:0/2613708710 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260186 (secure 0 0 0) 0x7f5c6404daf0 con 0x7f5c440664a0 2023-10-25T16:13:19.805 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:19.807 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:13:19.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c440664a0 msgr2=0x7f5c44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c440664a0 0x7f5c44068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5c540af000 tx=0x7f5c5401b090 comp rx=0 tx=0).stop 2023-10-25T16:13:19.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 msgr2=0x7f5c640b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 0x7f5c640b0c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00d750 tx=0x7f5c4c00dc10 comp rx=0 tx=0).stop 2023-10-25T16:13:19.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 shutdown_connections 2023-10-25T16:13:19.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5c440664a0 0x7f5c44068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c64159230 0x7f5c641558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c640cc610 0x7f5c640b0c80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 --2- 172.21.15.177:0/2613708710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5c64070510 0x7f5c6414df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 >> 172.21.15.177:0/2613708710 conn(0x7f5c640b2450 msgr2=0x7f5c640b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 shutdown_connections 2023-10-25T16:13:19.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.802+0000 7f5c6a4e5640 1 -- 172.21.15.177:0/2613708710 wait complete. 2023-10-25T16:13:19.822 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-25T16:13:18.595763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1744,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560755,"statfs":{"total":1600000000,"available":1598213284,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.053052"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541423+0000","last_change":"2023-10-25T16:13:07.579322+0000","last_active":"2023-10-25T16:13:08.541423+0000","last_peered":"2023-10-25T16:13:08.541423+0000","last_clean":"2023-10-25T16:13:08.541423+0000","last_became_active":"2023-10-25T16:13:07.566613+0000","last_became_peered":"2023-10-25T16:13:07.566613+0000","last_unstale":"2023-10-25T16:13:08.541423+0000","last_undegraded":"2023-10-25T16:13:08.541423+0000","last_fullsized":"2023-10-25T16:13:08.541423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477996+0000","last_change":"2023-10-25T16:13:07.553120+0000","last_active":"2023-10-25T16:13:09.477996+0000","last_peered":"2023-10-25T16:13:09.477996+0000","last_clean":"2023-10-25T16:13:09.477996+0000","last_became_active":"2023-10-25T16:13:07.551990+0000","last_became_peered":"2023-10-25T16:13:07.551990+0000","last_unstale":"2023-10-25T16:13:09.477996+0000","last_undegraded":"2023-10-25T16:13:09.477996+0000","last_fullsized":"2023-10-25T16:13:09.477996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478313+0000","last_change":"2023-10-25T16:13:07.563333+0000","last_active":"2023-10-25T16:13:09.478313+0000","last_peered":"2023-10-25T16:13:09.478313+0000","last_clean":"2023-10-25T16:13:09.478313+0000","last_became_active":"2023-10-25T16:13:07.560920+0000","last_became_peered":"2023-10-25T16:13:07.560920+0000","last_unstale":"2023-10-25T16:13:09.478313+0000","last_undegraded":"2023-10-25T16:13:09.478313+0000","last_fullsized":"2023-10-25T16:13:09.478313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544460+0000","last_change":"2023-10-25T16:13:07.567528+0000","last_active":"2023-10-25T16:13:08.544460+0000","last_peered":"2023-10-25T16:13:08.544460+0000","last_clean":"2023-10-25T16:13:08.544460+0000","last_became_active":"2023-10-25T16:13:07.566685+0000","last_became_peered":"2023-10-25T16:13:07.566685+0000","last_unstale":"2023-10-25T16:13:08.544460+0000","last_undegraded":"2023-10-25T16:13:08.544460+0000","last_fullsized":"2023-10-25T16:13:08.544460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541668+0000","last_change":"2023-10-25T16:13:07.579075+0000","last_active":"2023-10-25T16:13:08.541668+0000","last_peered":"2023-10-25T16:13:08.541668+0000","last_clean":"2023-10-25T16:13:08.541668+0000","last_became_active":"2023-10-25T16:13:07.567451+0000","last_became_peered":"2023-10-25T16:13:07.567451+0000","last_unstale":"2023-10-25T16:13:08.541668+0000","last_undegraded":"2023-10-25T16:13:08.541668+0000","last_fullsized":"2023-10-25T16:13:08.541668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545497+0000","last_change":"2023-10-25T16:13:07.585648+0000","last_active":"2023-10-25T16:13:08.545497+0000","last_peered":"2023-10-25T16:13:08.545497+0000","last_clean":"2023-10-25T16:13:08.545497+0000","last_became_active":"2023-10-25T16:13:07.583670+0000","last_became_peered":"2023-10-25T16:13:07.583670+0000","last_unstale":"2023-10-25T16:13:08.545497+0000","last_undegraded":"2023-10-25T16:13:08.545497+0000","last_fullsized":"2023-10-25T16:13:08.545497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541701+0000","last_change":"2023-10-25T16:13:07.581287+0000","last_active":"2023-10-25T16:13:08.541701+0000","last_peered":"2023-10-25T16:13:08.541701+0000","last_clean":"2023-10-25T16:13:08.541701+0000","last_became_active":"2023-10-25T16:13:07.577390+0000","last_became_peered":"2023-10-25T16:13:07.577390+0000","last_unstale":"2023-10-25T16:13:08.541701+0000","last_undegraded":"2023-10-25T16:13:08.541701+0000","last_fullsized":"2023-10-25T16:13:08.541701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477246+0000","last_change":"2023-10-25T16:13:07.569496+0000","last_active":"2023-10-25T16:13:09.477246+0000","last_peered":"2023-10-25T16:13:09.477246+0000","last_clean":"2023-10-25T16:13:09.477246+0000","last_became_active":"2023-10-25T16:13:07.563950+0000","last_became_peered":"2023-10-25T16:13:07.563950+0000","last_unstale":"2023-10-25T16:13:09.477246+0000","last_undegraded":"2023-10-25T16:13:09.477246+0000","last_fullsized":"2023-10-25T16:13:09.477246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:11.014336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541010+0000","last_change":"2023-10-25T16:13:07.577965+0000","last_active":"2023-10-25T16:13:08.541010+0000","last_peered":"2023-10-25T16:13:08.541010+0000","last_clean":"2023-10-25T16:13:08.541010+0000","last_became_active":"2023-10-25T16:13:07.576892+0000","last_became_peered":"2023-10-25T16:13:07.576892+0000","last_unstale":"2023-10-25T16:13:08.541010+0000","last_undegraded":"2023-10-25T16:13:08.541010+0000","last_fullsized":"2023-10-25T16:13:08.541010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464171+0000","last_change":"2023-10-25T16:13:07.561076+0000","last_active":"2023-10-25T16:13:09.464171+0000","last_peered":"2023-10-25T16:13:09.464171+0000","last_clean":"2023-10-25T16:13:09.464171+0000","last_became_active":"2023-10-25T16:13:07.560340+0000","last_became_peered":"2023-10-25T16:13:07.560340+0000","last_unstale":"2023-10-25T16:13:09.464171+0000","last_undegraded":"2023-10-25T16:13:09.464171+0000","last_fullsized":"2023-10-25T16:13:09.464171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.463985+0000","last_change":"2023-10-25T16:13:07.585838+0000","last_active":"2023-10-25T16:13:09.463985+0000","last_peered":"2023-10-25T16:13:09.463985+0000","last_clean":"2023-10-25T16:13:09.463985+0000","last_became_active":"2023-10-25T16:13:07.585351+0000","last_became_peered":"2023-10-25T16:13:07.585351+0000","last_unstale":"2023-10-25T16:13:09.463985+0000","last_undegraded":"2023-10-25T16:13:09.463985+0000","last_fullsized":"2023-10-25T16:13:09.463985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186012+0000","last_change":"2023-10-25T16:13:07.572936+0000","last_active":"2023-10-25T16:13:09.186012+0000","last_peered":"2023-10-25T16:13:09.186012+0000","last_clean":"2023-10-25T16:13:09.186012+0000","last_became_active":"2023-10-25T16:13:07.572216+0000","last_became_peered":"2023-10-25T16:13:07.572216+0000","last_unstale":"2023-10-25T16:13:09.186012+0000","last_undegraded":"2023-10-25T16:13:09.186012+0000","last_fullsized":"2023-10-25T16:13:09.186012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:56.036325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480366+0000","last_change":"2023-10-25T16:13:07.567194+0000","last_active":"2023-10-25T16:13:09.480366+0000","last_peered":"2023-10-25T16:13:09.480366+0000","last_clean":"2023-10-25T16:13:09.480366+0000","last_became_active":"2023-10-25T16:13:07.561537+0000","last_became_peered":"2023-10-25T16:13:07.561537+0000","last_unstale":"2023-10-25T16:13:09.480366+0000","last_undegraded":"2023-10-25T16:13:09.480366+0000","last_fullsized":"2023-10-25T16:13:09.480366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477496+0000","last_change":"2023-10-25T16:13:07.567614+0000","last_active":"2023-10-25T16:13:09.477496+0000","last_peered":"2023-10-25T16:13:09.477496+0000","last_clean":"2023-10-25T16:13:09.477496+0000","last_became_active":"2023-10-25T16:13:07.564979+0000","last_became_peered":"2023-10-25T16:13:07.564979+0000","last_unstale":"2023-10-25T16:13:09.477496+0000","last_undegraded":"2023-10-25T16:13:09.477496+0000","last_fullsized":"2023-10-25T16:13:09.477496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:05.007750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478079+0000","last_change":"2023-10-25T16:13:07.562980+0000","last_active":"2023-10-25T16:13:09.478079+0000","last_peered":"2023-10-25T16:13:09.478079+0000","last_clean":"2023-10-25T16:13:09.478079+0000","last_became_active":"2023-10-25T16:13:07.562370+0000","last_became_peered":"2023-10-25T16:13:07.562370+0000","last_unstale":"2023-10-25T16:13:09.478079+0000","last_undegraded":"2023-10-25T16:13:09.478079+0000","last_fullsized":"2023-10-25T16:13:09.478079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545182+0000","last_change":"2023-10-25T16:13:07.587718+0000","last_active":"2023-10-25T16:13:08.545182+0000","last_peered":"2023-10-25T16:13:08.545182+0000","last_clean":"2023-10-25T16:13:08.545182+0000","last_became_active":"2023-10-25T16:13:07.584346+0000","last_became_peered":"2023-10-25T16:13:07.584346+0000","last_unstale":"2023-10-25T16:13:08.545182+0000","last_undegraded":"2023-10-25T16:13:08.545182+0000","last_fullsized":"2023-10-25T16:13:08.545182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:22:15.853472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544311+0000","last_change":"2023-10-25T16:13:07.590347+0000","last_active":"2023-10-25T16:13:08.544311+0000","last_peered":"2023-10-25T16:13:08.544311+0000","last_clean":"2023-10-25T16:13:08.544311+0000","last_became_active":"2023-10-25T16:13:07.589306+0000","last_became_peered":"2023-10-25T16:13:07.589306+0000","last_unstale":"2023-10-25T16:13:08.544311+0000","last_undegraded":"2023-10-25T16:13:08.544311+0000","last_fullsized":"2023-10-25T16:13:08.544311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480257+0000","last_change":"2023-10-25T16:13:07.571462+0000","last_active":"2023-10-25T16:13:09.480257+0000","last_peered":"2023-10-25T16:13:09.480257+0000","last_clean":"2023-10-25T16:13:09.480257+0000","last_became_active":"2023-10-25T16:13:07.571017+0000","last_became_peered":"2023-10-25T16:13:07.571017+0000","last_unstale":"2023-10-25T16:13:09.480257+0000","last_undegraded":"2023-10-25T16:13:09.480257+0000","last_fullsized":"2023-10-25T16:13:09.480257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541426+0000","last_change":"2023-10-25T16:13:07.565774+0000","last_active":"2023-10-25T16:13:08.541426+0000","last_peered":"2023-10-25T16:13:08.541426+0000","last_clean":"2023-10-25T16:13:08.541426+0000","last_became_active":"2023-10-25T16:13:07.564671+0000","last_became_peered":"2023-10-25T16:13:07.564671+0000","last_unstale":"2023-10-25T16:13:08.541426+0000","last_undegraded":"2023-10-25T16:13:08.541426+0000","last_fullsized":"2023-10-25T16:13:08.541426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464359+0000","last_change":"2023-10-25T16:13:07.569779+0000","last_active":"2023-10-25T16:13:09.464359+0000","last_peered":"2023-10-25T16:13:09.464359+0000","last_clean":"2023-10-25T16:13:09.464359+0000","last_became_active":"2023-10-25T16:13:07.568943+0000","last_became_peered":"2023-10-25T16:13:07.568943+0000","last_unstale":"2023-10-25T16:13:09.464359+0000","last_undegraded":"2023-10-25T16:13:09.464359+0000","last_fullsized":"2023-10-25T16:13:09.464359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478818+0000","last_change":"2023-10-25T16:13:07.588566+0000","last_active":"2023-10-25T16:13:09.478818+0000","last_peered":"2023-10-25T16:13:09.478818+0000","last_clean":"2023-10-25T16:13:09.478818+0000","last_became_active":"2023-10-25T16:13:07.586975+0000","last_became_peered":"2023-10-25T16:13:07.586975+0000","last_unstale":"2023-10-25T16:13:09.478818+0000","last_undegraded":"2023-10-25T16:13:09.478818+0000","last_fullsized":"2023-10-25T16:13:09.478818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544961+0000","last_change":"2023-10-25T16:13:07.589720+0000","last_active":"2023-10-25T16:13:08.544961+0000","last_peered":"2023-10-25T16:13:08.544961+0000","last_clean":"2023-10-25T16:13:08.544961+0000","last_became_active":"2023-10-25T16:13:07.587901+0000","last_became_peered":"2023-10-25T16:13:07.587901+0000","last_unstale":"2023-10-25T16:13:08.544961+0000","last_undegraded":"2023-10-25T16:13:08.544961+0000","last_fullsized":"2023-10-25T16:13:08.544961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:52.336109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481296+0000","last_change":"2023-10-25T16:13:07.564523+0000","last_active":"2023-10-25T16:13:09.481296+0000","last_peered":"2023-10-25T16:13:09.481296+0000","last_clean":"2023-10-25T16:13:09.481296+0000","last_became_active":"2023-10-25T16:13:07.558883+0000","last_became_peered":"2023-10-25T16:13:07.558883+0000","last_unstale":"2023-10-25T16:13:09.481296+0000","last_undegraded":"2023-10-25T16:13:09.481296+0000","last_fullsized":"2023-10-25T16:13:09.481296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544854+0000","last_change":"2023-10-25T16:13:07.565692+0000","last_active":"2023-10-25T16:13:08.544854+0000","last_peered":"2023-10-25T16:13:08.544854+0000","last_clean":"2023-10-25T16:13:08.544854+0000","last_became_active":"2023-10-25T16:13:07.565063+0000","last_became_peered":"2023-10-25T16:13:07.565063+0000","last_unstale":"2023-10-25T16:13:08.544854+0000","last_undegraded":"2023-10-25T16:13:08.544854+0000","last_fullsized":"2023-10-25T16:13:08.544854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478118+0000","last_change":"2023-10-25T16:13:07.567029+0000","last_active":"2023-10-25T16:13:09.478118+0000","last_peered":"2023-10-25T16:13:09.478118+0000","last_clean":"2023-10-25T16:13:09.478118+0000","last_became_active":"2023-10-25T16:13:07.563753+0000","last_became_peered":"2023-10-25T16:13:07.563753+0000","last_unstale":"2023-10-25T16:13:09.478118+0000","last_undegraded":"2023-10-25T16:13:09.478118+0000","last_fullsized":"2023-10-25T16:13:09.478118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464243+0000","last_change":"2023-10-25T16:13:07.571465+0000","last_active":"2023-10-25T16:13:09.464243+0000","last_peered":"2023-10-25T16:13:09.464243+0000","last_clean":"2023-10-25T16:13:09.464243+0000","last_became_active":"2023-10-25T16:13:07.570569+0000","last_became_peered":"2023-10-25T16:13:07.570569+0000","last_unstale":"2023-10-25T16:13:09.464243+0000","last_undegraded":"2023-10-25T16:13:09.464243+0000","last_fullsized":"2023-10-25T16:13:09.464243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478333+0000","last_change":"2023-10-25T16:13:07.552675+0000","last_active":"2023-10-25T16:13:09.478333+0000","last_peered":"2023-10-25T16:13:09.478333+0000","last_clean":"2023-10-25T16:13:09.478333+0000","last_became_active":"2023-10-25T16:13:07.551113+0000","last_became_peered":"2023-10-25T16:13:07.551113+0000","last_unstale":"2023-10-25T16:13:09.478333+0000","last_undegraded":"2023-10-25T16:13:09.478333+0000","last_fullsized":"2023-10-25T16:13:09.478333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480684+0000","last_change":"2023-10-25T16:13:07.563309+0000","last_active":"2023-10-25T16:13:09.480684+0000","last_peered":"2023-10-25T16:13:09.480684+0000","last_clean":"2023-10-25T16:13:09.480684+0000","last_became_active":"2023-10-25T16:13:07.556854+0000","last_became_peered":"2023-10-25T16:13:07.556854+0000","last_unstale":"2023-10-25T16:13:09.480684+0000","last_undegraded":"2023-10-25T16:13:09.480684+0000","last_fullsized":"2023-10-25T16:13:09.480684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.481261+0000","last_change":"2023-10-25T16:13:07.563614+0000","last_active":"2023-10-25T16:13:09.481261+0000","last_peered":"2023-10-25T16:13:09.481261+0000","last_clean":"2023-10-25T16:13:09.481261+0000","last_became_active":"2023-10-25T16:13:07.562379+0000","last_became_peered":"2023-10-25T16:13:07.562379+0000","last_unstale":"2023-10-25T16:13:09.481261+0000","last_undegraded":"2023-10-25T16:13:09.481261+0000","last_fullsized":"2023-10-25T16:13:09.481261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544963+0000","last_change":"2023-10-25T16:13:07.575589+0000","last_active":"2023-10-25T16:13:08.544963+0000","last_peered":"2023-10-25T16:13:08.544963+0000","last_clean":"2023-10-25T16:13:08.544963+0000","last_became_active":"2023-10-25T16:13:07.569050+0000","last_became_peered":"2023-10-25T16:13:07.569050+0000","last_unstale":"2023-10-25T16:13:08.544963+0000","last_undegraded":"2023-10-25T16:13:08.544963+0000","last_fullsized":"2023-10-25T16:13:08.544963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:28:47.608534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477456+0000","last_change":"2023-10-25T16:13:07.586185+0000","last_active":"2023-10-25T16:13:09.477456+0000","last_peered":"2023-10-25T16:13:09.477456+0000","last_clean":"2023-10-25T16:13:09.477456+0000","last_became_active":"2023-10-25T16:13:07.585479+0000","last_became_peered":"2023-10-25T16:13:07.585479+0000","last_unstale":"2023-10-25T16:13:09.477456+0000","last_undegraded":"2023-10-25T16:13:09.477456+0000","last_fullsized":"2023-10-25T16:13:09.477456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464294+0000","last_change":"2023-10-25T16:13:07.571634+0000","last_active":"2023-10-25T16:13:09.464294+0000","last_peered":"2023-10-25T16:13:09.464294+0000","last_clean":"2023-10-25T16:13:09.464294+0000","last_became_active":"2023-10-25T16:13:07.570373+0000","last_became_peered":"2023-10-25T16:13:07.570373+0000","last_unstale":"2023-10-25T16:13:09.464294+0000","last_undegraded":"2023-10-25T16:13:09.464294+0000","last_fullsized":"2023-10-25T16:13:09.464294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185835+0000","last_change":"2023-10-25T16:13:07.554976+0000","last_active":"2023-10-25T16:13:09.185835+0000","last_peered":"2023-10-25T16:13:09.185835+0000","last_clean":"2023-10-25T16:13:09.185835+0000","last_became_active":"2023-10-25T16:13:07.554311+0000","last_became_peered":"2023-10-25T16:13:07.554311+0000","last_unstale":"2023-10-25T16:13:09.185835+0000","last_undegraded":"2023-10-25T16:13:09.185835+0000","last_fullsized":"2023-10-25T16:13:09.185835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:17.389644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479939+0000","last_change":"2023-10-25T16:13:06.604007+0000","last_active":"2023-10-25T16:13:09.479939+0000","last_peered":"2023-10-25T16:13:09.479939+0000","last_clean":"2023-10-25T16:13:09.479939+0000","last_became_active":"2023-10-25T16:13:06.603266+0000","last_became_peered":"2023-10-25T16:13:06.603266+0000","last_unstale":"2023-10-25T16:13:09.479939+0000","last_undegraded":"2023-10-25T16:13:09.479939+0000","last_fullsized":"2023-10-25T16:13:09.479939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478778+0000","last_change":"2023-10-25T16:13:07.559020+0000","last_active":"2023-10-25T16:13:09.478778+0000","last_peered":"2023-10-25T16:13:09.478778+0000","last_clean":"2023-10-25T16:13:09.478778+0000","last_became_active":"2023-10-25T16:13:07.558319+0000","last_became_peered":"2023-10-25T16:13:07.558319+0000","last_unstale":"2023-10-25T16:13:09.478778+0000","last_undegraded":"2023-10-25T16:13:09.478778+0000","last_fullsized":"2023-10-25T16:13:09.478778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464815+0000","last_change":"2023-10-25T16:13:06.598258+0000","last_active":"2023-10-25T16:13:09.464815+0000","last_peered":"2023-10-25T16:13:09.464815+0000","last_clean":"2023-10-25T16:13:09.464815+0000","last_became_active":"2023-10-25T16:13:06.597739+0000","last_became_peered":"2023-10-25T16:13:06.597739+0000","last_unstale":"2023-10-25T16:13:09.464815+0000","last_undegraded":"2023-10-25T16:13:09.464815+0000","last_fullsized":"2023-10-25T16:13:09.464815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480678+0000","last_change":"2023-10-25T16:13:06.593802+0000","last_active":"2023-10-25T16:13:09.480678+0000","last_peered":"2023-10-25T16:13:09.480678+0000","last_clean":"2023-10-25T16:13:09.480678+0000","last_became_active":"2023-10-25T16:13:06.591848+0000","last_became_peered":"2023-10-25T16:13:06.591848+0000","last_unstale":"2023-10-25T16:13:09.480678+0000","last_undegraded":"2023-10-25T16:13:09.480678+0000","last_fullsized":"2023-10-25T16:13:09.480678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478429+0000","last_change":"2023-10-25T16:13:07.564400+0000","last_active":"2023-10-25T16:13:09.478429+0000","last_peered":"2023-10-25T16:13:09.478429+0000","last_clean":"2023-10-25T16:13:09.478429+0000","last_became_active":"2023-10-25T16:13:07.560990+0000","last_became_peered":"2023-10-25T16:13:07.560990+0000","last_unstale":"2023-10-25T16:13:09.478429+0000","last_undegraded":"2023-10-25T16:13:09.478429+0000","last_fullsized":"2023-10-25T16:13:09.478429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:10.068273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545533+0000","last_change":"2023-10-25T16:13:06.585016+0000","last_active":"2023-10-25T16:13:08.545533+0000","last_peered":"2023-10-25T16:13:08.545533+0000","last_clean":"2023-10-25T16:13:08.545533+0000","last_became_active":"2023-10-25T16:13:06.584376+0000","last_became_peered":"2023-10-25T16:13:06.584376+0000","last_unstale":"2023-10-25T16:13:08.545533+0000","last_undegraded":"2023-10-25T16:13:08.545533+0000","last_fullsized":"2023-10-25T16:13:08.545533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:10.754090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479516+0000","last_change":"2023-10-25T16:13:07.559199+0000","last_active":"2023-10-25T16:13:09.479516+0000","last_peered":"2023-10-25T16:13:09.479516+0000","last_clean":"2023-10-25T16:13:09.479516+0000","last_became_active":"2023-10-25T16:13:07.556631+0000","last_became_peered":"2023-10-25T16:13:07.556631+0000","last_unstale":"2023-10-25T16:13:09.479516+0000","last_undegraded":"2023-10-25T16:13:09.479516+0000","last_fullsized":"2023-10-25T16:13:09.479516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:27.874955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464487+0000","last_change":"2023-10-25T16:13:06.584038+0000","last_active":"2023-10-25T16:13:09.464487+0000","last_peered":"2023-10-25T16:13:09.464487+0000","last_clean":"2023-10-25T16:13:09.464487+0000","last_became_active":"2023-10-25T16:13:06.583589+0000","last_became_peered":"2023-10-25T16:13:06.583589+0000","last_unstale":"2023-10-25T16:13:09.464487+0000","last_undegraded":"2023-10-25T16:13:09.464487+0000","last_fullsized":"2023-10-25T16:13:09.464487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.544608+0000","last_change":"2023-10-25T16:13:07.590063+0000","last_active":"2023-10-25T16:13:08.544608+0000","last_peered":"2023-10-25T16:13:08.544608+0000","last_clean":"2023-10-25T16:13:08.544608+0000","last_became_active":"2023-10-25T16:13:07.588495+0000","last_became_peered":"2023-10-25T16:13:07.588495+0000","last_unstale":"2023-10-25T16:13:08.544608+0000","last_undegraded":"2023-10-25T16:13:08.544608+0000","last_fullsized":"2023-10-25T16:13:08.544608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546034+0000","last_change":"2023-10-25T16:13:06.590184+0000","last_active":"2023-10-25T16:13:08.546034+0000","last_peered":"2023-10-25T16:13:08.546034+0000","last_clean":"2023-10-25T16:13:08.546034+0000","last_became_active":"2023-10-25T16:13:06.588948+0000","last_became_peered":"2023-10-25T16:13:06.588948+0000","last_unstale":"2023-10-25T16:13:08.546034+0000","last_undegraded":"2023-10-25T16:13:08.546034+0000","last_fullsized":"2023-10-25T16:13:08.546034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479144+0000","last_change":"2023-10-25T16:13:07.586291+0000","last_active":"2023-10-25T16:13:09.479144+0000","last_peered":"2023-10-25T16:13:09.479144+0000","last_clean":"2023-10-25T16:13:09.479144+0000","last_became_active":"2023-10-25T16:13:07.585591+0000","last_became_peered":"2023-10-25T16:13:07.585591+0000","last_unstale":"2023-10-25T16:13:09.479144+0000","last_undegraded":"2023-10-25T16:13:09.479144+0000","last_fullsized":"2023-10-25T16:13:09.479144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480345+0000","last_change":"2023-10-25T16:13:06.583823+0000","last_active":"2023-10-25T16:13:09.480345+0000","last_peered":"2023-10-25T16:13:09.480345+0000","last_clean":"2023-10-25T16:13:09.480345+0000","last_became_active":"2023-10-25T16:13:06.583486+0000","last_became_peered":"2023-10-25T16:13:06.583486+0000","last_unstale":"2023-10-25T16:13:09.480345+0000","last_undegraded":"2023-10-25T16:13:09.480345+0000","last_fullsized":"2023-10-25T16:13:09.480345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:19.848515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185623+0000","last_change":"2023-10-25T16:13:07.568365+0000","last_active":"2023-10-25T16:13:09.185623+0000","last_peered":"2023-10-25T16:13:09.185623+0000","last_clean":"2023-10-25T16:13:09.185623+0000","last_became_active":"2023-10-25T16:13:07.567142+0000","last_became_peered":"2023-10-25T16:13:07.567142+0000","last_unstale":"2023-10-25T16:13:09.185623+0000","last_undegraded":"2023-10-25T16:13:09.185623+0000","last_fullsized":"2023-10-25T16:13:09.185623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:05:11.764579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464438+0000","last_change":"2023-10-25T16:13:06.595459+0000","last_active":"2023-10-25T16:13:09.464438+0000","last_peered":"2023-10-25T16:13:09.464438+0000","last_clean":"2023-10-25T16:13:09.464438+0000","last_became_active":"2023-10-25T16:13:06.594824+0000","last_became_peered":"2023-10-25T16:13:06.594824+0000","last_unstale":"2023-10-25T16:13:09.464438+0000","last_undegraded":"2023-10-25T16:13:09.464438+0000","last_fullsized":"2023-10-25T16:13:09.464438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541328+0000","last_change":"2023-10-25T16:13:07.577436+0000","last_active":"2023-10-25T16:13:08.541328+0000","last_peered":"2023-10-25T16:13:08.541328+0000","last_clean":"2023-10-25T16:13:08.541328+0000","last_became_active":"2023-10-25T16:13:07.567759+0000","last_became_peered":"2023-10-25T16:13:07.567759+0000","last_unstale":"2023-10-25T16:13:08.541328+0000","last_undegraded":"2023-10-25T16:13:08.541328+0000","last_fullsized":"2023-10-25T16:13:08.541328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:56.218455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480167+0000","last_change":"2023-10-25T16:13:06.591408+0000","last_active":"2023-10-25T16:13:09.480167+0000","last_peered":"2023-10-25T16:13:09.480167+0000","last_clean":"2023-10-25T16:13:09.480167+0000","last_became_active":"2023-10-25T16:13:06.591012+0000","last_became_peered":"2023-10-25T16:13:06.591012+0000","last_unstale":"2023-10-25T16:13:09.480167+0000","last_undegraded":"2023-10-25T16:13:09.480167+0000","last_fullsized":"2023-10-25T16:13:09.480167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:44.572046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479460+0000","last_change":"2023-10-25T16:13:07.589102+0000","last_active":"2023-10-25T16:13:09.479460+0000","last_peered":"2023-10-25T16:13:09.479460+0000","last_clean":"2023-10-25T16:13:09.479460+0000","last_became_active":"2023-10-25T16:13:07.587838+0000","last_became_peered":"2023-10-25T16:13:07.587838+0000","last_unstale":"2023-10-25T16:13:09.479460+0000","last_undegraded":"2023-10-25T16:13:09.479460+0000","last_fullsized":"2023-10-25T16:13:09.479460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546334+0000","last_change":"2023-10-25T16:13:06.589759+0000","last_active":"2023-10-25T16:13:08.546334+0000","last_peered":"2023-10-25T16:13:08.546334+0000","last_clean":"2023-10-25T16:13:08.546334+0000","last_became_active":"2023-10-25T16:13:06.589100+0000","last_became_peered":"2023-10-25T16:13:06.589100+0000","last_unstale":"2023-10-25T16:13:08.546334+0000","last_undegraded":"2023-10-25T16:13:08.546334+0000","last_fullsized":"2023-10-25T16:13:08.546334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542048+0000","last_change":"2023-10-25T16:13:07.577105+0000","last_active":"2023-10-25T16:13:08.542048+0000","last_peered":"2023-10-25T16:13:08.542048+0000","last_clean":"2023-10-25T16:13:08.542048+0000","last_became_active":"2023-10-25T16:13:07.565017+0000","last_became_peered":"2023-10-25T16:13:07.565017+0000","last_unstale":"2023-10-25T16:13:08.542048+0000","last_undegraded":"2023-10-25T16:13:08.542048+0000","last_fullsized":"2023-10-25T16:13:08.542048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:23.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464495+0000","last_change":"2023-10-25T16:13:06.598452+0000","last_active":"2023-10-25T16:13:09.464495+0000","last_peered":"2023-10-25T16:13:09.464495+0000","last_clean":"2023-10-25T16:13:09.464495+0000","last_became_active":"2023-10-25T16:13:06.597797+0000","last_became_peered":"2023-10-25T16:13:06.597797+0000","last_unstale":"2023-10-25T16:13:09.464495+0000","last_undegraded":"2023-10-25T16:13:09.464495+0000","last_fullsized":"2023-10-25T16:13:09.464495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464575+0000","last_change":"2023-10-25T16:13:07.569409+0000","last_active":"2023-10-25T16:13:09.464575+0000","last_peered":"2023-10-25T16:13:09.464575+0000","last_clean":"2023-10-25T16:13:09.464575+0000","last_became_active":"2023-10-25T16:13:07.561141+0000","last_became_peered":"2023-10-25T16:13:07.561141+0000","last_unstale":"2023-10-25T16:13:09.464575+0000","last_undegraded":"2023-10-25T16:13:09.464575+0000","last_fullsized":"2023-10-25T16:13:09.464575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.613385+0000","last_change":"2023-10-25T16:13:06.587180+0000","last_active":"2023-10-25T16:13:07.613385+0000","last_peered":"2023-10-25T16:13:07.613385+0000","last_clean":"2023-10-25T16:13:07.613385+0000","last_became_active":"2023-10-25T16:13:06.585285+0000","last_became_peered":"2023-10-25T16:13:06.585285+0000","last_unstale":"2023-10-25T16:13:07.613385+0000","last_undegraded":"2023-10-25T16:13:07.613385+0000","last_fullsized":"2023-10-25T16:13:07.613385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:48.892031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542401+0000","last_change":"2023-10-25T16:13:07.586802+0000","last_active":"2023-10-25T16:13:08.542401+0000","last_peered":"2023-10-25T16:13:08.542401+0000","last_clean":"2023-10-25T16:13:08.542401+0000","last_became_active":"2023-10-25T16:13:07.586067+0000","last_became_peered":"2023-10-25T16:13:07.586067+0000","last_unstale":"2023-10-25T16:13:08.542401+0000","last_undegraded":"2023-10-25T16:13:08.542401+0000","last_fullsized":"2023-10-25T16:13:08.542401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185909+0000","last_change":"2023-10-25T16:13:06.576987+0000","last_active":"2023-10-25T16:13:09.185909+0000","last_peered":"2023-10-25T16:13:09.185909+0000","last_clean":"2023-10-25T16:13:09.185909+0000","last_became_active":"2023-10-25T16:13:06.576204+0000","last_became_peered":"2023-10-25T16:13:06.576204+0000","last_unstale":"2023-10-25T16:13:09.185909+0000","last_undegraded":"2023-10-25T16:13:09.185909+0000","last_fullsized":"2023-10-25T16:13:09.185909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:27.980983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542364+0000","last_change":"2023-10-25T16:13:07.577484+0000","last_active":"2023-10-25T16:13:08.542364+0000","last_peered":"2023-10-25T16:13:08.542364+0000","last_clean":"2023-10-25T16:13:08.542364+0000","last_became_active":"2023-10-25T16:13:07.566477+0000","last_became_peered":"2023-10-25T16:13:07.566477+0000","last_unstale":"2023-10-25T16:13:08.542364+0000","last_undegraded":"2023-10-25T16:13:08.542364+0000","last_fullsized":"2023-10-25T16:13:08.542364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.612118+0000","last_change":"2023-10-25T16:13:06.574238+0000","last_active":"2023-10-25T16:13:07.612118+0000","last_peered":"2023-10-25T16:13:07.612118+0000","last_clean":"2023-10-25T16:13:07.612118+0000","last_became_active":"2023-10-25T16:13:06.573942+0000","last_became_peered":"2023-10-25T16:13:06.573942+0000","last_unstale":"2023-10-25T16:13:07.612118+0000","last_undegraded":"2023-10-25T16:13:07.612118+0000","last_fullsized":"2023-10-25T16:13:07.612118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:47.976238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541203+0000","last_change":"2023-10-25T16:13:07.565301+0000","last_active":"2023-10-25T16:13:08.541203+0000","last_peered":"2023-10-25T16:13:08.541203+0000","last_clean":"2023-10-25T16:13:08.541203+0000","last_became_active":"2023-10-25T16:13:07.563812+0000","last_became_peered":"2023-10-25T16:13:07.563812+0000","last_unstale":"2023-10-25T16:13:08.541203+0000","last_undegraded":"2023-10-25T16:13:08.541203+0000","last_fullsized":"2023-10-25T16:13:08.541203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478001+0000","last_change":"2023-10-25T16:13:06.583997+0000","last_active":"2023-10-25T16:13:09.478001+0000","last_peered":"2023-10-25T16:13:09.478001+0000","last_clean":"2023-10-25T16:13:09.478001+0000","last_became_active":"2023-10-25T16:13:06.583355+0000","last_became_peered":"2023-10-25T16:13:06.583355+0000","last_unstale":"2023-10-25T16:13:09.478001+0000","last_undegraded":"2023-10-25T16:13:09.478001+0000","last_fullsized":"2023-10-25T16:13:09.478001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545728+0000","last_change":"2023-10-25T16:13:07.576400+0000","last_active":"2023-10-25T16:13:08.545728+0000","last_peered":"2023-10-25T16:13:08.545728+0000","last_clean":"2023-10-25T16:13:08.545728+0000","last_became_active":"2023-10-25T16:13:07.575767+0000","last_became_peered":"2023-10-25T16:13:07.575767+0000","last_unstale":"2023-10-25T16:13:08.545728+0000","last_undegraded":"2023-10-25T16:13:08.545728+0000","last_fullsized":"2023-10-25T16:13:08.545728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:36.175797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.548907+0000","last_change":"2023-10-25T16:13:06.586022+0000","last_active":"2023-10-25T16:13:07.548907+0000","last_peered":"2023-10-25T16:13:07.548907+0000","last_clean":"2023-10-25T16:13:07.548907+0000","last_became_active":"2023-10-25T16:13:06.585354+0000","last_became_peered":"2023-10-25T16:13:06.585354+0000","last_unstale":"2023-10-25T16:13:07.548907+0000","last_undegraded":"2023-10-25T16:13:07.548907+0000","last_fullsized":"2023-10-25T16:13:07.548907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:00.194766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541794+0000","last_change":"2023-10-25T16:13:07.587447+0000","last_active":"2023-10-25T16:13:08.541794+0000","last_peered":"2023-10-25T16:13:08.541794+0000","last_clean":"2023-10-25T16:13:08.541794+0000","last_became_active":"2023-10-25T16:13:07.586850+0000","last_became_peered":"2023-10-25T16:13:07.586850+0000","last_unstale":"2023-10-25T16:13:08.541794+0000","last_undegraded":"2023-10-25T16:13:08.541794+0000","last_fullsized":"2023-10-25T16:13:08.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.549368+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:13:07.549368+0000","last_peered":"2023-10-25T16:13:07.549368+0000","last_clean":"2023-10-25T16:13:07.549368+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:13:07.549368+0000","last_undegraded":"2023-10-25T16:13:07.549368+0000","last_fullsized":"2023-10-25T16:13:07.549368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546669+0000","last_change":"2023-10-25T16:13:06.587408+0000","last_active":"2023-10-25T16:13:08.546669+0000","last_peered":"2023-10-25T16:13:08.546669+0000","last_clean":"2023-10-25T16:13:08.546669+0000","last_became_active":"2023-10-25T16:13:06.586522+0000","last_became_peered":"2023-10-25T16:13:06.586522+0000","last_unstale":"2023-10-25T16:13:08.546669+0000","last_undegraded":"2023-10-25T16:13:08.546669+0000","last_fullsized":"2023-10-25T16:13:08.546669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:38.279671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479511+0000","last_change":"2023-10-25T16:13:07.576734+0000","last_active":"2023-10-25T16:13:09.479511+0000","last_peered":"2023-10-25T16:13:09.479511+0000","last_clean":"2023-10-25T16:13:09.479511+0000","last_became_active":"2023-10-25T16:13:07.575887+0000","last_became_peered":"2023-10-25T16:13:07.575887+0000","last_unstale":"2023-10-25T16:13:09.479511+0000","last_undegraded":"2023-10-25T16:13:09.479511+0000","last_fullsized":"2023-10-25T16:13:09.479511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541705+0000","last_change":"2023-10-25T16:13:06.603271+0000","last_active":"2023-10-25T16:13:08.541705+0000","last_peered":"2023-10-25T16:13:08.541705+0000","last_clean":"2023-10-25T16:13:08.541705+0000","last_became_active":"2023-10-25T16:13:06.602179+0000","last_became_peered":"2023-10-25T16:13:06.602179+0000","last_unstale":"2023-10-25T16:13:08.541705+0000","last_undegraded":"2023-10-25T16:13:08.541705+0000","last_fullsized":"2023-10-25T16:13:08.541705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479260+0000","last_change":"2023-10-25T16:13:07.563801+0000","last_active":"2023-10-25T16:13:09.479260+0000","last_peered":"2023-10-25T16:13:09.479260+0000","last_clean":"2023-10-25T16:13:09.479260+0000","last_became_active":"2023-10-25T16:13:07.561818+0000","last_became_peered":"2023-10-25T16:13:07.561818+0000","last_unstale":"2023-10-25T16:13:09.479260+0000","last_undegraded":"2023-10-25T16:13:09.479260+0000","last_fullsized":"2023-10-25T16:13:09.479260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:39.290159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T16:13:07.551983+0000","last_change":"2023-10-25T16:13:06.585957+0000","last_active":"2023-10-25T16:13:07.551983+0000","last_peered":"2023-10-25T16:13:07.551983+0000","last_clean":"2023-10-25T16:13:07.551983+0000","last_became_active":"2023-10-25T16:13:06.581257+0000","last_became_peered":"2023-10-25T16:13:06.581257+0000","last_unstale":"2023-10-25T16:13:07.551983+0000","last_undegraded":"2023-10-25T16:13:07.551983+0000","last_fullsized":"2023-10-25T16:13:07.551983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:13:19.127582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479843+0000","last_change":"2023-10-25T16:13:07.559564+0000","last_active":"2023-10-25T16:13:09.479843+0000","last_peered":"2023-10-25T16:13:09.479843+0000","last_clean":"2023-10-25T16:13:09.479843+0000","last_became_active":"2023-10-25T16:13:07.558584+0000","last_became_peered":"2023-10-25T16:13:07.558584+0000","last_unstale":"2023-10-25T16:13:09.479843+0000","last_undegraded":"2023-10-25T16:13:09.479843+0000","last_fullsized":"2023-10-25T16:13:09.479843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.546149+0000","last_change":"2023-10-25T16:13:06.583922+0000","last_active":"2023-10-25T16:13:08.546149+0000","last_peered":"2023-10-25T16:13:08.546149+0000","last_clean":"2023-10-25T16:13:08.546149+0000","last_became_active":"2023-10-25T16:13:06.581997+0000","last_became_peered":"2023-10-25T16:13:06.581997+0000","last_unstale":"2023-10-25T16:13:08.546149+0000","last_undegraded":"2023-10-25T16:13:08.546149+0000","last_fullsized":"2023-10-25T16:13:08.546149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.185545+0000","last_change":"2023-10-25T16:13:07.560270+0000","last_active":"2023-10-25T16:13:09.185545+0000","last_peered":"2023-10-25T16:13:09.185545+0000","last_clean":"2023-10-25T16:13:09.185545+0000","last_became_active":"2023-10-25T16:13:07.559551+0000","last_became_peered":"2023-10-25T16:13:07.559551+0000","last_unstale":"2023-10-25T16:13:09.185545+0000","last_undegraded":"2023-10-25T16:13:09.185545+0000","last_fullsized":"2023-10-25T16:13:09.185545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:19.572019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478513+0000","last_change":"2023-10-25T16:13:06.588392+0000","last_active":"2023-10-25T16:13:09.478513+0000","last_peered":"2023-10-25T16:13:09.478513+0000","last_clean":"2023-10-25T16:13:09.478513+0000","last_became_active":"2023-10-25T16:13:06.588114+0000","last_became_peered":"2023-10-25T16:13:06.588114+0000","last_unstale":"2023-10-25T16:13:09.478513+0000","last_undegraded":"2023-10-25T16:13:09.478513+0000","last_fullsized":"2023-10-25T16:13:09.478513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545216+0000","last_change":"2023-10-25T16:13:07.563744+0000","last_active":"2023-10-25T16:13:08.545216+0000","last_peered":"2023-10-25T16:13:08.545216+0000","last_clean":"2023-10-25T16:13:08.545216+0000","last_became_active":"2023-10-25T16:13:07.563027+0000","last_became_peered":"2023-10-25T16:13:07.563027+0000","last_unstale":"2023-10-25T16:13:08.545216+0000","last_undegraded":"2023-10-25T16:13:08.545216+0000","last_fullsized":"2023-10-25T16:13:08.545216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:57.148825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541562+0000","last_change":"2023-10-25T16:13:06.604452+0000","last_active":"2023-10-25T16:13:08.541562+0000","last_peered":"2023-10-25T16:13:08.541562+0000","last_clean":"2023-10-25T16:13:08.541562+0000","last_became_active":"2023-10-25T16:13:06.603857+0000","last_became_peered":"2023-10-25T16:13:06.603857+0000","last_unstale":"2023-10-25T16:13:08.541562+0000","last_undegraded":"2023-10-25T16:13:08.541562+0000","last_fullsized":"2023-10-25T16:13:08.541562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:32:50.626490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.477752+0000","last_change":"2023-10-25T16:13:07.555525+0000","last_active":"2023-10-25T16:13:09.477752+0000","last_peered":"2023-10-25T16:13:09.477752+0000","last_clean":"2023-10-25T16:13:09.477752+0000","last_became_active":"2023-10-25T16:13:07.554924+0000","last_became_peered":"2023-10-25T16:13:07.554924+0000","last_unstale":"2023-10-25T16:13:09.477752+0000","last_undegraded":"2023-10-25T16:13:09.477752+0000","last_fullsized":"2023-10-25T16:13:09.477752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.776119+0000","last_change":"2023-10-25T16:13:06.588519+0000","last_active":"2023-10-25T16:13:09.776119+0000","last_peered":"2023-10-25T16:13:09.776119+0000","last_clean":"2023-10-25T16:13:09.776119+0000","last_became_active":"2023-10-25T16:13:06.587754+0000","last_became_peered":"2023-10-25T16:13:06.587754+0000","last_unstale":"2023-10-25T16:13:09.776119+0000","last_undegraded":"2023-10-25T16:13:09.776119+0000","last_fullsized":"2023-10-25T16:13:09.776119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479179+0000","last_change":"2023-10-25T16:13:07.577983+0000","last_active":"2023-10-25T16:13:09.479179+0000","last_peered":"2023-10-25T16:13:09.479179+0000","last_clean":"2023-10-25T16:13:09.479179+0000","last_became_active":"2023-10-25T16:13:07.577344+0000","last_became_peered":"2023-10-25T16:13:07.577344+0000","last_unstale":"2023-10-25T16:13:09.479179+0000","last_undegraded":"2023-10-25T16:13:09.479179+0000","last_fullsized":"2023-10-25T16:13:09.479179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464626+0000","last_change":"2023-10-25T16:13:06.595499+0000","last_active":"2023-10-25T16:13:09.464626+0000","last_peered":"2023-10-25T16:13:09.464626+0000","last_clean":"2023-10-25T16:13:09.464626+0000","last_became_active":"2023-10-25T16:13:06.594639+0000","last_became_peered":"2023-10-25T16:13:06.594639+0000","last_unstale":"2023-10-25T16:13:09.464626+0000","last_undegraded":"2023-10-25T16:13:09.464626+0000","last_fullsized":"2023-10-25T16:13:09.464626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478650+0000","last_change":"2023-10-25T16:13:07.568153+0000","last_active":"2023-10-25T16:13:09.478650+0000","last_peered":"2023-10-25T16:13:09.478650+0000","last_clean":"2023-10-25T16:13:09.478650+0000","last_became_active":"2023-10-25T16:13:07.567204+0000","last_became_peered":"2023-10-25T16:13:07.567204+0000","last_unstale":"2023-10-25T16:13:09.478650+0000","last_undegraded":"2023-10-25T16:13:09.478650+0000","last_fullsized":"2023-10-25T16:13:09.478650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:20.859003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542227+0000","last_change":"2023-10-25T16:13:06.605135+0000","last_active":"2023-10-25T16:13:08.542227+0000","last_peered":"2023-10-25T16:13:08.542227+0000","last_clean":"2023-10-25T16:13:08.542227+0000","last_became_active":"2023-10-25T16:13:06.604117+0000","last_became_peered":"2023-10-25T16:13:06.604117+0000","last_unstale":"2023-10-25T16:13:08.542227+0000","last_undegraded":"2023-10-25T16:13:08.542227+0000","last_fullsized":"2023-10-25T16:13:08.542227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:20:09.057785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.186211+0000","last_change":"2023-10-25T16:13:07.570460+0000","last_active":"2023-10-25T16:13:09.186211+0000","last_peered":"2023-10-25T16:13:09.186211+0000","last_clean":"2023-10-25T16:13:09.186211+0000","last_became_active":"2023-10-25T16:13:07.565363+0000","last_became_peered":"2023-10-25T16:13:07.565363+0000","last_unstale":"2023-10-25T16:13:09.186211+0000","last_undegraded":"2023-10-25T16:13:09.186211+0000","last_fullsized":"2023-10-25T16:13:09.186211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:45.620922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478298+0000","last_change":"2023-10-25T16:13:06.607078+0000","last_active":"2023-10-25T16:13:09.478298+0000","last_peered":"2023-10-25T16:13:09.478298+0000","last_clean":"2023-10-25T16:13:09.478298+0000","last_became_active":"2023-10-25T16:13:06.606881+0000","last_became_peered":"2023-10-25T16:13:06.606881+0000","last_unstale":"2023-10-25T16:13:09.478298+0000","last_undegraded":"2023-10-25T16:13:09.478298+0000","last_fullsized":"2023-10-25T16:13:09.478298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:03.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480464+0000","last_change":"2023-10-25T16:13:07.546555+0000","last_active":"2023-10-25T16:13:09.480464+0000","last_peered":"2023-10-25T16:13:09.480464+0000","last_clean":"2023-10-25T16:13:09.480464+0000","last_became_active":"2023-10-25T16:13:07.545944+0000","last_became_peered":"2023-10-25T16:13:07.545944+0000","last_unstale":"2023-10-25T16:13:09.480464+0000","last_undegraded":"2023-10-25T16:13:09.480464+0000","last_fullsized":"2023-10-25T16:13:09.480464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:34:17.437806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480051+0000","last_change":"2023-10-25T16:13:06.589243+0000","last_active":"2023-10-25T16:13:09.480051+0000","last_peered":"2023-10-25T16:13:09.480051+0000","last_clean":"2023-10-25T16:13:09.480051+0000","last_became_active":"2023-10-25T16:13:06.588343+0000","last_became_peered":"2023-10-25T16:13:06.588343+0000","last_unstale":"2023-10-25T16:13:09.480051+0000","last_undegraded":"2023-10-25T16:13:09.480051+0000","last_fullsized":"2023-10-25T16:13:09.480051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:44.610433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480990+0000","last_change":"2023-10-25T16:13:07.569083+0000","last_active":"2023-10-25T16:13:09.480990+0000","last_peered":"2023-10-25T16:13:09.480990+0000","last_clean":"2023-10-25T16:13:09.480990+0000","last_became_active":"2023-10-25T16:13:07.562504+0000","last_became_peered":"2023-10-25T16:13:07.562504+0000","last_unstale":"2023-10-25T16:13:09.480990+0000","last_undegraded":"2023-10-25T16:13:09.480990+0000","last_fullsized":"2023-10-25T16:13:09.480990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:11.060400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.541587+0000","last_change":"2023-10-25T16:13:06.603385+0000","last_active":"2023-10-25T16:13:08.541587+0000","last_peered":"2023-10-25T16:13:08.541587+0000","last_clean":"2023-10-25T16:13:08.541587+0000","last_became_active":"2023-10-25T16:13:06.602760+0000","last_became_peered":"2023-10-25T16:13:06.602760+0000","last_unstale":"2023-10-25T16:13:08.541587+0000","last_undegraded":"2023-10-25T16:13:08.541587+0000","last_fullsized":"2023-10-25T16:13:08.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:55.025836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.464180+0000","last_change":"2023-10-25T16:13:07.569746+0000","last_active":"2023-10-25T16:13:09.464180+0000","last_peered":"2023-10-25T16:13:09.464180+0000","last_clean":"2023-10-25T16:13:09.464180+0000","last_became_active":"2023-10-25T16:13:07.568518+0000","last_became_peered":"2023-10-25T16:13:07.568518+0000","last_unstale":"2023-10-25T16:13:09.464180+0000","last_undegraded":"2023-10-25T16:13:09.464180+0000","last_fullsized":"2023-10-25T16:13:09.464180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:21.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545306+0000","last_change":"2023-10-25T16:13:07.576112+0000","last_active":"2023-10-25T16:13:08.545306+0000","last_peered":"2023-10-25T16:13:08.545306+0000","last_clean":"2023-10-25T16:13:08.545306+0000","last_became_active":"2023-10-25T16:13:07.574201+0000","last_became_peered":"2023-10-25T16:13:07.574201+0000","last_unstale":"2023-10-25T16:13:08.545306+0000","last_undegraded":"2023-10-25T16:13:08.545306+0000","last_fullsized":"2023-10-25T16:13:08.545306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:12.298147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542101+0000","last_change":"2023-10-25T16:13:06.604712+0000","last_active":"2023-10-25T16:13:08.542101+0000","last_peered":"2023-10-25T16:13:08.542101+0000","last_clean":"2023-10-25T16:13:08.542101+0000","last_became_active":"2023-10-25T16:13:06.602850+0000","last_became_peered":"2023-10-25T16:13:06.602850+0000","last_unstale":"2023-10-25T16:13:08.542101+0000","last_undegraded":"2023-10-25T16:13:08.542101+0000","last_fullsized":"2023-10-25T16:13:08.542101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:53:10.003847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.545831+0000","last_change":"2023-10-25T16:13:07.585084+0000","last_active":"2023-10-25T16:13:08.545831+0000","last_peered":"2023-10-25T16:13:08.545831+0000","last_clean":"2023-10-25T16:13:08.545831+0000","last_became_active":"2023-10-25T16:13:07.582955+0000","last_became_peered":"2023-10-25T16:13:07.582955+0000","last_unstale":"2023-10-25T16:13:08.545831+0000","last_undegraded":"2023-10-25T16:13:08.545831+0000","last_fullsized":"2023-10-25T16:13:08.545831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:06.947819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:08.542584+0000","last_change":"2023-10-25T16:13:06.606358+0000","last_active":"2023-10-25T16:13:08.542584+0000","last_peered":"2023-10-25T16:13:08.542584+0000","last_clean":"2023-10-25T16:13:08.542584+0000","last_became_active":"2023-10-25T16:13:06.602334+0000","last_became_peered":"2023-10-25T16:13:06.602334+0000","last_unstale":"2023-10-25T16:13:08.542584+0000","last_undegraded":"2023-10-25T16:13:08.542584+0000","last_fullsized":"2023-10-25T16:13:08.542584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:21.832114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.478959+0000","last_change":"2023-10-25T16:13:07.566273+0000","last_active":"2023-10-25T16:13:09.478959+0000","last_peered":"2023-10-25T16:13:09.478959+0000","last_clean":"2023-10-25T16:13:09.478959+0000","last_became_active":"2023-10-25T16:13:07.562676+0000","last_became_peered":"2023-10-25T16:13:07.562676+0000","last_unstale":"2023-10-25T16:13:09.478959+0000","last_undegraded":"2023-10-25T16:13:09.478959+0000","last_fullsized":"2023-10-25T16:13:09.478959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:45.413465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480470+0000","last_change":"2023-10-25T16:13:06.594182+0000","last_active":"2023-10-25T16:13:09.480470+0000","last_peered":"2023-10-25T16:13:09.480470+0000","last_clean":"2023-10-25T16:13:09.480470+0000","last_became_active":"2023-10-25T16:13:06.592991+0000","last_became_peered":"2023-10-25T16:13:06.592991+0000","last_unstale":"2023-10-25T16:13:09.480470+0000","last_undegraded":"2023-10-25T16:13:09.480470+0000","last_fullsized":"2023-10-25T16:13:09.480470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:34:18.561531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.480226+0000","last_change":"2023-10-25T16:13:07.564149+0000","last_active":"2023-10-25T16:13:09.480226+0000","last_peered":"2023-10-25T16:13:09.480226+0000","last_clean":"2023-10-25T16:13:09.480226+0000","last_became_active":"2023-10-25T16:13:07.561630+0000","last_became_peered":"2023-10-25T16:13:07.561630+0000","last_unstale":"2023-10-25T16:13:09.480226+0000","last_undegraded":"2023-10-25T16:13:09.480226+0000","last_fullsized":"2023-10-25T16:13:09.480226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:06.555563+0000","last_clean_scrub_stamp":"2023-10-25T16:13:06.555563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:22.842602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T16:13:09.479489+0000","last_change":"2023-10-25T16:13:06.603850+0000","last_active":"2023-10-25T16:13:09.479489+0000","last_peered":"2023-10-25T16:13:09.479489+0000","last_clean":"2023-10-25T16:13:09.479489+0000","last_became_active":"2023-10-25T16:13:06.603106+0000","last_became_peered":"2023-10-25T16:13:06.603106+0000","last_unstale":"2023-10-25T16:13:09.479489+0000","last_undegraded":"2023-10-25T16:13:09.479489+0000","last_fullsized":"2023-10-25T16:13:09.479489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:13:05.545075+0000","last_clean_scrub_stamp":"2023-10-25T16:13:05.545075+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:04:16.379156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924855,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199333905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195239,"statfs":{"total":200000000,"available":199924765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924729,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199923243,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924695,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333849,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]}],"pool_statfs":[]}} 2023-10-25T16:13:19.828 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-25T16:13:19.828 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-25T16:13:19.828 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-25T16:13:19.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-25T16:13:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 -- 172.21.15.177:0/2502916121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f672415bdb0 msgr2=0x7f67240aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 --2- 172.21.15.177:0/2502916121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f672415bdb0 0x7f67240aebc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67240cdef0 tx=0x7f671801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 -- 172.21.15.177:0/2502916121 shutdown_connections 2023-10-25T16:13:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 --2- 172.21.15.177:0/2502916121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67240af100 0x7f6724158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 --2- 172.21.15.177:0/2502916121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f672415bdb0 0x7f67240aebc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 --2- 172.21.15.177:0/2502916121 >> v2:172.21.15.184:3300/0 conn(0x7f672414e810 0x7f67240cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 -- 172.21.15.177:0/2502916121 >> 172.21.15.177:0/2502916121 conn(0x7f67240b2450 msgr2=0x7f67240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 -- 172.21.15.177:0/2502916121 shutdown_connections 2023-10-25T16:13:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 -- 172.21.15.177:0/2502916121 wait complete. 2023-10-25T16:13:19.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.982+0000 7f6729a7d640 1 Processor -- start 2023-10-25T16:13:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- start start 2023-10-25T16:13:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 0x7f672413b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f672414e810 0x7f67240adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f672415bdb0 0x7f67240ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672413c370 con 0x7f67240af100 2023-10-25T16:13:19.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724160670 con 0x7f672415bdb0 2023-10-25T16:13:19.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67240a67f0 con 0x7f672414e810 2023-10-25T16:13:19.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 0x7f672413b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 0x7f672413b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43906/0 (socket says 172.21.15.177:43906) 2023-10-25T16:13:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 -- 172.21.15.177:0/3701594429 learned_addr learned my addr 172.21.15.177:0/3701594429 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6722ffd640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f672414e810 0x7f67240adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6723fff640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f672415bdb0 0x7f67240ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 -- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f672414e810 msgr2=0x7f67240adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f672414e810 0x7f67240adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 -- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f672415bdb0 msgr2=0x7f67240ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f672415bdb0 0x7f67240ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 -- 172.21.15.177:0/3701594429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009500 con 0x7f67240af100 2023-10-25T16:13:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6723fff640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f672415bdb0 0x7f67240ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f67237fe640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 0x7f672413b7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f671400ccb0 tx=0x7f671400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714004b30 con 0x7f67240af100 2023-10-25T16:13:19.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6714004da0 con 0x7f67240af100 2023-10-25T16:13:19.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714005280 con 0x7f67240af100 2023-10-25T16:13:19.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724160020 con 0x7f67240af100 2023-10-25T16:13:19.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67240a64a0 con 0x7f67240af100 2023-10-25T16:13:19.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672415fe50 con 0x7f67240af100 2023-10-25T16:13:19.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f67140053e0 con 0x7f67240af100 2023-10-25T16:13:19.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f670bfff640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67100664a0 0x7f6710068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67140846f0 con 0x7f67240af100 2023-10-25T16:13:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.986+0000 7f6722ffd640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67100664a0 0x7f6710068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.990+0000 7f6722ffd640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67100664a0 0x7f6710068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67180ae000 tx=0x7f671801b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:19.990+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6714051b70 con 0x7f67240af100 2023-10-25T16:13:20.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.162+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f672404daf0 con 0x7f67240af100 2023-10-25T16:13:20.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.162+0000 7f670bfff640 1 -- 172.21.15.177:0/3701594429 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f671401d080 con 0x7f67240af100 2023-10-25T16:13:20.170 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:20.170 INFO:teuthology.orchestra.run.smithi177.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-25T16:13:20.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67100664a0 msgr2=0x7f6710068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67100664a0 0x7f6710068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67180ae000 tx=0x7f671801b030 comp rx=0 tx=0).stop 2023-10-25T16:13:20.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 msgr2=0x7f672413b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 0x7f672413b7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f671400ccb0 tx=0x7f671400a620 comp rx=0 tx=0).stop 2023-10-25T16:13:20.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 shutdown_connections 2023-10-25T16:13:20.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67100664a0 0x7f6710068960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f672415bdb0 0x7f67240ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f672414e810 0x7f67240adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 --2- 172.21.15.177:0/3701594429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67240af100 0x7f672413b7f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 >> 172.21.15.177:0/3701594429 conn(0x7f67240b2450 msgr2=0x7f67240b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:20.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 shutdown_connections 2023-10-25T16:13:20.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.166+0000 7f6729a7d640 1 -- 172.21.15.177:0/3701594429 wait complete. 2023-10-25T16:13:20.187 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-25T16:13:20.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:20.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 -- 172.21.15.177:0/1132871260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 msgr2=0x7fb8540af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 --2- 172.21.15.177:0/1132871260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb8540af5d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb848009840 tx=0x7fb84801c710 comp rx=0 tx=0).stop 2023-10-25T16:13:20.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 -- 172.21.15.177:0/1132871260 shutdown_connections 2023-10-25T16:13:20.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 --2- 172.21.15.177:0/1132871260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb8540af5d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 -- 172.21.15.177:0/1132871260 >> 172.21.15.177:0/1132871260 conn(0x7fb8540b2450 msgr2=0x7fb8540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:20.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 -- 172.21.15.177:0/1132871260 shutdown_connections 2023-10-25T16:13:20.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.298+0000 7fb85a26c640 1 -- 172.21.15.177:0/1132871260 wait complete. 2023-10-25T16:13:20.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 Processor -- start 2023-10-25T16:13:20.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- start start 2023-10-25T16:13:20.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb854157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85406f570 0x7fb854135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb854140cf0 0x7fb854135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85413ddb0 con 0x7fb85406c160 2023-10-25T16:13:20.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85413d1c0 con 0x7fb854140cf0 2023-10-25T16:13:20.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85413d410 con 0x7fb85406f570 2023-10-25T16:13:20.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb854157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb854157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43920/0 (socket says 172.21.15.177:43920) 2023-10-25T16:13:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 -- 172.21.15.177:0/2375406216 learned_addr learned my addr 172.21.15.177:0/2375406216 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb8537fe640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85406f570 0x7fb854135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb858809640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb854140cf0 0x7fb854135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 -- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85406f570 msgr2=0x7fb854135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85406f570 0x7fb854135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 -- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb854140cf0 msgr2=0x7fb854135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb854140cf0 0x7fb854135fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 -- 172.21.15.177:0/2375406216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009450 con 0x7fb85406c160 2023-10-25T16:13:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb8537fe640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85406f570 0x7fb854135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb853fff640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb854157d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb84400b3e0 tx=0x7fb84400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:20.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844011830 con 0x7fb85406c160 2023-10-25T16:13:20.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb844011aa0 con 0x7fb85406c160 2023-10-25T16:13:20.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85413d6f0 con 0x7fb85406c160 2023-10-25T16:13:20.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844010380 con 0x7fb85406c160 2023-10-25T16:13:20.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb854140050 con 0x7fb85406c160 2023-10-25T16:13:20.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85404daf0 con 0x7fb85406c160 2023-10-25T16:13:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.302+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8440104e0 con 0x7fb85406c160 2023-10-25T16:13:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.306+0000 7fb850ff9640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb840066470 0x7fb840068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.306+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8440841c0 con 0x7fb85406c160 2023-10-25T16:13:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.306+0000 7fb8537fe640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb840066470 0x7fb840068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.306+0000 7fb8537fe640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb840066470 0x7fb840068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ae000 tx=0x7fb84801af50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:20.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.310+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8440516d0 con 0x7fb85406c160 2023-10-25T16:13:20.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.450+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8541582d0 con 0x7fb85406c160 2023-10-25T16:13:20.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb850ff9640 1 -- 172.21.15.177:0/2375406216 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fb844054cf0 con 0x7fb85406c160 2023-10-25T16:13:20.458 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:20.458 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb840066470 msgr2=0x7fb840068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb840066470 0x7fb840068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ae000 tx=0x7fb84801af50 comp rx=0 tx=0).stop 2023-10-25T16:13:20.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 msgr2=0x7fb854157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb854157d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb84400b3e0 tx=0x7fb84400b8a0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 shutdown_connections 2023-10-25T16:13:20.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb840066470 0x7fb840068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb854140cf0 0x7fb854135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb85406f570 0x7fb854135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 --2- 172.21.15.177:0/2375406216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85406c160 0x7fb854157d30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 >> 172.21.15.177:0/2375406216 conn(0x7fb8540b2450 msgr2=0x7fb8540ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 shutdown_connections 2023-10-25T16:13:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.454+0000 7fb85a26c640 1 -- 172.21.15.177:0/2375406216 wait complete. 2023-10-25T16:13:20.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:20.477 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:20.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/1317110045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c9060 msgr2=0x7f50e40c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- 172.21.15.177:0/1317110045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c9060 0x7f50e40c9440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50e409c0d0 tx=0x7f50e001c7e0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/1317110045 shutdown_connections 2023-10-25T16:13:20.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- 172.21.15.177:0/1317110045 >> v2:172.21.15.184:3300/0 conn(0x7f50e40c8980 0x7f50e415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- 172.21.15.177:0/1317110045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50e40c16c0 0x7f50e415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- 172.21.15.177:0/1317110045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c9060 0x7f50e40c9440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/1317110045 >> 172.21.15.177:0/1317110045 conn(0x7f50e40afaa0 msgr2=0x7f50e40afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:20.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/1317110045 shutdown_connections 2023-10-25T16:13:20.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/1317110045 wait complete. 2023-10-25T16:13:20.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 Processor -- start 2023-10-25T16:13:20.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- start start 2023-10-25T16:13:20.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 0x7f50e40aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50e40c8980 0x7f50e40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50e40c9060 0x7f50e40ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e4163830 con 0x7f50e40c16c0 2023-10-25T16:13:20.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40aad10 con 0x7f50e40c8980 2023-10-25T16:13:20.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40c68d0 con 0x7f50e40c9060 2023-10-25T16:13:20.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 0x7f50e40aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 0x7f50e40aa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54162/0 (socket says 172.21.15.177:54162) 2023-10-25T16:13:20.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 -- 172.21.15.177:0/3963963748 learned_addr learned my addr 172.21.15.177:0/3963963748 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:20.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ea7b6640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50e40c9060 0x7f50e40ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e97b4640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50e40c8980 0x7f50e40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 -- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50e40c9060 msgr2=0x7f50e40ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50e40c9060 0x7f50e40ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 -- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50e40c8980 msgr2=0x7f50e40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50e40c8980 0x7f50e40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 -- 172.21.15.177:0/3963963748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0009560 con 0x7f50e40c16c0 2023-10-25T16:13:20.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50e9fb5640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 0x7f50e40aa7d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50e001ccc0 tx=0x7f50e00a6590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:20.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0004230 con 0x7f50e40c16c0 2023-10-25T16:13:20.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50e0004480 con 0x7f50e40c16c0 2023-10-25T16:13:20.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e4163a80 con 0x7f50e40c16c0 2023-10-25T16:13:20.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00052d0 con 0x7f50e40c16c0 2023-10-25T16:13:20.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.594+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e4164040 con 0x7f50e40c16c0 2023-10-25T16:13:20.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.598+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e4066b20 con 0x7f50e40c16c0 2023-10-25T16:13:20.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.598+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50e0005430 con 0x7f50e40c16c0 2023-10-25T16:13:20.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.598+0000 7f50da7fc640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50c8066470 0x7f50c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.598+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50e011e150 con 0x7f50e40c16c0 2023-10-25T16:13:20.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.598+0000 7f50e97b4640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50c8066470 0x7f50c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.598+0000 7f50e97b4640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50c8066470 0x7f50c8068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50e40b3d00 tx=0x7f50d40091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:20.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.602+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50e00eb660 con 0x7f50e40c16c0 2023-10-25T16:13:20.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.746+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50e406c3c0 con 0x7f50e40c16c0 2023-10-25T16:13:20.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.746+0000 7f50da7fc640 1 -- 172.21.15.177:0/3963963748 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50e00eec80 con 0x7f50e40c16c0 2023-10-25T16:13:20.754 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:20.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50c8066470 msgr2=0x7f50c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50c8066470 0x7f50c8068930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50e40b3d00 tx=0x7f50d40091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 msgr2=0x7f50e40aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 0x7f50e40aa7d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50e001ccc0 tx=0x7f50e00a6590 comp rx=0 tx=0).stop 2023-10-25T16:13:20.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 shutdown_connections 2023-10-25T16:13:20.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50c8066470 0x7f50c8068930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50e40c9060 0x7f50e40ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50e40c8980 0x7f50e40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 --2- 172.21.15.177:0/3963963748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e40c16c0 0x7f50e40aa7d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 >> 172.21.15.177:0/3963963748 conn(0x7f50e40afaa0 msgr2=0x7f50e409ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 shutdown_connections 2023-10-25T16:13:20.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.750+0000 7f50ec219640 1 -- 172.21.15.177:0/3963963748 wait complete. 2023-10-25T16:13:20.770 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 -- 172.21.15.177:0/1058642086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81015eba0 msgr2=0x7fd8100b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1058642086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81015eba0 0x7fd8100b4100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd800009900 tx=0x7fd80001c830 comp rx=0 tx=0).stop 2023-10-25T16:13:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 -- 172.21.15.177:0/1058642086 shutdown_connections 2023-10-25T16:13:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1058642086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8100b2120 0x7fd8100d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1058642086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd81015eba0 0x7fd8100b4100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 -- 172.21.15.177:0/1058642086 >> 172.21.15.177:0/1058642086 conn(0x7fd81009a5c0 msgr2=0x7fd8100d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 -- 172.21.15.177:0/1058642086 shutdown_connections 2023-10-25T16:13:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 -- 172.21.15.177:0/1058642086 wait complete. 2023-10-25T16:13:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 Processor -- start 2023-10-25T16:13:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.882+0000 7fd816b5f640 1 -- start start 2023-10-25T16:13:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 0x7fd8100c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8100cdb10 0x7fd810159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd81015eba0 0x7fd81015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c56a0 con 0x7fd8100b2120 2023-10-25T16:13:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c8a80 con 0x7fd81015eba0 2023-10-25T16:13:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c8d60 con 0x7fd8100cdb10 2023-10-25T16:13:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 0x7fd8100c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 0x7fd8100c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54188/0 (socket says 172.21.15.177:54188) 2023-10-25T16:13:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 -- 172.21.15.177:0/1986849413 learned_addr learned my addr 172.21.15.177:0/1986849413 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80ffff640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8100cdb10 0x7fd810159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 -- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8100cdb10 msgr2=0x7fd810159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8100cdb10 0x7fd810159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 -- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd81015eba0 msgr2=0x7fd81015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8150fc640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd81015eba0 0x7fd81015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd81015eba0 0x7fd81015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:20.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 -- 172.21.15.177:0/1986849413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009560 con 0x7fd8100b2120 2023-10-25T16:13:20.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd8148fb640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 0x7fd8100c8380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd800009850 tx=0x7fd8000a66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:20.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000042c0 con 0x7fd8100b2120 2023-10-25T16:13:20.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd800004510 con 0x7fd8100b2120 2023-10-25T16:13:20.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800005260 con 0x7fd8100b2120 2023-10-25T16:13:20.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8100c9040 con 0x7fd8100b2120 2023-10-25T16:13:20.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81015a7d0 con 0x7fd8100b2120 2023-10-25T16:13:20.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81004daf0 con 0x7fd8100b2120 2023-10-25T16:13:20.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8000053c0 con 0x7fd8100b2120 2023-10-25T16:13:20.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80d7fa640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7fc066470 0x7fd7fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:20.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8000aa070 con 0x7fd8100b2120 2023-10-25T16:13:20.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80ffff640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7fc066470 0x7fd7fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:20.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.886+0000 7fd80ffff640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7fc066470 0x7fd7fc068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8040058d0 tx=0x7fd804005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:20.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:20.890+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8000eba00 con 0x7fd8100b2120 2023-10-25T16:13:21.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.030+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd81015ade0 con 0x7fd8100b2120 2023-10-25T16:13:21.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.030+0000 7fd80d7fa640 1 -- 172.21.15.177:0/1986849413 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8000ef020 con 0x7fd8100b2120 2023-10-25T16:13:21.037 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:21.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7fc066470 msgr2=0x7fd7fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7fc066470 0x7fd7fc068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd8040058d0 tx=0x7fd804005860 comp rx=0 tx=0).stop 2023-10-25T16:13:21.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 msgr2=0x7fd8100c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 0x7fd8100c8380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd800009850 tx=0x7fd8000a66e0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 shutdown_connections 2023-10-25T16:13:21.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7fc066470 0x7fd7fc068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd81015eba0 0x7fd81015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8100cdb10 0x7fd810159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 --2- 172.21.15.177:0/1986849413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8100b2120 0x7fd8100c8380 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 >> 172.21.15.177:0/1986849413 conn(0x7fd81009a5c0 msgr2=0x7fd8100b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 shutdown_connections 2023-10-25T16:13:21.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.034+0000 7fd816b5f640 1 -- 172.21.15.177:0/1986849413 wait complete. 2023-10-25T16:13:21.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:21.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.178+0000 7f3b3d176640 1 -- 172.21.15.177:0/1761734856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3813d8f0 msgr2=0x7f3b380af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.178+0000 7f3b3d176640 1 --2- 172.21.15.177:0/1761734856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3813d8f0 0x7f3b380af5d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009920 tx=0x7f3b2c01c820 comp rx=0 tx=0).stop 2023-10-25T16:13:21.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.178+0000 7f3b3d176640 1 -- 172.21.15.177:0/1761734856 shutdown_connections 2023-10-25T16:13:21.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.178+0000 7f3b3d176640 1 --2- 172.21.15.177:0/1761734856 >> v2:172.21.15.184:3300/0 conn(0x7f3b3815c3a0 0x7f3b3815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.178+0000 7f3b3d176640 1 --2- 172.21.15.177:0/1761734856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3813d8f0 0x7f3b380af5d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- 172.21.15.177:0/1761734856 >> 172.21.15.177:0/1761734856 conn(0x7f3b380b2450 msgr2=0x7f3b380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- 172.21.15.177:0/1761734856 shutdown_connections 2023-10-25T16:13:21.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- 172.21.15.177:0/1761734856 wait complete. 2023-10-25T16:13:21.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 Processor -- start 2023-10-25T16:13:21.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- start start 2023-10-25T16:13:21.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b3813d8f0 0x7f3b38152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3815b710 0x7f3b3813c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 0x7f3b3813c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38156f20 con 0x7f3b3815c3a0 2023-10-25T16:13:21.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38154c90 con 0x7f3b3815b710 2023-10-25T16:13:21.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b38154f70 con 0x7f3b3813d8f0 2023-10-25T16:13:21.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 0x7f3b3813c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 0x7f3b3813c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54216/0 (socket says 172.21.15.177:54216) 2023-10-25T16:13:21.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 -- 172.21.15.177:0/2578834119 learned_addr learned my addr 172.21.15.177:0/2578834119 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:21.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3659c640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3815b710 0x7f3b3813c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b36d9d640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b3813d8f0 0x7f3b38152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 -- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b3813d8f0 msgr2=0x7f3b38152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b3813d8f0 0x7f3b38152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 -- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3815b710 msgr2=0x7f3b3813c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3815b710 0x7f3b3813c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 -- 172.21.15.177:0/2578834119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009500 con 0x7f3b3815c3a0 2023-10-25T16:13:21.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3659c640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3815b710 0x7f3b3813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:21.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3759e640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 0x7f3b3813c990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b970 tx=0x7f3b3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:21.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000cb40 con 0x7f3b3815c3a0 2023-10-25T16:13:21.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b3000cdb0 con 0x7f3b3815c3a0 2023-10-25T16:13:21.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b38155250 con 0x7f3b3815c3a0 2023-10-25T16:13:21.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300146a0 con 0x7f3b3815c3a0 2023-10-25T16:13:21.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.182+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38153ee0 con 0x7f3b3815c3a0 2023-10-25T16:13:21.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.186+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3804daf0 con 0x7f3b3815c3a0 2023-10-25T16:13:21.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.186+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3b3001d3b0 con 0x7f3b3815c3a0 2023-10-25T16:13:21.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.186+0000 7f3b1f7fe640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3b24066470 0x7f3b24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.186+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b30084090 con 0x7f3b3815c3a0 2023-10-25T16:13:21.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.186+0000 7f3b36d9d640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3b24066470 0x7f3b24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.186+0000 7f3b36d9d640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3b24066470 0x7f3b24068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b280016c0 tx=0x7f3b28009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:21.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.190+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3b30051510 con 0x7f3b3815c3a0 2023-10-25T16:13:21.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.338+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b38157060 con 0x7f3b3815c3a0 2023-10-25T16:13:21.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b1f7fe640 1 -- 172.21.15.177:0/2578834119 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b300190a0 con 0x7f3b3815c3a0 2023-10-25T16:13:21.346 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:21.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3b24066470 msgr2=0x7f3b24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3b24066470 0x7f3b24068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b280016c0 tx=0x7f3b28009040 comp rx=0 tx=0).stop 2023-10-25T16:13:21.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 msgr2=0x7f3b3813c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 0x7f3b3813c990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000b970 tx=0x7f3b3000be30 comp rx=0 tx=0).stop 2023-10-25T16:13:21.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 shutdown_connections 2023-10-25T16:13:21.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3b24066470 0x7f3b24068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b3815c3a0 0x7f3b3813c990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b3815b710 0x7f3b3813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 --2- 172.21.15.177:0/2578834119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b3813d8f0 0x7f3b38152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 >> 172.21.15.177:0/2578834119 conn(0x7f3b380b2450 msgr2=0x7f3b38070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 shutdown_connections 2023-10-25T16:13:21.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.342+0000 7f3b3d176640 1 -- 172.21.15.177:0/2578834119 wait complete. 2023-10-25T16:13:21.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:21.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/1079699712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10880cc060 msgr2=0x7f10880cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 --2- 172.21.15.177:0/1079699712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10880cc060 0x7f10880cc440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1078009840 tx=0x7f107801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/1079699712 shutdown_connections 2023-10-25T16:13:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 --2- 172.21.15.177:0/1079699712 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10880cc060 0x7f10880cc440 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/1079699712 >> 172.21.15.177:0/1079699712 conn(0x7f10880b3670 msgr2=0x7f10880b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/1079699712 shutdown_connections 2023-10-25T16:13:21.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/1079699712 wait complete. 2023-10-25T16:13:21.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 Processor -- start 2023-10-25T16:13:21.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- start start 2023-10-25T16:13:21.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10880cc060 0x7f108806a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1088141d60 0x7f1088137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 0x7f10880c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1088138830 con 0x7f108815bdb0 2023-10-25T16:13:21.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1088137c20 con 0x7f10880cc060 2023-10-25T16:13:21.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1088137f00 con 0x7f1088141d60 2023-10-25T16:13:21.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 0x7f10880c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 0x7f10880c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54232/0 (socket says 172.21.15.177:54232) 2023-10-25T16:13:21.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 -- 172.21.15.177:0/2584692777 learned_addr learned my addr 172.21.15.177:0/2584692777 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:21.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f1086ffd640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10880cc060 0x7f108806a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f107e7fc640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1088141d60 0x7f1088137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 -- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1088141d60 msgr2=0x7f1088137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1088141d60 0x7f1088137560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 -- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10880cc060 msgr2=0x7f108806a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10880cc060 0x7f108806a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 -- 172.21.15.177:0/2584692777 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10780094a0 con 0x7f108815bdb0 2023-10-25T16:13:21.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f1086ffd640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10880cc060 0x7f108806a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:21.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f10877fe640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 0x7f10880c98e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f108000cac0 tx=0x7f108000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:21.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000a850 con 0x7f108815bdb0 2023-10-25T16:13:21.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f108000aaa0 con 0x7f108815bdb0 2023-10-25T16:13:21.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10881381e0 con 0x7f108815bdb0 2023-10-25T16:13:21.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080012420 con 0x7f108815bdb0 2023-10-25T16:13:21.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.482+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10880c9e20 con 0x7f108815bdb0 2023-10-25T16:13:21.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.486+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10881389a0 con 0x7f108815bdb0 2023-10-25T16:13:21.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.486+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f108001a3b0 con 0x7f108815bdb0 2023-10-25T16:13:21.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.486+0000 7f1084ff9640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1068066470 0x7f1068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.486+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1080084160 con 0x7f108815bdb0 2023-10-25T16:13:21.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.486+0000 7f1086ffd640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1068066470 0x7f1068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.486+0000 7f1086ffd640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1068066470 0x7f1068068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10780af000 tx=0x7f107801b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:21.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.490+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1080051560 con 0x7f108815bdb0 2023-10-25T16:13:21.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.670+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f108815a960 con 0x7f108815bdb0 2023-10-25T16:13:21.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.674+0000 7f1084ff9640 1 -- 172.21.15.177:0/2584692777 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f108815a960 con 0x7f108815bdb0 2023-10-25T16:13:21.681 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:21.681 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:21.682 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:21.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1068066470 msgr2=0x7f1068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1068066470 0x7f1068068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10780af000 tx=0x7f107801b010 comp rx=0 tx=0).stop 2023-10-25T16:13:21.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 msgr2=0x7f10880c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 0x7f10880c98e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f108000cac0 tx=0x7f108000cbb0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 shutdown_connections 2023-10-25T16:13:21.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1068066470 0x7f1068068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f108815bdb0 0x7f10880c98e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1088141d60 0x7f1088137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 --2- 172.21.15.177:0/2584692777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10880cc060 0x7f108806a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 >> 172.21.15.177:0/2584692777 conn(0x7f10880b3670 msgr2=0x7f10880ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 shutdown_connections 2023-10-25T16:13:21.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.678+0000 7f108da12640 1 -- 172.21.15.177:0/2584692777 wait complete. 2023-10-25T16:13:21.699 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/1751371114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 msgr2=0x7f6ea40cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/1751371114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea40cdfc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ea406a0e0 tx=0x7f6e9c01ccd0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/1751371114 shutdown_connections 2023-10-25T16:13:21.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/1751371114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea40cdfc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/1751371114 >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b2120 0x7f6ea40d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/1751371114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea415eba0 0x7f6ea40b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/1751371114 >> 172.21.15.177:0/1751371114 conn(0x7f6ea409a5c0 msgr2=0x7f6ea40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/1751371114 shutdown_connections 2023-10-25T16:13:21.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/1751371114 wait complete. 2023-10-25T16:13:21.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 Processor -- start 2023-10-25T16:13:21.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- start start 2023-10-25T16:13:21.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea40b2120 0x7f6ea415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea4156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea415eba0 0x7f6ea40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea40c80b0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea415b5b0 con 0x7f6ea40b2120 2023-10-25T16:13:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea415bdf0 con 0x7f6ea415eba0 2023-10-25T16:13:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea4156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea4156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54254/0 (socket says 172.21.15.177:54254) 2023-10-25T16:13:21.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 -- 172.21.15.177:0/3201794124 learned_addr learned my addr 172.21.15.177:0/3201794124 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea259c640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea40b2120 0x7f6ea415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea2d9d640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea415eba0 0x7f6ea40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 -- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea415eba0 msgr2=0x7f6ea40ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea415eba0 0x7f6ea40ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 -- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea40b2120 msgr2=0x7f6ea415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea40b2120 0x7f6ea415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 -- 172.21.15.177:0/3201794124 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0098e0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e99d9b640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea4156f30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00b550 tx=0x7f6e8c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c010870 con 0x7f6ea40cdb10 2023-10-25T16:13:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e8c010ae0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00f3c0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea415c0d0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea40c5020 con 0x7f6ea40cdb10 2023-10-25T16:13:21.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.818+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea40c5240 con 0x7f6ea40cdb10 2023-10-25T16:13:21.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.822+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e8c00f520 con 0x7f6ea40cdb10 2023-10-25T16:13:21.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.822+0000 7f6e9b7fe640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e84066470 0x7f6e84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:21.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.822+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e8c0841f0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.822+0000 7f6ea259c640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e84066470 0x7f6e84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:21.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.822+0000 7f6ea259c640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e84066470 0x7f6e84068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e940058d0 tx=0x7f6e94005d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:21.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.826+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e8c0515e0 con 0x7f6ea40cdb10 2023-10-25T16:13:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.982+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ea415c470 con 0x7f6ea40cdb10 2023-10-25T16:13:21.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.982+0000 7f6e9b7fe640 1 -- 172.21.15.177:0/3201794124 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f6e8c054c00 con 0x7f6ea40cdb10 2023-10-25T16:13:21.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:21.990 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:21.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e84066470 msgr2=0x7f6e84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e84066470 0x7f6e84068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e940058d0 tx=0x7f6e94005d90 comp rx=0 tx=0).stop 2023-10-25T16:13:21.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 msgr2=0x7f6ea4156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:21.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea4156f30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00b550 tx=0x7f6e8c00ba10 comp rx=0 tx=0).stop 2023-10-25T16:13:21.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 shutdown_connections 2023-10-25T16:13:21.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e84066470 0x7f6e84068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea415eba0 0x7f6ea40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ea40cdb10 0x7f6ea4156f30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 --2- 172.21.15.177:0/3201794124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea40b2120 0x7f6ea415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:21.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 >> 172.21.15.177:0/3201794124 conn(0x7f6ea409a5c0 msgr2=0x7f6ea40b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:21.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 shutdown_connections 2023-10-25T16:13:21.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:21.986+0000 7f6ea8a60640 1 -- 172.21.15.177:0/3201794124 wait complete. 2023-10-25T16:13:22.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:22.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:22.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- 172.21.15.177:0/2225547144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 msgr2=0x7f4754003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 --2- 172.21.15.177:0/2225547144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f4754003da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4764009b60 tx=0x7f476401d250 comp rx=0 tx=0).stop 2023-10-25T16:13:22.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- 172.21.15.177:0/2225547144 shutdown_connections 2023-10-25T16:13:22.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 --2- 172.21.15.177:0/2225547144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f4754003da0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- 172.21.15.177:0/2225547144 >> 172.21.15.177:0/2225547144 conn(0x7f476c0b2450 msgr2=0x7f476c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:22.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- 172.21.15.177:0/2225547144 shutdown_connections 2023-10-25T16:13:22.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- 172.21.15.177:0/2225547144 wait complete. 2023-10-25T16:13:22.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 Processor -- start 2023-10-25T16:13:22.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- start start 2023-10-25T16:13:22.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f476c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f476c0cc8c0 0x7f476c1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f476c0acba0 0x7f476c0ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c0ad560 con 0x7f4754003980 2023-10-25T16:13:22.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c14f4b0 con 0x7f476c0acba0 2023-10-25T16:13:22.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4770eae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c14f790 con 0x7f476c0cc8c0 2023-10-25T16:13:22.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f476c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f476c14eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54262/0 (socket says 172.21.15.177:54262) 2023-10-25T16:13:22.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 -- 172.21.15.177:0/3297547135 learned_addr learned my addr 172.21.15.177:0/3297547135 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:22.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476ad9d640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f476c0acba0 0x7f476c0ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f4769d9b640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f476c0cc8c0 0x7f476c1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 -- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f476c0cc8c0 msgr2=0x7f476c1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f476c0cc8c0 0x7f476c1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 -- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f476c0acba0 msgr2=0x7f476c0ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f476c0acba0 0x7f476c0ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.134+0000 7f476a59c640 1 -- 172.21.15.177:0/3297547135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c1535f0 con 0x7f4754003980 2023-10-25T16:13:22.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f476a59c640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f476c14eed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f476401d080 tx=0x7f4764005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:22.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764004220 con 0x7f4754003980 2023-10-25T16:13:22.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4764004470 con 0x7f4754003980 2023-10-25T16:13:22.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c1538d0 con 0x7f4754003980 2023-10-25T16:13:22.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640049f0 con 0x7f4754003980 2023-10-25T16:13:22.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c0ccd40 con 0x7f4754003980 2023-10-25T16:13:22.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c04daf0 con 0x7f4754003980 2023-10-25T16:13:22.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f47640b3070 con 0x7f4754003980 2023-10-25T16:13:22.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f475affd640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f474c066470 0x7f474c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f476411f210 con 0x7f4754003980 2023-10-25T16:13:22.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.138+0000 7f4769d9b640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f474c066470 0x7f474c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.142+0000 7f4769d9b640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f474c066470 0x7f474c068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f476c1558a0 tx=0x7f4760000f50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:22.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.142+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f47640ec800 con 0x7f4754003980 2023-10-25T16:13:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.298+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f476c14f8d0 con 0x7f4754003980 2023-10-25T16:13:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.298+0000 7f475affd640 1 -- 172.21.15.177:0/3297547135 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f476c14f8d0 con 0x7f4754003980 2023-10-25T16:13:22.304 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:22.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f474c066470 msgr2=0x7f474c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f474c066470 0x7f474c068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f476c1558a0 tx=0x7f4760000f50 comp rx=0 tx=0).stop 2023-10-25T16:13:22.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 msgr2=0x7f476c14eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f476c14eed0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f476401d080 tx=0x7f4764005520 comp rx=0 tx=0).stop 2023-10-25T16:13:22.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 shutdown_connections 2023-10-25T16:13:22.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f474c066470 0x7f474c068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f476c0acba0 0x7f476c0ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f476c0cc8c0 0x7f476c1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 --2- 172.21.15.177:0/3297547135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4754003980 0x7f476c14eed0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 >> 172.21.15.177:0/3297547135 conn(0x7f476c0b2450 msgr2=0x7f476c1564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:22.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 shutdown_connections 2023-10-25T16:13:22.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.302+0000 7f4770eae640 1 -- 172.21.15.177:0/3297547135 wait complete. 2023-10-25T16:13:22.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:22.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/185411325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa9815b710 msgr2=0x7ffa9813d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/185411325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa9815b710 0x7ffa9813d8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009bf0 tx=0x7ffa8801cb50 comp rx=0 tx=0).stop 2023-10-25T16:13:22.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/185411325 shutdown_connections 2023-10-25T16:13:22.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/185411325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa980af5d0 0x7ffa9813b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/185411325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa9815b710 0x7ffa9813d8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/185411325 >> 172.21.15.177:0/185411325 conn(0x7ffa980b2450 msgr2=0x7ffa980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:22.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/185411325 shutdown_connections 2023-10-25T16:13:22.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/185411325 wait complete. 2023-10-25T16:13:22.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 Processor -- start 2023-10-25T16:13:22.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- start start 2023-10-25T16:13:22.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 0x7ffa9813f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa9813bda0 0x7ffa980aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa980cc640 0x7ffa980aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98140210 con 0x7ffa980af5d0 2023-10-25T16:13:22.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980ccad0 con 0x7ffa980cc640 2023-10-25T16:13:22.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9e2a8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa981404b0 con 0x7ffa9813bda0 2023-10-25T16:13:22.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 0x7ffa9813f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 0x7ffa9813f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54286/0 (socket says 172.21.15.177:54286) 2023-10-25T16:13:22.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 -- 172.21.15.177:0/447914501 learned_addr learned my addr 172.21.15.177:0/447914501 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:22.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa977fe640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa9813bda0 0x7ffa980aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 -- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa9813bda0 msgr2=0x7ffa980aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9c845640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa980cc640 0x7ffa980aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa9813bda0 0x7ffa980aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 -- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa980cc640 msgr2=0x7ffa980aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa980cc640 0x7ffa980aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 -- 172.21.15.177:0/447914501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009820 con 0x7ffa980af5d0 2023-10-25T16:13:22.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa9c845640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa980cc640 0x7ffa980aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:22.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa97fff640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 0x7ffa9813f760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffa88000f90 tx=0x7ffa880a5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:22.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88004c50 con 0x7ffa980af5d0 2023-10-25T16:13:22.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffa88004000 con 0x7ffa980af5d0 2023-10-25T16:13:22.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.446+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88004ea0 con 0x7ffa980af5d0 2023-10-25T16:13:22.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa98140790 con 0x7ffa980af5d0 2023-10-25T16:13:22.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa980ac220 con 0x7ffa980af5d0 2023-10-25T16:13:22.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa98140980 con 0x7ffa980af5d0 2023-10-25T16:13:22.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa880b4040 con 0x7ffa980af5d0 2023-10-25T16:13:22.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa94ff9640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa84066470 0x7ffa84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa8811de30 con 0x7ffa980af5d0 2023-10-25T16:13:22.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa977fe640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa84066470 0x7ffa84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.450+0000 7ffa977fe640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa84066470 0x7ffa84068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa98140c30 tx=0x7ffa8c005c60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:22.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.454+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa880eb2b0 con 0x7ffa980af5d0 2023-10-25T16:13:22.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.598+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa9804daf0 con 0x7ffa980af5d0 2023-10-25T16:13:22.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.598+0000 7ffa94ff9640 1 -- 172.21.15.177:0/447914501 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa880b2020 con 0x7ffa980af5d0 2023-10-25T16:13:22.604 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:22.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa84066470 msgr2=0x7ffa84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa84066470 0x7ffa84068930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffa98140c30 tx=0x7ffa8c005c60 comp rx=0 tx=0).stop 2023-10-25T16:13:22.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 msgr2=0x7ffa9813f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 0x7ffa9813f760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffa88000f90 tx=0x7ffa880a5a40 comp rx=0 tx=0).stop 2023-10-25T16:13:22.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 shutdown_connections 2023-10-25T16:13:22.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa84066470 0x7ffa84068930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa980cc640 0x7ffa980aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa9813bda0 0x7ffa980aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 --2- 172.21.15.177:0/447914501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa980af5d0 0x7ffa9813f760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 >> 172.21.15.177:0/447914501 conn(0x7ffa980b2450 msgr2=0x7ffa9813cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:22.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 shutdown_connections 2023-10-25T16:13:22.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.602+0000 7ffa9e2a8640 1 -- 172.21.15.177:0/447914501 wait complete. 2023-10-25T16:13:22.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:22.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/106276667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd89406b980 msgr2=0x7fd89406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 --2- 172.21.15.177:0/106276667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd89406b980 0x7fd89406be10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009bc0 tx=0x7fd88c01cb50 comp rx=0 tx=0).stop 2023-10-25T16:13:22.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/106276667 shutdown_connections 2023-10-25T16:13:22.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 --2- 172.21.15.177:0/106276667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd89406b980 0x7fd89406be10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 --2- 172.21.15.177:0/106276667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd894071500 0x7fd894070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/106276667 >> 172.21.15.177:0/106276667 conn(0x7fd8940b2450 msgr2=0x7fd8940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:22.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/106276667 shutdown_connections 2023-10-25T16:13:22.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/106276667 wait complete. 2023-10-25T16:13:22.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 Processor -- start 2023-10-25T16:13:22.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- start start 2023-10-25T16:13:22.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89406b980 0x7fd8940aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 0x7fd894149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894159230 0x7fd894149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894154010 con 0x7fd894071500 2023-10-25T16:13:22.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894156090 con 0x7fd894159230 2023-10-25T16:13:22.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940ad390 con 0x7fd89406b980 2023-10-25T16:13:22.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 0x7fd894149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 0x7fd894149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54294/0 (socket says 172.21.15.177:54294) 2023-10-25T16:13:22.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 -- 172.21.15.177:0/3600723045 learned_addr learned my addr 172.21.15.177:0/3600723045 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:22.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd89259c640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89406b980 0x7fd8940aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd892d9d640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894159230 0x7fd894149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 -- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89406b980 msgr2=0x7fd8940aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89406b980 0x7fd8940aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 -- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894159230 msgr2=0x7fd894149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894159230 0x7fd894149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 -- 172.21.15.177:0/3600723045 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009820 con 0x7fd894071500 2023-10-25T16:13:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd892d9d640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894159230 0x7fd894149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd891d9b640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 0x7fd894149540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd88800d950 tx=0x7fd88800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd888009c30 con 0x7fd894071500 2023-10-25T16:13:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd888009e80 con 0x7fd894071500 2023-10-25T16:13:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd894156330 con 0x7fd894071500 2023-10-25T16:13:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880106a0 con 0x7fd894071500 2023-10-25T16:13:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.746+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8940ad670 con 0x7fd894071500 2023-10-25T16:13:22.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.750+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89404daf0 con 0x7fd894071500 2023-10-25T16:13:22.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.750+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd888010800 con 0x7fd894071500 2023-10-25T16:13:22.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.750+0000 7fd882ffd640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8740664a0 0x7fd874068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.750+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd888084340 con 0x7fd894071500 2023-10-25T16:13:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.750+0000 7fd89259c640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8740664a0 0x7fd874068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.750+0000 7fd89259c640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8740664a0 0x7fd874068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8840011f0 tx=0x7fd884009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.754+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd888051850 con 0x7fd894071500 2023-10-25T16:13:22.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.910+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8941506e0 con 0x7fd894071500 2023-10-25T16:13:22.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.910+0000 7fd882ffd640 1 -- 172.21.15.177:0/3600723045 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd888054e70 con 0x7fd894071500 2023-10-25T16:13:22.916 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8740664a0 msgr2=0x7fd874068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8740664a0 0x7fd874068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8840011f0 tx=0x7fd884009040 comp rx=0 tx=0).stop 2023-10-25T16:13:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 msgr2=0x7fd894149540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 0x7fd894149540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd88800d950 tx=0x7fd88800de10 comp rx=0 tx=0).stop 2023-10-25T16:13:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 shutdown_connections 2023-10-25T16:13:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8740664a0 0x7fd874068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894159230 0x7fd894149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd894071500 0x7fd894149540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 --2- 172.21.15.177:0/3600723045 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd89406b980 0x7fd8940aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:22.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 >> 172.21.15.177:0/3600723045 conn(0x7fd8940b2450 msgr2=0x7fd894158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:22.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 shutdown_connections 2023-10-25T16:13:22.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:22.914+0000 7fd8988b9640 1 -- 172.21.15.177:0/3600723045 wait complete. 2023-10-25T16:13:22.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:23.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- 172.21.15.177:0/1505854214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0005190 msgr2=0x7f6ef000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/1505854214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0005190 0x7f6ef000b990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f00006fd0 tx=0x7f6f0001ca00 comp rx=0 tx=0).stop 2023-10-25T16:13:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- 172.21.15.177:0/1505854214 shutdown_connections 2023-10-25T16:13:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/1505854214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ef0005190 0x7f6ef000b990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- 172.21.15.177:0/1505854214 >> 172.21.15.177:0/1505854214 conn(0x7f6f08069d20 msgr2=0x7f6f0806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:23.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- 172.21.15.177:0/1505854214 shutdown_connections 2023-10-25T16:13:23.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- 172.21.15.177:0/1505854214 wait complete. 2023-10-25T16:13:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 Processor -- start 2023-10-25T16:13:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- start start 2023-10-25T16:13:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef0005190 0x7f6f080c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0814d010 0x7f6f080b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 0x7f6f0814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080b0a00 con 0x7f6f080b0580 2023-10-25T16:13:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08152150 con 0x7f6ef0005190 2023-10-25T16:13:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f0e12e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080c7320 con 0x7f6f0814d010 2023-10-25T16:13:23.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 0x7f6f0814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 0x7f6f0814d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54324/0 (socket says 172.21.15.177:54324) 2023-10-25T16:13:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.054+0000 7f6f07fff640 1 -- 172.21.15.177:0/604307372 learned_addr learned my addr 172.21.15.177:0/604307372 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f06ffd640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0814d010 0x7f6f080b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f077fe640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef0005190 0x7f6f080c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f07fff640 1 -- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0814d010 msgr2=0x7f6f080b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f07fff640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0814d010 0x7f6f080b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f07fff640 1 -- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef0005190 msgr2=0x7f6f080c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f07fff640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef0005190 0x7f6f080c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f07fff640 1 -- 172.21.15.177:0/604307372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080c6860 con 0x7f6f080b0580 2023-10-25T16:13:23.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f07fff640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 0x7f6f0814d7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f0001c830 tx=0x7f6f000a5de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004bb0 con 0x7f6f080b0580 2023-10-25T16:13:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f000060d0 con 0x7f6f080b0580 2023-10-25T16:13:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000064a0 con 0x7f6f080b0580 2023-10-25T16:13:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f081523a0 con 0x7f6f080b0580 2023-10-25T16:13:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f080c6fb0 con 0x7f6f080b0580 2023-10-25T16:13:23.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0814f470 con 0x7f6f080b0580 2023-10-25T16:13:23.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6f000b4020 con 0x7f6f080b0580 2023-10-25T16:13:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6eeffff640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ef4066470 0x7f6ef4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f0011dd10 con 0x7f6f080b0580 2023-10-25T16:13:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f077fe640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ef4066470 0x7f6ef4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.058+0000 7f6f077fe640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ef4066470 0x7f6ef4068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800cb90 tx=0x7f6ef8005e90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:23.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.062+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6f0814f470 con 0x7f6f080b0580 2023-10-25T16:13:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.234+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f0804daf0 con 0x7f6f080b0580 2023-10-25T16:13:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.234+0000 7f6eeffff640 1 -- 172.21.15.177:0/604307372 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f6f000bc090 con 0x7f6f080b0580 2023-10-25T16:13:23.240 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:23.240 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ef4066470 msgr2=0x7f6ef4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ef4066470 0x7f6ef4068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800cb90 tx=0x7f6ef8005e90 comp rx=0 tx=0).stop 2023-10-25T16:13:23.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 msgr2=0x7f6f0814d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 0x7f6f0814d7f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f0001c830 tx=0x7f6f000a5de0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 shutdown_connections 2023-10-25T16:13:23.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ef4066470 0x7f6ef4068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f080b0580 0x7f6f0814d7f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0814d010 0x7f6f080b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 --2- 172.21.15.177:0/604307372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ef0005190 0x7f6f080c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 >> 172.21.15.177:0/604307372 conn(0x7f6f08069d20 msgr2=0x7f6f080c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:23.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 shutdown_connections 2023-10-25T16:13:23.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.238+0000 7f6f0e12e640 1 -- 172.21.15.177:0/604307372 wait complete. 2023-10-25T16:13:23.258 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 -- 172.21.15.177:0/920186078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 msgr2=0x7f39680b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 --2- 172.21.15.177:0/920186078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f39680b4100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3964009840 tx=0x7f396401c730 comp rx=0 tx=0).stop 2023-10-25T16:13:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 -- 172.21.15.177:0/920186078 shutdown_connections 2023-10-25T16:13:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 --2- 172.21.15.177:0/920186078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f39680b4100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 -- 172.21.15.177:0/920186078 >> 172.21.15.177:0/920186078 conn(0x7f396809a5c0 msgr2=0x7f39680d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 -- 172.21.15.177:0/920186078 shutdown_connections 2023-10-25T16:13:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.366+0000 7f39704b9640 1 -- 172.21.15.177:0/920186078 wait complete. 2023-10-25T16:13:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 Processor -- start 2023-10-25T16:13:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- start start 2023-10-25T16:13:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39680b2120 0x7f3968155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39680cdb10 0x7f396814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f3968154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968153c70 con 0x7f396815eba0 2023-10-25T16:13:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39681560d0 con 0x7f39680cdb10 2023-10-25T16:13:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3968153340 con 0x7f39680b2120 2023-10-25T16:13:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f3968154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f3968154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54330/0 (socket says 172.21.15.177:54330) 2023-10-25T16:13:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 -- 172.21.15.177:0/759192367 learned_addr learned my addr 172.21.15.177:0/759192367 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 -- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39680b2120 msgr2=0x7f3968155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39680b2120 0x7f3968155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 -- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39680cdb10 msgr2=0x7f396814c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39680cdb10 0x7f396814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 -- 172.21.15.177:0/759192367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640094a0 con 0x7f396815eba0 2023-10-25T16:13:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f396ea56640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f3968154100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f396000cb40 tx=0x7f396000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000aa50 con 0x7f396815eba0 2023-10-25T16:13:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f396000aca0 con 0x7f396815eba0 2023-10-25T16:13:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968153620 con 0x7f396815eba0 2023-10-25T16:13:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960012680 con 0x7f396815eba0 2023-10-25T16:13:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39680ca280 con 0x7f396815eba0 2023-10-25T16:13:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396804daf0 con 0x7f396815eba0 2023-10-25T16:13:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.370+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f396001a3b0 con 0x7f396815eba0 2023-10-25T16:13:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.374+0000 7f395effd640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f394c0664a0 0x7f394c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.374+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3960084200 con 0x7f396815eba0 2023-10-25T16:13:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.374+0000 7f396e255640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f394c0664a0 0x7f394c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.374+0000 7f396e255640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f394c0664a0 0x7f394c068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39640af000 tx=0x7f39640194d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.378+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3960051680 con 0x7f396815eba0 2023-10-25T16:13:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.526+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3968153db0 con 0x7f396815eba0 2023-10-25T16:13:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.526+0000 7f395effd640 1 -- 172.21.15.177:0/759192367 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f3960054ca0 con 0x7f396815eba0 2023-10-25T16:13:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:23.532 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f394c0664a0 msgr2=0x7f394c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f394c0664a0 0x7f394c068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39640af000 tx=0x7f39640194d0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 msgr2=0x7f3968154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f3968154100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f396000cb40 tx=0x7f396000cc30 comp rx=0 tx=0).stop 2023-10-25T16:13:23.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 shutdown_connections 2023-10-25T16:13:23.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f394c0664a0 0x7f394c068960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396815eba0 0x7f3968154100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39680cdb10 0x7f396814c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 --2- 172.21.15.177:0/759192367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39680b2120 0x7f3968155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 >> 172.21.15.177:0/759192367 conn(0x7f396809a5c0 msgr2=0x7f39680b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:23.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 shutdown_connections 2023-10-25T16:13:23.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.530+0000 7f39704b9640 1 -- 172.21.15.177:0/759192367 wait complete. 2023-10-25T16:13:23.550 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:23.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2259549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e581500f0 msgr2=0x7f8e580c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2259549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e581500f0 0x7f8e580c9910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e5806fac0 tx=0x7f8e5401c740 comp rx=0 tx=0).stop 2023-10-25T16:13:23.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2259549751 shutdown_connections 2023-10-25T16:13:23.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2259549751 >> v2:172.21.15.184:3300/0 conn(0x7f8e5806c0f0 0x7f8e580706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2259549751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e581500f0 0x7f8e580c9910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2259549751 >> 172.21.15.177:0/2259549751 conn(0x7f8e580b2450 msgr2=0x7f8e580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:23.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2259549751 shutdown_connections 2023-10-25T16:13:23.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2259549751 wait complete. 2023-10-25T16:13:23.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 Processor -- start 2023-10-25T16:13:23.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- start start 2023-10-25T16:13:23.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e5806c0f0 0x7f8e5814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 0x7f8e58147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e581500f0 0x7f8e58144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58151300 con 0x7f8e580c9e50 2023-10-25T16:13:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e581485a0 con 0x7f8e5806c0f0 2023-10-25T16:13:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58148880 con 0x7f8e581500f0 2023-10-25T16:13:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 0x7f8e58147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 0x7f8e58147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54348/0 (socket says 172.21.15.177:54348) 2023-10-25T16:13:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 -- 172.21.15.177:0/2284941672 learned_addr learned my addr 172.21.15.177:0/2284941672 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5df6a640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e581500f0 0x7f8e58144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5d769640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e5806c0f0 0x7f8e5814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 -- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e581500f0 msgr2=0x7f8e58144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e581500f0 0x7f8e58144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 -- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e5806c0f0 msgr2=0x7f8e5814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e5806c0f0 0x7f8e5814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 -- 172.21.15.177:0/2284941672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540094a0 con 0x7f8e580c9e50 2023-10-25T16:13:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5df6a640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e581500f0 0x7f8e58144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5cf68640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 0x7f8e58147ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e48001240 tx=0x7f8e4800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:23.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48005480 con 0x7f8e580c9e50 2023-10-25T16:13:23.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e48003600 con 0x7f8e580c9e50 2023-10-25T16:13:23.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e58148b60 con 0x7f8e580c9e50 2023-10-25T16:13:23.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48003a10 con 0x7f8e580c9e50 2023-10-25T16:13:23.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.670+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5815ba00 con 0x7f8e580c9e50 2023-10-25T16:13:23.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.674+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e581510d0 con 0x7f8e580c9e50 2023-10-25T16:13:23.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.674+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e48003b70 con 0x7f8e580c9e50 2023-10-25T16:13:23.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.674+0000 7f8e4dffb640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e3c066470 0x7f8e3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:23.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.674+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e48083bb0 con 0x7f8e580c9e50 2023-10-25T16:13:23.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.674+0000 7f8e5d769640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e3c066470 0x7f8e3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:23.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.674+0000 7f8e5d769640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e3c066470 0x7f8e3c068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e540af000 tx=0x7f8e5401af80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:23.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.678+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e581510d0 con 0x7f8e580c9e50 2023-10-25T16:13:23.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.858+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e581510d0 con 0x7f8e580c9e50 2023-10-25T16:13:23.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e4dffb640 1 -- 172.21.15.177:0/2284941672 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f8e581510d0 con 0x7f8e580c9e50 2023-10-25T16:13:23.866 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:23.867 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:23.867 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:23.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e3c066470 msgr2=0x7f8e3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e3c066470 0x7f8e3c068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e540af000 tx=0x7f8e5401af80 comp rx=0 tx=0).stop 2023-10-25T16:13:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 msgr2=0x7f8e58147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 0x7f8e58147ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8e48001240 tx=0x7f8e4800c900 comp rx=0 tx=0).stop 2023-10-25T16:13:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 shutdown_connections 2023-10-25T16:13:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e3c066470 0x7f8e3c068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e581500f0 0x7f8e58144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e580c9e50 0x7f8e58147ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 --2- 172.21.15.177:0/2284941672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e5806c0f0 0x7f8e5814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 >> 172.21.15.177:0/2284941672 conn(0x7f8e580b2450 msgr2=0x7f8e580cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:23.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 shutdown_connections 2023-10-25T16:13:23.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:23.862+0000 7f8e5f9cd640 1 -- 172.21.15.177:0/2284941672 wait complete. 2023-10-25T16:13:24.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:13:06.929440+0000', 'modified': '2023-10-25T16:13:08.926933+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 154145}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_154145': {'gid': 154145, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6835/3257787330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 3257787330}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 3257787330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:13:24.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:13:24.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-25T16:13:24.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/2806198470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 msgr2=0x7fb09406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/2806198470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb09406be10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009c80 tx=0x7fb08c01cd50 comp rx=0 tx=0).stop 2023-10-25T16:13:24.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/2806198470 shutdown_connections 2023-10-25T16:13:24.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/2806198470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb09406be10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/2806198470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094071500 0x7fb094070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/2806198470 >> 172.21.15.177:0/2806198470 conn(0x7fb0940b2450 msgr2=0x7fb0940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/2806198470 shutdown_connections 2023-10-25T16:13:24.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/2806198470 wait complete. 2023-10-25T16:13:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 Processor -- start 2023-10-25T16:13:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- start start 2023-10-25T16:13:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb0940af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb094071500 0x7fb09413a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094159230 0x7fb09414c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09414b130 con 0x7fb09406b980 2023-10-25T16:13:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09414b410 con 0x7fb094071500 2023-10-25T16:13:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09414b6f0 con 0x7fb094159230 2023-10-25T16:13:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb0940af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb0940af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54358/0 (socket says 172.21.15.177:54358) 2023-10-25T16:13:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 -- 172.21.15.177:0/1194749612 learned_addr learned my addr 172.21.15.177:0/1194749612 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb098c86640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094159230 0x7fb09414c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 -- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094159230 msgr2=0x7fb09414c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094159230 0x7fb09414c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 -- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb094071500 msgr2=0x7fb09413a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb094071500 0x7fb09413a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 -- 172.21.15.177:0/1194749612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0098e0 con 0x7fb09406b980 2023-10-25T16:13:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb098c86640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094159230 0x7fb09414c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb093fff640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb0940af610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb08400c3c0 tx=0x7fb08400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb090ff9640 1 -- 172.21.15.177:0/1194749612 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0840052d0 con 0x7fb09406b980 2023-10-25T16:13:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb090ff9640 1 -- 172.21.15.177:0/1194749612 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb084003600 con 0x7fb09406b980 2023-10-25T16:13:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09414b9d0 con 0x7fb09406b980 2023-10-25T16:13:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb090ff9640 1 -- 172.21.15.177:0/1194749612 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084003a10 con 0x7fb09406b980 2023-10-25T16:13:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.414+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09413ac80 con 0x7fb09406b980 2023-10-25T16:13:24.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb090ff9640 1 -- 172.21.15.177:0/1194749612 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb084003b70 con 0x7fb09406b980 2023-10-25T16:13:24.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb090ff9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb080066470 0x7fb080068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb090ff9640 1 -- 172.21.15.177:0/1194749612 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb084083660 con 0x7fb09406b980 2023-10-25T16:13:24.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb080066470 0x7fb080068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 Processor -- start 2023-10-25T16:13:24.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 -- start start 2023-10-25T16:13:24.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb080066470 0x7fb080068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb094157b40 tx=0x7fb088005c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a678a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a679360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a46dcc0 con 0x555e4a6c32e0 2023-10-25T16:13:24.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a4d0920 con 0x555e4a6c29c0 2023-10-25T16:13:24.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e4a4cde50 con 0x555e4a678f80 2023-10-25T16:13:24.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a678a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a678a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54368/0 (socket says 172.21.15.177:54368) 2023-10-25T16:13:24.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 -- 172.21.15.177:0/3952179880 learned_addr learned my addr 172.21.15.177:0/3952179880 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:24.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb093fff640 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 -- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 msgr2=0x555e4a679360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a679360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 -- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 msgr2=0x555e4a6c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 -- 172.21.15.177:0/3952179880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e4a1c2890 con 0x555e4a6c32e0 2023-10-25T16:13:24.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb093fff640 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:24.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb0937fe640 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a678a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb08800cce0 tx=0x7fb08800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a02acd8033a336c server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb079ffb640 1 -- 172.21.15.177:0/3952179880 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08801c440 con 0x555e4a6c32e0 2023-10-25T16:13:24.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb079ffb640 1 -- 172.21.15.177:0/3952179880 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb08801c690 con 0x555e4a6c32e0 2023-10-25T16:13:24.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.418+0000 7fb079ffb640 1 -- 172.21.15.177:0/3952179880 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08801ca60 con 0x555e4a6c32e0 2023-10-25T16:13:24.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/3952179880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 msgr2=0x555e4a678a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a678a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb08800cce0 tx=0x7fb08800f000 comp rx=0 tx=0).stop 2023-10-25T16:13:24.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/3952179880 shutdown_connections 2023-10-25T16:13:24.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a679360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a678a40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- 172.21.15.177:0/3952179880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/3952179880 >> 172.21.15.177:0/3952179880 conn(0x555e4a6702f0 msgr2=0x555e4a677320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/3952179880 shutdown_connections 2023-10-25T16:13:24.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/3952179880 wait complete. 2023-10-25T16:13:24.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- start start 2023-10-25T16:13:24.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 Processor -- start 2023-10-25T16:13:24.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a67e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a67e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a684be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a4c9740 con 0x555e4a6c32e0 2023-10-25T16:13:24.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a488d10 con 0x555e4a6c29c0 2023-10-25T16:13:24.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e4a4889b0 con 0x555e4a678f80 2023-10-25T16:13:24.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 10 client.0 _ll_register_callbacks cb 0x555e4a6646c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:13:24.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a684be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a684be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54382/0 (socket says 172.21.15.177:54382) 2023-10-25T16:13:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 -- 172.21.15.177:0/2766966570 learned_addr learned my addr 172.21.15.177:0/2766966570 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb093fff640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a67e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb0937fe640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a67e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 -- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 msgr2=0x555e4a67e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a67e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 -- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 msgr2=0x555e4a67e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a67e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 -- 172.21.15.177:0/2766966570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08800c9c0 con 0x555e4a6c32e0 2023-10-25T16:13:24.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb098c86640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a684be0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009bd0 tx=0x7fb08c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bb153959f1fd0b server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:13:24.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 1 -- 172.21.15.177:0/2766966570 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c003b80 con 0x555e4a6c32e0 2023-10-25T16:13:24.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 1 -- 172.21.15.177:0/2766966570 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb08c0ad5b0 con 0x555e4a6c32e0 2023-10-25T16:13:24.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e4a47d370 con 0x555e4a6c32e0 2023-10-25T16:13:24.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 1 -- 172.21.15.177:0/2766966570 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb08c0ad770 con 0x555e4a6c32e0 2023-10-25T16:13:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 10 client.4785 fetch_fsmap learned FSMap version 6 2023-10-25T16:13:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555e4a48b460 con 0x555e4a6c32e0 2023-10-25T16:13:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 1 -- 172.21.15.177:0/2766966570 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x555e4a47d370 con 0x555e4a6c32e0 2023-10-25T16:13:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 1 -- 172.21.15.177:0/2766966570 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb08c0ad8d0 con 0x555e4a6c32e0 2023-10-25T16:13:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 10 client.4785 fetch_fsmap finished waiting for FSMap version 6 2023-10-25T16:13:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 10 client.4785 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:13:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 20 client.4785 populate_metadata read hostname 'smithi177' 2023-10-25T16:13:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a6855f0 0x555e4a6d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 4 client.4785 mds_command: new command op to 154145 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:13:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 --> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e4a4632d0 con 0x555e4a6855f0 2023-10-25T16:13:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb093fff640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a6855f0 0x555e4a6d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb072ffd640 10 client.4785 ms_handle_connect on v2:172.21.15.184:6834/3257787330 2023-10-25T16:13:24.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.422+0000 7fb093fff640 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a6855f0 0x555e4a6d4a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd46a54e7d190fa server_cookie=9e2082d7d85cc82e in_seq=0 out_seq=0 2023-10-25T16:13:24.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb072ffd640 1 -- 172.21.15.177:0/2766966570 <== mds.0 v2:172.21.15.184:6834/3257787330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555e4a4632d0 con 0x555e4a6855f0 2023-10-25T16:13:24.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb072ffd640 10 client.4785 handle_command_reply: tid=0 2023-10-25T16:13:24.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 client.4785 shutdown 2023-10-25T16:13:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 msgr2=0x555e4a684be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a684be0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009bd0 tx=0x7fb08c004b40 comp rx=0 tx=0).stop 2023-10-25T16:13:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 shutdown_connections 2023-10-25T16:13:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a6855f0 0x555e4a6d4a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a6c32e0 0x555e4a684be0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a67e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb072ffd640 0 client.4785 ms_handle_reset on v2:172.21.15.184:6834/3257787330 2023-10-25T16:13:24.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 --2- 172.21.15.177:0/2766966570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a678f80 0x555e4a67e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 >> 172.21.15.177:0/2766966570 conn(0x555e4a6702f0 msgr2=0x555e4a677a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 shutdown_connections 2023-10-25T16:13:24.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 1 -- 172.21.15.177:0/2766966570 wait complete. 2023-10-25T16:13:24.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.426+0000 7fb09d833000 20 client.4785 trim_cache size 0 max 16384 2023-10-25T16:13:24.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.438+0000 7fb09d833000 1 Processor -- start 2023-10-25T16:13:24.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.438+0000 7fb09d833000 1 -- start start 2023-10-25T16:13:24.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a183940 con 0x555e4a678f80 2023-10-25T16:13:24.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a683dc0 con 0x555e4a6c29c0 2023-10-25T16:13:24.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e4a492720 con 0x555e4a6c32e0 2023-10-25T16:13:24.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54398/0 (socket says 172.21.15.177:54398) 2023-10-25T16:13:24.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/3825430483 learned_addr learned my addr 172.21.15.177:0/3825430483 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:24.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/3825430483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 msgr2=0x555e4a6d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/3825430483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 msgr2=0x555e4a6c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/3825430483 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e4a471760 con 0x555e4a678f80 2023-10-25T16:13:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6c0bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb08400cd80 tx=0x7fb084000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c2ca71dfee87 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb07a7fc640 1 -- 172.21.15.177:0/3825430483 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084081c00 con 0x555e4a678f80 2023-10-25T16:13:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb07a7fc640 1 -- 172.21.15.177:0/3825430483 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb084052b30 con 0x555e4a678f80 2023-10-25T16:13:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb07a7fc640 1 -- 172.21.15.177:0/3825430483 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08405c600 con 0x555e4a678f80 2023-10-25T16:13:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- 172.21.15.177:0/3825430483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 msgr2=0x555e4a6c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6c0bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb08400cd80 tx=0x7fb084000ee0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- 172.21.15.177:0/3825430483 shutdown_connections 2023-10-25T16:13:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- 172.21.15.177:0/3825430483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6c0bb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- 172.21.15.177:0/3825430483 >> 172.21.15.177:0/3825430483 conn(0x555e4a6702f0 msgr2=0x555e4a6cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- 172.21.15.177:0/3825430483 shutdown_connections 2023-10-25T16:13:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- 172.21.15.177:0/3825430483 wait complete. 2023-10-25T16:13:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- start start 2023-10-25T16:13:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 Processor -- start 2023-10-25T16:13:24.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6dde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6de370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a4cc2a0 con 0x555e4a678f80 2023-10-25T16:13:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e4a67bd90 con 0x555e4a6c29c0 2023-10-25T16:13:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e4a4c3a40 con 0x555e4a6c32e0 2023-10-25T16:13:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 10 client.0 _ll_register_callbacks cb 0x555e4a4c7ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:13:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6d5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54408/0 (socket says 172.21.15.177:54408) 2023-10-25T16:13:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/2953006092 learned_addr learned my addr 172.21.15.177:0/2953006092 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb098c86640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb0937fe640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 msgr2=0x555e4a6de370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6de370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 msgr2=0x555e4a6dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:13:24.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 -- 172.21.15.177:0/2953006092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09413ac80 con 0x555e4a678f80 2023-10-25T16:13:24.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb098c86640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:24.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb093fff640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6d5ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb084054720 tx=0x7fb084052ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85da4851641caf41 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb072ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:13:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb072ffd640 1 -- 172.21.15.177:0/2953006092 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08405c800 con 0x555e4a678f80 2023-10-25T16:13:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb072ffd640 1 -- 172.21.15.177:0/2953006092 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb084081cc0 con 0x555e4a678f80 2023-10-25T16:13:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.442+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e4a67b6e0 con 0x555e4a678f80 2023-10-25T16:13:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 1 -- 172.21.15.177:0/2953006092 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb084050580 con 0x555e4a678f80 2023-10-25T16:13:24.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 10 client.4791 fetch_fsmap learned FSMap version 6 2023-10-25T16:13:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555e4a1c2cc0 con 0x555e4a678f80 2023-10-25T16:13:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 1 -- 172.21.15.177:0/2953006092 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x555e4a67b6e0 con 0x555e4a678f80 2023-10-25T16:13:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 1 -- 172.21.15.177:0/2953006092 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb08406d030 con 0x555e4a678f80 2023-10-25T16:13:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 10 client.4791 fetch_fsmap finished waiting for FSMap version 6 2023-10-25T16:13:24.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 10 client.4791 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:13:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 20 client.4791 populate_metadata read hostname 'smithi177' 2023-10-25T16:13:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a721260 0x555e4a721640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 4 client.4791 mds_command: new command op to 154145 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:13:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 --> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555e4a4616f0 con 0x555e4a721260 2023-10-25T16:13:24.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb0937fe640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a721260 0x555e4a721640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb0937fe640 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a721260 0x555e4a721640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8b2f3cff680b4c5 server_cookie=f3de303030e68bce in_seq=0 out_seq=0 2023-10-25T16:13:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 10 client.4791 ms_handle_connect on v2:172.21.15.184:6834/3257787330 2023-10-25T16:13:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 1 -- 172.21.15.177:0/2953006092 <== mds.0 v2:172.21.15.184:6834/3257787330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555e4a4616f0 con 0x555e4a721260 2023-10-25T16:13:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 10 client.4791 handle_command_reply: tid=0 2023-10-25T16:13:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 client.4791 shutdown 2023-10-25T16:13:24.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 msgr2=0x555e4a6d5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6d5ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb084054720 tx=0x7fb084052ca0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 shutdown_connections 2023-10-25T16:13:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:6834/3257787330,v1:172.21.15.184:6835/3257787330] conn(0x555e4a721260 0x555e4a721640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x555e4a6c32e0 0x555e4a6de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb072ffd640 0 client.4791 ms_handle_reset on v2:172.21.15.184:6834/3257787330 2023-10-25T16:13:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555e4a6c29c0 0x555e4a6dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 --2- 172.21.15.177:0/2953006092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555e4a678f80 0x555e4a6d5ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 >> 172.21.15.177:0/2953006092 conn(0x555e4a6702f0 msgr2=0x555e4a6bfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 shutdown_connections 2023-10-25T16:13:24.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 1 -- 172.21.15.177:0/2953006092 wait complete. 2023-10-25T16:13:24.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09d833000 20 client.4791 trim_cache size 0 max 16384 2023-10-25T16:13:24.472 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:13:24.472 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:13:24.472 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:13:24.473 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 154145, 2023-10-25T16:13:24.473 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:13:24.473 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:13:24.473 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:13:24.473 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 16.852623563000002, 2023-10-25T16:13:24.474 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 6, 2023-10-25T16:13:24.474 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 21, 2023-10-25T16:13:24.474 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 21, 2023-10-25T16:13:24.474 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 24.236798708999999 2023-10-25T16:13:24.474 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:13:24.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb080066470 msgr2=0x7fb080068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb080066470 0x7fb080068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb094157b40 tx=0x7fb088005c90 comp rx=0 tx=0).stop 2023-10-25T16:13:24.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 msgr2=0x7fb0940af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb0940af610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb08400c3c0 tx=0x7fb08400c880 comp rx=0 tx=0).stop 2023-10-25T16:13:24.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 shutdown_connections 2023-10-25T16:13:24.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb080066470 0x7fb080068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb094159230 0x7fb09414c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb094071500 0x7fb09413a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 --2- 172.21.15.177:0/1194749612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb09406b980 0x7fb0940af610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 >> 172.21.15.177:0/1194749612 conn(0x7fb0940b2450 msgr2=0x7fb0940cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 shutdown_connections 2023-10-25T16:13:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.446+0000 7fb09a6e9640 1 -- 172.21.15.177:0/1194749612 wait complete. 2023-10-25T16:13:24.478 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-25T16:13:24.501 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-25T16:13:24.501 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-25T16:13:24.502 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-25T16:13:24.502 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-25T16:13:24.503 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:24.503 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-25T16:13:24.503 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-25T16:13:24.503 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:24.504 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-25T16:13:24.504 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-25T16:13:24.504 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:24.504 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-25T16:13:24.505 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-25T16:13:24.505 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:24.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:24.506 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:13:24.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:24.513 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-25T16:13:24.574 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-25T16:13:24.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:13:24.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:24.576 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:13:24.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:24.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-10-25T16:13:24.640 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2023-10-25T16:13:24.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:13:24.642 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-25T16:13:24.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:13:24.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 -- 172.21.15.177:0/1064512613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100047d0 msgr2=0x7f8410004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 --2- 172.21.15.177:0/1064512613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100047d0 0x7f8410004c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f840c00bb20 tx=0x7f840c01cd60 comp rx=0 tx=0).stop 2023-10-25T16:13:24.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 -- 172.21.15.177:0/1064512613 shutdown_connections 2023-10-25T16:13:24.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 --2- 172.21.15.177:0/1064512613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100047d0 0x7f8410004c50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 -- 172.21.15.177:0/1064512613 >> 172.21.15.177:0/1064512613 conn(0x7f84240b2450 msgr2=0x7f84240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:24.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 -- 172.21.15.177:0/1064512613 shutdown_connections 2023-10-25T16:13:24.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 -- 172.21.15.177:0/1064512613 wait complete. 2023-10-25T16:13:24.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 Processor -- start 2023-10-25T16:13:24.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 -- start start 2023-10-25T16:13:24.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100047d0 0x7f84241ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.810+0000 7f8428f09640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84241eff30 0x7f842415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 0x7f842413f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842415a280 con 0x7f84241f04f0 2023-10-25T16:13:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842415b7d0 con 0x7f84100047d0 2023-10-25T16:13:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842415a4d0 con 0x7f84241eff30 2023-10-25T16:13:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 0x7f842413f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 0x7f842413f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54430/0 (socket says 172.21.15.177:54430) 2023-10-25T16:13:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 -- 172.21.15.177:0/747468642 learned_addr learned my addr 172.21.15.177:0/747468642 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f842259c640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100047d0 0x7f84241ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8421d9b640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84241eff30 0x7f842415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 -- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84241eff30 msgr2=0x7f842415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84241eff30 0x7f842415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 -- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100047d0 msgr2=0x7f84241ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:24.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100047d0 0x7f84241ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:24.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 -- 172.21.15.177:0/747468642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842415a7b0 con 0x7f84241f04f0 2023-10-25T16:13:24.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8422d9d640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 0x7f842413f470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f841c000f90 tx=0x7f841c010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c01a030 con 0x7f84241f04f0 2023-10-25T16:13:24.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f841c00ebe0 con 0x7f84241f04f0 2023-10-25T16:13:24.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842415aa90 con 0x7f84241f04f0 2023-10-25T16:13:24.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c013480 con 0x7f84241f04f0 2023-10-25T16:13:24.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84241f0970 con 0x7f84241f04f0 2023-10-25T16:13:24.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842404daf0 con 0x7f84241f04f0 2023-10-25T16:13:24.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f841c01d070 con 0x7f84241f04f0 2023-10-25T16:13:24.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f841affd640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8404066470 0x7f8404068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:24.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f841c01b070 con 0x7f84241f04f0 2023-10-25T16:13:24.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f842259c640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8404066470 0x7f8404068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:24.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.814+0000 7f842259c640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8404066470 0x7f8404068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8414006fd0 tx=0x7f8414006af0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:24.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:24.818+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f841c058400 con 0x7f84241f04f0 2023-10-25T16:13:25.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.010+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84240ca670 con 0x7f84241f04f0 2023-10-25T16:13:25.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.010+0000 7f841affd640 1 -- 172.21.15.177:0/747468642 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f841c057f90 con 0x7f84241f04f0 2023-10-25T16:13:25.017 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:13:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8404066470 msgr2=0x7f8404068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:25.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8404066470 0x7f8404068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8414006fd0 tx=0x7f8414006af0 comp rx=0 tx=0).stop 2023-10-25T16:13:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 msgr2=0x7f842413f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 0x7f842413f470 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f841c000f90 tx=0x7f841c010e70 comp rx=0 tx=0).stop 2023-10-25T16:13:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 shutdown_connections 2023-10-25T16:13:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8404066470 0x7f8404068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:25.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84241f04f0 0x7f842413f470 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84241eff30 0x7f842415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 --2- 172.21.15.177:0/747468642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100047d0 0x7f84241ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 >> 172.21.15.177:0/747468642 conn(0x7f84240b2450 msgr2=0x7f84240ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 shutdown_connections 2023-10-25T16:13:25.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:25.014+0000 7f8428f09640 1 -- 172.21.15.177:0/747468642 wait complete. 2023-10-25T16:13:25.036 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:13:25.036 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:13:25.036 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:13:25.037 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:13:25.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:25.037 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:13:25.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:13:25.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:13:25.038 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:13:25.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.039 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:13:25.044 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:25.045 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:25.045 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:25.045 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:25.045 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:25.045 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:25.046 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:25.046 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:25.046 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:13:25.046 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:25.046 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:25.047 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:13:25.047 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:25.047 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:25.047 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:13:25.047 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:25.048 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:13:25.048 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42513sec preferred_lft 42513sec 2023-10-25T16:13:25.048 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:13:25.048 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:25.048 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:13:25.049 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:25.049 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:13:25.049 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:25.049 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-25T16:13:25.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.050 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:25.050 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:25.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2023-10-25T16:13:25.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2023-10-25T16:13:25.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2023-10-25T16:13:25.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-25T16:13:25.052 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:25.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.123 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:13:25.174 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:13:25.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.175 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:13:25.238 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:13:25.238 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:13:25.239 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:13:25.239 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:13:25.239 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:13:25.239 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:13:25.239 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:25.240 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:25.240 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:25.240 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:13:25.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.241 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:25.241 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:25.241 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:13:25.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:13:25.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:13:25.242 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:25.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.315 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:13:25.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.363 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-10-25T16:13:25.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.411 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:25.411 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:25.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:25.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-25T16:13:25.412 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:25.478 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-25T16:13:25.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.479 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:25.480 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:25.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-25T16:13:25.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-25T16:13:25.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-25T16:13:25.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-25T16:13:25.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-25T16:13:25.481 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:25.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.589 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:25.589 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:25.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:13:25.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2023-10-25T16:13:25.590 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:25.609 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:13:25.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:25.610 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:25.658 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:13:25.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:25.659 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:25.706 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:25.758 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:13:25.799 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:13:25.799 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:13:25.799 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:13:25.799 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:13:25.800 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:13:25.800 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:13:25.800 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:13:25.800 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:13:25.800 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:13:25.801 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:13:25.801 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:13:25.801 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:25.801 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:13:25.801 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:13:25.801 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:13:25.802 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:13:25.802 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:13:25.802 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:25.802 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:13:25.802 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:25.803 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:13:25.803 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:13:25.803 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:13:25.803 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:13:25.803 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:13:25.804 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:13:25.804 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:13:25.804 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:13:25.804 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:25.804 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:25.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.806 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:13:25.854 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:13:25.855 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:13:25.899 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:25.906 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:13:25.906 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:13:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:13:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:13:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:13:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:13:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:13:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:13:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:13:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:13:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:13:25.908 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:13:25.909 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:25.909 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:13:25.909 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:13:25.909 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:13:25.909 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:13:25.910 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:13:25.910 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:25.910 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:13:25.910 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:25.910 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:13:25.911 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:13:25.911 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:13:25.911 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:13:25.911 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:13:25.911 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:13:25.911 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:13:25.912 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:13:25.912 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:25.912 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:25.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:25.913 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:13:25.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:13:25.986+0000 7f2ccc195580 -1 init, newargv = 0x56149ecf85f0 newargc=15 2023-10-25T16:13:25.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[35703]: starting ceph client 2023-10-25T16:13:25.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[35703]: starting fuse 2023-10-25T16:13:27.060 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:27.069 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:13:27.070 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:13:27.070 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:13:27.070 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:13:27.070 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:13:27.070 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:13:27.071 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:13:27.071 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:13:27.071 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:13:27.071 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:13:27.072 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:13:27.072 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:13:27.072 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:27.072 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:13:27.072 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:13:27.073 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:13:27.073 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:13:27.073 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:13:27.073 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:27.073 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:13:27.074 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:27.074 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:13:27.074 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:13:27.074 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:13:27.074 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:13:27.075 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:13:27.075 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:13:27.075 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:13:27.075 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:13:27.075 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:27.076 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:27.076 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:27.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:27.077 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:13:27.123 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:13:27.123 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:13:27.124 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:13:27.124 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:13:27.124 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:13:27.125 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:13:27.125 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:13:27.125 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:27.125 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:13:27.126 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:13:27.126 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:13:27.126 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:13:27.127 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:27.127 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:13:27.127 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:13:27.127 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:13:27.128 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:13:27.128 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:27.128 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:13:27.129 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:13:27.129 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:13:27.129 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:13:27.129 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:13:27.130 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:13:27.130 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:13:27.130 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:13:27.131 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:27.131 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:13:27.131 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:13:27.245 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.35703.asok 2023-10-25T16:13:27.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:27.256 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35703.asok 2023-10-25T16:13:27.257 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:27.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.35703.asok status 2023-10-25T16:13:27.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:27.450 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:13:27.451 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:13:27.451 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:13:27.451 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:13:27.451 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:13:27.452 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:13:27.452 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:13:27.452 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "35703", 2023-10-25T16:13:27.452 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:13:27.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:27.452 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:13:27.453 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:13:27.453 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4803, 2023-10-25T16:13:27.453 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:13:27.453 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:13:27.454 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:13:27.454 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 4803 2023-10-25T16:13:27.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:27.454 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:13:27.454 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:13:27.455 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:13:27.455 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3559855716 2023-10-25T16:13:27.455 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:13:27.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:27.455 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:13:27.455 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:13:27.456 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:13:27.456 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3559855716 2023-10-25T16:13:27.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:27.456 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.4803 192.168.0.1:0/3559855716", 2023-10-25T16:13:27.456 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3559855716", 2023-10-25T16:13:27.456 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:13:27.457 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 6, 2023-10-25T16:13:27.457 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 21, 2023-10-25T16:13:27.457 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:13:27.457 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:13:27.457 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:13:27.458 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:13:27.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:27.472 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:13:27.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0b180640 1 -- 172.21.15.177:0/2462983074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcec0039b0 msgr2=0x7fbcec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:27.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0b180640 1 --2- 172.21.15.177:0/2462983074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcec0039b0 0x7fbcec003dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ac70 tx=0x7fbcf401e040 comp rx=0 tx=0).stop 2023-10-25T16:13:27.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0971d640 1 -- 172.21.15.177:0/2462983074 reap_dead start 2023-10-25T16:13:27.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0b180640 1 -- 172.21.15.177:0/2462983074 shutdown_connections 2023-10-25T16:13:27.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0b180640 1 -- 172.21.15.177:0/2462983074 >> 172.21.15.177:0/2462983074 conn(0x7fbd040b2450 msgr2=0x7fbd040b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:27.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0b180640 1 -- 172.21.15.177:0/2462983074 shutdown_connections 2023-10-25T16:13:27.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.594+0000 7fbd0b180640 1 -- 172.21.15.177:0/2462983074 wait complete. 2023-10-25T16:13:27.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 Processor -- start 2023-10-25T16:13:27.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- start start 2023-10-25T16:13:27.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcec0039b0 0x7fbd041459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:27.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 0x7fbd041548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:27.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd041f2db0 0x7fbd041f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:27.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd04154e10 con 0x7fbd04154450 2023-10-25T16:13:27.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0415fc30 con 0x7fbd041f2db0 2023-10-25T16:13:27.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0415ff10 con 0x7fbcec0039b0 2023-10-25T16:13:27.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 0x7fbd041548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:27.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 0x7fbd041548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54444/0 (socket says 172.21.15.177:54444) 2023-10-25T16:13:27.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 -- 172.21.15.177:0/3987025739 learned_addr learned my addr 172.21.15.177:0/3987025739 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:27.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd08f1c640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcec0039b0 0x7fbd041459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:27.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 -- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcec0039b0 msgr2=0x7fbd041459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:27.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcec0039b0 0x7fbd041459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 -- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd041f2db0 msgr2=0x7fbd041f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:27.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0971d640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd041f2db0 0x7fbd041f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:27.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd041f2db0 0x7fbd041f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 -- 172.21.15.177:0/3987025739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd041601f0 con 0x7fbd04154450 2023-10-25T16:13:27.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd03fff640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 0x7fbd041548d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800d680 tx=0x7fbcf800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:27.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80060d0 con 0x7fbd04154450 2023-10-25T16:13:27.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbcf8006320 con 0x7fbd04154450 2023-10-25T16:13:27.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800b830 con 0x7fbd04154450 2023-10-25T16:13:27.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd041604d0 con 0x7fbd04154450 2023-10-25T16:13:27.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd04151e70 con 0x7fbd04154450 2023-10-25T16:13:27.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd040af120 con 0x7fbd04154450 2023-10-25T16:13:27.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.598+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbcf800b990 con 0x7fbd04154450 2023-10-25T16:13:27.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.602+0000 7fbd017fa640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbcf00664a0 0x7fbcf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:27.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.602+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcf80844d0 con 0x7fbd04154450 2023-10-25T16:13:27.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.602+0000 7fbd08f1c640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbcf00664a0 0x7fbcf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:27.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.602+0000 7fbd08f1c640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbcf00664a0 0x7fbcf0068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40af000 tx=0x7fbcf401ade0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:27.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.606+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbcf8051950 con 0x7fbd04154450 2023-10-25T16:13:27.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbd0404daf0 con 0x7fbd04154450 2023-10-25T16:13:27.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd017fa640 1 -- 172.21.15.177:0/3987025739 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbcf8014020 con 0x7fbd04154450 2023-10-25T16:13:27.799 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:13:27.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbcf00664a0 msgr2=0x7fbcf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:27.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbcf00664a0 0x7fbcf0068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40af000 tx=0x7fbcf401ade0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 msgr2=0x7fbd041548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:27.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 0x7fbd041548d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800d680 tx=0x7fbcf800db40 comp rx=0 tx=0).stop 2023-10-25T16:13:27.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 shutdown_connections 2023-10-25T16:13:27.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbcf00664a0 0x7fbcf0068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd041f2db0 0x7fbd041f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd04154450 0x7fbd041548d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 --2- 172.21.15.177:0/3987025739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcec0039b0 0x7fbd041459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:27.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 >> 172.21.15.177:0/3987025739 conn(0x7fbd040b2450 msgr2=0x7fbd04070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:27.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 shutdown_connections 2023-10-25T16:13:27.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:27.794+0000 7fbd0b180640 1 -- 172.21.15.177:0/3987025739 wait complete. 2023-10-25T16:13:27.817 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:13:27.818 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:13:27.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:13:27.818 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-25T16:13:27.819 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:27.819 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:13:27.819 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:13:27.819 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:13:27.820 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-25T16:13:27.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:27.820 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:13:27.826 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:27.826 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:27.827 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:27.827 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.827 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:27.827 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.827 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:27.827 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:27.828 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:13:27.828 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:27.828 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:27.828 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:13:27.828 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:27.829 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:27.829 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:13:27.829 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:27.829 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:13:27.829 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42510sec preferred_lft 42510sec 2023-10-25T16:13:27.829 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:13:27.830 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.830 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:13:27.830 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:27.830 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:13:27.830 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.831 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:13:27.831 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:27.831 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:13:27.831 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.831 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:13:27.832 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.832 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:13:27.832 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:27.832 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:13:27.832 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:27.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:27.833 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:13:27.881 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:13:27.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:27.883 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:13:27.934 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:13:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:13:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:13:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:13:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:13:27.936 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:13:27.936 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:27.936 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:27.936 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:27.936 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:13:27.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:27.937 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:27.938 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:27.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:13:27.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:13:27.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:13:27.939 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:28.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.011 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:13:28.059 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:13:28.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.061 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-10-25T16:13:28.107 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-25T16:13:28.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.108 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:28.108 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:28.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:28.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-25T16:13:28.109 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:28.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.175 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-25T16:13:28.230 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:28.230 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:28.231 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:28.231 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.231 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:28.231 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.232 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:13:28.232 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether b2:83:84:64:54:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-25T16:13:28.232 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-25T16:13:28.232 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.232 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::b083:84ff:fe64:54b7/64 scope link 2023-10-25T16:13:28.233 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.234 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-25T16:13:28.291 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:28.291 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:28.291 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:28.291 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.292 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:28.292 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.292 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:13:28.292 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether b2:83:84:64:54:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-25T16:13:28.292 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-25T16:13:28.293 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.293 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::b083:84ff:fe64:54b7/64 scope link 2023-10-25T16:13:28.293 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:28.294 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-25T16:13:28.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.295 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:28.295 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:28.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-25T16:13:28.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-25T16:13:28.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-25T16:13:28.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-25T16:13:28.297 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-25T16:13:28.297 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:28.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.389 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:13:28.389 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:13:28.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2023-10-25T16:13:28.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2023-10-25T16:13:28.390 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:13:28.409 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-25T16:13:28.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:28.410 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:28.458 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-25T16:13:28.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:28.459 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:28.506 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:28.556 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:13:28.556 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:13:28.556 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:13:28.556 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:13:28.557 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:13:28.557 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:13:28.557 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:13:28.557 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:13:28.558 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:13:28.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:13:28.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:13:28.558 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:13:28.558 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:28.559 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:13:28.559 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:13:28.559 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:13:28.559 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:13:28.559 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:13:28.560 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:28.560 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:13:28.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:28.560 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:13:28.561 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:13:28.561 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:13:28.561 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:13:28.561 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:13:28.562 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:13:28.562 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:13:28.562 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:13:28.562 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:28.562 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:28.563 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:28.563 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:28.563 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:28.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.564 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:13:28.612 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:13:28.612 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-10-25T16:13:28.612 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-25T16:13:28.655 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:28.662 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:13:28.662 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:13:28.662 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:13:28.662 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:13:28.663 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:13:28.663 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:13:28.663 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:13:28.663 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:13:28.664 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:13:28.664 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:13:28.664 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:13:28.664 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:13:28.664 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:28.665 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:13:28.665 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:13:28.665 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:13:28.665 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:13:28.665 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:13:28.666 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:28.666 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:13:28.666 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:28.666 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:13:28.666 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:13:28.667 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:13:28.667 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:13:28.667 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:13:28.667 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:13:28.667 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:13:28.668 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:13:28.668 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:28.668 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:28.668 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:28.668 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:28.669 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:28.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:28.670 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:13:28.718 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:13:28.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:2023-10-25T16:13:28.729+0000 7f4e85ffb580 -1 init, newargv = 0x55f2d55fd080 newargc=15 2023-10-25T16:13:28.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:ceph-fuse[35838]: starting ceph client 2023-10-25T16:13:28.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:ceph-fuse[35838]: starting fuse 2023-10-25T16:13:29.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:13:29.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:13:29.820 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:29.868 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:13:29.868 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:13:29.868 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:13:29.868 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:13:29.869 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:13:29.869 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:13:29.869 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:13:29.869 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:13:29.869 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:13:29.870 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:13:29.870 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:13:29.870 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:13:29.870 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:29.870 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:13:29.871 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:13:29.871 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:13:29.871 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:13:29.871 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:13:29.871 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:29.872 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:13:29.872 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:29.872 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:13:29.872 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:13:29.872 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:13:29.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:13:29.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:13:29.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:13:29.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:13:29.874 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:13:29.874 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:29.874 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:13:29.874 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:29.875 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:29.875 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:13:29.875 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:29.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:29.876 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:13:29.922 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:13:29.923 INFO:teuthology.orchestra.run.smithi177.stdout:46 2023-10-25T16:13:29.923 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-10-25T16:13:29.923 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:13:29.924 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:13:29.924 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:13:29.924 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:13:29.925 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:13:29.925 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:29.925 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:13:29.926 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-25T16:13:29.926 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:13:29.927 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-25T16:13:29.927 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:29.927 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:13:29.927 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:13:29.928 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:13:29.928 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:13:29.929 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:29.929 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:13:29.929 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:13:29.929 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:13:29.930 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:13:29.930 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:13:29.930 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:13:29.931 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:13:29.931 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:13:29.931 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:13:29.932 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.2")) 2023-10-25T16:13:29.932 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:13:30.047 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.2.35838.asok 2023-10-25T16:13:30.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:30.059 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35838.asok 2023-10-25T16:13:30.059 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:30.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.35838.asok status 2023-10-25T16:13:30.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:30.255 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:13:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:13:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:13:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:13:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "2", 2023-10-25T16:13:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:13:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-25T16:13:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "35838", 2023-10-25T16:13:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:13:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:13:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:13:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4818, 2023-10-25T16:13:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:13:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:13:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:13:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 4818 2023-10-25T16:13:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:13:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:13:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.2:0", 2023-10-25T16:13:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3444318936 2023-10-25T16:13:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:13:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:13:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:13:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.2:0", 2023-10-25T16:13:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3444318936 2023-10-25T16:13:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:13:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.4818 192.168.0.2:0/3444318936", 2023-10-25T16:13:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.2:0/3444318936", 2023-10-25T16:13:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:13:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 6, 2023-10-25T16:13:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 21, 2023-10-25T16:13:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:13:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:13:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:13:30.262 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:13:30.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:30.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:13:30.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 -- 172.21.15.177:0/1270494597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780b2bc0 msgr2=0x7f46780b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:30.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 --2- 172.21.15.177:0/1270494597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780b2bc0 0x7f46780b2fa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4678065d20 tx=0x7f466801c850 comp rx=0 tx=0).stop 2023-10-25T16:13:30.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 -- 172.21.15.177:0/1270494597 shutdown_connections 2023-10-25T16:13:30.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 --2- 172.21.15.177:0/1270494597 >> v2:172.21.15.184:3300/0 conn(0x7f46780654c0 0x7f467806c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 --2- 172.21.15.177:0/1270494597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780cbd10 0x7f467806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 --2- 172.21.15.177:0/1270494597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780b2bc0 0x7f46780b2fa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 -- 172.21.15.177:0/1270494597 >> 172.21.15.177:0/1270494597 conn(0x7f46780af5b0 msgr2=0x7f46780af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:30.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 -- 172.21.15.177:0/1270494597 shutdown_connections 2023-10-25T16:13:30.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.389+0000 7f467e27b640 1 -- 172.21.15.177:0/1270494597 wait complete. 2023-10-25T16:13:30.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 Processor -- start 2023-10-25T16:13:30.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- start start 2023-10-25T16:13:30.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 0x7f46780abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:30.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780b2bc0 0x7f467814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:30.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46780cbd10 0x7f467814a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:30.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467814f390 con 0x7f46780654c0 2023-10-25T16:13:30.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4678139af0 con 0x7f46780cbd10 2023-10-25T16:13:30.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467814bdc0 con 0x7f46780b2bc0 2023-10-25T16:13:30.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 0x7f46780abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:30.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 0x7f46780abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54470/0 (socket says 172.21.15.177:54470) 2023-10-25T16:13:30.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 -- 172.21.15.177:0/3869815475 learned_addr learned my addr 172.21.15.177:0/3869815475 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:30.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f46777fe640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780b2bc0 0x7f467814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:30.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467c818640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46780cbd10 0x7f467814a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:30.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 -- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780b2bc0 msgr2=0x7f467814b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:30.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780b2bc0 0x7f467814b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 -- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46780cbd10 msgr2=0x7f467814a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:30.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46780cbd10 0x7f467814a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 -- 172.21.15.177:0/3869815475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668009560 con 0x7f46780654c0 2023-10-25T16:13:30.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467c818640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46780cbd10 0x7f467814a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:30.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f46777fe640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780b2bc0 0x7f467814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:30.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4677fff640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 0x7f46780abca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f46680b0040 tx=0x7f46680a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:30.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668005230 con 0x7f46780654c0 2023-10-25T16:13:30.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4668005480 con 0x7f46780654c0 2023-10-25T16:13:30.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467814f630 con 0x7f46780654c0 2023-10-25T16:13:30.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668004930 con 0x7f46780654c0 2023-10-25T16:13:30.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46780ac1e0 con 0x7f46780654c0 2023-10-25T16:13:30.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467804daf0 con 0x7f46780654c0 2023-10-25T16:13:30.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46680b4070 con 0x7f46780654c0 2023-10-25T16:13:30.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.393+0000 7f4674ff9640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4664066470 0x7f4664068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:30.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.397+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f466811e3d0 con 0x7f46780654c0 2023-10-25T16:13:30.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.397+0000 7f46777fe640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4664066470 0x7f4664068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:30.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.397+0000 7f46777fe640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4664066470 0x7f4664068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46780ac4d0 tx=0x7f466c00b5b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:30.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.401+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46680eb8e0 con 0x7f46780654c0 2023-10-25T16:13:30.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46780acac0 con 0x7f46780654c0 2023-10-25T16:13:30.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f4674ff9640 1 -- 172.21.15.177:0/3869815475 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f46680a5980 con 0x7f46780654c0 2023-10-25T16:13:30.595 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:13:30.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4664066470 msgr2=0x7f4664068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:30.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4664066470 0x7f4664068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f46780ac4d0 tx=0x7f466c00b5b0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 msgr2=0x7f46780abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:30.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 0x7f46780abca0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f46680b0040 tx=0x7f46680a56d0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 shutdown_connections 2023-10-25T16:13:30.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4664066470 0x7f4664068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46780cbd10 0x7f467814a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46780b2bc0 0x7f467814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 --2- 172.21.15.177:0/3869815475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46780654c0 0x7f46780abca0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:30.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 >> 172.21.15.177:0/3869815475 conn(0x7f46780af5b0 msgr2=0x7f46781511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:30.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 shutdown_connections 2023-10-25T16:13:30.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:30.589+0000 7f467e27b640 1 -- 172.21.15.177:0/3869815475 wait complete. 2023-10-25T16:13:30.614 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:13:30.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:13:30.615 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:13:30.615 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:13:30.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:30.617 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:13:30.617 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:13:30.617 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:13:30.618 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:13:30.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.619 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:13:30.626 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:30.626 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:30.626 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:30.627 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:30.627 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:30.627 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:30.627 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:30.627 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:30.628 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:13:30.628 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:30.628 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:30.628 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:13:30.628 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:30.628 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:30.629 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:13:30.629 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:30.629 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:13:30.629 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-10-25T16:13:30.629 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:13:30.630 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:30.630 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:13:30.630 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:30.630 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:13:30.630 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:30.631 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-25T16:13:30.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.631 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:30.632 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:30.632 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-10-25T16:13:30.632 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-10-25T16:13:30.632 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-10-25T16:13:30.634 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-25T16:13:30.634 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:30.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.712 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:13:30.763 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:13:30.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.765 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:13:30.829 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:13:30.830 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:13:30.830 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:13:30.830 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:13:30.831 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:13:30.831 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:13:30.831 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:30.831 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:30.831 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:30.832 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:13:30.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.832 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:30.833 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:30.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:13:30.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:13:30.834 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:13:30.834 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:30.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.907 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:13:30.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:30.954 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-25T16:13:31.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:31.003 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:31.004 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:31.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:31.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-25T16:13:31.005 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:31.071 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-25T16:13:31.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:31.072 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:31.072 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:31.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-25T16:13:31.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-25T16:13:31.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-25T16:13:31.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-25T16:13:31.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-25T16:13:31.074 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:31.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:31.177 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:31.177 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:31.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:13:31.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-10-25T16:13:31.178 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:31.197 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:13:31.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:31.198 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:31.249 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:13:31.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:31.250 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:31.296 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:31.346 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:13:31.346 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:13:31.346 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:13:31.347 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:13:31.347 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:13:31.347 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:13:31.347 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:13:31.348 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:13:31.348 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:13:31.348 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:13:31.348 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:13:31.348 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:13:31.349 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:31.349 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:13:31.349 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:13:31.349 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:13:31.350 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:13:31.350 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:13:31.350 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:31.350 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:13:31.350 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:31.351 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:13:31.351 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:13:31.351 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:13:31.351 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:13:31.351 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:13:31.351 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:13:31.352 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:13:31.352 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:13:31.352 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:31.352 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:31.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:31.354 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:13:31.401 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:13:31.402 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:13:31.446 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:31.452 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:13:31.452 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:13:31.452 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:13:31.452 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:13:31.453 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:13:31.453 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:13:31.453 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:13:31.453 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:13:31.453 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:13:31.453 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:13:31.454 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:13:31.454 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:13:31.454 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:31.454 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:13:31.454 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:13:31.455 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:13:31.455 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:13:31.455 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:13:31.455 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:31.455 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:13:31.456 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:31.456 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:13:31.456 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:13:31.456 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:13:31.456 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:13:31.457 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:13:31.457 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:13:31.457 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:13:31.457 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:13:31.457 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:31.457 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:31.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:31.459 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:13:31.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:13:31.530+0000 7fe6489ce580 -1 init, newargv = 0x56096e523440 newargc=15 2023-10-25T16:13:31.534 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[33748]: starting ceph client 2023-10-25T16:13:31.537 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[33748]: starting fuse 2023-10-25T16:13:32.609 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:32.618 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:13:32.618 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:13:32.618 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:13:32.619 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:13:32.619 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:13:32.619 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:13:32.619 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:13:32.619 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:13:32.620 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:13:32.620 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:13:32.620 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:13:32.620 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:13:32.620 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:32.621 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:13:32.621 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:13:32.621 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:13:32.621 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:13:32.621 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:13:32.622 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:32.622 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:13:32.622 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:32.622 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:13:32.623 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:13:32.623 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:13:32.623 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:13:32.623 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:13:32.623 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:13:32.624 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:13:32.624 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:13:32.624 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:32.624 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:32.624 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:32.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:32.625 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:13:32.670 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:13:32.670 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:13:32.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:13:32.671 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:13:32.671 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:13:32.671 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:13:32.672 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:13:32.672 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:32.672 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:13:32.673 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:13:32.673 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:13:32.673 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:13:32.673 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:32.674 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:13:32.674 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:13:32.674 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:13:32.675 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:13:32.675 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:32.675 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:13:32.675 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:13:32.676 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:13:32.676 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:13:32.676 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:13:32.677 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:13:32.677 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:13:32.677 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:13:32.678 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:32.678 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:13:32.678 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:13:32.796 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.33748.asok 2023-10-25T16:13:32.799 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:32.807 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33748.asok 2023-10-25T16:13:32.807 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:32.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.33748.asok status 2023-10-25T16:13:32.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:32.995 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:13:32.996 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:13:32.996 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:13:32.996 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:13:32.996 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:13:32.996 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:13:32.997 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:13:32.997 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "33748", 2023-10-25T16:13:32.997 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:13:32.997 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:32.997 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:13:32.998 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:13:32.998 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 154370, 2023-10-25T16:13:32.998 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:13:32.998 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:13:32.999 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:13:32.999 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 154370 2023-10-25T16:13:32.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:32.999 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:13:33.000 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:13:33.000 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:13:33.000 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 2661263940 2023-10-25T16:13:33.000 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:13:33.000 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:13:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:13:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:13:33.001 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 2661263940 2023-10-25T16:13:33.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:33.002 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.154370 192.168.0.1:0/2661263940", 2023-10-25T16:13:33.002 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/2661263940", 2023-10-25T16:13:33.002 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:13:33.002 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 6, 2023-10-25T16:13:33.003 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 21, 2023-10-25T16:13:33.003 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:13:33.003 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:13:33.003 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:13:33.003 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:13:33.008 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:33.015 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:13:33.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- 172.21.15.177:0/1459176734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0041537d0 msgr2=0x7ff0040caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 --2- 172.21.15.177:0/1459176734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0041537d0 0x7ff0040caf90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec01c890 comp rx=0 tx=0).stop 2023-10-25T16:13:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- 172.21.15.177:0/1459176734 shutdown_connections 2023-10-25T16:13:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 --2- 172.21.15.177:0/1459176734 >> v2:172.21.15.184:3300/0 conn(0x7ff00415cdd0 0x7ff00415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 --2- 172.21.15.177:0/1459176734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0041537d0 0x7ff0040caf90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- 172.21.15.177:0/1459176734 >> 172.21.15.177:0/1459176734 conn(0x7ff0040b2450 msgr2=0x7ff0040b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- 172.21.15.177:0/1459176734 shutdown_connections 2023-10-25T16:13:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- 172.21.15.177:0/1459176734 wait complete. 2023-10-25T16:13:33.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 Processor -- start 2023-10-25T16:13:33.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- start start 2023-10-25T16:13:33.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 0x7ff00414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:33.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0041537d0 0x7ff004138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:33.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff00415cdd0 0x7ff004158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:33.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00414b3a0 con 0x7ff00406b9e0 2023-10-25T16:13:33.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040b0030 con 0x7ff0041537d0 2023-10-25T16:13:33.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff009fda640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040b0bb0 con 0x7ff00415cdd0 2023-10-25T16:13:33.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 0x7ff00414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:33.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 0x7ff00414ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52728/0 (socket says 172.21.15.177:52728) 2023-10-25T16:13:33.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 -- 172.21.15.177:0/4223564176 learned_addr learned my addr 172.21.15.177:0/4223564176 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:33.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff002ffd640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0041537d0 0x7ff004138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:33.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff003fff640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff00415cdd0 0x7ff004158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:33.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 -- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff00415cdd0 msgr2=0x7ff004158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:33.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff00415cdd0 0x7ff004158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 -- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0041537d0 msgr2=0x7ff004138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:33.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0041537d0 0x7ff004138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff0037fe640 1 -- 172.21.15.177:0/4223564176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec009560 con 0x7ff00406b9e0 2023-10-25T16:13:33.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff002ffd640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0041537d0 0x7ff004138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:33.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.145+0000 7ff003fff640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff00415cdd0 0x7ff004158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:33.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7ff0037fe640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 0x7ff00414ae60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fefec009850 tx=0x7fefec005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:33.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec005230 con 0x7ff00406b9e0 2023-10-25T16:13:33.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefec005480 con 0x7ff00406b9e0 2023-10-25T16:13:33.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0040b0280 con 0x7ff00406b9e0 2023-10-25T16:13:33.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefec004930 con 0x7ff00406b9e0 2023-10-25T16:13:33.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0040b0840 con 0x7ff00406b9e0 2023-10-25T16:13:33.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00404daf0 con 0x7ff00406b9e0 2023-10-25T16:13:33.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefec0b4040 con 0x7ff00406b9e0 2023-10-25T16:13:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7feffbfff640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fefe4066470 0x7fefe4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefec11dd60 con 0x7ff00406b9e0 2023-10-25T16:13:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7ff002ffd640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fefe4066470 0x7fefe4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.149+0000 7ff002ffd640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fefe4066470 0x7fefe4068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff00414a400 tx=0x7feff4005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.153+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fefec0eb1e0 con 0x7ff00406b9e0 2023-10-25T16:13:33.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.341+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff0040afd80 con 0x7ff00406b9e0 2023-10-25T16:13:33.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.341+0000 7feffbfff640 1 -- 172.21.15.177:0/4223564176 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fefec0b2060 con 0x7ff00406b9e0 2023-10-25T16:13:33.349 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:13:33.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fefe4066470 msgr2=0x7fefe4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:33.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fefe4066470 0x7fefe4068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff00414a400 tx=0x7feff4005f40 comp rx=0 tx=0).stop 2023-10-25T16:13:33.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 msgr2=0x7ff00414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:33.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 0x7ff00414ae60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fefec009850 tx=0x7fefec005e70 comp rx=0 tx=0).stop 2023-10-25T16:13:33.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 shutdown_connections 2023-10-25T16:13:33.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fefe4066470 0x7fefe4068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff00415cdd0 0x7ff004158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0041537d0 0x7ff004138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 --2- 172.21.15.177:0/4223564176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff00406b9e0 0x7ff00414ae60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:33.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 >> 172.21.15.177:0/4223564176 conn(0x7ff0040b2450 msgr2=0x7ff004070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:33.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 shutdown_connections 2023-10-25T16:13:33.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:33.345+0000 7ff009fda640 1 -- 172.21.15.177:0/4223564176 wait complete. 2023-10-25T16:13:33.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:13:33.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:13:33.369 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:13:33.369 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-25T16:13:33.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:33.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:13:33.370 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:13:33.370 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:13:33.370 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-25T16:13:33.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.371 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:13:33.378 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:33.378 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:33.379 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:33.379 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.379 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:33.379 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.379 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:33.380 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:33.380 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:13:33.380 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:33.380 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:33.380 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:13:33.381 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:13:33.381 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:33.381 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:13:33.381 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:33.381 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:13:33.381 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42486sec preferred_lft 42486sec 2023-10-25T16:13:33.382 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:13:33.382 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.382 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:13:33.382 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:33.383 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:13:33.383 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.383 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:13:33.383 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:13:33.383 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:13:33.384 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.384 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:13:33.384 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.384 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:13:33.384 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:33.385 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:13:33.385 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.385 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:13:33.432 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:13:33.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.434 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:13:33.484 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:13:33.485 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:13:33.485 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:13:33.485 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:13:33.485 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:13:33.485 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:13:33.486 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:33.486 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:33.486 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:13:33.486 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:13:33.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.487 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:33.487 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:33.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:13:33.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:13:33.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:13:33.488 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:33.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.561 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:13:33.614 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:13:33.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.615 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-25T16:13:33.661 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-25T16:13:33.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.662 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:33.662 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:33.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:33.663 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-25T16:13:33.663 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:33.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.732 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-25T16:13:33.786 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:33.786 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:33.787 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:33.787 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.787 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:33.787 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.788 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:13:33.788 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 4a:e8:c7:6f:20:0b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-25T16:13:33.788 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-25T16:13:33.788 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.788 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::48e8:c7ff:fe6f:200b/64 scope link 2023-10-25T16:13:33.789 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-25T16:13:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:13:33.846 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:13:33.846 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:13:33.846 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.846 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:13:33.847 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.847 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:13:33.847 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 4a:e8:c7:6f:20:0b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-25T16:13:33.847 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-25T16:13:33.847 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.848 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::48e8:c7ff:fe6f:200b/64 scope link 2023-10-25T16:13:33.848 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:13:33.849 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-25T16:13:33.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.850 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:33.850 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:33.850 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-25T16:13:33.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-25T16:13:33.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-25T16:13:33.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-25T16:13:33.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-25T16:13:33.852 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:33.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:33.948 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:13:33.948 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:13:33.948 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-10-25T16:13:33.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-10-25T16:13:33.949 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:13:33.968 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-25T16:13:33.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:33.969 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:34.018 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-25T16:13:34.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:13:34.019 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:34.064 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:13:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:13:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:13:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:13:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:13:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:13:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:13:34.116 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:13:34.116 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:13:34.116 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:13:34.116 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:13:34.116 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:13:34.117 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:34.117 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:13:34.117 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:13:34.117 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:13:34.117 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:13:34.118 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:13:34.118 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:34.118 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:13:34.118 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:34.118 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:13:34.119 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:13:34.119 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:13:34.119 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:13:34.119 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:13:34.119 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:13:34.120 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:13:34.120 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:13:34.120 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:34.120 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:34.121 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:34.121 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:34.121 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:34.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:34.122 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:13:34.170 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:13:34.170 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-10-25T16:13:34.171 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-25T16:13:34.214 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:34.221 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:13:34.221 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:13:34.222 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:13:34.222 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:13:34.222 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:13:34.222 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:13:34.222 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:13:34.223 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:13:34.223 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:13:34.223 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:13:34.223 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:13:34.223 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:13:34.224 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:34.224 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:13:34.224 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:13:34.224 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:13:34.224 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:13:34.225 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:13:34.225 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:34.225 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:13:34.225 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:34.225 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:13:34.226 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:13:34.226 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:13:34.226 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:13:34.226 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:13:34.226 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:13:34.227 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:13:34.227 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:13:34.227 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:34.227 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:34.227 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:34.228 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:34.228 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:34.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:34.229 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:13:34.276 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:13:34.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:2023-10-25T16:13:34.294+0000 7fc0b2cbc580 -1 init, newargv = 0x562f8d9ef440 newargc=15 2023-10-25T16:13:34.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:ceph-fuse[33858]: starting ceph client 2023-10-25T16:13:34.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:ceph-fuse[33858]: starting fuse 2023-10-25T16:13:35.378 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:13:35.386 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:13:35.387 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:13:35.387 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:13:35.388 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:13:35.388 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:13:35.388 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:13:35.389 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:13:35.389 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:13:35.389 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:13:35.390 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:13:35.390 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:13:35.390 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:13:35.391 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:13:35.391 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:13:35.391 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:13:35.391 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:13:35.391 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:13:35.392 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:13:35.392 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:13:35.392 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:13:35.392 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:13:35.392 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:13:35.393 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:13:35.393 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:13:35.393 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:13:35.393 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:13:35.393 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:13:35.394 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:13:35.394 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:13:35.394 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:35.394 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:13:35.394 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:13:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:35.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:35.396 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:13:35.441 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:13:35.442 INFO:teuthology.orchestra.run.smithi184.stdout:46 2023-10-25T16:13:35.442 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-10-25T16:13:35.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:13:35.443 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:13:35.444 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:13:35.444 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:13:35.444 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:13:35.444 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:35.445 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:13:35.445 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-25T16:13:35.445 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:13:35.446 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-25T16:13:35.446 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:35.446 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:13:35.446 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:13:35.447 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:13:35.447 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:13:35.448 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:35.449 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:13:35.450 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:13:35.450 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:13:35.451 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:13:35.451 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:13:35.452 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:13:35.452 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:13:35.452 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:13:35.453 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:13:35.454 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.3")) 2023-10-25T16:13:35.454 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:13:35.566 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.3.33858.asok 2023-10-25T16:13:35.570 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:35.579 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33858.asok 2023-10-25T16:13:35.579 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:35.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.33858.asok status 2023-10-25T16:13:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:35.770 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:13:35.770 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:13:35.770 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:13:35.770 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:13:35.771 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "3", 2023-10-25T16:13:35.771 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:13:35.771 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-25T16:13:35.771 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "33858", 2023-10-25T16:13:35.771 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:13:35.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:35.772 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:13:35.772 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:13:35.772 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 4618, 2023-10-25T16:13:35.772 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:13:35.773 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:13:35.773 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:13:35.773 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 4618 2023-10-25T16:13:35.773 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:35.773 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:13:35.774 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:13:35.774 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.2:0", 2023-10-25T16:13:35.774 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 3387679719 2023-10-25T16:13:35.774 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:13:35.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:35.775 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:13:35.775 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:13:35.775 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.2:0", 2023-10-25T16:13:35.775 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 3387679719 2023-10-25T16:13:35.775 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:13:35.776 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.4618 192.168.0.2:0/3387679719", 2023-10-25T16:13:35.776 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.2:0/3387679719", 2023-10-25T16:13:35.776 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:13:35.776 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 6, 2023-10-25T16:13:35.776 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 21, 2023-10-25T16:13:35.777 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:13:35.777 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:13:35.777 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:13:35.777 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:13:35.783 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:35.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:35.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:13:35.791 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:35.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:35.848 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:13:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:35.855 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:35.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:35.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:35.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:35.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:35.917 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:35.917 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:13:35.918 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:35.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:35.967 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:13:35.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:35.975 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:35.975 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:35.976 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:36.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:36.071 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:36.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:13:36.072 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:36.125 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:36.127 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:13:36.127 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:36.134 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:36.134 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:36.135 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:36.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:36.190 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:36.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:13:36.191 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:36.236 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:36.238 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:13:36.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:36.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:36.245 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:36.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:36.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:36.293 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:36.299 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-25T16:13:36.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:36.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 -- 172.21.15.177:0/2571765965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340c9b70 msgr2=0x7f84340cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 --2- 172.21.15.177:0/2571765965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340c9b70 0x7f84340cad80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f84340af820 tx=0x7f842401c780 comp rx=0 tx=0).stop 2023-10-25T16:13:36.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 -- 172.21.15.177:0/2571765965 shutdown_connections 2023-10-25T16:13:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 --2- 172.21.15.177:0/2571765965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340c9b70 0x7f84340cad80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 --2- 172.21.15.177:0/2571765965 >> v2:172.21.15.184:3300/0 conn(0x7f84341577a0 0x7f84340cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 -- 172.21.15.177:0/2571765965 >> 172.21.15.177:0/2571765965 conn(0x7f84340b2450 msgr2=0x7f84340b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 -- 172.21.15.177:0/2571765965 shutdown_connections 2023-10-25T16:13:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.469+0000 7f843c318640 1 -- 172.21.15.177:0/2571765965 wait complete. 2023-10-25T16:13:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 Processor -- start 2023-10-25T16:13:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- start start 2023-10-25T16:13:36.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340ca220 0x7f843414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84341577a0 0x7f84341389e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 0x7f84340ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340aec90 con 0x7f84340ae2c0 2023-10-25T16:13:36.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843414a750 con 0x7f84341577a0 2023-10-25T16:13:36.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8434150670 con 0x7f84340ca220 2023-10-25T16:13:36.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 0x7f84340ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 0x7f84340ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52752/0 (socket says 172.21.15.177:52752) 2023-10-25T16:13:36.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 -- 172.21.15.177:0/81587903 learned_addr learned my addr 172.21.15.177:0/81587903 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:36.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f84398b3640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84341577a0 0x7f84341389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a0b4640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340ca220 0x7f843414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 -- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340ca220 msgr2=0x7f843414a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340ca220 0x7f843414a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 -- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84341577a0 msgr2=0x7f84341389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84341577a0 0x7f84341389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 -- 172.21.15.177:0/81587903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009500 con 0x7f84340ae2c0 2023-10-25T16:13:36.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843a8b5640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 0x7f84340ae750 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f842c00c780 tx=0x7f842c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:36.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c004b70 con 0x7f84340ae2c0 2023-10-25T16:13:36.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f842c00ce90 con 0x7f84340ae2c0 2023-10-25T16:13:36.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8434152a70 con 0x7f84340ae2c0 2023-10-25T16:13:36.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00aa50 con 0x7f84340ae2c0 2023-10-25T16:13:36.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8434153030 con 0x7f84340ae2c0 2023-10-25T16:13:36.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.473+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84341528d0 con 0x7f84340ae2c0 2023-10-25T16:13:36.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.477+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f842c00abb0 con 0x7f84340ae2c0 2023-10-25T16:13:36.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.477+0000 7f842affd640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84180664a0 0x7f8418068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.477+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f842c084440 con 0x7f84340ae2c0 2023-10-25T16:13:36.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.477+0000 7f843a0b4640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84180664a0 0x7f8418068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.477+0000 7f843a0b4640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84180664a0 0x7f8418068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f84300058d0 tx=0x7f8430005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:36.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.481+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84341528d0 con 0x7f84340ae2c0 2023-10-25T16:13:36.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.633+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8434146b70 con 0x7f84340ae2c0 2023-10-25T16:13:36.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f842affd640 1 -- 172.21.15.177:0/81587903 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f8434146b70 con 0x7f84340ae2c0 2023-10-25T16:13:36.640 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:36.640 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84180664a0 msgr2=0x7f8418068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84180664a0 0x7f8418068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f84300058d0 tx=0x7f8430005860 comp rx=0 tx=0).stop 2023-10-25T16:13:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 msgr2=0x7f84340ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 0x7f84340ae750 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f842c00c780 tx=0x7f842c00cc40 comp rx=0 tx=0).stop 2023-10-25T16:13:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 shutdown_connections 2023-10-25T16:13:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84180664a0 0x7f8418068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84340ae2c0 0x7f84340ae750 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84341577a0 0x7f84341389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 --2- 172.21.15.177:0/81587903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84340ca220 0x7f843414a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.637+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 >> 172.21.15.177:0/81587903 conn(0x7f84340b2450 msgr2=0x7f84340ace20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:36.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.641+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 shutdown_connections 2023-10-25T16:13:36.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.641+0000 7f843c318640 1 -- 172.21.15.177:0/81587903 wait complete. 2023-10-25T16:13:36.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:36.660 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:36.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1937656954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737006b980 msgr2=0x7f737006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 --2- 172.21.15.177:0/1937656954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737006b980 0x7f737006be10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73700ccde0 tx=0x7f736801ccd0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1937656954 shutdown_connections 2023-10-25T16:13:36.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 --2- 172.21.15.177:0/1937656954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737006b980 0x7f737006be10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 --2- 172.21.15.177:0/1937656954 >> v2:172.21.15.184:3300/0 conn(0x7f7370159230 0x7f7370071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1937656954 >> 172.21.15.177:0/1937656954 conn(0x7f73700b2450 msgr2=0x7f73700b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:36.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1937656954 shutdown_connections 2023-10-25T16:13:36.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1937656954 wait complete. 2023-10-25T16:13:36.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 Processor -- start 2023-10-25T16:13:36.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- start start 2023-10-25T16:13:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f737006b980 0x7f73701467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 0x7f73701351c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7370159230 0x7f7370153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370135700 con 0x7f7370070510 2023-10-25T16:13:36.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370147a90 con 0x7f737006b980 2023-10-25T16:13:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7370153e40 con 0x7f7370159230 2023-10-25T16:13:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 0x7f73701351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 0x7f73701351c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52774/0 (socket says 172.21.15.177:52774) 2023-10-25T16:13:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 -- 172.21.15.177:0/1115415964 learned_addr learned my addr 172.21.15.177:0/1115415964 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:36.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7376454640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f737006b980 0x7f73701467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7376c55640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7370159230 0x7f7370153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 -- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7370159230 msgr2=0x7f7370153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7370159230 0x7f7370153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 -- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f737006b980 msgr2=0x7f73701467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f737006b980 0x7f73701467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 -- 172.21.15.177:0/1115415964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680098e0 con 0x7f7370070510 2023-10-25T16:13:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7376c55640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7370159230 0x7f7370153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7375c53640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 0x7f73701351c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f736000c410 tx=0x7f736000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360003600 con 0x7f7370070510 2023-10-25T16:13:36.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7360003760 con 0x7f7370070510 2023-10-25T16:13:36.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370146e80 con 0x7f7370070510 2023-10-25T16:13:36.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360003bb0 con 0x7f7370070510 2023-10-25T16:13:36.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.781+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7370147440 con 0x7f7370070510 2023-10-25T16:13:36.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.785+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737004daf0 con 0x7f7370070510 2023-10-25T16:13:36.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.785+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7360003d10 con 0x7f7370070510 2023-10-25T16:13:36.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.785+0000 7f7366ffd640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7354066470 0x7f7354068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.785+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7360083650 con 0x7f7370070510 2023-10-25T16:13:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.785+0000 7f7376454640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7354066470 0x7f7354068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.785+0000 7f7376454640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7354066470 0x7f7354068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f736c006fd0 tx=0x7f736c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.789+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7360050ad0 con 0x7f7370070510 2023-10-25T16:13:36.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73700ca680 con 0x7f7370070510 2023-10-25T16:13:36.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f7366ffd640 1 -- 172.21.15.177:0/1115415964 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73600170a0 con 0x7f7370070510 2023-10-25T16:13:36.936 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:36.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7354066470 msgr2=0x7f7354068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7354066470 0x7f7354068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f736c006fd0 tx=0x7f736c008040 comp rx=0 tx=0).stop 2023-10-25T16:13:36.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 msgr2=0x7f73701351c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:36.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 0x7f73701351c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f736000c410 tx=0x7f736000c8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 shutdown_connections 2023-10-25T16:13:36.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7354066470 0x7f7354068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7370159230 0x7f7370153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7370070510 0x7f73701351c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 --2- 172.21.15.177:0/1115415964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f737006b980 0x7f73701467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:36.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 >> 172.21.15.177:0/1115415964 conn(0x7f73700b2450 msgr2=0x7f7370149330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:36.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 shutdown_connections 2023-10-25T16:13:36.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:36.933+0000 7f73786b8640 1 -- 172.21.15.177:0/1115415964 wait complete. 2023-10-25T16:13:36.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:37.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- 172.21.15.177:0/942114580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a40af2d0 msgr2=0x7f58a4158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 --2- 172.21.15.177:0/942114580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a40af2d0 0x7f58a4158170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f589c00acd0 tx=0x7f589c01ded0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- 172.21.15.177:0/942114580 shutdown_connections 2023-10-25T16:13:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 --2- 172.21.15.177:0/942114580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a40af2d0 0x7f58a4158170 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 --2- 172.21.15.177:0/942114580 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58a414e810 0x7f58a40cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- 172.21.15.177:0/942114580 >> 172.21.15.177:0/942114580 conn(0x7f58a40b2450 msgr2=0x7f58a40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:37.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- 172.21.15.177:0/942114580 shutdown_connections 2023-10-25T16:13:37.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- 172.21.15.177:0/942114580 wait complete. 2023-10-25T16:13:37.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 Processor -- start 2023-10-25T16:13:37.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- start start 2023-10-25T16:13:37.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58a40af2d0 0x7f58a4143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a414e810 0x7f58a41464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 0x7f58a4146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4144520 con 0x7f58a415bdb0 2023-10-25T16:13:37.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a406f910 con 0x7f58a414e810 2023-10-25T16:13:37.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a8c56640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a414a260 con 0x7f58a40af2d0 2023-10-25T16:13:37.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 0x7f58a4146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 0x7f58a4146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52776/0 (socket says 172.21.15.177:52776) 2023-10-25T16:13:37.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 -- 172.21.15.177:0/4219999741 learned_addr learned my addr 172.21.15.177:0/4219999741 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:37.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f5899d9b640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a414e810 0x7f58a41464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a259c640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58a40af2d0 0x7f58a4143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 -- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58a40af2d0 msgr2=0x7f58a4143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58a40af2d0 0x7f58a4143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 -- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a414e810 msgr2=0x7f58a41464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a414e810 0x7f58a41464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 -- 172.21.15.177:0/4219999741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894009560 con 0x7f58a415bdb0 2023-10-25T16:13:37.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.081+0000 7f58a2d9d640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 0x7f58a4146a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f589c00ac20 tx=0x7f589c0a6bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:37.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c003d90 con 0x7f58a415bdb0 2023-10-25T16:13:37.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f589c004030 con 0x7f58a415bdb0 2023-10-25T16:13:37.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589c00a930 con 0x7f58a415bdb0 2023-10-25T16:13:37.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c004420 con 0x7f58a415bdb0 2023-10-25T16:13:37.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a414a820 con 0x7f58a415bdb0 2023-10-25T16:13:37.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a406fac0 con 0x7f58a415bdb0 2023-10-25T16:13:37.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f589c0b5040 con 0x7f58a415bdb0 2023-10-25T16:13:37.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f589b7fe640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f589c11e7d0 con 0x7f58a415bdb0 2023-10-25T16:13:37.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f58a259c640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.085+0000 7f58a259c640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5894009d00 tx=0x7f5894009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:37.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.089+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f589c0ebbb0 con 0x7f58a415bdb0 2023-10-25T16:13:37.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.241+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58a404daf0 con 0x7f58a415bdb0 2023-10-25T16:13:37.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.241+0000 7f589b7fe640 1 -- 172.21.15.177:0/4219999741 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f589c0b3020 con 0x7f58a415bdb0 2023-10-25T16:13:37.245 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:37.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 msgr2=0x7f5884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5894009d00 tx=0x7f5894009260 comp rx=0 tx=0).stop 2023-10-25T16:13:37.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 msgr2=0x7f58a4146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 0x7f58a4146a10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f589c00ac20 tx=0x7f589c0a6bb0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 shutdown_connections 2023-10-25T16:13:37.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58a415bdb0 0x7f58a4146a10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a414e810 0x7f58a41464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 --2- 172.21.15.177:0/4219999741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58a40af2d0 0x7f58a4143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 >> 172.21.15.177:0/4219999741 conn(0x7f58a40b2450 msgr2=0x7f58a4069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:37.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 shutdown_connections 2023-10-25T16:13:37.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.245+0000 7f58a8c56640 1 -- 172.21.15.177:0/4219999741 wait complete. 2023-10-25T16:13:37.265 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:37.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3676042359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 msgr2=0x7f15e806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3676042359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e806be10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15e806c6a0 tx=0x7f15e001ccf0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3676042359 shutdown_connections 2023-10-25T16:13:37.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3676042359 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e806be10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3676042359 >> v2:172.21.15.184:3300/0 conn(0x7f15e8071500 0x7f15e8070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3676042359 >> 172.21.15.177:0/3676042359 conn(0x7f15e80b2450 msgr2=0x7f15e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:37.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3676042359 shutdown_connections 2023-10-25T16:13:37.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3676042359 wait complete. 2023-10-25T16:13:37.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 Processor -- start 2023-10-25T16:13:37.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- start start 2023-10-25T16:13:37.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e8146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15e8071500 0x7f15e8149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15e8159230 0x7f15e8149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8156560 con 0x7f15e806b980 2023-10-25T16:13:37.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e814e700 con 0x7f15e8159230 2023-10-25T16:13:37.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e814e140 con 0x7f15e8071500 2023-10-25T16:13:37.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e8146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e8146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52790/0 (socket says 172.21.15.177:52790) 2023-10-25T16:13:37.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 -- 172.21.15.177:0/3309601017 learned_addr learned my addr 172.21.15.177:0/3309601017 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:37.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e6d9d640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15e8159230 0x7f15e8149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e5d9b640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15e8071500 0x7f15e8149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 -- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15e8071500 msgr2=0x7f15e8149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15e8071500 0x7f15e8149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 -- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15e8159230 msgr2=0x7f15e8149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15e8159230 0x7f15e8149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 -- 172.21.15.177:0/3309601017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00098e0 con 0x7f15e806b980 2023-10-25T16:13:37.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15e659c640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e8146720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b410 tx=0x7f15d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:37.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8004020 con 0x7f15e806b980 2023-10-25T16:13:37.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f15d8004270 con 0x7f15e806b980 2023-10-25T16:13:37.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e814e420 con 0x7f15e806b980 2023-10-25T16:13:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011890 con 0x7f15e806b980 2023-10-25T16:13:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.389+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e8156280 con 0x7f15e806b980 2023-10-25T16:13:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.393+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e804daf0 con 0x7f15e806b980 2023-10-25T16:13:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.393+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f15d8003600 con 0x7f15e806b980 2023-10-25T16:13:37.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.393+0000 7f15d6ffd640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15c8066470 0x7f15c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.393+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15d8083f20 con 0x7f15e806b980 2023-10-25T16:13:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.393+0000 7f15e5d9b640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15c8066470 0x7f15c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.393+0000 7f15e5d9b640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15c8066470 0x7f15c8068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15e81f5ca0 tx=0x7f15dc005c60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:37.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.397+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15d8051310 con 0x7f15e806b980 2023-10-25T16:13:37.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.549+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15e80c9940 con 0x7f15e806b980 2023-10-25T16:13:37.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.549+0000 7f15d6ffd640 1 -- 172.21.15.177:0/3309601017 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15d80150a0 con 0x7f15e806b980 2023-10-25T16:13:37.553 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:37.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15c8066470 msgr2=0x7f15c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15c8066470 0x7f15c8068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15e81f5ca0 tx=0x7f15dc005c60 comp rx=0 tx=0).stop 2023-10-25T16:13:37.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 msgr2=0x7f15e8146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e8146720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f15d800b410 tx=0x7f15d800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 shutdown_connections 2023-10-25T16:13:37.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15c8066470 0x7f15c8068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15e8159230 0x7f15e8149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15e8071500 0x7f15e8149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 --2- 172.21.15.177:0/3309601017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f15e806b980 0x7f15e8146720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 >> 172.21.15.177:0/3309601017 conn(0x7f15e80b2450 msgr2=0x7f15e80cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:37.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 shutdown_connections 2023-10-25T16:13:37.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.553+0000 7f15ecb48640 1 -- 172.21.15.177:0/3309601017 wait complete. 2023-10-25T16:13:37.572 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:37.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- 172.21.15.177:0/4146531671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c15bdb0 msgr2=0x7eff5c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- 172.21.15.177:0/4146531671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c15bdb0 0x7eff5c0aebc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff5c155980 tx=0x7eff5001c880 comp rx=0 tx=0).stop 2023-10-25T16:13:37.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- 172.21.15.177:0/4146531671 shutdown_connections 2023-10-25T16:13:37.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- 172.21.15.177:0/4146531671 >> v2:172.21.15.184:3300/0 conn(0x7eff5c0af100 0x7eff5c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- 172.21.15.177:0/4146531671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c15bdb0 0x7eff5c0aebc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- 172.21.15.177:0/4146531671 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 0x7eff5c0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- 172.21.15.177:0/4146531671 >> 172.21.15.177:0/4146531671 conn(0x7eff5c0b2450 msgr2=0x7eff5c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:37.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- 172.21.15.177:0/4146531671 shutdown_connections 2023-10-25T16:13:37.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- 172.21.15.177:0/4146531671 wait complete. 2023-10-25T16:13:37.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 Processor -- start 2023-10-25T16:13:37.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- start start 2023-10-25T16:13:37.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 0x7eff5c130600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 0x7eff5c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff5c15bdb0 0x7eff5c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c070230 con 0x7eff5c0af100 2023-10-25T16:13:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c131570 con 0x7eff5c15bdb0 2023-10-25T16:13:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff61734640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c14a990 con 0x7eff5c14e810 2023-10-25T16:13:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 0x7eff5c130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 0x7eff5c130600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52812/0 (socket says 172.21.15.177:52812) 2023-10-25T16:13:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 -- 172.21.15.177:0/730780412 learned_addr learned my addr 172.21.15.177:0/730780412 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5b7fe640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff5c15bdb0 0x7eff5c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5a7fc640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 0x7eff5c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 -- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 msgr2=0x7eff5c147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 0x7eff5c147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 -- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff5c15bdb0 msgr2=0x7eff5c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff5c15bdb0 0x7eff5c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 -- 172.21.15.177:0/730780412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50009500 con 0x7eff5c0af100 2023-10-25T16:13:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5a7fc640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 0x7eff5c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5b7fe640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff5c15bdb0 0x7eff5c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff5affd640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 0x7eff5c130600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c9a0 tx=0x7eff4c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c007bb0 con 0x7eff5c0af100 2023-10-25T16:13:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7eff4c007e20 con 0x7eff5c0af100 2023-10-25T16:13:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.697+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c005280 con 0x7eff5c0af100 2023-10-25T16:13:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c130cd0 con 0x7eff5c0af100 2023-10-25T16:13:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c131290 con 0x7eff5c0af100 2023-10-25T16:13:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c04daf0 con 0x7eff5c0af100 2023-10-25T16:13:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7eff4c0053e0 con 0x7eff5c0af100 2023-10-25T16:13:37.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff437fe640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7eff48066470 0x7eff48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:37.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff4c084680 con 0x7eff5c0af100 2023-10-25T16:13:37.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff5a7fc640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7eff48066470 0x7eff48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:37.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.701+0000 7eff5a7fc640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7eff48066470 0x7eff48068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff500ae000 tx=0x7eff5001b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:37.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.705+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff4c051b90 con 0x7eff5c0af100 2023-10-25T16:13:37.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.857+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff5c15b330 con 0x7eff5c0af100 2023-10-25T16:13:37.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.857+0000 7eff437fe640 1 -- 172.21.15.177:0/730780412 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7eff4c01d090 con 0x7eff5c0af100 2023-10-25T16:13:37.862 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:37.862 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:37.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7eff48066470 msgr2=0x7eff48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7eff48066470 0x7eff48068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff500ae000 tx=0x7eff5001b0c0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 msgr2=0x7eff5c130600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 0x7eff5c130600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c9a0 tx=0x7eff4c00ce60 comp rx=0 tx=0).stop 2023-10-25T16:13:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 shutdown_connections 2023-10-25T16:13:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7eff48066470 0x7eff48068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff5c15bdb0 0x7eff5c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff5c14e810 0x7eff5c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 --2- 172.21.15.177:0/730780412 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff5c0af100 0x7eff5c130600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 >> 172.21.15.177:0/730780412 conn(0x7eff5c0b2450 msgr2=0x7eff5c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 shutdown_connections 2023-10-25T16:13:37.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:37.861+0000 7eff61734640 1 -- 172.21.15.177:0/730780412 wait complete. 2023-10-25T16:13:37.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:37.880 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:38.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- 172.21.15.177:0/2611524965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc0cca70 msgr2=0x7f6fdc0ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 --2- 172.21.15.177:0/2611524965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc0cca70 0x7f6fdc0ad3f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009cb0 tx=0x7f6fd401cd40 comp rx=0 tx=0).stop 2023-10-25T16:13:38.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- 172.21.15.177:0/2611524965 shutdown_connections 2023-10-25T16:13:38.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 --2- 172.21.15.177:0/2611524965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc0cbb80 0x7f6fdc0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 --2- 172.21.15.177:0/2611524965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc0cca70 0x7f6fdc0ad3f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- 172.21.15.177:0/2611524965 >> 172.21.15.177:0/2611524965 conn(0x7f6fdc0caa30 msgr2=0x7f6fdc0cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- 172.21.15.177:0/2611524965 shutdown_connections 2023-10-25T16:13:38.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- 172.21.15.177:0/2611524965 wait complete. 2023-10-25T16:13:38.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 Processor -- start 2023-10-25T16:13:38.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- start start 2023-10-25T16:13:38.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc0cbb80 0x7f6fdc1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc0cca70 0x7f6fdc1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 0x7f6fdc15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc151e30 con 0x7f6fdc1592e0 2023-10-25T16:13:38.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ab4c0 con 0x7f6fdc0cbb80 2023-10-25T16:13:38.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe2796640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ab7a0 con 0x7f6fdc0cca70 2023-10-25T16:13:38.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 0x7f6fdc15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 0x7f6fdc15be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52834/0 (socket says 172.21.15.177:52834) 2023-10-25T16:13:38.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 -- 172.21.15.177:0/188951134 learned_addr learned my addr 172.21.15.177:0/188951134 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:38.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fdbfff640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc0cbb80 0x7f6fdc1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fdb7fe640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc0cca70 0x7f6fdc1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 -- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc0cca70 msgr2=0x7f6fdc1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc0cca70 0x7f6fdc1504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 -- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc0cbb80 msgr2=0x7f6fdc1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc0cbb80 0x7f6fdc1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.001+0000 7f6fe0d33640 1 -- 172.21.15.177:0/188951134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40098e0 con 0x7f6fdc1592e0 2023-10-25T16:13:38.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fe0d33640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 0x7f6fdc15be50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00b410 tx=0x7f6fcc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc011830 con 0x7f6fdc1592e0 2023-10-25T16:13:38.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6fcc011ac0 con 0x7f6fdc1592e0 2023-10-25T16:13:38.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc010380 con 0x7f6fdc1592e0 2023-10-25T16:13:38.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc0aba80 con 0x7f6fdc1592e0 2023-10-25T16:13:38.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0ac040 con 0x7f6fdc1592e0 2023-10-25T16:13:38.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc04daf0 con 0x7f6fdc1592e0 2023-10-25T16:13:38.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6fcc0104e0 con 0x7f6fdc1592e0 2023-10-25T16:13:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fd8ff9640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fbc066470 0x7f6fbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fcc083ec0 con 0x7f6fdc1592e0 2023-10-25T16:13:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fdbfff640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fbc066470 0x7f6fbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.005+0000 7f6fdbfff640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fbc066470 0x7f6fbc068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40af000 tx=0x7f6fd401b580 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.009+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fcc051340 con 0x7f6fdc1592e0 2023-10-25T16:13:38.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6fdc1598d0 con 0x7f6fdc1592e0 2023-10-25T16:13:38.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fd8ff9640 1 -- 172.21.15.177:0/188951134 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6fcc054960 con 0x7f6fdc1592e0 2023-10-25T16:13:38.168 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:38.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fbc066470 msgr2=0x7f6fbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fbc066470 0x7f6fbc068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40af000 tx=0x7f6fd401b580 comp rx=0 tx=0).stop 2023-10-25T16:13:38.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 msgr2=0x7f6fdc15be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 0x7f6fdc15be50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00b410 tx=0x7f6fcc00b8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 shutdown_connections 2023-10-25T16:13:38.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fbc066470 0x7f6fbc068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fdc1592e0 0x7f6fdc15be50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fdc0cca70 0x7f6fdc1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 --2- 172.21.15.177:0/188951134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fdc0cbb80 0x7f6fdc1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 >> 172.21.15.177:0/188951134 conn(0x7f6fdc0caa30 msgr2=0x7f6fdc0acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 shutdown_connections 2023-10-25T16:13:38.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.165+0000 7f6fe2796640 1 -- 172.21.15.177:0/188951134 wait complete. 2023-10-25T16:13:38.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- 172.21.15.177:0/153354498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa48003fe0 msgr2=0x7faa480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 --2- 172.21.15.177:0/153354498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa48003fe0 0x7faa480047d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa5400bb20 tx=0x7faa5401cd60 comp rx=0 tx=0).stop 2023-10-25T16:13:38.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 -- 172.21.15.177:0/153354498 reap_dead start 2023-10-25T16:13:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- 172.21.15.177:0/153354498 shutdown_connections 2023-10-25T16:13:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- 172.21.15.177:0/153354498 >> 172.21.15.177:0/153354498 conn(0x7faa600b2450 msgr2=0x7faa600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- 172.21.15.177:0/153354498 shutdown_connections 2023-10-25T16:13:38.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- 172.21.15.177:0/153354498 wait complete. 2023-10-25T16:13:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 Processor -- start 2023-10-25T16:13:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- start start 2023-10-25T16:13:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa48003fe0 0x7faa6014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa601efde0 0x7faa60158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 0x7faa601548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60154df0 con 0x7faa60154430 2023-10-25T16:13:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601f0340 con 0x7faa48003fe0 2023-10-25T16:13:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa663be640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa601f0620 con 0x7faa601efde0 2023-10-25T16:13:38.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 0x7faa601548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 0x7faa601548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52856/0 (socket says 172.21.15.177:52856) 2023-10-25T16:13:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 -- 172.21.15.177:0/964831966 learned_addr learned my addr 172.21.15.177:0/964831966 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa5f7fe640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa601efde0 0x7faa60158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa5ffff640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa48003fe0 0x7faa6014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 -- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa601efde0 msgr2=0x7faa60158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa601efde0 0x7faa60158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 -- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa48003fe0 msgr2=0x7faa6014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.313+0000 7faa6495b640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa48003fe0 0x7faa6014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa6495b640 1 -- 172.21.15.177:0/964831966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa601f0900 con 0x7faa60154430 2023-10-25T16:13:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa6495b640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 0x7faa601548b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa600ca4b0 tx=0x7faa5800dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58015030 con 0x7faa60154430 2023-10-25T16:13:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faa58003b90 con 0x7faa60154430 2023-10-25T16:13:38.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa601f0be0 con 0x7faa60154430 2023-10-25T16:13:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5800b800 con 0x7faa60154430 2023-10-25T16:13:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60158980 con 0x7faa60154430 2023-10-25T16:13:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa601f0dd0 con 0x7faa60154430 2023-10-25T16:13:38.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa58018070 con 0x7faa60154430 2023-10-25T16:13:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5cff9640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa4c0664a0 0x7faa4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa58016070 con 0x7faa60154430 2023-10-25T16:13:38.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5ffff640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa4c0664a0 0x7faa4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.317+0000 7faa5ffff640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa4c0664a0 0x7faa4c068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa500017b0 tx=0x7faa500015a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.321+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa580512c0 con 0x7faa60154430 2023-10-25T16:13:38.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa6004daf0 con 0x7faa60154430 2023-10-25T16:13:38.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa5cff9640 1 -- 172.21.15.177:0/964831966 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa580548e0 con 0x7faa60154430 2023-10-25T16:13:38.468 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:38.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa4c0664a0 msgr2=0x7faa4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa4c0664a0 0x7faa4c068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa500017b0 tx=0x7faa500015a0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 msgr2=0x7faa601548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 0x7faa601548b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa600ca4b0 tx=0x7faa5800dd80 comp rx=0 tx=0).stop 2023-10-25T16:13:38.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 shutdown_connections 2023-10-25T16:13:38.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa4c0664a0 0x7faa4c068960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa60154430 0x7faa601548b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa601efde0 0x7faa60158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 --2- 172.21.15.177:0/964831966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa48003fe0 0x7faa6014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 >> 172.21.15.177:0/964831966 conn(0x7faa600b2450 msgr2=0x7faa6014f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 shutdown_connections 2023-10-25T16:13:38.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.465+0000 7faa663be640 1 -- 172.21.15.177:0/964831966 wait complete. 2023-10-25T16:13:38.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:38.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/1417874780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c0c9e50 msgr2=0x7f1f1c06b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 --2- 172.21.15.177:0/1417874780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c0c9e50 0x7f1f1c06b980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0ccde0 tx=0x7f1f1001c700 comp rx=0 tx=0).stop 2023-10-25T16:13:38.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/1417874780 shutdown_connections 2023-10-25T16:13:38.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 --2- 172.21.15.177:0/1417874780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c0c9e50 0x7f1f1c06b980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 --2- 172.21.15.177:0/1417874780 >> v2:172.21.15.184:3300/0 conn(0x7f1f1c1500f0 0x7f1f1c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/1417874780 >> 172.21.15.177:0/1417874780 conn(0x7f1f1c0b2450 msgr2=0x7f1f1c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/1417874780 shutdown_connections 2023-10-25T16:13:38.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/1417874780 wait complete. 2023-10-25T16:13:38.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 Processor -- start 2023-10-25T16:13:38.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- start start 2023-10-25T16:13:38.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f1c06bec0 0x7f1f1c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f1c0c9e50 0x7f1f1c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 0x7f1f1c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c154c30 con 0x7f1f1c1500f0 2023-10-25T16:13:38.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c153d40 con 0x7f1f1c06bec0 2023-10-25T16:13:38.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c154020 con 0x7f1f1c0c9e50 2023-10-25T16:13:38.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 0x7f1f1c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 0x7f1f1c147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52876/0 (socket says 172.21.15.177:52876) 2023-10-25T16:13:38.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 -- 172.21.15.177:0/3521941949 learned_addr learned my addr 172.21.15.177:0/3521941949 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:38.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1affd640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f1c06bec0 0x7f1f1c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1a7fc640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f1c0c9e50 0x7f1f1c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 -- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f1c0c9e50 msgr2=0x7f1f1c1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f1c0c9e50 0x7f1f1c1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 -- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f1c06bec0 msgr2=0x7f1f1c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f1c06bec0 0x7f1f1c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 -- 172.21.15.177:0/3521941949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10009450 con 0x7f1f1c1500f0 2023-10-25T16:13:38.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1a7fc640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f1c0c9e50 0x7f1f1c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:38.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f1b7fe640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 0x7f1f1c147990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400cb10 tx=0x7f1f1400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1400aa50 con 0x7f1f1c1500f0 2023-10-25T16:13:38.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1f1400aca0 con 0x7f1f1c1500f0 2023-10-25T16:13:38.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14012680 con 0x7f1f1c1500f0 2023-10-25T16:13:38.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c154300 con 0x7f1f1c1500f0 2023-10-25T16:13:38.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.613+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c1548c0 con 0x7f1f1c1500f0 2023-10-25T16:13:38.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.617+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c154da0 con 0x7f1f1c1500f0 2023-10-25T16:13:38.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.617+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1f1401b410 con 0x7f1f1c1500f0 2023-10-25T16:13:38.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.617+0000 7f1f037fe640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f08066470 0x7f1f08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.617+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f140840b0 con 0x7f1f1c1500f0 2023-10-25T16:13:38.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.617+0000 7f1f1affd640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f08066470 0x7f1f08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.617+0000 7f1f1affd640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f08066470 0x7f1f08068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005fd0 tx=0x7f1f0c005db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.621+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f14051530 con 0x7f1f1c1500f0 2023-10-25T16:13:38.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f1c04daf0 con 0x7f1f1c1500f0 2023-10-25T16:13:38.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f037fe640 1 -- 172.21.15.177:0/3521941949 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f14054b50 con 0x7f1f1c1500f0 2023-10-25T16:13:38.788 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:38.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f08066470 msgr2=0x7f1f08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f08066470 0x7f1f08068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005fd0 tx=0x7f1f0c005db0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 msgr2=0x7f1f1c147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 0x7f1f1c147990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400cb10 tx=0x7f1f1400cc00 comp rx=0 tx=0).stop 2023-10-25T16:13:38.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 shutdown_connections 2023-10-25T16:13:38.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f08066470 0x7f1f08068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f1c1500f0 0x7f1f1c147990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f1c0c9e50 0x7f1f1c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 --2- 172.21.15.177:0/3521941949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f1c06bec0 0x7f1f1c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 >> 172.21.15.177:0/3521941949 conn(0x7f1f1c0b2450 msgr2=0x7f1f1c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 shutdown_connections 2023-10-25T16:13:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.785+0000 7f1f217d7640 1 -- 172.21.15.177:0/3521941949 wait complete. 2023-10-25T16:13:38.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:38.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.917+0000 7f76a9a5f640 1 -- 172.21.15.177:0/2680557046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f768c0039d0 msgr2=0x7f768c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.917+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/2680557046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f768c0039d0 0x7f768c003df0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f76940016b0 tx=0x7f769401c750 comp rx=0 tx=0).stop 2023-10-25T16:13:38.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/2680557046 shutdown_connections 2023-10-25T16:13:38.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/2680557046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f768c0039d0 0x7f768c003df0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/2680557046 >> 172.21.15.177:0/2680557046 conn(0x7f76a40b2450 msgr2=0x7f76a40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:38.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/2680557046 shutdown_connections 2023-10-25T16:13:38.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/2680557046 wait complete. 2023-10-25T16:13:38.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 Processor -- start 2023-10-25T16:13:38.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- start start 2023-10-25T16:13:38.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0039d0 0x7f76a4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a413ab10 0x7f76a413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 0x7f76a40a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a413b4d0 con 0x7f76a40a6ee0 2023-10-25T16:13:38.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a41f6440 con 0x7f768c0039d0 2023-10-25T16:13:38.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a41f66e0 con 0x7f76a413ab10 2023-10-25T16:13:38.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 0x7f76a40a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 0x7f76a40a7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52908/0 (socket says 172.21.15.177:52908) 2023-10-25T16:13:38.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 -- 172.21.15.177:0/200441743 learned_addr learned my addr 172.21.15.177:0/200441743 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:38.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a2ffd640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0039d0 0x7f76a4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a27fc640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a413ab10 0x7f76a413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 -- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a413ab10 msgr2=0x7f76a413af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a413ab10 0x7f76a413af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 -- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0039d0 msgr2=0x7f76a4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:38.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0039d0 0x7f76a4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:38.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 -- 172.21.15.177:0/200441743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a41f69c0 con 0x7f76a40a6ee0 2023-10-25T16:13:38.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a37fe640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 0x7f76a40a7390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f769c001340 tx=0x7f769c00dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00ded0 con 0x7f76a40a6ee0 2023-10-25T16:13:38.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f769c003b90 con 0x7f76a40a6ee0 2023-10-25T16:13:38.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c005030 con 0x7f76a40a6ee0 2023-10-25T16:13:38.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a41f6ca0 con 0x7f76a40a6ee0 2023-10-25T16:13:38.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a4158210 con 0x7f76a40a6ee0 2023-10-25T16:13:38.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.921+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a404daf0 con 0x7f76a40a6ee0 2023-10-25T16:13:38.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.925+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f769c005190 con 0x7f76a40a6ee0 2023-10-25T16:13:38.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.925+0000 7f768bfff640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f76900664a0 0x7f7690068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:38.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.925+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f769c0838f0 con 0x7f76a40a6ee0 2023-10-25T16:13:38.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.925+0000 7f76a2ffd640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f76900664a0 0x7f7690068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:38.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.925+0000 7f76a2ffd640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f76900664a0 0x7f7690068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7694001680 tx=0x7f76940194f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:38.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:38.929+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f769c050e10 con 0x7f76a40a6ee0 2023-10-25T16:13:39.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.073+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76a41f7150 con 0x7f76a40a6ee0 2023-10-25T16:13:39.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f768bfff640 1 -- 172.21.15.177:0/200441743 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f769c018070 con 0x7f76a40a6ee0 2023-10-25T16:13:39.079 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:39.079 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:39.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f76900664a0 msgr2=0x7f7690068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f76900664a0 0x7f7690068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7694001680 tx=0x7f76940194f0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 msgr2=0x7f76a40a7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 0x7f76a40a7390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f769c001340 tx=0x7f769c00dc80 comp rx=0 tx=0).stop 2023-10-25T16:13:39.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 shutdown_connections 2023-10-25T16:13:39.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f76900664a0 0x7f7690068960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76a40a6ee0 0x7f76a40a7390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76a413ab10 0x7f76a413af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 --2- 172.21.15.177:0/200441743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768c0039d0 0x7f76a4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 >> 172.21.15.177:0/200441743 conn(0x7f76a40b2450 msgr2=0x7f76a4158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 shutdown_connections 2023-10-25T16:13:39.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.077+0000 7f76a9a5f640 1 -- 172.21.15.177:0/200441743 wait complete. 2023-10-25T16:13:39.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:39.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:39.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/2414130718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc330004d10 msgr2=0x7fc330005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 --2- 172.21.15.177:0/2414130718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc330004d10 0x7fc330005190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc34000c590 tx=0x7fc34001d320 comp rx=0 tx=0).stop 2023-10-25T16:13:39.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 -- 172.21.15.177:0/2414130718 reap_dead start 2023-10-25T16:13:39.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/2414130718 shutdown_connections 2023-10-25T16:13:39.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/2414130718 >> 172.21.15.177:0/2414130718 conn(0x7fc3480983a0 msgr2=0x7fc3480cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/2414130718 shutdown_connections 2023-10-25T16:13:39.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/2414130718 wait complete. 2023-10-25T16:13:39.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 Processor -- start 2023-10-25T16:13:39.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- start start 2023-10-25T16:13:39.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc330004d10 0x7fc34806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc34815bda0 0x7fc348156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 0x7fc348159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34815a400 con 0x7fc348159a40 2023-10-25T16:13:39.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34806b5c0 con 0x7fc34815bda0 2023-10-25T16:13:39.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34806b8a0 con 0x7fc330004d10 2023-10-25T16:13:39.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 0x7fc348159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 0x7fc348159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52918/0 (socket says 172.21.15.177:52918) 2023-10-25T16:13:39.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 -- 172.21.15.177:0/3711927496 learned_addr learned my addr 172.21.15.177:0/3711927496 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:39.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc346ffd640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc330004d10 0x7fc34806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3467fc640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc34815bda0 0x7fc348156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 -- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc330004d10 msgr2=0x7fc34806ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc330004d10 0x7fc34806ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 -- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc34815bda0 msgr2=0x7fc348156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc34815bda0 0x7fc348156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 -- 172.21.15.177:0/3711927496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480cd770 con 0x7fc348159a40 2023-10-25T16:13:39.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3467fc640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc34815bda0 0x7fc348156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:39.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc346ffd640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc330004d10 0x7fc34806ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:39.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc3477fe640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 0x7fc348159ec0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc34001d150 tx=0x7fc340002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:39.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400b6040 con 0x7fc348159a40 2023-10-25T16:13:39.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc340001b50 con 0x7fc348159a40 2023-10-25T16:13:39.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34806bb80 con 0x7fc348159a40 2023-10-25T16:13:39.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340004db0 con 0x7fc348159a40 2023-10-25T16:13:39.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34806c140 con 0x7fc348159a40 2023-10-25T16:13:39.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.225+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34806c360 con 0x7fc348159a40 2023-10-25T16:13:39.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.229+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc340003980 con 0x7fc348159a40 2023-10-25T16:13:39.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.229+0000 7fc32f7fe640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3340664a0 0x7fc334068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.229+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc34011dd10 con 0x7fc348159a40 2023-10-25T16:13:39.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.229+0000 7fc346ffd640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3340664a0 0x7fc334068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.229+0000 7fc346ffd640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3340664a0 0x7fc334068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc338009a80 tx=0x7fc3380091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:39.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.233+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3400eb100 con 0x7fc348159a40 2023-10-25T16:13:39.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.377+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3480ce1c0 con 0x7fc348159a40 2023-10-25T16:13:39.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc32f7fe640 1 -- 172.21.15.177:0/3711927496 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3480ce1c0 con 0x7fc348159a40 2023-10-25T16:13:39.383 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:39.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3340664a0 msgr2=0x7fc334068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3340664a0 0x7fc334068960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc338009a80 tx=0x7fc3380091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 msgr2=0x7fc348159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 0x7fc348159ec0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc34001d150 tx=0x7fc340002190 comp rx=0 tx=0).stop 2023-10-25T16:13:39.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 shutdown_connections 2023-10-25T16:13:39.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3340664a0 0x7fc334068960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc348159a40 0x7fc348159ec0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc34815bda0 0x7fc348156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 --2- 172.21.15.177:0/3711927496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc330004d10 0x7fc34806ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 >> 172.21.15.177:0/3711927496 conn(0x7fc3480983a0 msgr2=0x7fc3480ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 shutdown_connections 2023-10-25T16:13:39.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.381+0000 7fc34d412640 1 -- 172.21.15.177:0/3711927496 wait complete. 2023-10-25T16:13:39.400 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:39.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/1324140460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c80cdce0 msgr2=0x7fc3c80c2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/1324140460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c80cdce0 0x7fc3c80c2eb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009840 tx=0x7fc3b801c6b0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/1324140460 shutdown_connections 2023-10-25T16:13:39.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/1324140460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80ccdd0 0x7fc3c80c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/1324140460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c80cdce0 0x7fc3c80c2eb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/1324140460 >> 172.21.15.177:0/1324140460 conn(0x7fc3c80b0ae0 msgr2=0x7fc3c80b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/1324140460 shutdown_connections 2023-10-25T16:13:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/1324140460 wait complete. 2023-10-25T16:13:39.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 Processor -- start 2023-10-25T16:13:39.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- start start 2023-10-25T16:13:39.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3c80ccdd0 0x7fc3c80b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80cdce0 0x7fc3c814f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 0x7fc3c80c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814fbf0 con 0x7fc3c815ca30 2023-10-25T16:13:39.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814fed0 con 0x7fc3c80ccdd0 2023-10-25T16:13:39.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c81501b0 con 0x7fc3c80cdce0 2023-10-25T16:13:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 0x7fc3c80c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 0x7fc3c80c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52932/0 (socket says 172.21.15.177:52932) 2023-10-25T16:13:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 -- 172.21.15.177:0/3528237348 learned_addr learned my addr 172.21.15.177:0/3528237348 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3cdb57640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80cdce0 0x7fc3c814f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ce358640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3c80ccdd0 0x7fc3c80b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 -- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80cdce0 msgr2=0x7fc3c814f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80cdce0 0x7fc3c814f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 -- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3c80ccdd0 msgr2=0x7fc3c80b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3c80ccdd0 0x7fc3c80b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 -- 172.21.15.177:0/3528237348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80094a0 con 0x7fc3c815ca30 2023-10-25T16:13:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3cdb57640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80cdce0 0x7fc3c814f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3ceb59640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 0x7fc3c80c7340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000ea20 tx=0x7fc3c000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000cde0 con 0x7fc3c815ca30 2023-10-25T16:13:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc3c0004c40 con 0x7fc3c815ca30 2023-10-25T16:13:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c8150490 con 0x7fc3c815ca30 2023-10-25T16:13:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0005020 con 0x7fc3c815ca30 2023-10-25T16:13:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.525+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c8150970 con 0x7fc3c815ca30 2023-10-25T16:13:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.529+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c804daf0 con 0x7fc3c815ca30 2023-10-25T16:13:39.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.529+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc3c0005180 con 0x7fc3c815ca30 2023-10-25T16:13:39.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.529+0000 7fc3beffd640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3ac066470 0x7fc3ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.529+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3c00849a0 con 0x7fc3c815ca30 2023-10-25T16:13:39.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.529+0000 7fc3ce358640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3ac066470 0x7fc3ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.529+0000 7fc3ce358640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3ac066470 0x7fc3ac068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b50a0 tx=0x7fc3c4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:39.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.533+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3c0051d90 con 0x7fc3c815ca30 2023-10-25T16:13:39.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.685+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3c80ca4f0 con 0x7fc3c815ca30 2023-10-25T16:13:39.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.685+0000 7fc3beffd640 1 -- 172.21.15.177:0/3528237348 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3c001f070 con 0x7fc3c815ca30 2023-10-25T16:13:39.690 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3ac066470 msgr2=0x7fc3ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3ac066470 0x7fc3ac068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b50a0 tx=0x7fc3c4009040 comp rx=0 tx=0).stop 2023-10-25T16:13:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 msgr2=0x7fc3c80c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 0x7fc3c80c7340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000ea20 tx=0x7fc3c000eee0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 shutdown_connections 2023-10-25T16:13:39.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3ac066470 0x7fc3ac068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3c815ca30 0x7fc3c80c7340 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3c80cdce0 0x7fc3c814f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 --2- 172.21.15.177:0/3528237348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3c80ccdd0 0x7fc3c80b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 >> 172.21.15.177:0/3528237348 conn(0x7fc3c80b0ae0 msgr2=0x7fc3c81596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 shutdown_connections 2023-10-25T16:13:39.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.689+0000 7fc3d05bc640 1 -- 172.21.15.177:0/3528237348 wait complete. 2023-10-25T16:13:39.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:39.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/3762596630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0540140cf0 msgr2=0x7f05400af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 --2- 172.21.15.177:0/3762596630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0540140cf0 0x7f05400af5d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0530009bc0 tx=0x7f053001caf0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/3762596630 shutdown_connections 2023-10-25T16:13:39.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 --2- 172.21.15.177:0/3762596630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f054006c160 0x7f05400cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 --2- 172.21.15.177:0/3762596630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0540140cf0 0x7f05400af5d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/3762596630 >> 172.21.15.177:0/3762596630 conn(0x7f05400b2450 msgr2=0x7f05400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/3762596630 shutdown_connections 2023-10-25T16:13:39.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/3762596630 wait complete. 2023-10-25T16:13:39.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 Processor -- start 2023-10-25T16:13:39.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- start start 2023-10-25T16:13:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 0x7f054013d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054006f570 0x7f0540157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0540140cf0 0x7f054013ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540136950 con 0x7f054006c160 2023-10-25T16:13:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540136c30 con 0x7f054006f570 2023-10-25T16:13:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540136f10 con 0x7f0540140cf0 2023-10-25T16:13:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 0x7f054013d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 0x7f054013d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52942/0 (socket says 172.21.15.177:52942) 2023-10-25T16:13:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 -- 172.21.15.177:0/1265807779 learned_addr learned my addr 172.21.15.177:0/1265807779 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 -- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0540140cf0 msgr2=0x7f054013ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0540140cf0 0x7f054013ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 -- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054006f570 msgr2=0x7f0540157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054006f570 0x7f0540157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 -- 172.21.15.177:0/1265807779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009820 con 0x7f054006c160 2023-10-25T16:13:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0545bac640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 0x7f054013d700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0530000f90 tx=0x7f05300a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300bc070 con 0x7f054006c160 2023-10-25T16:13:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0530005040 con 0x7f054006c160 2023-10-25T16:13:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540158900 con 0x7f054006c160 2023-10-25T16:13:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300053d0 con 0x7f054006c160 2023-10-25T16:13:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.821+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054013f490 con 0x7f054006c160 2023-10-25T16:13:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.825+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0540137050 con 0x7f054006c160 2023-10-25T16:13:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.825+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05300b4040 con 0x7f054006c160 2023-10-25T16:13:39.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.825+0000 7f053e7fc640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f052c066470 0x7f052c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:39.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.825+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f053011e860 con 0x7f054006c160 2023-10-25T16:13:39.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.825+0000 7f05453ab640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f052c066470 0x7f052c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:39.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.825+0000 7f05453ab640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f052c066470 0x7f052c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f05340010a0 tx=0x7f05340077d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:39.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.829+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0540137050 con 0x7f054006c160 2023-10-25T16:13:39.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.969+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0540137050 con 0x7f054006c160 2023-10-25T16:13:39.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.969+0000 7f053e7fc640 1 -- 172.21.15.177:0/1265807779 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0540137050 con 0x7f054006c160 2023-10-25T16:13:39.974 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:39.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f052c066470 msgr2=0x7f052c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f052c066470 0x7f052c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f05340010a0 tx=0x7f05340077d0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 msgr2=0x7f054013d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:39.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 0x7f054013d700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0530000f90 tx=0x7f05300a5840 comp rx=0 tx=0).stop 2023-10-25T16:13:39.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 shutdown_connections 2023-10-25T16:13:39.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f052c066470 0x7f052c068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0540140cf0 0x7f054013ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f054006f570 0x7f0540157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 --2- 172.21.15.177:0/1265807779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f054006c160 0x7f054013d700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 >> 172.21.15.177:0/1265807779 conn(0x7f05400b2450 msgr2=0x7f05400aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 shutdown_connections 2023-10-25T16:13:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:39.973+0000 7f0547e10640 1 -- 172.21.15.177:0/1265807779 wait complete. 2023-10-25T16:13:39.991 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:40.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 -- 172.21.15.177:0/2166613915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80b2120 msgr2=0x7f98b80d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2166613915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80b2120 0x7f98b80d1bd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009900 tx=0x7f98a801c830 comp rx=0 tx=0).stop 2023-10-25T16:13:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 -- 172.21.15.177:0/2166613915 shutdown_connections 2023-10-25T16:13:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2166613915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80b2120 0x7f98b80d1bd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2166613915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98b815eba0 0x7f98b80b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 -- 172.21.15.177:0/2166613915 >> 172.21.15.177:0/2166613915 conn(0x7f98b809a5c0 msgr2=0x7f98b80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 -- 172.21.15.177:0/2166613915 shutdown_connections 2023-10-25T16:13:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.105+0000 7f98c03ff640 1 -- 172.21.15.177:0/2166613915 wait complete. 2023-10-25T16:13:40.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 Processor -- start 2023-10-25T16:13:40.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- start start 2023-10-25T16:13:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98b80b2120 0x7f98b80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 0x7f98b8151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98b815eba0 0x7f98b80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80b4ea0 con 0x7f98b80cdb10 2023-10-25T16:13:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80b5d00 con 0x7f98b815eba0 2023-10-25T16:13:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80b50f0 con 0x7f98b80b2120 2023-10-25T16:13:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 0x7f98b8151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 0x7f98b8151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52964/0 (socket says 172.21.15.177:52964) 2023-10-25T16:13:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 -- 172.21.15.177:0/2204563941 learned_addr learned my addr 172.21.15.177:0/2204563941 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98be19b640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98b80b2120 0x7f98b80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98be99c640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98b815eba0 0x7f98b80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 -- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98b80b2120 msgr2=0x7f98b80b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98b80b2120 0x7f98b80b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 -- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98b815eba0 msgr2=0x7f98b80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98b815eba0 0x7f98b80c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 -- 172.21.15.177:0/2204563941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009560 con 0x7f98b80cdb10 2023-10-25T16:13:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98be99c640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98b815eba0 0x7f98b80c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:40.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98bd99a640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 0x7f98b8151090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009850 tx=0x7f98a80a66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80be070 con 0x7f98b80cdb10 2023-10-25T16:13:40.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98a8004270 con 0x7f98b80cdb10 2023-10-25T16:13:40.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8003600 con 0x7f98b80cdb10 2023-10-25T16:13:40.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b80b53d0 con 0x7f98b80cdb10 2023-10-25T16:13:40.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b80b5990 con 0x7f98b80cdb10 2023-10-25T16:13:40.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b80b5e70 con 0x7f98b80cdb10 2023-10-25T16:13:40.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98a8003760 con 0x7f98b80cdb10 2023-10-25T16:13:40.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98aeffd640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f989c0664a0 0x7f989c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.109+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98a80aa070 con 0x7f98b80cdb10 2023-10-25T16:13:40.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.113+0000 7f98be19b640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f989c0664a0 0x7f989c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.113+0000 7f98be19b640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f989c0664a0 0x7f989c068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005c50 tx=0x7f98b400a390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.113+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f98a80ec570 con 0x7f98b80cdb10 2023-10-25T16:13:40.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.269+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98b804daf0 con 0x7f98b80cdb10 2023-10-25T16:13:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.269+0000 7f98aeffd640 1 -- 172.21.15.177:0/2204563941 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f98a80ade80 con 0x7f98b80cdb10 2023-10-25T16:13:40.274 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:40.274 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f989c0664a0 msgr2=0x7f989c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f989c0664a0 0x7f989c068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005c50 tx=0x7f98b400a390 comp rx=0 tx=0).stop 2023-10-25T16:13:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 msgr2=0x7f98b8151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 0x7f98b8151090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009850 tx=0x7f98a80a66e0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 shutdown_connections 2023-10-25T16:13:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f989c0664a0 0x7f989c068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98b815eba0 0x7f98b80c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b80cdb10 0x7f98b8151090 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 --2- 172.21.15.177:0/2204563941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98b80b2120 0x7f98b80b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 >> 172.21.15.177:0/2204563941 conn(0x7f98b809a5c0 msgr2=0x7f98b8158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 shutdown_connections 2023-10-25T16:13:40.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.273+0000 7f98c03ff640 1 -- 172.21.15.177:0/2204563941 wait complete. 2023-10-25T16:13:40.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:40.292 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:40.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4008089139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 msgr2=0x7f77dc0adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4008089139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc0adeb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009840 tx=0x7f77d001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4008089139 shutdown_connections 2023-10-25T16:13:40.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4008089139 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77dc0b0280 0x7f77dc0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4008089139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc0adeb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4008089139 >> 172.21.15.177:0/4008089139 conn(0x7f77dc0983a0 msgr2=0x7f77dc0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4008089139 shutdown_connections 2023-10-25T16:13:40.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.401+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4008089139 wait complete. 2023-10-25T16:13:40.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 Processor -- start 2023-10-25T16:13:40.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- start start 2023-10-25T16:13:40.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77dc0b0280 0x7f77dc1f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc1f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77dc15ca70 0x7f77dc0c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc14ef10 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc14f1f0 con 0x7f77dc0b0280 2023-10-25T16:13:40.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc14f4d0 con 0x7f77dc15ca70 2023-10-25T16:13:40.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc1f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc1f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52982/0 (socket says 172.21.15.177:52982) 2023-10-25T16:13:40.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 -- 172.21.15.177:0/4281421736 learned_addr learned my addr 172.21.15.177:0/4281421736 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:40.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 -- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77dc15ca70 msgr2=0x7f77dc0c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77dc15ca70 0x7f77dc0c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 -- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77dc0b0280 msgr2=0x7f77dc1f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77dc0b0280 0x7f77dc1f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 -- 172.21.15.177:0/4281421736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094a0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77d9d9b640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc1f6660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f77d001ccb0 tx=0x7f77d00a5860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00bc070 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77d00052b0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc15a1c0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00046d0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc14f7b0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc04daf0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.405+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77d00b4040 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.409+0000 7f77caffd640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77bc066470 0x7f77bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.409+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77d011e7b0 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.409+0000 7f77da59c640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77bc066470 0x7f77bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.409+0000 7f77da59c640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77bc066470 0x7f77bc068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f77cc007fd0 tx=0x7f77cc007940 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.413+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77d00ebd50 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.553+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77dc15a670 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.553+0000 7f77caffd640 1 -- 172.21.15.177:0/4281421736 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77d00b2020 con 0x7f77dc0cc0a0 2023-10-25T16:13:40.558 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:40.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77bc066470 msgr2=0x7f77bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77bc066470 0x7f77bc068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f77cc007fd0 tx=0x7f77cc007940 comp rx=0 tx=0).stop 2023-10-25T16:13:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 msgr2=0x7f77dc1f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc1f6660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f77d001ccb0 tx=0x7f77d00a5860 comp rx=0 tx=0).stop 2023-10-25T16:13:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 shutdown_connections 2023-10-25T16:13:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77bc066470 0x7f77bc068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77dc15ca70 0x7f77dc0c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77dc0cc0a0 0x7f77dc1f6660 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 --2- 172.21.15.177:0/4281421736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77dc0b0280 0x7f77dc1f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 >> 172.21.15.177:0/4281421736 conn(0x7f77dc0983a0 msgr2=0x7f77dc1595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 shutdown_connections 2023-10-25T16:13:40.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.557+0000 7f77e0cd5640 1 -- 172.21.15.177:0/4281421736 wait complete. 2023-10-25T16:13:40.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:40.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- 172.21.15.177:0/4025387124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0cde10 msgr2=0x7f749c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 --2- 172.21.15.177:0/4025387124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0cde10 0x7f749c0ce220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f749c070210 tx=0x7f749401cc60 comp rx=0 tx=0).stop 2023-10-25T16:13:40.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- 172.21.15.177:0/4025387124 shutdown_connections 2023-10-25T16:13:40.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 --2- 172.21.15.177:0/4025387124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0cde10 0x7f749c0ce220 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 --2- 172.21.15.177:0/4025387124 >> v2:172.21.15.184:3300/0 conn(0x7f749c158030 0x7f749c15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- 172.21.15.177:0/4025387124 >> 172.21.15.177:0/4025387124 conn(0x7f749c06a830 msgr2=0x7f749c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- 172.21.15.177:0/4025387124 shutdown_connections 2023-10-25T16:13:40.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- 172.21.15.177:0/4025387124 wait complete. 2023-10-25T16:13:40.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 Processor -- start 2023-10-25T16:13:40.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- start start 2023-10-25T16:13:40.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 0x7f749c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f749c0cde10 0x7f749c146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f749c158030 0x7f749c069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c162de0 con 0x7f749c0712a0 2023-10-25T16:13:40.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c154500 con 0x7f749c0cde10 2023-10-25T16:13:40.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a47f6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c155c40 con 0x7f749c158030 2023-10-25T16:13:40.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 0x7f749c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 0x7f749c156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59534/0 (socket says 172.21.15.177:59534) 2023-10-25T16:13:40.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 -- 172.21.15.177:0/3650879004 learned_addr learned my addr 172.21.15.177:0/3650879004 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:40.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a1d91640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f749c0cde10 0x7f749c146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 -- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f749c158030 msgr2=0x7f749c069720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2d93640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f749c158030 0x7f749c069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f749c158030 0x7f749c069720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 -- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f749c0cde10 msgr2=0x7f749c146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f749c0cde10 0x7f749c146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 -- 172.21.15.177:0/3650879004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940098e0 con 0x7f749c0712a0 2023-10-25T16:13:40.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a1d91640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f749c0cde10 0x7f749c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:40.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.689+0000 7f74a2592640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 0x7f749c156fa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f749800d750 tx=0x7f749800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498009c30 con 0x7f749c0712a0 2023-10-25T16:13:40.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7498009e80 con 0x7f749c0712a0 2023-10-25T16:13:40.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c1574e0 con 0x7f749c0712a0 2023-10-25T16:13:40.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498005260 con 0x7f749c0712a0 2023-10-25T16:13:40.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c1f52d0 con 0x7f749c0712a0 2023-10-25T16:13:40.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c04daf0 con 0x7f749c0712a0 2023-10-25T16:13:40.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74980053c0 con 0x7f749c0712a0 2023-10-25T16:13:40.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f7492ffd640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7480066470 0x7f7480068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7498083f30 con 0x7f749c0712a0 2023-10-25T16:13:40.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.693+0000 7f74a1d91640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7480066470 0x7f7480068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.697+0000 7f74a1d91640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7480066470 0x7f7480068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f749c0b0d20 tx=0x7f748c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.697+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7498051440 con 0x7f749c0712a0 2023-10-25T16:13:40.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.845+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f749c154640 con 0x7f749c0712a0 2023-10-25T16:13:40.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.845+0000 7f7492ffd640 1 -- 172.21.15.177:0/3650879004 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7498017020 con 0x7f749c0712a0 2023-10-25T16:13:40.850 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:40.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7480066470 msgr2=0x7f7480068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7480066470 0x7f7480068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f749c0b0d20 tx=0x7f748c009040 comp rx=0 tx=0).stop 2023-10-25T16:13:40.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 msgr2=0x7f749c156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 0x7f749c156fa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f749800d750 tx=0x7f749800dc10 comp rx=0 tx=0).stop 2023-10-25T16:13:40.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 shutdown_connections 2023-10-25T16:13:40.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7480066470 0x7f7480068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f749c158030 0x7f749c069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f749c0cde10 0x7f749c146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 --2- 172.21.15.177:0/3650879004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f749c0712a0 0x7f749c156fa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 >> 172.21.15.177:0/3650879004 conn(0x7f749c06a830 msgr2=0x7f749c15a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 shutdown_connections 2023-10-25T16:13:40.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.849+0000 7f74a47f6640 1 -- 172.21.15.177:0/3650879004 wait complete. 2023-10-25T16:13:40.866 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:40.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- 172.21.15.177:0/948795123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 msgr2=0x7fc82c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 --2- 172.21.15.177:0/948795123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc82c00b990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e30 tx=0x7fc83c01d190 comp rx=0 tx=0).stop 2023-10-25T16:13:40.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- 172.21.15.177:0/948795123 shutdown_connections 2023-10-25T16:13:40.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 --2- 172.21.15.177:0/948795123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc82c00b990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- 172.21.15.177:0/948795123 >> 172.21.15.177:0/948795123 conn(0x7fc8440b2450 msgr2=0x7fc8440b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:40.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- 172.21.15.177:0/948795123 shutdown_connections 2023-10-25T16:13:40.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- 172.21.15.177:0/948795123 wait complete. 2023-10-25T16:13:40.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 Processor -- start 2023-10-25T16:13:40.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- start start 2023-10-25T16:13:40.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc84413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84413ab00 0x7fc84413e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84413e5d0 0x7fc8440cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc844159e20 con 0x7fc82c005260 2023-10-25T16:13:40.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84413f790 con 0x7fc84413ab00 2023-10-25T16:13:40.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc84982c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84413b550 con 0x7fc84413e5d0 2023-10-25T16:13:40.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc84413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc84413f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59554/0 (socket says 172.21.15.177:59554) 2023-10-25T16:13:40.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 -- 172.21.15.177:0/70902760 learned_addr learned my addr 172.21.15.177:0/70902760 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:40.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc8427fc640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84413ab00 0x7fc84413e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc8437fe640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84413e5d0 0x7fc8440cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 -- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84413e5d0 msgr2=0x7fc8440cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84413e5d0 0x7fc8440cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 -- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84413ab00 msgr2=0x7fc84413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:40.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84413ab00 0x7fc84413e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:40.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc842ffd640 1 -- 172.21.15.177:0/70902760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84413b830 con 0x7fc82c005260 2023-10-25T16:13:40.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.981+0000 7fc8427fc640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84413ab00 0x7fc84413e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:40.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc842ffd640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc84413f250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc83400d500 tx=0x7fc83400d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834012630 con 0x7fc82c005260 2023-10-25T16:13:40.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc834012790 con 0x7fc82c005260 2023-10-25T16:13:40.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84415a070 con 0x7fc82c005260 2023-10-25T16:13:40.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834012ba0 con 0x7fc82c005260 2023-10-25T16:13:40.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84413fb40 con 0x7fc82c005260 2023-10-25T16:13:40.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84404daf0 con 0x7fc82c005260 2023-10-25T16:13:40.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc83401b400 con 0x7fc82c005260 2023-10-25T16:13:40.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc82bfff640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc830066470 0x7fc830068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:40.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8340840d0 con 0x7fc82c005260 2023-10-25T16:13:40.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc8427fc640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc830066470 0x7fc830068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:40.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.985+0000 7fc8427fc640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc830066470 0x7fc830068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8440c96a0 tx=0x7fc838001000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:40.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:40.989+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc834051580 con 0x7fc82c005260 2023-10-25T16:13:41.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.137+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc84413b9c0 con 0x7fc82c005260 2023-10-25T16:13:41.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.137+0000 7fc82bfff640 1 -- 172.21.15.177:0/70902760 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc834054ba0 con 0x7fc82c005260 2023-10-25T16:13:41.142 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:41.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc830066470 msgr2=0x7fc830068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc830066470 0x7fc830068930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8440c96a0 tx=0x7fc838001000 comp rx=0 tx=0).stop 2023-10-25T16:13:41.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 msgr2=0x7fc84413f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc84413f250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc83400d500 tx=0x7fc83400d9c0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 shutdown_connections 2023-10-25T16:13:41.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc830066470 0x7fc830068930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84413e5d0 0x7fc8440cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84413ab00 0x7fc84413e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 --2- 172.21.15.177:0/70902760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc82c005260 0x7fc84413f250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 >> 172.21.15.177:0/70902760 conn(0x7fc8440b2450 msgr2=0x7fc8440b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:41.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 shutdown_connections 2023-10-25T16:13:41.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.141+0000 7fc84982c640 1 -- 172.21.15.177:0/70902760 wait complete. 2023-10-25T16:13:41.195 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-25T16:13:41.196 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-10-25T16:13:41.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:41.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1989904564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca94140db0 msgr2=0x7fca940af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 --2- 172.21.15.177:0/1989904564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca94140db0 0x7fca940af5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fca84009900 tx=0x7fca8401c890 comp rx=0 tx=0).stop 2023-10-25T16:13:41.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1989904564 shutdown_connections 2023-10-25T16:13:41.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 --2- 172.21.15.177:0/1989904564 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca9406ba00 0x7fca9406be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 --2- 172.21.15.177:0/1989904564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca94140db0 0x7fca940af5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1989904564 >> 172.21.15.177:0/1989904564 conn(0x7fca940b2450 msgr2=0x7fca940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:41.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1989904564 shutdown_connections 2023-10-25T16:13:41.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1989904564 wait complete. 2023-10-25T16:13:41.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 Processor -- start 2023-10-25T16:13:41.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- start start 2023-10-25T16:13:41.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 0x7fca941f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca940aff30 0x7fca9413d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca94140db0 0x7fca941572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca941f2eb0 con 0x7fca9406ba00 2023-10-25T16:13:41.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9413ebd0 con 0x7fca940aff30 2023-10-25T16:13:41.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9413dd20 con 0x7fca94140db0 2023-10-25T16:13:41.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 0x7fca941f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 0x7fca941f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59560/0 (socket says 172.21.15.177:59560) 2023-10-25T16:13:41.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 -- 172.21.15.177:0/1470930058 learned_addr learned my addr 172.21.15.177:0/1470930058 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:41.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca927fc640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca940aff30 0x7fca9413d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca937fe640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca94140db0 0x7fca941572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 -- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca94140db0 msgr2=0x7fca941572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca94140db0 0x7fca941572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 -- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca940aff30 msgr2=0x7fca9413d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca940aff30 0x7fca9413d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 -- 172.21.15.177:0/1470930058 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84009560 con 0x7fca9406ba00 2023-10-25T16:13:41.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca937fe640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca94140db0 0x7fca941572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:41.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca92ffd640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 0x7fca941f2970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fca8401a4c0 tx=0x7fca84005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:41.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84005020 con 0x7fca9406ba00 2023-10-25T16:13:41.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca84005270 con 0x7fca9406ba00 2023-10-25T16:13:41.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9413dfc0 con 0x7fca9406ba00 2023-10-25T16:13:41.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca840046d0 con 0x7fca9406ba00 2023-10-25T16:13:41.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9413e580 con 0x7fca9406ba00 2023-10-25T16:13:41.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.305+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9404daf0 con 0x7fca9406ba00 2023-10-25T16:13:41.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.309+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca840b4040 con 0x7fca9406ba00 2023-10-25T16:13:41.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.309+0000 7fca7bfff640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca800664a0 0x7fca80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.309+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca8411d4d0 con 0x7fca9406ba00 2023-10-25T16:13:41.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.309+0000 7fca927fc640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca800664a0 0x7fca80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.309+0000 7fca927fc640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca800664a0 0x7fca80068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca94135140 tx=0x7fca88005e70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:41.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.313+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca840ea960 con 0x7fca9406ba00 2023-10-25T16:13:41.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.453+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca940ca670 con 0x7fca9406ba00 2023-10-25T16:13:41.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca7bfff640 1 -- 172.21.15.177:0/1470930058 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fca840edf80 con 0x7fca9406ba00 2023-10-25T16:13:41.461 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:41.461 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:41.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca800664a0 msgr2=0x7fca80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca800664a0 0x7fca80068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca94135140 tx=0x7fca88005e70 comp rx=0 tx=0).stop 2023-10-25T16:13:41.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 msgr2=0x7fca941f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 0x7fca941f2970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fca8401a4c0 tx=0x7fca84005e00 comp rx=0 tx=0).stop 2023-10-25T16:13:41.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 shutdown_connections 2023-10-25T16:13:41.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca800664a0 0x7fca80068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca94140db0 0x7fca941572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca940aff30 0x7fca9413d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.457+0000 7fca99821640 1 --2- 172.21.15.177:0/1470930058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9406ba00 0x7fca941f2970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.461+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 >> 172.21.15.177:0/1470930058 conn(0x7fca940b2450 msgr2=0x7fca940cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:41.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.461+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 shutdown_connections 2023-10-25T16:13:41.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.461+0000 7fca99821640 1 -- 172.21.15.177:0/1470930058 wait complete. 2023-10-25T16:13:41.478 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:41.479 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:41.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- 172.21.15.177:0/1420707350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006be00 msgr2=0x7f6780070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 --2- 172.21.15.177:0/1420707350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006be00 0x7f6780070720 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6770009840 tx=0x7f677001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- 172.21.15.177:0/1420707350 shutdown_connections 2023-10-25T16:13:41.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 --2- 172.21.15.177:0/1420707350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006be00 0x7f6780070720 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 --2- 172.21.15.177:0/1420707350 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f678006ba20 0x7f678015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- 172.21.15.177:0/1420707350 >> 172.21.15.177:0/1420707350 conn(0x7f67800b2450 msgr2=0x7f67800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:41.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- 172.21.15.177:0/1420707350 shutdown_connections 2023-10-25T16:13:41.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- 172.21.15.177:0/1420707350 wait complete. 2023-10-25T16:13:41.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 Processor -- start 2023-10-25T16:13:41.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- start start 2023-10-25T16:13:41.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006ba20 0x7f67801466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 0x7f678014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6780070c60 0x7f678015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678014c1a0 con 0x7f678006be00 2023-10-25T16:13:41.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780147660 con 0x7f678006ba20 2023-10-25T16:13:41.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.589+0000 7f6787a07640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780147940 con 0x7f6780070c60 2023-10-25T16:13:41.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 0x7f678014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 0x7f678014bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59566/0 (socket says 172.21.15.177:59566) 2023-10-25T16:13:41.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 -- 172.21.15.177:0/2653771505 learned_addr learned my addr 172.21.15.177:0/2653771505 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:41.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f67857a3640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006ba20 0x7f67801466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6785fa4640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6780070c60 0x7f678015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 -- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6780070c60 msgr2=0x7f678015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6780070c60 0x7f678015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 -- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006ba20 msgr2=0x7f67801466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006ba20 0x7f67801466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 -- 172.21.15.177:0/2653771505 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009450 con 0x7f678006be00 2023-10-25T16:13:41.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6784fa2640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 0x7f678014bc60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6770009790 tx=0x7f6770005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:41.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700046d0 con 0x7f678006be00 2023-10-25T16:13:41.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6770004920 con 0x7f678006be00 2023-10-25T16:13:41.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6780147c20 con 0x7f678006be00 2023-10-25T16:13:41.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770004cd0 con 0x7f678006be00 2023-10-25T16:13:41.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678014c950 con 0x7f678006be00 2023-10-25T16:13:41.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678004daf0 con 0x7f678006be00 2023-10-25T16:13:41.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6770003600 con 0x7f678006be00 2023-10-25T16:13:41.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6775ffb640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6764066470 0x7f6764068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f677011f1f0 con 0x7f678006be00 2023-10-25T16:13:41.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f67857a3640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6764066470 0x7f6764068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.593+0000 7f67857a3640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6764066470 0x7f6764068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6780156a70 tx=0x7f677c0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:41.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.597+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f67700ec790 con 0x7f678006be00 2023-10-25T16:13:41.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6780147a80 con 0x7f678006be00 2023-10-25T16:13:41.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6775ffb640 1 -- 172.21.15.177:0/2653771505 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6780147a80 con 0x7f678006be00 2023-10-25T16:13:41.752 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:41.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6764066470 msgr2=0x7f6764068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6764066470 0x7f6764068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6780156a70 tx=0x7f677c0091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 msgr2=0x7f678014bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 0x7f678014bc60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6770009790 tx=0x7f6770005cc0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 shutdown_connections 2023-10-25T16:13:41.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6764066470 0x7f6764068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6780070c60 0x7f678015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f678006be00 0x7f678014bc60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 --2- 172.21.15.177:0/2653771505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f678006ba20 0x7f67801466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 >> 172.21.15.177:0/2653771505 conn(0x7f67800b2450 msgr2=0x7f6780159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:41.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 shutdown_connections 2023-10-25T16:13:41.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.749+0000 7f6787a07640 1 -- 172.21.15.177:0/2653771505 wait complete. 2023-10-25T16:13:41.769 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:41.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/1217833240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c081591e0 msgr2=0x7f9c080c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/1217833240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c081591e0 0x7f9c080c2b30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9c080718b0 tx=0x7f9bf801c870 comp rx=0 tx=0).stop 2023-10-25T16:13:41.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/1217833240 shutdown_connections 2023-10-25T16:13:41.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/1217833240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c080af110 0x7f9c080af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/1217833240 >> v2:172.21.15.184:3300/0 conn(0x7f9c080b0a20 0x7f9c080b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/1217833240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c081591e0 0x7f9c080c2b30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/1217833240 >> 172.21.15.177:0/1217833240 conn(0x7f9c080cefe0 msgr2=0x7f9c080cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:41.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/1217833240 shutdown_connections 2023-10-25T16:13:41.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/1217833240 wait complete. 2023-10-25T16:13:41.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 Processor -- start 2023-10-25T16:13:41.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.881+0000 7f9c0dfbf640 1 -- start start 2023-10-25T16:13:41.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c080af110 0x7f9c0814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 0x7f9c081548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c081591e0 0x7f9c080c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c9150 con 0x7f9c080b0a20 2023-10-25T16:13:41.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08154460 con 0x7f9c080af110 2023-10-25T16:13:41.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080aeb20 con 0x7f9c081591e0 2023-10-25T16:13:41.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 0x7f9c081548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 0x7f9c081548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59584/0 (socket says 172.21.15.177:59584) 2023-10-25T16:13:41.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 -- 172.21.15.177:0/2387028410 learned_addr learned my addr 172.21.15.177:0/2387028410 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:41.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 -- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c081591e0 msgr2=0x7f9c080c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c081591e0 0x7f9c080c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 -- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c080af110 msgr2=0x7f9c0814fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:41.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c080af110 0x7f9c0814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:41.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 -- 172.21.15.177:0/2387028410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8009560 con 0x7f9c080b0a20 2023-10-25T16:13:41.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9bfffff640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 0x7f9c081548f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b550 tx=0x7f9bf000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:41.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0010870 con 0x7f9c080b0a20 2023-10-25T16:13:41.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9bf0010ae0 con 0x7f9c080b0a20 2023-10-25T16:13:41.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000f3c0 con 0x7f9c080b0a20 2023-10-25T16:13:41.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08153b30 con 0x7f9c080b0a20 2023-10-25T16:13:41.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c081540f0 con 0x7f9c080b0a20 2023-10-25T16:13:41.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0804daf0 con 0x7f9c080b0a20 2023-10-25T16:13:41.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9bf000f520 con 0x7f9c080b0a20 2023-10-25T16:13:41.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c04ff9640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9be80664a0 0x7f9be8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:41.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bf0084060 con 0x7f9c080b0a20 2023-10-25T16:13:41.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.885+0000 7f9c077fe640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9be80664a0 0x7f9be8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:41.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.889+0000 7f9c077fe640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9be80664a0 0x7f9be8068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80af000 tx=0x7f9bf8019610 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:41.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:41.893+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9bf0051570 con 0x7f9c080b0a20 2023-10-25T16:13:42.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.033+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c080c4480 con 0x7f9c080b0a20 2023-10-25T16:13:42.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.033+0000 7f9c04ff9640 1 -- 172.21.15.177:0/2387028410 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9bf0014020 con 0x7f9c080b0a20 2023-10-25T16:13:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:42.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9be80664a0 msgr2=0x7f9be8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9be80664a0 0x7f9be8068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80af000 tx=0x7f9bf8019610 comp rx=0 tx=0).stop 2023-10-25T16:13:42.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 msgr2=0x7f9c081548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 0x7f9c081548f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b550 tx=0x7f9bf000ba10 comp rx=0 tx=0).stop 2023-10-25T16:13:42.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 shutdown_connections 2023-10-25T16:13:42.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9be80664a0 0x7f9be8068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9c081591e0 0x7f9c080c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c080b0a20 0x7f9c081548f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 --2- 172.21.15.177:0/2387028410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c080af110 0x7f9c0814fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 >> 172.21.15.177:0/2387028410 conn(0x7f9c080cefe0 msgr2=0x7f9c081561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:42.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 shutdown_connections 2023-10-25T16:13:42.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.037+0000 7f9c0dfbf640 1 -- 172.21.15.177:0/2387028410 wait complete. 2023-10-25T16:13:42.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:42.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3388532850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc0155db0 msgr2=0x7f1dc00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3388532850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc0155db0 0x7f1dc00cbf00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00726d0 tx=0x7f1db001c5b0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3388532850 shutdown_connections 2023-10-25T16:13:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3388532850 >> v2:172.21.15.184:3300/0 conn(0x7f1dc00ccf70 0x7f1dc015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3388532850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dc00cc440 0x7f1dc00cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3388532850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc0155db0 0x7f1dc00cbf00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3388532850 >> 172.21.15.177:0/3388532850 conn(0x7f1dc00ce000 msgr2=0x7f1dc00ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3388532850 shutdown_connections 2023-10-25T16:13:42.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3388532850 wait complete. 2023-10-25T16:13:42.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 Processor -- start 2023-10-25T16:13:42.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- start start 2023-10-25T16:13:42.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc00cc440 0x7f1dc014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 0x7f1dc00b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dc0155db0 0x7f1dc00ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00b1e50 con 0x7f1dc00ccf70 2023-10-25T16:13:42.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc0150400 con 0x7f1dc00cc440 2023-10-25T16:13:42.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00b15b0 con 0x7f1dc0155db0 2023-10-25T16:13:42.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 0x7f1dc00b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 0x7f1dc00b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59592/0 (socket says 172.21.15.177:59592) 2023-10-25T16:13:42.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 -- 172.21.15.177:0/3533713846 learned_addr learned my addr 172.21.15.177:0/3533713846 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:42.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc4ad1640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dc0155db0 0x7f1dc00ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbffff640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc00cc440 0x7f1dc014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 -- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dc0155db0 msgr2=0x7f1dc00ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dc0155db0 0x7f1dc00ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 -- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc00cc440 msgr2=0x7f1dc014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc00cc440 0x7f1dc014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 -- 172.21.15.177:0/3533713846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0009560 con 0x7f1dc00ccf70 2023-10-25T16:13:42.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbffff640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc00cc440 0x7f1dc014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:42.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbf7fe640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 0x7f1dc00b0d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1db400b550 tx=0x7f1db400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:42.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4010870 con 0x7f1dc00ccf70 2023-10-25T16:13:42.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1db4010ae0 con 0x7f1dc00ccf70 2023-10-25T16:13:42.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc00b1890 con 0x7f1dc00ccf70 2023-10-25T16:13:42.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db400f3c0 con 0x7f1dc00ccf70 2023-10-25T16:13:42.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc01506a0 con 0x7f1dc00ccf70 2023-10-25T16:13:42.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.169+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc006fe60 con 0x7f1dc00ccf70 2023-10-25T16:13:42.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.173+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1db400f520 con 0x7f1dc00ccf70 2023-10-25T16:13:42.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.173+0000 7f1dbcff9640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1dac066470 0x7f1dac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.173+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1db40840d0 con 0x7f1dc00ccf70 2023-10-25T16:13:42.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.173+0000 7f1dbffff640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1dac066470 0x7f1dac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.173+0000 7f1dbffff640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1dac066470 0x7f1dac068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1db00ae000 tx=0x7f1db001adf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:42.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.177+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1db40515e0 con 0x7f1dc00ccf70 2023-10-25T16:13:42.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1dc014f100 con 0x7f1dc00ccf70 2023-10-25T16:13:42.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dbcff9640 1 -- 172.21.15.177:0/3533713846 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dc014f100 con 0x7f1dc00ccf70 2023-10-25T16:13:42.320 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:42.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1dac066470 msgr2=0x7f1dac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1dac066470 0x7f1dac068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1db00ae000 tx=0x7f1db001adf0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 msgr2=0x7f1dc00b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 0x7f1dc00b0d60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1db400b550 tx=0x7f1db400ba10 comp rx=0 tx=0).stop 2023-10-25T16:13:42.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 shutdown_connections 2023-10-25T16:13:42.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1dac066470 0x7f1dac068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dc0155db0 0x7f1dc00ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc00ccf70 0x7f1dc00b0d60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 --2- 172.21.15.177:0/3533713846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc00cc440 0x7f1dc014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 >> 172.21.15.177:0/3533713846 conn(0x7f1dc00ce000 msgr2=0x7f1dc0155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:42.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 shutdown_connections 2023-10-25T16:13:42.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.317+0000 7f1dc6534640 1 -- 172.21.15.177:0/3533713846 wait complete. 2023-10-25T16:13:42.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-25T16:13:42.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1812612948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa374005190 msgr2=0x7fa37400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1812612948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa374005190 0x7fa37400b990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa380001da0 tx=0x7fa38001cb20 comp rx=0 tx=0).stop 2023-10-25T16:13:42.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1812612948 shutdown_connections 2023-10-25T16:13:42.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1812612948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa374005190 0x7fa37400b990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1812612948 >> 172.21.15.177:0/1812612948 conn(0x7fa3880afe20 msgr2=0x7fa3880b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:42.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1812612948 shutdown_connections 2023-10-25T16:13:42.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1812612948 wait complete. 2023-10-25T16:13:42.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 Processor -- start 2023-10-25T16:13:42.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- start start 2023-10-25T16:13:42.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374005190 0x7fa38813bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 0x7fa388139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa388139950 0x7fa3880b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38813e370 con 0x7fa38813c240 2023-10-25T16:13:42.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38813c6c0 con 0x7fa388139950 2023-10-25T16:13:42.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa38ccc4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38813a370 con 0x7fa374005190 2023-10-25T16:13:42.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 0x7fa388139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa37dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 0x7fa388139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59606/0 (socket says 172.21.15.177:59606) 2023-10-25T16:13:42.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.461+0000 7fa37dd9b640 1 -- 172.21.15.177:0/1303274591 learned_addr learned my addr 172.21.15.177:0/1303274591 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:42.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa38659c640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374005190 0x7fa38813bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa386d9d640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa388139950 0x7fa3880b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37dd9b640 1 -- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374005190 msgr2=0x7fa38813bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37dd9b640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374005190 0x7fa38813bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37dd9b640 1 -- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa388139950 msgr2=0x7fa3880b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37dd9b640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa388139950 0x7fa3880b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37dd9b640 1 -- 172.21.15.177:0/1303274591 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38813e920 con 0x7fa38813c240 2023-10-25T16:13:42.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37dd9b640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 0x7fa388139410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3700107b0 tx=0x7fa370010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:42.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000ece0 con 0x7fa38813c240 2023-10-25T16:13:42.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa37000ee40 con 0x7fa38813c240 2023-10-25T16:13:42.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa388139dd0 con 0x7fa38813c240 2023-10-25T16:13:42.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370004290 con 0x7fa38813c240 2023-10-25T16:13:42.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3880b0e90 con 0x7fa38813c240 2023-10-25T16:13:42.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38804daf0 con 0x7fa38813c240 2023-10-25T16:13:42.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa370003600 con 0x7fa38813c240 2023-10-25T16:13:42.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37f7fe640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3680664a0 0x7fa368068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa370016070 con 0x7fa38813c240 2023-10-25T16:13:42.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa38659c640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3680664a0 0x7fa368068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.465+0000 7fa38659c640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3680664a0 0x7fa368068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa378000fc0 tx=0x7fa3780014c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:42.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.469+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa370052020 con 0x7fa38813c240 2023-10-25T16:13:42.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.672+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fa3880cf040 con 0x7fa38813c240 2023-10-25T16:13:42.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa37f7fe640 1 -- 172.21.15.177:0/1303274591 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v50) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa370055640 con 0x7fa38813c240 2023-10-25T16:13:42.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3680664a0 msgr2=0x7fa368068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3680664a0 0x7fa368068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa378000fc0 tx=0x7fa3780014c0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 msgr2=0x7fa388139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 0x7fa388139410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3700107b0 tx=0x7fa370010c70 comp rx=0 tx=0).stop 2023-10-25T16:13:42.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 shutdown_connections 2023-10-25T16:13:42.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3680664a0 0x7fa368068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa388139950 0x7fa3880b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa38813c240 0x7fa388139410 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 --2- 172.21.15.177:0/1303274591 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa374005190 0x7fa38813bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 >> 172.21.15.177:0/1303274591 conn(0x7fa3880afe20 msgr2=0x7fa388157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:42.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 shutdown_connections 2023-10-25T16:13:42.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.696+0000 7fa38ccc4640 1 -- 172.21.15.177:0/1303274591 wait complete. 2023-10-25T16:13:42.718 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-25T16:13:42.849 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_objectstore":"memstore"} 2023-10-25T16:13:42.849 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-25T16:13:42.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:13:42.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc81988e640 1 -- 172.21.15.177:0/2362223416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7fc003980 msgr2=0x7fc7fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc81988e640 1 --2- 172.21.15.177:0/2362223416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7fc003980 0x7fc7fc003da0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc804009b60 tx=0x7fc80401d220 comp rx=0 tx=0).stop 2023-10-25T16:13:42.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc8137fe640 1 -- 172.21.15.177:0/2362223416 reap_dead start 2023-10-25T16:13:42.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc81988e640 1 -- 172.21.15.177:0/2362223416 shutdown_connections 2023-10-25T16:13:42.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc81988e640 1 -- 172.21.15.177:0/2362223416 >> 172.21.15.177:0/2362223416 conn(0x7fc8140983a0 msgr2=0x7fc8140cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:42.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc81988e640 1 -- 172.21.15.177:0/2362223416 shutdown_connections 2023-10-25T16:13:42.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.964+0000 7fc81988e640 1 -- 172.21.15.177:0/2362223416 wait complete. 2023-10-25T16:13:42.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 Processor -- start 2023-10-25T16:13:42.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- start start 2023-10-25T16:13:42.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8141f2cc0 0x7fc814144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8141f71a0 0x7fc814155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 0x7fc8140ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc814156730 con 0x7fc8141562b0 2023-10-25T16:13:42.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8141f30a0 con 0x7fc8141f2cc0 2023-10-25T16:13:42.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814145300 con 0x7fc8141f71a0 2023-10-25T16:13:42.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 0x7fc8140ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 0x7fc8140ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59632/0 (socket says 172.21.15.177:59632) 2023-10-25T16:13:42.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 -- 172.21.15.177:0/2263651251 learned_addr learned my addr 172.21.15.177:0/2263651251 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:42.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8127fc640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8141f71a0 0x7fc814155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc812ffd640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8141f2cc0 0x7fc814144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 -- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8141f71a0 msgr2=0x7fc814155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8141f71a0 0x7fc814155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 -- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8141f2cc0 msgr2=0x7fc814144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:42.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8141f2cc0 0x7fc814144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:42.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 -- 172.21.15.177:0/2263651251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140cb360 con 0x7fc8141562b0 2023-10-25T16:13:42.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc8137fe640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 0x7fc8140ae9e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc81406a760 tx=0x7fc80c006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:42.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00e8f0 con 0x7fc8141562b0 2023-10-25T16:13:42.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc80c00eb60 con 0x7fc8141562b0 2023-10-25T16:13:42.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8141455e0 con 0x7fc8141562b0 2023-10-25T16:13:42.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c011460 con 0x7fc8141562b0 2023-10-25T16:13:42.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc814145ba0 con 0x7fc8141562b0 2023-10-25T16:13:42.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81404daf0 con 0x7fc8141562b0 2023-10-25T16:13:42.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.968+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc80c0115c0 con 0x7fc8141562b0 2023-10-25T16:13:42.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.972+0000 7fc7fbfff640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc800066470 0x7fc800068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:42.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.972+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc80c084640 con 0x7fc8141562b0 2023-10-25T16:13:42.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.972+0000 7fc812ffd640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc800066470 0x7fc800068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:42.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.972+0000 7fc812ffd640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc800066470 0x7fc800068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8040ae000 tx=0x7fc804019fc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:42.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:42.976+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc80c051b50 con 0x7fc8141562b0 2023-10-25T16:13:43.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fc8140ce1c0 con 0x7fc8141562b0 2023-10-25T16:13:43.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc7fbfff640 1 -- 172.21.15.177:0/2263651251 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v18) v1 ==== 59+0+1116 (secure 0 0 0) 0x7fc8140ce1c0 con 0x7fc8141562b0 2023-10-25T16:13:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:13:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:13:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:13:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:13:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:13:43.125 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:13:43.125 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:13:43.125 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:13:43.125 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:13:43.125 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:13:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:13:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:13:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:13:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:13:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:13:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:13:43.127 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:13:43.127 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:13:43.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc800066470 msgr2=0x7fc800068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc800066470 0x7fc800068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc8040ae000 tx=0x7fc804019fc0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 msgr2=0x7fc8140ae9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 0x7fc8140ae9e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc81406a760 tx=0x7fc80c006420 comp rx=0 tx=0).stop 2023-10-25T16:13:43.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 shutdown_connections 2023-10-25T16:13:43.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc800066470 0x7fc800068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8141562b0 0x7fc8140ae9e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8141f71a0 0x7fc814155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 --2- 172.21.15.177:0/2263651251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8141f2cc0 0x7fc814144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 >> 172.21.15.177:0/2263651251 conn(0x7fc8140983a0 msgr2=0x7fc8140abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:43.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 shutdown_connections 2023-10-25T16:13:43.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.120+0000 7fc81988e640 1 -- 172.21.15.177:0/2263651251 wait complete. 2023-10-25T16:13:43.140 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:13:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 -- 172.21.15.177:0/4287112250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa0004d10 msgr2=0x7fcaa0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 --2- 172.21.15.177:0/4287112250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcaa0004d10 0x7fcaa0005190 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800bb40 tx=0x7fcaa801cd60 comp rx=0 tx=0).stop 2023-10-25T16:13:43.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcab7fff640 1 -- 172.21.15.177:0/4287112250 reap_dead start 2023-10-25T16:13:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 -- 172.21.15.177:0/4287112250 shutdown_connections 2023-10-25T16:13:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 -- 172.21.15.177:0/4287112250 >> 172.21.15.177:0/4287112250 conn(0x7fcab808ac70 msgr2=0x7fcab809a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 -- 172.21.15.177:0/4287112250 shutdown_connections 2023-10-25T16:13:43.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 -- 172.21.15.177:0/4287112250 wait complete. 2023-10-25T16:13:43.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 Processor -- start 2023-10-25T16:13:43.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.248+0000 7fcabde41640 1 -- start start 2023-10-25T16:13:43.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa0004d10 0x7fcab80ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcab814c290 0x7fcab814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 0x7fcab815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab81f4c40 con 0x7fcab815bcb0 2023-10-25T16:13:43.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab81f4eb0 con 0x7fcaa0004d10 2023-10-25T16:13:43.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab81f5190 con 0x7fcab814c290 2023-10-25T16:13:43.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 0x7fcab815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 0x7fcab815c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59658/0 (socket says 172.21.15.177:59658) 2023-10-25T16:13:43.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 -- 172.21.15.177:0/1387770655 learned_addr learned my addr 172.21.15.177:0/1387770655 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:43.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab6ffd640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcab814c290 0x7fcab814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab77fe640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa0004d10 0x7fcab80ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 -- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcab814c290 msgr2=0x7fcab814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcab814c290 0x7fcab814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 -- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa0004d10 msgr2=0x7fcab80ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa0004d10 0x7fcab80ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 -- 172.21.15.177:0/1387770655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab81f5470 con 0x7fcab815bcb0 2023-10-25T16:13:43.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab77fe640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa0004d10 0x7fcab80ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:43.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab7fff640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 0x7fcab815c0f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800bb40 tx=0x7fcaa8005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:43.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8005440 con 0x7fcab815bcb0 2023-10-25T16:13:43.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcaa8005690 con 0x7fcab815bcb0 2023-10-25T16:13:43.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab81f5750 con 0x7fcab815bcb0 2023-10-25T16:13:43.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8004910 con 0x7fcab815bcb0 2023-10-25T16:13:43.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab815c630 con 0x7fcab815bcb0 2023-10-25T16:13:43.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab804daf0 con 0x7fcab815bcb0 2023-10-25T16:13:43.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcaa8004a70 con 0x7fcab815bcb0 2023-10-25T16:13:43.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fca9ffff640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaa40664a0 0x7fcaa4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaa811e4e0 con 0x7fcab815bcb0 2023-10-25T16:13:43.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab77fe640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaa40664a0 0x7fcaa4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.252+0000 7fcab77fe640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaa40664a0 0x7fcaa4068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcab0002240 tx=0x7fcab0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:43.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.256+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcaa80eb9f0 con 0x7fcab815bcb0 2023-10-25T16:13:43.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.396+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcab80cd020 con 0x7fcab815bcb0 2023-10-25T16:13:43.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.404+0000 7fca9ffff640 1 -- 172.21.15.177:0/1387770655 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcaa80bf0c0 con 0x7fcab815bcb0 2023-10-25T16:13:43.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.404+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaa40664a0 msgr2=0x7fcaa4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.404+0000 7fcabde41640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaa40664a0 0x7fcaa4068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcab0002240 tx=0x7fcab0009040 comp rx=0 tx=0).stop 2023-10-25T16:13:43.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.404+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 msgr2=0x7fcab815c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.404+0000 7fcabde41640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 0x7fcab815c0f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800bb40 tx=0x7fcaa8005e60 comp rx=0 tx=0).stop 2023-10-25T16:13:43.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 shutdown_connections 2023-10-25T16:13:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaa40664a0 0x7fcaa4068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcab815bcb0 0x7fcab815c0f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcab814c290 0x7fcab814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 --2- 172.21.15.177:0/1387770655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcaa0004d10 0x7fcab80ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 >> 172.21.15.177:0/1387770655 conn(0x7fcab808ac70 msgr2=0x7fcab815a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:43.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 shutdown_connections 2023-10-25T16:13:43.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.408+0000 7fcabde41640 1 -- 172.21.15.177:0/1387770655 wait complete. 2023-10-25T16:13:43.426 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:13:43.426 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:13:43.464 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:13:43.518 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:13:43.519 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:13:43.519 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:43.525 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:13:43.526 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:43.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:43.619 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:13:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:43.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/3206455047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c159230 msgr2=0x7fb60c071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 --2- 172.21.15.177:0/3206455047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c159230 0x7fb60c071500 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009cb0 tx=0x7fb5fc01cd10 comp rx=0 tx=0).stop 2023-10-25T16:13:43.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/3206455047 shutdown_connections 2023-10-25T16:13:43.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 --2- 172.21.15.177:0/3206455047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c070510 0x7fb60c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 --2- 172.21.15.177:0/3206455047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c159230 0x7fb60c071500 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/3206455047 >> 172.21.15.177:0/3206455047 conn(0x7fb60c0b2450 msgr2=0x7fb60c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:43.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/3206455047 shutdown_connections 2023-10-25T16:13:43.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/3206455047 wait complete. 2023-10-25T16:13:43.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 Processor -- start 2023-10-25T16:13:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- start start 2023-10-25T16:13:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 0x7fb60c13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c0cc610 0x7fb60c0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb60c159230 0x7fb60c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0aef50 con 0x7fb60c070510 2023-10-25T16:13:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0af230 con 0x7fb60c159230 2023-10-25T16:13:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0af510 con 0x7fb60c0cc610 2023-10-25T16:13:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 0x7fb60c13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 0x7fb60c13e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59678/0 (socket says 172.21.15.177:59678) 2023-10-25T16:13:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 -- 172.21.15.177:0/2965921376 learned_addr learned my addr 172.21.15.177:0/2965921376 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb610bdc640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb60c159230 0x7fb60c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60b7fe640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c0cc610 0x7fb60c0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 -- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c0cc610 msgr2=0x7fb60c0ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c0cc610 0x7fb60c0ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 -- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb60c159230 msgr2=0x7fb60c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb60c159230 0x7fb60c154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 -- 172.21.15.177:0/2965921376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0098e0 con 0x7fb60c070510 2023-10-25T16:13:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60b7fe640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c0cc610 0x7fb60c0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb60bfff640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 0x7fb60c13e820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc000f90 tx=0x7fb5fc004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc003e50 con 0x7fb60c070510 2023-10-25T16:13:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5fc004120 con 0x7fb60c070510 2023-10-25T16:13:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c0af7f0 con 0x7fb60c070510 2023-10-25T16:13:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc004530 con 0x7fb60c070510 2023-10-25T16:13:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.740+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c1f4370 con 0x7fb60c070510 2023-10-25T16:13:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.744+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c04daf0 con 0x7fb60c070510 2023-10-25T16:13:43.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.744+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb5fc0b4040 con 0x7fb60c070510 2023-10-25T16:13:43.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.744+0000 7fb608ff9640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5f8066470 0x7fb5f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:43.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.744+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5fc11e3a0 con 0x7fb60c070510 2023-10-25T16:13:43.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.744+0000 7fb60b7fe640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5f8066470 0x7fb5f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:43.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.744+0000 7fb60b7fe640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5f8066470 0x7fb5f8068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb60c157e20 tx=0x7fb60000a5c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:43.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.748+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5fc0eb790 con 0x7fb60c070510 2023-10-25T16:13:43.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.892+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb60c14fb80 con 0x7fb60c070510 2023-10-25T16:13:43.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.892+0000 7fb608ff9640 1 -- 172.21.15.177:0/2965921376 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fb5fc0eedb0 con 0x7fb60c070510 2023-10-25T16:13:43.898 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:43.898 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:43.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5f8066470 msgr2=0x7fb5f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5f8066470 0x7fb5f8068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb60c157e20 tx=0x7fb60000a5c0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 msgr2=0x7fb60c13e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:43.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 0x7fb60c13e820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc000f90 tx=0x7fb5fc004d90 comp rx=0 tx=0).stop 2023-10-25T16:13:43.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 shutdown_connections 2023-10-25T16:13:43.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5f8066470 0x7fb5f8068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb60c159230 0x7fb60c154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb60c0cc610 0x7fb60c0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 --2- 172.21.15.177:0/2965921376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb60c070510 0x7fb60c13e820 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:43.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 >> 172.21.15.177:0/2965921376 conn(0x7fb60c0b2450 msgr2=0x7fb60c15a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:43.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 shutdown_connections 2023-10-25T16:13:43.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:43.896+0000 7fb61263f640 1 -- 172.21.15.177:0/2965921376 wait complete. 2023-10-25T16:13:43.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:43.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:44.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/2268482770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d00c9e50 msgr2=0x7f43d006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 --2- 172.21.15.177:0/2268482770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d00c9e50 0x7f43d006b9e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009830 tx=0x7f43b801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/2268482770 shutdown_connections 2023-10-25T16:13:44.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 --2- 172.21.15.177:0/2268482770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d00c9e50 0x7f43d006b9e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 --2- 172.21.15.177:0/2268482770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d01500f0 0x7f43d00c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/2268482770 >> 172.21.15.177:0/2268482770 conn(0x7f43d00b2450 msgr2=0x7f43d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/2268482770 shutdown_connections 2023-10-25T16:13:44.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/2268482770 wait complete. 2023-10-25T16:13:44.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 Processor -- start 2023-10-25T16:13:44.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- start start 2023-10-25T16:13:44.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 0x7f43d0145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d00c9e50 0x7f43d00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d01500f0 0x7f43d00caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01480e0 con 0x7f43d006bf20 2023-10-25T16:13:44.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b0a40 con 0x7f43d00c9e50 2023-10-25T16:13:44.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b1000 con 0x7f43d01500f0 2023-10-25T16:13:44.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 0x7f43d0145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 0x7f43d0145040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59702/0 (socket says 172.21.15.177:59702) 2023-10-25T16:13:44.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 -- 172.21.15.177:0/1633450374 learned_addr learned my addr 172.21.15.177:0/1633450374 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:44.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d00c9e50 0x7f43d00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43cf7fe640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d01500f0 0x7f43d00caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 -- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d01500f0 msgr2=0x7f43d00caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d01500f0 0x7f43d00caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 -- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d00c9e50 msgr2=0x7f43d00b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d00c9e50 0x7f43d00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 -- 172.21.15.177:0/1633450374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009440 con 0x7f43d006bf20 2023-10-25T16:13:44.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43ceffd640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 0x7f43d0145040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43c000d950 tx=0x7f43c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0009c30 con 0x7f43d006bf20 2023-10-25T16:13:44.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f43c0009e80 con 0x7f43d006bf20 2023-10-25T16:13:44.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d00ae950 con 0x7f43d006bf20 2023-10-25T16:13:44.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00106c0 con 0x7f43d006bf20 2023-10-25T16:13:44.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d00aef10 con 0x7f43d006bf20 2023-10-25T16:13:44.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.040+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d004daf0 con 0x7f43d006bf20 2023-10-25T16:13:44.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.044+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43c0010820 con 0x7f43d006bf20 2023-10-25T16:13:44.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.044+0000 7f43c77fe640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43b00664a0 0x7f43b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.044+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c0084230 con 0x7f43d006bf20 2023-10-25T16:13:44.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.044+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43b00664a0 0x7f43b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.044+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43b00664a0 0x7f43b0068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43b80af000 tx=0x7f43b801b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.048+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43c0051740 con 0x7f43d006bf20 2023-10-25T16:13:44.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.200+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43d00b29d0 con 0x7f43d006bf20 2023-10-25T16:13:44.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.200+0000 7f43c77fe640 1 -- 172.21.15.177:0/1633450374 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43c0054d60 con 0x7f43d006bf20 2023-10-25T16:13:44.205 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:44.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43b00664a0 msgr2=0x7f43b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43b00664a0 0x7f43b0068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f43b80af000 tx=0x7f43b801b010 comp rx=0 tx=0).stop 2023-10-25T16:13:44.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 msgr2=0x7f43d0145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 0x7f43d0145040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f43c000d950 tx=0x7f43c000de10 comp rx=0 tx=0).stop 2023-10-25T16:13:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 shutdown_connections 2023-10-25T16:13:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43b00664a0 0x7f43b0068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d01500f0 0x7f43d00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d00c9e50 0x7f43d00b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 --2- 172.21.15.177:0/1633450374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43d006bf20 0x7f43d0145040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 >> 172.21.15.177:0/1633450374 conn(0x7f43d00b2450 msgr2=0x7f43d0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 shutdown_connections 2023-10-25T16:13:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.204+0000 7f43d55de640 1 -- 172.21.15.177:0/1633450374 wait complete. 2023-10-25T16:13:44.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14c5270640 1 -- 172.21.15.177:0/154045893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14ac003980 msgr2=0x7f14ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14c5270640 1 --2- 172.21.15.177:0/154045893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14ac003980 0x7f14ac003da0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f14b0005fd0 tx=0x7f14b001cd80 comp rx=0 tx=0).stop 2023-10-25T16:13:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14bf7fe640 1 -- 172.21.15.177:0/154045893 reap_dead start 2023-10-25T16:13:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14c5270640 1 -- 172.21.15.177:0/154045893 shutdown_connections 2023-10-25T16:13:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14c5270640 1 -- 172.21.15.177:0/154045893 >> 172.21.15.177:0/154045893 conn(0x7f14c009a5c0 msgr2=0x7f14c00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14c5270640 1 -- 172.21.15.177:0/154045893 shutdown_connections 2023-10-25T16:13:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.348+0000 7f14c5270640 1 -- 172.21.15.177:0/154045893 wait complete. 2023-10-25T16:13:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 Processor -- start 2023-10-25T16:13:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- start start 2023-10-25T16:13:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 0x7f14c0155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14c015c7e0 0x7f14c00c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c01539e0 0x7f14c0153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c01543a0 con 0x7f14c015c400 2023-10-25T16:13:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00c5bc0 con 0x7f14c015c7e0 2023-10-25T16:13:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00c5e20 con 0x7f14c01539e0 2023-10-25T16:13:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 0x7f14c0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 0x7f14c0155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59722/0 (socket says 172.21.15.177:59722) 2023-10-25T16:13:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 -- 172.21.15.177:0/647311865 learned_addr learned my addr 172.21.15.177:0/647311865 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:44.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 -- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c01539e0 msgr2=0x7f14c0153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c01539e0 0x7f14c0153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 -- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14c015c7e0 msgr2=0x7f14c00c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14c015c7e0 0x7f14c00c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 -- 172.21.15.177:0/647311865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c00c6100 con 0x7f14c015c400 2023-10-25T16:13:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14beffd640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 0x7f14c0155d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f14b000ba60 tx=0x7f14b00a5ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00be070 con 0x7f14c015c400 2023-10-25T16:13:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f14b0004110 con 0x7f14c015c400 2023-10-25T16:13:44.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c00c63e0 con 0x7f14c015c400 2023-10-25T16:13:44.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00050c0 con 0x7f14c015c400 2023-10-25T16:13:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c00c69a0 con 0x7f14c015c400 2023-10-25T16:13:44.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c004daf0 con 0x7f14c015c400 2023-10-25T16:13:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.352+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14b0005220 con 0x7f14c015c400 2023-10-25T16:13:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.356+0000 7f14b77fe640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14a00664a0 0x7f14a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.356+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14b011ee70 con 0x7f14c015c400 2023-10-25T16:13:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.356+0000 7f14be7fc640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14a00664a0 0x7f14a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.356+0000 7f14be7fc640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14a00664a0 0x7f14a0068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14a8001ec0 tx=0x7f14a8003620 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.356+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14b00ec3d0 con 0x7f14c015c400 2023-10-25T16:13:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.508+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14c00ce930 con 0x7f14c015c400 2023-10-25T16:13:44.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.508+0000 7f14b77fe640 1 -- 172.21.15.177:0/647311865 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14b00ef9f0 con 0x7f14c015c400 2023-10-25T16:13:44.514 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:44.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14a00664a0 msgr2=0x7f14a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14a00664a0 0x7f14a0068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14a8001ec0 tx=0x7f14a8003620 comp rx=0 tx=0).stop 2023-10-25T16:13:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 msgr2=0x7f14c0155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 0x7f14c0155d50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f14b000ba60 tx=0x7f14b00a5ef0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 shutdown_connections 2023-10-25T16:13:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14a00664a0 0x7f14a0068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c01539e0 0x7f14c0153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14c015c7e0 0x7f14c00c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 --2- 172.21.15.177:0/647311865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c015c400 0x7f14c0155d50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 >> 172.21.15.177:0/647311865 conn(0x7f14c009a5c0 msgr2=0x7f14c00d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 shutdown_connections 2023-10-25T16:13:44.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.512+0000 7f14c5270640 1 -- 172.21.15.177:0/647311865 wait complete. 2023-10-25T16:13:44.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:44.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 -- 172.21.15.177:0/3107783507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1184071500 msgr2=0x7f1184070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 --2- 172.21.15.177:0/3107783507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1184071500 0x7f1184070510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f11780098f0 tx=0x7f117801c850 comp rx=0 tx=0).stop 2023-10-25T16:13:44.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 -- 172.21.15.177:0/3107783507 shutdown_connections 2023-10-25T16:13:44.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 --2- 172.21.15.177:0/3107783507 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f118406b980 0x7f118406be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 --2- 172.21.15.177:0/3107783507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1184071500 0x7f1184070510 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 -- 172.21.15.177:0/3107783507 >> 172.21.15.177:0/3107783507 conn(0x7f11840b2450 msgr2=0x7f11840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 -- 172.21.15.177:0/3107783507 shutdown_connections 2023-10-25T16:13:44.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 -- 172.21.15.177:0/3107783507 wait complete. 2023-10-25T16:13:44.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 Processor -- start 2023-10-25T16:13:44.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.644+0000 7f118b13d640 1 -- start start 2023-10-25T16:13:44.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 0x7f11840ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1184071500 0x7f1184145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1184159230 0x7f11841573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11840acec0 con 0x7f118406b980 2023-10-25T16:13:44.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841463b0 con 0x7f1184159230 2023-10-25T16:13:44.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1184152f20 con 0x7f1184071500 2023-10-25T16:13:44.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 0x7f11840ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 0x7f11840ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59754/0 (socket says 172.21.15.177:59754) 2023-10-25T16:13:44.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 -- 172.21.15.177:0/1257380383 learned_addr learned my addr 172.21.15.177:0/1257380383 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:44.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11896da640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1184159230 0x7f11841573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1183fff640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1184071500 0x7f1184145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 -- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1184071500 msgr2=0x7f1184145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1184071500 0x7f1184145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 -- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1184159230 msgr2=0x7f11841573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1184159230 0x7f11841573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 -- 172.21.15.177:0/1257380383 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178009500 con 0x7f118406b980 2023-10-25T16:13:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1188ed9640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 0x7f11840ac980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f117400b3e0 tx=0x7f117400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174011830 con 0x7f118406b980 2023-10-25T16:13:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1174011aa0 con 0x7f118406b980 2023-10-25T16:13:44.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1184150fe0 con 0x7f118406b980 2023-10-25T16:13:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174010380 con 0x7f118406b980 2023-10-25T16:13:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841515a0 con 0x7f118406b980 2023-10-25T16:13:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118404daf0 con 0x7f118406b980 2023-10-25T16:13:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f11740104e0 con 0x7f118406b980 2023-10-25T16:13:44.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11817fa640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1170066470 0x7f1170068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11740842c0 con 0x7f118406b980 2023-10-25T16:13:44.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.648+0000 7f1183fff640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1170066470 0x7f1170068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.652+0000 7f1183fff640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1170066470 0x7f1170068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f11780af000 tx=0x7f117801b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.652+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1174051740 con 0x7f118406b980 2023-10-25T16:13:44.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.796+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11840cdae0 con 0x7f118406b980 2023-10-25T16:13:44.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.796+0000 7f11817fa640 1 -- 172.21.15.177:0/1257380383 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1174054d60 con 0x7f118406b980 2023-10-25T16:13:44.802 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:44.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1170066470 msgr2=0x7f1170068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1170066470 0x7f1170068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f11780af000 tx=0x7f117801b090 comp rx=0 tx=0).stop 2023-10-25T16:13:44.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 msgr2=0x7f11840ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 0x7f11840ac980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f117400b3e0 tx=0x7f117400b8a0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 shutdown_connections 2023-10-25T16:13:44.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1170066470 0x7f1170068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1184159230 0x7f11841573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1184071500 0x7f1184145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 --2- 172.21.15.177:0/1257380383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f118406b980 0x7f11840ac980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 >> 172.21.15.177:0/1257380383 conn(0x7f11840b2450 msgr2=0x7f118415a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 shutdown_connections 2023-10-25T16:13:44.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.800+0000 7f118b13d640 1 -- 172.21.15.177:0/1257380383 wait complete. 2023-10-25T16:13:44.819 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:44.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3870259642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd940004d10 msgr2=0x7fd940005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3870259642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd940004d10 0x7fd940005190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd95000c590 tx=0x7fd95001faa0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95d290640 1 -- 172.21.15.177:0/3870259642 reap_dead start 2023-10-25T16:13:44.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3870259642 shutdown_connections 2023-10-25T16:13:44.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3870259642 >> 172.21.15.177:0/3870259642 conn(0x7fd95809a5c0 msgr2=0x7fd9580d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:44.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3870259642 shutdown_connections 2023-10-25T16:13:44.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3870259642 wait complete. 2023-10-25T16:13:44.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 Processor -- start 2023-10-25T16:13:44.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- start start 2023-10-25T16:13:44.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9581518d0 0x7fd958157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 0x7fd958158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd958155710 0x7fd958155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958156400 con 0x7fd958151cb0 2023-10-25T16:13:44.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9581566e0 con 0x7fd958155710 2023-10-25T16:13:44.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd95ecf3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9581569c0 con 0x7fd9581518d0 2023-10-25T16:13:44.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd957fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 0x7fd958158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd957fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 0x7fd958158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59774/0 (socket says 172.21.15.177:59774) 2023-10-25T16:13:44.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.928+0000 7fd957fff640 1 -- 172.21.15.177:0/3708707222 learned_addr learned my addr 172.21.15.177:0/3708707222 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:44.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95d290640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd958155710 0x7fd958155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ca8f640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9581518d0 0x7fd958157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd957fff640 1 -- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9581518d0 msgr2=0x7fd958157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd957fff640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9581518d0 0x7fd958157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd957fff640 1 -- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd958155710 msgr2=0x7fd958155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:44.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd957fff640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd958155710 0x7fd958155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:44.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd957fff640 1 -- 172.21.15.177:0/3708707222 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958156ca0 con 0x7fd958151cb0 2023-10-25T16:13:44.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95d290640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd958155710 0x7fd958155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:44.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ca8f640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9581518d0 0x7fd958157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:44.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd957fff640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 0x7fd958158480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00d5a0 tx=0x7fd94c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c012630 con 0x7fd958151cb0 2023-10-25T16:13:44.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd94c012790 con 0x7fd958151cb0 2023-10-25T16:13:44.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958156f80 con 0x7fd958151cb0 2023-10-25T16:13:44.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c012be0 con 0x7fd958151cb0 2023-10-25T16:13:44.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95815b070 con 0x7fd958151cb0 2023-10-25T16:13:44.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95804daf0 con 0x7fd958151cb0 2023-10-25T16:13:44.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd94c012d40 con 0x7fd958151cb0 2023-10-25T16:13:44.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd9557fa640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd944066470 0x7fd944068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:44.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd94c083dd0 con 0x7fd958151cb0 2023-10-25T16:13:44.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ca8f640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd944066470 0x7fd944068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:44.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.932+0000 7fd95ca8f640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd944066470 0x7fd944068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd948009aa0 tx=0x7fd9480091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:44.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:44.936+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd94c051250 con 0x7fd958151cb0 2023-10-25T16:13:45.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9581529c0 con 0x7fd958151cb0 2023-10-25T16:13:45.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd9557fa640 1 -- 172.21.15.177:0/3708707222 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd94c054870 con 0x7fd958151cb0 2023-10-25T16:13:45.096 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:45.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd944066470 msgr2=0x7fd944068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd944066470 0x7fd944068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd948009aa0 tx=0x7fd9480091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 msgr2=0x7fd958158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 0x7fd958158480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00d5a0 tx=0x7fd94c00da60 comp rx=0 tx=0).stop 2023-10-25T16:13:45.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 shutdown_connections 2023-10-25T16:13:45.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd944066470 0x7fd944068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd958155710 0x7fd958155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd958151cb0 0x7fd958158480 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 --2- 172.21.15.177:0/3708707222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9581518d0 0x7fd958157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 >> 172.21.15.177:0/3708707222 conn(0x7fd95809a5c0 msgr2=0x7fd9580b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:45.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 shutdown_connections 2023-10-25T16:13:45.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.092+0000 7fd95ecf3640 1 -- 172.21.15.177:0/3708707222 wait complete. 2023-10-25T16:13:45.112 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:13:45.113 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:45.119 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:45.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 -- 172.21.15.177:0/4090139275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 msgr2=0x7f93e80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 --2- 172.21.15.177:0/4090139275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80b4100 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f93e80cb890 tx=0x7f93dc01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 -- 172.21.15.177:0/4090139275 shutdown_connections 2023-10-25T16:13:45.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 --2- 172.21.15.177:0/4090139275 >> v2:172.21.15.184:3300/0 conn(0x7f93e80cdb10 0x7f93e80cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 --2- 172.21.15.177:0/4090139275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80b4100 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 -- 172.21.15.177:0/4090139275 >> 172.21.15.177:0/4090139275 conn(0x7f93e809a5c0 msgr2=0x7f93e80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:45.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 -- 172.21.15.177:0/4090139275 shutdown_connections 2023-10-25T16:13:45.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.276+0000 7f93ee44f640 1 -- 172.21.15.177:0/4090139275 wait complete. 2023-10-25T16:13:45.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 Processor -- start 2023-10-25T16:13:45.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- start start 2023-10-25T16:13:45.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e80cdb10 0x7f93e80c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e815eba0 0x7f93e815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80ca960 con 0x7f93e80b2120 2023-10-25T16:13:45.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e814e6c0 con 0x7f93e815eba0 2023-10-25T16:13:45.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8159110 con 0x7f93e80cdb10 2023-10-25T16:13:45.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59796/0 (socket says 172.21.15.177:59796) 2023-10-25T16:13:45.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 -- 172.21.15.177:0/3048776873 learned_addr learned my addr 172.21.15.177:0/3048776873 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:45.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 -- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e80cdb10 msgr2=0x7f93e80c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e80cdb10 0x7f93e80c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 -- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e815eba0 msgr2=0x7f93e815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e815eba0 0x7f93e815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 -- 172.21.15.177:0/3048776873 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009560 con 0x7f93e80b2120 2023-10-25T16:13:45.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e7fff640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80ca420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b3e0 tx=0x7f93d800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:45.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8011830 con 0x7f93e80b2120 2023-10-25T16:13:45.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93d8011aa0 con 0x7f93e80b2120 2023-10-25T16:13:45.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80cab70 con 0x7f93e80b2120 2023-10-25T16:13:45.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8010380 con 0x7f93e80b2120 2023-10-25T16:13:45.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80cb130 con 0x7f93e80b2120 2023-10-25T16:13:45.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e804daf0 con 0x7f93e80b2120 2023-10-25T16:13:45.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.280+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f93d80104e0 con 0x7f93e80b2120 2023-10-25T16:13:45.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.284+0000 7f93e4ff9640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f93d4066470 0x7f93d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.284+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93d80842e0 con 0x7f93e80b2120 2023-10-25T16:13:45.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.284+0000 7f93e77fe640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f93d4066470 0x7f93d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.284+0000 7f93e77fe640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f93d4066470 0x7f93d4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0ae000 tx=0x7f93dc019570 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:45.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.288+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93d8051760 con 0x7f93e80b2120 2023-10-25T16:13:45.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.444+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e80ce110 con 0x7f93e80b2120 2023-10-25T16:13:45.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.444+0000 7f93e4ff9640 1 -- 172.21.15.177:0/3048776873 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f93d8054d80 con 0x7f93e80b2120 2023-10-25T16:13:45.450 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:45.450 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:45.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f93d4066470 msgr2=0x7f93d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f93d4066470 0x7f93d4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f93dc0ae000 tx=0x7f93dc019570 comp rx=0 tx=0).stop 2023-10-25T16:13:45.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 msgr2=0x7f93e80ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80ca420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f93d800b3e0 tx=0x7f93d800b8a0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 shutdown_connections 2023-10-25T16:13:45.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f93d4066470 0x7f93d4068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93e815eba0 0x7f93e815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93e80cdb10 0x7f93e80c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 --2- 172.21.15.177:0/3048776873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93e80b2120 0x7f93e80ca420 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 >> 172.21.15.177:0/3048776873 conn(0x7f93e809a5c0 msgr2=0x7f93e815c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 shutdown_connections 2023-10-25T16:13:45.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.448+0000 7f93ee44f640 1 -- 172.21.15.177:0/3048776873 wait complete. 2023-10-25T16:13:45.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:45.469 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:45.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4153176243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c80cfe20 msgr2=0x7f34c80c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 --2- 172.21.15.177:0/4153176243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c80cfe20 0x7f34c80c8310 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009840 tx=0x7f34bc01c730 comp rx=0 tx=0).stop 2023-10-25T16:13:45.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4153176243 shutdown_connections 2023-10-25T16:13:45.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 --2- 172.21.15.177:0/4153176243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c80cfe20 0x7f34c80c8310 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4153176243 >> 172.21.15.177:0/4153176243 conn(0x7f34c809a580 msgr2=0x7f34c80d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:45.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4153176243 shutdown_connections 2023-10-25T16:13:45.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4153176243 wait complete. 2023-10-25T16:13:45.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 Processor -- start 2023-10-25T16:13:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- start start 2023-10-25T16:13:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34c80b2070 0x7f34c814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34c80cfe20 0x7f34c814b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 0x7f34c8148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c814de20 con 0x7f34c815eba0 2023-10-25T16:13:45.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8149ae0 con 0x7f34c80b2070 2023-10-25T16:13:45.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c814d7d0 con 0x7f34c80cfe20 2023-10-25T16:13:45.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 0x7f34c8148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 0x7f34c8148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59822/0 (socket says 172.21.15.177:59822) 2023-10-25T16:13:45.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 -- 172.21.15.177:0/4156530537 learned_addr learned my addr 172.21.15.177:0/4156530537 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:45.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c659c640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34c80cfe20 0x7f34c814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c6d9d640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34c80b2070 0x7f34c814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 -- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34c80cfe20 msgr2=0x7f34c814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34c80cfe20 0x7f34c814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 -- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34c80b2070 msgr2=0x7f34c814e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34c80b2070 0x7f34c814e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 -- 172.21.15.177:0/4156530537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0094a0 con 0x7f34c815eba0 2023-10-25T16:13:45.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c659c640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34c80cfe20 0x7f34c814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:45.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c6d9d640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34c80b2070 0x7f34c814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:45.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34c759e640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 0x7f34c8148f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f34c000cb40 tx=0x7f34c000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:45.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000aa50 con 0x7f34c815eba0 2023-10-25T16:13:45.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34c000aca0 con 0x7f34c815eba0 2023-10-25T16:13:45.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c814dab0 con 0x7f34c815eba0 2023-10-25T16:13:45.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0012680 con 0x7f34c815eba0 2023-10-25T16:13:45.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.596+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c8149dc0 con 0x7f34c815eba0 2023-10-25T16:13:45.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.600+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c814df90 con 0x7f34c815eba0 2023-10-25T16:13:45.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.600+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34c001a3b0 con 0x7f34c815eba0 2023-10-25T16:13:45.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.600+0000 7f34af7fe640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34b4066470 0x7f34b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.600+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34c0084100 con 0x7f34c815eba0 2023-10-25T16:13:45.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.600+0000 7f34c6d9d640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34b4066470 0x7f34b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.600+0000 7f34c6d9d640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34b4066470 0x7f34b4068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f34b800a850 tx=0x7f34b8008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:45.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.604+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34c0051580 con 0x7f34c815eba0 2023-10-25T16:13:45.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34c804daf0 con 0x7f34c815eba0 2023-10-25T16:13:45.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34af7fe640 1 -- 172.21.15.177:0/4156530537 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34c0054ba0 con 0x7f34c815eba0 2023-10-25T16:13:45.765 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:45.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34b4066470 msgr2=0x7f34b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34b4066470 0x7f34b4068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f34b800a850 tx=0x7f34b8008040 comp rx=0 tx=0).stop 2023-10-25T16:13:45.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 msgr2=0x7f34c8148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 0x7f34c8148f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f34c000cb40 tx=0x7f34c000cc30 comp rx=0 tx=0).stop 2023-10-25T16:13:45.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 shutdown_connections 2023-10-25T16:13:45.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34b4066470 0x7f34b4068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34c815eba0 0x7f34c8148f90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34c80cfe20 0x7f34c814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 --2- 172.21.15.177:0/4156530537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34c80b2070 0x7f34c814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 >> 172.21.15.177:0/4156530537 conn(0x7f34c809a580 msgr2=0x7f34c815c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:45.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.760+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 shutdown_connections 2023-10-25T16:13:45.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.764+0000 7f34cd124640 1 -- 172.21.15.177:0/4156530537 wait complete. 2023-10-25T16:13:45.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:45.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.904+0000 7f345bdae640 1 -- 172.21.15.177:0/2954042240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34540cb770 msgr2=0x7f345415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.904+0000 7f345bdae640 1 --2- 172.21.15.177:0/2954042240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34540cb770 0x7f345415bce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3444009900 tx=0x7f344401c890 comp rx=0 tx=0).stop 2023-10-25T16:13:45.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.904+0000 7f345bdae640 1 -- 172.21.15.177:0/2954042240 shutdown_connections 2023-10-25T16:13:45.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.904+0000 7f345bdae640 1 --2- 172.21.15.177:0/2954042240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f345415c220 0x7f34540b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.904+0000 7f345bdae640 1 --2- 172.21.15.177:0/2954042240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34540cb770 0x7f345415bce0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.904+0000 7f345bdae640 1 -- 172.21.15.177:0/2954042240 >> 172.21.15.177:0/2954042240 conn(0x7f34540afc40 msgr2=0x7f34540b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:45.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- 172.21.15.177:0/2954042240 shutdown_connections 2023-10-25T16:13:45.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- 172.21.15.177:0/2954042240 wait complete. 2023-10-25T16:13:45.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 Processor -- start 2023-10-25T16:13:45.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- start start 2023-10-25T16:13:45.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34540cb770 0x7f3454157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 0x7f34541624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f345415c220 0x7f34541517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541362c0 con 0x7f3454141b50 2023-10-25T16:13:45.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541365a0 con 0x7f345415c220 2023-10-25T16:13:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3454136880 con 0x7f34540cb770 2023-10-25T16:13:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 0x7f34541624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 0x7f34541624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59848/0 (socket says 172.21.15.177:59848) 2023-10-25T16:13:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 -- 172.21.15.177:0/3147510542 learned_addr learned my addr 172.21.15.177:0/3147510542 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459b4a640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34540cb770 0x7f3454157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345a34b640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f345415c220 0x7f34541517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 -- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34540cb770 msgr2=0x7f3454157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34540cb770 0x7f3454157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 -- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f345415c220 msgr2=0x7f34541517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f345415c220 0x7f34541517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 -- 172.21.15.177:0/3147510542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444009560 con 0x7f3454141b50 2023-10-25T16:13:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f3459349640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 0x7f34541624e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3444009850 tx=0x7f34440a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444003800 con 0x7f3454141b50 2023-10-25T16:13:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34440a5940 con 0x7f3454141b50 2023-10-25T16:13:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3454136b60 con 0x7f3454141b50 2023-10-25T16:13:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444003c70 con 0x7f3454141b50 2023-10-25T16:13:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3454137360 con 0x7f3454141b50 2023-10-25T16:13:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.908+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3454066b20 con 0x7f3454141b50 2023-10-25T16:13:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.912+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34440b4040 con 0x7f3454141b50 2023-10-25T16:13:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.912+0000 7f344a7fc640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3438066470 0x7f3438068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.912+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f344411e140 con 0x7f3454141b50 2023-10-25T16:13:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.912+0000 7f3459b4a640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3438066470 0x7f3438068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.912+0000 7f3459b4a640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3438066470 0x7f3438068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3450000f70 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:45.916+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34440eb5c0 con 0x7f3454141b50 2023-10-25T16:13:46.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f345404daf0 con 0x7f3454141b50 2023-10-25T16:13:46.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f344a7fc640 1 -- 172.21.15.177:0/3147510542 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34440eebe0 con 0x7f3454141b50 2023-10-25T16:13:46.065 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:46.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3438066470 msgr2=0x7f3438068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3438066470 0x7f3438068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3450000f70 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-10-25T16:13:46.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 msgr2=0x7f34541624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 0x7f34541624e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3444009850 tx=0x7f34440a5750 comp rx=0 tx=0).stop 2023-10-25T16:13:46.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 shutdown_connections 2023-10-25T16:13:46.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3438066470 0x7f3438068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f345415c220 0x7f34541517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3454141b50 0x7f34541624e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.060+0000 7f345bdae640 1 --2- 172.21.15.177:0/3147510542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34540cb770 0x7f3454157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.064+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 >> 172.21.15.177:0/3147510542 conn(0x7f34540afc40 msgr2=0x7f34540aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:46.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.064+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 shutdown_connections 2023-10-25T16:13:46.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.064+0000 7f345bdae640 1 -- 172.21.15.177:0/3147510542 wait complete. 2023-10-25T16:13:46.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:46.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- 172.21.15.177:0/3139399490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6300003980 msgr2=0x7f6300003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 --2- 172.21.15.177:0/3139399490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6300003980 0x7f6300003da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6304006fb0 tx=0x7f630401cf70 comp rx=0 tx=0).stop 2023-10-25T16:13:46.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- 172.21.15.177:0/3139399490 shutdown_connections 2023-10-25T16:13:46.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 --2- 172.21.15.177:0/3139399490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6300003980 0x7f6300003da0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- 172.21.15.177:0/3139399490 >> 172.21.15.177:0/3139399490 conn(0x7f6314097a40 msgr2=0x7f6314097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:46.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- 172.21.15.177:0/3139399490 shutdown_connections 2023-10-25T16:13:46.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- 172.21.15.177:0/3139399490 wait complete. 2023-10-25T16:13:46.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 Processor -- start 2023-10-25T16:13:46.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- start start 2023-10-25T16:13:46.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6300003980 0x7f63140b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6314150240 0x7f631414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 0x7f63140b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314150b00 con 0x7f63140b3440 2023-10-25T16:13:46.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b23a0 con 0x7f6300003980 2023-10-25T16:13:46.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f631a50c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b2680 con 0x7f6314150240 2023-10-25T16:13:46.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f6318aa9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 0x7f63140b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f6318aa9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 0x7f63140b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59856/0 (socket says 172.21.15.177:59856) 2023-10-25T16:13:46.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f6318aa9640 1 -- 172.21.15.177:0/3878985037 learned_addr learned my addr 172.21.15.177:0/3878985037 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:46.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.200+0000 7f6313fff640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6300003980 0x7f63140b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f630b7fe640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6314150240 0x7f631414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6318aa9640 1 -- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6314150240 msgr2=0x7f631414f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6318aa9640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6314150240 0x7f631414f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6318aa9640 1 -- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6300003980 msgr2=0x7f63140b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6318aa9640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6300003980 0x7f63140b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6318aa9640 1 -- 172.21.15.177:0/3878985037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140b2960 con 0x7f63140b3440 2023-10-25T16:13:46.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6318aa9640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 0x7f63140b40b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63140c9720 tx=0x7f630c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:46.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c003980 con 0x7f63140b3440 2023-10-25T16:13:46.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f630c003ae0 con 0x7f63140b3440 2023-10-25T16:13:46.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63140b2c40 con 0x7f63140b3440 2023-10-25T16:13:46.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c005030 con 0x7f63140b3440 2023-10-25T16:13:46.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631414ff30 con 0x7f63140b3440 2023-10-25T16:13:46.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631404daf0 con 0x7f63140b3440 2023-10-25T16:13:46.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f630c005190 con 0x7f63140b3440 2023-10-25T16:13:46.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f63117fa640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62f40664a0 0x7f62f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f630c083820 con 0x7f63140b3440 2023-10-25T16:13:46.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6313fff640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62f40664a0 0x7f62f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.204+0000 7f6313fff640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62f40664a0 0x7f62f4068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f63040ac000 tx=0x7f63040b0040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:46.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.208+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f630c050ca0 con 0x7f63140b3440 2023-10-25T16:13:46.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.364+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63140b30f0 con 0x7f63140b3440 2023-10-25T16:13:46.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.364+0000 7f63117fa640 1 -- 172.21.15.177:0/3878985037 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f630c018070 con 0x7f63140b3440 2023-10-25T16:13:46.368 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.364+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62f40664a0 msgr2=0x7f62f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.364+0000 7f631a50c640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62f40664a0 0x7f62f4068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f63040ac000 tx=0x7f63040b0040 comp rx=0 tx=0).stop 2023-10-25T16:13:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.364+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 msgr2=0x7f63140b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.364+0000 7f631a50c640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 0x7f63140b40b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63140c9720 tx=0x7f630c00dc10 comp rx=0 tx=0).stop 2023-10-25T16:13:46.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 shutdown_connections 2023-10-25T16:13:46.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62f40664a0 0x7f62f4068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63140b3440 0x7f63140b40b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6314150240 0x7f631414f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 --2- 172.21.15.177:0/3878985037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6300003980 0x7f63140b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 >> 172.21.15.177:0/3878985037 conn(0x7f6314097a40 msgr2=0x7f63140abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:46.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 shutdown_connections 2023-10-25T16:13:46.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.368+0000 7f631a50c640 1 -- 172.21.15.177:0/3878985037 wait complete. 2023-10-25T16:13:46.388 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:46.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- 172.21.15.177:0/3172823491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8070004d10 msgr2=0x7f8070005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 --2- 172.21.15.177:0/3172823491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8070004d10 0x7f8070005190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8078009e30 tx=0x7f807801d150 comp rx=0 tx=0).stop 2023-10-25T16:13:46.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808e45e640 1 -- 172.21.15.177:0/3172823491 reap_dead start 2023-10-25T16:13:46.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- 172.21.15.177:0/3172823491 shutdown_connections 2023-10-25T16:13:46.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- 172.21.15.177:0/3172823491 >> 172.21.15.177:0/3172823491 conn(0x7f80880b2450 msgr2=0x7f80880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:46.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- 172.21.15.177:0/3172823491 shutdown_connections 2023-10-25T16:13:46.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- 172.21.15.177:0/3172823491 wait complete. 2023-10-25T16:13:46.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 Processor -- start 2023-10-25T16:13:46.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- start start 2023-10-25T16:13:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070004d10 0x7f8088070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 0x7f8088147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f808813bb70 0x7f808813c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808813c560 con 0x7f8088164230 2023-10-25T16:13:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808815aee0 con 0x7f8070004d10 2023-10-25T16:13:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808fec1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808815a900 con 0x7f808813bb70 2023-10-25T16:13:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 0x7f8088147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 0x7f8088147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59878/0 (socket says 172.21.15.177:59878) 2023-10-25T16:13:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 -- 172.21.15.177:0/2496672701 learned_addr learned my addr 172.21.15.177:0/2496672701 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808e45e640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f808813bb70 0x7f808813c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808dc5d640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070004d10 0x7f8088070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 -- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f808813bb70 msgr2=0x7f808813c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f808813bb70 0x7f808813c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 -- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070004d10 msgr2=0x7f8088070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070004d10 0x7f8088070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.504+0000 7f808d45c640 1 -- 172.21.15.177:0/2496672701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80881584a0 con 0x7f8088164230 2023-10-25T16:13:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f808d45c640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 0x7f8088147dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f807c00d810 tx=0x7f807c00dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0052e0 con 0x7f8088164230 2023-10-25T16:13:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f807c005440 con 0x7f8088164230 2023-10-25T16:13:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808815ab70 con 0x7f8088164230 2023-10-25T16:13:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00b8a0 con 0x7f8088164230 2023-10-25T16:13:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8088158780 con 0x7f8088164230 2023-10-25T16:13:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808804daf0 con 0x7f8088164230 2023-10-25T16:13:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f807c00ba00 con 0x7f8088164230 2023-10-25T16:13:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f80867fc640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8074066470 0x7f8074068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f807c083a80 con 0x7f8088164230 2023-10-25T16:13:46.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f808dc5d640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8074066470 0x7f8074068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:46.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.508+0000 7f808dc5d640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8074066470 0x7f8074068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8080005fd0 tx=0x7f8080005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:46.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.512+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f807c050ef0 con 0x7f8088164230 2023-10-25T16:13:46.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80880af550 con 0x7f8088164230 2023-10-25T16:13:46.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f80867fc640 1 -- 172.21.15.177:0/2496672701 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f80880af550 con 0x7f8088164230 2023-10-25T16:13:46.672 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:46.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8074066470 msgr2=0x7f8074068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8074066470 0x7f8074068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8080005fd0 tx=0x7f8080005f40 comp rx=0 tx=0).stop 2023-10-25T16:13:46.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 msgr2=0x7f8088147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:46.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 0x7f8088147dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f807c00d810 tx=0x7f807c00dcd0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 shutdown_connections 2023-10-25T16:13:46.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8074066470 0x7f8074068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f808813bb70 0x7f808813c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8088164230 0x7f8088147dd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 --2- 172.21.15.177:0/2496672701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070004d10 0x7f8088070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:46.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 >> 172.21.15.177:0/2496672701 conn(0x7f80880b2450 msgr2=0x7f80880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:46.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 shutdown_connections 2023-10-25T16:13:46.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46.668+0000 7f808fec1640 1 -- 172.21.15.177:0/2496672701 wait complete. 2023-10-25T16:13:46.689 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:13:46.690 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:46.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:13:46.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:46.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[35703]: fuse finished with error 0 and tester_r 0 2023-10-25T16:13:46.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:46.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:46.764 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:13:46.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:13:46.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:46.771 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:13:46.828 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:13:46.828 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:46.835 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:13:46.836 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:46.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:46.929 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:13:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:47.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- 172.21.15.177:0/2615743710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c601592c0 msgr2=0x7f7c600c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 --2- 172.21.15.177:0/2615743710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c601592c0 0x7f7c600c98a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7c600cbc30 tx=0x7f7c5801cd60 comp rx=0 tx=0).stop 2023-10-25T16:13:47.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- 172.21.15.177:0/2615743710 shutdown_connections 2023-10-25T16:13:47.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 --2- 172.21.15.177:0/2615743710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c601592c0 0x7f7c600c98a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 --2- 172.21.15.177:0/2615743710 >> v2:172.21.15.184:3300/0 conn(0x7f7c600ce980 0x7f7c600cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- 172.21.15.177:0/2615743710 >> 172.21.15.177:0/2615743710 conn(0x7f7c60069d20 msgr2=0x7f7c6006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- 172.21.15.177:0/2615743710 shutdown_connections 2023-10-25T16:13:47.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- 172.21.15.177:0/2615743710 wait complete. 2023-10-25T16:13:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 Processor -- start 2023-10-25T16:13:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- start start 2023-10-25T16:13:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 0x7f7c60157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c600ced60 0x7f7c60154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c601592c0 0x7f7c601485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6014f910 con 0x7f7c600ce980 2023-10-25T16:13:47.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015b530 con 0x7f7c600ced60 2023-10-25T16:13:47.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015b810 con 0x7f7c601592c0 2023-10-25T16:13:47.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 0x7f7c60157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 0x7f7c60157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59896/0 (socket says 172.21.15.177:59896) 2023-10-25T16:13:47.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 -- 172.21.15.177:0/4064800900 learned_addr learned my addr 172.21.15.177:0/4064800900 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:47.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c6497e640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c601592c0 0x7f7c601485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5f7fe640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c600ced60 0x7f7c60154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 -- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c601592c0 msgr2=0x7f7c601485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c601592c0 0x7f7c601485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 -- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c600ced60 msgr2=0x7f7c60154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c600ced60 0x7f7c60154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 -- 172.21.15.177:0/4064800900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580098e0 con 0x7f7c600ce980 2023-10-25T16:13:47.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c6497e640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c601592c0 0x7f7c601485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:47.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5f7fe640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c600ced60 0x7f7c60154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:47.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5ffff640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 0x7f7c60157750 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000b550 tx=0x7f7c5000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50010870 con 0x7f7c600ce980 2023-10-25T16:13:47.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7c50010ae0 con 0x7f7c600ce980 2023-10-25T16:13:47.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6015baf0 con 0x7f7c600ce980 2023-10-25T16:13:47.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.004+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000f3c0 con 0x7f7c600ce980 2023-10-25T16:13:47.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c601493f0 con 0x7f7c600ce980 2023-10-25T16:13:47.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6004daf0 con 0x7f7c600ce980 2023-10-25T16:13:47.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c5000f520 con 0x7f7c600ce980 2023-10-25T16:13:47.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c5cff9640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c4c066470 0x7f7c4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c50084140 con 0x7f7c600ce980 2023-10-25T16:13:47.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c5f7fe640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c4c066470 0x7f7c4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.008+0000 7f7c5f7fe640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c4c066470 0x7f7c4c068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c6014f7c0 tx=0x7f7c54009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.012+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c500515c0 con 0x7f7c600ce980 2023-10-25T16:13:47.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.168+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c60065660 con 0x7f7c600ce980 2023-10-25T16:13:47.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.168+0000 7f7c5cff9640 1 -- 172.21.15.177:0/4064800900 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f7c50054be0 con 0x7f7c600ce980 2023-10-25T16:13:47.174 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:47.174 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:47.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c4c066470 msgr2=0x7f7c4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c4c066470 0x7f7c4c068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c6014f7c0 tx=0x7f7c54009040 comp rx=0 tx=0).stop 2023-10-25T16:13:47.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 msgr2=0x7f7c60157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 0x7f7c60157750 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000b550 tx=0x7f7c5000ba10 comp rx=0 tx=0).stop 2023-10-25T16:13:47.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 shutdown_connections 2023-10-25T16:13:47.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c4c066470 0x7f7c4c068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c601592c0 0x7f7c601485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c600ced60 0x7f7c60154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 --2- 172.21.15.177:0/4064800900 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c600ce980 0x7f7c60157750 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 >> 172.21.15.177:0/4064800900 conn(0x7f7c60069d20 msgr2=0x7f7c600b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 shutdown_connections 2023-10-25T16:13:47.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.172+0000 7f7c663e1640 1 -- 172.21.15.177:0/4064800900 wait complete. 2023-10-25T16:13:47.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:47.193 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:47.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/4206166257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0415c650 msgr2=0x7fea0415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 --2- 172.21.15.177:0/4206166257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0415c650 0x7fea0415a380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009900 tx=0x7fe9f401c850 comp rx=0 tx=0).stop 2023-10-25T16:13:47.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/4206166257 shutdown_connections 2023-10-25T16:13:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 --2- 172.21.15.177:0/4206166257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 0x7fea0406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 --2- 172.21.15.177:0/4206166257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0415c650 0x7fea0415a380 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/4206166257 >> 172.21.15.177:0/4206166257 conn(0x7fea040afe20 msgr2=0x7fea040b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/4206166257 shutdown_connections 2023-10-25T16:13:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/4206166257 wait complete. 2023-10-25T16:13:47.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 Processor -- start 2023-10-25T16:13:47.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- start start 2023-10-25T16:13:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 0x7fea041516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 0x7fea041414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea0415c650 0x7fea041535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea04141a20 con 0x7fea04069720 2023-10-25T16:13:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea04153ae0 con 0x7fea0415c650 2023-10-25T16:13:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea04151c80 con 0x7fea0415a9b0 2023-10-25T16:13:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 0x7fea041516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 0x7fea041516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59904/0 (socket says 172.21.15.177:59904) 2023-10-25T16:13:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 -- 172.21.15.177:0/1726449402 learned_addr learned my addr 172.21.15.177:0/1726449402 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea01d9b640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 0x7fea041414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea02d9d640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea0415c650 0x7fea041535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 -- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 msgr2=0x7fea041414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 0x7fea041414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 -- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea0415c650 msgr2=0x7fea041535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea0415c650 0x7fea041535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 -- 172.21.15.177:0/1726449402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4009560 con 0x7fea04069720 2023-10-25T16:13:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea01d9b640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 0x7fea041414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea02d9d640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea0415c650 0x7fea041535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea0259c640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 0x7fea041516a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401af00 tx=0x7fe9f40a5940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4004340 con 0x7fea04069720 2023-10-25T16:13:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe9f4003600 con 0x7fea04069720 2023-10-25T16:13:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea04151f60 con 0x7fea04069720 2023-10-25T16:13:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40039d0 con 0x7fea04069720 2023-10-25T16:13:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea04152520 con 0x7fea04069720 2023-10-25T16:13:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.308+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0404daf0 con 0x7fea04069720 2023-10-25T16:13:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.312+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9f40b4040 con 0x7fea04069720 2023-10-25T16:13:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.312+0000 7fe9f2ffd640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9e40664a0 0x7fe9e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.312+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f411d970 con 0x7fea04069720 2023-10-25T16:13:47.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.312+0000 7fea01d9b640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9e40664a0 0x7fe9e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.312+0000 7fea01d9b640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9e40664a0 0x7fe9e4068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8005fd0 tx=0x7fe9f8005da0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.316+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9f40eadf0 con 0x7fea04069720 2023-10-25T16:13:47.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea0406a570 con 0x7fea04069720 2023-10-25T16:13:47.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fe9f2ffd640 1 -- 172.21.15.177:0/1726449402 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9f40b20a0 con 0x7fea04069720 2023-10-25T16:13:47.465 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:47.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9e40664a0 msgr2=0x7fe9e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9e40664a0 0x7fe9e4068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8005fd0 tx=0x7fe9f8005da0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 msgr2=0x7fea041516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 0x7fea041516a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401af00 tx=0x7fe9f40a5940 comp rx=0 tx=0).stop 2023-10-25T16:13:47.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 shutdown_connections 2023-10-25T16:13:47.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9e40664a0 0x7fe9e4068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea0415c650 0x7fea041535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea0415a9b0 0x7fea041414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 --2- 172.21.15.177:0/1726449402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea04069720 0x7fea041516a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 >> 172.21.15.177:0/1726449402 conn(0x7fea040afe20 msgr2=0x7fea04158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 shutdown_connections 2023-10-25T16:13:47.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.460+0000 7fea08f0e640 1 -- 172.21.15.177:0/1726449402 wait complete. 2023-10-25T16:13:47.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:47.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- 172.21.15.177:0/134026912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd86406b9e0 msgr2=0x7fd86406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 --2- 172.21.15.177:0/134026912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd86406b9e0 0x7fd86406be90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd858005fd0 tx=0x7fd85801c7c0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- 172.21.15.177:0/134026912 shutdown_connections 2023-10-25T16:13:47.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 --2- 172.21.15.177:0/134026912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd86406b9e0 0x7fd86406be90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- 172.21.15.177:0/134026912 >> 172.21.15.177:0/134026912 conn(0x7fd8640b2450 msgr2=0x7fd8640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- 172.21.15.177:0/134026912 shutdown_connections 2023-10-25T16:13:47.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- 172.21.15.177:0/134026912 wait complete. 2023-10-25T16:13:47.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 Processor -- start 2023-10-25T16:13:47.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- start start 2023-10-25T16:13:47.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd86406b9e0 0x7fd864152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8640706f0 0x7fd864141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 0x7fd864145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864152800 con 0x7fd8641500f0 2023-10-25T16:13:47.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8641421b0 con 0x7fd86406b9e0 2023-10-25T16:13:47.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864151490 con 0x7fd8640706f0 2023-10-25T16:13:47.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 0x7fd864145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 0x7fd864145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59922/0 (socket says 172.21.15.177:59922) 2023-10-25T16:13:47.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 -- 172.21.15.177:0/957972828 learned_addr learned my addr 172.21.15.177:0/957972828 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:47.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd8637fe640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd86406b9e0 0x7fd864152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd862ffd640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8640706f0 0x7fd864141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 -- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8640706f0 msgr2=0x7fd864141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8640706f0 0x7fd864141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 -- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd86406b9e0 msgr2=0x7fd864152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd86406b9e0 0x7fd864152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 -- 172.21.15.177:0/957972828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009450 con 0x7fd8641500f0 2023-10-25T16:13:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd863fff640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 0x7fd864145750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00c770 tx=0x7fd85c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c003b80 con 0x7fd8641500f0 2023-10-25T16:13:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd85c003ce0 con 0x7fd8641500f0 2023-10-25T16:13:47.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86415a6b0 con 0x7fd8641500f0 2023-10-25T16:13:47.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.596+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00aab0 con 0x7fd8641500f0 2023-10-25T16:13:47.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd864152490 con 0x7fd8641500f0 2023-10-25T16:13:47.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864152970 con 0x7fd8641500f0 2023-10-25T16:13:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd85c00ac10 con 0x7fd8641500f0 2023-10-25T16:13:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd84bfff640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd850066470 0x7fd850068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd85c083f00 con 0x7fd8641500f0 2023-10-25T16:13:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd8637fe640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd850066470 0x7fd850068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.600+0000 7fd8637fe640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd850066470 0x7fd850068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8540011f0 tx=0x7fd854009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.604+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd85c0512f0 con 0x7fd8641500f0 2023-10-25T16:13:47.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.748+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd86404daf0 con 0x7fd8641500f0 2023-10-25T16:13:47.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.748+0000 7fd84bfff640 1 -- 172.21.15.177:0/957972828 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd85c054910 con 0x7fd8641500f0 2023-10-25T16:13:47.753 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:47.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd850066470 msgr2=0x7fd850068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd850066470 0x7fd850068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd8540011f0 tx=0x7fd854009040 comp rx=0 tx=0).stop 2023-10-25T16:13:47.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 msgr2=0x7fd864145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 0x7fd864145750 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00c770 tx=0x7fd85c00cc30 comp rx=0 tx=0).stop 2023-10-25T16:13:47.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 shutdown_connections 2023-10-25T16:13:47.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd850066470 0x7fd850068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8641500f0 0x7fd864145750 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8640706f0 0x7fd864141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 --2- 172.21.15.177:0/957972828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd86406b9e0 0x7fd864152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 >> 172.21.15.177:0/957972828 conn(0x7fd8640b2450 msgr2=0x7fd86415c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 shutdown_connections 2023-10-25T16:13:47.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.752+0000 7fd869d65640 1 -- 172.21.15.177:0/957972828 wait complete. 2023-10-25T16:13:47.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:47.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/2704332743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 msgr2=0x7f41c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 --2- 172.21.15.177:0/2704332743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41c00047d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f41d80ca230 tx=0x7f41cc01c720 comp rx=0 tx=0).stop 2023-10-25T16:13:47.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d6d9d640 1 -- 172.21.15.177:0/2704332743 reap_dead start 2023-10-25T16:13:47.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/2704332743 shutdown_connections 2023-10-25T16:13:47.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/2704332743 >> 172.21.15.177:0/2704332743 conn(0x7f41d80b2450 msgr2=0x7f41d80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:47.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/2704332743 shutdown_connections 2023-10-25T16:13:47.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/2704332743 wait complete. 2023-10-25T16:13:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 Processor -- start 2023-10-25T16:13:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- start start 2023-10-25T16:13:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41d814d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41d80af410 0x7f41d81ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41d81ef9d0 0x7f41d81f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d81efe80 con 0x7f41c0003f30 2023-10-25T16:13:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d8154750 con 0x7f41d80af410 2023-10-25T16:13:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d8154a30 con 0x7f41d81ef9d0 2023-10-25T16:13:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41d814d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41d814d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59940/0 (socket says 172.21.15.177:59940) 2023-10-25T16:13:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 -- 172.21.15.177:0/136281592 learned_addr learned my addr 172.21.15.177:0/136281592 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d5d9b640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41d80af410 0x7f41d81ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d6d9d640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41d81ef9d0 0x7f41d81f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 -- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41d81ef9d0 msgr2=0x7f41d81f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41d81ef9d0 0x7f41d81f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 -- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41d80af410 msgr2=0x7f41d81ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:47.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41d80af410 0x7f41d81ef490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:47.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 -- 172.21.15.177:0/136281592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8154d10 con 0x7f41c0003f30 2023-10-25T16:13:47.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d6d9d640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41d81ef9d0 0x7f41d81f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:47.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41d659c640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41d814d7e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f41c8011a50 tx=0x7f41c8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800fd90 con 0x7f41c0003f30 2023-10-25T16:13:47.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f41c8012450 con 0x7f41c0003f30 2023-10-25T16:13:47.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8012800 con 0x7f41c0003f30 2023-10-25T16:13:47.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d8154ff0 con 0x7f41c0003f30 2023-10-25T16:13:47.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.900+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d81555b0 con 0x7f41c0003f30 2023-10-25T16:13:47.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.904+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d804daf0 con 0x7f41c0003f30 2023-10-25T16:13:47.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.904+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f41c8012960 con 0x7f41c0003f30 2023-10-25T16:13:47.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.904+0000 7f41c6ffd640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f41b80664a0 0x7f41b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:47.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.904+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41c8084dd0 con 0x7f41c0003f30 2023-10-25T16:13:47.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.904+0000 7f41d5d9b640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f41b80664a0 0x7f41b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:47.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.904+0000 7f41d5d9b640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f41b80664a0 0x7f41b8068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0aa000 tx=0x7f41cc0194c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:47.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:47.908+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41c8052300 con 0x7f41c0003f30 2023-10-25T16:13:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.064+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41d80cd970 con 0x7f41c0003f30 2023-10-25T16:13:48.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.064+0000 7f41c6ffd640 1 -- 172.21.15.177:0/136281592 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41c80860a0 con 0x7f41c0003f30 2023-10-25T16:13:48.070 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:48.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f41b80664a0 msgr2=0x7f41b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f41b80664a0 0x7f41b8068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0aa000 tx=0x7f41cc0194c0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 msgr2=0x7f41d814d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41d814d7e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f41c8011a50 tx=0x7f41c8011f10 comp rx=0 tx=0).stop 2023-10-25T16:13:48.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 shutdown_connections 2023-10-25T16:13:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f41b80664a0 0x7f41b8068960 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0aa000 tx=0x7f41cc0194c0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41d81ef9d0 0x7f41d81f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41d80af410 0x7f41d81ef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 --2- 172.21.15.177:0/136281592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41c0003f30 0x7f41d814d7e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 >> 172.21.15.177:0/136281592 conn(0x7f41d80b2450 msgr2=0x7f41d815a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 shutdown_connections 2023-10-25T16:13:48.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.068+0000 7f41dcb97640 1 -- 172.21.15.177:0/136281592 wait complete. 2023-10-25T16:13:48.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:48.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 -- 172.21.15.177:0/300194405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14815cdd0 msgr2=0x7fc1480caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 --2- 172.21.15.177:0/300194405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14815cdd0 0x7fc1480caf90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc1380098f0 tx=0x7fc13801c850 comp rx=0 tx=0).stop 2023-10-25T16:13:48.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 -- 172.21.15.177:0/300194405 shutdown_connections 2023-10-25T16:13:48.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 --2- 172.21.15.177:0/300194405 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14806b9e0 0x7fc14806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 --2- 172.21.15.177:0/300194405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14815cdd0 0x7fc1480caf90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 -- 172.21.15.177:0/300194405 >> 172.21.15.177:0/300194405 conn(0x7fc1480b2450 msgr2=0x7fc1480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 -- 172.21.15.177:0/300194405 shutdown_connections 2023-10-25T16:13:48.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 -- 172.21.15.177:0/300194405 wait complete. 2023-10-25T16:13:48.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 Processor -- start 2023-10-25T16:13:48.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.208+0000 7fc14f64f640 1 -- start start 2023-10-25T16:13:48.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 0x7fc148149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1481537d0 0x7fc148147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14815cdd0 0x7fc14814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148152340 con 0x7fc14806b9e0 2023-10-25T16:13:48.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc148152620 con 0x7fc1481537d0 2023-10-25T16:13:48.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc148152900 con 0x7fc14815cdd0 2023-10-25T16:13:48.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 0x7fc148149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 0x7fc148149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59958/0 (socket says 172.21.15.177:59958) 2023-10-25T16:13:48.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 -- 172.21.15.177:0/3435889344 learned_addr learned my addr 172.21.15.177:0/3435889344 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:48.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14cbea640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1481537d0 0x7fc148147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 -- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14815cdd0 msgr2=0x7fc14814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14815cdd0 0x7fc14814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 -- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1481537d0 msgr2=0x7fc148147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1481537d0 0x7fc148147010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 -- 172.21.15.177:0/3435889344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc138009500 con 0x7fc14806b9e0 2023-10-25T16:13:48.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14d3eb640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 0x7fc148149980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c450 tx=0x7fc14400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:48.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144012830 con 0x7fc14806b9e0 2023-10-25T16:13:48.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc144012aa0 con 0x7fc14806b9e0 2023-10-25T16:13:48.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc148152be0 con 0x7fc14806b9e0 2023-10-25T16:13:48.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144011380 con 0x7fc14806b9e0 2023-10-25T16:13:48.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc148147550 con 0x7fc14806b9e0 2023-10-25T16:13:48.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14804daf0 con 0x7fc14806b9e0 2023-10-25T16:13:48.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc1440114e0 con 0x7fc14806b9e0 2023-10-25T16:13:48.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc13dffb640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc12c066470 0x7fc12c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc144083f00 con 0x7fc14806b9e0 2023-10-25T16:13:48.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.212+0000 7fc14cbea640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc12c066470 0x7fc12c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.216+0000 7fc14cbea640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc12c066470 0x7fc12c068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1380af000 tx=0x7fc13801b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:48.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.216+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc144051410 con 0x7fc14806b9e0 2023-10-25T16:13:48.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1480cd990 con 0x7fc14806b9e0 2023-10-25T16:13:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc13dffb640 1 -- 172.21.15.177:0/3435889344 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc144054a30 con 0x7fc14806b9e0 2023-10-25T16:13:48.376 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:48.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc12c066470 msgr2=0x7fc12c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc12c066470 0x7fc12c068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc1380af000 tx=0x7fc13801b090 comp rx=0 tx=0).stop 2023-10-25T16:13:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 msgr2=0x7fc148149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 0x7fc148149980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c450 tx=0x7fc14400c910 comp rx=0 tx=0).stop 2023-10-25T16:13:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 shutdown_connections 2023-10-25T16:13:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc12c066470 0x7fc12c068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc14815cdd0 0x7fc14814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1481537d0 0x7fc148147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 --2- 172.21.15.177:0/3435889344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14806b9e0 0x7fc148149980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 >> 172.21.15.177:0/3435889344 conn(0x7fc1480b2450 msgr2=0x7fc1480b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 shutdown_connections 2023-10-25T16:13:48.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.372+0000 7fc14f64f640 1 -- 172.21.15.177:0/3435889344 wait complete. 2023-10-25T16:13:48.394 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:13:48.394 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:48.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:48.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 -- 172.21.15.177:0/2873282120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813b0d0 msgr2=0x7f30e806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 --2- 172.21.15.177:0/2873282120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813b0d0 0x7f30e806c720 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f30e80718f0 tx=0x7f30e001c5b0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 -- 172.21.15.177:0/2873282120 shutdown_connections 2023-10-25T16:13:48.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 --2- 172.21.15.177:0/2873282120 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e815c230 0x7f30e8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 --2- 172.21.15.177:0/2873282120 >> v2:172.21.15.184:3300/0 conn(0x7f30e806cc60 0x7f30e815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 --2- 172.21.15.177:0/2873282120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e813b0d0 0x7f30e806c720 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 -- 172.21.15.177:0/2873282120 >> 172.21.15.177:0/2873282120 conn(0x7f30e80afe20 msgr2=0x7f30e80b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 -- 172.21.15.177:0/2873282120 shutdown_connections 2023-10-25T16:13:48.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.516+0000 7f30eeed3640 1 -- 172.21.15.177:0/2873282120 wait complete. 2023-10-25T16:13:48.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 Processor -- start 2023-10-25T16:13:48.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- start start 2023-10-25T16:13:48.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e806cc60 0x7f30e81f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e813b0d0 0x7f30e8155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 0x7f30e8131c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e81f2960 con 0x7f30e815c230 2023-10-25T16:13:48.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e81f5790 con 0x7f30e806cc60 2023-10-25T16:13:48.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e81326b0 con 0x7f30e813b0d0 2023-10-25T16:13:48.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 0x7f30e8131c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 0x7f30e8131c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59982/0 (socket says 172.21.15.177:59982) 2023-10-25T16:13:48.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 -- 172.21.15.177:0/1563732271 learned_addr learned my addr 172.21.15.177:0/1563732271 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:48.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30e7fff640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e813b0d0 0x7f30e8155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ecc6f640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e806cc60 0x7f30e81f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 -- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e813b0d0 msgr2=0x7f30e8155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e813b0d0 0x7f30e8155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 -- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e806cc60 msgr2=0x7f30e81f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e806cc60 0x7f30e81f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 -- 172.21.15.177:0/1563732271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0009560 con 0x7f30e815c230 2023-10-25T16:13:48.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30e7fff640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e813b0d0 0x7f30e8155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:48.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ecc6f640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e806cc60 0x7f30e81f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:48.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30ed470640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 0x7f30e8131c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f30d800e970 tx=0x7f30d800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:48.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8004d30 con 0x7f30e815c230 2023-10-25T16:13:48.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e8132990 con 0x7f30e815c230 2023-10-25T16:13:48.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f30d800cb20 con 0x7f30e815c230 2023-10-25T16:13:48.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8005020 con 0x7f30e815c230 2023-10-25T16:13:48.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8132f50 con 0x7f30e815c230 2023-10-25T16:13:48.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.520+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e804daf0 con 0x7f30e815c230 2023-10-25T16:13:48.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.524+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f30d8005180 con 0x7f30e815c230 2023-10-25T16:13:48.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.524+0000 7f30e57fa640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30c8066470 0x7f30c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.524+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30d8084820 con 0x7f30e815c230 2023-10-25T16:13:48.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.524+0000 7f30ecc6f640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30c8066470 0x7f30c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.524+0000 7f30ecc6f640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30c8066470 0x7f30c8068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30e00ae000 tx=0x7f30e001adf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:48.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.528+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f30d8051c20 con 0x7f30e815c230 2023-10-25T16:13:48.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.680+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30e8136cb0 con 0x7f30e815c230 2023-10-25T16:13:48.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.684+0000 7f30e57fa640 1 -- 172.21.15.177:0/1563732271 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f30d801f020 con 0x7f30e815c230 2023-10-25T16:13:48.689 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:48.689 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30c8066470 msgr2=0x7f30c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30c8066470 0x7f30c8068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30e00ae000 tx=0x7f30e001adf0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 msgr2=0x7f30e8131c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 0x7f30e8131c10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f30d800e970 tx=0x7f30d800ee30 comp rx=0 tx=0).stop 2023-10-25T16:13:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 shutdown_connections 2023-10-25T16:13:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30c8066470 0x7f30c8068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30e815c230 0x7f30e8131c10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30e813b0d0 0x7f30e8155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 --2- 172.21.15.177:0/1563732271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30e806cc60 0x7f30e81f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 >> 172.21.15.177:0/1563732271 conn(0x7f30e80afe20 msgr2=0x7f30e8138a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 shutdown_connections 2023-10-25T16:13:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.688+0000 7f30eeed3640 1 -- 172.21.15.177:0/1563732271 wait complete. 2023-10-25T16:13:48.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:48.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:48.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/1766001241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c0cbfa0 msgr2=0x7fe33c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 --2- 172.21.15.177:0/1766001241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c0cbfa0 0x7fe33c0aebc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe330005fd0 tx=0x7fe33001c7c0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/1766001241 shutdown_connections 2023-10-25T16:13:48.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 --2- 172.21.15.177:0/1766001241 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c0cbfa0 0x7fe33c0aebc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/1766001241 >> 172.21.15.177:0/1766001241 conn(0x7fe33c0b2450 msgr2=0x7fe33c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/1766001241 shutdown_connections 2023-10-25T16:13:48.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/1766001241 wait complete. 2023-10-25T16:13:48.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 Processor -- start 2023-10-25T16:13:48.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- start start 2023-10-25T16:13:48.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe33c0af100 0x7fe33c1f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe33c0cbfa0 0x7fe33c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 0x7fe33c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1f6e70 con 0x7fe33c14e810 2023-10-25T16:13:48.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1480e0 con 0x7fe33c0cbfa0 2023-10-25T16:13:48.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1490c0 con 0x7fe33c0af100 2023-10-25T16:13:48.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 0x7fe33c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 0x7fe33c146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60010/0 (socket says 172.21.15.177:60010) 2023-10-25T16:13:48.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 -- 172.21.15.177:0/4084912522 learned_addr learned my addr 172.21.15.177:0/4084912522 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:48.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 -- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe33c0af100 msgr2=0x7fe33c1f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe33c0af100 0x7fe33c1f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 -- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe33c0cbfa0 msgr2=0x7fe33c147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe33c0cbfa0 0x7fe33c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 -- 172.21.15.177:0/4084912522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009450 con 0x7fe33c14e810 2023-10-25T16:13:48.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe341dd2640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 0x7fe33c146700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c3c0 tx=0x7fe33400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:48.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334011790 con 0x7fe33c14e810 2023-10-25T16:13:48.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe3340119e0 con 0x7fe33c14e810 2023-10-25T16:13:48.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c1470c0 con 0x7fe33c14e810 2023-10-25T16:13:48.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334011df0 con 0x7fe33c14e810 2023-10-25T16:13:48.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.824+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c147680 con 0x7fe33c14e810 2023-10-25T16:13:48.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.828+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c146f20 con 0x7fe33c14e810 2023-10-25T16:13:48.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.828+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe33401c460 con 0x7fe33c14e810 2023-10-25T16:13:48.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.828+0000 7fe32dffb640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe320066470 0x7fe320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:48.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.828+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe334084060 con 0x7fe33c14e810 2023-10-25T16:13:48.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.828+0000 7fe3415d1640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe320066470 0x7fe320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:48.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.828+0000 7fe3415d1640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe320066470 0x7fe320068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe33c14b880 tx=0x7fe338007cc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:48.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.832+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3340b5090 con 0x7fe33c14e810 2023-10-25T16:13:48.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.972+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe33c1478a0 con 0x7fe33c14e810 2023-10-25T16:13:48.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.972+0000 7fe32dffb640 1 -- 172.21.15.177:0/4084912522 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe33c146f20 con 0x7fe33c14e810 2023-10-25T16:13:48.978 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:48.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.972+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe320066470 msgr2=0x7fe320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.972+0000 7fe343835640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe320066470 0x7fe320068930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe33c14b880 tx=0x7fe338007cc0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.972+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 msgr2=0x7fe33c146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:48.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.972+0000 7fe343835640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 0x7fe33c146700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c3c0 tx=0x7fe33400c880 comp rx=0 tx=0).stop 2023-10-25T16:13:48.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 shutdown_connections 2023-10-25T16:13:48.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe320066470 0x7fe320068930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe33c14e810 0x7fe33c146700 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe33c0cbfa0 0x7fe33c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 --2- 172.21.15.177:0/4084912522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe33c0af100 0x7fe33c1f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:48.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 >> 172.21.15.177:0/4084912522 conn(0x7fe33c0b2450 msgr2=0x7fe33c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:48.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 shutdown_connections 2023-10-25T16:13:48.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:48.976+0000 7fe343835640 1 -- 172.21.15.177:0/4084912522 wait complete. 2023-10-25T16:13:48.994 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:49.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/3968463887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5340ce630 msgr2=0x7fe5340caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/3968463887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5340ce630 0x7fe5340caa20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe534069d60 tx=0x7fe52c01caa0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/3968463887 shutdown_connections 2023-10-25T16:13:49.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/3968463887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5340ce630 0x7fe5340caa20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/3968463887 >> v2:172.21.15.184:3300/0 conn(0x7fe5341448b0 0x7fe5340cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/3968463887 >> 172.21.15.177:0/3968463887 conn(0x7fe53406a830 msgr2=0x7fe53406ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:49.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/3968463887 shutdown_connections 2023-10-25T16:13:49.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/3968463887 wait complete. 2023-10-25T16:13:49.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 Processor -- start 2023-10-25T16:13:49.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- start start 2023-10-25T16:13:49.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5340ce630 0x7fe53415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 0x7fe5340aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe53415fb80 0x7fe534140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53413d470 con 0x7fe5341448b0 2023-10-25T16:13:49.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53415b4a0 con 0x7fe53415fb80 2023-10-25T16:13:49.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53413cb80 con 0x7fe5340ce630 2023-10-25T16:13:49.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 0x7fe5340aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 0x7fe5340aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60024/0 (socket says 172.21.15.177:60024) 2023-10-25T16:13:49.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 -- 172.21.15.177:0/1479987681 learned_addr learned my addr 172.21.15.177:0/1479987681 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:49.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe539a6f640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe53415fb80 0x7fe534140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53926e640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5340ce630 0x7fe53415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 -- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5340ce630 msgr2=0x7fe53415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5340ce630 0x7fe53415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 -- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe53415fb80 msgr2=0x7fe534140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe53415fb80 0x7fe534140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 -- 172.21.15.177:0/1479987681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c009820 con 0x7fe5341448b0 2023-10-25T16:13:49.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe539a6f640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe53415fb80 0x7fe534140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:49.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe538a6d640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 0x7fe5340aa8b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c410 tx=0x7fe53000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:49.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530011790 con 0x7fe5341448b0 2023-10-25T16:13:49.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5300119e0 con 0x7fe5341448b0 2023-10-25T16:13:49.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53413ce20 con 0x7fe5341448b0 2023-10-25T16:13:49.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530011dd0 con 0x7fe5341448b0 2023-10-25T16:13:49.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.120+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe534141300 con 0x7fe5341448b0 2023-10-25T16:13:49.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.124+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53404daf0 con 0x7fe5341448b0 2023-10-25T16:13:49.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.124+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe53001c460 con 0x7fe5341448b0 2023-10-25T16:13:49.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.124+0000 7fe529ffb640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe518066470 0x7fe518068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.124+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe530084070 con 0x7fe5341448b0 2023-10-25T16:13:49.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.124+0000 7fe53926e640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe518066470 0x7fe518068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.124+0000 7fe53926e640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe518066470 0x7fe518068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5240058d0 tx=0x7fe524005c70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:49.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.128+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5300515b0 con 0x7fe5341448b0 2023-10-25T16:13:49.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe53406af40 con 0x7fe5341448b0 2023-10-25T16:13:49.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe529ffb640 1 -- 172.21.15.177:0/1479987681 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe530054bd0 con 0x7fe5341448b0 2023-10-25T16:13:49.276 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe518066470 msgr2=0x7fe518068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe518066470 0x7fe518068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5240058d0 tx=0x7fe524005c70 comp rx=0 tx=0).stop 2023-10-25T16:13:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 msgr2=0x7fe5340aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 0x7fe5340aa8b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe53000c410 tx=0x7fe53000c8d0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 shutdown_connections 2023-10-25T16:13:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe518066470 0x7fe518068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe53415fb80 0x7fe534140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5341448b0 0x7fe5340aa8b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 --2- 172.21.15.177:0/1479987681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5340ce630 0x7fe53415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 >> 172.21.15.177:0/1479987681 conn(0x7fe53406a830 msgr2=0x7fe53415cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 shutdown_connections 2023-10-25T16:13:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.272+0000 7fe53b4d2640 1 -- 172.21.15.177:0/1479987681 wait complete. 2023-10-25T16:13:49.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:49.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 -- 172.21.15.177:0/48830863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406f570 msgr2=0x7f073406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 --2- 172.21.15.177:0/48830863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406f570 0x7f073406ba50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07240098f0 tx=0x7f072401c7f0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 -- 172.21.15.177:0/48830863 shutdown_connections 2023-10-25T16:13:49.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 --2- 172.21.15.177:0/48830863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406f570 0x7f073406ba50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 --2- 172.21.15.177:0/48830863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0734140cf0 0x7f07340af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 -- 172.21.15.177:0/48830863 >> 172.21.15.177:0/48830863 conn(0x7f07340b2450 msgr2=0x7f07340b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:49.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 -- 172.21.15.177:0/48830863 shutdown_connections 2023-10-25T16:13:49.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 -- 172.21.15.177:0/48830863 wait complete. 2023-10-25T16:13:49.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 Processor -- start 2023-10-25T16:13:49.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.412+0000 7f073c271640 1 -- start start 2023-10-25T16:13:49.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 0x7f073413d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073406f570 0x7f0734070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0734140cf0 0x7f0734070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340a6c60 con 0x7f073406bf90 2023-10-25T16:13:49.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073413dc80 con 0x7f073406f570 2023-10-25T16:13:49.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073413df60 con 0x7f0734140cf0 2023-10-25T16:13:49.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 0x7f073413d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 0x7f073413d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60036/0 (socket says 172.21.15.177:60036) 2023-10-25T16:13:49.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 -- 172.21.15.177:0/364489466 learned_addr learned my addr 172.21.15.177:0/364489466 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:49.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a80e640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0734140cf0 0x7f0734070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073980c640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073406f570 0x7f0734070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 -- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0734140cf0 msgr2=0x7f0734070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0734140cf0 0x7f0734070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 -- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073406f570 msgr2=0x7f0734070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073406f570 0x7f0734070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 -- 172.21.15.177:0/364489466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724009500 con 0x7f073406bf90 2023-10-25T16:13:49.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073a00d640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 0x7f073413d1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f073000c940 tx=0x7f073000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:49.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730004220 con 0x7f073406bf90 2023-10-25T16:13:49.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0730004470 con 0x7f073406bf90 2023-10-25T16:13:49.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073413e240 con 0x7f073406bf90 2023-10-25T16:13:49.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730007c10 con 0x7f073406bf90 2023-10-25T16:13:49.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073413e800 con 0x7f073406bf90 2023-10-25T16:13:49.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073404daf0 con 0x7f073406bf90 2023-10-25T16:13:49.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0730003600 con 0x7f073406bf90 2023-10-25T16:13:49.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f072affd640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0718066470 0x7f0718068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0730083fe0 con 0x7f073406bf90 2023-10-25T16:13:49.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.416+0000 7f073980c640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0718066470 0x7f0718068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.420+0000 7f073980c640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0718066470 0x7f0718068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07240ae000 tx=0x7f07240b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:49.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.420+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07300514f0 con 0x7f073406bf90 2023-10-25T16:13:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07340ac2e0 con 0x7f073406bf90 2023-10-25T16:13:49.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f072affd640 1 -- 172.21.15.177:0/364489466 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f073001d0a0 con 0x7f073406bf90 2023-10-25T16:13:49.579 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:49.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0718066470 msgr2=0x7f0718068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0718066470 0x7f0718068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f07240ae000 tx=0x7f07240b3040 comp rx=0 tx=0).stop 2023-10-25T16:13:49.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 msgr2=0x7f073413d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 0x7f073413d1c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f073000c940 tx=0x7f073000ce00 comp rx=0 tx=0).stop 2023-10-25T16:13:49.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 shutdown_connections 2023-10-25T16:13:49.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0718066470 0x7f0718068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0734140cf0 0x7f0734070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f073406f570 0x7f0734070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 --2- 172.21.15.177:0/364489466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f073406bf90 0x7f073413d1c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 >> 172.21.15.177:0/364489466 conn(0x7f07340b2450 msgr2=0x7f073413b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:49.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 shutdown_connections 2023-10-25T16:13:49.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.572+0000 7f073c271640 1 -- 172.21.15.177:0/364489466 wait complete. 2023-10-25T16:13:49.594 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:49.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac41923640 1 -- 172.21.15.177:0/1891871893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 msgr2=0x7fac28003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac41923640 1 --2- 172.21.15.177:0/1891871893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac28003dd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fac2c006fb0 tx=0x7fac2c01cfc0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac3b7fe640 1 -- 172.21.15.177:0/1891871893 reap_dead start 2023-10-25T16:13:49.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac41923640 1 -- 172.21.15.177:0/1891871893 shutdown_connections 2023-10-25T16:13:49.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac41923640 1 -- 172.21.15.177:0/1891871893 >> 172.21.15.177:0/1891871893 conn(0x7fac3c09a5c0 msgr2=0x7fac3c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:49.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac41923640 1 -- 172.21.15.177:0/1891871893 shutdown_connections 2023-10-25T16:13:49.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.716+0000 7fac41923640 1 -- 172.21.15.177:0/1891871893 wait complete. 2023-10-25T16:13:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 Processor -- start 2023-10-25T16:13:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- start start 2023-10-25T16:13:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac3c0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac3c157a30 0x7fac3c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac3c159780 0x7fac3c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0caf10 con 0x7fac280039b0 2023-10-25T16:13:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c159c00 con 0x7fac3c157a30 2023-10-25T16:13:49.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0c7670 con 0x7fac3c159780 2023-10-25T16:13:49.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac3c0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac3c0ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60050/0 (socket says 172.21.15.177:60050) 2023-10-25T16:13:49.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 -- 172.21.15.177:0/3090493631 learned_addr learned my addr 172.21.15.177:0/3090493631 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:49.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3b7fe640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac3c159780 0x7fac3c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac33fff640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac3c157a30 0x7fac3c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 -- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac3c159780 msgr2=0x7fac3c0c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac3c159780 0x7fac3c0c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 -- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac3c157a30 msgr2=0x7fac3c159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac3c157a30 0x7fac3c159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 -- 172.21.15.177:0/3090493631 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c157eb0 con 0x7fac280039b0 2023-10-25T16:13:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac33fff640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac3c157a30 0x7fac3c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac3affd640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac3c0ca120 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac2c01cdf0 tx=0x7fac2c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0b3070 con 0x7fac280039b0 2023-10-25T16:13:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac2c0016c0 con 0x7fac280039b0 2023-10-25T16:13:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c0c90c0 con 0x7fac280039b0 2023-10-25T16:13:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c006440 con 0x7fac280039b0 2023-10-25T16:13:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c0c9640 con 0x7fac280039b0 2023-10-25T16:13:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c04daf0 con 0x7fac280039b0 2023-10-25T16:13:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac2c0ab020 con 0x7fac280039b0 2023-10-25T16:13:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.720+0000 7fac38ff9640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac1c066470 0x7fac1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.724+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac2c11d5f0 con 0x7fac280039b0 2023-10-25T16:13:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.724+0000 7fac33fff640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac1c066470 0x7fac1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.724+0000 7fac33fff640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac1c066470 0x7fac1c068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac24005b70 tx=0x7fac24005d20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.728+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac2c0eaa70 con 0x7fac280039b0 2023-10-25T16:13:49.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.892+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac3c15c970 con 0x7fac280039b0 2023-10-25T16:13:49.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.892+0000 7fac38ff9640 1 -- 172.21.15.177:0/3090493631 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac2c0ee090 con 0x7fac280039b0 2023-10-25T16:13:49.899 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:49.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac1c066470 msgr2=0x7fac1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac1c066470 0x7fac1c068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac24005b70 tx=0x7fac24005d20 comp rx=0 tx=0).stop 2023-10-25T16:13:49.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 msgr2=0x7fac3c0ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:49.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac3c0ca120 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac2c01cdf0 tx=0x7fac2c0014d0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 shutdown_connections 2023-10-25T16:13:49.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac1c066470 0x7fac1c068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac3c159780 0x7fac3c0c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac3c157a30 0x7fac3c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 --2- 172.21.15.177:0/3090493631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac280039b0 0x7fac3c0ca120 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:49.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 >> 172.21.15.177:0/3090493631 conn(0x7fac3c09a5c0 msgr2=0x7fac3c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:49.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 shutdown_connections 2023-10-25T16:13:49.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:49.896+0000 7fac41923640 1 -- 172.21.15.177:0/3090493631 wait complete. 2023-10-25T16:13:49.917 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:13:49.917 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:49.918 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:13:49.984 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:49.985 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[33748]: fuse finished with error 0 and tester_r 0 2023-10-25T16:13:49.985 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:49.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:49.994 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:13:50.001 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:13:50.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:50.002 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:13:50.060 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:13:50.061 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:50.071 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:13:50.071 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:50.121 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:50.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:2023-10-25T16:13:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:50.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/147013976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 msgr2=0x7f59b806beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 --2- 172.21.15.177:0/147013976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b806beb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f59a00098f0 tx=0x7f59a001c890 comp rx=0 tx=0).stop 2023-10-25T16:13:50.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/147013976 shutdown_connections 2023-10-25T16:13:50.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 --2- 172.21.15.177:0/147013976 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59b80706f0 0x7f59b8070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 --2- 172.21.15.177:0/147013976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b806beb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/147013976 >> 172.21.15.177:0/147013976 conn(0x7f59b80b2450 msgr2=0x7f59b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:50.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/147013976 shutdown_connections 2023-10-25T16:13:50.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/147013976 wait complete. 2023-10-25T16:13:50.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 Processor -- start 2023-10-25T16:13:50.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- start start 2023-10-25T16:13:50.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b8143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59b80706f0 0x7f59b8142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59b81500f0 0x7f59b8146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81438e0 con 0x7f59b806ba00 2023-10-25T16:13:50.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8143bc0 con 0x7f59b80706f0 2023-10-25T16:13:50.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8143ea0 con 0x7f59b81500f0 2023-10-25T16:13:50.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b8143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60064/0 (socket says 172.21.15.177:60064) 2023-10-25T16:13:50.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 -- 172.21.15.177:0/2558602736 learned_addr learned my addr 172.21.15.177:0/2558602736 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:50.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b77fe640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59b81500f0 0x7f59b8146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59ae7fc640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59b80706f0 0x7f59b8142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 -- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59b81500f0 msgr2=0x7f59b8146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59b81500f0 0x7f59b8146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 -- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59b80706f0 msgr2=0x7f59b8142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59b80706f0 0x7f59b8142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 -- 172.21.15.177:0/2558602736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0009500 con 0x7f59b806ba00 2023-10-25T16:13:50.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59ae7fc640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59b80706f0 0x7f59b8142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:50.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b6ffd640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b8143090 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59a800c520 tx=0x7f59a800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:50.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80052d0 con 0x7f59b806ba00 2023-10-25T16:13:50.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f59a8012630 con 0x7f59b806ba00 2023-10-25T16:13:50.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b8144180 con 0x7f59b806ba00 2023-10-25T16:13:50.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8012a80 con 0x7f59b806ba00 2023-10-25T16:13:50.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.280+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b8142da0 con 0x7f59b806ba00 2023-10-25T16:13:50.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.284+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b804daf0 con 0x7f59b806ba00 2023-10-25T16:13:50.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.284+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59a8012be0 con 0x7f59b806ba00 2023-10-25T16:13:50.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.284+0000 7f59b4ff9640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5998066470 0x7f5998068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.284+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59a80838f0 con 0x7f59b806ba00 2023-10-25T16:13:50.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.284+0000 7f59ae7fc640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5998066470 0x7f5998068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.284+0000 7f59ae7fc640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5998066470 0x7f5998068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59a00af000 tx=0x7f59a001b0d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:50.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.288+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59a8050d60 con 0x7f59b806ba00 2023-10-25T16:13:50.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.432+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59b814a700 con 0x7f59b806ba00 2023-10-25T16:13:50.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.432+0000 7f59b4ff9640 1 -- 172.21.15.177:0/2558602736 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f59a8017090 con 0x7f59b806ba00 2023-10-25T16:13:50.438 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:50.439 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:50.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5998066470 msgr2=0x7f5998068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5998066470 0x7f5998068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59a00af000 tx=0x7f59a001b0d0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 msgr2=0x7f59b8143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b8143090 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59a800c520 tx=0x7f59a800c9e0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 shutdown_connections 2023-10-25T16:13:50.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5998066470 0x7f5998068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59b81500f0 0x7f59b8146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59b80706f0 0x7f59b8142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 --2- 172.21.15.177:0/2558602736 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59b806ba00 0x7f59b8143090 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 >> 172.21.15.177:0/2558602736 conn(0x7f59b80b2450 msgr2=0x7f59b8158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:50.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 shutdown_connections 2023-10-25T16:13:50.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.436+0000 7f59bd881640 1 -- 172.21.15.177:0/2558602736 wait complete. 2023-10-25T16:13:50.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:50.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/1102460402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6800047d0 msgr2=0x7fa680004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/1102460402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6800047d0 0x7fa680004c50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa6940ca230 tx=0x7fa68401cd40 comp rx=0 tx=0).stop 2023-10-25T16:13:50.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 -- 172.21.15.177:0/1102460402 reap_dead start 2023-10-25T16:13:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/1102460402 shutdown_connections 2023-10-25T16:13:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/1102460402 >> 172.21.15.177:0/1102460402 conn(0x7fa6940b2450 msgr2=0x7fa6940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/1102460402 shutdown_connections 2023-10-25T16:13:50.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/1102460402 wait complete. 2023-10-25T16:13:50.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 Processor -- start 2023-10-25T16:13:50.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- start start 2023-10-25T16:13:50.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800047d0 0x7fa6940ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa694152a60 0x7fa694152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 0x7fa694150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa694153420 con 0x7fa694150760 2023-10-25T16:13:50.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa694151490 con 0x7fa694152a60 2023-10-25T16:13:50.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa694151770 con 0x7fa6800047d0 2023-10-25T16:13:50.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 0x7fa694150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 0x7fa694150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40532/0 (socket says 172.21.15.177:40532) 2023-10-25T16:13:50.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 -- 172.21.15.177:0/2133868362 learned_addr learned my addr 172.21.15.177:0/2133868362 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:50.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699283640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800047d0 0x7fa6940ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa698a82640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa694152a60 0x7fa694152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 -- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800047d0 msgr2=0x7fa6940ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800047d0 0x7fa6940ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 -- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa694152a60 msgr2=0x7fa694152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa694152a60 0x7fa694152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 -- 172.21.15.177:0/2133868362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa694151a50 con 0x7fa694150760 2023-10-25T16:13:50.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699283640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800047d0 0x7fa6940ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:50.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa698a82640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa694152a60 0x7fa694152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:50.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa699a84640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 0x7fa694150be0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa6940b2280 tx=0x7fa68c00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:50.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00a440 con 0x7fa694150760 2023-10-25T16:13:50.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa68c00a690 con 0x7fa694150760 2023-10-25T16:13:50.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa694151d30 con 0x7fa694150760 2023-10-25T16:13:50.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00aaa0 con 0x7fa694150760 2023-10-25T16:13:50.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.568+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa694151120 con 0x7fa694150760 2023-10-25T16:13:50.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.572+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69404daf0 con 0x7fa694150760 2023-10-25T16:13:50.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.572+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa68c0163c0 con 0x7fa694150760 2023-10-25T16:13:50.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.572+0000 7fa689ffb640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6780664a0 0x7fa678068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.572+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa68c086880 con 0x7fa694150760 2023-10-25T16:13:50.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.572+0000 7fa699283640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6780664a0 0x7fa678068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.572+0000 7fa699283640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6780664a0 0x7fa678068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa6900099f0 tx=0x7fa6900091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:50.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.576+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa68c053d00 con 0x7fa694150760 2023-10-25T16:13:50.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.716+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa69406c370 con 0x7fa694150760 2023-10-25T16:13:50.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.716+0000 7fa689ffb640 1 -- 172.21.15.177:0/2133868362 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa69406c370 con 0x7fa694150760 2023-10-25T16:13:50.723 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6780664a0 msgr2=0x7fa678068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6780664a0 0x7fa678068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa6900099f0 tx=0x7fa6900091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 msgr2=0x7fa694150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 0x7fa694150be0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa6940b2280 tx=0x7fa68c00f890 comp rx=0 tx=0).stop 2023-10-25T16:13:50.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 shutdown_connections 2023-10-25T16:13:50.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6780664a0 0x7fa678068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa694150760 0x7fa694150be0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa694152a60 0x7fa694152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 --2- 172.21.15.177:0/2133868362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6800047d0 0x7fa6940ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 >> 172.21.15.177:0/2133868362 conn(0x7fa6940b2450 msgr2=0x7fa69415c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 shutdown_connections 2023-10-25T16:13:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.720+0000 7fa69b4e7640 1 -- 172.21.15.177:0/2133868362 wait complete. 2023-10-25T16:13:50.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:50.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 -- 172.21.15.177:0/3234236535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f40c9f90 msgr2=0x7f29f415b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/3234236535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f40c9f90 0x7f29f415b1f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f29f4065cc0 tx=0x7f29ec01cb60 comp rx=0 tx=0).stop 2023-10-25T16:13:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 -- 172.21.15.177:0/3234236535 shutdown_connections 2023-10-25T16:13:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/3234236535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f40c9f90 0x7f29f415b1f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/3234236535 >> v2:172.21.15.184:3300/0 conn(0x7f29f4156e60 0x7f29f40cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 -- 172.21.15.177:0/3234236535 >> 172.21.15.177:0/3234236535 conn(0x7f29f40b0de0 msgr2=0x7f29f40b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:50.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 -- 172.21.15.177:0/3234236535 shutdown_connections 2023-10-25T16:13:50.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 -- 172.21.15.177:0/3234236535 wait complete. 2023-10-25T16:13:50.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 Processor -- start 2023-10-25T16:13:50.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.848+0000 7f29fa0aa640 1 -- start start 2023-10-25T16:13:50.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29f40c9f90 0x7f29f40ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f40cbd20 0x7f29f41501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 0x7f29f4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c2e90 con 0x7f29f4156e60 2023-10-25T16:13:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c3170 con 0x7f29f40cbd20 2023-10-25T16:13:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c3450 con 0x7f29f40c9f90 2023-10-25T16:13:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 0x7f29f4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 0x7f29f4150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40556/0 (socket says 172.21.15.177:40556) 2023-10-25T16:13:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 -- 172.21.15.177:0/1206422325 learned_addr learned my addr 172.21.15.177:0/1206422325 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f37fe640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29f40c9f90 0x7f29f40ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 -- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29f40c9f90 msgr2=0x7f29f40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f2ffd640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f40cbd20 0x7f29f41501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29f40c9f90 0x7f29f40ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 -- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f40cbd20 msgr2=0x7f29f41501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f40cbd20 0x7f29f41501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 -- 172.21.15.177:0/1206422325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009820 con 0x7f29f4156e60 2023-10-25T16:13:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f3fff640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 0x7f29f4150f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009b10 tx=0x7f29ec0a5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec004d10 con 0x7f29f4156e60 2023-10-25T16:13:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29ec004000 con 0x7f29f4156e60 2023-10-25T16:13:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f40c3730 con 0x7f29f4156e60 2023-10-25T16:13:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec004410 con 0x7f29f4156e60 2023-10-25T16:13:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f40cf0c0 con 0x7f29f4156e60 2023-10-25T16:13:50.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f404daf0 con 0x7f29f4156e60 2023-10-25T16:13:50.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f29ec0b4040 con 0x7f29f4156e60 2023-10-25T16:13:50.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29dbfff640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29e0066470 0x7f29e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:50.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29ec11e0d0 con 0x7f29f4156e60 2023-10-25T16:13:50.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.852+0000 7f29f37fe640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29e0066470 0x7f29e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:50.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.856+0000 7f29f37fe640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29e0066470 0x7f29e0068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29f40ceb10 tx=0x7f29e4008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:50.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.856+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29ec0eb5e0 con 0x7f29f4156e60 2023-10-25T16:13:51.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.996+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29f4065cf0 con 0x7f29f4156e60 2023-10-25T16:13:51.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:50.996+0000 7f29dbfff640 1 -- 172.21.15.177:0/1206422325 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29ec0eec00 con 0x7f29f4156e60 2023-10-25T16:13:51.003 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:51.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29e0066470 msgr2=0x7f29e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29e0066470 0x7f29e0068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29f40ceb10 tx=0x7f29e4008040 comp rx=0 tx=0).stop 2023-10-25T16:13:51.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 msgr2=0x7f29f4150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 0x7f29f4150f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009b10 tx=0x7f29ec0a5920 comp rx=0 tx=0).stop 2023-10-25T16:13:51.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 shutdown_connections 2023-10-25T16:13:51.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29e0066470 0x7f29e0068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29f4156e60 0x7f29f4150f70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29f40cbd20 0x7f29f41501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 --2- 172.21.15.177:0/1206422325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29f40c9f90 0x7f29f40ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 >> 172.21.15.177:0/1206422325 conn(0x7f29f40b0de0 msgr2=0x7f29f4158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 shutdown_connections 2023-10-25T16:13:51.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.000+0000 7f29fa0aa640 1 -- 172.21.15.177:0/1206422325 wait complete. 2023-10-25T16:13:51.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:51.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 -- 172.21.15.177:0/3007915761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 msgr2=0x7f02880cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 --2- 172.21.15.177:0/3007915761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f02880cdfc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f028806a0e0 tx=0x7f028001ccd0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 -- 172.21.15.177:0/3007915761 shutdown_connections 2023-10-25T16:13:51.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 --2- 172.21.15.177:0/3007915761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f02880cdfc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 --2- 172.21.15.177:0/3007915761 >> v2:172.21.15.184:3300/0 conn(0x7f02880b2120 0x7f02880d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 --2- 172.21.15.177:0/3007915761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f028815eba0 0x7f02880b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 -- 172.21.15.177:0/3007915761 >> 172.21.15.177:0/3007915761 conn(0x7f028809a5c0 msgr2=0x7f02880d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 -- 172.21.15.177:0/3007915761 shutdown_connections 2023-10-25T16:13:51.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 -- 172.21.15.177:0/3007915761 wait complete. 2023-10-25T16:13:51.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 Processor -- start 2023-10-25T16:13:51.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.128+0000 7f028e04f640 1 -- start start 2023-10-25T16:13:51.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02880b2120 0x7f0288152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f028806b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028815eba0 0x7f02881536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028806a340 con 0x7f02880cdb10 2023-10-25T16:13:51.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880c6610 con 0x7f028815eba0 2023-10-25T16:13:51.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028806a590 con 0x7f02880b2120 2023-10-25T16:13:51.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f028806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f028806b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40572/0 (socket says 172.21.15.177:40572) 2023-10-25T16:13:51.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 -- 172.21.15.177:0/343359511 learned_addr learned my addr 172.21.15.177:0/343359511 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:51.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f02877fe640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02880b2120 0x7f0288152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0287fff640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028815eba0 0x7f02881536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 -- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02880b2120 msgr2=0x7f0288152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02880b2120 0x7f0288152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 -- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028815eba0 msgr2=0x7f02881536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028815eba0 0x7f02881536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 -- 172.21.15.177:0/343359511 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02800098e0 con 0x7f02880cdb10 2023-10-25T16:13:51.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0287fff640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028815eba0 0x7f02881536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:51.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f0286ffd640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f028806b070 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c940 tx=0x7f027c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:51.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c007bb0 con 0x7f02880cdb10 2023-10-25T16:13:51.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f027c007e20 con 0x7f02880cdb10 2023-10-25T16:13:51.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028806a870 con 0x7f02880cdb10 2023-10-25T16:13:51.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00f6b0 con 0x7f02880cdb10 2023-10-25T16:13:51.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028806b5b0 con 0x7f02880cdb10 2023-10-25T16:13:51.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028804daf0 con 0x7f02880cdb10 2023-10-25T16:13:51.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f027c00f810 con 0x7f02880cdb10 2023-10-25T16:13:51.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f026ffff640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02740664a0 0x7f0274068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f027c084700 con 0x7f02880cdb10 2023-10-25T16:13:51.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.132+0000 7f02877fe640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02740664a0 0x7f0274068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.136+0000 7f02877fe640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02740664a0 0x7f0274068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02780058d0 tx=0x7f0278005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:51.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.136+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f027c051c10 con 0x7f02880cdb10 2023-10-25T16:13:51.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f028806ad20 con 0x7f02880cdb10 2023-10-25T16:13:51.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f026ffff640 1 -- 172.21.15.177:0/343359511 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f027c055230 con 0x7f02880cdb10 2023-10-25T16:13:51.296 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:51.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02740664a0 msgr2=0x7f0274068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02740664a0 0x7f0274068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02780058d0 tx=0x7f0278005860 comp rx=0 tx=0).stop 2023-10-25T16:13:51.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 msgr2=0x7f028806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f028806b070 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c940 tx=0x7f027c00ce00 comp rx=0 tx=0).stop 2023-10-25T16:13:51.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 shutdown_connections 2023-10-25T16:13:51.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02740664a0 0x7f0274068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028815eba0 0x7f02881536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02880cdb10 0x7f028806b070 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 --2- 172.21.15.177:0/343359511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02880b2120 0x7f0288152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 >> 172.21.15.177:0/343359511 conn(0x7f028809a5c0 msgr2=0x7f02880d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 shutdown_connections 2023-10-25T16:13:51.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.292+0000 7f028e04f640 1 -- 172.21.15.177:0/343359511 wait complete. 2023-10-25T16:13:51.315 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 -- 172.21.15.177:0/1464318105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c80705b0 msgr2=0x7f73c806b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 --2- 172.21.15.177:0/1464318105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c80705b0 0x7f73c806b980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f73c806d680 tx=0x7f73bc01c850 comp rx=0 tx=0).stop 2023-10-25T16:13:51.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 -- 172.21.15.177:0/1464318105 shutdown_connections 2023-10-25T16:13:51.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 --2- 172.21.15.177:0/1464318105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c80705b0 0x7f73c806b980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 --2- 172.21.15.177:0/1464318105 >> v2:172.21.15.184:3300/0 conn(0x7f73c8153970 0x7f73c8159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 -- 172.21.15.177:0/1464318105 >> 172.21.15.177:0/1464318105 conn(0x7f73c80b2450 msgr2=0x7f73c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 -- 172.21.15.177:0/1464318105 shutdown_connections 2023-10-25T16:13:51.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 -- 172.21.15.177:0/1464318105 wait complete. 2023-10-25T16:13:51.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 Processor -- start 2023-10-25T16:13:51.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.432+0000 7f73ccb58640 1 -- start start 2023-10-25T16:13:51.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73c806bec0 0x7f73c814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c80705b0 0x7f73c80b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 0x7f73c80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80b02c0 con 0x7f73c8153970 2023-10-25T16:13:51.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80b05a0 con 0x7f73c80705b0 2023-10-25T16:13:51.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c80b0880 con 0x7f73c806bec0 2023-10-25T16:13:51.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 0x7f73c80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 0x7f73c80b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40584/0 (socket says 172.21.15.177:40584) 2023-10-25T16:13:51.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 -- 172.21.15.177:0/505320611 learned_addr learned my addr 172.21.15.177:0/505320611 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:51.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c659c640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73c806bec0 0x7f73c814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c5d9b640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c80705b0 0x7f73c80b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 -- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73c806bec0 msgr2=0x7f73c814d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73c806bec0 0x7f73c814d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 -- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c80705b0 msgr2=0x7f73c80b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c80705b0 0x7f73c80b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 -- 172.21.15.177:0/505320611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc009500 con 0x7f73c8153970 2023-10-25T16:13:51.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c5d9b640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c80705b0 0x7f73c80b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:51.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c6d9d640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 0x7f73c80b1660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c450 tx=0x7f73c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:51.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c0005480 con 0x7f73c8153970 2023-10-25T16:13:51.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f73c00036f0 con 0x7f73c8153970 2023-10-25T16:13:51.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c80b0b60 con 0x7f73c8153970 2023-10-25T16:13:51.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c0003b00 con 0x7f73c8153970 2023-10-25T16:13:51.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c814dcf0 con 0x7f73c8153970 2023-10-25T16:13:51.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c804daf0 con 0x7f73c8153970 2023-10-25T16:13:51.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f73c0003c60 con 0x7f73c8153970 2023-10-25T16:13:51.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73b6ffd640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f73a8066470 0x7f73a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73c00836e0 con 0x7f73c8153970 2023-10-25T16:13:51.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c659c640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f73a8066470 0x7f73a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.436+0000 7f73c659c640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f73a8066470 0x7f73a8068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f73b8005c50 tx=0x7f73b8005be0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:51.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.440+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73c0050c20 con 0x7f73c8153970 2023-10-25T16:13:51.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.592+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73c8158350 con 0x7f73c8153970 2023-10-25T16:13:51.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.592+0000 7f73b6ffd640 1 -- 172.21.15.177:0/505320611 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73c0017080 con 0x7f73c8153970 2023-10-25T16:13:51.598 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:51.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f73a8066470 msgr2=0x7f73a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f73a8066470 0x7f73a8068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f73b8005c50 tx=0x7f73b8005be0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 msgr2=0x7f73c80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 0x7f73c80b1660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c450 tx=0x7f73c000c910 comp rx=0 tx=0).stop 2023-10-25T16:13:51.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 shutdown_connections 2023-10-25T16:13:51.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f73a8066470 0x7f73a8068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73c8153970 0x7f73c80b1660 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73c80705b0 0x7f73c80b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 --2- 172.21.15.177:0/505320611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73c806bec0 0x7f73c814d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 >> 172.21.15.177:0/505320611 conn(0x7f73c80b2450 msgr2=0x7f73c8069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 shutdown_connections 2023-10-25T16:13:51.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.596+0000 7f73ccb58640 1 -- 172.21.15.177:0/505320611 wait complete. 2023-10-25T16:13:51.616 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:13:51.617 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:51.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/2072199180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff510003980 msgr2=0x7ff510003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 --2- 172.21.15.177:0/2072199180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff510003980 0x7ff510003d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c700 tx=0x7ff52001c6a0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/2072199180 shutdown_connections 2023-10-25T16:13:51.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 --2- 172.21.15.177:0/2072199180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff510003980 0x7ff510003d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/2072199180 >> 172.21.15.177:0/2072199180 conn(0x7ff5280b2450 msgr2=0x7ff5280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/2072199180 shutdown_connections 2023-10-25T16:13:51.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/2072199180 wait complete. 2023-10-25T16:13:51.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 Processor -- start 2023-10-25T16:13:51.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- start start 2023-10-25T16:13:51.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff510003980 0x7ff5281f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff52813c570 0x7ff5280ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 0x7ff5280abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280ab2c0 con 0x7ff5280a77e0 2023-10-25T16:13:51.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280a8850 con 0x7ff510003980 2023-10-25T16:13:51.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5281f5da0 con 0x7ff52813c570 2023-10-25T16:13:51.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 0x7ff5280abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 0x7ff5280abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40594/0 (socket says 172.21.15.177:40594) 2023-10-25T16:13:51.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 -- 172.21.15.177:0/3173356233 learned_addr learned my addr 172.21.15.177:0/3173356233 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:51.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52659c640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff510003980 0x7ff5281f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 -- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff52813c570 msgr2=0x7ff5280ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff525d9b640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff52813c570 0x7ff5280ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff52813c570 0x7ff5280ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 -- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff510003980 msgr2=0x7ff5281f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff510003980 0x7ff5281f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 -- 172.21.15.177:0/3173356233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280aa640 con 0x7ff5280a77e0 2023-10-25T16:13:51.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff526d9d640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 0x7ff5280abd60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff5280c9ce0 tx=0x7ff51c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:51.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00f890 con 0x7ff5280a77e0 2023-10-25T16:13:51.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff51c00fae0 con 0x7ff5280a77e0 2023-10-25T16:13:51.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5280aa920 con 0x7ff5280a77e0 2023-10-25T16:13:51.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c010460 con 0x7ff5280a77e0 2023-10-25T16:13:51.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.784+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5280aaee0 con 0x7ff5280a77e0 2023-10-25T16:13:51.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.788+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5280ab400 con 0x7ff5280a77e0 2023-10-25T16:13:51.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.788+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff51c0105c0 con 0x7ff5280a77e0 2023-10-25T16:13:51.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.788+0000 7ff516ffd640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5080664a0 0x7ff508068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:51.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.788+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51c083dd0 con 0x7ff5280a77e0 2023-10-25T16:13:51.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.788+0000 7ff52659c640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5080664a0 0x7ff508068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:51.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.788+0000 7ff52659c640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5080664a0 0x7ff508068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5100057b0 tx=0x7ff520019440 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:51.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.792+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5280ab400 con 0x7ff5280a77e0 2023-10-25T16:13:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.932+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5280ab400 con 0x7ff5280a77e0 2023-10-25T16:13:51.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff516ffd640 1 -- 172.21.15.177:0/3173356233 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16529 (secure 0 0 0) 0x7ff5280ab400 con 0x7ff5280a77e0 2023-10-25T16:13:51.941 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:51.941 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:08.535749+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5080664a0 msgr2=0x7ff508068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5080664a0 0x7ff508068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5100057b0 tx=0x7ff520019440 comp rx=0 tx=0).stop 2023-10-25T16:13:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 msgr2=0x7ff5280abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 0x7ff5280abd60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff5280c9ce0 tx=0x7ff51c00da20 comp rx=0 tx=0).stop 2023-10-25T16:13:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 shutdown_connections 2023-10-25T16:13:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5080664a0 0x7ff508068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5280a77e0 0x7ff5280abd60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff52813c570 0x7ff5280ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 --2- 172.21.15.177:0/3173356233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff510003980 0x7ff5281f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.936+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 >> 172.21.15.177:0/3173356233 conn(0x7ff5280b2450 msgr2=0x7ff5280cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.940+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 shutdown_connections 2023-10-25T16:13:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:51.940+0000 7ff52c846640 1 -- 172.21.15.177:0/3173356233 wait complete. 2023-10-25T16:13:51.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:51.959 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:52.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/57834118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe00c9e50 msgr2=0x7f8fe006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/57834118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe00c9e50 0x7f8fe006b9e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fe015dd70 tx=0x7f8fc801c590 comp rx=0 tx=0).stop 2023-10-25T16:13:52.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/57834118 shutdown_connections 2023-10-25T16:13:52.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/57834118 >> v2:172.21.15.184:3300/0 conn(0x7f8fe006bf20 0x7f8fe00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/57834118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe00c9e50 0x7f8fe006b9e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/57834118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe01500f0 0x7f8fe00c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/57834118 >> 172.21.15.177:0/57834118 conn(0x7f8fe00b2450 msgr2=0x7f8fe00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/57834118 shutdown_connections 2023-10-25T16:13:52.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/57834118 wait complete. 2023-10-25T16:13:52.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 Processor -- start 2023-10-25T16:13:52.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- start start 2023-10-25T16:13:52.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe006bf20 0x7f8fe00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe00c9e50 0x7f8fe014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 0x7f8fe00b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0150f70 con 0x7f8fe01500f0 2023-10-25T16:13:52.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe014ba70 con 0x7f8fe00c9e50 2023-10-25T16:13:52.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00b1cc0 con 0x7f8fe006bf20 2023-10-25T16:13:52.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 0x7f8fe00b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 0x7f8fe00b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40622/0 (socket says 172.21.15.177:40622) 2023-10-25T16:13:52.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 -- 172.21.15.177:0/1031059037 learned_addr learned my addr 172.21.15.177:0/1031059037 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:52.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdf7fe640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe006bf20 0x7f8fe00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fd6ffd640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe00c9e50 0x7f8fe014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 -- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe006bf20 msgr2=0x7f8fe00adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe006bf20 0x7f8fe00adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 -- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe00c9e50 msgr2=0x7f8fe014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe00c9e50 0x7f8fe014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 -- 172.21.15.177:0/1031059037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8009500 con 0x7f8fe01500f0 2023-10-25T16:13:52.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fd6ffd640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe00c9e50 0x7f8fe014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:52.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdffff640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 0x7f8fe00b0bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800cd10 tx=0x7f8fd800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800f450 con 0x7f8fe01500f0 2023-10-25T16:13:52.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8fd800f6c0 con 0x7f8fe01500f0 2023-10-25T16:13:52.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe00b1420 con 0x7f8fe01500f0 2023-10-25T16:13:52.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800fad0 con 0x7f8fe01500f0 2023-10-25T16:13:52.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.084+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe00b19e0 con 0x7f8fe01500f0 2023-10-25T16:13:52.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.088+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe0150d40 con 0x7f8fe01500f0 2023-10-25T16:13:52.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.088+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8fd8022430 con 0x7f8fe01500f0 2023-10-25T16:13:52.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.088+0000 7f8fdcff9640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fc00664a0 0x7f8fc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.088+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd8084800 con 0x7f8fe01500f0 2023-10-25T16:13:52.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.088+0000 7f8fdf7fe640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fc00664a0 0x7f8fc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.088+0000 7f8fdf7fe640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fc00664a0 0x7f8fc0068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00058d0 tx=0x7f8fd0005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.092+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8fd8051cf0 con 0x7f8fe01500f0 2023-10-25T16:13:52.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fe0151120 con 0x7f8fe01500f0 2023-10-25T16:13:52.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fdcff9640 1 -- 172.21.15.177:0/1031059037 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fd801d020 con 0x7f8fe01500f0 2023-10-25T16:13:52.240 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:52.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fc00664a0 msgr2=0x7f8fc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fc00664a0 0x7f8fc0068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00058d0 tx=0x7f8fd0005860 comp rx=0 tx=0).stop 2023-10-25T16:13:52.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 msgr2=0x7f8fe00b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 0x7f8fe00b0bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800cd10 tx=0x7f8fd800a620 comp rx=0 tx=0).stop 2023-10-25T16:13:52.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 shutdown_connections 2023-10-25T16:13:52.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fc00664a0 0x7f8fc0068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe01500f0 0x7f8fe00b0bb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fe00c9e50 0x7f8fe014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 --2- 172.21.15.177:0/1031059037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fe006bf20 0x7f8fe00adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 >> 172.21.15.177:0/1031059037 conn(0x7f8fe00b2450 msgr2=0x7f8fe00cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 shutdown_connections 2023-10-25T16:13:52.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.236+0000 7f8fe5ce5640 1 -- 172.21.15.177:0/1031059037 wait complete. 2023-10-25T16:13:52.256 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:52.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3950436535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815bdb0 msgr2=0x7fbdb80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3950436535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815bdb0 0x7fbdb80aebc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80cdef0 tx=0x7fbda001c880 comp rx=0 tx=0).stop 2023-10-25T16:13:52.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3950436535 shutdown_connections 2023-10-25T16:13:52.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3950436535 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdb80af100 0x7fbdb8158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3950436535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb815bdb0 0x7fbdb80aebc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3950436535 >> v2:172.21.15.184:3300/0 conn(0x7fbdb814e810 0x7fbdb80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3950436535 >> 172.21.15.177:0/3950436535 conn(0x7fbdb80b2450 msgr2=0x7fbdb80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3950436535 shutdown_connections 2023-10-25T16:13:52.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3950436535 wait complete. 2023-10-25T16:13:52.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 Processor -- start 2023-10-25T16:13:52.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- start start 2023-10-25T16:13:52.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 0x7fbdb8141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdb814e810 0x7fbdb80709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdb815bdb0 0x7fbdb806f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb8144ab0 con 0x7fbdb80af100 2023-10-25T16:13:52.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb8071750 con 0x7fbdb814e810 2023-10-25T16:13:52.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb8071470 con 0x7fbdb815bdb0 2023-10-25T16:13:52.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 0x7fbdb8141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 0x7fbdb8141290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40654/0 (socket says 172.21.15.177:40654) 2023-10-25T16:13:52.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 -- 172.21.15.177:0/3281456196 learned_addr learned my addr 172.21.15.177:0/3281456196 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:52.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb77fe640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdb815bdb0 0x7fbdb806f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb67fc640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdb814e810 0x7fbdb80709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 -- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdb815bdb0 msgr2=0x7fbdb806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdb815bdb0 0x7fbdb806f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 -- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdb814e810 msgr2=0x7fbdb80709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdb814e810 0x7fbdb80709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 -- 172.21.15.177:0/3281456196 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0009500 con 0x7fbdb80af100 2023-10-25T16:13:52.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdb6ffd640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 0x7fbdb8141290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c970 tx=0x7fbda800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8007bb0 con 0x7fbdb80af100 2023-10-25T16:13:52.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbda8007e00 con 0x7fbdb80af100 2023-10-25T16:13:52.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb81443f0 con 0x7fbdb80af100 2023-10-25T16:13:52.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8005280 con 0x7fbdb80af100 2023-10-25T16:13:52.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.368+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb8140900 con 0x7fbdb80af100 2023-10-25T16:13:52.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.372+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb8144bf0 con 0x7fbdb80af100 2023-10-25T16:13:52.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.372+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbda80053e0 con 0x7fbdb80af100 2023-10-25T16:13:52.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.372+0000 7fbdaffff640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd98066470 0x7fbd98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.372+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda80843b0 con 0x7fbdb80af100 2023-10-25T16:13:52.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.372+0000 7fbdb67fc640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd98066470 0x7fbd98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.372+0000 7fbdb67fc640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd98066470 0x7fbd98068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbda00ae000 tx=0x7fbda001b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.376+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbdb8144bf0 con 0x7fbdb80af100 2023-10-25T16:13:52.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.512+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdb804daf0 con 0x7fbdb80af100 2023-10-25T16:13:52.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.512+0000 7fbdaffff640 1 -- 172.21.15.177:0/3281456196 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbda801d020 con 0x7fbdb80af100 2023-10-25T16:13:52.518 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:52.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd98066470 msgr2=0x7fbd98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd98066470 0x7fbd98068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbda00ae000 tx=0x7fbda001b0c0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 msgr2=0x7fbdb8141290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 0x7fbdb8141290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c970 tx=0x7fbda800ce30 comp rx=0 tx=0).stop 2023-10-25T16:13:52.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 shutdown_connections 2023-10-25T16:13:52.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd98066470 0x7fbd98068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbdb815bdb0 0x7fbdb806f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdb814e810 0x7fbdb80709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 --2- 172.21.15.177:0/3281456196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbdb80af100 0x7fbdb8141290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 >> 172.21.15.177:0/3281456196 conn(0x7fbdb80b2450 msgr2=0x7fbdb80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 shutdown_connections 2023-10-25T16:13:52.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.516+0000 7fbdbd9d5640 1 -- 172.21.15.177:0/3281456196 wait complete. 2023-10-25T16:13:52.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:52.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/1420949608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 msgr2=0x7fb02c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 --2- 172.21.15.177:0/1420949608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c0af5d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb024009cb0 tx=0x7fb02401ccb0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/1420949608 shutdown_connections 2023-10-25T16:13:52.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 --2- 172.21.15.177:0/1420949608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c0af5d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/1420949608 >> 172.21.15.177:0/1420949608 conn(0x7fb02c0b2450 msgr2=0x7fb02c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/1420949608 shutdown_connections 2023-10-25T16:13:52.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/1420949608 wait complete. 2023-10-25T16:13:52.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 Processor -- start 2023-10-25T16:13:52.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- start start 2023-10-25T16:13:52.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02c06c160 0x7fb02c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02c140cf0 0x7fb02c13f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c157630 con 0x7fb02c06f570 2023-10-25T16:13:52.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c13ffd0 con 0x7fb02c140cf0 2023-10-25T16:13:52.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c13fa10 con 0x7fb02c06c160 2023-10-25T16:13:52.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c1570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40682/0 (socket says 172.21.15.177:40682) 2023-10-25T16:13:52.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 -- 172.21.15.177:0/2236961417 learned_addr learned my addr 172.21.15.177:0/2236961417 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:52.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0325d3640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02c140cf0 0x7fb02c13f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 -- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02c06c160 msgr2=0x7fb02c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb031dd2640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02c06c160 0x7fb02c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02c06c160 0x7fb02c1577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 -- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02c140cf0 msgr2=0x7fb02c13f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02c140cf0 0x7fb02c13f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 -- 172.21.15.177:0/2236961417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0240098e0 con 0x7fb02c06f570 2023-10-25T16:13:52.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0315d1640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c1570f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c550 tx=0x7fb01c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c005480 con 0x7fb02c06f570 2023-10-25T16:13:52.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb01c003710 con 0x7fb02c06f570 2023-10-25T16:13:52.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c13fcf0 con 0x7fb02c06f570 2023-10-25T16:13:52.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c003b20 con 0x7fb02c06f570 2023-10-25T16:13:52.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.648+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1588e0 con 0x7fb02c06f570 2023-10-25T16:13:52.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.652+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c158b00 con 0x7fb02c06f570 2023-10-25T16:13:52.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.652+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb01c003c80 con 0x7fb02c06f570 2023-10-25T16:13:52.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.652+0000 7fb0227fc640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb010066470 0x7fb010068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.652+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c083700 con 0x7fb02c06f570 2023-10-25T16:13:52.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.652+0000 7fb031dd2640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb010066470 0x7fb010068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.652+0000 7fb031dd2640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb010066470 0x7fb010068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0cda20 tx=0x7fb028008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.656+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb01c050c40 con 0x7fb02c06f570 2023-10-25T16:13:52.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.804+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb02c04daf0 con 0x7fb02c06f570 2023-10-25T16:13:52.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb0227fc640 1 -- 172.21.15.177:0/2236961417 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb01c017020 con 0x7fb02c06f570 2023-10-25T16:13:52.812 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:52.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb010066470 msgr2=0x7fb010068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb010066470 0x7fb010068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0cda20 tx=0x7fb028008040 comp rx=0 tx=0).stop 2023-10-25T16:13:52.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 msgr2=0x7fb02c1570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c1570f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c550 tx=0x7fb01c00ca10 comp rx=0 tx=0).stop 2023-10-25T16:13:52.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 shutdown_connections 2023-10-25T16:13:52.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb010066470 0x7fb010068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02c140cf0 0x7fb02c13f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb02c06f570 0x7fb02c1570f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 --2- 172.21.15.177:0/2236961417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02c06c160 0x7fb02c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 >> 172.21.15.177:0/2236961417 conn(0x7fb02c0b2450 msgr2=0x7fb02c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 shutdown_connections 2023-10-25T16:13:52.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.808+0000 7fb034036640 1 -- 172.21.15.177:0/2236961417 wait complete. 2023-10-25T16:13:52.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:52.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1671696244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 msgr2=0x7f80680b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1671696244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80680b4100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f80680cb890 tx=0x7f805801cad0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1671696244 shutdown_connections 2023-10-25T16:13:52.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1671696244 >> v2:172.21.15.184:3300/0 conn(0x7f80680cdb10 0x7f80680cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1671696244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80680b4100 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1671696244 >> 172.21.15.177:0/1671696244 conn(0x7f806809a5c0 msgr2=0x7f80680d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:52.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1671696244 shutdown_connections 2023-10-25T16:13:52.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1671696244 wait complete. 2023-10-25T16:13:52.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 Processor -- start 2023-10-25T16:13:52.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- start start 2023-10-25T16:13:52.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80680b2120 0x7f806814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80680cdb10 0x7f8068153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80681539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806814fcd0 con 0x7f806815eba0 2023-10-25T16:13:52.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8068159be0 con 0x7f80680b2120 2023-10-25T16:13:52.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8068159ec0 con 0x7f80680cdb10 2023-10-25T16:13:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80681539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80681539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40710/0 (socket says 172.21.15.177:40710) 2023-10-25T16:13:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 -- 172.21.15.177:0/1130038009 learned_addr learned my addr 172.21.15.177:0/1130038009 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d13c640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80680b2120 0x7f806814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 -- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80680cdb10 msgr2=0x7f8068153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80680cdb10 0x7f8068153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 -- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80680b2120 msgr2=0x7f806814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:52.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80680b2120 0x7f806814f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:52.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 -- 172.21.15.177:0/1130038009 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058009820 con 0x7f806815eba0 2023-10-25T16:13:52.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806d93d640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80681539a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f806000d750 tx=0x7f806000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060009c30 con 0x7f806815eba0 2023-10-25T16:13:52.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8060009e80 con 0x7f806815eba0 2023-10-25T16:13:52.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806815a1a0 con 0x7f806815eba0 2023-10-25T16:13:52.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060005280 con 0x7f806815eba0 2023-10-25T16:13:52.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.940+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806815a760 con 0x7f806815eba0 2023-10-25T16:13:52.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.944+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806804daf0 con 0x7f806815eba0 2023-10-25T16:13:52.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.944+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f80600053e0 con 0x7f806815eba0 2023-10-25T16:13:52.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.944+0000 7f8065ffb640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8054066470 0x7f8054068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:52.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.944+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80600840d0 con 0x7f806815eba0 2023-10-25T16:13:52.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.944+0000 7f806d13c640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8054066470 0x7f8054068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:52.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.944+0000 7f806d13c640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8054066470 0x7f8054068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80580af000 tx=0x7f805801b310 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:52.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:52.948+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80600514c0 con 0x7f806815eba0 2023-10-25T16:13:53.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.116+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8068073140 con 0x7f806815eba0 2023-10-25T16:13:53.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.116+0000 7f8065ffb640 1 -- 172.21.15.177:0/1130038009 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8060017080 con 0x7f806815eba0 2023-10-25T16:13:53.121 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:53.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8054066470 msgr2=0x7f8054068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8054066470 0x7f8054068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80580af000 tx=0x7f805801b310 comp rx=0 tx=0).stop 2023-10-25T16:13:53.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 msgr2=0x7f80681539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80681539a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f806000d750 tx=0x7f806000dc10 comp rx=0 tx=0).stop 2023-10-25T16:13:53.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 shutdown_connections 2023-10-25T16:13:53.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8054066470 0x7f8054068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f806815eba0 0x7f80681539a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80680cdb10 0x7f8068153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 --2- 172.21.15.177:0/1130038009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80680b2120 0x7f806814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 >> 172.21.15.177:0/1130038009 conn(0x7f806809a5c0 msgr2=0x7f80680d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:53.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 shutdown_connections 2023-10-25T16:13:53.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.120+0000 7f806f3a0640 1 -- 172.21.15.177:0/1130038009 wait complete. 2023-10-25T16:13:53.140 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:13:53.140 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:53.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-25T16:13:53.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:53.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:ceph-fuse[35838]: fuse finished with error 0 and tester_r 0 2023-10-25T16:13:53.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:53.199 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi177.stderr:2023-10-25T16:13:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:53.200 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:13:53.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:13:53.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:53.207 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:13:53.259 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:13:53.259 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:53.266 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:13:53.266 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:53.314 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:53.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:2023-10-25T16:13:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:53.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 -- 172.21.15.177:0/980134955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 msgr2=0x7f5bf806b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/980134955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf806b980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80afca0 tx=0x7f5bec01c530 comp rx=0 tx=0).stop 2023-10-25T16:13:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 -- 172.21.15.177:0/980134955 shutdown_connections 2023-10-25T16:13:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/980134955 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5bf806bec0 0x7f5bf80aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/980134955 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf806b980 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/980134955 >> v2:172.21.15.184:3300/0 conn(0x7f5bf8140e90 0x7f5bf80af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 -- 172.21.15.177:0/980134955 >> 172.21.15.177:0/980134955 conn(0x7f5bf80b2450 msgr2=0x7f5bf80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:53.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 -- 172.21.15.177:0/980134955 shutdown_connections 2023-10-25T16:13:53.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 -- 172.21.15.177:0/980134955 wait complete. 2023-10-25T16:13:53.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 Processor -- start 2023-10-25T16:13:53.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.432+0000 7f5bfe2de640 1 -- start start 2023-10-25T16:13:53.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5bf806bec0 0x7f5bf8136930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf813b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf8140e90 0x7f5bf8139050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8071250 con 0x7f5bf806f570 2023-10-25T16:13:53.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8070380 con 0x7f5bf8140e90 2023-10-25T16:13:53.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80705d0 con 0x7f5bf806bec0 2023-10-25T16:13:53.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf813b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf813b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40728/0 (socket says 172.21.15.177:40728) 2023-10-25T16:13:53.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 -- 172.21.15.177:0/4200861881 learned_addr learned my addr 172.21.15.177:0/4200861881 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:53.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf7fff640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5bf806bec0 0x7f5bf8136930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfc87b640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf8140e90 0x7f5bf8139050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 -- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5bf806bec0 msgr2=0x7f5bf8136930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5bf806bec0 0x7f5bf8136930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 -- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf8140e90 msgr2=0x7f5bf8139050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf8140e90 0x7f5bf8139050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 -- 172.21.15.177:0/4200861881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009500 con 0x7f5bf806f570 2023-10-25T16:13:53.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf77fe640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf813b0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5bec01c360 tx=0x7f5bec005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:53.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec004240 con 0x7f5bf806f570 2023-10-25T16:13:53.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5bec0b9070 con 0x7f5bf806f570 2023-10-25T16:13:53.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0aa5d0 con 0x7f5bf806f570 2023-10-25T16:13:53.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf80708b0 con 0x7f5bf806f570 2023-10-25T16:13:53.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf8070e70 con 0x7f5bf806f570 2023-10-25T16:13:53.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf804daf0 con 0x7f5bf806f570 2023-10-25T16:13:53.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5bec0bb030 con 0x7f5bf806f570 2023-10-25T16:13:53.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf4ff9640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5be4066470 0x7f5be4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bec11f150 con 0x7f5bf806f570 2023-10-25T16:13:53.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.436+0000 7f5bf7fff640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5be4066470 0x7f5be4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.440+0000 7f5bf7fff640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5be4066470 0x7f5be4068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5be80058d0 tx=0x7f5be8005db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:53.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.440+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5bec0ec5d0 con 0x7f5bf806f570 2023-10-25T16:13:53.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.600+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bf80ca670 con 0x7f5bf806f570 2023-10-25T16:13:53.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bf4ff9640 1 -- 172.21.15.177:0/4200861881 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f5bec0efbf0 con 0x7f5bf806f570 2023-10-25T16:13:53.607 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:53.607 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":22,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:53.550244+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:53.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5be4066470 msgr2=0x7f5be4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5be4066470 0x7f5be4068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5be80058d0 tx=0x7f5be8005db0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 msgr2=0x7f5bf813b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf813b0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5bec01c360 tx=0x7f5bec005e10 comp rx=0 tx=0).stop 2023-10-25T16:13:53.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 shutdown_connections 2023-10-25T16:13:53.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5be4066470 0x7f5be4068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5bf8140e90 0x7f5bf8139050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5bf806f570 0x7f5bf813b0c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 --2- 172.21.15.177:0/4200861881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5bf806bec0 0x7f5bf8136930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 >> 172.21.15.177:0/4200861881 conn(0x7f5bf80b2450 msgr2=0x7f5bf80ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:53.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 shutdown_connections 2023-10-25T16:13:53.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.604+0000 7f5bfe2de640 1 -- 172.21.15.177:0/4200861881 wait complete. 2023-10-25T16:13:53.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:53.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:53.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- 172.21.15.177:0/3897594448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c06c180 msgr2=0x7f194c15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 --2- 172.21.15.177:0/3897594448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c06c180 0x7f194c15afb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f194800aa00 tx=0x7f194801daf0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- 172.21.15.177:0/3897594448 shutdown_connections 2023-10-25T16:13:53.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 --2- 172.21.15.177:0/3897594448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c06c180 0x7f194c15afb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- 172.21.15.177:0/3897594448 >> 172.21.15.177:0/3897594448 conn(0x7f194c0b2450 msgr2=0x7f194c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:53.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- 172.21.15.177:0/3897594448 shutdown_connections 2023-10-25T16:13:53.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- 172.21.15.177:0/3897594448 wait complete. 2023-10-25T16:13:53.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 Processor -- start 2023-10-25T16:13:53.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- start start 2023-10-25T16:13:53.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f194c06c180 0x7f194c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f194c0c9df0 0x7f194c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 0x7f194c14b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c14db50 con 0x7f194c15bbe0 2023-10-25T16:13:53.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c14e4b0 con 0x7f194c06c180 2023-10-25T16:13:53.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1953bdc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c1514c0 con 0x7f194c0c9df0 2023-10-25T16:13:53.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1952179640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 0x7f194c14b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1952179640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 0x7f194c14b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40750/0 (socket says 172.21.15.177:40750) 2023-10-25T16:13:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1952179640 1 -- 172.21.15.177:0/810407553 learned_addr learned my addr 172.21.15.177:0/810407553 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1951978640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f194c06c180 0x7f194c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.752+0000 7f1951177640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f194c0c9df0 0x7f194c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1952179640 1 -- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f194c0c9df0 msgr2=0x7f194c150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1952179640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f194c0c9df0 0x7f194c150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1952179640 1 -- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f194c06c180 msgr2=0x7f194c14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1952179640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f194c06c180 0x7f194c14df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1952179640 1 -- 172.21.15.177:0/810407553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194800a610 con 0x7f194c15bbe0 2023-10-25T16:13:53.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1952179640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 0x7f194c14b130 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f194400c780 tx=0x7f194400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:53.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944003d90 con 0x7f194c15bbe0 2023-10-25T16:13:53.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f194400ce90 con 0x7f194c15bbe0 2023-10-25T16:13:53.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440052d0 con 0x7f194c15bbe0 2023-10-25T16:13:53.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c153610 con 0x7f194c15bbe0 2023-10-25T16:13:53.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c153bd0 con 0x7f194c15bbe0 2023-10-25T16:13:53.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c14d8b0 con 0x7f194c15bbe0 2023-10-25T16:13:53.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1944005430 con 0x7f194c15bbe0 2023-10-25T16:13:53.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f19427fc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1930066470 0x7f1930068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:53.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.756+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1944083590 con 0x7f194c15bbe0 2023-10-25T16:13:53.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.760+0000 7f1951978640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1930066470 0x7f1930068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:53.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.760+0000 7f1951978640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1930066470 0x7f1930068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f193c000f70 tx=0x7f193c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:53.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.764+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f194c14d8b0 con 0x7f194c15bbe0 2023-10-25T16:13:53.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f194c14dc90 con 0x7f194c15bbe0 2023-10-25T16:13:53.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f19427fc640 1 -- 172.21.15.177:0/810407553 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f194c14dc90 con 0x7f194c15bbe0 2023-10-25T16:13:53.912 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:53.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1930066470 msgr2=0x7f1930068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1930066470 0x7f1930068930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f193c000f70 tx=0x7f193c009040 comp rx=0 tx=0).stop 2023-10-25T16:13:53.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 msgr2=0x7f194c14b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:53.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 0x7f194c14b130 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f194400c780 tx=0x7f194400cc40 comp rx=0 tx=0).stop 2023-10-25T16:13:53.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 shutdown_connections 2023-10-25T16:13:53.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1930066470 0x7f1930068930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c15bbe0 0x7f194c14b130 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f194c0c9df0 0x7f194c150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 --2- 172.21.15.177:0/810407553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f194c06c180 0x7f194c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:53.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 >> 172.21.15.177:0/810407553 conn(0x7f194c0b2450 msgr2=0x7f194c157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:53.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 shutdown_connections 2023-10-25T16:13:53.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:53.908+0000 7f1953bdc640 1 -- 172.21.15.177:0/810407553 wait complete. 2023-10-25T16:13:53.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:54.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 -- 172.21.15.177:0/554575333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521006bec0 msgr2=0x7f52100aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 --2- 172.21.15.177:0/554575333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521006bec0 0x7f52100aff30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52100afca0 tx=0x7f520801c9f0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 -- 172.21.15.177:0/554575333 shutdown_connections 2023-10-25T16:13:54.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 --2- 172.21.15.177:0/554575333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521006bec0 0x7f52100aff30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 --2- 172.21.15.177:0/554575333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006f570 0x7f521006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 --2- 172.21.15.177:0/554575333 >> v2:172.21.15.184:3300/0 conn(0x7f5210140e90 0x7f52100af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 -- 172.21.15.177:0/554575333 >> 172.21.15.177:0/554575333 conn(0x7f52100b2450 msgr2=0x7f52100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 -- 172.21.15.177:0/554575333 shutdown_connections 2023-10-25T16:13:54.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.052+0000 7f5216fd9640 1 -- 172.21.15.177:0/554575333 wait complete. 2023-10-25T16:13:54.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 Processor -- start 2023-10-25T16:13:54.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- start start 2023-10-25T16:13:54.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006bec0 0x7f52101353d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f521006f570 0x7f5210155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 0x7f521015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52101f3550 con 0x7f5210140e90 2023-10-25T16:13:54.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210135910 con 0x7f521006f570 2023-10-25T16:13:54.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52101f2990 con 0x7f521006bec0 2023-10-25T16:13:54.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 0x7f521015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 0x7f521015b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40760/0 (socket says 172.21.15.177:40760) 2023-10-25T16:13:54.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 -- 172.21.15.177:0/1324631526 learned_addr learned my addr 172.21.15.177:0/1324631526 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:54.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5214d75640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006bec0 0x7f52101353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f520ffff640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f521006f570 0x7f5210155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 -- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006bec0 msgr2=0x7f52101353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006bec0 0x7f52101353d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 -- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f521006f570 msgr2=0x7f5210155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f521006f570 0x7f5210155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 -- 172.21.15.177:0/1324631526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080098e0 con 0x7f5210140e90 2023-10-25T16:13:54.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5215576640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 0x7f521015b160 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f520801b0a0 tx=0x7f52080a5870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208003b90 con 0x7f5210140e90 2023-10-25T16:13:54.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5208003de0 con 0x7f5210140e90 2023-10-25T16:13:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52101f2bb0 con 0x7f5210140e90 2023-10-25T16:13:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208004290 con 0x7f5210140e90 2023-10-25T16:13:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101f3170 con 0x7f5210140e90 2023-10-25T16:13:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.056+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52101f3690 con 0x7f5210140e90 2023-10-25T16:13:54.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.060+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f52080b4040 con 0x7f5210140e90 2023-10-25T16:13:54.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.060+0000 7f520d7fa640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51f00664a0 0x7f51f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.060+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f520811e720 con 0x7f5210140e90 2023-10-25T16:13:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.060+0000 7f5214d75640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51f00664a0 0x7f51f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.060+0000 7f5214d75640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51f00664a0 0x7f51f0068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5200005fd0 tx=0x7f520000c460 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.064+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52101f3690 con 0x7f5210140e90 2023-10-25T16:13:54.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52101f3690 con 0x7f5210140e90 2023-10-25T16:13:54.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f520d7fa640 1 -- 172.21.15.177:0/1324631526 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52080b2020 con 0x7f5210140e90 2023-10-25T16:13:54.209 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:54.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51f00664a0 msgr2=0x7f51f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51f00664a0 0x7f51f0068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5200005fd0 tx=0x7f520000c460 comp rx=0 tx=0).stop 2023-10-25T16:13:54.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 msgr2=0x7f521015b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 0x7f521015b160 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f520801b0a0 tx=0x7f52080a5870 comp rx=0 tx=0).stop 2023-10-25T16:13:54.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 shutdown_connections 2023-10-25T16:13:54.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51f00664a0 0x7f51f0068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5210140e90 0x7f521015b160 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f521006f570 0x7f5210155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 --2- 172.21.15.177:0/1324631526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f521006bec0 0x7f52101353d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 >> 172.21.15.177:0/1324631526 conn(0x7f52100b2450 msgr2=0x7f521013c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 shutdown_connections 2023-10-25T16:13:54.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.204+0000 7f5216fd9640 1 -- 172.21.15.177:0/1324631526 wait complete. 2023-10-25T16:13:54.227 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:54.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 -- 172.21.15.177:0/1620455142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e8140db0 msgr2=0x7f69e80af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 --2- 172.21.15.177:0/1620455142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e8140db0 0x7f69e80af5a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009840 tx=0x7f69d801c6f0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 -- 172.21.15.177:0/1620455142 shutdown_connections 2023-10-25T16:13:54.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 --2- 172.21.15.177:0/1620455142 >> v2:172.21.15.184:3300/0 conn(0x7f69e806ba00 0x7f69e806be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 --2- 172.21.15.177:0/1620455142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e8140db0 0x7f69e80af5a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 -- 172.21.15.177:0/1620455142 >> 172.21.15.177:0/1620455142 conn(0x7f69e80b2450 msgr2=0x7f69e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 -- 172.21.15.177:0/1620455142 shutdown_connections 2023-10-25T16:13:54.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.344+0000 7f69ed056640 1 -- 172.21.15.177:0/1620455142 wait complete. 2023-10-25T16:13:54.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 Processor -- start 2023-10-25T16:13:54.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- start start 2023-10-25T16:13:54.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e806ba00 0x7f69e813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e80aff30 0x7f69e8138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 0x7f69e8156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e813eba0 con 0x7f69e8140db0 2023-10-25T16:13:54.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8157cb0 con 0x7f69e806ba00 2023-10-25T16:13:54.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e813ff70 con 0x7f69e80aff30 2023-10-25T16:13:54.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 0x7f69e8156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 0x7f69e8156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40764/0 (socket says 172.21.15.177:40764) 2023-10-25T16:13:54.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 -- 172.21.15.177:0/728917134 learned_addr learned my addr 172.21.15.177:0/728917134 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:54.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e659c640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e80aff30 0x7f69e8138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e6d9d640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e806ba00 0x7f69e813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 -- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e80aff30 msgr2=0x7f69e8138a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e80aff30 0x7f69e8138a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 -- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e806ba00 msgr2=0x7f69e813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e806ba00 0x7f69e813e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 -- 172.21.15.177:0/728917134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80094a0 con 0x7f69e8140db0 2023-10-25T16:13:54.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e6d9d640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e806ba00 0x7f69e813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:54.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69e759e640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 0x7f69e8156880 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f69e00018b0 tx=0x7f69e00019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000aab0 con 0x7f69e8140db0 2023-10-25T16:13:54.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f69e000ad20 con 0x7f69e8140db0 2023-10-25T16:13:54.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e8159210 con 0x7f69e8140db0 2023-10-25T16:13:54.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0012680 con 0x7f69e8140db0 2023-10-25T16:13:54.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e8159460 con 0x7f69e8140db0 2023-10-25T16:13:54.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.348+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e81401a0 con 0x7f69e8140db0 2023-10-25T16:13:54.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.352+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f69e001b400 con 0x7f69e8140db0 2023-10-25T16:13:54.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.352+0000 7f69cf7fe640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69d4066470 0x7f69d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.352+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f69e0084840 con 0x7f69e8140db0 2023-10-25T16:13:54.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.352+0000 7f69e6d9d640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69d4066470 0x7f69d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.352+0000 7f69e6d9d640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69d4066470 0x7f69d4068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69d80af000 tx=0x7f69d801af30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.356+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69e0051c50 con 0x7f69e8140db0 2023-10-25T16:13:54.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69e81412a0 con 0x7f69e8140db0 2023-10-25T16:13:54.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69cf7fe640 1 -- 172.21.15.177:0/728917134 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69e00160a0 con 0x7f69e8140db0 2023-10-25T16:13:54.512 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:54.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69d4066470 msgr2=0x7f69d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69d4066470 0x7f69d4068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69d80af000 tx=0x7f69d801af30 comp rx=0 tx=0).stop 2023-10-25T16:13:54.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 msgr2=0x7f69e8156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 0x7f69e8156880 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f69e00018b0 tx=0x7f69e00019a0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 shutdown_connections 2023-10-25T16:13:54.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69d4066470 0x7f69d4068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e8140db0 0x7f69e8156880 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e80aff30 0x7f69e8138a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 --2- 172.21.15.177:0/728917134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e806ba00 0x7f69e813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 >> 172.21.15.177:0/728917134 conn(0x7f69e80b2450 msgr2=0x7f69e80700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 shutdown_connections 2023-10-25T16:13:54.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.508+0000 7f69ed056640 1 -- 172.21.15.177:0/728917134 wait complete. 2023-10-25T16:13:54.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:54.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 -- 172.21.15.177:0/486999727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c06b9e0 msgr2=0x7f2e4c06be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 --2- 172.21.15.177:0/486999727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c06b9e0 0x7f2e4c06be30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009c80 tx=0x7f2e4401cd10 comp rx=0 tx=0).stop 2023-10-25T16:13:54.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 -- 172.21.15.177:0/486999727 shutdown_connections 2023-10-25T16:13:54.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 --2- 172.21.15.177:0/486999727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c06b9e0 0x7f2e4c06be30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 --2- 172.21.15.177:0/486999727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e4c1537d0 0x7f2e4c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 -- 172.21.15.177:0/486999727 >> 172.21.15.177:0/486999727 conn(0x7f2e4c0b2450 msgr2=0x7f2e4c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 -- 172.21.15.177:0/486999727 shutdown_connections 2023-10-25T16:13:54.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.648+0000 7f2e5404f640 1 -- 172.21.15.177:0/486999727 wait complete. 2023-10-25T16:13:54.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 Processor -- start 2023-10-25T16:13:54.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- start start 2023-10-25T16:13:54.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e4c06b9e0 0x7f2e4c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1537d0 0x7f2e4c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 0x7f2e4c146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b1e80 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b1270 con 0x7f2e4c1537d0 2023-10-25T16:13:54.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b1550 con 0x7f2e4c06b9e0 2023-10-25T16:13:54.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 0x7f2e4c146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 0x7f2e4c146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40780/0 (socket says 172.21.15.177:40780) 2023-10-25T16:13:54.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 -- 172.21.15.177:0/2303552033 learned_addr learned my addr 172.21.15.177:0/2303552033 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:54.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e51deb640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e4c06b9e0 0x7f2e4c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e515ea640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1537d0 0x7f2e4c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 -- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e4c06b9e0 msgr2=0x7f2e4c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e4c06b9e0 0x7f2e4c0b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 -- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1537d0 msgr2=0x7f2e4c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1537d0 0x7f2e4c150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 -- 172.21.15.177:0/2303552033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440098e0 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e515ea640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1537d0 0x7f2e4c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:54.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e525ec640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 0x7f2e4c146c00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009bd0 tx=0x7f2e44003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44004e60 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e440ad6a0 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c0b1830 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440adab0 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c0b0f80 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.652+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0b2030 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.656+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e440b4040 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.656+0000 7f2e427fc640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e30066470 0x7f2e30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.656+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2e4411e4a0 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.656+0000 7f2e51deb640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e30066470 0x7f2e30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.656+0000 7f2e51deb640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e30066470 0x7f2e30068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e480058d0 tx=0x7f2e48005c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.660+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e4c0b2030 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.820+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e4c0b2030 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.820+0000 7f2e427fc640 1 -- 172.21.15.177:0/2303552033 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e4c0b2030 con 0x7f2e4c15cdd0 2023-10-25T16:13:54.827 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:54.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e30066470 msgr2=0x7f2e30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e30066470 0x7f2e30068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e480058d0 tx=0x7f2e48005c90 comp rx=0 tx=0).stop 2023-10-25T16:13:54.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 msgr2=0x7f2e4c146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 0x7f2e4c146c00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009bd0 tx=0x7f2e44003c40 comp rx=0 tx=0).stop 2023-10-25T16:13:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 shutdown_connections 2023-10-25T16:13:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e30066470 0x7f2e30068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c15cdd0 0x7f2e4c146c00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1537d0 0x7f2e4c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 --2- 172.21.15.177:0/2303552033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e4c06b9e0 0x7f2e4c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 >> 172.21.15.177:0/2303552033 conn(0x7f2e4c0b2450 msgr2=0x7f2e4c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 shutdown_connections 2023-10-25T16:13:54.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.824+0000 7f2e5404f640 1 -- 172.21.15.177:0/2303552033 wait complete. 2023-10-25T16:13:54.844 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:13:54.844 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:13:54.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:54.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/2444367041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 msgr2=0x7f39c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 --2- 172.21.15.177:0/2444367041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39c4004c50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009b50 tx=0x7f39c001d230 comp rx=0 tx=0).stop 2023-10-25T16:13:54.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/2444367041 shutdown_connections 2023-10-25T16:13:54.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 --2- 172.21.15.177:0/2444367041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39c4004c50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/2444367041 >> 172.21.15.177:0/2444367041 conn(0x7f39d80b2450 msgr2=0x7f39d80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:54.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/2444367041 shutdown_connections 2023-10-25T16:13:54.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/2444367041 wait complete. 2023-10-25T16:13:54.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 Processor -- start 2023-10-25T16:13:54.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- start start 2023-10-25T16:13:54.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39d80aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d81f2200 0x7f39d81498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80b14e0 0x7f39d80b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80b1ea0 con 0x7f39c40047d0 2023-10-25T16:13:54.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80aae90 con 0x7f39d80b14e0 2023-10-25T16:13:54.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d80ab170 con 0x7f39d81f2200 2023-10-25T16:13:54.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39d80aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39d80aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40792/0 (socket says 172.21.15.177:40792) 2023-10-25T16:13:54.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 -- 172.21.15.177:0/523224013 learned_addr learned my addr 172.21.15.177:0/523224013 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:54.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d5d9b640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d81f2200 0x7f39d81498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d6d9d640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80b14e0 0x7f39d80b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 -- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d81f2200 msgr2=0x7f39d81498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d81f2200 0x7f39d81498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 -- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80b14e0 msgr2=0x7f39d80b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:54.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80b14e0 0x7f39d80b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:54.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 -- 172.21.15.177:0/523224013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80ab450 con 0x7f39c40047d0 2023-10-25T16:13:54.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39d659c640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39d80aa8b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39d000d5b0 tx=0x7f39d000da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d00062e0 con 0x7f39c40047d0 2023-10-25T16:13:54.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f39d0006530 con 0x7f39c40047d0 2023-10-25T16:13:54.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d80ab730 con 0x7f39c40047d0 2023-10-25T16:13:54.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0003880 con 0x7f39c40047d0 2023-10-25T16:13:54.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d81520e0 con 0x7f39c40047d0 2023-10-25T16:13:54.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.960+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d80c9780 con 0x7f39c40047d0 2023-10-25T16:13:54.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.964+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39d00039e0 con 0x7f39c40047d0 2023-10-25T16:13:54.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.964+0000 7f39ceffd640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39b8066470 0x7f39b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:54.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.964+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f39d0084be0 con 0x7f39c40047d0 2023-10-25T16:13:54.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.964+0000 7f39d5d9b640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39b8066470 0x7f39b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:54.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.964+0000 7f39d5d9b640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39b8066470 0x7f39b8068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f39c00ad000 tx=0x7f39c0019fd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:54.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:54.968+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39d00520c0 con 0x7f39c40047d0 2023-10-25T16:13:55.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.108+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d804daf0 con 0x7f39c40047d0 2023-10-25T16:13:55.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39ceffd640 1 -- 172.21.15.177:0/523224013 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f39d00556e0 con 0x7f39c40047d0 2023-10-25T16:13:55.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:55.116 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":23,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:54.560047+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:55.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39b8066470 msgr2=0x7f39b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39b8066470 0x7f39b8068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f39c00ad000 tx=0x7f39c0019fd0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 msgr2=0x7f39d80aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39d80aa8b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f39d000d5b0 tx=0x7f39d000da70 comp rx=0 tx=0).stop 2023-10-25T16:13:55.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 shutdown_connections 2023-10-25T16:13:55.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39b8066470 0x7f39b8068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d80b14e0 0x7f39d80b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39d81f2200 0x7f39d81498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 --2- 172.21.15.177:0/523224013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39c40047d0 0x7f39d80aa8b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 >> 172.21.15.177:0/523224013 conn(0x7f39d80b2450 msgr2=0x7f39d80caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 shutdown_connections 2023-10-25T16:13:55.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.112+0000 7f39dccf7640 1 -- 172.21.15.177:0/523224013 wait complete. 2023-10-25T16:13:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:55.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:55.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 -- 172.21.15.177:0/136095465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec1500f0 msgr2=0x7f9eec0c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 --2- 172.21.15.177:0/136095465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec1500f0 0x7f9eec0c9910 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9eec06fac0 tx=0x7f9ee401c720 comp rx=0 tx=0).stop 2023-10-25T16:13:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 -- 172.21.15.177:0/136095465 shutdown_connections 2023-10-25T16:13:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 --2- 172.21.15.177:0/136095465 >> v2:172.21.15.184:3300/0 conn(0x7f9eec06c0f0 0x7f9eec0706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 --2- 172.21.15.177:0/136095465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec1500f0 0x7f9eec0c9910 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 -- 172.21.15.177:0/136095465 >> 172.21.15.177:0/136095465 conn(0x7f9eec0b2450 msgr2=0x7f9eec0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 -- 172.21.15.177:0/136095465 shutdown_connections 2023-10-25T16:13:55.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 -- 172.21.15.177:0/136095465 wait complete. 2023-10-25T16:13:55.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 Processor -- start 2023-10-25T16:13:55.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.244+0000 7f9ef3390640 1 -- start start 2023-10-25T16:13:55.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 0x7f9eec0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec0c9e50 0x7f9eec15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec1500f0 0x7f9eec15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0afa70 con 0x7f9eec06c0f0 2023-10-25T16:13:55.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1438f0 con 0x7f9eec1500f0 2023-10-25T16:13:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec143610 con 0x7f9eec0c9e50 2023-10-25T16:13:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 0x7f9eec0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 0x7f9eec0af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40818/0 (socket says 172.21.15.177:40818) 2023-10-25T16:13:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 -- 172.21.15.177:0/1368353684 learned_addr learned my addr 172.21.15.177:0/1368353684 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:55.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef092b640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec0c9e50 0x7f9eec15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef192d640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec1500f0 0x7f9eec15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 -- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec0c9e50 msgr2=0x7f9eec15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec0c9e50 0x7f9eec15ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 -- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec1500f0 msgr2=0x7f9eec15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec1500f0 0x7f9eec15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 -- 172.21.15.177:0/1368353684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40094a0 con 0x7f9eec06c0f0 2023-10-25T16:13:55.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef112c640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 0x7f9eec0af530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009790 tx=0x7f9ee40a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:55.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40042c0 con 0x7f9eec06c0f0 2023-10-25T16:13:55.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ee4004510 con 0x7f9eec06c0f0 2023-10-25T16:13:55.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4003840 con 0x7f9eec06c0f0 2023-10-25T16:13:55.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec14a7c0 con 0x7f9eec06c0f0 2023-10-25T16:13:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec14ad80 con 0x7f9eec06c0f0 2023-10-25T16:13:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec159ab0 con 0x7f9eec06c0f0 2023-10-25T16:13:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ee40b4040 con 0x7f9eec06c0f0 2023-10-25T16:13:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ee9ffb640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ed8066470 0x7f9ed8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9ee411f280 con 0x7f9eec06c0f0 2023-10-25T16:13:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.248+0000 7f9ef092b640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ed8066470 0x7f9ed8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.252+0000 7f9ef092b640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ed8066470 0x7f9ed8068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0b2ac0 tx=0x7f9ee0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:55.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.252+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ee40ec710 con 0x7f9eec06c0f0 2023-10-25T16:13:55.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.392+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9eec04daf0 con 0x7f9eec06c0f0 2023-10-25T16:13:55.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.392+0000 7f9ee9ffb640 1 -- 172.21.15.177:0/1368353684 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ee40b20a0 con 0x7f9eec06c0f0 2023-10-25T16:13:55.399 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:55.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ed8066470 msgr2=0x7f9ed8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ed8066470 0x7f9ed8068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0b2ac0 tx=0x7f9ee0009040 comp rx=0 tx=0).stop 2023-10-25T16:13:55.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 msgr2=0x7f9eec0af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 0x7f9eec0af530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009790 tx=0x7f9ee40a57c0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 shutdown_connections 2023-10-25T16:13:55.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ed8066470 0x7f9ed8068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9eec1500f0 0x7f9eec15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9eec0c9e50 0x7f9eec15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 --2- 172.21.15.177:0/1368353684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eec06c0f0 0x7f9eec0af530 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 >> 172.21.15.177:0/1368353684 conn(0x7f9eec0b2450 msgr2=0x7f9eec0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 shutdown_connections 2023-10-25T16:13:55.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.396+0000 7f9ef3390640 1 -- 172.21.15.177:0/1368353684 wait complete. 2023-10-25T16:13:55.415 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:55.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1730251927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5324004d10 msgr2=0x7f5324005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1730251927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5324004d10 0x7f5324005190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5330009e00 tx=0x7f533001d110 comp rx=0 tx=0).stop 2023-10-25T16:13:55.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533e1fb640 1 -- 172.21.15.177:0/1730251927 reap_dead start 2023-10-25T16:13:55.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1730251927 shutdown_connections 2023-10-25T16:13:55.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1730251927 >> 172.21.15.177:0/1730251927 conn(0x7f53380b2450 msgr2=0x7f53380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1730251927 shutdown_connections 2023-10-25T16:13:55.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1730251927 wait complete. 2023-10-25T16:13:55.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 Processor -- start 2023-10-25T16:13:55.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- start start 2023-10-25T16:13:55.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53381447e0 0x7f53381468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 0x7f5338145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f533815a860 0x7f533815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533815b220 con 0x7f53380a88b0 2023-10-25T16:13:55.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338146460 con 0x7f533815a860 2023-10-25T16:13:55.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5338146e30 con 0x7f53381447e0 2023-10-25T16:13:55.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 0x7f5338145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 0x7f5338145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40838/0 (socket says 172.21.15.177:40838) 2023-10-25T16:13:55.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 -- 172.21.15.177:0/1004493138 learned_addr learned my addr 172.21.15.177:0/1004493138 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:55.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d9fa640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53381447e0 0x7f53381468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533e1fb640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f533815a860 0x7f533815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 -- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53381447e0 msgr2=0x7f53381468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53381447e0 0x7f53381468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 -- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f533815a860 msgr2=0x7f533815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f533815a860 0x7f533815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 -- 172.21.15.177:0/1004493138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338145850 con 0x7f53380a88b0 2023-10-25T16:13:55.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d9fa640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53381447e0 0x7f53381468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:55.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533e1fb640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f533815a860 0x7f533815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:55.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533d1f9640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 0x7f5338145020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f532800d7b0 tx=0x7f532800dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:55.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280052e0 con 0x7f53380a88b0 2023-10-25T16:13:55.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5328005440 con 0x7f53380a88b0 2023-10-25T16:13:55.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5338145b30 con 0x7f53380a88b0 2023-10-25T16:13:55.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328003920 con 0x7f53380a88b0 2023-10-25T16:13:55.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.528+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53381460f0 con 0x7f53380a88b0 2023-10-25T16:13:55.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.532+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53381462b0 con 0x7f53380a88b0 2023-10-25T16:13:55.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.532+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5328003a80 con 0x7f53380a88b0 2023-10-25T16:13:55.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.532+0000 7f532e7fc640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f531c0664a0 0x7f531c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.532+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5328083c00 con 0x7f53380a88b0 2023-10-25T16:13:55.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.532+0000 7f533d9fa640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f531c0664a0 0x7f531c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.532+0000 7f533d9fa640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f531c0664a0 0x7f531c068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53340017b0 tx=0x7f5334006a80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:55.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.536+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f532808a080 con 0x7f53380a88b0 2023-10-25T16:13:55.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.680+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f533804daf0 con 0x7f53380a88b0 2023-10-25T16:13:55.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f532e7fc640 1 -- 172.21.15.177:0/1004493138 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5328019020 con 0x7f53380a88b0 2023-10-25T16:13:55.687 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:55.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f531c0664a0 msgr2=0x7f531c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f531c0664a0 0x7f531c068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53340017b0 tx=0x7f5334006a80 comp rx=0 tx=0).stop 2023-10-25T16:13:55.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 msgr2=0x7f5338145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 0x7f5338145020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f532800d7b0 tx=0x7f532800dc70 comp rx=0 tx=0).stop 2023-10-25T16:13:55.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 shutdown_connections 2023-10-25T16:13:55.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f531c0664a0 0x7f531c068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f533815a860 0x7f533815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53380a88b0 0x7f5338145020 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 --2- 172.21.15.177:0/1004493138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53381447e0 0x7f53381468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 >> 172.21.15.177:0/1004493138 conn(0x7f53380b2450 msgr2=0x7f5338155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 shutdown_connections 2023-10-25T16:13:55.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.684+0000 7f533fc5e640 1 -- 172.21.15.177:0/1004493138 wait complete. 2023-10-25T16:13:55.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:55.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/3313689333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3200047d0 msgr2=0x7fd320004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 --2- 172.21.15.177:0/3313689333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3200047d0 0x7fd320004c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fb0 tx=0x7fd32c01cf90 comp rx=0 tx=0).stop 2023-10-25T16:13:55.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/3313689333 shutdown_connections 2023-10-25T16:13:55.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 --2- 172.21.15.177:0/3313689333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3200047d0 0x7fd320004c50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/3313689333 >> 172.21.15.177:0/3313689333 conn(0x7fd3380b2450 msgr2=0x7fd3380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/3313689333 shutdown_connections 2023-10-25T16:13:55.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/3313689333 wait complete. 2023-10-25T16:13:55.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 Processor -- start 2023-10-25T16:13:55.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- start start 2023-10-25T16:13:55.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3200047d0 0x7fd338157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 0x7fd3380707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3380ad150 0x7fd3380ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33813ece0 con 0x7fd338070340 2023-10-25T16:13:55.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd338070d00 con 0x7fd3200047d0 2023-10-25T16:13:55.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33813e340 con 0x7fd3380ad150 2023-10-25T16:13:55.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 0x7fd3380707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 0x7fd3380707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40866/0 (socket says 172.21.15.177:40866) 2023-10-25T16:13:55.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 -- 172.21.15.177:0/200335456 learned_addr learned my addr 172.21.15.177:0/200335456 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:55.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd337fff640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3380ad150 0x7fd3380ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd3377fe640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3200047d0 0x7fd338157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 -- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3380ad150 msgr2=0x7fd3380ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3380ad150 0x7fd3380ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 -- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3200047d0 msgr2=0x7fd338157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3200047d0 0x7fd338157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 -- 172.21.15.177:0/200335456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33813e620 con 0x7fd338070340 2023-10-25T16:13:55.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd336ffd640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 0x7fd3380707c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd32c01cdc0 tx=0x7fd32c001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:55.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0b3070 con 0x7fd338070340 2023-10-25T16:13:55.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd32c001710 con 0x7fd338070340 2023-10-25T16:13:55.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33813e900 con 0x7fd338070340 2023-10-25T16:13:55.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c006440 con 0x7fd338070340 2023-10-25T16:13:55.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.828+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380adb10 con 0x7fd338070340 2023-10-25T16:13:55.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.832+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33813e480 con 0x7fd338070340 2023-10-25T16:13:55.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.832+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd32c0ab020 con 0x7fd338070340 2023-10-25T16:13:55.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.832+0000 7fd31ffff640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd324066470 0x7fd324068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:55.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.832+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd32c11def0 con 0x7fd338070340 2023-10-25T16:13:55.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.832+0000 7fd3377fe640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd324066470 0x7fd324068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:55.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.832+0000 7fd3377fe640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd324066470 0x7fd324068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd3380b15e0 tx=0x7fd3280060f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:55.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.836+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd33813e480 con 0x7fd338070340 2023-10-25T16:13:55.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.980+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd33813e480 con 0x7fd338070340 2023-10-25T16:13:55.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.980+0000 7fd31ffff640 1 -- 172.21.15.177:0/200335456 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd33813e480 con 0x7fd338070340 2023-10-25T16:13:55.986 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:55.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd324066470 msgr2=0x7fd324068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd324066470 0x7fd324068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd3380b15e0 tx=0x7fd3280060f0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 msgr2=0x7fd3380707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:55.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 0x7fd3380707c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd32c01cdc0 tx=0x7fd32c001d60 comp rx=0 tx=0).stop 2023-10-25T16:13:55.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 shutdown_connections 2023-10-25T16:13:55.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd324066470 0x7fd324068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3380ad150 0x7fd3380ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd338070340 0x7fd3380707c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 --2- 172.21.15.177:0/200335456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3200047d0 0x7fd338157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:55.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 >> 172.21.15.177:0/200335456 conn(0x7fd3380b2450 msgr2=0x7fd3380cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:55.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 shutdown_connections 2023-10-25T16:13:55.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:55.984+0000 7fd33e021640 1 -- 172.21.15.177:0/200335456 wait complete. 2023-10-25T16:13:56.005 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:13:56.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 -- 172.21.15.177:0/3845736778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37c003fe0 msgr2=0x7fe37c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 --2- 172.21.15.177:0/3845736778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe37c003fe0 0x7fe37c0047d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe3940ac640 tx=0x7fe38801c740 comp rx=0 tx=0).stop 2023-10-25T16:13:56.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe392d9d640 1 -- 172.21.15.177:0/3845736778 reap_dead start 2023-10-25T16:13:56.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 -- 172.21.15.177:0/3845736778 shutdown_connections 2023-10-25T16:13:56.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 -- 172.21.15.177:0/3845736778 >> 172.21.15.177:0/3845736778 conn(0x7fe3940b2450 msgr2=0x7fe3940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:56.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 -- 172.21.15.177:0/3845736778 shutdown_connections 2023-10-25T16:13:56.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 -- 172.21.15.177:0/3845736778 wait complete. 2023-10-25T16:13:56.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 Processor -- start 2023-10-25T16:13:56.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.116+0000 7fe398d6c640 1 -- start start 2023-10-25T16:13:56.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37c003fe0 0x7fe3941f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 0x7fe3941f9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe394142380 0x7fe3941f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940b0a40 con 0x7fe3941e4510 2023-10-25T16:13:56.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940b0d20 con 0x7fe37c003fe0 2023-10-25T16:13:56.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940b1000 con 0x7fe394142380 2023-10-25T16:13:56.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 0x7fe3941f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 0x7fe3941f9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40886/0 (socket says 172.21.15.177:40886) 2023-10-25T16:13:56.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 -- 172.21.15.177:0/4141941305 learned_addr learned my addr 172.21.15.177:0/4141941305 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:56.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe392d9d640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe394142380 0x7fe3941f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe39259c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37c003fe0 0x7fe3941f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 -- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe394142380 msgr2=0x7fe3941f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe394142380 0x7fe3941f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 -- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37c003fe0 msgr2=0x7fe3941f9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37c003fe0 0x7fe3941f9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 -- 172.21.15.177:0/4141941305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3940b12e0 con 0x7fe3941e4510 2023-10-25T16:13:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe391d9b640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 0x7fe3941f9950 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe38801c570 tx=0x7fe388006a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388003800 con 0x7fe3941e4510 2023-10-25T16:13:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe388003960 con 0x7fe3941e4510 2023-10-25T16:13:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388003d50 con 0x7fe3941e4510 2023-10-25T16:13:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3940b15c0 con 0x7fe3941e4510 2023-10-25T16:13:56.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3941f55e0 con 0x7fe3941e4510 2023-10-25T16:13:56.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39404daf0 con 0x7fe3941e4510 2023-10-25T16:13:56.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3880a7420 con 0x7fe3941e4510 2023-10-25T16:13:56.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe382ffd640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe374066470 0x7fe374068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe38811de50 con 0x7fe3941e4510 2023-10-25T16:13:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.120+0000 7fe39259c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe374066470 0x7fe374068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.124+0000 7fe39259c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe374066470 0x7fe374068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe3840017b0 tx=0x7fe3840011a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.124+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3880eb300 con 0x7fe3941e4510 2023-10-25T16:13:56.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.288+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe394153000 con 0x7fe3941e4510 2023-10-25T16:13:56.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.288+0000 7fe382ffd640 1 -- 172.21.15.177:0/4141941305 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3880ee920 con 0x7fe3941e4510 2023-10-25T16:13:56.294 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:13:56.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe374066470 msgr2=0x7fe374068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe374066470 0x7fe374068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe3840017b0 tx=0x7fe3840011a0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 msgr2=0x7fe3941f9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 0x7fe3941f9950 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe38801c570 tx=0x7fe388006a00 comp rx=0 tx=0).stop 2023-10-25T16:13:56.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 shutdown_connections 2023-10-25T16:13:56.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe374066470 0x7fe374068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe394142380 0x7fe3941f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3941e4510 0x7fe3941f9950 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 --2- 172.21.15.177:0/4141941305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37c003fe0 0x7fe3941f9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 >> 172.21.15.177:0/4141941305 conn(0x7fe3940b2450 msgr2=0x7fe3940cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:56.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 shutdown_connections 2023-10-25T16:13:56.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.292+0000 7fe398d6c640 1 -- 172.21.15.177:0/4141941305 wait complete. 2023-10-25T16:13:56.311 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:13:56.311 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:13:56.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-25T16:13:56.365 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:13:56.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:ceph-fuse[33858]: fuse finished with error 0 and tester_r 0 2023-10-25T16:13:56.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:13:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:56.373 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi184.stderr:2023-10-25T16:13:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:13:56.374 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:13:56.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:13:56.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:13:56.384 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:13:56.429 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:13:56.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 -- 172.21.15.177:0/3411003765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c0ce220 msgr2=0x7fa72c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 --2- 172.21.15.177:0/3411003765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c0ce220 0x7fa72c0b4100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa724009bc0 tx=0x7fa72401cab0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 -- 172.21.15.177:0/3411003765 shutdown_connections 2023-10-25T16:13:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 --2- 172.21.15.177:0/3411003765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c0ce220 0x7fa72c0b4100 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 -- 172.21.15.177:0/3411003765 >> 172.21.15.177:0/3411003765 conn(0x7fa72c09a5c0 msgr2=0x7fa72c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 -- 172.21.15.177:0/3411003765 shutdown_connections 2023-10-25T16:13:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.548+0000 7fa732771640 1 -- 172.21.15.177:0/3411003765 wait complete. 2023-10-25T16:13:56.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 Processor -- start 2023-10-25T16:13:56.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- start start 2023-10-25T16:13:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72c0b2120 0x7fa72c15c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa72c0ce220 0x7fa72c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 0x7fa72c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c14c2f0 con 0x7fa72c15eba0 2023-10-25T16:13:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c0b68d0 con 0x7fa72c0ce220 2023-10-25T16:13:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c14b720 con 0x7fa72c0b2120 2023-10-25T16:13:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 0x7fa72c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 0x7fa72c1523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40914/0 (socket says 172.21.15.177:40914) 2023-10-25T16:13:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 -- 172.21.15.177:0/3279672612 learned_addr learned my addr 172.21.15.177:0/3279672612 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa72b7fe640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa72c0ce220 0x7fa72c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa72bfff640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72c0b2120 0x7fa72c15c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 -- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72c0b2120 msgr2=0x7fa72c15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72c0b2120 0x7fa72c15c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 -- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa72c0ce220 msgr2=0x7fa72c149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa72c0ce220 0x7fa72c149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 -- 172.21.15.177:0/3279672612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa724009820 con 0x7fa72c15eba0 2023-10-25T16:13:56.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa72b7fe640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa72c0ce220 0x7fa72c149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:56.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa730d0e640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 0x7fa72c1523c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa72401c520 tx=0x7fa7240a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:56.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724003e50 con 0x7fa72c15eba0 2023-10-25T16:13:56.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa724004120 con 0x7fa72c15eba0 2023-10-25T16:13:56.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c14b9c0 con 0x7fa72c15eba0 2023-10-25T16:13:56.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724004490 con 0x7fa72c15eba0 2023-10-25T16:13:56.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c14bf80 con 0x7fa72c15eba0 2023-10-25T16:13:56.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.552+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c14c460 con 0x7fa72c15eba0 2023-10-25T16:13:56.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.556+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa7240a6d50 con 0x7fa72c15eba0 2023-10-25T16:13:56.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.556+0000 7fa728ff9640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa718066470 0x7fa718068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.556+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa72411f1d0 con 0x7fa72c15eba0 2023-10-25T16:13:56.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.556+0000 7fa72bfff640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa718066470 0x7fa718068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.556+0000 7fa72bfff640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa718066470 0x7fa718068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa72000a750 tx=0x7fa720008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:56.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.560+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7240ec5d0 con 0x7fa72c15eba0 2023-10-25T16:13:56.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.732+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa72c04daf0 con 0x7fa72c15eba0 2023-10-25T16:13:56.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.732+0000 7fa728ff9640 1 -- 172.21.15.177:0/3279672612 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fa7240efbf0 con 0x7fa72c15eba0 2023-10-25T16:13:56.738 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:56.739 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:56.739 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:56.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa718066470 msgr2=0x7fa718068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa718066470 0x7fa718068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa72000a750 tx=0x7fa720008040 comp rx=0 tx=0).stop 2023-10-25T16:13:56.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 msgr2=0x7fa72c1523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 0x7fa72c1523c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa72401c520 tx=0x7fa7240a5890 comp rx=0 tx=0).stop 2023-10-25T16:13:56.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 shutdown_connections 2023-10-25T16:13:56.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa718066470 0x7fa718068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa72c15eba0 0x7fa72c1523c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa72c0ce220 0x7fa72c149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 --2- 172.21.15.177:0/3279672612 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa72c0b2120 0x7fa72c15c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 >> 172.21.15.177:0/3279672612 conn(0x7fa72c09a5c0 msgr2=0x7fa72c153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:56.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 shutdown_connections 2023-10-25T16:13:56.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.736+0000 7fa732771640 1 -- 172.21.15.177:0/3279672612 wait complete. 2023-10-25T16:13:56.755 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f6111d2d640 1 -- 172.21.15.177:0/2980984461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f8003f80 msgr2=0x7f60f80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2980984461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f8003f80 0x7f60f80047d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006f00 tx=0x7f60f401ced0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f610bfff640 1 -- 172.21.15.177:0/2980984461 reap_dead start 2023-10-25T16:13:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f6111d2d640 1 -- 172.21.15.177:0/2980984461 shutdown_connections 2023-10-25T16:13:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f6111d2d640 1 -- 172.21.15.177:0/2980984461 >> 172.21.15.177:0/2980984461 conn(0x7f610c0b2450 msgr2=0x7f610c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:56.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f6111d2d640 1 -- 172.21.15.177:0/2980984461 shutdown_connections 2023-10-25T16:13:56.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.872+0000 7f6111d2d640 1 -- 172.21.15.177:0/2980984461 wait complete. 2023-10-25T16:13:56.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 Processor -- start 2023-10-25T16:13:56.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- start start 2023-10-25T16:13:56.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f8003f80 0x7f610c13e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f610c13ea00 0x7f610c1f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 0x7f610c1f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15ad90 con 0x7f610c13ee80 2023-10-25T16:13:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c13e770 con 0x7f610c13ea00 2023-10-25T16:13:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c154240 con 0x7f60f8003f80 2023-10-25T16:13:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 0x7f610c1f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 0x7f610c1f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40942/0 (socket says 172.21.15.177:40942) 2023-10-25T16:13:56.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 -- 172.21.15.177:0/2848000633 learned_addr learned my addr 172.21.15.177:0/2848000633 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:56.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610b7fe640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f8003f80 0x7f610c13e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 -- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f8003f80 msgr2=0x7f610c13e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f8003f80 0x7f610c13e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6102ffd640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f610c13ea00 0x7f610c1f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 -- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f610c13ea00 msgr2=0x7f610c1f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:56.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f610c13ea00 0x7f610c1f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:56.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 -- 172.21.15.177:0/2848000633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c154520 con 0x7f610c13ee80 2023-10-25T16:13:56.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f610bfff640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 0x7f610c1f9430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f610c06d9f0 tx=0x7f6104001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:56.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104011900 con 0x7f610c13ee80 2023-10-25T16:13:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6104011a80 con 0x7f610c13ee80 2023-10-25T16:13:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c154800 con 0x7f610c13ee80 2023-10-25T16:13:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104011e90 con 0x7f610c13ee80 2023-10-25T16:13:56.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c155000 con 0x7f610c13ee80 2023-10-25T16:13:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c04daf0 con 0x7f610c13ee80 2023-10-25T16:13:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f610401d460 con 0x7f610c13ee80 2023-10-25T16:13:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.876+0000 7f6108ff9640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60ec0664a0 0x7f60ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.880+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f61040849b0 con 0x7f610c13ee80 2023-10-25T16:13:56.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.880+0000 7f610b7fe640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60ec0664a0 0x7f60ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:56.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.880+0000 7f610b7fe640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60ec0664a0 0x7f60ec068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ba0 tx=0x7f60fc0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:56.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:56.884+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6104051db0 con 0x7f610c13ee80 2023-10-25T16:13:57.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.024+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f610c154cb0 con 0x7f610c13ee80 2023-10-25T16:13:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.028+0000 7f6108ff9640 1 -- 172.21.15.177:0/2848000633 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f61040553d0 con 0x7f610c13ee80 2023-10-25T16:13:57.035 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:57.035 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":23,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:54.560047+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60ec0664a0 msgr2=0x7f60ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60ec0664a0 0x7f60ec068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009ba0 tx=0x7f60fc0091e0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 msgr2=0x7f610c1f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 0x7f610c1f9430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f610c06d9f0 tx=0x7f6104001bd0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 shutdown_connections 2023-10-25T16:13:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60ec0664a0 0x7f60ec068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610c13ee80 0x7f610c1f9430 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f610c13ea00 0x7f610c1f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 --2- 172.21.15.177:0/2848000633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f8003f80 0x7f610c13e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 >> 172.21.15.177:0/2848000633 conn(0x7f610c0b2450 msgr2=0x7f610c0ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 shutdown_connections 2023-10-25T16:13:57.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.032+0000 7f6111d2d640 1 -- 172.21.15.177:0/2848000633 wait complete. 2023-10-25T16:13:57.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:13:04.603178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:13:05.918346+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:13:57.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:13:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.156+0000 7fe0a771b640 1 -- 172.21.15.177:0/4189844062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006c160 msgr2=0x7fe0a00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.156+0000 7fe0a771b640 1 --2- 172.21.15.177:0/4189844062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006c160 0x7fe0a00cb5c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00ca1f0 tx=0x7fe09801cad0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.156+0000 7fe0a771b640 1 -- 172.21.15.177:0/4189844062 shutdown_connections 2023-10-25T16:13:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.156+0000 7fe0a771b640 1 --2- 172.21.15.177:0/4189844062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006c160 0x7fe0a00cb5c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.156+0000 7fe0a771b640 1 --2- 172.21.15.177:0/4189844062 >> v2:172.21.15.184:3300/0 conn(0x7fe0a0140cf0 0x7fe0a00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.156+0000 7fe0a771b640 1 -- 172.21.15.177:0/4189844062 >> 172.21.15.177:0/4189844062 conn(0x7fe0a00b2450 msgr2=0x7fe0a00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- 172.21.15.177:0/4189844062 shutdown_connections 2023-10-25T16:13:57.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- 172.21.15.177:0/4189844062 wait complete. 2023-10-25T16:13:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 Processor -- start 2023-10-25T16:13:57.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- start start 2023-10-25T16:13:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0a006c160 0x7fe0a013ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 0x7fe0a013c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0a0140cf0 0x7fe0a006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a013f380 con 0x7fe0a006f570 2023-10-25T16:13:57.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0158dd0 con 0x7fe0a006c160 2023-10-25T16:13:57.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01590b0 con 0x7fe0a0140cf0 2023-10-25T16:13:57.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 0x7fe0a013c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 0x7fe0a013c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40950/0 (socket says 172.21.15.177:40950) 2023-10-25T16:13:57.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 -- 172.21.15.177:0/2368241164 learned_addr learned my addr 172.21.15.177:0/2368241164 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:57.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a5cb8640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0a0140cf0 0x7fe0a006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a54b7640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0a006c160 0x7fe0a013ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 -- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0a0140cf0 msgr2=0x7fe0a006fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0a0140cf0 0x7fe0a006fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 -- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0a006c160 msgr2=0x7fe0a013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0a006c160 0x7fe0a013ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 -- 172.21.15.177:0/2368241164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009820 con 0x7fe0a006f570 2023-10-25T16:13:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a4cb6640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 0x7fe0a013c890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c450 tx=0x7fe09000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090012830 con 0x7fe0a006f570 2023-10-25T16:13:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe090012a80 con 0x7fe0a006f570 2023-10-25T16:13:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a0159390 con 0x7fe0a006f570 2023-10-25T16:13:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090012e90 con 0x7fe0a006f570 2023-10-25T16:13:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a013f660 con 0x7fe0a006f570 2023-10-25T16:13:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.160+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a004daf0 con 0x7fe0a006f570 2023-10-25T16:13:57.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.164+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe09001b400 con 0x7fe0a006f570 2023-10-25T16:13:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.164+0000 7fe095ffb640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe084066470 0x7fe084068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.164+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe090084300 con 0x7fe0a006f570 2023-10-25T16:13:57.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.164+0000 7fe0a54b7640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe084066470 0x7fe084068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.164+0000 7fe0a54b7640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe084066470 0x7fe084068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0058d0 tx=0x7fe09c005bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:57.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.168+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe090051790 con 0x7fe0a006f570 2023-10-25T16:13:57.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.320+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0a00ca670 con 0x7fe0a006f570 2023-10-25T16:13:57.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.320+0000 7fe095ffb640 1 -- 172.21.15.177:0/2368241164 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe090054db0 con 0x7fe0a006f570 2023-10-25T16:13:57.325 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:13:57.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe084066470 msgr2=0x7fe084068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe084066470 0x7fe084068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0058d0 tx=0x7fe09c005bd0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 msgr2=0x7fe0a013c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 0x7fe0a013c890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c450 tx=0x7fe09000c910 comp rx=0 tx=0).stop 2023-10-25T16:13:57.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 shutdown_connections 2023-10-25T16:13:57.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe084066470 0x7fe084068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe0a0140cf0 0x7fe0a006fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a006f570 0x7fe0a013c890 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 --2- 172.21.15.177:0/2368241164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0a006c160 0x7fe0a013ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 >> 172.21.15.177:0/2368241164 conn(0x7fe0a00b2450 msgr2=0x7fe0a00711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 shutdown_connections 2023-10-25T16:13:57.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.324+0000 7fe0a771b640 1 -- 172.21.15.177:0/2368241164 wait complete. 2023-10-25T16:13:57.344 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:13:57.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/745596542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 msgr2=0x7f7778158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 --2- 172.21.15.177:0/745596542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778158170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f77780cdef0 tx=0x7f777001cb60 comp rx=0 tx=0).stop 2023-10-25T16:13:57.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/745596542 shutdown_connections 2023-10-25T16:13:57.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 --2- 172.21.15.177:0/745596542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778158170 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 --2- 172.21.15.177:0/745596542 >> v2:172.21.15.184:3300/0 conn(0x7f777814e810 0x7f77780cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/745596542 >> 172.21.15.177:0/745596542 conn(0x7f77780b2450 msgr2=0x7f77780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/745596542 shutdown_connections 2023-10-25T16:13:57.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/745596542 wait complete. 2023-10-25T16:13:57.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 Processor -- start 2023-10-25T16:13:57.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- start start 2023-10-25T16:13:57.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777814e810 0x7f777806f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777815bdb0 0x7f777814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778145f60 con 0x7f77780af2d0 2023-10-25T16:13:57.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778070bd0 con 0x7f777815bdb0 2023-10-25T16:13:57.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777806ffc0 con 0x7f777814e810 2023-10-25T16:13:57.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40960/0 (socket says 172.21.15.177:40960) 2023-10-25T16:13:57.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 -- 172.21.15.177:0/1266601546 learned_addr learned my addr 172.21.15.177:0/1266601546 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:57.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f7777fff640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777814e810 0x7f777806f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 -- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777814e810 msgr2=0x7f777806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777814e810 0x7f777806f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 -- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777815bdb0 msgr2=0x7f777814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777d269640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777815bdb0 0x7f777814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777815bdb0 0x7f777814bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 -- 172.21.15.177:0/1266601546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770009820 con 0x7f77780af2d0 2023-10-25T16:13:57.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777ca68640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778145a20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d980 tx=0x7f776c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:57.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c009c30 con 0x7f77780af2d0 2023-10-25T16:13:57.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f776c009e80 con 0x7f77780af2d0 2023-10-25T16:13:57.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0106a0 con 0x7f77780af2d0 2023-10-25T16:13:57.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77780702a0 con 0x7f77780af2d0 2023-10-25T16:13:57.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.456+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7778070860 con 0x7f77780af2d0 2023-10-25T16:13:57.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.460+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777804daf0 con 0x7f77780af2d0 2023-10-25T16:13:57.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.460+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f776c010800 con 0x7f77780af2d0 2023-10-25T16:13:57.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.460+0000 7f77757fa640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f775c066470 0x7f775c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.460+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f776c0842e0 con 0x7f77780af2d0 2023-10-25T16:13:57.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.460+0000 7f7777fff640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f775c066470 0x7f775c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.460+0000 7f7777fff640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f775c066470 0x7f775c068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7764001220 tx=0x7f7764009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:57.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.464+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f776c051770 con 0x7f77780af2d0 2023-10-25T16:13:57.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77780cd260 con 0x7f77780af2d0 2023-10-25T16:13:57.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f77757fa640 1 -- 172.21.15.177:0/1266601546 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f776c054d90 con 0x7f77780af2d0 2023-10-25T16:13:57.616 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:13:57.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f775c066470 msgr2=0x7f775c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f775c066470 0x7f775c068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7764001220 tx=0x7f7764009040 comp rx=0 tx=0).stop 2023-10-25T16:13:57.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 msgr2=0x7f7778145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778145a20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f776c00d980 tx=0x7f776c00de40 comp rx=0 tx=0).stop 2023-10-25T16:13:57.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 shutdown_connections 2023-10-25T16:13:57.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f775c066470 0x7f775c068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777815bdb0 0x7f777814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777814e810 0x7f777806f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 --2- 172.21.15.177:0/1266601546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77780af2d0 0x7f7778145a20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 >> 172.21.15.177:0/1266601546 conn(0x7f77780b2450 msgr2=0x7f77780c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 shutdown_connections 2023-10-25T16:13:57.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.612+0000 7f777eccc640 1 -- 172.21.15.177:0/1266601546 wait complete. 2023-10-25T16:13:57.634 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:13:57.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- 172.21.15.177:0/262866459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a4005260 msgr2=0x7fa0a400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/262866459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a4005260 0x7fa0a400b990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009e30 tx=0x7fa0b001d190 comp rx=0 tx=0).stop 2023-10-25T16:13:57.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- 172.21.15.177:0/262866459 shutdown_connections 2023-10-25T16:13:57.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/262866459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a4005260 0x7fa0a400b990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- 172.21.15.177:0/262866459 >> 172.21.15.177:0/262866459 conn(0x7fa0b80b2450 msgr2=0x7fa0b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- 172.21.15.177:0/262866459 shutdown_connections 2023-10-25T16:13:57.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- 172.21.15.177:0/262866459 wait complete. 2023-10-25T16:13:57.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 Processor -- start 2023-10-25T16:13:57.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- start start 2023-10-25T16:13:57.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0a4005260 0x7fa0b81f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b815b280 0x7fa0b8157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 0x7fa0b8159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8159870 con 0x7fa0b8158e80 2023-10-25T16:13:57.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80adf30 con 0x7fa0b815b280 2023-10-25T16:13:57.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0bd45f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80ad040 con 0x7fa0a4005260 2023-10-25T16:13:57.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 0x7fa0b8159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 0x7fa0b8159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40974/0 (socket says 172.21.15.177:40974) 2023-10-25T16:13:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 -- 172.21.15.177:0/1436528871 learned_addr learned my addr 172.21.15.177:0/1436528871 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0ae7fc640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b815b280 0x7fa0b8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b6ffd640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0a4005260 0x7fa0b81f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 -- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0a4005260 msgr2=0x7fa0b81f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0a4005260 0x7fa0b81f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 -- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b815b280 msgr2=0x7fa0b8157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b815b280 0x7fa0b8157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 -- 172.21.15.177:0/1436528871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80ad320 con 0x7fa0b8158e80 2023-10-25T16:13:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0ae7fc640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b815b280 0x7fa0b8157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0b77fe640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 0x7fa0b8159330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa0b001cc00 tx=0x7fa0b0003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.744+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0004a50 con 0x7fa0b8158e80 2023-10-25T16:13:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0b0004ca0 con 0x7fa0b8158e80 2023-10-25T16:13:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b80ad600 con 0x7fa0b8158e80 2023-10-25T16:13:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0004180 con 0x7fa0b8158e80 2023-10-25T16:13:57.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b80adbc0 con 0x7fa0b8158e80 2023-10-25T16:13:57.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b80add50 con 0x7fa0b8158e80 2023-10-25T16:13:57.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0b00042e0 con 0x7fa0b8158e80 2023-10-25T16:13:57.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0affff640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0980664a0 0x7fa098068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:57.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa0b011f560 con 0x7fa0b8158e80 2023-10-25T16:13:57.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0b6ffd640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0980664a0 0x7fa098068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:57.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.748+0000 7fa0b6ffd640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0980664a0 0x7fa098068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8000fc0 tx=0x7fa0a8001560 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:57.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.752+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0b00eca80 con 0x7fa0b8158e80 2023-10-25T16:13:57.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.892+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0b804daf0 con 0x7fa0b8158e80 2023-10-25T16:13:57.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0affff640 1 -- 172.21.15.177:0/1436528871 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0b00f00a0 con 0x7fa0b8158e80 2023-10-25T16:13:57.900 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:13:57.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0980664a0 msgr2=0x7fa098068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0980664a0 0x7fa098068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8000fc0 tx=0x7fa0a8001560 comp rx=0 tx=0).stop 2023-10-25T16:13:57.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 msgr2=0x7fa0b8159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:57.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 0x7fa0b8159330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa0b001cc00 tx=0x7fa0b0003ef0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 shutdown_connections 2023-10-25T16:13:57.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0980664a0 0x7fa098068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b8158e80 0x7fa0b8159330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b815b280 0x7fa0b8157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 --2- 172.21.15.177:0/1436528871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0a4005260 0x7fa0b81f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:57.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 >> 172.21.15.177:0/1436528871 conn(0x7fa0b80b2450 msgr2=0x7fa0b8157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:57.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 shutdown_connections 2023-10-25T16:13:57.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:57.896+0000 7fa0bd45f640 1 -- 172.21.15.177:0/1436528871 wait complete. 2023-10-25T16:13:57.917 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:58.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3558851769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa80cbd80 msgr2=0x7fdfa80c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3558851769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa80cbd80 0x7fdfa80c9e70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00a950 tx=0x7fdf9c01dae0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3558851769 shutdown_connections 2023-10-25T16:13:58.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3558851769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa80cbd80 0x7fdfa80c9e70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3558851769 >> 172.21.15.177:0/3558851769 conn(0x7fdfa80af3f0 msgr2=0x7fdfa80af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:58.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3558851769 shutdown_connections 2023-10-25T16:13:58.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3558851769 wait complete. 2023-10-25T16:13:58.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 Processor -- start 2023-10-25T16:13:58.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- start start 2023-10-25T16:13:58.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80cbd80 0x7fdfa8144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 0x7fdfa80ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa815be10 0x7fdfa80adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80b2350 con 0x7fdfa8157920 2023-10-25T16:13:58.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa8158700 con 0x7fdfa80cbd80 2023-10-25T16:13:58.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfb01e5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81f6d10 con 0x7fdfa815be10 2023-10-25T16:13:58.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfad780640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 0x7fdfa80ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfad780640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 0x7fdfa80ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40994/0 (socket says 172.21.15.177:40994) 2023-10-25T16:13:58.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.028+0000 7fdfad780640 1 -- 172.21.15.177:0/3204786698 learned_addr learned my addr 172.21.15.177:0/3204786698 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:58.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfadf81640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80cbd80 0x7fdfa8144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfae782640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa815be10 0x7fdfa80adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfad780640 1 -- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa815be10 msgr2=0x7fdfa80adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfad780640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa815be10 0x7fdfa80adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfad780640 1 -- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80cbd80 msgr2=0x7fdfa8144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfad780640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80cbd80 0x7fdfa8144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfad780640 1 -- 172.21.15.177:0/3204786698 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c00a5b0 con 0x7fdfa8157920 2023-10-25T16:13:58.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfadf81640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80cbd80 0x7fdfa8144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:58.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfae782640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa815be10 0x7fdfa80adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:58.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfad780640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 0x7fdfa80ada20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00a8a0 tx=0x7fdf9c0a6ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:58.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0bb070 con 0x7fdfa8157920 2023-10-25T16:13:58.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf9c0053f0 con 0x7fdfa8157920 2023-10-25T16:13:58.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa80b1a20 con 0x7fdfa8157920 2023-10-25T16:13:58.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0a7ea0 con 0x7fdfa8157920 2023-10-25T16:13:58.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa80b1fe0 con 0x7fdfa8157920 2023-10-25T16:13:58.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa80b24c0 con 0x7fdfa8157920 2023-10-25T16:13:58.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf9c0b5070 con 0x7fdfa8157920 2023-10-25T16:13:58.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfa67fc640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf94066470 0x7fdf94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdf9c11e700 con 0x7fdfa8157920 2023-10-25T16:13:58.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfadf81640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf94066470 0x7fdf94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.032+0000 7fdfadf81640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf94066470 0x7fdf94068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf98007fd0 tx=0x7fdf98009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:58.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.036+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf9c0ebb10 con 0x7fdfa8157920 2023-10-25T16:13:58.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.212+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfa80b2490 con 0x7fdfa8157920 2023-10-25T16:13:58.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfa67fc640 1 -- 172.21.15.177:0/3204786698 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fdf9c0ef130 con 0x7fdfa8157920 2023-10-25T16:13:58.220 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:58.220 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:58.220 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:58.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf94066470 msgr2=0x7fdf94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf94066470 0x7fdf94068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf98007fd0 tx=0x7fdf98009040 comp rx=0 tx=0).stop 2023-10-25T16:13:58.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 msgr2=0x7fdfa80ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 0x7fdfa80ada20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00a8a0 tx=0x7fdf9c0a6ab0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 shutdown_connections 2023-10-25T16:13:58.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf94066470 0x7fdf94068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa815be10 0x7fdfa80adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa8157920 0x7fdfa80ada20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 --2- 172.21.15.177:0/3204786698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80cbd80 0x7fdfa8144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 >> 172.21.15.177:0/3204786698 conn(0x7fdfa80af3f0 msgr2=0x7fdfa80cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 shutdown_connections 2023-10-25T16:13:58.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.216+0000 7fdfb01e5640 1 -- 172.21.15.177:0/3204786698 wait complete. 2023-10-25T16:13:58.236 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:58.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f200e1bf640 1 -- 172.21.15.177:0/3214827350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ff40047d0 msgr2=0x7f1ff4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f200e1bf640 1 --2- 172.21.15.177:0/3214827350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ff40047d0 0x7f1ff4004c50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009b30 tx=0x7f1ff001d230 comp rx=0 tx=0).stop 2023-10-25T16:13:58.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f2007fff640 1 -- 172.21.15.177:0/3214827350 reap_dead start 2023-10-25T16:13:58.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f200e1bf640 1 -- 172.21.15.177:0/3214827350 shutdown_connections 2023-10-25T16:13:58.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f200e1bf640 1 -- 172.21.15.177:0/3214827350 >> 172.21.15.177:0/3214827350 conn(0x7f20080983a0 msgr2=0x7f20080cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:58.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f200e1bf640 1 -- 172.21.15.177:0/3214827350 shutdown_connections 2023-10-25T16:13:58.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.352+0000 7f200e1bf640 1 -- 172.21.15.177:0/3214827350 wait complete. 2023-10-25T16:13:58.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 Processor -- start 2023-10-25T16:13:58.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- start start 2023-10-25T16:13:58.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ff40047d0 0x7f2008156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20080b4390 0x7f20080c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 0x7f200806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008156840 con 0x7f20080b4810 2023-10-25T16:13:58.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080c6230 con 0x7f1ff40047d0 2023-10-25T16:13:58.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080c6510 con 0x7f20080b4390 2023-10-25T16:13:58.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 0x7f200806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 0x7f200806e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41012/0 (socket says 172.21.15.177:41012) 2023-10-25T16:13:58.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 -- 172.21.15.177:0/2762729800 learned_addr learned my addr 172.21.15.177:0/2762729800 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:58.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f20077fe640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ff40047d0 0x7f2008156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2006ffd640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20080b4390 0x7f20080c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 -- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20080b4390 msgr2=0x7f20080c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20080b4390 0x7f20080c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 -- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ff40047d0 msgr2=0x7f2008156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ff40047d0 0x7f2008156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 -- 172.21.15.177:0/2762729800 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080cd770 con 0x7f20080b4810 2023-10-25T16:13:58.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f20077fe640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ff40047d0 0x7f2008156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:58.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f2007fff640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 0x7f200806e830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f20000036b0 tx=0x7f200000f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:58.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000007cb0 con 0x7f20080b4810 2023-10-25T16:13:58.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f200000ae30 con 0x7f20080b4810 2023-10-25T16:13:58.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000a350 con 0x7f20080b4810 2023-10-25T16:13:58.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080c67f0 con 0x7f20080b4810 2023-10-25T16:13:58.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20080c6db0 con 0x7f20080b4810 2023-10-25T16:13:58.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200804daf0 con 0x7f20080b4810 2023-10-25T16:13:58.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f200000a4b0 con 0x7f20080b4810 2023-10-25T16:13:58.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.356+0000 7f1ffffff640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.360+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2000086420 con 0x7f20080b4810 2023-10-25T16:13:58.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.360+0000 7f20077fe640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.360+0000 7f20077fe640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1fe80664a0 0x7f1fe8068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80062f0 tx=0x7f1ff8006f50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:58.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.364+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20000538b0 con 0x7f20080b4810 2023-10-25T16:13:58.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.520+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20080ce1c0 con 0x7f20080b4810 2023-10-25T16:13:58.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f1ffffff640 1 -- 172.21.15.177:0/2762729800 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f20080ce1c0 con 0x7f20080b4810 2023-10-25T16:13:58.527 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:58.527 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":23,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:54.560047+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:58.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1fe80664a0 msgr2=0x7f1fe8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1fe80664a0 0x7f1fe8068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80062f0 tx=0x7f1ff8006f50 comp rx=0 tx=0).stop 2023-10-25T16:13:58.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 msgr2=0x7f200806e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 0x7f200806e830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f20000036b0 tx=0x7f200000f820 comp rx=0 tx=0).stop 2023-10-25T16:13:58.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 shutdown_connections 2023-10-25T16:13:58.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20080b4810 0x7f200806e830 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f20080b4390 0x7f20080c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 --2- 172.21.15.177:0/2762729800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ff40047d0 0x7f2008156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 >> 172.21.15.177:0/2762729800 conn(0x7f20080983a0 msgr2=0x7f2008157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:58.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 shutdown_connections 2023-10-25T16:13:58.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.524+0000 7f200e1bf640 1 -- 172.21.15.177:0/2762729800 wait complete. 2023-10-25T16:13:58.546 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:13:58.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:58.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 -- 172.21.15.177:0/1116329639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 msgr2=0x7f552c0c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 --2- 172.21.15.177:0/1116329639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 0x7f552c0c9910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5528009900 tx=0x7f552801c890 comp rx=0 tx=0).stop 2023-10-25T16:13:58.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 -- 172.21.15.177:0/1116329639 shutdown_connections 2023-10-25T16:13:58.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 --2- 172.21.15.177:0/1116329639 >> v2:172.21.15.184:3300/0 conn(0x7f552c0c9e50 0x7f552c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 --2- 172.21.15.177:0/1116329639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 0x7f552c0c9910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 -- 172.21.15.177:0/1116329639 >> 172.21.15.177:0/1116329639 conn(0x7f552c0b2450 msgr2=0x7f552c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:58.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 -- 172.21.15.177:0/1116329639 shutdown_connections 2023-10-25T16:13:58.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.668+0000 7f5533f39640 1 -- 172.21.15.177:0/1116329639 wait complete. 2023-10-25T16:13:58.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 Processor -- start 2023-10-25T16:13:58.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- start start 2023-10-25T16:13:58.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f552c06bf20 0x7f552c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 0x7f552c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 0x7f552c1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c154f30 con 0x7f552c0c9e50 2023-10-25T16:13:58.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c149390 con 0x7f552c06bf20 2023-10-25T16:13:58.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c148780 con 0x7f552c1500f0 2023-10-25T16:13:58.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 0x7f552c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 0x7f552c157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41026/0 (socket says 172.21.15.177:41026) 2023-10-25T16:13:58.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 -- 172.21.15.177:0/2091618201 learned_addr learned my addr 172.21.15.177:0/2091618201 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:58.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55324d6640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 0x7f552c1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5531cd5640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f552c06bf20 0x7f552c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 -- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 msgr2=0x7f552c1432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 0x7f552c1432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 -- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f552c06bf20 msgr2=0x7f552c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f552c06bf20 0x7f552c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 -- 172.21.15.177:0/2091618201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009560 con 0x7f552c0c9e50 2023-10-25T16:13:58.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55314d4640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 0x7f552c157500 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f551c00e9f0 tx=0x7f551c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:58.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c00ccc0 con 0x7f552c0c9e50 2023-10-25T16:13:58.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f551c010430 con 0x7f552c0c9e50 2023-10-25T16:13:58.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c148a60 con 0x7f552c0c9e50 2023-10-25T16:13:58.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c010800 con 0x7f552c0c9e50 2023-10-25T16:13:58.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c149020 con 0x7f552c0c9e50 2023-10-25T16:13:58.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c1491b0 con 0x7f552c0c9e50 2023-10-25T16:13:58.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f551c010960 con 0x7f552c0c9e50 2023-10-25T16:13:58.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55227fc640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5510066470 0x7f5510068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:58.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f551c014070 con 0x7f552c0c9e50 2023-10-25T16:13:58.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.672+0000 7f5531cd5640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5510066470 0x7f5510068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:58.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.676+0000 7f5531cd5640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5510066470 0x7f5510068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f55280af000 tx=0x7f552801b0d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:58.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.676+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f551c051ff0 con 0x7f552c0c9e50 2023-10-25T16:13:58.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.860+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f552c04daf0 con 0x7f552c0c9e50 2023-10-25T16:13:58.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.860+0000 7f55227fc640 1 -- 172.21.15.177:0/2091618201 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f551c055610 con 0x7f552c0c9e50 2023-10-25T16:13:58.865 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:58.865 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:58.866 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.860+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5510066470 msgr2=0x7f5510068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5510066470 0x7f5510068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f55280af000 tx=0x7f552801b0d0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 msgr2=0x7f552c157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 0x7f552c157500 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f551c00e9f0 tx=0x7f551c00eeb0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 shutdown_connections 2023-10-25T16:13:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5510066470 0x7f5510068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f552c1500f0 0x7f552c1432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f552c0c9e50 0x7f552c157500 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 --2- 172.21.15.177:0/2091618201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f552c06bf20 0x7f552c14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 >> 172.21.15.177:0/2091618201 conn(0x7f552c0b2450 msgr2=0x7f552c0ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 shutdown_connections 2023-10-25T16:13:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:58.864+0000 7f5533f39640 1 -- 172.21.15.177:0/2091618201 wait complete. 2023-10-25T16:13:58.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:13:59.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 -- 172.21.15.177:0/3616218131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 msgr2=0x7f7f000adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 --2- 172.21.15.177:0/3616218131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000adf20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009900 tx=0x7f7efc01f070 comp rx=0 tx=0).stop 2023-10-25T16:13:59.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 -- 172.21.15.177:0/3616218131 shutdown_connections 2023-10-25T16:13:59.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 --2- 172.21.15.177:0/3616218131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f000b00f0 0x7f7f000cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 --2- 172.21.15.177:0/3616218131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000adf20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 -- 172.21.15.177:0/3616218131 >> 172.21.15.177:0/3616218131 conn(0x7f7f0009a5c0 msgr2=0x7f7f000d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 -- 172.21.15.177:0/3616218131 shutdown_connections 2023-10-25T16:13:59.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.004+0000 7f7f077ba640 1 -- 172.21.15.177:0/3616218131 wait complete. 2023-10-25T16:13:59.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 Processor -- start 2023-10-25T16:13:59.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 -- start start 2023-10-25T16:13:59.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f000b00f0 0x7f7f0014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f000cfbc0 0x7f7f0015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000c9ec0 con 0x7f7f000cf7e0 2023-10-25T16:13:59.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000c9240 con 0x7f7f000b00f0 2023-10-25T16:13:59.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000c9520 con 0x7f7f000cfbc0 2023-10-25T16:13:59.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41048/0 (socket says 172.21.15.177:41048) 2023-10-25T16:13:59.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 -- 172.21.15.177:0/1725067590 learned_addr learned my addr 172.21.15.177:0/1725067590 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:59.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f05d57640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f000cfbc0 0x7f7f0015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f05556640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f000b00f0 0x7f7f0014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 -- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f000cfbc0 msgr2=0x7f7f0015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f000cfbc0 0x7f7f0015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 -- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f000b00f0 msgr2=0x7f7f0014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f000b00f0 0x7f7f0014a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 -- 172.21.15.177:0/1725067590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc009560 con 0x7f7f000cf7e0 2023-10-25T16:13:59.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f04d55640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000c87f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c970 tx=0x7f7ef000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0007bb0 con 0x7f7f000cf7e0 2023-10-25T16:13:59.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ef0007e20 con 0x7f7f000cf7e0 2023-10-25T16:13:59.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f000c9800 con 0x7f7f000cf7e0 2023-10-25T16:13:59.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0005280 con 0x7f7f000cf7e0 2023-10-25T16:13:59.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.008+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0015cd90 con 0x7f7f000cf7e0 2023-10-25T16:13:59.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.012+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f000ca000 con 0x7f7f000cf7e0 2023-10-25T16:13:59.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.012+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ef00053e0 con 0x7f7f000cf7e0 2023-10-25T16:13:59.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.012+0000 7f7ef5ffb640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ee4066470 0x7f7ee4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.012+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7ef0084890 con 0x7f7f000cf7e0 2023-10-25T16:13:59.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.012+0000 7f7f05556640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ee4066470 0x7f7ee4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.012+0000 7f7f05556640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ee4066470 0x7f7ee4068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0b2000 tx=0x7f7efc01d8b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.016+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7f000ca000 con 0x7f7f000cf7e0 2023-10-25T16:13:59.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f000ca000 con 0x7f7f000cf7e0 2023-10-25T16:13:59.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7ef5ffb640 1 -- 172.21.15.177:0/1725067590 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f7f000ca000 con 0x7f7f000cf7e0 2023-10-25T16:13:59.208 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:59.208 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/802978460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":802978460},{"type":"v1","addr":"172.21.15.177:6834","nonce":802978460}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4003052955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4003052955},{"type":"v1","addr":"172.21.15.184:6837","nonce":4003052955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":154133,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/156745246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":156745246},{"type":"v1","addr":"172.21.15.177:6835","nonce":156745246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:13:06.929440+0000","modified":"2023-10-25T16:13:08.926933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154145":{"gid":154145,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/3257787330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3257787330},{"type":"v1","addr":"172.21.15.184:6835","nonce":3257787330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T16:13:59.209 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 6 2023-10-25T16:13:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ee4066470 msgr2=0x7f7ee4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ee4066470 0x7f7ee4068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0b2000 tx=0x7f7efc01d8b0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 msgr2=0x7f7f000c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000c87f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c970 tx=0x7f7ef000ce30 comp rx=0 tx=0).stop 2023-10-25T16:13:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 shutdown_connections 2023-10-25T16:13:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ee4066470 0x7f7ee4068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f000cfbc0 0x7f7f0015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f000cf7e0 0x7f7f000c87f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 --2- 172.21.15.177:0/1725067590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f000b00f0 0x7f7f0014a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 >> 172.21.15.177:0/1725067590 conn(0x7f7f0009a5c0 msgr2=0x7f7f0015e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 shutdown_connections 2023-10-25T16:13:59.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.204+0000 7f7f077ba640 1 -- 172.21.15.177:0/1725067590 wait complete. 2023-10-25T16:13:59.227 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:13:59.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 -- 172.21.15.177:0/630065860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa406c160 msgr2=0x7f0fa40cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 --2- 172.21.15.177:0/630065860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa406c160 0x7f0fa40cb5c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009bc0 tx=0x7f0f9c01caf0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 -- 172.21.15.177:0/630065860 shutdown_connections 2023-10-25T16:13:59.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 --2- 172.21.15.177:0/630065860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa406c160 0x7f0fa40cb5c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 --2- 172.21.15.177:0/630065860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa4140cf0 0x7f0fa40af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 -- 172.21.15.177:0/630065860 >> 172.21.15.177:0/630065860 conn(0x7f0fa40b2450 msgr2=0x7f0fa40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 -- 172.21.15.177:0/630065860 shutdown_connections 2023-10-25T16:13:59.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 -- 172.21.15.177:0/630065860 wait complete. 2023-10-25T16:13:59.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 Processor -- start 2023-10-25T16:13:59.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.344+0000 7f0faaa41640 1 -- start start 2023-10-25T16:13:59.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa406c160 0x7f0fa41378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 0x7f0fa4159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa4140cf0 0x7f0fa4159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41330b0 con 0x7f0fa406f570 2023-10-25T16:13:59.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4138100 con 0x7f0fa4140cf0 2023-10-25T16:13:59.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41383e0 con 0x7f0fa406c160 2023-10-25T16:13:59.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 0x7f0fa4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 0x7f0fa4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41052/0 (socket says 172.21.15.177:41052) 2023-10-25T16:13:59.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 -- 172.21.15.177:0/3421666189 learned_addr learned my addr 172.21.15.177:0/3421666189 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:59.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa3fff640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa406c160 0x7f0fa41378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa8fde640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa4140cf0 0x7f0fa4159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 -- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa406c160 msgr2=0x7f0fa41378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa406c160 0x7f0fa41378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 -- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa4140cf0 msgr2=0x7f0fa4159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa4140cf0 0x7f0fa4159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 -- 172.21.15.177:0/3421666189 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94009560 con 0x7f0fa406f570 2023-10-25T16:13:59.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa3fff640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa406c160 0x7f0fa41378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:13:59.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa37fe640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 0x7f0fa4159900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800c440 tx=0x7f0f98001ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980052d0 con 0x7f0fa406f570 2023-10-25T16:13:59.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f98005540 con 0x7f0fa406f570 2023-10-25T16:13:59.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c009820 con 0x7f0fa406f570 2023-10-25T16:13:59.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98006a70 con 0x7f0fa406f570 2023-10-25T16:13:59.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa4133300 con 0x7f0fa406f570 2023-10-25T16:13:59.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa404daf0 con 0x7f0fa406f570 2023-10-25T16:13:59.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0f98003650 con 0x7f0fa406f570 2023-10-25T16:13:59.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa0ff9640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0f90066470 0x7f0f90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0f98083570 con 0x7f0fa406f570 2023-10-25T16:13:59.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.348+0000 7f0fa3fff640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0f90066470 0x7f0f90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.352+0000 7f0fa3fff640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0f90066470 0x7f0f90068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009d20 tx=0x7f0f94009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.352+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f98050980 con 0x7f0fa406f570 2023-10-25T16:13:59.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.496+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fa4066e30 con 0x7f0fa406f570 2023-10-25T16:13:59.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0fa0ff9640 1 -- 172.21.15.177:0/3421666189 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f0f98053fa0 con 0x7f0fa406f570 2023-10-25T16:13:59.506 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:13:59.507 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":23,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:13:54.560047+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:13:04.603178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T16:13:05.918346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:13:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0f90066470 msgr2=0x7f0f90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0f90066470 0x7f0f90068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009d20 tx=0x7f0f94009260 comp rx=0 tx=0).stop 2023-10-25T16:13:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 msgr2=0x7f0fa4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 0x7f0fa4159900 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800c440 tx=0x7f0f98001ed0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 shutdown_connections 2023-10-25T16:13:59.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0f90066470 0x7f0f90068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fa4140cf0 0x7f0fa4159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa406f570 0x7f0fa4159900 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 --2- 172.21.15.177:0/3421666189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fa406c160 0x7f0fa41378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.500+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 >> 172.21.15.177:0/3421666189 conn(0x7f0fa40b2450 msgr2=0x7f0fa415ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.504+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 shutdown_connections 2023-10-25T16:13:59.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.504+0000 7f0faaa41640 1 -- 172.21.15.177:0/3421666189 wait complete. 2023-10-25T16:13:59.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:13:59.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- 172.21.15.177:0/4285877829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c015eba0 msgr2=0x7fb9c00b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/4285877829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c015eba0 0x7fb9c00b4100 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb9c009f200 tx=0x7fb9b001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- 172.21.15.177:0/4285877829 shutdown_connections 2023-10-25T16:13:59.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/4285877829 >> v2:172.21.15.184:3300/0 conn(0x7fb9c00b2120 0x7fb9c00d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/4285877829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c015eba0 0x7fb9c00b4100 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- 172.21.15.177:0/4285877829 >> 172.21.15.177:0/4285877829 conn(0x7fb9c009a5c0 msgr2=0x7fb9c00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- 172.21.15.177:0/4285877829 shutdown_connections 2023-10-25T16:13:59.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- 172.21.15.177:0/4285877829 wait complete. 2023-10-25T16:13:59.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 Processor -- start 2023-10-25T16:13:59.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- start start 2023-10-25T16:13:59.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9c00b2120 0x7fb9c00c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 0x7fb9c0153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9c015eba0 0x7fb9c014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01560e0 con 0x7fb9c00cdb10 2023-10-25T16:13:59.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00c7cb0 con 0x7fb9c00b2120 2023-10-25T16:13:59.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9c4e00640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01557b0 con 0x7fb9c015eba0 2023-10-25T16:13:59.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 0x7fb9c0153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 0x7fb9c0153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41064/0 (socket says 172.21.15.177:41064) 2023-10-25T16:13:59.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 -- 172.21.15.177:0/2845871747 learned_addr learned my addr 172.21.15.177:0/2845871747 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:59.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9be59c640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9c00b2120 0x7fb9c00c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bed9d640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9c015eba0 0x7fb9c014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 -- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9c015eba0 msgr2=0x7fb9c014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9c015eba0 0x7fb9c014e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 -- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9c00b2120 msgr2=0x7fb9c00c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9c00b2120 0x7fb9c00c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.628+0000 7fb9bdd9b640 1 -- 172.21.15.177:0/2845871747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b0009560 con 0x7fb9c00cdb10 2023-10-25T16:13:59.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9bdd9b640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 0x7fb9c0153440 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c970 tx=0x7fb9b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4007bb0 con 0x7fb9c00cdb10 2023-10-25T16:13:59.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9b4007e20 con 0x7fb9c00cdb10 2023-10-25T16:13:59.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c0155a90 con 0x7fb9c00cdb10 2023-10-25T16:13:59.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4005280 con 0x7fb9c00cdb10 2023-10-25T16:13:59.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0150580 con 0x7fb9c00cdb10 2023-10-25T16:13:59.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c004daf0 con 0x7fb9c00cdb10 2023-10-25T16:13:59.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9b40053e0 con 0x7fb9c00cdb10 2023-10-25T16:13:59.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9aeffd640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9a0066470 0x7fb9a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb9b4084870 con 0x7fb9c00cdb10 2023-10-25T16:13:59.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9be59c640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9a0066470 0x7fb9a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.632+0000 7fb9be59c640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9a0066470 0x7fb9a0068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00ae000 tx=0x7fb9b001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.636+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9b4051c70 con 0x7fb9c00cdb10 2023-10-25T16:13:59.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.808+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb9c00ce930 con 0x7fb9c00cdb10 2023-10-25T16:13:59.814 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:13:59.808+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:13:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.812+0000 7fb9aeffd640 1 -- 172.21.15.177:0/2845871747 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb9b401d070 con 0x7fb9c00cdb10 2023-10-25T16:13:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:13:59.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9a0066470 msgr2=0x7fb9a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9a0066470 0x7fb9a0068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00ae000 tx=0x7fb9b001b010 comp rx=0 tx=0).stop 2023-10-25T16:13:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 msgr2=0x7fb9c0153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 0x7fb9c0153440 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400c970 tx=0x7fb9b400ce30 comp rx=0 tx=0).stop 2023-10-25T16:13:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 shutdown_connections 2023-10-25T16:13:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9a0066470 0x7fb9a0068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9c015eba0 0x7fb9c014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c00cdb10 0x7fb9c0153440 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 --2- 172.21.15.177:0/2845871747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9c00b2120 0x7fb9c00c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 >> 172.21.15.177:0/2845871747 conn(0x7fb9c009a5c0 msgr2=0x7fb9c00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 shutdown_connections 2023-10-25T16:13:59.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.816+0000 7fb9c4e00640 1 -- 172.21.15.177:0/2845871747 wait complete. 2023-10-25T16:13:59.833 INFO:tasks.ceph.mds.d.smithi184.stderr: -3212> 2023-10-25T16:13:12.246+0000 7faa1f25d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:13:59.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:13:59.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:13:59.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:13:59.894 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:13:59.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/1323659311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c13d8f0 msgr2=0x7fe82c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 --2- 172.21.15.177:0/1323659311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c13d8f0 0x7fe82c0af5d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe81c005fd0 tx=0x7fe81c01c720 comp rx=0 tx=0).stop 2023-10-25T16:13:59.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/1323659311 shutdown_connections 2023-10-25T16:13:59.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 --2- 172.21.15.177:0/1323659311 >> v2:172.21.15.184:3300/0 conn(0x7fe82c15c3a0 0x7fe82c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 --2- 172.21.15.177:0/1323659311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c13d8f0 0x7fe82c0af5d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/1323659311 >> 172.21.15.177:0/1323659311 conn(0x7fe82c0b2450 msgr2=0x7fe82c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:13:59.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/1323659311 shutdown_connections 2023-10-25T16:13:59.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/1323659311 wait complete. 2023-10-25T16:13:59.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 Processor -- start 2023-10-25T16:13:59.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- start start 2023-10-25T16:13:59.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82c13d8f0 0x7fe82c13a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c15b710 0x7fe82c1405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 0x7fe82c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c140160 con 0x7fe82c15c3a0 2023-10-25T16:13:59.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c158280 con 0x7fe82c13d8f0 2023-10-25T16:13:59.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c158520 con 0x7fe82c15b710 2023-10-25T16:13:59.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 0x7fe82c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 0x7fe82c0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41076/0 (socket says 172.21.15.177:41076) 2023-10-25T16:13:59.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 -- 172.21.15.177:0/782033636 learned_addr learned my addr 172.21.15.177:0/782033636 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:13:59.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe83117f640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82c13d8f0 0x7fe82c13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe83097e640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c15b710 0x7fe82c1405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 -- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c15b710 msgr2=0x7fe82c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c15b710 0x7fe82c1405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 -- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82c13d8f0 msgr2=0x7fe82c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:13:59.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82c13d8f0 0x7fe82c13a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:13:59.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 -- 172.21.15.177:0/782033636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c009450 con 0x7fe82c15c3a0 2023-10-25T16:13:59.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe83097e640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c15b710 0x7fe82c1405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:59.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe83117f640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82c13d8f0 0x7fe82c13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:13:59.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe831980640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 0x7fe82c0cbdd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe82400dac0 tx=0x7fe82400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400be30 con 0x7fe82c15c3a0 2023-10-25T16:13:59.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe824004b30 con 0x7fe82c15c3a0 2023-10-25T16:13:59.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c158800 con 0x7fe82c15c3a0 2023-10-25T16:13:59.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824005020 con 0x7fe82c15c3a0 2023-10-25T16:13:59.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c158ae0 con 0x7fe82c15c3a0 2023-10-25T16:13:59.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.948+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c13ff30 con 0x7fe82c15c3a0 2023-10-25T16:13:59.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.952+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe824005180 con 0x7fe82c15c3a0 2023-10-25T16:13:59.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.952+0000 7fe821ffb640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe810066470 0x7fe810068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:13:59.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.952+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe824084450 con 0x7fe82c15c3a0 2023-10-25T16:13:59.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.952+0000 7fe83117f640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe810066470 0x7fe810068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:13:59.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.952+0000 7fe83117f640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe810066470 0x7fe810068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe82c1f7f00 tx=0x7fe828009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:13:59.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:13:59.956+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe82c13ff30 con 0x7fe82c15c3a0 2023-10-25T16:14:00.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.128+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe82c13ff30 con 0x7fe82c15c3a0 2023-10-25T16:14:00.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.824+0000 7fe821ffb640 1 -- 172.21.15.177:0/782033636 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe82c13ff30 con 0x7fe82c15c3a0 2023-10-25T16:14:00.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe810066470 msgr2=0x7fe810068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:00.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe810066470 0x7fe810068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe82c1f7f00 tx=0x7fe828009040 comp rx=0 tx=0).stop 2023-10-25T16:14:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 msgr2=0x7fe82c0cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 0x7fe82c0cbdd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe82400dac0 tx=0x7fe82400df80 comp rx=0 tx=0).stop 2023-10-25T16:14:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 shutdown_connections 2023-10-25T16:14:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe810066470 0x7fe810068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe82c15c3a0 0x7fe82c0cbdd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe82c15b710 0x7fe82c1405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 --2- 172.21.15.177:0/782033636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe82c13d8f0 0x7fe82c13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 >> 172.21.15.177:0/782033636 conn(0x7fe82c0b2450 msgr2=0x7fe82c0abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 shutdown_connections 2023-10-25T16:14:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:00.828+0000 7fe8333e3640 1 -- 172.21.15.177:0/782033636 wait complete. 2023-10-25T16:14:00.855 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:14:01.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 -- 172.21.15.177:0/587731332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740c9680 msgr2=0x7f6274071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 --2- 172.21.15.177:0/587731332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740c9680 0x7f6274071110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6270009900 tx=0x7f627001c890 comp rx=0 tx=0).stop 2023-10-25T16:14:01.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 -- 172.21.15.177:0/587731332 shutdown_connections 2023-10-25T16:14:01.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 --2- 172.21.15.177:0/587731332 >> v2:172.21.15.184:3300/0 conn(0x7f62740afd90 0x7f62740b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 --2- 172.21.15.177:0/587731332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740c9680 0x7f6274071110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 -- 172.21.15.177:0/587731332 >> 172.21.15.177:0/587731332 conn(0x7f6274069920 msgr2=0x7f6274069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:01.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 -- 172.21.15.177:0/587731332 shutdown_connections 2023-10-25T16:14:01.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.028+0000 7f627b9ef640 1 -- 172.21.15.177:0/587731332 wait complete. 2023-10-25T16:14:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 Processor -- start 2023-10-25T16:14:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- start start 2023-10-25T16:14:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 0x7f627409a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740afd90 0x7f62740aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62740c9680 0x7f62741571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274097f50 con 0x7f627406c3d0 2023-10-25T16:14:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740adf50 con 0x7f62740c9680 2023-10-25T16:14:01.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627409a820 con 0x7f62740afd90 2023-10-25T16:14:01.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 0x7f627409a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 0x7f627409a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51780/0 (socket says 172.21.15.177:51780) 2023-10-25T16:14:01.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 -- 172.21.15.177:0/3503561868 learned_addr learned my addr 172.21.15.177:0/3503561868 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:01.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f6278f8a640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740afd90 0x7f62740aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f6279f8c640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62740c9680 0x7f62741571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 -- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740afd90 msgr2=0x7f62740aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740afd90 0x7f62740aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 -- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62740c9680 msgr2=0x7f62741571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62740c9680 0x7f62741571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 -- 172.21.15.177:0/3503561868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009560 con 0x7f627406c3d0 2023-10-25T16:14:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627978b640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 0x7f627409a2e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6270009850 tx=0x7f6270005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270005030 con 0x7f627406c3d0 2023-10-25T16:14:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6270005280 con 0x7f627406c3d0 2023-10-25T16:14:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62740ad990 con 0x7f627406c3d0 2023-10-25T16:14:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62700046d0 con 0x7f627406c3d0 2023-10-25T16:14:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6274097b70 con 0x7f627406c3d0 2023-10-25T16:14:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274073360 con 0x7f627406c3d0 2023-10-25T16:14:01.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.032+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62700b4070 con 0x7f627406c3d0 2023-10-25T16:14:01.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.036+0000 7f6269ffb640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6258066470 0x7f6258068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.036+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f627011e310 con 0x7f627406c3d0 2023-10-25T16:14:01.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.036+0000 7f6278f8a640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6258066470 0x7f6258068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.036+0000 7f6278f8a640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6258066470 0x7f6258068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f62740af9c0 tx=0x7f6264009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:01.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.040+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62700eb750 con 0x7f627406c3d0 2023-10-25T16:14:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.180+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62740b03c0 con 0x7f627406c3d0 2023-10-25T16:14:01.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.828+0000 7f6269ffb640 1 -- 172.21.15.177:0/3503561868 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f62700eed70 con 0x7f627406c3d0 2023-10-25T16:14:01.832 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:14:01.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.828+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6258066470 msgr2=0x7f6258068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.828+0000 7f627b9ef640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6258066470 0x7f6258068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f62740af9c0 tx=0x7f6264009040 comp rx=0 tx=0).stop 2023-10-25T16:14:01.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.828+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 msgr2=0x7f627409a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.828+0000 7f627b9ef640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 0x7f627409a2e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6270009850 tx=0x7f6270005de0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 shutdown_connections 2023-10-25T16:14:01.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6258066470 0x7f6258068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62740c9680 0x7f62741571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62740afd90 0x7f62740aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 --2- 172.21.15.177:0/3503561868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f627406c3d0 0x7f627409a2e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 >> 172.21.15.177:0/3503561868 conn(0x7f6274069920 msgr2=0x7f6274069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:01.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 shutdown_connections 2023-10-25T16:14:01.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.832+0000 7f627b9ef640 1 -- 172.21.15.177:0/3503561868 wait complete. 2023-10-25T16:14:01.857 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:14:01.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/1129362547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff944003f00 msgr2=0x7ff9440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 --2- 172.21.15.177:0/1129362547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff944003f00 0x7ff9440047d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff95000c260 tx=0x7ff95001f700 comp rx=0 tx=0).stop 2023-10-25T16:14:01.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 -- 172.21.15.177:0/1129362547 reap_dead start 2023-10-25T16:14:01.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/1129362547 shutdown_connections 2023-10-25T16:14:01.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/1129362547 >> 172.21.15.177:0/1129362547 conn(0x7ff95c09a5b0 msgr2=0x7ff95c0d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:01.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/1129362547 shutdown_connections 2023-10-25T16:14:01.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/1129362547 wait complete. 2023-10-25T16:14:01.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 Processor -- start 2023-10-25T16:14:01.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- start start 2023-10-25T16:14:01.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff944003f00 0x7ff95c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff95c14f6c0 0x7ff95c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 0x7ff95c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:01.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0b27b0 con 0x7ff95c0b2c40 2023-10-25T16:14:01.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0cb5f0 con 0x7ff95c14f6c0 2023-10-25T16:14:01.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c0b1ba0 con 0x7ff944003f00 2023-10-25T16:14:01.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 0x7ff95c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 0x7ff95c15dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51798/0 (socket says 172.21.15.177:51798) 2023-10-25T16:14:01.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 -- 172.21.15.177:0/3484214583 learned_addr learned my addr 172.21.15.177:0/3484214583 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:01.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95affd640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff944003f00 0x7ff95c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95a7fc640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff95c14f6c0 0x7ff95c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:01.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 -- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff944003f00 msgr2=0x7ff95c0b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff944003f00 0x7ff95c0b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 -- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff95c14f6c0 msgr2=0x7ff95c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:01.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff95c14f6c0 0x7ff95c0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:01.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 -- 172.21.15.177:0/3484214583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0b1e80 con 0x7ff95c0b2c40 2023-10-25T16:14:01.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff95b7fe640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 0x7ff95c15dce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0b3e20 tx=0x7ff954011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:01.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954004230 con 0x7ff95c0b2c40 2023-10-25T16:14:01.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95c0b2160 con 0x7ff95c0b2c40 2023-10-25T16:14:01.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff954004480 con 0x7ff95c0b2c40 2023-10-25T16:14:02.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95400fa90 con 0x7ff95c0b2c40 2023-10-25T16:14:02.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.988+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95c14fb40 con 0x7ff95c0b2c40 2023-10-25T16:14:02.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.992+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95c073360 con 0x7ff95c0b2c40 2023-10-25T16:14:02.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.992+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff954018070 con 0x7ff95c0b2c40 2023-10-25T16:14:02.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.992+0000 7ff9437fe640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff948066470 0x7ff948068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:02.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.992+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7ff954084aa0 con 0x7ff95c0b2c40 2023-10-25T16:14:02.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.992+0000 7ff95affd640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff948066470 0x7ff948068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:02.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.992+0000 7ff95affd640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff948066470 0x7ff948068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009e30 tx=0x7ff94c009500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:02.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:01.996+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff954051ef0 con 0x7ff95c0b2c40 2023-10-25T16:14:02.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.136+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff95c0ce8d0 con 0x7ff95c0b2c40 2023-10-25T16:14:02.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.828+0000 7ff9437fe640 1 -- 172.21.15.177:0/3484214583 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff954055510 con 0x7ff95c0b2c40 2023-10-25T16:14:02.835 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:14:02.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff948066470 msgr2=0x7ff948068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:02.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff948066470 0x7ff948068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009e30 tx=0x7ff94c009500 comp rx=0 tx=0).stop 2023-10-25T16:14:02.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 msgr2=0x7ff95c15dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:02.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 0x7ff95c15dce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0b3e20 tx=0x7ff954011b10 comp rx=0 tx=0).stop 2023-10-25T16:14:02.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 shutdown_connections 2023-10-25T16:14:02.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff948066470 0x7ff948068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff95c0b2c40 0x7ff95c15dce0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff95c14f6c0 0x7ff95c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 --2- 172.21.15.177:0/3484214583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff944003f00 0x7ff95c0b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.832+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 >> 172.21.15.177:0/3484214583 conn(0x7ff95c09a5b0 msgr2=0x7ff95c15a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.836+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 shutdown_connections 2023-10-25T16:14:02.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:02.836+0000 7ff9614c5640 1 -- 172.21.15.177:0/3484214583 wait complete. 2023-10-25T16:14:02.861 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:14:02.861 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:14:02.862 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:14:02.862 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:02.862 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:14:02.863 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:14:02.863 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:14:02.863 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:02.863 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:14:02.864 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:14:02.864 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:14:02.864 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:02.865 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:14:02.865 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:14:02.865 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:14:02.865 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:02.874 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:14:02.874 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:14:02.877 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:14:02.877 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:14:02.878 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:14:02.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:14:02.882 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:14:02.882 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:14:02.921 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:14:02.922 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:02.923 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:14:02.924 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:02.927 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:14:02.928 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:02.929 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:14:02.929 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:02.930 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:14:02.985 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:14:02.995 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:14:02.996 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:14:02.997 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:14:03.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/165937127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 msgr2=0x7f56080ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:03.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 --2- 172.21.15.177:0/165937127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080ae700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5600009bc0 tx=0x7f560001cac0 comp rx=0 tx=0).stop 2023-10-25T16:14:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/165937127 shutdown_connections 2023-10-25T16:14:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 --2- 172.21.15.177:0/165937127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56080cdcf0 0x7f56080ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 --2- 172.21.15.177:0/165937127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080ae700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/165937127 >> 172.21.15.177:0/165937127 conn(0x7f5608097a40 msgr2=0x7f5608097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/165937127 shutdown_connections 2023-10-25T16:14:03.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/165937127 wait complete. 2023-10-25T16:14:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 Processor -- start 2023-10-25T16:14:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- start start 2023-10-25T16:14:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56080afd80 0x7f56080b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56080cdcf0 0x7f56080b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c73d0 con 0x7f5608159210 2023-10-25T16:14:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c76b0 con 0x7f56080cdcf0 2023-10-25T16:14:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c7990 con 0x7f56080afd80 2023-10-25T16:14:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51844/0 (socket says 172.21.15.177:51844) 2023-10-25T16:14:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 -- 172.21.15.177:0/4168259617 learned_addr learned my addr 172.21.15.177:0/4168259617 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f56077fe640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56080cdcf0 0x7f56080b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f5607fff640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56080afd80 0x7f56080b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 -- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56080afd80 msgr2=0x7f56080b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:03.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56080afd80 0x7f56080b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:03.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 -- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56080cdcf0 msgr2=0x7f56080b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:03.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56080cdcf0 0x7f56080b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 -- 172.21.15.177:0/4168259617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600009820 con 0x7f5608159210 2023-10-25T16:14:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560cde9640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080c63a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f55f800d750 tx=0x7f55f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8009c30 con 0x7f5608159210 2023-10-25T16:14:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f55f8009e80 con 0x7f5608159210 2023-10-25T16:14:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5608159800 con 0x7f5608159210 2023-10-25T16:14:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8005280 con 0x7f5608159210 2023-10-25T16:14:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56080c68e0 con 0x7f5608159210 2023-10-25T16:14:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.048+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56080c7b50 con 0x7f5608159210 2023-10-25T16:14:03.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.052+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f55f80053e0 con 0x7f5608159210 2023-10-25T16:14:03.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.052+0000 7f5604ff9640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f55f4066470 0x7f55f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:03.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.052+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f55f8083c70 con 0x7f5608159210 2023-10-25T16:14:03.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.052+0000 7f5607fff640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f55f4066470 0x7f55f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:03.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.052+0000 7f5607fff640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f55f4066470 0x7f55f4068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f56000af000 tx=0x7f560001b300 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:03.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.056+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55f8051480 con 0x7f5608159210 2023-10-25T16:14:03.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:03.220+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f56080c7510 con 0x7f5608159210 2023-10-25T16:14:04.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.584+0000 7f5604ff9640 1 -- 172.21.15.177:0/4168259617 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f56080c7510 con 0x7f5608159210 2023-10-25T16:14:04.590 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:14:04.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f55f4066470 msgr2=0x7f55f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:04.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f55f4066470 0x7f55f4068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f56000af000 tx=0x7f560001b300 comp rx=0 tx=0).stop 2023-10-25T16:14:04.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 msgr2=0x7f56080c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:04.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080c63a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f55f800d750 tx=0x7f55f800dc10 comp rx=0 tx=0).stop 2023-10-25T16:14:04.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 shutdown_connections 2023-10-25T16:14:04.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f55f4066470 0x7f55f4068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5608159210 0x7f56080c63a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56080cdcf0 0x7f56080b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 --2- 172.21.15.177:0/4168259617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56080afd80 0x7f56080b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 >> 172.21.15.177:0/4168259617 conn(0x7f5608097a40 msgr2=0x7f5608097e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:04.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 shutdown_connections 2023-10-25T16:14:04.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.588+0000 7f560e84c640 1 -- 172.21.15.177:0/4168259617 wait complete. 2023-10-25T16:14:04.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:14:04.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- 172.21.15.177:0/1132815068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4013d8f0 msgr2=0x7f6b400af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:04.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 --2- 172.21.15.177:0/1132815068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4013d8f0 0x7f6b400af5d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009950 tx=0x7f6b3401c8a0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- 172.21.15.177:0/1132815068 shutdown_connections 2023-10-25T16:14:04.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 --2- 172.21.15.177:0/1132815068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b4015c3a0 0x7f6b4015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 --2- 172.21.15.177:0/1132815068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4013d8f0 0x7f6b400af5d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- 172.21.15.177:0/1132815068 >> 172.21.15.177:0/1132815068 conn(0x7f6b400b2450 msgr2=0x7f6b400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:04.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- 172.21.15.177:0/1132815068 shutdown_connections 2023-10-25T16:14:04.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- 172.21.15.177:0/1132815068 wait complete. 2023-10-25T16:14:04.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 Processor -- start 2023-10-25T16:14:04.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- start start 2023-10-25T16:14:04.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 0x7f6b40151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:04.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b4015b710 0x7f6b400aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:04.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4015c3a0 0x7f6b400cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:04.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4015a170 con 0x7f6b4013d8f0 2023-10-25T16:14:04.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4013b3f0 con 0x7f6b4015c3a0 2023-10-25T16:14:04.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b449e0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b401594f0 con 0x7f6b4015b710 2023-10-25T16:14:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b3e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 0x7f6b40151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:04.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b3e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 0x7f6b40151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51852/0 (socket says 172.21.15.177:51852) 2023-10-25T16:14:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b3e59c640 1 -- 172.21.15.177:0/4005172895 learned_addr learned my addr 172.21.15.177:0/4005172895 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b3ed9d640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4015c3a0 0x7f6b400cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:04.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.740+0000 7f6b3dd9b640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b4015b710 0x7f6b400aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:04.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3e59c640 1 -- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b4015b710 msgr2=0x7f6b400aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:04.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3e59c640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b4015b710 0x7f6b400aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3e59c640 1 -- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4015c3a0 msgr2=0x7f6b400cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:04.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3e59c640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4015c3a0 0x7f6b400cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:04.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3e59c640 1 -- 172.21.15.177:0/4005172895 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009500 con 0x7f6b4013d8f0 2023-10-25T16:14:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3e59c640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 0x7f6b40151c20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c500 tx=0x7f6b3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30005220 con 0x7f6b4013d8f0 2023-10-25T16:14:04.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b30005470 con 0x7f6b4013d8f0 2023-10-25T16:14:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b401597d0 con 0x7f6b4013d8f0 2023-10-25T16:14:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30007290 con 0x7f6b4013d8f0 2023-10-25T16:14:04.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b40159d90 con 0x7f6b4013d8f0 2023-10-25T16:14:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4015a2b0 con 0x7f6b4013d8f0 2023-10-25T16:14:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b300073f0 con 0x7f6b4013d8f0 2023-10-25T16:14:04.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b2effd640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b20066470 0x7f6b20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b300834d0 con 0x7f6b4013d8f0 2023-10-25T16:14:04.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3dd9b640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b20066470 0x7f6b20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:04.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.744+0000 7f6b3dd9b640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b20066470 0x7f6b20068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b340af000 tx=0x7f6b3401b0e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:04.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.748+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b30050d30 con 0x7f6b4013d8f0 2023-10-25T16:14:04.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.952+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6b4015a2b0 con 0x7f6b4013d8f0 2023-10-25T16:14:04.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.952+0000 7f6b2effd640 1 -- 172.21.15.177:0/4005172895 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6b4015a2b0 con 0x7f6b4013d8f0 2023-10-25T16:14:04.958 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:04.958 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:04.958 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:14:04.959 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.959 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:14:04.959 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:14:04.959 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.960 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.960 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:04.960 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:04.960 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.960 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.961 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:14:04.961 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:14:04.962 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.962 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.962 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:04.962 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:04.963 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.963 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.963 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:14:04.964 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:14:04.964 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.964 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.964 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:04.965 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:04.965 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.965 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.966 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:14:04.966 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:14:04.966 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.966 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.966 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:04.967 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:04.967 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.967 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.968 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:14:04.968 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:14:04.968 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.969 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.969 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.969 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.970 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:14:04.970 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:14:04.970 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.971 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.971 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.971 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.971 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.972 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:14:04.972 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:14:04.972 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.973 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.973 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.973 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.973 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.974 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:14:04.974 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:14:04.974 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.975 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.975 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.975 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.975 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.976 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:14:04.976 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:14:04.976 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.977 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.977 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.977 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.977 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.978 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:14:04.978 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:14:04.979 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.979 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.979 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.979 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.980 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.980 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:14:04.980 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:14:04.981 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.981 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.981 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.981 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.982 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.982 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:14:04.983 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:14:04.983 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.983 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:04.983 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:04.983 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.984 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.984 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:14:04.984 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:14:04.985 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.985 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.985 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:04.985 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:04.985 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:04.986 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.986 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:14:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:14:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.987 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:14:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:14:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.989 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:14:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:14:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.991 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:04.992 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:14:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:14:04.993 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:14:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:04.994 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-mds", 2023-10-25T16:14:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB/Pjll5kvrMBAAxFQEYWlYjDrdLQoxGnSGCw==", 2023-10-25T16:14:04.995 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-mds" 2023-10-25T16:14:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.996 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-mgr", 2023-10-25T16:14:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB/PjllOWXrMBAAwBojlmtoRhFYhZCVhKxu2Q==", 2023-10-25T16:14:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-25T16:14:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-osd", 2023-10-25T16:14:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB/PjllQnzrMBAA3QGGz98TxtpX/cGNPlcYnw==", 2023-10-25T16:14:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-osd" 2023-10-25T16:14:04.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rbd", 2023-10-25T16:14:04.999 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB/PjllWpLrMBAAuCw4gjNuboRBzWvawYaT6Q==", 2023-10-25T16:14:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-25T16:14:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:05.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-25T16:14:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB/PjllmKjrMBAAVCm9U2SWzZeusm9X0GnyPw==", 2023-10-25T16:14:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:05.001 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-25T16:14:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:05.002 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.bootstrap-rgw", 2023-10-25T16:14:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB/PjllzL/rMBAAyopuQpyABRcEbD4NdEgWbw==", 2023-10-25T16:14:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-25T16:14:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:05.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:14:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:14:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:05.004 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:14:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:14:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:05.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:14:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:14:05.006 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:14:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:14:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:05.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:05.008 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:14:05.008 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:05.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b20066470 msgr2=0x7f6b20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b20066470 0x7f6b20068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b340af000 tx=0x7f6b3401b0e0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 msgr2=0x7f6b40151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 0x7f6b40151c20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c500 tx=0x7f6b3000c9c0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 shutdown_connections 2023-10-25T16:14:05.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b20066470 0x7f6b20068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b4015c3a0 0x7f6b400cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b4015b710 0x7f6b400aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 --2- 172.21.15.177:0/4005172895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b4013d8f0 0x7f6b40151c20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 >> 172.21.15.177:0/4005172895 conn(0x7f6b400b2450 msgr2=0x7f6b40140ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 shutdown_connections 2023-10-25T16:14:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:04.956+0000 7f6b449e0640 1 -- 172.21.15.177:0/4005172895 wait complete. 2023-10-25T16:14:05.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-25T16:14:05.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 -- 172.21.15.177:0/2707565500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 msgr2=0x7f59200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 --2- 172.21.15.177:0/2707565500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f59200047d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f592c009b50 tx=0x7f592c01d1f0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f59377fe640 1 -- 172.21.15.177:0/2707565500 reap_dead start 2023-10-25T16:14:05.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 -- 172.21.15.177:0/2707565500 shutdown_connections 2023-10-25T16:14:05.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 -- 172.21.15.177:0/2707565500 >> 172.21.15.177:0/2707565500 conn(0x7f59380b2450 msgr2=0x7f59380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:05.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 -- 172.21.15.177:0/2707565500 shutdown_connections 2023-10-25T16:14:05.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 -- 172.21.15.177:0/2707565500 wait complete. 2023-10-25T16:14:05.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 Processor -- start 2023-10-25T16:14:05.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.132+0000 7f593d289640 1 -- start start 2023-10-25T16:14:05.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f5938070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59381f6b30 0x7f5938157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59380aeb80 0x7f59380af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59380af540 con 0x7f5920003f00 2023-10-25T16:14:05.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593815b710 con 0x7f59380aeb80 2023-10-25T16:14:05.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59381f6090 con 0x7f59381f6b30 2023-10-25T16:14:05.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f5938070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f5938070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51864/0 (socket says 172.21.15.177:51864) 2023-10-25T16:14:05.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 -- 172.21.15.177:0/1936968163 learned_addr learned my addr 172.21.15.177:0/1936968163 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:05.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f59377fe640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59380aeb80 0x7f59380af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f59367fc640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59381f6b30 0x7f5938157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 -- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59381f6b30 msgr2=0x7f5938157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59381f6b30 0x7f5938157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 -- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59380aeb80 msgr2=0x7f59380af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59380aeb80 0x7f59380af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 -- 172.21.15.177:0/1936968163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593815b430 con 0x7f5920003f00 2023-10-25T16:14:05.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f5936ffd640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f5938070ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5928010990 tx=0x7f5928010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:05.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928009730 con 0x7f5920003f00 2023-10-25T16:14:05.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f592800ed80 con 0x7f5920003f00 2023-10-25T16:14:05.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59381f6330 con 0x7f5920003f00 2023-10-25T16:14:05.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928005280 con 0x7f5920003f00 2023-10-25T16:14:05.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593815b050 con 0x7f5920003f00 2023-10-25T16:14:05.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59381f5ef0 con 0x7f5920003f00 2023-10-25T16:14:05.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59280053e0 con 0x7f5920003f00 2023-10-25T16:14:05.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f591f7fe640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59240664a0 0x7f5924068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5928016070 con 0x7f5920003f00 2023-10-25T16:14:05.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.136+0000 7f59367fc640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59240664a0 0x7f5924068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.140+0000 7f59367fc640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59240664a0 0x7f5924068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f592c0ad000 tx=0x7f592c0af040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:05.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.140+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59381f5ef0 con 0x7f5920003f00 2023-10-25T16:14:05.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.344+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f59381f5ef0 con 0x7f5920003f00 2023-10-25T16:14:05.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.348+0000 7f591f7fe640 1 -- 172.21.15.177:0/1936968163 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v18) v1 ==== 90+0+0 (secure 0 0 0) 0x7f59381f5ef0 con 0x7f5920003f00 2023-10-25T16:14:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59240664a0 msgr2=0x7f5924068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59240664a0 0x7f5924068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f592c0ad000 tx=0x7f592c0af040 comp rx=0 tx=0).stop 2023-10-25T16:14:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 msgr2=0x7f5938070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f5938070ad0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5928010990 tx=0x7f5928010e50 comp rx=0 tx=0).stop 2023-10-25T16:14:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 shutdown_connections 2023-10-25T16:14:05.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59240664a0 0x7f5924068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59380aeb80 0x7f59380af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59381f6b30 0x7f5938157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 --2- 172.21.15.177:0/1936968163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5920003f00 0x7f5938070ad0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 >> 172.21.15.177:0/1936968163 conn(0x7f59380b2450 msgr2=0x7f5938162850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:05.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 shutdown_connections 2023-10-25T16:14:05.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.352+0000 7f593d289640 1 -- 172.21.15.177:0/1936968163 wait complete. 2023-10-25T16:14:05.373 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-25T16:14:05.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- 172.21.15.177:0/2812196524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c15d460 msgr2=0x7fef6c06d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2812196524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c15d460 0x7fef6c06d800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fef54009bc0 tx=0x7fef5401cb80 comp rx=0 tx=0).stop 2023-10-25T16:14:05.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- 172.21.15.177:0/2812196524 shutdown_connections 2023-10-25T16:14:05.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2812196524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6c0accf0 0x7fef6c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2812196524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c15d460 0x7fef6c06d800 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- 172.21.15.177:0/2812196524 >> 172.21.15.177:0/2812196524 conn(0x7fef6c0af3f0 msgr2=0x7fef6c0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- 172.21.15.177:0/2812196524 shutdown_connections 2023-10-25T16:14:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- 172.21.15.177:0/2812196524 wait complete. 2023-10-25T16:14:05.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 Processor -- start 2023-10-25T16:14:05.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- start start 2023-10-25T16:14:05.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6c0accf0 0x7fef6c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 0x7fef6c13f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6c15d460 0x7fef6c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c13fb70 con 0x7fef6c156e60 2023-10-25T16:14:05.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c155a10 con 0x7fef6c15d460 2023-10-25T16:14:05.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef72ae7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c156250 con 0x7fef6c0accf0 2023-10-25T16:14:05.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 0x7fef6c13f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 0x7fef6c13f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51886/0 (socket says 172.21.15.177:51886) 2023-10-25T16:14:05.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 -- 172.21.15.177:0/2751171260 learned_addr learned my addr 172.21.15.177:0/2751171260 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:05.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 -- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6c0accf0 msgr2=0x7fef6c152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef70883640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6c0accf0 0x7fef6c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef71084640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6c15d460 0x7fef6c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6c0accf0 0x7fef6c152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 -- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6c15d460 msgr2=0x7fef6c153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6c15d460 0x7fef6c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 -- 172.21.15.177:0/2751171260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009820 con 0x7fef6c156e60 2023-10-25T16:14:05.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.492+0000 7fef6bfff640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 0x7fef6c13f630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fef54000f90 tx=0x7fef540a5af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:05.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540bc070 con 0x7fef6c156e60 2023-10-25T16:14:05.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef54005040 con 0x7fef6c156e60 2023-10-25T16:14:05.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c152d20 con 0x7fef6c156e60 2023-10-25T16:14:05.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540053d0 con 0x7fef6c156e60 2023-10-25T16:14:05.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c155f70 con 0x7fef6c156e60 2023-10-25T16:14:05.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c04daf0 con 0x7fef6c156e60 2023-10-25T16:14:05.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fef540b4040 con 0x7fef6c156e60 2023-10-25T16:14:05.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef697fa640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef4c066470 0x7fef4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fef5411e380 con 0x7fef6c156e60 2023-10-25T16:14:05.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef70883640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef4c066470 0x7fef4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.496+0000 7fef70883640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef4c066470 0x7fef4c068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef640015e0 tx=0x7fef64009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:05.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.500+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef540ebbe0 con 0x7fef6c156e60 2023-10-25T16:14:05.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.696+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fef6c0cada0 con 0x7fef6c156e60 2023-10-25T16:14:05.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef697fa640 1 -- 172.21.15.177:0/2751171260 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v19) v1 ==== 90+0+0 (secure 0 0 0) 0x7fef540b2020 con 0x7fef6c156e60 2023-10-25T16:14:05.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef4c066470 msgr2=0x7fef4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef4c066470 0x7fef4c068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef640015e0 tx=0x7fef64009040 comp rx=0 tx=0).stop 2023-10-25T16:14:05.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 msgr2=0x7fef6c13f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 0x7fef6c13f630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fef54000f90 tx=0x7fef540a5af0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 shutdown_connections 2023-10-25T16:14:05.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef4c066470 0x7fef4c068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef6c15d460 0x7fef6c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef6c156e60 0x7fef6c13f630 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 --2- 172.21.15.177:0/2751171260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef6c0accf0 0x7fef6c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 >> 172.21.15.177:0/2751171260 conn(0x7fef6c0af3f0 msgr2=0x7fef6c0cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:05.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 shutdown_connections 2023-10-25T16:14:05.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.700+0000 7fef72ae7640 1 -- 172.21.15.177:0/2751171260 wait complete. 2023-10-25T16:14:05.721 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-25T16:14:05.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 -- 172.21.15.177:0/2019086042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 msgr2=0x7f42e00af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2019086042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e00af5d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f42e00b0f60 tx=0x7f42dc01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 -- 172.21.15.177:0/2019086042 shutdown_connections 2023-10-25T16:14:05.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2019086042 >> v2:172.21.15.184:3300/0 conn(0x7f42e006c160 0x7f42e00cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2019086042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e00af5d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 -- 172.21.15.177:0/2019086042 >> 172.21.15.177:0/2019086042 conn(0x7f42e00b2450 msgr2=0x7f42e00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:05.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 -- 172.21.15.177:0/2019086042 shutdown_connections 2023-10-25T16:14:05.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 -- 172.21.15.177:0/2019086042 wait complete. 2023-10-25T16:14:05.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 Processor -- start 2023-10-25T16:14:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.832+0000 7f42e78b0640 1 -- start start 2023-10-25T16:14:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e006c160 0x7f42e0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42e006f570 0x7f42e013ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e013fb10 con 0x7f42e0140cf0 2023-10-25T16:14:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0137430 con 0x7f42e006c160 2023-10-25T16:14:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e015b490 con 0x7f42e006f570 2023-10-25T16:14:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e013f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51894/0 (socket says 172.21.15.177:51894) 2023-10-25T16:14:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 -- 172.21.15.177:0/2084829872 learned_addr learned my addr 172.21.15.177:0/2084829872 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e564c640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e006c160 0x7f42e0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e4e4b640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42e006f570 0x7f42e013ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 -- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42e006f570 msgr2=0x7f42e013ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42e006f570 0x7f42e013ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 -- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e006c160 msgr2=0x7f42e0155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e006c160 0x7f42e0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 -- 172.21.15.177:0/2084829872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009560 con 0x7f42e0140cf0 2023-10-25T16:14:05.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e5e4d640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e013f490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f42d800cad0 tx=0x7f42d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800ae20 con 0x7f42e0140cf0 2023-10-25T16:14:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f42d80039a0 con 0x7f42e0140cf0 2023-10-25T16:14:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e0136b00 con 0x7f42e0140cf0 2023-10-25T16:14:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d8003dd0 con 0x7f42e0140cf0 2023-10-25T16:14:05.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01370c0 con 0x7f42e0140cf0 2023-10-25T16:14:05.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e01375c0 con 0x7f42e0140cf0 2023-10-25T16:14:05.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f42d8004030 con 0x7f42e0140cf0 2023-10-25T16:14:05.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42d5ffb640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42c40664a0 0x7f42c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:05.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42d8084290 con 0x7f42e0140cf0 2023-10-25T16:14:05.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.836+0000 7f42e564c640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42c40664a0 0x7f42c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:05.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.840+0000 7f42e564c640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42c40664a0 0x7f42c4068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0ae000 tx=0x7f42dc01b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:05.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:05.840+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42d8051af0 con 0x7f42e0140cf0 2023-10-25T16:14:06.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.036+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f42e004daf0 con 0x7f42e0140cf0 2023-10-25T16:14:06.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.036+0000 7f42d5ffb640 1 -- 172.21.15.177:0/2084829872 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v20) v1 ==== 90+0+0 (secure 0 0 0) 0x7f42d8055110 con 0x7f42e0140cf0 2023-10-25T16:14:06.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42c40664a0 msgr2=0x7f42c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42c40664a0 0x7f42c4068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0ae000 tx=0x7f42dc01b010 comp rx=0 tx=0).stop 2023-10-25T16:14:06.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 msgr2=0x7f42e013f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e013f490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f42d800cad0 tx=0x7f42d800cf90 comp rx=0 tx=0).stop 2023-10-25T16:14:06.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 shutdown_connections 2023-10-25T16:14:06.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42c40664a0 0x7f42c4068960 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42e0140cf0 0x7f42e013f490 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42e006f570 0x7f42e013ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 --2- 172.21.15.177:0/2084829872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e006c160 0x7f42e0155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 >> 172.21.15.177:0/2084829872 conn(0x7f42e00b2450 msgr2=0x7f42e00afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:06.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 shutdown_connections 2023-10-25T16:14:06.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.040+0000 7f42e78b0640 1 -- 172.21.15.177:0/2084829872 wait complete. 2023-10-25T16:14:06.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-25T16:14:06.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- 172.21.15.177:0/705752500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c0af5d0 msgr2=0x7f233c13b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 --2- 172.21.15.177:0/705752500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c0af5d0 0x7f233c13b860 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f232c009840 tx=0x7f232c01c770 comp rx=0 tx=0).stop 2023-10-25T16:14:06.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- 172.21.15.177:0/705752500 shutdown_connections 2023-10-25T16:14:06.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 --2- 172.21.15.177:0/705752500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c0af5d0 0x7f233c13b860 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 --2- 172.21.15.177:0/705752500 >> v2:172.21.15.184:3300/0 conn(0x7f233c15b710 0x7f233c13d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- 172.21.15.177:0/705752500 >> 172.21.15.177:0/705752500 conn(0x7f233c0b2450 msgr2=0x7f233c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:06.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- 172.21.15.177:0/705752500 shutdown_connections 2023-10-25T16:14:06.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- 172.21.15.177:0/705752500 wait complete. 2023-10-25T16:14:06.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 Processor -- start 2023-10-25T16:14:06.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- start start 2023-10-25T16:14:06.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f233c0af5d0 0x7f233c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f233c13bda0 0x7f233c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 0x7f233c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0ac340 con 0x7f233c15b710 2023-10-25T16:14:06.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0a6650 con 0x7f233c13bda0 2023-10-25T16:14:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f23408b3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c1574d0 con 0x7f233c0af5d0 2023-10-25T16:14:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 0x7f233c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 0x7f233c157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51914/0 (socket says 172.21.15.177:51914) 2023-10-25T16:14:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 -- 172.21.15.177:0/3380087031 learned_addr learned my addr 172.21.15.177:0/3380087031 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:06.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f2339d9b640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f233c13bda0 0x7f233c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233a59c640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f233c0af5d0 0x7f233c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 -- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f233c0af5d0 msgr2=0x7f233c156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f233c0af5d0 0x7f233c156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 -- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f233c13bda0 msgr2=0x7f233c1576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f233c13bda0 0x7f233c1576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.180+0000 7f233ad9d640 1 -- 172.21.15.177:0/3380087031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009450 con 0x7f233c15b710 2023-10-25T16:14:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f233ad9d640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 0x7f233c157c10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f233400c780 tx=0x7f233400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334003db0 con 0x7f233c15b710 2023-10-25T16:14:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f233400ce90 con 0x7f233c15b710 2023-10-25T16:14:06.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340052d0 con 0x7f233c15b710 2023-10-25T16:14:06.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0ab7c0 con 0x7f233c15b710 2023-10-25T16:14:06.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0abd80 con 0x7f233c15b710 2023-10-25T16:14:06.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c0a6a00 con 0x7f233c15b710 2023-10-25T16:14:06.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2334005430 con 0x7f233c15b710 2023-10-25T16:14:06.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f2332ffd640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f231c066470 0x7f231c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2334083b10 con 0x7f233c15b710 2023-10-25T16:14:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f233a59c640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f231c066470 0x7f231c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.184+0000 7f233a59c640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f231c066470 0x7f231c068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f23240058d0 tx=0x7f2324005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:06.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.188+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f233c0a6a00 con 0x7f233c15b710 2023-10-25T16:14:06.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.403+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f233c0a6a00 con 0x7f233c15b710 2023-10-25T16:14:06.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f2332ffd640 1 -- 172.21.15.177:0/3380087031 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v21) v1 ==== 90+0+0 (secure 0 0 0) 0x7f233c0a6a00 con 0x7f233c15b710 2023-10-25T16:14:06.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f231c066470 msgr2=0x7f231c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f231c066470 0x7f231c068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f23240058d0 tx=0x7f2324005860 comp rx=0 tx=0).stop 2023-10-25T16:14:06.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 msgr2=0x7f233c157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 0x7f233c157c10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f233400c780 tx=0x7f233400cc40 comp rx=0 tx=0).stop 2023-10-25T16:14:06.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 shutdown_connections 2023-10-25T16:14:06.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f231c066470 0x7f231c068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f233c15b710 0x7f233c157c10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f233c13bda0 0x7f233c1576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 --2- 172.21.15.177:0/3380087031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f233c0af5d0 0x7f233c156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 >> 172.21.15.177:0/3380087031 conn(0x7f233c0b2450 msgr2=0x7f233c06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:06.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 shutdown_connections 2023-10-25T16:14:06.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.407+0000 7f23408b3640 1 -- 172.21.15.177:0/3380087031 wait complete. 2023-10-25T16:14:06.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-25T16:14:06.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- 172.21.15.177:0/4086734714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 msgr2=0x7f58980cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4086734714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f58980cc620 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f589806c4f0 tx=0x7f589001c790 comp rx=0 tx=0).stop 2023-10-25T16:14:06.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- 172.21.15.177:0/4086734714 shutdown_connections 2023-10-25T16:14:06.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4086734714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5898070d30 0x7f58980b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4086734714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f58980cc620 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- 172.21.15.177:0/4086734714 >> 172.21.15.177:0/4086734714 conn(0x7f58980cdf10 msgr2=0x7f58980ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:06.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- 172.21.15.177:0/4086734714 shutdown_connections 2023-10-25T16:14:06.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- 172.21.15.177:0/4086734714 wait complete. 2023-10-25T16:14:06.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 Processor -- start 2023-10-25T16:14:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- start start 2023-10-25T16:14:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5898070d30 0x7f5898134920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58980715f0 0x7f589806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f589806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898134e60 con 0x7f58981581a0 2023-10-25T16:14:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898158d90 con 0x7f58980715f0 2023-10-25T16:14:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f58a03d4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5898158fa0 con 0x7f5898070d30 2023-10-25T16:14:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f589e971640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f589806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f589e971640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f589806d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51936/0 (socket says 172.21.15.177:51936) 2023-10-25T16:14:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.551+0000 7f589e971640 1 -- 172.21.15.177:0/4264770296 learned_addr learned my addr 172.21.15.177:0/4264770296 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e170640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5898070d30 0x7f5898134920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589d96f640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58980715f0 0x7f589806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e971640 1 -- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5898070d30 msgr2=0x7f5898134920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e971640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5898070d30 0x7f5898134920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e971640 1 -- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58980715f0 msgr2=0x7f589806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e971640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58980715f0 0x7f589806d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e971640 1 -- 172.21.15.177:0/4264770296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009560 con 0x7f58981581a0 2023-10-25T16:14:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589d96f640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58980715f0 0x7f589806d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e971640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f589806d660 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f588800cce0 tx=0x7f588800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800f450 con 0x7f58981581a0 2023-10-25T16:14:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f588800f6a0 con 0x7f58981581a0 2023-10-25T16:14:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898159280 con 0x7f58981581a0 2023-10-25T16:14:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800fab0 con 0x7f58981581a0 2023-10-25T16:14:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898159840 con 0x7f58981581a0 2023-10-25T16:14:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589804daf0 con 0x7f58981581a0 2023-10-25T16:14:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f588800fc10 con 0x7f58981581a0 2023-10-25T16:14:06.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f5896ffd640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5888084700 con 0x7f58981581a0 2023-10-25T16:14:06.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e170640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.555+0000 7f589e170640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58900af000 tx=0x7f589001afd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:06.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.559+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5888051f80 con 0x7f58981581a0 2023-10-25T16:14:06.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.755+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f58980af670 con 0x7f58981581a0 2023-10-25T16:14:06.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.759+0000 7f5896ffd640 1 -- 172.21.15.177:0/4264770296 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v22) v1 ==== 97+0+0 (secure 0 0 0) 0x7f58880555a0 con 0x7f58981581a0 2023-10-25T16:14:06.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 msgr2=0x7f5884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58900af000 tx=0x7f589001afd0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 msgr2=0x7f589806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f589806d660 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f588800cce0 tx=0x7f588800a620 comp rx=0 tx=0).stop 2023-10-25T16:14:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 shutdown_connections 2023-10-25T16:14:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5884066470 0x7f5884068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58981581a0 0x7f589806d660 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58980715f0 0x7f589806d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 --2- 172.21.15.177:0/4264770296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5898070d30 0x7f5898134920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 >> 172.21.15.177:0/4264770296 conn(0x7f58980cdf10 msgr2=0x7f58980aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 shutdown_connections 2023-10-25T16:14:06.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.763+0000 7f58a03d4640 1 -- 172.21.15.177:0/4264770296 wait complete. 2023-10-25T16:14:06.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-25T16:14:06.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- 172.21.15.177:0/908695873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd864005190 msgr2=0x7fd86400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 --2- 172.21.15.177:0/908695873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd864005190 0x7fd86400b990 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd87806c270 tx=0x7fd87001cc40 comp rx=0 tx=0).stop 2023-10-25T16:14:06.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87e49c640 1 -- 172.21.15.177:0/908695873 reap_dead start 2023-10-25T16:14:06.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- 172.21.15.177:0/908695873 shutdown_connections 2023-10-25T16:14:06.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- 172.21.15.177:0/908695873 >> 172.21.15.177:0/908695873 conn(0x7fd8780b2450 msgr2=0x7fd8780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:06.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- 172.21.15.177:0/908695873 shutdown_connections 2023-10-25T16:14:06.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- 172.21.15.177:0/908695873 wait complete. 2023-10-25T16:14:06.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 Processor -- start 2023-10-25T16:14:06.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- start start 2023-10-25T16:14:06.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 0x7fd8781556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8780af7a0 0x7fd878155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8780ad820 0x7fd8780adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878156120 con 0x7fd878144c40 2023-10-25T16:14:06.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878145020 con 0x7fd8780af7a0 2023-10-25T16:14:06.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87feff640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781523e0 con 0x7fd8780ad820 2023-10-25T16:14:06.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 0x7fd8781556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 0x7fd8781556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51952/0 (socket says 172.21.15.177:51952) 2023-10-25T16:14:06.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 -- 172.21.15.177:0/2828209100 learned_addr learned my addr 172.21.15.177:0/2828209100 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:06.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 -- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8780ad820 msgr2=0x7fd8780adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8780ad820 0x7fd8780adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 -- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8780af7a0 msgr2=0x7fd878155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:06.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8780af7a0 0x7fd878155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:06.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 -- 172.21.15.177:0/2828209100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780acd40 con 0x7fd878144c40 2023-10-25T16:14:06.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.899+0000 7fd87dc9b640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 0x7fd8781556a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd8740018b0 tx=0x7fd874001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:06.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874010890 con 0x7fd878144c40 2023-10-25T16:14:06.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd874010ae0 con 0x7fd878144c40 2023-10-25T16:14:06.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8780ad020 con 0x7fd878144c40 2023-10-25T16:14:06.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874011460 con 0x7fd878144c40 2023-10-25T16:14:06.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780ae1e0 con 0x7fd878144c40 2023-10-25T16:14:06.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87814ff20 con 0x7fd878144c40 2023-10-25T16:14:06.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8740115c0 con 0x7fd878144c40 2023-10-25T16:14:06.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd86e7fc640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd85c0664a0 0x7fd85c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:06.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd874084be0 con 0x7fd878144c40 2023-10-25T16:14:06.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd87d49a640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd85c0664a0 0x7fd85c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:06.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.903+0000 7fd87d49a640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd85c0664a0 0x7fd85c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd868001900 tx=0x7fd868001290 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:06.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:06.907+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8740523b0 con 0x7fd878144c40 2023-10-25T16:14:07.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.107+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd8780ca070 con 0x7fd878144c40 2023-10-25T16:14:07.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.111+0000 7fd86e7fc640 1 -- 172.21.15.177:0/2828209100 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v23) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd8740559d0 con 0x7fd878144c40 2023-10-25T16:14:07.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd85c0664a0 msgr2=0x7fd85c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd85c0664a0 0x7fd85c068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd868001900 tx=0x7fd868001290 comp rx=0 tx=0).stop 2023-10-25T16:14:07.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 msgr2=0x7fd8781556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 0x7fd8781556a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd8740018b0 tx=0x7fd874001d70 comp rx=0 tx=0).stop 2023-10-25T16:14:07.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 shutdown_connections 2023-10-25T16:14:07.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd85c0664a0 0x7fd85c068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8780ad820 0x7fd8780adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8780af7a0 0x7fd878155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 --2- 172.21.15.177:0/2828209100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd878144c40 0x7fd8781556a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 >> 172.21.15.177:0/2828209100 conn(0x7fd8780b2450 msgr2=0x7fd87814f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:07.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 shutdown_connections 2023-10-25T16:14:07.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.115+0000 7fd87feff640 1 -- 172.21.15.177:0/2828209100 wait complete. 2023-10-25T16:14:07.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/1488877165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439406c090 msgr2=0x7f43940cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 --2- 172.21.15.177:0/1488877165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439406c090 0x7f43940cb5c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f438c009bf0 tx=0x7f438c01caf0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/1488877165 shutdown_connections 2023-10-25T16:14:07.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 --2- 172.21.15.177:0/1488877165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f439406c090 0x7f43940cb5c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 --2- 172.21.15.177:0/1488877165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4394140e90 0x7f43940af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/1488877165 >> 172.21.15.177:0/1488877165 conn(0x7f43940b2450 msgr2=0x7f43940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/1488877165 shutdown_connections 2023-10-25T16:14:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/1488877165 wait complete. 2023-10-25T16:14:07.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 Processor -- start 2023-10-25T16:14:07.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- start start 2023-10-25T16:14:07.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f439406c090 0x7f43941f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f439406f570 0x7f439413a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 0x7f439413b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941f2e00 con 0x7f4394140e90 2023-10-25T16:14:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941551b0 con 0x7f439406f570 2023-10-25T16:14:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4394155490 con 0x7f439406c090 2023-10-25T16:14:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 0x7f439413b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 0x7f439413b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51978/0 (socket says 172.21.15.177:51978) 2023-10-25T16:14:07.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 -- 172.21.15.177:0/3510218394 learned_addr learned my addr 172.21.15.177:0/3510218394 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:07.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4392ffd640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f439406f570 0x7f439413a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f43937fe640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f439406c090 0x7f43941f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 -- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f439406c090 msgr2=0x7f43941f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f439406c090 0x7f43941f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 -- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f439406f570 msgr2=0x7f439413a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f439406f570 0x7f439413a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 -- 172.21.15.177:0/3510218394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c009820 con 0x7f4394140e90 2023-10-25T16:14:07.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4392ffd640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f439406f570 0x7f439413a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:07.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4393fff640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 0x7f439413b130 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f438c01b1a0 tx=0x7f438c0a5a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:07.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c0bc070 con 0x7f4394140e90 2023-10-25T16:14:07.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f438c003a70 con 0x7f4394140e90 2023-10-25T16:14:07.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4394155770 con 0x7f4394140e90 2023-10-25T16:14:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c003e60 con 0x7f4394140e90 2023-10-25T16:14:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.251+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394155d30 con 0x7f4394140e90 2023-10-25T16:14:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.255+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4394153fe0 con 0x7f4394140e90 2023-10-25T16:14:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.255+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f438c0b4040 con 0x7f4394140e90 2023-10-25T16:14:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.255+0000 7f438bfff640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4374066470 0x7f4374068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.255+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f438c11e460 con 0x7f4394140e90 2023-10-25T16:14:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.255+0000 7f43937fe640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4374066470 0x7f4374068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.255+0000 7f43937fe640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4374066470 0x7f4374068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.259+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f438c0ebc40 con 0x7f4394140e90 2023-10-25T16:14:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.411+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f439404daf0 con 0x7f4394140e90 2023-10-25T16:14:07.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f438bfff640 1 -- 172.21.15.177:0/3510218394 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f438c0ef260 con 0x7f4394140e90 2023-10-25T16:14:07.420 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:07.420 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:04.584617+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:07.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4374066470 msgr2=0x7f4374068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4374066470 0x7f4374068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f437c006fd0 tx=0x7f437c008040 comp rx=0 tx=0).stop 2023-10-25T16:14:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 msgr2=0x7f439413b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 0x7f439413b130 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f438c01b1a0 tx=0x7f438c0a5a70 comp rx=0 tx=0).stop 2023-10-25T16:14:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 shutdown_connections 2023-10-25T16:14:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4374066470 0x7f4374068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4394140e90 0x7f439413b130 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f439406f570 0x7f439413a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 --2- 172.21.15.177:0/3510218394 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f439406c090 0x7f43941f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 >> 172.21.15.177:0/3510218394 conn(0x7f43940b2450 msgr2=0x7f4394070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 shutdown_connections 2023-10-25T16:14:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.415+0000 7f4399e80640 1 -- 172.21.15.177:0/3510218394 wait complete. 2023-10-25T16:14:07.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:14:07.439 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:14:07.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 -- 172.21.15.177:0/2098920192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0b2bc0 msgr2=0x7f0dec0b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 --2- 172.21.15.177:0/2098920192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0b2bc0 0x7f0dec0b2fa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009840 tx=0x7f0de401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 -- 172.21.15.177:0/2098920192 shutdown_connections 2023-10-25T16:14:07.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 --2- 172.21.15.177:0/2098920192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0cbd10 0x7f0dec06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 --2- 172.21.15.177:0/2098920192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0b2bc0 0x7f0dec0b2fa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 -- 172.21.15.177:0/2098920192 >> 172.21.15.177:0/2098920192 conn(0x7f0dec0af5b0 msgr2=0x7f0dec0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:07.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 -- 172.21.15.177:0/2098920192 shutdown_connections 2023-10-25T16:14:07.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 -- 172.21.15.177:0/2098920192 wait complete. 2023-10-25T16:14:07.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.559+0000 7f0df27d2640 1 Processor -- start 2023-10-25T16:14:07.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- start start 2023-10-25T16:14:07.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0654c0 0x7f0dec141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0b2bc0 0x7f0dec14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 0x7f0dec1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec14ee00 con 0x7f0dec0cbd10 2023-10-25T16:14:07.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec14fd50 con 0x7f0dec0654c0 2023-10-25T16:14:07.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec155080 con 0x7f0dec0b2bc0 2023-10-25T16:14:07.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 0x7f0dec1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 0x7f0dec1546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51986/0 (socket says 172.21.15.177:51986) 2023-10-25T16:14:07.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 -- 172.21.15.177:0/1678727654 learned_addr learned my addr 172.21.15.177:0/1678727654 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:07.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0deb7fe640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0b2bc0 0x7f0dec14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0debfff640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0654c0 0x7f0dec141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 -- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0b2bc0 msgr2=0x7f0dec14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0b2bc0 0x7f0dec14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 -- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0654c0 msgr2=0x7f0dec141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0654c0 0x7f0dec141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 -- 172.21.15.177:0/1678727654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40094a0 con 0x7f0dec0cbd10 2023-10-25T16:14:07.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0deb7fe640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0b2bc0 0x7f0dec14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:07.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df0d6f640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 0x7f0dec1546e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00cb40 tx=0x7f0ddc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:07.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc00aa50 con 0x7f0dec0cbd10 2023-10-25T16:14:07.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ddc00aca0 con 0x7f0dec0cbd10 2023-10-25T16:14:07.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de40094a0 con 0x7f0dec0cbd10 2023-10-25T16:14:07.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc012680 con 0x7f0dec0cbd10 2023-10-25T16:14:07.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec14f010 con 0x7f0dec0cbd10 2023-10-25T16:14:07.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec04daf0 con 0x7f0dec0cbd10 2023-10-25T16:14:07.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ddc01b400 con 0x7f0dec0cbd10 2023-10-25T16:14:07.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0de8ff9640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0dcc066470 0x7f0dcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ddc084190 con 0x7f0dec0cbd10 2023-10-25T16:14:07.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.563+0000 7f0debfff640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0dcc066470 0x7f0dcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.567+0000 7f0debfff640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0dcc066470 0x7f0dcc068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0de40af000 tx=0x7f0de401b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:07.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.567+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ddc0519f0 con 0x7f0dec0cbd10 2023-10-25T16:14:07.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dec150ae0 con 0x7f0dec0cbd10 2023-10-25T16:14:07.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0de8ff9640 1 -- 172.21.15.177:0/1678727654 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ddc055010 con 0x7f0dec0cbd10 2023-10-25T16:14:07.717 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:14:07.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0dcc066470 msgr2=0x7f0dcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0dcc066470 0x7f0dcc068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0de40af000 tx=0x7f0de401b010 comp rx=0 tx=0).stop 2023-10-25T16:14:07.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 msgr2=0x7f0dec1546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 0x7f0dec1546e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00cb40 tx=0x7f0ddc00cc30 comp rx=0 tx=0).stop 2023-10-25T16:14:07.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 shutdown_connections 2023-10-25T16:14:07.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0dcc066470 0x7f0dcc068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dec0cbd10 0x7f0dec1546e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0dec0b2bc0 0x7f0dec14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 --2- 172.21.15.177:0/1678727654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dec0654c0 0x7f0dec141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 >> 172.21.15.177:0/1678727654 conn(0x7f0dec0af5b0 msgr2=0x7f0dec0ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:07.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 shutdown_connections 2023-10-25T16:14:07.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.711+0000 7f0df27d2640 1 -- 172.21.15.177:0/1678727654 wait complete. 2023-10-25T16:14:07.734 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:14:07.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/3216928696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bb8004ac0 msgr2=0x7f3bb8004ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 --2- 172.21.15.177:0/3216928696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bb8004ac0 0x7f3bb8004ec0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c290 tx=0x7f3bbc01cf20 comp rx=0 tx=0).stop 2023-10-25T16:14:07.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd09c0640 1 -- 172.21.15.177:0/3216928696 reap_dead start 2023-10-25T16:14:07.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/3216928696 shutdown_connections 2023-10-25T16:14:07.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/3216928696 >> 172.21.15.177:0/3216928696 conn(0x7f3bcc0b2450 msgr2=0x7f3bcc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:07.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/3216928696 shutdown_connections 2023-10-25T16:14:07.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/3216928696 wait complete. 2023-10-25T16:14:07.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 Processor -- start 2023-10-25T16:14:07.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- start start 2023-10-25T16:14:07.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb8004ac0 0x7f3bcc070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 0x7f3bcc14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bcc1f4da0 0x7f3bcc1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0708d0 con 0x7f3bcc0ab280 2023-10-25T16:14:07.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0aba30 con 0x7f3bb8004ac0 2023-10-25T16:14:07.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0abd10 con 0x7f3bcc1f4da0 2023-10-25T16:14:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 0x7f3bcc14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 0x7f3bcc14b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52006/0 (socket says 172.21.15.177:52006) 2023-10-25T16:14:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 -- 172.21.15.177:0/662106689 learned_addr learned my addr 172.21.15.177:0/662106689 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bcbfff640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb8004ac0 0x7f3bcc070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd09c0640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bcc1f4da0 0x7f3bcc1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 -- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bcc1f4da0 msgr2=0x7f3bcc1f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bcc1f4da0 0x7f3bcc1f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 -- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb8004ac0 msgr2=0x7f3bcc070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb8004ac0 0x7f3bcc070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 -- 172.21.15.177:0/662106689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0cc500 con 0x7f3bcc0ab280 2023-10-25T16:14:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc3fff640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 0x7f3bcc14b960 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400e990 tx=0x7f3bb400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400cbe0 con 0x7f3bcc0ab280 2023-10-25T16:14:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3bb400ce30 con 0x7f3bcc0ab280 2023-10-25T16:14:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc0abff0 con 0x7f3bcc0ab280 2023-10-25T16:14:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb401a6c0 con 0x7f3bcc0ab280 2023-10-25T16:14:07.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.851+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc1f5760 con 0x7f3bcc0ab280 2023-10-25T16:14:07.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.855+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc04daf0 con 0x7f3bcc0ab280 2023-10-25T16:14:07.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.855+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3bb401a820 con 0x7f3bcc0ab280 2023-10-25T16:14:07.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.855+0000 7f3bc97fa640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3bac066470 0x7f3bac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:07.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.855+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3bb4015070 con 0x7f3bcc0ab280 2023-10-25T16:14:07.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.855+0000 7f3bcbfff640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3bac066470 0x7f3bac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:07.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.855+0000 7f3bcbfff640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3bac066470 0x7f3bac068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0ac000 tx=0x7f3bbc0a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:07.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:07.859+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3bb4052770 con 0x7f3bcc0ab280 2023-10-25T16:14:08.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.007+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3bcc0c96c0 con 0x7f3bcc0ab280 2023-10-25T16:14:08.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bc97fa640 1 -- 172.21.15.177:0/662106689 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3bb4055d90 con 0x7f3bcc0ab280 2023-10-25T16:14:08.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:08.016 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:14:08.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:08.016 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:14:08.016 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:14:08.016 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:08.017 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:14:08.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3bac066470 msgr2=0x7f3bac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3bac066470 0x7f3bac068930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0ac000 tx=0x7f3bbc0a7040 comp rx=0 tx=0).stop 2023-10-25T16:14:08.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 msgr2=0x7f3bcc14b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 0x7f3bcc14b960 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400e990 tx=0x7f3bb400ee50 comp rx=0 tx=0).stop 2023-10-25T16:14:08.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 shutdown_connections 2023-10-25T16:14:08.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3bac066470 0x7f3bac068930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bcc1f4da0 0x7f3bcc1f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bcc0ab280 0x7f3bcc14b960 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 --2- 172.21.15.177:0/662106689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb8004ac0 0x7f3bcc070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 >> 172.21.15.177:0/662106689 conn(0x7f3bcc0b2450 msgr2=0x7f3bcc14d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:08.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 shutdown_connections 2023-10-25T16:14:08.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.011+0000 7f3bd2423640 1 -- 172.21.15.177:0/662106689 wait complete. 2023-10-25T16:14:08.033 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:14:08.033 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:14:08.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 -- 172.21.15.177:0/3820135524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 msgr2=0x7f22d81589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 --2- 172.21.15.177:0/3820135524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 0x7f22d81589a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009870 tx=0x7f22d401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 -- 172.21.15.177:0/3820135524 shutdown_connections 2023-10-25T16:14:08.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 --2- 172.21.15.177:0/3820135524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22d80cd1c0 0x7f22d80cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 --2- 172.21.15.177:0/3820135524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 0x7f22d81589a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 -- 172.21.15.177:0/3820135524 >> 172.21.15.177:0/3820135524 conn(0x7f22d8069920 msgr2=0x7f22d8069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:08.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 -- 172.21.15.177:0/3820135524 shutdown_connections 2023-10-25T16:14:08.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.159+0000 7f22e0586640 1 -- 172.21.15.177:0/3820135524 wait complete. 2023-10-25T16:14:08.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 Processor -- start 2023-10-25T16:14:08.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- start start 2023-10-25T16:14:08.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 0x7f22d8142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:08.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 0x7f22d8149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:08.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22d8142810 0x7f22d81419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:08.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d81478b0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8146c30 con 0x7f22d814f2f0 2023-10-25T16:14:08.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8146f10 con 0x7f22d8142810 2023-10-25T16:14:08.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 0x7f22d8142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:08.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 0x7f22d8142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52018/0 (socket says 172.21.15.177:52018) 2023-10-25T16:14:08.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 -- 172.21.15.177:0/801973958 learned_addr learned my addr 172.21.15.177:0/801973958 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:08.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22ddb21640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 0x7f22d8149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:08.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22deb23640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22d8142810 0x7f22d81419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:08.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 -- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22d8142810 msgr2=0x7f22d81419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22d8142810 0x7f22d81419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 -- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 msgr2=0x7f22d8149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 0x7f22d8149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 -- 172.21.15.177:0/801973958 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0009820 con 0x7f22d80cd1c0 2023-10-25T16:14:08.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22de322640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 0x7f22d8142250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009790 tx=0x7f22d40a5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:08.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40043c0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f22d4005020 con 0x7f22d80cd1c0 2023-10-25T16:14:08.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4005410 con 0x7f22d80cd1c0 2023-10-25T16:14:08.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d40094a0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d81474d0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d814eec0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.163+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f22d40b4040 con 0x7f22d80cd1c0 2023-10-25T16:14:08.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.167+0000 7f22ceffd640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22bc0664a0 0x7f22bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:08.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.167+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22d411d970 con 0x7f22d80cd1c0 2023-10-25T16:14:08.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.167+0000 7f22ddb21640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22bc0664a0 0x7f22bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:08.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.167+0000 7f22ddb21640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22bc0664a0 0x7f22bc068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22d81564d0 tx=0x7f22c8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:08.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.171+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22d40eb1d0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.323+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f22d8073360 con 0x7f22d80cd1c0 2023-10-25T16:14:08.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.879+0000 7f22ceffd640 1 -- 172.21.15.177:0/801973958 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f22d40b20b0 con 0x7f22d80cd1c0 2023-10-25T16:14:08.884 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:14:08.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22bc0664a0 msgr2=0x7f22bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22bc0664a0 0x7f22bc068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22d81564d0 tx=0x7f22c8009040 comp rx=0 tx=0).stop 2023-10-25T16:14:08.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 msgr2=0x7f22d8142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:08.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 0x7f22d8142250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009790 tx=0x7f22d40a5920 comp rx=0 tx=0).stop 2023-10-25T16:14:08.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 shutdown_connections 2023-10-25T16:14:08.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22bc0664a0 0x7f22bc068960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22d8142810 0x7f22d81419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22d814f2f0 0x7f22d8149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:08.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 --2- 172.21.15.177:0/801973958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d80cd1c0 0x7f22d8142250 secure :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009790 tx=0x7f22d40a5920 comp rx=0 tx=0).stop 2023-10-25T16:14:08.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 >> 172.21.15.177:0/801973958 conn(0x7f22d8069920 msgr2=0x7f22d814e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:08.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 shutdown_connections 2023-10-25T16:14:08.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:08.883+0000 7f22e0586640 1 -- 172.21.15.177:0/801973958 wait complete. 2023-10-25T16:14:08.912 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:14:09.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 -- 172.21.15.177:0/1073999003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 msgr2=0x7fc49c0af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:09.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/1073999003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c0af370 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc490009900 tx=0x7fc49001c890 comp rx=0 tx=0).stop 2023-10-25T16:14:09.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 -- 172.21.15.177:0/1073999003 shutdown_connections 2023-10-25T16:14:09.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/1073999003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc49c0aff30 0x7fc49c0b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/1073999003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c0af370 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 -- 172.21.15.177:0/1073999003 >> 172.21.15.177:0/1073999003 conn(0x7fc49c0698f0 msgr2=0x7fc49c069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:09.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 -- 172.21.15.177:0/1073999003 shutdown_connections 2023-10-25T16:14:09.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 -- 172.21.15.177:0/1073999003 wait complete. 2023-10-25T16:14:09.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.043+0000 7fc4a18e4640 1 Processor -- start 2023-10-25T16:14:09.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- start start 2023-10-25T16:14:09.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:09.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc49c0aff30 0x7fc49c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:09.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc49c141410 0x7fc49c13e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:09.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c13e790 con 0x7fc49c0aeee0 2023-10-25T16:14:09.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c13db70 con 0x7fc49c141410 2023-10-25T16:14:09.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c13de50 con 0x7fc49c0aff30 2023-10-25T16:14:09.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:09.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52042/0 (socket says 172.21.15.177:52042) 2023-10-25T16:14:09.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 -- 172.21.15.177:0/2550671168 learned_addr learned my addr 172.21.15.177:0/2550671168 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:09.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 -- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc49c0aff30 msgr2=0x7fc49c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:09.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc49c0aff30 0x7fc49c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 -- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc49c141410 msgr2=0x7fc49c13e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:09.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc49c141410 0x7fc49c13e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 -- 172.21.15.177:0/2550671168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490009560 con 0x7fc49c0aeee0 2023-10-25T16:14:09.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc49affd640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c157520 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc48c001ec0 tx=0x7fc48c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:09.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0054e0 con 0x7fc49c0aeee0 2023-10-25T16:14:09.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc48c003600 con 0x7fc49c0aeee0 2023-10-25T16:14:09.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c13a590 con 0x7fc49c0aeee0 2023-10-25T16:14:09.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c003a10 con 0x7fc49c0aeee0 2023-10-25T16:14:09.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c13ad90 con 0x7fc49c0aeee0 2023-10-25T16:14:09.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c04db20 con 0x7fc49c0aeee0 2023-10-25T16:14:09.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc48c003b70 con 0x7fc49c0aeee0 2023-10-25T16:14:09.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc483fff640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc488066470 0x7fc488068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:09.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.047+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc48c083890 con 0x7fc49c0aeee0 2023-10-25T16:14:09.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.051+0000 7fc49a7fc640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc488066470 0x7fc488068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:09.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.051+0000 7fc49a7fc640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc488066470 0x7fc488068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc4900af000 tx=0x7fc490019630 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:09.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.051+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc48c050ef0 con 0x7fc49c0aeee0 2023-10-25T16:14:09.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.207+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc49c06d050 con 0x7fc49c0aeee0 2023-10-25T16:14:09.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.883+0000 7fc483fff640 1 -- 172.21.15.177:0/2550671168 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc48c017020 con 0x7fc49c0aeee0 2023-10-25T16:14:09.889 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:14:09.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc488066470 msgr2=0x7fc488068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:09.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc488066470 0x7fc488068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc4900af000 tx=0x7fc490019630 comp rx=0 tx=0).stop 2023-10-25T16:14:09.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 msgr2=0x7fc49c157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:09.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c157520 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc48c001ec0 tx=0x7fc48c00c8e0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 shutdown_connections 2023-10-25T16:14:09.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc488066470 0x7fc488068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc49c141410 0x7fc49c13e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc49c0aff30 0x7fc49c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 --2- 172.21.15.177:0/2550671168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc49c0aeee0 0x7fc49c157520 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:09.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 >> 172.21.15.177:0/2550671168 conn(0x7fc49c0698f0 msgr2=0x7fc49c069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:09.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 shutdown_connections 2023-10-25T16:14:09.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:09.887+0000 7fc4a18e4640 1 -- 172.21.15.177:0/2550671168 wait complete. 2023-10-25T16:14:09.924 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:14:10.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/483530300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860c0039b0 msgr2=0x7f860c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:10.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 --2- 172.21.15.177:0/483530300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f860c0039b0 0x7f860c003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f861400bb40 tx=0x7f861401cd80 comp rx=0 tx=0).stop 2023-10-25T16:14:10.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86237fe640 1 -- 172.21.15.177:0/483530300 reap_dead start 2023-10-25T16:14:10.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/483530300 shutdown_connections 2023-10-25T16:14:10.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/483530300 >> 172.21.15.177:0/483530300 conn(0x7f862409a640 msgr2=0x7f86240d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:10.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/483530300 shutdown_connections 2023-10-25T16:14:10.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/483530300 wait complete. 2023-10-25T16:14:10.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 Processor -- start 2023-10-25T16:14:10.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- start start 2023-10-25T16:14:10.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f860c0039b0 0x7f86240c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:10.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 0x7f86240c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:10.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86240ca790 0x7f86240cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:10.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240cb150 con 0x7f862415c070 2023-10-25T16:14:10.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240ca420 con 0x7f860c0039b0 2023-10-25T16:14:10.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862415d140 con 0x7f86240ca790 2023-10-25T16:14:10.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 0x7f86240c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:10.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 0x7f86240c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52058/0 (socket says 172.21.15.177:52058) 2023-10-25T16:14:10.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 -- 172.21.15.177:0/2791067075 learned_addr learned my addr 172.21.15.177:0/2791067075 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:10.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86237fe640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86240ca790 0x7f86240cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:10.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8622ffd640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f860c0039b0 0x7f86240c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:10.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 -- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86240ca790 msgr2=0x7f86240cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:10.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86240ca790 0x7f86240cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 -- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f860c0039b0 msgr2=0x7f86240c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:10.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f860c0039b0 0x7f86240c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 -- 172.21.15.177:0/2791067075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862415db80 con 0x7f862415c070 2023-10-25T16:14:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f86227fc640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 0x7f86240c7110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f861800f610 tx=0x7f861800fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86180118a0 con 0x7f862415c070 2023-10-25T16:14:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8618011af0 con 0x7f862415c070 2023-10-25T16:14:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862415c530 con 0x7f862415c070 2023-10-25T16:14:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618012470 con 0x7f862415c070 2023-10-25T16:14:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.043+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862415caf0 con 0x7f862415c070 2023-10-25T16:14:10.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.047+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862415d2d0 con 0x7f862415c070 2023-10-25T16:14:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.047+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86180125d0 con 0x7f862415c070 2023-10-25T16:14:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.047+0000 7f860b7fe640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f86100664a0 0x7f8610068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.047+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8618087810 con 0x7f862415c070 2023-10-25T16:14:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.047+0000 7f8622ffd640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f86100664a0 0x7f8610068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.047+0000 7f8622ffd640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f86100664a0 0x7f8610068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f86140b0000 tx=0x7f86140a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:10.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.051+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8618054de0 con 0x7f862415c070 2023-10-25T16:14:10.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.235+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f862404daf0 con 0x7f862415c070 2023-10-25T16:14:10.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.951+0000 7f860b7fe640 1 -- 172.21.15.177:0/2791067075 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8618058400 con 0x7f862415c070 2023-10-25T16:14:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 4 and data pool 5 2023-10-25T16:14:10.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f86100664a0 msgr2=0x7f8610068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:10.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f86100664a0 0x7f8610068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f86140b0000 tx=0x7f86140a7040 comp rx=0 tx=0).stop 2023-10-25T16:14:10.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 msgr2=0x7f86240c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:10.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 0x7f86240c7110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f861800f610 tx=0x7f861800fad0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 shutdown_connections 2023-10-25T16:14:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f86100664a0 0x7f8610068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f86240ca790 0x7f86240cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f862415c070 0x7f86240c7110 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 --2- 172.21.15.177:0/2791067075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f860c0039b0 0x7f86240c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 >> 172.21.15.177:0/2791067075 conn(0x7f862409a640 msgr2=0x7f86241515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 shutdown_connections 2023-10-25T16:14:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:10.959+0000 7f8629707640 1 -- 172.21.15.177:0/2791067075 wait complete. 2023-10-25T16:14:10.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:11.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 -- 172.21.15.177:0/2224366456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0ce220 msgr2=0x7f2b8c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 --2- 172.21.15.177:0/2224366456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0ce220 0x7f2b8c0b4100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009bc0 tx=0x7f2b8401cab0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 -- 172.21.15.177:0/2224366456 shutdown_connections 2023-10-25T16:14:11.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 --2- 172.21.15.177:0/2224366456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0ce220 0x7f2b8c0b4100 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 -- 172.21.15.177:0/2224366456 >> 172.21.15.177:0/2224366456 conn(0x7f2b8c09a5c0 msgr2=0x7f2b8c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:11.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 -- 172.21.15.177:0/2224366456 shutdown_connections 2023-10-25T16:14:11.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.107+0000 7f2b93da3640 1 -- 172.21.15.177:0/2224366456 wait complete. 2023-10-25T16:14:11.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 Processor -- start 2023-10-25T16:14:11.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- start start 2023-10-25T16:14:11.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 0x7f2b8c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c0ce220 0x7f2b8c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b8c15eba0 0x7f2b8c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ca350 con 0x7f2b8c0b2120 2023-10-25T16:14:11.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c152910 con 0x7f2b8c0ce220 2023-10-25T16:14:11.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ca560 con 0x7f2b8c15eba0 2023-10-25T16:14:11.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 0x7f2b8c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 0x7f2b8c1523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38284/0 (socket says 172.21.15.177:38284) 2023-10-25T16:14:11.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 -- 172.21.15.177:0/712157908 learned_addr learned my addr 172.21.15.177:0/712157908 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:11.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b9133e640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c0ce220 0x7f2b8c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 -- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b8c15eba0 msgr2=0x7f2b8c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b8c15eba0 0x7f2b8c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 -- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c0ce220 msgr2=0x7f2b8c0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c0ce220 0x7f2b8c0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 -- 172.21.15.177:0/712157908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009820 con 0x7f2b8c0b2120 2023-10-25T16:14:11.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b91b3f640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 0x7f2b8c1523d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000c410 tx=0x7f2b8000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:11.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80011790 con 0x7f2b8c0b2120 2023-10-25T16:14:11.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b800119e0 con 0x7f2b8c0b2120 2023-10-25T16:14:11.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c0ca840 con 0x7f2b8c0b2120 2023-10-25T16:14:11.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80011dd0 con 0x7f2b8c0b2120 2023-10-25T16:14:11.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c0cae00 con 0x7f2b8c0b2120 2023-10-25T16:14:11.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c04daf0 con 0x7f2b8c0b2120 2023-10-25T16:14:11.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.111+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b8001c460 con 0x7f2b8c0b2120 2023-10-25T16:14:11.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.115+0000 7f2b7e7fc640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b70066470 0x7f2b70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.115+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b80083fe0 con 0x7f2b8c0b2120 2023-10-25T16:14:11.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.115+0000 7f2b9133e640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b70066470 0x7f2b70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.115+0000 7f2b9133e640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b70066470 0x7f2b70068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c071a00 tx=0x7f2b88009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:11.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.119+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b800515b0 con 0x7f2b8c0b2120 2023-10-25T16:14:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.271+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b8c0ce930 con 0x7f2b8c0b2120 2023-10-25T16:14:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.275+0000 7f2b7e7fc640 1 -- 172.21.15.177:0/712157908 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f2b80054bd0 con 0x7f2b8c0b2120 2023-10-25T16:14:11.281 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:11.281 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":34,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:10.241913+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b70066470 msgr2=0x7f2b70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b70066470 0x7f2b70068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c071a00 tx=0x7f2b88009040 comp rx=0 tx=0).stop 2023-10-25T16:14:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 msgr2=0x7f2b8c1523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 0x7f2b8c1523d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000c410 tx=0x7f2b8000c8d0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 shutdown_connections 2023-10-25T16:14:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b70066470 0x7f2b70068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b8c15eba0 0x7f2b8c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8c0ce220 0x7f2b8c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 --2- 172.21.15.177:0/712157908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b8c0b2120 0x7f2b8c1523d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 >> 172.21.15.177:0/712157908 conn(0x7f2b8c09a5c0 msgr2=0x7f2b8c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 shutdown_connections 2023-10-25T16:14:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.279+0000 7f2b93da3640 1 -- 172.21.15.177:0/712157908 wait complete. 2023-10-25T16:14:11.301 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 -- 172.21.15.177:0/3143433352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a8004d10 msgr2=0x7fd7a8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3143433352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a8004d10 0x7fd7a8005190 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009b60 tx=0x7fd7b001d250 comp rx=0 tx=0).stop 2023-10-25T16:14:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7bf7fe640 1 -- 172.21.15.177:0/3143433352 reap_dead start 2023-10-25T16:14:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 -- 172.21.15.177:0/3143433352 shutdown_connections 2023-10-25T16:14:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 -- 172.21.15.177:0/3143433352 >> 172.21.15.177:0/3143433352 conn(0x7fd7c00b2450 msgr2=0x7fd7c00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 -- 172.21.15.177:0/3143433352 shutdown_connections 2023-10-25T16:14:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 -- 172.21.15.177:0/3143433352 wait complete. 2023-10-25T16:14:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 Processor -- start 2023-10-25T16:14:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.415+0000 7fd7c5928640 1 -- start start 2023-10-25T16:14:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a8004d10 0x7fd7c00a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 0x7fd7c0150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c00aa610 0x7fd7c0159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00a6840 con 0x7fd7c01f2d00 2023-10-25T16:14:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00a64a0 con 0x7fd7c00aa610 2023-10-25T16:14:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01512a0 con 0x7fd7a8004d10 2023-10-25T16:14:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 0x7fd7c0150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 0x7fd7c0150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38300/0 (socket says 172.21.15.177:38300) 2023-10-25T16:14:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 -- 172.21.15.177:0/3156279835 learned_addr learned my addr 172.21.15.177:0/3156279835 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7bf7fe640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c00aa610 0x7fd7c0159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7beffd640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a8004d10 0x7fd7c00a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 -- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a8004d10 msgr2=0x7fd7c00a8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a8004d10 0x7fd7c00a8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 -- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c00aa610 msgr2=0x7fd7c0159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c00aa610 0x7fd7c0159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 -- 172.21.15.177:0/3156279835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c01f34e0 con 0x7fd7c01f2d00 2023-10-25T16:14:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7bf7fe640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c00aa610 0x7fd7c0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7beffd640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a8004d10 0x7fd7c00a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7be7fc640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 0x7fd7c0150d60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d700 tx=0x7fd7b400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400de10 con 0x7fd7c01f2d00 2023-10-25T16:14:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7b40052e0 con 0x7fd7c01f2d00 2023-10-25T16:14:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400b920 con 0x7fd7c01f2d00 2023-10-25T16:14:11.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c01f37c0 con 0x7fd7c01f2d00 2023-10-25T16:14:11.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01f3180 con 0x7fd7c01f2d00 2023-10-25T16:14:11.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c004daf0 con 0x7fd7c01f2d00 2023-10-25T16:14:11.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.419+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7b400ba80 con 0x7fd7c01f2d00 2023-10-25T16:14:11.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.423+0000 7fd7a7fff640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7ac0664a0 0x7fd7ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.423+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7b4083b60 con 0x7fd7c01f2d00 2023-10-25T16:14:11.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.423+0000 7fd7beffd640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7ac0664a0 0x7fd7ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.423+0000 7fd7beffd640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7ac0664a0 0x7fd7ac068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8006fd0 tx=0x7fd7b8006e00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:11.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.427+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7b4051150 con 0x7fd7c01f2d00 2023-10-25T16:14:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.583+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c006d7f0 con 0x7fd7c01f2d00 2023-10-25T16:14:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7a7fff640 1 -- 172.21.15.177:0/3156279835 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16606 (secure 0 0 0) 0x7fd7b4019090 con 0x7fd7c01f2d00 2023-10-25T16:14:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:11.592 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":34,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:10.241913+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7ac0664a0 msgr2=0x7fd7ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7ac0664a0 0x7fd7ac068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8006fd0 tx=0x7fd7b8006e00 comp rx=0 tx=0).stop 2023-10-25T16:14:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 msgr2=0x7fd7c0150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 0x7fd7c0150d60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d700 tx=0x7fd7b400dbc0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 shutdown_connections 2023-10-25T16:14:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7ac0664a0 0x7fd7ac068960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c00aa610 0x7fd7c0159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7c01f2d00 0x7fd7c0150d60 secure :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d700 tx=0x7fd7b400dbc0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 --2- 172.21.15.177:0/3156279835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a8004d10 0x7fd7c00a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 >> 172.21.15.177:0/3156279835 conn(0x7fd7c00b2450 msgr2=0x7fd7c0151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:11.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 shutdown_connections 2023-10-25T16:14:11.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.587+0000 7fd7c5928640 1 -- 172.21.15.177:0/3156279835 wait complete. 2023-10-25T16:14:11.611 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:14:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa81869e640 1 -- 172.21.15.177:0/4107583718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7fc003980 msgr2=0x7fa7fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa81869e640 1 --2- 172.21.15.177:0/4107583718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7fc003980 0x7fa7fc003da0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa80c005fd0 tx=0x7fa80c01cc70 comp rx=0 tx=0).stop 2023-10-25T16:14:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa816c3b640 1 -- 172.21.15.177:0/4107583718 reap_dead start 2023-10-25T16:14:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa81869e640 1 -- 172.21.15.177:0/4107583718 shutdown_connections 2023-10-25T16:14:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa81869e640 1 -- 172.21.15.177:0/4107583718 >> 172.21.15.177:0/4107583718 conn(0x7fa8100b2450 msgr2=0x7fa8100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa81869e640 1 -- 172.21.15.177:0/4107583718 shutdown_connections 2023-10-25T16:14:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.731+0000 7fa81869e640 1 -- 172.21.15.177:0/4107583718 wait complete. 2023-10-25T16:14:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 Processor -- start 2023-10-25T16:14:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- start start 2023-10-25T16:14:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7fc003980 0x7fa8101f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8100acb40 0x7fa8100ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 0x7fa81006fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810070100 con 0x7fa81006f740 2023-10-25T16:14:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810156260 con 0x7fa7fc003980 2023-10-25T16:14:11.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101564b0 con 0x7fa8100acb40 2023-10-25T16:14:11.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 0x7fa81006fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 0x7fa81006fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38328/0 (socket says 172.21.15.177:38328) 2023-10-25T16:14:11.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 -- 172.21.15.177:0/748146096 learned_addr learned my addr 172.21.15.177:0/748146096 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:11.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa815c39640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8100acb40 0x7fa8100ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81643a640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7fc003980 0x7fa8101f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 -- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8100acb40 msgr2=0x7fa8100ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8100acb40 0x7fa8100ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 -- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7fc003980 msgr2=0x7fa8101f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7fc003980 0x7fa8101f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 -- 172.21.15.177:0/748146096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810156790 con 0x7fa81006f740 2023-10-25T16:14:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa816c3b640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 0x7fa81006fbc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa8100cce30 tx=0x7fa80800fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808003e50 con 0x7fa81006f740 2023-10-25T16:14:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa808004c20 con 0x7fa81006f740 2023-10-25T16:14:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa810156a70 con 0x7fa81006f740 2023-10-25T16:14:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80800d900 con 0x7fa81006f740 2023-10-25T16:14:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8101f4c90 con 0x7fa81006f740 2023-10-25T16:14:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81004daf0 con 0x7fa81006f740 2023-10-25T16:14:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa808019070 con 0x7fa81006f740 2023-10-25T16:14:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.735+0000 7fa806ffd640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7f4066490 0x7fa7f4068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.739+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa808084320 con 0x7fa81006f740 2023-10-25T16:14:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.739+0000 7fa81643a640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7f4066490 0x7fa7f4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.739+0000 7fa81643a640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7f4066490 0x7fa7f4068950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0b0000 tx=0x7fa80c0a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.743+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa808055370 con 0x7fa81006f740 2023-10-25T16:14:11.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.931+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa8101631f0 con 0x7fa81006f740 2023-10-25T16:14:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.951+0000 7fa806ffd640 1 -- 172.21.15.177:0/748146096 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa808054f00 con 0x7fa81006f740 2023-10-25T16:14:11.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7f4066490 msgr2=0x7fa7f4068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7f4066490 0x7fa7f4068950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0b0000 tx=0x7fa80c0a7040 comp rx=0 tx=0).stop 2023-10-25T16:14:11.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 msgr2=0x7fa81006fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:11.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 0x7fa81006fbc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa8100cce30 tx=0x7fa80800fed0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 shutdown_connections 2023-10-25T16:14:11.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7f4066490 0x7fa7f4068950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa81006f740 0x7fa81006fbc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8100acb40 0x7fa8100ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 --2- 172.21.15.177:0/748146096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7fc003980 0x7fa8101f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:11.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 >> 172.21.15.177:0/748146096 conn(0x7fa8100b2450 msgr2=0x7fa810154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:11.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 shutdown_connections 2023-10-25T16:14:11.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:11.955+0000 7fa81869e640 1 -- 172.21.15.177:0/748146096 wait complete. 2023-10-25T16:14:11.977 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:14:11.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:14:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 -- 172.21.15.177:0/2272513566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51a8003980 msgr2=0x7f51a8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 --2- 172.21.15.177:0/2272513566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51a8003980 0x7f51a8003da0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c290 tx=0x7f51bc01cfe0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5064640 1 -- 172.21.15.177:0/2272513566 reap_dead start 2023-10-25T16:14:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 -- 172.21.15.177:0/2272513566 shutdown_connections 2023-10-25T16:14:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 -- 172.21.15.177:0/2272513566 >> 172.21.15.177:0/2272513566 conn(0x7f51c009a3f0 msgr2=0x7f51c00d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 -- 172.21.15.177:0/2272513566 shutdown_connections 2023-10-25T16:14:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 -- 172.21.15.177:0/2272513566 wait complete. 2023-10-25T16:14:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 Processor -- start 2023-10-25T16:14:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.099+0000 7f51c5865640 1 -- start start 2023-10-25T16:14:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51a8003980 0x7f51c00c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 0x7f51c00c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c015d410 0x7f51c00c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c9fe0 con 0x7f51c015c6d0 2023-10-25T16:14:12.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c8750 con 0x7f51a8003980 2023-10-25T16:14:12.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c8a20 con 0x7f51c015d410 2023-10-25T16:14:12.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 0x7f51c00c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:12.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 0x7f51c00c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38352/0 (socket says 172.21.15.177:38352) 2023-10-25T16:14:12.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 -- 172.21.15.177:0/3691101910 learned_addr learned my addr 172.21.15.177:0/3691101910 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:12.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5064640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c015d410 0x7f51c00c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:12.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c4863640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51a8003980 0x7f51c00c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:12.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 -- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c015d410 msgr2=0x7f51c00c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:12.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c015d410 0x7f51c00c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 -- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51a8003980 msgr2=0x7f51c00c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:12.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51a8003980 0x7f51c00c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 -- 172.21.15.177:0/3691101910 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00c8d00 con 0x7f51c015c6d0 2023-10-25T16:14:12.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b7fff640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 0x7f51c00c8210 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f51b0010a10 tx=0x7f51b0010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:12.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000ece0 con 0x7f51c015c6d0 2023-10-25T16:14:12.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f51b000ee40 con 0x7f51c015c6d0 2023-10-25T16:14:12.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c00c8fe0 con 0x7f51c015c6d0 2023-10-25T16:14:12.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0005280 con 0x7f51c015c6d0 2023-10-25T16:14:12.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c00c95a0 con 0x7f51c015c6d0 2023-10-25T16:14:12.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c00c9760 con 0x7f51c015c6d0 2023-10-25T16:14:12.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f51b00053e0 con 0x7f51c015c6d0 2023-10-25T16:14:12.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b57fa640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51ac0664a0 0x7f51ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:12.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51b0016070 con 0x7f51c015c6d0 2023-10-25T16:14:12.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.103+0000 7f51c4863640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51ac0664a0 0x7f51ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:12.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.107+0000 7f51c4863640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51ac0664a0 0x7f51ac068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0ac000 tx=0x7f51bc019d80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:12.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.107+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f51b0055be0 con 0x7f51c015c6d0 2023-10-25T16:14:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.295+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f51c004da80 con 0x7f51c015c6d0 2023-10-25T16:14:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.955+0000 7f51b57fa640 1 -- 172.21.15.177:0/3691101910 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f51b0055770 con 0x7f51c015c6d0 2023-10-25T16:14:12.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51ac0664a0 msgr2=0x7f51ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:12.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51ac0664a0 0x7f51ac068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0ac000 tx=0x7f51bc019d80 comp rx=0 tx=0).stop 2023-10-25T16:14:12.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 msgr2=0x7f51c00c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:12.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 0x7f51c00c8210 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f51b0010a10 tx=0x7f51b0010ed0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 shutdown_connections 2023-10-25T16:14:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f51ac0664a0 0x7f51ac068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f51c015d410 0x7f51c00c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51c015c6d0 0x7f51c00c8210 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 --2- 172.21.15.177:0/3691101910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51a8003980 0x7f51c00c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 >> 172.21.15.177:0/3691101910 conn(0x7f51c009a3f0 msgr2=0x7f51c0164560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 shutdown_connections 2023-10-25T16:14:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:12.959+0000 7f51c5865640 1 -- 172.21.15.177:0/3691101910 wait complete. 2023-10-25T16:14:12.984 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:14:12.984 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:13.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- 172.21.15.177:0/3040790891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd38015eba0 msgr2=0x7fd3800b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 --2- 172.21.15.177:0/3040790891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd38015eba0 0x7fd3800b4100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009840 tx=0x7fd37c01c770 comp rx=0 tx=0).stop 2023-10-25T16:14:13.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- 172.21.15.177:0/3040790891 shutdown_connections 2023-10-25T16:14:13.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 --2- 172.21.15.177:0/3040790891 >> v2:172.21.15.184:3300/0 conn(0x7fd3800cdb10 0x7fd3800cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 --2- 172.21.15.177:0/3040790891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd38015eba0 0x7fd3800b4100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- 172.21.15.177:0/3040790891 >> 172.21.15.177:0/3040790891 conn(0x7fd38009a5c0 msgr2=0x7fd3800d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:13.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- 172.21.15.177:0/3040790891 shutdown_connections 2023-10-25T16:14:13.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- 172.21.15.177:0/3040790891 wait complete. 2023-10-25T16:14:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 Processor -- start 2023-10-25T16:14:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- start start 2023-10-25T16:14:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3800b2120 0x7fd38015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3800cdb10 0x7fd3800c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 0x7fd3800c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800c7c80 con 0x7fd38015eba0 2023-10-25T16:14:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800ca0b0 con 0x7fd3800cdb10 2023-10-25T16:14:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd387f27640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3800c76c0 con 0x7fd3800b2120 2023-10-25T16:14:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd3864c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 0x7fd3800c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd3864c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 0x7fd3800c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38354/0 (socket says 172.21.15.177:38354) 2023-10-25T16:14:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd3864c4640 1 -- 172.21.15.177:0/3457703414 learned_addr learned my addr 172.21.15.177:0/3457703414 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:13.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd385cc3640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3800b2120 0x7fd38015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.107+0000 7fd3854c2640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3800cdb10 0x7fd3800c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3864c4640 1 -- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3800b2120 msgr2=0x7fd38015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3864c4640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3800b2120 0x7fd38015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3864c4640 1 -- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3800cdb10 msgr2=0x7fd3800c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3864c4640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3800cdb10 0x7fd3800c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3864c4640 1 -- 172.21.15.177:0/3457703414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd378009820 con 0x7fd38015eba0 2023-10-25T16:14:13.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3864c4640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 0x7fd3800c6ba0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd37800efd0 tx=0x7fd37800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:13.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378009b80 con 0x7fd38015eba0 2023-10-25T16:14:13.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd378003b80 con 0x7fd38015eba0 2023-10-25T16:14:13.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378004020 con 0x7fd38015eba0 2023-10-25T16:14:13.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0094a0 con 0x7fd38015eba0 2023-10-25T16:14:13.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38015b860 con 0x7fd38015eba0 2023-10-25T16:14:13.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3800c9f10 con 0x7fd38015eba0 2023-10-25T16:14:13.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd378004180 con 0x7fd38015eba0 2023-10-25T16:14:13.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3767fc640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd364066470 0x7fd364068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd378014070 con 0x7fd38015eba0 2023-10-25T16:14:13.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd385cc3640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd364066470 0x7fd364068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.111+0000 7fd385cc3640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd364066470 0x7fd364068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0ae000 tx=0x7fd37c01afb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:13.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.115+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3800c9f10 con 0x7fd38015eba0 2023-10-25T16:14:13.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3800c9f10 con 0x7fd38015eba0 2023-10-25T16:14:13.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd3767fc640 1 -- 172.21.15.177:0/3457703414 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fd3800c9f10 con 0x7fd38015eba0 2023-10-25T16:14:13.312 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:13.312 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:13.313 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:13.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd364066470 msgr2=0x7fd364068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd364066470 0x7fd364068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0ae000 tx=0x7fd37c01afb0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 msgr2=0x7fd3800c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 0x7fd3800c6ba0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd37800efd0 tx=0x7fd37800c6a0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 shutdown_connections 2023-10-25T16:14:13.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd364066470 0x7fd364068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38015eba0 0x7fd3800c6ba0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3800cdb10 0x7fd3800c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 --2- 172.21.15.177:0/3457703414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3800b2120 0x7fd38015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 >> 172.21.15.177:0/3457703414 conn(0x7fd38009a5c0 msgr2=0x7fd3800b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:13.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 shutdown_connections 2023-10-25T16:14:13.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.307+0000 7fd387f27640 1 -- 172.21.15.177:0/3457703414 wait complete. 2023-10-25T16:14:13.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:13.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2921754564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 msgr2=0x7fb3300af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2921754564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb3300af5d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb3300b0f60 tx=0x7fb32c01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2921754564 shutdown_connections 2023-10-25T16:14:13.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2921754564 >> v2:172.21.15.184:3300/0 conn(0x7fb33006c160 0x7fb3300cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2921754564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb3300af5d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2921754564 >> 172.21.15.177:0/2921754564 conn(0x7fb3300b2450 msgr2=0x7fb3300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:13.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2921754564 shutdown_connections 2023-10-25T16:14:13.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2921754564 wait complete. 2023-10-25T16:14:13.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 Processor -- start 2023-10-25T16:14:13.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- start start 2023-10-25T16:14:13.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33006c160 0x7fb330157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33006f570 0x7fb3301362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb330136830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33015a330 con 0x7fb330140cf0 2023-10-25T16:14:13.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301402d0 con 0x7fb33006f570 2023-10-25T16:14:13.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33015a540 con 0x7fb33006c160 2023-10-25T16:14:13.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb330136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb330136830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38372/0 (socket says 172.21.15.177:38372) 2023-10-25T16:14:13.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 -- 172.21.15.177:0/2469553815 learned_addr learned my addr 172.21.15.177:0/2469553815 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:13.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335697640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33006c160 0x7fb330157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb334e96640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33006f570 0x7fb3301362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 -- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33006c160 msgr2=0x7fb330157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33006c160 0x7fb330157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 -- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33006f570 msgr2=0x7fb3301362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33006f570 0x7fb3301362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 -- 172.21.15.177:0/2469553815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009560 con 0x7fb330140cf0 2023-10-25T16:14:13.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb334e96640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33006f570 0x7fb3301362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:13.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb335e98640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb330136830 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb32800cad0 tx=0x7fb32800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:13.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32800ae20 con 0x7fb330140cf0 2023-10-25T16:14:13.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb3280039a0 con 0x7fb330140cf0 2023-10-25T16:14:13.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33015a820 con 0x7fb330140cf0 2023-10-25T16:14:13.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328003dd0 con 0x7fb330140cf0 2023-10-25T16:14:13.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.447+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33015ade0 con 0x7fb330140cf0 2023-10-25T16:14:13.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.451+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33004daf0 con 0x7fb330140cf0 2023-10-25T16:14:13.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.451+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb328004030 con 0x7fb330140cf0 2023-10-25T16:14:13.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.451+0000 7fb325ffb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb314066470 0x7fb314068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.451+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb328084670 con 0x7fb330140cf0 2023-10-25T16:14:13.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.451+0000 7fb335697640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb314066470 0x7fb314068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.451+0000 7fb335697640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb314066470 0x7fb314068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ae000 tx=0x7fb32c01b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:13.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.455+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb328051af0 con 0x7fb330140cf0 2023-10-25T16:14:13.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.599+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3300ca670 con 0x7fb330140cf0 2023-10-25T16:14:13.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb325ffb640 1 -- 172.21.15.177:0/2469553815 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fb328055110 con 0x7fb330140cf0 2023-10-25T16:14:13.609 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:13.609 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":35,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:11.918760+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:13.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb314066470 msgr2=0x7fb314068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb314066470 0x7fb314068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ae000 tx=0x7fb32c01b010 comp rx=0 tx=0).stop 2023-10-25T16:14:13.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 msgr2=0x7fb330136830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb330136830 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb32800cad0 tx=0x7fb32800cf90 comp rx=0 tx=0).stop 2023-10-25T16:14:13.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 shutdown_connections 2023-10-25T16:14:13.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb314066470 0x7fb314068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb330140cf0 0x7fb330136830 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb33006f570 0x7fb3301362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 --2- 172.21.15.177:0/2469553815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb33006c160 0x7fb330157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 >> 172.21.15.177:0/2469553815 conn(0x7fb3300b2450 msgr2=0x7fb33013c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:13.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 shutdown_connections 2023-10-25T16:14:13.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.603+0000 7fb3378fb640 1 -- 172.21.15.177:0/2469553815 wait complete. 2023-10-25T16:14:13.626 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:14:13.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:13.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.727+0000 7f6f4d266640 1 -- 172.21.15.177:0/4245403974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 msgr2=0x7f6f34003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.727+0000 7f6f4d266640 1 --2- 172.21.15.177:0/4245403974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f34003df0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f30001680 tx=0x7f6f3001c730 comp rx=0 tx=0).stop 2023-10-25T16:14:13.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.727+0000 7f6f4d266640 1 -- 172.21.15.177:0/4245403974 shutdown_connections 2023-10-25T16:14:13.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.727+0000 7f6f4d266640 1 --2- 172.21.15.177:0/4245403974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f34003df0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.727+0000 7f6f4d266640 1 -- 172.21.15.177:0/4245403974 >> 172.21.15.177:0/4245403974 conn(0x7f6f4806a830 msgr2=0x7f6f4806ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:13.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- 172.21.15.177:0/4245403974 shutdown_connections 2023-10-25T16:14:13.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- 172.21.15.177:0/4245403974 wait complete. 2023-10-25T16:14:13.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 Processor -- start 2023-10-25T16:14:13.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- start start 2023-10-25T16:14:13.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f48149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4814e8a0 0x7f6f4814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f4814ed20 0x7f6f4814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48150300 con 0x7f6f340039d0 2023-10-25T16:14:13.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4814f260 con 0x7f6f4814e8a0 2023-10-25T16:14:13.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4814f540 con 0x7f6f4814ed20 2023-10-25T16:14:13.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f48149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f48149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38390/0 (socket says 172.21.15.177:38390) 2023-10-25T16:14:13.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 -- 172.21.15.177:0/2766527248 learned_addr learned my addr 172.21.15.177:0/2766527248 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:13.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f467fc640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4814e8a0 0x7f6f4814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f477fe640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f4814ed20 0x7f6f4814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 -- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f4814ed20 msgr2=0x7f6f4814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f4814ed20 0x7f6f4814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 -- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4814e8a0 msgr2=0x7f6f4814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4814e8a0 0x7f6f4814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 -- 172.21.15.177:0/2766527248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4814f820 con 0x7f6f340039d0 2023-10-25T16:14:13.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f477fe640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f4814ed20 0x7f6f4814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:13.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f46ffd640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f48149e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6f30005040 tx=0x7f6f30003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:13.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300a9040 con 0x7f6f340039d0 2023-10-25T16:14:13.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f30006150 con 0x7f6f340039d0 2023-10-25T16:14:13.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300a5820 con 0x7f6f340039d0 2023-10-25T16:14:13.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4814fb00 con 0x7f6f340039d0 2023-10-25T16:14:13.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4814a370 con 0x7f6f340039d0 2023-10-25T16:14:13.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.731+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4804daf0 con 0x7f6f340039d0 2023-10-25T16:14:13.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.735+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6f300b5020 con 0x7f6f340039d0 2023-10-25T16:14:13.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.735+0000 7f6f3f7fe640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6f280664a0 0x7f6f28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:13.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.735+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f300aa070 con 0x7f6f340039d0 2023-10-25T16:14:13.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.735+0000 7f6f467fc640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6f280664a0 0x7f6f28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:13.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.735+0000 7f6f467fc640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6f280664a0 0x7f6f28068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f380017b0 tx=0x7f6f38001bb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:13.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.739+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6f300eb1b0 con 0x7f6f340039d0 2023-10-25T16:14:13.863 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-25T16:14:13.858+0000 7f4d3dcd4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:14:13.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.875+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f4814a560 con 0x7f6f280664a0 2023-10-25T16:14:13.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.899+0000 7f6f3f7fe640 1 -- 172.21.15.177:0/2766527248 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274729 (secure 0 0 0) 0x7f6f4814a560 con 0x7f6f280664a0 2023-10-25T16:14:13.907 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:13.909 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:13.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6f280664a0 msgr2=0x7f6f28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6f280664a0 0x7f6f28068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f380017b0 tx=0x7f6f38001bb0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 msgr2=0x7f6f48149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:13.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f48149e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6f30005040 tx=0x7f6f30003c20 comp rx=0 tx=0).stop 2023-10-25T16:14:13.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 shutdown_connections 2023-10-25T16:14:13.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6f280664a0 0x7f6f28068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f4814ed20 0x7f6f4814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4814e8a0 0x7f6f4814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 --2- 172.21.15.177:0/2766527248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f340039d0 0x7f6f48149e30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:13.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 >> 172.21.15.177:0/2766527248 conn(0x7f6f4806a830 msgr2=0x7f6f48151a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:13.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 shutdown_connections 2023-10-25T16:14:13.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:13.903+0000 7f6f4d266640 1 -- 172.21.15.177:0/2766527248 wait complete. 2023-10-25T16:14:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-25T16:14:12.614668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560274,"statfs":{"total":1600000000,"available":1597720602,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001237"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.953527+0000","last_change":"2023-10-25T16:14:10.953124+0000","last_active":"2023-10-25T16:14:10.953527+0000","last_peered":"2023-10-25T16:14:10.953527+0000","last_clean":"2023-10-25T16:14:10.953527+0000","last_became_active":"2023-10-25T16:14:10.952432+0000","last_became_peered":"2023-10-25T16:14:10.952432+0000","last_unstale":"2023-10-25T16:14:10.953527+0000","last_undegraded":"2023-10-25T16:14:10.953527+0000","last_fullsized":"2023-10-25T16:14:10.953527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:30:26.675353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.956014+0000","last_change":"2023-10-25T16:14:10.955870+0000","last_active":"2023-10-25T16:14:10.956014+0000","last_peered":"2023-10-25T16:14:10.956014+0000","last_clean":"2023-10-25T16:14:10.956014+0000","last_became_active":"2023-10-25T16:14:10.954791+0000","last_became_peered":"2023-10-25T16:14:10.954791+0000","last_unstale":"2023-10-25T16:14:10.956014+0000","last_undegraded":"2023-10-25T16:14:10.956014+0000","last_fullsized":"2023-10-25T16:14:10.956014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:31.884348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.944987+0000","last_change":"2023-10-25T16:14:10.944831+0000","last_active":"2023-10-25T16:14:10.944987+0000","last_peered":"2023-10-25T16:14:10.944987+0000","last_clean":"2023-10-25T16:14:10.944987+0000","last_became_active":"2023-10-25T16:14:10.944176+0000","last_became_peered":"2023-10-25T16:14:10.944176+0000","last_unstale":"2023-10-25T16:14:10.944987+0000","last_undegraded":"2023-10-25T16:14:10.944987+0000","last_fullsized":"2023-10-25T16:14:10.944987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:01.937535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894171+0000","last_change":"2023-10-25T16:14:08.894171+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894171+0000","last_undegraded":"2023-10-25T16:14:08.894171+0000","last_fullsized":"2023-10-25T16:14:08.894171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916955+0000","last_change":"2023-10-25T16:14:08.916955+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916955+0000","last_undegraded":"2023-10-25T16:14:08.916955+0000","last_fullsized":"2023-10-25T16:14:08.916955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889616+0000","last_change":"2023-10-25T16:14:08.889616+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889616+0000","last_undegraded":"2023-10-25T16:14:08.889616+0000","last_fullsized":"2023-10-25T16:14:08.889616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.970376+0000","last_change":"2023-10-25T16:14:09.903571+0000","last_active":"2023-10-25T16:14:10.970376+0000","last_peered":"2023-10-25T16:14:10.970376+0000","last_clean":"2023-10-25T16:14:10.970376+0000","last_became_active":"2023-10-25T16:14:09.903046+0000","last_became_peered":"2023-10-25T16:14:09.903046+0000","last_unstale":"2023-10-25T16:14:10.970376+0000","last_undegraded":"2023-10-25T16:14:10.970376+0000","last_fullsized":"2023-10-25T16:14:10.970376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:58:54.186103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897571+0000","last_change":"2023-10-25T16:14:08.897571+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897571+0000","last_undegraded":"2023-10-25T16:14:08.897571+0000","last_fullsized":"2023-10-25T16:14:08.897571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897586+0000","last_change":"2023-10-25T16:14:08.897586+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897586+0000","last_undegraded":"2023-10-25T16:14:08.897586+0000","last_fullsized":"2023-10-25T16:14:08.897586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889511+0000","last_change":"2023-10-25T16:14:08.889511+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889511+0000","last_undegraded":"2023-10-25T16:14:08.889511+0000","last_fullsized":"2023-10-25T16:14:08.889511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.899365+0000","last_change":"2023-10-25T16:14:08.899365+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.899365+0000","last_undegraded":"2023-10-25T16:14:08.899365+0000","last_fullsized":"2023-10-25T16:14:08.899365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889215+0000","last_change":"2023-10-25T16:14:08.889215+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889215+0000","last_undegraded":"2023-10-25T16:14:08.889215+0000","last_fullsized":"2023-10-25T16:14:08.889215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916857+0000","last_change":"2023-10-25T16:14:08.916857+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916857+0000","last_undegraded":"2023-10-25T16:14:08.916857+0000","last_fullsized":"2023-10-25T16:14:08.916857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887938+0000","last_change":"2023-10-25T16:14:08.887938+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887938+0000","last_undegraded":"2023-10-25T16:14:08.887938+0000","last_fullsized":"2023-10-25T16:14:08.887938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888870+0000","last_change":"2023-10-25T16:14:08.888870+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888870+0000","last_undegraded":"2023-10-25T16:14:08.888870+0000","last_fullsized":"2023-10-25T16:14:08.888870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898762+0000","last_change":"2023-10-25T16:14:08.898762+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898762+0000","last_undegraded":"2023-10-25T16:14:08.898762+0000","last_fullsized":"2023-10-25T16:14:08.898762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890071+0000","last_change":"2023-10-25T16:14:08.890071+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890071+0000","last_undegraded":"2023-10-25T16:14:08.890071+0000","last_fullsized":"2023-10-25T16:14:08.890071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888097+0000","last_change":"2023-10-25T16:14:08.888097+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888097+0000","last_undegraded":"2023-10-25T16:14:08.888097+0000","last_fullsized":"2023-10-25T16:14:08.888097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887769+0000","last_change":"2023-10-25T16:14:08.887769+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887769+0000","last_undegraded":"2023-10-25T16:14:08.887769+0000","last_fullsized":"2023-10-25T16:14:08.887769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889900+0000","last_change":"2023-10-25T16:14:08.889900+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889900+0000","last_undegraded":"2023-10-25T16:14:08.889900+0000","last_fullsized":"2023-10-25T16:14:08.889900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898115+0000","last_change":"2023-10-25T16:14:08.898115+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898115+0000","last_undegraded":"2023-10-25T16:14:08.898115+0000","last_fullsized":"2023-10-25T16:14:08.898115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896667+0000","last_change":"2023-10-25T16:14:08.896667+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896667+0000","last_undegraded":"2023-10-25T16:14:08.896667+0000","last_fullsized":"2023-10-25T16:14:08.896667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.959001+0000","last_change":"2023-10-25T16:14:10.958874+0000","last_active":"2023-10-25T16:14:10.959001+0000","last_peered":"2023-10-25T16:14:10.959001+0000","last_clean":"2023-10-25T16:14:10.959001+0000","last_became_active":"2023-10-25T16:14:10.958296+0000","last_became_peered":"2023-10-25T16:14:10.958296+0000","last_unstale":"2023-10-25T16:14:10.959001+0000","last_undegraded":"2023-10-25T16:14:10.959001+0000","last_fullsized":"2023-10-25T16:14:10.959001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:26.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896669+0000","last_change":"2023-10-25T16:14:08.896669+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896669+0000","last_undegraded":"2023-10-25T16:14:08.896669+0000","last_fullsized":"2023-10-25T16:14:08.896669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.958717+0000","last_change":"2023-10-25T16:14:10.958544+0000","last_active":"2023-10-25T16:14:10.958717+0000","last_peered":"2023-10-25T16:14:10.958717+0000","last_clean":"2023-10-25T16:14:10.958717+0000","last_became_active":"2023-10-25T16:14:10.957921+0000","last_became_peered":"2023-10-25T16:14:10.957921+0000","last_unstale":"2023-10-25T16:14:10.958717+0000","last_undegraded":"2023-10-25T16:14:10.958717+0000","last_fullsized":"2023-10-25T16:14:10.958717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:52.704832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.917501+0000","last_change":"2023-10-25T16:14:08.917501+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.917501+0000","last_undegraded":"2023-10-25T16:14:08.917501+0000","last_fullsized":"2023-10-25T16:14:08.917501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.955611+0000","last_change":"2023-10-25T16:14:10.955445+0000","last_active":"2023-10-25T16:14:10.955611+0000","last_peered":"2023-10-25T16:14:10.955611+0000","last_clean":"2023-10-25T16:14:10.955611+0000","last_became_active":"2023-10-25T16:14:10.953936+0000","last_became_peered":"2023-10-25T16:14:10.953936+0000","last_unstale":"2023-10-25T16:14:10.955611+0000","last_undegraded":"2023-10-25T16:14:10.955611+0000","last_fullsized":"2023-10-25T16:14:10.955611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:15.520022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.895232+0000","last_change":"2023-10-25T16:14:08.895232+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.895232+0000","last_undegraded":"2023-10-25T16:14:08.895232+0000","last_fullsized":"2023-10-25T16:14:08.895232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951050+0000","last_change":"2023-10-25T16:14:10.950887+0000","last_active":"2023-10-25T16:14:10.951050+0000","last_peered":"2023-10-25T16:14:10.951050+0000","last_clean":"2023-10-25T16:14:10.951050+0000","last_became_active":"2023-10-25T16:14:10.947905+0000","last_became_peered":"2023-10-25T16:14:10.947905+0000","last_unstale":"2023-10-25T16:14:10.951050+0000","last_undegraded":"2023-10-25T16:14:10.951050+0000","last_fullsized":"2023-10-25T16:14:10.951050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:05.721268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897327+0000","last_change":"2023-10-25T16:14:08.897327+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897327+0000","last_undegraded":"2023-10-25T16:14:08.897327+0000","last_fullsized":"2023-10-25T16:14:08.897327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887934+0000","last_change":"2023-10-25T16:14:08.887934+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887934+0000","last_undegraded":"2023-10-25T16:14:08.887934+0000","last_fullsized":"2023-10-25T16:14:08.887934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951361+0000","last_change":"2023-10-25T16:14:10.951202+0000","last_active":"2023-10-25T16:14:10.951361+0000","last_peered":"2023-10-25T16:14:10.951361+0000","last_clean":"2023-10-25T16:14:10.951361+0000","last_became_active":"2023-10-25T16:14:10.950592+0000","last_became_peered":"2023-10-25T16:14:10.950592+0000","last_unstale":"2023-10-25T16:14:10.951361+0000","last_undegraded":"2023-10-25T16:14:10.951361+0000","last_fullsized":"2023-10-25T16:14:10.951361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:43.328417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.891308+0000","last_change":"2023-10-25T16:14:08.891308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.891308+0000","last_undegraded":"2023-10-25T16:14:08.891308+0000","last_fullsized":"2023-10-25T16:14:08.891308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916958+0000","last_change":"2023-10-25T16:14:08.916958+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916958+0000","last_undegraded":"2023-10-25T16:14:08.916958+0000","last_fullsized":"2023-10-25T16:14:08.916958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890308+0000","last_change":"2023-10-25T16:14:08.890308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890308+0000","last_undegraded":"2023-10-25T16:14:08.890308+0000","last_fullsized":"2023-10-25T16:14:08.890308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916953+0000","last_change":"2023-10-25T16:14:08.916953+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916953+0000","last_undegraded":"2023-10-25T16:14:08.916953+0000","last_fullsized":"2023-10-25T16:14:08.916953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890510+0000","last_change":"2023-10-25T16:14:08.890510+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890510+0000","last_undegraded":"2023-10-25T16:14:08.890510+0000","last_fullsized":"2023-10-25T16:14:08.890510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896647+0000","last_change":"2023-10-25T16:14:08.896647+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896647+0000","last_undegraded":"2023-10-25T16:14:08.896647+0000","last_fullsized":"2023-10-25T16:14:08.896647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888109+0000","last_change":"2023-10-25T16:14:08.888109+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888109+0000","last_undegraded":"2023-10-25T16:14:08.888109+0000","last_fullsized":"2023-10-25T16:14:08.888109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894318+0000","last_change":"2023-10-25T16:14:08.894318+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894318+0000","last_undegraded":"2023-10-25T16:14:08.894318+0000","last_fullsized":"2023-10-25T16:14:08.894318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-25T16:14:05.393545+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:05.393545+0000","last_peered":"2023-10-25T16:14:05.393545+0000","last_clean":"2023-10-25T16:14:05.393545+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:05.393545+0000","last_undegraded":"2023-10-25T16:14:05.393545+0000","last_fullsized":"2023-10-25T16:14:05.393545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.98999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1850000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.878},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.80600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.25}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.2070000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0329999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.135},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92300000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.097},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.071}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.85899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":1.0860000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.749},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.95099999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.228},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.70399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.755}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.149},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.97199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.0569999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.01}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195184,"statfs":{"total":200000000,"available":199868669,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.91600000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.62}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":0.72099999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:13.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:14.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 -- 172.21.15.177:0/1564626064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e80af5d0 msgr2=0x7fb4e806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 --2- 172.21.15.177:0/1564626064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e80af5d0 0x7fb4e806ba70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009bf0 tx=0x7fb4e001cb40 comp rx=0 tx=0).stop 2023-10-25T16:14:14.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 -- 172.21.15.177:0/1564626064 shutdown_connections 2023-10-25T16:14:14.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 --2- 172.21.15.177:0/1564626064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e80af5d0 0x7fb4e806ba70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 -- 172.21.15.177:0/1564626064 >> 172.21.15.177:0/1564626064 conn(0x7fb4e80b2450 msgr2=0x7fb4e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:14.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 -- 172.21.15.177:0/1564626064 shutdown_connections 2023-10-25T16:14:14.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 -- 172.21.15.177:0/1564626064 wait complete. 2023-10-25T16:14:14.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 Processor -- start 2023-10-25T16:14:14.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.087+0000 7fb4ec987640 1 -- start start 2023-10-25T16:14:14.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4e80af5d0 0x7fb4e813cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4e813d8f0 0x7fb4e813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 0x7fb4e8139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8139440 con 0x7fb4e815b710 2023-10-25T16:14:14.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80a64a0 con 0x7fb4e80af5d0 2023-10-25T16:14:14.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e81387c0 con 0x7fb4e813d8f0 2023-10-25T16:14:14.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 0x7fb4e8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 0x7fb4e8139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38402/0 (socket says 172.21.15.177:38402) 2023-10-25T16:14:14.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 -- 172.21.15.177:0/3634092166 learned_addr learned my addr 172.21.15.177:0/3634092166 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:14.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e659c640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4e80af5d0 0x7fb4e813cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 -- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4e813d8f0 msgr2=0x7fb4e813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4e813d8f0 0x7fb4e813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 -- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4e80af5d0 msgr2=0x7fb4e813cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4e80af5d0 0x7fb4e813cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 -- 172.21.15.177:0/3634092166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009820 con 0x7fb4e815b710 2023-10-25T16:14:14.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e659c640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4e80af5d0 0x7fb4e813cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:14.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e6d9d640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 0x7fb4e8139860 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00b0040 tx=0x7fb4e00a5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:14.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00041e0 con 0x7fb4e815b710 2023-10-25T16:14:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb4e0004430 con 0x7fb4e815b710 2023-10-25T16:14:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00047c0 con 0x7fb4e815b710 2023-10-25T16:14:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8138aa0 con 0x7fb4e815b710 2023-10-25T16:14:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e8139060 con 0x7fb4e815b710 2023-10-25T16:14:14.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e8139580 con 0x7fb4e815b710 2023-10-25T16:14:14.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb4e00b4040 con 0x7fb4e815b710 2023-10-25T16:14:14.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4deffd640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb4c8066470 0x7fb4c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e011ed50 con 0x7fb4e815b710 2023-10-25T16:14:14.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e659c640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb4c8066470 0x7fb4c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.091+0000 7fb4e659c640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb4c8066470 0x7fb4c8068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8000f70 tx=0x7fb4d8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:14.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.095+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4e0122030 con 0x7fb4e815b710 2023-10-25T16:14:14.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.243+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4e8139580 con 0x7fb4c8066470 2023-10-25T16:14:14.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.263+0000 7fb4deffd640 1 -- 172.21.15.177:0/3634092166 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274729 (secure 0 0 0) 0x7fb4e8139580 con 0x7fb4c8066470 2023-10-25T16:14:14.273 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:14.275 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:14.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb4c8066470 msgr2=0x7fb4c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb4c8066470 0x7fb4c8068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8000f70 tx=0x7fb4d8009040 comp rx=0 tx=0).stop 2023-10-25T16:14:14.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 msgr2=0x7fb4e8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 0x7fb4e8139860 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00b0040 tx=0x7fb4e00a5970 comp rx=0 tx=0).stop 2023-10-25T16:14:14.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 shutdown_connections 2023-10-25T16:14:14.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb4c8066470 0x7fb4c8068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e815b710 0x7fb4e8139860 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb4e813d8f0 0x7fb4e813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 --2- 172.21.15.177:0/3634092166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4e80af5d0 0x7fb4e813cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 >> 172.21.15.177:0/3634092166 conn(0x7fb4e80b2450 msgr2=0x7fb4e80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 shutdown_connections 2023-10-25T16:14:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.267+0000 7fb4ec987640 1 -- 172.21.15.177:0/3634092166 wait complete. 2023-10-25T16:14:14.292 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-25T16:14:12.614668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560274,"statfs":{"total":1600000000,"available":1597720602,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001237"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.953527+0000","last_change":"2023-10-25T16:14:10.953124+0000","last_active":"2023-10-25T16:14:10.953527+0000","last_peered":"2023-10-25T16:14:10.953527+0000","last_clean":"2023-10-25T16:14:10.953527+0000","last_became_active":"2023-10-25T16:14:10.952432+0000","last_became_peered":"2023-10-25T16:14:10.952432+0000","last_unstale":"2023-10-25T16:14:10.953527+0000","last_undegraded":"2023-10-25T16:14:10.953527+0000","last_fullsized":"2023-10-25T16:14:10.953527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:30:26.675353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.956014+0000","last_change":"2023-10-25T16:14:10.955870+0000","last_active":"2023-10-25T16:14:10.956014+0000","last_peered":"2023-10-25T16:14:10.956014+0000","last_clean":"2023-10-25T16:14:10.956014+0000","last_became_active":"2023-10-25T16:14:10.954791+0000","last_became_peered":"2023-10-25T16:14:10.954791+0000","last_unstale":"2023-10-25T16:14:10.956014+0000","last_undegraded":"2023-10-25T16:14:10.956014+0000","last_fullsized":"2023-10-25T16:14:10.956014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:31.884348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.944987+0000","last_change":"2023-10-25T16:14:10.944831+0000","last_active":"2023-10-25T16:14:10.944987+0000","last_peered":"2023-10-25T16:14:10.944987+0000","last_clean":"2023-10-25T16:14:10.944987+0000","last_became_active":"2023-10-25T16:14:10.944176+0000","last_became_peered":"2023-10-25T16:14:10.944176+0000","last_unstale":"2023-10-25T16:14:10.944987+0000","last_undegraded":"2023-10-25T16:14:10.944987+0000","last_fullsized":"2023-10-25T16:14:10.944987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:01.937535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894171+0000","last_change":"2023-10-25T16:14:08.894171+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894171+0000","last_undegraded":"2023-10-25T16:14:08.894171+0000","last_fullsized":"2023-10-25T16:14:08.894171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916955+0000","last_change":"2023-10-25T16:14:08.916955+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916955+0000","last_undegraded":"2023-10-25T16:14:08.916955+0000","last_fullsized":"2023-10-25T16:14:08.916955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889616+0000","last_change":"2023-10-25T16:14:08.889616+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889616+0000","last_undegraded":"2023-10-25T16:14:08.889616+0000","last_fullsized":"2023-10-25T16:14:08.889616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.970376+0000","last_change":"2023-10-25T16:14:09.903571+0000","last_active":"2023-10-25T16:14:10.970376+0000","last_peered":"2023-10-25T16:14:10.970376+0000","last_clean":"2023-10-25T16:14:10.970376+0000","last_became_active":"2023-10-25T16:14:09.903046+0000","last_became_peered":"2023-10-25T16:14:09.903046+0000","last_unstale":"2023-10-25T16:14:10.970376+0000","last_undegraded":"2023-10-25T16:14:10.970376+0000","last_fullsized":"2023-10-25T16:14:10.970376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:58:54.186103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897571+0000","last_change":"2023-10-25T16:14:08.897571+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897571+0000","last_undegraded":"2023-10-25T16:14:08.897571+0000","last_fullsized":"2023-10-25T16:14:08.897571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897586+0000","last_change":"2023-10-25T16:14:08.897586+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897586+0000","last_undegraded":"2023-10-25T16:14:08.897586+0000","last_fullsized":"2023-10-25T16:14:08.897586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889511+0000","last_change":"2023-10-25T16:14:08.889511+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889511+0000","last_undegraded":"2023-10-25T16:14:08.889511+0000","last_fullsized":"2023-10-25T16:14:08.889511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.899365+0000","last_change":"2023-10-25T16:14:08.899365+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.899365+0000","last_undegraded":"2023-10-25T16:14:08.899365+0000","last_fullsized":"2023-10-25T16:14:08.899365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889215+0000","last_change":"2023-10-25T16:14:08.889215+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889215+0000","last_undegraded":"2023-10-25T16:14:08.889215+0000","last_fullsized":"2023-10-25T16:14:08.889215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916857+0000","last_change":"2023-10-25T16:14:08.916857+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916857+0000","last_undegraded":"2023-10-25T16:14:08.916857+0000","last_fullsized":"2023-10-25T16:14:08.916857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887938+0000","last_change":"2023-10-25T16:14:08.887938+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887938+0000","last_undegraded":"2023-10-25T16:14:08.887938+0000","last_fullsized":"2023-10-25T16:14:08.887938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888870+0000","last_change":"2023-10-25T16:14:08.888870+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888870+0000","last_undegraded":"2023-10-25T16:14:08.888870+0000","last_fullsized":"2023-10-25T16:14:08.888870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898762+0000","last_change":"2023-10-25T16:14:08.898762+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898762+0000","last_undegraded":"2023-10-25T16:14:08.898762+0000","last_fullsized":"2023-10-25T16:14:08.898762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890071+0000","last_change":"2023-10-25T16:14:08.890071+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890071+0000","last_undegraded":"2023-10-25T16:14:08.890071+0000","last_fullsized":"2023-10-25T16:14:08.890071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888097+0000","last_change":"2023-10-25T16:14:08.888097+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888097+0000","last_undegraded":"2023-10-25T16:14:08.888097+0000","last_fullsized":"2023-10-25T16:14:08.888097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887769+0000","last_change":"2023-10-25T16:14:08.887769+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887769+0000","last_undegraded":"2023-10-25T16:14:08.887769+0000","last_fullsized":"2023-10-25T16:14:08.887769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889900+0000","last_change":"2023-10-25T16:14:08.889900+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889900+0000","last_undegraded":"2023-10-25T16:14:08.889900+0000","last_fullsized":"2023-10-25T16:14:08.889900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898115+0000","last_change":"2023-10-25T16:14:08.898115+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898115+0000","last_undegraded":"2023-10-25T16:14:08.898115+0000","last_fullsized":"2023-10-25T16:14:08.898115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896667+0000","last_change":"2023-10-25T16:14:08.896667+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896667+0000","last_undegraded":"2023-10-25T16:14:08.896667+0000","last_fullsized":"2023-10-25T16:14:08.896667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.959001+0000","last_change":"2023-10-25T16:14:10.958874+0000","last_active":"2023-10-25T16:14:10.959001+0000","last_peered":"2023-10-25T16:14:10.959001+0000","last_clean":"2023-10-25T16:14:10.959001+0000","last_became_active":"2023-10-25T16:14:10.958296+0000","last_became_peered":"2023-10-25T16:14:10.958296+0000","last_unstale":"2023-10-25T16:14:10.959001+0000","last_undegraded":"2023-10-25T16:14:10.959001+0000","last_fullsized":"2023-10-25T16:14:10.959001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:26.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896669+0000","last_change":"2023-10-25T16:14:08.896669+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896669+0000","last_undegraded":"2023-10-25T16:14:08.896669+0000","last_fullsized":"2023-10-25T16:14:08.896669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.958717+0000","last_change":"2023-10-25T16:14:10.958544+0000","last_active":"2023-10-25T16:14:10.958717+0000","last_peered":"2023-10-25T16:14:10.958717+0000","last_clean":"2023-10-25T16:14:10.958717+0000","last_became_active":"2023-10-25T16:14:10.957921+0000","last_became_peered":"2023-10-25T16:14:10.957921+0000","last_unstale":"2023-10-25T16:14:10.958717+0000","last_undegraded":"2023-10-25T16:14:10.958717+0000","last_fullsized":"2023-10-25T16:14:10.958717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:52.704832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.917501+0000","last_change":"2023-10-25T16:14:08.917501+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.917501+0000","last_undegraded":"2023-10-25T16:14:08.917501+0000","last_fullsized":"2023-10-25T16:14:08.917501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.955611+0000","last_change":"2023-10-25T16:14:10.955445+0000","last_active":"2023-10-25T16:14:10.955611+0000","last_peered":"2023-10-25T16:14:10.955611+0000","last_clean":"2023-10-25T16:14:10.955611+0000","last_became_active":"2023-10-25T16:14:10.953936+0000","last_became_peered":"2023-10-25T16:14:10.953936+0000","last_unstale":"2023-10-25T16:14:10.955611+0000","last_undegraded":"2023-10-25T16:14:10.955611+0000","last_fullsized":"2023-10-25T16:14:10.955611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:15.520022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.895232+0000","last_change":"2023-10-25T16:14:08.895232+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.895232+0000","last_undegraded":"2023-10-25T16:14:08.895232+0000","last_fullsized":"2023-10-25T16:14:08.895232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951050+0000","last_change":"2023-10-25T16:14:10.950887+0000","last_active":"2023-10-25T16:14:10.951050+0000","last_peered":"2023-10-25T16:14:10.951050+0000","last_clean":"2023-10-25T16:14:10.951050+0000","last_became_active":"2023-10-25T16:14:10.947905+0000","last_became_peered":"2023-10-25T16:14:10.947905+0000","last_unstale":"2023-10-25T16:14:10.951050+0000","last_undegraded":"2023-10-25T16:14:10.951050+0000","last_fullsized":"2023-10-25T16:14:10.951050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:05.721268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897327+0000","last_change":"2023-10-25T16:14:08.897327+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897327+0000","last_undegraded":"2023-10-25T16:14:08.897327+0000","last_fullsized":"2023-10-25T16:14:08.897327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887934+0000","last_change":"2023-10-25T16:14:08.887934+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887934+0000","last_undegraded":"2023-10-25T16:14:08.887934+0000","last_fullsized":"2023-10-25T16:14:08.887934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951361+0000","last_change":"2023-10-25T16:14:10.951202+0000","last_active":"2023-10-25T16:14:10.951361+0000","last_peered":"2023-10-25T16:14:10.951361+0000","last_clean":"2023-10-25T16:14:10.951361+0000","last_became_active":"2023-10-25T16:14:10.950592+0000","last_became_peered":"2023-10-25T16:14:10.950592+0000","last_unstale":"2023-10-25T16:14:10.951361+0000","last_undegraded":"2023-10-25T16:14:10.951361+0000","last_fullsized":"2023-10-25T16:14:10.951361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:43.328417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.891308+0000","last_change":"2023-10-25T16:14:08.891308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.891308+0000","last_undegraded":"2023-10-25T16:14:08.891308+0000","last_fullsized":"2023-10-25T16:14:08.891308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916958+0000","last_change":"2023-10-25T16:14:08.916958+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916958+0000","last_undegraded":"2023-10-25T16:14:08.916958+0000","last_fullsized":"2023-10-25T16:14:08.916958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890308+0000","last_change":"2023-10-25T16:14:08.890308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890308+0000","last_undegraded":"2023-10-25T16:14:08.890308+0000","last_fullsized":"2023-10-25T16:14:08.890308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916953+0000","last_change":"2023-10-25T16:14:08.916953+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916953+0000","last_undegraded":"2023-10-25T16:14:08.916953+0000","last_fullsized":"2023-10-25T16:14:08.916953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890510+0000","last_change":"2023-10-25T16:14:08.890510+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890510+0000","last_undegraded":"2023-10-25T16:14:08.890510+0000","last_fullsized":"2023-10-25T16:14:08.890510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896647+0000","last_change":"2023-10-25T16:14:08.896647+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896647+0000","last_undegraded":"2023-10-25T16:14:08.896647+0000","last_fullsized":"2023-10-25T16:14:08.896647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888109+0000","last_change":"2023-10-25T16:14:08.888109+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888109+0000","last_undegraded":"2023-10-25T16:14:08.888109+0000","last_fullsized":"2023-10-25T16:14:08.888109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894318+0000","last_change":"2023-10-25T16:14:08.894318+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894318+0000","last_undegraded":"2023-10-25T16:14:08.894318+0000","last_fullsized":"2023-10-25T16:14:08.894318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-25T16:14:05.393545+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:05.393545+0000","last_peered":"2023-10-25T16:14:05.393545+0000","last_clean":"2023-10-25T16:14:05.393545+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:05.393545+0000","last_undegraded":"2023-10-25T16:14:05.393545+0000","last_fullsized":"2023-10-25T16:14:05.393545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.98999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1850000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.878},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.80600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.25}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.2070000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0329999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.135},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92300000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.097},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.071}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.85899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":1.0860000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.749},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.95099999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.228},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.70399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.755}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.149},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.97199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.0569999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.01}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195184,"statfs":{"total":200000000,"available":199868669,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.91600000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.62}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":0.72099999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:14.298 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:14.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/4164362737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800cdb10 msgr2=0x7f90800cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 --2- 172.21.15.177:0/4164362737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800cdb10 0x7f90800cdf80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f908009f200 tx=0x7f907801ccd0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/4164362737 shutdown_connections 2023-10-25T16:14:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 --2- 172.21.15.177:0/4164362737 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800cdb10 0x7f90800cdf80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 --2- 172.21.15.177:0/4164362737 >> v2:172.21.15.184:3300/0 conn(0x7f90800b2120 0x7f90800b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/4164362737 >> 172.21.15.177:0/4164362737 conn(0x7f908009a5c0 msgr2=0x7f90800d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:14.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/4164362737 shutdown_connections 2023-10-25T16:14:14.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/4164362737 wait complete. 2023-10-25T16:14:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 Processor -- start 2023-10-25T16:14:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- start start 2023-10-25T16:14:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 0x7f908015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90800cdb10 0x7f9080153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908015eba0 0x7f90801578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015a840 con 0x7f90800b2120 2023-10-25T16:14:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080154240 con 0x7f908015eba0 2023-10-25T16:14:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908015aa30 con 0x7f90800cdb10 2023-10-25T16:14:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 0x7f908015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 0x7f908015a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38412/0 (socket says 172.21.15.177:38412) 2023-10-25T16:14:14.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 -- 172.21.15.177:0/1252053500 learned_addr learned my addr 172.21.15.177:0/1252053500 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:14.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085d8a640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908015eba0 0x7f90801578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9084d88640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90800cdb10 0x7f9080153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 -- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90800cdb10 msgr2=0x7f9080153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90800cdb10 0x7f9080153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 -- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908015eba0 msgr2=0x7f90801578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908015eba0 0x7f90801578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 -- 172.21.15.177:0/1252053500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780098e0 con 0x7f90800b2120 2023-10-25T16:14:14.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9085589640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 0x7f908015a300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c370 tx=0x7f907c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:14.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0052d0 con 0x7f90800b2120 2023-10-25T16:14:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f907c007020 con 0x7f90800b2120 2023-10-25T16:14:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800b5d70 con 0x7f90800b2120 2023-10-25T16:14:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c007430 con 0x7f90800b2120 2023-10-25T16:14:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800b6850 con 0x7f90800b2120 2023-10-25T16:14:14.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.451+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90800b6570 con 0x7f90800b2120 2023-10-25T16:14:14.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.455+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f907c0067e0 con 0x7f90800b2120 2023-10-25T16:14:14.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.455+0000 7f9075ffb640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.455+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f907c083350 con 0x7f90800b2120 2023-10-25T16:14:14.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.455+0000 7f9084d88640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.455+0000 7f9084d88640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f90800c82e0 tx=0x7f90700091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:14.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.459+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90800b6570 con 0x7f90800b2120 2023-10-25T16:14:14.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.603+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90800b5f60 con 0x7f9064066470 2023-10-25T16:14:14.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.623+0000 7f9075ffb640 1 -- 172.21.15.177:0/1252053500 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274729 (secure 0 0 0) 0x7f90800b5f60 con 0x7f9064066470 2023-10-25T16:14:14.629 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 msgr2=0x7f9064068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f90800c82e0 tx=0x7f90700091e0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 msgr2=0x7f908015a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 0x7f908015a300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c370 tx=0x7f907c00c830 comp rx=0 tx=0).stop 2023-10-25T16:14:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 shutdown_connections 2023-10-25T16:14:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908015eba0 0x7f90801578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90800cdb10 0x7f9080153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 --2- 172.21.15.177:0/1252053500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90800b2120 0x7f908015a300 secure :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c370 tx=0x7f907c00c830 comp rx=0 tx=0).stop 2023-10-25T16:14:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 >> 172.21.15.177:0/1252053500 conn(0x7f908009a5c0 msgr2=0x7f90800d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 shutdown_connections 2023-10-25T16:14:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.627+0000 7f90877ed640 1 -- 172.21.15.177:0/1252053500 wait complete. 2023-10-25T16:14:14.648 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-25T16:14:12.614668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560274,"statfs":{"total":1600000000,"available":1597720602,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001237"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.953527+0000","last_change":"2023-10-25T16:14:10.953124+0000","last_active":"2023-10-25T16:14:10.953527+0000","last_peered":"2023-10-25T16:14:10.953527+0000","last_clean":"2023-10-25T16:14:10.953527+0000","last_became_active":"2023-10-25T16:14:10.952432+0000","last_became_peered":"2023-10-25T16:14:10.952432+0000","last_unstale":"2023-10-25T16:14:10.953527+0000","last_undegraded":"2023-10-25T16:14:10.953527+0000","last_fullsized":"2023-10-25T16:14:10.953527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:30:26.675353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.956014+0000","last_change":"2023-10-25T16:14:10.955870+0000","last_active":"2023-10-25T16:14:10.956014+0000","last_peered":"2023-10-25T16:14:10.956014+0000","last_clean":"2023-10-25T16:14:10.956014+0000","last_became_active":"2023-10-25T16:14:10.954791+0000","last_became_peered":"2023-10-25T16:14:10.954791+0000","last_unstale":"2023-10-25T16:14:10.956014+0000","last_undegraded":"2023-10-25T16:14:10.956014+0000","last_fullsized":"2023-10-25T16:14:10.956014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:31.884348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.944987+0000","last_change":"2023-10-25T16:14:10.944831+0000","last_active":"2023-10-25T16:14:10.944987+0000","last_peered":"2023-10-25T16:14:10.944987+0000","last_clean":"2023-10-25T16:14:10.944987+0000","last_became_active":"2023-10-25T16:14:10.944176+0000","last_became_peered":"2023-10-25T16:14:10.944176+0000","last_unstale":"2023-10-25T16:14:10.944987+0000","last_undegraded":"2023-10-25T16:14:10.944987+0000","last_fullsized":"2023-10-25T16:14:10.944987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:01.937535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894171+0000","last_change":"2023-10-25T16:14:08.894171+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894171+0000","last_undegraded":"2023-10-25T16:14:08.894171+0000","last_fullsized":"2023-10-25T16:14:08.894171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916955+0000","last_change":"2023-10-25T16:14:08.916955+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916955+0000","last_undegraded":"2023-10-25T16:14:08.916955+0000","last_fullsized":"2023-10-25T16:14:08.916955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889616+0000","last_change":"2023-10-25T16:14:08.889616+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889616+0000","last_undegraded":"2023-10-25T16:14:08.889616+0000","last_fullsized":"2023-10-25T16:14:08.889616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.970376+0000","last_change":"2023-10-25T16:14:09.903571+0000","last_active":"2023-10-25T16:14:10.970376+0000","last_peered":"2023-10-25T16:14:10.970376+0000","last_clean":"2023-10-25T16:14:10.970376+0000","last_became_active":"2023-10-25T16:14:09.903046+0000","last_became_peered":"2023-10-25T16:14:09.903046+0000","last_unstale":"2023-10-25T16:14:10.970376+0000","last_undegraded":"2023-10-25T16:14:10.970376+0000","last_fullsized":"2023-10-25T16:14:10.970376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:58:54.186103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897571+0000","last_change":"2023-10-25T16:14:08.897571+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897571+0000","last_undegraded":"2023-10-25T16:14:08.897571+0000","last_fullsized":"2023-10-25T16:14:08.897571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897586+0000","last_change":"2023-10-25T16:14:08.897586+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897586+0000","last_undegraded":"2023-10-25T16:14:08.897586+0000","last_fullsized":"2023-10-25T16:14:08.897586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889511+0000","last_change":"2023-10-25T16:14:08.889511+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889511+0000","last_undegraded":"2023-10-25T16:14:08.889511+0000","last_fullsized":"2023-10-25T16:14:08.889511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.899365+0000","last_change":"2023-10-25T16:14:08.899365+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.899365+0000","last_undegraded":"2023-10-25T16:14:08.899365+0000","last_fullsized":"2023-10-25T16:14:08.899365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889215+0000","last_change":"2023-10-25T16:14:08.889215+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889215+0000","last_undegraded":"2023-10-25T16:14:08.889215+0000","last_fullsized":"2023-10-25T16:14:08.889215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916857+0000","last_change":"2023-10-25T16:14:08.916857+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916857+0000","last_undegraded":"2023-10-25T16:14:08.916857+0000","last_fullsized":"2023-10-25T16:14:08.916857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887938+0000","last_change":"2023-10-25T16:14:08.887938+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887938+0000","last_undegraded":"2023-10-25T16:14:08.887938+0000","last_fullsized":"2023-10-25T16:14:08.887938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888870+0000","last_change":"2023-10-25T16:14:08.888870+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888870+0000","last_undegraded":"2023-10-25T16:14:08.888870+0000","last_fullsized":"2023-10-25T16:14:08.888870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898762+0000","last_change":"2023-10-25T16:14:08.898762+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898762+0000","last_undegraded":"2023-10-25T16:14:08.898762+0000","last_fullsized":"2023-10-25T16:14:08.898762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890071+0000","last_change":"2023-10-25T16:14:08.890071+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890071+0000","last_undegraded":"2023-10-25T16:14:08.890071+0000","last_fullsized":"2023-10-25T16:14:08.890071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888097+0000","last_change":"2023-10-25T16:14:08.888097+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888097+0000","last_undegraded":"2023-10-25T16:14:08.888097+0000","last_fullsized":"2023-10-25T16:14:08.888097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887769+0000","last_change":"2023-10-25T16:14:08.887769+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887769+0000","last_undegraded":"2023-10-25T16:14:08.887769+0000","last_fullsized":"2023-10-25T16:14:08.887769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889900+0000","last_change":"2023-10-25T16:14:08.889900+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889900+0000","last_undegraded":"2023-10-25T16:14:08.889900+0000","last_fullsized":"2023-10-25T16:14:08.889900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898115+0000","last_change":"2023-10-25T16:14:08.898115+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898115+0000","last_undegraded":"2023-10-25T16:14:08.898115+0000","last_fullsized":"2023-10-25T16:14:08.898115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896667+0000","last_change":"2023-10-25T16:14:08.896667+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896667+0000","last_undegraded":"2023-10-25T16:14:08.896667+0000","last_fullsized":"2023-10-25T16:14:08.896667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.959001+0000","last_change":"2023-10-25T16:14:10.958874+0000","last_active":"2023-10-25T16:14:10.959001+0000","last_peered":"2023-10-25T16:14:10.959001+0000","last_clean":"2023-10-25T16:14:10.959001+0000","last_became_active":"2023-10-25T16:14:10.958296+0000","last_became_peered":"2023-10-25T16:14:10.958296+0000","last_unstale":"2023-10-25T16:14:10.959001+0000","last_undegraded":"2023-10-25T16:14:10.959001+0000","last_fullsized":"2023-10-25T16:14:10.959001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:26.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896669+0000","last_change":"2023-10-25T16:14:08.896669+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896669+0000","last_undegraded":"2023-10-25T16:14:08.896669+0000","last_fullsized":"2023-10-25T16:14:08.896669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.958717+0000","last_change":"2023-10-25T16:14:10.958544+0000","last_active":"2023-10-25T16:14:10.958717+0000","last_peered":"2023-10-25T16:14:10.958717+0000","last_clean":"2023-10-25T16:14:10.958717+0000","last_became_active":"2023-10-25T16:14:10.957921+0000","last_became_peered":"2023-10-25T16:14:10.957921+0000","last_unstale":"2023-10-25T16:14:10.958717+0000","last_undegraded":"2023-10-25T16:14:10.958717+0000","last_fullsized":"2023-10-25T16:14:10.958717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:52.704832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.917501+0000","last_change":"2023-10-25T16:14:08.917501+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.917501+0000","last_undegraded":"2023-10-25T16:14:08.917501+0000","last_fullsized":"2023-10-25T16:14:08.917501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.955611+0000","last_change":"2023-10-25T16:14:10.955445+0000","last_active":"2023-10-25T16:14:10.955611+0000","last_peered":"2023-10-25T16:14:10.955611+0000","last_clean":"2023-10-25T16:14:10.955611+0000","last_became_active":"2023-10-25T16:14:10.953936+0000","last_became_peered":"2023-10-25T16:14:10.953936+0000","last_unstale":"2023-10-25T16:14:10.955611+0000","last_undegraded":"2023-10-25T16:14:10.955611+0000","last_fullsized":"2023-10-25T16:14:10.955611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:15.520022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.895232+0000","last_change":"2023-10-25T16:14:08.895232+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.895232+0000","last_undegraded":"2023-10-25T16:14:08.895232+0000","last_fullsized":"2023-10-25T16:14:08.895232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951050+0000","last_change":"2023-10-25T16:14:10.950887+0000","last_active":"2023-10-25T16:14:10.951050+0000","last_peered":"2023-10-25T16:14:10.951050+0000","last_clean":"2023-10-25T16:14:10.951050+0000","last_became_active":"2023-10-25T16:14:10.947905+0000","last_became_peered":"2023-10-25T16:14:10.947905+0000","last_unstale":"2023-10-25T16:14:10.951050+0000","last_undegraded":"2023-10-25T16:14:10.951050+0000","last_fullsized":"2023-10-25T16:14:10.951050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:05.721268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897327+0000","last_change":"2023-10-25T16:14:08.897327+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897327+0000","last_undegraded":"2023-10-25T16:14:08.897327+0000","last_fullsized":"2023-10-25T16:14:08.897327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887934+0000","last_change":"2023-10-25T16:14:08.887934+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887934+0000","last_undegraded":"2023-10-25T16:14:08.887934+0000","last_fullsized":"2023-10-25T16:14:08.887934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951361+0000","last_change":"2023-10-25T16:14:10.951202+0000","last_active":"2023-10-25T16:14:10.951361+0000","last_peered":"2023-10-25T16:14:10.951361+0000","last_clean":"2023-10-25T16:14:10.951361+0000","last_became_active":"2023-10-25T16:14:10.950592+0000","last_became_peered":"2023-10-25T16:14:10.950592+0000","last_unstale":"2023-10-25T16:14:10.951361+0000","last_undegraded":"2023-10-25T16:14:10.951361+0000","last_fullsized":"2023-10-25T16:14:10.951361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:43.328417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.891308+0000","last_change":"2023-10-25T16:14:08.891308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.891308+0000","last_undegraded":"2023-10-25T16:14:08.891308+0000","last_fullsized":"2023-10-25T16:14:08.891308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916958+0000","last_change":"2023-10-25T16:14:08.916958+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916958+0000","last_undegraded":"2023-10-25T16:14:08.916958+0000","last_fullsized":"2023-10-25T16:14:08.916958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890308+0000","last_change":"2023-10-25T16:14:08.890308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890308+0000","last_undegraded":"2023-10-25T16:14:08.890308+0000","last_fullsized":"2023-10-25T16:14:08.890308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916953+0000","last_change":"2023-10-25T16:14:08.916953+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916953+0000","last_undegraded":"2023-10-25T16:14:08.916953+0000","last_fullsized":"2023-10-25T16:14:08.916953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890510+0000","last_change":"2023-10-25T16:14:08.890510+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890510+0000","last_undegraded":"2023-10-25T16:14:08.890510+0000","last_fullsized":"2023-10-25T16:14:08.890510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896647+0000","last_change":"2023-10-25T16:14:08.896647+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896647+0000","last_undegraded":"2023-10-25T16:14:08.896647+0000","last_fullsized":"2023-10-25T16:14:08.896647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888109+0000","last_change":"2023-10-25T16:14:08.888109+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888109+0000","last_undegraded":"2023-10-25T16:14:08.888109+0000","last_fullsized":"2023-10-25T16:14:08.888109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894318+0000","last_change":"2023-10-25T16:14:08.894318+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894318+0000","last_undegraded":"2023-10-25T16:14:08.894318+0000","last_fullsized":"2023-10-25T16:14:08.894318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-25T16:14:05.393545+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:05.393545+0000","last_peered":"2023-10-25T16:14:05.393545+0000","last_clean":"2023-10-25T16:14:05.393545+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:05.393545+0000","last_undegraded":"2023-10-25T16:14:05.393545+0000","last_fullsized":"2023-10-25T16:14:05.393545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.98999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1850000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.878},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.80600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.25}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.2070000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0329999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.135},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92300000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.097},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.071}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.85899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":1.0860000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.749},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.95099999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.228},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.70399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.755}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.149},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.97199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.0569999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.01}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195184,"statfs":{"total":200000000,"available":199868669,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.91600000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.62}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":0.72099999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:14.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-10-25T16:14:14.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-10-25T16:14:14.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-10-25T16:14:14.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-10-25T16:14:14.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-10-25T16:14:14.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-10-25T16:14:14.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-10-25T16:14:14.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-10-25T16:14:14.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-10-25T16:14:14.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-10-25T16:14:14.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-10-25T16:14:14.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-10-25T16:14:14.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-10-25T16:14:14.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-10-25T16:14:14.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-10-25T16:14:14.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-10-25T16:14:14.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-10-25T16:14:14.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-10-25T16:14:14.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-10-25T16:14:14.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-10-25T16:14:14.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-10-25T16:14:14.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-10-25T16:14:14.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-10-25T16:14:14.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-10-25T16:14:14.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-10-25T16:14:14.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-10-25T16:14:14.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-10-25T16:14:14.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-10-25T16:14:14.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-10-25T16:14:14.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-10-25T16:14:14.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-25T16:14:14.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.894171+0000', 'last_change': '2023-10-25T16:14:08.894171+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.894171+0000', 'last_undegraded': '2023-10-25T16:14:08.894171+0000', 'last_fullsized': '2023-10-25T16:14:08.894171+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:14:14.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-10-25T16:14:14.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-10-25T16:14:14.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.916955+0000', 'last_change': '2023-10-25T16:14:08.916955+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.916955+0000', 'last_undegraded': '2023-10-25T16:14:08.916955+0000', 'last_fullsized': '2023-10-25T16:14:08.916955+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:14:14.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-10-25T16:14:14.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-25T16:14:14.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.889616+0000', 'last_change': '2023-10-25T16:14:08.889616+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.889616+0000', 'last_undegraded': '2023-10-25T16:14:08.889616+0000', 'last_fullsized': '2023-10-25T16:14:08.889616+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-10-25T16:14:14.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-10-25T16:14:14.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-25T16:14:14.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.897571+0000', 'last_change': '2023-10-25T16:14:08.897571+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.897571+0000', 'last_undegraded': '2023-10-25T16:14:08.897571+0000', 'last_fullsized': '2023-10-25T16:14:08.897571+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-10-25T16:14:14.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-25T16:14:14.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.897586+0000', 'last_change': '2023-10-25T16:14:08.897586+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.897586+0000', 'last_undegraded': '2023-10-25T16:14:08.897586+0000', 'last_fullsized': '2023-10-25T16:14:08.897586+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-10-25T16:14:14.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-25T16:14:14.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.889511+0000', 'last_change': '2023-10-25T16:14:08.889511+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.889511+0000', 'last_undegraded': '2023-10-25T16:14:08.889511+0000', 'last_fullsized': '2023-10-25T16:14:08.889511+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-10-25T16:14:14.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-25T16:14:14.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.899365+0000', 'last_change': '2023-10-25T16:14:08.899365+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.899365+0000', 'last_undegraded': '2023-10-25T16:14:08.899365+0000', 'last_fullsized': '2023-10-25T16:14:08.899365+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-10-25T16:14:14.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-25T16:14:14.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.889215+0000', 'last_change': '2023-10-25T16:14:08.889215+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.889215+0000', 'last_undegraded': '2023-10-25T16:14:08.889215+0000', 'last_fullsized': '2023-10-25T16:14:08.889215+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-25T16:14:14.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-10-25T16:14:14.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.916857+0000', 'last_change': '2023-10-25T16:14:08.916857+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.916857+0000', 'last_undegraded': '2023-10-25T16:14:08.916857+0000', 'last_fullsized': '2023-10-25T16:14:08.916857+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:14:14.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-25T16:14:14.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-25T16:14:14.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.887938+0000', 'last_change': '2023-10-25T16:14:08.887938+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.887938+0000', 'last_undegraded': '2023-10-25T16:14:08.887938+0000', 'last_fullsized': '2023-10-25T16:14:08.887938+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:14:14.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-10-25T16:14:14.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-25T16:14:14.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.888870+0000', 'last_change': '2023-10-25T16:14:08.888870+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.888870+0000', 'last_undegraded': '2023-10-25T16:14:08.888870+0000', 'last_fullsized': '2023-10-25T16:14:08.888870+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-10-25T16:14:14.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-25T16:14:14.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.898762+0000', 'last_change': '2023-10-25T16:14:08.898762+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.898762+0000', 'last_undegraded': '2023-10-25T16:14:08.898762+0000', 'last_fullsized': '2023-10-25T16:14:08.898762+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-25T16:14:14.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-25T16:14:14.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.890071+0000', 'last_change': '2023-10-25T16:14:08.890071+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.890071+0000', 'last_undegraded': '2023-10-25T16:14:08.890071+0000', 'last_fullsized': '2023-10-25T16:14:08.890071+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:14:14.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-10-25T16:14:14.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-25T16:14:14.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.888097+0000', 'last_change': '2023-10-25T16:14:08.888097+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.888097+0000', 'last_undegraded': '2023-10-25T16:14:08.888097+0000', 'last_fullsized': '2023-10-25T16:14:08.888097+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-10-25T16:14:14.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-25T16:14:14.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.887769+0000', 'last_change': '2023-10-25T16:14:08.887769+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.887769+0000', 'last_undegraded': '2023-10-25T16:14:08.887769+0000', 'last_fullsized': '2023-10-25T16:14:08.887769+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-10-25T16:14:14.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-25T16:14:14.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.889900+0000', 'last_change': '2023-10-25T16:14:08.889900+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.889900+0000', 'last_undegraded': '2023-10-25T16:14:08.889900+0000', 'last_fullsized': '2023-10-25T16:14:08.889900+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:14:14.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-10-25T16:14:14.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-25T16:14:14.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.898115+0000', 'last_change': '2023-10-25T16:14:08.898115+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.898115+0000', 'last_undegraded': '2023-10-25T16:14:08.898115+0000', 'last_fullsized': '2023-10-25T16:14:08.898115+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-10-25T16:14:14.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-25T16:14:14.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.896667+0000', 'last_change': '2023-10-25T16:14:08.896667+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.896667+0000', 'last_undegraded': '2023-10-25T16:14:08.896667+0000', 'last_fullsized': '2023-10-25T16:14:08.896667+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-25T16:14:14.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.896669+0000', 'last_change': '2023-10-25T16:14:08.896669+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.896669+0000', 'last_undegraded': '2023-10-25T16:14:08.896669+0000', 'last_fullsized': '2023-10-25T16:14:08.896669+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-10-25T16:14:14.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.917501+0000', 'last_change': '2023-10-25T16:14:08.917501+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.917501+0000', 'last_undegraded': '2023-10-25T16:14:08.917501+0000', 'last_fullsized': '2023-10-25T16:14:08.917501+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:14:14.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-25T16:14:14.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.895232+0000', 'last_change': '2023-10-25T16:14:08.895232+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.895232+0000', 'last_undegraded': '2023-10-25T16:14:08.895232+0000', 'last_fullsized': '2023-10-25T16:14:08.895232+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:14:14.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-25T16:14:14.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.897327+0000', 'last_change': '2023-10-25T16:14:08.897327+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.897327+0000', 'last_undegraded': '2023-10-25T16:14:08.897327+0000', 'last_fullsized': '2023-10-25T16:14:08.897327+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-10-25T16:14:14.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-25T16:14:14.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.887934+0000', 'last_change': '2023-10-25T16:14:08.887934+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.887934+0000', 'last_undegraded': '2023-10-25T16:14:08.887934+0000', 'last_fullsized': '2023-10-25T16:14:08.887934+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:14:14.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-25T16:14:14.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.891308+0000', 'last_change': '2023-10-25T16:14:08.891308+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.891308+0000', 'last_undegraded': '2023-10-25T16:14:08.891308+0000', 'last_fullsized': '2023-10-25T16:14:08.891308+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:14:14.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-10-25T16:14:14.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-10-25T16:14:14.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.916958+0000', 'last_change': '2023-10-25T16:14:08.916958+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.916958+0000', 'last_undegraded': '2023-10-25T16:14:08.916958+0000', 'last_fullsized': '2023-10-25T16:14:08.916958+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:14:14.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-10-25T16:14:14.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-25T16:14:14.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.890308+0000', 'last_change': '2023-10-25T16:14:08.890308+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.890308+0000', 'last_undegraded': '2023-10-25T16:14:08.890308+0000', 'last_fullsized': '2023-10-25T16:14:08.890308+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:14:14.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-10-25T16:14:14.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-10-25T16:14:14.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.916953+0000', 'last_change': '2023-10-25T16:14:08.916953+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.916953+0000', 'last_undegraded': '2023-10-25T16:14:08.916953+0000', 'last_fullsized': '2023-10-25T16:14:08.916953+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:14:14.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-10-25T16:14:14.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-25T16:14:14.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.890510+0000', 'last_change': '2023-10-25T16:14:08.890510+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.890510+0000', 'last_undegraded': '2023-10-25T16:14:08.890510+0000', 'last_fullsized': '2023-10-25T16:14:08.890510+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:14:14.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-25T16:14:14.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-25T16:14:14.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.896647+0000', 'last_change': '2023-10-25T16:14:08.896647+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.896647+0000', 'last_undegraded': '2023-10-25T16:14:08.896647+0000', 'last_fullsized': '2023-10-25T16:14:08.896647+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:14:14.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-10-25T16:14:14.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-25T16:14:14.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.888109+0000', 'last_change': '2023-10-25T16:14:08.888109+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.888109+0000', 'last_undegraded': '2023-10-25T16:14:08.888109+0000', 'last_fullsized': '2023-10-25T16:14:08.888109+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:14:14.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-10-25T16:14:14.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:09.881393+0000', 'last_change': '2023-10-25T16:14:09.881393+0000', 'last_active': '2023-10-25T16:14:09.881393+0000', 'last_peered': '2023-10-25T16:14:09.881393+0000', 'last_clean': '2023-10-25T16:14:09.881393+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:09.881393+0000', 'last_undegraded': '2023-10-25T16:14:09.881393+0000', 'last_fullsized': '2023-10-25T16:14:09.881393+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:09.881393+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:14.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-25T16:14:14.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:14:08.894318+0000', 'last_change': '2023-10-25T16:14:08.894318+0000', 'last_active': '2023-10-25T16:14:08.865466+0000', 'last_peered': '2023-10-25T16:14:08.865466+0000', 'last_clean': '2023-10-25T16:14:08.865466+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:08.894318+0000', 'last_undegraded': '2023-10-25T16:14:08.894318+0000', 'last_fullsized': '2023-10-25T16:14:08.894318+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:08.865466+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:14:14.732 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:14:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa877e1b640 1 -- 172.21.15.177:0/3954580537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85c003980 msgr2=0x7fa85c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa877e1b640 1 --2- 172.21.15.177:0/3954580537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85c003980 0x7fa85c003da0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009b90 tx=0x7fa86c01d1d0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa8763b8640 1 -- 172.21.15.177:0/3954580537 reap_dead start 2023-10-25T16:14:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa877e1b640 1 -- 172.21.15.177:0/3954580537 shutdown_connections 2023-10-25T16:14:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa877e1b640 1 -- 172.21.15.177:0/3954580537 >> 172.21.15.177:0/3954580537 conn(0x7fa8700b2450 msgr2=0x7fa8700b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa877e1b640 1 -- 172.21.15.177:0/3954580537 shutdown_connections 2023-10-25T16:14:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.855+0000 7fa877e1b640 1 -- 172.21.15.177:0/3954580537 wait complete. 2023-10-25T16:14:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 Processor -- start 2023-10-25T16:14:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- start start 2023-10-25T16:14:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa85c003980 0x7fa870146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa870158a00 0x7fa870158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 0x7fa87014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87015a560 con 0x7fa87014eed0 2023-10-25T16:14:14.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701594c0 con 0x7fa870158a00 2023-10-25T16:14:14.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701597a0 con 0x7fa85c003980 2023-10-25T16:14:14.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 0x7fa87014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 0x7fa87014f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38438/0 (socket says 172.21.15.177:38438) 2023-10-25T16:14:14.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 -- 172.21.15.177:0/1586622453 learned_addr learned my addr 172.21.15.177:0/1586622453 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:14.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa875bb7640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa85c003980 0x7fa870146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8753b6640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa870158a00 0x7fa870158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 -- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa85c003980 msgr2=0x7fa870146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa85c003980 0x7fa870146600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 -- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa870158a00 msgr2=0x7fa870158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:14.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa870158a00 0x7fa870158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:14.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 -- 172.21.15.177:0/1586622453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870159a80 con 0x7fa87014eed0 2023-10-25T16:14:14.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8753b6640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa870158a00 0x7fa870158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:14.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8763b8640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 0x7fa87014f350 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa870155980 tx=0x7fa868010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:14.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800ee70 con 0x7fa87014eed0 2023-10-25T16:14:14.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa868003a90 con 0x7fa87014eed0 2023-10-25T16:14:14.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa870159d60 con 0x7fa87014eed0 2023-10-25T16:14:14.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868003ea0 con 0x7fa87014eed0 2023-10-25T16:14:14.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870146b40 con 0x7fa87014eed0 2023-10-25T16:14:14.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87015a280 con 0x7fa87014eed0 2023-10-25T16:14:14.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.859+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa868019030 con 0x7fa87014eed0 2023-10-25T16:14:14.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.863+0000 7fa8667fc640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8540664a0 0x7fa854068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:14.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.863+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa868017070 con 0x7fa87014eed0 2023-10-25T16:14:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.863+0000 7fa875bb7640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8540664a0 0x7fa854068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.863+0000 7fa875bb7640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8540664a0 0x7fa854068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0ae000 tx=0x7fa86c019f70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:14.867+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa87015a280 con 0x7fa87014eed0 2023-10-25T16:14:15.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.075+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa87015a280 con 0x7fa87014eed0 2023-10-25T16:14:15.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.075+0000 7fa8667fc640 1 -- 172.21.15.177:0/1586622453 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1326 (secure 0 0 0) 0x7fa87015a280 con 0x7fa87014eed0 2023-10-25T16:14:15.082 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:15.083 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":86,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":56},{"state_name":"creating+peering","count":31},{"state_name":"active+clean","count":10}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":2279398,"bytes_avail":1597720602,"bytes_total":1600000000,"unknown_pgs_ratio":0.57731956243515015,"inactive_pgs_ratio":0.31958761811256409,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":12,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":154595}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-25T16:14:02.611909+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:14:15.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8540664a0 msgr2=0x7fa854068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8540664a0 0x7fa854068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0ae000 tx=0x7fa86c019f70 comp rx=0 tx=0).stop 2023-10-25T16:14:15.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 msgr2=0x7fa87014f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 0x7fa87014f350 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa870155980 tx=0x7fa868010f40 comp rx=0 tx=0).stop 2023-10-25T16:14:15.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 shutdown_connections 2023-10-25T16:14:15.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8540664a0 0x7fa854068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa87014eed0 0x7fa87014f350 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa870158a00 0x7fa870158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 --2- 172.21.15.177:0/1586622453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa85c003980 0x7fa870146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 >> 172.21.15.177:0/1586622453 conn(0x7fa8700b2450 msgr2=0x7fa870156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:15.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 shutdown_connections 2023-10-25T16:14:15.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.079+0000 7fa877e1b640 1 -- 172.21.15.177:0/1586622453 wait complete. 2023-10-25T16:14:15.101 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:14:15.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 -- 172.21.15.177:0/890790403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 msgr2=0x7f62b80cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 --2- 172.21.15.177:0/890790403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b80cbfa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f62b80c9b20 tx=0x7f62a801cd20 comp rx=0 tx=0).stop 2023-10-25T16:14:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 -- 172.21.15.177:0/890790403 shutdown_connections 2023-10-25T16:14:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 --2- 172.21.15.177:0/890790403 >> v2:172.21.15.184:3300/0 conn(0x7f62b815bdb0 0x7f62b80aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 --2- 172.21.15.177:0/890790403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b80cbfa0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 -- 172.21.15.177:0/890790403 >> 172.21.15.177:0/890790403 conn(0x7f62b80b2450 msgr2=0x7f62b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 -- 172.21.15.177:0/890790403 shutdown_connections 2023-10-25T16:14:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.215+0000 7f62beff6640 1 -- 172.21.15.177:0/890790403 wait complete. 2023-10-25T16:14:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 Processor -- start 2023-10-25T16:14:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- start start 2023-10-25T16:14:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b80af100 0x7f62b80ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b815bdb0 0x7f62b814a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80aee50 con 0x7f62b814e810 2023-10-25T16:14:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b814f410 con 0x7f62b80af100 2023-10-25T16:14:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80ad850 con 0x7f62b815bdb0 2023-10-25T16:14:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b814eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38452/0 (socket says 172.21.15.177:38452) 2023-10-25T16:14:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 -- 172.21.15.177:0/4055703225 learned_addr learned my addr 172.21.15.177:0/4055703225 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 -- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b815bdb0 msgr2=0x7f62b814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b815bdb0 0x7f62b814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 -- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b80af100 msgr2=0x7f62b80ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b80af100 0x7f62b80ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 -- 172.21.15.177:0/4055703225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80098e0 con 0x7f62b814e810 2023-10-25T16:14:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b7fff640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b814eed0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f62a000b440 tx=0x7f62a000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0005980 con 0x7f62b814e810 2023-10-25T16:14:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f62a0005bd0 con 0x7f62b814e810 2023-10-25T16:14:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b814aad0 con 0x7f62b814e810 2023-10-25T16:14:15.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0011690 con 0x7f62b814e810 2023-10-25T16:14:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b80acc40 con 0x7f62b814e810 2023-10-25T16:14:15.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b804daf0 con 0x7f62b814e810 2023-10-25T16:14:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62a0006000 con 0x7f62b814e810 2023-10-25T16:14:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b57fa640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6298066470 0x7f6298068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62a0084000 con 0x7f62b814e810 2023-10-25T16:14:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.219+0000 7f62bcd92640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6298066470 0x7f6298068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.223+0000 7f62bcd92640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6298066470 0x7f6298068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62a80af000 tx=0x7f62a8019ac0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.223+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62a0051480 con 0x7f62b814e810 2023-10-25T16:14:15.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.363+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62b80ad9c0 con 0x7f6298066470 2023-10-25T16:14:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.383+0000 7f62b57fa640 1 -- 172.21.15.177:0/4055703225 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274729 (secure 0 0 0) 0x7f62b80ad9c0 con 0x7f6298066470 2023-10-25T16:14:15.391 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:15.394 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:15.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6298066470 msgr2=0x7f6298068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6298066470 0x7f6298068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62a80af000 tx=0x7f62a8019ac0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 msgr2=0x7f62b814eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:15.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b814eed0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f62a000b440 tx=0x7f62a000b900 comp rx=0 tx=0).stop 2023-10-25T16:14:15.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 shutdown_connections 2023-10-25T16:14:15.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6298066470 0x7f6298068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62b815bdb0 0x7f62b814a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62b814e810 0x7f62b814eed0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 --2- 172.21.15.177:0/4055703225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62b80af100 0x7f62b80ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:15.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 >> 172.21.15.177:0/4055703225 conn(0x7f62b80b2450 msgr2=0x7f62b806b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 shutdown_connections 2023-10-25T16:14:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:15.387+0000 7f62beff6640 1 -- 172.21.15.177:0/4055703225 wait complete. 2023-10-25T16:14:15.409 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-10-25T16:14:14.628081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560274,"statfs":{"total":1600000000,"available":1597720602,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.741405"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.953527+0000","last_change":"2023-10-25T16:14:10.953124+0000","last_active":"2023-10-25T16:14:10.953527+0000","last_peered":"2023-10-25T16:14:10.953527+0000","last_clean":"2023-10-25T16:14:10.953527+0000","last_became_active":"2023-10-25T16:14:10.952432+0000","last_became_peered":"2023-10-25T16:14:10.952432+0000","last_unstale":"2023-10-25T16:14:10.953527+0000","last_undegraded":"2023-10-25T16:14:10.953527+0000","last_fullsized":"2023-10-25T16:14:10.953527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:30:26.675353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.956014+0000","last_change":"2023-10-25T16:14:10.955870+0000","last_active":"2023-10-25T16:14:10.956014+0000","last_peered":"2023-10-25T16:14:10.956014+0000","last_clean":"2023-10-25T16:14:10.956014+0000","last_became_active":"2023-10-25T16:14:10.954791+0000","last_became_peered":"2023-10-25T16:14:10.954791+0000","last_unstale":"2023-10-25T16:14:10.956014+0000","last_undegraded":"2023-10-25T16:14:10.956014+0000","last_fullsized":"2023-10-25T16:14:10.956014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:31.884348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.944987+0000","last_change":"2023-10-25T16:14:10.944831+0000","last_active":"2023-10-25T16:14:10.944987+0000","last_peered":"2023-10-25T16:14:10.944987+0000","last_clean":"2023-10-25T16:14:10.944987+0000","last_became_active":"2023-10-25T16:14:10.944176+0000","last_became_peered":"2023-10-25T16:14:10.944176+0000","last_unstale":"2023-10-25T16:14:10.944987+0000","last_undegraded":"2023-10-25T16:14:10.944987+0000","last_fullsized":"2023-10-25T16:14:10.944987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:01.937535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894171+0000","last_change":"2023-10-25T16:14:08.894171+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894171+0000","last_undegraded":"2023-10-25T16:14:08.894171+0000","last_fullsized":"2023-10-25T16:14:08.894171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916955+0000","last_change":"2023-10-25T16:14:08.916955+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916955+0000","last_undegraded":"2023-10-25T16:14:08.916955+0000","last_fullsized":"2023-10-25T16:14:08.916955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889616+0000","last_change":"2023-10-25T16:14:08.889616+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889616+0000","last_undegraded":"2023-10-25T16:14:08.889616+0000","last_fullsized":"2023-10-25T16:14:08.889616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.970376+0000","last_change":"2023-10-25T16:14:09.903571+0000","last_active":"2023-10-25T16:14:10.970376+0000","last_peered":"2023-10-25T16:14:10.970376+0000","last_clean":"2023-10-25T16:14:10.970376+0000","last_became_active":"2023-10-25T16:14:09.903046+0000","last_became_peered":"2023-10-25T16:14:09.903046+0000","last_unstale":"2023-10-25T16:14:10.970376+0000","last_undegraded":"2023-10-25T16:14:10.970376+0000","last_fullsized":"2023-10-25T16:14:10.970376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:58:54.186103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897571+0000","last_change":"2023-10-25T16:14:08.897571+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897571+0000","last_undegraded":"2023-10-25T16:14:08.897571+0000","last_fullsized":"2023-10-25T16:14:08.897571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897586+0000","last_change":"2023-10-25T16:14:08.897586+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897586+0000","last_undegraded":"2023-10-25T16:14:08.897586+0000","last_fullsized":"2023-10-25T16:14:08.897586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889511+0000","last_change":"2023-10-25T16:14:08.889511+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889511+0000","last_undegraded":"2023-10-25T16:14:08.889511+0000","last_fullsized":"2023-10-25T16:14:08.889511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.899365+0000","last_change":"2023-10-25T16:14:08.899365+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.899365+0000","last_undegraded":"2023-10-25T16:14:08.899365+0000","last_fullsized":"2023-10-25T16:14:08.899365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889215+0000","last_change":"2023-10-25T16:14:08.889215+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889215+0000","last_undegraded":"2023-10-25T16:14:08.889215+0000","last_fullsized":"2023-10-25T16:14:08.889215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916857+0000","last_change":"2023-10-25T16:14:08.916857+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916857+0000","last_undegraded":"2023-10-25T16:14:08.916857+0000","last_fullsized":"2023-10-25T16:14:08.916857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887938+0000","last_change":"2023-10-25T16:14:08.887938+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887938+0000","last_undegraded":"2023-10-25T16:14:08.887938+0000","last_fullsized":"2023-10-25T16:14:08.887938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888870+0000","last_change":"2023-10-25T16:14:08.888870+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888870+0000","last_undegraded":"2023-10-25T16:14:08.888870+0000","last_fullsized":"2023-10-25T16:14:08.888870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898762+0000","last_change":"2023-10-25T16:14:08.898762+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898762+0000","last_undegraded":"2023-10-25T16:14:08.898762+0000","last_fullsized":"2023-10-25T16:14:08.898762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890071+0000","last_change":"2023-10-25T16:14:08.890071+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890071+0000","last_undegraded":"2023-10-25T16:14:08.890071+0000","last_fullsized":"2023-10-25T16:14:08.890071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888097+0000","last_change":"2023-10-25T16:14:08.888097+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888097+0000","last_undegraded":"2023-10-25T16:14:08.888097+0000","last_fullsized":"2023-10-25T16:14:08.888097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887769+0000","last_change":"2023-10-25T16:14:08.887769+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887769+0000","last_undegraded":"2023-10-25T16:14:08.887769+0000","last_fullsized":"2023-10-25T16:14:08.887769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.889900+0000","last_change":"2023-10-25T16:14:08.889900+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.889900+0000","last_undegraded":"2023-10-25T16:14:08.889900+0000","last_fullsized":"2023-10-25T16:14:08.889900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.898115+0000","last_change":"2023-10-25T16:14:08.898115+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.898115+0000","last_undegraded":"2023-10-25T16:14:08.898115+0000","last_fullsized":"2023-10-25T16:14:08.898115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896667+0000","last_change":"2023-10-25T16:14:08.896667+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896667+0000","last_undegraded":"2023-10-25T16:14:08.896667+0000","last_fullsized":"2023-10-25T16:14:08.896667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.959001+0000","last_change":"2023-10-25T16:14:10.958874+0000","last_active":"2023-10-25T16:14:10.959001+0000","last_peered":"2023-10-25T16:14:10.959001+0000","last_clean":"2023-10-25T16:14:10.959001+0000","last_became_active":"2023-10-25T16:14:10.958296+0000","last_became_peered":"2023-10-25T16:14:10.958296+0000","last_unstale":"2023-10-25T16:14:10.959001+0000","last_undegraded":"2023-10-25T16:14:10.959001+0000","last_fullsized":"2023-10-25T16:14:10.959001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:26.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896669+0000","last_change":"2023-10-25T16:14:08.896669+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896669+0000","last_undegraded":"2023-10-25T16:14:08.896669+0000","last_fullsized":"2023-10-25T16:14:08.896669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.958717+0000","last_change":"2023-10-25T16:14:10.958544+0000","last_active":"2023-10-25T16:14:10.958717+0000","last_peered":"2023-10-25T16:14:10.958717+0000","last_clean":"2023-10-25T16:14:10.958717+0000","last_became_active":"2023-10-25T16:14:10.957921+0000","last_became_peered":"2023-10-25T16:14:10.957921+0000","last_unstale":"2023-10-25T16:14:10.958717+0000","last_undegraded":"2023-10-25T16:14:10.958717+0000","last_fullsized":"2023-10-25T16:14:10.958717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:52.704832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.917501+0000","last_change":"2023-10-25T16:14:08.917501+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.917501+0000","last_undegraded":"2023-10-25T16:14:08.917501+0000","last_fullsized":"2023-10-25T16:14:08.917501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.955611+0000","last_change":"2023-10-25T16:14:10.955445+0000","last_active":"2023-10-25T16:14:10.955611+0000","last_peered":"2023-10-25T16:14:10.955611+0000","last_clean":"2023-10-25T16:14:10.955611+0000","last_became_active":"2023-10-25T16:14:10.953936+0000","last_became_peered":"2023-10-25T16:14:10.953936+0000","last_unstale":"2023-10-25T16:14:10.955611+0000","last_undegraded":"2023-10-25T16:14:10.955611+0000","last_fullsized":"2023-10-25T16:14:10.955611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:15.520022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.895232+0000","last_change":"2023-10-25T16:14:08.895232+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.895232+0000","last_undegraded":"2023-10-25T16:14:08.895232+0000","last_fullsized":"2023-10-25T16:14:08.895232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951050+0000","last_change":"2023-10-25T16:14:10.950887+0000","last_active":"2023-10-25T16:14:10.951050+0000","last_peered":"2023-10-25T16:14:10.951050+0000","last_clean":"2023-10-25T16:14:10.951050+0000","last_became_active":"2023-10-25T16:14:10.947905+0000","last_became_peered":"2023-10-25T16:14:10.947905+0000","last_unstale":"2023-10-25T16:14:10.951050+0000","last_undegraded":"2023-10-25T16:14:10.951050+0000","last_fullsized":"2023-10-25T16:14:10.951050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:05.721268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.897327+0000","last_change":"2023-10-25T16:14:08.897327+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.897327+0000","last_undegraded":"2023-10-25T16:14:08.897327+0000","last_fullsized":"2023-10-25T16:14:08.897327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.887934+0000","last_change":"2023-10-25T16:14:08.887934+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.887934+0000","last_undegraded":"2023-10-25T16:14:08.887934+0000","last_fullsized":"2023-10-25T16:14:08.887934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.951361+0000","last_change":"2023-10-25T16:14:10.951202+0000","last_active":"2023-10-25T16:14:10.951361+0000","last_peered":"2023-10-25T16:14:10.951361+0000","last_clean":"2023-10-25T16:14:10.951361+0000","last_became_active":"2023-10-25T16:14:10.950592+0000","last_became_peered":"2023-10-25T16:14:10.950592+0000","last_unstale":"2023-10-25T16:14:10.951361+0000","last_undegraded":"2023-10-25T16:14:10.951361+0000","last_fullsized":"2023-10-25T16:14:10.951361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:43.328417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.891308+0000","last_change":"2023-10-25T16:14:08.891308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.891308+0000","last_undegraded":"2023-10-25T16:14:08.891308+0000","last_fullsized":"2023-10-25T16:14:08.891308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916958+0000","last_change":"2023-10-25T16:14:08.916958+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916958+0000","last_undegraded":"2023-10-25T16:14:08.916958+0000","last_fullsized":"2023-10-25T16:14:08.916958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890308+0000","last_change":"2023-10-25T16:14:08.890308+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890308+0000","last_undegraded":"2023-10-25T16:14:08.890308+0000","last_fullsized":"2023-10-25T16:14:08.890308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.916953+0000","last_change":"2023-10-25T16:14:08.916953+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.916953+0000","last_undegraded":"2023-10-25T16:14:08.916953+0000","last_fullsized":"2023-10-25T16:14:08.916953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.890510+0000","last_change":"2023-10-25T16:14:08.890510+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.890510+0000","last_undegraded":"2023-10-25T16:14:08.890510+0000","last_fullsized":"2023-10-25T16:14:08.890510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.896647+0000","last_change":"2023-10-25T16:14:08.896647+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.896647+0000","last_undegraded":"2023-10-25T16:14:08.896647+0000","last_fullsized":"2023-10-25T16:14:08.896647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.888109+0000","last_change":"2023-10-25T16:14:08.888109+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.888109+0000","last_undegraded":"2023-10-25T16:14:08.888109+0000","last_fullsized":"2023-10-25T16:14:08.888109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:09.881393+0000","last_change":"2023-10-25T16:14:09.881393+0000","last_active":"2023-10-25T16:14:09.881393+0000","last_peered":"2023-10-25T16:14:09.881393+0000","last_clean":"2023-10-25T16:14:09.881393+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:09.881393+0000","last_undegraded":"2023-10-25T16:14:09.881393+0000","last_fullsized":"2023-10-25T16:14:09.881393+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-10-25T16:14:08.894318+0000","last_change":"2023-10-25T16:14:08.894318+0000","last_active":"2023-10-25T16:14:08.865466+0000","last_peered":"2023-10-25T16:14:08.865466+0000","last_clean":"2023-10-25T16:14:08.865466+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:08.894318+0000","last_undegraded":"2023-10-25T16:14:08.894318+0000","last_fullsized":"2023-10-25T16:14:08.894318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-25T16:14:05.393545+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:05.393545+0000","last_peered":"2023-10-25T16:14:05.393545+0000","last_clean":"2023-10-25T16:14:05.393545+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:05.393545+0000","last_undegraded":"2023-10-25T16:14:05.393545+0000","last_fullsized":"2023-10-25T16:14:05.393545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":146,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195165,"statfs":{"total":200000000,"available":199849740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.98999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1850000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194602,"statfs":{"total":200000000,"available":199272484,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.878},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.80600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.84199999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.25}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.2070000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0329999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.135},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92300000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.097},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.071}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.85899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":1.0860000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.749},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.95099999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.228},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.70399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.755}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.149},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.97199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.0569999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.01}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195184,"statfs":{"total":200000000,"available":199868669,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71999999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.91600000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.0449999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195178,"statfs":{"total":200000000,"available":199862852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.62}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.748},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":704,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194607,"statfs":{"total":200000000,"available":199278301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.79000000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":0.72099999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:18.417 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:18.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/774635600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40047d0 msgr2=0x7f2ad4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/774635600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40047d0 0x7f2ad4004c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00016b0 tx=0x7f2ae001c720 comp rx=0 tx=0).stop 2023-10-25T16:14:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/774635600 shutdown_connections 2023-10-25T16:14:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/774635600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40047d0 0x7f2ad4004c50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/774635600 >> 172.21.15.177:0/774635600 conn(0x7f2aec0b2450 msgr2=0x7f2aec0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/774635600 shutdown_connections 2023-10-25T16:14:18.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/774635600 wait complete. 2023-10-25T16:14:18.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 Processor -- start 2023-10-25T16:14:18.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- start start 2023-10-25T16:14:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad40047d0 0x7f2aec0ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 0x7f2aec0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2aec13cab0 0x7f2aec1f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0aac50 con 0x7f2aec159b10 2023-10-25T16:14:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0aa040 con 0x7f2ad40047d0 2023-10-25T16:14:18.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0aa320 con 0x7f2aec13cab0 2023-10-25T16:14:18.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 0x7f2aec0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 0x7f2aec0ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38478/0 (socket says 172.21.15.177:38478) 2023-10-25T16:14:18.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 -- 172.21.15.177:0/3410442294 learned_addr learned my addr 172.21.15.177:0/3410442294 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:18.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af08b7640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad40047d0 0x7f2aec0ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af10b8640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2aec13cab0 0x7f2aec1f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 -- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2aec13cab0 msgr2=0x7f2aec1f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2aec13cab0 0x7f2aec1f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 -- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad40047d0 msgr2=0x7f2aec0ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad40047d0 0x7f2aec0ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 -- 172.21.15.177:0/3410442294 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0aa600 con 0x7f2aec159b10 2023-10-25T16:14:18.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af10b8640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2aec13cab0 0x7f2aec1f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:18.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af08b7640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad40047d0 0x7f2aec0ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:18.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2aebfff640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 0x7f2aec0ab0e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0000c10 tx=0x7f2ae0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:18.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0006330 con 0x7f2aec159b10 2023-10-25T16:14:18.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2ae0003e80 con 0x7f2aec159b10 2023-10-25T16:14:18.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0aa8e0 con 0x7f2aec159b10 2023-10-25T16:14:18.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00b6670 con 0x7f2aec159b10 2023-10-25T16:14:18.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.551+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec13cf30 con 0x7f2aec159b10 2023-10-25T16:14:18.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.555+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0aaa70 con 0x7f2aec159b10 2023-10-25T16:14:18.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.555+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ae00be3f0 con 0x7f2aec159b10 2023-10-25T16:14:18.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.555+0000 7f2ae97fa640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ad8066470 0x7f2ad8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.555+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ae011d8c0 con 0x7f2aec159b10 2023-10-25T16:14:18.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.555+0000 7f2af08b7640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ad8066470 0x7f2ad8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.555+0000 7f2af08b7640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ad8066470 0x7f2ad8068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0011f0 tx=0x7f2adc001c80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:18.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.559+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ae00ead30 con 0x7f2aec159b10 2023-10-25T16:14:18.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.711+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2aec0b0740 con 0x7f2ad8066470 2023-10-25T16:14:18.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.731+0000 7f2ae97fa640 1 -- 172.21.15.177:0/3410442294 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283651 (secure 0 0 0) 0x7f2adc00fa10 con 0x7f2ad8066470 2023-10-25T16:14:18.741 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:18.742 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:18.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ad8066470 msgr2=0x7f2ad8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ad8066470 0x7f2ad8068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0011f0 tx=0x7f2adc001c80 comp rx=0 tx=0).stop 2023-10-25T16:14:18.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 msgr2=0x7f2aec0ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 0x7f2aec0ab0e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0000c10 tx=0x7f2ae0003c90 comp rx=0 tx=0).stop 2023-10-25T16:14:18.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 shutdown_connections 2023-10-25T16:14:18.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ad8066470 0x7f2ad8068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2aec13cab0 0x7f2aec1f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aec159b10 0x7f2aec0ab0e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 --2- 172.21.15.177:0/3410442294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad40047d0 0x7f2aec0ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 >> 172.21.15.177:0/3410442294 conn(0x7f2aec0b2450 msgr2=0x7f2aec0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 shutdown_connections 2023-10-25T16:14:18.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.735+0000 7f2af2b1b640 1 -- 172.21.15.177:0/3410442294 wait complete. 2023-10-25T16:14:18.759 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-10-25T16:14:18.629664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2380,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560119,"statfs":{"total":1600000000,"available":1597562524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.015718"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081494+0000","last_change":"2023-10-25T16:14:10.952224+0000","last_active":"2023-10-25T16:14:12.081494+0000","last_peered":"2023-10-25T16:14:12.081494+0000","last_clean":"2023-10-25T16:14:12.081494+0000","last_became_active":"2023-10-25T16:14:10.951285+0000","last_became_peered":"2023-10-25T16:14:10.951285+0000","last_unstale":"2023-10-25T16:14:12.081494+0000","last_undegraded":"2023-10-25T16:14:12.081494+0000","last_fullsized":"2023-10-25T16:14:12.081494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:52.960670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077206+0000","last_change":"2023-10-25T16:14:10.944740+0000","last_active":"2023-10-25T16:14:12.077206+0000","last_peered":"2023-10-25T16:14:12.077206+0000","last_clean":"2023-10-25T16:14:12.077206+0000","last_became_active":"2023-10-25T16:14:10.943201+0000","last_became_peered":"2023-10-25T16:14:10.943201+0000","last_unstale":"2023-10-25T16:14:12.077206+0000","last_undegraded":"2023-10-25T16:14:12.077206+0000","last_fullsized":"2023-10-25T16:14:12.077206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:51.761351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081752+0000","last_change":"2023-10-25T16:14:10.959229+0000","last_active":"2023-10-25T16:14:12.081752+0000","last_peered":"2023-10-25T16:14:12.081752+0000","last_clean":"2023-10-25T16:14:12.081752+0000","last_became_active":"2023-10-25T16:14:10.955575+0000","last_became_peered":"2023-10-25T16:14:10.955575+0000","last_unstale":"2023-10-25T16:14:12.081752+0000","last_undegraded":"2023-10-25T16:14:12.081752+0000","last_fullsized":"2023-10-25T16:14:12.081752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:50.110647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.076914+0000","last_change":"2023-10-25T16:14:10.952836+0000","last_active":"2023-10-25T16:14:12.076914+0000","last_peered":"2023-10-25T16:14:12.076914+0000","last_clean":"2023-10-25T16:14:12.076914+0000","last_became_active":"2023-10-25T16:14:10.951149+0000","last_became_peered":"2023-10-25T16:14:10.951149+0000","last_unstale":"2023-10-25T16:14:12.076914+0000","last_undegraded":"2023-10-25T16:14:12.076914+0000","last_fullsized":"2023-10-25T16:14:12.076914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932509+0000","last_change":"2023-10-25T16:14:10.953124+0000","last_active":"2023-10-25T16:14:11.932509+0000","last_peered":"2023-10-25T16:14:11.932509+0000","last_clean":"2023-10-25T16:14:11.932509+0000","last_became_active":"2023-10-25T16:14:10.952432+0000","last_became_peered":"2023-10-25T16:14:10.952432+0000","last_unstale":"2023-10-25T16:14:11.932509+0000","last_undegraded":"2023-10-25T16:14:11.932509+0000","last_fullsized":"2023-10-25T16:14:11.932509+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:27:15.408459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077118+0000","last_change":"2023-10-25T16:14:10.942852+0000","last_active":"2023-10-25T16:14:12.077118+0000","last_peered":"2023-10-25T16:14:12.077118+0000","last_clean":"2023-10-25T16:14:12.077118+0000","last_became_active":"2023-10-25T16:14:10.941918+0000","last_became_peered":"2023-10-25T16:14:10.941918+0000","last_unstale":"2023-10-25T16:14:12.077118+0000","last_undegraded":"2023-10-25T16:14:12.077118+0000","last_fullsized":"2023-10-25T16:14:12.077118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:23.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935271+0000","last_change":"2023-10-25T16:14:10.949026+0000","last_active":"2023-10-25T16:14:11.935271+0000","last_peered":"2023-10-25T16:14:11.935271+0000","last_clean":"2023-10-25T16:14:11.935271+0000","last_became_active":"2023-10-25T16:14:10.947936+0000","last_became_peered":"2023-10-25T16:14:10.947936+0000","last_unstale":"2023-10-25T16:14:11.935271+0000","last_undegraded":"2023-10-25T16:14:11.935271+0000","last_fullsized":"2023-10-25T16:14:11.935271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:37.758824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935056+0000","last_change":"2023-10-25T16:14:10.957229+0000","last_active":"2023-10-25T16:14:11.935056+0000","last_peered":"2023-10-25T16:14:11.935056+0000","last_clean":"2023-10-25T16:14:11.935056+0000","last_became_active":"2023-10-25T16:14:10.956214+0000","last_became_peered":"2023-10-25T16:14:10.956214+0000","last_unstale":"2023-10-25T16:14:11.935056+0000","last_undegraded":"2023-10-25T16:14:11.935056+0000","last_fullsized":"2023-10-25T16:14:11.935056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080295+0000","last_change":"2023-10-25T16:14:10.950603+0000","last_active":"2023-10-25T16:14:12.080295+0000","last_peered":"2023-10-25T16:14:12.080295+0000","last_clean":"2023-10-25T16:14:12.080295+0000","last_became_active":"2023-10-25T16:14:10.949992+0000","last_became_peered":"2023-10-25T16:14:10.949992+0000","last_unstale":"2023-10-25T16:14:12.080295+0000","last_undegraded":"2023-10-25T16:14:12.080295+0000","last_fullsized":"2023-10-25T16:14:12.080295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:06.419571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.076005+0000","last_change":"2023-10-25T16:14:10.955908+0000","last_active":"2023-10-25T16:14:12.076005+0000","last_peered":"2023-10-25T16:14:12.076005+0000","last_clean":"2023-10-25T16:14:12.076005+0000","last_became_active":"2023-10-25T16:14:10.953975+0000","last_became_peered":"2023-10-25T16:14:10.953975+0000","last_unstale":"2023-10-25T16:14:12.076005+0000","last_undegraded":"2023-10-25T16:14:12.076005+0000","last_fullsized":"2023-10-25T16:14:12.076005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:04.718351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935715+0000","last_change":"2023-10-25T16:14:10.953307+0000","last_active":"2023-10-25T16:14:11.935715+0000","last_peered":"2023-10-25T16:14:11.935715+0000","last_clean":"2023-10-25T16:14:11.935715+0000","last_became_active":"2023-10-25T16:14:10.952664+0000","last_became_peered":"2023-10-25T16:14:10.952664+0000","last_unstale":"2023-10-25T16:14:11.935715+0000","last_undegraded":"2023-10-25T16:14:11.935715+0000","last_fullsized":"2023-10-25T16:14:11.935715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:23.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.079657+0000","last_change":"2023-10-25T16:14:10.942287+0000","last_active":"2023-10-25T16:14:12.079657+0000","last_peered":"2023-10-25T16:14:12.079657+0000","last_clean":"2023-10-25T16:14:12.079657+0000","last_became_active":"2023-10-25T16:14:10.939667+0000","last_became_peered":"2023-10-25T16:14:10.939667+0000","last_unstale":"2023-10-25T16:14:12.079657+0000","last_undegraded":"2023-10-25T16:14:12.079657+0000","last_fullsized":"2023-10-25T16:14:12.079657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.512311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932295+0000","last_change":"2023-10-25T16:14:10.955870+0000","last_active":"2023-10-25T16:14:11.932295+0000","last_peered":"2023-10-25T16:14:11.932295+0000","last_clean":"2023-10-25T16:14:11.932295+0000","last_became_active":"2023-10-25T16:14:10.954791+0000","last_became_peered":"2023-10-25T16:14:10.954791+0000","last_unstale":"2023-10-25T16:14:11.932295+0000","last_undegraded":"2023-10-25T16:14:11.932295+0000","last_fullsized":"2023-10-25T16:14:11.932295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:31:11.435498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077125+0000","last_change":"2023-10-25T16:14:10.950898+0000","last_active":"2023-10-25T16:14:12.077125+0000","last_peered":"2023-10-25T16:14:12.077125+0000","last_clean":"2023-10-25T16:14:12.077125+0000","last_became_active":"2023-10-25T16:14:10.946242+0000","last_became_peered":"2023-10-25T16:14:10.946242+0000","last_unstale":"2023-10-25T16:14:12.077125+0000","last_undegraded":"2023-10-25T16:14:12.077125+0000","last_fullsized":"2023-10-25T16:14:12.077125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:05:44.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080878+0000","last_change":"2023-10-25T16:14:10.944446+0000","last_active":"2023-10-25T16:14:12.080878+0000","last_peered":"2023-10-25T16:14:12.080878+0000","last_clean":"2023-10-25T16:14:12.080878+0000","last_became_active":"2023-10-25T16:14:10.943843+0000","last_became_peered":"2023-10-25T16:14:10.943843+0000","last_unstale":"2023-10-25T16:14:12.080878+0000","last_undegraded":"2023-10-25T16:14:12.080878+0000","last_fullsized":"2023-10-25T16:14:12.080878+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:05:44.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935009+0000","last_change":"2023-10-25T16:14:10.947151+0000","last_active":"2023-10-25T16:14:11.935009+0000","last_peered":"2023-10-25T16:14:11.935009+0000","last_clean":"2023-10-25T16:14:11.935009+0000","last_became_active":"2023-10-25T16:14:10.946422+0000","last_became_peered":"2023-10-25T16:14:10.946422+0000","last_unstale":"2023-10-25T16:14:11.935009+0000","last_undegraded":"2023-10-25T16:14:11.935009+0000","last_fullsized":"2023-10-25T16:14:11.935009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:41.918929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.934584+0000","last_change":"2023-10-25T16:14:10.948634+0000","last_active":"2023-10-25T16:14:11.934584+0000","last_peered":"2023-10-25T16:14:11.934584+0000","last_clean":"2023-10-25T16:14:11.934584+0000","last_became_active":"2023-10-25T16:14:10.947098+0000","last_became_peered":"2023-10-25T16:14:10.947098+0000","last_unstale":"2023-10-25T16:14:11.934584+0000","last_undegraded":"2023-10-25T16:14:11.934584+0000","last_fullsized":"2023-10-25T16:14:11.934584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:04.718351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077204+0000","last_change":"2023-10-25T16:14:10.953121+0000","last_active":"2023-10-25T16:14:12.077204+0000","last_peered":"2023-10-25T16:14:12.077204+0000","last_clean":"2023-10-25T16:14:12.077204+0000","last_became_active":"2023-10-25T16:14:10.952453+0000","last_became_peered":"2023-10-25T16:14:10.952453+0000","last_unstale":"2023-10-25T16:14:12.077204+0000","last_undegraded":"2023-10-25T16:14:12.077204+0000","last_fullsized":"2023-10-25T16:14:12.077204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:06.852284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.076755+0000","last_change":"2023-10-25T16:14:10.957313+0000","last_active":"2023-10-25T16:14:12.076755+0000","last_peered":"2023-10-25T16:14:12.076755+0000","last_clean":"2023-10-25T16:14:12.076755+0000","last_became_active":"2023-10-25T16:14:10.950146+0000","last_became_peered":"2023-10-25T16:14:10.950146+0000","last_unstale":"2023-10-25T16:14:12.076755+0000","last_undegraded":"2023-10-25T16:14:12.076755+0000","last_fullsized":"2023-10-25T16:14:12.076755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:43.515266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932698+0000","last_change":"2023-10-25T16:14:10.944831+0000","last_active":"2023-10-25T16:14:11.932698+0000","last_peered":"2023-10-25T16:14:11.932698+0000","last_clean":"2023-10-25T16:14:11.932698+0000","last_became_active":"2023-10-25T16:14:10.944176+0000","last_became_peered":"2023-10-25T16:14:10.944176+0000","last_unstale":"2023-10-25T16:14:11.932698+0000","last_undegraded":"2023-10-25T16:14:11.932698+0000","last_fullsized":"2023-10-25T16:14:11.932698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:29.940732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080995+0000","last_change":"2023-10-25T16:14:10.944915+0000","last_active":"2023-10-25T16:14:12.080995+0000","last_peered":"2023-10-25T16:14:12.080995+0000","last_clean":"2023-10-25T16:14:12.080995+0000","last_became_active":"2023-10-25T16:14:10.944333+0000","last_became_peered":"2023-10-25T16:14:10.944333+0000","last_unstale":"2023-10-25T16:14:12.080995+0000","last_undegraded":"2023-10-25T16:14:12.080995+0000","last_fullsized":"2023-10-25T16:14:12.080995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:13:36.039804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.082830+0000","last_change":"2023-10-25T16:14:10.942705+0000","last_active":"2023-10-25T16:14:12.082830+0000","last_peered":"2023-10-25T16:14:12.082830+0000","last_clean":"2023-10-25T16:14:12.082830+0000","last_became_active":"2023-10-25T16:14:10.939336+0000","last_became_peered":"2023-10-25T16:14:10.939336+0000","last_unstale":"2023-10-25T16:14:12.082830+0000","last_undegraded":"2023-10-25T16:14:12.082830+0000","last_fullsized":"2023-10-25T16:14:12.082830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:41.918929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.062776+0000","last_change":"2023-10-25T16:14:10.951261+0000","last_active":"2023-10-25T16:14:12.062776+0000","last_peered":"2023-10-25T16:14:12.062776+0000","last_clean":"2023-10-25T16:14:12.062776+0000","last_became_active":"2023-10-25T16:14:10.950517+0000","last_became_peered":"2023-10-25T16:14:10.950517+0000","last_unstale":"2023-10-25T16:14:12.062776+0000","last_undegraded":"2023-10-25T16:14:12.062776+0000","last_fullsized":"2023-10-25T16:14:12.062776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:14.439843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.079863+0000","last_change":"2023-10-25T16:14:10.943615+0000","last_active":"2023-10-25T16:14:12.079863+0000","last_peered":"2023-10-25T16:14:12.079863+0000","last_clean":"2023-10-25T16:14:12.079863+0000","last_became_active":"2023-10-25T16:14:10.942970+0000","last_became_peered":"2023-10-25T16:14:10.942970+0000","last_unstale":"2023-10-25T16:14:12.079863+0000","last_undegraded":"2023-10-25T16:14:12.079863+0000","last_fullsized":"2023-10-25T16:14:12.079863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:25:33.734555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.076356+0000","last_change":"2023-10-25T16:14:10.956564+0000","last_active":"2023-10-25T16:14:12.076356+0000","last_peered":"2023-10-25T16:14:12.076356+0000","last_clean":"2023-10-25T16:14:12.076356+0000","last_became_active":"2023-10-25T16:14:10.954795+0000","last_became_peered":"2023-10-25T16:14:10.954795+0000","last_unstale":"2023-10-25T16:14:12.076356+0000","last_undegraded":"2023-10-25T16:14:12.076356+0000","last_fullsized":"2023-10-25T16:14:12.076356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:41.918929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077294+0000","last_change":"2023-10-25T16:14:10.956011+0000","last_active":"2023-10-25T16:14:12.077294+0000","last_peered":"2023-10-25T16:14:12.077294+0000","last_clean":"2023-10-25T16:14:12.077294+0000","last_became_active":"2023-10-25T16:14:10.953682+0000","last_became_peered":"2023-10-25T16:14:10.953682+0000","last_unstale":"2023-10-25T16:14:12.077294+0000","last_undegraded":"2023-10-25T16:14:12.077294+0000","last_fullsized":"2023-10-25T16:14:12.077294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:18:50.110647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.075801+0000","last_change":"2023-10-25T16:14:10.954047+0000","last_active":"2023-10-25T16:14:12.075801+0000","last_peered":"2023-10-25T16:14:12.075801+0000","last_clean":"2023-10-25T16:14:12.075801+0000","last_became_active":"2023-10-25T16:14:10.952292+0000","last_became_peered":"2023-10-25T16:14:10.952292+0000","last_unstale":"2023-10-25T16:14:12.075801+0000","last_undegraded":"2023-10-25T16:14:12.075801+0000","last_fullsized":"2023-10-25T16:14:12.075801+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:59.095510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080876+0000","last_change":"2023-10-25T16:14:10.936571+0000","last_active":"2023-10-25T16:14:12.080876+0000","last_peered":"2023-10-25T16:14:12.080876+0000","last_clean":"2023-10-25T16:14:12.080876+0000","last_became_active":"2023-10-25T16:14:10.935848+0000","last_became_peered":"2023-10-25T16:14:10.935848+0000","last_unstale":"2023-10-25T16:14:12.080876+0000","last_undegraded":"2023-10-25T16:14:12.080876+0000","last_fullsized":"2023-10-25T16:14:12.080876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:51.761351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080614+0000","last_change":"2023-10-25T16:14:10.952394+0000","last_active":"2023-10-25T16:14:12.080614+0000","last_peered":"2023-10-25T16:14:12.080614+0000","last_clean":"2023-10-25T16:14:12.080614+0000","last_became_active":"2023-10-25T16:14:10.951798+0000","last_became_peered":"2023-10-25T16:14:10.951798+0000","last_unstale":"2023-10-25T16:14:12.080614+0000","last_undegraded":"2023-10-25T16:14:12.080614+0000","last_fullsized":"2023-10-25T16:14:12.080614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:48:31.271328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935119+0000","last_change":"2023-10-25T16:14:10.951217+0000","last_active":"2023-10-25T16:14:11.935119+0000","last_peered":"2023-10-25T16:14:11.935119+0000","last_clean":"2023-10-25T16:14:11.935119+0000","last_became_active":"2023-10-25T16:14:10.949210+0000","last_became_peered":"2023-10-25T16:14:10.949210+0000","last_unstale":"2023-10-25T16:14:11.935119+0000","last_undegraded":"2023-10-25T16:14:11.935119+0000","last_fullsized":"2023-10-25T16:14:11.935119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:25:33.734555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081837+0000","last_change":"2023-10-25T16:14:10.956175+0000","last_active":"2023-10-25T16:14:12.081837+0000","last_peered":"2023-10-25T16:14:12.081837+0000","last_clean":"2023-10-25T16:14:12.081837+0000","last_became_active":"2023-10-25T16:14:10.955053+0000","last_became_peered":"2023-10-25T16:14:10.955053+0000","last_unstale":"2023-10-25T16:14:12.081837+0000","last_undegraded":"2023-10-25T16:14:12.081837+0000","last_fullsized":"2023-10-25T16:14:12.081837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:14.439843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.934938+0000","last_change":"2023-10-25T16:14:10.935732+0000","last_active":"2023-10-25T16:14:11.934938+0000","last_peered":"2023-10-25T16:14:11.934938+0000","last_clean":"2023-10-25T16:14:11.934938+0000","last_became_active":"2023-10-25T16:14:10.935071+0000","last_became_peered":"2023-10-25T16:14:10.935071+0000","last_unstale":"2023-10-25T16:14:11.934938+0000","last_undegraded":"2023-10-25T16:14:11.934938+0000","last_fullsized":"2023-10-25T16:14:11.934938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:19:28.095926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.063352+0000","last_change":"2023-10-25T16:14:10.948858+0000","last_active":"2023-10-25T16:14:12.063352+0000","last_peered":"2023-10-25T16:14:12.063352+0000","last_clean":"2023-10-25T16:14:12.063352+0000","last_became_active":"2023-10-25T16:14:10.947342+0000","last_became_peered":"2023-10-25T16:14:10.947342+0000","last_unstale":"2023-10-25T16:14:12.063352+0000","last_undegraded":"2023-10-25T16:14:12.063352+0000","last_fullsized":"2023-10-25T16:14:12.063352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:48:31.271328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973275+0000","last_change":"2023-10-25T16:14:09.922405+0000","last_active":"2023-10-25T16:14:10.973275+0000","last_peered":"2023-10-25T16:14:10.973275+0000","last_clean":"2023-10-25T16:14:10.973275+0000","last_became_active":"2023-10-25T16:14:09.921750+0000","last_became_peered":"2023-10-25T16:14:09.921750+0000","last_unstale":"2023-10-25T16:14:10.973275+0000","last_undegraded":"2023-10-25T16:14:10.973275+0000","last_fullsized":"2023-10-25T16:14:10.973275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:54:33.757431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.079182+0000","last_change":"2023-10-25T16:14:10.951594+0000","last_active":"2023-10-25T16:14:12.079182+0000","last_peered":"2023-10-25T16:14:12.079182+0000","last_clean":"2023-10-25T16:14:12.079182+0000","last_became_active":"2023-10-25T16:14:10.951003+0000","last_became_peered":"2023-10-25T16:14:10.951003+0000","last_unstale":"2023-10-25T16:14:12.079182+0000","last_undegraded":"2023-10-25T16:14:12.079182+0000","last_fullsized":"2023-10-25T16:14:12.079182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:06:07.180125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.971312+0000","last_change":"2023-10-25T16:14:09.896346+0000","last_active":"2023-10-25T16:14:10.971312+0000","last_peered":"2023-10-25T16:14:10.971312+0000","last_clean":"2023-10-25T16:14:10.971312+0000","last_became_active":"2023-10-25T16:14:09.895371+0000","last_became_peered":"2023-10-25T16:14:09.895371+0000","last_unstale":"2023-10-25T16:14:10.971312+0000","last_undegraded":"2023-10-25T16:14:10.971312+0000","last_fullsized":"2023-10-25T16:14:10.971312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:10:03.580913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081306+0000","last_change":"2023-10-25T16:14:10.947087+0000","last_active":"2023-10-25T16:14:12.081306+0000","last_peered":"2023-10-25T16:14:12.081306+0000","last_clean":"2023-10-25T16:14:12.081306+0000","last_became_active":"2023-10-25T16:14:10.946420+0000","last_became_peered":"2023-10-25T16:14:10.946420+0000","last_unstale":"2023-10-25T16:14:12.081306+0000","last_undegraded":"2023-10-25T16:14:12.081306+0000","last_fullsized":"2023-10-25T16:14:12.081306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:59.095510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.968682+0000","last_change":"2023-10-25T16:14:09.900779+0000","last_active":"2023-10-25T16:14:10.968682+0000","last_peered":"2023-10-25T16:14:10.968682+0000","last_clean":"2023-10-25T16:14:10.968682+0000","last_became_active":"2023-10-25T16:14:09.900488+0000","last_became_peered":"2023-10-25T16:14:09.900488+0000","last_unstale":"2023-10-25T16:14:10.968682+0000","last_undegraded":"2023-10-25T16:14:10.968682+0000","last_fullsized":"2023-10-25T16:14:10.968682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:10:14.810382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077787+0000","last_change":"2023-10-25T16:14:10.959153+0000","last_active":"2023-10-25T16:14:12.077787+0000","last_peered":"2023-10-25T16:14:12.077787+0000","last_clean":"2023-10-25T16:14:12.077787+0000","last_became_active":"2023-10-25T16:14:10.958693+0000","last_became_peered":"2023-10-25T16:14:10.958693+0000","last_unstale":"2023-10-25T16:14:12.077787+0000","last_undegraded":"2023-10-25T16:14:12.077787+0000","last_fullsized":"2023-10-25T16:14:12.077787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:37.758824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.775871+0000","last_change":"2023-10-25T16:14:09.903571+0000","last_active":"2023-10-25T16:14:11.775871+0000","last_peered":"2023-10-25T16:14:11.775871+0000","last_clean":"2023-10-25T16:14:11.775871+0000","last_became_active":"2023-10-25T16:14:09.903046+0000","last_became_peered":"2023-10-25T16:14:09.903046+0000","last_unstale":"2023-10-25T16:14:11.775871+0000","last_undegraded":"2023-10-25T16:14:11.775871+0000","last_fullsized":"2023-10-25T16:14:11.775871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:58:54.186103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935946+0000","last_change":"2023-10-25T16:14:10.946159+0000","last_active":"2023-10-25T16:14:11.935946+0000","last_peered":"2023-10-25T16:14:11.935946+0000","last_clean":"2023-10-25T16:14:11.935946+0000","last_became_active":"2023-10-25T16:14:10.936552+0000","last_became_peered":"2023-10-25T16:14:10.936552+0000","last_unstale":"2023-10-25T16:14:11.935946+0000","last_undegraded":"2023-10-25T16:14:11.935946+0000","last_fullsized":"2023-10-25T16:14:11.935946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:51.761351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973572+0000","last_change":"2023-10-25T16:14:09.920892+0000","last_active":"2023-10-25T16:14:10.973572+0000","last_peered":"2023-10-25T16:14:10.973572+0000","last_clean":"2023-10-25T16:14:10.973572+0000","last_became_active":"2023-10-25T16:14:09.914535+0000","last_became_peered":"2023-10-25T16:14:09.914535+0000","last_unstale":"2023-10-25T16:14:10.973572+0000","last_undegraded":"2023-10-25T16:14:10.973572+0000","last_fullsized":"2023-10-25T16:14:10.973572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:09.933760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080006+0000","last_change":"2023-10-25T16:14:10.940512+0000","last_active":"2023-10-25T16:14:12.080006+0000","last_peered":"2023-10-25T16:14:12.080006+0000","last_clean":"2023-10-25T16:14:12.080006+0000","last_became_active":"2023-10-25T16:14:10.936932+0000","last_became_peered":"2023-10-25T16:14:10.936932+0000","last_unstale":"2023-10-25T16:14:12.080006+0000","last_undegraded":"2023-10-25T16:14:12.080006+0000","last_fullsized":"2023-10-25T16:14:12.080006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:37.758824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.971945+0000","last_change":"2023-10-25T16:14:09.915676+0000","last_active":"2023-10-25T16:14:10.971945+0000","last_peered":"2023-10-25T16:14:10.971945+0000","last_clean":"2023-10-25T16:14:10.971945+0000","last_became_active":"2023-10-25T16:14:09.914933+0000","last_became_peered":"2023-10-25T16:14:09.914933+0000","last_unstale":"2023-10-25T16:14:10.971945+0000","last_undegraded":"2023-10-25T16:14:10.971945+0000","last_fullsized":"2023-10-25T16:14:10.971945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:24.723032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081406+0000","last_change":"2023-10-25T16:14:10.960921+0000","last_active":"2023-10-25T16:14:12.081406+0000","last_peered":"2023-10-25T16:14:12.081406+0000","last_clean":"2023-10-25T16:14:12.081406+0000","last_became_active":"2023-10-25T16:14:10.959009+0000","last_became_peered":"2023-10-25T16:14:10.959009+0000","last_unstale":"2023-10-25T16:14:12.081406+0000","last_undegraded":"2023-10-25T16:14:12.081406+0000","last_fullsized":"2023-10-25T16:14:12.081406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:04.718351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.930318+0000","last_change":"2023-10-25T16:14:09.903570+0000","last_active":"2023-10-25T16:14:10.930318+0000","last_peered":"2023-10-25T16:14:10.930318+0000","last_clean":"2023-10-25T16:14:10.930318+0000","last_became_active":"2023-10-25T16:14:09.903211+0000","last_became_peered":"2023-10-25T16:14:09.903211+0000","last_unstale":"2023-10-25T16:14:10.930318+0000","last_undegraded":"2023-10-25T16:14:10.930318+0000","last_fullsized":"2023-10-25T16:14:10.930318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:58.079583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077225+0000","last_change":"2023-10-25T16:14:10.945870+0000","last_active":"2023-10-25T16:14:12.077225+0000","last_peered":"2023-10-25T16:14:12.077225+0000","last_clean":"2023-10-25T16:14:12.077225+0000","last_became_active":"2023-10-25T16:14:10.945070+0000","last_became_peered":"2023-10-25T16:14:10.945070+0000","last_unstale":"2023-10-25T16:14:12.077225+0000","last_undegraded":"2023-10-25T16:14:12.077225+0000","last_fullsized":"2023-10-25T16:14:12.077225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:25:33.734555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.953756+0000","last_change":"2023-10-25T16:14:09.919464+0000","last_active":"2023-10-25T16:14:10.953756+0000","last_peered":"2023-10-25T16:14:10.953756+0000","last_clean":"2023-10-25T16:14:10.953756+0000","last_became_active":"2023-10-25T16:14:09.916972+0000","last_became_peered":"2023-10-25T16:14:09.916972+0000","last_unstale":"2023-10-25T16:14:10.953756+0000","last_undegraded":"2023-10-25T16:14:10.953756+0000","last_fullsized":"2023-10-25T16:14:10.953756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:51:04.126027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080529+0000","last_change":"2023-10-25T16:14:10.942764+0000","last_active":"2023-10-25T16:14:12.080529+0000","last_peered":"2023-10-25T16:14:12.080529+0000","last_clean":"2023-10-25T16:14:12.080529+0000","last_became_active":"2023-10-25T16:14:10.941531+0000","last_became_peered":"2023-10-25T16:14:10.941531+0000","last_unstale":"2023-10-25T16:14:12.080529+0000","last_undegraded":"2023-10-25T16:14:12.080529+0000","last_fullsized":"2023-10-25T16:14:12.080529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:23.079441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.932309+0000","last_change":"2023-10-25T16:14:09.897875+0000","last_active":"2023-10-25T16:14:10.932309+0000","last_peered":"2023-10-25T16:14:10.932309+0000","last_clean":"2023-10-25T16:14:10.932309+0000","last_became_active":"2023-10-25T16:14:09.897520+0000","last_became_peered":"2023-10-25T16:14:09.897520+0000","last_unstale":"2023-10-25T16:14:10.932309+0000","last_undegraded":"2023-10-25T16:14:10.932309+0000","last_fullsized":"2023-10-25T16:14:10.932309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:36.742898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077459+0000","last_change":"2023-10-25T16:14:10.956483+0000","last_active":"2023-10-25T16:14:12.077459+0000","last_peered":"2023-10-25T16:14:12.077459+0000","last_clean":"2023-10-25T16:14:12.077459+0000","last_became_active":"2023-10-25T16:14:10.955407+0000","last_became_peered":"2023-10-25T16:14:10.955407+0000","last_unstale":"2023-10-25T16:14:12.077459+0000","last_undegraded":"2023-10-25T16:14:12.077459+0000","last_fullsized":"2023-10-25T16:14:12.077459+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:50:54.137838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.926492+0000","last_change":"2023-10-25T16:14:09.897286+0000","last_active":"2023-10-25T16:14:10.926492+0000","last_peered":"2023-10-25T16:14:10.926492+0000","last_clean":"2023-10-25T16:14:10.926492+0000","last_became_active":"2023-10-25T16:14:09.897011+0000","last_became_peered":"2023-10-25T16:14:09.897011+0000","last_unstale":"2023-10-25T16:14:10.926492+0000","last_undegraded":"2023-10-25T16:14:10.926492+0000","last_fullsized":"2023-10-25T16:14:10.926492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:28:56.151020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.077452+0000","last_change":"2023-10-25T16:14:10.954503+0000","last_active":"2023-10-25T16:14:12.077452+0000","last_peered":"2023-10-25T16:14:12.077452+0000","last_clean":"2023-10-25T16:14:12.077452+0000","last_became_active":"2023-10-25T16:14:10.947644+0000","last_became_peered":"2023-10-25T16:14:10.947644+0000","last_unstale":"2023-10-25T16:14:12.077452+0000","last_undegraded":"2023-10-25T16:14:12.077452+0000","last_fullsized":"2023-10-25T16:14:12.077452+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:07.618917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.972011+0000","last_change":"2023-10-25T16:14:09.916641+0000","last_active":"2023-10-25T16:14:10.972011+0000","last_peered":"2023-10-25T16:14:10.972011+0000","last_clean":"2023-10-25T16:14:10.972011+0000","last_became_active":"2023-10-25T16:14:09.916008+0000","last_became_peered":"2023-10-25T16:14:09.916008+0000","last_unstale":"2023-10-25T16:14:10.972011+0000","last_undegraded":"2023-10-25T16:14:10.972011+0000","last_fullsized":"2023-10-25T16:14:10.972011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:40.903002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081399+0000","last_change":"2023-10-25T16:14:10.959634+0000","last_active":"2023-10-25T16:14:12.081399+0000","last_peered":"2023-10-25T16:14:12.081399+0000","last_clean":"2023-10-25T16:14:12.081399+0000","last_became_active":"2023-10-25T16:14:10.957389+0000","last_became_peered":"2023-10-25T16:14:10.957389+0000","last_unstale":"2023-10-25T16:14:12.081399+0000","last_undegraded":"2023-10-25T16:14:12.081399+0000","last_fullsized":"2023-10-25T16:14:12.081399+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:06.852284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973177+0000","last_change":"2023-10-25T16:14:09.900297+0000","last_active":"2023-10-25T16:14:10.973177+0000","last_peered":"2023-10-25T16:14:10.973177+0000","last_clean":"2023-10-25T16:14:10.973177+0000","last_became_active":"2023-10-25T16:14:09.900016+0000","last_became_peered":"2023-10-25T16:14:09.900016+0000","last_unstale":"2023-10-25T16:14:10.973177+0000","last_undegraded":"2023-10-25T16:14:10.973177+0000","last_fullsized":"2023-10-25T16:14:10.973177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:19:27.080000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.076212+0000","last_change":"2023-10-25T16:14:10.946716+0000","last_active":"2023-10-25T16:14:12.076212+0000","last_peered":"2023-10-25T16:14:12.076212+0000","last_clean":"2023-10-25T16:14:12.076212+0000","last_became_active":"2023-10-25T16:14:10.946215+0000","last_became_peered":"2023-10-25T16:14:10.946215+0000","last_unstale":"2023-10-25T16:14:12.076212+0000","last_undegraded":"2023-10-25T16:14:12.076212+0000","last_fullsized":"2023-10-25T16:14:12.076212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:19:28.095926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973865+0000","last_change":"2023-10-25T16:14:09.918677+0000","last_active":"2023-10-25T16:14:10.973865+0000","last_peered":"2023-10-25T16:14:10.973865+0000","last_clean":"2023-10-25T16:14:10.973865+0000","last_became_active":"2023-10-25T16:14:09.914456+0000","last_became_peered":"2023-10-25T16:14:09.914456+0000","last_unstale":"2023-10-25T16:14:10.973865+0000","last_undegraded":"2023-10-25T16:14:10.973865+0000","last_fullsized":"2023-10-25T16:14:10.973865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:10:14.810382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.078148+0000","last_change":"2023-10-25T16:14:10.948672+0000","last_active":"2023-10-25T16:14:12.078148+0000","last_peered":"2023-10-25T16:14:12.078148+0000","last_clean":"2023-10-25T16:14:12.078148+0000","last_became_active":"2023-10-25T16:14:10.946035+0000","last_became_peered":"2023-10-25T16:14:10.946035+0000","last_unstale":"2023-10-25T16:14:12.078148+0000","last_undegraded":"2023-10-25T16:14:12.078148+0000","last_fullsized":"2023-10-25T16:14:12.078148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:10.169966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.945253+0000","last_change":"2023-10-25T16:14:09.912614+0000","last_active":"2023-10-25T16:14:10.945253+0000","last_peered":"2023-10-25T16:14:10.945253+0000","last_clean":"2023-10-25T16:14:10.945253+0000","last_became_active":"2023-10-25T16:14:09.912418+0000","last_became_peered":"2023-10-25T16:14:09.912418+0000","last_unstale":"2023-10-25T16:14:10.945253+0000","last_undegraded":"2023-10-25T16:14:10.945253+0000","last_fullsized":"2023-10-25T16:14:10.945253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:57.687328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935423+0000","last_change":"2023-10-25T16:14:10.948092+0000","last_active":"2023-10-25T16:14:11.935423+0000","last_peered":"2023-10-25T16:14:11.935423+0000","last_clean":"2023-10-25T16:14:11.935423+0000","last_became_active":"2023-10-25T16:14:10.945448+0000","last_became_peered":"2023-10-25T16:14:10.945448+0000","last_unstale":"2023-10-25T16:14:11.935423+0000","last_undegraded":"2023-10-25T16:14:11.935423+0000","last_fullsized":"2023-10-25T16:14:11.935423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:43.515266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.929942+0000","last_change":"2023-10-25T16:14:09.902203+0000","last_active":"2023-10-25T16:14:10.929942+0000","last_peered":"2023-10-25T16:14:10.929942+0000","last_clean":"2023-10-25T16:14:10.929942+0000","last_became_active":"2023-10-25T16:14:09.901945+0000","last_became_peered":"2023-10-25T16:14:09.901945+0000","last_unstale":"2023-10-25T16:14:10.929942+0000","last_undegraded":"2023-10-25T16:14:10.929942+0000","last_fullsized":"2023-10-25T16:14:10.929942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:13:35.023877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.079709+0000","last_change":"2023-10-25T16:14:10.956365+0000","last_active":"2023-10-25T16:14:12.079709+0000","last_peered":"2023-10-25T16:14:12.079709+0000","last_clean":"2023-10-25T16:14:12.079709+0000","last_became_active":"2023-10-25T16:14:10.954644+0000","last_became_peered":"2023-10-25T16:14:10.954644+0000","last_unstale":"2023-10-25T16:14:12.079709+0000","last_undegraded":"2023-10-25T16:14:12.079709+0000","last_fullsized":"2023-10-25T16:14:12.079709+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:51:05.141954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973284+0000","last_change":"2023-10-25T16:14:09.898597+0000","last_active":"2023-10-25T16:14:10.973284+0000","last_peered":"2023-10-25T16:14:10.973284+0000","last_clean":"2023-10-25T16:14:10.973284+0000","last_became_active":"2023-10-25T16:14:09.898326+0000","last_became_peered":"2023-10-25T16:14:09.898326+0000","last_unstale":"2023-10-25T16:14:10.973284+0000","last_undegraded":"2023-10-25T16:14:10.973284+0000","last_fullsized":"2023-10-25T16:14:10.973284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:51.944744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.081921+0000","last_change":"2023-10-25T16:14:10.962307+0000","last_active":"2023-10-25T16:14:12.081921+0000","last_peered":"2023-10-25T16:14:12.081921+0000","last_clean":"2023-10-25T16:14:12.081921+0000","last_became_active":"2023-10-25T16:14:10.959956+0000","last_became_peered":"2023-10-25T16:14:10.959956+0000","last_unstale":"2023-10-25T16:14:12.081921+0000","last_undegraded":"2023-10-25T16:14:12.081921+0000","last_fullsized":"2023-10-25T16:14:12.081921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:19:28.095926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.967896+0000","last_change":"2023-10-25T16:14:09.900214+0000","last_active":"2023-10-25T16:14:10.967896+0000","last_peered":"2023-10-25T16:14:10.967896+0000","last_clean":"2023-10-25T16:14:10.967896+0000","last_became_active":"2023-10-25T16:14:09.899931+0000","last_became_peered":"2023-10-25T16:14:09.899931+0000","last_unstale":"2023-10-25T16:14:10.967896+0000","last_undegraded":"2023-10-25T16:14:10.967896+0000","last_fullsized":"2023-10-25T16:14:10.967896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:10:14.810382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080195+0000","last_change":"2023-10-25T16:14:10.936520+0000","last_active":"2023-10-25T16:14:12.080195+0000","last_peered":"2023-10-25T16:14:12.080195+0000","last_clean":"2023-10-25T16:14:12.080195+0000","last_became_active":"2023-10-25T16:14:10.935929+0000","last_became_peered":"2023-10-25T16:14:10.935929+0000","last_unstale":"2023-10-25T16:14:12.080195+0000","last_undegraded":"2023-10-25T16:14:12.080195+0000","last_fullsized":"2023-10-25T16:14:12.080195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:43.515266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973206+0000","last_change":"2023-10-25T16:14:09.917999+0000","last_active":"2023-10-25T16:14:10.973206+0000","last_peered":"2023-10-25T16:14:10.973206+0000","last_clean":"2023-10-25T16:14:10.973206+0000","last_became_active":"2023-10-25T16:14:09.913140+0000","last_became_peered":"2023-10-25T16:14:09.913140+0000","last_unstale":"2023-10-25T16:14:10.973206+0000","last_undegraded":"2023-10-25T16:14:10.973206+0000","last_fullsized":"2023-10-25T16:14:10.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:51.944744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.075559+0000","last_change":"2023-10-25T16:14:10.954428+0000","last_active":"2023-10-25T16:14:12.075559+0000","last_peered":"2023-10-25T16:14:12.075559+0000","last_clean":"2023-10-25T16:14:12.075559+0000","last_became_active":"2023-10-25T16:14:10.953314+0000","last_became_peered":"2023-10-25T16:14:10.953314+0000","last_unstale":"2023-10-25T16:14:12.075559+0000","last_undegraded":"2023-10-25T16:14:12.075559+0000","last_fullsized":"2023-10-25T16:14:12.075559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:13:36.039804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.973208+0000","last_change":"2023-10-25T16:14:09.914266+0000","last_active":"2023-10-25T16:14:10.973208+0000","last_peered":"2023-10-25T16:14:10.973208+0000","last_clean":"2023-10-25T16:14:10.973208+0000","last_became_active":"2023-10-25T16:14:09.913641+0000","last_became_peered":"2023-10-25T16:14:09.913641+0000","last_unstale":"2023-10-25T16:14:10.973208+0000","last_undegraded":"2023-10-25T16:14:10.973208+0000","last_fullsized":"2023-10-25T16:14:10.973208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:35:12.438039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932718+0000","last_change":"2023-10-25T16:14:10.958874+0000","last_active":"2023-10-25T16:14:11.932718+0000","last_peered":"2023-10-25T16:14:11.932718+0000","last_clean":"2023-10-25T16:14:11.932718+0000","last_became_active":"2023-10-25T16:14:10.958296+0000","last_became_peered":"2023-10-25T16:14:10.958296+0000","last_unstale":"2023-10-25T16:14:11.932718+0000","last_undegraded":"2023-10-25T16:14:11.932718+0000","last_fullsized":"2023-10-25T16:14:11.932718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:10:04.596840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.932825+0000","last_change":"2023-10-25T16:14:09.915236+0000","last_active":"2023-10-25T16:14:10.932825+0000","last_peered":"2023-10-25T16:14:10.932825+0000","last_clean":"2023-10-25T16:14:10.932825+0000","last_became_active":"2023-10-25T16:14:09.913700+0000","last_became_peered":"2023-10-25T16:14:09.913700+0000","last_unstale":"2023-10-25T16:14:10.932825+0000","last_undegraded":"2023-10-25T16:14:10.932825+0000","last_fullsized":"2023-10-25T16:14:10.932825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:28.924806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932490+0000","last_change":"2023-10-25T16:14:10.958544+0000","last_active":"2023-10-25T16:14:11.932490+0000","last_peered":"2023-10-25T16:14:11.932490+0000","last_clean":"2023-10-25T16:14:11.932490+0000","last_became_active":"2023-10-25T16:14:10.957921+0000","last_became_peered":"2023-10-25T16:14:10.957921+0000","last_unstale":"2023-10-25T16:14:11.932490+0000","last_undegraded":"2023-10-25T16:14:11.932490+0000","last_fullsized":"2023-10-25T16:14:11.932490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:25.738959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.971323+0000","last_change":"2023-10-25T16:14:09.893705+0000","last_active":"2023-10-25T16:14:10.971323+0000","last_peered":"2023-10-25T16:14:10.971323+0000","last_clean":"2023-10-25T16:14:10.971323+0000","last_became_active":"2023-10-25T16:14:09.893053+0000","last_became_peered":"2023-10-25T16:14:09.893053+0000","last_unstale":"2023-10-25T16:14:10.971323+0000","last_undegraded":"2023-10-25T16:14:10.971323+0000","last_fullsized":"2023-10-25T16:14:10.971323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:06:06.164198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932451+0000","last_change":"2023-10-25T16:14:10.955445+0000","last_active":"2023-10-25T16:14:11.932451+0000","last_peered":"2023-10-25T16:14:11.932451+0000","last_clean":"2023-10-25T16:14:11.932451+0000","last_became_active":"2023-10-25T16:14:10.953936+0000","last_became_peered":"2023-10-25T16:14:10.953936+0000","last_unstale":"2023-10-25T16:14:11.932451+0000","last_undegraded":"2023-10-25T16:14:11.932451+0000","last_fullsized":"2023-10-25T16:14:11.932451+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:21:53.654216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.938148+0000","last_change":"2023-10-25T16:14:09.911158+0000","last_active":"2023-10-25T16:14:10.938148+0000","last_peered":"2023-10-25T16:14:10.938148+0000","last_clean":"2023-10-25T16:14:10.938148+0000","last_became_active":"2023-10-25T16:14:09.910559+0000","last_became_peered":"2023-10-25T16:14:09.910559+0000","last_unstale":"2023-10-25T16:14:10.938148+0000","last_undegraded":"2023-10-25T16:14:10.938148+0000","last_fullsized":"2023-10-25T16:14:10.938148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:24.723032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.933020+0000","last_change":"2023-10-25T16:14:10.950887+0000","last_active":"2023-10-25T16:14:11.933020+0000","last_peered":"2023-10-25T16:14:11.933020+0000","last_clean":"2023-10-25T16:14:11.933020+0000","last_became_active":"2023-10-25T16:14:10.947905+0000","last_became_peered":"2023-10-25T16:14:10.947905+0000","last_unstale":"2023-10-25T16:14:11.933020+0000","last_undegraded":"2023-10-25T16:14:11.933020+0000","last_fullsized":"2023-10-25T16:14:11.933020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:35:13.453965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.955131+0000","last_change":"2023-10-25T16:14:09.917611+0000","last_active":"2023-10-25T16:14:10.955131+0000","last_peered":"2023-10-25T16:14:10.955131+0000","last_clean":"2023-10-25T16:14:10.955131+0000","last_became_active":"2023-10-25T16:14:09.911386+0000","last_became_peered":"2023-10-25T16:14:09.911386+0000","last_unstale":"2023-10-25T16:14:10.955131+0000","last_undegraded":"2023-10-25T16:14:10.955131+0000","last_fullsized":"2023-10-25T16:14:10.955131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:13.423917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935492+0000","last_change":"2023-10-25T16:14:10.951627+0000","last_active":"2023-10-25T16:14:11.935492+0000","last_peered":"2023-10-25T16:14:11.935492+0000","last_clean":"2023-10-25T16:14:11.935492+0000","last_became_active":"2023-10-25T16:14:10.950186+0000","last_became_peered":"2023-10-25T16:14:10.950186+0000","last_unstale":"2023-10-25T16:14:11.935492+0000","last_undegraded":"2023-10-25T16:14:11.935492+0000","last_fullsized":"2023-10-25T16:14:11.935492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:50.207245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.928475+0000","last_change":"2023-10-25T16:14:09.919760+0000","last_active":"2023-10-25T16:14:10.928475+0000","last_peered":"2023-10-25T16:14:10.928475+0000","last_clean":"2023-10-25T16:14:10.928475+0000","last_became_active":"2023-10-25T16:14:09.918971+0000","last_became_peered":"2023-10-25T16:14:09.918971+0000","last_unstale":"2023-10-25T16:14:10.928475+0000","last_undegraded":"2023-10-25T16:14:10.928475+0000","last_fullsized":"2023-10-25T16:14:10.928475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:57.687328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.932584+0000","last_change":"2023-10-25T16:14:10.951202+0000","last_active":"2023-10-25T16:14:11.932584+0000","last_peered":"2023-10-25T16:14:11.932584+0000","last_clean":"2023-10-25T16:14:11.932584+0000","last_became_active":"2023-10-25T16:14:10.950592+0000","last_became_peered":"2023-10-25T16:14:10.950592+0000","last_unstale":"2023-10-25T16:14:11.932584+0000","last_undegraded":"2023-10-25T16:14:11.932584+0000","last_fullsized":"2023-10-25T16:14:11.932584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:28:57.166946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.971558+0000","last_change":"2023-10-25T16:14:09.919819+0000","last_active":"2023-10-25T16:14:10.971558+0000","last_peered":"2023-10-25T16:14:10.971558+0000","last_clean":"2023-10-25T16:14:10.971558+0000","last_became_active":"2023-10-25T16:14:09.919355+0000","last_became_peered":"2023-10-25T16:14:09.919355+0000","last_unstale":"2023-10-25T16:14:10.971558+0000","last_undegraded":"2023-10-25T16:14:10.971558+0000","last_fullsized":"2023-10-25T16:14:10.971558+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:13.423917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080242+0000","last_change":"2023-10-25T16:14:10.955779+0000","last_active":"2023-10-25T16:14:12.080242+0000","last_peered":"2023-10-25T16:14:12.080242+0000","last_clean":"2023-10-25T16:14:12.080242+0000","last_became_active":"2023-10-25T16:14:10.953852+0000","last_became_peered":"2023-10-25T16:14:10.953852+0000","last_unstale":"2023-10-25T16:14:12.080242+0000","last_undegraded":"2023-10-25T16:14:12.080242+0000","last_fullsized":"2023-10-25T16:14:12.080242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:50.207245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.062929+0000","last_change":"2023-10-25T16:14:09.893886+0000","last_active":"2023-10-25T16:14:12.062929+0000","last_peered":"2023-10-25T16:14:12.062929+0000","last_clean":"2023-10-25T16:14:12.062929+0000","last_became_active":"2023-10-25T16:14:09.893432+0000","last_became_peered":"2023-10-25T16:14:09.893432+0000","last_unstale":"2023-10-25T16:14:12.062929+0000","last_undegraded":"2023-10-25T16:14:12.062929+0000","last_fullsized":"2023-10-25T16:14:12.062929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:51:04.126027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.062793+0000","last_change":"2023-10-25T16:14:10.949240+0000","last_active":"2023-10-25T16:14:12.062793+0000","last_peered":"2023-10-25T16:14:12.062793+0000","last_clean":"2023-10-25T16:14:12.062793+0000","last_became_active":"2023-10-25T16:14:10.948221+0000","last_became_peered":"2023-10-25T16:14:10.948221+0000","last_unstale":"2023-10-25T16:14:12.062793+0000","last_undegraded":"2023-10-25T16:14:12.062793+0000","last_fullsized":"2023-10-25T16:14:12.062793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:06.419571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.942821+0000","last_change":"2023-10-25T16:14:09.903262+0000","last_active":"2023-10-25T16:14:10.942821+0000","last_peered":"2023-10-25T16:14:10.942821+0000","last_clean":"2023-10-25T16:14:10.942821+0000","last_became_active":"2023-10-25T16:14:09.903057+0000","last_became_peered":"2023-10-25T16:14:09.903057+0000","last_unstale":"2023-10-25T16:14:10.942821+0000","last_undegraded":"2023-10-25T16:14:10.942821+0000","last_fullsized":"2023-10-25T16:14:10.942821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:51.944744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080015+0000","last_change":"2023-10-25T16:14:10.946220+0000","last_active":"2023-10-25T16:14:12.080015+0000","last_peered":"2023-10-25T16:14:12.080015+0000","last_clean":"2023-10-25T16:14:12.080015+0000","last_became_active":"2023-10-25T16:14:10.944317+0000","last_became_peered":"2023-10-25T16:14:10.944317+0000","last_unstale":"2023-10-25T16:14:12.080015+0000","last_undegraded":"2023-10-25T16:14:12.080015+0000","last_fullsized":"2023-10-25T16:14:12.080015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:10:15.826309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.927659+0000","last_change":"2023-10-25T16:14:09.919298+0000","last_active":"2023-10-25T16:14:10.927659+0000","last_peered":"2023-10-25T16:14:10.927659+0000","last_clean":"2023-10-25T16:14:10.927659+0000","last_became_active":"2023-10-25T16:14:09.919124+0000","last_became_peered":"2023-10-25T16:14:09.919124+0000","last_unstale":"2023-10-25T16:14:10.927659+0000","last_undegraded":"2023-10-25T16:14:10.927659+0000","last_fullsized":"2023-10-25T16:14:10.927659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:38:01.659382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.063060+0000","last_change":"2023-10-25T16:14:10.941927+0000","last_active":"2023-10-25T16:14:12.063060+0000","last_peered":"2023-10-25T16:14:12.063060+0000","last_clean":"2023-10-25T16:14:12.063060+0000","last_became_active":"2023-10-25T16:14:10.941176+0000","last_became_peered":"2023-10-25T16:14:10.941176+0000","last_unstale":"2023-10-25T16:14:12.063060+0000","last_undegraded":"2023-10-25T16:14:12.063060+0000","last_fullsized":"2023-10-25T16:14:12.063060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:58.703255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.944017+0000","last_change":"2023-10-25T16:14:09.919635+0000","last_active":"2023-10-25T16:14:10.944017+0000","last_peered":"2023-10-25T16:14:10.944017+0000","last_clean":"2023-10-25T16:14:10.944017+0000","last_became_active":"2023-10-25T16:14:09.918977+0000","last_became_peered":"2023-10-25T16:14:09.918977+0000","last_unstale":"2023-10-25T16:14:10.944017+0000","last_undegraded":"2023-10-25T16:14:10.944017+0000","last_fullsized":"2023-10-25T16:14:10.944017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:05.403644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.076899+0000","last_change":"2023-10-25T16:14:10.954900+0000","last_active":"2023-10-25T16:14:12.076899+0000","last_peered":"2023-10-25T16:14:12.076899+0000","last_clean":"2023-10-25T16:14:12.076899+0000","last_became_active":"2023-10-25T16:14:10.948878+0000","last_became_peered":"2023-10-25T16:14:10.948878+0000","last_unstale":"2023-10-25T16:14:12.076899+0000","last_undegraded":"2023-10-25T16:14:12.076899+0000","last_fullsized":"2023-10-25T16:14:12.076899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:50.207245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.934189+0000","last_change":"2023-10-25T16:14:09.926399+0000","last_active":"2023-10-25T16:14:10.934189+0000","last_peered":"2023-10-25T16:14:10.934189+0000","last_clean":"2023-10-25T16:14:10.934189+0000","last_became_active":"2023-10-25T16:14:09.925779+0000","last_became_peered":"2023-10-25T16:14:09.925779+0000","last_unstale":"2023-10-25T16:14:10.934189+0000","last_undegraded":"2023-10-25T16:14:10.934189+0000","last_fullsized":"2023-10-25T16:14:10.934189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:31:14.463136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:12.080395+0000","last_change":"2023-10-25T16:14:10.940118+0000","last_active":"2023-10-25T16:14:12.080395+0000","last_peered":"2023-10-25T16:14:12.080395+0000","last_clean":"2023-10-25T16:14:12.080395+0000","last_became_active":"2023-10-25T16:14:10.938879+0000","last_became_peered":"2023-10-25T16:14:10.938879+0000","last_unstale":"2023-10-25T16:14:12.080395+0000","last_undegraded":"2023-10-25T16:14:12.080395+0000","last_fullsized":"2023-10-25T16:14:12.080395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:58.703255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.932263+0000","last_change":"2023-10-25T16:14:09.902489+0000","last_active":"2023-10-25T16:14:10.932263+0000","last_peered":"2023-10-25T16:14:10.932263+0000","last_clean":"2023-10-25T16:14:10.932263+0000","last_became_active":"2023-10-25T16:14:09.902239+0000","last_became_peered":"2023-10-25T16:14:09.902239+0000","last_unstale":"2023-10-25T16:14:10.932263+0000","last_undegraded":"2023-10-25T16:14:10.932263+0000","last_fullsized":"2023-10-25T16:14:10.932263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:25:32.718629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-25T16:14:11.935823+0000","last_change":"2023-10-25T16:14:10.950844+0000","last_active":"2023-10-25T16:14:11.935823+0000","last_peered":"2023-10-25T16:14:11.935823+0000","last_clean":"2023-10-25T16:14:11.935823+0000","last_became_active":"2023-10-25T16:14:10.946470+0000","last_became_peered":"2023-10-25T16:14:10.946470+0000","last_unstale":"2023-10-25T16:14:11.935823+0000","last_undegraded":"2023-10-25T16:14:11.935823+0000","last_fullsized":"2023-10-25T16:14:11.935823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:09.881393+0000","last_clean_scrub_stamp":"2023-10-25T16:14:09.881393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:05:44.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.938630+0000","last_change":"2023-10-25T16:14:09.919882+0000","last_active":"2023-10-25T16:14:10.938630+0000","last_peered":"2023-10-25T16:14:10.938630+0000","last_clean":"2023-10-25T16:14:10.938630+0000","last_became_active":"2023-10-25T16:14:09.919262+0000","last_became_peered":"2023-10-25T16:14:09.919262+0000","last_unstale":"2023-10-25T16:14:10.938630+0000","last_undegraded":"2023-10-25T16:14:10.938630+0000","last_fullsized":"2023-10-25T16:14:10.938630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:08.865466+0000","last_clean_scrub_stamp":"2023-10-25T16:14:08.865466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:28.924806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-25T16:14:10.923607+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:10.923607+0000","last_peered":"2023-10-25T16:14:10.923607+0000","last_clean":"2023-10-25T16:14:10.923607+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:10.923607+0000","last_undegraded":"2023-10-25T16:14:10.923607+0000","last_fullsized":"2023-10-25T16:14:10.923607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199843440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.98999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.018}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1850000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253052,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.95899999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.876}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.091},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.208}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.169}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.268}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199842894,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0329999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.135},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.92300000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.097},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.071}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.85899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199842838,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":1.0860000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.749},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.95099999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.228},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":0.98299999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199843406,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.028}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.149}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.27},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.2290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":154,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199841876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":1}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.627}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.111},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.036}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.069}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.95799999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.159},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.92500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":154,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199841876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.624},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.875}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.747},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.70199999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.98499999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.01}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.93300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.503},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.33000000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.438},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.752},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":0.78300000000000003}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:18.765 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:14:18.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:14:18.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 -- 172.21.15.177:0/555131585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071560 msgr2=0x7fa218154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 --2- 172.21.15.177:0/555131585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071560 0x7fa218154f40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa2180acb50 tx=0x7fa21001cab0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 -- 172.21.15.177:0/555131585 shutdown_connections 2023-10-25T16:14:18.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 --2- 172.21.15.177:0/555131585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa218071560 0x7fa218154f40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 --2- 172.21.15.177:0/555131585 >> v2:172.21.15.184:3300/0 conn(0x7fa2180c9b70 0x7fa218071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 -- 172.21.15.177:0/555131585 >> 172.21.15.177:0/555131585 conn(0x7fa2180698f0 msgr2=0x7fa218069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:18.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 -- 172.21.15.177:0/555131585 shutdown_connections 2023-10-25T16:14:18.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.927+0000 7fa220291640 1 -- 172.21.15.177:0/555131585 wait complete. 2023-10-25T16:14:18.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 Processor -- start 2023-10-25T16:14:18.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- start start 2023-10-25T16:14:18.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa218071560 0x7fa218137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 0x7fa2180acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa21815bea0 0x7fa2180ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180ae220 con 0x7fa2180c9b70 2023-10-25T16:14:18.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180ad610 con 0x7fa218071560 2023-10-25T16:14:18.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180ad8f0 con 0x7fa21815bea0 2023-10-25T16:14:18.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 0x7fa2180acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 0x7fa2180acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38496/0 (socket says 172.21.15.177:38496) 2023-10-25T16:14:18.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 -- 172.21.15.177:0/1597911173 learned_addr learned my addr 172.21.15.177:0/1597911173 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:18.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21e82e640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa21815bea0 0x7fa2180ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21e02d640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa218071560 0x7fa218137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 -- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa21815bea0 msgr2=0x7fa2180ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa21815bea0 0x7fa2180ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 -- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa218071560 msgr2=0x7fa218137980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:18.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa218071560 0x7fa218137980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:18.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 -- 172.21.15.177:0/1597911173 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210009820 con 0x7fa2180c9b70 2023-10-25T16:14:18.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21e02d640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa218071560 0x7fa218137980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:18.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa21d82c640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 0x7fa2180acb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c970 tx=0x7fa20800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:18.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208007bb0 con 0x7fa2180c9b70 2023-10-25T16:14:18.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa208007e00 con 0x7fa2180c9b70 2023-10-25T16:14:18.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180adbd0 con 0x7fa2180c9b70 2023-10-25T16:14:18.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208005280 con 0x7fa2180c9b70 2023-10-25T16:14:18.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa218137ec0 con 0x7fa2180c9b70 2023-10-25T16:14:18.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2180aef50 con 0x7fa2180c9b70 2023-10-25T16:14:18.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.931+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2080053e0 con 0x7fa2180c9b70 2023-10-25T16:14:18.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.935+0000 7fa20effd640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1fc066470 0x7fa1fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:18.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.935+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2080844c0 con 0x7fa2180c9b70 2023-10-25T16:14:18.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.935+0000 7fa21e02d640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1fc066470 0x7fa1fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:18.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.935+0000 7fa21e02d640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1fc066470 0x7fa1fc068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa214000f70 tx=0x7fa214009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:18.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:18.939+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2080553d0 con 0x7fa2180c9b70 2023-10-25T16:14:19.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.143+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa21806d040 con 0x7fa2180c9b70 2023-10-25T16:14:19.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa20effd640 1 -- 172.21.15.177:0/1597911173 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa20801d0e0 con 0x7fa2180c9b70 2023-10-25T16:14:19.152 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:14:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:14:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:14:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:14:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:14:19.154 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:14:19.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1fc066470 msgr2=0x7fa1fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1fc066470 0x7fa1fc068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa214000f70 tx=0x7fa214009040 comp rx=0 tx=0).stop 2023-10-25T16:14:19.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 msgr2=0x7fa2180acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 0x7fa2180acb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c970 tx=0x7fa20800ce30 comp rx=0 tx=0).stop 2023-10-25T16:14:19.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 shutdown_connections 2023-10-25T16:14:19.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1fc066470 0x7fa1fc068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa21815bea0 0x7fa2180ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2180c9b70 0x7fa2180acb50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 --2- 172.21.15.177:0/1597911173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa218071560 0x7fa218137980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 >> 172.21.15.177:0/1597911173 conn(0x7fa2180698f0 msgr2=0x7fa218069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:19.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 shutdown_connections 2023-10-25T16:14:19.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.147+0000 7fa220291640 1 -- 172.21.15.177:0/1597911173 wait complete. 2023-10-25T16:14:19.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:19.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/712732074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642006b980 msgr2=0x7f642006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 --2- 172.21.15.177:0/712732074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642006b980 0x7f642006be30 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f64200cd680 tx=0x7f641001c810 comp rx=0 tx=0).stop 2023-10-25T16:14:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/712732074 shutdown_connections 2023-10-25T16:14:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 --2- 172.21.15.177:0/712732074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 0x7f6420070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 --2- 172.21.15.177:0/712732074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642006b980 0x7f642006be30 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/712732074 >> 172.21.15.177:0/712732074 conn(0x7f64200b2450 msgr2=0x7f64200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/712732074 shutdown_connections 2023-10-25T16:14:19.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/712732074 wait complete. 2023-10-25T16:14:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 Processor -- start 2023-10-25T16:14:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- start start 2023-10-25T16:14:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f642006b980 0x7f64200b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:19.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 0x7f6420147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 0x7f6420142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6420147ad0 con 0x7f64201500f0 2023-10-25T16:14:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6420147d00 con 0x7f642006b980 2023-10-25T16:14:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6420147fe0 con 0x7f64200706f0 2023-10-25T16:14:19.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 0x7f6420142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 0x7f6420142950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38506/0 (socket says 172.21.15.177:38506) 2023-10-25T16:14:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 -- 172.21.15.177:0/2759775542 learned_addr learned my addr 172.21.15.177:0/2759775542 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6425f42640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f642006b980 0x7f64200b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6425741640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 0x7f6420147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:19.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 -- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 msgr2=0x7f6420147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 0x7f6420147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 -- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f642006b980 msgr2=0x7f64200b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f642006b980 0x7f64200b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 -- 172.21.15.177:0/2759775542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410009500 con 0x7f64201500f0 2023-10-25T16:14:19.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6425741640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 0x7f6420147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f6426743640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 0x7f6420142950 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f641800ccb0 tx=0x7f641800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418004b30 con 0x7f64201500f0 2023-10-25T16:14:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6418004da0 con 0x7f64201500f0 2023-10-25T16:14:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64201482c0 con 0x7f64201500f0 2023-10-25T16:14:19.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418005280 con 0x7f64201500f0 2023-10-25T16:14:19.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.291+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6420148880 con 0x7f64201500f0 2023-10-25T16:14:19.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.295+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642004daf0 con 0x7f64201500f0 2023-10-25T16:14:19.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.295+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64180053e0 con 0x7f64201500f0 2023-10-25T16:14:19.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.295+0000 7f64167fc640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:19.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.295+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6418084700 con 0x7f64201500f0 2023-10-25T16:14:19.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.295+0000 7f6425f42640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:19.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.295+0000 7f6425f42640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f641c004e30 tx=0x7f641c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:19.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.299+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6418051b80 con 0x7f64201500f0 2023-10-25T16:14:19.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6420148a70 con 0x7f64201500f0 2023-10-25T16:14:19.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64167fc640 1 -- 172.21.15.177:0/2759775542 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f641801d020 con 0x7f64201500f0 2023-10-25T16:14:19.493 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:19.493 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:19.495 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:19.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 msgr2=0x7f6404068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f641c004e30 tx=0x7f641c009040 comp rx=0 tx=0).stop 2023-10-25T16:14:19.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 msgr2=0x7f6420142950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:19.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 0x7f6420142950 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f641800ccb0 tx=0x7f641800a620 comp rx=0 tx=0).stop 2023-10-25T16:14:19.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 shutdown_connections 2023-10-25T16:14:19.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64201500f0 0x7f6420142950 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64200706f0 0x7f6420147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 --2- 172.21.15.177:0/2759775542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f642006b980 0x7f64200b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:19.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 >> 172.21.15.177:0/2759775542 conn(0x7f64200b2450 msgr2=0x7f64200b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:19.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 shutdown_connections 2023-10-25T16:14:19.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:19.487+0000 7f64281a6640 1 -- 172.21.15.177:0/2759775542 wait complete. 2023-10-25T16:14:19.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:14:10.242627+0000', 'modified': '2023-10-25T16:14:12.301221+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 154595}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_154595': {'gid': 154595, 'name': 'd', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/2532234730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 2532234730}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2532234730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:14:19.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:14:19.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-25T16:14:20.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 -- 172.21.15.177:0/1986077734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 msgr2=0x7f2630005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 --2- 172.21.15.177:0/1986077734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f2630005d60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f26480cabd0 tx=0x7f263c01f700 comp rx=0 tx=0).stop 2023-10-25T16:14:20.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 -- 172.21.15.177:0/1986077734 shutdown_connections 2023-10-25T16:14:20.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 --2- 172.21.15.177:0/1986077734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f2630005d60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 -- 172.21.15.177:0/1986077734 >> 172.21.15.177:0/1986077734 conn(0x7f26480b2450 msgr2=0x7f26480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 -- 172.21.15.177:0/1986077734 shutdown_connections 2023-10-25T16:14:20.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.043+0000 7f264e44a640 1 -- 172.21.15.177:0/1986077734 wait complete. 2023-10-25T16:14:20.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 Processor -- start 2023-10-25T16:14:20.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 -- start start 2023-10-25T16:14:20.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f264814c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2648155a60 0x7f26480abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26480cd0d0 0x7f26480cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2648157070 con 0x7f26300058e0 2023-10-25T16:14:20.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264814cd80 con 0x7f26480cd0d0 2023-10-25T16:14:20.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480cda90 con 0x7f2648155a60 2023-10-25T16:14:20.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f264814c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f264814c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38518/0 (socket says 172.21.15.177:38518) 2023-10-25T16:14:20.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 -- 172.21.15.177:0/3944144776 learned_addr learned my addr 172.21.15.177:0/3944144776 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:20.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f26477fe640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2648155a60 0x7f26480abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264c9e7640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26480cd0d0 0x7f26480cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 -- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2648155a60 msgr2=0x7f26480abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2648155a60 0x7f26480abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 -- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26480cd0d0 msgr2=0x7f26480cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26480cd0d0 0x7f26480cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 -- 172.21.15.177:0/3944144776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264814c7a0 con 0x7f26300058e0 2023-10-25T16:14:20.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2647fff640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f264814c260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2638011a10 tx=0x7f2638011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2644ff9640 1 -- 172.21.15.177:0/3944144776 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638004460 con 0x7f26300058e0 2023-10-25T16:14:20.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2644ff9640 1 -- 172.21.15.177:0/3944144776 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f263800f940 con 0x7f26300058e0 2023-10-25T16:14:20.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26480ac2e0 con 0x7f26300058e0 2023-10-25T16:14:20.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2644ff9640 1 -- 172.21.15.177:0/3944144776 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800fd30 con 0x7f26300058e0 2023-10-25T16:14:20.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481562b0 con 0x7f26300058e0 2023-10-25T16:14:20.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2644ff9640 1 -- 172.21.15.177:0/3944144776 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2638003600 con 0x7f26300058e0 2023-10-25T16:14:20.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.047+0000 7f2644ff9640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2634066470 0x7f2634068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2644ff9640 1 -- 172.21.15.177:0/3944144776 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2638084bd0 con 0x7f26300058e0 2023-10-25T16:14:20.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f26477fe640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2634066470 0x7f2634068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 Processor -- start 2023-10-25T16:14:20.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- start start 2023-10-25T16:14:20.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f26477fe640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2634066470 0x7f2634068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f263c0b0000 tx=0x7f263c01c4a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 0x56293a62bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62c2e0 0x56293a5e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a5e2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a3d6cc0 con 0x56293a62b9c0 2023-10-25T16:14:20.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a439920 con 0x56293a62c2e0 2023-10-25T16:14:20.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56293a436e50 con 0x56293a5e1f80 2023-10-25T16:14:20.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 0x56293a62bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 0x56293a62bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38528/0 (socket says 172.21.15.177:38528) 2023-10-25T16:14:20.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 -- 172.21.15.177:0/755880004 learned_addr learned my addr 172.21.15.177:0/755880004 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:20.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f26477fe640 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62c2e0 0x56293a5e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 -- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 msgr2=0x56293a5e2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a5e2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 -- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62c2e0 msgr2=0x56293a5e1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62c2e0 0x56293a5e1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 -- 172.21.15.177:0/755880004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56293a12b890 con 0x56293a62b9c0 2023-10-25T16:14:20.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f26477fe640 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62c2e0 0x56293a5e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:20.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2647fff640 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 0x56293a62bda0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f26380522c0 tx=0x7f2638055dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b64134d40d5145 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f262dffb640 1 -- 172.21.15.177:0/755880004 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638054160 con 0x56293a62b9c0 2023-10-25T16:14:20.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f262dffb640 1 -- 172.21.15.177:0/755880004 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f26380524d0 con 0x56293a62b9c0 2023-10-25T16:14:20.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f262dffb640 1 -- 172.21.15.177:0/755880004 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263805dd80 con 0x56293a62b9c0 2023-10-25T16:14:20.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- 172.21.15.177:0/755880004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 msgr2=0x56293a62bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 0x56293a62bda0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f26380522c0 tx=0x7f2638055dc0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- 172.21.15.177:0/755880004 shutdown_connections 2023-10-25T16:14:20.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a5e2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62c2e0 0x56293a5e1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 --2- 172.21.15.177:0/755880004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62b9c0 0x56293a62bda0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- 172.21.15.177:0/755880004 >> 172.21.15.177:0/755880004 conn(0x56293a5d92f0 msgr2=0x56293a5e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- 172.21.15.177:0/755880004 shutdown_connections 2023-10-25T16:14:20.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- 172.21.15.177:0/755880004 wait complete. 2023-10-25T16:14:20.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 -- start start 2023-10-25T16:14:20.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.051+0000 7f2651594000 1 Processor -- start 2023-10-25T16:14:20.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 0x56293a5ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a5ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62c2e0 0x56293a5ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a432740 con 0x56293a5e1f80 2023-10-25T16:14:20.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a3f1d10 con 0x56293a62b9c0 2023-10-25T16:14:20.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56293a3f19b0 con 0x56293a62c2e0 2023-10-25T16:14:20.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 0x56293a5ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 10 client.0 _ll_register_callbacks cb 0x56293a5cd6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:14:20.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 0x56293a5ecb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38542/0 (socket says 172.21.15.177:38542) 2023-10-25T16:14:20.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 -- 172.21.15.177:0/3642963434 learned_addr learned my addr 172.21.15.177:0/3642963434 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:20.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f264c9e7640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62c2e0 0x56293a5ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f26477fe640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a5ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 -- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62c2e0 msgr2=0x56293a5ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62c2e0 0x56293a5ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 -- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 msgr2=0x56293a5ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a5ed0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 -- 172.21.15.177:0/3642963434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481562b0 con 0x56293a5e1f80 2023-10-25T16:14:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2647fff640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 0x56293a5ecb90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2638055d50 tx=0x7f26380541e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58249669b38d19a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:14:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 1 -- 172.21.15.177:0/3642963434 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263805de50 con 0x56293a5e1f80 2023-10-25T16:14:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 1 -- 172.21.15.177:0/3642963434 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f263805ada0 con 0x56293a5e1f80 2023-10-25T16:14:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56293a3e6370 con 0x56293a5e1f80 2023-10-25T16:14:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 1 -- 172.21.15.177:0/3642963434 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2638051bb0 con 0x56293a5e1f80 2023-10-25T16:14:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 10 client.5568 fetch_fsmap learned FSMap version 12 2023-10-25T16:14:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x56293a3f4460 con 0x56293a5e1f80 2023-10-25T16:14:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 1 -- 172.21.15.177:0/3642963434 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x56293a3e6370 con 0x56293a5e1f80 2023-10-25T16:14:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 1 -- 172.21.15.177:0/3642963434 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 12) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2638051d10 con 0x56293a5e1f80 2023-10-25T16:14:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 10 client.5568 fetch_fsmap finished waiting for FSMap version 12 2023-10-25T16:14:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 10 client.5568 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:14:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 20 client.5568 populate_metadata read hostname 'smithi177' 2023-10-25T16:14:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a63aa50 0x56293a63ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 4 client.5568 mds_command: new command op to 154595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:14:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 --> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56293a3cc2d0 con 0x56293a63aa50 2023-10-25T16:14:20.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f26477fe640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a63aa50 0x56293a63ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f26477fe640 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a63aa50 0x56293a63ce40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f7dee258b7c50b server_cookie=4d76b61ca3828fcb in_seq=0 out_seq=0 2023-10-25T16:14:20.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.055+0000 7f2626ffd640 10 client.5568 ms_handle_connect on v2:172.21.15.184:6836/2532234730 2023-10-25T16:14:20.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2626ffd640 1 -- 172.21.15.177:0/3642963434 <== mds.0 v2:172.21.15.184:6836/2532234730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56293a3cc2d0 con 0x56293a63aa50 2023-10-25T16:14:20.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2626ffd640 10 client.5568 handle_command_reply: tid=0 2023-10-25T16:14:20.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 client.5568 shutdown 2023-10-25T16:14:20.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 msgr2=0x56293a5ecb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 0x56293a5ecb90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2638055d50 tx=0x7f26380541e0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 shutdown_connections 2023-10-25T16:14:20.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a63aa50 0x56293a63ce40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62c2e0 0x56293a5ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2626ffd640 0 client.5568 ms_handle_reset on v2:172.21.15.184:6836/2532234730 2023-10-25T16:14:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a5ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 --2- 172.21.15.177:0/3642963434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a5e1f80 0x56293a5ecb90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 >> 172.21.15.177:0/3642963434 conn(0x56293a5d92f0 msgr2=0x56293a5e0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 shutdown_connections 2023-10-25T16:14:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 1 -- 172.21.15.177:0/3642963434 wait complete. 2023-10-25T16:14:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.059+0000 7f2651594000 20 client.5568 trim_cache size 0 max 16384 2023-10-25T16:14:20.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.071+0000 7f2651594000 1 Processor -- start 2023-10-25T16:14:20.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.071+0000 7f2651594000 1 -- start start 2023-10-25T16:14:20.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a5e1f80 0x56293a68e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62b9c0 0x56293a68e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a68eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a0ec940 con 0x56293a62c2e0 2023-10-25T16:14:20.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a3fb720 con 0x56293a5e1f80 2023-10-25T16:14:20.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56293a5e4d90 con 0x56293a62b9c0 2023-10-25T16:14:20.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a68eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a68eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38554/0 (socket says 172.21.15.177:38554) 2023-10-25T16:14:20.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 -- 172.21.15.177:0/4253383691 learned_addr learned my addr 172.21.15.177:0/4253383691 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:20.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 -- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62b9c0 msgr2=0x56293a68e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62b9c0 0x56293a68e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2647fff640 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a5e1f80 0x56293a68e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 -- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a5e1f80 msgr2=0x56293a68e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a5e1f80 0x56293a68e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 -- 172.21.15.177:0/4253383691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56293a3da760 con 0x56293a62c2e0 2023-10-25T16:14:20.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a68eca0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2648071320 tx=0x7f2640006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5f72b4354ba096 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f262e7fc640 1 -- 172.21.15.177:0/4253383691 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640013650 con 0x56293a62c2e0 2023-10-25T16:14:20.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f262e7fc640 1 -- 172.21.15.177:0/4253383691 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f26400138a0 con 0x56293a62c2e0 2023-10-25T16:14:20.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f262e7fc640 1 -- 172.21.15.177:0/4253383691 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640013c70 con 0x56293a62c2e0 2023-10-25T16:14:20.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- 172.21.15.177:0/4253383691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 msgr2=0x56293a68eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a68eca0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2648071320 tx=0x7f2640006420 comp rx=0 tx=0).stop 2023-10-25T16:14:20.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- 172.21.15.177:0/4253383691 shutdown_connections 2023-10-25T16:14:20.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a68eca0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a62b9c0 0x56293a68e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- 172.21.15.177:0/4253383691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a5e1f80 0x56293a68e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- 172.21.15.177:0/4253383691 >> 172.21.15.177:0/4253383691 conn(0x56293a5d92f0 msgr2=0x56293a63d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- 172.21.15.177:0/4253383691 shutdown_connections 2023-10-25T16:14:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- 172.21.15.177:0/4253383691 wait complete. 2023-10-25T16:14:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- start start 2023-10-25T16:14:20.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 Processor -- start 2023-10-25T16:14:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a62a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a64ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a64ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a408a10 con 0x56293a62c2e0 2023-10-25T16:14:20.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293a42a640 con 0x56293a62b9c0 2023-10-25T16:14:20.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56293a3f1d10 con 0x56293a5e1f80 2023-10-25T16:14:20.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2651594000 10 client.0 _ll_register_callbacks cb 0x56293a430ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:14:20.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a64ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a64ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38570/0 (socket says 172.21.15.177:38570) 2023-10-25T16:14:20.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 -- 172.21.15.177:0/1538751599 learned_addr learned my addr 172.21.15.177:0/1538751599 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:20.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f26477fe640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a64ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f2647fff640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a62a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.075+0000 7f264c9e7640 1 -- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 msgr2=0x56293a62a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264c9e7640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a62a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264c9e7640 1 -- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 msgr2=0x56293a64ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:14:20.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264c9e7640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a64ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264c9e7640 1 -- 172.21.15.177:0/1538751599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26480b1c30 con 0x56293a62c2e0 2023-10-25T16:14:20.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2647fff640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a62a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:20.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264c9e7640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a64ef50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x56293a488120 tx=0x7f264001ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b83559028c00b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:14:20.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 1 -- 172.21.15.177:0/1538751599 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640023070 con 0x56293a62c2e0 2023-10-25T16:14:20.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 1 -- 172.21.15.177:0/1538751599 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2640003c50 con 0x56293a62c2e0 2023-10-25T16:14:20.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56293a5e5910 con 0x56293a62c2e0 2023-10-25T16:14:20.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 1 -- 172.21.15.177:0/1538751599 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2640003e10 con 0x56293a62c2e0 2023-10-25T16:14:20.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 10 client.5574 fetch_fsmap learned FSMap version 12 2023-10-25T16:14:20.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x56293a12bcc0 con 0x56293a62c2e0 2023-10-25T16:14:20.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 1 -- 172.21.15.177:0/1538751599 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x56293a5e5910 con 0x56293a62c2e0 2023-10-25T16:14:20.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 1 -- 172.21.15.177:0/1538751599 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 12) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f264001e0d0 con 0x56293a62c2e0 2023-10-25T16:14:20.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 10 client.5574 fetch_fsmap finished waiting for FSMap version 12 2023-10-25T16:14:20.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 10 client.5574 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:14:20.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 20 client.5574 populate_metadata read hostname 'smithi177' 2023-10-25T16:14:20.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a692090 0x56293a692470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 4 client.5574 mds_command: new command op to 154595 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:14:20.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 --> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56293a3ca6f0 con 0x56293a692090 2023-10-25T16:14:20.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2647fff640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a692090 0x56293a692470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 10 client.5574 ms_handle_connect on v2:172.21.15.184:6836/2532234730 2023-10-25T16:14:20.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2647fff640 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a692090 0x56293a692470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55e1fdb078260536 server_cookie=6528ec492ec1a70 in_seq=0 out_seq=0 2023-10-25T16:14:20.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 1 -- 172.21.15.177:0/1538751599 <== mds.0 v2:172.21.15.184:6836/2532234730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56293a3ca6f0 con 0x56293a692090 2023-10-25T16:14:20.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 10 client.5574 handle_command_reply: tid=0 2023-10-25T16:14:20.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 client.5574 shutdown 2023-10-25T16:14:20.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 msgr2=0x56293a64ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a64ef50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x56293a488120 tx=0x7f264001ece0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 shutdown_connections 2023-10-25T16:14:20.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56293a62c2e0 0x56293a64ef50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56293a62b9c0 0x56293a64ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:6836/2532234730,v1:172.21.15.184:6837/2532234730] conn(0x56293a692090 0x56293a692470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 --2- 172.21.15.177:0/1538751599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x56293a5e1f80 0x56293a62a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2626ffd640 0 client.5574 ms_handle_reset on v2:172.21.15.184:6836/2532234730 2023-10-25T16:14:20.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 >> 172.21.15.177:0/1538751599 conn(0x56293a5d92f0 msgr2=0x56293a63ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 shutdown_connections 2023-10-25T16:14:20.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 1 -- 172.21.15.177:0/1538751599 wait complete. 2023-10-25T16:14:20.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f2651594000 20 client.5574 trim_cache size 0 max 16384 2023-10-25T16:14:20.104 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:20.104 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:14:20.104 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:14:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 154595, 2023-10-25T16:14:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:14:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:14:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:14:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1255752809999997, 2023-10-25T16:14:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 12, 2023-10-25T16:14:20.106 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 35, 2023-10-25T16:14:20.106 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 35, 2023-10-25T16:14:20.106 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 17.086956311000002 2023-10-25T16:14:20.106 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:20.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2634066470 msgr2=0x7f2634068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2634066470 0x7f2634068930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f263c0b0000 tx=0x7f263c01c4a0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 msgr2=0x7f264814c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f264814c260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2638011a10 tx=0x7f2638011ed0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 shutdown_connections 2023-10-25T16:14:20.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2634066470 0x7f2634068930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26480cd0d0 0x7f26480cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2648155a60 0x7f26480abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 --2- 172.21.15.177:0/3944144776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26300058e0 0x7f264814c260 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 >> 172.21.15.177:0/3944144776 conn(0x7f26480b2450 msgr2=0x7f26480ac9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 shutdown_connections 2023-10-25T16:14:20.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.079+0000 7f264e44a640 1 -- 172.21.15.177:0/3944144776 wait complete. 2023-10-25T16:14:20.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:14:20.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 -- 172.21.15.177:0/643452494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b815eba0 msgr2=0x7f64b80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 --2- 172.21.15.177:0/643452494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b815eba0 0x7f64b80b4100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f64b80cb990 tx=0x7f64a801c810 comp rx=0 tx=0).stop 2023-10-25T16:14:20.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 -- 172.21.15.177:0/643452494 shutdown_connections 2023-10-25T16:14:20.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 --2- 172.21.15.177:0/643452494 >> v2:172.21.15.184:3300/0 conn(0x7f64b80cdb10 0x7f64b80cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 --2- 172.21.15.177:0/643452494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64b80b2120 0x7f64b80d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 --2- 172.21.15.177:0/643452494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b815eba0 0x7f64b80b4100 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 -- 172.21.15.177:0/643452494 >> 172.21.15.177:0/643452494 conn(0x7f64b809a5c0 msgr2=0x7f64b80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 -- 172.21.15.177:0/643452494 shutdown_connections 2023-10-25T16:14:20.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.207+0000 7f64bf290640 1 -- 172.21.15.177:0/643452494 wait complete. 2023-10-25T16:14:20.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 Processor -- start 2023-10-25T16:14:20.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- start start 2023-10-25T16:14:20.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64b80b2120 0x7f64b8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 0x7f64b8152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64b815eba0 0x7f64b815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b806a680 con 0x7f64b80cdb10 2023-10-25T16:14:20.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b815a1f0 con 0x7f64b815eba0 2023-10-25T16:14:20.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80c9e80 con 0x7f64b80b2120 2023-10-25T16:14:20.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 0x7f64b8152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 0x7f64b8152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38594/0 (socket says 172.21.15.177:38594) 2023-10-25T16:14:20.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 -- 172.21.15.177:0/2674948134 learned_addr learned my addr 172.21.15.177:0/2674948134 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:20.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bd02c640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64b80b2120 0x7f64b8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bd82d640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64b815eba0 0x7f64b815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 -- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64b80b2120 msgr2=0x7f64b8159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64b80b2120 0x7f64b8159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 -- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64b815eba0 msgr2=0x7f64b815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64b815eba0 0x7f64b815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 -- 172.21.15.177:0/2674948134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8009560 con 0x7f64b80cdb10 2023-10-25T16:14:20.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bc82b640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 0x7f64b8152950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c940 tx=0x7f64b400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4007bb0 con 0x7f64b80cdb10 2023-10-25T16:14:20.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64b4007e00 con 0x7f64b80cdb10 2023-10-25T16:14:20.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80ca160 con 0x7f64b80cdb10 2023-10-25T16:14:20.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4005280 con 0x7f64b80cdb10 2023-10-25T16:14:20.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b80ca720 con 0x7f64b80cdb10 2023-10-25T16:14:20.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.211+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b804daf0 con 0x7f64b80cdb10 2023-10-25T16:14:20.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.215+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64b40054a0 con 0x7f64b80cdb10 2023-10-25T16:14:20.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.215+0000 7f64adffb640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f649c066470 0x7f649c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:20.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.215+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b40847c0 con 0x7f64b80cdb10 2023-10-25T16:14:20.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.215+0000 7f64bd02c640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f649c066470 0x7f649c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:20.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.215+0000 7f64bd02c640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f649c066470 0x7f649c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64a80ae000 tx=0x7f64a801b050 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:20.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.219+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64b4051bb0 con 0x7f64b80cdb10 2023-10-25T16:14:20.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.391+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64b80ce930 con 0x7f64b80cdb10 2023-10-25T16:14:20.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.391+0000 7f64adffb640 1 -- 172.21.15.177:0/2674948134 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64b401d070 con 0x7f64b80cdb10 2023-10-25T16:14:20.398 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:14:20.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f649c066470 msgr2=0x7f649c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f649c066470 0x7f649c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64a80ae000 tx=0x7f64a801b050 comp rx=0 tx=0).stop 2023-10-25T16:14:20.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 msgr2=0x7f64b8152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:20.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 0x7f64b8152950 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c940 tx=0x7f64b400ce00 comp rx=0 tx=0).stop 2023-10-25T16:14:20.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 shutdown_connections 2023-10-25T16:14:20.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f649c066470 0x7f649c068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64b815eba0 0x7f64b815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64b80cdb10 0x7f64b8152950 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 --2- 172.21.15.177:0/2674948134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64b80b2120 0x7f64b8159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:20.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 >> 172.21.15.177:0/2674948134 conn(0x7f64b809a5c0 msgr2=0x7f64b80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:20.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 shutdown_connections 2023-10-25T16:14:20.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:20.395+0000 7f64bf290640 1 -- 172.21.15.177:0/2674948134 wait complete. 2023-10-25T16:14:20.415 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:14:20.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:14:20.415 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:14:20.416 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:14:20.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:20.416 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:14:20.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:14:20.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:14:20.417 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:14:20.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.418 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:14:20.424 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:14:20.424 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:14:20.424 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:14:20.425 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.425 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:14:20.425 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.425 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:14:20.425 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:20.426 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:14:20.426 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:14:20.426 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:20.426 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:14:20.426 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:14:20.426 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:20.427 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:14:20.427 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:20.427 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:14:20.427 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42457sec preferred_lft 42457sec 2023-10-25T16:14:20.427 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:14:20.428 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.428 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:14:20.428 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:20.428 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:14:20.428 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.429 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:14:20.429 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:20.429 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:14:20.429 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.429 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:14:20.429 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.430 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:14:20.430 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:20.430 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:14:20.430 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.430 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:14:20.431 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:20.431 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:14:20.431 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:20.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.432 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:14:20.476 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:14:20.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.478 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:14:20.526 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:14:20.526 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:14:20.526 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:14:20.527 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:14:20.527 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:14:20.527 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:14:20.528 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:14:20.528 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:14:20.528 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:14:20.528 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:14:20.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.529 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:14:20.529 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:14:20.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:14:20.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:14:20.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:14:20.531 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:14:20.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.598 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:14:20.643 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:14:20.643 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:14:20.643 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:14:20.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:14:20.701 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:14:20.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:14:20.701 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:20.747 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:14:20.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:14:20.748 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:20.797 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:14:20.844 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:14:20.845 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:14:20.845 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:14:20.845 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:14:20.845 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:14:20.845 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:14:20.846 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:14:20.846 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:14:20.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:14:20.846 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:14:20.846 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:14:20.847 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:14:20.847 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:14:20.847 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:14:20.847 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:14:20.847 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:14:20.848 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:14:20.848 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:14:20.848 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:14:20.848 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:14:20.848 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:14:20.848 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:14:20.849 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:14:20.849 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:14:20.849 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:14:20.849 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:14:20.849 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:14:20.850 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:14:20.850 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:14:20.850 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:20.850 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:20.850 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:20.851 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:20.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.852 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:14:20.903 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:14:20.904 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:14:20.948 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:14:20.955 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:14:20.955 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:14:20.956 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:14:20.956 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:14:20.956 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:14:20.956 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:14:20.956 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:14:20.957 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:14:20.957 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:14:20.957 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:14:20.957 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:14:20.957 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:14:20.957 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:14:20.958 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:14:20.958 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:14:20.958 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:14:20.958 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:14:20.958 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:14:20.959 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:14:20.959 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:14:20.959 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:14:20.959 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:14:20.959 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:14:20.960 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:14:20.960 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:14:20.960 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:14:20.960 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:14:20.960 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:14:20.960 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:14:20.961 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:20.961 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:20.961 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:20.961 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:20.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:20.962 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:14:21.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:14:21.027+0000 7fb64d8b5580 -1 init, newargv = 0x55e055506a50 newargc=15 2023-10-25T16:14:21.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[38864]: starting ceph client 2023-10-25T16:14:21.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[38864]: starting fuse 2023-10-25T16:14:22.108 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:14:22.116 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:14:22.116 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:14:22.116 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:14:22.117 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:14:22.117 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:14:22.117 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:14:22.117 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:14:22.117 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:14:22.118 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:14:22.118 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:14:22.118 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:14:22.118 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:14:22.118 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:14:22.119 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:14:22.119 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:14:22.119 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:14:22.119 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:14:22.119 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:14:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:14:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:14:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:14:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:14:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:14:22.121 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:14:22.121 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:14:22.121 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:14:22.121 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:14:22.122 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:14:22.122 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:14:22.122 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:22.122 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:14:22.122 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:22.123 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:14:22.123 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:22.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:22.124 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:14:22.171 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:14:22.172 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:14:22.172 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:14:22.173 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:14:22.173 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:14:22.173 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:22.174 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:14:22.174 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:22.174 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:14:22.175 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:14:22.175 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:14:22.176 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:14:22.176 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:22.176 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:14:22.177 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:14:22.177 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:14:22.178 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:14:22.178 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:22.178 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:14:22.179 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:14:22.179 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:14:22.179 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:14:22.180 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:14:22.180 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:14:22.181 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:14:22.181 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:14:22.181 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:22.182 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:14:22.182 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:22.296 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:22.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:22.308 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:22.308 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:22.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.38864.asok status 2023-10-25T16:14:22.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:22.507 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:22.508 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:14:22.508 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:14:22.508 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:14:22.508 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:14:22.509 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:14:22.509 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:14:22.509 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "38864", 2023-10-25T16:14:22.509 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:14:22.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:22.510 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:14:22.510 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:14:22.510 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5586, 2023-10-25T16:14:22.510 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:14:22.511 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:14:22.511 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:14:22.511 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5586 2023-10-25T16:14:22.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:22.511 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:22.512 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:22.512 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:22.512 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:22.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:22.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:22.513 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:22.513 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:22.513 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:22.513 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:22.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:22.514 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5586 192.168.0.1:0/3766596604", 2023-10-25T16:14:22.514 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3766596604", 2023-10-25T16:14:22.514 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:14:22.514 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 12, 2023-10-25T16:14:22.515 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 35, 2023-10-25T16:14:22.515 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:14:22.515 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:14:22.515 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:14:22.516 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:22.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:22.529 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:22.529 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:14:22.530 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:22.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:22.577 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:14:22.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:22.585 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:22.585 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:22.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:22.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:22.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:22.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:14:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/787302598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 msgr2=0x7fa7a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/787302598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7a4003dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0ce6d0 tx=0x7fa7b401cc40 comp rx=0 tx=0).stop 2023-10-25T16:14:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7bad9d640 1 -- 172.21.15.177:0/787302598 reap_dead start 2023-10-25T16:14:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/787302598 shutdown_connections 2023-10-25T16:14:22.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/787302598 >> 172.21.15.177:0/787302598 conn(0x7fa7bc069b20 msgr2=0x7fa7bc069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:22.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/787302598 shutdown_connections 2023-10-25T16:14:22.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.763+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/787302598 wait complete. 2023-10-25T16:14:22.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 Processor -- start 2023-10-25T16:14:22.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 -- start start 2023-10-25T16:14:22.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7bc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:22.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7bc13b260 0x7fa7bc0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:22.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7bc0b0d30 0x7fa7bc13ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:22.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0ab4a0 con 0x7fa7a40039b0 2023-10-25T16:14:22.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0aa8b0 con 0x7fa7bc0b0d30 2023-10-25T16:14:22.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0aab00 con 0x7fa7bc13b260 2023-10-25T16:14:22.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7bc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:22.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7bc1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51484/0 (socket says 172.21.15.177:51484) 2023-10-25T16:14:22.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 -- 172.21.15.177:0/3684150109 learned_addr learned my addr 172.21.15.177:0/3684150109 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:22.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7b9d9b640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7bc13b260 0x7fa7bc0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:22.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7bad9d640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7bc0b0d30 0x7fa7bc13ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:22.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 -- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7bc13b260 msgr2=0x7fa7bc0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:22.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7bc13b260 0x7fa7bc0b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:22.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 -- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7bc0b0d30 msgr2=0x7fa7bc13ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:22.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7bc0b0d30 0x7fa7bc13ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:22.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 -- 172.21.15.177:0/3684150109 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0aade0 con 0x7fa7a40039b0 2023-10-25T16:14:22.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7ba59c640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7bc1565d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001ec0 tx=0x7fa7b40a5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:22.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4005400 con 0x7fa7a40039b0 2023-10-25T16:14:22.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa7b4005650 con 0x7fa7a40039b0 2023-10-25T16:14:22.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0ab0c0 con 0x7fa7a40039b0 2023-10-25T16:14:22.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004910 con 0x7fa7a40039b0 2023-10-25T16:14:22.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.767+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc13fce0 con 0x7fa7a40039b0 2023-10-25T16:14:22.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.771+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc0ab710 con 0x7fa7a40039b0 2023-10-25T16:14:22.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.771+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa7b4004a70 con 0x7fa7a40039b0 2023-10-25T16:14:22.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.771+0000 7fa7aaffd640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa79c066470 0x7fa79c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:22.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.771+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7b411ecb0 con 0x7fa7a40039b0 2023-10-25T16:14:22.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.771+0000 7fa7b9d9b640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa79c066470 0x7fa79c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:22.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.771+0000 7fa7b9d9b640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa79c066470 0x7fa79c068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc13c9a0 tx=0x7fa7b0006b70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:22.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.775+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7b40ec1b0 con 0x7fa7a40039b0 2023-10-25T16:14:22.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.967+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7bc04daf0 con 0x7fa7a40039b0 2023-10-25T16:14:22.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.967+0000 7fa7aaffd640 1 -- 172.21.15.177:0/3684150109 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa7b40ab020 con 0x7fa7a40039b0 2023-10-25T16:14:22.973 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:14:22.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa79c066470 msgr2=0x7fa79c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:22.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa79c066470 0x7fa79c068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc13c9a0 tx=0x7fa7b0006b70 comp rx=0 tx=0).stop 2023-10-25T16:14:22.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 msgr2=0x7fa7bc1565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:22.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7bc1565d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001ec0 tx=0x7fa7b40a5f70 comp rx=0 tx=0).stop 2023-10-25T16:14:22.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 shutdown_connections 2023-10-25T16:14:22.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa79c066470 0x7fa79c068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:22.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7bc0b0d30 0x7fa7bc13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:22.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7bc13b260 0x7fa7bc0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:22.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 --2- 172.21.15.177:0/3684150109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a40039b0 0x7fa7bc1565d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:22.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 >> 172.21.15.177:0/3684150109 conn(0x7fa7bc069b20 msgr2=0x7fa7bc0ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:22.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 shutdown_connections 2023-10-25T16:14:22.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:22.971+0000 7fa7c0a6e640 1 -- 172.21.15.177:0/3684150109 wait complete. 2023-10-25T16:14:22.992 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:14:22.992 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:14:22.992 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:14:22.993 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:14:22.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:22.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:14:22.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:14:22.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:14:22.994 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:14:22.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:22.995 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:14:23.002 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:14:23.002 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:14:23.003 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:14:23.003 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.003 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:14:23.003 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.005 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:14:23.005 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:23.005 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:14:23.006 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:14:23.006 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:23.006 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:14:23.006 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:14:23.006 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:23.007 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:14:23.007 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:23.007 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:14:23.007 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42436sec preferred_lft 42436sec 2023-10-25T16:14:23.007 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:14:23.007 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.008 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:14:23.008 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:23.008 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:14:23.008 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.008 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:14:23.009 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:14:23.009 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:14:23.009 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.009 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:14:23.009 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.010 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:14:23.010 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:23.010 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:14:23.010 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.010 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:14:23.011 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:23.011 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:14:23.011 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:14:23.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.012 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:14:23.060 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:14:23.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.062 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:14:23.113 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:14:23.113 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:14:23.113 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:14:23.113 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:14:23.113 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:14:23.114 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:14:23.114 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:14:23.114 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:14:23.114 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:14:23.114 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:14:23.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.115 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:14:23.116 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:14:23.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:14:23.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:14:23.117 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:14:23.117 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:14:23.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.189 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:14:23.237 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:14:23.237 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:14:23.238 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:14:23.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:14:23.294 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:14:23.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:14:23.295 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:23.341 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:14:23.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:14:23.342 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:23.388 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:14:23.437 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:14:23.438 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:14:23.438 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:14:23.438 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:14:23.439 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:14:23.439 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:14:23.439 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:14:23.439 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:14:23.439 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:14:23.440 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:14:23.440 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:14:23.440 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:14:23.440 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:14:23.440 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:14:23.441 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:14:23.441 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:14:23.441 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:14:23.441 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:14:23.441 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:14:23.442 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:14:23.442 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:14:23.442 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:14:23.442 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:14:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:14:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:14:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:14:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:14:23.443 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:14:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:14:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:23.444 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:23.445 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:23.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.446 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:14:23.493 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:14:23.493 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:14:23.538 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:14:23.544 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:14:23.545 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:14:23.545 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:14:23.545 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:14:23.545 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:14:23.545 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:14:23.546 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:14:23.546 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:14:23.546 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:14:23.546 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:14:23.546 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:14:23.547 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:14:23.547 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:14:23.547 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:14:23.547 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:14:23.547 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:14:23.548 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:14:23.548 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:14:23.548 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:14:23.548 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:14:23.548 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:14:23.548 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:14:23.549 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:14:23.549 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:14:23.549 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:14:23.549 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:14:23.549 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:14:23.550 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:14:23.550 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:14:23.550 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:23.550 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:23.550 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:23.551 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:23.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:23.552 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:14:23.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:14:23.618+0000 7ff21550e580 -1 init, newargv = 0x563e2b3e9330 newargc=15 2023-10-25T16:14:23.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34045]: starting ceph client 2023-10-25T16:14:23.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34045]: starting fuse 2023-10-25T16:14:24.701 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:14:24.709 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:14:24.710 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:14:24.710 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:14:24.710 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:14:24.710 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:14:24.711 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:14:24.711 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:14:24.711 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:14:24.711 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:14:24.711 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:14:24.712 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:14:24.712 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:14:24.712 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:14:24.712 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:14:24.712 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:14:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:14:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:14:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:14:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:14:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:14:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:14:24.714 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:14:24.714 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:14:24.714 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:14:24.714 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:14:24.714 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:14:24.715 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:14:24.715 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:14:24.715 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:14:24.715 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:24.715 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:14:24.715 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:24.716 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:14:24.716 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:24.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:24.717 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:14:24.765 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:14:24.765 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:14:24.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:14:24.766 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:14:24.766 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:14:24.767 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:14:24.767 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:14:24.767 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:14:24.768 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:14:24.768 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:14:24.768 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:14:24.769 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:14:24.769 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:14:24.770 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:14:24.770 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:14:24.770 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:14:24.771 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:14:24.771 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:14:24.771 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:14:24.772 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:14:24.772 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:14:24.773 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:14:24.773 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:14:24.773 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:14:24.774 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:14:24.774 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:14:24.774 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:14:24.775 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:14:24.775 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:14:24.889 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.34045.asok 2023-10-25T16:14:24.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:24.900 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34045.asok 2023-10-25T16:14:24.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:24.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.34045.asok status 2023-10-25T16:14:24.995 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:25.099 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:14:25.099 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:14:25.099 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:14:25.100 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:14:25.100 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:14:25.100 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:14:25.100 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:14:25.100 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "34045", 2023-10-25T16:14:25.101 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:14:25.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:14:25.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:14:25.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:14:25.101 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 154700, 2023-10-25T16:14:25.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:14:25.102 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:14:25.102 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:14:25.102 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 154700 2023-10-25T16:14:25.102 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:14:25.103 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:14:25.103 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:14:25.103 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:25.103 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 905010109 2023-10-25T16:14:25.103 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:14:25.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:14:25.104 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:14:25.104 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:14:25.104 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:25.104 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 905010109 2023-10-25T16:14:25.104 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:14:25.105 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.154700 192.168.0.1:0/905010109", 2023-10-25T16:14:25.105 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/905010109", 2023-10-25T16:14:25.105 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:14:25.105 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 12, 2023-10-25T16:14:25.105 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 35, 2023-10-25T16:14:25.106 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:14:25.106 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:14:25.106 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:14:25.106 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:14:25.111 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:25.119 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:25.119 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:14:25.120 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:25.164 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:25.165 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:14:25.165 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:25.172 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:25.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:25.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:25.266 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:25.267 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:25.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:25.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/3141297230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b500cca30 msgr2=0x7f1b500cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 --2- 172.21.15.177:0/3141297230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b500cca30 0x7f1b500cce90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009840 tx=0x7f1b4001c700 comp rx=0 tx=0).stop 2023-10-25T16:14:25.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/3141297230 shutdown_connections 2023-10-25T16:14:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 --2- 172.21.15.177:0/3141297230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b500cca30 0x7f1b500cce90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/3141297230 >> 172.21.15.177:0/3141297230 conn(0x7f1b500ce000 msgr2=0x7f1b500ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/3141297230 shutdown_connections 2023-10-25T16:14:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/3141297230 wait complete. 2023-10-25T16:14:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 Processor -- start 2023-10-25T16:14:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- start start 2023-10-25T16:14:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b500c93f0 0x7f1b5014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b500cca30 0x7f1b500adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 0x7f1b50149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500aeb50 con 0x7f1b50155db0 2023-10-25T16:14:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b501366e0 con 0x7f1b500c93f0 2023-10-25T16:14:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500ae010 con 0x7f1b500cca30 2023-10-25T16:14:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 0x7f1b50149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 0x7f1b50149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51506/0 (socket says 172.21.15.177:51506) 2023-10-25T16:14:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 -- 172.21.15.177:0/2733439285 learned_addr learned my addr 172.21.15.177:0/2733439285 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 -- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b500cca30 msgr2=0x7f1b500adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b500cca30 0x7f1b500adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 -- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b500c93f0 msgr2=0x7f1b5014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56294640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b500c93f0 0x7f1b5014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b500c93f0 0x7f1b5014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 -- 172.21.15.177:0/2733439285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400094a0 con 0x7f1b50155db0 2023-10-25T16:14:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56294640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b500c93f0 0x7f1b5014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b56a95640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 0x7f1b50149710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c3c0 tx=0x7f1b4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48011790 con 0x7f1b50155db0 2023-10-25T16:14:25.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1b480119e0 con 0x7f1b50155db0 2023-10-25T16:14:25.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500ae2b0 con 0x7f1b50155db0 2023-10-25T16:14:25.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48011e30 con 0x7f1b50155db0 2023-10-25T16:14:25.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.407+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b500ae870 con 0x7f1b50155db0 2023-10-25T16:14:25.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.411+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5006fe40 con 0x7f1b50155db0 2023-10-25T16:14:25.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.411+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b4801c460 con 0x7f1b50155db0 2023-10-25T16:14:25.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.411+0000 7f1b46ffd640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1b34066470 0x7f1b34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.411+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b48083f70 con 0x7f1b50155db0 2023-10-25T16:14:25.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.411+0000 7f1b56294640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1b34066470 0x7f1b34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.411+0000 7f1b56294640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1b34066470 0x7f1b34068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c004a40 tx=0x7f1b4c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:25.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.415+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b480b5090 con 0x7f1b50155db0 2023-10-25T16:14:25.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.603+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5004daf0 con 0x7f1b50155db0 2023-10-25T16:14:25.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.603+0000 7f1b46ffd640 1 -- 172.21.15.177:0/2733439285 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f1b48051480 con 0x7f1b50155db0 2023-10-25T16:14:25.609 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:25.609 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:25.610 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:25.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1b34066470 msgr2=0x7f1b34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1b34066470 0x7f1b34068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c004a40 tx=0x7f1b4c009040 comp rx=0 tx=0).stop 2023-10-25T16:14:25.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 msgr2=0x7f1b50149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 0x7f1b50149710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c3c0 tx=0x7f1b4800c880 comp rx=0 tx=0).stop 2023-10-25T16:14:25.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 shutdown_connections 2023-10-25T16:14:25.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1b34066470 0x7f1b34068930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b50155db0 0x7f1b50149710 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b500cca30 0x7f1b500adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 --2- 172.21.15.177:0/2733439285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b500c93f0 0x7f1b5014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 >> 172.21.15.177:0/2733439285 conn(0x7f1b500ce000 msgr2=0x7f1b500c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:25.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 shutdown_connections 2023-10-25T16:14:25.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.607+0000 7f1b584f8640 1 -- 172.21.15.177:0/2733439285 wait complete. 2023-10-25T16:14:25.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:14:25.772 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":154595,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.799302955,"mdsmap_epoch":12,"osdmap_epoch":35,"osdmap_epoch_barrier":35,"uptime":22.760674602000002} 2023-10-25T16:14:25.773 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 154595, "mdsmap_epoch": 12, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "rank_uptime": 14.799302955, "state": "up:active", "uptime": 22.760674602, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:14:25.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-10-25T16:14:25.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1756271347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 msgr2=0x7fd8280cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1756271347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd8280cb390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd818009bc0 tx=0x7fd81801cb40 comp rx=0 tx=0).stop 2023-10-25T16:14:25.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1756271347 shutdown_connections 2023-10-25T16:14:25.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1756271347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd8280cb390 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1756271347 >> 172.21.15.177:0/1756271347 conn(0x7fd828069d20 msgr2=0x7fd82806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:25.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1756271347 shutdown_connections 2023-10-25T16:14:25.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1756271347 wait complete. 2023-10-25T16:14:25.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 Processor -- start 2023-10-25T16:14:25.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- start start 2023-10-25T16:14:25.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd82815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8280ced60 0x7fd828143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8281592c0 0x7fd828155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281598d0 con 0x7fd8280ce980 2023-10-25T16:14:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828144100 con 0x7fd8281592c0 2023-10-25T16:14:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281443e0 con 0x7fd8280ced60 2023-10-25T16:14:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd82815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd82815c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51530/0 (socket says 172.21.15.177:51530) 2023-10-25T16:14:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 -- 172.21.15.177:0/1026944024 learned_addr learned my addr 172.21.15.177:0/1026944024 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82d3f0640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8280ced60 0x7fd828143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82e3f2640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8281592c0 0x7fd828155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 -- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8280ced60 msgr2=0x7fd828143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8280ced60 0x7fd828143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 -- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8281592c0 msgr2=0x7fd828155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:25.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8281592c0 0x7fd828155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:25.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 -- 172.21.15.177:0/1026944024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009820 con 0x7fd8280ce980 2023-10-25T16:14:25.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82dbf1640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd82815c470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd818009b10 tx=0x7fd8180a5940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:25.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818004d10 con 0x7fd8280ce980 2023-10-25T16:14:25.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd818004000 con 0x7fd8280ce980 2023-10-25T16:14:25.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8281446c0 con 0x7fd8280ce980 2023-10-25T16:14:25.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180043f0 con 0x7fd8280ce980 2023-10-25T16:14:25.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.899+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd828143c40 con 0x7fd8280ce980 2023-10-25T16:14:25.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.903+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82804daf0 con 0x7fd8280ce980 2023-10-25T16:14:25.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.903+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8180b4040 con 0x7fd8280ce980 2023-10-25T16:14:25.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.903+0000 7fd8267fc640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:25.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.903+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd81811e170 con 0x7fd8280ce980 2023-10-25T16:14:25.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.903+0000 7fd82d3f0640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:25.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.903+0000 7fd82d3f0640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd828144ca0 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:25.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:25.907+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8180eb560 con 0x7fd8280ce980 2023-10-25T16:14:26.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.107+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fd828143e30 con 0x7fd8280ce980 2023-10-25T16:14:26.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.107+0000 7fd8267fc640 1 -- 172.21.15.177:0/1026944024 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1619 (secure 0 0 0) 0x7fd8180b2090 con 0x7fd8280ce980 2023-10-25T16:14:26.114 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:26.114 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:26.115 INFO:teuthology.orchestra.run.smithi177.stdout: "stats": { 2023-10-25T16:14:26.115 INFO:teuthology.orchestra.run.smithi177.stdout: "total_bytes": 1600000000, 2023-10-25T16:14:26.115 INFO:teuthology.orchestra.run.smithi177.stdout: "total_avail_bytes": 1597562524, 2023-10-25T16:14:26.115 INFO:teuthology.orchestra.run.smithi177.stdout: "total_used_bytes": 2437476, 2023-10-25T16:14:26.115 INFO:teuthology.orchestra.run.smithi177.stdout: "total_used_raw_bytes": 2437476, 2023-10-25T16:14:26.116 INFO:teuthology.orchestra.run.smithi177.stdout: "total_used_raw_ratio": 0.0015234225429594517, 2023-10-25T16:14:26.116 INFO:teuthology.orchestra.run.smithi177.stdout: "num_osds": 8, 2023-10-25T16:14:26.116 INFO:teuthology.orchestra.run.smithi177.stdout: "num_per_pool_osds": 0, 2023-10-25T16:14:26.116 INFO:teuthology.orchestra.run.smithi177.stdout: "num_per_pool_omap_osds": 0 2023-10-25T16:14:26.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.116 INFO:teuthology.orchestra.run.smithi177.stdout: "stats_by_class": { 2023-10-25T16:14:26.117 INFO:teuthology.orchestra.run.smithi177.stdout: "hdd": { 2023-10-25T16:14:26.117 INFO:teuthology.orchestra.run.smithi177.stdout: "total_bytes": 1600000000, 2023-10-25T16:14:26.117 INFO:teuthology.orchestra.run.smithi177.stdout: "total_avail_bytes": 1597562524, 2023-10-25T16:14:26.117 INFO:teuthology.orchestra.run.smithi177.stdout: "total_used_bytes": 2437476, 2023-10-25T16:14:26.117 INFO:teuthology.orchestra.run.smithi177.stdout: "total_used_raw_bytes": 2437476, 2023-10-25T16:14:26.118 INFO:teuthology.orchestra.run.smithi177.stdout: "total_used_raw_ratio": 0.0015234225429594517 2023-10-25T16:14:26.118 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:26.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.118 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:14:26.118 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:26.119 INFO:teuthology.orchestra.run.smithi177.stdout: "name": ".mgr", 2023-10-25T16:14:26.119 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 1, 2023-10-25T16:14:26.119 INFO:teuthology.orchestra.run.smithi177.stdout: "stats": { 2023-10-25T16:14:26.119 INFO:teuthology.orchestra.run.smithi177.stdout: "stored": 590368, 2023-10-25T16:14:26.119 INFO:teuthology.orchestra.run.smithi177.stdout: "objects": 2, 2023-10-25T16:14:26.119 INFO:teuthology.orchestra.run.smithi177.stdout: "kb_used": 577, 2023-10-25T16:14:26.120 INFO:teuthology.orchestra.run.smithi177.stdout: "bytes_used": 590368, 2023-10-25T16:14:26.120 INFO:teuthology.orchestra.run.smithi177.stdout: "percent_used": 0.0005296607268974185, 2023-10-25T16:14:26.120 INFO:teuthology.orchestra.run.smithi177.stdout: "max_avail": 557012544 2023-10-25T16:14:26.120 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:26.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "cephfs_metadata", 2023-10-25T16:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4, 2023-10-25T16:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: "stats": { 2023-10-25T16:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: "stored": 2410, 2023-10-25T16:14:26.121 INFO:teuthology.orchestra.run.smithi177.stdout: "objects": 22, 2023-10-25T16:14:26.122 INFO:teuthology.orchestra.run.smithi177.stdout: "kb_used": 3, 2023-10-25T16:14:26.122 INFO:teuthology.orchestra.run.smithi177.stdout: "bytes_used": 2410, 2023-10-25T16:14:26.122 INFO:teuthology.orchestra.run.smithi177.stdout: "percent_used": 2.1633218239003327e-06, 2023-10-25T16:14:26.122 INFO:teuthology.orchestra.run.smithi177.stdout: "max_avail": 557012544 2023-10-25T16:14:26.122 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:26.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:26.123 INFO:teuthology.orchestra.run.smithi177.stdout: "name": "cephfs_data", 2023-10-25T16:14:26.123 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5, 2023-10-25T16:14:26.123 INFO:teuthology.orchestra.run.smithi177.stdout: "stats": { 2023-10-25T16:14:26.123 INFO:teuthology.orchestra.run.smithi177.stdout: "stored": 0, 2023-10-25T16:14:26.124 INFO:teuthology.orchestra.run.smithi177.stdout: "objects": 0, 2023-10-25T16:14:26.124 INFO:teuthology.orchestra.run.smithi177.stdout: "kb_used": 0, 2023-10-25T16:14:26.124 INFO:teuthology.orchestra.run.smithi177.stdout: "bytes_used": 0, 2023-10-25T16:14:26.124 INFO:teuthology.orchestra.run.smithi177.stdout: "percent_used": 0, 2023-10-25T16:14:26.124 INFO:teuthology.orchestra.run.smithi177.stdout: "max_avail": 557012544 2023-10-25T16:14:26.125 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:26.125 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:26.125 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:14:26.125 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:26.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 msgr2=0x7fd814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:26.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd828144ca0 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2023-10-25T16:14:26.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 msgr2=0x7fd82815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd82815c470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd818009b10 tx=0x7fd8180a5940 comp rx=0 tx=0).stop 2023-10-25T16:14:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 shutdown_connections 2023-10-25T16:14:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8281592c0 0x7fd828155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8280ced60 0x7fd828143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 --2- 172.21.15.177:0/1026944024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8280ce980 0x7fd82815c470 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 >> 172.21.15.177:0/1026944024 conn(0x7fd828069d20 msgr2=0x7fd82814bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 shutdown_connections 2023-10-25T16:14:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.111+0000 7fd82fe55640 1 -- 172.21.15.177:0/1026944024 wait complete. 2023-10-25T16:14:26.131 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:14:26.131 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:26.132 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-25T16:14:26.132 DEBUG:teuthology.orchestra.run.smithi177:> os.fchmod(fd, 0O666) 2023-10-25T16:14:26.132 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(fd) 2023-10-25T16:14:26.133 DEBUG:teuthology.orchestra.run.smithi177:> os.close(fd) 2023-10-25T16:14:26.133 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:26.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:26.215 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:14:26.215 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:14:26.216 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:14:26.216 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:26.216 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:14:26.217 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:26.217 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:14:26.217 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:14:26.218 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:14:26.218 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:14:26.218 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:26.219 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:14:26.219 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:14:26.219 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:14:26.220 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:14:26.220 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:26.221 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:14:26.221 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:14:26.221 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:14:26.222 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:14:26.222 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:14:26.222 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:14:26.223 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:14:26.223 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:14:26.223 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:26.224 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:14:26.224 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:26.331 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:26.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:26.343 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:26.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:26.343 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.38864.asok status 2023-10-25T16:14:26.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:26.522 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:26.522 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:14:26.523 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:14:26.523 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:14:26.523 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:14:26.523 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:14:26.524 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:14:26.524 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "38864", 2023-10-25T16:14:26.524 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:14:26.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.524 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 1, 2023-10-25T16:14:26.524 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:14:26.525 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5586, 2023-10-25T16:14:26.525 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:14:26.525 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:14:26.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:14:26.525 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5586 2023-10-25T16:14:26.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:26.526 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:26.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:26.526 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:26.527 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:26.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:26.527 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:26.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:26.528 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:26.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:26.528 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5586 192.168.0.1:0/3766596604", 2023-10-25T16:14:26.528 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3766596604", 2023-10-25T16:14:26.528 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 2, 2023-10-25T16:14:26.528 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 12, 2023-10-25T16:14:26.529 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 35, 2023-10-25T16:14:26.529 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 35, 2023-10-25T16:14:26.529 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:14:26.529 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:14:26.529 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:26.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:26.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-25T16:14:26.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 -- 172.21.15.177:0/2000375824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1c004d10 msgr2=0x7f7d1c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:26.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 --2- 172.21.15.177:0/2000375824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d1c004d10 0x7f7d1c005190 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009e30 tx=0x7f7d2c01d190 comp rx=0 tx=0).stop 2023-10-25T16:14:26.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d33fff640 1 -- 172.21.15.177:0/2000375824 reap_dead start 2023-10-25T16:14:26.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 -- 172.21.15.177:0/2000375824 shutdown_connections 2023-10-25T16:14:26.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 -- 172.21.15.177:0/2000375824 >> 172.21.15.177:0/2000375824 conn(0x7f7d340cd6c0 msgr2=0x7f7d340cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:26.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 -- 172.21.15.177:0/2000375824 shutdown_connections 2023-10-25T16:14:26.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 -- 172.21.15.177:0/2000375824 wait complete. 2023-10-25T16:14:26.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 Processor -- start 2023-10-25T16:14:26.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.703+0000 7f7d39b19640 1 -- start start 2023-10-25T16:14:26.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d340ccc10 0x7f7d34134f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:26.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d34135450 0x7f7d34136f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:26.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 0x7f7d34146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:26.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340ccff0 con 0x7f7d341374b0 2023-10-25T16:14:26.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d34137a60 con 0x7f7d34135450 2023-10-25T16:14:26.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d34137d40 con 0x7f7d340ccc10 2023-10-25T16:14:26.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 0x7f7d34146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:26.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 0x7f7d34146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51552/0 (socket says 172.21.15.177:51552) 2023-10-25T16:14:26.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 -- 172.21.15.177:0/3207190464 learned_addr learned my addr 172.21.15.177:0/3207190464 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:26.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d337fe640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d340ccc10 0x7f7d34134f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:26.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d32ffd640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d34135450 0x7f7d34136f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:26.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 -- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d340ccc10 msgr2=0x7f7d34134f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:26.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d340ccc10 0x7f7d34134f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:26.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 -- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d34135450 msgr2=0x7f7d34136f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:26.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d34135450 0x7f7d34136f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:26.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 -- 172.21.15.177:0/3207190464 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34145f90 con 0x7f7d341374b0 2023-10-25T16:14:26.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d33fff640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 0x7f7d34146790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c002240 tx=0x7f7d2c0ada10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:26.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0adc90 con 0x7f7d341374b0 2023-10-25T16:14:26.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d2c004a50 con 0x7f7d341374b0 2023-10-25T16:14:26.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d34146270 con 0x7f7d341374b0 2023-10-25T16:14:26.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c004de0 con 0x7f7d341374b0 2023-10-25T16:14:26.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3413ac90 con 0x7f7d341374b0 2023-10-25T16:14:26.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d34066f10 con 0x7f7d341374b0 2023-10-25T16:14:26.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d2c0b3070 con 0x7f7d341374b0 2023-10-25T16:14:26.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d1bfff640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d200664a0 0x7f7d20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:26.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d2c11ece0 con 0x7f7d341374b0 2023-10-25T16:14:26.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.707+0000 7f7d337fe640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d200664a0 0x7f7d20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:26.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.711+0000 7f7d337fe640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d200664a0 0x7f7d20068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7d24001ec0 tx=0x7f7d24001ce0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:26.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.711+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d2c0ec1f0 con 0x7f7d341374b0 2023-10-25T16:14:26.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:26.879+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f7d3404daf0 con 0x7f7d341374b0 2023-10-25T16:14:27.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.707+0000 7f7d1bfff640 1 -- 172.21.15.177:0/3207190464 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7d2c0b1080 con 0x7f7d341374b0 2023-10-25T16:14:27.714 INFO:teuthology.orchestra.run.smithi177.stderr:pauserd,pausewr is set 2023-10-25T16:14:27.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d200664a0 msgr2=0x7f7d20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:27.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d200664a0 0x7f7d20068960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7d24001ec0 tx=0x7f7d24001ce0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 msgr2=0x7f7d34146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:27.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 0x7f7d34146790 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c002240 tx=0x7f7d2c0ada10 comp rx=0 tx=0).stop 2023-10-25T16:14:27.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 shutdown_connections 2023-10-25T16:14:27.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d200664a0 0x7f7d20068960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d341374b0 0x7f7d34146790 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d34135450 0x7f7d34136f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 --2- 172.21.15.177:0/3207190464 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d340ccc10 0x7f7d34134f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 >> 172.21.15.177:0/3207190464 conn(0x7f7d340cd6c0 msgr2=0x7f7d3414e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:27.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 shutdown_connections 2023-10-25T16:14:27.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.711+0000 7f7d39b19640 1 -- 172.21.15.177:0/3207190464 wait complete. 2023-10-25T16:14:27.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-25T16:14:27.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 -- 172.21.15.177:0/1056202229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0b2120 msgr2=0x7fce1c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:27.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 --2- 172.21.15.177:0/1056202229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0b2120 0x7fce1c0b4100 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0cb890 tx=0x7fce1001c750 comp rx=0 tx=0).stop 2023-10-25T16:14:27.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 -- 172.21.15.177:0/1056202229 shutdown_connections 2023-10-25T16:14:27.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 --2- 172.21.15.177:0/1056202229 >> v2:172.21.15.184:3300/0 conn(0x7fce1c0cdb10 0x7fce1c0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 --2- 172.21.15.177:0/1056202229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0b2120 0x7fce1c0b4100 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 -- 172.21.15.177:0/1056202229 >> 172.21.15.177:0/1056202229 conn(0x7fce1c09a5c0 msgr2=0x7fce1c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:27.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 -- 172.21.15.177:0/1056202229 shutdown_connections 2023-10-25T16:14:27.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 -- 172.21.15.177:0/1056202229 wait complete. 2023-10-25T16:14:27.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 Processor -- start 2023-10-25T16:14:27.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.863+0000 7fce208c7640 1 -- start start 2023-10-25T16:14:27.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce1c0b2120 0x7fce1c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:27.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 0x7fce1c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:27.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce1c15eba0 0x7fce1c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:27.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c152e20 con 0x7fce1c0cdb10 2023-10-25T16:14:27.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c158a20 con 0x7fce1c0b2120 2023-10-25T16:14:27.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c153e60 con 0x7fce1c15eba0 2023-10-25T16:14:27.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 0x7fce1c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:27.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 0x7fce1c15a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51566/0 (socket says 172.21.15.177:51566) 2023-10-25T16:14:27.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 -- 172.21.15.177:0/2652139568 learned_addr learned my addr 172.21.15.177:0/2652139568 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:27.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce1a59c640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce1c0b2120 0x7fce1c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:27.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce1ad9d640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce1c15eba0 0x7fce1c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:27.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 -- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce1c15eba0 msgr2=0x7fce1c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:27.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce1c15eba0 0x7fce1c15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 -- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce1c0b2120 msgr2=0x7fce1c1528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:27.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce1c0b2120 0x7fce1c1528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:27.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100094a0 con 0x7fce1c0cdb10 2023-10-25T16:14:27.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce1a59c640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce1c0b2120 0x7fce1c1528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:27.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce19d9b640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 0x7fce1c15a4a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce10000c10 tx=0x7fce100a6530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:27.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100b4040 con 0x7fce1c0cdb10 2023-10-25T16:14:27.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce10004250 con 0x7fce1c0cdb10 2023-10-25T16:14:27.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c158c70 con 0x7fce1c0cdb10 2023-10-25T16:14:27.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce10005040 con 0x7fce1c0cdb10 2023-10-25T16:14:27.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c159230 con 0x7fce1c0cdb10 2023-10-25T16:14:27.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c159420 con 0x7fce1c0cdb10 2023-10-25T16:14:27.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce100051a0 con 0x7fce1c0cdb10 2023-10-25T16:14:27.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdfc066470 0x7fcdfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:27.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce1011e210 con 0x7fce1c0cdb10 2023-10-25T16:14:27.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.867+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=37+}) v3 -- 0x7fcdfc06dfa0 con 0x7fce1c0cdb10 2023-10-25T16:14:27.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.871+0000 7fce1a59c640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdfc066470 0x7fcdfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:27.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.871+0000 7fce1a59c640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdfc066470 0x7fcdfc068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0016a0 tx=0x7fce0c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:27.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:27.875+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce100be060 con 0x7fce1c0cdb10 2023-10-25T16:14:28.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.035+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fce1c04daf0 con 0x7fce1c0cdb10 2023-10-25T16:14:28.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.711+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7fce100eb690 con 0x7fce1c0cdb10 2023-10-25T16:14:28.717 INFO:teuthology.orchestra.run.smithi177.stderr:pauserd,pausewr is unset 2023-10-25T16:14:28.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.711+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(37..37 src has 1..37) v4 ==== 288+0+0 (secure 0 0 0) 0x7fce100efa50 con 0x7fce1c0cdb10 2023-10-25T16:14:28.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.711+0000 7fce0affd640 1 -- 172.21.15.177:0/2652139568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7fcdfc06e9a0 con 0x7fce1c0cdb10 2023-10-25T16:14:28.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdfc066470 msgr2=0x7fcdfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:28.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdfc066470 0x7fcdfc068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0016a0 tx=0x7fce0c009040 comp rx=0 tx=0).stop 2023-10-25T16:14:28.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 msgr2=0x7fce1c15a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:28.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 0x7fce1c15a4a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fce10000c10 tx=0x7fce100a6530 comp rx=0 tx=0).stop 2023-10-25T16:14:28.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 shutdown_connections 2023-10-25T16:14:28.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdfc066470 0x7fcdfc068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:28.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce1c15eba0 0x7fce1c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:28.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce1c0cdb10 0x7fce1c15a4a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:28.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 --2- 172.21.15.177:0/2652139568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce1c0b2120 0x7fce1c1528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:28.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 >> 172.21.15.177:0/2652139568 conn(0x7fce1c09a5c0 msgr2=0x7fce1c072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:28.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 shutdown_connections 2023-10-25T16:14:28.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.715+0000 7fce208c7640 1 -- 172.21.15.177:0/2652139568 wait complete. 2023-10-25T16:14:28.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:28.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/2068789837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e100047d0 msgr2=0x7f5e10004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:28.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/2068789837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e100047d0 0x7f5e10004c50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5e2406f520 tx=0x7f5e1401f700 comp rx=0 tx=0).stop 2023-10-25T16:14:28.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2aa94640 1 -- 172.21.15.177:0/2068789837 reap_dead start 2023-10-25T16:14:28.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/2068789837 shutdown_connections 2023-10-25T16:14:28.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/2068789837 >> 172.21.15.177:0/2068789837 conn(0x7f5e240b2450 msgr2=0x7f5e240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:28.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/2068789837 shutdown_connections 2023-10-25T16:14:28.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/2068789837 wait complete. 2023-10-25T16:14:28.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 Processor -- start 2023-10-25T16:14:28.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- start start 2023-10-25T16:14:28.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e2414db30 0x7f5e240ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:28.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e2414df10 0x7f5e24153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:28.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 0x7f5e240b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:28.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240add00 con 0x7f5e24153f40 2023-10-25T16:14:28.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240ada60 con 0x7f5e2414db30 2023-10-25T16:14:28.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2c4f7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240af9c0 con 0x7f5e2414df10 2023-10-25T16:14:28.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2aa94640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 0x7f5e240b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:28.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2aa94640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 0x7f5e240b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51584/0 (socket says 172.21.15.177:51584) 2023-10-25T16:14:28.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2aa94640 1 -- 172.21.15.177:0/1107008941 learned_addr learned my addr 172.21.15.177:0/1107008941 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:28.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e29a92640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e2414df10 0x7f5e24153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:28.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.863+0000 7f5e2a293640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e2414db30 0x7f5e240ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:28.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2aa94640 1 -- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e2414df10 msgr2=0x7f5e24153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:28.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2aa94640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e2414df10 0x7f5e24153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:28.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2aa94640 1 -- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e2414db30 msgr2=0x7f5e240ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:28.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2aa94640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e2414db30 0x7f5e240ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:28.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2aa94640 1 -- 172.21.15.177:0/1107008941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e240af120 con 0x7f5e24153f40 2023-10-25T16:14:28.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2a293640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e2414db30 0x7f5e240ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:28.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2aa94640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 0x7f5e240b0d70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5e240ca4b0 tx=0x7f5e1c00fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:28.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c004d30 con 0x7f5e24153f40 2023-10-25T16:14:28.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5e1c00dae0 con 0x7f5e24153f40 2023-10-25T16:14:28.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e240af400 con 0x7f5e24153f40 2023-10-25T16:14:28.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00deb0 con 0x7f5e24153f40 2023-10-25T16:14:28.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e24152790 con 0x7f5e24153f40 2023-10-25T16:14:28.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e24157110 con 0x7f5e24153f40 2023-10-25T16:14:28.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5e1c01b440 con 0x7f5e24153f40 2023-10-25T16:14:28.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e1affd640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e08066470 0x7f5e08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:28.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e1c084460 con 0x7f5e24153f40 2023-10-25T16:14:28.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2a293640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e08066470 0x7f5e08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:28.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.867+0000 7f5e2a293640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e08066470 0x7f5e08068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009a90 tx=0x7f5e200091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:28.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:28.871+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e1c051840 con 0x7f5e24153f40 2023-10-25T16:14:29.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e24152980 con 0x7f5e24153f40 2023-10-25T16:14:29.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e1affd640 1 -- 172.21.15.177:0/1107008941 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f5e1c054e60 con 0x7f5e24153f40 2023-10-25T16:14:29.037 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:29.037 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":37,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:28.711678+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:29.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e08066470 msgr2=0x7f5e08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e08066470 0x7f5e08068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009a90 tx=0x7f5e200091e0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 msgr2=0x7f5e240b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 0x7f5e240b0d70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5e240ca4b0 tx=0x7f5e1c00fd60 comp rx=0 tx=0).stop 2023-10-25T16:14:29.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 shutdown_connections 2023-10-25T16:14:29.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.031+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e08066470 0x7f5e08068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.035+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e24153f40 0x7f5e240b0d70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.035+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e2414df10 0x7f5e24153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.035+0000 7f5e2c4f7640 1 --2- 172.21.15.177:0/1107008941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e2414db30 0x7f5e240ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.035+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 >> 172.21.15.177:0/1107008941 conn(0x7f5e240b2450 msgr2=0x7f5e240ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:29.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.035+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 shutdown_connections 2023-10-25T16:14:29.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.035+0000 7f5e2c4f7640 1 -- 172.21.15.177:0/1107008941 wait complete. 2023-10-25T16:14:29.056 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:14:29.056 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:29.057 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-25T16:14:29.057 DEBUG:teuthology.orchestra.run.smithi177:> os.fchmod(fd, 0O666) 2023-10-25T16:14:29.057 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(fd) 2023-10-25T16:14:29.058 DEBUG:teuthology.orchestra.run.smithi177:> os.close(fd) 2023-10-25T16:14:29.058 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:29.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:29.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:14:29.129 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:14:29.129 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:14:29.130 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:29.130 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:14:29.131 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:29.131 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:14:29.131 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:14:29.132 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:14:29.132 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:14:29.132 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:29.133 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:14:29.133 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:14:29.133 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:14:29.134 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:14:29.134 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:29.134 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:14:29.135 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:14:29.135 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:14:29.135 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:14:29.136 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:14:29.136 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:14:29.136 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:14:29.137 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:14:29.137 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:29.137 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:14:29.138 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:29.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:29.257 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:29.257 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:29.258 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.38864.asok status 2023-10-25T16:14:29.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:29.446 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:29.447 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:14:29.447 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:14:29.447 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:14:29.447 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:14:29.447 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:14:29.448 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:14:29.448 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "38864", 2023-10-25T16:14:29.448 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:14:29.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:29.448 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 1, 2023-10-25T16:14:29.449 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:14:29.449 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5586, 2023-10-25T16:14:29.449 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:14:29.449 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:14:29.449 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:14:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5586 2023-10-25T16:14:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:29.451 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:29.451 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:29.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:29.451 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:29.451 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:29.451 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:29.452 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:29.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:29.452 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5586 192.168.0.1:0/3766596604", 2023-10-25T16:14:29.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3766596604", 2023-10-25T16:14:29.452 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 2, 2023-10-25T16:14:29.453 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 12, 2023-10-25T16:14:29.453 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 35, 2023-10-25T16:14:29.453 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 35, 2023-10-25T16:14:29.453 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:14:29.453 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:14:29.454 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:29.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:29.468 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3245954103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6900cdb10 msgr2=0x7fc6900cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3245954103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6900cdb10 0x7fc6900cdf80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc69009f200 tx=0x7fc68801cc90 comp rx=0 tx=0).stop 2023-10-25T16:14:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3245954103 shutdown_connections 2023-10-25T16:14:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3245954103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6900cdb10 0x7fc6900cdf80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3245954103 >> v2:172.21.15.184:3300/0 conn(0x7fc6900b2120 0x7fc6900b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3245954103 >> 172.21.15.177:0/3245954103 conn(0x7fc69009a5c0 msgr2=0x7fc6900d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3245954103 shutdown_connections 2023-10-25T16:14:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3245954103 wait complete. 2023-10-25T16:14:29.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 Processor -- start 2023-10-25T16:14:29.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- start start 2023-10-25T16:14:29.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6900b2120 0x7fc69015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:29.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6900cdb10 0x7fc6900c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:29.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 0x7fc6901529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:29.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c5380 con 0x7fc69015eba0 2023-10-25T16:14:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690159640 con 0x7fc6900b2120 2023-10-25T16:14:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690159920 con 0x7fc6900cdb10 2023-10-25T16:14:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 0x7fc6901529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 0x7fc6901529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51602/0 (socket says 172.21.15.177:51602) 2023-10-25T16:14:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 -- 172.21.15.177:0/3780303959 learned_addr learned my addr 172.21.15.177:0/3780303959 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:29.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68e7fc640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6900cdb10 0x7fc6900c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:29.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 -- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6900cdb10 msgr2=0x7fc6900c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6900cdb10 0x7fc6900c4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 -- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6900b2120 msgr2=0x7fc69015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68effd640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6900b2120 0x7fc69015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:29.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6900b2120 0x7fc69015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 -- 172.21.15.177:0/3780303959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880098e0 con 0x7fc69015eba0 2023-10-25T16:14:29.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68e7fc640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6900cdb10 0x7fc6900c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:29.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc68f7fe640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 0x7fc6901529b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc68801a8c0 tx=0x7fc6880a5ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:29.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688004e60 con 0x7fc69015eba0 2023-10-25T16:14:29.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc688004050 con 0x7fc69015eba0 2023-10-25T16:14:29.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc690159c00 con 0x7fc69015eba0 2023-10-25T16:14:29.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688004420 con 0x7fc69015eba0 2023-10-25T16:14:29.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6901f4db0 con 0x7fc69015eba0 2023-10-25T16:14:29.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.591+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69004daf0 con 0x7fc69015eba0 2023-10-25T16:14:29.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.595+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6880b4040 con 0x7fc69015eba0 2023-10-25T16:14:29.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.595+0000 7fc6777fe640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc67c066470 0x7fc67c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:29.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.595+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68811e270 con 0x7fc69015eba0 2023-10-25T16:14:29.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.595+0000 7fc68effd640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc67c066470 0x7fc67c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:29.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.595+0000 7fc68effd640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc67c066470 0x7fc67c068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc68000a750 tx=0x7fc680008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:29.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.599+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6880eb780 con 0x7fc69015eba0 2023-10-25T16:14:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.787+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6900ce930 con 0x7fc69015eba0 2023-10-25T16:14:29.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6777fe640 1 -- 172.21.15.177:0/3780303959 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7fc6880bc090 con 0x7fc69015eba0 2023-10-25T16:14:29.796 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:29.796 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:29.796 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:29.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc67c066470 msgr2=0x7fc67c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc67c066470 0x7fc67c068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc68000a750 tx=0x7fc680008040 comp rx=0 tx=0).stop 2023-10-25T16:14:29.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 msgr2=0x7fc6901529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:29.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 0x7fc6901529b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc68801a8c0 tx=0x7fc6880a5ac0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 shutdown_connections 2023-10-25T16:14:29.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc67c066470 0x7fc67c068930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc69015eba0 0x7fc6901529b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6900cdb10 0x7fc6900c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 --2- 172.21.15.177:0/3780303959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6900b2120 0x7fc69015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:29.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 >> 172.21.15.177:0/3780303959 conn(0x7fc69009a5c0 msgr2=0x7fc69015c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:29.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 shutdown_connections 2023-10-25T16:14:29.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:29.791+0000 7fc6956b5640 1 -- 172.21.15.177:0/3780303959 wait complete. 2023-10-25T16:14:29.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 37 2023-10-25T16:14:29.958 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-25T16:14:29.959 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:14:29.959 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:29.959 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-25T16:14:29.960 DEBUG:teuthology.orchestra.run.smithi177:> os.fchmod(fd, 0O666) 2023-10-25T16:14:29.960 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(fd) 2023-10-25T16:14:29.960 DEBUG:teuthology.orchestra.run.smithi177:> os.close(fd) 2023-10-25T16:14:29.961 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:29.996 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:14:29.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:14:30.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:30.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:14:30.042 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:14:30.042 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:14:30.043 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:30.043 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:14:30.044 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.044 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:14:30.044 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:14:30.045 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:14:30.045 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:14:30.045 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.046 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:14:30.046 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:14:30.047 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:14:30.047 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:14:30.047 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.048 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:14:30.048 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:14:30.048 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:14:30.049 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:14:30.049 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:14:30.049 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:14:30.050 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:14:30.050 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:14:30.050 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.051 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:14:30.051 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:30.159 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:30.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:30.171 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:30.171 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:30.172 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.38864.asok status 2023-10-25T16:14:30.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:30.368 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:30.368 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:14:30.368 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:14:30.368 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:14:30.369 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:14:30.369 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:14:30.369 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:14:30.369 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "38864", 2023-10-25T16:14:30.369 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:14:30.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.370 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 2, 2023-10-25T16:14:30.370 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:14:30.370 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5586, 2023-10-25T16:14:30.370 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:14:30.371 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:14:30.371 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:14:30.371 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5586 2023-10-25T16:14:30.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.371 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:30.371 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:30.372 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:30.372 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:30.372 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:30.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.372 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:30.373 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:30.373 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:30.373 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:30.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.373 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5586 192.168.0.1:0/3766596604", 2023-10-25T16:14:30.374 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3766596604", 2023-10-25T16:14:30.374 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 3, 2023-10-25T16:14:30.374 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 12, 2023-10-25T16:14:30.374 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 37, 2023-10-25T16:14:30.374 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 37, 2023-10-25T16:14:30.375 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:14:30.375 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:14:30.375 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:30.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:30.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:14:30.388 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:14:30.388 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:14:30.388 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:14:30.389 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:14:30.389 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.390 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:14:30.390 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:14:30.390 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:14:30.391 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:14:30.391 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.391 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:14:30.392 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:14:30.392 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:14:30.393 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:14:30.393 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.393 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:14:30.394 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:14:30.394 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:14:30.395 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:14:30.395 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:14:30.395 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:14:30.396 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:14:30.396 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:14:30.396 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:14:30.397 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:14:30.397 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:14:30.467 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:30.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:30.479 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.38864.asok 2023-10-25T16:14:30.479 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:30.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.38864.asok status 2023-10-25T16:14:30.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:30.672 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:30.672 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:14:30.672 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:14:30.672 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:14:30.673 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:14:30.673 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:14:30.673 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:14:30.673 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "38864", 2023-10-25T16:14:30.673 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:14:30.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.674 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 2, 2023-10-25T16:14:30.674 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:14:30.674 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5586, 2023-10-25T16:14:30.674 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:14:30.675 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:14:30.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:14:30.675 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 5586 2023-10-25T16:14:30.675 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:30.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:30.676 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:30.676 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:30.676 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:30.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.678 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:14:30.678 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:14:30.678 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:14:30.678 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3766596604 2023-10-25T16:14:30.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:30.679 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.5586 192.168.0.1:0/3766596604", 2023-10-25T16:14:30.679 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3766596604", 2023-10-25T16:14:30.679 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 3, 2023-10-25T16:14:30.680 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 12, 2023-10-25T16:14:30.680 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 37, 2023-10-25T16:14:30.680 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 37, 2023-10-25T16:14:30.680 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:14:30.681 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:14:30.681 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:30.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:30.693 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:14:30.694 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:14:30.694 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:14:30.756 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:14:30.806 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:14:30.807 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:14:30.807 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:30.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:30.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/95974381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 msgr2=0x7f0b7c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:30.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 --2- 172.21.15.177:0/95974381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b7c004c50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0b9006c5f0 tx=0x7f0b8001cc20 comp rx=0 tx=0).stop 2023-10-25T16:14:30.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8ffff640 1 -- 172.21.15.177:0/95974381 reap_dead start 2023-10-25T16:14:30.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/95974381 shutdown_connections 2023-10-25T16:14:30.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/95974381 >> 172.21.15.177:0/95974381 conn(0x7f0b900b2450 msgr2=0x7f0b900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:30.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/95974381 shutdown_connections 2023-10-25T16:14:30.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/95974381 wait complete. 2023-10-25T16:14:30.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 Processor -- start 2023-10-25T16:14:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- start start 2023-10-25T16:14:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b90149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90157580 0x7f0b90157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:30.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b901efb70 0x7f0b901efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90156bb0 con 0x7f0b7c0047d0 2023-10-25T16:14:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90157f40 con 0x7f0b90157580 2023-10-25T16:14:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9014a0a0 con 0x7f0b901efb70 2023-10-25T16:14:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b90149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b90149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33676/0 (socket says 172.21.15.177:33676) 2023-10-25T16:14:30.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 -- 172.21.15.177:0/3220150368 learned_addr learned my addr 172.21.15.177:0/3220150368 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b86ffd640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90157580 0x7f0b90157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8ffff640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b901efb70 0x7f0b901efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 -- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b901efb70 msgr2=0x7f0b901efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b901efb70 0x7f0b901efff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:30.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 -- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90157580 msgr2=0x7f0b90157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90157580 0x7f0b90157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 -- 172.21.15.177:0/3220150368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b901f0530 con 0x7f0b7c0047d0 2023-10-25T16:14:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8f7fe640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b90149b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800e360 tx=0x7f0b7800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78012910 con 0x7f0b7c0047d0 2023-10-25T16:14:30.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0b78012b80 con 0x7f0b7c0047d0 2023-10-25T16:14:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b901f0aa0 con 0x7f0b7c0047d0 2023-10-25T16:14:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7801a400 con 0x7f0b7c0047d0 2023-10-25T16:14:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.979+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b900add00 con 0x7f0b7c0047d0 2023-10-25T16:14:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.983+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9004daf0 con 0x7f0b7c0047d0 2023-10-25T16:14:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.983+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0b780113d0 con 0x7f0b7c0047d0 2023-10-25T16:14:30.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.983+0000 7f0b8cff9640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b700664a0 0x7f0b70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.983+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b78087440 con 0x7f0b7c0047d0 2023-10-25T16:14:30.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.983+0000 7f0b86ffd640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b700664a0 0x7f0b70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:30.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.983+0000 7f0b86ffd640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b700664a0 0x7f0b70068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0b9006c5f0 tx=0x7f0b800a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:30.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:30.987+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b78054950 con 0x7f0b7c0047d0 2023-10-25T16:14:31.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.143+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b90159380 con 0x7f0b7c0047d0 2023-10-25T16:14:31.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b8cff9640 1 -- 172.21.15.177:0/3220150368 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f0b7801f090 con 0x7f0b7c0047d0 2023-10-25T16:14:31.151 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:31.151 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":37,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:28.711678+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b700664a0 msgr2=0x7f0b70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b700664a0 0x7f0b70068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0b9006c5f0 tx=0x7f0b800a7040 comp rx=0 tx=0).stop 2023-10-25T16:14:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 msgr2=0x7f0b90149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b90149b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800e360 tx=0x7f0b7800e820 comp rx=0 tx=0).stop 2023-10-25T16:14:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 shutdown_connections 2023-10-25T16:14:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b700664a0 0x7f0b70068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b901efb70 0x7f0b901efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90157580 0x7f0b90157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 --2- 172.21.15.177:0/3220150368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b7c0047d0 0x7f0b90149b60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 >> 172.21.15.177:0/3220150368 conn(0x7f0b900b2450 msgr2=0x7f0b9014f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 shutdown_connections 2023-10-25T16:14:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.147+0000 7f0b95f77640 1 -- 172.21.15.177:0/3220150368 wait complete. 2023-10-25T16:14:31.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:14:08.367295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:14:09.251027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:14:31.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:14:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- 172.21.15.177:0/4189555727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040003980 msgr2=0x7f0040003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 --2- 172.21.15.177:0/4189555727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0040003980 0x7f0040003da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f005000bbe0 tx=0x7f005001ce30 comp rx=0 tx=0).stop 2023-10-25T16:14:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005ffff640 1 -- 172.21.15.177:0/4189555727 reap_dead start 2023-10-25T16:14:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- 172.21.15.177:0/4189555727 shutdown_connections 2023-10-25T16:14:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- 172.21.15.177:0/4189555727 >> 172.21.15.177:0/4189555727 conn(0x7f00600b2450 msgr2=0x7f00600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- 172.21.15.177:0/4189555727 shutdown_connections 2023-10-25T16:14:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- 172.21.15.177:0/4189555727 wait complete. 2023-10-25T16:14:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 Processor -- start 2023-10-25T16:14:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- start start 2023-10-25T16:14:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0040003980 0x7f0060150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 0x7f006015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f006015d160 0x7f006015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600adac0 con 0x7f006015a4d0 2023-10-25T16:14:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006015ae90 con 0x7f006015d160 2023-10-25T16:14:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f0065ba7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00601f6bf0 con 0x7f0040003980 2023-10-25T16:14:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 0x7f006015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 0x7f006015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33698/0 (socket says 172.21.15.177:33698) 2023-10-25T16:14:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 -- 172.21.15.177:0/2575650871 learned_addr learned my addr 172.21.15.177:0/2575650871 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005f7fe640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0040003980 0x7f0060150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005ffff640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f006015d160 0x7f006015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 -- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0040003980 msgr2=0x7f0060150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0040003980 0x7f0060150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 -- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f006015d160 msgr2=0x7f006015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f006015d160 0x7f006015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 -- 172.21.15.177:0/2575650871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060150a60 con 0x7f006015a4d0 2023-10-25T16:14:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.295+0000 7f005effd640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 0x7f006015a950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0058009fd0 tx=0x7f005800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058009980 con 0x7f006015a4d0 2023-10-25T16:14:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0058012740 con 0x7f006015a4d0 2023-10-25T16:14:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00601f6070 con 0x7f006015a4d0 2023-10-25T16:14:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058012b70 con 0x7f006015a4d0 2023-10-25T16:14:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00601f6630 con 0x7f006015a4d0 2023-10-25T16:14:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006004daf0 con 0x7f006015a4d0 2023-10-25T16:14:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0058012cd0 con 0x7f006015a4d0 2023-10-25T16:14:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0057fff640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f00440664a0 0x7f0044068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0058085080 con 0x7f006015a4d0 2023-10-25T16:14:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f005f7fe640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f00440664a0 0x7f0044068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.299+0000 7f005f7fe640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f00440664a0 0x7f0044068960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f00500b0000 tx=0x7f0050019bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.303+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00580525b0 con 0x7f006015a4d0 2023-10-25T16:14:31.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0060151a10 con 0x7f006015a4d0 2023-10-25T16:14:31.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0057fff640 1 -- 172.21.15.177:0/2575650871 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0058055bd0 con 0x7f006015a4d0 2023-10-25T16:14:31.464 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:14:31.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f00440664a0 msgr2=0x7f0044068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f00440664a0 0x7f0044068960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f00500b0000 tx=0x7f0050019bd0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 msgr2=0x7f006015a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 0x7f006015a950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0058009fd0 tx=0x7f005800f730 comp rx=0 tx=0).stop 2023-10-25T16:14:31.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 shutdown_connections 2023-10-25T16:14:31.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f00440664a0 0x7f0044068960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f006015d160 0x7f006015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f006015a4d0 0x7f006015a950 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 --2- 172.21.15.177:0/2575650871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0040003980 0x7f0060150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 >> 172.21.15.177:0/2575650871 conn(0x7f00600b2450 msgr2=0x7f0060069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 shutdown_connections 2023-10-25T16:14:31.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.459+0000 7f0065ba7640 1 -- 172.21.15.177:0/2575650871 wait complete. 2023-10-25T16:14:31.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:14:31.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/324445392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed40003980 msgr2=0x7fed40003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 --2- 172.21.15.177:0/324445392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed40003980 0x7fed40003da0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fed4800bbe0 tx=0x7fed4801ce30 comp rx=0 tx=0).stop 2023-10-25T16:14:31.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed56d9d640 1 -- 172.21.15.177:0/324445392 reap_dead start 2023-10-25T16:14:31.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/324445392 shutdown_connections 2023-10-25T16:14:31.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/324445392 >> 172.21.15.177:0/324445392 conn(0x7fed580b2450 msgr2=0x7fed580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:31.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/324445392 shutdown_connections 2023-10-25T16:14:31.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/324445392 wait complete. 2023-10-25T16:14:31.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 Processor -- start 2023-10-25T16:14:31.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- start start 2023-10-25T16:14:31.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40003980 0x7fed58156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 0x7fed580cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed580cb910 0x7fed58151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580cbd90 con 0x7fed581425c0 2023-10-25T16:14:31.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed581535f0 con 0x7fed40003980 2023-10-25T16:14:31.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed58142a40 con 0x7fed580cb910 2023-10-25T16:14:31.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 0x7fed580cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 0x7fed580cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33712/0 (socket says 172.21.15.177:33712) 2023-10-25T16:14:31.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 -- 172.21.15.177:0/2960047106 learned_addr learned my addr 172.21.15.177:0/2960047106 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:31.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5659c640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40003980 0x7fed58156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed56d9d640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed580cb910 0x7fed58151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 -- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed580cb910 msgr2=0x7fed58151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed580cb910 0x7fed58151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 -- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40003980 msgr2=0x7fed58156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40003980 0x7fed58156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 -- 172.21.15.177:0/2960047106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58155980 con 0x7fed581425c0 2023-10-25T16:14:31.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed56d9d640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed580cb910 0x7fed58151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:31.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed55d9b640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 0x7fed580cb3d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fed4c004fd0 tx=0x7fed4c00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:31.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c010890 con 0x7fed581425c0 2023-10-25T16:14:31.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed4c010b20 con 0x7fed581425c0 2023-10-25T16:14:31.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed58155c60 con 0x7fed581425c0 2023-10-25T16:14:31.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c011460 con 0x7fed581425c0 2023-10-25T16:14:31.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.603+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed58156220 con 0x7fed581425c0 2023-10-25T16:14:31.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.607+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5804daf0 con 0x7fed581425c0 2023-10-25T16:14:31.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.607+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fed4c0115c0 con 0x7fed581425c0 2023-10-25T16:14:31.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.607+0000 7fed46ffd640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fed38066470 0x7fed38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.607+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed4c0845b0 con 0x7fed581425c0 2023-10-25T16:14:31.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.607+0000 7fed5659c640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fed38066470 0x7fed38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.607+0000 7fed5659c640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fed38066470 0x7fed38068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fed480b0000 tx=0x7fed48019bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:31.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.611+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fed4c051ac0 con 0x7fed581425c0 2023-10-25T16:14:31.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.759+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed580cd970 con 0x7fed581425c0 2023-10-25T16:14:31.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed46ffd640 1 -- 172.21.15.177:0/2960047106 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed4c015020 con 0x7fed581425c0 2023-10-25T16:14:31.767 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:14:31.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fed38066470 msgr2=0x7fed38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fed38066470 0x7fed38068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fed480b0000 tx=0x7fed48019bd0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 msgr2=0x7fed580cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 0x7fed580cb3d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fed4c004fd0 tx=0x7fed4c00ea20 comp rx=0 tx=0).stop 2023-10-25T16:14:31.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 shutdown_connections 2023-10-25T16:14:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fed38066470 0x7fed38068930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed580cb910 0x7fed58151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed581425c0 0x7fed580cb3d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 --2- 172.21.15.177:0/2960047106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40003980 0x7fed58156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 >> 172.21.15.177:0/2960047106 conn(0x7fed580b2450 msgr2=0x7fed581572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 shutdown_connections 2023-10-25T16:14:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.763+0000 7fed5caf4640 1 -- 172.21.15.177:0/2960047106 wait complete. 2023-10-25T16:14:31.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:14:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/3228367516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0af2d0 msgr2=0x7fa3dc06f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 --2- 172.21.15.177:0/3228367516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0af2d0 0x7fa3dc06f570 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009bc0 tx=0x7fa3d401cb50 comp rx=0 tx=0).stop 2023-10-25T16:14:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/3228367516 shutdown_connections 2023-10-25T16:14:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 --2- 172.21.15.177:0/3228367516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0af2d0 0x7fa3dc06f570 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 --2- 172.21.15.177:0/3228367516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc14e920 0x7fa3dc1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/3228367516 >> 172.21.15.177:0/3228367516 conn(0x7fa3dc0b2450 msgr2=0x7fa3dc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/3228367516 shutdown_connections 2023-10-25T16:14:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/3228367516 wait complete. 2023-10-25T16:14:31.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 Processor -- start 2023-10-25T16:14:31.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- start start 2023-10-25T16:14:31.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc0af2d0 0x7fa3dc148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 0x7fa3dc151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3dc14e920 0x7fa3dc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc15c080 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc151720 con 0x7fa3dc14e920 2023-10-25T16:14:31.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc150130 con 0x7fa3dc0af2d0 2023-10-25T16:14:31.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 0x7fa3dc151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 0x7fa3dc151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33732/0 (socket says 172.21.15.177:33732) 2023-10-25T16:14:31.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 -- 172.21.15.177:0/99463948 learned_addr learned my addr 172.21.15.177:0/99463948 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:31.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e1712640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc0af2d0 0x7fa3dc148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e1f13640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3dc14e920 0x7fa3dc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 -- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc0af2d0 msgr2=0x7fa3dc148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc0af2d0 0x7fa3dc148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 -- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3dc14e920 msgr2=0x7fa3dc15bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:31.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3dc14e920 0x7fa3dc15bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:31.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 -- 172.21.15.177:0/99463948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4009820 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e1712640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc0af2d0 0x7fa3dc148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:31.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e0f11640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 0x7fa3dc151c20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00c450 tx=0x7fa3cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:31.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc012830 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3cc012a80 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc012e90 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc150410 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.911+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc15b620 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.915+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc04daf0 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.915+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa3cc01a3b0 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.915+0000 7fa3d1ffb640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3c0066470 0x7fa3c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:31.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.915+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3cc083c80 con 0x7fa3dc0ca7a0 2023-10-25T16:14:31.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.915+0000 7fa3e1712640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3c0066470 0x7fa3c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:31.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.915+0000 7fa3e1712640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3c0066470 0x7fa3c0068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d8005f20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:31.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:31.919+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3cc051190 con 0x7fa3dc0ca7a0 2023-10-25T16:14:32.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.071+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3dc15b7b0 con 0x7fa3dc0ca7a0 2023-10-25T16:14:32.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.071+0000 7fa3d1ffb640 1 -- 172.21.15.177:0/99463948 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3cc016020 con 0x7fa3dc0ca7a0 2023-10-25T16:14:32.078 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:14:32.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3c0066470 msgr2=0x7fa3c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3c0066470 0x7fa3c0068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d8005f20 comp rx=0 tx=0).stop 2023-10-25T16:14:32.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 msgr2=0x7fa3dc151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 0x7fa3dc151c20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00c450 tx=0x7fa3cc00c910 comp rx=0 tx=0).stop 2023-10-25T16:14:32.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 shutdown_connections 2023-10-25T16:14:32.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3c0066470 0x7fa3c0068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3dc14e920 0x7fa3dc15bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc0ca7a0 0x7fa3dc151c20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 --2- 172.21.15.177:0/99463948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3dc0af2d0 0x7fa3dc148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 >> 172.21.15.177:0/99463948 conn(0x7fa3dc0b2450 msgr2=0x7fa3dc0ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:32.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 shutdown_connections 2023-10-25T16:14:32.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.075+0000 7fa3e3976640 1 -- 172.21.15.177:0/99463948 wait complete. 2023-10-25T16:14:32.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:14:32.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 -- 172.21.15.177:0/3617994396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c80af2d0 msgr2=0x7f19c8158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 --2- 172.21.15.177:0/3617994396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c80af2d0 0x7f19c8158170 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009c80 tx=0x7f19c001cd40 comp rx=0 tx=0).stop 2023-10-25T16:14:32.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 -- 172.21.15.177:0/3617994396 shutdown_connections 2023-10-25T16:14:32.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 --2- 172.21.15.177:0/3617994396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c80af2d0 0x7f19c8158170 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 --2- 172.21.15.177:0/3617994396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c814e810 0x7f19c80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 -- 172.21.15.177:0/3617994396 >> 172.21.15.177:0/3617994396 conn(0x7f19c80b2450 msgr2=0x7f19c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:32.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 -- 172.21.15.177:0/3617994396 shutdown_connections 2023-10-25T16:14:32.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 -- 172.21.15.177:0/3617994396 wait complete. 2023-10-25T16:14:32.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.215+0000 7f19d077f640 1 Processor -- start 2023-10-25T16:14:32.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- start start 2023-10-25T16:14:32.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c80af2d0 0x7f19c80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c814e810 0x7f19c814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 0x7f19c81f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814b660 con 0x7f19c815bdb0 2023-10-25T16:14:32.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8070990 con 0x7f19c80af2d0 2023-10-25T16:14:32.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8070c70 con 0x7f19c814e810 2023-10-25T16:14:32.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 0x7f19c81f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 0x7f19c81f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33750/0 (socket says 172.21.15.177:33750) 2023-10-25T16:14:32.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 -- 172.21.15.177:0/4199028053 learned_addr learned my addr 172.21.15.177:0/4199028053 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:32.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19cdd1a640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c814e810 0x7f19c814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ce51b640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c80af2d0 0x7f19c80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 -- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c814e810 msgr2=0x7f19c814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c814e810 0x7f19c814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 -- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c80af2d0 msgr2=0x7f19c80702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c80af2d0 0x7f19c80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 -- 172.21.15.177:0/4199028053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00098e0 con 0x7f19c815bdb0 2023-10-25T16:14:32.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ced1c640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 0x7f19c81f74a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f19c001d5e0 tx=0x7f19c00093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:32.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0004e60 con 0x7f19c815bdb0 2023-10-25T16:14:32.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f19c00a5ad0 con 0x7f19c815bdb0 2023-10-25T16:14:32.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c8070f50 con 0x7f19c815bdb0 2023-10-25T16:14:32.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0004260 con 0x7f19c815bdb0 2023-10-25T16:14:32.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8071510 con 0x7f19c815bdb0 2023-10-25T16:14:32.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8071700 con 0x7f19c815bdb0 2023-10-25T16:14:32.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19c00b4040 con 0x7f19c815bdb0 2023-10-25T16:14:32.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19beffd640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19ac066470 0x7f19ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19c011e000 con 0x7f19c815bdb0 2023-10-25T16:14:32.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.219+0000 7f19ce51b640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19ac066470 0x7f19ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.223+0000 7f19ce51b640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19ac066470 0x7f19ac068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19c40058d0 tx=0x7f19c4005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:32.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.223+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19c00eb490 con 0x7f19c815bdb0 2023-10-25T16:14:32.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.379+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19c804daf0 con 0x7f19c815bdb0 2023-10-25T16:14:32.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19beffd640 1 -- 172.21.15.177:0/4199028053 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19c00eeab0 con 0x7f19c815bdb0 2023-10-25T16:14:32.387 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:14:32.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19ac066470 msgr2=0x7f19ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19ac066470 0x7f19ac068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f19c40058d0 tx=0x7f19c4005860 comp rx=0 tx=0).stop 2023-10-25T16:14:32.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 msgr2=0x7f19c81f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 0x7f19c81f74a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f19c001d5e0 tx=0x7f19c00093b0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 shutdown_connections 2023-10-25T16:14:32.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19ac066470 0x7f19ac068930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19c815bdb0 0x7f19c81f74a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19c814e810 0x7f19c814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 --2- 172.21.15.177:0/4199028053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19c80af2d0 0x7f19c80702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 >> 172.21.15.177:0/4199028053 conn(0x7f19c80b2450 msgr2=0x7f19c8069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:32.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 shutdown_connections 2023-10-25T16:14:32.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.383+0000 7f19d077f640 1 -- 172.21.15.177:0/4199028053 wait complete. 2023-10-25T16:14:32.404 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:14:32.404 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:32.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:14:32.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:32.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[38864]: fuse finished with error 0 and tester_r 0 2023-10-25T16:14:32.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:32.454 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:14:32.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:32.454 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:14:32.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:14:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:32.528 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:14:32.528 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:32.534 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:32.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- 172.21.15.177:0/3666009155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc81577a0 msgr2=0x7f4cc80cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3666009155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc81577a0 0x7f4cc80cd420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009900 tx=0x7f4cc401c800 comp rx=0 tx=0).stop 2023-10-25T16:14:32.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- 172.21.15.177:0/3666009155 shutdown_connections 2023-10-25T16:14:32.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3666009155 >> v2:172.21.15.184:3300/0 conn(0x7f4cc80ca220 0x7f4cc80aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3666009155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc81577a0 0x7f4cc80cd420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- 172.21.15.177:0/3666009155 >> 172.21.15.177:0/3666009155 conn(0x7f4cc80b2450 msgr2=0x7f4cc80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:32.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- 172.21.15.177:0/3666009155 shutdown_connections 2023-10-25T16:14:32.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- 172.21.15.177:0/3666009155 wait complete. 2023-10-25T16:14:32.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 Processor -- start 2023-10-25T16:14:32.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- start start 2023-10-25T16:14:32.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc80c9b70 0x7f4cc80ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc80ca220 0x7f4cc8136830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 0x7f4cc8148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80aee70 con 0x7f4cc81577a0 2023-10-25T16:14:32.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc81488e0 con 0x7f4cc80c9b70 2023-10-25T16:14:32.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cd073b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc8136d70 con 0x7f4cc80ca220 2023-10-25T16:14:32.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4ccecd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 0x7f4cc8148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4ccecd8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 0x7f4cc8148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33762/0 (socket says 172.21.15.177:33762) 2023-10-25T16:14:32.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4ccecd8640 1 -- 172.21.15.177:0/3626829147 learned_addr learned my addr 172.21.15.177:0/3626829147 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:32.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4cce4d7640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc80c9b70 0x7f4cc80ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.687+0000 7f4ccdcd6640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc80ca220 0x7f4cc8136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4ccecd8640 1 -- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc80ca220 msgr2=0x7f4cc8136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4ccecd8640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc80ca220 0x7f4cc8136830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4ccecd8640 1 -- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc80c9b70 msgr2=0x7f4cc80ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4ccecd8640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc80c9b70 0x7f4cc80ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4ccecd8640 1 -- 172.21.15.177:0/3626829147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4009560 con 0x7f4cc81577a0 2023-10-25T16:14:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4ccecd8640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 0x7f4cc8148d70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000ec90 tx=0x7f4cc000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0004d30 con 0x7f4cc81577a0 2023-10-25T16:14:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4cc0004e90 con 0x7f4cc81577a0 2023-10-25T16:14:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc8147cd0 con 0x7f4cc81577a0 2023-10-25T16:14:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000b7d0 con 0x7f4cc81577a0 2023-10-25T16:14:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc8148290 con 0x7f4cc81577a0 2023-10-25T16:14:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc8148a90 con 0x7f4cc81577a0 2023-10-25T16:14:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4cc000b930 con 0x7f4cc81577a0 2023-10-25T16:14:32.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cbeffd640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4cac066470 0x7f4cac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:32.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cc0084a60 con 0x7f4cc81577a0 2023-10-25T16:14:32.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cce4d7640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4cac066470 0x7f4cac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:32.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.691+0000 7f4cce4d7640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4cac066470 0x7f4cac068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40af000 tx=0x7f4cc401b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:32.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.695+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4cc8148a90 con 0x7f4cc81577a0 2023-10-25T16:14:32.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.843+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cc8148a50 con 0x7f4cc81577a0 2023-10-25T16:14:32.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.843+0000 7f4cbeffd640 1 -- 172.21.15.177:0/3626829147 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f4cc0051f00 con 0x7f4cc81577a0 2023-10-25T16:14:32.850 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:32.851 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":37,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:28.711678+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:32.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4cac066470 msgr2=0x7f4cac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4cac066470 0x7f4cac068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40af000 tx=0x7f4cc401b040 comp rx=0 tx=0).stop 2023-10-25T16:14:32.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 msgr2=0x7f4cc8148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 0x7f4cc8148d70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000ec90 tx=0x7f4cc000c7a0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 shutdown_connections 2023-10-25T16:14:32.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4cac066470 0x7f4cac068930 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4cc81577a0 0x7f4cc8148d70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cc80ca220 0x7f4cc8136830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 --2- 172.21.15.177:0/3626829147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc80c9b70 0x7f4cc80ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 >> 172.21.15.177:0/3626829147 conn(0x7f4cc80b2450 msgr2=0x7f4cc8070980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:32.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 shutdown_connections 2023-10-25T16:14:32.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.847+0000 7f4cd073b640 1 -- 172.21.15.177:0/3626829147 wait complete. 2023-10-25T16:14:32.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:14:08.367295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:14:09.251027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:14:32.870 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:14:32.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/3523570989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 msgr2=0x7febcc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:32.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 --2- 172.21.15.177:0/3523570989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc0b4100 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7febcc0cb890 tx=0x7febbc01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/3523570989 shutdown_connections 2023-10-25T16:14:32.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 --2- 172.21.15.177:0/3523570989 >> v2:172.21.15.184:3300/0 conn(0x7febcc0cdb10 0x7febcc0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 --2- 172.21.15.177:0/3523570989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc0b4100 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:32.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/3523570989 >> 172.21.15.177:0/3523570989 conn(0x7febcc09a5c0 msgr2=0x7febcc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:32.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/3523570989 shutdown_connections 2023-10-25T16:14:32.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/3523570989 wait complete. 2023-10-25T16:14:32.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 Processor -- start 2023-10-25T16:14:33.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- start start 2023-10-25T16:14:33.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febcc0cdb10 0x7febcc151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febcc15eba0 0x7febcc1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc15adb0 con 0x7febcc0b2120 2023-10-25T16:14:33.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc15aad0 con 0x7febcc15eba0 2023-10-25T16:14:33.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc0b47e0 con 0x7febcc0cdb10 2023-10-25T16:14:33.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33782/0 (socket says 172.21.15.177:33782) 2023-10-25T16:14:33.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 -- 172.21.15.177:0/2332891057 learned_addr learned my addr 172.21.15.177:0/2332891057 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:33.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd1f6f640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febcc15eba0 0x7febcc1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd0f6d640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febcc0cdb10 0x7febcc151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 -- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febcc0cdb10 msgr2=0x7febcc151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febcc0cdb10 0x7febcc151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 -- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febcc15eba0 msgr2=0x7febcc1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febcc15eba0 0x7febcc1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 -- 172.21.15.177:0/2332891057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc009560 con 0x7febcc0b2120 2023-10-25T16:14:33.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd1f6f640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febcc15eba0 0x7febcc1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:33.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd176e640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc14f2b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7febc800b410 tx=0x7febc800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8004020 con 0x7febcc0b2120 2023-10-25T16:14:33.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7febc8004270 con 0x7febcc0b2120 2023-10-25T16:14:33.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc0b4ac0 con 0x7febcc0b2120 2023-10-25T16:14:33.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011890 con 0x7febcc0b2120 2023-10-25T16:14:33.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.991+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc159d60 con 0x7febcc0b2120 2023-10-25T16:14:33.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.995+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc04daf0 con 0x7febcc0b2120 2023-10-25T16:14:33.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.995+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7febc8003600 con 0x7febcc0b2120 2023-10-25T16:14:33.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.995+0000 7febc1ffb640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7febb0066470 0x7febb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.995+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febc8083ea0 con 0x7febcc0b2120 2023-10-25T16:14:33.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.995+0000 7febd0f6d640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7febb0066470 0x7febb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.995+0000 7febd0f6d640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7febb0066470 0x7febb0068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ae000 tx=0x7febbc0b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:32.999+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7febc8051320 con 0x7febcc0b2120 2023-10-25T16:14:33.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.151+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febcc0ce930 con 0x7febcc0b2120 2023-10-25T16:14:33.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febc1ffb640 1 -- 172.21.15.177:0/2332891057 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7febc8054940 con 0x7febcc0b2120 2023-10-25T16:14:33.159 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:14:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7febb0066470 msgr2=0x7febb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7febb0066470 0x7febb0068930 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ae000 tx=0x7febbc0b3040 comp rx=0 tx=0).stop 2023-10-25T16:14:33.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 msgr2=0x7febcc14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc14f2b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7febc800b410 tx=0x7febc800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 shutdown_connections 2023-10-25T16:14:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7febb0066470 0x7febb0068930 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febcc15eba0 0x7febcc1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febcc0cdb10 0x7febcc151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 --2- 172.21.15.177:0/2332891057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febcc0b2120 0x7febcc14f2b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 >> 172.21.15.177:0/2332891057 conn(0x7febcc09a5c0 msgr2=0x7febcc15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:33.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 shutdown_connections 2023-10-25T16:14:33.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.155+0000 7febd39d2640 1 -- 172.21.15.177:0/2332891057 wait complete. 2023-10-25T16:14:33.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:14:33.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/2592276457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 msgr2=0x7fb544003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 --2- 172.21.15.177:0/2592276457 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb544003dd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb55800bb40 tx=0x7fb55801cd50 comp rx=0 tx=0).stop 2023-10-25T16:14:33.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb561311640 1 -- 172.21.15.177:0/2592276457 reap_dead start 2023-10-25T16:14:33.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/2592276457 shutdown_connections 2023-10-25T16:14:33.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/2592276457 >> 172.21.15.177:0/2592276457 conn(0x7fb55c0b2450 msgr2=0x7fb55c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:33.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/2592276457 shutdown_connections 2023-10-25T16:14:33.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/2592276457 wait complete. 2023-10-25T16:14:33.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 Processor -- start 2023-10-25T16:14:33.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- start start 2023-10-25T16:14:33.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb55c1482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb55c0ae400 0x7fb55c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb55c157bc0 0x7fb55c158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c148810 con 0x7fb5440039b0 2023-10-25T16:14:33.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c158580 con 0x7fb55c157bc0 2023-10-25T16:14:33.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0af5d0 con 0x7fb55c0ae400 2023-10-25T16:14:33.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb55c1482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb55c1482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33810/0 (socket says 172.21.15.177:33810) 2023-10-25T16:14:33.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 -- 172.21.15.177:0/474265198 learned_addr learned my addr 172.21.15.177:0/474265198 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:33.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb561311640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb55c157bc0 0x7fb55c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb553fff640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb55c0ae400 0x7fb55c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 -- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb55c0ae400 msgr2=0x7fb55c0ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb55c0ae400 0x7fb55c0ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 -- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb55c157bc0 msgr2=0x7fb55c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb55c157bc0 0x7fb55c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 -- 172.21.15.177:0/474265198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0ae9c0 con 0x7fb5440039b0 2023-10-25T16:14:33.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb561311640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb55c157bc0 0x7fb55c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:33.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb560b10640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb55c1482d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb5580b1040 tx=0x7fb5580a5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558004220 con 0x7fb5440039b0 2023-10-25T16:14:33.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb558004470 con 0x7fb5440039b0 2023-10-25T16:14:33.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0aeca0 con 0x7fb5440039b0 2023-10-25T16:14:33.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5580053e0 con 0x7fb5440039b0 2023-10-25T16:14:33.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.291+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0af260 con 0x7fb5440039b0 2023-10-25T16:14:33.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.295+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c04daf0 con 0x7fb5440039b0 2023-10-25T16:14:33.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.295+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb5580046d0 con 0x7fb5440039b0 2023-10-25T16:14:33.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.295+0000 7fb5517fa640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5480664a0 0x7fb548068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.295+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb55811e280 con 0x7fb5440039b0 2023-10-25T16:14:33.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.295+0000 7fb553fff640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5480664a0 0x7fb548068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.295+0000 7fb553fff640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5480664a0 0x7fb548068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb54c001ec0 tx=0x7fb54c001df0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.299+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5580eb670 con 0x7fb5440039b0 2023-10-25T16:14:33.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.443+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb55c156f70 con 0x7fb5440039b0 2023-10-25T16:14:33.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.443+0000 7fb5517fa640 1 -- 172.21.15.177:0/474265198 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5580eec90 con 0x7fb5440039b0 2023-10-25T16:14:33.449 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:14:33.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5480664a0 msgr2=0x7fb548068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5480664a0 0x7fb548068960 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb54c001ec0 tx=0x7fb54c001df0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 msgr2=0x7fb55c1482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb55c1482d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb5580b1040 tx=0x7fb5580a5f50 comp rx=0 tx=0).stop 2023-10-25T16:14:33.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 shutdown_connections 2023-10-25T16:14:33.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5480664a0 0x7fb548068960 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb55c157bc0 0x7fb55c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb55c0ae400 0x7fb55c0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 --2- 172.21.15.177:0/474265198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5440039b0 0x7fb55c1482d0 secure :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb5580b1040 tx=0x7fb5580a5f50 comp rx=0 tx=0).stop 2023-10-25T16:14:33.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 >> 172.21.15.177:0/474265198 conn(0x7fb55c0b2450 msgr2=0x7fb55c0cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:33.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 shutdown_connections 2023-10-25T16:14:33.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.447+0000 7fb562d74640 1 -- 172.21.15.177:0/474265198 wait complete. 2023-10-25T16:14:33.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:14:33.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- 172.21.15.177:0/2495694078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd480069b00 msgr2=0x7fd48006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 --2- 172.21.15.177:0/2495694078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd480069b00 0x7fd48006d260 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd468009840 tx=0x7fd46801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- 172.21.15.177:0/2495694078 shutdown_connections 2023-10-25T16:14:33.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 --2- 172.21.15.177:0/2495694078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd480069b00 0x7fd48006d260 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 --2- 172.21.15.177:0/2495694078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd480069720 0x7fd4800cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- 172.21.15.177:0/2495694078 >> 172.21.15.177:0/2495694078 conn(0x7fd4800ce000 msgr2=0x7fd4800ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:33.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- 172.21.15.177:0/2495694078 shutdown_connections 2023-10-25T16:14:33.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- 172.21.15.177:0/2495694078 wait complete. 2023-10-25T16:14:33.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 Processor -- start 2023-10-25T16:14:33.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- start start 2023-10-25T16:14:33.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd480069720 0x7fd480134950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 0x7fd48013d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48006d7a0 0x7fd48015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48015e670 con 0x7fd480069b00 2023-10-25T16:14:33.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48015e930 con 0x7fd48006d7a0 2023-10-25T16:14:33.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd484d62640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480138ef0 con 0x7fd480069720 2023-10-25T16:14:33.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd477fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 0x7fd48013d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd477fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 0x7fd48013d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33822/0 (socket says 172.21.15.177:33822) 2023-10-25T16:14:33.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.579+0000 7fd477fff640 1 -- 172.21.15.177:0/1279401700 learned_addr learned my addr 172.21.15.177:0/1279401700 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:33.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd47e59c640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd480069720 0x7fd480134950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd47ed9d640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48006d7a0 0x7fd48015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd477fff640 1 -- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd480069720 msgr2=0x7fd480134950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd477fff640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd480069720 0x7fd480134950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd477fff640 1 -- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48006d7a0 msgr2=0x7fd48015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd477fff640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48006d7a0 0x7fd48015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd477fff640 1 -- 172.21.15.177:0/1279401700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470009560 con 0x7fd480069b00 2023-10-25T16:14:33.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd47ed9d640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48006d7a0 0x7fd48015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:33.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd477fff640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 0x7fd48013d7e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd468000c10 tx=0x7fd4680a5880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680bc070 con 0x7fd480069b00 2023-10-25T16:14:33.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4680094a0 con 0x7fd480069b00 2023-10-25T16:14:33.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd468005230 con 0x7fd480069b00 2023-10-25T16:14:33.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680055e0 con 0x7fd480069b00 2023-10-25T16:14:33.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480141ff0 con 0x7fd480069b00 2023-10-25T16:14:33.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48004daf0 con 0x7fd480069b00 2023-10-25T16:14:33.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd4680b4040 con 0x7fd480069b00 2023-10-25T16:14:33.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd476ffd640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd460066470 0x7fd460068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd46811e3c0 con 0x7fd480069b00 2023-10-25T16:14:33.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd47e59c640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd460066470 0x7fd460068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.583+0000 7fd47e59c640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd460066470 0x7fd460068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd470009c60 tx=0x7fd470009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.587+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4680eb720 con 0x7fd480069b00 2023-10-25T16:14:33.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.739+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd48006a350 con 0x7fd480069b00 2023-10-25T16:14:33.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.739+0000 7fd476ffd640 1 -- 172.21.15.177:0/1279401700 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4680eed40 con 0x7fd480069b00 2023-10-25T16:14:33.747 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:14:33.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd460066470 msgr2=0x7fd460068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd460066470 0x7fd460068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd470009c60 tx=0x7fd470009260 comp rx=0 tx=0).stop 2023-10-25T16:14:33.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 msgr2=0x7fd48013d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 0x7fd48013d7e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd468000c10 tx=0x7fd4680a5880 comp rx=0 tx=0).stop 2023-10-25T16:14:33.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 shutdown_connections 2023-10-25T16:14:33.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd460066470 0x7fd460068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48006d7a0 0x7fd48015e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd480069b00 0x7fd48013d7e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 --2- 172.21.15.177:0/1279401700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd480069720 0x7fd480134950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 >> 172.21.15.177:0/1279401700 conn(0x7fd4800ce000 msgr2=0x7fd480070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:33.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 shutdown_connections 2023-10-25T16:14:33.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.743+0000 7fd484d62640 1 -- 172.21.15.177:0/1279401700 wait complete. 2023-10-25T16:14:33.764 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:14:33.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 -- 172.21.15.177:0/100963514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb440b2120 msgr2=0x7ffb440d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 --2- 172.21.15.177:0/100963514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb440b2120 0x7ffb440d1bd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009840 tx=0x7ffb3801c770 comp rx=0 tx=0).stop 2023-10-25T16:14:33.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 -- 172.21.15.177:0/100963514 shutdown_connections 2023-10-25T16:14:33.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 --2- 172.21.15.177:0/100963514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb440b2120 0x7ffb440d1bd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 --2- 172.21.15.177:0/100963514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb4415eba0 0x7ffb440b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 -- 172.21.15.177:0/100963514 >> 172.21.15.177:0/100963514 conn(0x7ffb4409a5c0 msgr2=0x7ffb440d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:33.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 -- 172.21.15.177:0/100963514 shutdown_connections 2023-10-25T16:14:33.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.867+0000 7ffb4953d640 1 -- 172.21.15.177:0/100963514 wait complete. 2023-10-25T16:14:33.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 Processor -- start 2023-10-25T16:14:33.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- start start 2023-10-25T16:14:33.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb440b2120 0x7ffb440b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb440cdb10 0x7ffb44159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 0x7ffb44150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441513e0 con 0x7ffb4415eba0 2023-10-25T16:14:33.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440b53d0 con 0x7ffb440cdb10 2023-10-25T16:14:33.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440b56b0 con 0x7ffb440b2120 2023-10-25T16:14:33.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 0x7ffb44150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 0x7ffb44150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33844/0 (socket says 172.21.15.177:33844) 2023-10-25T16:14:33.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 -- 172.21.15.177:0/2082757474 learned_addr learned my addr 172.21.15.177:0/2082757474 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:33.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb42ffd640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb440b2120 0x7ffb440b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 -- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb440b2120 msgr2=0x7ffb440b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb440b2120 0x7ffb440b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 -- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb440cdb10 msgr2=0x7ffb44159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:33.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb440cdb10 0x7ffb44159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:33.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 -- 172.21.15.177:0/2082757474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380094a0 con 0x7ffb4415eba0 2023-10-25T16:14:33.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb437fe640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 0x7ffb44150ea0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00c780 tx=0x7ffb3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c003db0 con 0x7ffb4415eba0 2023-10-25T16:14:33.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb3c00ce90 con 0x7ffb4415eba0 2023-10-25T16:14:33.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb440b5990 con 0x7ffb4415eba0 2023-10-25T16:14:33.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0052d0 con 0x7ffb4415eba0 2023-10-25T16:14:33.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb440b5f50 con 0x7ffb4415eba0 2023-10-25T16:14:33.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb440b6140 con 0x7ffb4415eba0 2023-10-25T16:14:33.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb3c005430 con 0x7ffb4415eba0 2023-10-25T16:14:33.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb2b7fe640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb30066470 0x7ffb30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:33.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.871+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb3c083ef0 con 0x7ffb4415eba0 2023-10-25T16:14:33.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.875+0000 7ffb42ffd640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb30066470 0x7ffb30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:33.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.875+0000 7ffb42ffd640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb30066470 0x7ffb30068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400b9a0 tx=0x7ffb34005c30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:33.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:33.875+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb3c051370 con 0x7ffb4415eba0 2023-10-25T16:14:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.035+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb4404daf0 con 0x7ffb4415eba0 2023-10-25T16:14:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.035+0000 7ffb2b7fe640 1 -- 172.21.15.177:0/2082757474 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffb3c054990 con 0x7ffb4415eba0 2023-10-25T16:14:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:14:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb30066470 msgr2=0x7ffb30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb30066470 0x7ffb30068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400b9a0 tx=0x7ffb34005c30 comp rx=0 tx=0).stop 2023-10-25T16:14:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 msgr2=0x7ffb44150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 0x7ffb44150ea0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00c780 tx=0x7ffb3c00cc40 comp rx=0 tx=0).stop 2023-10-25T16:14:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 shutdown_connections 2023-10-25T16:14:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb30066470 0x7ffb30068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb4415eba0 0x7ffb44150ea0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb440cdb10 0x7ffb44159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 --2- 172.21.15.177:0/2082757474 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb440b2120 0x7ffb440b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 >> 172.21.15.177:0/2082757474 conn(0x7ffb4409a5c0 msgr2=0x7ffb44158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:34.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 shutdown_connections 2023-10-25T16:14:34.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.039+0000 7ffb4953d640 1 -- 172.21.15.177:0/2082757474 wait complete. 2023-10-25T16:14:34.058 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:14:34.059 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:14:34.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:14:34.114 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:14:34.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34045]: fuse finished with error 0 and tester_r 0 2023-10-25T16:14:34.116 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:14:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:34.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:14:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:14:34.126 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:14:34.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:34.127 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:14:34.133 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:14:34.134 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:34.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:14:34.140 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:14:34.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:34.141 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:14:34.187 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:14:34.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:14:34.189 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:14:34.189 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:34.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:14:34.195 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:14:34.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:14:34.196 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:14:34.240 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:14:34.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:14:34.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:34.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/452647369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6060004d10 msgr2=0x7f6060005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 --2- 172.21.15.177:0/452647369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6060004d10 0x7f6060005190 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f607808a9b0 tx=0x7f607001d590 comp rx=0 tx=0).stop 2023-10-25T16:14:34.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 -- 172.21.15.177:0/452647369 reap_dead start 2023-10-25T16:14:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/452647369 shutdown_connections 2023-10-25T16:14:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/452647369 >> 172.21.15.177:0/452647369 conn(0x7f607809a5c0 msgr2=0x7f60780d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/452647369 shutdown_connections 2023-10-25T16:14:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/452647369 wait complete. 2023-10-25T16:14:34.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 Processor -- start 2023-10-25T16:14:34.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- start start 2023-10-25T16:14:34.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6060004d10 0x7f60780c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6078157540 0x7f60781579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 0x7f607814caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078146e50 con 0x7f607814c620 2023-10-25T16:14:34.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780c8160 con 0x7f6078157540 2023-10-25T16:14:34.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6078157f00 con 0x7f6060004d10 2023-10-25T16:14:34.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 0x7f607814caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 0x7f607814caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33854/0 (socket says 172.21.15.177:33854) 2023-10-25T16:14:34.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 -- 172.21.15.177:0/678502804 learned_addr learned my addr 172.21.15.177:0/678502804 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:34.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f6076ffd640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6060004d10 0x7f60780c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60767fc640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6078157540 0x7f60781579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 -- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6060004d10 msgr2=0x7f60780c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6060004d10 0x7f60780c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 -- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6078157540 msgr2=0x7f60781579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6078157540 0x7f60781579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 -- 172.21.15.177:0/678502804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607814cfe0 con 0x7f607814c620 2023-10-25T16:14:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60767fc640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6078157540 0x7f60781579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f60777fe640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 0x7f607814caa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6070002240 tx=0x7f60700abec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700b6070 con 0x7f607814c620 2023-10-25T16:14:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6070009200 con 0x7f607814c620 2023-10-25T16:14:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60781589f0 con 0x7f607814c620 2023-10-25T16:14:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700a94d0 con 0x7f607814c620 2023-10-25T16:14:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.363+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6078158430 con 0x7f607814c620 2023-10-25T16:14:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.367+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607804daf0 con 0x7f607814c620 2023-10-25T16:14:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.367+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60700a7040 con 0x7f607814c620 2023-10-25T16:14:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.367+0000 7f605f7fe640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60640664a0 0x7f6064068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.367+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f607011ea50 con 0x7f607814c620 2023-10-25T16:14:34.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.367+0000 7f6076ffd640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60640664a0 0x7f6064068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.367+0000 7f6076ffd640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60640664a0 0x7f6064068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6078156010 tx=0x7f606c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:34.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.371+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60700ebed0 con 0x7f607814c620 2023-10-25T16:14:34.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.543+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6078146e30 con 0x7f607814c620 2023-10-25T16:14:34.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.543+0000 7f605f7fe640 1 -- 172.21.15.177:0/678502804 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f60700c0020 con 0x7f607814c620 2023-10-25T16:14:34.551 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:34.551 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:34.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60640664a0 msgr2=0x7f6064068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60640664a0 0x7f6064068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6078156010 tx=0x7f606c009040 comp rx=0 tx=0).stop 2023-10-25T16:14:34.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 msgr2=0x7f607814caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 0x7f607814caa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6070002240 tx=0x7f60700abec0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 shutdown_connections 2023-10-25T16:14:34.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60640664a0 0x7f6064068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607814c620 0x7f607814caa0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6078157540 0x7f60781579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 --2- 172.21.15.177:0/678502804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6060004d10 0x7f60780c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 >> 172.21.15.177:0/678502804 conn(0x7f607809a5c0 msgr2=0x7f607815a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 shutdown_connections 2023-10-25T16:14:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.547+0000 7f607d5e1640 1 -- 172.21.15.177:0/678502804 wait complete. 2023-10-25T16:14:34.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 -- 172.21.15.177:0/3056235497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc15eba0 msgr2=0x7fb1dc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/3056235497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc15eba0 0x7fb1dc0b4100 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009840 tx=0x7fb1d801c730 comp rx=0 tx=0).stop 2023-10-25T16:14:34.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 -- 172.21.15.177:0/3056235497 shutdown_connections 2023-10-25T16:14:34.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/3056235497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc15eba0 0x7fb1dc0b4100 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 -- 172.21.15.177:0/3056235497 >> 172.21.15.177:0/3056235497 conn(0x7fb1dc09a5c0 msgr2=0x7fb1dc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:34.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 -- 172.21.15.177:0/3056235497 shutdown_connections 2023-10-25T16:14:34.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 -- 172.21.15.177:0/3056235497 wait complete. 2023-10-25T16:14:34.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 Processor -- start 2023-10-25T16:14:34.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.675+0000 7fb1e3a41640 1 -- start start 2023-10-25T16:14:34.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 0x7fb1dc1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1dc0cdb10 0x7fb1dc14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1dc15eba0 0x7fb1dc0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc153070 con 0x7fb1dc0b2120 2023-10-25T16:14:34.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15ac00 con 0x7fb1dc0cdb10 2023-10-25T16:14:34.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc159ff0 con 0x7fb1dc15eba0 2023-10-25T16:14:34.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 0x7fb1dc1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 0x7fb1dc1527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33876/0 (socket says 172.21.15.177:33876) 2023-10-25T16:14:34.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 -- 172.21.15.177:0/1843677609 learned_addr learned my addr 172.21.15.177:0/1843677609 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:34.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 -- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1dc15eba0 msgr2=0x7fb1dc0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1dc15eba0 0x7fb1dc0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 -- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1dc0cdb10 msgr2=0x7fb1dc14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1dc0cdb10 0x7fb1dc14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 -- 172.21.15.177:0/1843677609 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80094a0 con 0x7fb1dc0b2120 2023-10-25T16:14:34.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e17dd640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 0x7fb1dc1527f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000c10 tx=0x7fb1d80a86f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:34.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80b5070 con 0x7fb1dc0b2120 2023-10-25T16:14:34.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb1d80a8a20 con 0x7fb1dc0b2120 2023-10-25T16:14:34.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc15a2d0 con 0x7fb1dc0b2120 2023-10-25T16:14:34.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a8dd0 con 0x7fb1dc0b2120 2023-10-25T16:14:34.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc15a890 con 0x7fb1dc0b2120 2023-10-25T16:14:34.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc04daf0 con 0x7fb1dc0b2120 2023-10-25T16:14:34.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1d80051c0 con 0x7fb1dc0b2120 2023-10-25T16:14:34.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1cdffb640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1c0066470 0x7fb1c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d811e610 con 0x7fb1dc0b2120 2023-10-25T16:14:34.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e0fdc640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1c0066470 0x7fb1c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.679+0000 7fb1e0fdc640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1c0066470 0x7fb1c0068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0007fd0 tx=0x7fb1d00079a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:34.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.683+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1d80ebb20 con 0x7fb1dc0b2120 2023-10-25T16:14:34.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.831+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1dc08b370 con 0x7fb1dc0b2120 2023-10-25T16:14:34.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.831+0000 7fb1cdffb640 1 -- 172.21.15.177:0/1843677609 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fb1d80bf090 con 0x7fb1dc0b2120 2023-10-25T16:14:34.838 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:34.838 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":37,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:28.711678+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:34.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1c0066470 msgr2=0x7fb1c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1c0066470 0x7fb1c0068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0007fd0 tx=0x7fb1d00079a0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 msgr2=0x7fb1dc1527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 0x7fb1dc1527f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000c10 tx=0x7fb1d80a86f0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 shutdown_connections 2023-10-25T16:14:34.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1c0066470 0x7fb1c0068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1dc15eba0 0x7fb1dc0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1dc0cdb10 0x7fb1dc14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 --2- 172.21.15.177:0/1843677609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0b2120 0x7fb1dc1527f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 >> 172.21.15.177:0/1843677609 conn(0x7fb1dc09a5c0 msgr2=0x7fb1dc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:34.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 shutdown_connections 2023-10-25T16:14:34.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.835+0000 7fb1e3a41640 1 -- 172.21.15.177:0/1843677609 wait complete. 2023-10-25T16:14:34.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:14:08.367295+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:14:09.251027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:14:34.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:14:34.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/3880305029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef0415ca70 msgr2=0x7fef040adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/3880305029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef0415ca70 0x7fef040adeb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fef00009900 tx=0x7fef0001c850 comp rx=0 tx=0).stop 2023-10-25T16:14:34.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/3880305029 shutdown_connections 2023-10-25T16:14:34.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/3880305029 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef040cc0a0 0x7fef040ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/3880305029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef0415ca70 0x7fef040adeb0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/3880305029 >> 172.21.15.177:0/3880305029 conn(0x7fef040983a0 msgr2=0x7fef040cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:34.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/3880305029 shutdown_connections 2023-10-25T16:14:34.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/3880305029 wait complete. 2023-10-25T16:14:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 Processor -- start 2023-10-25T16:14:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- start start 2023-10-25T16:14:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef040b0280 0x7fef0414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 0x7fef0414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef0415ca70 0x7fef040c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0414dfb0 con 0x7fef040cc0a0 2023-10-25T16:14:34.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04150450 con 0x7fef040b0280 2023-10-25T16:14:34.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef040c6ae0 con 0x7fef0415ca70 2023-10-25T16:14:34.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 0x7fef0414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 0x7fef0414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33892/0 (socket says 172.21.15.177:33892) 2023-10-25T16:14:34.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 -- 172.21.15.177:0/2354714817 learned_addr learned my addr 172.21.15.177:0/2354714817 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:34.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0a05d640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef040b0280 0x7fef0414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0a85e640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef0415ca70 0x7fef040c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 -- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef0415ca70 msgr2=0x7fef040c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef0415ca70 0x7fef040c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 -- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef040b0280 msgr2=0x7fef0414d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:34.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef040b0280 0x7fef0414d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:34.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 -- 172.21.15.177:0/2354714817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00009560 con 0x7fef040cc0a0 2023-10-25T16:14:34.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0985c640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 0x7fef0414ff10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7feef400c4c0 tx=0x7feef4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:34.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4005480 con 0x7fef040cc0a0 2023-10-25T16:14:34.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feef4003600 con 0x7fef040cc0a0 2023-10-25T16:14:34.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef040c6dc0 con 0x7fef040cc0a0 2023-10-25T16:14:34.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4003a30 con 0x7fef040cc0a0 2023-10-25T16:14:34.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.967+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0414e200 con 0x7fef040cc0a0 2023-10-25T16:14:34.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.971+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0404daf0 con 0x7fef040cc0a0 2023-10-25T16:14:34.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.971+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feef4003b90 con 0x7fef040cc0a0 2023-10-25T16:14:34.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.971+0000 7feefaffd640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feee8066470 0x7feee8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:34.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.971+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feef4083250 con 0x7fef040cc0a0 2023-10-25T16:14:34.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.971+0000 7fef0a05d640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feee8066470 0x7feee8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:34.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.971+0000 7fef0a05d640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feee8066470 0x7feee8068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef000af000 tx=0x7fef0001b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:34.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:34.975+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feef40506e0 con 0x7fef040cc0a0 2023-10-25T16:14:35.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef04098880 con 0x7fef040cc0a0 2023-10-25T16:14:35.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7feefaffd640 1 -- 172.21.15.177:0/2354714817 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7feef4053d00 con 0x7fef040cc0a0 2023-10-25T16:14:35.132 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:14:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feee8066470 msgr2=0x7feee8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feee8066470 0x7feee8068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef000af000 tx=0x7fef0001b090 comp rx=0 tx=0).stop 2023-10-25T16:14:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 msgr2=0x7fef0414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 0x7fef0414ff10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7feef400c4c0 tx=0x7feef4001e80 comp rx=0 tx=0).stop 2023-10-25T16:14:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 shutdown_connections 2023-10-25T16:14:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feee8066470 0x7feee8068930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef0415ca70 0x7fef040c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef040cc0a0 0x7fef0414ff10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 --2- 172.21.15.177:0/2354714817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef040b0280 0x7fef0414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 >> 172.21.15.177:0/2354714817 conn(0x7fef040983a0 msgr2=0x7fef040ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 shutdown_connections 2023-10-25T16:14:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.127+0000 7fef0c2c1640 1 -- 172.21.15.177:0/2354714817 wait complete. 2023-10-25T16:14:35.150 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:14:35.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b159a640 1 -- 172.21.15.177:0/1994794539 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40aacb0 con 0x7fc8b4140cf0 2023-10-25T16:14:35.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1994794539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b4140cf0 msgr2=0x7fc8b40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1994794539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b4140cf0 0x7fc8b40af5d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4141ee0 tx=0x7fc8a401c530 comp rx=0 tx=0).stop 2023-10-25T16:14:35.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1994794539 shutdown_connections 2023-10-25T16:14:35.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1994794539 >> v2:172.21.15.184:3300/0 conn(0x7fc8b406bf90 0x7fc8b40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1994794539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b406f570 0x7fc8b406ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1994794539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b4140cf0 0x7fc8b40af5d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1994794539 >> 172.21.15.177:0/1994794539 conn(0x7fc8b40b2450 msgr2=0x7fc8b40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:35.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1994794539 shutdown_connections 2023-10-25T16:14:35.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1994794539 wait complete. 2023-10-25T16:14:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 Processor -- start 2023-10-25T16:14:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- start start 2023-10-25T16:14:35.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b406bf90 0x7fc8b4138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 0x7fc8b4156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b4140cf0 0x7fc8b41524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b4155d80 con 0x7fc8b406f570 2023-10-25T16:14:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b4156060 con 0x7fc8b406bf90 2023-10-25T16:14:35.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b8fb6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b4156340 con 0x7fc8b4140cf0 2023-10-25T16:14:35.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 0x7fc8b4156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 0x7fc8b4156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33912/0 (socket says 172.21.15.177:33912) 2023-10-25T16:14:35.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 -- 172.21.15.177:0/1465393835 learned_addr learned my addr 172.21.15.177:0/1465393835 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:35.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b259c640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b406bf90 0x7fc8b4138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b2d9d640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b4140cf0 0x7fc8b41524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 -- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b4140cf0 msgr2=0x7fc8b41524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b4140cf0 0x7fc8b41524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 -- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b406bf90 msgr2=0x7fc8b4138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b406bf90 0x7fc8b4138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.275+0000 7fc8b1d9b640 1 -- 172.21.15.177:0/1465393835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4009560 con 0x7fc8b406f570 2023-10-25T16:14:35.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8b1d9b640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 0x7fc8b4156e20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800d750 tx=0x7fc8a800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:35.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8009c30 con 0x7fc8b406f570 2023-10-25T16:14:35.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b4156620 con 0x7fc8b406f570 2023-10-25T16:14:35.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc8a800de60 con 0x7fc8b406f570 2023-10-25T16:14:35.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8009ea0 con 0x7fc8b406f570 2023-10-25T16:14:35.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b4155a70 con 0x7fc8b406f570 2023-10-25T16:14:35.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b404daf0 con 0x7fc8b406f570 2023-10-25T16:14:35.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc8a8004260 con 0x7fc8b406f570 2023-10-25T16:14:35.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8a2ffd640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc894066470 0x7fc894068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8a8084050 con 0x7fc8b406f570 2023-10-25T16:14:35.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8b259c640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc894066470 0x7fc894068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.279+0000 7fc8b259c640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc894066470 0x7fc894068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40ae000 tx=0x7fc8a401ad70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:35.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.283+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc8a8051500 con 0x7fc8b406f570 2023-10-25T16:14:35.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.427+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8b40ca670 con 0x7fc8b406f570 2023-10-25T16:14:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8a2ffd640 1 -- 172.21.15.177:0/1465393835 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8a8054b20 con 0x7fc8b406f570 2023-10-25T16:14:35.435 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:14:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc894066470 msgr2=0x7fc894068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc894066470 0x7fc894068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40ae000 tx=0x7fc8a401ad70 comp rx=0 tx=0).stop 2023-10-25T16:14:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 msgr2=0x7fc8b4156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 0x7fc8b4156e20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800d750 tx=0x7fc8a800dc10 comp rx=0 tx=0).stop 2023-10-25T16:14:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 shutdown_connections 2023-10-25T16:14:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc894066470 0x7fc894068930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8b4140cf0 0x7fc8b41524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8b406f570 0x7fc8b4156e20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 --2- 172.21.15.177:0/1465393835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8b406bf90 0x7fc8b4138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 >> 172.21.15.177:0/1465393835 conn(0x7fc8b40b2450 msgr2=0x7fc8b4070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 shutdown_connections 2023-10-25T16:14:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.431+0000 7fc8b8fb6640 1 -- 172.21.15.177:0/1465393835 wait complete. 2023-10-25T16:14:35.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:14:35.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 -- 172.21.15.177:0/3074916689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec06c0f0 msgr2=0x7fb8ec0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 --2- 172.21.15.177:0/3074916689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec06c0f0 0x7fb8ec0706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009bc0 tx=0x7fb8e401cb50 comp rx=0 tx=0).stop 2023-10-25T16:14:35.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 -- 172.21.15.177:0/3074916689 shutdown_connections 2023-10-25T16:14:35.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 --2- 172.21.15.177:0/3074916689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec06c0f0 0x7fb8ec0706f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 --2- 172.21.15.177:0/3074916689 >> v2:172.21.15.184:3300/0 conn(0x7fb8ec1500f0 0x7fb8ec0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 -- 172.21.15.177:0/3074916689 >> 172.21.15.177:0/3074916689 conn(0x7fb8ec0b2450 msgr2=0x7fb8ec0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:35.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 -- 172.21.15.177:0/3074916689 shutdown_connections 2023-10-25T16:14:35.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.575+0000 7fb8f1011640 1 -- 172.21.15.177:0/3074916689 wait complete. 2023-10-25T16:14:35.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 Processor -- start 2023-10-25T16:14:35.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 -- start start 2023-10-25T16:14:35.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec06c0f0 0x7fb8ec14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec0c9e50 0x7fb8ec140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 0x7fb8ec146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec1536a0 con 0x7fb8ec1500f0 2023-10-25T16:14:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec14d480 con 0x7fb8ec06c0f0 2023-10-25T16:14:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec152bc0 con 0x7fb8ec0c9e50 2023-10-25T16:14:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 0x7fb8ec146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 0x7fb8ec146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33924/0 (socket says 172.21.15.177:33924) 2023-10-25T16:14:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 -- 172.21.15.177:0/2010592894 learned_addr learned my addr 172.21.15.177:0/2010592894 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8ea59c640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec0c9e50 0x7fb8ec140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8ead9d640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec06c0f0 0x7fb8ec14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 -- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec0c9e50 msgr2=0x7fb8ec140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec0c9e50 0x7fb8ec140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 -- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec06c0f0 msgr2=0x7fb8ec14cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec06c0f0 0x7fb8ec14cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 -- 172.21.15.177:0/2010592894 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009820 con 0x7fb8ec1500f0 2023-10-25T16:14:35.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8eb59e640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 0x7fb8ec146630 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b10 tx=0x7fb8e40a5a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:35.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4003b80 con 0x7fb8ec1500f0 2023-10-25T16:14:35.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb8e40a5c10 con 0x7fb8ec1500f0 2023-10-25T16:14:35.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec152ea0 con 0x7fb8ec1500f0 2023-10-25T16:14:35.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4004030 con 0x7fb8ec1500f0 2023-10-25T16:14:35.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.579+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec14d100 con 0x7fb8ec1500f0 2023-10-25T16:14:35.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.583+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec15b980 con 0x7fb8ec1500f0 2023-10-25T16:14:35.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.583+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8e40b4040 con 0x7fb8ec1500f0 2023-10-25T16:14:35.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.583+0000 7fb8d37fe640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d80664a0 0x7fb8d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.583+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8e411ea60 con 0x7fb8ec1500f0 2023-10-25T16:14:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.583+0000 7fb8ead9d640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d80664a0 0x7fb8d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.583+0000 7fb8ead9d640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d80664a0 0x7fb8d8068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009b70 tx=0x7fb8dc0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.587+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8e40ec000 con 0x7fb8ec1500f0 2023-10-25T16:14:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.727+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8ec04daf0 con 0x7fb8ec1500f0 2023-10-25T16:14:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8d37fe640 1 -- 172.21.15.177:0/2010592894 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8e40b2020 con 0x7fb8ec1500f0 2023-10-25T16:14:35.735 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:14:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d80664a0 msgr2=0x7fb8d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d80664a0 0x7fb8d8068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009b70 tx=0x7fb8dc0091e0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 msgr2=0x7fb8ec146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 0x7fb8ec146630 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b10 tx=0x7fb8e40a5a20 comp rx=0 tx=0).stop 2023-10-25T16:14:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 shutdown_connections 2023-10-25T16:14:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d80664a0 0x7fb8d8068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8ec1500f0 0x7fb8ec146630 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8ec0c9e50 0x7fb8ec140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 --2- 172.21.15.177:0/2010592894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8ec06c0f0 0x7fb8ec14cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 >> 172.21.15.177:0/2010592894 conn(0x7fb8ec0b2450 msgr2=0x7fb8ec15c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 shutdown_connections 2023-10-25T16:14:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.731+0000 7fb8f1011640 1 -- 172.21.15.177:0/2010592894 wait complete. 2023-10-25T16:14:35.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:35.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- 172.21.15.177:0/1863151233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990159230 msgr2=0x7f2990071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 --2- 172.21.15.177:0/1863151233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990159230 0x7f2990071500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f299006c6a0 tx=0x7f298c01c830 comp rx=0 tx=0).stop 2023-10-25T16:14:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- 172.21.15.177:0/1863151233 shutdown_connections 2023-10-25T16:14:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 --2- 172.21.15.177:0/1863151233 >> v2:172.21.15.184:3300/0 conn(0x7f2990070510 0x7f29900cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 --2- 172.21.15.177:0/1863151233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990159230 0x7f2990071500 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- 172.21.15.177:0/1863151233 >> 172.21.15.177:0/1863151233 conn(0x7f29900b2450 msgr2=0x7f29900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- 172.21.15.177:0/1863151233 shutdown_connections 2023-10-25T16:14:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- 172.21.15.177:0/1863151233 wait complete. 2023-10-25T16:14:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 Processor -- start 2023-10-25T16:14:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- start start 2023-10-25T16:14:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 0x7f2990147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900cc610 0x7f299014eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2990159230 0x7f299014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29900ac0e0 con 0x7f2990070510 2023-10-25T16:14:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990147d50 con 0x7f2990159230 2023-10-25T16:14:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2997cdf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29900c96b0 con 0x7f29900cc610 2023-10-25T16:14:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 0x7f2990147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 0x7f2990147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33952/0 (socket says 172.21.15.177:33952) 2023-10-25T16:14:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 -- 172.21.15.177:0/914929410 learned_addr learned my addr 172.21.15.177:0/914929410 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f299627c640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2990159230 0x7f299014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f299527a640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900cc610 0x7f299014eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 -- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900cc610 msgr2=0x7f299014eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900cc610 0x7f299014eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 -- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2990159230 msgr2=0x7f299014f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2990159230 0x7f299014f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 -- 172.21.15.177:0/914929410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c009560 con 0x7f2990070510 2023-10-25T16:14:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f299527a640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900cc610 0x7f299014eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:35.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.871+0000 7f2995a7b640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 0x7f2990147810 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f298c0b0040 tx=0x7f298c005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:35.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0a58f0 con 0x7f2990070510 2023-10-25T16:14:35.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f298c0038f0 con 0x7f2990070510 2023-10-25T16:14:35.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c003d00 con 0x7f2990070510 2023-10-25T16:14:35.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29900ab460 con 0x7f2990070510 2023-10-25T16:14:35.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29900aba20 con 0x7f2990070510 2023-10-25T16:14:35.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29900ac350 con 0x7f2990070510 2023-10-25T16:14:35.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f298c0b4070 con 0x7f2990070510 2023-10-25T16:14:35.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f29867fc640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2974066470 0x7f2974068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:35.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f298c11e310 con 0x7f2990070510 2023-10-25T16:14:35.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f299527a640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2974066470 0x7f2974068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:35.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.875+0000 7f299527a640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2974066470 0x7f2974068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29900afbb0 tx=0x7f2980005d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:35.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:35.879+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f298c0eb820 con 0x7f2990070510 2023-10-25T16:14:36.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f299004daf0 con 0x7f2990070510 2023-10-25T16:14:36.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f29867fc640 1 -- 172.21.15.177:0/914929410 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f298c003e60 con 0x7f2990070510 2023-10-25T16:14:36.073 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:36.073 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:36.075 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:36.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2974066470 msgr2=0x7f2974068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2974066470 0x7f2974068930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f29900afbb0 tx=0x7f2980005d90 comp rx=0 tx=0).stop 2023-10-25T16:14:36.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 msgr2=0x7f2990147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 0x7f2990147810 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f298c0b0040 tx=0x7f298c005790 comp rx=0 tx=0).stop 2023-10-25T16:14:36.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 shutdown_connections 2023-10-25T16:14:36.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2974066470 0x7f2974068930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2990159230 0x7f299014f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29900cc610 0x7f299014eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 --2- 172.21.15.177:0/914929410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2990070510 0x7f2990147810 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 >> 172.21.15.177:0/914929410 conn(0x7f29900b2450 msgr2=0x7f2990157610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:36.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 shutdown_connections 2023-10-25T16:14:36.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.067+0000 7f2997cdf640 1 -- 172.21.15.177:0/914929410 wait complete. 2023-10-25T16:14:36.091 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/666854074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db806bf20 msgr2=0x7f8db80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/666854074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db806bf20 0x7f8db80aebc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8db80afcc0 tx=0x7f8db001ca70 comp rx=0 tx=0).stop 2023-10-25T16:14:36.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/666854074 shutdown_connections 2023-10-25T16:14:36.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/666854074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db806bf20 0x7f8db80aebc0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/666854074 >> v2:172.21.15.184:3300/0 conn(0x7f8db80c9e50 0x7f8db806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/666854074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db81500f0 0x7f8db80c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/666854074 >> 172.21.15.177:0/666854074 conn(0x7f8db80b2450 msgr2=0x7f8db80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:36.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/666854074 shutdown_connections 2023-10-25T16:14:36.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/666854074 wait complete. 2023-10-25T16:14:36.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 Processor -- start 2023-10-25T16:14:36.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- start start 2023-10-25T16:14:36.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db806bf20 0x7f8db814aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 0x7f8db8156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8db81500f0 0x7f8db8149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81f6b50 con 0x7f8db80c9e50 2023-10-25T16:14:36.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db8149cb0 con 0x7f8db81500f0 2023-10-25T16:14:36.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db8149f90 con 0x7f8db806bf20 2023-10-25T16:14:36.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 0x7f8db8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 0x7f8db8156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33964/0 (socket says 172.21.15.177:33964) 2023-10-25T16:14:36.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 -- 172.21.15.177:0/4097846760 learned_addr learned my addr 172.21.15.177:0/4097846760 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:36.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db77fe640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8db81500f0 0x7f8db8149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db6ffd640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db806bf20 0x7f8db814aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 -- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db806bf20 msgr2=0x7f8db814aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db806bf20 0x7f8db814aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 -- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8db81500f0 msgr2=0x7f8db8149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8db81500f0 0x7f8db8149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 -- 172.21.15.177:0/4097846760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00098e0 con 0x7f8db80c9e50 2023-10-25T16:14:36.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db6ffd640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db806bf20 0x7f8db814aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:36.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8db67fc640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 0x7f8db8156290 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00d750 tx=0x7f8dac00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:36.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac009c30 con 0x7f8db80c9e50 2023-10-25T16:14:36.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8dac009e80 con 0x7f8db80c9e50 2023-10-25T16:14:36.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db814a270 con 0x7f8db80c9e50 2023-10-25T16:14:36.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0106c0 con 0x7f8db80c9e50 2023-10-25T16:14:36.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.207+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db81567d0 con 0x7f8db80c9e50 2023-10-25T16:14:36.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.211+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db804daf0 con 0x7f8db80c9e50 2023-10-25T16:14:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.211+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8dac010820 con 0x7f8db80c9e50 2023-10-25T16:14:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.211+0000 7f8d9f7fe640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.211+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dac016030 con 0x7f8db80c9e50 2023-10-25T16:14:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.211+0000 7f8db6ffd640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.211+0000 7f8db6ffd640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009ad0 tx=0x7f8da80094d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.215+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8dac051930 con 0x7f8db80c9e50 2023-10-25T16:14:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.363+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8db80cd970 con 0x7f8db80c9e50 2023-10-25T16:14:36.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8d9f7fe640 1 -- 172.21.15.177:0/4097846760 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f8dac00de60 con 0x7f8db80c9e50 2023-10-25T16:14:36.372 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:36.373 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":37,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:28.711678+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:36.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 msgr2=0x7f8da4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009ad0 tx=0x7f8da80094d0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 msgr2=0x7f8db8156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 0x7f8db8156290 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00d750 tx=0x7f8dac00dc10 comp rx=0 tx=0).stop 2023-10-25T16:14:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 shutdown_connections 2023-10-25T16:14:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8db81500f0 0x7f8db8149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8db80c9e50 0x7f8db8156290 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 --2- 172.21.15.177:0/4097846760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8db806bf20 0x7f8db814aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 >> 172.21.15.177:0/4097846760 conn(0x7f8db80b2450 msgr2=0x7f8db815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 shutdown_connections 2023-10-25T16:14:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.367+0000 7f8dbd3b5640 1 -- 172.21.15.177:0/4097846760 wait complete. 2023-10-25T16:14:36.390 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:14:36.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:36.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/773697063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0cbfa0 msgr2=0x7f8fdc0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/773697063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0cbfa0 0x7f8fdc0aebc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8fc400aa00 tx=0x7f8fc401dbf0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/773697063 shutdown_connections 2023-10-25T16:14:36.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/773697063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fdc0af100 0x7f8fdc158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/773697063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0cbfa0 0x7f8fdc0aebc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/773697063 >> 172.21.15.177:0/773697063 conn(0x7f8fdc0b2450 msgr2=0x7f8fdc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:36.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/773697063 shutdown_connections 2023-10-25T16:14:36.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/773697063 wait complete. 2023-10-25T16:14:36.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 Processor -- start 2023-10-25T16:14:36.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- start start 2023-10-25T16:14:36.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 0x7f8fdc1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fdc0cbfa0 0x7f8fdc14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fdc14e810 0x7f8fdc14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14fa50 con 0x7f8fdc0af100 2023-10-25T16:14:36.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14b590 con 0x7f8fdc14e810 2023-10-25T16:14:36.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14ee60 con 0x7f8fdc0cbfa0 2023-10-25T16:14:36.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 0x7f8fdc1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 0x7f8fdc1548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33992/0 (socket says 172.21.15.177:33992) 2023-10-25T16:14:36.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 -- 172.21.15.177:0/2652971437 learned_addr learned my addr 172.21.15.177:0/2652971437 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:36.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fdbfff640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fdc0cbfa0 0x7f8fdc14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe1377640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fdc14e810 0x7f8fdc14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 -- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fdc0cbfa0 msgr2=0x7f8fdc14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fdc0cbfa0 0x7f8fdc14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 -- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fdc14e810 msgr2=0x7f8fdc14b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fdc14e810 0x7f8fdc14b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 -- 172.21.15.177:0/2652971437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc400a610 con 0x7f8fdc0af100 2023-10-25T16:14:36.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe1377640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fdc14e810 0x7f8fdc14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:36.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe0b76640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 0x7f8fdc1548e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c7d0 tx=0x7f8fcc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:36.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc003b80 con 0x7f8fdc0af100 2023-10-25T16:14:36.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8fcc003ce0 con 0x7f8fdc0af100 2023-10-25T16:14:36.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc14f0b0 con 0x7f8fdc0af100 2023-10-25T16:14:36.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00aab0 con 0x7f8fdc0af100 2023-10-25T16:14:36.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.503+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc14f670 con 0x7f8fdc0af100 2023-10-25T16:14:36.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.507+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc04daf0 con 0x7f8fdc0af100 2023-10-25T16:14:36.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.507+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8fcc00ac10 con 0x7f8fdc0af100 2023-10-25T16:14:36.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.507+0000 7f8fd97fa640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fbc066470 0x7f8fbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.507+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fcc083b50 con 0x7f8fdc0af100 2023-10-25T16:14:36.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.507+0000 7f8fdbfff640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fbc066470 0x7f8fbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.507+0000 7f8fdbfff640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fbc066470 0x7f8fbc068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40b0000 tx=0x7f8fc401c430 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:36.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.511+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8fcc051060 con 0x7f8fdc0af100 2023-10-25T16:14:36.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.691+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fdc0af550 con 0x7f8fdc0af100 2023-10-25T16:14:36.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.691+0000 7f8fd97fa640 1 -- 172.21.15.177:0/2652971437 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f8fdc0af550 con 0x7f8fdc0af100 2023-10-25T16:14:36.697 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:36.697 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:36.697 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:36.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fbc066470 msgr2=0x7f8fbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fbc066470 0x7f8fbc068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40b0000 tx=0x7f8fc401c430 comp rx=0 tx=0).stop 2023-10-25T16:14:36.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 msgr2=0x7f8fdc1548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 0x7f8fdc1548e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c7d0 tx=0x7f8fcc00cc90 comp rx=0 tx=0).stop 2023-10-25T16:14:36.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 shutdown_connections 2023-10-25T16:14:36.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8fbc066470 0x7f8fbc068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fdc14e810 0x7f8fdc14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fdc0cbfa0 0x7f8fdc14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 --2- 172.21.15.177:0/2652971437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fdc0af100 0x7f8fdc1548e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 >> 172.21.15.177:0/2652971437 conn(0x7f8fdc0b2450 msgr2=0x7f8fdc0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:36.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 shutdown_connections 2023-10-25T16:14:36.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.695+0000 7f8fe2dda640 1 -- 172.21.15.177:0/2652971437 wait complete. 2023-10-25T16:14:36.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:36.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/107791870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 msgr2=0x7f674000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 --2- 172.21.15.177:0/107791870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f674000b990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f674c006fd0 tx=0x7f674c01ca00 comp rx=0 tx=0).stop 2023-10-25T16:14:36.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/107791870 shutdown_connections 2023-10-25T16:14:36.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 --2- 172.21.15.177:0/107791870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f674000b990 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/107791870 >> 172.21.15.177:0/107791870 conn(0x7f67540b2450 msgr2=0x7f67540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:36.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/107791870 shutdown_connections 2023-10-25T16:14:36.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/107791870 wait complete. 2023-10-25T16:14:36.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 Processor -- start 2023-10-25T16:14:36.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- start start 2023-10-25T16:14:36.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f67541446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67541506e0 0x7f67540aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6754152c10 0x7f6754153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6754144c20 con 0x7f6740005190 2023-10-25T16:14:36.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67541535d0 con 0x7f67541506e0 2023-10-25T16:14:36.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540af520 con 0x7f6754152c10 2023-10-25T16:14:36.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f67541446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f67541446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34014/0 (socket says 172.21.15.177:34014) 2023-10-25T16:14:36.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 -- 172.21.15.177:0/2325468437 learned_addr learned my addr 172.21.15.177:0/2325468437 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:36.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675aac6640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6754152c10 0x7f6754153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 -- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6754152c10 msgr2=0x7f6754153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6754152c10 0x7f6754153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 -- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67541506e0 msgr2=0x7f67540aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:36.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67541506e0 0x7f67540aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:36.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 -- 172.21.15.177:0/2325468437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754150e50 con 0x7f6740005190 2023-10-25T16:14:36.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675a2c5640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f67541446e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f675000e6d0 tx=0x7f675000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:36.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750004250 con 0x7f6740005190 2023-10-25T16:14:36.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f67500044a0 con 0x7f6740005190 2023-10-25T16:14:36.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6754151130 con 0x7f6740005190 2023-10-25T16:14:36.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000ca40 con 0x7f6740005190 2023-10-25T16:14:36.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.831+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67541516f0 con 0x7f6740005190 2023-10-25T16:14:36.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.835+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675404daf0 con 0x7f6740005190 2023-10-25T16:14:36.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.835+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f675000cba0 con 0x7f6740005190 2023-10-25T16:14:36.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.835+0000 7f674affd640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6738066470 0x7f6738068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:36.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.835+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6750084d40 con 0x7f6740005190 2023-10-25T16:14:36.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.835+0000 7f6759ac4640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6738066470 0x7f6738068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:36.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.835+0000 7f6759ac4640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6738066470 0x7f6738068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6744005c70 tx=0x7f6744005c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:36.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:36.839+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6750055d30 con 0x7f6740005190 2023-10-25T16:14:37.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.011+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67540cd970 con 0x7f6740005190 2023-10-25T16:14:37.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.011+0000 7f674affd640 1 -- 172.21.15.177:0/2325468437 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4928 (secure 0 0 0) 0x7f6750015090 con 0x7f6740005190 2023-10-25T16:14:37.018 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:37.019 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:10.242627+0000","modified":"2023-10-25T16:14:12.301221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":154595},"failed":[],"damaged":[],"stopped":[],"info":{"gid_154595":{"gid":154595,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/2532234730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2532234730},{"type":"v1","addr":"172.21.15.184:6837","nonce":2532234730}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-25T16:14:37.019 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 12 2023-10-25T16:14:37.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6738066470 msgr2=0x7f6738068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6738066470 0x7f6738068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6744005c70 tx=0x7f6744005c00 comp rx=0 tx=0).stop 2023-10-25T16:14:37.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 msgr2=0x7f67541446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f67541446e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f675000e6d0 tx=0x7f675000eb90 comp rx=0 tx=0).stop 2023-10-25T16:14:37.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 shutdown_connections 2023-10-25T16:14:37.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6738066470 0x7f6738068930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6754152c10 0x7f6754153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67541506e0 0x7f67540aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 --2- 172.21.15.177:0/2325468437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740005190 0x7f67541446e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 >> 172.21.15.177:0/2325468437 conn(0x7f67540b2450 msgr2=0x7f67540b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:37.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 shutdown_connections 2023-10-25T16:14:37.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.015+0000 7f675c529640 1 -- 172.21.15.177:0/2325468437 wait complete. 2023-10-25T16:14:37.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:37.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 -- 172.21.15.177:0/2052709686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704071500 msgr2=0x7fe704070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 --2- 172.21.15.177:0/2052709686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704071500 0x7fe704070510 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe7040ca900 tx=0x7fe6ec01c850 comp rx=0 tx=0).stop 2023-10-25T16:14:37.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 -- 172.21.15.177:0/2052709686 shutdown_connections 2023-10-25T16:14:37.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 --2- 172.21.15.177:0/2052709686 >> v2:172.21.15.184:3300/0 conn(0x7fe70406b980 0x7fe70406be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 --2- 172.21.15.177:0/2052709686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704071500 0x7fe704070510 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 -- 172.21.15.177:0/2052709686 >> 172.21.15.177:0/2052709686 conn(0x7fe7040b2450 msgr2=0x7fe7040b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:37.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 -- 172.21.15.177:0/2052709686 shutdown_connections 2023-10-25T16:14:37.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.139+0000 7fe708e2c640 1 -- 172.21.15.177:0/2052709686 wait complete. 2023-10-25T16:14:37.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 Processor -- start 2023-10-25T16:14:37.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- start start 2023-10-25T16:14:37.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe70406b980 0x7fe7041472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe704071500 0x7fe70414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 0x7fe70414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040aba40 con 0x7fe704159230 2023-10-25T16:14:37.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040aa9e0 con 0x7fe70406b980 2023-10-25T16:14:37.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040aac80 con 0x7fe704071500 2023-10-25T16:14:37.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 0x7fe70414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 0x7fe70414ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34040/0 (socket says 172.21.15.177:34040) 2023-10-25T16:14:37.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 -- 172.21.15.177:0/229442018 learned_addr learned my addr 172.21.15.177:0/229442018 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:37.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 -- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe704071500 msgr2=0x7fe70414c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe704071500 0x7fe70414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 -- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe70406b980 msgr2=0x7fe7041472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe70406b980 0x7fe7041472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 -- 172.21.15.177:0/229442018 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec009500 con 0x7fe704159230 2023-10-25T16:14:37.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe702d9d640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 0x7fe70414ccd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00ccb0 tx=0x7fe6fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:37.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc004b30 con 0x7fe704159230 2023-10-25T16:14:37.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe6fc004da0 con 0x7fe704159230 2023-10-25T16:14:37.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040aaf60 con 0x7fe704159230 2023-10-25T16:14:37.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc005280 con 0x7fe704159230 2023-10-25T16:14:37.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7040ab520 con 0x7fe704159230 2023-10-25T16:14:37.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040ab740 con 0x7fe704159230 2023-10-25T16:14:37.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6fc0053e0 con 0x7fe704159230 2023-10-25T16:14:37.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe6fb7fe640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe6e40664a0 0x7fe6e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6fc0846f0 con 0x7fe704159230 2023-10-25T16:14:37.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.143+0000 7fe70259c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe6e40664a0 0x7fe6e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.147+0000 7fe70259c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe6e40664a0 0x7fe6e4068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4007fd0 tx=0x7fe6f4007900 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:37.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.147+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6fc051b70 con 0x7fe704159230 2023-10-25T16:14:37.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.291+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe70404daf0 con 0x7fe704159230 2023-10-25T16:14:37.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe6fb7fe640 1 -- 172.21.15.177:0/229442018 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fe6fc01d020 con 0x7fe704159230 2023-10-25T16:14:37.300 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:37.300 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":37,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:28.711678+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:08.367295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:09.251027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:37.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe6e40664a0 msgr2=0x7fe6e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe6e40664a0 0x7fe6e4068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4007fd0 tx=0x7fe6f4007900 comp rx=0 tx=0).stop 2023-10-25T16:14:37.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 msgr2=0x7fe70414ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 0x7fe70414ccd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00ccb0 tx=0x7fe6fc00a620 comp rx=0 tx=0).stop 2023-10-25T16:14:37.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 shutdown_connections 2023-10-25T16:14:37.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe6e40664a0 0x7fe6e4068960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe704159230 0x7fe70414ccd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe704071500 0x7fe70414c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 --2- 172.21.15.177:0/229442018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe70406b980 0x7fe7041472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 >> 172.21.15.177:0/229442018 conn(0x7fe7040b2450 msgr2=0x7fe7040cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:37.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 shutdown_connections 2023-10-25T16:14:37.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.295+0000 7fe708e2c640 1 -- 172.21.15.177:0/229442018 wait complete. 2023-10-25T16:14:37.317 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:14:37.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e79f11640 1 -- 172.21.15.177:0/3571633198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e5c003fb0 msgr2=0x7f2e5c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e79f11640 1 --2- 172.21.15.177:0/3571633198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e5c003fb0 0x7f2e5c0047d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c290 tx=0x7f2e6801f760 comp rx=0 tx=0).stop 2023-10-25T16:14:37.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e73fff640 1 -- 172.21.15.177:0/3571633198 reap_dead start 2023-10-25T16:14:37.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e79f11640 1 -- 172.21.15.177:0/3571633198 shutdown_connections 2023-10-25T16:14:37.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e79f11640 1 -- 172.21.15.177:0/3571633198 >> 172.21.15.177:0/3571633198 conn(0x7f2e740afc40 msgr2=0x7f2e740b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:37.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e79f11640 1 -- 172.21.15.177:0/3571633198 shutdown_connections 2023-10-25T16:14:37.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.435+0000 7f2e79f11640 1 -- 172.21.15.177:0/3571633198 wait complete. 2023-10-25T16:14:37.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 Processor -- start 2023-10-25T16:14:37.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- start start 2023-10-25T16:14:37.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5c003fb0 0x7f2e7413e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7414c4e0 0x7f2e7413c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 0x7f2e7414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7414c1e0 con 0x7f2e7414b7f0 2023-10-25T16:14:37.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74141c20 con 0x7f2e5c003fb0 2023-10-25T16:14:37.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74141010 con 0x7f2e7414c4e0 2023-10-25T16:14:37.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 0x7f2e7414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 0x7f2e7414bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34054/0 (socket says 172.21.15.177:34054) 2023-10-25T16:14:37.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 -- 172.21.15.177:0/151292252 learned_addr learned my addr 172.21.15.177:0/151292252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:37.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e737fe640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5c003fb0 0x7f2e7413e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e72ffd640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7414c4e0 0x7f2e7413c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 -- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7414c4e0 msgr2=0x7f2e7413c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7414c4e0 0x7f2e7413c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 -- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5c003fb0 msgr2=0x7f2e7413e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5c003fb0 0x7f2e7413e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 -- 172.21.15.177:0/151292252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e741412f0 con 0x7f2e7414b7f0 2023-10-25T16:14:37.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e737fe640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5c003fb0 0x7f2e7413e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:37.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e73fff640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 0x7f2e7414bca0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2e64004660 tx=0x7f2e6400fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:37.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64011910 con 0x7f2e7414b7f0 2023-10-25T16:14:37.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e64011b80 con 0x7f2e7414b7f0 2023-10-25T16:14:37.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6401b410 con 0x7f2e7414b7f0 2023-10-25T16:14:37.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e741415d0 con 0x7f2e7414b7f0 2023-10-25T16:14:37.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7413ee20 con 0x7f2e7414b7f0 2023-10-25T16:14:37.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e74066b20 con 0x7f2e7414b7f0 2023-10-25T16:14:37.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e640103d0 con 0x7f2e7414b7f0 2023-10-25T16:14:37.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e5bfff640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e600664a0 0x7f2e60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.439+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e64084030 con 0x7f2e7414b7f0 2023-10-25T16:14:37.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.443+0000 7f2e737fe640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e600664a0 0x7f2e60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.443+0000 7f2e737fe640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e600664a0 0x7f2e60068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009e70 tx=0x7f2e6c009510 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:37.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.443+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e64051540 con 0x7f2e7414b7f0 2023-10-25T16:14:37.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.619+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2e74136e60 con 0x7f2e7414b7f0 2023-10-25T16:14:37.623 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:14:37.619+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:14:37.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e5bfff640 1 -- 172.21.15.177:0/151292252 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2e74136e60 con 0x7f2e7414b7f0 2023-10-25T16:14:37.627 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:14:37.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e600664a0 msgr2=0x7f2e60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e600664a0 0x7f2e60068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009e70 tx=0x7f2e6c009510 comp rx=0 tx=0).stop 2023-10-25T16:14:37.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 msgr2=0x7f2e7414bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 0x7f2e7414bca0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2e64004660 tx=0x7f2e6400fa90 comp rx=0 tx=0).stop 2023-10-25T16:14:37.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 shutdown_connections 2023-10-25T16:14:37.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e600664a0 0x7f2e60068960 secure :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009e70 tx=0x7f2e6c009510 comp rx=0 tx=0).stop 2023-10-25T16:14:37.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7414b7f0 0x7f2e7414bca0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e7414c4e0 0x7f2e7413c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 --2- 172.21.15.177:0/151292252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5c003fb0 0x7f2e7413e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 >> 172.21.15.177:0/151292252 conn(0x7f2e740afc40 msgr2=0x7f2e74158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:37.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 shutdown_connections 2023-10-25T16:14:37.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.623+0000 7f2e79f11640 1 -- 172.21.15.177:0/151292252 wait complete. 2023-10-25T16:14:37.642 INFO:tasks.ceph.mds.d.smithi184.stderr: -3359> 2023-10-25T16:14:13.858+0000 7f4d3dcd4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:14:37.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:14:37.707 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:14:37.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/3095290135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce08005190 msgr2=0x7fce0800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 --2- 172.21.15.177:0/3095290135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce08005190 0x7fce0800b990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fce18009ee0 tx=0x7fce1801d610 comp rx=0 tx=0).stop 2023-10-25T16:14:37.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/3095290135 shutdown_connections 2023-10-25T16:14:37.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 --2- 172.21.15.177:0/3095290135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce08005190 0x7fce0800b990 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/3095290135 >> 172.21.15.177:0/3095290135 conn(0x7fce200cdf10 msgr2=0x7fce200ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:37.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/3095290135 shutdown_connections 2023-10-25T16:14:37.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/3095290135 wait complete. 2023-10-25T16:14:37.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 Processor -- start 2023-10-25T16:14:37.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- start start 2023-10-25T16:14:37.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce08005190 0x7fce2014d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 0x7fce200abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce200ac280 0x7fce2006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce200aa8b0 con 0x7fce200ab8c0 2023-10-25T16:14:37.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2014ddf0 con 0x7fce200ac280 2023-10-25T16:14:37.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce200aab00 con 0x7fce08005190 2023-10-25T16:14:37.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 0x7fce200abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 0x7fce200abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34066/0 (socket says 172.21.15.177:34066) 2023-10-25T16:14:37.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 -- 172.21.15.177:0/2598779414 learned_addr learned my addr 172.21.15.177:0/2598779414 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:37.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1effd640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce08005190 0x7fce2014d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1f7fe640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce200ac280 0x7fce2006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 -- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce08005190 msgr2=0x7fce2014d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce08005190 0x7fce2014d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 -- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce200ac280 msgr2=0x7fce2006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:37.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce200ac280 0x7fce2006c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:37.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 -- 172.21.15.177:0/2598779414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce200aade0 con 0x7fce200ab8c0 2023-10-25T16:14:37.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce1e7fc640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 0x7fce200abd40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce1400e310 tx=0x7fce1400e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:37.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14012850 con 0x7fce200ab8c0 2023-10-25T16:14:37.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce14012aa0 con 0x7fce200ab8c0 2023-10-25T16:14:37.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce200ab0c0 con 0x7fce200ab8c0 2023-10-25T16:14:37.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce14012e70 con 0x7fce200ab8c0 2023-10-25T16:14:37.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.767+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2014ae20 con 0x7fce200ab8c0 2023-10-25T16:14:37.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.771+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2004daf0 con 0x7fce200ab8c0 2023-10-25T16:14:37.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.771+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce1401a400 con 0x7fce200ab8c0 2023-10-25T16:14:37.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.771+0000 7fce07fff640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce0c066470 0x7fce0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:37.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.771+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fce14087490 con 0x7fce200ab8c0 2023-10-25T16:14:37.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.771+0000 7fce1effd640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce0c066470 0x7fce0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:37.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.771+0000 7fce1effd640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce0c066470 0x7fce0c068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce10000c10 tx=0x7fce10006c70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:37.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.775+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce14054940 con 0x7fce200ab8c0 2023-10-25T16:14:37.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:37.959+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fce200ab570 con 0x7fce200ab8c0 2023-10-25T16:14:38.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.623+0000 7fce07fff640 1 -- 172.21.15.177:0/2598779414 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce14057f60 con 0x7fce200ab8c0 2023-10-25T16:14:38.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce0c066470 msgr2=0x7fce0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:38.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce0c066470 0x7fce0c068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fce10000c10 tx=0x7fce10006c70 comp rx=0 tx=0).stop 2023-10-25T16:14:38.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 msgr2=0x7fce200abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:38.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 0x7fce200abd40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce1400e310 tx=0x7fce1400e7d0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 shutdown_connections 2023-10-25T16:14:38.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce0c066470 0x7fce0c068930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce200ac280 0x7fce2006c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200ab8c0 0x7fce200abd40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 --2- 172.21.15.177:0/2598779414 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce08005190 0x7fce2014d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 >> 172.21.15.177:0/2598779414 conn(0x7fce200cdf10 msgr2=0x7fce200adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:38.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 shutdown_connections 2023-10-25T16:14:38.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.627+0000 7fce25855640 1 -- 172.21.15.177:0/2598779414 wait complete. 2023-10-25T16:14:38.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:14:38.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/495002165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c06a320 msgr2=0x7f6e9c06a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:38.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/495002165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c06a320 0x7f6e9c06a790 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0b0ca0 tx=0x7f6e9001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/495002165 shutdown_connections 2023-10-25T16:14:38.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/495002165 >> v2:172.21.15.184:3300/0 conn(0x7f6e9c0cf850 0x7f6e9c0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/495002165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c06a320 0x7f6e9c06a790 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/495002165 >> 172.21.15.177:0/495002165 conn(0x7f6e9c09a580 msgr2=0x7f6e9c0d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:38.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/495002165 shutdown_connections 2023-10-25T16:14:38.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/495002165 wait complete. 2023-10-25T16:14:38.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 Processor -- start 2023-10-25T16:14:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- start start 2023-10-25T16:14:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9c06a320 0x7f6e9c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 0x7f6e9c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e9c15e840 0x7f6e9c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:38.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c15d2a0 con 0x7f6e9c0cf850 2023-10-25T16:14:38.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c15bfe0 con 0x7f6e9c06a320 2023-10-25T16:14:38.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c15c280 con 0x7f6e9c15e840 2023-10-25T16:14:38.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 0x7f6e9c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:38.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 0x7f6e9c0c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34076/0 (socket says 172.21.15.177:34076) 2023-10-25T16:14:38.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 -- 172.21.15.177:0/1848668518 learned_addr learned my addr 172.21.15.177:0/1848668518 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e9a59c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9c06a320 0x7f6e9c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 -- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e9c15e840 msgr2=0x7f6e9c14ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e9ad9d640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e9c15e840 0x7f6e9c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e9c15e840 0x7f6e9c14ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 -- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9c06a320 msgr2=0x7f6e9c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:38.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9c06a320 0x7f6e9c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:38.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 -- 172.21.15.177:0/1848668518 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900094a0 con 0x7f6e9c0cf850 2023-10-25T16:14:38.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e9a59c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9c06a320 0x7f6e9c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:38.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e99d9b640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 0x7f6e9c0c94d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001a3e0 tx=0x7f6e90005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:38.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900048d0 con 0x7f6e9c0cf850 2023-10-25T16:14:38.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e90004b20 con 0x7f6e9c0cf850 2023-10-25T16:14:38.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900b7440 con 0x7f6e9c0cf850 2023-10-25T16:14:38.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c15c560 con 0x7f6e9c0cf850 2023-10-25T16:14:38.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.783+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c151980 con 0x7f6e9c0cf850 2023-10-25T16:14:38.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.787+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9c09f1f0 con 0x7f6e9c0cf850 2023-10-25T16:14:38.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.787+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e900b75a0 con 0x7f6e9c0cf850 2023-10-25T16:14:38.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.787+0000 7f6e8affd640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e7c0664a0 0x7f6e7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:38.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.787+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6e9011f400 con 0x7f6e9c0cf850 2023-10-25T16:14:38.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.787+0000 7f6e9a59c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e7c0664a0 0x7f6e7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:38.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.787+0000 7f6e9a59c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e7c0664a0 0x7f6e7c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c000f70 tx=0x7f6e8c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:38.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.791+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e900ec950 con 0x7f6e9c0cf850 2023-10-25T16:14:38.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:38.935+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e9c0cca30 con 0x7f6e9c0cf850 2023-10-25T16:14:39.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.751+0000 7f6e8affd640 1 -- 172.21.15.177:0/1848668518 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6e900b20d0 con 0x7f6e9c0cf850 2023-10-25T16:14:39.758 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:14:39.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e7c0664a0 msgr2=0x7f6e7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:39.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e7c0664a0 0x7f6e7c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c000f70 tx=0x7f6e8c009040 comp rx=0 tx=0).stop 2023-10-25T16:14:39.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 msgr2=0x7f6e9c0c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:39.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 0x7f6e9c0c94d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001a3e0 tx=0x7f6e90005740 comp rx=0 tx=0).stop 2023-10-25T16:14:39.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 shutdown_connections 2023-10-25T16:14:39.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e7c0664a0 0x7f6e7c068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e9c15e840 0x7f6e9c14ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e9c0cf850 0x7f6e9c0c94d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 --2- 172.21.15.177:0/1848668518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9c06a320 0x7f6e9c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 >> 172.21.15.177:0/1848668518 conn(0x7f6e9c09a580 msgr2=0x7f6e9c0af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:39.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 shutdown_connections 2023-10-25T16:14:39.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.755+0000 7f6ea0a2c640 1 -- 172.21.15.177:0/1848668518 wait complete. 2023-10-25T16:14:39.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:14:39.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/405803225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800c3b10 msgr2=0x7f7c800c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:39.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 --2- 172.21.15.177:0/405803225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800c3b10 0x7f7c800c3f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c800ad2b0 tx=0x7f7c7801cb10 comp rx=0 tx=0).stop 2023-10-25T16:14:39.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/405803225 shutdown_connections 2023-10-25T16:14:39.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 --2- 172.21.15.177:0/405803225 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800c3b10 0x7f7c800c3f40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/405803225 >> 172.21.15.177:0/405803225 conn(0x7f7c800afbf0 msgr2=0x7f7c800b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:39.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/405803225 shutdown_connections 2023-10-25T16:14:39.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/405803225 wait complete. 2023-10-25T16:14:39.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 Processor -- start 2023-10-25T16:14:39.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- start start 2023-10-25T16:14:39.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 0x7f7c80153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:39.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c800c3b10 0x7f7c8006daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:39.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80158220 0x7f7c8014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:39.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8014d070 con 0x7f7c800ad750 2023-10-25T16:14:39.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80152cd0 con 0x7f7c80158220 2023-10-25T16:14:39.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80152fb0 con 0x7f7c800c3b10 2023-10-25T16:14:39.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 0x7f7c80153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:39.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 0x7f7c80153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34098/0 (socket says 172.21.15.177:34098) 2023-10-25T16:14:39.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 -- 172.21.15.177:0/3856627135 learned_addr learned my addr 172.21.15.177:0/3856627135 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:39.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c77fff640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c800c3b10 0x7f7c8006daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:39.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 -- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c800c3b10 msgr2=0x7f7c8006daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:39.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c800c3b10 0x7f7c8006daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7ed9d640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80158220 0x7f7c8014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:39.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 -- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80158220 msgr2=0x7f7c8014c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:39.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80158220 0x7f7c8014c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:39.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 -- 172.21.15.177:0/3856627135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78009820 con 0x7f7c800ad750 2023-10-25T16:14:39.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c7e59c640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 0x7f7c80153d70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000b3e0 tx=0x7f7c7000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:39.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70011830 con 0x7f7c800ad750 2023-10-25T16:14:39.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7c70011aa0 con 0x7f7c800ad750 2023-10-25T16:14:39.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c80153290 con 0x7f7c800ad750 2023-10-25T16:14:39.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70010380 con 0x7f7c800ad750 2023-10-25T16:14:39.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.907+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c80153850 con 0x7f7c800ad750 2023-10-25T16:14:39.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.911+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c80066b20 con 0x7f7c800ad750 2023-10-25T16:14:39.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.911+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c700104e0 con 0x7f7c800ad750 2023-10-25T16:14:39.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.911+0000 7f7c76ffd640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c60066470 0x7f7c60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:39.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.911+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7c70084160 con 0x7f7c800ad750 2023-10-25T16:14:39.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.911+0000 7f7c77fff640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c60066470 0x7f7c60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:39.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.911+0000 7f7c77fff640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c60066470 0x7f7c60068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7c80152bc0 tx=0x7f7c68009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:39.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:39.915+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c70051740 con 0x7f7c800ad750 2023-10-25T16:14:40.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.059+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c80073360 con 0x7f7c800ad750 2023-10-25T16:14:40.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.771+0000 7f7c76ffd640 1 -- 172.21.15.177:0/3856627135 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c70054d60 con 0x7f7c800ad750 2023-10-25T16:14:40.778 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:14:40.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c60066470 msgr2=0x7f7c60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:40.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c60066470 0x7f7c60068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7c80152bc0 tx=0x7f7c68009040 comp rx=0 tx=0).stop 2023-10-25T16:14:40.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 msgr2=0x7f7c80153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:40.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 0x7f7c80153d70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000b3e0 tx=0x7f7c7000b8a0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 shutdown_connections 2023-10-25T16:14:40.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c60066470 0x7f7c60068930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80158220 0x7f7c8014c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c800c3b10 0x7f7c8006daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 --2- 172.21.15.177:0/3856627135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c800ad750 0x7f7c80153d70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.775+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 >> 172.21.15.177:0/3856627135 conn(0x7f7c800afbf0 msgr2=0x7f7c8015c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:40.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.779+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 shutdown_connections 2023-10-25T16:14:40.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.779+0000 7f7c84adc640 1 -- 172.21.15.177:0/3856627135 wait complete. 2023-10-25T16:14:40.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:14:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3587595806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2814e810 msgr2=0x7f3f280cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3587595806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2814e810 0x7f3f280cbfa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009c80 tx=0x7f3f1801cd80 comp rx=0 tx=0).stop 2023-10-25T16:14:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3587595806 shutdown_connections 2023-10-25T16:14:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3587595806 >> v2:172.21.15.184:3300/0 conn(0x7f3f2815bdb0 0x7f3f280aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3587595806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2814e810 0x7f3f280cbfa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3587595806 >> 172.21.15.177:0/3587595806 conn(0x7f3f280b2450 msgr2=0x7f3f280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3587595806 shutdown_connections 2023-10-25T16:14:40.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.931+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3587595806 wait complete. 2023-10-25T16:14:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 Processor -- start 2023-10-25T16:14:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- start start 2023-10-25T16:14:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f280af100 0x7f3f2814b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 0x7f3f2814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2815bdb0 0x7f3f28154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28138680 con 0x7f3f2814e810 2023-10-25T16:14:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28135620 con 0x7f3f2815bdb0 2023-10-25T16:14:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28137de0 con 0x7f3f280af100 2023-10-25T16:14:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 0x7f3f2814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 0x7f3f2814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48890/0 (socket says 172.21.15.177:48890) 2023-10-25T16:14:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 -- 172.21.15.177:0/3407028717 learned_addr learned my addr 172.21.15.177:0/3407028717 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2659c640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f280af100 0x7f3f2814b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f26d9d640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2815bdb0 0x7f3f28154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 -- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f280af100 msgr2=0x7f3f2814b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f280af100 0x7f3f2814b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 -- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2815bdb0 msgr2=0x7f3f28154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2815bdb0 0x7f3f28154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 -- 172.21.15.177:0/3407028717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c00a560 con 0x7f3f2814e810 2023-10-25T16:14:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f25d9b640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 0x7f3f2814d620 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00eb20 tx=0x7f3f1c00c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00ce10 con 0x7f3f2814e810 2023-10-25T16:14:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f1c004020 con 0x7f3f2814e810 2023-10-25T16:14:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f180098e0 con 0x7f3f2814e810 2023-10-25T16:14:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c004450 con 0x7f3f2814e810 2023-10-25T16:14:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f281383a0 con 0x7f3f2814e810 2023-10-25T16:14:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.935+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2804daf0 con 0x7f3f2814e810 2023-10-25T16:14:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.939+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f1c005030 con 0x7f3f2814e810 2023-10-25T16:14:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.939+0000 7f3f16ffd640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f08066470 0x7f3f08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.939+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3f1c084210 con 0x7f3f2814e810 2023-10-25T16:14:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.939+0000 7f3f2659c640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f08066470 0x7f3f08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:40.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.939+0000 7f3f2659c640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f08066470 0x7f3f08068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f180af000 tx=0x7f3f1801b5c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:40.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:40.943+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f1c051990 con 0x7f3f2814e810 2023-10-25T16:14:41.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.095+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7f3f2814ecb0 con 0x7f3f2814e810 2023-10-25T16:14:41.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f16ffd640 1 -- 172.21.15.177:0/3407028717 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v20) v1 ==== 71+0+0 (secure 0 0 0) 0x7f3f1c082e60 con 0x7f3f2814e810 2023-10-25T16:14:41.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f08066470 msgr2=0x7f3f08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f08066470 0x7f3f08068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f180af000 tx=0x7f3f1801b5c0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 msgr2=0x7f3f2814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 0x7f3f2814d620 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00eb20 tx=0x7f3f1c00c3d0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 shutdown_connections 2023-10-25T16:14:41.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f08066470 0x7f3f08068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2815bdb0 0x7f3f28154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2814e810 0x7f3f2814d620 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 --2- 172.21.15.177:0/3407028717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f280af100 0x7f3f2814b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 >> 172.21.15.177:0/3407028717 conn(0x7f3f280b2450 msgr2=0x7f3f280cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:41.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 shutdown_connections 2023-10-25T16:14:41.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.103+0000 7f3f2ca56640 1 -- 172.21.15.177:0/3407028717 wait complete. 2023-10-25T16:14:41.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-10-25T16:14:41.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 -- 172.21.15.177:0/2735123247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 msgr2=0x7fea840aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 --2- 172.21.15.177:0/2735123247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea840aebc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fea840cdef0 tx=0x7fea6c01c880 comp rx=0 tx=0).stop 2023-10-25T16:14:41.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 -- 172.21.15.177:0/2735123247 shutdown_connections 2023-10-25T16:14:41.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 --2- 172.21.15.177:0/2735123247 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea840af100 0x7fea84158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 --2- 172.21.15.177:0/2735123247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea840aebc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 --2- 172.21.15.177:0/2735123247 >> v2:172.21.15.184:3300/0 conn(0x7fea8414e810 0x7fea840cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 -- 172.21.15.177:0/2735123247 >> 172.21.15.177:0/2735123247 conn(0x7fea840b2450 msgr2=0x7fea840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:41.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 -- 172.21.15.177:0/2735123247 shutdown_connections 2023-10-25T16:14:41.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.239+0000 7fea88e6e640 1 -- 172.21.15.177:0/2735123247 wait complete. 2023-10-25T16:14:41.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 Processor -- start 2023-10-25T16:14:41.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- start start 2023-10-25T16:14:41.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea840af100 0x7fea84141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8414e810 0x7fea8406fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea84156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea84141db0 con 0x7fea8415bdb0 2023-10-25T16:14:41.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea84070480 con 0x7fea840af100 2023-10-25T16:14:41.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea84070760 con 0x7fea8414e810 2023-10-25T16:14:41.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea84156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea84156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48908/0 (socket says 172.21.15.177:48908) 2023-10-25T16:14:41.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 -- 172.21.15.177:0/3729120885 learned_addr learned my addr 172.21.15.177:0/3729120885 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:41.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea81d9b640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8414e810 0x7fea8406fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea8259c640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea840af100 0x7fea84141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 -- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8414e810 msgr2=0x7fea8406fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8414e810 0x7fea8406fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 -- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea840af100 msgr2=0x7fea84141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea840af100 0x7fea84141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 -- 172.21.15.177:0/3729120885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009500 con 0x7fea8415bdb0 2023-10-25T16:14:41.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea81d9b640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8414e810 0x7fea8406fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:41.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea82d9d640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea84156d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fea7400ea20 tx=0x7fea7400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:41.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400cde0 con 0x7fea8415bdb0 2023-10-25T16:14:41.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea74004c40 con 0x7fea8415bdb0 2023-10-25T16:14:41.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea84070a40 con 0x7fea8415bdb0 2023-10-25T16:14:41.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74005020 con 0x7fea8415bdb0 2023-10-25T16:14:41.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea84070070 con 0x7fea8415bdb0 2023-10-25T16:14:41.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea84070ef0 con 0x7fea8415bdb0 2023-10-25T16:14:41.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.243+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea74005180 con 0x7fea8415bdb0 2023-10-25T16:14:41.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.247+0000 7fea7affd640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea64066470 0x7fea64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.247+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea74084500 con 0x7fea8415bdb0 2023-10-25T16:14:41.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.247+0000 7fea8259c640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea64066470 0x7fea64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.247+0000 7fea8259c640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea64066470 0x7fea64068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea7c005fd0 tx=0x7fea7c00a4c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:41.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.251+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea74051d10 con 0x7fea8415bdb0 2023-10-25T16:14:41.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.447+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fea8404daf0 con 0x7fea8415bdb0 2023-10-25T16:14:41.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.775+0000 7fea7affd640 1 -- 172.21.15.177:0/3729120885 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v105) v1 ==== 130+0+0 (secure 0 0 0) 0x7fea7401f0c0 con 0x7fea8415bdb0 2023-10-25T16:14:41.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea64066470 msgr2=0x7fea64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea64066470 0x7fea64068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea7c005fd0 tx=0x7fea7c00a4c0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 msgr2=0x7fea84156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea84156d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fea7400ea20 tx=0x7fea7400eee0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 shutdown_connections 2023-10-25T16:14:41.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea64066470 0x7fea64068930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea8415bdb0 0x7fea84156d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea8414e810 0x7fea8406fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 --2- 172.21.15.177:0/3729120885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea840af100 0x7fea84141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 >> 172.21.15.177:0/3729120885 conn(0x7fea840b2450 msgr2=0x7fea840b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:41.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 shutdown_connections 2023-10-25T16:14:41.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.779+0000 7fea88e6e640 1 -- 172.21.15.177:0/3729120885 wait complete. 2023-10-25T16:14:41.805 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-25T16:14:41.805 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-25T16:14:41.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 -- 172.21.15.177:0/124642362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39a4003980 msgr2=0x7f39a4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 --2- 172.21.15.177:0/124642362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39a4003980 0x7f39a4003da0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009b30 tx=0x7f39b401d1e0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 -- 172.21.15.177:0/124642362 shutdown_connections 2023-10-25T16:14:41.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 --2- 172.21.15.177:0/124642362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39a4003980 0x7f39a4003da0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 -- 172.21.15.177:0/124642362 >> 172.21.15.177:0/124642362 conn(0x7f39b80cd6b0 msgr2=0x7f39b80cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:41.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 -- 172.21.15.177:0/124642362 shutdown_connections 2023-10-25T16:14:41.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 -- 172.21.15.177:0/124642362 wait complete. 2023-10-25T16:14:41.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 Processor -- start 2023-10-25T16:14:41.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.927+0000 7f39c06dc640 1 -- start start 2023-10-25T16:14:41.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39a4003980 0x7f39b8145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39b80ae180 0x7f39b80ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 0x7f39b8151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81459a0 con 0x7f39b8151170 2023-10-25T16:14:41.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80aeb40 con 0x7f39b80ae180 2023-10-25T16:14:41.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81e4a30 con 0x7f39a4003980 2023-10-25T16:14:41.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 0x7f39b8151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 0x7f39b8151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48920/0 (socket says 172.21.15.177:48920) 2023-10-25T16:14:41.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 -- 172.21.15.177:0/2834964806 learned_addr learned my addr 172.21.15.177:0/2834964806 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:41.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39be478640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39a4003980 0x7f39b8145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bdc77640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39b80ae180 0x7f39b80ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 -- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39a4003980 msgr2=0x7f39b8145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39a4003980 0x7f39b8145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 -- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39b80ae180 msgr2=0x7f39b80ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:41.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39b80ae180 0x7f39b80ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:41.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 -- 172.21.15.177:0/2834964806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b81e3e20 con 0x7f39b8151170 2023-10-25T16:14:41.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39be478640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39a4003980 0x7f39b8145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:41.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39bec79640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 0x7f39b8151620 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f39b0000f90 tx=0x7f39b00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:41.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b00107d0 con 0x7f39b8151170 2023-10-25T16:14:41.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f39b0010930 con 0x7f39b8151170 2023-10-25T16:14:41.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b81e4100 con 0x7f39b8151170 2023-10-25T16:14:41.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0010d40 con 0x7f39b8151170 2023-10-25T16:14:41.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b81e46c0 con 0x7f39b8151170 2023-10-25T16:14:41.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b804daf0 con 0x7f39b8151170 2023-10-25T16:14:41.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.931+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39b001a400 con 0x7f39b8151170 2023-10-25T16:14:41.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.935+0000 7f39aeffd640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f399c0664a0 0x7f399c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:41.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.935+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f39b0084aa0 con 0x7f39b8151170 2023-10-25T16:14:41.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.935+0000 7f39be478640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f399c0664a0 0x7f399c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:41.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.935+0000 7f39be478640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f399c0664a0 0x7f399c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f39b40ae000 tx=0x7f39b4019f80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:41.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:41.935+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39b0052390 con 0x7f39b8151170 2023-10-25T16:14:42.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.079+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b81e4b70 con 0x7f39b8151170 2023-10-25T16:14:42.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.079+0000 7f39aeffd640 1 -- 172.21.15.177:0/2834964806 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f39b0006b70 con 0x7f39b8151170 2023-10-25T16:14:42.085 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:42.086 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":40,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:40.765663+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6837/2532234730":"2023-10-26T16:14:37.622363+0000","172.21.15.184:6836/2532234730":"2023-10-26T16:14:37.622363+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:42.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f399c0664a0 msgr2=0x7f399c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f399c0664a0 0x7f399c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f39b40ae000 tx=0x7f39b4019f80 comp rx=0 tx=0).stop 2023-10-25T16:14:42.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 msgr2=0x7f39b8151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 0x7f39b8151620 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f39b0000f90 tx=0x7f39b00019c0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 shutdown_connections 2023-10-25T16:14:42.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f399c0664a0 0x7f399c068960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39b8151170 0x7f39b8151620 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39b80ae180 0x7f39b80ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 --2- 172.21.15.177:0/2834964806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39a4003980 0x7f39b8145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 >> 172.21.15.177:0/2834964806 conn(0x7f39b80cd6b0 msgr2=0x7f39b815af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:42.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 shutdown_connections 2023-10-25T16:14:42.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.083+0000 7f39c06dc640 1 -- 172.21.15.177:0/2834964806 wait complete. 2023-10-25T16:14:42.103 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:14:42.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:14:42.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 -- 172.21.15.177:0/3014302190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0b00f0 msgr2=0x7f57bc0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 --2- 172.21.15.177:0/3014302190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0b00f0 0x7f57bc0cdc20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f57bc08b730 tx=0x7f57ac01f050 comp rx=0 tx=0).stop 2023-10-25T16:14:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 -- 172.21.15.177:0/3014302190 shutdown_connections 2023-10-25T16:14:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 --2- 172.21.15.177:0/3014302190 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0b00f0 0x7f57bc0cdc20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 --2- 172.21.15.177:0/3014302190 >> v2:172.21.15.184:3300/0 conn(0x7f57bc0cf7e0 0x7f57bc0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 -- 172.21.15.177:0/3014302190 >> 172.21.15.177:0/3014302190 conn(0x7f57bc09a5c0 msgr2=0x7f57bc0d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:42.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 -- 172.21.15.177:0/3014302190 shutdown_connections 2023-10-25T16:14:42.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.219+0000 7f57c3d11640 1 -- 172.21.15.177:0/3014302190 wait complete. 2023-10-25T16:14:42.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 Processor -- start 2023-10-25T16:14:42.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- start start 2023-10-25T16:14:42.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57bc0b00f0 0x7f57bc1f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 0x7f57bc0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc0cfbc0 0x7f57bc1f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0c94a0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0ca2c0 con 0x7f57bc0cfbc0 2023-10-25T16:14:42.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc1f6290 con 0x7f57bc0b00f0 2023-10-25T16:14:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 0x7f57bc0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 0x7f57bc0ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48946/0 (socket says 172.21.15.177:48946) 2023-10-25T16:14:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 -- 172.21.15.177:0/2218372720 learned_addr learned my addr 172.21.15.177:0/2218372720 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c1aad640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57bc0b00f0 0x7f57bc1f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c22ae640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc0cfbc0 0x7f57bc1f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 -- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57bc0b00f0 msgr2=0x7f57bc1f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57bc0b00f0 0x7f57bc1f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 -- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc0cfbc0 msgr2=0x7f57bc1f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc0cfbc0 0x7f57bc1f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 -- 172.21.15.177:0/2218372720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009560 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c12ac640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 0x7f57bc0ca750 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b3040 tx=0x7f57ac0b0880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0b0c70 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f57ac005030 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57bc0c96b0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac005440 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc0c9c70 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.223+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc04daf0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.227+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57ac0b7070 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.227+0000 7f57b27fc640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57a0066470 0x7f57a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.227+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57ac120cb0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.227+0000 7f57c1aad640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57a0066470 0x7f57a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.227+0000 7f57c1aad640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57a0066470 0x7f57a0068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57b8005c50 tx=0x7f57b800a3b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:42.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.231+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57ac0ee3b0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57bc0af4b0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57b27fc640 1 -- 172.21.15.177:0/2218372720 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57ac0f19d0 con 0x7f57bc0cf7e0 2023-10-25T16:14:42.388 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:14:42.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57a0066470 msgr2=0x7f57a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57a0066470 0x7f57a0068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f57b8005c50 tx=0x7f57b800a3b0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 msgr2=0x7f57bc0ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 0x7f57bc0ca750 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b3040 tx=0x7f57ac0b0880 comp rx=0 tx=0).stop 2023-10-25T16:14:42.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 shutdown_connections 2023-10-25T16:14:42.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57a0066470 0x7f57a0068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57bc0cfbc0 0x7f57bc1f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc0cf7e0 0x7f57bc0ca750 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 --2- 172.21.15.177:0/2218372720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57bc0b00f0 0x7f57bc1f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 >> 172.21.15.177:0/2218372720 conn(0x7f57bc09a5c0 msgr2=0x7f57bc0ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:42.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 shutdown_connections 2023-10-25T16:14:42.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.383+0000 7f57c3d11640 1 -- 172.21.15.177:0/2218372720 wait complete. 2023-10-25T16:14:42.408 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-25T16:14:42.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- 172.21.15.177:0/1417349309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 msgr2=0x7f17c0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1417349309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17c0003d60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f17c4009b60 tx=0x7f17c401d270 comp rx=0 tx=0).stop 2023-10-25T16:14:42.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- 172.21.15.177:0/1417349309 shutdown_connections 2023-10-25T16:14:42.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1417349309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17c0003d60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- 172.21.15.177:0/1417349309 >> 172.21.15.177:0/1417349309 conn(0x7f17d00af3f0 msgr2=0x7f17d00af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:42.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- 172.21.15.177:0/1417349309 shutdown_connections 2023-10-25T16:14:42.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- 172.21.15.177:0/1417349309 wait complete. 2023-10-25T16:14:42.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 Processor -- start 2023-10-25T16:14:42.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- start start 2023-10-25T16:14:42.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17d01535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d01f5040 0x7f17d01f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b0ff0 0x7f17d00b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01f5a00 con 0x7f17c0003980 2023-10-25T16:14:42.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01428e0 con 0x7f17d01f5040 2023-10-25T16:14:42.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d6efc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0141fb0 con 0x7f17d00b0ff0 2023-10-25T16:14:42.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d4c98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17d01535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d4c98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17d01535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48968/0 (socket says 172.21.15.177:48968) 2023-10-25T16:14:42.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.527+0000 7f17d4c98640 1 -- 172.21.15.177:0/1050988824 learned_addr learned my addr 172.21.15.177:0/1050988824 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:42.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d5499640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b0ff0 0x7f17d00b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cffff640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d01f5040 0x7f17d01f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d4c98640 1 -- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b0ff0 msgr2=0x7f17d00b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d4c98640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b0ff0 0x7f17d00b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d4c98640 1 -- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d01f5040 msgr2=0x7f17d01f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d4c98640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d01f5040 0x7f17d01f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d4c98640 1 -- 172.21.15.177:0/1050988824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0142290 con 0x7f17c0003980 2023-10-25T16:14:42.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d5499640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b0ff0 0x7f17d00b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:42.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cffff640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d01f5040 0x7f17d01f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:42.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d4c98640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17d01535b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f17c40b0040 tx=0x7f17c4005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:42.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4004230 con 0x7f17c0003980 2023-10-25T16:14:42.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17c4004480 con 0x7f17c0003980 2023-10-25T16:14:42.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d0142570 con 0x7f17c0003980 2023-10-25T16:14:42.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40ad970 con 0x7f17c0003980 2023-10-25T16:14:42.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d00b1d90 con 0x7f17c0003980 2023-10-25T16:14:42.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d004daf0 con 0x7f17c0003980 2023-10-25T16:14:42.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17c40b4040 con 0x7f17c0003980 2023-10-25T16:14:42.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cd7fa640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17b4066470 0x7f17b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:42.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17c411e940 con 0x7f17c0003980 2023-10-25T16:14:42.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cffff640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17b4066470 0x7f17b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:42.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.531+0000 7f17cffff640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17b4066470 0x7f17b4068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001c30 tx=0x7f17bc001590 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:42.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.535+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17c40ec270 con 0x7f17c0003980 2023-10-25T16:14:42.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.731+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f17d00aff90 con 0x7f17c0003980 2023-10-25T16:14:42.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.779+0000 7f17cd7fa640 1 -- 172.21.15.177:0/1050988824 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v106) v1 ==== 145+0+0 (secure 0 0 0) 0x7f17c40b2020 con 0x7f17c0003980 2023-10-25T16:14:42.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17b4066470 msgr2=0x7f17b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17b4066470 0x7f17b4068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001c30 tx=0x7f17bc001590 comp rx=0 tx=0).stop 2023-10-25T16:14:42.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 msgr2=0x7f17d01535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:42.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17d01535b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f17c40b0040 tx=0x7f17c4005540 comp rx=0 tx=0).stop 2023-10-25T16:14:42.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 shutdown_connections 2023-10-25T16:14:42.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17b4066470 0x7f17b4068930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b0ff0 0x7f17d00b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d01f5040 0x7f17d01f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 --2- 172.21.15.177:0/1050988824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c0003980 0x7f17d01535b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:42.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 >> 172.21.15.177:0/1050988824 conn(0x7f17d00af3f0 msgr2=0x7f17d0150390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:42.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 shutdown_connections 2023-10-25T16:14:42.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:42.783+0000 7f17d6efc640 1 -- 172.21.15.177:0/1050988824 wait complete. 2023-10-25T16:14:42.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-25T16:14:42.923 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_objectstore":"memstore"} 2023-10-25T16:14:42.924 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-25T16:14:42.924 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:14:43.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 -- 172.21.15.177:0/1646278599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac0c9d10 msgr2=0x7f9cac15b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1646278599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac0c9d10 0x7f9cac15b900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009bf0 tx=0x7f9ca401cbc0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 -- 172.21.15.177:0/1646278599 shutdown_connections 2023-10-25T16:14:43.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1646278599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac0c9d10 0x7f9cac15b900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 -- 172.21.15.177:0/1646278599 >> 172.21.15.177:0/1646278599 conn(0x7f9cac0b0de0 msgr2=0x7f9cac0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:43.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 -- 172.21.15.177:0/1646278599 shutdown_connections 2023-10-25T16:14:43.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 -- 172.21.15.177:0/1646278599 wait complete. 2023-10-25T16:14:43.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 Processor -- start 2023-10-25T16:14:43.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.043+0000 7f9cb457d640 1 -- start start 2023-10-25T16:14:43.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cac0c9880 0x7f9cac14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 0x7f9cac0c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac156e60 0x7f9cac0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac06b5b0 con 0x7f9cac0c9d10 2023-10-25T16:14:43.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac06b890 con 0x7f9cac0c9880 2023-10-25T16:14:43.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac06bb70 con 0x7f9cac156e60 2023-10-25T16:14:43.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 0x7f9cac0c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 0x7f9cac0c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48972/0 (socket says 172.21.15.177:48972) 2023-10-25T16:14:43.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 -- 172.21.15.177:0/1951041219 learned_addr learned my addr 172.21.15.177:0/1951041219 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:43.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb2319640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cac0c9880 0x7f9cac14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb2b1a640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac156e60 0x7f9cac0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 -- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac156e60 msgr2=0x7f9cac0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac156e60 0x7f9cac0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 -- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cac0c9880 msgr2=0x7f9cac14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cac0c9880 0x7f9cac14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 -- 172.21.15.177:0/1951041219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009820 con 0x7f9cac0c9d10 2023-10-25T16:14:43.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb2319640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cac0c9880 0x7f9cac14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:43.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb1b18640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 0x7f9cac0c1e10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c500 tx=0x7f9c9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:43.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c0052d0 con 0x7f9cac0c9d10 2023-10-25T16:14:43.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9c9c005450 con 0x7f9cac0c9d10 2023-10-25T16:14:43.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac0cc110 con 0x7f9cac0c9d10 2023-10-25T16:14:43.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c012890 con 0x7f9cac0c9d10 2023-10-25T16:14:43.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac06c130 con 0x7f9cac0c9d10 2023-10-25T16:14:43.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac06c350 con 0x7f9cac0c9d10 2023-10-25T16:14:43.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c9c003600 con 0x7f9cac0c9d10 2023-10-25T16:14:43.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9ca2ffd640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c90066470 0x7f9c90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c9c0839e0 con 0x7f9cac0c9d10 2023-10-25T16:14:43.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.047+0000 7f9cb2319640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c90066470 0x7f9c90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.051+0000 7f9cb2319640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c90066470 0x7f9c90068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80011f0 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:43.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.055+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c9c051170 con 0x7f9cac0c9d10 2023-10-25T16:14:43.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.195+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f9cac04daf0 con 0x7f9cac0c9d10 2023-10-25T16:14:43.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.195+0000 7f9ca2ffd640 1 -- 172.21.15.177:0/1951041219 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v20) v1 ==== 59+0+1116 (secure 0 0 0) 0x7f9c9c054790 con 0x7f9cac0c9d10 2023-10-25T16:14:43.202 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:14:43.202 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:14:43.202 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:14:43.202 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:14:43.203 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:14:43.203 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:14:43.203 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:14:43.203 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:14:43.203 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:14:43.204 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:14:43.204 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:14:43.204 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:14:43.204 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:14:43.205 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:14:43.205 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:14:43.205 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:14:43.205 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:14:43.205 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:14:43.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c90066470 msgr2=0x7f9c90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c90066470 0x7f9c90068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80011f0 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2023-10-25T16:14:43.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 msgr2=0x7f9cac0c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 0x7f9cac0c1e10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00c500 tx=0x7f9c9c00c9c0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 shutdown_connections 2023-10-25T16:14:43.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c90066470 0x7f9c90068930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cac156e60 0x7f9cac0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cac0c9d10 0x7f9cac0c1e10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 --2- 172.21.15.177:0/1951041219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cac0c9880 0x7f9cac14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 >> 172.21.15.177:0/1951041219 conn(0x7f9cac0b0de0 msgr2=0x7f9cac0afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:43.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 shutdown_connections 2023-10-25T16:14:43.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.199+0000 7f9cb457d640 1 -- 172.21.15.177:0/1951041219 wait complete. 2023-10-25T16:14:43.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:14:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 -- 172.21.15.177:0/271032602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44800047d0 msgr2=0x7f4480004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 --2- 172.21.15.177:0/271032602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44800047d0 0x7f4480004c50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f44840016b0 tx=0x7f448401c6f0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 -- 172.21.15.177:0/271032602 shutdown_connections 2023-10-25T16:14:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 --2- 172.21.15.177:0/271032602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44800047d0 0x7f4480004c50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 -- 172.21.15.177:0/271032602 >> 172.21.15.177:0/271032602 conn(0x7f44940b2450 msgr2=0x7f44940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 -- 172.21.15.177:0/271032602 shutdown_connections 2023-10-25T16:14:43.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 -- 172.21.15.177:0/271032602 wait complete. 2023-10-25T16:14:43.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 Processor -- start 2023-10-25T16:14:43.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.339+0000 7f449c3a7640 1 -- start start 2023-10-25T16:14:43.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800047d0 0x7f44940af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 0x7f4494158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4494159440 0x7f4494153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940ae810 con 0x7f4494158a80 2023-10-25T16:14:43.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494151340 con 0x7f44800047d0 2023-10-25T16:14:43.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44941554a0 con 0x7f4494159440 2023-10-25T16:14:43.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 0x7f4494158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 0x7f4494158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48984/0 (socket says 172.21.15.177:48984) 2023-10-25T16:14:43.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 -- 172.21.15.177:0/3825831447 learned_addr learned my addr 172.21.15.177:0/3825831447 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:43.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449a143640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800047d0 0x7f44940af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 -- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4494159440 msgr2=0x7f4494153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4494159440 0x7f4494153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 -- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800047d0 msgr2=0x7f44940af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800047d0 0x7f44940af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 -- 172.21.15.177:0/3825831447 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940ada50 con 0x7f4494158a80 2023-10-25T16:14:43.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f4499942640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 0x7f4494158f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f448401c520 tx=0x7f4484003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:43.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484006940 con 0x7f4494158a80 2023-10-25T16:14:43.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4484006130 con 0x7f4494158a80 2023-10-25T16:14:43.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940add30 con 0x7f4494158a80 2023-10-25T16:14:43.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840a6760 con 0x7f4494158a80 2023-10-25T16:14:43.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940ae2f0 con 0x7f4494158a80 2023-10-25T16:14:43.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940ae480 con 0x7f4494158a80 2023-10-25T16:14:43.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f44840a68c0 con 0x7f4494158a80 2023-10-25T16:14:43.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f448affd640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4478066470 0x7f4478068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f448411d790 con 0x7f4494158a80 2023-10-25T16:14:43.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449a143640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4478066470 0x7f4478068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.343+0000 7f449a143640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4478066470 0x7f4478068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4490001210 tx=0x7f4490001d60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:43.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.347+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44840eaf10 con 0x7f4494158a80 2023-10-25T16:14:43.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.495+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f44940ae810 con 0x7f4494158a80 2023-10-25T16:14:43.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.503+0000 7f448affd640 1 -- 172.21.15.177:0/3825831447 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v21)=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44840bd020 con 0x7f4494158a80 2023-10-25T16:14:43.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4478066470 msgr2=0x7f4478068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4478066470 0x7f4478068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4490001210 tx=0x7f4490001d60 comp rx=0 tx=0).stop 2023-10-25T16:14:43.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 msgr2=0x7f4494158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 0x7f4494158f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f448401c520 tx=0x7f4484003c20 comp rx=0 tx=0).stop 2023-10-25T16:14:43.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 shutdown_connections 2023-10-25T16:14:43.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4478066470 0x7f4478068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4494159440 0x7f4494153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4494158a80 0x7f4494158f00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 --2- 172.21.15.177:0/3825831447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800047d0 0x7f44940af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 >> 172.21.15.177:0/3825831447 conn(0x7f44940b2450 msgr2=0x7f44940afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:43.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 shutdown_connections 2023-10-25T16:14:43.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.507+0000 7f449c3a7640 1 -- 172.21.15.177:0/3825831447 wait complete. 2023-10-25T16:14:43.529 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:14:43.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:14:43.576 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:14:43.618 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:14:43.619 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:14:43.619 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:43.624 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:14:43.625 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:14:43.625 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:43.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:14:43.665 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:14:43.665 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:43.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:14:43.671 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:14:43.671 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:14:43.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:14:43.713 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:14:43.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:43.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/3706776289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea814e810 msgr2=0x7f8ea80cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- 172.21.15.177:0/3706776289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea814e810 0x7f8ea80cbfa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8155980 tx=0x7f8e9801c8a0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/3706776289 shutdown_connections 2023-10-25T16:14:43.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- 172.21.15.177:0/3706776289 >> v2:172.21.15.184:3300/0 conn(0x7f8ea80af100 0x7f8ea8158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- 172.21.15.177:0/3706776289 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 0x7f8ea80aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- 172.21.15.177:0/3706776289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea814e810 0x7f8ea80cbfa0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/3706776289 >> 172.21.15.177:0/3706776289 conn(0x7f8ea80b2450 msgr2=0x7f8ea80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:43.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/3706776289 shutdown_connections 2023-10-25T16:14:43.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/3706776289 wait complete. 2023-10-25T16:14:43.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 Processor -- start 2023-10-25T16:14:43.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- start start 2023-10-25T16:14:43.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 0x7f8ea8163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea814e810 0x7f8ea81438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 0x7f8ea8143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea814ad90 con 0x7f8ea80af100 2023-10-25T16:14:43.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea814b070 con 0x7f8ea814e810 2023-10-25T16:14:43.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea814b350 con 0x7f8ea815bdb0 2023-10-25T16:14:43.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 0x7f8ea8163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 0x7f8ea8163890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49000/0 (socket says 172.21.15.177:49000) 2023-10-25T16:14:43.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 -- 172.21.15.177:0/1810535004 learned_addr learned my addr 172.21.15.177:0/1810535004 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:43.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8e9ffff640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea814e810 0x7f8ea81438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea77fe640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 0x7f8ea8143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 -- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 msgr2=0x7f8ea8143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 0x7f8ea8143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 -- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea814e810 msgr2=0x7f8ea81438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea814e810 0x7f8ea81438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 -- 172.21.15.177:0/1810535004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98009560 con 0x7f8ea80af100 2023-10-25T16:14:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea77fe640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 0x7f8ea8143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ea6ffd640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 0x7f8ea8163890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8e980b0040 tx=0x7f8e980a6af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98004240 con 0x7f8ea80af100 2023-10-25T16:14:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e980044b0 con 0x7f8ea80af100 2023-10-25T16:14:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea814b630 con 0x7f8ea80af100 2023-10-25T16:14:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98003860 con 0x7f8ea80af100 2023-10-25T16:14:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.835+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8163dd0 con 0x7f8ea80af100 2023-10-25T16:14:43.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.839+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8163fc0 con 0x7f8ea80af100 2023-10-25T16:14:43.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.839+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e980039c0 con 0x7f8ea80af100 2023-10-25T16:14:43.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.839+0000 7f8e9f7fe640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e880664a0 0x7f8e88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:43.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.839+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e980aa070 con 0x7f8ea80af100 2023-10-25T16:14:43.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.839+0000 7f8e9ffff640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e880664a0 0x7f8e88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:43.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.839+0000 7f8e9ffff640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e880664a0 0x7f8e88068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e90005cd0 tx=0x7f8e90005c60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:43.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:43.843+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ea8163fc0 con 0x7f8ea80af100 2023-10-25T16:14:44.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.019+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ea8163fc0 con 0x7f8ea80af100 2023-10-25T16:14:44.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.019+0000 7f8e9f7fe640 1 -- 172.21.15.177:0/1810535004 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3707 (secure 0 0 0) 0x7f8e980bde90 con 0x7f8ea80af100 2023-10-25T16:14:44.026 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:44.026 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1136720092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1136720092},{"type":"v1","addr":"172.21.15.184:6835","nonce":1136720092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":4882,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1185868380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1185868380},{"type":"v1","addr":"172.21.15.177:6835","nonce":1185868380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5370,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3478594776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3478594776},{"type":"v1","addr":"172.21.15.177:6833","nonce":3478594776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":154805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/982197815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":982197815},{"type":"v1","addr":"172.21.15.184:6837","nonce":982197815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":14}],"filesystems":[]} 2023-10-25T16:14:44.027 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 14 2023-10-25T16:14:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e880664a0 msgr2=0x7f8e88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e880664a0 0x7f8e88068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e90005cd0 tx=0x7f8e90005c60 comp rx=0 tx=0).stop 2023-10-25T16:14:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 msgr2=0x7f8ea8163890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 0x7f8ea8163890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8e980b0040 tx=0x7f8e980a6af0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 shutdown_connections 2023-10-25T16:14:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e880664a0 0x7f8e88068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ea815bdb0 0x7f8ea8143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea814e810 0x7f8ea81438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 --2- 172.21.15.177:0/1810535004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea80af100 0x7f8ea8163890 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 >> 172.21.15.177:0/1810535004 conn(0x7f8ea80b2450 msgr2=0x7f8ea80afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 shutdown_connections 2023-10-25T16:14:44.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.023+0000 7f8ead51b640 1 -- 172.21.15.177:0/1810535004 wait complete. 2023-10-25T16:14:44.043 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:14:44.044 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:14:44.044 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:14:44.044 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:44.045 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:14:44.045 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:14:44.045 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:14:44.045 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:44.046 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:14:44.046 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:14:44.046 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:14:44.047 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:44.047 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:14:44.047 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:14:44.047 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:14:44.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:14:44.055 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:14:44.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:14:44.056 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:14:44.057 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:14:44.061 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:14:44.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:14:44.063 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:14:44.063 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:14:44.104 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:14:44.104 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:44.105 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:14:44.106 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:44.107 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:14:44.107 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:44.108 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:14:44.108 DEBUG:teuthology.parallel:result is None 2023-10-25T16:14:44.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:14:44.162 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:14:44.166 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:14:44.177 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:14:44.182 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:14:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 -- 172.21.15.177:0/4253040969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 msgr2=0x7f54380c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 --2- 172.21.15.177:0/4253040969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54380c2b30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5434009c80 tx=0x7f543401cc70 comp rx=0 tx=0).stop 2023-10-25T16:14:44.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 -- 172.21.15.177:0/4253040969 shutdown_connections 2023-10-25T16:14:44.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 --2- 172.21.15.177:0/4253040969 >> v2:172.21.15.184:3300/0 conn(0x7f54380af820 0x7f54380b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 --2- 172.21.15.177:0/4253040969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54380c2b30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 -- 172.21.15.177:0/4253040969 >> 172.21.15.177:0/4253040969 conn(0x7f54380cefe0 msgr2=0x7f54380cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:44.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 -- 172.21.15.177:0/4253040969 shutdown_connections 2023-10-25T16:14:44.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.215+0000 7f543fc77640 1 -- 172.21.15.177:0/4253040969 wait complete. 2023-10-25T16:14:44.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 Processor -- start 2023-10-25T16:14:44.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- start start 2023-10-25T16:14:44.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54380af820 0x7f543814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54380b0a20 0x7f5438153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54381542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543814fa90 con 0x7f54381591e0 2023-10-25T16:14:44.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438154920 con 0x7f54380af820 2023-10-25T16:14:44.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5438154c00 con 0x7f54380b0a20 2023-10-25T16:14:44.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54381542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54381542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49046/0 (socket says 172.21.15.177:49046) 2023-10-25T16:14:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 -- 172.21.15.177:0/3580929060 learned_addr learned my addr 172.21.15.177:0/3580929060 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543d212640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54380b0a20 0x7f5438153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543da13640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54380af820 0x7f543814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 -- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54380b0a20 msgr2=0x7f5438153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54380b0a20 0x7f5438153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 -- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54380af820 msgr2=0x7f543814f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54380af820 0x7f543814f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 -- 172.21.15.177:0/3580929060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54340098e0 con 0x7f54381591e0 2023-10-25T16:14:44.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543e214640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54381542f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f543000b430 tx=0x7f543000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:44.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430011830 con 0x7f54381591e0 2023-10-25T16:14:44.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5430011a80 con 0x7f54381591e0 2023-10-25T16:14:44.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5438154ee0 con 0x7f54381591e0 2023-10-25T16:14:44.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430011e90 con 0x7f54381591e0 2023-10-25T16:14:44.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5438153b30 con 0x7f54381591e0 2023-10-25T16:14:44.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543804daf0 con 0x7f54381591e0 2023-10-25T16:14:44.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f543001a400 con 0x7f54381591e0 2023-10-25T16:14:44.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f542e7fc640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f541c066470 0x7f541c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5430083fe0 con 0x7f54381591e0 2023-10-25T16:14:44.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.219+0000 7f543da13640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f541c066470 0x7f541c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.223+0000 7f543da13640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f541c066470 0x7f541c068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54340af000 tx=0x7f543401b4b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:44.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.223+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f54300516c0 con 0x7f54381591e0 2023-10-25T16:14:44.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-25T16:14:44.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-25T16:14:44.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.379+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54380c3380 con 0x7f54381591e0 2023-10-25T16:14:44.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.807+0000 7f542e7fc640 1 -- 172.21.15.177:0/3580929060 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5430015020 con 0x7f54381591e0 2023-10-25T16:14:44.812 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:14:44.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f541c066470 msgr2=0x7f541c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f541c066470 0x7f541c068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54340af000 tx=0x7f543401b4b0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 msgr2=0x7f54381542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54381542f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f543000b430 tx=0x7f543000b8f0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 shutdown_connections 2023-10-25T16:14:44.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f541c066470 0x7f541c068930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54381591e0 0x7f54381542f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54380b0a20 0x7f5438153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 --2- 172.21.15.177:0/3580929060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54380af820 0x7f543814f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 >> 172.21.15.177:0/3580929060 conn(0x7f54380cefe0 msgr2=0x7f54380c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:44.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 shutdown_connections 2023-10-25T16:14:44.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.811+0000 7f543fc77640 1 -- 172.21.15.177:0/3580929060 wait complete. 2023-10-25T16:14:44.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:14:44.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3d1968640 1 -- 172.21.15.177:0/2307494927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 msgr2=0x7fa3b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3d1968640 1 --2- 172.21.15.177:0/2307494927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3b8004c50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc06f520 tx=0x7fa3b401f5b0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3cb7fe640 1 -- 172.21.15.177:0/2307494927 reap_dead start 2023-10-25T16:14:44.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3d1968640 1 -- 172.21.15.177:0/2307494927 shutdown_connections 2023-10-25T16:14:44.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3d1968640 1 -- 172.21.15.177:0/2307494927 >> 172.21.15.177:0/2307494927 conn(0x7fa3cc0b2450 msgr2=0x7fa3cc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:44.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3d1968640 1 -- 172.21.15.177:0/2307494927 shutdown_connections 2023-10-25T16:14:44.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.959+0000 7fa3d1968640 1 -- 172.21.15.177:0/2307494927 wait complete. 2023-10-25T16:14:44.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 Processor -- start 2023-10-25T16:14:44.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- start start 2023-10-25T16:14:44.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3cc0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3cc0adc50 0x7fa3cc0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3cc14b950 0x7fa3cc0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc142230 con 0x7fa3b80047d0 2023-10-25T16:14:44.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0acbb0 con 0x7fa3cc0adc50 2023-10-25T16:14:44.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0ace90 con 0x7fa3cc14b950 2023-10-25T16:14:44.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3cc0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3cc0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49074/0 (socket says 172.21.15.177:49074) 2023-10-25T16:14:44.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 -- 172.21.15.177:0/1148582941 learned_addr learned my addr 172.21.15.177:0/1148582941 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:44.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3ca7fc640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3cc0adc50 0x7fa3cc0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3cb7fe640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3cc14b950 0x7fa3cc0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 -- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3cc14b950 msgr2=0x7fa3cc0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3cc14b950 0x7fa3cc0ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 -- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3cc0adc50 msgr2=0x7fa3cc0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:44.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3cc0adc50 0x7fa3cc0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:44.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 -- 172.21.15.177:0/1148582941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0ad170 con 0x7fa3b80047d0 2023-10-25T16:14:44.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3caffd640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3cc0cbdd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400e970 tx=0x7fa3c400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:44.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c400ccc0 con 0x7fa3b80047d0 2023-10-25T16:14:44.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3c400ce20 con 0x7fa3b80047d0 2023-10-25T16:14:44.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc0ad450 con 0x7fa3b80047d0 2023-10-25T16:14:44.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4005280 con 0x7fa3b80047d0 2023-10-25T16:14:44.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc0ae890 con 0x7fa3b80047d0 2023-10-25T16:14:44.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc04daf0 con 0x7fa3b80047d0 2023-10-25T16:14:44.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa3c40053e0 con 0x7fa3b80047d0 2023-10-25T16:14:44.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3c3fff640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3ac066470 0x7fa3ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:44.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3c4014070 con 0x7fa3b80047d0 2023-10-25T16:14:44.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.963+0000 7fa3ca7fc640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3ac066470 0x7fa3ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:44.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.967+0000 7fa3ca7fc640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3ac066470 0x7fa3ac068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ae000 tx=0x7fa3b401c3b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:44.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:44.967+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3c4051be0 con 0x7fa3b80047d0 2023-10-25T16:14:45.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.171+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa3cc0cd970 con 0x7fa3b80047d0 2023-10-25T16:14:45.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.171+0000 7fa3c3fff640 1 -- 172.21.15.177:0/1148582941 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa3c4055200 con 0x7fa3b80047d0 2023-10-25T16:14:45.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:45.177 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:14:45.177 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:14:45.177 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.178 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:14:45.178 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:14:45.178 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.178 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.178 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:45.181 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:45.181 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.182 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.182 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.182 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.183 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:14:45.183 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:14:45.183 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.183 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.184 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:45.184 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:45.184 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.185 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.185 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.185 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.186 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:14:45.186 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:14:45.187 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.187 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.187 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:45.188 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:45.188 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.188 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.189 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:14:45.190 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:14:45.190 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.190 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.191 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:45.191 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:45.191 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.191 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.192 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.192 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:14:45.192 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:14:45.193 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.193 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.193 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.193 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.193 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.194 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:14:45.194 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:14:45.194 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.195 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.195 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.195 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.195 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:14:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:14:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.196 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.197 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.197 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.197 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.197 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:14:45.198 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:14:45.198 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.198 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.198 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.198 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.199 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.199 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:14:45.199 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:14:45.200 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.200 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.200 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.200 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.200 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.201 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.201 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:14:45.201 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:14:45.201 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.202 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.202 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.202 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.202 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.203 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:14:45.203 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:14:45.203 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.203 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.204 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.204 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.204 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.204 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.205 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:14:45.205 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:14:45.205 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.205 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:14:45.206 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:14:45.206 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.206 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.207 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:14:45.207 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:14:45.207 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.207 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.207 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:14:45.207 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:14:45.208 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.208 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:14:45.208 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:14:45.209 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:45.209 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:45.209 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:45.210 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.210 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:14:45.210 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:14:45.211 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.211 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.211 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:45.211 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:45.211 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:45.212 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.212 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:14:45.212 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:14:45.213 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.213 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:14:45.213 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:14:45.213 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:14:45.213 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:14:45.213 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.214 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:14:45.214 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:14:45.214 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.215 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:14:45.215 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:14:45.215 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:14:45.215 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.216 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.216 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.216 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:14:45.216 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:14:45.217 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.217 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:14:45.217 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:14:45.217 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.217 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:14:45.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:45.218 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:14:45.218 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:14:45.218 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:14:45.219 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:14:45.219 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:14:45.219 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:14:45.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:45.219 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:14:45.220 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:14:45.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3ac066470 msgr2=0x7fa3ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3ac066470 0x7fa3ac068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ae000 tx=0x7fa3b401c3b0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 msgr2=0x7fa3cc0cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3cc0cbdd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400e970 tx=0x7fa3c400ee30 comp rx=0 tx=0).stop 2023-10-25T16:14:45.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 shutdown_connections 2023-10-25T16:14:45.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa3ac066470 0x7fa3ac068930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3cc14b950 0x7fa3cc0ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3cc0adc50 0x7fa3cc0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 --2- 172.21.15.177:0/1148582941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3b80047d0 0x7fa3cc0cbdd0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 >> 172.21.15.177:0/1148582941 conn(0x7fa3cc0b2450 msgr2=0x7fa3cc0c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:45.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 shutdown_connections 2023-10-25T16:14:45.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.175+0000 7fa3d1968640 1 -- 172.21.15.177:0/1148582941 wait complete. 2023-10-25T16:14:45.225 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:45.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 -- 172.21.15.177:0/3710413990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 msgr2=0x7fab0c06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 --2- 172.21.15.177:0/3710413990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c06ba50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fab000098f0 tx=0x7fab0001c830 comp rx=0 tx=0).stop 2023-10-25T16:14:45.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 -- 172.21.15.177:0/3710413990 shutdown_connections 2023-10-25T16:14:45.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 --2- 172.21.15.177:0/3710413990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c06ba50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 --2- 172.21.15.177:0/3710413990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab0c140cf0 0x7fab0c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 -- 172.21.15.177:0/3710413990 >> 172.21.15.177:0/3710413990 conn(0x7fab0c0b2450 msgr2=0x7fab0c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:45.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 -- 172.21.15.177:0/3710413990 shutdown_connections 2023-10-25T16:14:45.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.331+0000 7fab12cbb640 1 -- 172.21.15.177:0/3710413990 wait complete. 2023-10-25T16:14:45.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 Processor -- start 2023-10-25T16:14:45.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- start start 2023-10-25T16:14:45.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 0x7fab0c1369f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab0c140cf0 0x7fab0c13e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c15dd50 con 0x7fab0c06bf90 2023-10-25T16:14:45.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c13eae0 con 0x7fab0c06f570 2023-10-25T16:14:45.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c13edc0 con 0x7fab0c140cf0 2023-10-25T16:14:45.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 0x7fab0c1369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 0x7fab0c1369f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49088/0 (socket says 172.21.15.177:49088) 2023-10-25T16:14:45.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 -- 172.21.15.177:0/2413970968 learned_addr learned my addr 172.21.15.177:0/2413970968 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:45.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab11258640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab0c140cf0 0x7fab0c13e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab0bfff640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 -- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab0c140cf0 msgr2=0x7fab0c13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab0c140cf0 0x7fab0c13e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 -- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 msgr2=0x7fab0c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 -- 172.21.15.177:0/2413970968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00009500 con 0x7fab0c06bf90 2023-10-25T16:14:45.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab0bfff640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:45.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab10a57640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 0x7fab0c1369f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e7a0 tx=0x7faafc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:45.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc009590 con 0x7fab0c06bf90 2023-10-25T16:14:45.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faafc00cdb0 con 0x7fab0c06bf90 2023-10-25T16:14:45.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0c13f0a0 con 0x7fab0c06bf90 2023-10-25T16:14:45.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc010690 con 0x7fab0c06bf90 2023-10-25T16:14:45.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c13f660 con 0x7fab0c06bf90 2023-10-25T16:14:45.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.335+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c04daf0 con 0x7fab0c06bf90 2023-10-25T16:14:45.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.339+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faafc0107f0 con 0x7fab0c06bf90 2023-10-25T16:14:45.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.339+0000 7fab097fa640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faaf8066470 0x7faaf8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.339+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faafc014070 con 0x7fab0c06bf90 2023-10-25T16:14:45.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.339+0000 7fab0bfff640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faaf8066470 0x7faaf8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.339+0000 7fab0bfff640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faaf8066470 0x7faaf8068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab000af000 tx=0x7fab0001b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:45.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.343+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faafc050090 con 0x7fab0c06bf90 2023-10-25T16:14:45.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.487+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab0c0ca670 con 0x7fab0c06bf90 2023-10-25T16:14:45.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.487+0000 7fab097fa640 1 -- 172.21.15.177:0/2413970968 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12881 (secure 0 0 0) 0x7faafc051d60 con 0x7fab0c06bf90 2023-10-25T16:14:45.494 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:45.495 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:44.823592+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:45.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faaf8066470 msgr2=0x7faaf8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faaf8066470 0x7faaf8068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab000af000 tx=0x7fab0001b070 comp rx=0 tx=0).stop 2023-10-25T16:14:45.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 msgr2=0x7fab0c1369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 0x7fab0c1369f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7faafc00e7a0 tx=0x7faafc00ec60 comp rx=0 tx=0).stop 2023-10-25T16:14:45.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 shutdown_connections 2023-10-25T16:14:45.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faaf8066470 0x7faaf8068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab0c140cf0 0x7fab0c13e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab0c06f570 0x7fab0c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 --2- 172.21.15.177:0/2413970968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab0c06bf90 0x7fab0c1369f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 >> 172.21.15.177:0/2413970968 conn(0x7fab0c0b2450 msgr2=0x7fab0c13acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:45.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 shutdown_connections 2023-10-25T16:14:45.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.491+0000 7fab12cbb640 1 -- 172.21.15.177:0/2413970968 wait complete. 2023-10-25T16:14:45.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:14:45.512 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:14:45.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee335c640 1 -- 172.21.15.177:0/1620073997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 msgr2=0x7f6ec80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee335c640 1 --2- 172.21.15.177:0/1620073997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6ec80047d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00c260 tx=0x7f6ecc01f740 comp rx=0 tx=0).stop 2023-10-25T16:14:45.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee18f9640 1 -- 172.21.15.177:0/1620073997 reap_dead start 2023-10-25T16:14:45.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee335c640 1 -- 172.21.15.177:0/1620073997 shutdown_connections 2023-10-25T16:14:45.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee335c640 1 -- 172.21.15.177:0/1620073997 >> 172.21.15.177:0/1620073997 conn(0x7f6edc09a580 msgr2=0x7f6edc0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:45.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee335c640 1 -- 172.21.15.177:0/1620073997 shutdown_connections 2023-10-25T16:14:45.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.631+0000 7f6ee335c640 1 -- 172.21.15.177:0/1620073997 wait complete. 2023-10-25T16:14:45.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 Processor -- start 2023-10-25T16:14:45.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- start start 2023-10-25T16:14:45.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6edc0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6edc1564b0 0x7f6edc0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6edc1568d0 0x7f6edc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc158060 con 0x7f6ec8003fe0 2023-10-25T16:14:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc158340 con 0x7f6edc1568d0 2023-10-25T16:14:45.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc14f230 con 0x7f6edc1564b0 2023-10-25T16:14:45.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6edc0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6edc0b17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49108/0 (socket says 172.21.15.177:49108) 2023-10-25T16:14:45.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 -- 172.21.15.177:0/4234343085 learned_addr learned my addr 172.21.15.177:0/4234343085 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:45.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee08f7640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6edc1564b0 0x7f6edc0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee18f9640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6edc1568d0 0x7f6edc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 -- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6edc1564b0 msgr2=0x7f6edc0cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6edc1564b0 0x7f6edc0cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 -- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6edc1568d0 msgr2=0x7f6edc0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6edc1568d0 0x7f6edc0cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 -- 172.21.15.177:0/4234343085 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc14f510 con 0x7f6ec8003fe0 2023-10-25T16:14:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee10f8640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6edc0b17e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800f9d0 tx=0x7f6ed800fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800bcb0 con 0x7f6ec8003fe0 2023-10-25T16:14:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ed8011440 con 0x7f6ec8003fe0 2023-10-25T16:14:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc0b1d20 con 0x7f6ec8003fe0 2023-10-25T16:14:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8011810 con 0x7f6ec8003fe0 2023-10-25T16:14:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc14fa30 con 0x7f6ec8003fe0 2023-10-25T16:14:45.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc04daf0 con 0x7f6ec8003fe0 2023-10-25T16:14:45.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ed8011970 con 0x7f6ec8003fe0 2023-10-25T16:14:45.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.635+0000 7f6ed1ffb640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec00664a0 0x7f6ec0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.639+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ed8084860 con 0x7f6ec8003fe0 2023-10-25T16:14:45.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.639+0000 7f6ee08f7640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec00664a0 0x7f6ec0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.639+0000 7f6ee08f7640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec00664a0 0x7f6ec0068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0b0000 tx=0x7f6ecc005040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:45.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.643+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ed8051fa0 con 0x7f6ec8003fe0 2023-10-25T16:14:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6edc06ad00 con 0x7f6ec8003fe0 2023-10-25T16:14:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ed1ffb640 1 -- 172.21.15.177:0/4234343085 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ed80555c0 con 0x7f6ec8003fe0 2023-10-25T16:14:45.788 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:14:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec00664a0 msgr2=0x7f6ec0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec00664a0 0x7f6ec0068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0b0000 tx=0x7f6ecc005040 comp rx=0 tx=0).stop 2023-10-25T16:14:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 msgr2=0x7f6edc0b17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6edc0b17e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800f9d0 tx=0x7f6ed800fe90 comp rx=0 tx=0).stop 2023-10-25T16:14:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 shutdown_connections 2023-10-25T16:14:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec00664a0 0x7f6ec0068960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6edc1568d0 0x7f6edc0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6edc1564b0 0x7f6edc0cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 --2- 172.21.15.177:0/4234343085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec8003fe0 0x7f6edc0b17e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 >> 172.21.15.177:0/4234343085 conn(0x7f6edc09a580 msgr2=0x7f6edc0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 shutdown_connections 2023-10-25T16:14:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.783+0000 7f6ee335c640 1 -- 172.21.15.177:0/4234343085 wait complete. 2023-10-25T16:14:45.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:14:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/883792060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 msgr2=0x7f6dc40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/883792060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc40af5d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4142050 tx=0x7f6db401c550 comp rx=0 tx=0).stop 2023-10-25T16:14:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/883792060 shutdown_connections 2023-10-25T16:14:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/883792060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dc406bf90 0x7f6dc40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/883792060 >> v2:172.21.15.184:3300/0 conn(0x7f6dc406f570 0x7f6dc406ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/883792060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc40af5d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/883792060 >> 172.21.15.177:0/883792060 conn(0x7f6dc40b2450 msgr2=0x7f6dc40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/883792060 shutdown_connections 2023-10-25T16:14:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/883792060 wait complete. 2023-10-25T16:14:45.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 Processor -- start 2023-10-25T16:14:45.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.915+0000 7f6dc8ca1640 1 -- start start 2023-10-25T16:14:45.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dc406bf90 0x7f6dc4157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc406f570 0x7f6dc413a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc4137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4158b90 con 0x7f6dc4140cf0 2023-10-25T16:14:45.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4157f40 con 0x7f6dc406f570 2023-10-25T16:14:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4137170 con 0x7f6dc406bf90 2023-10-25T16:14:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc4137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc4137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49128/0 (socket says 172.21.15.177:49128) 2023-10-25T16:14:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 -- 172.21.15.177:0/3637104841 learned_addr learned my addr 172.21.15.177:0/3637104841 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 -- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dc406bf90 msgr2=0x7f6dc4157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dc406bf90 0x7f6dc4157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 -- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc406f570 msgr2=0x7f6dc413a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:45.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbbfff640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc406f570 0x7f6dc413a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc406f570 0x7f6dc413a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:45.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 -- 172.21.15.177:0/3637104841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4009560 con 0x7f6dc4140cf0 2023-10-25T16:14:45.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc2d9d640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc4137f30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00ca60 tx=0x7f6dbc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:45.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00adc0 con 0x7f6dc4140cf0 2023-10-25T16:14:45.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6dbc004c40 con 0x7f6dc4140cf0 2023-10-25T16:14:45.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc4137450 con 0x7f6dc4140cf0 2023-10-25T16:14:45.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc005020 con 0x7f6dc4140cf0 2023-10-25T16:14:45.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc4137a10 con 0x7f6dc4140cf0 2023-10-25T16:14:45.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc40c9780 con 0x7f6dc4140cf0 2023-10-25T16:14:45.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6dbc005180 con 0x7f6dc4140cf0 2023-10-25T16:14:45.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbaffd640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6da4066470 0x7f6da4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:45.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6dbc084370 con 0x7f6dc4140cf0 2023-10-25T16:14:45.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.919+0000 7f6dc259c640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6da4066470 0x7f6da4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:45.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.923+0000 7f6dc259c640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6da4066470 0x7f6da4068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6db40ae000 tx=0x7f6db40192f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:45.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:45.923+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6dbc051b40 con 0x7f6dc4140cf0 2023-10-25T16:14:46.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.079+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6dc4137c30 con 0x7f6dc4140cf0 2023-10-25T16:14:46.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.079+0000 7f6dbaffd640 1 -- 172.21.15.177:0/3637104841 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6dbc01d020 con 0x7f6dc4140cf0 2023-10-25T16:14:46.086 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:46.086 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:14:46.086 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:14:46.086 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:14:46.087 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:14:46.087 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:14:46.087 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:14:46.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6da4066470 msgr2=0x7f6da4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6da4066470 0x7f6da4068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6db40ae000 tx=0x7f6db40192f0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 msgr2=0x7f6dc4137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc4137f30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc00ca60 tx=0x7f6dbc00cf20 comp rx=0 tx=0).stop 2023-10-25T16:14:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 shutdown_connections 2023-10-25T16:14:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6da4066470 0x7f6da4068930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dc4140cf0 0x7f6dc4137f30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dc406f570 0x7f6dc413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 --2- 172.21.15.177:0/3637104841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dc406bf90 0x7f6dc4157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 >> 172.21.15.177:0/3637104841 conn(0x7f6dc40b2450 msgr2=0x7f6dc4070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:46.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 shutdown_connections 2023-10-25T16:14:46.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.083+0000 7f6dc8ca1640 1 -- 172.21.15.177:0/3637104841 wait complete. 2023-10-25T16:14:46.104 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:14:46.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:14:46.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/1225910739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 msgr2=0x7f0c5815fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/1225910739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5815fc60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b2d10 tx=0x7f0c5401c870 comp rx=0 tx=0).stop 2023-10-25T16:14:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/1225910739 shutdown_connections 2023-10-25T16:14:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/1225910739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c580cf830 0x7f0c580cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/1225910739 >> v2:172.21.15.184:3300/0 conn(0x7f0c580ccf00 0x7f0c580d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/1225910739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5815fc60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/1225910739 >> 172.21.15.177:0/1225910739 conn(0x7f0c5809a5b0 msgr2=0x7f0c580d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/1225910739 shutdown_connections 2023-10-25T16:14:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/1225910739 wait complete. 2023-10-25T16:14:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 Processor -- start 2023-10-25T16:14:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- start start 2023-10-25T16:14:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c580ccf00 0x7f0c580b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c580cf830 0x7f0c581536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58159fe0 con 0x7f0c5815b6f0 2023-10-25T16:14:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581593d0 con 0x7f0c580ccf00 2023-10-25T16:14:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c581596b0 con 0x7f0c580cf830 2023-10-25T16:14:46.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:46.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49142/0 (socket says 172.21.15.177:49142) 2023-10-25T16:14:46.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 -- 172.21.15.177:0/218135169 learned_addr learned my addr 172.21.15.177:0/218135169 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:46.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5d11d640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c580cf830 0x7f0c581536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:46.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 -- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c580cf830 msgr2=0x7f0c581536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5d91e640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c580ccf00 0x7f0c580b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:46.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c580cf830 0x7f0c581536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 -- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c580ccf00 msgr2=0x7f0c580b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c580ccf00 0x7f0c580b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 -- 172.21.15.177:0/218135169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54009560 con 0x7f0c5815b6f0 2023-10-25T16:14:46.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5e11f640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5814e220 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000ccb0 tx=0x7f0c5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:46.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50004b30 con 0x7f0c5815b6f0 2023-10-25T16:14:46.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c50004da0 con 0x7f0c5815b6f0 2023-10-25T16:14:46.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c58159990 con 0x7f0c5815b6f0 2023-10-25T16:14:46.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50005280 con 0x7f0c5815b6f0 2023-10-25T16:14:46.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.227+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c580b0690 con 0x7f0c5815b6f0 2023-10-25T16:14:46.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.231+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5815a190 con 0x7f0c5815b6f0 2023-10-25T16:14:46.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.231+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0c500053e0 con 0x7f0c5815b6f0 2023-10-25T16:14:46.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.231+0000 7f0c4e7fc640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c3c066470 0x7f0c3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.231+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0c500844c0 con 0x7f0c5815b6f0 2023-10-25T16:14:46.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.231+0000 7f0c5d91e640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c3c066470 0x7f0c3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:46.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.231+0000 7f0c5d91e640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c3c066470 0x7f0c3c068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c540af000 tx=0x7f0c5401b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:46.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.235+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c5815a190 con 0x7f0c5815b6f0 2023-10-25T16:14:46.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.375+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0c58073360 con 0x7f0c5815b6f0 2023-10-25T16:14:46.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.823+0000 7f0c4e7fc640 1 -- 172.21.15.177:0/218135169 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c5001d020 con 0x7f0c5815b6f0 2023-10-25T16:14:46.828 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:14:46.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c3c066470 msgr2=0x7f0c3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c3c066470 0x7f0c3c068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c540af000 tx=0x7f0c5401b0b0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 msgr2=0x7f0c5814e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5814e220 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000ccb0 tx=0x7f0c5000a620 comp rx=0 tx=0).stop 2023-10-25T16:14:46.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 shutdown_connections 2023-10-25T16:14:46.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c3c066470 0x7f0c3c068930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c5815b6f0 0x7f0c5814e220 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c580cf830 0x7f0c581536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 --2- 172.21.15.177:0/218135169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c580ccf00 0x7f0c580b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 >> 172.21.15.177:0/218135169 conn(0x7f0c5809a5b0 msgr2=0x7f0c5815e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:46.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 shutdown_connections 2023-10-25T16:14:46.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.827+0000 7f0c5fb82640 1 -- 172.21.15.177:0/218135169 wait complete. 2023-10-25T16:14:46.853 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:14:46.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 -- 172.21.15.177:0/1788436491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 msgr2=0x7fe680003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:46.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/1788436491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe680003da0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe690009b60 tx=0x7fe69001d250 comp rx=0 tx=0).stop 2023-10-25T16:14:46.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 -- 172.21.15.177:0/1788436491 shutdown_connections 2023-10-25T16:14:46.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/1788436491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe680003da0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:46.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 -- 172.21.15.177:0/1788436491 >> 172.21.15.177:0/1788436491 conn(0x7fe69408ac90 msgr2=0x7fe69409a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:46.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 -- 172.21.15.177:0/1788436491 shutdown_connections 2023-10-25T16:14:46.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.987+0000 7fe69bd6b640 1 -- 172.21.15.177:0/1788436491 wait complete. 2023-10-25T16:14:46.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 Processor -- start 2023-10-25T16:14:46.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- start start 2023-10-25T16:14:46.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe6940cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6940c8d30 0x7fe6940c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6940c4d60 0x7fe6940c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:46.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69415c510 con 0x7fe680003980 2023-10-25T16:14:46.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940c9d90 con 0x7fe6940c4d60 2023-10-25T16:14:46.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940c94f0 con 0x7fe6940c8d30 2023-10-25T16:14:46.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe6940cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:46.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe6940cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49158/0 (socket says 172.21.15.177:49158) 2023-10-25T16:14:46.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 -- 172.21.15.177:0/3213062891 learned_addr learned my addr 172.21.15.177:0/3213062891 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:47.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699306640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6940c8d30 0x7fe6940c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:47.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69a308640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6940c4d60 0x7fe6940c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:47.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 -- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6940c8d30 msgr2=0x7fe6940c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:47.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6940c8d30 0x7fe6940c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 -- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6940c4d60 msgr2=0x7fe6940c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6940c4d60 0x7fe6940c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 -- 172.21.15.177:0/3213062891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940c97d0 con 0x7fe680003980 2023-10-25T16:14:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69a308640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6940c4d60 0x7fe6940c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe699b07640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe6940cad20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe69001d080 tx=0x7fe690005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690004220 con 0x7fe680003980 2023-10-25T16:14:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe690004470 con 0x7fe680003980 2023-10-25T16:14:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6900049f0 con 0x7fe680003980 2023-10-25T16:14:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6940c9ab0 con 0x7fe680003980 2023-10-25T16:14:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6940c9190 con 0x7fe680003980 2023-10-25T16:14:47.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69404db20 con 0x7fe680003980 2023-10-25T16:14:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.991+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6900b3070 con 0x7fe680003980 2023-10-25T16:14:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.995+0000 7fe68a7fc640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe678066470 0x7fe678068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.995+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe69011e160 con 0x7fe680003980 2023-10-25T16:14:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.995+0000 7fe699306640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe678066470 0x7fe678068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.995+0000 7fe699306640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe678066470 0x7fe678068930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6840017b0 tx=0x7fe684001da0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:46.999+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6900eb7c0 con 0x7fe680003980 2023-10-25T16:14:47.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.151+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe6940b08f0 con 0x7fe680003980 2023-10-25T16:14:47.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.835+0000 7fe68a7fc640 1 -- 172.21.15.177:0/3213062891 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe6900b10d0 con 0x7fe680003980 2023-10-25T16:14:47.841 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:14:47.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe678066470 msgr2=0x7fe678068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:47.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe678066470 0x7fe678068930 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6840017b0 tx=0x7fe684001da0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 msgr2=0x7fe6940cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:47.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe6940cad20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe69001d080 tx=0x7fe690005520 comp rx=0 tx=0).stop 2023-10-25T16:14:47.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 shutdown_connections 2023-10-25T16:14:47.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe678066470 0x7fe678068930 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6940c4d60 0x7fe6940c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6940c8d30 0x7fe6940c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 --2- 172.21.15.177:0/3213062891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe680003980 0x7fe6940cad20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:47.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 >> 172.21.15.177:0/3213062891 conn(0x7fe69408ac90 msgr2=0x7fe694157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:47.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 shutdown_connections 2023-10-25T16:14:47.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.839+0000 7fe69bd6b640 1 -- 172.21.15.177:0/3213062891 wait complete. 2023-10-25T16:14:47.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:14:48.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 -- 172.21.15.177:0/4105769169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6406f570 msgr2=0x7f2f6406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:48.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/4105769169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6406f570 0x7f2f6406ba50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2f64141ee0 tx=0x7f2f5401c530 comp rx=0 tx=0).stop 2023-10-25T16:14:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 -- 172.21.15.177:0/4105769169 shutdown_connections 2023-10-25T16:14:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/4105769169 >> v2:172.21.15.184:3300/0 conn(0x7f2f6406bf90 0x7f2f640aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/4105769169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6406f570 0x7f2f6406ba50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/4105769169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f64140cf0 0x7f2f640af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 -- 172.21.15.177:0/4105769169 >> 172.21.15.177:0/4105769169 conn(0x7f2f640b2450 msgr2=0x7f2f640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:48.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 -- 172.21.15.177:0/4105769169 shutdown_connections 2023-10-25T16:14:48.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.995+0000 7f2f6b19f640 1 -- 172.21.15.177:0/4105769169 wait complete. 2023-10-25T16:14:48.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 Processor -- start 2023-10-25T16:14:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- start start 2023-10-25T16:14:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6406bf90 0x7f2f6413bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6406f570 0x7f2f64162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 0x7f2f6413a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:48.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6413c4f0 con 0x7f2f64140cf0 2023-10-25T16:14:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6415d210 con 0x7f2f6406f570 2023-10-25T16:14:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6413af10 con 0x7f2f6406bf90 2023-10-25T16:14:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 0x7f2f6413a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 0x7f2f6413a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49178/0 (socket says 172.21.15.177:49178) 2023-10-25T16:14:48.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 -- 172.21.15.177:0/1671295344 learned_addr learned my addr 172.21.15.177:0/1671295344 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f68f3b640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6406bf90 0x7f2f6413bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f63fff640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6406f570 0x7f2f64162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 -- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6406bf90 msgr2=0x7f2f6413bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6406bf90 0x7f2f6413bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 -- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6406f570 msgr2=0x7f2f64162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6406f570 0x7f2f64162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 -- 172.21.15.177:0/1671295344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009500 con 0x7f2f64140cf0 2023-10-25T16:14:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f63fff640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6406f570 0x7f2f64162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6973c640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 0x7f2f6413a3a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00b430 tx=0x7f2f4c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:48.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c011830 con 0x7f2f64140cf0 2023-10-25T16:14:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6413b1f0 con 0x7f2f64140cf0 2023-10-25T16:14:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f4c011a80 con 0x7f2f64140cf0 2023-10-25T16:14:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c011e90 con 0x7f2f64140cf0 2023-10-25T16:14:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6413b7b0 con 0x7f2f64140cf0 2023-10-25T16:14:48.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6404daf0 con 0x7f2f64140cf0 2023-10-25T16:14:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:47.999+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f4c01a400 con 0x7f2f64140cf0 2023-10-25T16:14:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.003+0000 7f2f617fa640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f44066470 0x7f2f44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.003+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2f4c0841d0 con 0x7f2f64140cf0 2023-10-25T16:14:48.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.003+0000 7f2f68f3b640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f44066470 0x7f2f44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:48.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.003+0000 7f2f68f3b640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f44066470 0x7f2f44068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009f20 tx=0x7f2f5c0094f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:48.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.007+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f4c0516c0 con 0x7f2f64140cf0 2023-10-25T16:14:48.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.195+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2f64141b30 con 0x7f2f64140cf0 2023-10-25T16:14:48.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.839+0000 7f2f617fa640 1 -- 172.21.15.177:0/1671295344 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2f4c054ce0 con 0x7f2f64140cf0 2023-10-25T16:14:48.844 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 6 and data pool 7 2023-10-25T16:14:48.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f44066470 msgr2=0x7f2f44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:48.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f44066470 0x7f2f44068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009f20 tx=0x7f2f5c0094f0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 msgr2=0x7f2f6413a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:48.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 0x7f2f6413a3a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00b430 tx=0x7f2f4c00b8f0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 shutdown_connections 2023-10-25T16:14:48.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f44066470 0x7f2f44068930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f64140cf0 0x7f2f6413a3a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6406f570 0x7f2f64162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 --2- 172.21.15.177:0/1671295344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6406bf90 0x7f2f6413bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:48.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 >> 172.21.15.177:0/1671295344 conn(0x7f2f640b2450 msgr2=0x7f2f64138720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:48.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 shutdown_connections 2023-10-25T16:14:48.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:48.843+0000 7f2f6b19f640 1 -- 172.21.15.177:0/1671295344 wait complete. 2023-10-25T16:14:48.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:49.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- 172.21.15.177:0/1787303450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0c9e70 msgr2=0x7fe46c15be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 --2- 172.21.15.177:0/1787303450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0c9e70 0x7fe46c15be10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe464009bc0 tx=0x7fe46401cb40 comp rx=0 tx=0).stop 2023-10-25T16:14:49.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- 172.21.15.177:0/1787303450 shutdown_connections 2023-10-25T16:14:49.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 --2- 172.21.15.177:0/1787303450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0c9e70 0x7fe46c15be10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- 172.21.15.177:0/1787303450 >> 172.21.15.177:0/1787303450 conn(0x7fe46c0af3f0 msgr2=0x7fe46c0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:49.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- 172.21.15.177:0/1787303450 shutdown_connections 2023-10-25T16:14:49.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- 172.21.15.177:0/1787303450 wait complete. 2023-10-25T16:14:49.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 Processor -- start 2023-10-25T16:14:49.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- start start 2023-10-25T16:14:49.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe46c0c9e70 0x7fe46c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 0x7fe46c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe46c157920 0x7fe46c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1563f0 con 0x7fe46c0cbd80 2023-10-25T16:14:49.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1557e0 con 0x7fe46c0c9e70 2023-10-25T16:14:49.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe47390d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c155ac0 con 0x7fe46c157920 2023-10-25T16:14:49.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe470ea8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 0x7fe46c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe470ea8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 0x7fe46c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49202/0 (socket says 172.21.15.177:49202) 2023-10-25T16:14:49.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe470ea8640 1 -- 172.21.15.177:0/4001759829 learned_addr learned my addr 172.21.15.177:0/4001759829 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:49.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.007+0000 7fe4716a9640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe46c0c9e70 0x7fe46c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe471eaa640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe46c157920 0x7fe46c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe470ea8640 1 -- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe46c157920 msgr2=0x7fe46c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe470ea8640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe46c157920 0x7fe46c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe470ea8640 1 -- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe46c0c9e70 msgr2=0x7fe46c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe470ea8640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe46c0c9e70 0x7fe46c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe470ea8640 1 -- 172.21.15.177:0/4001759829 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464009820 con 0x7fe46c0cbd80 2023-10-25T16:14:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe471eaa640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe46c157920 0x7fe46c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe470ea8640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 0x7fe46c15a1a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c450 tx=0x7fe45c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c012830 con 0x7fe46c0cbd80 2023-10-25T16:14:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe45c012aa0 con 0x7fe46c0cbd80 2023-10-25T16:14:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c155da0 con 0x7fe46c0cbd80 2023-10-25T16:14:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c011380 con 0x7fe46c0cbd80 2023-10-25T16:14:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c155460 con 0x7fe46c0cbd80 2023-10-25T16:14:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c156560 con 0x7fe46c0cbd80 2023-10-25T16:14:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe45c0114e0 con 0x7fe46c0cbd80 2023-10-25T16:14:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe461ffb640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe450066470 0x7fe450068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe45c083f90 con 0x7fe46c0cbd80 2023-10-25T16:14:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe4716a9640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe450066470 0x7fe450068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.011+0000 7fe4716a9640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe450066470 0x7fe450068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4680015e0 tx=0x7fe468009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:49.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.015+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe45c0b5090 con 0x7fe46c0cbd80 2023-10-25T16:14:49.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.171+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe46c04daf0 con 0x7fe46c0cbd80 2023-10-25T16:14:49.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.171+0000 7fe461ffb640 1 -- 172.21.15.177:0/4001759829 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16550 (secure 0 0 0) 0x7fe45c051410 con 0x7fe46c0cbd80 2023-10-25T16:14:49.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:49.178 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":47,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:48.199529+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:49.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe450066470 msgr2=0x7fe450068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe450066470 0x7fe450068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe4680015e0 tx=0x7fe468009040 comp rx=0 tx=0).stop 2023-10-25T16:14:49.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 msgr2=0x7fe46c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 0x7fe46c15a1a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00c450 tx=0x7fe45c00c910 comp rx=0 tx=0).stop 2023-10-25T16:14:49.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 shutdown_connections 2023-10-25T16:14:49.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe450066470 0x7fe450068930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe46c157920 0x7fe46c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe46c0cbd80 0x7fe46c15a1a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 --2- 172.21.15.177:0/4001759829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe46c0c9e70 0x7fe46c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 >> 172.21.15.177:0/4001759829 conn(0x7fe46c0af3f0 msgr2=0x7fe46c14e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:49.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 shutdown_connections 2023-10-25T16:14:49.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.175+0000 7fe47390d640 1 -- 172.21.15.177:0/4001759829 wait complete. 2023-10-25T16:14:49.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/3485118909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501590c0 msgr2=0x7f0e500c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 --2- 172.21.15.177:0/3485118909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501590c0 0x7f0e500c9bf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0e500b1960 tx=0x7f0e4001c750 comp rx=0 tx=0).stop 2023-10-25T16:14:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/3485118909 shutdown_connections 2023-10-25T16:14:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 --2- 172.21.15.177:0/3485118909 >> v2:172.21.15.184:3300/0 conn(0x7f0e5015cec0 0x7f0e500b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 --2- 172.21.15.177:0/3485118909 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501590c0 0x7f0e500c9bf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/3485118909 >> 172.21.15.177:0/3485118909 conn(0x7f0e500cefe0 msgr2=0x7f0e500cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/3485118909 shutdown_connections 2023-10-25T16:14:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/3485118909 wait complete. 2023-10-25T16:14:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 Processor -- start 2023-10-25T16:14:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- start start 2023-10-25T16:14:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e501590c0 0x7f0e50140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 0x7f0e50162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e5015cec0 0x7f0e5006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5006bb90 con 0x7f0e501594a0 2023-10-25T16:14:49.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e501632c0 con 0x7f0e5015cec0 2023-10-25T16:14:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5006af10 con 0x7f0e501590c0 2023-10-25T16:14:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 0x7f0e50162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 0x7f0e50162d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49222/0 (socket says 172.21.15.177:49222) 2023-10-25T16:14:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 -- 172.21.15.177:0/119580098 learned_addr learned my addr 172.21.15.177:0/119580098 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:49.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4f7fe640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e5015cec0 0x7f0e5006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4effd640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e501590c0 0x7f0e50140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 -- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e501590c0 msgr2=0x7f0e50140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e501590c0 0x7f0e50140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 -- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e5015cec0 msgr2=0x7f0e5006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e5015cec0 0x7f0e5006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 -- 172.21.15.177:0/119580098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400094a0 con 0x7f0e501594a0 2023-10-25T16:14:49.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e4e7fc640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 0x7f0e50162d80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0e440058d0 tx=0x7f0e4400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:49.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44009c30 con 0x7f0e501594a0 2023-10-25T16:14:49.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e44009e80 con 0x7f0e501594a0 2023-10-25T16:14:49.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440106a0 con 0x7f0e501594a0 2023-10-25T16:14:49.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5006b1f0 con 0x7f0e501594a0 2023-10-25T16:14:49.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.319+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5006b7b0 con 0x7f0e501594a0 2023-10-25T16:14:49.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.323+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5004daf0 con 0x7f0e501594a0 2023-10-25T16:14:49.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.323+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e44010800 con 0x7f0e501594a0 2023-10-25T16:14:49.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.323+0000 7f0e377fe640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e3c0664a0 0x7f0e3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.323+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e440842f0 con 0x7f0e501594a0 2023-10-25T16:14:49.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.323+0000 7f0e4effd640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e3c0664a0 0x7f0e3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.323+0000 7f0e4effd640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e3c0664a0 0x7f0e3c068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e400af000 tx=0x7f0e4001af90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:49.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.327+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e44051770 con 0x7f0e501594a0 2023-10-25T16:14:49.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.483+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e500aeaa0 con 0x7f0e501594a0 2023-10-25T16:14:49.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e377fe640 1 -- 172.21.15.177:0/119580098 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16550 (secure 0 0 0) 0x7f0e44054d90 con 0x7f0e501594a0 2023-10-25T16:14:49.492 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:49.492 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":47,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:48.199529+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:49.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e3c0664a0 msgr2=0x7f0e3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e3c0664a0 0x7f0e3c068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e400af000 tx=0x7f0e4001af90 comp rx=0 tx=0).stop 2023-10-25T16:14:49.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 msgr2=0x7f0e50162d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 0x7f0e50162d80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0e440058d0 tx=0x7f0e4400dde0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 shutdown_connections 2023-10-25T16:14:49.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e3c0664a0 0x7f0e3c068960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e5015cec0 0x7f0e5006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e501594a0 0x7f0e50162d80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 --2- 172.21.15.177:0/119580098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e501590c0 0x7f0e50140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 >> 172.21.15.177:0/119580098 conn(0x7f0e500cefe0 msgr2=0x7f0e500ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:49.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 shutdown_connections 2023-10-25T16:14:49.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.487+0000 7f0e55599640 1 -- 172.21.15.177:0/119580098 wait complete. 2023-10-25T16:14:49.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:14:49.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 -- 172.21.15.177:0/2110427811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 msgr2=0x7f61040cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 --2- 172.21.15.177:0/2110427811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f61040cdfc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009bc0 tx=0x7f60fc01caf0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 -- 172.21.15.177:0/2110427811 shutdown_connections 2023-10-25T16:14:49.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 --2- 172.21.15.177:0/2110427811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f61040cdfc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 --2- 172.21.15.177:0/2110427811 >> v2:172.21.15.184:3300/0 conn(0x7f610415eba0 0x7f61040b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 -- 172.21.15.177:0/2110427811 >> 172.21.15.177:0/2110427811 conn(0x7f610409a5c0 msgr2=0x7f61040d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:49.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 -- 172.21.15.177:0/2110427811 shutdown_connections 2023-10-25T16:14:49.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.635+0000 7f610c40a640 1 -- 172.21.15.177:0/2110427811 wait complete. 2023-10-25T16:14:49.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 Processor -- start 2023-10-25T16:14:49.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 -- start start 2023-10-25T16:14:49.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61040b2120 0x7f61041518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f610406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 0x7f610406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61040c8730 con 0x7f610415eba0 2023-10-25T16:14:49.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104151e10 con 0x7f61040b2120 2023-10-25T16:14:49.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61040c4f70 con 0x7f61040cdb10 2023-10-25T16:14:49.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 0x7f610406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 0x7f610406b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49230/0 (socket says 172.21.15.177:49230) 2023-10-25T16:14:49.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 -- 172.21.15.177:0/3267480519 learned_addr learned my addr 172.21.15.177:0/3267480519 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:49.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a1a6640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61040b2120 0x7f61041518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f61099a5640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f610406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 -- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 msgr2=0x7f610406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f610406ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 -- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61040b2120 msgr2=0x7f61041518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61040b2120 0x7f61041518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 -- 172.21.15.177:0/3267480519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009560 con 0x7f610415eba0 2023-10-25T16:14:49.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f61099a5640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f610406ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:49.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610a9a7640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 0x7f610406b3c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009b10 tx=0x7f60fc0a5860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:49.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc003980 con 0x7f610415eba0 2023-10-25T16:14:49.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc009820 con 0x7f610415eba0 2023-10-25T16:14:49.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f60fc003bd0 con 0x7f610415eba0 2023-10-25T16:14:49.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc004030 con 0x7f610415eba0 2023-10-25T16:14:49.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.639+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61040c54f0 con 0x7f610415eba0 2023-10-25T16:14:49.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.643+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610404daf0 con 0x7f610415eba0 2023-10-25T16:14:49.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.643+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60fc0b4040 con 0x7f610415eba0 2023-10-25T16:14:49.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.643+0000 7f60faffd640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60e80664a0 0x7f60e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.643+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60fc11e550 con 0x7f610415eba0 2023-10-25T16:14:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.643+0000 7f610a1a6640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60e80664a0 0x7f60e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.643+0000 7f610a1a6640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60e80664a0 0x7f60e8068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6100009c60 tx=0x7f6100009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:49.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.647+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60fc0eb950 con 0x7f610415eba0 2023-10-25T16:14:49.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.823+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f61040ce930 con 0x7f610415eba0 2023-10-25T16:14:49.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.883+0000 7f60faffd640 1 -- 172.21.15.177:0/3267480519 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f60fc0eef70 con 0x7f610415eba0 2023-10-25T16:14:49.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60e80664a0 msgr2=0x7f60e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60e80664a0 0x7f60e8068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6100009c60 tx=0x7f6100009260 comp rx=0 tx=0).stop 2023-10-25T16:14:49.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 msgr2=0x7f610406b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:49.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 0x7f610406b3c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009b10 tx=0x7f60fc0a5860 comp rx=0 tx=0).stop 2023-10-25T16:14:49.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 shutdown_connections 2023-10-25T16:14:49.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60e80664a0 0x7f60e8068960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f610415eba0 0x7f610406b3c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61040cdb10 0x7f610406ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 --2- 172.21.15.177:0/3267480519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61040b2120 0x7f61041518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 >> 172.21.15.177:0/3267480519 conn(0x7f610409a5c0 msgr2=0x7f610415c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 shutdown_connections 2023-10-25T16:14:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:49.887+0000 7f610c40a640 1 -- 172.21.15.177:0/3267480519 wait complete. 2023-10-25T16:14:49.909 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:14:49.909 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:14:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/2257978806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140cca30 msgr2=0x7ff2140cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 --2- 172.21.15.177:0/2257978806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140cca30 0x7ff2140cce90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff204009900 tx=0x7ff20401c7c0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/2257978806 shutdown_connections 2023-10-25T16:14:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 --2- 172.21.15.177:0/2257978806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140cca30 0x7ff2140cce90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/2257978806 >> 172.21.15.177:0/2257978806 conn(0x7ff2140ce000 msgr2=0x7ff2140ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/2257978806 shutdown_connections 2023-10-25T16:14:50.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/2257978806 wait complete. 2023-10-25T16:14:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 Processor -- start 2023-10-25T16:14:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- start start 2023-10-25T16:14:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 0x7ff214147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2140cca30 0x7ff21414a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff214155db0 0x7ff21414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:50.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214156900 con 0x7ff2140c93f0 2023-10-25T16:14:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406c980 con 0x7ff214155db0 2023-10-25T16:14:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406cc60 con 0x7ff2140cca30 2023-10-25T16:14:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 0x7ff214147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 0x7ff214147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49248/0 (socket says 172.21.15.177:49248) 2023-10-25T16:14:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 -- 172.21.15.177:0/3519107051 learned_addr learned my addr 172.21.15.177:0/3519107051 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:50.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21900b640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2140cca30 0x7ff21414a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 -- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2140cca30 msgr2=0x7ff21414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2140cca30 0x7ff21414a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 -- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff214155db0 msgr2=0x7ff21414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff214155db0 0x7ff21414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 -- 172.21.15.177:0/3519107051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009560 con 0x7ff2140c93f0 2023-10-25T16:14:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21980c640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 0x7ff214147c20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00b410 tx=0x7ff20c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c004020 con 0x7ff2140c93f0 2023-10-25T16:14:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff20c004270 con 0x7ff2140c93f0 2023-10-25T16:14:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c011890 con 0x7ff2140c93f0 2023-10-25T16:14:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21406cf40 con 0x7ff2140c93f0 2023-10-25T16:14:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.035+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21406d500 con 0x7ff2140c93f0 2023-10-25T16:14:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.039+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21406fe60 con 0x7ff2140c93f0 2023-10-25T16:14:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.039+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff20c003600 con 0x7ff2140c93f0 2023-10-25T16:14:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.039+0000 7ff20a7fc640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff1f8066470 0x7ff1f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.039+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff20c083750 con 0x7ff2140c93f0 2023-10-25T16:14:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.039+0000 7ff21900b640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff1f8066470 0x7ff1f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.039+0000 7ff21900b640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff1f8066470 0x7ff1f8068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2040af000 tx=0x7ff20401b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.043+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff20c050c60 con 0x7ff2140c93f0 2023-10-25T16:14:50.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.231+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff21406d720 con 0x7ff2140c93f0 2023-10-25T16:14:50.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.895+0000 7ff20a7fc640 1 -- 172.21.15.177:0/3519107051 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff20c054280 con 0x7ff2140c93f0 2023-10-25T16:14:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff1f8066470 msgr2=0x7ff1f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff1f8066470 0x7ff1f8068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2040af000 tx=0x7ff20401b000 comp rx=0 tx=0).stop 2023-10-25T16:14:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 msgr2=0x7ff214147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 0x7ff214147c20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00b410 tx=0x7ff20c00b8d0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 shutdown_connections 2023-10-25T16:14:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff1f8066470 0x7ff1f8068930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff214155db0 0x7ff21414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2140cca30 0x7ff21414a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 --2- 172.21.15.177:0/3519107051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2140c93f0 0x7ff214147c20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 >> 172.21.15.177:0/3519107051 conn(0x7ff2140ce000 msgr2=0x7ff2140ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 shutdown_connections 2023-10-25T16:14:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:50.899+0000 7ff21ba70640 1 -- 172.21.15.177:0/3519107051 wait complete. 2023-10-25T16:14:50.924 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:14:50.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:14:50.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-25T16:14:50.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-25T16:14:51.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- 172.21.15.177:0/3969501940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 msgr2=0x7f161815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 --2- 172.21.15.177:0/3969501940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f161815c810 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1610009cb0 tx=0x7f161001ccd0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- 172.21.15.177:0/3969501940 shutdown_connections 2023-10-25T16:14:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 --2- 172.21.15.177:0/3969501940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f161815c810 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 --2- 172.21.15.177:0/3969501940 >> v2:172.21.15.184:3300/0 conn(0x7f161815b710 0x7f161813d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- 172.21.15.177:0/3969501940 >> 172.21.15.177:0/3969501940 conn(0x7f16180b2450 msgr2=0x7f16180b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- 172.21.15.177:0/3969501940 shutdown_connections 2023-10-25T16:14:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- 172.21.15.177:0/3969501940 wait complete. 2023-10-25T16:14:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 Processor -- start 2023-10-25T16:14:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- start start 2023-10-25T16:14:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16180af5d0 0x7f161813fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f161815b710 0x7f1618138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f16180aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161813a710 con 0x7f161815c3a0 2023-10-25T16:14:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16181391b0 con 0x7f16180af5d0 2023-10-25T16:14:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f162065f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180aa9e0 con 0x7f161815b710 2023-10-25T16:14:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f16180aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f16180aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56240/0 (socket says 172.21.15.177:56240) 2023-10-25T16:14:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 -- 172.21.15.177:0/1322005308 learned_addr learned my addr 172.21.15.177:0/1322005308 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161e3fb640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16180af5d0 0x7f161813fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161dbfa640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f161815b710 0x7f1618138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 -- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f161815b710 msgr2=0x7f1618138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f161815b710 0x7f1618138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 -- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16180af5d0 msgr2=0x7f161813fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16180af5d0 0x7f161813fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 -- 172.21.15.177:0/1322005308 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100098e0 con 0x7f161815c3a0 2023-10-25T16:14:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f161ebfc640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f16180aba80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f161001a900 tx=0x7f1610004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610003d90 con 0x7f161815c3a0 2023-10-25T16:14:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.051+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1610004e90 con 0x7f161815c3a0 2023-10-25T16:14:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16180aacc0 con 0x7f161815c3a0 2023-10-25T16:14:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610004290 con 0x7f161815c3a0 2023-10-25T16:14:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16180ab280 con 0x7f161815c3a0 2023-10-25T16:14:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161804daf0 con 0x7f161815c3a0 2023-10-25T16:14:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f16100b4040 con 0x7f161815c3a0 2023-10-25T16:14:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f160effd640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15fc066470 0x7f15fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f161011e3a0 con 0x7f161815c3a0 2023-10-25T16:14:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f161e3fb640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15fc066470 0x7f15fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.055+0000 7f161e3fb640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15fc066470 0x7f15fc068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1614006fd0 tx=0x7f1614008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.059+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f16100eb8b0 con 0x7f161815c3a0 2023-10-25T16:14:51.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f161813c0e0 con 0x7f161815c3a0 2023-10-25T16:14:51.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f160effd640 1 -- 172.21.15.177:0/1322005308 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f16100eeed0 con 0x7f161815c3a0 2023-10-25T16:14:51.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:51.252 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:14:51.253 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:14:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15fc066470 msgr2=0x7f15fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15fc066470 0x7f15fc068930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1614006fd0 tx=0x7f1614008040 comp rx=0 tx=0).stop 2023-10-25T16:14:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 msgr2=0x7f16180aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f16180aba80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f161001a900 tx=0x7f1610004ca0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 shutdown_connections 2023-10-25T16:14:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f15fc066470 0x7f15fc068930 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f161815c3a0 0x7f16180aba80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f161815b710 0x7f1618138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 --2- 172.21.15.177:0/1322005308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f16180af5d0 0x7f161813fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.247+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 >> 172.21.15.177:0/1322005308 conn(0x7f16180b2450 msgr2=0x7f161806ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:51.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.251+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 shutdown_connections 2023-10-25T16:14:51.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.251+0000 7f162065f640 1 -- 172.21.15.177:0/1322005308 wait complete. 2023-10-25T16:14:51.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:14:51.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/1663476644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f800accf0 msgr2=0x7f7f80070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- 172.21.15.177:0/1663476644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f800accf0 0x7f7f80070160 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7f800b3860 tx=0x7f7f6801c870 comp rx=0 tx=0).stop 2023-10-25T16:14:51.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/1663476644 shutdown_connections 2023-10-25T16:14:51.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- 172.21.15.177:0/1663476644 >> v2:172.21.15.184:3300/0 conn(0x7f7f8006bde0 0x7f7f8006c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- 172.21.15.177:0/1663476644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f800accf0 0x7f7f80070160 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- 172.21.15.177:0/1663476644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f8006fd80 0x7f7f800cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/1663476644 >> 172.21.15.177:0/1663476644 conn(0x7f7f800af3f0 msgr2=0x7f7f800af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:51.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/1663476644 shutdown_connections 2023-10-25T16:14:51.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/1663476644 wait complete. 2023-10-25T16:14:51.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 Processor -- start 2023-10-25T16:14:51.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- start start 2023-10-25T16:14:51.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 0x7f7f8014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f8006fd80 0x7f7f80147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f800accf0 0x7f7f800b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800b11d0 con 0x7f7f8006bde0 2023-10-25T16:14:51.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800b14b0 con 0x7f7f800accf0 2023-10-25T16:14:51.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800b1790 con 0x7f7f8006fd80 2023-10-25T16:14:51.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 0x7f7f8014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 0x7f7f8014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56260/0 (socket says 172.21.15.177:56260) 2023-10-25T16:14:51.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 -- 172.21.15.177:0/519420560 learned_addr learned my addr 172.21.15.177:0/519420560 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:51.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7dd9b640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f8006fd80 0x7f7f80147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7ed9d640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f800accf0 0x7f7f800b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 -- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f8006fd80 msgr2=0x7f7f80147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f8006fd80 0x7f7f80147010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 -- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f800accf0 msgr2=0x7f7f800b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f800accf0 0x7f7f800b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 -- 172.21.15.177:0/519420560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009560 con 0x7f7f8006bde0 2023-10-25T16:14:51.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f7e59c640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 0x7f7f8014ea40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800ccb0 tx=0x7f7f7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:51.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78004b30 con 0x7f7f8006bde0 2023-10-25T16:14:51.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f78004d80 con 0x7f7f8006bde0 2023-10-25T16:14:51.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f800b1a70 con 0x7f7f8006bde0 2023-10-25T16:14:51.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78005280 con 0x7f7f8006bde0 2023-10-25T16:14:51.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.391+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8014ef80 con 0x7f7f8006bde0 2023-10-25T16:14:51.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.395+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f800b1cb0 con 0x7f7f8006bde0 2023-10-25T16:14:51.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.395+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7f780053e0 con 0x7f7f8006bde0 2023-10-25T16:14:51.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.395+0000 7f7f76ffd640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f60066470 0x7f7f60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.395+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f78084730 con 0x7f7f8006bde0 2023-10-25T16:14:51.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.395+0000 7f7f7dd9b640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f60066470 0x7f7f60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.395+0000 7f7f7dd9b640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f60066470 0x7f7f60068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f680af000 tx=0x7f7f6801b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:51.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.399+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7f800b1cb0 con 0x7f7f8006bde0 2023-10-25T16:14:51.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.551+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f800b1cb0 con 0x7f7f8006bde0 2023-10-25T16:14:51.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.555+0000 7f7f76ffd640 1 -- 172.21.15.177:0/519420560 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f7f800b1cb0 con 0x7f7f8006bde0 2023-10-25T16:14:51.561 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:51.561 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":48,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:14:49.842616+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:14:51.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f60066470 msgr2=0x7f7f60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f60066470 0x7f7f60068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f680af000 tx=0x7f7f6801b0b0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 msgr2=0x7f7f8014ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 0x7f7f8014ea40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800ccb0 tx=0x7f7f7800a620 comp rx=0 tx=0).stop 2023-10-25T16:14:51.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 shutdown_connections 2023-10-25T16:14:51.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f60066470 0x7f7f60068930 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f800accf0 0x7f7f800b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f8006fd80 0x7f7f80147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 --2- 172.21.15.177:0/519420560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f8006bde0 0x7f7f8014ea40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 >> 172.21.15.177:0/519420560 conn(0x7f7f800af3f0 msgr2=0x7f7f800ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:51.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 shutdown_connections 2023-10-25T16:14:51.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.559+0000 7f7f84bed640 1 -- 172.21.15.177:0/519420560 wait complete. 2023-10-25T16:14:51.580 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:14:51.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:51.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/3363179878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb080cbfa0 msgr2=0x7ffb080aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/3363179878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb080cbfa0 0x7ffb080aebc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ffb0806c7b0 tx=0x7ffb0401c7c0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/3363179878 shutdown_connections 2023-10-25T16:14:51.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/3363179878 >> v2:172.21.15.184:3300/0 conn(0x7ffb080af100 0x7ffb08158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/3363179878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb080cbfa0 0x7ffb080aebc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/3363179878 >> 172.21.15.177:0/3363179878 conn(0x7ffb080b2450 msgr2=0x7ffb080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:51.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/3363179878 shutdown_connections 2023-10-25T16:14:51.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/3363179878 wait complete. 2023-10-25T16:14:51.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 Processor -- start 2023-10-25T16:14:51.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- start start 2023-10-25T16:14:51.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb080af100 0x7ffb0814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb080cbfa0 0x7ffb0814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 0x7ffb0814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08153250 con 0x7ffb0814e810 2023-10-25T16:14:51.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08152610 con 0x7ffb080af100 2023-10-25T16:14:51.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081528b0 con 0x7ffb080cbfa0 2023-10-25T16:14:51.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 0x7ffb0814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 0x7ffb0814f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56286/0 (socket says 172.21.15.177:56286) 2023-10-25T16:14:51.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 -- 172.21.15.177:0/2987552131 learned_addr learned my addr 172.21.15.177:0/2987552131 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:51.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0c93b640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb080cbfa0 0x7ffb0814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d13c640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb080af100 0x7ffb0814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 -- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb080cbfa0 msgr2=0x7ffb0814f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb080cbfa0 0x7ffb0814f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 -- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb080af100 msgr2=0x7ffb0814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb080af100 0x7ffb0814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 -- 172.21.15.177:0/2987552131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009450 con 0x7ffb0814e810 2023-10-25T16:14:51.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d13c640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb080af100 0x7ffb0814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:51.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0d93d640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 0x7ffb0814f910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b970 tx=0x7ffb0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:51.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000cb40 con 0x7ffb0814e810 2023-10-25T16:14:51.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb0000cdb0 con 0x7ffb0814e810 2023-10-25T16:14:51.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb08152b90 con 0x7ffb0814e810 2023-10-25T16:14:51.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.691+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb000146a0 con 0x7ffb0814e810 2023-10-25T16:14:51.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb08150b60 con 0x7ffb0814e810 2023-10-25T16:14:51.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb08153390 con 0x7ffb0814e810 2023-10-25T16:14:51.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb0001d3b0 con 0x7ffb0814e810 2023-10-25T16:14:51.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffafdffb640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffaec066470 0x7ffaec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:51.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb00084100 con 0x7ffb0814e810 2023-10-25T16:14:51.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffb0d13c640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffaec066470 0x7ffaec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:51.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.695+0000 7ffb0d13c640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffaec066470 0x7ffaec068930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb080acb20 tx=0x7ffaf8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:51.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.699+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb08153390 con 0x7ffb0814e810 2023-10-25T16:14:51.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.839+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb08153390 con 0x7ffaec066470 2023-10-25T16:14:51.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.855+0000 7ffafdffb640 1 -- 172.21.15.177:0/2987552131 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282690 (secure 0 0 0) 0x7ffb08153390 con 0x7ffaec066470 2023-10-25T16:14:51.865 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:51.868 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:51.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffaec066470 msgr2=0x7ffaec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffaec066470 0x7ffaec068930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb080acb20 tx=0x7ffaf8009040 comp rx=0 tx=0).stop 2023-10-25T16:14:51.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 msgr2=0x7ffb0814f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:51.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 0x7ffb0814f910 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b970 tx=0x7ffb0000be30 comp rx=0 tx=0).stop 2023-10-25T16:14:51.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 shutdown_connections 2023-10-25T16:14:51.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffaec066470 0x7ffaec068930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb0814e810 0x7ffb0814f910 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb080cbfa0 0x7ffb0814f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 --2- 172.21.15.177:0/2987552131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb080af100 0x7ffb0814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:51.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 >> 172.21.15.177:0/2987552131 conn(0x7ffb080b2450 msgr2=0x7ffb08158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:51.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 shutdown_connections 2023-10-25T16:14:51.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:51.859+0000 7ffb0f3a0640 1 -- 172.21.15.177:0/2987552131 wait complete. 2023-10-25T16:14:51.881 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-10-25T16:14:50.640460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2877,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559622,"statfs":{"total":1600000000,"available":1597053721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001090"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.862030+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:48.862030+0000","last_peered":"2023-10-25T16:14:48.862030+0000","last_clean":"2023-10-25T16:14:48.862030+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:48.862030+0000","last_undegraded":"2023-10-25T16:14:48.862030+0000","last_fullsized":"2023-10-25T16:14:48.862030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886809+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:48.886809+0000","last_peered":"2023-10-25T16:14:48.886809+0000","last_clean":"2023-10-25T16:14:48.886809+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:48.886809+0000","last_undegraded":"2023-10-25T16:14:48.886809+0000","last_fullsized":"2023-10-25T16:14:48.886809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879850+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:48.879850+0000","last_peered":"2023-10-25T16:14:48.879850+0000","last_clean":"2023-10-25T16:14:48.879850+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:48.879850+0000","last_undegraded":"2023-10-25T16:14:48.879850+0000","last_fullsized":"2023-10-25T16:14:48.879850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868897+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:48.868897+0000","last_peered":"2023-10-25T16:14:48.868897+0000","last_clean":"2023-10-25T16:14:48.868897+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:48.868897+0000","last_undegraded":"2023-10-25T16:14:48.868897+0000","last_fullsized":"2023-10-25T16:14:48.868897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869762+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:48.869762+0000","last_peered":"2023-10-25T16:14:48.869762+0000","last_clean":"2023-10-25T16:14:48.869762+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:48.869762+0000","last_undegraded":"2023-10-25T16:14:48.869762+0000","last_fullsized":"2023-10-25T16:14:48.869762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874074+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:48.874074+0000","last_peered":"2023-10-25T16:14:48.874074+0000","last_clean":"2023-10-25T16:14:48.874074+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:48.874074+0000","last_undegraded":"2023-10-25T16:14:48.874074+0000","last_fullsized":"2023-10-25T16:14:48.874074+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.704168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876691+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:48.876691+0000","last_peered":"2023-10-25T16:14:48.876691+0000","last_clean":"2023-10-25T16:14:48.876691+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:48.876691+0000","last_undegraded":"2023-10-25T16:14:48.876691+0000","last_fullsized":"2023-10-25T16:14:48.876691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864126+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:48.864126+0000","last_peered":"2023-10-25T16:14:48.864126+0000","last_clean":"2023-10-25T16:14:48.864126+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:48.864126+0000","last_undegraded":"2023-10-25T16:14:48.864126+0000","last_fullsized":"2023-10-25T16:14:48.864126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883567+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:48.883567+0000","last_peered":"2023-10-25T16:14:48.883567+0000","last_clean":"2023-10-25T16:14:48.883567+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:48.883567+0000","last_undegraded":"2023-10-25T16:14:48.883567+0000","last_fullsized":"2023-10-25T16:14:48.883567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864627+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:48.864627+0000","last_peered":"2023-10-25T16:14:48.864627+0000","last_clean":"2023-10-25T16:14:48.864627+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:48.864627+0000","last_undegraded":"2023-10-25T16:14:48.864627+0000","last_fullsized":"2023-10-25T16:14:48.864627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883250+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:48.883250+0000","last_peered":"2023-10-25T16:14:48.883250+0000","last_clean":"2023-10-25T16:14:48.883250+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:48.883250+0000","last_undegraded":"2023-10-25T16:14:48.883250+0000","last_fullsized":"2023-10-25T16:14:48.883250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881599+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:48.881599+0000","last_peered":"2023-10-25T16:14:48.881599+0000","last_clean":"2023-10-25T16:14:48.881599+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:48.881599+0000","last_undegraded":"2023-10-25T16:14:48.881599+0000","last_fullsized":"2023-10-25T16:14:48.881599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.885307+0000","last_change":"2023-10-25T16:14:48.884361+0000","last_active":"2023-10-25T16:14:48.885307+0000","last_peered":"2023-10-25T16:14:48.885307+0000","last_clean":"2023-10-25T16:14:48.885307+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:48.885307+0000","last_undegraded":"2023-10-25T16:14:48.885307+0000","last_fullsized":"2023-10-25T16:14:48.885307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876262+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:48.876262+0000","last_peered":"2023-10-25T16:14:48.876262+0000","last_clean":"2023-10-25T16:14:48.876262+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:48.876262+0000","last_undegraded":"2023-10-25T16:14:48.876262+0000","last_fullsized":"2023-10-25T16:14:48.876262+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884903+0000","last_change":"2023-10-25T16:14:48.884844+0000","last_active":"2023-10-25T16:14:48.884903+0000","last_peered":"2023-10-25T16:14:48.884903+0000","last_clean":"2023-10-25T16:14:48.884903+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:48.884903+0000","last_undegraded":"2023-10-25T16:14:48.884903+0000","last_fullsized":"2023-10-25T16:14:48.884903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868577+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:48.868577+0000","last_peered":"2023-10-25T16:14:48.868577+0000","last_clean":"2023-10-25T16:14:48.868577+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:48.868577+0000","last_undegraded":"2023-10-25T16:14:48.868577+0000","last_fullsized":"2023-10-25T16:14:48.868577+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877481+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:48.877481+0000","last_peered":"2023-10-25T16:14:48.877481+0000","last_clean":"2023-10-25T16:14:48.877481+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:48.877481+0000","last_undegraded":"2023-10-25T16:14:48.877481+0000","last_fullsized":"2023-10-25T16:14:48.877481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873219+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:48.873219+0000","last_peered":"2023-10-25T16:14:48.873219+0000","last_clean":"2023-10-25T16:14:48.873219+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:48.873219+0000","last_undegraded":"2023-10-25T16:14:48.873219+0000","last_fullsized":"2023-10-25T16:14:48.873219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869215+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:48.869215+0000","last_peered":"2023-10-25T16:14:48.869215+0000","last_clean":"2023-10-25T16:14:48.869215+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:48.869215+0000","last_undegraded":"2023-10-25T16:14:48.869215+0000","last_fullsized":"2023-10-25T16:14:48.869215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:54.213888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883301+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:48.883301+0000","last_peered":"2023-10-25T16:14:48.883301+0000","last_clean":"2023-10-25T16:14:48.883301+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:48.883301+0000","last_undegraded":"2023-10-25T16:14:48.883301+0000","last_fullsized":"2023-10-25T16:14:48.883301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865001+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:48.865001+0000","last_peered":"2023-10-25T16:14:48.865001+0000","last_clean":"2023-10-25T16:14:48.865001+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:48.865001+0000","last_undegraded":"2023-10-25T16:14:48.865001+0000","last_fullsized":"2023-10-25T16:14:48.865001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:15.704551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875694+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:48.875694+0000","last_peered":"2023-10-25T16:14:48.875694+0000","last_clean":"2023-10-25T16:14:48.875694+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:48.875694+0000","last_undegraded":"2023-10-25T16:14:48.875694+0000","last_fullsized":"2023-10-25T16:14:48.875694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879591+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:48.879591+0000","last_peered":"2023-10-25T16:14:48.879591+0000","last_clean":"2023-10-25T16:14:48.879591+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:48.879591+0000","last_undegraded":"2023-10-25T16:14:48.879591+0000","last_fullsized":"2023-10-25T16:14:48.879591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:33:21.460992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868627+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:48.868627+0000","last_peered":"2023-10-25T16:14:48.868627+0000","last_clean":"2023-10-25T16:14:48.868627+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:48.868627+0000","last_undegraded":"2023-10-25T16:14:48.868627+0000","last_fullsized":"2023-10-25T16:14:48.868627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881624+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:48.881624+0000","last_peered":"2023-10-25T16:14:48.881624+0000","last_clean":"2023-10-25T16:14:48.881624+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:48.881624+0000","last_undegraded":"2023-10-25T16:14:48.881624+0000","last_fullsized":"2023-10-25T16:14:48.881624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879135+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:48.879135+0000","last_peered":"2023-10-25T16:14:48.879135+0000","last_clean":"2023-10-25T16:14:48.879135+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:48.879135+0000","last_undegraded":"2023-10-25T16:14:48.879135+0000","last_fullsized":"2023-10-25T16:14:48.879135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860777+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:48.860777+0000","last_peered":"2023-10-25T16:14:48.860777+0000","last_clean":"2023-10-25T16:14:48.860777+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:48.860777+0000","last_undegraded":"2023-10-25T16:14:48.860777+0000","last_fullsized":"2023-10-25T16:14:48.860777+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.870390+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:48.870390+0000","last_peered":"2023-10-25T16:14:48.870390+0000","last_clean":"2023-10-25T16:14:48.870390+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:48.870390+0000","last_undegraded":"2023-10-25T16:14:48.870390+0000","last_fullsized":"2023-10-25T16:14:48.870390+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:45.872159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875933+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:48.875933+0000","last_peered":"2023-10-25T16:14:48.875933+0000","last_clean":"2023-10-25T16:14:48.875933+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:48.875933+0000","last_undegraded":"2023-10-25T16:14:48.875933+0000","last_fullsized":"2023-10-25T16:14:48.875933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874161+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:48.874161+0000","last_peered":"2023-10-25T16:14:48.874161+0000","last_clean":"2023-10-25T16:14:48.874161+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:48.874161+0000","last_undegraded":"2023-10-25T16:14:48.874161+0000","last_fullsized":"2023-10-25T16:14:48.874161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877787+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:48.877787+0000","last_peered":"2023-10-25T16:14:48.877787+0000","last_clean":"2023-10-25T16:14:48.877787+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:48.877787+0000","last_undegraded":"2023-10-25T16:14:48.877787+0000","last_fullsized":"2023-10-25T16:14:48.877787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:23:28.152972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871080+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:48.871080+0000","last_peered":"2023-10-25T16:14:48.871080+0000","last_clean":"2023-10-25T16:14:48.871080+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:48.871080+0000","last_undegraded":"2023-10-25T16:14:48.871080+0000","last_fullsized":"2023-10-25T16:14:48.871080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868976+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:48.868976+0000","last_peered":"2023-10-25T16:14:48.868976+0000","last_clean":"2023-10-25T16:14:48.868976+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:48.868976+0000","last_undegraded":"2023-10-25T16:14:48.868976+0000","last_fullsized":"2023-10-25T16:14:48.868976+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877619+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:48.877619+0000","last_peered":"2023-10-25T16:14:48.877619+0000","last_clean":"2023-10-25T16:14:48.877619+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:48.877619+0000","last_undegraded":"2023-10-25T16:14:48.877619+0000","last_fullsized":"2023-10-25T16:14:48.877619+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875387+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:48.875387+0000","last_peered":"2023-10-25T16:14:48.875387+0000","last_clean":"2023-10-25T16:14:48.875387+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:48.875387+0000","last_undegraded":"2023-10-25T16:14:48.875387+0000","last_fullsized":"2023-10-25T16:14:48.875387+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875842+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:48.875842+0000","last_peered":"2023-10-25T16:14:48.875842+0000","last_clean":"2023-10-25T16:14:48.875842+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:48.875842+0000","last_undegraded":"2023-10-25T16:14:48.875842+0000","last_fullsized":"2023-10-25T16:14:48.875842+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878002+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:48.878002+0000","last_peered":"2023-10-25T16:14:48.878002+0000","last_clean":"2023-10-25T16:14:48.878002+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:48.878002+0000","last_undegraded":"2023-10-25T16:14:48.878002+0000","last_fullsized":"2023-10-25T16:14:48.878002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875032+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:48.875032+0000","last_peered":"2023-10-25T16:14:48.875032+0000","last_clean":"2023-10-25T16:14:48.875032+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:48.875032+0000","last_undegraded":"2023-10-25T16:14:48.875032+0000","last_fullsized":"2023-10-25T16:14:48.875032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883519+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:48.883519+0000","last_peered":"2023-10-25T16:14:48.883519+0000","last_clean":"2023-10-25T16:14:48.883519+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:48.883519+0000","last_undegraded":"2023-10-25T16:14:48.883519+0000","last_fullsized":"2023-10-25T16:14:48.883519+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879623+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:48.879623+0000","last_peered":"2023-10-25T16:14:48.879623+0000","last_clean":"2023-10-25T16:14:48.879623+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:48.879623+0000","last_undegraded":"2023-10-25T16:14:48.879623+0000","last_fullsized":"2023-10-25T16:14:48.879623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865076+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:48.865076+0000","last_peered":"2023-10-25T16:14:48.865076+0000","last_clean":"2023-10-25T16:14:48.865076+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:48.865076+0000","last_undegraded":"2023-10-25T16:14:48.865076+0000","last_fullsized":"2023-10-25T16:14:48.865076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860901+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.860901+0000","last_peered":"2023-10-25T16:14:48.860901+0000","last_clean":"2023-10-25T16:14:48.860901+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:48.860901+0000","last_undegraded":"2023-10-25T16:14:48.860901+0000","last_fullsized":"2023-10-25T16:14:48.860901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875524+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:48.875524+0000","last_peered":"2023-10-25T16:14:48.875524+0000","last_clean":"2023-10-25T16:14:48.875524+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:48.875524+0000","last_undegraded":"2023-10-25T16:14:48.875524+0000","last_fullsized":"2023-10-25T16:14:48.875524+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863335+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:48.863335+0000","last_peered":"2023-10-25T16:14:48.863335+0000","last_clean":"2023-10-25T16:14:48.863335+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:48.863335+0000","last_undegraded":"2023-10-25T16:14:48.863335+0000","last_fullsized":"2023-10-25T16:14:48.863335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873934+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:48.873934+0000","last_peered":"2023-10-25T16:14:48.873934+0000","last_clean":"2023-10-25T16:14:48.873934+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:48.873934+0000","last_undegraded":"2023-10-25T16:14:48.873934+0000","last_fullsized":"2023-10-25T16:14:48.873934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.856803+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:48.856803+0000","last_peered":"2023-10-25T16:14:48.856803+0000","last_clean":"2023-10-25T16:14:48.856803+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:48.856803+0000","last_undegraded":"2023-10-25T16:14:48.856803+0000","last_fullsized":"2023-10-25T16:14:48.856803+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864185+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:48.864185+0000","last_peered":"2023-10-25T16:14:48.864185+0000","last_clean":"2023-10-25T16:14:48.864185+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:48.864185+0000","last_undegraded":"2023-10-25T16:14:48.864185+0000","last_fullsized":"2023-10-25T16:14:48.864185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.858667+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.858667+0000","last_peered":"2023-10-25T16:14:48.858667+0000","last_clean":"2023-10-25T16:14:48.858667+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:48.858667+0000","last_undegraded":"2023-10-25T16:14:48.858667+0000","last_fullsized":"2023-10-25T16:14:48.858667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880331+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:48.880331+0000","last_peered":"2023-10-25T16:14:48.880331+0000","last_clean":"2023-10-25T16:14:48.880331+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:48.880331+0000","last_undegraded":"2023-10-25T16:14:48.880331+0000","last_fullsized":"2023-10-25T16:14:48.880331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877980+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:48.877980+0000","last_peered":"2023-10-25T16:14:48.877980+0000","last_clean":"2023-10-25T16:14:48.877980+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:48.877980+0000","last_undegraded":"2023-10-25T16:14:48.877980+0000","last_fullsized":"2023-10-25T16:14:48.877980+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875144+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:48.875144+0000","last_peered":"2023-10-25T16:14:48.875144+0000","last_clean":"2023-10-25T16:14:48.875144+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:48.875144+0000","last_undegraded":"2023-10-25T16:14:48.875144+0000","last_fullsized":"2023-10-25T16:14:48.875144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:46.814378+0000","last_change":"2023-10-25T16:14:46.814378+0000","last_active":"2023-10-25T16:14:46.814378+0000","last_peered":"2023-10-25T16:14:46.814378+0000","last_clean":"2023-10-25T16:14:46.814378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:46.814378+0000","last_undegraded":"2023-10-25T16:14:46.814378+0000","last_fullsized":"2023-10-25T16:14:46.814378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884735+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:48.884735+0000","last_peered":"2023-10-25T16:14:48.884735+0000","last_clean":"2023-10-25T16:14:48.884735+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:48.884735+0000","last_undegraded":"2023-10-25T16:14:48.884735+0000","last_fullsized":"2023-10-25T16:14:48.884735+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:22.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873036+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:48.873036+0000","last_peered":"2023-10-25T16:14:48.873036+0000","last_clean":"2023-10-25T16:14:48.873036+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:48.873036+0000","last_undegraded":"2023-10-25T16:14:48.873036+0000","last_fullsized":"2023-10-25T16:14:48.873036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880483+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:48.880483+0000","last_peered":"2023-10-25T16:14:48.880483+0000","last_clean":"2023-10-25T16:14:48.880483+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:48.880483+0000","last_undegraded":"2023-10-25T16:14:48.880483+0000","last_fullsized":"2023-10-25T16:14:48.880483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.849846+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:48.849846+0000","last_peered":"2023-10-25T16:14:48.849846+0000","last_clean":"2023-10-25T16:14:48.849846+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:48.849846+0000","last_undegraded":"2023-10-25T16:14:48.849846+0000","last_fullsized":"2023-10-25T16:14:48.849846+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872880+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:48.872880+0000","last_peered":"2023-10-25T16:14:48.872880+0000","last_clean":"2023-10-25T16:14:48.872880+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:48.872880+0000","last_undegraded":"2023-10-25T16:14:48.872880+0000","last_fullsized":"2023-10-25T16:14:48.872880+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857123+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:48.857123+0000","last_peered":"2023-10-25T16:14:48.857123+0000","last_clean":"2023-10-25T16:14:48.857123+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:48.857123+0000","last_undegraded":"2023-10-25T16:14:48.857123+0000","last_fullsized":"2023-10-25T16:14:48.857123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868415+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:48.868415+0000","last_peered":"2023-10-25T16:14:48.868415+0000","last_clean":"2023-10-25T16:14:48.868415+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:48.868415+0000","last_undegraded":"2023-10-25T16:14:48.868415+0000","last_fullsized":"2023-10-25T16:14:48.868415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886761+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:48.886761+0000","last_peered":"2023-10-25T16:14:48.886761+0000","last_clean":"2023-10-25T16:14:48.886761+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:48.886761+0000","last_undegraded":"2023-10-25T16:14:48.886761+0000","last_fullsized":"2023-10-25T16:14:48.886761+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:46.814378+0000","last_change":"2023-10-25T16:14:46.814378+0000","last_active":"2023-10-25T16:14:46.814378+0000","last_peered":"2023-10-25T16:14:46.814378+0000","last_clean":"2023-10-25T16:14:46.814378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:46.814378+0000","last_undegraded":"2023-10-25T16:14:46.814378+0000","last_fullsized":"2023-10-25T16:14:46.814378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868926+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:48.868926+0000","last_peered":"2023-10-25T16:14:48.868926+0000","last_clean":"2023-10-25T16:14:48.868926+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:48.868926+0000","last_undegraded":"2023-10-25T16:14:48.868926+0000","last_fullsized":"2023-10-25T16:14:48.868926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879753+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:48.879753+0000","last_peered":"2023-10-25T16:14:48.879753+0000","last_clean":"2023-10-25T16:14:48.879753+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:48.879753+0000","last_undegraded":"2023-10-25T16:14:48.879753+0000","last_fullsized":"2023-10-25T16:14:48.879753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872484+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:48.872484+0000","last_peered":"2023-10-25T16:14:48.872484+0000","last_clean":"2023-10-25T16:14:48.872484+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:48.872484+0000","last_undegraded":"2023-10-25T16:14:48.872484+0000","last_fullsized":"2023-10-25T16:14:48.872484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878256+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:48.878256+0000","last_peered":"2023-10-25T16:14:48.878256+0000","last_clean":"2023-10-25T16:14:48.878256+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:48.878256+0000","last_undegraded":"2023-10-25T16:14:48.878256+0000","last_fullsized":"2023-10-25T16:14:48.878256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871763+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:48.871763+0000","last_peered":"2023-10-25T16:14:48.871763+0000","last_clean":"2023-10-25T16:14:48.871763+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:48.871763+0000","last_undegraded":"2023-10-25T16:14:48.871763+0000","last_fullsized":"2023-10-25T16:14:48.871763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:29:01.025167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857377+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:48.857377+0000","last_peered":"2023-10-25T16:14:48.857377+0000","last_clean":"2023-10-25T16:14:48.857377+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:48.857377+0000","last_undegraded":"2023-10-25T16:14:48.857377+0000","last_fullsized":"2023-10-25T16:14:48.857377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880581+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:48.880581+0000","last_peered":"2023-10-25T16:14:48.880581+0000","last_clean":"2023-10-25T16:14:48.880581+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:48.880581+0000","last_undegraded":"2023-10-25T16:14:48.880581+0000","last_fullsized":"2023-10-25T16:14:48.880581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874012+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:48.874012+0000","last_peered":"2023-10-25T16:14:48.874012+0000","last_clean":"2023-10-25T16:14:48.874012+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:48.874012+0000","last_undegraded":"2023-10-25T16:14:48.874012+0000","last_fullsized":"2023-10-25T16:14:48.874012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874219+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:48.874219+0000","last_peered":"2023-10-25T16:14:48.874219+0000","last_clean":"2023-10-25T16:14:48.874219+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:48.874219+0000","last_undegraded":"2023-10-25T16:14:48.874219+0000","last_fullsized":"2023-10-25T16:14:48.874219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.861107+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:48.861107+0000","last_peered":"2023-10-25T16:14:48.861107+0000","last_clean":"2023-10-25T16:14:48.861107+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:48.861107+0000","last_undegraded":"2023-10-25T16:14:48.861107+0000","last_fullsized":"2023-10-25T16:14:48.861107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863484+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:48.863484+0000","last_peered":"2023-10-25T16:14:48.863484+0000","last_clean":"2023-10-25T16:14:48.863484+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:48.863484+0000","last_undegraded":"2023-10-25T16:14:48.863484+0000","last_fullsized":"2023-10-25T16:14:48.863484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886331+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:48.886331+0000","last_peered":"2023-10-25T16:14:48.886331+0000","last_clean":"2023-10-25T16:14:48.886331+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:48.886331+0000","last_undegraded":"2023-10-25T16:14:48.886331+0000","last_fullsized":"2023-10-25T16:14:48.886331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850013+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:48.850013+0000","last_peered":"2023-10-25T16:14:48.850013+0000","last_clean":"2023-10-25T16:14:48.850013+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:48.850013+0000","last_undegraded":"2023-10-25T16:14:48.850013+0000","last_fullsized":"2023-10-25T16:14:48.850013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.888758+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:48.888758+0000","last_peered":"2023-10-25T16:14:48.888758+0000","last_clean":"2023-10-25T16:14:48.888758+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:48.888758+0000","last_undegraded":"2023-10-25T16:14:48.888758+0000","last_fullsized":"2023-10-25T16:14:48.888758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857285+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:48.857285+0000","last_peered":"2023-10-25T16:14:48.857285+0000","last_clean":"2023-10-25T16:14:48.857285+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:48.857285+0000","last_undegraded":"2023-10-25T16:14:48.857285+0000","last_fullsized":"2023-10-25T16:14:48.857285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871679+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:48.871679+0000","last_peered":"2023-10-25T16:14:48.871679+0000","last_clean":"2023-10-25T16:14:48.871679+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:48.871679+0000","last_undegraded":"2023-10-25T16:14:48.871679+0000","last_fullsized":"2023-10-25T16:14:48.871679+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.848890+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:48.848890+0000","last_peered":"2023-10-25T16:14:48.848890+0000","last_clean":"2023-10-25T16:14:48.848890+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:48.848890+0000","last_undegraded":"2023-10-25T16:14:48.848890+0000","last_fullsized":"2023-10-25T16:14:48.848890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.852307+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:48.852307+0000","last_peered":"2023-10-25T16:14:48.852307+0000","last_clean":"2023-10-25T16:14:48.852307+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:48.852307+0000","last_undegraded":"2023-10-25T16:14:48.852307+0000","last_fullsized":"2023-10-25T16:14:48.852307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871732+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:48.871732+0000","last_peered":"2023-10-25T16:14:48.871732+0000","last_clean":"2023-10-25T16:14:48.871732+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:48.871732+0000","last_undegraded":"2023-10-25T16:14:48.871732+0000","last_fullsized":"2023-10-25T16:14:48.871732+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874096+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:48.874096+0000","last_peered":"2023-10-25T16:14:48.874096+0000","last_clean":"2023-10-25T16:14:48.874096+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:48.874096+0000","last_undegraded":"2023-10-25T16:14:48.874096+0000","last_fullsized":"2023-10-25T16:14:48.874096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850187+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:48.850187+0000","last_peered":"2023-10-25T16:14:48.850187+0000","last_clean":"2023-10-25T16:14:48.850187+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:48.850187+0000","last_undegraded":"2023-10-25T16:14:48.850187+0000","last_fullsized":"2023-10-25T16:14:48.850187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881358+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:48.881358+0000","last_peered":"2023-10-25T16:14:48.881358+0000","last_clean":"2023-10-25T16:14:48.881358+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:48.881358+0000","last_undegraded":"2023-10-25T16:14:48.881358+0000","last_fullsized":"2023-10-25T16:14:48.881358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:15.015350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857778+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:48.857778+0000","last_peered":"2023-10-25T16:14:48.857778+0000","last_clean":"2023-10-25T16:14:48.857778+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:48.857778+0000","last_undegraded":"2023-10-25T16:14:48.857778+0000","last_fullsized":"2023-10-25T16:14:48.857778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878787+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:48.878787+0000","last_peered":"2023-10-25T16:14:48.878787+0000","last_clean":"2023-10-25T16:14:48.878787+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:48.878787+0000","last_undegraded":"2023-10-25T16:14:48.878787+0000","last_fullsized":"2023-10-25T16:14:48.878787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868388+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:48.868388+0000","last_peered":"2023-10-25T16:14:48.868388+0000","last_clean":"2023-10-25T16:14:48.868388+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:48.868388+0000","last_undegraded":"2023-10-25T16:14:48.868388+0000","last_fullsized":"2023-10-25T16:14:48.868388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879152+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:48.879152+0000","last_peered":"2023-10-25T16:14:48.879152+0000","last_clean":"2023-10-25T16:14:48.879152+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:48.879152+0000","last_undegraded":"2023-10-25T16:14:48.879152+0000","last_fullsized":"2023-10-25T16:14:48.879152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.855133+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:48.855133+0000","last_peered":"2023-10-25T16:14:48.855133+0000","last_clean":"2023-10-25T16:14:48.855133+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:48.855133+0000","last_undegraded":"2023-10-25T16:14:48.855133+0000","last_fullsized":"2023-10-25T16:14:48.855133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860018+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:48.860018+0000","last_peered":"2023-10-25T16:14:48.860018+0000","last_clean":"2023-10-25T16:14:48.860018+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:48.860018+0000","last_undegraded":"2023-10-25T16:14:48.860018+0000","last_fullsized":"2023-10-25T16:14:48.860018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872800+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:48.872800+0000","last_peered":"2023-10-25T16:14:48.872800+0000","last_clean":"2023-10-25T16:14:48.872800+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:48.872800+0000","last_undegraded":"2023-10-25T16:14:48.872800+0000","last_fullsized":"2023-10-25T16:14:48.872800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-25T16:14:47.845101+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:47.845101+0000","last_peered":"2023-10-25T16:14:47.845101+0000","last_clean":"2023-10-25T16:14:47.845101+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:47.845101+0000","last_undegraded":"2023-10-25T16:14:47.845101+0000","last_fullsized":"2023-10-25T16:14:47.845101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":60,"acting":60,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":181,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195130,"statfs":{"total":200000000,"available":199814043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93799999999999994}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.90200000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.87}]}]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199184342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.622}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82999999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.99199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774128,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.252}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.93200000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.872},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.089}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.337},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.1799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.121}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.1539999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":221,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96899999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.077}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.998}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.879}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.236}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0349999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.175},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.2070000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.4650000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0209999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.377},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.746},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.103}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.024}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:51.887 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:52.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 -- 172.21.15.177:0/1317863363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c159040 msgr2=0x7f3f2c070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/1317863363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c159040 0x7f3f2c070620 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0adc60 tx=0x7f3f1c01c8a0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 -- 172.21.15.177:0/1317863363 shutdown_connections 2023-10-25T16:14:52.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/1317863363 >> v2:172.21.15.184:3300/0 conn(0x7f3f2c15cd90 0x7f3f2c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/1317863363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159420 0x7f3f2c070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/1317863363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c159040 0x7f3f2c070620 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 -- 172.21.15.177:0/1317863363 >> 172.21.15.177:0/1317863363 conn(0x7f3f2c06a830 msgr2=0x7f3f2c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:52.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.039+0000 7f3f30fb7640 1 -- 172.21.15.177:0/1317863363 shutdown_connections 2023-10-25T16:14:52.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- 172.21.15.177:0/1317863363 wait complete. 2023-10-25T16:14:52.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 Processor -- start 2023-10-25T16:14:52.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- start start 2023-10-25T16:14:52.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159040 0x7f3f2c1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2c15cd90 0x7f3f2c154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 0x7f3f2c0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c146cf0 con 0x7f3f2c154e90 2023-10-25T16:14:52.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c155320 con 0x7f3f2c15cd90 2023-10-25T16:14:52.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0b3100 con 0x7f3f2c159040 2023-10-25T16:14:52.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 0x7f3f2c0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 0x7f3f2c0b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56302/0 (socket says 172.21.15.177:56302) 2023-10-25T16:14:52.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 -- 172.21.15.177:0/3644250744 learned_addr learned my addr 172.21.15.177:0/3644250744 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:52.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f29d9b640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2c15cd90 0x7f3f2c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2a59c640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159040 0x7f3f2c1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 -- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159040 msgr2=0x7f3f2c1467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159040 0x7f3f2c1467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 -- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2c15cd90 msgr2=0x7f3f2c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2c15cd90 0x7f3f2c154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 -- 172.21.15.177:0/3644250744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c009560 con 0x7f3f2c154e90 2023-10-25T16:14:52.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f29d9b640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2c15cd90 0x7f3f2c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:52.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2a59c640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159040 0x7f3f2c1467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:52.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f2ad9d640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 0x7f3f2c0b1ae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400b970 tx=0x7f3f2400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:52.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400cb40 con 0x7f3f2c154e90 2023-10-25T16:14:52.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f2400cdb0 con 0x7f3f2c154e90 2023-10-25T16:14:52.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c0b2860 con 0x7f3f2c154e90 2023-10-25T16:14:52.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240146a0 con 0x7f3f2c154e90 2023-10-25T16:14:52.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.043+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c0b2e20 con 0x7f3f2c154e90 2023-10-25T16:14:52.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.047+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c04daf0 con 0x7f3f2c154e90 2023-10-25T16:14:52.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.047+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f2401d3b0 con 0x7f3f2c154e90 2023-10-25T16:14:52.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.047+0000 7f3f1affd640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f0c0664a0 0x7f3f0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.047+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f24084020 con 0x7f3f2c154e90 2023-10-25T16:14:52.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.047+0000 7f3f2a59c640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f0c0664a0 0x7f3f0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.047+0000 7f3f2a59c640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f0c0664a0 0x7f3f0c068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0af000 tx=0x7f3f1c01b0e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:52.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.051+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f240514a0 con 0x7f3f2c154e90 2023-10-25T16:14:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.199+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f2c0b07c0 con 0x7f3f0c0664a0 2023-10-25T16:14:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.219+0000 7f3f1affd640 1 -- 172.21.15.177:0/3644250744 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282690 (secure 0 0 0) 0x7f3f2c0b07c0 con 0x7f3f0c0664a0 2023-10-25T16:14:52.229 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:52.230 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f0c0664a0 msgr2=0x7f3f0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f0c0664a0 0x7f3f0c068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0af000 tx=0x7f3f1c01b0e0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 msgr2=0x7f3f2c0b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 0x7f3f2c0b1ae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400b970 tx=0x7f3f2400be30 comp rx=0 tx=0).stop 2023-10-25T16:14:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 shutdown_connections 2023-10-25T16:14:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f0c0664a0 0x7f3f0c068960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f2c154e90 0x7f3f2c0b1ae0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f2c15cd90 0x7f3f2c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 --2- 172.21.15.177:0/3644250744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f2c159040 0x7f3f2c1467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.223+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 >> 172.21.15.177:0/3644250744 conn(0x7f3f2c06a830 msgr2=0x7f3f2c15bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:52.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.227+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 shutdown_connections 2023-10-25T16:14:52.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.227+0000 7f3f30fb7640 1 -- 172.21.15.177:0/3644250744 wait complete. 2023-10-25T16:14:52.247 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-10-25T16:14:50.640460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2877,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559622,"statfs":{"total":1600000000,"available":1597053721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001090"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.862030+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:48.862030+0000","last_peered":"2023-10-25T16:14:48.862030+0000","last_clean":"2023-10-25T16:14:48.862030+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:48.862030+0000","last_undegraded":"2023-10-25T16:14:48.862030+0000","last_fullsized":"2023-10-25T16:14:48.862030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886809+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:48.886809+0000","last_peered":"2023-10-25T16:14:48.886809+0000","last_clean":"2023-10-25T16:14:48.886809+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:48.886809+0000","last_undegraded":"2023-10-25T16:14:48.886809+0000","last_fullsized":"2023-10-25T16:14:48.886809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879850+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:48.879850+0000","last_peered":"2023-10-25T16:14:48.879850+0000","last_clean":"2023-10-25T16:14:48.879850+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:48.879850+0000","last_undegraded":"2023-10-25T16:14:48.879850+0000","last_fullsized":"2023-10-25T16:14:48.879850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868897+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:48.868897+0000","last_peered":"2023-10-25T16:14:48.868897+0000","last_clean":"2023-10-25T16:14:48.868897+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:48.868897+0000","last_undegraded":"2023-10-25T16:14:48.868897+0000","last_fullsized":"2023-10-25T16:14:48.868897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869762+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:48.869762+0000","last_peered":"2023-10-25T16:14:48.869762+0000","last_clean":"2023-10-25T16:14:48.869762+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:48.869762+0000","last_undegraded":"2023-10-25T16:14:48.869762+0000","last_fullsized":"2023-10-25T16:14:48.869762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874074+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:48.874074+0000","last_peered":"2023-10-25T16:14:48.874074+0000","last_clean":"2023-10-25T16:14:48.874074+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:48.874074+0000","last_undegraded":"2023-10-25T16:14:48.874074+0000","last_fullsized":"2023-10-25T16:14:48.874074+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.704168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876691+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:48.876691+0000","last_peered":"2023-10-25T16:14:48.876691+0000","last_clean":"2023-10-25T16:14:48.876691+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:48.876691+0000","last_undegraded":"2023-10-25T16:14:48.876691+0000","last_fullsized":"2023-10-25T16:14:48.876691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864126+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:48.864126+0000","last_peered":"2023-10-25T16:14:48.864126+0000","last_clean":"2023-10-25T16:14:48.864126+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:48.864126+0000","last_undegraded":"2023-10-25T16:14:48.864126+0000","last_fullsized":"2023-10-25T16:14:48.864126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883567+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:48.883567+0000","last_peered":"2023-10-25T16:14:48.883567+0000","last_clean":"2023-10-25T16:14:48.883567+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:48.883567+0000","last_undegraded":"2023-10-25T16:14:48.883567+0000","last_fullsized":"2023-10-25T16:14:48.883567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864627+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:48.864627+0000","last_peered":"2023-10-25T16:14:48.864627+0000","last_clean":"2023-10-25T16:14:48.864627+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:48.864627+0000","last_undegraded":"2023-10-25T16:14:48.864627+0000","last_fullsized":"2023-10-25T16:14:48.864627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883250+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:48.883250+0000","last_peered":"2023-10-25T16:14:48.883250+0000","last_clean":"2023-10-25T16:14:48.883250+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:48.883250+0000","last_undegraded":"2023-10-25T16:14:48.883250+0000","last_fullsized":"2023-10-25T16:14:48.883250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881599+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:48.881599+0000","last_peered":"2023-10-25T16:14:48.881599+0000","last_clean":"2023-10-25T16:14:48.881599+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:48.881599+0000","last_undegraded":"2023-10-25T16:14:48.881599+0000","last_fullsized":"2023-10-25T16:14:48.881599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.885307+0000","last_change":"2023-10-25T16:14:48.884361+0000","last_active":"2023-10-25T16:14:48.885307+0000","last_peered":"2023-10-25T16:14:48.885307+0000","last_clean":"2023-10-25T16:14:48.885307+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:48.885307+0000","last_undegraded":"2023-10-25T16:14:48.885307+0000","last_fullsized":"2023-10-25T16:14:48.885307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876262+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:48.876262+0000","last_peered":"2023-10-25T16:14:48.876262+0000","last_clean":"2023-10-25T16:14:48.876262+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:48.876262+0000","last_undegraded":"2023-10-25T16:14:48.876262+0000","last_fullsized":"2023-10-25T16:14:48.876262+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884903+0000","last_change":"2023-10-25T16:14:48.884844+0000","last_active":"2023-10-25T16:14:48.884903+0000","last_peered":"2023-10-25T16:14:48.884903+0000","last_clean":"2023-10-25T16:14:48.884903+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:48.884903+0000","last_undegraded":"2023-10-25T16:14:48.884903+0000","last_fullsized":"2023-10-25T16:14:48.884903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868577+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:48.868577+0000","last_peered":"2023-10-25T16:14:48.868577+0000","last_clean":"2023-10-25T16:14:48.868577+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:48.868577+0000","last_undegraded":"2023-10-25T16:14:48.868577+0000","last_fullsized":"2023-10-25T16:14:48.868577+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877481+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:48.877481+0000","last_peered":"2023-10-25T16:14:48.877481+0000","last_clean":"2023-10-25T16:14:48.877481+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:48.877481+0000","last_undegraded":"2023-10-25T16:14:48.877481+0000","last_fullsized":"2023-10-25T16:14:48.877481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873219+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:48.873219+0000","last_peered":"2023-10-25T16:14:48.873219+0000","last_clean":"2023-10-25T16:14:48.873219+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:48.873219+0000","last_undegraded":"2023-10-25T16:14:48.873219+0000","last_fullsized":"2023-10-25T16:14:48.873219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869215+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:48.869215+0000","last_peered":"2023-10-25T16:14:48.869215+0000","last_clean":"2023-10-25T16:14:48.869215+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:48.869215+0000","last_undegraded":"2023-10-25T16:14:48.869215+0000","last_fullsized":"2023-10-25T16:14:48.869215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:54.213888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883301+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:48.883301+0000","last_peered":"2023-10-25T16:14:48.883301+0000","last_clean":"2023-10-25T16:14:48.883301+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:48.883301+0000","last_undegraded":"2023-10-25T16:14:48.883301+0000","last_fullsized":"2023-10-25T16:14:48.883301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865001+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:48.865001+0000","last_peered":"2023-10-25T16:14:48.865001+0000","last_clean":"2023-10-25T16:14:48.865001+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:48.865001+0000","last_undegraded":"2023-10-25T16:14:48.865001+0000","last_fullsized":"2023-10-25T16:14:48.865001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:15.704551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875694+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:48.875694+0000","last_peered":"2023-10-25T16:14:48.875694+0000","last_clean":"2023-10-25T16:14:48.875694+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:48.875694+0000","last_undegraded":"2023-10-25T16:14:48.875694+0000","last_fullsized":"2023-10-25T16:14:48.875694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879591+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:48.879591+0000","last_peered":"2023-10-25T16:14:48.879591+0000","last_clean":"2023-10-25T16:14:48.879591+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:48.879591+0000","last_undegraded":"2023-10-25T16:14:48.879591+0000","last_fullsized":"2023-10-25T16:14:48.879591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:33:21.460992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868627+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:48.868627+0000","last_peered":"2023-10-25T16:14:48.868627+0000","last_clean":"2023-10-25T16:14:48.868627+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:48.868627+0000","last_undegraded":"2023-10-25T16:14:48.868627+0000","last_fullsized":"2023-10-25T16:14:48.868627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881624+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:48.881624+0000","last_peered":"2023-10-25T16:14:48.881624+0000","last_clean":"2023-10-25T16:14:48.881624+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:48.881624+0000","last_undegraded":"2023-10-25T16:14:48.881624+0000","last_fullsized":"2023-10-25T16:14:48.881624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879135+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:48.879135+0000","last_peered":"2023-10-25T16:14:48.879135+0000","last_clean":"2023-10-25T16:14:48.879135+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:48.879135+0000","last_undegraded":"2023-10-25T16:14:48.879135+0000","last_fullsized":"2023-10-25T16:14:48.879135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860777+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:48.860777+0000","last_peered":"2023-10-25T16:14:48.860777+0000","last_clean":"2023-10-25T16:14:48.860777+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:48.860777+0000","last_undegraded":"2023-10-25T16:14:48.860777+0000","last_fullsized":"2023-10-25T16:14:48.860777+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.870390+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:48.870390+0000","last_peered":"2023-10-25T16:14:48.870390+0000","last_clean":"2023-10-25T16:14:48.870390+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:48.870390+0000","last_undegraded":"2023-10-25T16:14:48.870390+0000","last_fullsized":"2023-10-25T16:14:48.870390+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:45.872159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875933+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:48.875933+0000","last_peered":"2023-10-25T16:14:48.875933+0000","last_clean":"2023-10-25T16:14:48.875933+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:48.875933+0000","last_undegraded":"2023-10-25T16:14:48.875933+0000","last_fullsized":"2023-10-25T16:14:48.875933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874161+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:48.874161+0000","last_peered":"2023-10-25T16:14:48.874161+0000","last_clean":"2023-10-25T16:14:48.874161+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:48.874161+0000","last_undegraded":"2023-10-25T16:14:48.874161+0000","last_fullsized":"2023-10-25T16:14:48.874161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877787+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:48.877787+0000","last_peered":"2023-10-25T16:14:48.877787+0000","last_clean":"2023-10-25T16:14:48.877787+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:48.877787+0000","last_undegraded":"2023-10-25T16:14:48.877787+0000","last_fullsized":"2023-10-25T16:14:48.877787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:23:28.152972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871080+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:48.871080+0000","last_peered":"2023-10-25T16:14:48.871080+0000","last_clean":"2023-10-25T16:14:48.871080+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:48.871080+0000","last_undegraded":"2023-10-25T16:14:48.871080+0000","last_fullsized":"2023-10-25T16:14:48.871080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868976+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:48.868976+0000","last_peered":"2023-10-25T16:14:48.868976+0000","last_clean":"2023-10-25T16:14:48.868976+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:48.868976+0000","last_undegraded":"2023-10-25T16:14:48.868976+0000","last_fullsized":"2023-10-25T16:14:48.868976+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877619+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:48.877619+0000","last_peered":"2023-10-25T16:14:48.877619+0000","last_clean":"2023-10-25T16:14:48.877619+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:48.877619+0000","last_undegraded":"2023-10-25T16:14:48.877619+0000","last_fullsized":"2023-10-25T16:14:48.877619+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875387+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:48.875387+0000","last_peered":"2023-10-25T16:14:48.875387+0000","last_clean":"2023-10-25T16:14:48.875387+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:48.875387+0000","last_undegraded":"2023-10-25T16:14:48.875387+0000","last_fullsized":"2023-10-25T16:14:48.875387+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875842+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:48.875842+0000","last_peered":"2023-10-25T16:14:48.875842+0000","last_clean":"2023-10-25T16:14:48.875842+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:48.875842+0000","last_undegraded":"2023-10-25T16:14:48.875842+0000","last_fullsized":"2023-10-25T16:14:48.875842+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878002+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:48.878002+0000","last_peered":"2023-10-25T16:14:48.878002+0000","last_clean":"2023-10-25T16:14:48.878002+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:48.878002+0000","last_undegraded":"2023-10-25T16:14:48.878002+0000","last_fullsized":"2023-10-25T16:14:48.878002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875032+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:48.875032+0000","last_peered":"2023-10-25T16:14:48.875032+0000","last_clean":"2023-10-25T16:14:48.875032+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:48.875032+0000","last_undegraded":"2023-10-25T16:14:48.875032+0000","last_fullsized":"2023-10-25T16:14:48.875032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883519+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:48.883519+0000","last_peered":"2023-10-25T16:14:48.883519+0000","last_clean":"2023-10-25T16:14:48.883519+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:48.883519+0000","last_undegraded":"2023-10-25T16:14:48.883519+0000","last_fullsized":"2023-10-25T16:14:48.883519+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879623+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:48.879623+0000","last_peered":"2023-10-25T16:14:48.879623+0000","last_clean":"2023-10-25T16:14:48.879623+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:48.879623+0000","last_undegraded":"2023-10-25T16:14:48.879623+0000","last_fullsized":"2023-10-25T16:14:48.879623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865076+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:48.865076+0000","last_peered":"2023-10-25T16:14:48.865076+0000","last_clean":"2023-10-25T16:14:48.865076+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:48.865076+0000","last_undegraded":"2023-10-25T16:14:48.865076+0000","last_fullsized":"2023-10-25T16:14:48.865076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860901+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.860901+0000","last_peered":"2023-10-25T16:14:48.860901+0000","last_clean":"2023-10-25T16:14:48.860901+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:48.860901+0000","last_undegraded":"2023-10-25T16:14:48.860901+0000","last_fullsized":"2023-10-25T16:14:48.860901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875524+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:48.875524+0000","last_peered":"2023-10-25T16:14:48.875524+0000","last_clean":"2023-10-25T16:14:48.875524+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:48.875524+0000","last_undegraded":"2023-10-25T16:14:48.875524+0000","last_fullsized":"2023-10-25T16:14:48.875524+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863335+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:48.863335+0000","last_peered":"2023-10-25T16:14:48.863335+0000","last_clean":"2023-10-25T16:14:48.863335+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:48.863335+0000","last_undegraded":"2023-10-25T16:14:48.863335+0000","last_fullsized":"2023-10-25T16:14:48.863335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873934+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:48.873934+0000","last_peered":"2023-10-25T16:14:48.873934+0000","last_clean":"2023-10-25T16:14:48.873934+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:48.873934+0000","last_undegraded":"2023-10-25T16:14:48.873934+0000","last_fullsized":"2023-10-25T16:14:48.873934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.856803+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:48.856803+0000","last_peered":"2023-10-25T16:14:48.856803+0000","last_clean":"2023-10-25T16:14:48.856803+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:48.856803+0000","last_undegraded":"2023-10-25T16:14:48.856803+0000","last_fullsized":"2023-10-25T16:14:48.856803+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864185+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:48.864185+0000","last_peered":"2023-10-25T16:14:48.864185+0000","last_clean":"2023-10-25T16:14:48.864185+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:48.864185+0000","last_undegraded":"2023-10-25T16:14:48.864185+0000","last_fullsized":"2023-10-25T16:14:48.864185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.858667+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.858667+0000","last_peered":"2023-10-25T16:14:48.858667+0000","last_clean":"2023-10-25T16:14:48.858667+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:48.858667+0000","last_undegraded":"2023-10-25T16:14:48.858667+0000","last_fullsized":"2023-10-25T16:14:48.858667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880331+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:48.880331+0000","last_peered":"2023-10-25T16:14:48.880331+0000","last_clean":"2023-10-25T16:14:48.880331+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:48.880331+0000","last_undegraded":"2023-10-25T16:14:48.880331+0000","last_fullsized":"2023-10-25T16:14:48.880331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877980+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:48.877980+0000","last_peered":"2023-10-25T16:14:48.877980+0000","last_clean":"2023-10-25T16:14:48.877980+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:48.877980+0000","last_undegraded":"2023-10-25T16:14:48.877980+0000","last_fullsized":"2023-10-25T16:14:48.877980+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875144+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:48.875144+0000","last_peered":"2023-10-25T16:14:48.875144+0000","last_clean":"2023-10-25T16:14:48.875144+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:48.875144+0000","last_undegraded":"2023-10-25T16:14:48.875144+0000","last_fullsized":"2023-10-25T16:14:48.875144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:46.814378+0000","last_change":"2023-10-25T16:14:46.814378+0000","last_active":"2023-10-25T16:14:46.814378+0000","last_peered":"2023-10-25T16:14:46.814378+0000","last_clean":"2023-10-25T16:14:46.814378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:46.814378+0000","last_undegraded":"2023-10-25T16:14:46.814378+0000","last_fullsized":"2023-10-25T16:14:46.814378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884735+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:48.884735+0000","last_peered":"2023-10-25T16:14:48.884735+0000","last_clean":"2023-10-25T16:14:48.884735+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:48.884735+0000","last_undegraded":"2023-10-25T16:14:48.884735+0000","last_fullsized":"2023-10-25T16:14:48.884735+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:22.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873036+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:48.873036+0000","last_peered":"2023-10-25T16:14:48.873036+0000","last_clean":"2023-10-25T16:14:48.873036+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:48.873036+0000","last_undegraded":"2023-10-25T16:14:48.873036+0000","last_fullsized":"2023-10-25T16:14:48.873036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880483+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:48.880483+0000","last_peered":"2023-10-25T16:14:48.880483+0000","last_clean":"2023-10-25T16:14:48.880483+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:48.880483+0000","last_undegraded":"2023-10-25T16:14:48.880483+0000","last_fullsized":"2023-10-25T16:14:48.880483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.849846+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:48.849846+0000","last_peered":"2023-10-25T16:14:48.849846+0000","last_clean":"2023-10-25T16:14:48.849846+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:48.849846+0000","last_undegraded":"2023-10-25T16:14:48.849846+0000","last_fullsized":"2023-10-25T16:14:48.849846+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872880+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:48.872880+0000","last_peered":"2023-10-25T16:14:48.872880+0000","last_clean":"2023-10-25T16:14:48.872880+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:48.872880+0000","last_undegraded":"2023-10-25T16:14:48.872880+0000","last_fullsized":"2023-10-25T16:14:48.872880+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857123+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:48.857123+0000","last_peered":"2023-10-25T16:14:48.857123+0000","last_clean":"2023-10-25T16:14:48.857123+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:48.857123+0000","last_undegraded":"2023-10-25T16:14:48.857123+0000","last_fullsized":"2023-10-25T16:14:48.857123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868415+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:48.868415+0000","last_peered":"2023-10-25T16:14:48.868415+0000","last_clean":"2023-10-25T16:14:48.868415+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:48.868415+0000","last_undegraded":"2023-10-25T16:14:48.868415+0000","last_fullsized":"2023-10-25T16:14:48.868415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886761+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:48.886761+0000","last_peered":"2023-10-25T16:14:48.886761+0000","last_clean":"2023-10-25T16:14:48.886761+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:48.886761+0000","last_undegraded":"2023-10-25T16:14:48.886761+0000","last_fullsized":"2023-10-25T16:14:48.886761+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:46.814378+0000","last_change":"2023-10-25T16:14:46.814378+0000","last_active":"2023-10-25T16:14:46.814378+0000","last_peered":"2023-10-25T16:14:46.814378+0000","last_clean":"2023-10-25T16:14:46.814378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:46.814378+0000","last_undegraded":"2023-10-25T16:14:46.814378+0000","last_fullsized":"2023-10-25T16:14:46.814378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868926+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:48.868926+0000","last_peered":"2023-10-25T16:14:48.868926+0000","last_clean":"2023-10-25T16:14:48.868926+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:48.868926+0000","last_undegraded":"2023-10-25T16:14:48.868926+0000","last_fullsized":"2023-10-25T16:14:48.868926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879753+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:48.879753+0000","last_peered":"2023-10-25T16:14:48.879753+0000","last_clean":"2023-10-25T16:14:48.879753+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:48.879753+0000","last_undegraded":"2023-10-25T16:14:48.879753+0000","last_fullsized":"2023-10-25T16:14:48.879753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872484+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:48.872484+0000","last_peered":"2023-10-25T16:14:48.872484+0000","last_clean":"2023-10-25T16:14:48.872484+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:48.872484+0000","last_undegraded":"2023-10-25T16:14:48.872484+0000","last_fullsized":"2023-10-25T16:14:48.872484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878256+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:48.878256+0000","last_peered":"2023-10-25T16:14:48.878256+0000","last_clean":"2023-10-25T16:14:48.878256+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:48.878256+0000","last_undegraded":"2023-10-25T16:14:48.878256+0000","last_fullsized":"2023-10-25T16:14:48.878256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871763+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:48.871763+0000","last_peered":"2023-10-25T16:14:48.871763+0000","last_clean":"2023-10-25T16:14:48.871763+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:48.871763+0000","last_undegraded":"2023-10-25T16:14:48.871763+0000","last_fullsized":"2023-10-25T16:14:48.871763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:29:01.025167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857377+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:48.857377+0000","last_peered":"2023-10-25T16:14:48.857377+0000","last_clean":"2023-10-25T16:14:48.857377+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:48.857377+0000","last_undegraded":"2023-10-25T16:14:48.857377+0000","last_fullsized":"2023-10-25T16:14:48.857377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880581+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:48.880581+0000","last_peered":"2023-10-25T16:14:48.880581+0000","last_clean":"2023-10-25T16:14:48.880581+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:48.880581+0000","last_undegraded":"2023-10-25T16:14:48.880581+0000","last_fullsized":"2023-10-25T16:14:48.880581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874012+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:48.874012+0000","last_peered":"2023-10-25T16:14:48.874012+0000","last_clean":"2023-10-25T16:14:48.874012+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:48.874012+0000","last_undegraded":"2023-10-25T16:14:48.874012+0000","last_fullsized":"2023-10-25T16:14:48.874012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874219+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:48.874219+0000","last_peered":"2023-10-25T16:14:48.874219+0000","last_clean":"2023-10-25T16:14:48.874219+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:48.874219+0000","last_undegraded":"2023-10-25T16:14:48.874219+0000","last_fullsized":"2023-10-25T16:14:48.874219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.861107+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:48.861107+0000","last_peered":"2023-10-25T16:14:48.861107+0000","last_clean":"2023-10-25T16:14:48.861107+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:48.861107+0000","last_undegraded":"2023-10-25T16:14:48.861107+0000","last_fullsized":"2023-10-25T16:14:48.861107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863484+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:48.863484+0000","last_peered":"2023-10-25T16:14:48.863484+0000","last_clean":"2023-10-25T16:14:48.863484+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:48.863484+0000","last_undegraded":"2023-10-25T16:14:48.863484+0000","last_fullsized":"2023-10-25T16:14:48.863484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886331+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:48.886331+0000","last_peered":"2023-10-25T16:14:48.886331+0000","last_clean":"2023-10-25T16:14:48.886331+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:48.886331+0000","last_undegraded":"2023-10-25T16:14:48.886331+0000","last_fullsized":"2023-10-25T16:14:48.886331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850013+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:48.850013+0000","last_peered":"2023-10-25T16:14:48.850013+0000","last_clean":"2023-10-25T16:14:48.850013+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:48.850013+0000","last_undegraded":"2023-10-25T16:14:48.850013+0000","last_fullsized":"2023-10-25T16:14:48.850013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.888758+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:48.888758+0000","last_peered":"2023-10-25T16:14:48.888758+0000","last_clean":"2023-10-25T16:14:48.888758+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:48.888758+0000","last_undegraded":"2023-10-25T16:14:48.888758+0000","last_fullsized":"2023-10-25T16:14:48.888758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857285+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:48.857285+0000","last_peered":"2023-10-25T16:14:48.857285+0000","last_clean":"2023-10-25T16:14:48.857285+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:48.857285+0000","last_undegraded":"2023-10-25T16:14:48.857285+0000","last_fullsized":"2023-10-25T16:14:48.857285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871679+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:48.871679+0000","last_peered":"2023-10-25T16:14:48.871679+0000","last_clean":"2023-10-25T16:14:48.871679+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:48.871679+0000","last_undegraded":"2023-10-25T16:14:48.871679+0000","last_fullsized":"2023-10-25T16:14:48.871679+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.848890+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:48.848890+0000","last_peered":"2023-10-25T16:14:48.848890+0000","last_clean":"2023-10-25T16:14:48.848890+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:48.848890+0000","last_undegraded":"2023-10-25T16:14:48.848890+0000","last_fullsized":"2023-10-25T16:14:48.848890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.852307+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:48.852307+0000","last_peered":"2023-10-25T16:14:48.852307+0000","last_clean":"2023-10-25T16:14:48.852307+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:48.852307+0000","last_undegraded":"2023-10-25T16:14:48.852307+0000","last_fullsized":"2023-10-25T16:14:48.852307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871732+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:48.871732+0000","last_peered":"2023-10-25T16:14:48.871732+0000","last_clean":"2023-10-25T16:14:48.871732+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:48.871732+0000","last_undegraded":"2023-10-25T16:14:48.871732+0000","last_fullsized":"2023-10-25T16:14:48.871732+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874096+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:48.874096+0000","last_peered":"2023-10-25T16:14:48.874096+0000","last_clean":"2023-10-25T16:14:48.874096+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:48.874096+0000","last_undegraded":"2023-10-25T16:14:48.874096+0000","last_fullsized":"2023-10-25T16:14:48.874096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850187+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:48.850187+0000","last_peered":"2023-10-25T16:14:48.850187+0000","last_clean":"2023-10-25T16:14:48.850187+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:48.850187+0000","last_undegraded":"2023-10-25T16:14:48.850187+0000","last_fullsized":"2023-10-25T16:14:48.850187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881358+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:48.881358+0000","last_peered":"2023-10-25T16:14:48.881358+0000","last_clean":"2023-10-25T16:14:48.881358+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:48.881358+0000","last_undegraded":"2023-10-25T16:14:48.881358+0000","last_fullsized":"2023-10-25T16:14:48.881358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:15.015350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857778+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:48.857778+0000","last_peered":"2023-10-25T16:14:48.857778+0000","last_clean":"2023-10-25T16:14:48.857778+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:48.857778+0000","last_undegraded":"2023-10-25T16:14:48.857778+0000","last_fullsized":"2023-10-25T16:14:48.857778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878787+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:48.878787+0000","last_peered":"2023-10-25T16:14:48.878787+0000","last_clean":"2023-10-25T16:14:48.878787+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:48.878787+0000","last_undegraded":"2023-10-25T16:14:48.878787+0000","last_fullsized":"2023-10-25T16:14:48.878787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868388+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:48.868388+0000","last_peered":"2023-10-25T16:14:48.868388+0000","last_clean":"2023-10-25T16:14:48.868388+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:48.868388+0000","last_undegraded":"2023-10-25T16:14:48.868388+0000","last_fullsized":"2023-10-25T16:14:48.868388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879152+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:48.879152+0000","last_peered":"2023-10-25T16:14:48.879152+0000","last_clean":"2023-10-25T16:14:48.879152+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:48.879152+0000","last_undegraded":"2023-10-25T16:14:48.879152+0000","last_fullsized":"2023-10-25T16:14:48.879152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.855133+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:48.855133+0000","last_peered":"2023-10-25T16:14:48.855133+0000","last_clean":"2023-10-25T16:14:48.855133+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:48.855133+0000","last_undegraded":"2023-10-25T16:14:48.855133+0000","last_fullsized":"2023-10-25T16:14:48.855133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860018+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:48.860018+0000","last_peered":"2023-10-25T16:14:48.860018+0000","last_clean":"2023-10-25T16:14:48.860018+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:48.860018+0000","last_undegraded":"2023-10-25T16:14:48.860018+0000","last_fullsized":"2023-10-25T16:14:48.860018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872800+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:48.872800+0000","last_peered":"2023-10-25T16:14:48.872800+0000","last_clean":"2023-10-25T16:14:48.872800+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:48.872800+0000","last_undegraded":"2023-10-25T16:14:48.872800+0000","last_fullsized":"2023-10-25T16:14:48.872800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-25T16:14:47.845101+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:47.845101+0000","last_peered":"2023-10-25T16:14:47.845101+0000","last_clean":"2023-10-25T16:14:47.845101+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:47.845101+0000","last_undegraded":"2023-10-25T16:14:47.845101+0000","last_fullsized":"2023-10-25T16:14:47.845101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":60,"acting":60,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":181,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195130,"statfs":{"total":200000000,"available":199814043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93799999999999994}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.90200000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.87}]}]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199184342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.622}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82999999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.99199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774128,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.252}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.93200000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.872},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.089}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.337},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.1799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.121}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.1539999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":221,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96899999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.077}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.998}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.879}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.236}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0349999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.175},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.2070000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.4650000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0209999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.377},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.746},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.103}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.024}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:52.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:52.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/193475411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580c9e50 msgr2=0x7fe25806ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 --2- 172.21.15.177:0/193475411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580c9e50 0x7fe25806ba00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe2480098f0 tx=0x7fe24801c890 comp rx=0 tx=0).stop 2023-10-25T16:14:52.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/193475411 shutdown_connections 2023-10-25T16:14:52.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 --2- 172.21.15.177:0/193475411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2580c9e50 0x7fe25806ba00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 --2- 172.21.15.177:0/193475411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2581500f0 0x7fe2580c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/193475411 >> 172.21.15.177:0/193475411 conn(0x7fe2580b2450 msgr2=0x7fe2580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:52.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/193475411 shutdown_connections 2023-10-25T16:14:52.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/193475411 wait complete. 2023-10-25T16:14:52.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 Processor -- start 2023-10-25T16:14:52.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- start start 2023-10-25T16:14:52.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 0x7fe2581483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2580c9e50 0x7fe258162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2581500f0 0x7fe2580b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258163880 con 0x7fe25806bf40 2023-10-25T16:14:52.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258163ca0 con 0x7fe2580c9e50 2023-10-25T16:14:52.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe258162c00 con 0x7fe2581500f0 2023-10-25T16:14:52.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 0x7fe2581483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 0x7fe2581483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56322/0 (socket says 172.21.15.177:56322) 2023-10-25T16:14:52.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 -- 172.21.15.177:0/62385684 learned_addr learned my addr 172.21.15.177:0/62385684 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:52.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 -- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2581500f0 msgr2=0x7fe2580b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe2577fe640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2581500f0 0x7fe2580b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe2567fc640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2580c9e50 0x7fe258162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2581500f0 0x7fe2580b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 -- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2580c9e50 msgr2=0x7fe258162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2580c9e50 0x7fe258162220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 -- 172.21.15.177:0/62385684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248009500 con 0x7fe25806bf40 2023-10-25T16:14:52.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe256ffd640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 0x7fe2581483e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe24000ccb0 tx=0x7fe24000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:52.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240004b30 con 0x7fe25806bf40 2023-10-25T16:14:52.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe240004d80 con 0x7fe25806bf40 2023-10-25T16:14:52.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe258162ee0 con 0x7fe25806bf40 2023-10-25T16:14:52.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240005280 con 0x7fe25806bf40 2023-10-25T16:14:52.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.415+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2581634a0 con 0x7fe25806bf40 2023-10-25T16:14:52.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.419+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe258163af0 con 0x7fe25806bf40 2023-10-25T16:14:52.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.419+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2400053e0 con 0x7fe25806bf40 2023-10-25T16:14:52.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.419+0000 7fe24ffff640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe238066470 0x7fe238068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.419+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe240084a80 con 0x7fe25806bf40 2023-10-25T16:14:52.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.419+0000 7fe2567fc640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe238066470 0x7fe238068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.419+0000 7fe2567fc640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe238066470 0x7fe238068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe2480af000 tx=0x7fe24801b0d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:52.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.423+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe240051f90 con 0x7fe25806bf40 2023-10-25T16:14:52.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.575+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe25804daf0 con 0x7fe238066470 2023-10-25T16:14:52.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.595+0000 7fe24ffff640 1 -- 172.21.15.177:0/62385684 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282690 (secure 0 0 0) 0x7fe25804daf0 con 0x7fe238066470 2023-10-25T16:14:52.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:52.605 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:52.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe238066470 msgr2=0x7fe238068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe238066470 0x7fe238068930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe2480af000 tx=0x7fe24801b0d0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 msgr2=0x7fe2581483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 0x7fe2581483e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe24000ccb0 tx=0x7fe24000a620 comp rx=0 tx=0).stop 2023-10-25T16:14:52.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 shutdown_connections 2023-10-25T16:14:52.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe238066470 0x7fe238068930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2581500f0 0x7fe2580b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2580c9e50 0x7fe258162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 --2- 172.21.15.177:0/62385684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe25806bf40 0x7fe2581483e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 >> 172.21.15.177:0/62385684 conn(0x7fe2580b2450 msgr2=0x7fe25814d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:52.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 shutdown_connections 2023-10-25T16:14:52.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.599+0000 7fe25d923640 1 -- 172.21.15.177:0/62385684 wait complete. 2023-10-25T16:14:52.622 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-10-25T16:14:50.640460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2877,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559622,"statfs":{"total":1600000000,"available":1597053721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001090"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.862030+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:48.862030+0000","last_peered":"2023-10-25T16:14:48.862030+0000","last_clean":"2023-10-25T16:14:48.862030+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:48.862030+0000","last_undegraded":"2023-10-25T16:14:48.862030+0000","last_fullsized":"2023-10-25T16:14:48.862030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886809+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:48.886809+0000","last_peered":"2023-10-25T16:14:48.886809+0000","last_clean":"2023-10-25T16:14:48.886809+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:48.886809+0000","last_undegraded":"2023-10-25T16:14:48.886809+0000","last_fullsized":"2023-10-25T16:14:48.886809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879850+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:48.879850+0000","last_peered":"2023-10-25T16:14:48.879850+0000","last_clean":"2023-10-25T16:14:48.879850+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:48.879850+0000","last_undegraded":"2023-10-25T16:14:48.879850+0000","last_fullsized":"2023-10-25T16:14:48.879850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868897+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:48.868897+0000","last_peered":"2023-10-25T16:14:48.868897+0000","last_clean":"2023-10-25T16:14:48.868897+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:48.868897+0000","last_undegraded":"2023-10-25T16:14:48.868897+0000","last_fullsized":"2023-10-25T16:14:48.868897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869762+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:48.869762+0000","last_peered":"2023-10-25T16:14:48.869762+0000","last_clean":"2023-10-25T16:14:48.869762+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:48.869762+0000","last_undegraded":"2023-10-25T16:14:48.869762+0000","last_fullsized":"2023-10-25T16:14:48.869762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874074+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:48.874074+0000","last_peered":"2023-10-25T16:14:48.874074+0000","last_clean":"2023-10-25T16:14:48.874074+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:48.874074+0000","last_undegraded":"2023-10-25T16:14:48.874074+0000","last_fullsized":"2023-10-25T16:14:48.874074+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.704168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876691+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:48.876691+0000","last_peered":"2023-10-25T16:14:48.876691+0000","last_clean":"2023-10-25T16:14:48.876691+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:48.876691+0000","last_undegraded":"2023-10-25T16:14:48.876691+0000","last_fullsized":"2023-10-25T16:14:48.876691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864126+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:48.864126+0000","last_peered":"2023-10-25T16:14:48.864126+0000","last_clean":"2023-10-25T16:14:48.864126+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:48.864126+0000","last_undegraded":"2023-10-25T16:14:48.864126+0000","last_fullsized":"2023-10-25T16:14:48.864126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883567+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:48.883567+0000","last_peered":"2023-10-25T16:14:48.883567+0000","last_clean":"2023-10-25T16:14:48.883567+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:48.883567+0000","last_undegraded":"2023-10-25T16:14:48.883567+0000","last_fullsized":"2023-10-25T16:14:48.883567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864627+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:48.864627+0000","last_peered":"2023-10-25T16:14:48.864627+0000","last_clean":"2023-10-25T16:14:48.864627+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:48.864627+0000","last_undegraded":"2023-10-25T16:14:48.864627+0000","last_fullsized":"2023-10-25T16:14:48.864627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883250+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:48.883250+0000","last_peered":"2023-10-25T16:14:48.883250+0000","last_clean":"2023-10-25T16:14:48.883250+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:48.883250+0000","last_undegraded":"2023-10-25T16:14:48.883250+0000","last_fullsized":"2023-10-25T16:14:48.883250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881599+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:48.881599+0000","last_peered":"2023-10-25T16:14:48.881599+0000","last_clean":"2023-10-25T16:14:48.881599+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:48.881599+0000","last_undegraded":"2023-10-25T16:14:48.881599+0000","last_fullsized":"2023-10-25T16:14:48.881599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.885307+0000","last_change":"2023-10-25T16:14:48.884361+0000","last_active":"2023-10-25T16:14:48.885307+0000","last_peered":"2023-10-25T16:14:48.885307+0000","last_clean":"2023-10-25T16:14:48.885307+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:48.885307+0000","last_undegraded":"2023-10-25T16:14:48.885307+0000","last_fullsized":"2023-10-25T16:14:48.885307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876262+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:48.876262+0000","last_peered":"2023-10-25T16:14:48.876262+0000","last_clean":"2023-10-25T16:14:48.876262+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:48.876262+0000","last_undegraded":"2023-10-25T16:14:48.876262+0000","last_fullsized":"2023-10-25T16:14:48.876262+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884903+0000","last_change":"2023-10-25T16:14:48.884844+0000","last_active":"2023-10-25T16:14:48.884903+0000","last_peered":"2023-10-25T16:14:48.884903+0000","last_clean":"2023-10-25T16:14:48.884903+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:48.884903+0000","last_undegraded":"2023-10-25T16:14:48.884903+0000","last_fullsized":"2023-10-25T16:14:48.884903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868577+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:48.868577+0000","last_peered":"2023-10-25T16:14:48.868577+0000","last_clean":"2023-10-25T16:14:48.868577+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:48.868577+0000","last_undegraded":"2023-10-25T16:14:48.868577+0000","last_fullsized":"2023-10-25T16:14:48.868577+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877481+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:48.877481+0000","last_peered":"2023-10-25T16:14:48.877481+0000","last_clean":"2023-10-25T16:14:48.877481+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:48.877481+0000","last_undegraded":"2023-10-25T16:14:48.877481+0000","last_fullsized":"2023-10-25T16:14:48.877481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873219+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:48.873219+0000","last_peered":"2023-10-25T16:14:48.873219+0000","last_clean":"2023-10-25T16:14:48.873219+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:48.873219+0000","last_undegraded":"2023-10-25T16:14:48.873219+0000","last_fullsized":"2023-10-25T16:14:48.873219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869215+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:48.869215+0000","last_peered":"2023-10-25T16:14:48.869215+0000","last_clean":"2023-10-25T16:14:48.869215+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:48.869215+0000","last_undegraded":"2023-10-25T16:14:48.869215+0000","last_fullsized":"2023-10-25T16:14:48.869215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:54.213888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883301+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:48.883301+0000","last_peered":"2023-10-25T16:14:48.883301+0000","last_clean":"2023-10-25T16:14:48.883301+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:48.883301+0000","last_undegraded":"2023-10-25T16:14:48.883301+0000","last_fullsized":"2023-10-25T16:14:48.883301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865001+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:48.865001+0000","last_peered":"2023-10-25T16:14:48.865001+0000","last_clean":"2023-10-25T16:14:48.865001+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:48.865001+0000","last_undegraded":"2023-10-25T16:14:48.865001+0000","last_fullsized":"2023-10-25T16:14:48.865001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:15.704551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875694+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:48.875694+0000","last_peered":"2023-10-25T16:14:48.875694+0000","last_clean":"2023-10-25T16:14:48.875694+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:48.875694+0000","last_undegraded":"2023-10-25T16:14:48.875694+0000","last_fullsized":"2023-10-25T16:14:48.875694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879591+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:48.879591+0000","last_peered":"2023-10-25T16:14:48.879591+0000","last_clean":"2023-10-25T16:14:48.879591+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:48.879591+0000","last_undegraded":"2023-10-25T16:14:48.879591+0000","last_fullsized":"2023-10-25T16:14:48.879591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:33:21.460992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868627+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:48.868627+0000","last_peered":"2023-10-25T16:14:48.868627+0000","last_clean":"2023-10-25T16:14:48.868627+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:48.868627+0000","last_undegraded":"2023-10-25T16:14:48.868627+0000","last_fullsized":"2023-10-25T16:14:48.868627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881624+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:48.881624+0000","last_peered":"2023-10-25T16:14:48.881624+0000","last_clean":"2023-10-25T16:14:48.881624+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:48.881624+0000","last_undegraded":"2023-10-25T16:14:48.881624+0000","last_fullsized":"2023-10-25T16:14:48.881624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879135+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:48.879135+0000","last_peered":"2023-10-25T16:14:48.879135+0000","last_clean":"2023-10-25T16:14:48.879135+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:48.879135+0000","last_undegraded":"2023-10-25T16:14:48.879135+0000","last_fullsized":"2023-10-25T16:14:48.879135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860777+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:48.860777+0000","last_peered":"2023-10-25T16:14:48.860777+0000","last_clean":"2023-10-25T16:14:48.860777+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:48.860777+0000","last_undegraded":"2023-10-25T16:14:48.860777+0000","last_fullsized":"2023-10-25T16:14:48.860777+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.870390+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:48.870390+0000","last_peered":"2023-10-25T16:14:48.870390+0000","last_clean":"2023-10-25T16:14:48.870390+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:48.870390+0000","last_undegraded":"2023-10-25T16:14:48.870390+0000","last_fullsized":"2023-10-25T16:14:48.870390+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:45.872159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875933+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:48.875933+0000","last_peered":"2023-10-25T16:14:48.875933+0000","last_clean":"2023-10-25T16:14:48.875933+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:48.875933+0000","last_undegraded":"2023-10-25T16:14:48.875933+0000","last_fullsized":"2023-10-25T16:14:48.875933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874161+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:48.874161+0000","last_peered":"2023-10-25T16:14:48.874161+0000","last_clean":"2023-10-25T16:14:48.874161+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:48.874161+0000","last_undegraded":"2023-10-25T16:14:48.874161+0000","last_fullsized":"2023-10-25T16:14:48.874161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877787+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:48.877787+0000","last_peered":"2023-10-25T16:14:48.877787+0000","last_clean":"2023-10-25T16:14:48.877787+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:48.877787+0000","last_undegraded":"2023-10-25T16:14:48.877787+0000","last_fullsized":"2023-10-25T16:14:48.877787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:23:28.152972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871080+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:48.871080+0000","last_peered":"2023-10-25T16:14:48.871080+0000","last_clean":"2023-10-25T16:14:48.871080+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:48.871080+0000","last_undegraded":"2023-10-25T16:14:48.871080+0000","last_fullsized":"2023-10-25T16:14:48.871080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868976+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:48.868976+0000","last_peered":"2023-10-25T16:14:48.868976+0000","last_clean":"2023-10-25T16:14:48.868976+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:48.868976+0000","last_undegraded":"2023-10-25T16:14:48.868976+0000","last_fullsized":"2023-10-25T16:14:48.868976+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877619+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:48.877619+0000","last_peered":"2023-10-25T16:14:48.877619+0000","last_clean":"2023-10-25T16:14:48.877619+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:48.877619+0000","last_undegraded":"2023-10-25T16:14:48.877619+0000","last_fullsized":"2023-10-25T16:14:48.877619+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875387+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:48.875387+0000","last_peered":"2023-10-25T16:14:48.875387+0000","last_clean":"2023-10-25T16:14:48.875387+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:48.875387+0000","last_undegraded":"2023-10-25T16:14:48.875387+0000","last_fullsized":"2023-10-25T16:14:48.875387+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875842+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:48.875842+0000","last_peered":"2023-10-25T16:14:48.875842+0000","last_clean":"2023-10-25T16:14:48.875842+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:48.875842+0000","last_undegraded":"2023-10-25T16:14:48.875842+0000","last_fullsized":"2023-10-25T16:14:48.875842+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878002+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:48.878002+0000","last_peered":"2023-10-25T16:14:48.878002+0000","last_clean":"2023-10-25T16:14:48.878002+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:48.878002+0000","last_undegraded":"2023-10-25T16:14:48.878002+0000","last_fullsized":"2023-10-25T16:14:48.878002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875032+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:48.875032+0000","last_peered":"2023-10-25T16:14:48.875032+0000","last_clean":"2023-10-25T16:14:48.875032+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:48.875032+0000","last_undegraded":"2023-10-25T16:14:48.875032+0000","last_fullsized":"2023-10-25T16:14:48.875032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883519+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:48.883519+0000","last_peered":"2023-10-25T16:14:48.883519+0000","last_clean":"2023-10-25T16:14:48.883519+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:48.883519+0000","last_undegraded":"2023-10-25T16:14:48.883519+0000","last_fullsized":"2023-10-25T16:14:48.883519+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879623+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:48.879623+0000","last_peered":"2023-10-25T16:14:48.879623+0000","last_clean":"2023-10-25T16:14:48.879623+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:48.879623+0000","last_undegraded":"2023-10-25T16:14:48.879623+0000","last_fullsized":"2023-10-25T16:14:48.879623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865076+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:48.865076+0000","last_peered":"2023-10-25T16:14:48.865076+0000","last_clean":"2023-10-25T16:14:48.865076+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:48.865076+0000","last_undegraded":"2023-10-25T16:14:48.865076+0000","last_fullsized":"2023-10-25T16:14:48.865076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860901+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.860901+0000","last_peered":"2023-10-25T16:14:48.860901+0000","last_clean":"2023-10-25T16:14:48.860901+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:48.860901+0000","last_undegraded":"2023-10-25T16:14:48.860901+0000","last_fullsized":"2023-10-25T16:14:48.860901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875524+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:48.875524+0000","last_peered":"2023-10-25T16:14:48.875524+0000","last_clean":"2023-10-25T16:14:48.875524+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:48.875524+0000","last_undegraded":"2023-10-25T16:14:48.875524+0000","last_fullsized":"2023-10-25T16:14:48.875524+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863335+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:48.863335+0000","last_peered":"2023-10-25T16:14:48.863335+0000","last_clean":"2023-10-25T16:14:48.863335+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:48.863335+0000","last_undegraded":"2023-10-25T16:14:48.863335+0000","last_fullsized":"2023-10-25T16:14:48.863335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873934+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:48.873934+0000","last_peered":"2023-10-25T16:14:48.873934+0000","last_clean":"2023-10-25T16:14:48.873934+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:48.873934+0000","last_undegraded":"2023-10-25T16:14:48.873934+0000","last_fullsized":"2023-10-25T16:14:48.873934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.856803+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:48.856803+0000","last_peered":"2023-10-25T16:14:48.856803+0000","last_clean":"2023-10-25T16:14:48.856803+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:48.856803+0000","last_undegraded":"2023-10-25T16:14:48.856803+0000","last_fullsized":"2023-10-25T16:14:48.856803+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864185+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:48.864185+0000","last_peered":"2023-10-25T16:14:48.864185+0000","last_clean":"2023-10-25T16:14:48.864185+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:48.864185+0000","last_undegraded":"2023-10-25T16:14:48.864185+0000","last_fullsized":"2023-10-25T16:14:48.864185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.858667+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.858667+0000","last_peered":"2023-10-25T16:14:48.858667+0000","last_clean":"2023-10-25T16:14:48.858667+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:48.858667+0000","last_undegraded":"2023-10-25T16:14:48.858667+0000","last_fullsized":"2023-10-25T16:14:48.858667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880331+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:48.880331+0000","last_peered":"2023-10-25T16:14:48.880331+0000","last_clean":"2023-10-25T16:14:48.880331+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:48.880331+0000","last_undegraded":"2023-10-25T16:14:48.880331+0000","last_fullsized":"2023-10-25T16:14:48.880331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877980+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:48.877980+0000","last_peered":"2023-10-25T16:14:48.877980+0000","last_clean":"2023-10-25T16:14:48.877980+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:48.877980+0000","last_undegraded":"2023-10-25T16:14:48.877980+0000","last_fullsized":"2023-10-25T16:14:48.877980+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875144+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:48.875144+0000","last_peered":"2023-10-25T16:14:48.875144+0000","last_clean":"2023-10-25T16:14:48.875144+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:48.875144+0000","last_undegraded":"2023-10-25T16:14:48.875144+0000","last_fullsized":"2023-10-25T16:14:48.875144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:46.814378+0000","last_change":"2023-10-25T16:14:46.814378+0000","last_active":"2023-10-25T16:14:46.814378+0000","last_peered":"2023-10-25T16:14:46.814378+0000","last_clean":"2023-10-25T16:14:46.814378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:46.814378+0000","last_undegraded":"2023-10-25T16:14:46.814378+0000","last_fullsized":"2023-10-25T16:14:46.814378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884735+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:48.884735+0000","last_peered":"2023-10-25T16:14:48.884735+0000","last_clean":"2023-10-25T16:14:48.884735+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:48.884735+0000","last_undegraded":"2023-10-25T16:14:48.884735+0000","last_fullsized":"2023-10-25T16:14:48.884735+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:22.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873036+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:48.873036+0000","last_peered":"2023-10-25T16:14:48.873036+0000","last_clean":"2023-10-25T16:14:48.873036+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:48.873036+0000","last_undegraded":"2023-10-25T16:14:48.873036+0000","last_fullsized":"2023-10-25T16:14:48.873036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880483+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:48.880483+0000","last_peered":"2023-10-25T16:14:48.880483+0000","last_clean":"2023-10-25T16:14:48.880483+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:48.880483+0000","last_undegraded":"2023-10-25T16:14:48.880483+0000","last_fullsized":"2023-10-25T16:14:48.880483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.849846+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:48.849846+0000","last_peered":"2023-10-25T16:14:48.849846+0000","last_clean":"2023-10-25T16:14:48.849846+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:48.849846+0000","last_undegraded":"2023-10-25T16:14:48.849846+0000","last_fullsized":"2023-10-25T16:14:48.849846+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872880+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:48.872880+0000","last_peered":"2023-10-25T16:14:48.872880+0000","last_clean":"2023-10-25T16:14:48.872880+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:48.872880+0000","last_undegraded":"2023-10-25T16:14:48.872880+0000","last_fullsized":"2023-10-25T16:14:48.872880+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857123+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:48.857123+0000","last_peered":"2023-10-25T16:14:48.857123+0000","last_clean":"2023-10-25T16:14:48.857123+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:48.857123+0000","last_undegraded":"2023-10-25T16:14:48.857123+0000","last_fullsized":"2023-10-25T16:14:48.857123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868415+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:48.868415+0000","last_peered":"2023-10-25T16:14:48.868415+0000","last_clean":"2023-10-25T16:14:48.868415+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:48.868415+0000","last_undegraded":"2023-10-25T16:14:48.868415+0000","last_fullsized":"2023-10-25T16:14:48.868415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886761+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:48.886761+0000","last_peered":"2023-10-25T16:14:48.886761+0000","last_clean":"2023-10-25T16:14:48.886761+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:48.886761+0000","last_undegraded":"2023-10-25T16:14:48.886761+0000","last_fullsized":"2023-10-25T16:14:48.886761+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:46.814378+0000","last_change":"2023-10-25T16:14:46.814378+0000","last_active":"2023-10-25T16:14:46.814378+0000","last_peered":"2023-10-25T16:14:46.814378+0000","last_clean":"2023-10-25T16:14:46.814378+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:46.814378+0000","last_undegraded":"2023-10-25T16:14:46.814378+0000","last_fullsized":"2023-10-25T16:14:46.814378+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868926+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:48.868926+0000","last_peered":"2023-10-25T16:14:48.868926+0000","last_clean":"2023-10-25T16:14:48.868926+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:48.868926+0000","last_undegraded":"2023-10-25T16:14:48.868926+0000","last_fullsized":"2023-10-25T16:14:48.868926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879753+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:48.879753+0000","last_peered":"2023-10-25T16:14:48.879753+0000","last_clean":"2023-10-25T16:14:48.879753+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:48.879753+0000","last_undegraded":"2023-10-25T16:14:48.879753+0000","last_fullsized":"2023-10-25T16:14:48.879753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872484+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:48.872484+0000","last_peered":"2023-10-25T16:14:48.872484+0000","last_clean":"2023-10-25T16:14:48.872484+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:48.872484+0000","last_undegraded":"2023-10-25T16:14:48.872484+0000","last_fullsized":"2023-10-25T16:14:48.872484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878256+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:48.878256+0000","last_peered":"2023-10-25T16:14:48.878256+0000","last_clean":"2023-10-25T16:14:48.878256+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:48.878256+0000","last_undegraded":"2023-10-25T16:14:48.878256+0000","last_fullsized":"2023-10-25T16:14:48.878256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871763+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:48.871763+0000","last_peered":"2023-10-25T16:14:48.871763+0000","last_clean":"2023-10-25T16:14:48.871763+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:48.871763+0000","last_undegraded":"2023-10-25T16:14:48.871763+0000","last_fullsized":"2023-10-25T16:14:48.871763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:29:01.025167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857377+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:48.857377+0000","last_peered":"2023-10-25T16:14:48.857377+0000","last_clean":"2023-10-25T16:14:48.857377+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:48.857377+0000","last_undegraded":"2023-10-25T16:14:48.857377+0000","last_fullsized":"2023-10-25T16:14:48.857377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880581+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:48.880581+0000","last_peered":"2023-10-25T16:14:48.880581+0000","last_clean":"2023-10-25T16:14:48.880581+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:48.880581+0000","last_undegraded":"2023-10-25T16:14:48.880581+0000","last_fullsized":"2023-10-25T16:14:48.880581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874012+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:48.874012+0000","last_peered":"2023-10-25T16:14:48.874012+0000","last_clean":"2023-10-25T16:14:48.874012+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:48.874012+0000","last_undegraded":"2023-10-25T16:14:48.874012+0000","last_fullsized":"2023-10-25T16:14:48.874012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874219+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:48.874219+0000","last_peered":"2023-10-25T16:14:48.874219+0000","last_clean":"2023-10-25T16:14:48.874219+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:48.874219+0000","last_undegraded":"2023-10-25T16:14:48.874219+0000","last_fullsized":"2023-10-25T16:14:48.874219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.861107+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:48.861107+0000","last_peered":"2023-10-25T16:14:48.861107+0000","last_clean":"2023-10-25T16:14:48.861107+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:48.861107+0000","last_undegraded":"2023-10-25T16:14:48.861107+0000","last_fullsized":"2023-10-25T16:14:48.861107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:14:47.827119+0000","last_change":"2023-10-25T16:14:47.827119+0000","last_active":"2023-10-25T16:14:47.827119+0000","last_peered":"2023-10-25T16:14:47.827119+0000","last_clean":"2023-10-25T16:14:47.827119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:14:47.827119+0000","last_undegraded":"2023-10-25T16:14:47.827119+0000","last_fullsized":"2023-10-25T16:14:47.827119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863484+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:48.863484+0000","last_peered":"2023-10-25T16:14:48.863484+0000","last_clean":"2023-10-25T16:14:48.863484+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:48.863484+0000","last_undegraded":"2023-10-25T16:14:48.863484+0000","last_fullsized":"2023-10-25T16:14:48.863484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886331+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:48.886331+0000","last_peered":"2023-10-25T16:14:48.886331+0000","last_clean":"2023-10-25T16:14:48.886331+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:48.886331+0000","last_undegraded":"2023-10-25T16:14:48.886331+0000","last_fullsized":"2023-10-25T16:14:48.886331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850013+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:48.850013+0000","last_peered":"2023-10-25T16:14:48.850013+0000","last_clean":"2023-10-25T16:14:48.850013+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:48.850013+0000","last_undegraded":"2023-10-25T16:14:48.850013+0000","last_fullsized":"2023-10-25T16:14:48.850013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.888758+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:48.888758+0000","last_peered":"2023-10-25T16:14:48.888758+0000","last_clean":"2023-10-25T16:14:48.888758+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:48.888758+0000","last_undegraded":"2023-10-25T16:14:48.888758+0000","last_fullsized":"2023-10-25T16:14:48.888758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857285+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:48.857285+0000","last_peered":"2023-10-25T16:14:48.857285+0000","last_clean":"2023-10-25T16:14:48.857285+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:48.857285+0000","last_undegraded":"2023-10-25T16:14:48.857285+0000","last_fullsized":"2023-10-25T16:14:48.857285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871679+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:48.871679+0000","last_peered":"2023-10-25T16:14:48.871679+0000","last_clean":"2023-10-25T16:14:48.871679+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:48.871679+0000","last_undegraded":"2023-10-25T16:14:48.871679+0000","last_fullsized":"2023-10-25T16:14:48.871679+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.848890+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:48.848890+0000","last_peered":"2023-10-25T16:14:48.848890+0000","last_clean":"2023-10-25T16:14:48.848890+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:48.848890+0000","last_undegraded":"2023-10-25T16:14:48.848890+0000","last_fullsized":"2023-10-25T16:14:48.848890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.852307+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:48.852307+0000","last_peered":"2023-10-25T16:14:48.852307+0000","last_clean":"2023-10-25T16:14:48.852307+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:48.852307+0000","last_undegraded":"2023-10-25T16:14:48.852307+0000","last_fullsized":"2023-10-25T16:14:48.852307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871732+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:48.871732+0000","last_peered":"2023-10-25T16:14:48.871732+0000","last_clean":"2023-10-25T16:14:48.871732+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:48.871732+0000","last_undegraded":"2023-10-25T16:14:48.871732+0000","last_fullsized":"2023-10-25T16:14:48.871732+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874096+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:48.874096+0000","last_peered":"2023-10-25T16:14:48.874096+0000","last_clean":"2023-10-25T16:14:48.874096+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:48.874096+0000","last_undegraded":"2023-10-25T16:14:48.874096+0000","last_fullsized":"2023-10-25T16:14:48.874096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850187+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:48.850187+0000","last_peered":"2023-10-25T16:14:48.850187+0000","last_clean":"2023-10-25T16:14:48.850187+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:48.850187+0000","last_undegraded":"2023-10-25T16:14:48.850187+0000","last_fullsized":"2023-10-25T16:14:48.850187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881358+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:48.881358+0000","last_peered":"2023-10-25T16:14:48.881358+0000","last_clean":"2023-10-25T16:14:48.881358+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:48.881358+0000","last_undegraded":"2023-10-25T16:14:48.881358+0000","last_fullsized":"2023-10-25T16:14:48.881358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:15.015350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857778+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:48.857778+0000","last_peered":"2023-10-25T16:14:48.857778+0000","last_clean":"2023-10-25T16:14:48.857778+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:48.857778+0000","last_undegraded":"2023-10-25T16:14:48.857778+0000","last_fullsized":"2023-10-25T16:14:48.857778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878787+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:48.878787+0000","last_peered":"2023-10-25T16:14:48.878787+0000","last_clean":"2023-10-25T16:14:48.878787+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:48.878787+0000","last_undegraded":"2023-10-25T16:14:48.878787+0000","last_fullsized":"2023-10-25T16:14:48.878787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868388+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:48.868388+0000","last_peered":"2023-10-25T16:14:48.868388+0000","last_clean":"2023-10-25T16:14:48.868388+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:48.868388+0000","last_undegraded":"2023-10-25T16:14:48.868388+0000","last_fullsized":"2023-10-25T16:14:48.868388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879152+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:48.879152+0000","last_peered":"2023-10-25T16:14:48.879152+0000","last_clean":"2023-10-25T16:14:48.879152+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:48.879152+0000","last_undegraded":"2023-10-25T16:14:48.879152+0000","last_fullsized":"2023-10-25T16:14:48.879152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.855133+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:48.855133+0000","last_peered":"2023-10-25T16:14:48.855133+0000","last_clean":"2023-10-25T16:14:48.855133+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:48.855133+0000","last_undegraded":"2023-10-25T16:14:48.855133+0000","last_fullsized":"2023-10-25T16:14:48.855133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860018+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:48.860018+0000","last_peered":"2023-10-25T16:14:48.860018+0000","last_clean":"2023-10-25T16:14:48.860018+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:48.860018+0000","last_undegraded":"2023-10-25T16:14:48.860018+0000","last_fullsized":"2023-10-25T16:14:48.860018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872800+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:48.872800+0000","last_peered":"2023-10-25T16:14:48.872800+0000","last_clean":"2023-10-25T16:14:48.872800+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:48.872800+0000","last_undegraded":"2023-10-25T16:14:48.872800+0000","last_fullsized":"2023-10-25T16:14:48.872800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-25T16:14:47.845101+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:47.845101+0000","last_peered":"2023-10-25T16:14:47.845101+0000","last_clean":"2023-10-25T16:14:47.845101+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:47.845101+0000","last_undegraded":"2023-10-25T16:14:47.845101+0000","last_fullsized":"2023-10-25T16:14:47.845101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":60,"acting":60,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":181,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195130,"statfs":{"total":200000000,"available":199814043,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.93799999999999994}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.90200000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.87}]}]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199184342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.622}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82999999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.99199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774128,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.252}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.93200000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.872},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.089}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.337},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.1799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.121}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.1539999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":221,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96899999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.077}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.998}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.879}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.236}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0349999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.175},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.2070000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.4650000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0209999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.377},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.746},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.103}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.024}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:52.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-10-25T16:14:52.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:47.827119+0000', 'last_change': '2023-10-25T16:14:47.827119+0000', 'last_active': '2023-10-25T16:14:47.827119+0000', 'last_peered': '2023-10-25T16:14:47.827119+0000', 'last_clean': '2023-10-25T16:14:47.827119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:47.827119+0000', 'last_undegraded': '2023-10-25T16:14:47.827119+0000', 'last_fullsized': '2023-10-25T16:14:47.827119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-10-25T16:14:52.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:47.827119+0000', 'last_change': '2023-10-25T16:14:47.827119+0000', 'last_active': '2023-10-25T16:14:47.827119+0000', 'last_peered': '2023-10-25T16:14:47.827119+0000', 'last_clean': '2023-10-25T16:14:47.827119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:47.827119+0000', 'last_undegraded': '2023-10-25T16:14:47.827119+0000', 'last_fullsized': '2023-10-25T16:14:47.827119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-10-25T16:14:52.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:47.827119+0000', 'last_change': '2023-10-25T16:14:47.827119+0000', 'last_active': '2023-10-25T16:14:47.827119+0000', 'last_peered': '2023-10-25T16:14:47.827119+0000', 'last_clean': '2023-10-25T16:14:47.827119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:47.827119+0000', 'last_undegraded': '2023-10-25T16:14:47.827119+0000', 'last_fullsized': '2023-10-25T16:14:47.827119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-10-25T16:14:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:47.827119+0000', 'last_change': '2023-10-25T16:14:47.827119+0000', 'last_active': '2023-10-25T16:14:47.827119+0000', 'last_peered': '2023-10-25T16:14:47.827119+0000', 'last_clean': '2023-10-25T16:14:47.827119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:47.827119+0000', 'last_undegraded': '2023-10-25T16:14:47.827119+0000', 'last_fullsized': '2023-10-25T16:14:47.827119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-25T16:14:52.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:46.814378+0000', 'last_change': '2023-10-25T16:14:46.814378+0000', 'last_active': '2023-10-25T16:14:46.814378+0000', 'last_peered': '2023-10-25T16:14:46.814378+0000', 'last_clean': '2023-10-25T16:14:46.814378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:46.814378+0000', 'last_undegraded': '2023-10-25T16:14:46.814378+0000', 'last_fullsized': '2023-10-25T16:14:46.814378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:46.814378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:46.814378+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:46.814378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-10-25T16:14:52.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:47.827119+0000', 'last_change': '2023-10-25T16:14:47.827119+0000', 'last_active': '2023-10-25T16:14:47.827119+0000', 'last_peered': '2023-10-25T16:14:47.827119+0000', 'last_clean': '2023-10-25T16:14:47.827119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:47.827119+0000', 'last_undegraded': '2023-10-25T16:14:47.827119+0000', 'last_fullsized': '2023-10-25T16:14:47.827119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-25T16:14:52.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:46.814378+0000', 'last_change': '2023-10-25T16:14:46.814378+0000', 'last_active': '2023-10-25T16:14:46.814378+0000', 'last_peered': '2023-10-25T16:14:46.814378+0000', 'last_clean': '2023-10-25T16:14:46.814378+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:46.814378+0000', 'last_undegraded': '2023-10-25T16:14:46.814378+0000', 'last_fullsized': '2023-10-25T16:14:46.814378+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:46.814378+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:46.814378+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:46.814378+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-10-25T16:14:52.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:14:47.827119+0000', 'last_change': '2023-10-25T16:14:47.827119+0000', 'last_active': '2023-10-25T16:14:47.827119+0000', 'last_peered': '2023-10-25T16:14:47.827119+0000', 'last_clean': '2023-10-25T16:14:47.827119+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:14:47.827119+0000', 'last_undegraded': '2023-10-25T16:14:47.827119+0000', 'last_fullsized': '2023-10-25T16:14:47.827119+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:14:52.635 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:14:52.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 -- 172.21.15.177:0/3316065469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa26015b480 msgr2=0x7fa26015c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3316065469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa26015b480 0x7fa26015c370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009900 tx=0x7fa25c01c770 comp rx=0 tx=0).stop 2023-10-25T16:14:52.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 -- 172.21.15.177:0/3316065469 shutdown_connections 2023-10-25T16:14:52.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3316065469 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2600cb5f0 0x7fa26006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3316065469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa26015b480 0x7fa26015c370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 -- 172.21.15.177:0/3316065469 >> 172.21.15.177:0/3316065469 conn(0x7fa2600b2450 msgr2=0x7fa2600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:52.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 -- 172.21.15.177:0/3316065469 shutdown_connections 2023-10-25T16:14:52.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.783+0000 7fa2685ad640 1 -- 172.21.15.177:0/3316065469 wait complete. 2023-10-25T16:14:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 Processor -- start 2023-10-25T16:14:52.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- start start 2023-10-25T16:14:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2600c9910 0x7fa260156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 0x7fa26015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa26015b480 0x7fa2601464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014f910 con 0x7fa2600cb5f0 2023-10-25T16:14:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014fbf0 con 0x7fa2600c9910 2023-10-25T16:14:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26014fed0 con 0x7fa26015b480 2023-10-25T16:14:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 0x7fa26015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 0x7fa26015dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56328/0 (socket says 172.21.15.177:56328) 2023-10-25T16:14:52.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 -- 172.21.15.177:0/3366214445 learned_addr learned my addr 172.21.15.177:0/3366214445 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:52.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa266349640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2600c9910 0x7fa260156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa266b4a640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa26015b480 0x7fa2601464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 -- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa26015b480 msgr2=0x7fa2601464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa26015b480 0x7fa2601464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 -- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2600c9910 msgr2=0x7fa260156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:52.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2600c9910 0x7fa260156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:52.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 -- 172.21.15.177:0/3366214445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c009560 con 0x7fa2600cb5f0 2023-10-25T16:14:52.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa266349640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2600c9910 0x7fa260156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:14:52.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa265b48640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 0x7fa26015dbe0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa25000e9f0 tx=0x7fa25000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:52.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250009710 con 0x7fa2600cb5f0 2023-10-25T16:14:52.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa25000ce70 con 0x7fa2600cb5f0 2023-10-25T16:14:52.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250010670 con 0x7fa2600cb5f0 2023-10-25T16:14:52.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2601501b0 con 0x7fa2600cb5f0 2023-10-25T16:14:52.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260157570 con 0x7fa2600cb5f0 2023-10-25T16:14:52.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26004daf0 con 0x7fa2600cb5f0 2023-10-25T16:14:52.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2500107d0 con 0x7fa2600cb5f0 2023-10-25T16:14:52.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa256ffd640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa244066470 0x7fa244068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:52.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.787+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa250014070 con 0x7fa2600cb5f0 2023-10-25T16:14:52.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.791+0000 7fa266349640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa244066470 0x7fa244068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:52.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.791+0000 7fa266349640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa244066470 0x7fa244068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0af000 tx=0x7fa25c01afb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:52.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:52.795+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa250050090 con 0x7fa2600cb5f0 2023-10-25T16:14:53.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.003+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa26014fa50 con 0x7fa2600cb5f0 2023-10-25T16:14:53.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.003+0000 7fa256ffd640 1 -- 172.21.15.177:0/3366214445 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1501 (secure 0 0 0) 0x7fa26014fa50 con 0x7fa2600cb5f0 2023-10-25T16:14:53.010 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:53.010 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":124,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":89},{"state_name":"unknown","count":8}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":591144,"bytes_used":2946279,"bytes_avail":1597053721,"bytes_total":1600000000,"unknown_pgs_ratio":0.082474224269390106,"write_bytes_sec":2559,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":19,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5859}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-25T16:14:38.636892+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:14:53.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa244066470 msgr2=0x7fa244068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa244066470 0x7fa244068930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0af000 tx=0x7fa25c01afb0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 msgr2=0x7fa26015dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 0x7fa26015dbe0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa25000e9f0 tx=0x7fa25000eeb0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 shutdown_connections 2023-10-25T16:14:53.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa244066470 0x7fa244068930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa26015b480 0x7fa2601464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2600cb5f0 0x7fa26015dbe0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 --2- 172.21.15.177:0/3366214445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2600c9910 0x7fa260156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 >> 172.21.15.177:0/3366214445 conn(0x7fa2600b2450 msgr2=0x7fa26015cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:53.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 shutdown_connections 2023-10-25T16:14:53.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.007+0000 7fa2685ad640 1 -- 172.21.15.177:0/3366214445 wait complete. 2023-10-25T16:14:53.028 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:14:53.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:53.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/3652252166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff32814e810 msgr2=0x7ff3280cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 --2- 172.21.15.177:0/3652252166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff32814e810 0x7ff3280cbfa0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00a950 tx=0x7ff31c01db10 comp rx=0 tx=0).stop 2023-10-25T16:14:53.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/3652252166 shutdown_connections 2023-10-25T16:14:53.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 --2- 172.21.15.177:0/3652252166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff32814e810 0x7ff3280cbfa0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/3652252166 >> 172.21.15.177:0/3652252166 conn(0x7ff3280b2450 msgr2=0x7ff3280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:53.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/3652252166 shutdown_connections 2023-10-25T16:14:53.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/3652252166 wait complete. 2023-10-25T16:14:53.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 Processor -- start 2023-10-25T16:14:53.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- start start 2023-10-25T16:14:53.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 0x7ff3280a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:53.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff32814e810 0x7ff3281563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:53.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff32815bdb0 0x7ff32814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:53.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328155340 con 0x7ff3280af2d0 2023-10-25T16:14:53.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328152a20 con 0x7ff32815bdb0 2023-10-25T16:14:53.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff328152d00 con 0x7ff32814e810 2023-10-25T16:14:53.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 0x7ff3280a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:53.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 0x7ff3280a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56344/0 (socket says 172.21.15.177:56344) 2023-10-25T16:14:53.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 -- 172.21.15.177:0/2301855001 learned_addr learned my addr 172.21.15.177:0/2301855001 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:53.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff325d9b640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff32814e810 0x7ff3281563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:53.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 -- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff32814e810 msgr2=0x7ff3281563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff326d9d640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff32815bdb0 0x7ff32814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:53.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff32814e810 0x7ff3281563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 -- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff32815bdb0 msgr2=0x7ff32814d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff32815bdb0 0x7ff32814d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 -- 172.21.15.177:0/2301855001 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c00a5b0 con 0x7ff3280af2d0 2023-10-25T16:14:53.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32659c640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 0x7ff3280a64a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00a8a0 tx=0x7ff31c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:53.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0bb070 con 0x7ff3280af2d0 2023-10-25T16:14:53.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff31c003810 con 0x7ff3280af2d0 2023-10-25T16:14:53.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff328152fe0 con 0x7ff3280af2d0 2023-10-25T16:14:53.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c003ba0 con 0x7ff3280af2d0 2023-10-25T16:14:53.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.147+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3281535a0 con 0x7ff3280af2d0 2023-10-25T16:14:53.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.151+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3280a6a40 con 0x7ff3280af2d0 2023-10-25T16:14:53.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.151+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff31c0b5040 con 0x7ff3280af2d0 2023-10-25T16:14:53.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.151+0000 7ff316ffd640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff308066470 0x7ff308068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:53.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.151+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff31c11e790 con 0x7ff3280af2d0 2023-10-25T16:14:53.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.151+0000 7ff325d9b640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff308066470 0x7ff308068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:53.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.151+0000 7ff325d9b640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff308066470 0x7ff308068930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff328151e60 tx=0x7ff318008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:53.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.155+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff31c0ebc00 con 0x7ff3280af2d0 2023-10-25T16:14:53.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.307+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff328165540 con 0x7ff308066470 2023-10-25T16:14:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.327+0000 7ff316ffd640 1 -- 172.21.15.177:0/2301855001 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283542 (secure 0 0 0) 0x7ff31800c4a0 con 0x7ff308066470 2023-10-25T16:14:53.335 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:53.338 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:53.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff308066470 msgr2=0x7ff308068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff308066470 0x7ff308068930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff328151e60 tx=0x7ff318008040 comp rx=0 tx=0).stop 2023-10-25T16:14:53.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 msgr2=0x7ff3280a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:53.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 0x7ff3280a64a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00a8a0 tx=0x7ff31c005dd0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 shutdown_connections 2023-10-25T16:14:53.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff308066470 0x7ff308068930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff32815bdb0 0x7ff32814d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff32814e810 0x7ff3281563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 --2- 172.21.15.177:0/2301855001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3280af2d0 0x7ff3280a64a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:53.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 >> 172.21.15.177:0/2301855001 conn(0x7ff3280b2450 msgr2=0x7ff3280aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:53.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 shutdown_connections 2023-10-25T16:14:53.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:53.335+0000 7ff32c84e640 1 -- 172.21.15.177:0/2301855001 wait complete. 2023-10-25T16:14:53.355 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-10-25T16:14:52.640987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559576,"statfs":{"total":1600000000,"available":1597006544,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.809089"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.862030+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:48.862030+0000","last_peered":"2023-10-25T16:14:48.862030+0000","last_clean":"2023-10-25T16:14:48.862030+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:48.862030+0000","last_undegraded":"2023-10-25T16:14:48.862030+0000","last_fullsized":"2023-10-25T16:14:48.862030+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886809+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:48.886809+0000","last_peered":"2023-10-25T16:14:48.886809+0000","last_clean":"2023-10-25T16:14:48.886809+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:48.886809+0000","last_undegraded":"2023-10-25T16:14:48.886809+0000","last_fullsized":"2023-10-25T16:14:48.886809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879850+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:48.879850+0000","last_peered":"2023-10-25T16:14:48.879850+0000","last_clean":"2023-10-25T16:14:48.879850+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:48.879850+0000","last_undegraded":"2023-10-25T16:14:48.879850+0000","last_fullsized":"2023-10-25T16:14:48.879850+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868897+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:48.868897+0000","last_peered":"2023-10-25T16:14:48.868897+0000","last_clean":"2023-10-25T16:14:48.868897+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:48.868897+0000","last_undegraded":"2023-10-25T16:14:48.868897+0000","last_fullsized":"2023-10-25T16:14:48.868897+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869762+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:48.869762+0000","last_peered":"2023-10-25T16:14:48.869762+0000","last_clean":"2023-10-25T16:14:48.869762+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:48.869762+0000","last_undegraded":"2023-10-25T16:14:48.869762+0000","last_fullsized":"2023-10-25T16:14:48.869762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874074+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:48.874074+0000","last_peered":"2023-10-25T16:14:48.874074+0000","last_clean":"2023-10-25T16:14:48.874074+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:48.874074+0000","last_undegraded":"2023-10-25T16:14:48.874074+0000","last_fullsized":"2023-10-25T16:14:48.874074+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:21.704168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876691+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:48.876691+0000","last_peered":"2023-10-25T16:14:48.876691+0000","last_clean":"2023-10-25T16:14:48.876691+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:48.876691+0000","last_undegraded":"2023-10-25T16:14:48.876691+0000","last_fullsized":"2023-10-25T16:14:48.876691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864126+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:48.864126+0000","last_peered":"2023-10-25T16:14:48.864126+0000","last_clean":"2023-10-25T16:14:48.864126+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:48.864126+0000","last_undegraded":"2023-10-25T16:14:48.864126+0000","last_fullsized":"2023-10-25T16:14:48.864126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883567+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:48.883567+0000","last_peered":"2023-10-25T16:14:48.883567+0000","last_clean":"2023-10-25T16:14:48.883567+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:48.883567+0000","last_undegraded":"2023-10-25T16:14:48.883567+0000","last_fullsized":"2023-10-25T16:14:48.883567+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864627+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:48.864627+0000","last_peered":"2023-10-25T16:14:48.864627+0000","last_clean":"2023-10-25T16:14:48.864627+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:48.864627+0000","last_undegraded":"2023-10-25T16:14:48.864627+0000","last_fullsized":"2023-10-25T16:14:48.864627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883250+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:48.883250+0000","last_peered":"2023-10-25T16:14:48.883250+0000","last_clean":"2023-10-25T16:14:48.883250+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:48.883250+0000","last_undegraded":"2023-10-25T16:14:48.883250+0000","last_fullsized":"2023-10-25T16:14:48.883250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881599+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:48.881599+0000","last_peered":"2023-10-25T16:14:48.881599+0000","last_clean":"2023-10-25T16:14:48.881599+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:48.881599+0000","last_undegraded":"2023-10-25T16:14:48.881599+0000","last_fullsized":"2023-10-25T16:14:48.881599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488829+0000","last_change":"2023-10-25T16:14:48.877528+0000","last_active":"2023-10-25T16:14:50.488829+0000","last_peered":"2023-10-25T16:14:50.488829+0000","last_clean":"2023-10-25T16:14:50.488829+0000","last_became_active":"2023-10-25T16:14:48.876876+0000","last_became_peered":"2023-10-25T16:14:48.876876+0000","last_unstale":"2023-10-25T16:14:50.488829+0000","last_undegraded":"2023-10-25T16:14:50.488829+0000","last_fullsized":"2023-10-25T16:14:50.488829+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.885307+0000","last_change":"2023-10-25T16:14:48.884361+0000","last_active":"2023-10-25T16:14:48.885307+0000","last_peered":"2023-10-25T16:14:48.885307+0000","last_clean":"2023-10-25T16:14:48.885307+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:48.885307+0000","last_undegraded":"2023-10-25T16:14:48.885307+0000","last_fullsized":"2023-10-25T16:14:48.885307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.876262+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:48.876262+0000","last_peered":"2023-10-25T16:14:48.876262+0000","last_clean":"2023-10-25T16:14:48.876262+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:48.876262+0000","last_undegraded":"2023-10-25T16:14:48.876262+0000","last_fullsized":"2023-10-25T16:14:48.876262+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884903+0000","last_change":"2023-10-25T16:14:48.884844+0000","last_active":"2023-10-25T16:14:48.884903+0000","last_peered":"2023-10-25T16:14:48.884903+0000","last_clean":"2023-10-25T16:14:48.884903+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:48.884903+0000","last_undegraded":"2023-10-25T16:14:48.884903+0000","last_fullsized":"2023-10-25T16:14:48.884903+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868577+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:48.868577+0000","last_peered":"2023-10-25T16:14:48.868577+0000","last_clean":"2023-10-25T16:14:48.868577+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:48.868577+0000","last_undegraded":"2023-10-25T16:14:48.868577+0000","last_fullsized":"2023-10-25T16:14:48.868577+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877481+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:48.877481+0000","last_peered":"2023-10-25T16:14:48.877481+0000","last_clean":"2023-10-25T16:14:48.877481+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:48.877481+0000","last_undegraded":"2023-10-25T16:14:48.877481+0000","last_fullsized":"2023-10-25T16:14:48.877481+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873219+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:48.873219+0000","last_peered":"2023-10-25T16:14:48.873219+0000","last_clean":"2023-10-25T16:14:48.873219+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:48.873219+0000","last_undegraded":"2023-10-25T16:14:48.873219+0000","last_fullsized":"2023-10-25T16:14:48.873219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488818+0000","last_change":"2023-10-25T16:14:48.868676+0000","last_active":"2023-10-25T16:14:50.488818+0000","last_peered":"2023-10-25T16:14:50.488818+0000","last_clean":"2023-10-25T16:14:50.488818+0000","last_became_active":"2023-10-25T16:14:48.868055+0000","last_became_peered":"2023-10-25T16:14:48.868055+0000","last_unstale":"2023-10-25T16:14:50.488818+0000","last_undegraded":"2023-10-25T16:14:50.488818+0000","last_fullsized":"2023-10-25T16:14:50.488818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.869215+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:48.869215+0000","last_peered":"2023-10-25T16:14:48.869215+0000","last_clean":"2023-10-25T16:14:48.869215+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:48.869215+0000","last_undegraded":"2023-10-25T16:14:48.869215+0000","last_fullsized":"2023-10-25T16:14:48.869215+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:54.213888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883301+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:48.883301+0000","last_peered":"2023-10-25T16:14:48.883301+0000","last_clean":"2023-10-25T16:14:48.883301+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:48.883301+0000","last_undegraded":"2023-10-25T16:14:48.883301+0000","last_fullsized":"2023-10-25T16:14:48.883301+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865001+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:48.865001+0000","last_peered":"2023-10-25T16:14:48.865001+0000","last_clean":"2023-10-25T16:14:48.865001+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:48.865001+0000","last_undegraded":"2023-10-25T16:14:48.865001+0000","last_fullsized":"2023-10-25T16:14:48.865001+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:44:15.704551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875694+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:48.875694+0000","last_peered":"2023-10-25T16:14:48.875694+0000","last_clean":"2023-10-25T16:14:48.875694+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:48.875694+0000","last_undegraded":"2023-10-25T16:14:48.875694+0000","last_fullsized":"2023-10-25T16:14:48.875694+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879591+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:48.879591+0000","last_peered":"2023-10-25T16:14:48.879591+0000","last_clean":"2023-10-25T16:14:48.879591+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:48.879591+0000","last_undegraded":"2023-10-25T16:14:48.879591+0000","last_fullsized":"2023-10-25T16:14:48.879591+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:33:21.460992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489168+0000","last_change":"2023-10-25T16:14:48.878231+0000","last_active":"2023-10-25T16:14:50.489168+0000","last_peered":"2023-10-25T16:14:50.489168+0000","last_clean":"2023-10-25T16:14:50.489168+0000","last_became_active":"2023-10-25T16:14:48.877966+0000","last_became_peered":"2023-10-25T16:14:48.877966+0000","last_unstale":"2023-10-25T16:14:50.489168+0000","last_undegraded":"2023-10-25T16:14:50.489168+0000","last_fullsized":"2023-10-25T16:14:50.489168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868627+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:48.868627+0000","last_peered":"2023-10-25T16:14:48.868627+0000","last_clean":"2023-10-25T16:14:48.868627+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:48.868627+0000","last_undegraded":"2023-10-25T16:14:48.868627+0000","last_fullsized":"2023-10-25T16:14:48.868627+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:00.548101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881624+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:48.881624+0000","last_peered":"2023-10-25T16:14:48.881624+0000","last_clean":"2023-10-25T16:14:48.881624+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:48.881624+0000","last_undegraded":"2023-10-25T16:14:48.881624+0000","last_fullsized":"2023-10-25T16:14:48.881624+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879135+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:48.879135+0000","last_peered":"2023-10-25T16:14:48.879135+0000","last_clean":"2023-10-25T16:14:48.879135+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:48.879135+0000","last_undegraded":"2023-10-25T16:14:48.879135+0000","last_fullsized":"2023-10-25T16:14:48.879135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860777+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:48.860777+0000","last_peered":"2023-10-25T16:14:48.860777+0000","last_clean":"2023-10-25T16:14:48.860777+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:48.860777+0000","last_undegraded":"2023-10-25T16:14:48.860777+0000","last_fullsized":"2023-10-25T16:14:48.860777+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.870390+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:48.870390+0000","last_peered":"2023-10-25T16:14:48.870390+0000","last_clean":"2023-10-25T16:14:48.870390+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:48.870390+0000","last_undegraded":"2023-10-25T16:14:48.870390+0000","last_fullsized":"2023-10-25T16:14:48.870390+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:45.872159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488720+0000","last_change":"2023-10-25T16:14:48.872434+0000","last_active":"2023-10-25T16:14:50.488720+0000","last_peered":"2023-10-25T16:14:50.488720+0000","last_clean":"2023-10-25T16:14:50.488720+0000","last_became_active":"2023-10-25T16:14:48.871802+0000","last_became_peered":"2023-10-25T16:14:48.871802+0000","last_unstale":"2023-10-25T16:14:50.488720+0000","last_undegraded":"2023-10-25T16:14:50.488720+0000","last_fullsized":"2023-10-25T16:14:50.488720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875933+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:48.875933+0000","last_peered":"2023-10-25T16:14:48.875933+0000","last_clean":"2023-10-25T16:14:48.875933+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:48.875933+0000","last_undegraded":"2023-10-25T16:14:48.875933+0000","last_fullsized":"2023-10-25T16:14:48.875933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874161+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:48.874161+0000","last_peered":"2023-10-25T16:14:48.874161+0000","last_clean":"2023-10-25T16:14:48.874161+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:48.874161+0000","last_undegraded":"2023-10-25T16:14:48.874161+0000","last_fullsized":"2023-10-25T16:14:48.874161+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877787+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:48.877787+0000","last_peered":"2023-10-25T16:14:48.877787+0000","last_clean":"2023-10-25T16:14:48.877787+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:48.877787+0000","last_undegraded":"2023-10-25T16:14:48.877787+0000","last_fullsized":"2023-10-25T16:14:48.877787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:23:28.152972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871080+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:48.871080+0000","last_peered":"2023-10-25T16:14:48.871080+0000","last_clean":"2023-10-25T16:14:48.871080+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:48.871080+0000","last_undegraded":"2023-10-25T16:14:48.871080+0000","last_fullsized":"2023-10-25T16:14:48.871080+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868976+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:48.868976+0000","last_peered":"2023-10-25T16:14:48.868976+0000","last_clean":"2023-10-25T16:14:48.868976+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:48.868976+0000","last_undegraded":"2023-10-25T16:14:48.868976+0000","last_fullsized":"2023-10-25T16:14:48.868976+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877619+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:48.877619+0000","last_peered":"2023-10-25T16:14:48.877619+0000","last_clean":"2023-10-25T16:14:48.877619+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:48.877619+0000","last_undegraded":"2023-10-25T16:14:48.877619+0000","last_fullsized":"2023-10-25T16:14:48.877619+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875387+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:48.875387+0000","last_peered":"2023-10-25T16:14:48.875387+0000","last_clean":"2023-10-25T16:14:48.875387+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:48.875387+0000","last_undegraded":"2023-10-25T16:14:48.875387+0000","last_fullsized":"2023-10-25T16:14:48.875387+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875842+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:48.875842+0000","last_peered":"2023-10-25T16:14:48.875842+0000","last_clean":"2023-10-25T16:14:48.875842+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:48.875842+0000","last_undegraded":"2023-10-25T16:14:48.875842+0000","last_fullsized":"2023-10-25T16:14:48.875842+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878002+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:48.878002+0000","last_peered":"2023-10-25T16:14:48.878002+0000","last_clean":"2023-10-25T16:14:48.878002+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:48.878002+0000","last_undegraded":"2023-10-25T16:14:48.878002+0000","last_fullsized":"2023-10-25T16:14:48.878002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875032+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:48.875032+0000","last_peered":"2023-10-25T16:14:48.875032+0000","last_clean":"2023-10-25T16:14:48.875032+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:48.875032+0000","last_undegraded":"2023-10-25T16:14:48.875032+0000","last_fullsized":"2023-10-25T16:14:48.875032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.883519+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:48.883519+0000","last_peered":"2023-10-25T16:14:48.883519+0000","last_clean":"2023-10-25T16:14:48.883519+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:48.883519+0000","last_undegraded":"2023-10-25T16:14:48.883519+0000","last_fullsized":"2023-10-25T16:14:48.883519+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879623+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:48.879623+0000","last_peered":"2023-10-25T16:14:48.879623+0000","last_clean":"2023-10-25T16:14:48.879623+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:48.879623+0000","last_undegraded":"2023-10-25T16:14:48.879623+0000","last_fullsized":"2023-10-25T16:14:48.879623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.865076+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:48.865076+0000","last_peered":"2023-10-25T16:14:48.865076+0000","last_clean":"2023-10-25T16:14:48.865076+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:48.865076+0000","last_undegraded":"2023-10-25T16:14:48.865076+0000","last_fullsized":"2023-10-25T16:14:48.865076+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860901+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.860901+0000","last_peered":"2023-10-25T16:14:48.860901+0000","last_clean":"2023-10-25T16:14:48.860901+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:48.860901+0000","last_undegraded":"2023-10-25T16:14:48.860901+0000","last_fullsized":"2023-10-25T16:14:48.860901+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875524+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:48.875524+0000","last_peered":"2023-10-25T16:14:48.875524+0000","last_clean":"2023-10-25T16:14:48.875524+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:48.875524+0000","last_undegraded":"2023-10-25T16:14:48.875524+0000","last_fullsized":"2023-10-25T16:14:48.875524+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863335+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:48.863335+0000","last_peered":"2023-10-25T16:14:48.863335+0000","last_clean":"2023-10-25T16:14:48.863335+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:48.863335+0000","last_undegraded":"2023-10-25T16:14:48.863335+0000","last_fullsized":"2023-10-25T16:14:48.863335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873934+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:48.873934+0000","last_peered":"2023-10-25T16:14:48.873934+0000","last_clean":"2023-10-25T16:14:48.873934+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:48.873934+0000","last_undegraded":"2023-10-25T16:14:48.873934+0000","last_fullsized":"2023-10-25T16:14:48.873934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.856803+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:48.856803+0000","last_peered":"2023-10-25T16:14:48.856803+0000","last_clean":"2023-10-25T16:14:48.856803+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:48.856803+0000","last_undegraded":"2023-10-25T16:14:48.856803+0000","last_fullsized":"2023-10-25T16:14:48.856803+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.864185+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:48.864185+0000","last_peered":"2023-10-25T16:14:48.864185+0000","last_clean":"2023-10-25T16:14:48.864185+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:48.864185+0000","last_undegraded":"2023-10-25T16:14:48.864185+0000","last_fullsized":"2023-10-25T16:14:48.864185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.858667+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:48.858667+0000","last_peered":"2023-10-25T16:14:48.858667+0000","last_clean":"2023-10-25T16:14:48.858667+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:48.858667+0000","last_undegraded":"2023-10-25T16:14:48.858667+0000","last_fullsized":"2023-10-25T16:14:48.858667+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880331+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:48.880331+0000","last_peered":"2023-10-25T16:14:48.880331+0000","last_clean":"2023-10-25T16:14:48.880331+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:48.880331+0000","last_undegraded":"2023-10-25T16:14:48.880331+0000","last_fullsized":"2023-10-25T16:14:48.880331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.877980+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:48.877980+0000","last_peered":"2023-10-25T16:14:48.877980+0000","last_clean":"2023-10-25T16:14:48.877980+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:48.877980+0000","last_undegraded":"2023-10-25T16:14:48.877980+0000","last_fullsized":"2023-10-25T16:14:48.877980+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.875144+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:48.875144+0000","last_peered":"2023-10-25T16:14:48.875144+0000","last_clean":"2023-10-25T16:14:48.875144+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:48.875144+0000","last_undegraded":"2023-10-25T16:14:48.875144+0000","last_fullsized":"2023-10-25T16:14:48.875144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488734+0000","last_change":"2023-10-25T16:14:47.868446+0000","last_active":"2023-10-25T16:14:50.488734+0000","last_peered":"2023-10-25T16:14:50.488734+0000","last_clean":"2023-10-25T16:14:50.488734+0000","last_became_active":"2023-10-25T16:14:47.868199+0000","last_became_peered":"2023-10-25T16:14:47.868199+0000","last_unstale":"2023-10-25T16:14:50.488734+0000","last_undegraded":"2023-10-25T16:14:50.488734+0000","last_fullsized":"2023-10-25T16:14:50.488734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:20:05.028912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.884735+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:48.884735+0000","last_peered":"2023-10-25T16:14:48.884735+0000","last_clean":"2023-10-25T16:14:48.884735+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:48.884735+0000","last_undegraded":"2023-10-25T16:14:48.884735+0000","last_fullsized":"2023-10-25T16:14:48.884735+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:22.529306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.873036+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:48.873036+0000","last_peered":"2023-10-25T16:14:48.873036+0000","last_clean":"2023-10-25T16:14:48.873036+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:48.873036+0000","last_undegraded":"2023-10-25T16:14:48.873036+0000","last_fullsized":"2023-10-25T16:14:48.873036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880483+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:48.880483+0000","last_peered":"2023-10-25T16:14:48.880483+0000","last_clean":"2023-10-25T16:14:48.880483+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:48.880483+0000","last_undegraded":"2023-10-25T16:14:48.880483+0000","last_fullsized":"2023-10-25T16:14:48.880483+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.849846+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:48.849846+0000","last_peered":"2023-10-25T16:14:48.849846+0000","last_clean":"2023-10-25T16:14:48.849846+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:48.849846+0000","last_undegraded":"2023-10-25T16:14:48.849846+0000","last_fullsized":"2023-10-25T16:14:48.849846+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872880+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:48.872880+0000","last_peered":"2023-10-25T16:14:48.872880+0000","last_clean":"2023-10-25T16:14:48.872880+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:48.872880+0000","last_undegraded":"2023-10-25T16:14:48.872880+0000","last_fullsized":"2023-10-25T16:14:48.872880+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857123+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:48.857123+0000","last_peered":"2023-10-25T16:14:48.857123+0000","last_clean":"2023-10-25T16:14:48.857123+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:48.857123+0000","last_undegraded":"2023-10-25T16:14:48.857123+0000","last_fullsized":"2023-10-25T16:14:48.857123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868415+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:48.868415+0000","last_peered":"2023-10-25T16:14:48.868415+0000","last_clean":"2023-10-25T16:14:48.868415+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:48.868415+0000","last_undegraded":"2023-10-25T16:14:48.868415+0000","last_fullsized":"2023-10-25T16:14:48.868415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886761+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:48.886761+0000","last_peered":"2023-10-25T16:14:48.886761+0000","last_clean":"2023-10-25T16:14:48.886761+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:48.886761+0000","last_undegraded":"2023-10-25T16:14:48.886761+0000","last_fullsized":"2023-10-25T16:14:48.886761+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489135+0000","last_change":"2023-10-25T16:14:48.865059+0000","last_active":"2023-10-25T16:14:50.489135+0000","last_peered":"2023-10-25T16:14:50.489135+0000","last_clean":"2023-10-25T16:14:50.489135+0000","last_became_active":"2023-10-25T16:14:48.864397+0000","last_became_peered":"2023-10-25T16:14:48.864397+0000","last_unstale":"2023-10-25T16:14:50.489135+0000","last_undegraded":"2023-10-25T16:14:50.489135+0000","last_fullsized":"2023-10-25T16:14:50.489135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488952+0000","last_change":"2023-10-25T16:14:47.853938+0000","last_active":"2023-10-25T16:14:50.488952+0000","last_peered":"2023-10-25T16:14:50.488952+0000","last_clean":"2023-10-25T16:14:50.488952+0000","last_became_active":"2023-10-25T16:14:47.853677+0000","last_became_peered":"2023-10-25T16:14:47.853677+0000","last_unstale":"2023-10-25T16:14:50.488952+0000","last_undegraded":"2023-10-25T16:14:50.488952+0000","last_fullsized":"2023-10-25T16:14:50.488952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:58.445296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868926+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:48.868926+0000","last_peered":"2023-10-25T16:14:48.868926+0000","last_clean":"2023-10-25T16:14:48.868926+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:48.868926+0000","last_undegraded":"2023-10-25T16:14:48.868926+0000","last_fullsized":"2023-10-25T16:14:48.868926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879753+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:48.879753+0000","last_peered":"2023-10-25T16:14:48.879753+0000","last_clean":"2023-10-25T16:14:48.879753+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:48.879753+0000","last_undegraded":"2023-10-25T16:14:48.879753+0000","last_fullsized":"2023-10-25T16:14:48.879753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872484+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:48.872484+0000","last_peered":"2023-10-25T16:14:48.872484+0000","last_clean":"2023-10-25T16:14:48.872484+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:48.872484+0000","last_undegraded":"2023-10-25T16:14:48.872484+0000","last_fullsized":"2023-10-25T16:14:48.872484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878256+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:48.878256+0000","last_peered":"2023-10-25T16:14:48.878256+0000","last_clean":"2023-10-25T16:14:48.878256+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:48.878256+0000","last_undegraded":"2023-10-25T16:14:48.878256+0000","last_fullsized":"2023-10-25T16:14:48.878256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871763+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:48.871763+0000","last_peered":"2023-10-25T16:14:48.871763+0000","last_clean":"2023-10-25T16:14:48.871763+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:48.871763+0000","last_undegraded":"2023-10-25T16:14:48.871763+0000","last_fullsized":"2023-10-25T16:14:48.871763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:29:01.025167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857377+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:48.857377+0000","last_peered":"2023-10-25T16:14:48.857377+0000","last_clean":"2023-10-25T16:14:48.857377+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:48.857377+0000","last_undegraded":"2023-10-25T16:14:48.857377+0000","last_fullsized":"2023-10-25T16:14:48.857377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.880581+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:48.880581+0000","last_peered":"2023-10-25T16:14:48.880581+0000","last_clean":"2023-10-25T16:14:48.880581+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:48.880581+0000","last_undegraded":"2023-10-25T16:14:48.880581+0000","last_fullsized":"2023-10-25T16:14:48.880581+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874012+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:48.874012+0000","last_peered":"2023-10-25T16:14:48.874012+0000","last_clean":"2023-10-25T16:14:48.874012+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:48.874012+0000","last_undegraded":"2023-10-25T16:14:48.874012+0000","last_fullsized":"2023-10-25T16:14:48.874012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874219+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:48.874219+0000","last_peered":"2023-10-25T16:14:48.874219+0000","last_clean":"2023-10-25T16:14:48.874219+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:48.874219+0000","last_undegraded":"2023-10-25T16:14:48.874219+0000","last_fullsized":"2023-10-25T16:14:48.874219+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.861107+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:48.861107+0000","last_peered":"2023-10-25T16:14:48.861107+0000","last_clean":"2023-10-25T16:14:48.861107+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:48.861107+0000","last_undegraded":"2023-10-25T16:14:48.861107+0000","last_fullsized":"2023-10-25T16:14:48.861107+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488979+0000","last_change":"2023-10-25T16:14:48.851029+0000","last_active":"2023-10-25T16:14:50.488979+0000","last_peered":"2023-10-25T16:14:50.488979+0000","last_clean":"2023-10-25T16:14:50.488979+0000","last_became_active":"2023-10-25T16:14:48.850613+0000","last_became_peered":"2023-10-25T16:14:48.850613+0000","last_unstale":"2023-10-25T16:14:50.488979+0000","last_undegraded":"2023-10-25T16:14:50.488979+0000","last_fullsized":"2023-10-25T16:14:50.488979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.863484+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:48.863484+0000","last_peered":"2023-10-25T16:14:48.863484+0000","last_clean":"2023-10-25T16:14:48.863484+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:48.863484+0000","last_undegraded":"2023-10-25T16:14:48.863484+0000","last_fullsized":"2023-10-25T16:14:48.863484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.886331+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:48.886331+0000","last_peered":"2023-10-25T16:14:48.886331+0000","last_clean":"2023-10-25T16:14:48.886331+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:48.886331+0000","last_undegraded":"2023-10-25T16:14:48.886331+0000","last_fullsized":"2023-10-25T16:14:48.886331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850013+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:48.850013+0000","last_peered":"2023-10-25T16:14:48.850013+0000","last_clean":"2023-10-25T16:14:48.850013+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:48.850013+0000","last_undegraded":"2023-10-25T16:14:48.850013+0000","last_fullsized":"2023-10-25T16:14:48.850013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.888758+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:48.888758+0000","last_peered":"2023-10-25T16:14:48.888758+0000","last_clean":"2023-10-25T16:14:48.888758+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:48.888758+0000","last_undegraded":"2023-10-25T16:14:48.888758+0000","last_fullsized":"2023-10-25T16:14:48.888758+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857285+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:48.857285+0000","last_peered":"2023-10-25T16:14:48.857285+0000","last_clean":"2023-10-25T16:14:48.857285+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:48.857285+0000","last_undegraded":"2023-10-25T16:14:48.857285+0000","last_fullsized":"2023-10-25T16:14:48.857285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871679+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:48.871679+0000","last_peered":"2023-10-25T16:14:48.871679+0000","last_clean":"2023-10-25T16:14:48.871679+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:48.871679+0000","last_undegraded":"2023-10-25T16:14:48.871679+0000","last_fullsized":"2023-10-25T16:14:48.871679+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.848890+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:48.848890+0000","last_peered":"2023-10-25T16:14:48.848890+0000","last_clean":"2023-10-25T16:14:48.848890+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:48.848890+0000","last_undegraded":"2023-10-25T16:14:48.848890+0000","last_fullsized":"2023-10-25T16:14:48.848890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.852307+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:48.852307+0000","last_peered":"2023-10-25T16:14:48.852307+0000","last_clean":"2023-10-25T16:14:48.852307+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:48.852307+0000","last_undegraded":"2023-10-25T16:14:48.852307+0000","last_fullsized":"2023-10-25T16:14:48.852307+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.871732+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:48.871732+0000","last_peered":"2023-10-25T16:14:48.871732+0000","last_clean":"2023-10-25T16:14:48.871732+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:48.871732+0000","last_undegraded":"2023-10-25T16:14:48.871732+0000","last_fullsized":"2023-10-25T16:14:48.871732+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.874096+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:48.874096+0000","last_peered":"2023-10-25T16:14:48.874096+0000","last_clean":"2023-10-25T16:14:48.874096+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:48.874096+0000","last_undegraded":"2023-10-25T16:14:48.874096+0000","last_fullsized":"2023-10-25T16:14:48.874096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.850187+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:48.850187+0000","last_peered":"2023-10-25T16:14:48.850187+0000","last_clean":"2023-10-25T16:14:48.850187+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:48.850187+0000","last_undegraded":"2023-10-25T16:14:48.850187+0000","last_fullsized":"2023-10-25T16:14:48.850187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.881358+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:48.881358+0000","last_peered":"2023-10-25T16:14:48.881358+0000","last_clean":"2023-10-25T16:14:48.881358+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:48.881358+0000","last_undegraded":"2023-10-25T16:14:48.881358+0000","last_fullsized":"2023-10-25T16:14:48.881358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:15.015350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.857778+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:48.857778+0000","last_peered":"2023-10-25T16:14:48.857778+0000","last_clean":"2023-10-25T16:14:48.857778+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:48.857778+0000","last_undegraded":"2023-10-25T16:14:48.857778+0000","last_fullsized":"2023-10-25T16:14:48.857778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.878787+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:48.878787+0000","last_peered":"2023-10-25T16:14:48.878787+0000","last_clean":"2023-10-25T16:14:48.878787+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:48.878787+0000","last_undegraded":"2023-10-25T16:14:48.878787+0000","last_fullsized":"2023-10-25T16:14:48.878787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.868388+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:48.868388+0000","last_peered":"2023-10-25T16:14:48.868388+0000","last_clean":"2023-10-25T16:14:48.868388+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:48.868388+0000","last_undegraded":"2023-10-25T16:14:48.868388+0000","last_fullsized":"2023-10-25T16:14:48.868388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.879152+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:48.879152+0000","last_peered":"2023-10-25T16:14:48.879152+0000","last_clean":"2023-10-25T16:14:48.879152+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:48.879152+0000","last_undegraded":"2023-10-25T16:14:48.879152+0000","last_fullsized":"2023-10-25T16:14:48.879152+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.855133+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:48.855133+0000","last_peered":"2023-10-25T16:14:48.855133+0000","last_clean":"2023-10-25T16:14:48.855133+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:48.855133+0000","last_undegraded":"2023-10-25T16:14:48.855133+0000","last_fullsized":"2023-10-25T16:14:48.855133+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.860018+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:48.860018+0000","last_peered":"2023-10-25T16:14:48.860018+0000","last_clean":"2023-10-25T16:14:48.860018+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:48.860018+0000","last_undegraded":"2023-10-25T16:14:48.860018+0000","last_fullsized":"2023-10-25T16:14:48.860018+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:40.280070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-25T16:14:48.872800+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:48.872800+0000","last_peered":"2023-10-25T16:14:48.872800+0000","last_clean":"2023-10-25T16:14:48.872800+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:48.872800+0000","last_undegraded":"2023-10-25T16:14:48.872800+0000","last_fullsized":"2023-10-25T16:14:48.872800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-25T16:14:47.845101+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:47.845101+0000","last_peered":"2023-10-25T16:14:47.845101+0000","last_clean":"2023-10-25T16:14:47.845101+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:47.845101+0000","last_undegraded":"2023-10-25T16:14:47.845101+0000","last_fullsized":"2023-10-25T16:14:47.845101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79900000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.87}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.151},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.171}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.274},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.3080000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199184342,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.622}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.747},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82999999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.069},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.99199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774128,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.252}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.93200000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.872},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.089}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.337},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.1799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.121}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.84499999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.1539999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":221,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.96899999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.077}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.998}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.038}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199774162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.79300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.95399999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.879}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.996},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.236}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0349999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.175},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.2070000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":219,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195092,"statfs":{"total":200000000,"available":199774730,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.68000000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.4650000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0209999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.377},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":796,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194516,"statfs":{"total":200000000,"available":199184398,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.746},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.103}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.96399999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90800000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.024}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:54.820 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-25T16:14:54.813+0000 7f18e70f7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:14:56.362 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:56.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/2401744772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a406c0f0 msgr2=0x7f17a40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 --2- 172.21.15.177:0/2401744772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a406c0f0 0x7f17a40706f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f179c009c80 tx=0x7f179c01cd50 comp rx=0 tx=0).stop 2023-10-25T16:14:56.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/2401744772 shutdown_connections 2023-10-25T16:14:56.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 --2- 172.21.15.177:0/2401744772 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a406c0f0 0x7f17a40706f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 --2- 172.21.15.177:0/2401744772 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17a41500f0 0x7f17a40c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/2401744772 >> 172.21.15.177:0/2401744772 conn(0x7f17a40b2450 msgr2=0x7f17a40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:56.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/2401744772 shutdown_connections 2023-10-25T16:14:56.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/2401744772 wait complete. 2023-10-25T16:14:56.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 Processor -- start 2023-10-25T16:14:56.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- start start 2023-10-25T16:14:56.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17a406c0f0 0x7f17a41479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c9e50 0x7f17a4152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 0x7f17a41472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4153250 con 0x7f17a41500f0 2023-10-25T16:14:56.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41477e0 con 0x7f17a40c9e50 2023-10-25T16:14:56.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41517c0 con 0x7f17a406c0f0 2023-10-25T16:14:56.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 0x7f17a41472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 0x7f17a41472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56358/0 (socket says 172.21.15.177:56358) 2023-10-25T16:14:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 -- 172.21.15.177:0/4269324973 learned_addr learned my addr 172.21.15.177:0/4269324973 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a3fff640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17a406c0f0 0x7f17a41479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a37fe640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c9e50 0x7f17a4152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 -- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17a406c0f0 msgr2=0x7f17a41479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17a406c0f0 0x7f17a41479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 -- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c9e50 msgr2=0x7f17a4152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c9e50 0x7f17a4152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 -- 172.21.15.177:0/4269324973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c0098e0 con 0x7f17a41500f0 2023-10-25T16:14:56.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a88df640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 0x7f17a41472a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f179c098940 tx=0x7f179c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c003e50 con 0x7f17a41500f0 2023-10-25T16:14:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f179c0ae920 con 0x7f17a41500f0 2023-10-25T16:14:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a40718c0 con 0x7f17a41500f0 2023-10-25T16:14:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0aec90 con 0x7f17a41500f0 2023-10-25T16:14:56.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.495+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a414a9d0 con 0x7f17a41500f0 2023-10-25T16:14:56.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.499+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a404daf0 con 0x7f17a41500f0 2023-10-25T16:14:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.499+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f179c0b4040 con 0x7f17a41500f0 2023-10-25T16:14:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.499+0000 7f17a0ff9640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1790066470 0x7f1790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.499+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f179c11f750 con 0x7f17a41500f0 2023-10-25T16:14:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.499+0000 7f17a3fff640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1790066470 0x7f1790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.499+0000 7f17a3fff640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1790066470 0x7f1790068930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f179400ba40 tx=0x7f1794005cd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:56.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.503+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f179c0ecb90 con 0x7f17a41500f0 2023-10-25T16:14:56.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.655+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17a4071740 con 0x7f1790066470 2023-10-25T16:14:56.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17a0ff9640 1 -- 172.21.15.177:0/4269324973 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283508 (secure 0 0 0) 0x7f179400da80 con 0x7f1790066470 2023-10-25T16:14:56.683 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:56.685 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1790066470 msgr2=0x7f1790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1790066470 0x7f1790068930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f179400ba40 tx=0x7f1794005cd0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 msgr2=0x7f17a41472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 0x7f17a41472a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f179c098940 tx=0x7f179c0093d0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 shutdown_connections 2023-10-25T16:14:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1790066470 0x7f1790068930 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a41500f0 0x7f17a41472a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c9e50 0x7f17a4152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 --2- 172.21.15.177:0/4269324973 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17a406c0f0 0x7f17a41479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 >> 172.21.15.177:0/4269324973 conn(0x7f17a40b2450 msgr2=0x7f17a406b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 shutdown_connections 2023-10-25T16:14:56.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.679+0000 7f17aa342640 1 -- 172.21.15.177:0/4269324973 wait complete. 2023-10-25T16:14:56.703 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-25T16:14:56.642178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559521,"statfs":{"total":1600000000,"available":1596950394,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.790884"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985888+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:50.985888+0000","last_peered":"2023-10-25T16:14:50.985888+0000","last_clean":"2023-10-25T16:14:50.985888+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:50.985888+0000","last_undegraded":"2023-10-25T16:14:50.985888+0000","last_fullsized":"2023-10-25T16:14:50.985888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986502+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:50.986502+0000","last_peered":"2023-10-25T16:14:50.986502+0000","last_clean":"2023-10-25T16:14:50.986502+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:50.986502+0000","last_undegraded":"2023-10-25T16:14:50.986502+0000","last_fullsized":"2023-10-25T16:14:50.986502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603365+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:50.603365+0000","last_peered":"2023-10-25T16:14:50.603365+0000","last_clean":"2023-10-25T16:14:50.603365+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:50.603365+0000","last_undegraded":"2023-10-25T16:14:50.603365+0000","last_fullsized":"2023-10-25T16:14:50.603365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981881+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:50.981881+0000","last_peered":"2023-10-25T16:14:50.981881+0000","last_clean":"2023-10-25T16:14:50.981881+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:50.981881+0000","last_undegraded":"2023-10-25T16:14:50.981881+0000","last_fullsized":"2023-10-25T16:14:50.981881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986893+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:50.986893+0000","last_peered":"2023-10-25T16:14:50.986893+0000","last_clean":"2023-10-25T16:14:50.986893+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:50.986893+0000","last_undegraded":"2023-10-25T16:14:50.986893+0000","last_fullsized":"2023-10-25T16:14:50.986893+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847506+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:49.847506+0000","last_peered":"2023-10-25T16:14:49.847506+0000","last_clean":"2023-10-25T16:14:49.847506+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:49.847506+0000","last_undegraded":"2023-10-25T16:14:49.847506+0000","last_fullsized":"2023-10-25T16:14:49.847506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:26:12.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985267+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:50.985267+0000","last_peered":"2023-10-25T16:14:50.985267+0000","last_clean":"2023-10-25T16:14:50.985267+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:50.985267+0000","last_undegraded":"2023-10-25T16:14:50.985267+0000","last_fullsized":"2023-10-25T16:14:50.985267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981802+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:50.981802+0000","last_peered":"2023-10-25T16:14:50.981802+0000","last_clean":"2023-10-25T16:14:50.981802+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:50.981802+0000","last_undegraded":"2023-10-25T16:14:50.981802+0000","last_fullsized":"2023-10-25T16:14:50.981802+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982048+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:50.982048+0000","last_peered":"2023-10-25T16:14:50.982048+0000","last_clean":"2023-10-25T16:14:50.982048+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:50.982048+0000","last_undegraded":"2023-10-25T16:14:50.982048+0000","last_fullsized":"2023-10-25T16:14:50.982048+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982158+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:50.982158+0000","last_peered":"2023-10-25T16:14:50.982158+0000","last_clean":"2023-10-25T16:14:50.982158+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:50.982158+0000","last_undegraded":"2023-10-25T16:14:50.982158+0000","last_fullsized":"2023-10-25T16:14:50.982158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982000+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:50.982000+0000","last_peered":"2023-10-25T16:14:50.982000+0000","last_clean":"2023-10-25T16:14:50.982000+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:50.982000+0000","last_undegraded":"2023-10-25T16:14:50.982000+0000","last_fullsized":"2023-10-25T16:14:50.982000+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986804+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:50.986804+0000","last_peered":"2023-10-25T16:14:50.986804+0000","last_clean":"2023-10-25T16:14:50.986804+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:50.986804+0000","last_undegraded":"2023-10-25T16:14:50.986804+0000","last_fullsized":"2023-10-25T16:14:50.986804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488829+0000","last_change":"2023-10-25T16:14:48.877528+0000","last_active":"2023-10-25T16:14:50.488829+0000","last_peered":"2023-10-25T16:14:50.488829+0000","last_clean":"2023-10-25T16:14:50.488829+0000","last_became_active":"2023-10-25T16:14:48.876876+0000","last_became_peered":"2023-10-25T16:14:48.876876+0000","last_unstale":"2023-10-25T16:14:50.488829+0000","last_undegraded":"2023-10-25T16:14:50.488829+0000","last_fullsized":"2023-10-25T16:14:50.488829+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":2,"reported_epoch":49,"state":"peering","last_fresh":"2023-10-25T16:14:50.982345+0000","last_change":"2023-10-25T16:14:54.802095+0000","last_active":"2023-10-25T16:14:54.802095+0000","last_peered":"2023-10-25T16:14:50.982345+0000","last_clean":"2023-10-25T16:14:50.982345+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:50.982345+0000","last_undegraded":"2023-10-25T16:14:50.982345+0000","last_fullsized":"2023-10-25T16:14:50.982345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847013+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:49.847013+0000","last_peered":"2023-10-25T16:14:49.847013+0000","last_clean":"2023-10-25T16:14:49.847013+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:49.847013+0000","last_undegraded":"2023-10-25T16:14:49.847013+0000","last_fullsized":"2023-10-25T16:14:49.847013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:37:19.332657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"peering","last_fresh":"2023-10-25T16:14:50.781654+0000","last_change":"2023-10-25T16:14:54.585955+0000","last_active":"2023-10-25T16:14:54.585955+0000","last_peered":"2023-10-25T16:14:50.781654+0000","last_clean":"2023-10-25T16:14:50.781654+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:50.781654+0000","last_undegraded":"2023-10-25T16:14:50.781654+0000","last_fullsized":"2023-10-25T16:14:50.781654+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.602994+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:50.602994+0000","last_peered":"2023-10-25T16:14:50.602994+0000","last_clean":"2023-10-25T16:14:50.602994+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:50.602994+0000","last_undegraded":"2023-10-25T16:14:50.602994+0000","last_fullsized":"2023-10-25T16:14:50.602994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603730+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:50.603730+0000","last_peered":"2023-10-25T16:14:50.603730+0000","last_clean":"2023-10-25T16:14:50.603730+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:50.603730+0000","last_undegraded":"2023-10-25T16:14:50.603730+0000","last_fullsized":"2023-10-25T16:14:50.603730+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782351+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:50.782351+0000","last_peered":"2023-10-25T16:14:50.782351+0000","last_clean":"2023-10-25T16:14:50.782351+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:50.782351+0000","last_undegraded":"2023-10-25T16:14:50.782351+0000","last_fullsized":"2023-10-25T16:14:50.782351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488818+0000","last_change":"2023-10-25T16:14:48.868676+0000","last_active":"2023-10-25T16:14:50.488818+0000","last_peered":"2023-10-25T16:14:50.488818+0000","last_clean":"2023-10-25T16:14:50.488818+0000","last_became_active":"2023-10-25T16:14:48.868055+0000","last_became_peered":"2023-10-25T16:14:48.868055+0000","last_unstale":"2023-10-25T16:14:50.488818+0000","last_undegraded":"2023-10-25T16:14:50.488818+0000","last_fullsized":"2023-10-25T16:14:50.488818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847820+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:49.847820+0000","last_peered":"2023-10-25T16:14:49.847820+0000","last_clean":"2023-10-25T16:14:49.847820+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:49.847820+0000","last_undegraded":"2023-10-25T16:14:49.847820+0000","last_fullsized":"2023-10-25T16:14:49.847820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:24:32.144529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982159+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:50.982159+0000","last_peered":"2023-10-25T16:14:50.982159+0000","last_clean":"2023-10-25T16:14:50.982159+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:50.982159+0000","last_undegraded":"2023-10-25T16:14:50.982159+0000","last_fullsized":"2023-10-25T16:14:50.982159+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782169+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:50.782169+0000","last_peered":"2023-10-25T16:14:50.782169+0000","last_clean":"2023-10-25T16:14:50.782169+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:50.782169+0000","last_undegraded":"2023-10-25T16:14:50.782169+0000","last_fullsized":"2023-10-25T16:14:50.782169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781336+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:50.781336+0000","last_peered":"2023-10-25T16:14:50.781336+0000","last_clean":"2023-10-25T16:14:50.781336+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:50.781336+0000","last_undegraded":"2023-10-25T16:14:50.781336+0000","last_fullsized":"2023-10-25T16:14:50.781336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782378+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:50.782378+0000","last_peered":"2023-10-25T16:14:50.782378+0000","last_clean":"2023-10-25T16:14:50.782378+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:50.782378+0000","last_undegraded":"2023-10-25T16:14:50.782378+0000","last_fullsized":"2023-10-25T16:14:50.782378+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489168+0000","last_change":"2023-10-25T16:14:48.878231+0000","last_active":"2023-10-25T16:14:50.489168+0000","last_peered":"2023-10-25T16:14:50.489168+0000","last_clean":"2023-10-25T16:14:50.489168+0000","last_became_active":"2023-10-25T16:14:48.877966+0000","last_became_peered":"2023-10-25T16:14:48.877966+0000","last_unstale":"2023-10-25T16:14:50.489168+0000","last_undegraded":"2023-10-25T16:14:50.489168+0000","last_fullsized":"2023-10-25T16:14:50.489168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603342+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:50.603342+0000","last_peered":"2023-10-25T16:14:50.603342+0000","last_clean":"2023-10-25T16:14:50.603342+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:50.603342+0000","last_undegraded":"2023-10-25T16:14:50.603342+0000","last_fullsized":"2023-10-25T16:14:50.603342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986250+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:50.986250+0000","last_peered":"2023-10-25T16:14:50.986250+0000","last_clean":"2023-10-25T16:14:50.986250+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:50.986250+0000","last_undegraded":"2023-10-25T16:14:50.986250+0000","last_fullsized":"2023-10-25T16:14:50.986250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781635+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:50.781635+0000","last_peered":"2023-10-25T16:14:50.781635+0000","last_clean":"2023-10-25T16:14:50.781635+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:50.781635+0000","last_undegraded":"2023-10-25T16:14:50.781635+0000","last_fullsized":"2023-10-25T16:14:50.781635+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603394+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:50.603394+0000","last_peered":"2023-10-25T16:14:50.603394+0000","last_clean":"2023-10-25T16:14:50.603394+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:50.603394+0000","last_undegraded":"2023-10-25T16:14:50.603394+0000","last_fullsized":"2023-10-25T16:14:50.603394+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848120+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:49.848120+0000","last_peered":"2023-10-25T16:14:49.848120+0000","last_clean":"2023-10-25T16:14:49.848120+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:49.848120+0000","last_undegraded":"2023-10-25T16:14:49.848120+0000","last_fullsized":"2023-10-25T16:14:49.848120+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:10:53.111494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488720+0000","last_change":"2023-10-25T16:14:48.872434+0000","last_active":"2023-10-25T16:14:50.488720+0000","last_peered":"2023-10-25T16:14:50.488720+0000","last_clean":"2023-10-25T16:14:50.488720+0000","last_became_active":"2023-10-25T16:14:48.871802+0000","last_became_peered":"2023-10-25T16:14:48.871802+0000","last_unstale":"2023-10-25T16:14:50.488720+0000","last_undegraded":"2023-10-25T16:14:50.488720+0000","last_fullsized":"2023-10-25T16:14:50.488720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849854+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:49.849854+0000","last_peered":"2023-10-25T16:14:49.849854+0000","last_clean":"2023-10-25T16:14:49.849854+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:49.849854+0000","last_undegraded":"2023-10-25T16:14:49.849854+0000","last_fullsized":"2023-10-25T16:14:49.849854+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847194+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:49.847194+0000","last_peered":"2023-10-25T16:14:49.847194+0000","last_clean":"2023-10-25T16:14:49.847194+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:49.847194+0000","last_undegraded":"2023-10-25T16:14:49.847194+0000","last_fullsized":"2023-10-25T16:14:49.847194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781848+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:50.781848+0000","last_peered":"2023-10-25T16:14:50.781848+0000","last_clean":"2023-10-25T16:14:50.781848+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:50.781848+0000","last_undegraded":"2023-10-25T16:14:50.781848+0000","last_fullsized":"2023-10-25T16:14:50.781848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.602864+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:50.602864+0000","last_peered":"2023-10-25T16:14:50.602864+0000","last_clean":"2023-10-25T16:14:50.602864+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:50.602864+0000","last_undegraded":"2023-10-25T16:14:50.602864+0000","last_fullsized":"2023-10-25T16:14:50.602864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987151+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:50.987151+0000","last_peered":"2023-10-25T16:14:50.987151+0000","last_clean":"2023-10-25T16:14:50.987151+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:50.987151+0000","last_undegraded":"2023-10-25T16:14:50.987151+0000","last_fullsized":"2023-10-25T16:14:50.987151+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849630+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:49.849630+0000","last_peered":"2023-10-25T16:14:49.849630+0000","last_clean":"2023-10-25T16:14:49.849630+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:49.849630+0000","last_undegraded":"2023-10-25T16:14:49.849630+0000","last_fullsized":"2023-10-25T16:14:49.849630+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849522+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:49.849522+0000","last_peered":"2023-10-25T16:14:49.849522+0000","last_clean":"2023-10-25T16:14:49.849522+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:49.849522+0000","last_undegraded":"2023-10-25T16:14:49.849522+0000","last_fullsized":"2023-10-25T16:14:49.849522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986223+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:50.986223+0000","last_peered":"2023-10-25T16:14:50.986223+0000","last_clean":"2023-10-25T16:14:50.986223+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:50.986223+0000","last_undegraded":"2023-10-25T16:14:50.986223+0000","last_fullsized":"2023-10-25T16:14:50.986223+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603171+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:50.603171+0000","last_peered":"2023-10-25T16:14:50.603171+0000","last_clean":"2023-10-25T16:14:50.603171+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:50.603171+0000","last_undegraded":"2023-10-25T16:14:50.603171+0000","last_fullsized":"2023-10-25T16:14:50.603171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847811+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:49.847811+0000","last_peered":"2023-10-25T16:14:49.847811+0000","last_clean":"2023-10-25T16:14:49.847811+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:49.847811+0000","last_undegraded":"2023-10-25T16:14:49.847811+0000","last_fullsized":"2023-10-25T16:14:49.847811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982345+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:50.982345+0000","last_peered":"2023-10-25T16:14:50.982345+0000","last_clean":"2023-10-25T16:14:50.982345+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:50.982345+0000","last_undegraded":"2023-10-25T16:14:50.982345+0000","last_fullsized":"2023-10-25T16:14:50.982345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603854+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:50.603854+0000","last_peered":"2023-10-25T16:14:50.603854+0000","last_clean":"2023-10-25T16:14:50.603854+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:50.603854+0000","last_undegraded":"2023-10-25T16:14:50.603854+0000","last_fullsized":"2023-10-25T16:14:50.603854+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982344+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:50.982344+0000","last_peered":"2023-10-25T16:14:50.982344+0000","last_clean":"2023-10-25T16:14:50.982344+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:50.982344+0000","last_undegraded":"2023-10-25T16:14:50.982344+0000","last_fullsized":"2023-10-25T16:14:50.982344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985543+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:50.985543+0000","last_peered":"2023-10-25T16:14:50.985543+0000","last_clean":"2023-10-25T16:14:50.985543+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:50.985543+0000","last_undegraded":"2023-10-25T16:14:50.985543+0000","last_fullsized":"2023-10-25T16:14:50.985543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781989+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:50.781989+0000","last_peered":"2023-10-25T16:14:50.781989+0000","last_clean":"2023-10-25T16:14:50.781989+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:50.781989+0000","last_undegraded":"2023-10-25T16:14:50.781989+0000","last_fullsized":"2023-10-25T16:14:50.781989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982731+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:50.982731+0000","last_peered":"2023-10-25T16:14:50.982731+0000","last_clean":"2023-10-25T16:14:50.982731+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:50.982731+0000","last_undegraded":"2023-10-25T16:14:50.982731+0000","last_fullsized":"2023-10-25T16:14:50.982731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603681+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:50.603681+0000","last_peered":"2023-10-25T16:14:50.603681+0000","last_clean":"2023-10-25T16:14:50.603681+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:50.603681+0000","last_undegraded":"2023-10-25T16:14:50.603681+0000","last_fullsized":"2023-10-25T16:14:50.603681+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603067+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:50.603067+0000","last_peered":"2023-10-25T16:14:50.603067+0000","last_clean":"2023-10-25T16:14:50.603067+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:50.603067+0000","last_undegraded":"2023-10-25T16:14:50.603067+0000","last_fullsized":"2023-10-25T16:14:50.603067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986090+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:50.986090+0000","last_peered":"2023-10-25T16:14:50.986090+0000","last_clean":"2023-10-25T16:14:50.986090+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:50.986090+0000","last_undegraded":"2023-10-25T16:14:50.986090+0000","last_fullsized":"2023-10-25T16:14:50.986090+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:02.408430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982451+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:50.982451+0000","last_peered":"2023-10-25T16:14:50.982451+0000","last_clean":"2023-10-25T16:14:50.982451+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:50.982451+0000","last_undegraded":"2023-10-25T16:14:50.982451+0000","last_fullsized":"2023-10-25T16:14:50.982451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847559+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:49.847559+0000","last_peered":"2023-10-25T16:14:49.847559+0000","last_clean":"2023-10-25T16:14:49.847559+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:49.847559+0000","last_undegraded":"2023-10-25T16:14:49.847559+0000","last_fullsized":"2023-10-25T16:14:49.847559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:41.615017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986669+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:50.986669+0000","last_peered":"2023-10-25T16:14:50.986669+0000","last_clean":"2023-10-25T16:14:50.986669+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:50.986669+0000","last_undegraded":"2023-10-25T16:14:50.986669+0000","last_fullsized":"2023-10-25T16:14:50.986669+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986422+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:50.986422+0000","last_peered":"2023-10-25T16:14:50.986422+0000","last_clean":"2023-10-25T16:14:50.986422+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:50.986422+0000","last_undegraded":"2023-10-25T16:14:50.986422+0000","last_fullsized":"2023-10-25T16:14:50.986422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:23.653548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488734+0000","last_change":"2023-10-25T16:14:47.868446+0000","last_active":"2023-10-25T16:14:50.488734+0000","last_peered":"2023-10-25T16:14:50.488734+0000","last_clean":"2023-10-25T16:14:50.488734+0000","last_became_active":"2023-10-25T16:14:47.868199+0000","last_became_peered":"2023-10-25T16:14:47.868199+0000","last_unstale":"2023-10-25T16:14:50.488734+0000","last_undegraded":"2023-10-25T16:14:50.488734+0000","last_fullsized":"2023-10-25T16:14:50.488734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:20:05.028912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782046+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:50.782046+0000","last_peered":"2023-10-25T16:14:50.782046+0000","last_clean":"2023-10-25T16:14:50.782046+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:50.782046+0000","last_undegraded":"2023-10-25T16:14:50.782046+0000","last_fullsized":"2023-10-25T16:14:50.782046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847195+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:49.847195+0000","last_peered":"2023-10-25T16:14:49.847195+0000","last_clean":"2023-10-25T16:14:49.847195+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:49.847195+0000","last_undegraded":"2023-10-25T16:14:49.847195+0000","last_fullsized":"2023-10-25T16:14:49.847195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982492+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:50.982492+0000","last_peered":"2023-10-25T16:14:50.982492+0000","last_clean":"2023-10-25T16:14:50.982492+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:50.982492+0000","last_undegraded":"2023-10-25T16:14:50.982492+0000","last_fullsized":"2023-10-25T16:14:50.982492+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986336+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:50.986336+0000","last_peered":"2023-10-25T16:14:50.986336+0000","last_clean":"2023-10-25T16:14:50.986336+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:50.986336+0000","last_undegraded":"2023-10-25T16:14:50.986336+0000","last_fullsized":"2023-10-25T16:14:50.986336+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847014+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:49.847014+0000","last_peered":"2023-10-25T16:14:49.847014+0000","last_clean":"2023-10-25T16:14:49.847014+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:49.847014+0000","last_undegraded":"2023-10-25T16:14:49.847014+0000","last_fullsized":"2023-10-25T16:14:49.847014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:29:12.879767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847986+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:49.847986+0000","last_peered":"2023-10-25T16:14:49.847986+0000","last_clean":"2023-10-25T16:14:49.847986+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:49.847986+0000","last_undegraded":"2023-10-25T16:14:49.847986+0000","last_fullsized":"2023-10-25T16:14:49.847986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985602+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:50.985602+0000","last_peered":"2023-10-25T16:14:50.985602+0000","last_clean":"2023-10-25T16:14:50.985602+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:50.985602+0000","last_undegraded":"2023-10-25T16:14:50.985602+0000","last_fullsized":"2023-10-25T16:14:50.985602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982111+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:50.982111+0000","last_peered":"2023-10-25T16:14:50.982111+0000","last_clean":"2023-10-25T16:14:50.982111+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:50.982111+0000","last_undegraded":"2023-10-25T16:14:50.982111+0000","last_fullsized":"2023-10-25T16:14:50.982111+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489135+0000","last_change":"2023-10-25T16:14:48.865059+0000","last_active":"2023-10-25T16:14:50.489135+0000","last_peered":"2023-10-25T16:14:50.489135+0000","last_clean":"2023-10-25T16:14:50.489135+0000","last_became_active":"2023-10-25T16:14:48.864397+0000","last_became_peered":"2023-10-25T16:14:48.864397+0000","last_unstale":"2023-10-25T16:14:50.489135+0000","last_undegraded":"2023-10-25T16:14:50.489135+0000","last_fullsized":"2023-10-25T16:14:50.489135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488952+0000","last_change":"2023-10-25T16:14:47.853938+0000","last_active":"2023-10-25T16:14:50.488952+0000","last_peered":"2023-10-25T16:14:50.488952+0000","last_clean":"2023-10-25T16:14:50.488952+0000","last_became_active":"2023-10-25T16:14:47.853677+0000","last_became_peered":"2023-10-25T16:14:47.853677+0000","last_unstale":"2023-10-25T16:14:50.488952+0000","last_undegraded":"2023-10-25T16:14:50.488952+0000","last_fullsized":"2023-10-25T16:14:50.488952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:58.445296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982190+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:50.982190+0000","last_peered":"2023-10-25T16:14:50.982190+0000","last_clean":"2023-10-25T16:14:50.982190+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:50.982190+0000","last_undegraded":"2023-10-25T16:14:50.982190+0000","last_fullsized":"2023-10-25T16:14:50.982190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603616+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:50.603616+0000","last_peered":"2023-10-25T16:14:50.603616+0000","last_clean":"2023-10-25T16:14:50.603616+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:50.603616+0000","last_undegraded":"2023-10-25T16:14:50.603616+0000","last_fullsized":"2023-10-25T16:14:50.603616+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781860+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:50.781860+0000","last_peered":"2023-10-25T16:14:50.781860+0000","last_clean":"2023-10-25T16:14:50.781860+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:50.781860+0000","last_undegraded":"2023-10-25T16:14:50.781860+0000","last_fullsized":"2023-10-25T16:14:50.781860+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987377+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:50.987377+0000","last_peered":"2023-10-25T16:14:50.987377+0000","last_clean":"2023-10-25T16:14:50.987377+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:50.987377+0000","last_undegraded":"2023-10-25T16:14:50.987377+0000","last_fullsized":"2023-10-25T16:14:50.987377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782396+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:50.782396+0000","last_peered":"2023-10-25T16:14:50.782396+0000","last_clean":"2023-10-25T16:14:50.782396+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:50.782396+0000","last_undegraded":"2023-10-25T16:14:50.782396+0000","last_fullsized":"2023-10-25T16:14:50.782396+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848087+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:49.848087+0000","last_peered":"2023-10-25T16:14:49.848087+0000","last_clean":"2023-10-25T16:14:49.848087+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:49.848087+0000","last_undegraded":"2023-10-25T16:14:49.848087+0000","last_fullsized":"2023-10-25T16:14:49.848087+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847885+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:49.847885+0000","last_peered":"2023-10-25T16:14:49.847885+0000","last_clean":"2023-10-25T16:14:49.847885+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:49.847885+0000","last_undegraded":"2023-10-25T16:14:49.847885+0000","last_fullsized":"2023-10-25T16:14:49.847885+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:01:09.446290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847402+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:49.847402+0000","last_peered":"2023-10-25T16:14:49.847402+0000","last_clean":"2023-10-25T16:14:49.847402+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:49.847402+0000","last_undegraded":"2023-10-25T16:14:49.847402+0000","last_fullsized":"2023-10-25T16:14:49.847402+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849508+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:49.849508+0000","last_peered":"2023-10-25T16:14:49.849508+0000","last_clean":"2023-10-25T16:14:49.849508+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:49.849508+0000","last_undegraded":"2023-10-25T16:14:49.849508+0000","last_fullsized":"2023-10-25T16:14:49.849508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985784+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:50.985784+0000","last_peered":"2023-10-25T16:14:50.985784+0000","last_clean":"2023-10-25T16:14:50.985784+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:50.985784+0000","last_undegraded":"2023-10-25T16:14:50.985784+0000","last_fullsized":"2023-10-25T16:14:50.985784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488979+0000","last_change":"2023-10-25T16:14:48.851029+0000","last_active":"2023-10-25T16:14:50.488979+0000","last_peered":"2023-10-25T16:14:50.488979+0000","last_clean":"2023-10-25T16:14:50.488979+0000","last_became_active":"2023-10-25T16:14:48.850613+0000","last_became_peered":"2023-10-25T16:14:48.850613+0000","last_unstale":"2023-10-25T16:14:50.488979+0000","last_undegraded":"2023-10-25T16:14:50.488979+0000","last_fullsized":"2023-10-25T16:14:50.488979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982779+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:50.982779+0000","last_peered":"2023-10-25T16:14:50.982779+0000","last_clean":"2023-10-25T16:14:50.982779+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:50.982779+0000","last_undegraded":"2023-10-25T16:14:50.982779+0000","last_fullsized":"2023-10-25T16:14:50.982779+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982568+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:50.982568+0000","last_peered":"2023-10-25T16:14:50.982568+0000","last_clean":"2023-10-25T16:14:50.982568+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:50.982568+0000","last_undegraded":"2023-10-25T16:14:50.982568+0000","last_fullsized":"2023-10-25T16:14:50.982568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986448+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:50.986448+0000","last_peered":"2023-10-25T16:14:50.986448+0000","last_clean":"2023-10-25T16:14:50.986448+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:50.986448+0000","last_undegraded":"2023-10-25T16:14:50.986448+0000","last_fullsized":"2023-10-25T16:14:50.986448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782075+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:50.782075+0000","last_peered":"2023-10-25T16:14:50.782075+0000","last_clean":"2023-10-25T16:14:50.782075+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:50.782075+0000","last_undegraded":"2023-10-25T16:14:50.782075+0000","last_fullsized":"2023-10-25T16:14:50.782075+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.187522+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:54.187522+0000","last_peered":"2023-10-25T16:14:54.187522+0000","last_clean":"2023-10-25T16:14:54.187522+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:54.187522+0000","last_undegraded":"2023-10-25T16:14:54.187522+0000","last_fullsized":"2023-10-25T16:14:54.187522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982639+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:50.982639+0000","last_peered":"2023-10-25T16:14:50.982639+0000","last_clean":"2023-10-25T16:14:50.982639+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:50.982639+0000","last_undegraded":"2023-10-25T16:14:50.982639+0000","last_fullsized":"2023-10-25T16:14:50.982639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985713+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:50.985713+0000","last_peered":"2023-10-25T16:14:50.985713+0000","last_clean":"2023-10-25T16:14:50.985713+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:50.985713+0000","last_undegraded":"2023-10-25T16:14:50.985713+0000","last_fullsized":"2023-10-25T16:14:50.985713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985476+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:50.985476+0000","last_peered":"2023-10-25T16:14:50.985476+0000","last_clean":"2023-10-25T16:14:50.985476+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:50.985476+0000","last_undegraded":"2023-10-25T16:14:50.985476+0000","last_fullsized":"2023-10-25T16:14:50.985476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849686+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:49.849686+0000","last_peered":"2023-10-25T16:14:49.849686+0000","last_clean":"2023-10-25T16:14:49.849686+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:49.849686+0000","last_undegraded":"2023-10-25T16:14:49.849686+0000","last_fullsized":"2023-10-25T16:14:49.849686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847558+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:49.847558+0000","last_peered":"2023-10-25T16:14:49.847558+0000","last_clean":"2023-10-25T16:14:49.847558+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:49.847558+0000","last_undegraded":"2023-10-25T16:14:49.847558+0000","last_fullsized":"2023-10-25T16:14:49.847558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:15:28.083843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986558+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:50.986558+0000","last_peered":"2023-10-25T16:14:50.986558+0000","last_clean":"2023-10-25T16:14:50.986558+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:50.986558+0000","last_undegraded":"2023-10-25T16:14:50.986558+0000","last_fullsized":"2023-10-25T16:14:50.986558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848409+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:49.848409+0000","last_peered":"2023-10-25T16:14:49.848409+0000","last_clean":"2023-10-25T16:14:49.848409+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:49.848409+0000","last_undegraded":"2023-10-25T16:14:49.848409+0000","last_fullsized":"2023-10-25T16:14:49.848409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:16:46.241055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603811+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:50.603811+0000","last_peered":"2023-10-25T16:14:50.603811+0000","last_clean":"2023-10-25T16:14:50.603811+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:50.603811+0000","last_undegraded":"2023-10-25T16:14:50.603811+0000","last_fullsized":"2023-10-25T16:14:50.603811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985313+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:50.985313+0000","last_peered":"2023-10-25T16:14:50.985313+0000","last_clean":"2023-10-25T16:14:50.985313+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:50.985313+0000","last_undegraded":"2023-10-25T16:14:50.985313+0000","last_fullsized":"2023-10-25T16:14:50.985313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849687+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:49.849687+0000","last_peered":"2023-10-25T16:14:49.849687+0000","last_clean":"2023-10-25T16:14:49.849687+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:49.849687+0000","last_undegraded":"2023-10-25T16:14:49.849687+0000","last_fullsized":"2023-10-25T16:14:49.849687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603551+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:50.603551+0000","last_peered":"2023-10-25T16:14:50.603551+0000","last_clean":"2023-10-25T16:14:50.603551+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:50.603551+0000","last_undegraded":"2023-10-25T16:14:50.603551+0000","last_fullsized":"2023-10-25T16:14:50.603551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982249+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:50.982249+0000","last_peered":"2023-10-25T16:14:50.982249+0000","last_clean":"2023-10-25T16:14:50.982249+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:50.982249+0000","last_undegraded":"2023-10-25T16:14:50.982249+0000","last_fullsized":"2023-10-25T16:14:50.982249+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981965+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:50.981965+0000","last_peered":"2023-10-25T16:14:50.981965+0000","last_clean":"2023-10-25T16:14:50.981965+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:50.981965+0000","last_undegraded":"2023-10-25T16:14:50.981965+0000","last_fullsized":"2023-10-25T16:14:50.981965+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987048+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:50.987048+0000","last_peered":"2023-10-25T16:14:50.987048+0000","last_clean":"2023-10-25T16:14:50.987048+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:50.987048+0000","last_undegraded":"2023-10-25T16:14:50.987048+0000","last_fullsized":"2023-10-25T16:14:50.987048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985945+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:50.985945+0000","last_peered":"2023-10-25T16:14:50.985945+0000","last_clean":"2023-10-25T16:14:50.985945+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:50.985945+0000","last_undegraded":"2023-10-25T16:14:50.985945+0000","last_fullsized":"2023-10-25T16:14:50.985945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79900000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.87}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.151},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.171}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.274},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.3080000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.94499999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.016},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.99199999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.625},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.056},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.874}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767828,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0269999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1819999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.127},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.88},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.095}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":1.052},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.95499999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.149},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.006},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.105}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.423},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.3939999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195078,"statfs":{"total":200000000,"available":199760863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.76700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.2949999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.173},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.248}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.82299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.321}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0169999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.046},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.1240000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.99399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.438},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82499999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.04}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.871},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.089},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194503,"statfs":{"total":200000000,"available":199172073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.95999999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.161}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90700000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.079},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.119}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:56.709 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 -- 172.21.15.177:0/1129160657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c0cdb10 msgr2=0x7f6c8c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1129160657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0cdfc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009840 tx=0x7f6c8401c770 comp rx=0 tx=0).stop 2023-10-25T16:14:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 -- 172.21.15.177:0/1129160657 shutdown_connections 2023-10-25T16:14:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1129160657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0cdfc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1129160657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8c15eba0 0x7f6c8c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 -- 172.21.15.177:0/1129160657 >> 172.21.15.177:0/1129160657 conn(0x7f6c8c09a5c0 msgr2=0x7f6c8c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 -- 172.21.15.177:0/1129160657 shutdown_connections 2023-10-25T16:14:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 -- 172.21.15.177:0/1129160657 wait complete. 2023-10-25T16:14:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 Processor -- start 2023-10-25T16:14:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 -- start start 2023-10-25T16:14:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8c0b2120 0x7f6c8c156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.867+0000 7f6c946f9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c15eba0 0x7f6c8c0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c15a290 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c159610 con 0x7f6c8c15eba0 2023-10-25T16:14:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c1598f0 con 0x7f6c8c0b2120 2023-10-25T16:14:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56370/0 (socket says 172.21.15.177:56370) 2023-10-25T16:14:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 -- 172.21.15.177:0/1140807224 learned_addr learned my addr 172.21.15.177:0/1140807224 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c92495640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8c0b2120 0x7f6c8c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c92c96640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c15eba0 0x7f6c8c0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 -- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8c0b2120 msgr2=0x7f6c8c156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8c0b2120 0x7f6c8c156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 -- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c15eba0 msgr2=0x7f6c8c0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c15eba0 0x7f6c8c0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 -- 172.21.15.177:0/1140807224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840094a0 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c92c96640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c15eba0 0x7f6c8c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:14:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c91c94640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0c6460 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c420 tx=0x7f6c7c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0052d0 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c7c007020 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c159bd0 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c007430 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c156b50 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c156d40 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c7c007590 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c82ffd640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c700664a0 0x7f6c70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:56.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6c7c083450 con 0x7f6c8c0cdb10 2023-10-25T16:14:56.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.871+0000 7f6c92495640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c700664a0 0x7f6c70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:56.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.875+0000 7f6c92495640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c700664a0 0x7f6c70068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ec0 tx=0x7f6c88010040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:56.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:56.875+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c8c156d40 con 0x7f6c8c0cdb10 2023-10-25T16:14:57.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.023+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c8c15a3d0 con 0x7f6c700664a0 2023-10-25T16:14:57.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.047+0000 7f6c82ffd640 1 -- 172.21.15.177:0/1140807224 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283508 (secure 0 0 0) 0x7f6c8c15a3d0 con 0x7f6c700664a0 2023-10-25T16:14:57.053 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:57.054 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:57.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.047+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c700664a0 msgr2=0x7f6c70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.047+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c700664a0 0x7f6c70068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ec0 tx=0x7f6c88010040 comp rx=0 tx=0).stop 2023-10-25T16:14:57.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.047+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 msgr2=0x7f6c8c0c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0c6460 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00c420 tx=0x7f6c7c00c8e0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 shutdown_connections 2023-10-25T16:14:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c700664a0 0x7f6c70068960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c8c15eba0 0x7f6c8c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c8c0cdb10 0x7f6c8c0c6460 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 --2- 172.21.15.177:0/1140807224 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c8c0b2120 0x7f6c8c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 >> 172.21.15.177:0/1140807224 conn(0x7f6c8c09a5c0 msgr2=0x7f6c8c15c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 shutdown_connections 2023-10-25T16:14:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.051+0000 7f6c946f9640 1 -- 172.21.15.177:0/1140807224 wait complete. 2023-10-25T16:14:57.070 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-25T16:14:56.642178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559521,"statfs":{"total":1600000000,"available":1596950394,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.790884"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985888+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:50.985888+0000","last_peered":"2023-10-25T16:14:50.985888+0000","last_clean":"2023-10-25T16:14:50.985888+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:50.985888+0000","last_undegraded":"2023-10-25T16:14:50.985888+0000","last_fullsized":"2023-10-25T16:14:50.985888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986502+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:50.986502+0000","last_peered":"2023-10-25T16:14:50.986502+0000","last_clean":"2023-10-25T16:14:50.986502+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:50.986502+0000","last_undegraded":"2023-10-25T16:14:50.986502+0000","last_fullsized":"2023-10-25T16:14:50.986502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603365+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:50.603365+0000","last_peered":"2023-10-25T16:14:50.603365+0000","last_clean":"2023-10-25T16:14:50.603365+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:50.603365+0000","last_undegraded":"2023-10-25T16:14:50.603365+0000","last_fullsized":"2023-10-25T16:14:50.603365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981881+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:50.981881+0000","last_peered":"2023-10-25T16:14:50.981881+0000","last_clean":"2023-10-25T16:14:50.981881+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:50.981881+0000","last_undegraded":"2023-10-25T16:14:50.981881+0000","last_fullsized":"2023-10-25T16:14:50.981881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986893+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:50.986893+0000","last_peered":"2023-10-25T16:14:50.986893+0000","last_clean":"2023-10-25T16:14:50.986893+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:50.986893+0000","last_undegraded":"2023-10-25T16:14:50.986893+0000","last_fullsized":"2023-10-25T16:14:50.986893+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847506+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:49.847506+0000","last_peered":"2023-10-25T16:14:49.847506+0000","last_clean":"2023-10-25T16:14:49.847506+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:49.847506+0000","last_undegraded":"2023-10-25T16:14:49.847506+0000","last_fullsized":"2023-10-25T16:14:49.847506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:26:12.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985267+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:50.985267+0000","last_peered":"2023-10-25T16:14:50.985267+0000","last_clean":"2023-10-25T16:14:50.985267+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:50.985267+0000","last_undegraded":"2023-10-25T16:14:50.985267+0000","last_fullsized":"2023-10-25T16:14:50.985267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981802+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:50.981802+0000","last_peered":"2023-10-25T16:14:50.981802+0000","last_clean":"2023-10-25T16:14:50.981802+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:50.981802+0000","last_undegraded":"2023-10-25T16:14:50.981802+0000","last_fullsized":"2023-10-25T16:14:50.981802+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982048+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:50.982048+0000","last_peered":"2023-10-25T16:14:50.982048+0000","last_clean":"2023-10-25T16:14:50.982048+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:50.982048+0000","last_undegraded":"2023-10-25T16:14:50.982048+0000","last_fullsized":"2023-10-25T16:14:50.982048+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982158+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:50.982158+0000","last_peered":"2023-10-25T16:14:50.982158+0000","last_clean":"2023-10-25T16:14:50.982158+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:50.982158+0000","last_undegraded":"2023-10-25T16:14:50.982158+0000","last_fullsized":"2023-10-25T16:14:50.982158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982000+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:50.982000+0000","last_peered":"2023-10-25T16:14:50.982000+0000","last_clean":"2023-10-25T16:14:50.982000+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:50.982000+0000","last_undegraded":"2023-10-25T16:14:50.982000+0000","last_fullsized":"2023-10-25T16:14:50.982000+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986804+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:50.986804+0000","last_peered":"2023-10-25T16:14:50.986804+0000","last_clean":"2023-10-25T16:14:50.986804+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:50.986804+0000","last_undegraded":"2023-10-25T16:14:50.986804+0000","last_fullsized":"2023-10-25T16:14:50.986804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488829+0000","last_change":"2023-10-25T16:14:48.877528+0000","last_active":"2023-10-25T16:14:50.488829+0000","last_peered":"2023-10-25T16:14:50.488829+0000","last_clean":"2023-10-25T16:14:50.488829+0000","last_became_active":"2023-10-25T16:14:48.876876+0000","last_became_peered":"2023-10-25T16:14:48.876876+0000","last_unstale":"2023-10-25T16:14:50.488829+0000","last_undegraded":"2023-10-25T16:14:50.488829+0000","last_fullsized":"2023-10-25T16:14:50.488829+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":2,"reported_epoch":49,"state":"peering","last_fresh":"2023-10-25T16:14:50.982345+0000","last_change":"2023-10-25T16:14:54.802095+0000","last_active":"2023-10-25T16:14:54.802095+0000","last_peered":"2023-10-25T16:14:50.982345+0000","last_clean":"2023-10-25T16:14:50.982345+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:50.982345+0000","last_undegraded":"2023-10-25T16:14:50.982345+0000","last_fullsized":"2023-10-25T16:14:50.982345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847013+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:49.847013+0000","last_peered":"2023-10-25T16:14:49.847013+0000","last_clean":"2023-10-25T16:14:49.847013+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:49.847013+0000","last_undegraded":"2023-10-25T16:14:49.847013+0000","last_fullsized":"2023-10-25T16:14:49.847013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:37:19.332657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"peering","last_fresh":"2023-10-25T16:14:50.781654+0000","last_change":"2023-10-25T16:14:54.585955+0000","last_active":"2023-10-25T16:14:54.585955+0000","last_peered":"2023-10-25T16:14:50.781654+0000","last_clean":"2023-10-25T16:14:50.781654+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:50.781654+0000","last_undegraded":"2023-10-25T16:14:50.781654+0000","last_fullsized":"2023-10-25T16:14:50.781654+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.602994+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:50.602994+0000","last_peered":"2023-10-25T16:14:50.602994+0000","last_clean":"2023-10-25T16:14:50.602994+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:50.602994+0000","last_undegraded":"2023-10-25T16:14:50.602994+0000","last_fullsized":"2023-10-25T16:14:50.602994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603730+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:50.603730+0000","last_peered":"2023-10-25T16:14:50.603730+0000","last_clean":"2023-10-25T16:14:50.603730+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:50.603730+0000","last_undegraded":"2023-10-25T16:14:50.603730+0000","last_fullsized":"2023-10-25T16:14:50.603730+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782351+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:50.782351+0000","last_peered":"2023-10-25T16:14:50.782351+0000","last_clean":"2023-10-25T16:14:50.782351+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:50.782351+0000","last_undegraded":"2023-10-25T16:14:50.782351+0000","last_fullsized":"2023-10-25T16:14:50.782351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488818+0000","last_change":"2023-10-25T16:14:48.868676+0000","last_active":"2023-10-25T16:14:50.488818+0000","last_peered":"2023-10-25T16:14:50.488818+0000","last_clean":"2023-10-25T16:14:50.488818+0000","last_became_active":"2023-10-25T16:14:48.868055+0000","last_became_peered":"2023-10-25T16:14:48.868055+0000","last_unstale":"2023-10-25T16:14:50.488818+0000","last_undegraded":"2023-10-25T16:14:50.488818+0000","last_fullsized":"2023-10-25T16:14:50.488818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847820+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:49.847820+0000","last_peered":"2023-10-25T16:14:49.847820+0000","last_clean":"2023-10-25T16:14:49.847820+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:49.847820+0000","last_undegraded":"2023-10-25T16:14:49.847820+0000","last_fullsized":"2023-10-25T16:14:49.847820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:24:32.144529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982159+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:50.982159+0000","last_peered":"2023-10-25T16:14:50.982159+0000","last_clean":"2023-10-25T16:14:50.982159+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:50.982159+0000","last_undegraded":"2023-10-25T16:14:50.982159+0000","last_fullsized":"2023-10-25T16:14:50.982159+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782169+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:50.782169+0000","last_peered":"2023-10-25T16:14:50.782169+0000","last_clean":"2023-10-25T16:14:50.782169+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:50.782169+0000","last_undegraded":"2023-10-25T16:14:50.782169+0000","last_fullsized":"2023-10-25T16:14:50.782169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781336+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:50.781336+0000","last_peered":"2023-10-25T16:14:50.781336+0000","last_clean":"2023-10-25T16:14:50.781336+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:50.781336+0000","last_undegraded":"2023-10-25T16:14:50.781336+0000","last_fullsized":"2023-10-25T16:14:50.781336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782378+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:50.782378+0000","last_peered":"2023-10-25T16:14:50.782378+0000","last_clean":"2023-10-25T16:14:50.782378+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:50.782378+0000","last_undegraded":"2023-10-25T16:14:50.782378+0000","last_fullsized":"2023-10-25T16:14:50.782378+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489168+0000","last_change":"2023-10-25T16:14:48.878231+0000","last_active":"2023-10-25T16:14:50.489168+0000","last_peered":"2023-10-25T16:14:50.489168+0000","last_clean":"2023-10-25T16:14:50.489168+0000","last_became_active":"2023-10-25T16:14:48.877966+0000","last_became_peered":"2023-10-25T16:14:48.877966+0000","last_unstale":"2023-10-25T16:14:50.489168+0000","last_undegraded":"2023-10-25T16:14:50.489168+0000","last_fullsized":"2023-10-25T16:14:50.489168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603342+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:50.603342+0000","last_peered":"2023-10-25T16:14:50.603342+0000","last_clean":"2023-10-25T16:14:50.603342+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:50.603342+0000","last_undegraded":"2023-10-25T16:14:50.603342+0000","last_fullsized":"2023-10-25T16:14:50.603342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986250+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:50.986250+0000","last_peered":"2023-10-25T16:14:50.986250+0000","last_clean":"2023-10-25T16:14:50.986250+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:50.986250+0000","last_undegraded":"2023-10-25T16:14:50.986250+0000","last_fullsized":"2023-10-25T16:14:50.986250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781635+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:50.781635+0000","last_peered":"2023-10-25T16:14:50.781635+0000","last_clean":"2023-10-25T16:14:50.781635+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:50.781635+0000","last_undegraded":"2023-10-25T16:14:50.781635+0000","last_fullsized":"2023-10-25T16:14:50.781635+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603394+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:50.603394+0000","last_peered":"2023-10-25T16:14:50.603394+0000","last_clean":"2023-10-25T16:14:50.603394+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:50.603394+0000","last_undegraded":"2023-10-25T16:14:50.603394+0000","last_fullsized":"2023-10-25T16:14:50.603394+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848120+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:49.848120+0000","last_peered":"2023-10-25T16:14:49.848120+0000","last_clean":"2023-10-25T16:14:49.848120+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:49.848120+0000","last_undegraded":"2023-10-25T16:14:49.848120+0000","last_fullsized":"2023-10-25T16:14:49.848120+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:10:53.111494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488720+0000","last_change":"2023-10-25T16:14:48.872434+0000","last_active":"2023-10-25T16:14:50.488720+0000","last_peered":"2023-10-25T16:14:50.488720+0000","last_clean":"2023-10-25T16:14:50.488720+0000","last_became_active":"2023-10-25T16:14:48.871802+0000","last_became_peered":"2023-10-25T16:14:48.871802+0000","last_unstale":"2023-10-25T16:14:50.488720+0000","last_undegraded":"2023-10-25T16:14:50.488720+0000","last_fullsized":"2023-10-25T16:14:50.488720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849854+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:49.849854+0000","last_peered":"2023-10-25T16:14:49.849854+0000","last_clean":"2023-10-25T16:14:49.849854+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:49.849854+0000","last_undegraded":"2023-10-25T16:14:49.849854+0000","last_fullsized":"2023-10-25T16:14:49.849854+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847194+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:49.847194+0000","last_peered":"2023-10-25T16:14:49.847194+0000","last_clean":"2023-10-25T16:14:49.847194+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:49.847194+0000","last_undegraded":"2023-10-25T16:14:49.847194+0000","last_fullsized":"2023-10-25T16:14:49.847194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781848+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:50.781848+0000","last_peered":"2023-10-25T16:14:50.781848+0000","last_clean":"2023-10-25T16:14:50.781848+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:50.781848+0000","last_undegraded":"2023-10-25T16:14:50.781848+0000","last_fullsized":"2023-10-25T16:14:50.781848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.602864+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:50.602864+0000","last_peered":"2023-10-25T16:14:50.602864+0000","last_clean":"2023-10-25T16:14:50.602864+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:50.602864+0000","last_undegraded":"2023-10-25T16:14:50.602864+0000","last_fullsized":"2023-10-25T16:14:50.602864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987151+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:50.987151+0000","last_peered":"2023-10-25T16:14:50.987151+0000","last_clean":"2023-10-25T16:14:50.987151+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:50.987151+0000","last_undegraded":"2023-10-25T16:14:50.987151+0000","last_fullsized":"2023-10-25T16:14:50.987151+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849630+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:49.849630+0000","last_peered":"2023-10-25T16:14:49.849630+0000","last_clean":"2023-10-25T16:14:49.849630+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:49.849630+0000","last_undegraded":"2023-10-25T16:14:49.849630+0000","last_fullsized":"2023-10-25T16:14:49.849630+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849522+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:49.849522+0000","last_peered":"2023-10-25T16:14:49.849522+0000","last_clean":"2023-10-25T16:14:49.849522+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:49.849522+0000","last_undegraded":"2023-10-25T16:14:49.849522+0000","last_fullsized":"2023-10-25T16:14:49.849522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986223+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:50.986223+0000","last_peered":"2023-10-25T16:14:50.986223+0000","last_clean":"2023-10-25T16:14:50.986223+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:50.986223+0000","last_undegraded":"2023-10-25T16:14:50.986223+0000","last_fullsized":"2023-10-25T16:14:50.986223+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603171+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:50.603171+0000","last_peered":"2023-10-25T16:14:50.603171+0000","last_clean":"2023-10-25T16:14:50.603171+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:50.603171+0000","last_undegraded":"2023-10-25T16:14:50.603171+0000","last_fullsized":"2023-10-25T16:14:50.603171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847811+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:49.847811+0000","last_peered":"2023-10-25T16:14:49.847811+0000","last_clean":"2023-10-25T16:14:49.847811+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:49.847811+0000","last_undegraded":"2023-10-25T16:14:49.847811+0000","last_fullsized":"2023-10-25T16:14:49.847811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982345+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:50.982345+0000","last_peered":"2023-10-25T16:14:50.982345+0000","last_clean":"2023-10-25T16:14:50.982345+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:50.982345+0000","last_undegraded":"2023-10-25T16:14:50.982345+0000","last_fullsized":"2023-10-25T16:14:50.982345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603854+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:50.603854+0000","last_peered":"2023-10-25T16:14:50.603854+0000","last_clean":"2023-10-25T16:14:50.603854+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:50.603854+0000","last_undegraded":"2023-10-25T16:14:50.603854+0000","last_fullsized":"2023-10-25T16:14:50.603854+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982344+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:50.982344+0000","last_peered":"2023-10-25T16:14:50.982344+0000","last_clean":"2023-10-25T16:14:50.982344+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:50.982344+0000","last_undegraded":"2023-10-25T16:14:50.982344+0000","last_fullsized":"2023-10-25T16:14:50.982344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985543+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:50.985543+0000","last_peered":"2023-10-25T16:14:50.985543+0000","last_clean":"2023-10-25T16:14:50.985543+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:50.985543+0000","last_undegraded":"2023-10-25T16:14:50.985543+0000","last_fullsized":"2023-10-25T16:14:50.985543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781989+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:50.781989+0000","last_peered":"2023-10-25T16:14:50.781989+0000","last_clean":"2023-10-25T16:14:50.781989+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:50.781989+0000","last_undegraded":"2023-10-25T16:14:50.781989+0000","last_fullsized":"2023-10-25T16:14:50.781989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982731+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:50.982731+0000","last_peered":"2023-10-25T16:14:50.982731+0000","last_clean":"2023-10-25T16:14:50.982731+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:50.982731+0000","last_undegraded":"2023-10-25T16:14:50.982731+0000","last_fullsized":"2023-10-25T16:14:50.982731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603681+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:50.603681+0000","last_peered":"2023-10-25T16:14:50.603681+0000","last_clean":"2023-10-25T16:14:50.603681+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:50.603681+0000","last_undegraded":"2023-10-25T16:14:50.603681+0000","last_fullsized":"2023-10-25T16:14:50.603681+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603067+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:50.603067+0000","last_peered":"2023-10-25T16:14:50.603067+0000","last_clean":"2023-10-25T16:14:50.603067+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:50.603067+0000","last_undegraded":"2023-10-25T16:14:50.603067+0000","last_fullsized":"2023-10-25T16:14:50.603067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986090+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:50.986090+0000","last_peered":"2023-10-25T16:14:50.986090+0000","last_clean":"2023-10-25T16:14:50.986090+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:50.986090+0000","last_undegraded":"2023-10-25T16:14:50.986090+0000","last_fullsized":"2023-10-25T16:14:50.986090+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:02.408430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982451+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:50.982451+0000","last_peered":"2023-10-25T16:14:50.982451+0000","last_clean":"2023-10-25T16:14:50.982451+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:50.982451+0000","last_undegraded":"2023-10-25T16:14:50.982451+0000","last_fullsized":"2023-10-25T16:14:50.982451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847559+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:49.847559+0000","last_peered":"2023-10-25T16:14:49.847559+0000","last_clean":"2023-10-25T16:14:49.847559+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:49.847559+0000","last_undegraded":"2023-10-25T16:14:49.847559+0000","last_fullsized":"2023-10-25T16:14:49.847559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:41.615017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986669+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:50.986669+0000","last_peered":"2023-10-25T16:14:50.986669+0000","last_clean":"2023-10-25T16:14:50.986669+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:50.986669+0000","last_undegraded":"2023-10-25T16:14:50.986669+0000","last_fullsized":"2023-10-25T16:14:50.986669+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986422+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:50.986422+0000","last_peered":"2023-10-25T16:14:50.986422+0000","last_clean":"2023-10-25T16:14:50.986422+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:50.986422+0000","last_undegraded":"2023-10-25T16:14:50.986422+0000","last_fullsized":"2023-10-25T16:14:50.986422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:23.653548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488734+0000","last_change":"2023-10-25T16:14:47.868446+0000","last_active":"2023-10-25T16:14:50.488734+0000","last_peered":"2023-10-25T16:14:50.488734+0000","last_clean":"2023-10-25T16:14:50.488734+0000","last_became_active":"2023-10-25T16:14:47.868199+0000","last_became_peered":"2023-10-25T16:14:47.868199+0000","last_unstale":"2023-10-25T16:14:50.488734+0000","last_undegraded":"2023-10-25T16:14:50.488734+0000","last_fullsized":"2023-10-25T16:14:50.488734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:20:05.028912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782046+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:50.782046+0000","last_peered":"2023-10-25T16:14:50.782046+0000","last_clean":"2023-10-25T16:14:50.782046+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:50.782046+0000","last_undegraded":"2023-10-25T16:14:50.782046+0000","last_fullsized":"2023-10-25T16:14:50.782046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847195+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:49.847195+0000","last_peered":"2023-10-25T16:14:49.847195+0000","last_clean":"2023-10-25T16:14:49.847195+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:49.847195+0000","last_undegraded":"2023-10-25T16:14:49.847195+0000","last_fullsized":"2023-10-25T16:14:49.847195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982492+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:50.982492+0000","last_peered":"2023-10-25T16:14:50.982492+0000","last_clean":"2023-10-25T16:14:50.982492+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:50.982492+0000","last_undegraded":"2023-10-25T16:14:50.982492+0000","last_fullsized":"2023-10-25T16:14:50.982492+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986336+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:50.986336+0000","last_peered":"2023-10-25T16:14:50.986336+0000","last_clean":"2023-10-25T16:14:50.986336+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:50.986336+0000","last_undegraded":"2023-10-25T16:14:50.986336+0000","last_fullsized":"2023-10-25T16:14:50.986336+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847014+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:49.847014+0000","last_peered":"2023-10-25T16:14:49.847014+0000","last_clean":"2023-10-25T16:14:49.847014+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:49.847014+0000","last_undegraded":"2023-10-25T16:14:49.847014+0000","last_fullsized":"2023-10-25T16:14:49.847014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:29:12.879767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847986+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:49.847986+0000","last_peered":"2023-10-25T16:14:49.847986+0000","last_clean":"2023-10-25T16:14:49.847986+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:49.847986+0000","last_undegraded":"2023-10-25T16:14:49.847986+0000","last_fullsized":"2023-10-25T16:14:49.847986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985602+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:50.985602+0000","last_peered":"2023-10-25T16:14:50.985602+0000","last_clean":"2023-10-25T16:14:50.985602+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:50.985602+0000","last_undegraded":"2023-10-25T16:14:50.985602+0000","last_fullsized":"2023-10-25T16:14:50.985602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982111+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:50.982111+0000","last_peered":"2023-10-25T16:14:50.982111+0000","last_clean":"2023-10-25T16:14:50.982111+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:50.982111+0000","last_undegraded":"2023-10-25T16:14:50.982111+0000","last_fullsized":"2023-10-25T16:14:50.982111+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489135+0000","last_change":"2023-10-25T16:14:48.865059+0000","last_active":"2023-10-25T16:14:50.489135+0000","last_peered":"2023-10-25T16:14:50.489135+0000","last_clean":"2023-10-25T16:14:50.489135+0000","last_became_active":"2023-10-25T16:14:48.864397+0000","last_became_peered":"2023-10-25T16:14:48.864397+0000","last_unstale":"2023-10-25T16:14:50.489135+0000","last_undegraded":"2023-10-25T16:14:50.489135+0000","last_fullsized":"2023-10-25T16:14:50.489135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488952+0000","last_change":"2023-10-25T16:14:47.853938+0000","last_active":"2023-10-25T16:14:50.488952+0000","last_peered":"2023-10-25T16:14:50.488952+0000","last_clean":"2023-10-25T16:14:50.488952+0000","last_became_active":"2023-10-25T16:14:47.853677+0000","last_became_peered":"2023-10-25T16:14:47.853677+0000","last_unstale":"2023-10-25T16:14:50.488952+0000","last_undegraded":"2023-10-25T16:14:50.488952+0000","last_fullsized":"2023-10-25T16:14:50.488952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:58.445296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982190+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:50.982190+0000","last_peered":"2023-10-25T16:14:50.982190+0000","last_clean":"2023-10-25T16:14:50.982190+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:50.982190+0000","last_undegraded":"2023-10-25T16:14:50.982190+0000","last_fullsized":"2023-10-25T16:14:50.982190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603616+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:50.603616+0000","last_peered":"2023-10-25T16:14:50.603616+0000","last_clean":"2023-10-25T16:14:50.603616+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:50.603616+0000","last_undegraded":"2023-10-25T16:14:50.603616+0000","last_fullsized":"2023-10-25T16:14:50.603616+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781860+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:50.781860+0000","last_peered":"2023-10-25T16:14:50.781860+0000","last_clean":"2023-10-25T16:14:50.781860+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:50.781860+0000","last_undegraded":"2023-10-25T16:14:50.781860+0000","last_fullsized":"2023-10-25T16:14:50.781860+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987377+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:50.987377+0000","last_peered":"2023-10-25T16:14:50.987377+0000","last_clean":"2023-10-25T16:14:50.987377+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:50.987377+0000","last_undegraded":"2023-10-25T16:14:50.987377+0000","last_fullsized":"2023-10-25T16:14:50.987377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782396+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:50.782396+0000","last_peered":"2023-10-25T16:14:50.782396+0000","last_clean":"2023-10-25T16:14:50.782396+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:50.782396+0000","last_undegraded":"2023-10-25T16:14:50.782396+0000","last_fullsized":"2023-10-25T16:14:50.782396+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848087+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:49.848087+0000","last_peered":"2023-10-25T16:14:49.848087+0000","last_clean":"2023-10-25T16:14:49.848087+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:49.848087+0000","last_undegraded":"2023-10-25T16:14:49.848087+0000","last_fullsized":"2023-10-25T16:14:49.848087+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847885+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:49.847885+0000","last_peered":"2023-10-25T16:14:49.847885+0000","last_clean":"2023-10-25T16:14:49.847885+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:49.847885+0000","last_undegraded":"2023-10-25T16:14:49.847885+0000","last_fullsized":"2023-10-25T16:14:49.847885+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:01:09.446290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847402+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:49.847402+0000","last_peered":"2023-10-25T16:14:49.847402+0000","last_clean":"2023-10-25T16:14:49.847402+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:49.847402+0000","last_undegraded":"2023-10-25T16:14:49.847402+0000","last_fullsized":"2023-10-25T16:14:49.847402+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849508+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:49.849508+0000","last_peered":"2023-10-25T16:14:49.849508+0000","last_clean":"2023-10-25T16:14:49.849508+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:49.849508+0000","last_undegraded":"2023-10-25T16:14:49.849508+0000","last_fullsized":"2023-10-25T16:14:49.849508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985784+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:50.985784+0000","last_peered":"2023-10-25T16:14:50.985784+0000","last_clean":"2023-10-25T16:14:50.985784+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:50.985784+0000","last_undegraded":"2023-10-25T16:14:50.985784+0000","last_fullsized":"2023-10-25T16:14:50.985784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488979+0000","last_change":"2023-10-25T16:14:48.851029+0000","last_active":"2023-10-25T16:14:50.488979+0000","last_peered":"2023-10-25T16:14:50.488979+0000","last_clean":"2023-10-25T16:14:50.488979+0000","last_became_active":"2023-10-25T16:14:48.850613+0000","last_became_peered":"2023-10-25T16:14:48.850613+0000","last_unstale":"2023-10-25T16:14:50.488979+0000","last_undegraded":"2023-10-25T16:14:50.488979+0000","last_fullsized":"2023-10-25T16:14:50.488979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982779+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:50.982779+0000","last_peered":"2023-10-25T16:14:50.982779+0000","last_clean":"2023-10-25T16:14:50.982779+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:50.982779+0000","last_undegraded":"2023-10-25T16:14:50.982779+0000","last_fullsized":"2023-10-25T16:14:50.982779+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982568+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:50.982568+0000","last_peered":"2023-10-25T16:14:50.982568+0000","last_clean":"2023-10-25T16:14:50.982568+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:50.982568+0000","last_undegraded":"2023-10-25T16:14:50.982568+0000","last_fullsized":"2023-10-25T16:14:50.982568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986448+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:50.986448+0000","last_peered":"2023-10-25T16:14:50.986448+0000","last_clean":"2023-10-25T16:14:50.986448+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:50.986448+0000","last_undegraded":"2023-10-25T16:14:50.986448+0000","last_fullsized":"2023-10-25T16:14:50.986448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782075+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:50.782075+0000","last_peered":"2023-10-25T16:14:50.782075+0000","last_clean":"2023-10-25T16:14:50.782075+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:50.782075+0000","last_undegraded":"2023-10-25T16:14:50.782075+0000","last_fullsized":"2023-10-25T16:14:50.782075+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.187522+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:54.187522+0000","last_peered":"2023-10-25T16:14:54.187522+0000","last_clean":"2023-10-25T16:14:54.187522+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:54.187522+0000","last_undegraded":"2023-10-25T16:14:54.187522+0000","last_fullsized":"2023-10-25T16:14:54.187522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982639+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:50.982639+0000","last_peered":"2023-10-25T16:14:50.982639+0000","last_clean":"2023-10-25T16:14:50.982639+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:50.982639+0000","last_undegraded":"2023-10-25T16:14:50.982639+0000","last_fullsized":"2023-10-25T16:14:50.982639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985713+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:50.985713+0000","last_peered":"2023-10-25T16:14:50.985713+0000","last_clean":"2023-10-25T16:14:50.985713+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:50.985713+0000","last_undegraded":"2023-10-25T16:14:50.985713+0000","last_fullsized":"2023-10-25T16:14:50.985713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985476+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:50.985476+0000","last_peered":"2023-10-25T16:14:50.985476+0000","last_clean":"2023-10-25T16:14:50.985476+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:50.985476+0000","last_undegraded":"2023-10-25T16:14:50.985476+0000","last_fullsized":"2023-10-25T16:14:50.985476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849686+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:49.849686+0000","last_peered":"2023-10-25T16:14:49.849686+0000","last_clean":"2023-10-25T16:14:49.849686+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:49.849686+0000","last_undegraded":"2023-10-25T16:14:49.849686+0000","last_fullsized":"2023-10-25T16:14:49.849686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847558+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:49.847558+0000","last_peered":"2023-10-25T16:14:49.847558+0000","last_clean":"2023-10-25T16:14:49.847558+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:49.847558+0000","last_undegraded":"2023-10-25T16:14:49.847558+0000","last_fullsized":"2023-10-25T16:14:49.847558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:15:28.083843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986558+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:50.986558+0000","last_peered":"2023-10-25T16:14:50.986558+0000","last_clean":"2023-10-25T16:14:50.986558+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:50.986558+0000","last_undegraded":"2023-10-25T16:14:50.986558+0000","last_fullsized":"2023-10-25T16:14:50.986558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848409+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:49.848409+0000","last_peered":"2023-10-25T16:14:49.848409+0000","last_clean":"2023-10-25T16:14:49.848409+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:49.848409+0000","last_undegraded":"2023-10-25T16:14:49.848409+0000","last_fullsized":"2023-10-25T16:14:49.848409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:16:46.241055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603811+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:50.603811+0000","last_peered":"2023-10-25T16:14:50.603811+0000","last_clean":"2023-10-25T16:14:50.603811+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:50.603811+0000","last_undegraded":"2023-10-25T16:14:50.603811+0000","last_fullsized":"2023-10-25T16:14:50.603811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985313+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:50.985313+0000","last_peered":"2023-10-25T16:14:50.985313+0000","last_clean":"2023-10-25T16:14:50.985313+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:50.985313+0000","last_undegraded":"2023-10-25T16:14:50.985313+0000","last_fullsized":"2023-10-25T16:14:50.985313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849687+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:49.849687+0000","last_peered":"2023-10-25T16:14:49.849687+0000","last_clean":"2023-10-25T16:14:49.849687+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:49.849687+0000","last_undegraded":"2023-10-25T16:14:49.849687+0000","last_fullsized":"2023-10-25T16:14:49.849687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603551+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:50.603551+0000","last_peered":"2023-10-25T16:14:50.603551+0000","last_clean":"2023-10-25T16:14:50.603551+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:50.603551+0000","last_undegraded":"2023-10-25T16:14:50.603551+0000","last_fullsized":"2023-10-25T16:14:50.603551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982249+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:50.982249+0000","last_peered":"2023-10-25T16:14:50.982249+0000","last_clean":"2023-10-25T16:14:50.982249+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:50.982249+0000","last_undegraded":"2023-10-25T16:14:50.982249+0000","last_fullsized":"2023-10-25T16:14:50.982249+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981965+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:50.981965+0000","last_peered":"2023-10-25T16:14:50.981965+0000","last_clean":"2023-10-25T16:14:50.981965+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:50.981965+0000","last_undegraded":"2023-10-25T16:14:50.981965+0000","last_fullsized":"2023-10-25T16:14:50.981965+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987048+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:50.987048+0000","last_peered":"2023-10-25T16:14:50.987048+0000","last_clean":"2023-10-25T16:14:50.987048+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:50.987048+0000","last_undegraded":"2023-10-25T16:14:50.987048+0000","last_fullsized":"2023-10-25T16:14:50.987048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985945+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:50.985945+0000","last_peered":"2023-10-25T16:14:50.985945+0000","last_clean":"2023-10-25T16:14:50.985945+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:50.985945+0000","last_undegraded":"2023-10-25T16:14:50.985945+0000","last_fullsized":"2023-10-25T16:14:50.985945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79900000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.87}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.151},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.171}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.274},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.3080000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.94499999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.016},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.99199999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.625},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.056},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.874}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767828,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0269999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1819999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.127},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.88},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.095}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":1.052},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.95499999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.149},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.006},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.105}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.423},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.3939999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195078,"statfs":{"total":200000000,"available":199760863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.76700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.2949999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.173},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.248}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.82299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.321}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0169999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.046},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.1240000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.99399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.438},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82499999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.04}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.871},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.089},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194503,"statfs":{"total":200000000,"available":199172073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.95999999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.161}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90700000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.079},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.119}]}]}],"pool_statfs":[]}} 2023-10-25T16:14:57.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-10-25T16:14:57.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 49, 'state': 'peering', 'last_fresh': '2023-10-25T16:14:50.982345+0000', 'last_change': '2023-10-25T16:14:54.802095+0000', 'last_active': '2023-10-25T16:14:54.802095+0000', 'last_peered': '2023-10-25T16:14:50.982345+0000', 'last_clean': '2023-10-25T16:14:50.982345+0000', 'last_became_active': '2023-10-25T16:14:48.883224+0000', 'last_became_peered': '2023-10-25T16:14:48.883224+0000', 'last_unstale': '2023-10-25T16:14:50.982345+0000', 'last_undegraded': '2023-10-25T16:14:50.982345+0000', 'last_fullsized': '2023-10-25T16:14:50.982345+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 47, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:14:57.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-25T16:14:57.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 12, 'reported_epoch': 48, 'state': 'peering', 'last_fresh': '2023-10-25T16:14:50.781654+0000', 'last_change': '2023-10-25T16:14:54.585955+0000', 'last_active': '2023-10-25T16:14:54.585955+0000', 'last_peered': '2023-10-25T16:14:50.781654+0000', 'last_clean': '2023-10-25T16:14:50.781654+0000', 'last_became_active': '2023-10-25T16:14:48.884426+0000', 'last_became_peered': '2023-10-25T16:14:48.884426+0000', 'last_unstale': '2023-10-25T16:14:50.781654+0000', 'last_undegraded': '2023-10-25T16:14:50.781654+0000', 'last_fullsized': '2023-10-25T16:14:50.781654+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 47, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'last_clean_scrub_stamp': '2023-10-25T16:14:47.827119+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:14:57.078 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:14:57.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 -- 172.21.15.177:0/319967703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb406f570 msgr2=0x7f2eb40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/319967703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb406f570 0x7f2eb40af5d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009cb0 tx=0x7f2eac01ccb0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 -- 172.21.15.177:0/319967703 shutdown_connections 2023-10-25T16:14:57.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/319967703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb406f570 0x7f2eb40af5d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 -- 172.21.15.177:0/319967703 >> 172.21.15.177:0/319967703 conn(0x7f2eb40b2450 msgr2=0x7f2eb40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:57.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 -- 172.21.15.177:0/319967703 shutdown_connections 2023-10-25T16:14:57.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 -- 172.21.15.177:0/319967703 wait complete. 2023-10-25T16:14:57.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 Processor -- start 2023-10-25T16:14:57.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.231+0000 7f2eba3a5640 1 -- start start 2023-10-25T16:14:57.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eb406c160 0x7f2eb413cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eb406f570 0x7f2eb413b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 0x7f2eb40a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40a7880 con 0x7f2eb4140cf0 2023-10-25T16:14:57.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb413bda0 con 0x7f2eb406f570 2023-10-25T16:14:57.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40a6fe0 con 0x7f2eb406c160 2023-10-25T16:14:57.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 0x7f2eb40a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 0x7f2eb40a8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56396/0 (socket says 172.21.15.177:56396) 2023-10-25T16:14:57.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 -- 172.21.15.177:0/3830440325 learned_addr learned my addr 172.21.15.177:0/3830440325 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:57.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 -- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eb406c160 msgr2=0x7f2eb413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb3fff640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eb406c160 0x7f2eb413cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eb406c160 0x7f2eb413cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb37fe640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eb406f570 0x7f2eb413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 -- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eb406f570 msgr2=0x7f2eb413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eb406f570 0x7f2eb413b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 -- 172.21.15.177:0/3830440325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0098e0 con 0x7f2eb4140cf0 2023-10-25T16:14:57.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb8942640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 0x7f2eb40a8720 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0986a0 tx=0x7f2eac004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:57.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac003d90 con 0x7f2eb4140cf0 2023-10-25T16:14:57.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2eac004030 con 0x7f2eb4140cf0 2023-10-25T16:14:57.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb40a72c0 con 0x7f2eb4140cf0 2023-10-25T16:14:57.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac004400 con 0x7f2eb4140cf0 2023-10-25T16:14:57.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40a8290 con 0x7f2eb4140cf0 2023-10-25T16:14:57.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb404daf0 con 0x7f2eb4140cf0 2023-10-25T16:14:57.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2eac00a040 con 0x7f2eb4140cf0 2023-10-25T16:14:57.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb0ff9640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ea00664a0 0x7f2ea0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2eb40cc4e0 con 0x7f2eb4140cf0 2023-10-25T16:14:57.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb3fff640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ea00664a0 0x7f2ea0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.235+0000 7f2eb3fff640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ea00664a0 0x7f2ea0068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400a790 tx=0x7f2ea4008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:57.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.239+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2eac0ec420 con 0x7f2eb4140cf0 2023-10-25T16:14:57.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2eb404daf0 con 0x7f2eb4140cf0 2023-10-25T16:14:57.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eb0ff9640 1 -- 172.21.15.177:0/3830440325 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1425 (secure 0 0 0) 0x7f2eac0efa40 con 0x7f2eb4140cf0 2023-10-25T16:14:57.440 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:57.440 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":128,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":2993456,"bytes_avail":1597006544,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":19,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5859}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-10-25T16:14:38.636892+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:14:57.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ea00664a0 msgr2=0x7f2ea0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ea00664a0 0x7f2ea0068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400a790 tx=0x7f2ea4008040 comp rx=0 tx=0).stop 2023-10-25T16:14:57.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 msgr2=0x7f2eb40a8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 0x7f2eb40a8720 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0986a0 tx=0x7f2eac004f60 comp rx=0 tx=0).stop 2023-10-25T16:14:57.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 shutdown_connections 2023-10-25T16:14:57.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ea00664a0 0x7f2ea0068960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2eb4140cf0 0x7f2eb40a8720 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eb406f570 0x7f2eb413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 --2- 172.21.15.177:0/3830440325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eb406c160 0x7f2eb413cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 >> 172.21.15.177:0/3830440325 conn(0x7f2eb40b2450 msgr2=0x7f2eb40afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:57.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 shutdown_connections 2023-10-25T16:14:57.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.435+0000 7f2eba3a5640 1 -- 172.21.15.177:0/3830440325 wait complete. 2023-10-25T16:14:57.457 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:14:57.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:14:57.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 -- 172.21.15.177:0/540310521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc158030 msgr2=0x7efebc15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 --2- 172.21.15.177:0/540310521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc158030 0x7efebc15c810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009900 tx=0x7efeb801c800 comp rx=0 tx=0).stop 2023-10-25T16:14:57.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 -- 172.21.15.177:0/540310521 shutdown_connections 2023-10-25T16:14:57.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 --2- 172.21.15.177:0/540310521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efebc0cde10 0x7efebc0ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 --2- 172.21.15.177:0/540310521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc158030 0x7efebc15c810 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 -- 172.21.15.177:0/540310521 >> 172.21.15.177:0/540310521 conn(0x7efebc06a830 msgr2=0x7efebc06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:57.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 -- 172.21.15.177:0/540310521 shutdown_connections 2023-10-25T16:14:57.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 -- 172.21.15.177:0/540310521 wait complete. 2023-10-25T16:14:57.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 Processor -- start 2023-10-25T16:14:57.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.579+0000 7efec42fe640 1 -- start start 2023-10-25T16:14:57.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc0712a0 0x7efebc156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 0x7efebc156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efebc158030 0x7efebc1f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc1611d0 con 0x7efebc0cde10 2023-10-25T16:14:57.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc158870 con 0x7efebc0712a0 2023-10-25T16:14:57.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc157090 con 0x7efebc158030 2023-10-25T16:14:57.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 0x7efebc156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 0x7efebc156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56398/0 (socket says 172.21.15.177:56398) 2023-10-25T16:14:57.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 -- 172.21.15.177:0/1485899251 learned_addr learned my addr 172.21.15.177:0/1485899251 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:14:57.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec209a640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc0712a0 0x7efebc156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec289b640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efebc158030 0x7efebc1f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 -- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efebc158030 msgr2=0x7efebc1f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efebc158030 0x7efebc1f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 -- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc0712a0 msgr2=0x7efebc156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc0712a0 0x7efebc156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 -- 172.21.15.177:0/1485899251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8009560 con 0x7efebc0cde10 2023-10-25T16:14:57.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec1899640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 0x7efebc156b50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c420 tx=0x7efeac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:57.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0052d0 con 0x7efebc0cde10 2023-10-25T16:14:57.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efeac007020 con 0x7efebc0cde10 2023-10-25T16:14:57.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc157360 con 0x7efebc0cde10 2023-10-25T16:14:57.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac007430 con 0x7efebc0cde10 2023-10-25T16:14:57.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc161420 con 0x7efebc0cde10 2023-10-25T16:14:57.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc04daf0 con 0x7efebc0cde10 2023-10-25T16:14:57.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efeac0067e0 con 0x7efebc0cde10 2023-10-25T16:14:57.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efeb2ffd640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efea0066470 0x7efea0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:14:57.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efeac083550 con 0x7efebc0cde10 2023-10-25T16:14:57.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.583+0000 7efec209a640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efea0066470 0x7efea0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:14:57.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.587+0000 7efec209a640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efea0066470 0x7efea0068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efeb80af000 tx=0x7efeb801b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:14:57.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.587+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efeac0509a0 con 0x7efebc0cde10 2023-10-25T16:14:57.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.743+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efebc0cb360 con 0x7efea0066470 2023-10-25T16:14:57.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.763+0000 7efeb2ffd640 1 -- 172.21.15.177:0/1485899251 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283508 (secure 0 0 0) 0x7efebc0cb360 con 0x7efea0066470 2023-10-25T16:14:57.771 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:14:57.773 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:14:57.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efea0066470 msgr2=0x7efea0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efea0066470 0x7efea0068930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efeb80af000 tx=0x7efeb801b040 comp rx=0 tx=0).stop 2023-10-25T16:14:57.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 msgr2=0x7efebc156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:14:57.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 0x7efebc156b50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c420 tx=0x7efeac00c8e0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 shutdown_connections 2023-10-25T16:14:57.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efea0066470 0x7efea0068930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efebc158030 0x7efebc1f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efebc0cde10 0x7efebc156b50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 --2- 172.21.15.177:0/1485899251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efebc0712a0 0x7efebc156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:14:57.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 >> 172.21.15.177:0/1485899251 conn(0x7efebc06a830 msgr2=0x7efebc0b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:14:57.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 shutdown_connections 2023-10-25T16:14:57.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:14:57.767+0000 7efec42fe640 1 -- 172.21.15.177:0/1485899251 wait complete. 2023-10-25T16:14:57.789 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-25T16:14:56.642178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2978,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559521,"statfs":{"total":1600000000,"available":1596950394,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.790884"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985888+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:50.985888+0000","last_peered":"2023-10-25T16:14:50.985888+0000","last_clean":"2023-10-25T16:14:50.985888+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:50.985888+0000","last_undegraded":"2023-10-25T16:14:50.985888+0000","last_fullsized":"2023-10-25T16:14:50.985888+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986502+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:50.986502+0000","last_peered":"2023-10-25T16:14:50.986502+0000","last_clean":"2023-10-25T16:14:50.986502+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:50.986502+0000","last_undegraded":"2023-10-25T16:14:50.986502+0000","last_fullsized":"2023-10-25T16:14:50.986502+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603365+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:50.603365+0000","last_peered":"2023-10-25T16:14:50.603365+0000","last_clean":"2023-10-25T16:14:50.603365+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:50.603365+0000","last_undegraded":"2023-10-25T16:14:50.603365+0000","last_fullsized":"2023-10-25T16:14:50.603365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981881+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:50.981881+0000","last_peered":"2023-10-25T16:14:50.981881+0000","last_clean":"2023-10-25T16:14:50.981881+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:50.981881+0000","last_undegraded":"2023-10-25T16:14:50.981881+0000","last_fullsized":"2023-10-25T16:14:50.981881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986893+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:50.986893+0000","last_peered":"2023-10-25T16:14:50.986893+0000","last_clean":"2023-10-25T16:14:50.986893+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:50.986893+0000","last_undegraded":"2023-10-25T16:14:50.986893+0000","last_fullsized":"2023-10-25T16:14:50.986893+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847506+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:49.847506+0000","last_peered":"2023-10-25T16:14:49.847506+0000","last_clean":"2023-10-25T16:14:49.847506+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:49.847506+0000","last_undegraded":"2023-10-25T16:14:49.847506+0000","last_fullsized":"2023-10-25T16:14:49.847506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:26:12.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985267+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:50.985267+0000","last_peered":"2023-10-25T16:14:50.985267+0000","last_clean":"2023-10-25T16:14:50.985267+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:50.985267+0000","last_undegraded":"2023-10-25T16:14:50.985267+0000","last_fullsized":"2023-10-25T16:14:50.985267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981802+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:50.981802+0000","last_peered":"2023-10-25T16:14:50.981802+0000","last_clean":"2023-10-25T16:14:50.981802+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:50.981802+0000","last_undegraded":"2023-10-25T16:14:50.981802+0000","last_fullsized":"2023-10-25T16:14:50.981802+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982048+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:50.982048+0000","last_peered":"2023-10-25T16:14:50.982048+0000","last_clean":"2023-10-25T16:14:50.982048+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:50.982048+0000","last_undegraded":"2023-10-25T16:14:50.982048+0000","last_fullsized":"2023-10-25T16:14:50.982048+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982158+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:50.982158+0000","last_peered":"2023-10-25T16:14:50.982158+0000","last_clean":"2023-10-25T16:14:50.982158+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:50.982158+0000","last_undegraded":"2023-10-25T16:14:50.982158+0000","last_fullsized":"2023-10-25T16:14:50.982158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982000+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:50.982000+0000","last_peered":"2023-10-25T16:14:50.982000+0000","last_clean":"2023-10-25T16:14:50.982000+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:50.982000+0000","last_undegraded":"2023-10-25T16:14:50.982000+0000","last_fullsized":"2023-10-25T16:14:50.982000+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986804+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:50.986804+0000","last_peered":"2023-10-25T16:14:50.986804+0000","last_clean":"2023-10-25T16:14:50.986804+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:50.986804+0000","last_undegraded":"2023-10-25T16:14:50.986804+0000","last_fullsized":"2023-10-25T16:14:50.986804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488829+0000","last_change":"2023-10-25T16:14:48.877528+0000","last_active":"2023-10-25T16:14:50.488829+0000","last_peered":"2023-10-25T16:14:50.488829+0000","last_clean":"2023-10-25T16:14:50.488829+0000","last_became_active":"2023-10-25T16:14:48.876876+0000","last_became_peered":"2023-10-25T16:14:48.876876+0000","last_unstale":"2023-10-25T16:14:50.488829+0000","last_undegraded":"2023-10-25T16:14:50.488829+0000","last_fullsized":"2023-10-25T16:14:50.488829+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":2,"reported_epoch":49,"state":"peering","last_fresh":"2023-10-25T16:14:50.982345+0000","last_change":"2023-10-25T16:14:54.802095+0000","last_active":"2023-10-25T16:14:54.802095+0000","last_peered":"2023-10-25T16:14:50.982345+0000","last_clean":"2023-10-25T16:14:50.982345+0000","last_became_active":"2023-10-25T16:14:48.883224+0000","last_became_peered":"2023-10-25T16:14:48.883224+0000","last_unstale":"2023-10-25T16:14:50.982345+0000","last_undegraded":"2023-10-25T16:14:50.982345+0000","last_fullsized":"2023-10-25T16:14:50.982345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847013+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:49.847013+0000","last_peered":"2023-10-25T16:14:49.847013+0000","last_clean":"2023-10-25T16:14:49.847013+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:49.847013+0000","last_undegraded":"2023-10-25T16:14:49.847013+0000","last_fullsized":"2023-10-25T16:14:49.847013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:37:19.332657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"peering","last_fresh":"2023-10-25T16:14:50.781654+0000","last_change":"2023-10-25T16:14:54.585955+0000","last_active":"2023-10-25T16:14:54.585955+0000","last_peered":"2023-10-25T16:14:50.781654+0000","last_clean":"2023-10-25T16:14:50.781654+0000","last_became_active":"2023-10-25T16:14:48.884426+0000","last_became_peered":"2023-10-25T16:14:48.884426+0000","last_unstale":"2023-10-25T16:14:50.781654+0000","last_undegraded":"2023-10-25T16:14:50.781654+0000","last_fullsized":"2023-10-25T16:14:50.781654+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.602994+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:50.602994+0000","last_peered":"2023-10-25T16:14:50.602994+0000","last_clean":"2023-10-25T16:14:50.602994+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:50.602994+0000","last_undegraded":"2023-10-25T16:14:50.602994+0000","last_fullsized":"2023-10-25T16:14:50.602994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603730+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:50.603730+0000","last_peered":"2023-10-25T16:14:50.603730+0000","last_clean":"2023-10-25T16:14:50.603730+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:50.603730+0000","last_undegraded":"2023-10-25T16:14:50.603730+0000","last_fullsized":"2023-10-25T16:14:50.603730+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782351+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:50.782351+0000","last_peered":"2023-10-25T16:14:50.782351+0000","last_clean":"2023-10-25T16:14:50.782351+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:50.782351+0000","last_undegraded":"2023-10-25T16:14:50.782351+0000","last_fullsized":"2023-10-25T16:14:50.782351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488818+0000","last_change":"2023-10-25T16:14:48.868676+0000","last_active":"2023-10-25T16:14:50.488818+0000","last_peered":"2023-10-25T16:14:50.488818+0000","last_clean":"2023-10-25T16:14:50.488818+0000","last_became_active":"2023-10-25T16:14:48.868055+0000","last_became_peered":"2023-10-25T16:14:48.868055+0000","last_unstale":"2023-10-25T16:14:50.488818+0000","last_undegraded":"2023-10-25T16:14:50.488818+0000","last_fullsized":"2023-10-25T16:14:50.488818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847820+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:49.847820+0000","last_peered":"2023-10-25T16:14:49.847820+0000","last_clean":"2023-10-25T16:14:49.847820+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:49.847820+0000","last_undegraded":"2023-10-25T16:14:49.847820+0000","last_fullsized":"2023-10-25T16:14:49.847820+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:24:32.144529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982159+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:50.982159+0000","last_peered":"2023-10-25T16:14:50.982159+0000","last_clean":"2023-10-25T16:14:50.982159+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:50.982159+0000","last_undegraded":"2023-10-25T16:14:50.982159+0000","last_fullsized":"2023-10-25T16:14:50.982159+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782169+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:50.782169+0000","last_peered":"2023-10-25T16:14:50.782169+0000","last_clean":"2023-10-25T16:14:50.782169+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:50.782169+0000","last_undegraded":"2023-10-25T16:14:50.782169+0000","last_fullsized":"2023-10-25T16:14:50.782169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781336+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:50.781336+0000","last_peered":"2023-10-25T16:14:50.781336+0000","last_clean":"2023-10-25T16:14:50.781336+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:50.781336+0000","last_undegraded":"2023-10-25T16:14:50.781336+0000","last_fullsized":"2023-10-25T16:14:50.781336+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782378+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:50.782378+0000","last_peered":"2023-10-25T16:14:50.782378+0000","last_clean":"2023-10-25T16:14:50.782378+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:50.782378+0000","last_undegraded":"2023-10-25T16:14:50.782378+0000","last_fullsized":"2023-10-25T16:14:50.782378+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489168+0000","last_change":"2023-10-25T16:14:48.878231+0000","last_active":"2023-10-25T16:14:50.489168+0000","last_peered":"2023-10-25T16:14:50.489168+0000","last_clean":"2023-10-25T16:14:50.489168+0000","last_became_active":"2023-10-25T16:14:48.877966+0000","last_became_peered":"2023-10-25T16:14:48.877966+0000","last_unstale":"2023-10-25T16:14:50.489168+0000","last_undegraded":"2023-10-25T16:14:50.489168+0000","last_fullsized":"2023-10-25T16:14:50.489168+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603342+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:50.603342+0000","last_peered":"2023-10-25T16:14:50.603342+0000","last_clean":"2023-10-25T16:14:50.603342+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:50.603342+0000","last_undegraded":"2023-10-25T16:14:50.603342+0000","last_fullsized":"2023-10-25T16:14:50.603342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986250+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:50.986250+0000","last_peered":"2023-10-25T16:14:50.986250+0000","last_clean":"2023-10-25T16:14:50.986250+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:50.986250+0000","last_undegraded":"2023-10-25T16:14:50.986250+0000","last_fullsized":"2023-10-25T16:14:50.986250+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781635+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:50.781635+0000","last_peered":"2023-10-25T16:14:50.781635+0000","last_clean":"2023-10-25T16:14:50.781635+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:50.781635+0000","last_undegraded":"2023-10-25T16:14:50.781635+0000","last_fullsized":"2023-10-25T16:14:50.781635+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603394+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:50.603394+0000","last_peered":"2023-10-25T16:14:50.603394+0000","last_clean":"2023-10-25T16:14:50.603394+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:50.603394+0000","last_undegraded":"2023-10-25T16:14:50.603394+0000","last_fullsized":"2023-10-25T16:14:50.603394+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848120+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:49.848120+0000","last_peered":"2023-10-25T16:14:49.848120+0000","last_clean":"2023-10-25T16:14:49.848120+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:49.848120+0000","last_undegraded":"2023-10-25T16:14:49.848120+0000","last_fullsized":"2023-10-25T16:14:49.848120+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:10:53.111494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488720+0000","last_change":"2023-10-25T16:14:48.872434+0000","last_active":"2023-10-25T16:14:50.488720+0000","last_peered":"2023-10-25T16:14:50.488720+0000","last_clean":"2023-10-25T16:14:50.488720+0000","last_became_active":"2023-10-25T16:14:48.871802+0000","last_became_peered":"2023-10-25T16:14:48.871802+0000","last_unstale":"2023-10-25T16:14:50.488720+0000","last_undegraded":"2023-10-25T16:14:50.488720+0000","last_fullsized":"2023-10-25T16:14:50.488720+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849854+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:49.849854+0000","last_peered":"2023-10-25T16:14:49.849854+0000","last_clean":"2023-10-25T16:14:49.849854+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:49.849854+0000","last_undegraded":"2023-10-25T16:14:49.849854+0000","last_fullsized":"2023-10-25T16:14:49.849854+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847194+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:49.847194+0000","last_peered":"2023-10-25T16:14:49.847194+0000","last_clean":"2023-10-25T16:14:49.847194+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:49.847194+0000","last_undegraded":"2023-10-25T16:14:49.847194+0000","last_fullsized":"2023-10-25T16:14:49.847194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781848+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:50.781848+0000","last_peered":"2023-10-25T16:14:50.781848+0000","last_clean":"2023-10-25T16:14:50.781848+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:50.781848+0000","last_undegraded":"2023-10-25T16:14:50.781848+0000","last_fullsized":"2023-10-25T16:14:50.781848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.602864+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:50.602864+0000","last_peered":"2023-10-25T16:14:50.602864+0000","last_clean":"2023-10-25T16:14:50.602864+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:50.602864+0000","last_undegraded":"2023-10-25T16:14:50.602864+0000","last_fullsized":"2023-10-25T16:14:50.602864+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987151+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:50.987151+0000","last_peered":"2023-10-25T16:14:50.987151+0000","last_clean":"2023-10-25T16:14:50.987151+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:50.987151+0000","last_undegraded":"2023-10-25T16:14:50.987151+0000","last_fullsized":"2023-10-25T16:14:50.987151+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849630+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:49.849630+0000","last_peered":"2023-10-25T16:14:49.849630+0000","last_clean":"2023-10-25T16:14:49.849630+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:49.849630+0000","last_undegraded":"2023-10-25T16:14:49.849630+0000","last_fullsized":"2023-10-25T16:14:49.849630+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849522+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:49.849522+0000","last_peered":"2023-10-25T16:14:49.849522+0000","last_clean":"2023-10-25T16:14:49.849522+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:49.849522+0000","last_undegraded":"2023-10-25T16:14:49.849522+0000","last_fullsized":"2023-10-25T16:14:49.849522+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986223+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:50.986223+0000","last_peered":"2023-10-25T16:14:50.986223+0000","last_clean":"2023-10-25T16:14:50.986223+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:50.986223+0000","last_undegraded":"2023-10-25T16:14:50.986223+0000","last_fullsized":"2023-10-25T16:14:50.986223+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603171+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:50.603171+0000","last_peered":"2023-10-25T16:14:50.603171+0000","last_clean":"2023-10-25T16:14:50.603171+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:50.603171+0000","last_undegraded":"2023-10-25T16:14:50.603171+0000","last_fullsized":"2023-10-25T16:14:50.603171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847811+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:49.847811+0000","last_peered":"2023-10-25T16:14:49.847811+0000","last_clean":"2023-10-25T16:14:49.847811+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:49.847811+0000","last_undegraded":"2023-10-25T16:14:49.847811+0000","last_fullsized":"2023-10-25T16:14:49.847811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982345+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:50.982345+0000","last_peered":"2023-10-25T16:14:50.982345+0000","last_clean":"2023-10-25T16:14:50.982345+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:50.982345+0000","last_undegraded":"2023-10-25T16:14:50.982345+0000","last_fullsized":"2023-10-25T16:14:50.982345+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603854+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:50.603854+0000","last_peered":"2023-10-25T16:14:50.603854+0000","last_clean":"2023-10-25T16:14:50.603854+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:50.603854+0000","last_undegraded":"2023-10-25T16:14:50.603854+0000","last_fullsized":"2023-10-25T16:14:50.603854+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982344+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:50.982344+0000","last_peered":"2023-10-25T16:14:50.982344+0000","last_clean":"2023-10-25T16:14:50.982344+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:50.982344+0000","last_undegraded":"2023-10-25T16:14:50.982344+0000","last_fullsized":"2023-10-25T16:14:50.982344+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985543+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:50.985543+0000","last_peered":"2023-10-25T16:14:50.985543+0000","last_clean":"2023-10-25T16:14:50.985543+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:50.985543+0000","last_undegraded":"2023-10-25T16:14:50.985543+0000","last_fullsized":"2023-10-25T16:14:50.985543+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781989+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:50.781989+0000","last_peered":"2023-10-25T16:14:50.781989+0000","last_clean":"2023-10-25T16:14:50.781989+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:50.781989+0000","last_undegraded":"2023-10-25T16:14:50.781989+0000","last_fullsized":"2023-10-25T16:14:50.781989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982731+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:50.982731+0000","last_peered":"2023-10-25T16:14:50.982731+0000","last_clean":"2023-10-25T16:14:50.982731+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:50.982731+0000","last_undegraded":"2023-10-25T16:14:50.982731+0000","last_fullsized":"2023-10-25T16:14:50.982731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603681+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:50.603681+0000","last_peered":"2023-10-25T16:14:50.603681+0000","last_clean":"2023-10-25T16:14:50.603681+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:50.603681+0000","last_undegraded":"2023-10-25T16:14:50.603681+0000","last_fullsized":"2023-10-25T16:14:50.603681+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603067+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:50.603067+0000","last_peered":"2023-10-25T16:14:50.603067+0000","last_clean":"2023-10-25T16:14:50.603067+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:50.603067+0000","last_undegraded":"2023-10-25T16:14:50.603067+0000","last_fullsized":"2023-10-25T16:14:50.603067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986090+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:50.986090+0000","last_peered":"2023-10-25T16:14:50.986090+0000","last_clean":"2023-10-25T16:14:50.986090+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:50.986090+0000","last_undegraded":"2023-10-25T16:14:50.986090+0000","last_fullsized":"2023-10-25T16:14:50.986090+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:02.408430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982451+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:50.982451+0000","last_peered":"2023-10-25T16:14:50.982451+0000","last_clean":"2023-10-25T16:14:50.982451+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:50.982451+0000","last_undegraded":"2023-10-25T16:14:50.982451+0000","last_fullsized":"2023-10-25T16:14:50.982451+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847559+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:49.847559+0000","last_peered":"2023-10-25T16:14:49.847559+0000","last_clean":"2023-10-25T16:14:49.847559+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:49.847559+0000","last_undegraded":"2023-10-25T16:14:49.847559+0000","last_fullsized":"2023-10-25T16:14:49.847559+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:41.615017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986669+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:50.986669+0000","last_peered":"2023-10-25T16:14:50.986669+0000","last_clean":"2023-10-25T16:14:50.986669+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:50.986669+0000","last_undegraded":"2023-10-25T16:14:50.986669+0000","last_fullsized":"2023-10-25T16:14:50.986669+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986422+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:50.986422+0000","last_peered":"2023-10-25T16:14:50.986422+0000","last_clean":"2023-10-25T16:14:50.986422+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:50.986422+0000","last_undegraded":"2023-10-25T16:14:50.986422+0000","last_fullsized":"2023-10-25T16:14:50.986422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:23.653548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488734+0000","last_change":"2023-10-25T16:14:47.868446+0000","last_active":"2023-10-25T16:14:50.488734+0000","last_peered":"2023-10-25T16:14:50.488734+0000","last_clean":"2023-10-25T16:14:50.488734+0000","last_became_active":"2023-10-25T16:14:47.868199+0000","last_became_peered":"2023-10-25T16:14:47.868199+0000","last_unstale":"2023-10-25T16:14:50.488734+0000","last_undegraded":"2023-10-25T16:14:50.488734+0000","last_fullsized":"2023-10-25T16:14:50.488734+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:20:05.028912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782046+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:50.782046+0000","last_peered":"2023-10-25T16:14:50.782046+0000","last_clean":"2023-10-25T16:14:50.782046+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:50.782046+0000","last_undegraded":"2023-10-25T16:14:50.782046+0000","last_fullsized":"2023-10-25T16:14:50.782046+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847195+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:49.847195+0000","last_peered":"2023-10-25T16:14:49.847195+0000","last_clean":"2023-10-25T16:14:49.847195+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:49.847195+0000","last_undegraded":"2023-10-25T16:14:49.847195+0000","last_fullsized":"2023-10-25T16:14:49.847195+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982492+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:50.982492+0000","last_peered":"2023-10-25T16:14:50.982492+0000","last_clean":"2023-10-25T16:14:50.982492+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:50.982492+0000","last_undegraded":"2023-10-25T16:14:50.982492+0000","last_fullsized":"2023-10-25T16:14:50.982492+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986336+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:50.986336+0000","last_peered":"2023-10-25T16:14:50.986336+0000","last_clean":"2023-10-25T16:14:50.986336+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:50.986336+0000","last_undegraded":"2023-10-25T16:14:50.986336+0000","last_fullsized":"2023-10-25T16:14:50.986336+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847014+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:49.847014+0000","last_peered":"2023-10-25T16:14:49.847014+0000","last_clean":"2023-10-25T16:14:49.847014+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:49.847014+0000","last_undegraded":"2023-10-25T16:14:49.847014+0000","last_fullsized":"2023-10-25T16:14:49.847014+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:29:12.879767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847986+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:49.847986+0000","last_peered":"2023-10-25T16:14:49.847986+0000","last_clean":"2023-10-25T16:14:49.847986+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:49.847986+0000","last_undegraded":"2023-10-25T16:14:49.847986+0000","last_fullsized":"2023-10-25T16:14:49.847986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985602+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:50.985602+0000","last_peered":"2023-10-25T16:14:50.985602+0000","last_clean":"2023-10-25T16:14:50.985602+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:50.985602+0000","last_undegraded":"2023-10-25T16:14:50.985602+0000","last_fullsized":"2023-10-25T16:14:50.985602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":21,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982111+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:50.982111+0000","last_peered":"2023-10-25T16:14:50.982111+0000","last_clean":"2023-10-25T16:14:50.982111+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:50.982111+0000","last_undegraded":"2023-10-25T16:14:50.982111+0000","last_fullsized":"2023-10-25T16:14:50.982111+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.489135+0000","last_change":"2023-10-25T16:14:48.865059+0000","last_active":"2023-10-25T16:14:50.489135+0000","last_peered":"2023-10-25T16:14:50.489135+0000","last_clean":"2023-10-25T16:14:50.489135+0000","last_became_active":"2023-10-25T16:14:48.864397+0000","last_became_peered":"2023-10-25T16:14:48.864397+0000","last_unstale":"2023-10-25T16:14:50.489135+0000","last_undegraded":"2023-10-25T16:14:50.489135+0000","last_fullsized":"2023-10-25T16:14:50.489135+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488952+0000","last_change":"2023-10-25T16:14:47.853938+0000","last_active":"2023-10-25T16:14:50.488952+0000","last_peered":"2023-10-25T16:14:50.488952+0000","last_clean":"2023-10-25T16:14:50.488952+0000","last_became_active":"2023-10-25T16:14:47.853677+0000","last_became_peered":"2023-10-25T16:14:47.853677+0000","last_unstale":"2023-10-25T16:14:50.488952+0000","last_undegraded":"2023-10-25T16:14:50.488952+0000","last_fullsized":"2023-10-25T16:14:50.488952+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:58.445296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982190+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:50.982190+0000","last_peered":"2023-10-25T16:14:50.982190+0000","last_clean":"2023-10-25T16:14:50.982190+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:50.982190+0000","last_undegraded":"2023-10-25T16:14:50.982190+0000","last_fullsized":"2023-10-25T16:14:50.982190+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603616+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:50.603616+0000","last_peered":"2023-10-25T16:14:50.603616+0000","last_clean":"2023-10-25T16:14:50.603616+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:50.603616+0000","last_undegraded":"2023-10-25T16:14:50.603616+0000","last_fullsized":"2023-10-25T16:14:50.603616+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.781860+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:50.781860+0000","last_peered":"2023-10-25T16:14:50.781860+0000","last_clean":"2023-10-25T16:14:50.781860+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:50.781860+0000","last_undegraded":"2023-10-25T16:14:50.781860+0000","last_fullsized":"2023-10-25T16:14:50.781860+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987377+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:50.987377+0000","last_peered":"2023-10-25T16:14:50.987377+0000","last_clean":"2023-10-25T16:14:50.987377+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:50.987377+0000","last_undegraded":"2023-10-25T16:14:50.987377+0000","last_fullsized":"2023-10-25T16:14:50.987377+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782396+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:50.782396+0000","last_peered":"2023-10-25T16:14:50.782396+0000","last_clean":"2023-10-25T16:14:50.782396+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:50.782396+0000","last_undegraded":"2023-10-25T16:14:50.782396+0000","last_fullsized":"2023-10-25T16:14:50.782396+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848087+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:49.848087+0000","last_peered":"2023-10-25T16:14:49.848087+0000","last_clean":"2023-10-25T16:14:49.848087+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:49.848087+0000","last_undegraded":"2023-10-25T16:14:49.848087+0000","last_fullsized":"2023-10-25T16:14:49.848087+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847885+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:49.847885+0000","last_peered":"2023-10-25T16:14:49.847885+0000","last_clean":"2023-10-25T16:14:49.847885+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:49.847885+0000","last_undegraded":"2023-10-25T16:14:49.847885+0000","last_fullsized":"2023-10-25T16:14:49.847885+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:01:09.446290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847402+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:49.847402+0000","last_peered":"2023-10-25T16:14:49.847402+0000","last_clean":"2023-10-25T16:14:49.847402+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:49.847402+0000","last_undegraded":"2023-10-25T16:14:49.847402+0000","last_fullsized":"2023-10-25T16:14:49.847402+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849508+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:49.849508+0000","last_peered":"2023-10-25T16:14:49.849508+0000","last_clean":"2023-10-25T16:14:49.849508+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:49.849508+0000","last_undegraded":"2023-10-25T16:14:49.849508+0000","last_fullsized":"2023-10-25T16:14:49.849508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985784+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:50.985784+0000","last_peered":"2023-10-25T16:14:50.985784+0000","last_clean":"2023-10-25T16:14:50.985784+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:50.985784+0000","last_undegraded":"2023-10-25T16:14:50.985784+0000","last_fullsized":"2023-10-25T16:14:50.985784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.488979+0000","last_change":"2023-10-25T16:14:48.851029+0000","last_active":"2023-10-25T16:14:50.488979+0000","last_peered":"2023-10-25T16:14:50.488979+0000","last_clean":"2023-10-25T16:14:50.488979+0000","last_became_active":"2023-10-25T16:14:48.850613+0000","last_became_peered":"2023-10-25T16:14:48.850613+0000","last_unstale":"2023-10-25T16:14:50.488979+0000","last_undegraded":"2023-10-25T16:14:50.488979+0000","last_fullsized":"2023-10-25T16:14:50.488979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982779+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:50.982779+0000","last_peered":"2023-10-25T16:14:50.982779+0000","last_clean":"2023-10-25T16:14:50.982779+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:50.982779+0000","last_undegraded":"2023-10-25T16:14:50.982779+0000","last_fullsized":"2023-10-25T16:14:50.982779+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982568+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:50.982568+0000","last_peered":"2023-10-25T16:14:50.982568+0000","last_clean":"2023-10-25T16:14:50.982568+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:50.982568+0000","last_undegraded":"2023-10-25T16:14:50.982568+0000","last_fullsized":"2023-10-25T16:14:50.982568+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986448+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:50.986448+0000","last_peered":"2023-10-25T16:14:50.986448+0000","last_clean":"2023-10-25T16:14:50.986448+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:50.986448+0000","last_undegraded":"2023-10-25T16:14:50.986448+0000","last_fullsized":"2023-10-25T16:14:50.986448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.782075+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:50.782075+0000","last_peered":"2023-10-25T16:14:50.782075+0000","last_clean":"2023-10-25T16:14:50.782075+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:50.782075+0000","last_undegraded":"2023-10-25T16:14:50.782075+0000","last_fullsized":"2023-10-25T16:14:50.782075+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.187522+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:54.187522+0000","last_peered":"2023-10-25T16:14:54.187522+0000","last_clean":"2023-10-25T16:14:54.187522+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:54.187522+0000","last_undegraded":"2023-10-25T16:14:54.187522+0000","last_fullsized":"2023-10-25T16:14:54.187522+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982639+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:50.982639+0000","last_peered":"2023-10-25T16:14:50.982639+0000","last_clean":"2023-10-25T16:14:50.982639+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:50.982639+0000","last_undegraded":"2023-10-25T16:14:50.982639+0000","last_fullsized":"2023-10-25T16:14:50.982639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985713+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:50.985713+0000","last_peered":"2023-10-25T16:14:50.985713+0000","last_clean":"2023-10-25T16:14:50.985713+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:50.985713+0000","last_undegraded":"2023-10-25T16:14:50.985713+0000","last_fullsized":"2023-10-25T16:14:50.985713+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985476+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:50.985476+0000","last_peered":"2023-10-25T16:14:50.985476+0000","last_clean":"2023-10-25T16:14:50.985476+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:50.985476+0000","last_undegraded":"2023-10-25T16:14:50.985476+0000","last_fullsized":"2023-10-25T16:14:50.985476+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849686+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:49.849686+0000","last_peered":"2023-10-25T16:14:49.849686+0000","last_clean":"2023-10-25T16:14:49.849686+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:49.849686+0000","last_undegraded":"2023-10-25T16:14:49.849686+0000","last_fullsized":"2023-10-25T16:14:49.849686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.847558+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:49.847558+0000","last_peered":"2023-10-25T16:14:49.847558+0000","last_clean":"2023-10-25T16:14:49.847558+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:49.847558+0000","last_undegraded":"2023-10-25T16:14:49.847558+0000","last_fullsized":"2023-10-25T16:14:49.847558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:15:28.083843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.986558+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:50.986558+0000","last_peered":"2023-10-25T16:14:50.986558+0000","last_clean":"2023-10-25T16:14:50.986558+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:50.986558+0000","last_undegraded":"2023-10-25T16:14:50.986558+0000","last_fullsized":"2023-10-25T16:14:50.986558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.848409+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:49.848409+0000","last_peered":"2023-10-25T16:14:49.848409+0000","last_clean":"2023-10-25T16:14:49.848409+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:49.848409+0000","last_undegraded":"2023-10-25T16:14:49.848409+0000","last_fullsized":"2023-10-25T16:14:49.848409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:16:46.241055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603811+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:50.603811+0000","last_peered":"2023-10-25T16:14:50.603811+0000","last_clean":"2023-10-25T16:14:50.603811+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:50.603811+0000","last_undegraded":"2023-10-25T16:14:50.603811+0000","last_fullsized":"2023-10-25T16:14:50.603811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985313+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:50.985313+0000","last_peered":"2023-10-25T16:14:50.985313+0000","last_clean":"2023-10-25T16:14:50.985313+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:50.985313+0000","last_undegraded":"2023-10-25T16:14:50.985313+0000","last_fullsized":"2023-10-25T16:14:50.985313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:49.849687+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:49.849687+0000","last_peered":"2023-10-25T16:14:49.849687+0000","last_clean":"2023-10-25T16:14:49.849687+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:49.849687+0000","last_undegraded":"2023-10-25T16:14:49.849687+0000","last_fullsized":"2023-10-25T16:14:49.849687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.603551+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:50.603551+0000","last_peered":"2023-10-25T16:14:50.603551+0000","last_clean":"2023-10-25T16:14:50.603551+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:50.603551+0000","last_undegraded":"2023-10-25T16:14:50.603551+0000","last_fullsized":"2023-10-25T16:14:50.603551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.982249+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:50.982249+0000","last_peered":"2023-10-25T16:14:50.982249+0000","last_clean":"2023-10-25T16:14:50.982249+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:50.982249+0000","last_undegraded":"2023-10-25T16:14:50.982249+0000","last_fullsized":"2023-10-25T16:14:50.982249+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.981965+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:50.981965+0000","last_peered":"2023-10-25T16:14:50.981965+0000","last_clean":"2023-10-25T16:14:50.981965+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:50.981965+0000","last_undegraded":"2023-10-25T16:14:50.981965+0000","last_fullsized":"2023-10-25T16:14:50.981965+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.987048+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:50.987048+0000","last_peered":"2023-10-25T16:14:50.987048+0000","last_clean":"2023-10-25T16:14:50.987048+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:50.987048+0000","last_undegraded":"2023-10-25T16:14:50.987048+0000","last_fullsized":"2023-10-25T16:14:50.987048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-25T16:14:50.985945+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:50.985945+0000","last_peered":"2023-10-25T16:14:50.985945+0000","last_clean":"2023-10-25T16:14:50.985945+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:50.985945+0000","last_undegraded":"2023-10-25T16:14:50.985945+0000","last_fullsized":"2023-10-25T16:14:50.985945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766866,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67800000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79900000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.87}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.151},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.171}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.028},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.274},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.3080000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199178042,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.94499999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.016},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.99199999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.625},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:13:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.056},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.874}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767828,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0269999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":1.1819999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.96699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.127},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.88},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.095}]},{"osd":7,"last update":"Wed Oct 25 16:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.0569999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":1.052},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":0.95499999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.149},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":1.006},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.2709999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.105}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.423},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.3939999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195078,"statfs":{"total":200000000,"available":199760863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.76700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.2949999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.173},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":1.2150000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.248}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.82299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.321}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767862,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.76600000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0169999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.046},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.1240000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.99399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768430,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.438},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.82499999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.04}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.871},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.089},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":808,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194503,"statfs":{"total":200000000,"available":199172073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.95999999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.2320000000000002,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.78500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":4.1219999999999999,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.161}]},{"osd":4,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":3.4510000000000001,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.5430000000000001,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.93600000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.1349999999999998,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.90700000000000003}]},{"osd":7,"last update":"Wed Oct 25 16:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":11.891999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.079},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":11.622,"5min":11.622,"15min":11.622},"last":1.119}]}]}],"pool_statfs":[]}} 2023-10-25T16:15:00.260 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:15:00.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:15:00.796 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:15:00.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 -- 172.21.15.177:0/1870368644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815c760 msgr2=0x7fbf8806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:00.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 --2- 172.21.15.177:0/1870368644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815c760 0x7fbf8806b9e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbf880afcf0 tx=0x7fbf8001cd30 comp rx=0 tx=0).stop 2023-10-25T16:15:00.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 -- 172.21.15.177:0/1870368644 shutdown_connections 2023-10-25T16:15:00.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 --2- 172.21.15.177:0/1870368644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815c760 0x7fbf8806b9e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:00.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 --2- 172.21.15.177:0/1870368644 >> v2:172.21.15.184:3300/0 conn(0x7fbf8815b7e0 0x7fbf8815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:00.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 --2- 172.21.15.177:0/1870368644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf8815b400 0x7fbf8815f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:00.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 -- 172.21.15.177:0/1870368644 >> 172.21.15.177:0/1870368644 conn(0x7fbf880b2450 msgr2=0x7fbf880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:00.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 -- 172.21.15.177:0/1870368644 shutdown_connections 2023-10-25T16:15:00.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.931+0000 7fbf90538640 1 -- 172.21.15.177:0/1870368644 wait complete. 2023-10-25T16:15:00.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 Processor -- start 2023-10-25T16:15:00.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- start start 2023-10-25T16:15:00.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 0x7fbf881600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:00.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf8815b7e0 0x7fbf88146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:00.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8815c760 0x7fbf88155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:00.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf881555f0 con 0x7fbf8815b400 2023-10-25T16:15:00.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88154d30 con 0x7fbf8815c760 2023-10-25T16:15:00.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88155fc0 con 0x7fbf8815b7e0 2023-10-25T16:15:00.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 0x7fbf881600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:00.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 0x7fbf881600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46246/0 (socket says 172.21.15.177:46246) 2023-10-25T16:15:00.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 -- 172.21.15.177:0/3401335243 learned_addr learned my addr 172.21.15.177:0/3401335243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:00.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8dad3640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf8815b7e0 0x7fbf88146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:00.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8ead5640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8815c760 0x7fbf88155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:00.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 -- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf8815b7e0 msgr2=0x7fbf88146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:00.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf8815b7e0 0x7fbf88146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:00.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 -- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8815c760 msgr2=0x7fbf88155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:00.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8815c760 0x7fbf88155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:00.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 -- 172.21.15.177:0/3401335243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800098e0 con 0x7fbf8815b400 2023-10-25T16:15:00.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8ead5640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8815c760 0x7fbf88155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:00.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf8e2d4640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 0x7fbf881600d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c9a0 tx=0x7fbf8400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:00.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84007c70 con 0x7fbf8815b400 2023-10-25T16:15:00.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf8400f450 con 0x7fbf8815b400 2023-10-25T16:15:00.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf88146ce0 con 0x7fbf8815b400 2023-10-25T16:15:00.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400f860 con 0x7fbf8815b400 2023-10-25T16:15:00.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf88154fa0 con 0x7fbf8815b400 2023-10-25T16:15:00.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.935+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8804daf0 con 0x7fbf8815b400 2023-10-25T16:15:00.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.939+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf8400f9c0 con 0x7fbf8815b400 2023-10-25T16:15:00.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.939+0000 7fbf7effd640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf6c066470 0x7fbf6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:00.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.939+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbf84084760 con 0x7fbf8815b400 2023-10-25T16:15:00.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.939+0000 7fbf8dad3640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf6c066470 0x7fbf6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:00.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.939+0000 7fbf8dad3640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf6c066470 0x7fbf6c068930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf88160610 tx=0x7fbf78008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:00.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:00.943+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf84051c30 con 0x7fbf8815b400 2023-10-25T16:15:01.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.087+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf88161480 con 0x7fbf6c066470 2023-10-25T16:15:01.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.111+0000 7fbf7effd640 1 -- 172.21.15.177:0/3401335243 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283486 (secure 0 0 0) 0x7fbf88161480 con 0x7fbf6c066470 2023-10-25T16:15:01.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:01.119 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:15:01.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf6c066470 msgr2=0x7fbf6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf6c066470 0x7fbf6c068930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf88160610 tx=0x7fbf78008040 comp rx=0 tx=0).stop 2023-10-25T16:15:01.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 msgr2=0x7fbf881600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 0x7fbf881600d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c9a0 tx=0x7fbf8400ce60 comp rx=0 tx=0).stop 2023-10-25T16:15:01.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 shutdown_connections 2023-10-25T16:15:01.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf6c066470 0x7fbf6c068930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf8815c760 0x7fbf88155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf8815b7e0 0x7fbf88146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 --2- 172.21.15.177:0/3401335243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf8815b400 0x7fbf881600d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 >> 172.21.15.177:0/3401335243 conn(0x7fbf880b2450 msgr2=0x7fbf8815dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:01.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 shutdown_connections 2023-10-25T16:15:01.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.115+0000 7fbf90538640 1 -- 172.21.15.177:0/3401335243 wait complete. 2023-10-25T16:15:01.134 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-10-25T16:15:00.643405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559439,"statfs":{"total":1600000000,"available":1596865916,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002418"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604405+0000","last_change":"2023-10-25T16:14:48.861929+0000","last_active":"2023-10-25T16:14:54.604405+0000","last_peered":"2023-10-25T16:14:54.604405+0000","last_clean":"2023-10-25T16:14:54.604405+0000","last_became_active":"2023-10-25T16:14:48.859158+0000","last_became_peered":"2023-10-25T16:14:48.859158+0000","last_unstale":"2023-10-25T16:14:54.604405+0000","last_undegraded":"2023-10-25T16:14:54.604405+0000","last_fullsized":"2023-10-25T16:14:54.604405+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.588626+0000","last_change":"2023-10-25T16:14:48.886745+0000","last_active":"2023-10-25T16:14:54.588626+0000","last_peered":"2023-10-25T16:14:54.588626+0000","last_clean":"2023-10-25T16:14:54.588626+0000","last_became_active":"2023-10-25T16:14:48.886566+0000","last_became_peered":"2023-10-25T16:14:48.886566+0000","last_unstale":"2023-10-25T16:14:54.588626+0000","last_undegraded":"2023-10-25T16:14:54.588626+0000","last_fullsized":"2023-10-25T16:14:54.588626+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.590984+0000","last_change":"2023-10-25T16:14:48.879790+0000","last_active":"2023-10-25T16:14:54.590984+0000","last_peered":"2023-10-25T16:14:54.590984+0000","last_clean":"2023-10-25T16:14:54.590984+0000","last_became_active":"2023-10-25T16:14:48.879387+0000","last_became_peered":"2023-10-25T16:14:48.879387+0000","last_unstale":"2023-10-25T16:14:54.590984+0000","last_undegraded":"2023-10-25T16:14:54.590984+0000","last_fullsized":"2023-10-25T16:14:54.590984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.579723+0000","last_change":"2023-10-25T16:14:48.867899+0000","last_active":"2023-10-25T16:14:54.579723+0000","last_peered":"2023-10-25T16:14:54.579723+0000","last_clean":"2023-10-25T16:14:54.579723+0000","last_became_active":"2023-10-25T16:14:48.867288+0000","last_became_peered":"2023-10-25T16:14:48.867288+0000","last_unstale":"2023-10-25T16:14:54.579723+0000","last_undegraded":"2023-10-25T16:14:54.579723+0000","last_fullsized":"2023-10-25T16:14:54.579723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:31.361132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586953+0000","last_change":"2023-10-25T16:14:48.869692+0000","last_active":"2023-10-25T16:14:54.586953+0000","last_peered":"2023-10-25T16:14:54.586953+0000","last_clean":"2023-10-25T16:14:54.586953+0000","last_became_active":"2023-10-25T16:14:48.869404+0000","last_became_peered":"2023-10-25T16:14:48.869404+0000","last_unstale":"2023-10-25T16:14:54.586953+0000","last_undegraded":"2023-10-25T16:14:54.586953+0000","last_fullsized":"2023-10-25T16:14:54.586953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602418+0000","last_change":"2023-10-25T16:14:48.873636+0000","last_active":"2023-10-25T16:14:54.602418+0000","last_peered":"2023-10-25T16:14:54.602418+0000","last_clean":"2023-10-25T16:14:54.602418+0000","last_became_active":"2023-10-25T16:14:48.873116+0000","last_became_peered":"2023-10-25T16:14:48.873116+0000","last_unstale":"2023-10-25T16:14:54.602418+0000","last_undegraded":"2023-10-25T16:14:54.602418+0000","last_fullsized":"2023-10-25T16:14:54.602418+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:26:12.884962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604170+0000","last_change":"2023-10-25T16:14:48.876596+0000","last_active":"2023-10-25T16:14:54.604170+0000","last_peered":"2023-10-25T16:14:54.604170+0000","last_clean":"2023-10-25T16:14:54.604170+0000","last_became_active":"2023-10-25T16:14:48.876333+0000","last_became_peered":"2023-10-25T16:14:48.876333+0000","last_unstale":"2023-10-25T16:14:54.604170+0000","last_undegraded":"2023-10-25T16:14:54.604170+0000","last_fullsized":"2023-10-25T16:14:54.604170+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.579829+0000","last_change":"2023-10-25T16:14:48.862438+0000","last_active":"2023-10-25T16:14:54.579829+0000","last_peered":"2023-10-25T16:14:54.579829+0000","last_clean":"2023-10-25T16:14:54.579829+0000","last_became_active":"2023-10-25T16:14:48.862108+0000","last_became_peered":"2023-10-25T16:14:48.862108+0000","last_unstale":"2023-10-25T16:14:54.579829+0000","last_undegraded":"2023-10-25T16:14:54.579829+0000","last_fullsized":"2023-10-25T16:14:54.579829+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.579946+0000","last_change":"2023-10-25T16:14:48.883502+0000","last_active":"2023-10-25T16:14:54.579946+0000","last_peered":"2023-10-25T16:14:54.579946+0000","last_clean":"2023-10-25T16:14:54.579946+0000","last_became_active":"2023-10-25T16:14:48.882925+0000","last_became_peered":"2023-10-25T16:14:48.882925+0000","last_unstale":"2023-10-25T16:14:54.579946+0000","last_undegraded":"2023-10-25T16:14:54.579946+0000","last_fullsized":"2023-10-25T16:14:54.579946+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580399+0000","last_change":"2023-10-25T16:14:48.864415+0000","last_active":"2023-10-25T16:14:54.580399+0000","last_peered":"2023-10-25T16:14:54.580399+0000","last_clean":"2023-10-25T16:14:54.580399+0000","last_became_active":"2023-10-25T16:14:48.863970+0000","last_became_peered":"2023-10-25T16:14:48.863970+0000","last_unstale":"2023-10-25T16:14:54.580399+0000","last_undegraded":"2023-10-25T16:14:54.580399+0000","last_fullsized":"2023-10-25T16:14:54.580399+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.581267+0000","last_change":"2023-10-25T16:14:48.882100+0000","last_active":"2023-10-25T16:14:54.581267+0000","last_peered":"2023-10-25T16:14:54.581267+0000","last_clean":"2023-10-25T16:14:54.581267+0000","last_became_active":"2023-10-25T16:14:48.881395+0000","last_became_peered":"2023-10-25T16:14:48.881395+0000","last_unstale":"2023-10-25T16:14:54.581267+0000","last_undegraded":"2023-10-25T16:14:54.581267+0000","last_fullsized":"2023-10-25T16:14:54.581267+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.588821+0000","last_change":"2023-10-25T16:14:48.881528+0000","last_active":"2023-10-25T16:14:54.588821+0000","last_peered":"2023-10-25T16:14:54.588821+0000","last_clean":"2023-10-25T16:14:54.588821+0000","last_became_active":"2023-10-25T16:14:48.881303+0000","last_became_peered":"2023-10-25T16:14:48.881303+0000","last_unstale":"2023-10-25T16:14:54.588821+0000","last_undegraded":"2023-10-25T16:14:54.588821+0000","last_fullsized":"2023-10-25T16:14:54.588821+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:09.407484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601787+0000","last_change":"2023-10-25T16:14:48.877528+0000","last_active":"2023-10-25T16:14:54.601787+0000","last_peered":"2023-10-25T16:14:54.601787+0000","last_clean":"2023-10-25T16:14:54.601787+0000","last_became_active":"2023-10-25T16:14:48.876876+0000","last_became_peered":"2023-10-25T16:14:48.876876+0000","last_unstale":"2023-10-25T16:14:54.601787+0000","last_undegraded":"2023-10-25T16:14:54.601787+0000","last_fullsized":"2023-10-25T16:14:54.601787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:19:28.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-25T16:14:55.776052+0000","last_change":"2023-10-25T16:14:55.776052+0000","last_active":"2023-10-25T16:14:55.776052+0000","last_peered":"2023-10-25T16:14:55.776052+0000","last_clean":"2023-10-25T16:14:55.776052+0000","last_became_active":"2023-10-25T16:14:55.775610+0000","last_became_peered":"2023-10-25T16:14:55.775610+0000","last_unstale":"2023-10-25T16:14:55.776052+0000","last_undegraded":"2023-10-25T16:14:55.776052+0000","last_fullsized":"2023-10-25T16:14:55.776052+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:02.408430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602327+0000","last_change":"2023-10-25T16:14:48.876176+0000","last_active":"2023-10-25T16:14:54.602327+0000","last_peered":"2023-10-25T16:14:54.602327+0000","last_clean":"2023-10-25T16:14:54.602327+0000","last_became_active":"2023-10-25T16:14:48.875885+0000","last_became_peered":"2023-10-25T16:14:48.875885+0000","last_unstale":"2023-10-25T16:14:54.602327+0000","last_undegraded":"2023-10-25T16:14:54.602327+0000","last_fullsized":"2023-10-25T16:14:54.602327+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:37:19.332657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-25T16:14:55.701043+0000","last_change":"2023-10-25T16:14:55.701043+0000","last_active":"2023-10-25T16:14:55.701043+0000","last_peered":"2023-10-25T16:14:55.701043+0000","last_clean":"2023-10-25T16:14:55.701043+0000","last_became_active":"2023-10-25T16:14:55.700451+0000","last_became_peered":"2023-10-25T16:14:55.700451+0000","last_unstale":"2023-10-25T16:14:55.701043+0000","last_undegraded":"2023-10-25T16:14:55.701043+0000","last_fullsized":"2023-10-25T16:14:55.701043+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.590682+0000","last_change":"2023-10-25T16:14:48.866788+0000","last_active":"2023-10-25T16:14:54.590682+0000","last_peered":"2023-10-25T16:14:54.590682+0000","last_clean":"2023-10-25T16:14:54.590682+0000","last_became_active":"2023-10-25T16:14:48.866183+0000","last_became_peered":"2023-10-25T16:14:48.866183+0000","last_unstale":"2023-10-25T16:14:54.590682+0000","last_undegraded":"2023-10-25T16:14:54.590682+0000","last_fullsized":"2023-10-25T16:14:54.590682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:59.323596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591389+0000","last_change":"2023-10-25T16:14:48.877266+0000","last_active":"2023-10-25T16:14:54.591389+0000","last_peered":"2023-10-25T16:14:54.591389+0000","last_clean":"2023-10-25T16:14:54.591389+0000","last_became_active":"2023-10-25T16:14:48.873412+0000","last_became_peered":"2023-10-25T16:14:48.873412+0000","last_unstale":"2023-10-25T16:14:54.591389+0000","last_undegraded":"2023-10-25T16:14:54.591389+0000","last_fullsized":"2023-10-25T16:14:54.591389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:47.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.585710+0000","last_change":"2023-10-25T16:14:48.873139+0000","last_active":"2023-10-25T16:14:54.585710+0000","last_peered":"2023-10-25T16:14:54.585710+0000","last_clean":"2023-10-25T16:14:54.585710+0000","last_became_active":"2023-10-25T16:14:48.872845+0000","last_became_peered":"2023-10-25T16:14:48.872845+0000","last_unstale":"2023-10-25T16:14:54.585710+0000","last_undegraded":"2023-10-25T16:14:54.585710+0000","last_fullsized":"2023-10-25T16:14:54.585710+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601446+0000","last_change":"2023-10-25T16:14:48.868676+0000","last_active":"2023-10-25T16:14:54.601446+0000","last_peered":"2023-10-25T16:14:54.601446+0000","last_clean":"2023-10-25T16:14:54.601446+0000","last_became_active":"2023-10-25T16:14:48.868055+0000","last_became_peered":"2023-10-25T16:14:48.868055+0000","last_unstale":"2023-10-25T16:14:54.601446+0000","last_undegraded":"2023-10-25T16:14:54.601446+0000","last_fullsized":"2023-10-25T16:14:54.601446+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:36:44.798011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602546+0000","last_change":"2023-10-25T16:14:48.868974+0000","last_active":"2023-10-25T16:14:54.602546+0000","last_peered":"2023-10-25T16:14:54.602546+0000","last_clean":"2023-10-25T16:14:54.602546+0000","last_became_active":"2023-10-25T16:14:48.866909+0000","last_became_peered":"2023-10-25T16:14:48.866909+0000","last_unstale":"2023-10-25T16:14:54.602546+0000","last_undegraded":"2023-10-25T16:14:54.602546+0000","last_fullsized":"2023-10-25T16:14:54.602546+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:24:32.144529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580370+0000","last_change":"2023-10-25T16:14:48.883061+0000","last_active":"2023-10-25T16:14:54.580370+0000","last_peered":"2023-10-25T16:14:54.580370+0000","last_clean":"2023-10-25T16:14:54.580370+0000","last_became_active":"2023-10-25T16:14:48.873287+0000","last_became_peered":"2023-10-25T16:14:48.873287+0000","last_unstale":"2023-10-25T16:14:54.580370+0000","last_undegraded":"2023-10-25T16:14:54.580370+0000","last_fullsized":"2023-10-25T16:14:54.580370+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:25:51.583115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586221+0000","last_change":"2023-10-25T16:14:48.864656+0000","last_active":"2023-10-25T16:14:54.586221+0000","last_peered":"2023-10-25T16:14:54.586221+0000","last_clean":"2023-10-25T16:14:54.586221+0000","last_became_active":"2023-10-25T16:14:48.864331+0000","last_became_peered":"2023-10-25T16:14:48.864331+0000","last_unstale":"2023-10-25T16:14:54.586221+0000","last_undegraded":"2023-10-25T16:14:54.586221+0000","last_fullsized":"2023-10-25T16:14:54.586221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:03.031175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.585052+0000","last_change":"2023-10-25T16:14:48.875608+0000","last_active":"2023-10-25T16:14:54.585052+0000","last_peered":"2023-10-25T16:14:54.585052+0000","last_clean":"2023-10-25T16:14:54.585052+0000","last_became_active":"2023-10-25T16:14:48.875203+0000","last_became_peered":"2023-10-25T16:14:48.875203+0000","last_unstale":"2023-10-25T16:14:54.585052+0000","last_undegraded":"2023-10-25T16:14:54.585052+0000","last_fullsized":"2023-10-25T16:14:54.585052+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:40.909628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.587630+0000","last_change":"2023-10-25T16:14:48.879460+0000","last_active":"2023-10-25T16:14:54.587630+0000","last_peered":"2023-10-25T16:14:54.587630+0000","last_clean":"2023-10-25T16:14:54.587630+0000","last_became_active":"2023-10-25T16:14:48.878597+0000","last_became_peered":"2023-10-25T16:14:48.878597+0000","last_unstale":"2023-10-25T16:14:54.587630+0000","last_undegraded":"2023-10-25T16:14:54.587630+0000","last_fullsized":"2023-10-25T16:14:54.587630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601770+0000","last_change":"2023-10-25T16:14:48.878231+0000","last_active":"2023-10-25T16:14:54.601770+0000","last_peered":"2023-10-25T16:14:54.601770+0000","last_clean":"2023-10-25T16:14:54.601770+0000","last_became_active":"2023-10-25T16:14:48.877966+0000","last_became_peered":"2023-10-25T16:14:48.877966+0000","last_unstale":"2023-10-25T16:14:54.601770+0000","last_undegraded":"2023-10-25T16:14:54.601770+0000","last_fullsized":"2023-10-25T16:14:54.601770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:27:48.115692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.590893+0000","last_change":"2023-10-25T16:14:48.867321+0000","last_active":"2023-10-25T16:14:54.590893+0000","last_peered":"2023-10-25T16:14:54.590893+0000","last_clean":"2023-10-25T16:14:54.590893+0000","last_became_active":"2023-10-25T16:14:48.866541+0000","last_became_peered":"2023-10-25T16:14:48.866541+0000","last_unstale":"2023-10-25T16:14:54.590893+0000","last_undegraded":"2023-10-25T16:14:54.590893+0000","last_fullsized":"2023-10-25T16:14:54.590893+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:47.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586252+0000","last_change":"2023-10-25T16:14:48.881563+0000","last_active":"2023-10-25T16:14:54.586252+0000","last_peered":"2023-10-25T16:14:54.586252+0000","last_clean":"2023-10-25T16:14:54.586252+0000","last_became_active":"2023-10-25T16:14:48.881341+0000","last_became_peered":"2023-10-25T16:14:48.881341+0000","last_unstale":"2023-10-25T16:14:54.586252+0000","last_undegraded":"2023-10-25T16:14:54.586252+0000","last_fullsized":"2023-10-25T16:14:54.586252+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.585271+0000","last_change":"2023-10-25T16:14:48.878675+0000","last_active":"2023-10-25T16:14:54.585271+0000","last_peered":"2023-10-25T16:14:54.585271+0000","last_clean":"2023-10-25T16:14:54.585271+0000","last_became_active":"2023-10-25T16:14:48.878271+0000","last_became_peered":"2023-10-25T16:14:48.878271+0000","last_unstale":"2023-10-25T16:14:54.585271+0000","last_undegraded":"2023-10-25T16:14:54.585271+0000","last_fullsized":"2023-10-25T16:14:54.585271+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:15:45.877740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591063+0000","last_change":"2023-10-25T16:14:48.860619+0000","last_active":"2023-10-25T16:14:54.591063+0000","last_peered":"2023-10-25T16:14:54.591063+0000","last_clean":"2023-10-25T16:14:54.591063+0000","last_became_active":"2023-10-25T16:14:48.859959+0000","last_became_peered":"2023-10-25T16:14:48.859959+0000","last_unstale":"2023-10-25T16:14:54.591063+0000","last_undegraded":"2023-10-25T16:14:54.591063+0000","last_fullsized":"2023-10-25T16:14:54.591063+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602660+0000","last_change":"2023-10-25T16:14:48.869562+0000","last_active":"2023-10-25T16:14:54.602660+0000","last_peered":"2023-10-25T16:14:54.602660+0000","last_clean":"2023-10-25T16:14:54.602660+0000","last_became_active":"2023-10-25T16:14:48.868344+0000","last_became_peered":"2023-10-25T16:14:48.868344+0000","last_unstale":"2023-10-25T16:14:54.602660+0000","last_undegraded":"2023-10-25T16:14:54.602660+0000","last_fullsized":"2023-10-25T16:14:54.602660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:10:53.111494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601511+0000","last_change":"2023-10-25T16:14:48.872434+0000","last_active":"2023-10-25T16:14:54.601511+0000","last_peered":"2023-10-25T16:14:54.601511+0000","last_clean":"2023-10-25T16:14:54.601511+0000","last_became_active":"2023-10-25T16:14:48.871802+0000","last_became_peered":"2023-10-25T16:14:48.871802+0000","last_unstale":"2023-10-25T16:14:54.601511+0000","last_undegraded":"2023-10-25T16:14:54.601511+0000","last_fullsized":"2023-10-25T16:14:54.601511+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:29.707077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.583352+0000","last_change":"2023-10-25T16:14:48.875136+0000","last_active":"2023-10-25T16:14:54.583352+0000","last_peered":"2023-10-25T16:14:54.583352+0000","last_clean":"2023-10-25T16:14:54.583352+0000","last_became_active":"2023-10-25T16:14:48.874439+0000","last_became_peered":"2023-10-25T16:14:48.874439+0000","last_unstale":"2023-10-25T16:14:54.583352+0000","last_undegraded":"2023-10-25T16:14:54.583352+0000","last_fullsized":"2023-10-25T16:14:54.583352+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602476+0000","last_change":"2023-10-25T16:14:47.868310+0000","last_active":"2023-10-25T16:14:54.602476+0000","last_peered":"2023-10-25T16:14:54.602476+0000","last_clean":"2023-10-25T16:14:54.602476+0000","last_became_active":"2023-10-25T16:14:47.868063+0000","last_became_peered":"2023-10-25T16:14:47.868063+0000","last_unstale":"2023-10-25T16:14:54.602476+0000","last_undegraded":"2023-10-25T16:14:54.602476+0000","last_fullsized":"2023-10-25T16:14:54.602476+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:08.394743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.585855+0000","last_change":"2023-10-25T16:14:48.877540+0000","last_active":"2023-10-25T16:14:54.585855+0000","last_peered":"2023-10-25T16:14:54.585855+0000","last_clean":"2023-10-25T16:14:54.585855+0000","last_became_active":"2023-10-25T16:14:48.876892+0000","last_became_peered":"2023-10-25T16:14:48.876892+0000","last_unstale":"2023-10-25T16:14:54.585855+0000","last_undegraded":"2023-10-25T16:14:54.585855+0000","last_fullsized":"2023-10-25T16:14:54.585855+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:38.208340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.590601+0000","last_change":"2023-10-25T16:14:47.872091+0000","last_active":"2023-10-25T16:14:54.590601+0000","last_peered":"2023-10-25T16:14:54.590601+0000","last_clean":"2023-10-25T16:14:54.590601+0000","last_became_active":"2023-10-25T16:14:47.871224+0000","last_became_peered":"2023-10-25T16:14:47.871224+0000","last_unstale":"2023-10-25T16:14:54.590601+0000","last_undegraded":"2023-10-25T16:14:54.590601+0000","last_fullsized":"2023-10-25T16:14:54.590601+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:39.267329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586687+0000","last_change":"2023-10-25T16:14:48.868884+0000","last_active":"2023-10-25T16:14:54.586687+0000","last_peered":"2023-10-25T16:14:54.586687+0000","last_clean":"2023-10-25T16:14:54.586687+0000","last_became_active":"2023-10-25T16:14:48.868539+0000","last_became_peered":"2023-10-25T16:14:48.868539+0000","last_unstale":"2023-10-25T16:14:54.586687+0000","last_undegraded":"2023-10-25T16:14:54.586687+0000","last_fullsized":"2023-10-25T16:14:54.586687+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.583191+0000","last_change":"2023-10-25T16:14:47.859347+0000","last_active":"2023-10-25T16:14:54.583191+0000","last_peered":"2023-10-25T16:14:54.583191+0000","last_clean":"2023-10-25T16:14:54.583191+0000","last_became_active":"2023-10-25T16:14:47.859103+0000","last_became_peered":"2023-10-25T16:14:47.859103+0000","last_unstale":"2023-10-25T16:14:54.583191+0000","last_undegraded":"2023-10-25T16:14:54.583191+0000","last_fullsized":"2023-10-25T16:14:54.583191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.582858+0000","last_change":"2023-10-25T16:14:48.872771+0000","last_active":"2023-10-25T16:14:54.582858+0000","last_peered":"2023-10-25T16:14:54.582858+0000","last_clean":"2023-10-25T16:14:54.582858+0000","last_became_active":"2023-10-25T16:14:48.872059+0000","last_became_peered":"2023-10-25T16:14:48.872059+0000","last_unstale":"2023-10-25T16:14:54.582858+0000","last_undegraded":"2023-10-25T16:14:54.582858+0000","last_fullsized":"2023-10-25T16:14:54.582858+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:07.086686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604709+0000","last_change":"2023-10-25T16:14:47.874440+0000","last_active":"2023-10-25T16:14:54.604709+0000","last_peered":"2023-10-25T16:14:54.604709+0000","last_clean":"2023-10-25T16:14:54.604709+0000","last_became_active":"2023-10-25T16:14:47.868630+0000","last_became_peered":"2023-10-25T16:14:47.868630+0000","last_unstale":"2023-10-25T16:14:54.604709+0000","last_undegraded":"2023-10-25T16:14:54.604709+0000","last_fullsized":"2023-10-25T16:14:54.604709+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:58.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.590804+0000","last_change":"2023-10-25T16:14:48.877740+0000","last_active":"2023-10-25T16:14:54.590804+0000","last_peered":"2023-10-25T16:14:54.590804+0000","last_clean":"2023-10-25T16:14:54.590804+0000","last_became_active":"2023-10-25T16:14:48.874162+0000","last_became_peered":"2023-10-25T16:14:48.874162+0000","last_unstale":"2023-10-25T16:14:54.590804+0000","last_undegraded":"2023-10-25T16:14:54.590804+0000","last_fullsized":"2023-10-25T16:14:54.590804+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:07:01.923644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602657+0000","last_change":"2023-10-25T16:14:47.860596+0000","last_active":"2023-10-25T16:14:54.602657+0000","last_peered":"2023-10-25T16:14:54.602657+0000","last_clean":"2023-10-25T16:14:54.602657+0000","last_became_active":"2023-10-25T16:14:47.860096+0000","last_became_peered":"2023-10-25T16:14:47.860096+0000","last_unstale":"2023-10-25T16:14:54.602657+0000","last_undegraded":"2023-10-25T16:14:54.602657+0000","last_fullsized":"2023-10-25T16:14:54.602657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:01.107116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580588+0000","last_change":"2023-10-25T16:14:48.883397+0000","last_active":"2023-10-25T16:14:54.580588+0000","last_peered":"2023-10-25T16:14:54.580588+0000","last_clean":"2023-10-25T16:14:54.580588+0000","last_became_active":"2023-10-25T16:14:48.874246+0000","last_became_peered":"2023-10-25T16:14:48.874246+0000","last_unstale":"2023-10-25T16:14:54.580588+0000","last_undegraded":"2023-10-25T16:14:54.580588+0000","last_fullsized":"2023-10-25T16:14:54.580588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:21.890603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591512+0000","last_change":"2023-10-25T16:14:47.874727+0000","last_active":"2023-10-25T16:14:54.591512+0000","last_peered":"2023-10-25T16:14:54.591512+0000","last_clean":"2023-10-25T16:14:54.591512+0000","last_became_active":"2023-10-25T16:14:47.874121+0000","last_became_peered":"2023-10-25T16:14:47.874121+0000","last_unstale":"2023-10-25T16:14:54.591512+0000","last_undegraded":"2023-10-25T16:14:54.591512+0000","last_fullsized":"2023-10-25T16:14:54.591512+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:13:06.073945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580605+0000","last_change":"2023-10-25T16:14:48.864963+0000","last_active":"2023-10-25T16:14:54.580605+0000","last_peered":"2023-10-25T16:14:54.580605+0000","last_clean":"2023-10-25T16:14:54.580605+0000","last_became_active":"2023-10-25T16:14:48.864621+0000","last_became_peered":"2023-10-25T16:14:48.864621+0000","last_unstale":"2023-10-25T16:14:54.580605+0000","last_undegraded":"2023-10-25T16:14:54.580605+0000","last_fullsized":"2023-10-25T16:14:54.580605+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:33.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.588550+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:54.588550+0000","last_peered":"2023-10-25T16:14:54.588550+0000","last_clean":"2023-10-25T16:14:54.588550+0000","last_became_active":"2023-10-25T16:14:47.859897+0000","last_became_peered":"2023-10-25T16:14:47.859897+0000","last_unstale":"2023-10-25T16:14:54.588550+0000","last_undegraded":"2023-10-25T16:14:54.588550+0000","last_fullsized":"2023-10-25T16:14:54.588550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.585484+0000","last_change":"2023-10-25T16:14:48.875454+0000","last_active":"2023-10-25T16:14:54.585484+0000","last_peered":"2023-10-25T16:14:54.585484+0000","last_clean":"2023-10-25T16:14:54.585484+0000","last_became_active":"2023-10-25T16:14:48.874877+0000","last_became_peered":"2023-10-25T16:14:48.874877+0000","last_unstale":"2023-10-25T16:14:54.585484+0000","last_undegraded":"2023-10-25T16:14:54.585484+0000","last_fullsized":"2023-10-25T16:14:54.585484+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:06.492997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.581649+0000","last_change":"2023-10-25T16:14:47.855213+0000","last_active":"2023-10-25T16:14:54.581649+0000","last_peered":"2023-10-25T16:14:54.581649+0000","last_clean":"2023-10-25T16:14:54.581649+0000","last_became_active":"2023-10-25T16:14:47.855003+0000","last_became_peered":"2023-10-25T16:14:47.855003+0000","last_unstale":"2023-10-25T16:14:54.581649+0000","last_undegraded":"2023-10-25T16:14:54.581649+0000","last_fullsized":"2023-10-25T16:14:54.581649+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:28.176845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591114+0000","last_change":"2023-10-25T16:14:48.873858+0000","last_active":"2023-10-25T16:14:54.591114+0000","last_peered":"2023-10-25T16:14:54.591114+0000","last_clean":"2023-10-25T16:14:54.591114+0000","last_became_active":"2023-10-25T16:14:48.873523+0000","last_became_peered":"2023-10-25T16:14:48.873523+0000","last_unstale":"2023-10-25T16:14:54.591114+0000","last_undegraded":"2023-10-25T16:14:54.591114+0000","last_fullsized":"2023-10-25T16:14:54.591114+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:59.238544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.590899+0000","last_change":"2023-10-25T16:14:47.866759+0000","last_active":"2023-10-25T16:14:54.590899+0000","last_peered":"2023-10-25T16:14:54.590899+0000","last_clean":"2023-10-25T16:14:54.590899+0000","last_became_active":"2023-10-25T16:14:47.866171+0000","last_became_peered":"2023-10-25T16:14:47.866171+0000","last_unstale":"2023-10-25T16:14:54.590899+0000","last_undegraded":"2023-10-25T16:14:54.590899+0000","last_fullsized":"2023-10-25T16:14:54.590899+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604565+0000","last_change":"2023-10-25T16:14:48.864084+0000","last_active":"2023-10-25T16:14:54.604565+0000","last_peered":"2023-10-25T16:14:54.604565+0000","last_clean":"2023-10-25T16:14:54.604565+0000","last_became_active":"2023-10-25T16:14:48.863560+0000","last_became_peered":"2023-10-25T16:14:48.863560+0000","last_unstale":"2023-10-25T16:14:54.604565+0000","last_undegraded":"2023-10-25T16:14:54.604565+0000","last_fullsized":"2023-10-25T16:14:54.604565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:02.408430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580810+0000","last_change":"2023-10-25T16:14:47.860623+0000","last_active":"2023-10-25T16:14:54.580810+0000","last_peered":"2023-10-25T16:14:54.580810+0000","last_clean":"2023-10-25T16:14:54.580810+0000","last_became_active":"2023-10-25T16:14:47.860184+0000","last_became_peered":"2023-10-25T16:14:47.860184+0000","last_unstale":"2023-10-25T16:14:54.580810+0000","last_undegraded":"2023-10-25T16:14:54.580810+0000","last_fullsized":"2023-10-25T16:14:54.580810+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:49:05.480256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602511+0000","last_change":"2023-10-25T16:14:48.880227+0000","last_active":"2023-10-25T16:14:54.602511+0000","last_peered":"2023-10-25T16:14:54.602511+0000","last_clean":"2023-10-25T16:14:54.602511+0000","last_became_active":"2023-10-25T16:14:48.879015+0000","last_became_peered":"2023-10-25T16:14:48.879015+0000","last_unstale":"2023-10-25T16:14:54.602511+0000","last_undegraded":"2023-10-25T16:14:54.602511+0000","last_fullsized":"2023-10-25T16:14:54.602511+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:41.615017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604662+0000","last_change":"2023-10-25T16:14:47.873720+0000","last_active":"2023-10-25T16:14:54.604662+0000","last_peered":"2023-10-25T16:14:54.604662+0000","last_clean":"2023-10-25T16:14:54.604662+0000","last_became_active":"2023-10-25T16:14:47.873082+0000","last_became_peered":"2023-10-25T16:14:47.873082+0000","last_unstale":"2023-10-25T16:14:54.604662+0000","last_undegraded":"2023-10-25T16:14:54.604662+0000","last_fullsized":"2023-10-25T16:14:54.604662+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:46.391379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604371+0000","last_change":"2023-10-25T16:14:48.875071+0000","last_active":"2023-10-25T16:14:54.604371+0000","last_peered":"2023-10-25T16:14:54.604371+0000","last_clean":"2023-10-25T16:14:54.604371+0000","last_became_active":"2023-10-25T16:14:48.874839+0000","last_became_peered":"2023-10-25T16:14:48.874839+0000","last_unstale":"2023-10-25T16:14:54.604371+0000","last_undegraded":"2023-10-25T16:14:54.604371+0000","last_fullsized":"2023-10-25T16:14:54.604371+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:23.653548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601521+0000","last_change":"2023-10-25T16:14:47.868446+0000","last_active":"2023-10-25T16:14:54.601521+0000","last_peered":"2023-10-25T16:14:54.601521+0000","last_clean":"2023-10-25T16:14:54.601521+0000","last_became_active":"2023-10-25T16:14:47.868199+0000","last_became_peered":"2023-10-25T16:14:47.868199+0000","last_unstale":"2023-10-25T16:14:54.601521+0000","last_undegraded":"2023-10-25T16:14:54.601521+0000","last_fullsized":"2023-10-25T16:14:54.601521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:20:05.028912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586630+0000","last_change":"2023-10-25T16:14:48.884655+0000","last_active":"2023-10-25T16:14:54.586630+0000","last_peered":"2023-10-25T16:14:54.586630+0000","last_clean":"2023-10-25T16:14:54.586630+0000","last_became_active":"2023-10-25T16:14:48.884079+0000","last_became_peered":"2023-10-25T16:14:48.884079+0000","last_unstale":"2023-10-25T16:14:54.586630+0000","last_undegraded":"2023-10-25T16:14:54.586630+0000","last_fullsized":"2023-10-25T16:14:54.586630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:21.287637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602596+0000","last_change":"2023-10-25T16:14:47.856629+0000","last_active":"2023-10-25T16:14:54.602596+0000","last_peered":"2023-10-25T16:14:54.602596+0000","last_clean":"2023-10-25T16:14:54.602596+0000","last_became_active":"2023-10-25T16:14:47.855577+0000","last_became_peered":"2023-10-25T16:14:47.855577+0000","last_unstale":"2023-10-25T16:14:54.602596+0000","last_undegraded":"2023-10-25T16:14:54.602596+0000","last_fullsized":"2023-10-25T16:14:54.602596+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:54.478177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580855+0000","last_change":"2023-10-25T16:14:48.872240+0000","last_active":"2023-10-25T16:14:54.580855+0000","last_peered":"2023-10-25T16:14:54.580855+0000","last_clean":"2023-10-25T16:14:54.580855+0000","last_became_active":"2023-10-25T16:14:48.871974+0000","last_became_peered":"2023-10-25T16:14:48.871974+0000","last_unstale":"2023-10-25T16:14:54.580855+0000","last_undegraded":"2023-10-25T16:14:54.580855+0000","last_fullsized":"2023-10-25T16:14:54.580855+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604823+0000","last_change":"2023-10-25T16:14:47.873631+0000","last_active":"2023-10-25T16:14:54.604823+0000","last_peered":"2023-10-25T16:14:54.604823+0000","last_clean":"2023-10-25T16:14:54.604823+0000","last_became_active":"2023-10-25T16:14:47.867237+0000","last_became_peered":"2023-10-25T16:14:47.867237+0000","last_unstale":"2023-10-25T16:14:54.604823+0000","last_undegraded":"2023-10-25T16:14:54.604823+0000","last_fullsized":"2023-10-25T16:14:54.604823+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602175+0000","last_change":"2023-10-25T16:14:48.871424+0000","last_active":"2023-10-25T16:14:54.602175+0000","last_peered":"2023-10-25T16:14:54.602175+0000","last_clean":"2023-10-25T16:14:54.602175+0000","last_became_active":"2023-10-25T16:14:48.871135+0000","last_became_peered":"2023-10-25T16:14:48.871135+0000","last_unstale":"2023-10-25T16:14:54.602175+0000","last_undegraded":"2023-10-25T16:14:54.602175+0000","last_fullsized":"2023-10-25T16:14:54.602175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:29:12.879767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602880+0000","last_change":"2023-10-25T16:14:47.855700+0000","last_active":"2023-10-25T16:14:54.602880+0000","last_peered":"2023-10-25T16:14:54.602880+0000","last_clean":"2023-10-25T16:14:54.602880+0000","last_became_active":"2023-10-25T16:14:47.855418+0000","last_became_peered":"2023-10-25T16:14:47.855418+0000","last_unstale":"2023-10-25T16:14:54.602880+0000","last_undegraded":"2023-10-25T16:14:54.602880+0000","last_fullsized":"2023-10-25T16:14:54.602880+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:45:01.395689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604397+0000","last_change":"2023-10-25T16:14:48.868345+0000","last_active":"2023-10-25T16:14:54.604397+0000","last_peered":"2023-10-25T16:14:54.604397+0000","last_clean":"2023-10-25T16:14:54.604397+0000","last_became_active":"2023-10-25T16:14:48.867965+0000","last_became_peered":"2023-10-25T16:14:48.867965+0000","last_unstale":"2023-10-25T16:14:54.604397+0000","last_undegraded":"2023-10-25T16:14:54.604397+0000","last_fullsized":"2023-10-25T16:14:54.604397+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580339+0000","last_change":"2023-10-25T16:14:47.855788+0000","last_active":"2023-10-25T16:14:54.580339+0000","last_peered":"2023-10-25T16:14:54.580339+0000","last_clean":"2023-10-25T16:14:54.580339+0000","last_became_active":"2023-10-25T16:14:47.855557+0000","last_became_peered":"2023-10-25T16:14:47.855557+0000","last_unstale":"2023-10-25T16:14:54.580339+0000","last_undegraded":"2023-10-25T16:14:54.580339+0000","last_fullsized":"2023-10-25T16:14:54.580339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:39.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601698+0000","last_change":"2023-10-25T16:14:48.865059+0000","last_active":"2023-10-25T16:14:54.601698+0000","last_peered":"2023-10-25T16:14:54.601698+0000","last_clean":"2023-10-25T16:14:54.601698+0000","last_became_active":"2023-10-25T16:14:48.864397+0000","last_became_peered":"2023-10-25T16:14:48.864397+0000","last_unstale":"2023-10-25T16:14:54.601698+0000","last_undegraded":"2023-10-25T16:14:54.601698+0000","last_fullsized":"2023-10-25T16:14:54.601698+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:51:32.083564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601784+0000","last_change":"2023-10-25T16:14:47.853938+0000","last_active":"2023-10-25T16:14:54.601784+0000","last_peered":"2023-10-25T16:14:54.601784+0000","last_clean":"2023-10-25T16:14:54.601784+0000","last_became_active":"2023-10-25T16:14:47.853677+0000","last_became_peered":"2023-10-25T16:14:47.853677+0000","last_unstale":"2023-10-25T16:14:54.601784+0000","last_undegraded":"2023-10-25T16:14:54.601784+0000","last_fullsized":"2023-10-25T16:14:54.601784+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:24:58.445296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580082+0000","last_change":"2023-10-25T16:14:48.868049+0000","last_active":"2023-10-25T16:14:54.580082+0000","last_peered":"2023-10-25T16:14:54.580082+0000","last_clean":"2023-10-25T16:14:54.580082+0000","last_became_active":"2023-10-25T16:14:48.867648+0000","last_became_peered":"2023-10-25T16:14:48.867648+0000","last_unstale":"2023-10-25T16:14:54.580082+0000","last_undegraded":"2023-10-25T16:14:54.580082+0000","last_fullsized":"2023-10-25T16:14:54.580082+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591290+0000","last_change":"2023-10-25T16:14:47.868267+0000","last_active":"2023-10-25T16:14:54.591290+0000","last_peered":"2023-10-25T16:14:54.591290+0000","last_clean":"2023-10-25T16:14:54.591290+0000","last_became_active":"2023-10-25T16:14:47.867619+0000","last_became_peered":"2023-10-25T16:14:47.867619+0000","last_unstale":"2023-10-25T16:14:54.591290+0000","last_undegraded":"2023-10-25T16:14:54.591290+0000","last_fullsized":"2023-10-25T16:14:54.591290+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:44.684010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586900+0000","last_change":"2023-10-25T16:14:48.872316+0000","last_active":"2023-10-25T16:14:54.586900+0000","last_peered":"2023-10-25T16:14:54.586900+0000","last_clean":"2023-10-25T16:14:54.586900+0000","last_became_active":"2023-10-25T16:14:48.872065+0000","last_became_peered":"2023-10-25T16:14:48.872065+0000","last_unstale":"2023-10-25T16:14:54.586900+0000","last_undegraded":"2023-10-25T16:14:54.586900+0000","last_fullsized":"2023-10-25T16:14:54.586900+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:52:41.138301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586937+0000","last_change":"2023-10-25T16:14:47.857886+0000","last_active":"2023-10-25T16:14:54.586937+0000","last_peered":"2023-10-25T16:14:54.586937+0000","last_clean":"2023-10-25T16:14:54.586937+0000","last_became_active":"2023-10-25T16:14:47.856810+0000","last_became_peered":"2023-10-25T16:14:47.856810+0000","last_unstale":"2023-10-25T16:14:54.586937+0000","last_undegraded":"2023-10-25T16:14:54.586937+0000","last_fullsized":"2023-10-25T16:14:54.586937+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:10.244521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.586833+0000","last_change":"2023-10-25T16:14:48.871704+0000","last_active":"2023-10-25T16:14:54.586833+0000","last_peered":"2023-10-25T16:14:54.586833+0000","last_clean":"2023-10-25T16:14:54.586833+0000","last_became_active":"2023-10-25T16:14:48.871474+0000","last_became_peered":"2023-10-25T16:14:48.871474+0000","last_unstale":"2023-10-25T16:14:54.586833+0000","last_undegraded":"2023-10-25T16:14:54.586833+0000","last_fullsized":"2023-10-25T16:14:54.586833+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:00:29.189586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.603089+0000","last_change":"2023-10-25T16:14:47.865059+0000","last_active":"2023-10-25T16:14:54.603089+0000","last_peered":"2023-10-25T16:14:54.603089+0000","last_clean":"2023-10-25T16:14:54.603089+0000","last_became_active":"2023-10-25T16:14:47.864691+0000","last_became_peered":"2023-10-25T16:14:47.864691+0000","last_unstale":"2023-10-25T16:14:54.603089+0000","last_undegraded":"2023-10-25T16:14:54.603089+0000","last_fullsized":"2023-10-25T16:14:54.603089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:16:40.480185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602726+0000","last_change":"2023-10-25T16:14:48.880493+0000","last_active":"2023-10-25T16:14:54.602726+0000","last_peered":"2023-10-25T16:14:54.602726+0000","last_clean":"2023-10-25T16:14:54.602726+0000","last_became_active":"2023-10-25T16:14:48.879779+0000","last_became_peered":"2023-10-25T16:14:48.879779+0000","last_unstale":"2023-10-25T16:14:54.602726+0000","last_undegraded":"2023-10-25T16:14:54.602726+0000","last_fullsized":"2023-10-25T16:14:54.602726+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:01:09.446290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602818+0000","last_change":"2023-10-25T16:14:47.860221+0000","last_active":"2023-10-25T16:14:54.602818+0000","last_peered":"2023-10-25T16:14:54.602818+0000","last_clean":"2023-10-25T16:14:54.602818+0000","last_became_active":"2023-10-25T16:14:47.859970+0000","last_became_peered":"2023-10-25T16:14:47.859970+0000","last_unstale":"2023-10-25T16:14:54.602818+0000","last_undegraded":"2023-10-25T16:14:54.602818+0000","last_fullsized":"2023-10-25T16:14:54.602818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:30.187856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.582126+0000","last_change":"2023-10-25T16:14:48.869580+0000","last_active":"2023-10-25T16:14:54.582126+0000","last_peered":"2023-10-25T16:14:54.582126+0000","last_clean":"2023-10-25T16:14:54.582126+0000","last_became_active":"2023-10-25T16:14:48.868807+0000","last_became_peered":"2023-10-25T16:14:48.868807+0000","last_unstale":"2023-10-25T16:14:54.582126+0000","last_undegraded":"2023-10-25T16:14:54.582126+0000","last_fullsized":"2023-10-25T16:14:54.582126+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:46:10.109499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.588757+0000","last_change":"2023-10-25T16:14:47.867595+0000","last_active":"2023-10-25T16:14:54.588757+0000","last_peered":"2023-10-25T16:14:54.588757+0000","last_clean":"2023-10-25T16:14:54.588757+0000","last_became_active":"2023-10-25T16:14:47.867067+0000","last_became_peered":"2023-10-25T16:14:47.867067+0000","last_unstale":"2023-10-25T16:14:54.588757+0000","last_undegraded":"2023-10-25T16:14:54.588757+0000","last_fullsized":"2023-10-25T16:14:54.588757+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.601524+0000","last_change":"2023-10-25T16:14:48.851029+0000","last_active":"2023-10-25T16:14:54.601524+0000","last_peered":"2023-10-25T16:14:54.601524+0000","last_clean":"2023-10-25T16:14:54.601524+0000","last_became_active":"2023-10-25T16:14:48.850613+0000","last_became_peered":"2023-10-25T16:14:48.850613+0000","last_unstale":"2023-10-25T16:14:54.601524+0000","last_undegraded":"2023-10-25T16:14:54.601524+0000","last_fullsized":"2023-10-25T16:14:54.601524+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:45.564643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.581845+0000","last_change":"2023-10-25T16:14:47.857245+0000","last_active":"2023-10-25T16:14:54.581845+0000","last_peered":"2023-10-25T16:14:54.581845+0000","last_clean":"2023-10-25T16:14:54.581845+0000","last_became_active":"2023-10-25T16:14:47.856929+0000","last_became_peered":"2023-10-25T16:14:47.856929+0000","last_unstale":"2023-10-25T16:14:54.581845+0000","last_undegraded":"2023-10-25T16:14:54.581845+0000","last_fullsized":"2023-10-25T16:14:54.581845+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:58.310855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.581086+0000","last_change":"2023-10-25T16:14:48.886163+0000","last_active":"2023-10-25T16:14:54.581086+0000","last_peered":"2023-10-25T16:14:54.581086+0000","last_clean":"2023-10-25T16:14:54.581086+0000","last_became_active":"2023-10-25T16:14:48.885893+0000","last_became_peered":"2023-10-25T16:14:48.885893+0000","last_unstale":"2023-10-25T16:14:54.581086+0000","last_undegraded":"2023-10-25T16:14:54.581086+0000","last_fullsized":"2023-10-25T16:14:54.581086+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:31.200597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604928+0000","last_change":"2023-10-25T16:14:47.870306+0000","last_active":"2023-10-25T16:14:54.604928+0000","last_peered":"2023-10-25T16:14:54.604928+0000","last_clean":"2023-10-25T16:14:54.604928+0000","last_became_active":"2023-10-25T16:14:47.866197+0000","last_became_peered":"2023-10-25T16:14:47.866197+0000","last_unstale":"2023-10-25T16:14:54.604928+0000","last_undegraded":"2023-10-25T16:14:54.604928+0000","last_fullsized":"2023-10-25T16:14:54.604928+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:11.423851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.587092+0000","last_change":"2023-10-25T16:14:48.888702+0000","last_active":"2023-10-25T16:14:54.587092+0000","last_peered":"2023-10-25T16:14:54.587092+0000","last_clean":"2023-10-25T16:14:54.587092+0000","last_became_active":"2023-10-25T16:14:48.888470+0000","last_became_peered":"2023-10-25T16:14:48.888470+0000","last_unstale":"2023-10-25T16:14:54.587092+0000","last_undegraded":"2023-10-25T16:14:54.587092+0000","last_fullsized":"2023-10-25T16:14:54.587092+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:45.696751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602944+0000","last_change":"2023-10-25T16:14:47.867203+0000","last_active":"2023-10-25T16:14:54.602944+0000","last_peered":"2023-10-25T16:14:54.602944+0000","last_clean":"2023-10-25T16:14:54.602944+0000","last_became_active":"2023-10-25T16:14:47.867000+0000","last_became_peered":"2023-10-25T16:14:47.867000+0000","last_unstale":"2023-10-25T16:14:54.602944+0000","last_undegraded":"2023-10-25T16:14:54.602944+0000","last_fullsized":"2023-10-25T16:14:54.602944+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:22.640807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.581295+0000","last_change":"2023-10-25T16:14:48.871156+0000","last_active":"2023-10-25T16:14:54.581295+0000","last_peered":"2023-10-25T16:14:54.581295+0000","last_clean":"2023-10-25T16:14:54.581295+0000","last_became_active":"2023-10-25T16:14:48.869947+0000","last_became_peered":"2023-10-25T16:14:48.869947+0000","last_unstale":"2023-10-25T16:14:54.581295+0000","last_undegraded":"2023-10-25T16:14:54.581295+0000","last_fullsized":"2023-10-25T16:14:54.581295+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:53.663908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604546+0000","last_change":"2023-10-25T16:14:47.869880+0000","last_active":"2023-10-25T16:14:54.604546+0000","last_peered":"2023-10-25T16:14:54.604546+0000","last_clean":"2023-10-25T16:14:54.604546+0000","last_became_active":"2023-10-25T16:14:47.869229+0000","last_became_peered":"2023-10-25T16:14:47.869229+0000","last_unstale":"2023-10-25T16:14:54.604546+0000","last_undegraded":"2023-10-25T16:14:54.604546+0000","last_fullsized":"2023-10-25T16:14:54.604546+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:30.348392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.604304+0000","last_change":"2023-10-25T16:14:48.852158+0000","last_active":"2023-10-25T16:14:54.604304+0000","last_peered":"2023-10-25T16:14:54.604304+0000","last_clean":"2023-10-25T16:14:54.604304+0000","last_became_active":"2023-10-25T16:14:48.851969+0000","last_became_peered":"2023-10-25T16:14:48.851969+0000","last_unstale":"2023-10-25T16:14:54.604304+0000","last_undegraded":"2023-10-25T16:14:54.604304+0000","last_fullsized":"2023-10-25T16:14:54.604304+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:32:02.119857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.583333+0000","last_change":"2023-10-25T16:14:47.859260+0000","last_active":"2023-10-25T16:14:54.583333+0000","last_peered":"2023-10-25T16:14:54.583333+0000","last_clean":"2023-10-25T16:14:54.583333+0000","last_became_active":"2023-10-25T16:14:47.858876+0000","last_became_peered":"2023-10-25T16:14:47.858876+0000","last_unstale":"2023-10-25T16:14:54.583333+0000","last_undegraded":"2023-10-25T16:14:54.583333+0000","last_fullsized":"2023-10-25T16:14:54.583333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:02.018434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602394+0000","last_change":"2023-10-25T16:14:48.873829+0000","last_active":"2023-10-25T16:14:54.602394+0000","last_peered":"2023-10-25T16:14:54.602394+0000","last_clean":"2023-10-25T16:14:54.602394+0000","last_became_active":"2023-10-25T16:14:48.873514+0000","last_became_peered":"2023-10-25T16:14:48.873514+0000","last_unstale":"2023-10-25T16:14:54.602394+0000","last_undegraded":"2023-10-25T16:14:54.602394+0000","last_fullsized":"2023-10-25T16:14:54.602394+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:15:28.083843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.605028+0000","last_change":"2023-10-25T16:14:47.875255+0000","last_active":"2023-10-25T16:14:54.605028+0000","last_peered":"2023-10-25T16:14:54.605028+0000","last_clean":"2023-10-25T16:14:54.605028+0000","last_became_active":"2023-10-25T16:14:47.871967+0000","last_became_peered":"2023-10-25T16:14:47.871967+0000","last_unstale":"2023-10-25T16:14:54.605028+0000","last_undegraded":"2023-10-25T16:14:54.605028+0000","last_fullsized":"2023-10-25T16:14:54.605028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:27:20.877862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.602780+0000","last_change":"2023-10-25T16:14:48.881267+0000","last_active":"2023-10-25T16:14:54.602780+0000","last_peered":"2023-10-25T16:14:54.602780+0000","last_clean":"2023-10-25T16:14:54.602780+0000","last_became_active":"2023-10-25T16:14:48.879238+0000","last_became_peered":"2023-10-25T16:14:48.879238+0000","last_unstale":"2023-10-25T16:14:54.602780+0000","last_undegraded":"2023-10-25T16:14:54.602780+0000","last_fullsized":"2023-10-25T16:14:54.602780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:16:46.241055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591342+0000","last_change":"2023-10-25T16:14:47.872892+0000","last_active":"2023-10-25T16:14:54.591342+0000","last_peered":"2023-10-25T16:14:54.591342+0000","last_clean":"2023-10-25T16:14:54.591342+0000","last_became_active":"2023-10-25T16:14:47.870536+0000","last_became_peered":"2023-10-25T16:14:47.870536+0000","last_unstale":"2023-10-25T16:14:54.591342+0000","last_undegraded":"2023-10-25T16:14:54.591342+0000","last_fullsized":"2023-10-25T16:14:54.591342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.588342+0000","last_change":"2023-10-25T16:14:48.878705+0000","last_active":"2023-10-25T16:14:54.588342+0000","last_peered":"2023-10-25T16:14:54.588342+0000","last_clean":"2023-10-25T16:14:54.588342+0000","last_became_active":"2023-10-25T16:14:48.878430+0000","last_became_peered":"2023-10-25T16:14:48.878430+0000","last_unstale":"2023-10-25T16:14:54.588342+0000","last_undegraded":"2023-10-25T16:14:54.588342+0000","last_fullsized":"2023-10-25T16:14:54.588342+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:12.436592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.582355+0000","last_change":"2023-10-25T16:14:47.863035+0000","last_active":"2023-10-25T16:14:54.582355+0000","last_peered":"2023-10-25T16:14:54.582355+0000","last_clean":"2023-10-25T16:14:54.582355+0000","last_became_active":"2023-10-25T16:14:47.862784+0000","last_became_peered":"2023-10-25T16:14:47.862784+0000","last_unstale":"2023-10-25T16:14:54.582355+0000","last_undegraded":"2023-10-25T16:14:54.582355+0000","last_fullsized":"2023-10-25T16:14:54.582355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:01:20.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.591218+0000","last_change":"2023-10-25T16:14:48.879073+0000","last_active":"2023-10-25T16:14:54.591218+0000","last_peered":"2023-10-25T16:14:54.591218+0000","last_clean":"2023-10-25T16:14:54.591218+0000","last_became_active":"2023-10-25T16:14:48.878797+0000","last_became_peered":"2023-10-25T16:14:48.878797+0000","last_unstale":"2023-10-25T16:14:54.591218+0000","last_undegraded":"2023-10-25T16:14:54.591218+0000","last_fullsized":"2023-10-25T16:14:54.591218+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:11.257262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580201+0000","last_change":"2023-10-25T16:14:47.854525+0000","last_active":"2023-10-25T16:14:54.580201+0000","last_peered":"2023-10-25T16:14:54.580201+0000","last_clean":"2023-10-25T16:14:54.580201+0000","last_became_active":"2023-10-25T16:14:47.854172+0000","last_became_peered":"2023-10-25T16:14:47.854172+0000","last_unstale":"2023-10-25T16:14:54.580201+0000","last_undegraded":"2023-10-25T16:14:54.580201+0000","last_fullsized":"2023-10-25T16:14:54.580201+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:34.643376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.580061+0000","last_change":"2023-10-25T16:14:48.859802+0000","last_active":"2023-10-25T16:14:54.580061+0000","last_peered":"2023-10-25T16:14:54.580061+0000","last_clean":"2023-10-25T16:14:54.580061+0000","last_became_active":"2023-10-25T16:14:48.859454+0000","last_became_peered":"2023-10-25T16:14:48.859454+0000","last_unstale":"2023-10-25T16:14:54.580061+0000","last_undegraded":"2023-10-25T16:14:54.580061+0000","last_fullsized":"2023-10-25T16:14:54.580061+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:47.827119+0000","last_clean_scrub_stamp":"2023-10-25T16:14:47.827119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:13.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-25T16:14:54.589193+0000","last_change":"2023-10-25T16:14:47.862356+0000","last_active":"2023-10-25T16:14:54.589193+0000","last_peered":"2023-10-25T16:14:54.589193+0000","last_clean":"2023-10-25T16:14:54.589193+0000","last_became_active":"2023-10-25T16:14:47.861781+0000","last_became_peered":"2023-10-25T16:14:47.861781+0000","last_unstale":"2023-10-25T16:14:54.589193+0000","last_undegraded":"2023-10-25T16:14:54.589193+0000","last_fullsized":"2023-10-25T16:14:54.589193+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:14:46.814378+0000","last_clean_scrub_stamp":"2023-10-25T16:14:46.814378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:46.175695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-25T16:14:55.797619+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:14:55.797619+0000","last_peered":"2023-10-25T16:14:55.797619+0000","last_clean":"2023-10-25T16:14:55.797619+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:14:55.797619+0000","last_undegraded":"2023-10-25T16:14:55.797619+0000","last_fullsized":"2023-10-25T16:14:55.797619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:16.404228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":239,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195073,"statfs":{"total":200000000,"available":199754800,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.45900000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.376},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57199999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.52200000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.749},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.84499999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.86399999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.79500000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199165976,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.84299999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.149,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0409999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.246}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1899999999999999,"5min":1.304,"15min":1.304},"last":1.155},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.66900000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.119},{"interface":"front","average":{"1min":1.006,"5min":1.036,"15min":1.0409999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.25,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.79900000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.94799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195073,"statfs":{"total":200000000,"available":199755762,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2470000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.032},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.73699999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:00 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.85299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.63200000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.175,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.125},{"interface":"front","average":{"1min":1.052,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.206}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2629999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.413,"15min":1.413},"last":0.97999999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.72599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.181},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0620000000000001,"15min":1.056},"min":{"1min":0.76700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2509999999999999,"5min":1.895,"15min":1.895},"last":1.1559999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4339999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0329999999999999,"15min":1.0269999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.2370000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195074,"statfs":{"total":200000000,"available":199756364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":14.843,"5min":14.843,"15min":14.843},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":16.439,"5min":16.439,"15min":16.439},"last":1.032}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":14.630000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.133}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93300000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":14.954000000000001,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.2450000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":15.904,"5min":15.904,"15min":15.904},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":17.219999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.875}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":14.567,"5min":14.567,"15min":14.567},"last":1.212},{"interface":"front","average":{"1min":1.887,"5min":1.887,"15min":1.887},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":15.089,"5min":15.089,"15min":15.089},"last":1.175}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":17.492000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.7930000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.2749999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":239,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195073,"statfs":{"total":200000000,"available":199754822,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.47,"15min":1.47},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.05,"5min":1.262,"15min":1.262},"last":1.05}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.95699999999999996,"15min":0.93799999999999994},"min":{"1min":0.86299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.089}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.016}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1799999999999999,"5min":1.369,"15min":1.369},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.1359999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0640000000000001,"15min":1.0629999999999999},"min":{"1min":0.753,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95099999999999996,"15min":0.94299999999999995},"min":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.111}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":238,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195074,"statfs":{"total":200000000,"available":199755796,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.94999999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.505},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.0309999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1659999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.89400000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:13:59 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.091},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.1279999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195074,"statfs":{"total":200000000,"available":199756364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85999999999999999,"5min":1.423,"15min":1.423},"last":0.85299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.69399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.698,"5min":12.698,"15min":12.698},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.107,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.721,"5min":12.721,"15min":12.721},"last":1.006}]},{"osd":5,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.96299999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.331,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.02,"15min":1.024},"min":{"1min":0.68999999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.581,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.0740000000000001,"15min":0.97399999999999998},"min":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":14.776,"5min":14.776,"15min":14.776},"last":1.091},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.0780000000000001,"15min":1.012},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":10.509,"5min":10.509,"15min":10.509},"last":1.1259999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":814,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194498,"statfs":{"total":200000000,"available":199166032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.314,"5min":0.217,"15min":0.217},"max":{"1min":0.746,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.73299999999999998,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.95999999999999996,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.372,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80000000000000004,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.71199999999999997,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98799999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.161,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.89500000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.103,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.139,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94099999999999995,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.103,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.018}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.97499999999999998},"min":{"1min":0.66200000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2350000000000001,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.091},{"interface":"front","average":{"1min":0.877,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0740000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.97499999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.3049999999999999,"15min":1.375},"min":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1819999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.323,"15min":1.393},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.119,"5min":11.622,"15min":11.622},"last":1.0580000000000001}]}]}],"pool_statfs":[]}} 2023-10-25T16:15:01.140 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:15:01.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:15:01.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- 172.21.15.177:0/1455785541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 msgr2=0x7fd5e006d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 --2- 172.21.15.177:0/1455785541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e006d000 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00ad9a0 tx=0x7fd5d001c7a0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- 172.21.15.177:0/1455785541 shutdown_connections 2023-10-25T16:15:01.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 --2- 172.21.15.177:0/1455785541 >> v2:172.21.15.184:3300/0 conn(0x7fd5e00697b0 0x7fd5e0069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 --2- 172.21.15.177:0/1455785541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e006d000 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- 172.21.15.177:0/1455785541 >> 172.21.15.177:0/1455785541 conn(0x7fd5e00cdf30 msgr2=0x7fd5e00ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:01.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- 172.21.15.177:0/1455785541 shutdown_connections 2023-10-25T16:15:01.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- 172.21.15.177:0/1455785541 wait complete. 2023-10-25T16:15:01.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 Processor -- start 2023-10-25T16:15:01.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- start start 2023-10-25T16:15:01.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e00697b0 0x7fd5e00c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e006b3e0 0x7fd5e0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c5b90 con 0x7fd5e00705f0 2023-10-25T16:15:01.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00b2230 con 0x7fd5e006b3e0 2023-10-25T16:15:01.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e657c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c5dc0 con 0x7fd5e00697b0 2023-10-25T16:15:01.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e4b19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e4b19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e014ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46264/0 (socket says 172.21.15.177:46264) 2023-10-25T16:15:01.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.303+0000 7fd5e4b19640 1 -- 172.21.15.177:0/2524799204 learned_addr learned my addr 172.21.15.177:0/2524799204 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dffff640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e00697b0 0x7fd5e00c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5df7fe640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e006b3e0 0x7fd5e0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e4b19640 1 -- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e00697b0 msgr2=0x7fd5e00c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e4b19640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e00697b0 0x7fd5e00c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e4b19640 1 -- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e006b3e0 msgr2=0x7fd5e0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e4b19640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e006b3e0 0x7fd5e0156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e4b19640 1 -- 172.21.15.177:0/2524799204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009560 con 0x7fd5e00705f0 2023-10-25T16:15:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e4b19640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e014ffa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800cce0 tx=0x7fd5d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8004b30 con 0x7fd5e00705f0 2023-10-25T16:15:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5d8004d80 con 0x7fd5e00705f0 2023-10-25T16:15:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e00c60a0 con 0x7fd5e00705f0 2023-10-25T16:15:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8005280 con 0x7fd5e00705f0 2023-10-25T16:15:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e00b24a0 con 0x7fd5e00705f0 2023-10-25T16:15:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e00b2690 con 0x7fd5e00705f0 2023-10-25T16:15:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd5d80053e0 con 0x7fd5e00705f0 2023-10-25T16:15:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dcff9640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc0664a0 0x7fd5cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd5d8084650 con 0x7fd5e00705f0 2023-10-25T16:15:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dffff640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc0664a0 0x7fd5cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.307+0000 7fd5dffff640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc0664a0 0x7fd5cc068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00af000 tx=0x7fd5d001afe0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:01.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.311+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd5d8051b20 con 0x7fd5e00705f0 2023-10-25T16:15:01.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.527+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd5e004db20 con 0x7fd5e00705f0 2023-10-25T16:15:01.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5dcff9640 1 -- 172.21.15.177:0/2524799204 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd5d801d0e0 con 0x7fd5e00705f0 2023-10-25T16:15:01.535 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:15:01.535 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:15:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:15:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:15:01.536 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:15:01.536 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:15:01.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc0664a0 msgr2=0x7fd5cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc0664a0 0x7fd5cc068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00af000 tx=0x7fd5d001afe0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 msgr2=0x7fd5e014ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e014ffa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800cce0 tx=0x7fd5d800a620 comp rx=0 tx=0).stop 2023-10-25T16:15:01.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 shutdown_connections 2023-10-25T16:15:01.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc0664a0 0x7fd5cc068960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e00705f0 0x7fd5e014ffa0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e006b3e0 0x7fd5e0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 --2- 172.21.15.177:0/2524799204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e00697b0 0x7fd5e00c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 >> 172.21.15.177:0/2524799204 conn(0x7fd5e00cdf30 msgr2=0x7fd5e00cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:01.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 shutdown_connections 2023-10-25T16:15:01.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.531+0000 7fd5e657c640 1 -- 172.21.15.177:0/2524799204 wait complete. 2023-10-25T16:15:01.554 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:01.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf485a5640 1 -- 172.21.15.177:0/630687440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 msgr2=0x7fbf280047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf485a5640 1 --2- 172.21.15.177:0/630687440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf280047d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c290 tx=0x7fbf3401f760 comp rx=0 tx=0).stop 2023-10-25T16:15:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf46b42640 1 -- 172.21.15.177:0/630687440 reap_dead start 2023-10-25T16:15:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf485a5640 1 -- 172.21.15.177:0/630687440 shutdown_connections 2023-10-25T16:15:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf485a5640 1 -- 172.21.15.177:0/630687440 >> 172.21.15.177:0/630687440 conn(0x7fbf400983a0 msgr2=0x7fbf400cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:01.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf485a5640 1 -- 172.21.15.177:0/630687440 shutdown_connections 2023-10-25T16:15:01.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.671+0000 7fbf485a5640 1 -- 172.21.15.177:0/630687440 wait complete. 2023-10-25T16:15:01.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 Processor -- start 2023-10-25T16:15:01.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- start start 2023-10-25T16:15:01.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf4014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf400c8970 0x7fbf4006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf400c8df0 0x7fbf4006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4014d400 con 0x7fbf28003fb0 2023-10-25T16:15:01.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40150680 con 0x7fbf400c8970 2023-10-25T16:15:01.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40150960 con 0x7fbf400c8df0 2023-10-25T16:15:01.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf4014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf4014cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46286/0 (socket says 172.21.15.177:46286) 2023-10-25T16:15:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 -- 172.21.15.177:0/1609555034 learned_addr learned my addr 172.21.15.177:0/1609555034 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46b42640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf400c8df0 0x7fbf4006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf45b40640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf400c8970 0x7fbf4006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 -- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf400c8df0 msgr2=0x7fbf4006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf400c8df0 0x7fbf4006dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 -- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf400c8970 msgr2=0x7fbf4006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf400c8970 0x7fbf4006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 -- 172.21.15.177:0/1609555034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400cd770 con 0x7fbf28003fb0 2023-10-25T16:15:01.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46b42640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf400c8df0 0x7fbf4006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf46341640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf4014cec0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000fb40 tx=0x7fbf3000d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011440 con 0x7fbf28003fb0 2023-10-25T16:15:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf30011690 con 0x7fbf28003fb0 2023-10-25T16:15:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf40150c40 con 0x7fbf28003fb0 2023-10-25T16:15:01.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011a20 con 0x7fbf28003fb0 2023-10-25T16:15:01.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf40151200 con 0x7fbf28003fb0 2023-10-25T16:15:01.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4004daf0 con 0x7fbf28003fb0 2023-10-25T16:15:01.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.675+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf30011b80 con 0x7fbf28003fb0 2023-10-25T16:15:01.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.679+0000 7fbf3effd640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf2c066470 0x7fbf2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:01.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.679+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbf30015070 con 0x7fbf28003fb0 2023-10-25T16:15:01.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.679+0000 7fbf45b40640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf2c066470 0x7fbf2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:01.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.679+0000 7fbf45b40640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf2c066470 0x7fbf2c068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c260 tx=0x7fbf3401c500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:01.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.683+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf30051090 con 0x7fbf28003fb0 2023-10-25T16:15:01.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.867+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf40098880 con 0x7fbf28003fb0 2023-10-25T16:15:01.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.867+0000 7fbf3effd640 1 -- 172.21.15.177:0/1609555034 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fbf300521e0 con 0x7fbf28003fb0 2023-10-25T16:15:01.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:01.873 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:01.873 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:01.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf2c066470 msgr2=0x7fbf2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf2c066470 0x7fbf2c068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c260 tx=0x7fbf3401c500 comp rx=0 tx=0).stop 2023-10-25T16:15:01.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 msgr2=0x7fbf4014cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:01.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf4014cec0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000fb40 tx=0x7fbf3000d2e0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 shutdown_connections 2023-10-25T16:15:01.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf2c066470 0x7fbf2c068930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf400c8df0 0x7fbf4006dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf400c8970 0x7fbf4006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 --2- 172.21.15.177:0/1609555034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf28003fb0 0x7fbf4014cec0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:01.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 >> 172.21.15.177:0/1609555034 conn(0x7fbf400983a0 msgr2=0x7fbf400adbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:01.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 shutdown_connections 2023-10-25T16:15:01.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:01.871+0000 7fbf485a5640 1 -- 172.21.15.177:0/1609555034 wait complete. 2023-10-25T16:15:02.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:14:48.199862+0000', 'modified': '2023-10-25T16:14:50.236264+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5859}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5859': {'gid': 5859, 'name': 'd', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/4097207198', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 4097207198}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 4097207198}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:15:02.293 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:15:02.294 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-25T16:15:02.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 -- 172.21.15.177:0/1258220780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c1591e0 msgr2=0x7f673c0c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 --2- 172.21.15.177:0/1258220780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c1591e0 0x7f673c0c2b30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f672c009840 tx=0x7f672c01c800 comp rx=0 tx=0).stop 2023-10-25T16:15:02.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 -- 172.21.15.177:0/1258220780 shutdown_connections 2023-10-25T16:15:02.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 --2- 172.21.15.177:0/1258220780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c0af820 0x7f673c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 --2- 172.21.15.177:0/1258220780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c1591e0 0x7f673c0c2b30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 -- 172.21.15.177:0/1258220780 >> 172.21.15.177:0/1258220780 conn(0x7f673c0cefe0 msgr2=0x7f673c0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 -- 172.21.15.177:0/1258220780 shutdown_connections 2023-10-25T16:15:02.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 -- 172.21.15.177:0/1258220780 wait complete. 2023-10-25T16:15:02.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 Processor -- start 2023-10-25T16:15:02.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.423+0000 7f674126e640 1 -- start start 2023-10-25T16:15:02.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0af820 0x7f673c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 0x7f673c150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c1591e0 0x7f673c157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c6a40 con 0x7f673c0b0a20 2023-10-25T16:15:02.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0c6f70 con 0x7f673c0af820 2023-10-25T16:15:02.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0af1d0 con 0x7f673c1591e0 2023-10-25T16:15:02.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 0x7f673c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 0x7f673c150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46290/0 (socket says 172.21.15.177:46290) 2023-10-25T16:15:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 -- 172.21.15.177:0/1186973220 learned_addr learned my addr 172.21.15.177:0/1186973220 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 -- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c1591e0 msgr2=0x7f673c157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c1591e0 0x7f673c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 -- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0af820 msgr2=0x7f673c0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0af820 0x7f673c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 -- 172.21.15.177:0/1186973220 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0094a0 con 0x7f673c0b0a20 2023-10-25T16:15:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673a7fc640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 0x7f673c150940 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f673000c500 tx=0x7f673000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67237fe640 1 -- 172.21.15.177:0/1186973220 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730003600 con 0x7f673c0b0a20 2023-10-25T16:15:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67237fe640 1 -- 172.21.15.177:0/1186973220 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6730003850 con 0x7f673c0b0a20 2023-10-25T16:15:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c0af4b0 con 0x7f673c0b0a20 2023-10-25T16:15:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67237fe640 1 -- 172.21.15.177:0/1186973220 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730003c60 con 0x7f673c0b0a20 2023-10-25T16:15:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c0ac6f0 con 0x7f673c0b0a20 2023-10-25T16:15:02.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67237fe640 1 -- 172.21.15.177:0/1186973220 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f673001b3b0 con 0x7f673c0b0a20 2023-10-25T16:15:02.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67237fe640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67237fe640 1 -- 172.21.15.177:0/1186973220 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6730083790 con 0x7f673c0b0a20 2023-10-25T16:15:02.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f673affd640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.427+0000 7f67443b8000 1 Processor -- start 2023-10-25T16:15:02.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- start start 2023-10-25T16:15:02.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673affd640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f672c0af000 tx=0x7f672c0195a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a24200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 0x5642219d9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x5642219da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642217cacc0 con 0x564221a24740 2023-10-25T16:15:02.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56422182d920 con 0x564221a23e20 2023-10-25T16:15:02.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56422182ae50 con 0x5642219da390 2023-10-25T16:15:02.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 0x5642219d9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 0x5642219d9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46306/0 (socket says 172.21.15.177:46306) 2023-10-25T16:15:02.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 -- 172.21.15.177:0/3308299744 learned_addr learned my addr 172.21.15.177:0/3308299744 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:02.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673affd640 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a24200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 -- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 msgr2=0x5642219da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673b7fe640 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x5642219da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x5642219da770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 -- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 msgr2=0x564221a24200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a24200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 -- 172.21.15.177:0/3308299744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56422151f890 con 0x564221a24740 2023-10-25T16:15:02.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 0x5642219d9e50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6730050e40 tx=0x7f6730054940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177cbd9c1f15fcd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f6720ff9640 1 -- 172.21.15.177:0/3308299744 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673007f070 con 0x564221a24740 2023-10-25T16:15:02.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f6720ff9640 1 -- 172.21.15.177:0/3308299744 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6730052a80 con 0x564221a24740 2023-10-25T16:15:02.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f6720ff9640 1 -- 172.21.15.177:0/3308299744 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730052ce0 con 0x564221a24740 2023-10-25T16:15:02.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- 172.21.15.177:0/3308299744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 msgr2=0x5642219d9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 0x5642219d9e50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6730050e40 tx=0x7f6730054940 comp rx=0 tx=0).stop 2023-10-25T16:15:02.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- 172.21.15.177:0/3308299744 shutdown_connections 2023-10-25T16:15:02.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x5642219da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a24740 0x5642219d9e50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- 172.21.15.177:0/3308299744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a24200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- 172.21.15.177:0/3308299744 >> 172.21.15.177:0/3308299744 conn(0x5642219cd2f0 msgr2=0x5642219d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- 172.21.15.177:0/3308299744 shutdown_connections 2023-10-25T16:15:02.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- 172.21.15.177:0/3308299744 wait complete. 2023-10-25T16:15:02.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- start start 2023-10-25T16:15:02.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 Processor -- start 2023-10-25T16:15:02.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x564221a110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a11630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x564221a11b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564221826740 con 0x5642219da390 2023-10-25T16:15:02.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642217e5d10 con 0x564221a23e20 2023-10-25T16:15:02.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642217e59b0 con 0x564221a24740 2023-10-25T16:15:02.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f67443b8000 10 client.0 _ll_register_callbacks cb 0x5642219c16c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:15:02.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x564221a110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x564221a110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46310/0 (socket says 172.21.15.177:46310) 2023-10-25T16:15:02.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673affd640 1 -- 172.21.15.177:0/605218978 learned_addr learned my addr 172.21.15.177:0/605218978 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:02.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.431+0000 7f673a7fc640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a11630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673b7fe640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x564221a11b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673affd640 1 -- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 msgr2=0x564221a11b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673affd640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x564221a11b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673affd640 1 -- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 msgr2=0x564221a11630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673affd640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a11630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673affd640 1 -- 172.21.15.177:0/605218978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c0ac6f0 con 0x5642219da390 2023-10-25T16:15:02.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673affd640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x564221a110f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f672c000c10 tx=0x7f672c0091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf3a244ca78411 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:15:02.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 1 -- 172.21.15.177:0/605218978 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c005240 con 0x5642219da390 2023-10-25T16:15:02.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642217da370 con 0x5642219da390 2023-10-25T16:15:02.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 1 -- 172.21.15.177:0/605218978 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f672c0bb040 con 0x5642219da390 2023-10-25T16:15:02.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 1 -- 172.21.15.177:0/605218978 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f672c0053a0 con 0x5642219da390 2023-10-25T16:15:02.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 10 client.6039 fetch_fsmap learned FSMap version 19 2023-10-25T16:15:02.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5642217e8460 con 0x5642219da390 2023-10-25T16:15:02.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 1 -- 172.21.15.177:0/605218978 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5642217da370 con 0x5642219da390 2023-10-25T16:15:02.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 1 -- 172.21.15.177:0/605218978 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f672c0046d0 con 0x5642219da390 2023-10-25T16:15:02.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 10 client.6039 fetch_fsmap finished waiting for FSMap version 19 2023-10-25T16:15:02.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 10 client.6039 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:15:02.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 20 client.6039 populate_metadata read hostname 'smithi177' 2023-10-25T16:15:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a12580 0x564221a34ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 4 client.6039 mds_command: new command op to 5859 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:15:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 --> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642217c02d0 con 0x564221a12580 2023-10-25T16:15:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673a7fc640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a12580 0x564221a34ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 10 client.6039 ms_handle_connect on v2:172.21.15.184:6836/4097207198 2023-10-25T16:15:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f673a7fc640 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a12580 0x564221a34ec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c0a1e5f28ad8cb server_cookie=1dc7bae2d05e8ed1 in_seq=0 out_seq=0 2023-10-25T16:15:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 1 -- 172.21.15.177:0/605218978 <== mds.0 v2:172.21.15.184:6836/4097207198 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5642217c02d0 con 0x564221a12580 2023-10-25T16:15:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 10 client.6039 handle_command_reply: tid=0 2023-10-25T16:15:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 client.6039 shutdown 2023-10-25T16:15:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 msgr2=0x564221a110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x564221a110f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f672c000c10 tx=0x7f672c0091e0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 shutdown_connections 2023-10-25T16:15:02.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a12580 0x564221a34ec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x564221a11b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x564221a11630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 --2- 172.21.15.177:0/605218978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x564221a110f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f6719ffb640 0 client.6039 ms_handle_reset on v2:172.21.15.184:6836/4097207198 2023-10-25T16:15:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 >> 172.21.15.177:0/605218978 conn(0x5642219cd2f0 msgr2=0x5642219d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 shutdown_connections 2023-10-25T16:15:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 1 -- 172.21.15.177:0/605218978 wait complete. 2023-10-25T16:15:02.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.435+0000 7f67443b8000 20 client.6039 trim_cache size 0 max 16384 2023-10-25T16:15:02.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 Processor -- start 2023-10-25T16:15:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 -- start start 2023-10-25T16:15:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x5642219d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x5642219d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x5642219dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642214e0940 con 0x5642219da390 2023-10-25T16:15:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642217fca10 con 0x564221a23e20 2023-10-25T16:15:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56422182b8b0 con 0x564221a24740 2023-10-25T16:15:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x5642219d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x5642219d4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46312/0 (socket says 172.21.15.177:46312) 2023-10-25T16:15:02.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 -- 172.21.15.177:0/3347025470 learned_addr learned my addr 172.21.15.177:0/3347025470 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:02.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 -- 172.21.15.177:0/3347025470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 msgr2=0x5642219dae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x5642219dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 -- 172.21.15.177:0/3347025470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 msgr2=0x5642219d51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x5642219d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 -- 172.21.15.177:0/3347025470 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642217ce760 con 0x5642219da390 2023-10-25T16:15:02.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f673affd640 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x5642219d4cb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f672c01b080 tx=0x7f672c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf941445676b18a server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67217fa640 1 -- 172.21.15.177:0/3347025470 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c004420 con 0x5642219da390 2023-10-25T16:15:02.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67217fa640 1 -- 172.21.15.177:0/3347025470 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f672c0046d0 con 0x5642219da390 2023-10-25T16:15:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.451+0000 7f67217fa640 1 -- 172.21.15.177:0/3347025470 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c005140 con 0x5642219da390 2023-10-25T16:15:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/3347025470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 msgr2=0x5642219d4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x5642219d4cb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f672c01b080 tx=0x7f672c0b7000 comp rx=0 tx=0).stop 2023-10-25T16:15:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/3347025470 shutdown_connections 2023-10-25T16:15:02.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x564221a24740 0x5642219dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a23e20 0x5642219d51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- 172.21.15.177:0/3347025470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5642219da390 0x5642219d4cb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/3347025470 >> 172.21.15.177:0/3347025470 conn(0x5642219cd2f0 msgr2=0x5642219da770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/3347025470 shutdown_connections 2023-10-25T16:15:02.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/3347025470 wait complete. 2023-10-25T16:15:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- start start 2023-10-25T16:15:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 Processor -- start 2023-10-25T16:15:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x564221a32eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 0x564221a333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a24740 0x564221a33930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564221823f50 con 0x564221a23e20 2023-10-25T16:15:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642218292a0 con 0x564221a24740 2023-10-25T16:15:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x56422182a740 con 0x5642219da390 2023-10-25T16:15:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 10 client.0 _ll_register_callbacks cb 0x564221824ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:15:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 0x564221a333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 0x564221a333f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46326/0 (socket says 172.21.15.177:46326) 2023-10-25T16:15:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 -- 172.21.15.177:0/1212570987 learned_addr learned my addr 172.21.15.177:0/1212570987 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673b7fe640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a24740 0x564221a33930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673affd640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x564221a32eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 -- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 msgr2=0x564221a32eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x564221a32eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 -- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a24740 msgr2=0x564221a33930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:15:02.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a24740 0x564221a33930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 -- 172.21.15.177:0/1212570987 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642217e8460 con 0x564221a23e20 2023-10-25T16:15:02.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673b7fe640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a24740 0x564221a33930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:02.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673a7fc640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 0x564221a333f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f673000cec0 tx=0x7f6730055040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf74a4f7685eca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:15:02.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 1 -- 172.21.15.177:0/1212570987 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673007f070 con 0x564221a23e20 2023-10-25T16:15:02.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 1 -- 172.21.15.177:0/1212570987 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6730052ce0 con 0x564221a23e20 2023-10-25T16:15:02.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642217be6f0 con 0x564221a23e20 2023-10-25T16:15:02.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 1 -- 172.21.15.177:0/1212570987 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6730051050 con 0x564221a23e20 2023-10-25T16:15:02.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 10 client.6045 fetch_fsmap learned FSMap version 19 2023-10-25T16:15:02.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x56422151fcc0 con 0x564221a23e20 2023-10-25T16:15:02.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 1 -- 172.21.15.177:0/1212570987 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6730076070 con 0x564221a23e20 2023-10-25T16:15:02.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 1 -- 172.21.15.177:0/1212570987 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6730053e30 con 0x564221a23e20 2023-10-25T16:15:02.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 10 client.6045 fetch_fsmap finished waiting for FSMap version 19 2023-10-25T16:15:02.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 10 client.6045 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:15:02.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 20 client.6045 populate_metadata read hostname 'smithi177' 2023-10-25T16:15:02.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a33e70 0x564221a34250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 4 client.6045 mds_command: new command op to 5859 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:15:02.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 --> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56422181f720 con 0x564221a33e70 2023-10-25T16:15:02.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673affd640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a33e70 0x564221a34250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f673affd640 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a33e70 0x564221a34250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fdc7c65e9658000 server_cookie=a70808ba64ccadef in_seq=0 out_seq=0 2023-10-25T16:15:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.455+0000 7f6719ffb640 10 client.6045 ms_handle_connect on v2:172.21.15.184:6836/4097207198 2023-10-25T16:15:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f6719ffb640 1 -- 172.21.15.177:0/1212570987 <== mds.0 v2:172.21.15.184:6836/4097207198 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56422181f720 con 0x564221a33e70 2023-10-25T16:15:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f6719ffb640 10 client.6045 handle_command_reply: tid=0 2023-10-25T16:15:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 client.6045 shutdown 2023-10-25T16:15:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 msgr2=0x564221a333f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 0x564221a333f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f673000cec0 tx=0x7f6730055040 comp rx=0 tx=0).stop 2023-10-25T16:15:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 shutdown_connections 2023-10-25T16:15:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:6836/4097207198,v1:172.21.15.184:6837/4097207198] conn(0x564221a33e70 0x564221a34250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564221a24740 0x564221a33930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564221a23e20 0x564221a333f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f6719ffb640 0 client.6045 ms_handle_reset on v2:172.21.15.184:6836/4097207198 2023-10-25T16:15:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 --2- 172.21.15.177:0/1212570987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5642219da390 0x564221a32eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 >> 172.21.15.177:0/1212570987 conn(0x5642219cd2f0 msgr2=0x5642219db000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 shutdown_connections 2023-10-25T16:15:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 1 -- 172.21.15.177:0/1212570987 wait complete. 2023-10-25T16:15:02.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f67443b8000 20 client.6045 trim_cache size 0 max 16384 2023-10-25T16:15:02.481 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:02.481 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:02.482 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:15:02.482 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 5859, 2023-10-25T16:15:02.482 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:15:02.482 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:15:02.482 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:15:02.483 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 13.616920478000001, 2023-10-25T16:15:02.483 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 19, 2023-10-25T16:15:02.483 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 50, 2023-10-25T16:15:02.483 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 48, 2023-10-25T16:15:02.483 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 18.278392716999999 2023-10-25T16:15:02.484 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 msgr2=0x7f6728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f672c0af000 tx=0x7f672c0195a0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 msgr2=0x7f673c150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 0x7f673c150940 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f673000c500 tx=0x7f673000c9c0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 shutdown_connections 2023-10-25T16:15:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f673c1591e0 0x7f673c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673c0b0a20 0x7f673c150940 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 --2- 172.21.15.177:0/1186973220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f673c0af820 0x7f673c0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 >> 172.21.15.177:0/1186973220 conn(0x7f673c0cefe0 msgr2=0x7f673c06ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 shutdown_connections 2023-10-25T16:15:02.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.459+0000 7f674126e640 1 -- 172.21.15.177:0/1186973220 wait complete. 2023-10-25T16:15:02.487 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:15:02.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.599+0000 7f789607f640 1 -- 172.21.15.177:0/1975325507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f789006c160 msgr2=0x7f78900cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.599+0000 7f789607f640 1 --2- 172.21.15.177:0/1975325507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f789006c160 0x7f78900cb5c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f78900ca1f0 tx=0x7f788801ccd0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.599+0000 7f789607f640 1 -- 172.21.15.177:0/1975325507 shutdown_connections 2023-10-25T16:15:02.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.599+0000 7f789607f640 1 --2- 172.21.15.177:0/1975325507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f789006c160 0x7f78900cb5c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 --2- 172.21.15.177:0/1975325507 >> v2:172.21.15.184:3300/0 conn(0x7f7890140cf0 0x7f78900af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- 172.21.15.177:0/1975325507 >> 172.21.15.177:0/1975325507 conn(0x7f78900b2450 msgr2=0x7f78900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- 172.21.15.177:0/1975325507 shutdown_connections 2023-10-25T16:15:02.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- 172.21.15.177:0/1975325507 wait complete. 2023-10-25T16:15:02.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 Processor -- start 2023-10-25T16:15:02.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- start start 2023-10-25T16:15:02.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f789006c160 0x7f789013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f789006f570 0x7f789013bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 0x7f789013c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890158de0 con 0x7f7890140cf0 2023-10-25T16:15:02.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789013cb60 con 0x7f789006c160 2023-10-25T16:15:02.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789013ce40 con 0x7f789006f570 2023-10-25T16:15:02.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 0x7f789013c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 0x7f789013c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46340/0 (socket says 172.21.15.177:46340) 2023-10-25T16:15:02.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 -- 172.21.15.177:0/3533881315 learned_addr learned my addr 172.21.15.177:0/3533881315 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:02.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788f7fe640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f789006c160 0x7f789013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f7886ffd640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f789006f570 0x7f789013bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 -- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f789006f570 msgr2=0x7f789013bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f789006f570 0x7f789013bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 -- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f789006c160 msgr2=0x7f789013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f789006c160 0x7f789013ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 -- 172.21.15.177:0/3533881315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78880098e0 con 0x7f7890140cf0 2023-10-25T16:15:02.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788ffff640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 0x7f789013c110 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f788801a900 tx=0x7f7888009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888003d90 con 0x7f7890140cf0 2023-10-25T16:15:02.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78880a5b60 con 0x7f7890140cf0 2023-10-25T16:15:02.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7890158820 con 0x7f7890140cf0 2023-10-25T16:15:02.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888004290 con 0x7f7890140cf0 2023-10-25T16:15:02.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7890156f20 con 0x7f7890140cf0 2023-10-25T16:15:02.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.603+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789004daf0 con 0x7f7890140cf0 2023-10-25T16:15:02.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.607+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f788800a040 con 0x7f7890140cf0 2023-10-25T16:15:02.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.607+0000 7f788cff9640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7870066470 0x7f7870068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:02.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.607+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f788811fae0 con 0x7f7890140cf0 2023-10-25T16:15:02.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.607+0000 7f788f7fe640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7870066470 0x7f7870068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:02.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.607+0000 7f788f7fe640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7870066470 0x7f7870068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78800058d0 tx=0x7f7880005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:02.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.611+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78880ed120 con 0x7f7890140cf0 2023-10-25T16:15:02.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f78900ca670 con 0x7f7890140cf0 2023-10-25T16:15:02.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f788cff9640 1 -- 172.21.15.177:0/3533881315 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f78880b2070 con 0x7f7890140cf0 2023-10-25T16:15:02.801 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:15:02.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7870066470 msgr2=0x7f7870068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7870066470 0x7f7870068930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f78800058d0 tx=0x7f7880005860 comp rx=0 tx=0).stop 2023-10-25T16:15:02.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 msgr2=0x7f789013c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 0x7f789013c110 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f788801a900 tx=0x7f7888009340 comp rx=0 tx=0).stop 2023-10-25T16:15:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 shutdown_connections 2023-10-25T16:15:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7870066470 0x7f7870068930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7890140cf0 0x7f789013c110 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f789006f570 0x7f789013bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 --2- 172.21.15.177:0/3533881315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f789006c160 0x7f789013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:02.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 >> 172.21.15.177:0/3533881315 conn(0x7f78900b2450 msgr2=0x7f78900708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:02.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 shutdown_connections 2023-10-25T16:15:02.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:02.795+0000 7f789607f640 1 -- 172.21.15.177:0/3533881315 wait complete. 2023-10-25T16:15:02.818 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:15:02.818 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:15:02.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:15:02.819 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:15:02.819 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:02.820 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:15:02.820 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:15:02.820 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:15:02.821 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:15:02.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:02.821 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:15:02.828 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:15:02.828 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:15:02.828 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:15:02.829 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.829 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:15:02.829 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.829 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:15:02.829 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:02.830 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:15:02.830 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:15:02.830 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:02.830 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:15:02.831 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:15:02.831 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:02.831 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:15:02.831 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:02.831 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:15:02.831 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42415sec preferred_lft 42415sec 2023-10-25T16:15:02.832 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:15:02.832 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.832 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:15:02.832 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:02.832 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:15:02.833 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.833 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:15:02.833 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:02.833 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:15:02.833 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.834 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:15:02.834 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.834 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:15:02.834 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:02.834 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:15:02.835 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.835 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:15:02.835 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:02.835 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:15:02.835 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:02.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:02.836 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:15:02.879 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:15:02.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:02.881 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:15:02.930 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:15:02.930 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:15:02.930 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:15:02.930 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:15:02.931 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:15:02.931 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:15:02.931 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:15:02.931 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:15:02.931 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:15:02.932 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:15:02.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:02.932 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:15:02.933 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:15:02.933 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:15:02.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:15:02.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:15:02.936 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:15:03.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:03.005 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:15:03.051 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:15:03.216 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:15:03.216 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:15:03.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:03.217 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:15:03.232 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:15:03.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:15:03.232 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:03.279 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:15:03.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:15:03.280 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:03.326 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:15:03.377 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:15:03.378 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:15:03.378 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:15:03.378 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:15:03.378 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:15:03.379 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:15:03.379 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:15:03.379 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:15:03.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:15:03.379 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:15:03.380 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:15:03.380 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:15:03.380 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:15:03.381 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:15:03.381 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:15:03.381 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:15:03.381 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:15:03.381 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:15:03.382 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:15:03.382 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:15:03.382 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:15:03.382 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:15:03.383 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:15:03.383 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:15:03.383 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:15:03.383 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:15:03.384 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:15:03.384 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:15:03.384 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:15:03.384 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:03.384 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:03.385 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:03.385 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:03.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:03.386 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:15:03.435 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:15:03.435 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:15:03.480 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:15:03.486 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:15:03.487 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:15:03.487 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:15:03.487 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:15:03.487 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:15:03.487 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:15:03.488 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:15:03.488 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:15:03.488 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:15:03.488 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:15:03.488 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:15:03.488 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:15:03.489 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:15:03.489 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:15:03.489 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:15:03.489 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:15:03.489 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:15:03.490 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:15:03.490 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:15:03.490 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:15:03.490 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:15:03.490 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:15:03.491 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:15:03.491 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:15:03.491 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:15:03.491 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:15:03.491 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:15:03.491 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:15:03.492 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:15:03.492 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:03.492 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:03.492 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:03.492 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:03.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:03.494 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:15:03.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:15:03.559+0000 7f59d8f13580 -1 init, newargv = 0x55f7baa377d0 newargc=15 2023-10-25T16:15:03.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[40825]: starting ceph client 2023-10-25T16:15:03.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[40825]: starting fuse 2023-10-25T16:15:04.643 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:15:04.652 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:15:04.652 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:15:04.652 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:15:04.652 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:15:04.653 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:15:04.653 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:15:04.653 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:15:04.653 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:15:04.653 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:15:04.654 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:15:04.654 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:15:04.654 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:15:04.654 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:15:04.654 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:15:04.657 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:15:04.657 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:15:04.657 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:15:04.658 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:15:04.658 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:15:04.658 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:15:04.658 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:15:04.658 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:15:04.659 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:15:04.659 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:15:04.659 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:15:04.659 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:15:04.659 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:15:04.660 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:15:04.660 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:15:04.660 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:04.660 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:15:04.660 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:04.660 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:15:04.661 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:04.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:04.662 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:15:04.711 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:15:04.711 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:15:04.712 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:15:04.712 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:15:04.713 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:15:04.713 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:15:04.714 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:15:04.714 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:15:04.714 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:15:04.715 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:15:04.715 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:15:04.715 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:15:04.716 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:15:04.716 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:15:04.717 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:15:04.717 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:15:04.717 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:15:04.718 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:15:04.718 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:15:04.718 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:15:04.719 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:15:04.719 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:15:04.719 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:15:04.720 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:15:04.720 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:15:04.721 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:15:04.721 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:15:04.722 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:15:04.722 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:15:04.835 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.40825.asok 2023-10-25T16:15:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:04.847 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40825.asok 2023-10-25T16:15:04.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:04.848 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.40825.asok status 2023-10-25T16:15:04.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:05.042 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:05.042 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:15:05.042 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:15:05.043 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:15:05.043 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:15:05.043 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:15:05.043 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:15:05.043 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "40825", 2023-10-25T16:15:05.044 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:15:05.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:05.044 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:15:05.044 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:15:05.044 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6060, 2023-10-25T16:15:05.045 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:15:05.045 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:15:05.045 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:15:05.045 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 6060 2023-10-25T16:15:05.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:15:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:15:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2151827718 2023-10-25T16:15:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:05.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:05.047 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:15:05.047 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:05.047 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:15:05.047 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2151827718 2023-10-25T16:15:05.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:05.048 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.6060 192.168.0.1:0/2151827718", 2023-10-25T16:15:05.048 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/2151827718", 2023-10-25T16:15:05.048 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:15:05.048 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 19, 2023-10-25T16:15:05.048 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 50, 2023-10-25T16:15:05.049 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:15:05.049 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:15:05.049 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:15:05.049 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:05.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:05.061 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:05.062 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:15:05.062 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:05.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:05.109 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:15:05.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:05.116 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:05.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:05.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:05.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:05.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:05.177 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:15:05.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 -- 172.21.15.177:0/2182498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 msgr2=0x7f882406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:05.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 --2- 172.21.15.177:0/2182498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882406be90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f88240cd910 tx=0x7f881801c850 comp rx=0 tx=0).stop 2023-10-25T16:15:05.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 -- 172.21.15.177:0/2182498243 shutdown_connections 2023-10-25T16:15:05.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 --2- 172.21.15.177:0/2182498243 >> v2:172.21.15.184:3300/0 conn(0x7f88240706f0 0x7f8824070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 --2- 172.21.15.177:0/2182498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882406be90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 -- 172.21.15.177:0/2182498243 >> 172.21.15.177:0/2182498243 conn(0x7f88240b2450 msgr2=0x7f88240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:05.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 -- 172.21.15.177:0/2182498243 shutdown_connections 2023-10-25T16:15:05.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.287+0000 7f88288fe640 1 -- 172.21.15.177:0/2182498243 wait complete. 2023-10-25T16:15:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 Processor -- start 2023-10-25T16:15:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- start start 2023-10-25T16:15:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882415bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88240706f0 0x7f882413efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88241500f0 0x7f882414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882414e0e0 con 0x7f882406b9e0 2023-10-25T16:15:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b00d0 con 0x7f88241500f0 2023-10-25T16:15:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b03b0 con 0x7f88240706f0 2023-10-25T16:15:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882415bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:05.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882415bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46358/0 (socket says 172.21.15.177:46358) 2023-10-25T16:15:05.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 -- 172.21.15.177:0/3823488081 learned_addr learned my addr 172.21.15.177:0/3823488081 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:05.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 -- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88240706f0 msgr2=0x7f882413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:05.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f8821d9b640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88240706f0 0x7f882413efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:05.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f8822d9d640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88241500f0 0x7f882414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:05.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88240706f0 0x7f882413efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 -- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88241500f0 msgr2=0x7f882414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:05.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88241500f0 0x7f882414e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 -- 172.21.15.177:0/3823488081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8818009500 con 0x7f882406b9e0 2023-10-25T16:15:05.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f882259c640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882415bcc0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f881400c420 tx=0x7f881400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:05.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140052d0 con 0x7f882406b9e0 2023-10-25T16:15:05.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8814007020 con 0x7f882406b9e0 2023-10-25T16:15:05.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882414e350 con 0x7f882406b9e0 2023-10-25T16:15:05.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814007430 con 0x7f882406b9e0 2023-10-25T16:15:05.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882413f520 con 0x7f882406b9e0 2023-10-25T16:15:05.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.291+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882404daf0 con 0x7f882406b9e0 2023-10-25T16:15:05.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.295+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f88140067e0 con 0x7f882406b9e0 2023-10-25T16:15:05.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.295+0000 7f8812ffd640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8804066470 0x7f8804068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:05.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.295+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8814083520 con 0x7f882406b9e0 2023-10-25T16:15:05.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.295+0000 7f8821d9b640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8804066470 0x7f8804068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:05.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.295+0000 7f8821d9b640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8804066470 0x7f8804068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88180af000 tx=0x7f881801b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:05.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.299+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8814050960 con 0x7f882406b9e0 2023-10-25T16:15:05.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88240cd970 con 0x7f882406b9e0 2023-10-25T16:15:05.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f8812ffd640 1 -- 172.21.15.177:0/3823488081 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8814053f80 con 0x7f882406b9e0 2023-10-25T16:15:05.495 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:15:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8804066470 msgr2=0x7f8804068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8804066470 0x7f8804068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f88180af000 tx=0x7f881801b090 comp rx=0 tx=0).stop 2023-10-25T16:15:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 msgr2=0x7f882415bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882415bcc0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f881400c420 tx=0x7f881400c8e0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 shutdown_connections 2023-10-25T16:15:05.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8804066470 0x7f8804068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88241500f0 0x7f882414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88240706f0 0x7f882413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 --2- 172.21.15.177:0/3823488081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f882406b9e0 0x7f882415bcc0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:05.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 >> 172.21.15.177:0/3823488081 conn(0x7f88240b2450 msgr2=0x7f88240c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:05.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 shutdown_connections 2023-10-25T16:15:05.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:05.491+0000 7f88288fe640 1 -- 172.21.15.177:0/3823488081 wait complete. 2023-10-25T16:15:05.514 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:15:05.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:15:05.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:15:05.515 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:15:05.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:05.516 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:15:05.516 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:15:05.516 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:15:05.517 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:15:05.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.518 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:15:05.525 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:15:05.525 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:15:05.525 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:15:05.526 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.526 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:15:05.526 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.526 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:15:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:15:05.527 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:15:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:15:05.527 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:15:05.528 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:05.528 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:15:05.528 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:05.528 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:15:05.528 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-10-25T16:15:05.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:15:05.529 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.529 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:15:05.529 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:05.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:15:05.530 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.530 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:15:05.530 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:15:05.530 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:15:05.530 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.531 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:15:05.531 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.531 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:15:05.531 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:05.531 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:15:05.532 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.532 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:15:05.532 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:05.532 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:15:05.532 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:15:05.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.533 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:15:05.580 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:15:05.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.582 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:15:05.632 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:15:05.632 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:15:05.633 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:15:05.633 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:15:05.633 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:15:05.633 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:15:05.633 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:15:05.634 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:15:05.634 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:15:05.634 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:15:05.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.635 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:15:05.635 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:15:05.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:15:05.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:15:05.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:15:05.637 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:15:05.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.710 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:15:05.756 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:15:05.757 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:15:05.757 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:15:05.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:15:05.812 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:15:05.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:15:05.813 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:05.860 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:15:05.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:15:05.861 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:05.912 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:15:05.963 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:15:05.963 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:15:05.963 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:15:05.963 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:15:05.964 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:15:05.964 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:15:05.964 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:15:05.964 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:15:05.964 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:15:05.965 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:15:05.965 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:15:05.965 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:15:05.965 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:15:05.965 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:15:05.966 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:15:05.966 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:15:05.966 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:15:05.966 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:15:05.966 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:15:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:15:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:15:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:15:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:15:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:15:05.967 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:15:05.968 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:15:05.968 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:15:05.968 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:15:05.968 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:15:05.968 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:05.969 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:05.969 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:05.969 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:05.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:05.971 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:15:06.016 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:15:06.016 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:15:06.061 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:15:06.068 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:15:06.069 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:15:06.069 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:15:06.069 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:15:06.069 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:15:06.069 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:15:06.070 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:15:06.070 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:15:06.070 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:15:06.070 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:15:06.070 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:15:06.071 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:15:06.071 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:15:06.071 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:15:06.071 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:15:06.071 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:15:06.071 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:15:06.072 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:15:06.072 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:15:06.072 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:15:06.072 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:15:06.072 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:15:06.073 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:15:06.073 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:15:06.073 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:15:06.073 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:15:06.073 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:15:06.074 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:15:06.074 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:15:06.074 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:06.074 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:06.074 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:06.074 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:06.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:06.075 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:15:06.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:15:06.141+0000 7fd88ab32580 -1 init, newargv = 0x56178aa98200 newargc=15 2023-10-25T16:15:06.147 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34238]: starting ceph client 2023-10-25T16:15:06.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34238]: starting fuse 2023-10-25T16:15:07.221 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:15:07.229 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:15:07.229 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:15:07.230 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:15:07.230 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:15:07.230 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:15:07.230 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:15:07.231 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:15:07.231 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:15:07.231 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:15:07.231 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:15:07.231 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:15:07.232 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:15:07.232 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:15:07.232 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:15:07.232 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:15:07.232 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:15:07.233 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:15:07.233 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:15:07.233 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:15:07.233 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:15:07.233 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:15:07.234 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:15:07.234 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:15:07.234 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:15:07.234 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:15:07.234 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:15:07.235 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:15:07.235 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:15:07.235 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:15:07.235 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:07.235 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:15:07.236 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:07.236 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:15:07.236 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:07.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:07.238 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:15:07.285 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:15:07.285 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:15:07.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:15:07.286 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:15:07.286 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:15:07.287 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:15:07.287 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:15:07.287 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:15:07.288 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:15:07.288 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:15:07.289 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:15:07.289 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:15:07.289 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:15:07.290 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:15:07.290 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:15:07.290 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:15:07.291 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:15:07.291 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:15:07.292 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:15:07.292 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:15:07.292 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:15:07.293 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:15:07.293 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:15:07.293 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:15:07.294 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:15:07.294 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:15:07.294 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:15:07.295 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:15:07.295 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:15:07.410 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.34238.asok 2023-10-25T16:15:07.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:07.422 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34238.asok 2023-10-25T16:15:07.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:07.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.34238.asok status 2023-10-25T16:15:07.514 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:07.617 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:15:07.617 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:15:07.618 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:15:07.618 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:15:07.618 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:15:07.618 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:15:07.618 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:15:07.619 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "34238", 2023-10-25T16:15:07.619 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:15:07.619 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:15:07.619 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:15:07.619 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:15:07.620 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 154922, 2023-10-25T16:15:07.620 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:15:07.620 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:15:07.620 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:15:07.620 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 154922 2023-10-25T16:15:07.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:15:07.621 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:15:07.621 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:15:07.621 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:15:07.621 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1606833956 2023-10-25T16:15:07.622 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:15:07.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:15:07.622 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:15:07.622 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:15:07.622 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:15:07.623 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1606833956 2023-10-25T16:15:07.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:15:07.623 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.154922 192.168.0.1:0/1606833956", 2023-10-25T16:15:07.623 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/1606833956", 2023-10-25T16:15:07.623 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:15:07.624 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 19, 2023-10-25T16:15:07.624 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 50, 2023-10-25T16:15:07.624 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:15:07.624 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:15:07.624 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:15:07.625 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:15:07.629 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:07.636 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:07.637 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:15:07.638 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:07.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:07.687 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:15:07.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:07.694 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:07.695 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:07.695 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:07.738 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:07.738 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:07.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:07.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 -- 172.21.15.177:0/2348709383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741594a0 msgr2=0x7f19740cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:07.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 --2- 172.21.15.177:0/2348709383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741594a0 0x7f19740cd5c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1974071ab0 tx=0x7f196c01cc90 comp rx=0 tx=0).stop 2023-10-25T16:15:07.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 -- 172.21.15.177:0/2348709383 shutdown_connections 2023-10-25T16:15:07.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 --2- 172.21.15.177:0/2348709383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741594a0 0x7f19740cd5c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:07.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 --2- 172.21.15.177:0/2348709383 >> v2:172.21.15.184:3300/0 conn(0x7f19741590c0 0x7f19740c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:07.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 -- 172.21.15.177:0/2348709383 >> 172.21.15.177:0/2348709383 conn(0x7f19740cefe0 msgr2=0x7f19740cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:07.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 -- 172.21.15.177:0/2348709383 shutdown_connections 2023-10-25T16:15:07.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.875+0000 7f19791b4640 1 -- 172.21.15.177:0/2348709383 wait complete. 2023-10-25T16:15:07.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 Processor -- start 2023-10-25T16:15:07.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 -- start start 2023-10-25T16:15:07.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 0x7f19740b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:07.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19741594a0 0x7f19740b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:07.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f197415cec0 0x7f197406e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:07.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19740b4a60 con 0x7f19741590c0 2023-10-25T16:15:07.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19741f8ce0 con 0x7f19741594a0 2023-10-25T16:15:07.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19741f8fc0 con 0x7f197415cec0 2023-10-25T16:15:07.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 0x7f19740b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:07.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 0x7f19740b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46376/0 (socket says 172.21.15.177:46376) 2023-10-25T16:15:07.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 -- 172.21.15.177:0/3377996199 learned_addr learned my addr 172.21.15.177:0/3377996199 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:07.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f197359e640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f197415cec0 0x7f197406e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:07.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f197259c640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19741594a0 0x7f19740b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:07.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 -- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f197415cec0 msgr2=0x7f197406e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:07.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f197415cec0 0x7f197406e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:07.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 -- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19741594a0 msgr2=0x7f19740b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:07.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19741594a0 0x7f19740b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:07.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 -- 172.21.15.177:0/3377996199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0098e0 con 0x7f19741590c0 2023-10-25T16:15:07.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f197359e640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f197415cec0 0x7f197406e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:07.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f197259c640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19741594a0 0x7f19740b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:07.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f1972d9d640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 0x7f19740b4520 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f196800d980 tx=0x7f196800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:07.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968009c30 con 0x7f19741590c0 2023-10-25T16:15:07.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1968005020 con 0x7f19741590c0 2023-10-25T16:15:07.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968005430 con 0x7f19741590c0 2023-10-25T16:15:07.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19741f92a0 con 0x7f19741590c0 2023-10-25T16:15:07.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.879+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197406a830 con 0x7f19741590c0 2023-10-25T16:15:07.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.883+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197406a9c0 con 0x7f19741590c0 2023-10-25T16:15:07.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.883+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19680047b0 con 0x7f19741590c0 2023-10-25T16:15:07.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.883+0000 7f195b7fe640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19600664a0 0x7f1960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:07.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.883+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f19680840e0 con 0x7f19741590c0 2023-10-25T16:15:07.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.883+0000 7f197259c640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19600664a0 0x7f1960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:07.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.883+0000 7f197259c640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19600664a0 0x7f1960068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f197406c360 tx=0x7f1964008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:07.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:07.887+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1968051520 con 0x7f19741590c0 2023-10-25T16:15:08.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.075+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f197404daf0 con 0x7f19741590c0 2023-10-25T16:15:08.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.075+0000 7f195b7fe640 1 -- 172.21.15.177:0/3377996199 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f1968020090 con 0x7f19741590c0 2023-10-25T16:15:08.082 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:08.083 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:08.084 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:08.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19600664a0 msgr2=0x7f1960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:08.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19600664a0 0x7f1960068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f197406c360 tx=0x7f1964008040 comp rx=0 tx=0).stop 2023-10-25T16:15:08.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 msgr2=0x7f19740b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:08.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 0x7f19740b4520 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f196800d980 tx=0x7f196800de40 comp rx=0 tx=0).stop 2023-10-25T16:15:08.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 shutdown_connections 2023-10-25T16:15:08.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19600664a0 0x7f1960068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:08.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f197415cec0 0x7f197406e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:08.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19741594a0 0x7f19740b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 --2- 172.21.15.177:0/3377996199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19741590c0 0x7f19740b4520 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 >> 172.21.15.177:0/3377996199 conn(0x7f19740cefe0 msgr2=0x7f19740b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:08.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 shutdown_connections 2023-10-25T16:15:08.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:08.079+0000 7f19791b4640 1 -- 172.21.15.177:0/3377996199 wait complete. 2023-10-25T16:15:08.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:15:08.247 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":5859,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":19.387802059999999,"mdsmap_epoch":19,"osdmap_epoch":50,"osdmap_epoch_barrier":48,"uptime":24.049273005} 2023-10-25T16:15:08.248 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 5859, "mdsmap_epoch": 19, "osdmap_epoch": 50, "osdmap_epoch_barrier": 48, "rank_uptime": 19.38780206, "state": "up:active", "uptime": 24.049273005, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:15:08.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:15:08.386 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:15:08.387 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:15:08.387 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-25T16:15:08.388 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:08.388 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:08.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:08.394 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-25T16:15:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:265+0 records in 2023-10-25T16:15:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:265+0 records out 2023-10-25T16:15:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:277872640 bytes (278 MB, 265 MiB) copied, 2.77718 s, 100 MB/s 2023-10-25T16:15:11.229 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:11.229 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:11.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:11.236 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-25T16:15:13.329 INFO:teuthology.orchestra.run.smithi177.stderr:292+0 records in 2023-10-25T16:15:13.330 INFO:teuthology.orchestra.run.smithi177.stderr:292+0 records out 2023-10-25T16:15:13.330 INFO:teuthology.orchestra.run.smithi177.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.04036 s, 150 MB/s 2023-10-25T16:15:13.332 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-25T16:15:13.333 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:13.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- 172.21.15.177:0/3391717414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff07806c160 msgr2=0x7ff0780af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:13.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/3391717414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff07806c160 0x7ff0780af5d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0098f0 tx=0x7ff06c01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- 172.21.15.177:0/3391717414 shutdown_connections 2023-10-25T16:15:13.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/3391717414 >> v2:172.21.15.184:3300/0 conn(0x7ff07806f570 0x7ff0780cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/3391717414 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff07806c160 0x7ff0780af5d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- 172.21.15.177:0/3391717414 >> 172.21.15.177:0/3391717414 conn(0x7ff0780b2450 msgr2=0x7ff0780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:13.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- 172.21.15.177:0/3391717414 shutdown_connections 2023-10-25T16:15:13.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- 172.21.15.177:0/3391717414 wait complete. 2023-10-25T16:15:13.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 Processor -- start 2023-10-25T16:15:13.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- start start 2023-10-25T16:15:13.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff07806c160 0x7ff07813c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:13.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff07806f570 0x7ff078156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:13.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 0x7ff0781f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:13.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0781559b0 con 0x7ff078140cf0 2023-10-25T16:15:13.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff078155c90 con 0x7ff07806c160 2023-10-25T16:15:13.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07e6a2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff078155f70 con 0x7ff07806f570 2023-10-25T16:15:13.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07cc3f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 0x7ff0781f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:13.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07cc3f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 0x7ff0781f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43074/0 (socket says 172.21.15.177:43074) 2023-10-25T16:15:13.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff07cc3f640 1 -- 172.21.15.177:0/762640871 learned_addr learned my addr 172.21.15.177:0/762640871 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:13.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.459+0000 7ff077fff640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff07806c160 0x7ff07813c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:13.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff0777fe640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff07806f570 0x7ff078156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:13.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07cc3f640 1 -- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff07806f570 msgr2=0x7ff078156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:13.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07cc3f640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff07806f570 0x7ff078156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07cc3f640 1 -- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff07806c160 msgr2=0x7ff07813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:13.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07cc3f640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff07806c160 0x7ff07813c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07cc3f640 1 -- 172.21.15.177:0/762640871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009500 con 0x7ff078140cf0 2023-10-25T16:15:13.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff077fff640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff07806c160 0x7ff07813c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:13.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff0777fe640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff07806f570 0x7ff078156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:13.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07cc3f640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 0x7ff0781f2960 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff07000ea20 tx=0x7ff07000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:13.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000cde0 con 0x7ff078140cf0 2023-10-25T16:15:13.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff070004c40 con 0x7ff078140cf0 2023-10-25T16:15:13.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070005020 con 0x7ff078140cf0 2023-10-25T16:15:13.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff078156250 con 0x7ff078140cf0 2023-10-25T16:15:13.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07813cbb0 con 0x7ff078140cf0 2023-10-25T16:15:13.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07804daf0 con 0x7ff078140cf0 2023-10-25T16:15:13.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff070005180 con 0x7ff078140cf0 2023-10-25T16:15:13.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff074ff9640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff064066470 0x7ff064068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:13.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff070084990 con 0x7ff078140cf0 2023-10-25T16:15:13.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff077fff640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff064066470 0x7ff064068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:13.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.463+0000 7ff077fff640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff064066470 0x7ff064068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff06800a850 tx=0x7ff068008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:13.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.467+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff070051d30 con 0x7ff078140cf0 2023-10-25T16:15:13.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.623+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff0780ca670 con 0x7ff078140cf0 2023-10-25T16:15:13.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff074ff9640 1 -- 172.21.15.177:0/762640871 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+34403 (secure 0 0 0) 0x7ff07001f070 con 0x7ff078140cf0 2023-10-25T16:15:13.631 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:13.631 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:13.631 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 50, 2023-10-25T16:15:13.631 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:13.631 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:13.632 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:14:55.577682+0000", 2023-10-25T16:15:13.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:13.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:13.632 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:13.632 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:13.633 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:13.633 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:13.633 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:13.633 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:13.633 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:13.634 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:13.634 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:13.634 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:13.634 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:13.634 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:13.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:13.635 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:13.635 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:13.635 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:13.635 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:13.636 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:13.636 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:13.636 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:13.636 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.636 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:13.636 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:13.637 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:13.637 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:13.637 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:13.637 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:13.637 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:13.638 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:13.638 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:13.638 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:13.638 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:13.638 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:13.638 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:13.639 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:13.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:13.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:13.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:13.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:13.640 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:13.640 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:13.640 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:13.640 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:13.640 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:13.641 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:13.641 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:13.641 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:13.641 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:13.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.641 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "17", 2023-10-25T16:15:13.642 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:13.642 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:13.642 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:13.642 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:13.642 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:13.643 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:13.643 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:13.643 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:13.643 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:13.643 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:13.644 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:13.644 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:13.644 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:13.644 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:13.644 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:13.645 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:13.645 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:13.645 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:13.645 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:13.645 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:13.645 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:13.646 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:13.646 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:13.646 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:13.646 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:13.646 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:13.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.647 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:13.647 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:13.647 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:13.647 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:13.648 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:13.648 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:13.648 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:13.648 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:13.648 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:13.648 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:13.649 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:13.649 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:13.649 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:13.649 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:13.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.649 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:13.650 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:13.650 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.650 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:13.650 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:13.650 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:13.651 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:13.651 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:13.651 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:13.651 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:13.651 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:13.652 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:13.652 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:13.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:13.653 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:13.653 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:13.653 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:13.653 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:13.653 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:13.654 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:13.654 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:13.654 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:13.654 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:13.654 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:13.655 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:13.655 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:13.655 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:13.655 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:13.655 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:13.655 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:13.656 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:13.656 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:13.656 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:13.656 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:13.656 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:13.657 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:13.657 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:13.657 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:13.657 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:13.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.658 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "47", 2023-10-25T16:15:13.658 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:13.658 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:13.658 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:13.658 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:13.659 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:13.659 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:13.659 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:13.659 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:13.659 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:13.659 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:13.660 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:13.660 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:13.660 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:13.660 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:13.660 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:13.661 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:13.661 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:13.661 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:13.661 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:13.661 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:13.661 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:13.662 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:13.662 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:13.662 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:13.662 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:13.662 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:13.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.663 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:13.663 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:13.663 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:13.663 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:13.665 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:13.665 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:13.665 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:13.665 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:13.666 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:13.666 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:13.666 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:13.666 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:13.666 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:13.667 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:13.667 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:13.667 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.667 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:13.667 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:13.667 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:13.668 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.668 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:13.668 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:13.668 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:13.669 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:13.670 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.670 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:13.670 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:13.671 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:13.671 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:13.671 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:13.671 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:13.671 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:13.671 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:13.672 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:13.672 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:13.672 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:13.672 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:13.672 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:13.673 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:13.673 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:13.673 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:13.673 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:13.673 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:13.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:13.674 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:13.674 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:13.674 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:13.674 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:13.674 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:13.675 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:13.675 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:13.675 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:13.675 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.675 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "48", 2023-10-25T16:15:13.676 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:13.676 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:13.676 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:13.676 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:13.676 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:13.677 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:13.677 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:13.677 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:13.677 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:13.677 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:13.677 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:13.678 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:13.678 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:13.678 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:13.678 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:13.678 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:13.679 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:13.679 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:13.679 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:13.679 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:13.679 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:13.680 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:13.680 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:13.680 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:13.680 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:13.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:13.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.681 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:13.681 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:13.681 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:13.681 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:13.681 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:13.682 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:13.682 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:13.682 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:13.682 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:13.682 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:13.682 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:13.683 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:13.683 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:13.683 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:13.683 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.683 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:13.684 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:13.684 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:13.684 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.684 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:13.685 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:13.685 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:13.685 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:13.685 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:13.685 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:13.686 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:13.686 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:13.686 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:13.686 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.686 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.686 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:13.687 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:13.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.687 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:13.687 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.687 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.688 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.688 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.688 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.688 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.688 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.688 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.689 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:13.689 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.689 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.689 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.690 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.690 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:13.690 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.691 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.691 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:13.691 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.691 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.691 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.692 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.692 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.692 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.692 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.692 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:13.693 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.693 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.693 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:13.694 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.694 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.694 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.694 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.695 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.695 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.695 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.695 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:13.695 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.696 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.696 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:13.696 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.696 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.696 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.697 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.697 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.697 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.698 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:13.698 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.698 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.698 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.698 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:13.699 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:13.699 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.699 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.699 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:13.700 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:13.700 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:13.700 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:13.700 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.700 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.700 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.701 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.701 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:13.701 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.702 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.702 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.702 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.702 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.702 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.703 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.703 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.703 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:13.703 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.703 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.703 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.704 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.704 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:13.704 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.705 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:13.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.705 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.706 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.706 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.706 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.707 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.707 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:13.707 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.707 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.707 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.708 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.708 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:13.708 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.708 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.708 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.708 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.709 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.709 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:13.710 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.710 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.710 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.710 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:13.710 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.711 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.711 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.711 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.711 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.712 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.712 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:13.712 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.713 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.713 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:13.713 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:13.713 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.713 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.714 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:13.714 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:13.714 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:13.714 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:13.715 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.715 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.715 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.715 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.715 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.716 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:13.716 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.716 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.716 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.716 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.716 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.717 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.717 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.717 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:13.717 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:13.717 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.717 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.718 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.718 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.718 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:13.719 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.719 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.719 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.719 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:13.720 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.720 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.720 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.720 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.720 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.720 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.721 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.721 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.721 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:13.721 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.721 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.722 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.722 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.722 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:13.722 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.722 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.723 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.723 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.723 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.723 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.723 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.723 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.724 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:13.724 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.724 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.724 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.724 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.725 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:13.725 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.725 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.725 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.725 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.725 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.726 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.726 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.726 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.726 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:13.726 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.728 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.728 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:13.728 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:13.728 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:13.729 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:13.729 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.729 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.729 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.729 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.729 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.730 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:13.730 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.730 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.730 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.731 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:13.732 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.732 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.732 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.732 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.732 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.733 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.733 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:13.733 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.733 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.733 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.733 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.734 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:13.734 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.734 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.734 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.734 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.735 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.735 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.735 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.735 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.735 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:13.736 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.736 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.736 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.736 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.736 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:13.736 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.737 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.737 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.737 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.737 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.737 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.738 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.738 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:13.738 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.738 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.739 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.739 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:13.739 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.739 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.739 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.740 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:13.741 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.741 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.741 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:13.742 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:13.742 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.742 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.742 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:13.743 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:13.743 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:13.743 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:13.743 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.743 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.743 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.744 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.744 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.744 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.744 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:13.744 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.745 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.745 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.745 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.745 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.745 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.745 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.746 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.746 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:13.746 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.746 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.746 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.747 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.747 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.747 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:13.747 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.748 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.748 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.748 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:13.748 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.748 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.749 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.749 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.749 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.749 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.749 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.749 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.750 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:13.750 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.750 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.750 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.751 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:13.751 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.751 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.751 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.751 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.751 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.752 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.752 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.752 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:13.752 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.753 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.753 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.753 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:13.753 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.753 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.755 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.755 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:13.755 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.755 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.755 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.756 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:13.756 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:13.756 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.756 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.757 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:13.757 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:13.757 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:13.757 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:13.757 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.758 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.758 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.758 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.758 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.758 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.758 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:13.759 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.759 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.759 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.759 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.759 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.760 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.760 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.760 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.760 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:13.760 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.761 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.761 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.761 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.761 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.761 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.761 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:13.762 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.762 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.762 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.762 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:13.763 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.763 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.763 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.763 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.764 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.764 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.764 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:13.764 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.765 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.765 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.765 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:13.765 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.765 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.766 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.766 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.766 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.766 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.766 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.766 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.767 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:13.767 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.767 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.767 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.768 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:13.768 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.768 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.768 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.768 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.769 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.769 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.769 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.769 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.769 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:13.769 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.770 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.770 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.770 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.770 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:13.770 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:13.771 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.771 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.771 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.771 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:13.771 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:13.772 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:13.772 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:13.772 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.772 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.772 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.772 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.773 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.773 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.773 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:13.773 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.773 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.774 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.774 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.774 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.774 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.774 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.774 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.775 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:13.775 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.775 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.775 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.775 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.776 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.776 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.776 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:13.776 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.776 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.776 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.777 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.777 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:13.777 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.777 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.777 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.778 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.778 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.778 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.778 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.778 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.778 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:13.779 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.779 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.779 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.779 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.779 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:13.780 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.780 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.780 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.780 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.780 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.780 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.781 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.781 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.781 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:13.781 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.782 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.782 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.782 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:13.782 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.782 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.782 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.783 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.783 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.783 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.783 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.783 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.784 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:13.784 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.784 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.784 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.784 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.784 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:13.785 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:13.785 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.785 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.785 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:13.786 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:13.786 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:13.786 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:13.786 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.786 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.787 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.787 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.787 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.787 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.787 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:13.787 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:13.788 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:13.788 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:13.788 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:13.788 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:13.788 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:13.789 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:13.789 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:13.789 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:13.789 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:13.789 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:13.790 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:13.790 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.790 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.790 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.790 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:13.790 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.791 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.791 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.791 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.791 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:13.791 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.792 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.792 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.792 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.792 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:13.792 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.792 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.793 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.793 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:13.793 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.793 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.793 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.793 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.794 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:13.794 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.794 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.794 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.795 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:13.795 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.795 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.795 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.795 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:13.796 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.796 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.796 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.796 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.796 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:13.796 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.797 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.797 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.797 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.797 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:13.797 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:13.798 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.798 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:13.798 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:13.798 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.799 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.800 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:13.800 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:13.800 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:13.800 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:13.801 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:13.801 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:13.801 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:13.801 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.801 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.801 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:13.802 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:13.802 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.802 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:13.802 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.802 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.803 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.803 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.803 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.803 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:13.803 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.803 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.804 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.804 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:13.804 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.804 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.804 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.805 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.805 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.805 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:13.805 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.805 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.806 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.806 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:13.806 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.806 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.806 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.806 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.807 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.807 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:13.807 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.807 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.807 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.808 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:13.808 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.808 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.808 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.808 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.808 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.809 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:13.809 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.809 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.809 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.809 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:13.809 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.810 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.810 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.810 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.810 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.810 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:13.811 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.811 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:13.811 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.811 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.812 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.812 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.812 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.812 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:13.812 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.813 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.813 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.813 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:13.813 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.813 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.814 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.814 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.814 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.814 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:13.814 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.815 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.815 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.815 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:13.815 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:13.815 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:13.815 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:13.816 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:13.816 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:13.816 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:13.816 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:13.816 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.817 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:13.817 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:13.817 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:13.817 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.817 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:13.817 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:13.818 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.818 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:13.818 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:13.818 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.818 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.819 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:13.819 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:13.819 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:13.819 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:13.820 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:13.820 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.820 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:13.820 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.820 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:13.820 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:13.821 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:13.821 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:13.821 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:13.821 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:13.821 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:13.822 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:13.822 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:13.822 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:13.822 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:13.822 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:13.822 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:13.823 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:13.823 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:13.823 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:13.823 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:13.824 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:13.824 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:13.824 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:13.824 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:13.824 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:13.824 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:13.825 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:13.825 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:13.825 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:13.825 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff064066470 msgr2=0x7ff064068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff064066470 0x7ff064068930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff06800a850 tx=0x7ff068008040 comp rx=0 tx=0).stop 2023-10-25T16:15:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 msgr2=0x7ff0781f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 0x7ff0781f2960 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff07000ea20 tx=0x7ff07000eee0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 shutdown_connections 2023-10-25T16:15:13.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff064066470 0x7ff064068930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff078140cf0 0x7ff0781f2960 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff07806f570 0x7ff078156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 --2- 172.21.15.177:0/762640871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff07806c160 0x7ff07813c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:13.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 >> 172.21.15.177:0/762640871 conn(0x7ff0780b2450 msgr2=0x7ff07815a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:13.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 shutdown_connections 2023-10-25T16:15:13.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:13.627+0000 7ff07e6a2640 1 -- 172.21.15.177:0/762640871 wait complete. 2023-10-25T16:15:13.830 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:15:14.590 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:15:14.587+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-25T16:15:18.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:18.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/3370463862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 msgr2=0x7fc0fc071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:18.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- 172.21.15.177:0/3370463862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc071500 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc06c6a0 tx=0x7fc0ec01c870 comp rx=0 tx=0).stop 2023-10-25T16:15:18.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/3370463862 shutdown_connections 2023-10-25T16:15:18.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- 172.21.15.177:0/3370463862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0fc0cc610 0x7fc0fc06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:18.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- 172.21.15.177:0/3370463862 >> v2:172.21.15.184:3300/0 conn(0x7fc0fc070510 0x7fc0fc0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:18.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- 172.21.15.177:0/3370463862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc071500 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:18.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/3370463862 >> 172.21.15.177:0/3370463862 conn(0x7fc0fc0b2450 msgr2=0x7fc0fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:18.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/3370463862 shutdown_connections 2023-10-25T16:15:18.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/3370463862 wait complete. 2023-10-25T16:15:18.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 Processor -- start 2023-10-25T16:15:18.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- start start 2023-10-25T16:15:18.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0fc070510 0x7fc0fc1f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:18.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0fc0cc610 0x7fc0fc163780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:18.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:18.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc157a20 con 0x7fc0fc159230 2023-10-25T16:15:18.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc157eb0 con 0x7fc0fc070510 2023-10-25T16:15:18.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc156e10 con 0x7fc0fc0cc610 2023-10-25T16:15:18.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:18.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43094/0 (socket says 172.21.15.177:43094) 2023-10-25T16:15:18.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 -- 172.21.15.177:0/127015453 learned_addr learned my addr 172.21.15.177:0/127015453 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:18.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0f9d9b640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0fc0cc610 0x7fc0fc163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:18.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fa59c640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0fc070510 0x7fc0fc1f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:18.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 -- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0fc0cc610 msgr2=0x7fc0fc163780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:18.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0fc0cc610 0x7fc0fc163780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:18.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 -- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0fc070510 msgr2=0x7fc0fc1f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:18.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0fc070510 0x7fc0fc1f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:18.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 -- 172.21.15.177:0/127015453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec009560 con 0x7fc0fc159230 2023-10-25T16:15:18.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0fad9d640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc156710 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400ccb0 tx=0x7fc0f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:18.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4004b30 con 0x7fc0fc159230 2023-10-25T16:15:18.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc0f4004da0 con 0x7fc0fc159230 2023-10-25T16:15:18.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc1570f0 con 0x7fc0fc159230 2023-10-25T16:15:18.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4005280 con 0x7fc0fc159230 2023-10-25T16:15:18.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.963+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc1576b0 con 0x7fc0fc159230 2023-10-25T16:15:18.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc157b90 con 0x7fc0fc159230 2023-10-25T16:15:18.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0f40053e0 con 0x7fc0fc159230 2023-10-25T16:15:18.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc0eaffd640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0dc066470 0x7fc0dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:18.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc0f4084a50 con 0x7fc0fc159230 2023-10-25T16:15:18.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7fc0dc06e060 con 0x7fc0fc159230 2023-10-25T16:15:18.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc0fa59c640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0dc066470 0x7fc0dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:18.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.967+0000 7fc0fa59c640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0dc066470 0x7fc0dc068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0af000 tx=0x7fc0ec01b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:18.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:18.971+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0f401d020 con 0x7fc0fc159230 2023-10-25T16:15:19.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.123+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc0fc04daf0 con 0x7fc0fc159230 2023-10-25T16:15:19.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc0eaffd640 1 -- 172.21.15.177:0/127015453 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+34546 (secure 0 0 0) 0x7fc0f4051f40 con 0x7fc0fc159230 2023-10-25T16:15:19.131 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:19.132 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:19.132 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 53, 2023-10-25T16:15:19.132 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:19.132 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:19.132 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:15:18.623173+0000", 2023-10-25T16:15:19.133 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:19.133 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:19.133 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:19.133 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:19.133 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:19.134 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:19.134 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:19.134 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:19.134 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:19.134 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.135 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:19.135 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:19.135 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:19.135 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:19.135 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:19.136 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:19.136 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:19.136 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:19.136 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:19.136 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:19.137 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:19.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:19.137 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:19.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:19.138 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:19.138 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:19.138 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:19.138 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:19.138 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:19.139 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:19.139 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:19.139 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:19.139 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:19.139 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:19.140 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:19.140 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:19.140 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:19.140 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:19.140 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:19.140 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:19.141 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:19.141 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:19.141 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:19.141 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:19.141 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:19.142 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:19.142 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:19.142 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:19.142 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:19.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.143 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:19.143 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:19.143 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:19.143 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:19.143 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:19.144 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:19.144 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:19.145 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:19.145 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:19.146 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:19.146 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:19.146 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:19.146 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:19.147 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:19.147 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:19.147 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:19.147 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:19.147 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:19.148 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:19.148 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:19.148 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:19.148 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:19.148 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:19.149 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:19.149 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:19.149 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:19.149 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:19.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.150 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:19.150 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:19.150 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:19.150 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:19.150 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:19.151 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:19.151 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:19.151 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:19.151 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:19.151 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:19.152 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:19.152 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:19.152 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:19.152 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:19.152 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.153 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:19.154 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:19.154 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:19.154 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:19.154 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:19.154 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:19.155 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:19.155 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:19.155 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:19.155 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.155 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.156 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.156 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:19.156 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:19.156 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:19.157 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:19.157 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:19.157 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:19.157 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:19.157 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:19.158 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:19.158 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:19.158 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:19.158 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:19.158 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:19.159 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:19.159 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:19.159 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:19.159 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:19.159 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:19.160 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:19.160 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:19.160 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:19.160 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:19.160 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:19.161 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:19.161 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:19.161 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:19.161 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:19.162 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.162 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:19.162 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:19.162 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:19.162 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:19.163 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:19.163 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:19.163 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:19.163 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:19.163 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:19.164 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:19.164 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:19.164 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:19.164 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:19.164 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:19.165 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:19.165 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:19.165 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:19.165 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:19.165 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:19.166 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:19.166 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:19.167 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:19.167 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:19.167 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:19.168 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:19.168 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:19.168 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:19.168 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.168 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:19.169 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:19.169 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:19.169 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:19.169 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:19.169 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:19.170 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:19.170 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:19.170 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:19.170 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:19.170 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:19.171 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:19.171 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:19.171 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:19.171 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:19.171 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.172 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:19.172 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:19.172 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:19.172 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.172 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.172 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:19.173 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:19.173 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:19.173 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:19.173 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:19.174 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:19.174 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:19.174 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:19.174 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:19.174 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.175 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.175 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:19.175 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:19.176 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:19.176 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:19.176 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:19.176 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:19.176 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:19.176 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:19.177 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:19.177 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:19.177 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:19.177 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:19.177 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:19.178 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:19.178 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:19.178 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:19.178 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:19.178 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:19.179 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:19.179 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:19.179 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:19.179 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:19.179 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:19.180 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:19.180 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:19.180 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:19.180 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:19.181 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.181 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:19.181 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:19.181 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:19.181 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:19.182 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:19.182 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:19.182 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:19.182 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:19.182 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:19.183 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:19.183 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:19.183 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:19.183 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:19.184 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:19.184 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:19.184 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:19.184 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:19.185 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:19.185 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:19.185 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:19.185 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:19.185 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:19.186 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:19.186 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:19.186 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:19.186 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:19.186 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:19.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.187 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:19.187 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:19.187 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:19.188 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:19.188 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:19.188 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:19.188 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:19.189 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:19.189 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:19.189 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:19.189 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:19.189 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:19.190 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:19.190 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:19.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.190 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:19.190 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:19.191 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:19.191 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.191 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:19.191 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:19.191 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:19.192 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:19.192 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:19.192 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:19.193 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:19.193 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:19.194 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:19.194 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.194 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.194 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.194 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:19.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.195 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:19.196 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.196 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.196 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.196 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.196 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.196 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.197 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.197 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.197 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.197 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.197 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.198 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.198 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.198 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.198 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.202 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:19.202 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.202 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.203 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:19.203 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.204 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.204 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.204 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.204 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.205 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:19.205 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.206 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.206 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:19.206 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.206 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.206 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.207 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.207 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.207 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.207 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:19.208 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.208 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:19.209 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.209 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.209 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.209 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.210 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.210 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.210 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:19.210 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.211 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.211 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.211 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.211 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:19.211 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.212 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.212 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.212 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:19.212 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:19.212 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:19.213 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:19.213 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.213 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.213 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.214 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.214 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.214 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:19.215 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.215 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.215 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.215 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.215 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.216 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.216 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.216 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.216 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.216 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.217 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.217 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.217 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.218 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.218 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:19.218 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.218 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.219 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:19.219 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.219 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.219 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.220 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:19.221 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.221 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:19.221 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.222 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.222 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.222 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.222 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.223 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:19.223 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.223 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.224 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:19.224 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.225 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.225 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.225 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.225 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.226 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.226 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:19.226 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.227 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.227 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:19.227 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.227 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.228 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.228 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.228 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:19.228 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:19.228 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:19.228 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:19.229 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.229 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.229 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.229 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.230 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.230 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:19.230 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.230 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.230 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.231 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.231 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.231 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.231 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.231 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:19.231 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.232 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.232 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.232 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.232 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.233 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.233 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:19.233 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.233 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.234 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.234 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:19.234 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.234 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.235 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.235 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.236 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.236 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:19.236 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.237 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.237 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:19.237 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.237 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.237 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.238 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.238 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.238 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.238 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:19.239 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.239 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.239 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.239 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:19.239 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.240 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.240 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.240 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.240 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.241 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.241 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:19.241 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.242 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:19.242 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.242 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.242 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.243 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:19.243 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:19.243 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:19.243 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:19.244 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.244 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.244 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.244 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.245 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.245 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:19.245 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.246 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.246 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.246 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.246 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.246 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.247 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.247 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.247 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.247 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.247 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.247 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.248 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.248 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.248 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:19.248 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.249 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.249 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:19.249 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.249 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.250 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.250 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.250 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.250 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:19.251 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.251 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.251 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.253 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.253 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:19.253 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.254 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.254 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.254 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.254 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:19.255 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.255 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.255 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.255 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.255 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.256 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.256 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:19.256 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.257 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.257 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.257 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.257 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:19.257 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.257 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.258 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.258 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.258 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:19.258 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:19.258 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:19.259 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:19.259 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.259 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:15:19.259 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.259 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.260 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.260 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.260 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.260 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:19.260 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.260 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.261 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.261 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.261 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.261 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.261 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.261 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.262 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.262 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.262 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.262 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.262 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.263 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.263 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.263 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:19.263 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.263 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.263 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.264 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.264 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:19.264 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.264 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.264 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.265 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.265 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.265 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.265 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.266 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.266 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:19.266 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.266 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.267 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.267 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:19.267 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.267 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.267 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.268 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.268 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.268 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.268 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.268 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.269 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:19.269 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.269 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.269 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.269 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.269 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:19.270 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.270 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.270 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.270 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.270 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.271 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.271 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.271 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.271 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:19.271 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.271 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.272 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.272 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.272 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:19.272 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.272 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.273 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.273 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.273 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:19.273 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:19.273 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:19.273 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:19.274 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.274 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.274 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.274 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.274 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.275 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.275 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:19.276 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.276 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.276 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.276 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.277 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.277 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.277 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.277 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.277 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:19.278 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.278 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.278 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.278 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.278 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.278 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.279 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:19.279 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.279 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.279 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.279 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.280 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:19.280 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.280 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.280 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.280 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.280 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.281 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.281 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.281 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.281 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:19.281 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.282 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.282 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.282 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.282 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:19.282 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.283 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.283 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.283 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.283 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.283 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.283 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.284 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:19.284 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.284 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.284 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.285 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.286 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:19.286 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.286 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.286 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.287 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.287 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.287 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.287 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.287 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.287 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:19.288 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.288 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.288 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.288 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.288 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:19.289 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.289 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.289 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.289 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.290 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:19.290 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:19.290 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:19.290 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:19.290 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.291 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.291 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.291 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.291 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.291 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.292 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:19.292 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.292 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.292 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.292 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.293 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.293 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.293 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.293 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.293 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:19.294 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.294 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.294 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.294 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.294 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.294 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.295 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:19.295 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.295 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.295 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.296 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.296 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:19.296 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.296 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.296 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.297 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.297 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.297 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.297 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.297 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.298 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:19.298 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.298 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.298 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.298 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.299 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:19.299 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.299 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.299 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.299 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.300 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.300 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.300 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.300 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.300 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:19.300 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.301 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.301 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.301 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.301 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:19.301 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.302 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.302 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.302 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.302 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.302 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.303 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.303 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.303 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:19.303 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.303 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.304 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.304 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.304 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:19.304 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.304 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.304 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.305 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.305 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:19.305 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:19.305 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:19.305 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:19.306 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.306 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.306 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.306 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.306 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.307 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.307 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:19.307 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.307 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.308 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.308 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.308 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.308 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.308 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.308 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.309 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.309 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.309 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.309 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.310 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.310 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.310 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.310 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:19.310 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.311 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.311 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.311 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.311 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:19.311 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.312 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.312 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.312 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.312 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.312 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.313 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.313 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:19.313 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.314 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.314 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:19.314 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.314 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.314 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.315 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.315 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.315 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.316 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:19.316 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.316 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.316 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.316 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.317 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:19.317 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.317 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.317 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.317 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.318 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.318 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.318 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.318 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:19.318 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.319 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.319 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.319 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.319 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:19.319 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.320 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.320 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.320 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:19.320 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:19.320 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:19.321 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:19.321 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.321 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.321 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.321 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.322 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.322 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.322 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.322 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:19.322 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.323 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:19.323 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.323 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.323 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.323 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.323 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.324 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:19.324 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.324 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.324 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.324 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:19.325 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.325 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.325 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.325 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.325 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.325 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:19.326 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.326 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.326 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:19.326 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.327 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.327 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.327 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.327 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.327 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:19.327 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.328 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.328 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.328 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:19.328 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.328 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.329 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.329 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.329 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.329 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:19.329 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.330 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.330 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.330 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:19.330 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.330 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.331 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.331 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.331 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.331 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:19.331 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.332 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.333 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.333 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.333 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:19.333 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.333 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.334 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.334 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:19.334 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.334 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.334 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.334 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.335 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.335 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:19.335 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.335 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.335 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.336 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:19.336 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.336 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.336 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.336 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.337 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.337 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:19.337 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.337 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.337 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.338 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:19.338 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:19.338 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.338 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:19.338 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:19.339 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.339 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:19.339 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:19.339 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.339 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.340 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:19.340 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:19.340 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.340 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:19.341 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:19.341 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.341 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.341 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.341 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.341 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:19.342 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:19.342 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:19.342 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:19.342 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:19.342 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:19.343 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:19.343 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:19.343 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:19.343 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:19.343 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:19.344 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:19.344 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.344 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.344 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:19.344 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:19.345 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:19.345 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:19.345 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:19.345 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:19.345 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:19.345 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:19.346 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:19.346 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:19.346 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:19.346 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.346 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:19.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0dc066470 msgr2=0x7fc0dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:19.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0dc066470 0x7fc0dc068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0af000 tx=0x7fc0ec01b0b0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 msgr2=0x7fc0fc156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:19.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc156710 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400ccb0 tx=0x7fc0f400a620 comp rx=0 tx=0).stop 2023-10-25T16:15:19.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 shutdown_connections 2023-10-25T16:15:19.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0dc066470 0x7fc0dc068930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0fc159230 0x7fc0fc156710 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0fc0cc610 0x7fc0fc163780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 --2- 172.21.15.177:0/127015453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0fc070510 0x7fc0fc1f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 >> 172.21.15.177:0/127015453 conn(0x7fc0fc0b2450 msgr2=0x7fc0fc071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:19.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 shutdown_connections 2023-10-25T16:15:19.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.127+0000 7fc1009ab640 1 -- 172.21.15.177:0/127015453 wait complete. 2023-10-25T16:15:19.351 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-25T16:15:19.351 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:19.352 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:19.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:19.359 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-25T16:15:19.501 INFO:teuthology.orchestra.run.smithi177.stderr:dd: error writing 'large_file_b': No space left on device 2023-10-25T16:15:19.501 INFO:teuthology.orchestra.run.smithi177.stderr:dd: closing output file 'large_file_b': No space left on device 2023-10-25T16:15:19.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:15:19.503 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 -- 172.21.15.177:0/3104025751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00b2070 msgr2=0x7f17d00c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 --2- 172.21.15.177:0/3104025751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00b2070 0x7f17d00c8a20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009bc0 tx=0x7f17c801cab0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 -- 172.21.15.177:0/3104025751 shutdown_connections 2023-10-25T16:15:19.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 --2- 172.21.15.177:0/3104025751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00b2070 0x7f17d00c8a20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 -- 172.21.15.177:0/3104025751 >> 172.21.15.177:0/3104025751 conn(0x7f17d009a580 msgr2=0x7f17d00d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:19.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 -- 172.21.15.177:0/3104025751 shutdown_connections 2023-10-25T16:15:19.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 -- 172.21.15.177:0/3104025751 wait complete. 2023-10-25T16:15:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 Processor -- start 2023-10-25T16:15:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.627+0000 7f17d6297640 1 -- start start 2023-10-25T16:15:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b2070 0x7f17d0148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 0x7f17d00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d015eba0 0x7f17d00c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d0149530 con 0x7f17d00cfe20 2023-10-25T16:15:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00c5f50 con 0x7f17d015eba0 2023-10-25T16:15:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00c61d0 con 0x7f17d00b2070 2023-10-25T16:15:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 0x7f17d00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 0x7f17d00c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43124/0 (socket says 172.21.15.177:43124) 2023-10-25T16:15:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 -- 172.21.15.177:0/803967283 learned_addr learned my addr 172.21.15.177:0/803967283 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d4834640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d015eba0 0x7f17d00c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cffff640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b2070 0x7f17d0148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 -- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b2070 msgr2=0x7f17d0148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b2070 0x7f17d0148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 -- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d015eba0 msgr2=0x7f17d00c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d015eba0 0x7f17d00c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 -- 172.21.15.177:0/803967283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c8009820 con 0x7f17d00cfe20 2023-10-25T16:15:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cffff640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b2070 0x7f17d0148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cf7fe640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 0x7f17d00c5a10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c780 tx=0x7f17c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4005270 con 0x7f17d00cfe20 2023-10-25T16:15:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17c40053f0 con 0x7f17d00cfe20 2023-10-25T16:15:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d00c64b0 con 0x7f17d00cfe20 2023-10-25T16:15:19.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400a8a0 con 0x7f17d00cfe20 2023-10-25T16:15:19.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d01490e0 con 0x7f17d00cfe20 2023-10-25T16:15:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d01496e0 con 0x7f17d00cfe20 2023-10-25T16:15:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17c400aa00 con 0x7f17d00cfe20 2023-10-25T16:15:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f17c4083510 con 0x7f17d00cfe20 2023-10-25T16:15:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7f17bc06e090 con 0x7f17d00cfe20 2023-10-25T16:15:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.631+0000 7f17cffff640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.635+0000 7f17cffff640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f17c000a850 tx=0x7f17c0008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.635+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17c4017020 con 0x7f17d00cfe20 2023-10-25T16:15:19.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.791+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f17d00cbdb0 con 0x7f17d00cfe20 2023-10-25T16:15:19.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.795+0000 7f17ccff9640 1 -- 172.21.15.177:0/803967283 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+34546 (secure 0 0 0) 0x7f17d01496e0 con 0x7f17d00cfe20 2023-10-25T16:15:19.800 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:19.800 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:19.800 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 53, 2023-10-25T16:15:19.801 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:19.801 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:19.801 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:15:18.623173+0000", 2023-10-25T16:15:19.801 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:19.801 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:19.802 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:19.802 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:19.802 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:19.802 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:19.802 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:19.803 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:19.803 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:19.803 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.803 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:19.803 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:19.804 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:19.804 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:19.804 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:19.804 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:19.804 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:19.804 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:19.805 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:19.805 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:19.805 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:19.805 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:19.805 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.806 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:19.806 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:19.806 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:19.806 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:19.806 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:19.807 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:19.807 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:19.807 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:19.807 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:19.807 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:19.807 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:19.808 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:19.808 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:19.808 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:19.808 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:19.808 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:19.809 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:19.809 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:19.809 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:19.809 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:19.809 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:19.809 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:19.810 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:19.810 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:19.810 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:19.810 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:19.810 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:19.811 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.811 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:19.811 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:19.811 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:19.811 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:19.811 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:19.812 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:19.812 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:19.812 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:19.812 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:19.812 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:19.813 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:19.813 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:19.813 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:19.813 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:19.813 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:19.813 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:19.814 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:19.814 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:19.814 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:19.814 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:19.815 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:19.815 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:19.815 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:19.815 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:19.815 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:19.815 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:19.816 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:19.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.816 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:19.816 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:19.816 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:19.817 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:19.817 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:19.817 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:19.817 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:19.817 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:19.817 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:19.818 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:19.818 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:19.818 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:19.818 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:19.818 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:19.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.819 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:19.819 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:19.819 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.819 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:19.821 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:19.821 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:19.821 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:19.821 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:19.822 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:19.822 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:19.822 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:19.822 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:19.822 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.823 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.823 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.823 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:19.823 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:19.823 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:19.823 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:19.824 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:19.824 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:19.824 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:19.824 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:19.824 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:19.825 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:19.825 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:19.825 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:19.825 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:19.825 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:19.825 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:19.826 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:19.826 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:19.826 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:19.826 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:19.826 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:19.827 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:19.827 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:19.827 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:19.827 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:19.827 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:19.828 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:19.828 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:19.828 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.828 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:19.828 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:19.828 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:19.829 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:19.829 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:19.829 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:19.829 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:19.829 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:19.830 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:19.830 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:19.830 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:19.830 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:19.830 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:19.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:19.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:19.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:19.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:19.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:19.833 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:19.833 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:19.833 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:19.833 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.833 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:19.833 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:19.834 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:19.834 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:19.834 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:19.834 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:19.834 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:19.835 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:19.835 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:19.835 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:19.835 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:19.835 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:19.835 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:19.836 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:19.836 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:19.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.836 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:19.836 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:19.837 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:19.837 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.837 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.837 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:19.837 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:19.837 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:19.838 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:19.838 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:19.838 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:19.838 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:19.838 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:19.839 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:19.839 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.839 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:19.840 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:19.840 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:19.840 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:19.840 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:19.840 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:19.840 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:19.841 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:19.841 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:19.841 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:19.841 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:19.841 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:19.842 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:19.842 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:19.842 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:19.842 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:19.842 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:19.842 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:19.843 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:19.843 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:19.843 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:19.843 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:19.843 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:19.844 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:19.844 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:19.844 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:19.844 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:19.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.844 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:19.845 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:19.845 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:19.845 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:19.845 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:19.845 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:19.846 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:19.846 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:19.846 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:19.846 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:19.846 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:19.847 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:19.847 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:19.847 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:19.847 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:19.847 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:19.847 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:19.848 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:19.848 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:19.848 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:19.848 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:19.848 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.850 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:19.850 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:19.850 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:19.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:19.850 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:19.851 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:19.851 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:19.851 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:19.851 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:19.851 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:19.852 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:19.852 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:19.852 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:19.852 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:19.852 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.852 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:19.853 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:19.853 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:19.853 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.853 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:19.854 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:19.854 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:19.854 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:19.854 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:19.854 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:19.855 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:19.855 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:19.855 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:19.855 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.855 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.856 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.856 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:19.856 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.856 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:19.856 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.856 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.857 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.857 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.857 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.857 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.857 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.858 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.858 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.858 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.858 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.858 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.858 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.859 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.859 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.859 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:19.859 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.859 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.860 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.860 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:19.860 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.860 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.860 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.861 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.861 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.861 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.861 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.862 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:19.862 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.862 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.862 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.863 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:19.863 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.863 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.863 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.863 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.864 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.864 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.864 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:19.864 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.865 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.865 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.865 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:19.865 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.865 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.866 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.866 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.866 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.867 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.867 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:19.867 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.867 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.868 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:19.868 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:19.868 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.868 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.868 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:19.869 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:19.869 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:19.869 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:19.869 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.869 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.870 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.870 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.870 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.870 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.870 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:19.871 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.871 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.871 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.871 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.871 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.872 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.872 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.872 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.872 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.872 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.873 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.873 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.873 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.873 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.873 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.873 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.874 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:19.875 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.875 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.875 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.875 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.875 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.875 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.876 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.876 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.876 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:19.876 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.877 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.877 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.877 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:19.877 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.877 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.877 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.878 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.878 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.878 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.879 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:19.879 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.879 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.879 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.879 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.880 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:19.880 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.880 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.880 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.880 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.881 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.881 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.881 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.881 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:19.881 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.882 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.882 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.882 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:19.882 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:19.882 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.883 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.883 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:19.883 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:19.883 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:19.884 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:19.884 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.884 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.884 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.884 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.885 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.885 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:19.885 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.885 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.886 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:19.887 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.887 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.887 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.887 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.887 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.888 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.888 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.888 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:19.888 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.888 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.889 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.889 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:19.889 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.889 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.889 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.890 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.890 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.890 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.890 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.890 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.891 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:19.891 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.891 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.891 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.891 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.892 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:19.892 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.892 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.892 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.893 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.893 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.893 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.893 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.893 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:19.894 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.894 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.894 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.894 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:19.895 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.895 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.895 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.895 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.896 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.896 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.896 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.896 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:19.896 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.896 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.897 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.897 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.897 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:19.897 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:19.897 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.898 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.898 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:19.898 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:19.898 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:19.899 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:19.899 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.899 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.899 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.899 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.899 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.900 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.900 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:19.900 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.900 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.902 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.904 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.905 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.905 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.905 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.906 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:19.906 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.906 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.907 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:19.907 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.907 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.907 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.908 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.908 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.908 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.908 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:19.908 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.909 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.909 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:19.909 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.910 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.910 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.910 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.910 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.911 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.911 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:19.911 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.912 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.912 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:19.912 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:19.912 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.912 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.913 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:19.913 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:19.913 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:19.913 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:19.914 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.914 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:15:19.914 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.914 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.914 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.915 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:19.915 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.915 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.915 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.916 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.916 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.916 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.916 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.916 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.917 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.917 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.917 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.917 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.917 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.918 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.918 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:19.918 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.919 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.919 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:19.919 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.919 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.919 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:19.921 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.921 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:19.922 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.922 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.922 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.922 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.922 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.923 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.923 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:19.923 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.924 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:19.924 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.924 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.925 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.925 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.925 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.926 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:19.926 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.926 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.927 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:19.927 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:19.927 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.927 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.927 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:19.928 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:19.928 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:19.928 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:19.928 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.928 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.929 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.929 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.929 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:19.929 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.930 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.930 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.930 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.930 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.930 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.931 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.931 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.931 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:19.931 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.931 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.932 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.932 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.932 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.932 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:19.933 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.934 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.935 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.935 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:19.935 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.936 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.936 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:19.936 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.936 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.936 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.937 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.937 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.938 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:19.938 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:19.939 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.939 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.939 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.939 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.939 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.940 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.940 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.940 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.940 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:19.940 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.941 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.941 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.941 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.941 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:19.941 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:19.942 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.942 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.942 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.942 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:19.942 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:19.942 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:19.943 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:19.943 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.943 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.943 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.943 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.944 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.944 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.944 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:19.944 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.944 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.944 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.945 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.945 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.945 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.945 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.945 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.946 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:19.946 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.946 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.946 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.946 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.946 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.947 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.947 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:19.947 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.947 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.948 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:19.948 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.948 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.948 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.948 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.949 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.949 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.949 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:19.950 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.950 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.950 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.950 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.950 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:19.951 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.951 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.951 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.951 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.951 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.951 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.952 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.952 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.952 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:19.952 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.953 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.953 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.953 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:19.953 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.953 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.954 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.954 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.954 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.954 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.955 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.955 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:19.955 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.955 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.955 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.955 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.956 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:19.956 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:19.956 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.956 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.957 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:19.957 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:19.957 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:19.957 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:19.957 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.958 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.958 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.958 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.958 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.958 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.959 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.959 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:19.959 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:19.959 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:19.959 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:19.959 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:19.960 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:19.960 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:19.960 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:19.960 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:19.960 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:19.961 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:19.961 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:19.961 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:19.961 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:19.962 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:19.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.963 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.963 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.964 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:19.964 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.964 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.964 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:19.964 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.965 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.965 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:19.965 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.966 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.966 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.966 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:19.966 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.968 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:19.968 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.968 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.968 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.969 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:19.969 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:19.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.969 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:19.969 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:19.970 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.970 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:19.970 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:19.971 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:19.971 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.971 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.971 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:19.972 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:19.972 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:19.972 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:19.972 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:19.972 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:19.972 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:19.973 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:19.973 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.973 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.973 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.973 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:19.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.974 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:19.974 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.974 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.974 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.975 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.975 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.975 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:19.975 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.976 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:19.976 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.976 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.976 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.976 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.977 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.977 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:19.977 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.978 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:19.978 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.978 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.978 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.978 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.979 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.979 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:19.979 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.980 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:19.980 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.980 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.980 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.980 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.981 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.981 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:19.981 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.982 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:19.982 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.982 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.982 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.982 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.983 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.983 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:19.983 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.983 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:19.984 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.984 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.984 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.984 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.984 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.985 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:19.985 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.985 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:19.986 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.986 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.986 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.986 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.986 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.986 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:19.987 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.987 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:19.987 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:19.988 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:19.988 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:19.988 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:19.988 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:19.988 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:19.988 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:19.989 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.989 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.989 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:19.989 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:19.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.990 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:19.990 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:19.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.990 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:19.990 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:19.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.991 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.991 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:19.991 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:19.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:19.992 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:19.992 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:19.992 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.992 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:19.993 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.993 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:19.993 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:19.993 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:19.993 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:19.993 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:19.994 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:19.994 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:19.994 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:19.994 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:19.994 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:19.995 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:19.995 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:19.995 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:19.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:19.995 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:19.996 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:19.996 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:19.996 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:19.996 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:19.996 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:19.997 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:19.997 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:19.997 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:19.997 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:19.997 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:19.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:19.998 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.795+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 msgr2=0x7f17bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.795+0000 7f17d6297640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f17c000a850 tx=0x7f17c0008040 comp rx=0 tx=0).stop 2023-10-25T16:15:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.795+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 msgr2=0x7f17d00c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.795+0000 7f17d6297640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 0x7f17d00c5a10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f17c400c780 tx=0x7f17c400cc40 comp rx=0 tx=0).stop 2023-10-25T16:15:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 shutdown_connections 2023-10-25T16:15:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17d015eba0 0x7f17d00c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17d00cfe20 0x7f17d00c5a10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 --2- 172.21.15.177:0/803967283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17d00b2070 0x7f17d0148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 >> 172.21.15.177:0/803967283 conn(0x7f17d009a580 msgr2=0x7f17d00c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 shutdown_connections 2023-10-25T16:15:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:19.799+0000 7f17d6297640 1 -- 172.21.15.177:0/803967283 wait complete. 2023-10-25T16:15:20.002 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:20.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/370893245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 msgr2=0x7f340c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 --2- 172.21.15.177:0/370893245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0cdf80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f340c09f200 tx=0x7f340401cc90 comp rx=0 tx=0).stop 2023-10-25T16:15:20.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/370893245 shutdown_connections 2023-10-25T16:15:20.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 --2- 172.21.15.177:0/370893245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0cdf80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 --2- 172.21.15.177:0/370893245 >> v2:172.21.15.184:3300/0 conn(0x7f340c0b2120 0x7f340c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/370893245 >> 172.21.15.177:0/370893245 conn(0x7f340c09a5c0 msgr2=0x7f340c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:20.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/370893245 shutdown_connections 2023-10-25T16:15:20.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/370893245 wait complete. 2023-10-25T16:15:20.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 Processor -- start 2023-10-25T16:15:20.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- start start 2023-10-25T16:15:20.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f340c0b2120 0x7f340c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c15eba0 0x7f340c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c0c5380 con 0x7f340c0cdb10 2023-10-25T16:15:20.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c159640 con 0x7f340c15eba0 2023-10-25T16:15:20.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c159920 con 0x7f340c0b2120 2023-10-25T16:15:20.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43142/0 (socket says 172.21.15.177:43142) 2023-10-25T16:15:20.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 -- 172.21.15.177:0/587296284 learned_addr learned my addr 172.21.15.177:0/587296284 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:20.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f34109eb640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c15eba0 0x7f340c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340bfff640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f340c0b2120 0x7f340c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 -- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f340c0b2120 msgr2=0x7f340c15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f340c0b2120 0x7f340c15a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 -- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c15eba0 msgr2=0x7f340c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c15eba0 0x7f340c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 -- 172.21.15.177:0/587296284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040098e0 con 0x7f340c0cdb10 2023-10-25T16:15:20.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f340b7fe640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0c4ca0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f340000d980 tx=0x7f340000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:20.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400009c30 con 0x7f340c0cdb10 2023-10-25T16:15:20.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3400005020 con 0x7f340c0cdb10 2023-10-25T16:15:20.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c159c00 con 0x7f340c0cdb10 2023-10-25T16:15:20.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400005430 con 0x7f340c0cdb10 2023-10-25T16:15:20.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c1f4db0 con 0x7f340c0cdb10 2023-10-25T16:15:20.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.131+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c04daf0 con 0x7f340c0cdb10 2023-10-25T16:15:20.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.135+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34000047b0 con 0x7f340c0cdb10 2023-10-25T16:15:20.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.135+0000 7f3408ff9640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33f8066470 0x7f33f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.135+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3400084120 con 0x7f340c0cdb10 2023-10-25T16:15:20.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.135+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7f33f806e060 con 0x7f340c0cdb10 2023-10-25T16:15:20.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.135+0000 7f340bfff640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33f8066470 0x7f33f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.135+0000 7f340bfff640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33f8066470 0x7f33f8068930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b810 tx=0x7f33fc008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:20.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.139+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3400017060 con 0x7f340c0cdb10 2023-10-25T16:15:20.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f340c0ce930 con 0x7f340c0cdb10 2023-10-25T16:15:20.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f3408ff9640 1 -- 172.21.15.177:0/587296284 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f3400020020 con 0x7f340c0cdb10 2023-10-25T16:15:20.332 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:20.332 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:20.332 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:20.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33f8066470 msgr2=0x7f33f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33f8066470 0x7f33f8068930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b810 tx=0x7f33fc008040 comp rx=0 tx=0).stop 2023-10-25T16:15:20.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 msgr2=0x7f340c0c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0c4ca0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f340000d980 tx=0x7f340000de40 comp rx=0 tx=0).stop 2023-10-25T16:15:20.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 shutdown_connections 2023-10-25T16:15:20.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33f8066470 0x7f33f8068930 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c15eba0 0x7f340c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f340c0cdb10 0x7f340c0c4ca0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 --2- 172.21.15.177:0/587296284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f340c0b2120 0x7f340c15a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 >> 172.21.15.177:0/587296284 conn(0x7f340c09a5c0 msgr2=0x7f340c15c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 shutdown_connections 2023-10-25T16:15:20.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.327+0000 7f341244e640 1 -- 172.21.15.177:0/587296284 wait complete. 2023-10-25T16:15:20.353 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:15:20.499 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":5859,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":31.639243999000001,"mdsmap_epoch":19,"osdmap_epoch":53,"osdmap_epoch_barrier":48,"uptime":36.300717228000003} 2023-10-25T16:15:20.500 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 5859, "mdsmap_epoch": 19, "osdmap_epoch": 53, "osdmap_epoch_barrier": 48, "rank_uptime": 31.639243999, "state": "up:active", "uptime": 36.300717228, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:15:20.500 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:15:20.501 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:20.501 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:20.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:20.509 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-25T16:15:20.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:15:20.559+0000 7f59be7fc640 -1 client.6060 handle_client_reply no pending request on tid 14 safe is:1 2023-10-25T16:15:20.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:15:20.565 INFO:teuthology.orchestra.run.smithi177.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-25T16:15:20.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:20.565 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-25T16:15:20.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:20.639 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-25T16:15:20.702 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:20.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- 172.21.15.177:0/75174119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c3406c090 msgr2=0x7f6c340cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 --2- 172.21.15.177:0/75174119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c3406c090 0x7f6c340cb5c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009cb0 tx=0x7f6c2c01ccf0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- 172.21.15.177:0/75174119 shutdown_connections 2023-10-25T16:15:20.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 --2- 172.21.15.177:0/75174119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c3406c090 0x7f6c340cb5c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 --2- 172.21.15.177:0/75174119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c34140e90 0x7f6c340af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- 172.21.15.177:0/75174119 >> 172.21.15.177:0/75174119 conn(0x7f6c340b2450 msgr2=0x7f6c340b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:20.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- 172.21.15.177:0/75174119 shutdown_connections 2023-10-25T16:15:20.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- 172.21.15.177:0/75174119 wait complete. 2023-10-25T16:15:20.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 Processor -- start 2023-10-25T16:15:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- start start 2023-10-25T16:15:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c3406c090 0x7f6c3413e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c3406f570 0x7f6c34152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 0x7f6c3415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3413e800 con 0x7f6c34140e90 2023-10-25T16:15:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415b8e0 con 0x7f6c3406c090 2023-10-25T16:15:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3c138640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3413de30 con 0x7f6c3406f570 2023-10-25T16:15:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3a6d5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 0x7f6c3415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3a6d5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 0x7f6c3415b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46210/0 (socket says 172.21.15.177:46210) 2023-10-25T16:15:20.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c3a6d5640 1 -- 172.21.15.177:0/2305630654 learned_addr learned my addr 172.21.15.177:0/2305630654 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:20.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.879+0000 7f6c396d3640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c3406f570 0x7f6c34152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c39ed4640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c3406c090 0x7f6c3413e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3a6d5640 1 -- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c3406f570 msgr2=0x7f6c34152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3a6d5640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c3406f570 0x7f6c34152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3a6d5640 1 -- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c3406c090 msgr2=0x7f6c3413e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:20.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3a6d5640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c3406c090 0x7f6c3413e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:20.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3a6d5640 1 -- 172.21.15.177:0/2305630654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0098e0 con 0x7f6c34140e90 2023-10-25T16:15:20.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c39ed4640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c3406c090 0x7f6c3413e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3a6d5640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 0x7f6c3415b100 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c01c760 tx=0x7f6c2c009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c004e60 con 0x7f6c34140e90 2023-10-25T16:15:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c2c004000 con 0x7f6c34140e90 2023-10-25T16:15:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34152bc0 con 0x7f6c34140e90 2023-10-25T16:15:20.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0043f0 con 0x7f6c34140e90 2023-10-25T16:15:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3413d500 con 0x7f6c34140e90 2023-10-25T16:15:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340c9780 con 0x7f6c34140e90 2023-10-25T16:15:20.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c2c0b4040 con 0x7f6c34140e90 2023-10-25T16:15:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c18066470 0x7f6c18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6c2c11e4d0 con 0x7f6c34140e90 2023-10-25T16:15:20.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7f6c1806e060 con 0x7f6c34140e90 2023-10-25T16:15:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c39ed4640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c18066470 0x7f6c18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.883+0000 7f6c39ed4640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c18066470 0x7f6c18068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c30005fd0 tx=0x7f6c30005dc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:20.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:20.887+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c2c0b2060 con 0x7f6c34140e90 2023-10-25T16:15:21.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.043+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6c3404daf0 con 0x7f6c34140e90 2023-10-25T16:15:21.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.043+0000 7f6c2a7fc640 1 -- 172.21.15.177:0/2305630654 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+34546 (secure 0 0 0) 0x7f6c2c0bc020 con 0x7f6c34140e90 2023-10-25T16:15:21.049 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:21.050 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:21.050 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 53, 2023-10-25T16:15:21.050 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:21.050 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:21.051 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:15:18.623173+0000", 2023-10-25T16:15:21.051 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:21.051 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:21.051 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:21.052 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:21.052 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:21.052 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:21.052 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:21.052 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:21.053 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:21.053 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:21.053 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:21.053 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:21.054 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:21.054 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:21.054 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:21.054 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:21.055 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:21.055 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:21.055 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:21.055 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:21.056 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:21.056 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:21.056 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.056 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:21.056 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:21.057 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:21.058 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:21.058 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:21.058 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:21.058 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:21.058 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:21.059 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:21.059 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:21.059 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:21.059 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:21.059 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:21.060 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:21.060 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:21.060 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:21.060 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:21.060 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:21.061 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:21.061 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:21.061 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:21.061 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:21.062 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:21.062 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.062 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:21.062 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:21.063 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:21.063 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:21.063 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:21.065 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:21.065 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:21.065 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:21.066 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:21.066 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:21.066 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:21.066 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:21.066 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:21.067 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:21.067 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:21.067 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:21.067 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:21.067 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:21.068 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:21.068 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:21.068 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:21.068 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:21.068 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:21.068 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:21.069 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:21.069 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:21.069 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:21.069 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.069 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:21.070 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:21.070 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:21.070 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:21.070 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:21.070 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:21.071 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:21.071 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:21.071 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:21.071 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:21.071 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:21.072 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:21.072 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:21.072 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:21.072 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.072 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:21.072 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:21.073 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.073 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:21.073 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:21.073 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:21.073 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:21.074 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:21.074 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:21.074 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:21.074 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:21.074 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:21.075 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.075 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.075 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.076 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:21.076 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:21.076 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:21.076 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:21.076 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:21.077 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:21.078 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:21.078 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:21.078 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:21.078 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:21.078 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:21.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:21.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:21.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:21.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:21.079 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:21.080 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:21.080 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:21.080 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:21.080 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:21.080 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:21.081 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:21.081 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.081 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:21.081 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:21.081 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:21.082 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:21.082 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:21.082 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:21.082 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:21.082 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:21.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:21.083 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:21.083 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:21.083 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:21.083 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:21.084 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:21.084 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:21.084 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:21.084 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:21.084 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:21.084 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:21.085 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:21.085 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:21.085 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:21.085 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:21.085 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:21.086 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:21.086 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:21.086 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:21.086 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.086 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:21.087 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:21.087 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:21.087 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:21.087 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:21.087 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:21.088 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:21.088 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:21.088 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:21.088 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:21.088 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:21.089 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:21.089 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:21.089 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:21.089 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:21.089 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.090 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:21.090 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:21.090 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:21.090 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.091 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:21.091 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:21.091 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:21.091 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:21.091 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:21.091 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:21.092 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:21.092 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:21.092 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:21.092 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.092 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.093 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.093 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:21.093 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:21.093 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:21.093 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:21.094 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:21.094 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:21.094 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:21.094 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:21.094 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:21.095 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:21.095 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:21.095 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:21.095 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:21.095 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:21.095 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:21.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:21.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:21.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:21.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:21.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:21.097 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:21.098 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:21.098 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.098 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:21.098 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:21.098 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:21.099 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:21.099 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:21.099 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:21.099 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:21.099 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:21.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:21.100 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:21.100 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:21.100 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:21.100 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:21.101 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:21.101 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:21.101 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:21.101 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:21.101 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:21.101 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:21.102 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:21.102 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:21.102 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:21.102 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:21.102 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:21.103 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:21.103 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:21.103 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:21.103 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.104 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:21.104 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:21.104 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:21.104 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:21.104 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:21.104 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:21.105 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:21.105 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:21.105 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:21.105 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:21.105 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:21.106 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:21.106 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:21.106 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:21.106 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.106 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:21.107 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:21.107 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:21.107 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.107 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:21.108 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:21.108 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:21.108 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:21.108 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:21.108 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.109 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:21.110 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:21.110 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.110 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:21.110 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.110 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.111 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.111 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.111 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.111 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.111 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.112 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.112 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:21.112 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.112 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.112 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.113 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.113 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.113 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:21.113 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.114 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.114 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.114 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:21.114 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.114 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.115 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.115 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.115 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.116 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.116 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:21.116 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.117 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.117 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:21.117 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.117 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.118 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.118 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.118 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.118 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.118 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:21.119 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.119 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.119 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:21.120 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.120 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.120 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.120 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.120 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.121 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.121 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.121 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:21.121 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.122 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.122 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:21.122 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:21.123 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.123 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.123 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:21.123 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:21.124 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:21.124 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:21.124 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.124 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.124 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:21.124 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.125 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.125 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:21.125 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.126 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.126 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.126 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.126 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.126 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.127 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.127 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.127 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:21.127 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.127 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.128 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.128 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.128 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.128 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.128 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:21.128 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.129 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.129 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:21.129 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.130 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.130 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.130 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.130 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.130 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.131 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.131 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.131 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:21.131 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.131 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.132 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.132 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.132 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:21.132 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.132 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.133 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.133 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.133 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.133 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.133 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.134 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.134 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:21.134 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.134 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.134 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.135 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.135 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:21.135 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.135 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.135 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.135 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.136 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.136 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.136 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.136 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:21.137 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.137 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.137 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.137 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.137 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:21.138 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:21.138 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.138 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.138 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.138 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:21.139 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:21.139 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:21.139 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:21.139 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.139 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.139 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.140 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.140 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.140 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:21.140 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.141 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.141 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.141 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.141 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.141 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.142 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.142 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:21.142 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:21.142 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.142 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.143 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.143 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.143 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.143 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:21.144 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.144 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.144 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.144 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.144 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:21.144 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.145 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.145 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.145 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.145 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.145 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.146 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.147 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.147 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:21.147 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.147 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.147 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.148 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.148 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.148 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.148 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:21.149 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.149 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.149 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.149 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:21.150 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.150 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.150 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.150 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.150 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.151 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.151 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.151 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.151 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:21.151 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.151 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.152 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.152 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.152 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:21.152 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:21.152 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.153 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.153 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:21.153 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:21.153 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:21.154 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:21.154 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.154 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.154 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:21.154 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.155 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.155 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.155 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.155 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:21.155 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.156 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.156 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.156 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.156 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.156 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.156 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.157 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.157 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:21.157 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.157 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.157 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.158 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.158 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.158 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.158 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:21.158 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.159 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.159 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.159 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.159 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:21.159 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.159 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.160 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.160 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.160 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.161 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.161 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:21.161 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.161 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.161 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.162 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.162 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:21.162 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.162 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.162 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.162 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.163 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.163 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.163 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:21.164 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.164 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.164 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.164 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.164 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:21.165 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.165 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.165 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.165 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.165 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.166 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.166 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.166 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.166 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:21.166 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.166 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.167 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.167 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.167 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:21.167 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:21.167 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.168 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.168 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.168 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:21.168 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:21.168 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:21.169 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:21.169 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.169 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:15:21.169 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.169 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.169 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.170 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.170 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.170 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:21.170 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.170 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.171 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.171 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.171 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.171 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.171 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.172 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.172 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:21.172 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.172 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.172 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.172 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.173 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.173 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.173 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:21.173 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.173 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.174 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.174 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.174 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:21.174 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.175 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.175 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.175 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.175 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.175 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.176 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.176 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:21.176 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.176 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.176 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.177 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.177 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:21.177 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.177 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.177 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.178 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.178 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.178 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.178 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.178 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.179 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:21.179 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.179 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.179 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.179 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.179 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:21.180 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.180 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.180 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.180 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.181 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.181 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.181 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.181 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:21.181 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.181 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.182 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.182 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.182 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:21.182 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:21.182 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.183 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.183 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.183 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:21.183 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:21.183 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:21.184 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:21.184 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.184 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.184 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.184 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.185 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.185 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.185 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:21.185 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.185 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.185 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.186 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.186 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.186 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.186 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.187 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.187 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:21.187 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.187 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.187 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.187 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.188 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.188 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.188 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:21.188 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.188 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.189 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.189 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:21.189 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.189 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.189 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.190 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.190 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.190 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.190 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.191 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:21.191 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.191 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.192 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:21.192 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.192 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.192 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.192 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.193 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.193 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.193 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:21.194 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.194 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.194 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:21.195 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.195 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.195 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.195 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.195 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.196 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.196 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:21.196 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.196 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.198 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.198 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:21.198 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:21.198 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:21.198 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:21.199 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.199 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.199 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.199 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.200 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.200 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:21.200 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.200 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.201 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.201 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.201 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.201 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.202 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.202 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.202 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:21.202 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.203 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.203 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.203 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.204 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:21.204 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.204 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.204 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:21.205 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.205 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.205 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.206 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.206 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.206 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.206 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:21.207 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.207 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.207 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.207 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:21.208 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.208 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.208 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.208 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.209 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:21.209 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.210 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.210 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:21.210 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.211 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.211 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.211 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.211 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.211 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.212 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.212 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:21.212 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.213 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.213 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:21.213 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:21.213 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.213 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.214 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:21.214 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:21.214 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:21.214 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:21.215 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.215 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.215 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:21.215 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.216 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.216 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.216 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:21.216 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:21.217 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:21.217 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:21.217 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:21.217 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:21.217 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:21.217 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:21.218 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:21.218 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:21.218 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:21.218 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:21.219 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:21.219 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.219 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.219 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:21.220 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:21.221 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.221 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.221 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.221 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:21.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.222 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.222 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:21.222 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.223 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:21.223 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.223 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.224 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.224 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.224 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:21.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.224 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.225 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.225 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:21.225 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.225 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.226 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:21.226 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.226 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.226 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.227 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:21.227 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:21.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.227 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:21.227 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:21.228 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.228 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.228 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:21.228 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:21.228 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:21.229 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.229 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.229 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:21.229 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:21.230 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:21.230 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:21.230 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:21.230 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:21.230 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:21.231 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:21.231 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.231 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.231 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:21.231 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:21.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.232 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:21.232 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.232 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.232 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.232 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.233 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.233 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:21.233 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.233 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.234 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:21.234 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.234 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.234 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.234 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.235 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.235 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:21.235 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.235 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:21.236 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.236 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.236 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.236 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.236 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.237 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:21.237 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.237 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.237 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:21.238 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.238 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.238 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.238 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.238 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.239 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:21.239 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.239 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.239 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:21.239 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.240 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.240 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.240 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.240 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.240 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:21.241 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.241 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:21.241 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.241 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.242 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.242 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.242 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.242 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:21.242 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.243 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.244 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.244 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.244 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.244 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:21.244 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.245 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:21.245 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:21.245 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:21.245 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:21.246 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.247 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:21.247 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:21.247 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:21.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.247 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:21.247 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:21.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.248 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:21.248 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:21.248 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.248 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.249 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:21.249 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:21.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:21.249 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:21.250 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:21.250 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.250 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:21.250 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.250 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:21.251 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:21.251 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:21.251 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:21.251 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:21.251 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:21.252 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:21.252 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:21.252 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:21.252 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:21.252 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:21.253 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:21.253 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:21.253 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:21.253 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:21.253 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:21.254 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:21.254 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:21.254 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:21.254 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:21.254 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:21.255 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:21.255 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:21.255 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:21.255 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:21.255 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:21.255 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:21.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c18066470 msgr2=0x7f6c18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:21.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c18066470 0x7f6c18068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c30005fd0 tx=0x7f6c30005dc0 comp rx=0 tx=0).stop 2023-10-25T16:15:21.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 msgr2=0x7f6c3415b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:21.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 0x7f6c3415b100 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c01c760 tx=0x7f6c2c009330 comp rx=0 tx=0).stop 2023-10-25T16:15:21.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 shutdown_connections 2023-10-25T16:15:21.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c18066470 0x7f6c18068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:21.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34140e90 0x7f6c3415b100 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:21.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c3406f570 0x7f6c34152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:21.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 --2- 172.21.15.177:0/2305630654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c3406c090 0x7f6c3413e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:21.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 >> 172.21.15.177:0/2305630654 conn(0x7f6c340b2450 msgr2=0x7f6c340ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:21.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 shutdown_connections 2023-10-25T16:15:21.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:21.047+0000 7f6c3c138640 1 -- 172.21.15.177:0/2305630654 wait complete. 2023-10-25T16:15:21.260 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:15:22.578 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:15:22.575+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-25T16:15:26.261 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:26.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 -- 172.21.15.177:0/1164501100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 msgr2=0x7f5ad0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:26.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 --2- 172.21.15.177:0/1164501100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ad0004c50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5ae806f520 tx=0x7f5adc01f670 comp rx=0 tx=0).stop 2023-10-25T16:15:26.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aeca01640 1 -- 172.21.15.177:0/1164501100 reap_dead start 2023-10-25T16:15:26.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 -- 172.21.15.177:0/1164501100 shutdown_connections 2023-10-25T16:15:26.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 -- 172.21.15.177:0/1164501100 >> 172.21.15.177:0/1164501100 conn(0x7f5ae80b2450 msgr2=0x7f5ae80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:26.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 -- 172.21.15.177:0/1164501100 shutdown_connections 2023-10-25T16:15:26.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 -- 172.21.15.177:0/1164501100 wait complete. 2023-10-25T16:15:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 Processor -- start 2023-10-25T16:15:26.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.391+0000 7f5aee464640 1 -- start start 2023-10-25T16:15:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ae81ef810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae8157fb0 0x7f5ae80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae8158410 0x7f5ae81444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae8151c70 con 0x7f5ad00047d0 2023-10-25T16:15:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80ad590 con 0x7f5ae8157fb0 2023-10-25T16:15:26.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80ad870 con 0x7f5ae8158410 2023-10-25T16:15:26.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ae81ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:26.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ae81ef810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46232/0 (socket says 172.21.15.177:46232) 2023-10-25T16:15:26.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 -- 172.21.15.177:0/2900734936 learned_addr learned my addr 172.21.15.177:0/2900734936 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:26.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aeca01640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae8158410 0x7f5ae81444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:26.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae77fe640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae8157fb0 0x7f5ae80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:26.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 -- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae8158410 msgr2=0x7f5ae81444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:26.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae8158410 0x7f5ae81444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:26.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 -- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae8157fb0 msgr2=0x7f5ae80acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:26.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae8157fb0 0x7f5ae80acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:26.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 -- 172.21.15.177:0/2900734936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80adb50 con 0x7f5ad00047d0 2023-10-25T16:15:26.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aeca01640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae8158410 0x7f5ae81444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:26.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae7fff640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ae81ef810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8011a50 tx=0x7f5ad8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:26.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800fd90 con 0x7f5ad00047d0 2023-10-25T16:15:26.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ad8012450 con 0x7f5ad00047d0 2023-10-25T16:15:26.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae8151890 con 0x7f5ad00047d0 2023-10-25T16:15:26.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8012800 con 0x7f5ad00047d0 2023-10-25T16:15:26.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae80ad050 con 0x7f5ad00047d0 2023-10-25T16:15:26.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae8151ee0 con 0x7f5ad00047d0 2023-10-25T16:15:26.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5ad8012960 con 0x7f5ad00047d0 2023-10-25T16:15:26.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ad4066470 0x7f5ad4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:26.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5ad8084d80 con 0x7f5ad00047d0 2023-10-25T16:15:26.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7f5ad406e060 con 0x7f5ad00047d0 2023-10-25T16:15:26.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.395+0000 7f5ae77fe640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ad4066470 0x7f5ad4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:26.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.399+0000 7f5ae77fe640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ad4066470 0x7f5ad4068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b0000 tx=0x7f5adc0b5040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:26.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.399+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ad801f020 con 0x7f5ad00047d0 2023-10-25T16:15:26.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.555+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5ae804daf0 con 0x7f5ad00047d0 2023-10-25T16:15:26.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5ae4ff9640 1 -- 172.21.15.177:0/2900734936 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+34490 (secure 0 0 0) 0x7f5ad8055d90 con 0x7f5ad00047d0 2023-10-25T16:15:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:26.564 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 54, 2023-10-25T16:15:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:15:24.701933+0000", 2023-10-25T16:15:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:26.566 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:26.566 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:26.566 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:26.566 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:26.566 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:26.567 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:26.567 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:26.567 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:26.567 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:26.567 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:26.568 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:26.568 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:26.568 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:26.568 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:26.568 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:26.569 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:26.569 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:26.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.569 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:26.569 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:26.570 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:26.570 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:26.570 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:26.570 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:26.570 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:26.571 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:26.571 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:26.571 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:26.571 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:26.571 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:26.572 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:26.572 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:26.572 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:26.573 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:26.573 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:26.573 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:26.573 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:26.573 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:26.573 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:26.574 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:26.574 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:26.574 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:26.574 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:26.575 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:26.575 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:26.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.575 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:26.575 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:26.575 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:26.576 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:26.576 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:26.576 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:26.576 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:26.576 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:26.577 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:26.577 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:26.577 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:26.577 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:26.577 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:26.578 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:26.578 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:26.578 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:26.578 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:26.578 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:26.579 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:26.579 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:26.579 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:26.579 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:26.579 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:26.579 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:26.580 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:26.580 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:26.580 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:26.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.580 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:26.581 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:26.582 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:26.582 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:26.582 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:26.582 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:26.582 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:26.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:26.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:26.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.583 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:26.583 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:26.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.584 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:26.584 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:26.584 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:26.584 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:26.585 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:26.585 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:26.585 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:26.585 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:26.585 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:26.586 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.586 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:26.586 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:26.586 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:26.588 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:26.588 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:26.588 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:26.588 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:26.588 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:26.589 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:26.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:26.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:26.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:26.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:26.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:26.590 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:26.590 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:26.590 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:26.590 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:26.591 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:26.591 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:26.591 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:26.591 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:26.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.591 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:26.592 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:26.592 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:26.592 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:26.592 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:26.592 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:26.593 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:26.593 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:26.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:26.593 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:26.593 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:26.594 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:26.594 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:26.594 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:26.594 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:26.594 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:26.595 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:26.595 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:26.595 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:26.595 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:26.595 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:26.595 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:26.596 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:26.596 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:26.596 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:26.596 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:26.596 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:26.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.597 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:26.597 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:26.597 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:26.597 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:26.598 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:26.598 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:26.598 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:26.598 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:26.598 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:26.598 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:26.599 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:26.599 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:26.599 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:26.599 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:26.599 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:26.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.600 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:26.600 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:26.600 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:26.600 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.601 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:26.601 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:26.601 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:26.601 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:26.601 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:26.602 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:26.602 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:26.602 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:26.602 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:26.602 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.603 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:26.603 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:26.603 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:26.604 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:15:26.604 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:15:26.604 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:26.604 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:26.604 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:26.604 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:26.605 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:26.605 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:26.605 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:26.605 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:26.605 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:26.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:26.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:26.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:26.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:26.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:26.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:26.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:26.607 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:26.607 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:26.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:26.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:26.608 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:26.608 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:26.608 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.608 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "51", 2023-10-25T16:15:26.608 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:26.609 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:26.609 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:26.609 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:26.609 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:26.609 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:26.610 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:26.610 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:26.610 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:26.610 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:26.610 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:26.610 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:26.611 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:26.611 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:26.611 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:26.611 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:26.611 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:26.612 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:26.612 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:26.612 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:26.612 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:26.612 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:26.613 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:26.613 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:26.613 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:26.613 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:26.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.613 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:26.614 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:26.614 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:26.614 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:26.614 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:26.614 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:26.615 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:26.615 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:26.615 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:26.615 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:26.615 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:26.616 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:26.616 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:26.616 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:26.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.616 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:26.617 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:26.617 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:26.617 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.617 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:26.617 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:26.618 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:26.618 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:26.618 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:26.618 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:26.618 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:26.619 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:26.619 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:26.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.619 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:26.620 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:26.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.620 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:26.620 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.620 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.620 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.621 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.621 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.621 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.621 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.621 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:26.622 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.622 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.622 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.622 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.623 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.623 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:26.623 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.624 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:26.624 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.624 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.624 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.625 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.625 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:26.626 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.626 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:26.627 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.627 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.627 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.627 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.628 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.628 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.628 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:26.628 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.629 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.629 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:26.629 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.629 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.630 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.630 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.630 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.631 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.631 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:26.631 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.632 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:26.632 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:26.632 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.632 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.633 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:26.633 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:26.633 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:26.633 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:26.633 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.634 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.634 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:26.634 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.634 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.635 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:26.635 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.635 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.635 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.636 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.636 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.636 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.636 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.636 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.637 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:26.637 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.637 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.637 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.637 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.637 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.638 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.638 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:26.638 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.638 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.639 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.639 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:26.639 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.639 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.639 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.640 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.640 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.640 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.640 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:26.641 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.641 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.641 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:26.642 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.642 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.642 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.642 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.643 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.643 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.643 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:26.643 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.644 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.644 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:26.644 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.644 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.645 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.645 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.645 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.646 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.646 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:26.646 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.647 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.647 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:26.647 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:26.647 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.647 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.648 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:26.648 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:26.648 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:26.648 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:26.648 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.649 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.649 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.649 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.650 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:26.650 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.650 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.650 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.650 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.651 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.651 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.651 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.651 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:26.651 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:26.651 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.652 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.652 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.652 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.652 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.653 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:26.653 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.653 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.653 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.653 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:26.654 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.654 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.654 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.654 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:26.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.656 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:26.656 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.656 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.657 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.657 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.657 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.657 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.658 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.658 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:26.658 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.658 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.658 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.659 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.659 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:26.659 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.659 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.659 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.659 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.660 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.660 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.660 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.660 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:26.661 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.661 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.661 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:26.662 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:26.662 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.662 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.662 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:26.662 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:26.663 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:26.663 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:26.663 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.663 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.663 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:26.664 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.664 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.664 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:26.665 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.665 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.665 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.665 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.665 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.665 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.666 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.666 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.666 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:26.666 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.666 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.667 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.667 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.667 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.667 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:26.668 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.668 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.668 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.668 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:26.668 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.669 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.669 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.669 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.670 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.670 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:26.670 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.671 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.671 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:26.671 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.671 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.671 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.672 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.672 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:26.674 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.674 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.674 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.674 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:26.675 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.676 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.676 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:26.676 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:26.676 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.677 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.677 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:26.677 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:26.677 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:26.678 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:26.678 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.678 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.678 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.678 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.679 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.679 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:26.679 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.679 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.679 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.680 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.680 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.680 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.680 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.680 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.681 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:26.681 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.681 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.681 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.681 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.682 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.682 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:26.682 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.682 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.682 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.683 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.683 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:26.683 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.683 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.683 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.684 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.684 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:26.685 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.685 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.685 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.685 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.685 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:26.686 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.686 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.686 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.686 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.687 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:26.687 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.688 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.688 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:26.688 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.688 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.689 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.689 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.691 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:26.691 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:26.691 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.691 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.692 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:26.692 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:26.692 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:26.692 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:26.692 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.693 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.693 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.693 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.693 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:26.694 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.694 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.694 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.694 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.694 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.695 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.695 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.695 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.695 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:26.695 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.696 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.696 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.696 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.696 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.696 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:26.697 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.697 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.697 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:26.698 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.698 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.698 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.698 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.698 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.699 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.699 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:26.699 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.709 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.709 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.709 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.709 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.709 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.709 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.710 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:26.710 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.710 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.710 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.710 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.711 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.711 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.711 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:26.711 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.711 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.712 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.712 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:26.712 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.712 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.712 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.713 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.713 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.713 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.713 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.714 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:26.714 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.714 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.715 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:26.715 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.715 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.715 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.715 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.716 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.716 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.716 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:26.716 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.717 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.717 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:26.717 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.718 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.718 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.718 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.718 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.718 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.719 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.719 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:26.719 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.719 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.720 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.720 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:26.720 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:26.720 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.720 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.721 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.721 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:26.721 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:26.721 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:26.721 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:26.721 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.722 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.722 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:15:26.722 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.722 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.723 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.723 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:26.723 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:26.723 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:26.723 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:26.724 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:26.724 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:26.724 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:26.724 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:26.724 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:26.724 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:26.725 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:26.725 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:26.725 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:26.725 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.725 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.726 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.726 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:26.726 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.726 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.726 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.727 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.727 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:26.727 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.727 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.727 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.728 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:26.728 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.728 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.728 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.728 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.729 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:26.730 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.730 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.730 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.730 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.730 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.732 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.732 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.732 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:26.732 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.732 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.733 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.733 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.733 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:26.733 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:26.733 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.734 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:26.734 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:26.734 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.734 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.734 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.734 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:26.735 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:26.735 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:26.735 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.735 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.735 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.736 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:26.736 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:26.736 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:26.736 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:26.736 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:26.737 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:26.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.738 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:26.738 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.738 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.738 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.739 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.739 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.739 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:26.739 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.740 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:26.740 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.740 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.740 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.740 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.741 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.741 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:26.741 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.742 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:26.742 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.742 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.742 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.742 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.743 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:26.744 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.744 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.744 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.744 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.744 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.745 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:26.745 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.745 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:26.745 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.746 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.746 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.746 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.746 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.746 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:26.747 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.747 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:26.747 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.748 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.748 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.748 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.748 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.748 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:26.748 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.749 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.749 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.749 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:26.749 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.749 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.750 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.750 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.750 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.750 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:26.750 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.751 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.751 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.751 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:26.751 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:26.751 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:26.752 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:26.752 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:26.752 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:26.752 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:26.752 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:26.752 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.753 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:26.753 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:26.753 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:26.753 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.753 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:26.754 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:26.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.754 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:26.754 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:26.754 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.755 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.755 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.755 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:26.755 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:26.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:26.756 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:26.756 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:26.756 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.756 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:26.756 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.757 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:26.757 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:26.757 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:26.757 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:26.757 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:26.758 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:26.758 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:26.758 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:26.758 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:26.758 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:26.758 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:26.759 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:26.759 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:26.759 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:26.759 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:26.760 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:26.760 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:26.760 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:26.760 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:26.760 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:26.761 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:26.761 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:26.761 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:26.761 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:26.761 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:26.761 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:26.762 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:26.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ad4066470 msgr2=0x7f5ad4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ad4066470 0x7f5ad4068930 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0b0000 tx=0x7f5adc0b5040 comp rx=0 tx=0).stop 2023-10-25T16:15:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 msgr2=0x7f5ae81ef810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ae81ef810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8011a50 tx=0x7f5ad8011f10 comp rx=0 tx=0).stop 2023-10-25T16:15:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 shutdown_connections 2023-10-25T16:15:26.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ad4066470 0x7f5ad4068930 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae8158410 0x7f5ae81444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae8157fb0 0x7f5ae80acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 --2- 172.21.15.177:0/2900734936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ad00047d0 0x7f5ae81ef810 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 >> 172.21.15.177:0/2900734936 conn(0x7f5ae80b2450 msgr2=0x7f5ae8071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 shutdown_connections 2023-10-25T16:15:26.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:26.559+0000 7f5aee464640 1 -- 172.21.15.177:0/2900734936 wait complete. 2023-10-25T16:15:26.766 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:15:27.580 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:15:27.578+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-25T16:15:30.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:15:30.402 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:15:31.767 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:31.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- 172.21.15.177:0/1586253773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34840cdb10 msgr2=0x7f34840cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:31.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 --2- 172.21.15.177:0/1586253773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34840cdb10 0x7f34840cdf80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f348409f200 tx=0x7f347c01cad0 comp rx=0 tx=0).stop 2023-10-25T16:15:31.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- 172.21.15.177:0/1586253773 shutdown_connections 2023-10-25T16:15:31.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 --2- 172.21.15.177:0/1586253773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34840cdb10 0x7f34840cdf80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:31.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 --2- 172.21.15.177:0/1586253773 >> v2:172.21.15.184:3300/0 conn(0x7f34840b2120 0x7f34840b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:31.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- 172.21.15.177:0/1586253773 >> 172.21.15.177:0/1586253773 conn(0x7f348409a5c0 msgr2=0x7f34840d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:31.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- 172.21.15.177:0/1586253773 shutdown_connections 2023-10-25T16:15:31.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- 172.21.15.177:0/1586253773 wait complete. 2023-10-25T16:15:31.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 Processor -- start 2023-10-25T16:15:31.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- start start 2023-10-25T16:15:31.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2120 0x7f348415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:31.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840cdb10 0x7f348414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:31.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 0x7f3484158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:31.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348414f730 con 0x7f348415eba0 2023-10-25T16:15:31.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34841597f0 con 0x7f34840b2120 2023-10-25T16:15:31.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3484159a90 con 0x7f34840cdb10 2023-10-25T16:15:31.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 0x7f3484158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:31.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 0x7f3484158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41902/0 (socket says 172.21.15.177:41902) 2023-10-25T16:15:31.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 -- 172.21.15.177:0/4031983164 learned_addr learned my addr 172.21.15.177:0/4031983164 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 -- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840cdb10 msgr2=0x7f348414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840cdb10 0x7f348414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 -- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2120 msgr2=0x7f348415aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3483fff640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2120 0x7f348415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:31.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2120 0x7f348415aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 -- 172.21.15.177:0/4031983164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c009820 con 0x7f348415eba0 2023-10-25T16:15:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3483fff640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2120 0x7f348415aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f3488b86640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 0x7f3484158c20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f347c009b10 tx=0x7f347c0a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c004c50 con 0x7f348415eba0 2023-10-25T16:15:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f347c004000 con 0x7f348415eba0 2023-10-25T16:15:31.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3484159d70 con 0x7f348415eba0 2023-10-25T16:15:31.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.902+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c004ea0 con 0x7f348415eba0 2023-10-25T16:15:31.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348414e170 con 0x7f348415eba0 2023-10-25T16:15:31.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484157530 con 0x7f348415eba0 2023-10-25T16:15:31.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f347c0b4040 con 0x7f348415eba0 2023-10-25T16:15:31.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f34817fa640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3464066470 0x7f3464068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:31.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f347c11e150 con 0x7f348415eba0 2023-10-25T16:15:31.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f3483fff640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3464066470 0x7f3464068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:31.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.906+0000 7f3483fff640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3464066470 0x7f3464068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34740046c0 tx=0x7f3474009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:31.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:31.910+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3484157530 con 0x7f348415eba0 2023-10-25T16:15:32.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.066+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3484157910 con 0x7f348415eba0 2023-10-25T16:15:32.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.066+0000 7f34817fa640 1 -- 172.21.15.177:0/4031983164 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+34403 (secure 0 0 0) 0x7f3484157910 con 0x7f348415eba0 2023-10-25T16:15:32.073 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:32.074 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:32.074 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 56, 2023-10-25T16:15:32.074 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:32.074 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:32.074 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:15:28.786188+0000", 2023-10-25T16:15:32.075 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:32.075 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:32.075 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:32.075 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:32.075 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:32.076 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:32.076 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:32.076 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:32.076 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:32.076 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.077 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:32.077 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:32.077 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:32.077 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:32.077 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:32.078 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:32.078 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:32.078 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:32.078 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:32.078 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:32.079 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:32.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:32.079 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:32.079 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:32.080 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:32.080 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:32.080 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:32.080 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:32.080 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:32.081 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:32.081 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:32.081 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:32.081 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:32.081 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:32.081 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:32.082 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:32.082 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:32.082 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:32.082 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:32.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:32.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:32.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:32.083 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:32.083 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:32.084 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:32.084 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:32.084 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:32.084 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:32.084 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:32.084 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "56", 2023-10-25T16:15:32.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:32.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:32.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:32.085 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:32.086 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:32.086 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:32.086 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:32.086 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:32.086 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:32.087 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:32.087 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:32.087 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:32.087 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:32.087 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:32.088 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:32.088 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:32.088 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:32.088 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:32.088 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:32.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:32.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:32.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:32.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:32.089 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:32.089 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:32.090 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:32.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.090 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:32.090 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:32.091 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:32.091 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:32.091 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:32.091 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:32.091 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:32.092 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:32.092 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:32.092 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:32.092 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:32.092 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:32.092 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:32.093 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:32.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.093 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:32.093 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:32.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.094 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:32.094 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:32.094 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:32.094 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:32.094 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:32.095 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:32.095 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:32.095 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:32.095 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:32.095 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.096 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.096 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:32.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:32.096 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:32.097 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:32.097 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:32.097 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:32.097 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:32.097 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:32.097 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:32.098 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:32.098 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:32.098 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:32.098 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:32.098 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:32.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:32.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:32.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:32.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:32.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:32.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:32.100 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:32.100 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:32.100 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:32.100 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:32.100 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:32.101 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:32.101 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:32.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.101 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "56", 2023-10-25T16:15:32.101 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:32.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:32.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:32.102 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:32.102 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:32.102 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:32.103 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:32.103 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:32.103 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:32.103 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:32.103 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:32.104 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:32.104 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:32.104 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:32.104 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:32.104 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:32.105 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:32.105 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:32.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:32.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:32.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:32.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:32.106 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:32.106 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:32.106 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:32.106 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:32.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.107 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:32.107 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:32.107 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:32.107 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:32.107 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:32.108 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:32.108 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:32.108 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:32.108 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:32.108 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:32.109 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:32.109 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:32.109 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:32.109 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:32.109 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:32.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.110 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:32.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:32.110 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:32.110 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.111 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:32.111 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:32.111 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:32.111 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:32.111 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:32.112 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:32.112 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:32.112 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:32.112 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:32.112 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.113 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:32.113 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:32.113 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:32.113 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:32.114 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:32.114 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:32.114 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:32.114 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:32.114 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:32.115 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:32.115 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:32.115 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:32.115 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:32.115 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:32.116 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:32.116 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:32.116 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:32.116 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:32.116 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:32.117 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:32.117 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:32.117 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:32.117 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:32.117 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:32.117 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:32.118 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:32.118 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:32.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.118 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "56", 2023-10-25T16:15:32.118 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:32.119 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:32.119 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:32.119 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:32.119 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:32.119 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:32.120 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:32.120 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:32.120 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:32.120 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:32.120 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:32.121 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:32.121 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:32.121 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:32.121 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:32.121 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:32.122 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:32.122 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:32.122 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:32.122 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:32.122 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:32.122 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:32.123 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:32.123 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:32.123 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:32.123 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:32.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.124 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:32.124 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:32.124 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:32.124 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:32.124 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:32.125 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:32.125 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:32.125 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:32.125 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:32.125 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:32.126 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:32.126 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:32.126 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:32.126 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:32.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.127 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:32.127 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:32.127 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:32.127 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.127 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:32.128 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:32.128 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:32.128 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:32.128 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:32.128 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:32.129 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:32.129 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:32.129 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:32.129 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.129 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.130 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.130 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:32.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.130 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:32.130 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.131 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.131 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.131 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.131 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.131 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.131 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.132 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.132 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.132 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.132 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.132 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.133 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.133 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.133 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.133 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:32.133 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.134 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.134 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.134 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.134 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:32.134 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.135 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.135 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.135 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.135 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.135 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.136 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.136 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:32.136 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.136 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.137 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.137 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:32.137 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.137 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.137 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.138 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.138 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.138 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.138 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.138 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.139 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:32.139 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.139 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.139 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.139 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.140 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:32.140 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.140 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.140 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.141 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.141 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.141 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.141 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.141 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:32.142 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.142 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.142 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.142 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:32.143 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.143 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.143 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.143 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.143 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:32.144 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:32.144 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:32.144 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:32.144 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.144 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.145 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.145 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.145 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.145 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:32.146 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.146 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.146 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.146 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.146 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.147 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.147 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.147 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.147 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.147 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.147 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.148 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.148 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.148 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.148 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:32.149 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.149 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.149 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.149 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:32.150 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.150 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.150 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.150 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.150 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.151 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.151 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.151 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.151 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:32.151 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.151 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.152 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.152 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.152 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:32.152 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.152 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.153 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.153 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.153 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.153 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.154 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.154 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:32.154 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.154 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.155 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.155 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:32.155 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.155 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.155 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.156 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.156 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.156 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.156 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.157 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:32.157 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.157 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.157 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.157 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:32.158 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.158 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.158 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.158 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.158 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:32.159 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:32.159 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:32.159 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:32.159 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.159 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.160 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.160 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.160 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:32.161 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.161 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.161 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.161 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.161 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.161 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.162 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.162 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:32.162 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.162 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.162 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.163 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.163 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.163 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:32.164 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.164 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.164 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.164 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.164 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:32.165 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.165 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.165 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.165 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.165 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.165 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.166 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.166 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.166 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:32.166 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.166 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.167 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.167 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.167 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:32.167 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.167 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.168 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.168 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.168 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.168 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.168 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.169 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.169 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:32.169 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.169 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.169 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.170 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.170 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:32.170 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.170 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.170 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.170 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.171 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.171 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.171 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.171 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.171 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:32.172 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.172 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.172 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.172 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.172 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:32.173 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.173 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.173 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.173 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.173 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:32.174 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:32.174 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:32.174 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:32.174 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.174 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.175 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.175 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.175 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.175 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:32.175 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.176 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.176 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.176 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.176 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.176 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.177 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.177 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.177 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.177 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.177 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.178 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.178 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.178 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.178 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.178 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:32.179 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.179 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.179 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.179 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.179 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:32.180 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.180 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.180 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.180 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.181 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.181 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.181 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.181 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:32.181 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.181 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.182 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.182 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.182 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:32.182 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.183 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.183 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.183 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.183 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.183 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.183 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.184 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.184 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:32.184 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.184 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.184 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.185 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.185 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:32.185 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.185 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.185 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.186 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.186 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.186 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.186 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.187 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:32.187 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.187 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.187 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.187 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:32.188 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.188 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.188 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.188 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.188 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:32.189 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:32.189 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:32.189 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:32.189 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.189 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.189 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.190 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.190 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.190 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:32.190 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.191 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.191 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.191 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.191 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.191 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.192 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.192 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.192 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.192 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.192 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.193 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.193 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.193 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:32.194 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.194 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.194 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:32.195 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.195 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.195 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.195 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.196 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.196 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.196 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:32.196 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.196 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.197 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.197 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:32.197 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.197 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.198 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.198 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.198 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.198 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.198 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.199 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.199 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:32.199 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.200 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.200 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:32.200 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.200 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.200 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.201 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.201 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.201 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.201 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:32.202 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.202 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.202 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.202 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.202 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:32.203 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.203 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.203 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.203 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.204 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.205 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:32.206 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.206 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.206 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.206 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.207 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.207 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.207 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.207 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.207 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:32.208 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.208 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.208 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.209 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:32.209 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.210 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.210 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:32.210 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.211 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.211 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.211 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.211 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.211 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.212 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.212 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:32.212 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.213 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.213 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:32.213 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.214 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.214 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.214 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.214 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.215 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.215 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:32.215 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.216 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.216 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:32.216 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.216 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.217 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.217 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.217 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.218 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.218 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:32.218 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.219 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.219 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:32.219 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.220 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.220 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:32.220 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:32.221 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:32.221 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:32.221 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.221 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.221 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.222 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.222 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:32.222 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.223 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.223 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.223 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.223 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.223 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.224 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.224 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.224 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:32.224 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.224 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.225 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.225 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.225 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.226 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:32.226 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.226 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.227 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:32.227 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.227 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.227 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.228 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.228 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.228 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.228 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:32.229 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.229 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.229 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:32.230 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.230 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.230 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.231 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.231 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.231 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.231 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:32.232 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.232 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.232 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:32.233 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.233 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.233 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.234 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.234 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.234 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.234 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:32.235 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.235 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.235 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:32.236 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.236 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.236 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.236 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:32.237 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:32.237 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:32.237 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:32.237 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.237 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.238 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.238 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.238 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:32.239 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.239 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.239 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.239 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.240 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.240 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.240 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.240 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.240 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.241 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.241 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.241 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.241 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.242 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.242 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:32.242 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.243 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.243 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:32.243 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.243 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.243 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.244 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.244 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.244 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.245 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.245 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:32.245 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.246 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.246 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:32.246 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.246 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.246 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.247 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.247 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.247 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.247 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.248 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:32.248 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.248 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.249 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:32.249 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.249 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.249 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.250 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.250 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.250 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.250 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:32.251 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.251 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.251 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.252 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:32.252 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.252 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.252 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.253 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:32.253 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:32.253 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:32.253 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:32.253 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.254 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.254 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.254 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.254 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.255 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.255 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:32.255 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.255 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:32.255 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.256 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.256 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.256 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.256 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.256 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:32.257 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.257 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.257 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.257 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:32.257 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.258 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.258 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.258 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.258 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.258 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:32.259 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.259 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.259 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.259 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:32.260 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.260 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.260 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.260 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.260 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.261 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:32.261 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.261 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.261 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.261 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:32.262 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.262 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.262 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.262 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.263 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.263 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:32.263 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.263 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.263 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.264 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:32.264 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.264 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.264 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.264 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.264 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.265 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:32.265 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.265 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.265 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.265 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:32.266 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.266 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.266 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.266 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.267 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.267 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:32.267 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.267 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.267 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.268 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:32.268 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.268 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.268 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.268 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.269 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.269 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:32.269 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.269 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.269 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.270 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:32.270 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.270 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.270 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.270 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.271 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.271 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:32.271 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.271 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.271 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.272 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:32.272 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:32.272 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.272 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:32.273 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:32.273 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.273 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:32.273 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:32.273 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.274 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.274 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.274 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.274 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:32.274 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:32.275 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.275 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:32.275 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:32.275 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.275 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.276 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.276 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.276 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:32.276 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:32.276 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:32.277 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:32.277 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:32.277 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:32.277 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:32.277 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:32.278 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:32.278 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:32.278 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:32.278 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:32.279 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.279 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.279 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:32.279 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:32.279 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:32.280 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:32.280 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:32.280 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:32.280 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:32.280 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:32.281 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:32.281 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:32.281 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:32.281 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.281 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:32.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3464066470 msgr2=0x7f3464068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3464066470 0x7f3464068930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f34740046c0 tx=0x7f3474009040 comp rx=0 tx=0).stop 2023-10-25T16:15:32.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 msgr2=0x7f3484158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 0x7f3484158c20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f347c009b10 tx=0x7f347c0a57c0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 shutdown_connections 2023-10-25T16:15:32.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3464066470 0x7f3464068930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f348415eba0 0x7f3484158c20 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34840cdb10 0x7f348414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 --2- 172.21.15.177:0/4031983164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34840b2120 0x7f348415aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 >> 172.21.15.177:0/4031983164 conn(0x7f348409a5c0 msgr2=0x7f34840d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:32.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 shutdown_connections 2023-10-25T16:15:32.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.070+0000 7f348a5e9640 1 -- 172.21.15.177:0/4031983164 wait complete. 2023-10-25T16:15:32.286 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-25T16:15:32.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:15:32.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/293516954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0880047d0 msgr2=0x7fc088004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/293516954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0880047d0 0x7fc088004c50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc09400bb20 tx=0x7fc09401cda0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 -- 172.21.15.177:0/293516954 reap_dead start 2023-10-25T16:15:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/293516954 shutdown_connections 2023-10-25T16:15:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/293516954 >> 172.21.15.177:0/293516954 conn(0x7fc0a00b2450 msgr2=0x7fc0a00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:32.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/293516954 shutdown_connections 2023-10-25T16:15:32.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/293516954 wait complete. 2023-10-25T16:15:32.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 Processor -- start 2023-10-25T16:15:32.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- start start 2023-10-25T16:15:32.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0880047d0 0x7fc0a01e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0a013ac90 0x7fc0a0159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 0x7fc0a01f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01e3460 con 0x7fc0a01f0220 2023-10-25T16:15:32.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0159c40 con 0x7fc0880047d0 2023-10-25T16:15:32.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01e27e0 con 0x7fc0a013ac90 2023-10-25T16:15:32.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 0x7fc0a01f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 0x7fc0a01f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41914/0 (socket says 172.21.15.177:41914) 2023-10-25T16:15:32.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 -- 172.21.15.177:0/367450094 learned_addr learned my addr 172.21.15.177:0/367450094 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:32.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a5b24640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0880047d0 0x7fc0a01e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a5323640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0a013ac90 0x7fc0a0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 -- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0a013ac90 msgr2=0x7fc0a0159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0a013ac90 0x7fc0a0159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 -- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0880047d0 msgr2=0x7fc0a01e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0880047d0 0x7fc0a01e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 -- 172.21.15.177:0/367450094 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a01e2ac0 con 0x7fc0a01f0220 2023-10-25T16:15:32.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a5323640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0a013ac90 0x7fc0a0159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:32.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a6325640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 0x7fc0a01f06d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc0900036b0 tx=0x7fc09000f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:32.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090007cb0 con 0x7fc0a01f0220 2023-10-25T16:15:32.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc09000a070 con 0x7fc0a01f0220 2023-10-25T16:15:32.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a01e2da0 con 0x7fc0a01f0220 2023-10-25T16:15:32.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09000a420 con 0x7fc0a01f0220 2023-10-25T16:15:32.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.418+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0156cf0 con 0x7fc0a01f0220 2023-10-25T16:15:32.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.422+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a0072e50 con 0x7fc0a01f0220 2023-10-25T16:15:32.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.422+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc09000a580 con 0x7fc0a01f0220 2023-10-25T16:15:32.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.422+0000 7fc09e7fc640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc08c0664a0 0x7fc08c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.422+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc090086aa0 con 0x7fc0a01f0220 2023-10-25T16:15:32.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.422+0000 7fc0a5b24640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc08c0664a0 0x7fc08c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.422+0000 7fc0a5b24640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc08c0664a0 0x7fc08c068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc098005c50 tx=0x7fc098004e10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:32.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.426+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc090053f30 con 0x7fc0a01f0220 2023-10-25T16:15:32.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.578+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc0a01e35a0 con 0x7fc0a01f0220 2023-10-25T16:15:32.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc09e7fc640 1 -- 172.21.15.177:0/367450094 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+34403 (secure 0 0 0) 0x7fc0a01e35a0 con 0x7fc0a01f0220 2023-10-25T16:15:32.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:32.587 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:32.587 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 56, 2023-10-25T16:15:32.588 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:15:32.588 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:15:32.588 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:15:28.786188+0000", 2023-10-25T16:15:32.588 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:15:32.588 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:15:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:15:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:15:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:15:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:15:32.589 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:15:32.590 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:15:32.590 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:15:32.590 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.590 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:15:32.590 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:15:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:15:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:15:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:15:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 7, 2023-10-25T16:15:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:15:32.591 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:15:32.592 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "luminous", 2023-10-25T16:15:32.592 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:15:32.592 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:15:32.592 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:15:32.592 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:15:32.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:15:32.593 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:15:32.593 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:32.593 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:32.594 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:32.594 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:32.594 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:32.594 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:32.594 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:32.595 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:32.595 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:32.595 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:32.595 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:32.595 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:32.596 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:15:32.596 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:15:32.596 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:15:32.596 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:15:32.596 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:15:32.597 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:32.597 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:32.597 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:32.597 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:32.597 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:32.597 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:32.598 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:32.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.598 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "56", 2023-10-25T16:15:32.598 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:32.598 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:32.599 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:32.599 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:32.599 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:32.599 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:32.599 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:32.600 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:32.600 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:32.600 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:32.600 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:32.600 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:32.600 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:32.601 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:32.601 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:32.601 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:32.601 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:32.601 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:32.602 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:32.602 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:32.602 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:32.602 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:32.602 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:32.603 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:32.603 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:32.603 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:32.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.603 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:32.604 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:32.604 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:32.604 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:32.604 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:32.604 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:32.604 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:32.605 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:32.605 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:32.605 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:32.605 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:32.605 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:32.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:15:32.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:15:32.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.606 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:32.606 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:15:32.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.607 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:32.607 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:15:32.607 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:15:32.607 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:15:32.608 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:15:32.608 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:15:32.608 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:32.608 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:32.608 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:32.608 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.609 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 6, 2023-10-25T16:15:32.609 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:15:32.609 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:46.415314+0000", 2023-10-25T16:15:32.610 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:32.610 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:32.610 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:32.610 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:32.610 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:32.611 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:32.611 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:32.611 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:32.611 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:32.611 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:32.611 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:32.612 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:32.612 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:15:32.612 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:15:32.612 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:15:32.612 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:15:32.613 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:15:32.613 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:32.613 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:32.613 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:32.613 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:32.613 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:32.614 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:32.614 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:32.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.614 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "56", 2023-10-25T16:15:32.614 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:32.615 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:32.615 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:32.615 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:32.615 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:32.615 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:32.616 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:32.616 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:32.616 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:32.616 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:32.616 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:32.616 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:32.617 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:32.617 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:32.617 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:32.617 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:32.617 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:32.618 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:32.618 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:32.618 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:32.618 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:32.618 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:32.619 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:32.619 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:32.619 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:32.619 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:32.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.620 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:32.620 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:32.620 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:32.620 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:32.620 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:32.621 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:32.621 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:32.621 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:32.621 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:32.621 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:32.622 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:32.622 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:32.622 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:15:32.622 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:15:32.622 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:15:32.623 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.623 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:32.623 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:32.623 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:15:32.623 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.624 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:32.624 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:15:32.624 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:15:32.624 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:32.625 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:15:32.625 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:15:32.625 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:32.625 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:32.625 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:32.626 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.626 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 7, 2023-10-25T16:15:32.626 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:15:32.627 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:14:47.194703+0000", 2023-10-25T16:15:32.627 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:15:32.627 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:15:32.627 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:15:32.627 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:15:32.627 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:15:32.628 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:15:32.628 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:15:32.628 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:15:32.628 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:15:32.628 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:15:32.629 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:15:32.629 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:15:32.629 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:15:32.629 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:15:32.629 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:15:32.630 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:15:32.630 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:15:32.630 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:15:32.630 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:15:32.630 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:15:32.631 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:15:32.631 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:15:32.631 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:15:32.631 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:15:32.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "56", 2023-10-25T16:15:32.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:15:32.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:15:32.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:15:32.632 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:15:32.633 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:15:32.633 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:15:32.633 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:15:32.633 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:15:32.633 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:15:32.633 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:15:32.634 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:15:32.634 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:15:32.634 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:15:32.634 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:15:32.634 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:15:32.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:15:32.635 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:15:32.635 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:15:32.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:15:32.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:15:32.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:15:32.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:15:32.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:15:32.636 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:15:32.636 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:15:32.636 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:15:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:15:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:15:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:15:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:15:32.637 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:15:32.638 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:15:32.638 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:15:32.638 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:15:32.638 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:15:32.638 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:15:32.639 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:15:32.639 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:15:32.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:15:32.639 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:15:32.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.639 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:15:32.640 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:15:32.640 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:15:32.640 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.640 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:15:32.641 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.6299999952316284, 2023-10-25T16:15:32.641 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.6299999952316284, 2023-10-25T16:15:32.641 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:15:32.641 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-25T16:15:32.641 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-25T16:15:32.642 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:15:32.642 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:15:32.642 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:15:32.642 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.642 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.643 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.643 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:15:32.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.643 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:32.643 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.643 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.644 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.644 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.644 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.644 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.644 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.645 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.645 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.645 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.645 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.645 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.645 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.646 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.646 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:15:32.646 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.647 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.647 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.647 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:15:32.647 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.647 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.648 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.648 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.648 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.648 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.648 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.649 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:15:32.649 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.649 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.650 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:15:32.650 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.650 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.650 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.650 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.651 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.651 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.651 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.651 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:15:32.652 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.652 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.652 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:15:32.652 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.653 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.653 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.653 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.653 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.654 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:15:32.654 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:15:32.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:15:32.655 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.655 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.656 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:15:32.656 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:15:32.656 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:15:32.656 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:15:32.657 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.657 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.657 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.657 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.658 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.658 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:32.658 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.658 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.658 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.658 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.659 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.659 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.659 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.659 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.659 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.660 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.660 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.660 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.660 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.661 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.661 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:15:32.661 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.662 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.662 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:15:32.662 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.662 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.662 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.663 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.663 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.663 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.664 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:15:32.664 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.664 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.664 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:15:32.665 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.665 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.665 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.665 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.665 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.666 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.666 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.666 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.666 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:15:32.666 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.666 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.667 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.667 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:15:32.667 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.667 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.668 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.668 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.668 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.668 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.668 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:15:32.669 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.669 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.670 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:15:32.670 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:15:32.670 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.670 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.671 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:15:32.671 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:15:32.671 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:15:32.671 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:15:32.671 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.671 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.672 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.672 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.672 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:32.673 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.673 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.673 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.673 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.673 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:15:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.674 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.675 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:15:32.676 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.676 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.676 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:15:32.676 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.677 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.677 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.677 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.677 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.678 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.678 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:15:32.678 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.678 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.679 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.679 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.679 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:15:32.679 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.679 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.680 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.680 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.680 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.680 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.681 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.681 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:15:32.681 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.681 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.681 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.682 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:15:32.682 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.682 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.682 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.682 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.683 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.683 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.683 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.683 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.683 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:15:32.684 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.684 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:15:32.684 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:15:32.685 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.685 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.685 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.685 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:15:32.685 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:15:32.686 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:15:32.686 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:15:32.686 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.686 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.686 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.687 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.687 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:32.687 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.687 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.688 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.688 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.688 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.688 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.688 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.689 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.689 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.689 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.689 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.689 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.690 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.690 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:15:32.690 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.691 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.691 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:15:32.691 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.691 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.691 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.692 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.692 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.692 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.692 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.693 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:15:32.693 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.693 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.693 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:15:32.694 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.694 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.694 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.694 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.695 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.695 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.695 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.695 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:15:32.695 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.696 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.696 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:15:32.696 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.696 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.697 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.697 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.697 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:15:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.698 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:15:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:15:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.700 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:15:32.700 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:15:32.700 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:15:32.700 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:15:32.700 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.701 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.701 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.701 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.701 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:32.702 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.702 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.702 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.702 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.702 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.703 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.703 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.703 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.703 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.703 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.703 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.704 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.704 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.704 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:15:32.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.705 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:15:32.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.706 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.707 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.707 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.707 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:15:32.707 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.707 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.708 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.708 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.708 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:15:32.708 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.708 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.708 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.709 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.709 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.710 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:15:32.710 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.710 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.710 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.710 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:15:32.711 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.711 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.711 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.711 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.712 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.712 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.712 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:15:32.712 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.713 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.713 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.713 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:15:32.713 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:15:32.713 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.714 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.714 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:15:32.714 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:15:32.714 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:15:32.715 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:15:32.715 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.715 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.715 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.715 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.716 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:32.716 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.716 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.716 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.717 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.717 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.717 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.717 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.717 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.718 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:32.718 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.718 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.718 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.718 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.719 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.719 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:15:32.719 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.719 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.720 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.720 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:15:32.720 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.720 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.720 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.721 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.721 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.721 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.721 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.721 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.721 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:15:32.722 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.722 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.722 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.722 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:15:32.723 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.723 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.723 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.723 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.723 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.724 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.724 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.724 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.724 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:15:32.724 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.724 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.725 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.725 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.725 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:15:32.725 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.725 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.726 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.726 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.726 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.726 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.726 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:15:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.727 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.728 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:15:32.728 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:15:32.728 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.728 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.729 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:15:32.729 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:15:32.729 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:15:32.729 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:15:32.729 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.729 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.730 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.730 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.730 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.730 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.733 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:32.733 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.734 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.734 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.734 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.734 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.734 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.735 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.735 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.735 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 49, 2023-10-25T16:15:32.735 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.735 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.736 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.736 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.736 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.736 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.736 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:15:32.737 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.737 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.737 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.737 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.737 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:15:32.738 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.738 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.738 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.738 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.738 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.738 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.739 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.739 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.739 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:15:32.739 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.740 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.740 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:15:32.740 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.740 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.741 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.741 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.741 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.741 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.742 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:15:32.742 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.742 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.743 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.743 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:15:32.743 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.743 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.743 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.743 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.744 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.744 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.744 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.744 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.744 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:15:32.745 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.746 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.746 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:15:32.746 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:15:32.746 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.746 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.747 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:15:32.747 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:15:32.747 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:15:32.747 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:15:32.748 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.748 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.748 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.748 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.749 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.749 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:32.749 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:15:32.749 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:15:32.749 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:15:32.749 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:15:32.750 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:15:32.750 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:15:32.750 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:15:32.750 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:15:32.750 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 46, 2023-10-25T16:15:32.751 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:15:32.751 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:15:32.751 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:15:32.751 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.751 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.751 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.752 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:15:32.752 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.752 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.753 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:15:32.753 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.753 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.753 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.753 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:15:32.754 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.754 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.754 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:15:32.754 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.755 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.755 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.755 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:15:32.755 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.756 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.756 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.756 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:15:32.756 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:15:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.757 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.758 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.758 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:15:32.758 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.758 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.758 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.759 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:15:32.759 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:15:32.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.759 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:15:32.760 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:15:32.760 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.760 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.760 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.760 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:15:32.761 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:15:32.761 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:15:32.761 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.761 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.761 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.761 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:15:32.762 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:15:32.762 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:15:32.762 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:15:32.762 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:15:32.763 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:15:32.763 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:15:32.763 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.763 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.763 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:15:32.764 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.764 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:15:32.764 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.764 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.764 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.765 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.765 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.765 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:15:32.765 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.765 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.766 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.766 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:15:32.766 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.766 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.766 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.767 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.767 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.767 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:15:32.767 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.767 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.768 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:15:32.768 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.768 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.768 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.768 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.769 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.769 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:15:32.769 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.769 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.769 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.769 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:15:32.770 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.770 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.770 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.770 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.770 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.771 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:15:32.771 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.771 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.771 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.771 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:15:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.772 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:15:32.773 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.773 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.773 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.773 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:15:32.773 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.774 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.774 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.774 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.774 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.774 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:15:32.775 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.775 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.775 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.775 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:15:32.775 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.775 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.776 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.776 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.776 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.776 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:15:32.776 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.777 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.777 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.777 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:15:32.777 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:15:32.777 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:15:32.778 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:15:32.778 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:15:32.778 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:15:32.778 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:15:32.778 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:15:32.779 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.779 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.779 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:15:32.779 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [ 2023-10-25T16:15:32.779 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.779 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.30", 2023-10-25T16:15:32.780 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:32.780 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.780 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:32.780 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 4 2023-10-25T16:15:32.780 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.781 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.781 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.781 INFO:teuthology.orchestra.run.smithi177.stdout: "pgid": "7.32", 2023-10-25T16:15:32.781 INFO:teuthology.orchestra.run.smithi177.stdout: "mappings": [ 2023-10-25T16:15:32.781 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:32.782 INFO:teuthology.orchestra.run.smithi177.stdout: "from": 0, 2023-10-25T16:15:32.782 INFO:teuthology.orchestra.run.smithi177.stdout: "to": 5 2023-10-25T16:15:32.782 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.782 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:32.782 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.783 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:15:32.783 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:15:32.783 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:15:32.783 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:15:32.783 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:15:32.784 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:15:32.784 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:15:32.784 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:15:32.784 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:15:32.784 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:15:32.785 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:15:32.785 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:15:32.785 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:15:32.785 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:32.785 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:15:32.786 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:15:32.786 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:15:32.786 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:15:32.786 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:15:32.786 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:15:32.787 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:15:32.787 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:15:32.787 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:15:32.787 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:15:32.787 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:15:32.788 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:32.788 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:32.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc08c0664a0 msgr2=0x7fc08c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc08c0664a0 0x7fc08c068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc098005c50 tx=0x7fc098004e10 comp rx=0 tx=0).stop 2023-10-25T16:15:32.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 msgr2=0x7fc0a01f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 0x7fc0a01f06d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc0900036b0 tx=0x7fc09000f820 comp rx=0 tx=0).stop 2023-10-25T16:15:32.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 shutdown_connections 2023-10-25T16:15:32.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc08c0664a0 0x7fc08c068960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a01f0220 0x7fc0a01f06d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0a013ac90 0x7fc0a0159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 --2- 172.21.15.177:0/367450094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0880047d0 0x7fc0a01e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 >> 172.21.15.177:0/367450094 conn(0x7fc0a00b2450 msgr2=0x7fc0a006f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:32.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 shutdown_connections 2023-10-25T16:15:32.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.582+0000 7fc0a7d88640 1 -- 172.21.15.177:0/367450094 wait complete. 2023-10-25T16:15:32.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:32.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 -- 172.21.15.177:0/2930942212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4894140cf0 msgr2=0x7f48940af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 --2- 172.21.15.177:0/2930942212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4894140cf0 0x7f48940af5d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4884009900 tx=0x7f488401c7f0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 -- 172.21.15.177:0/2930942212 shutdown_connections 2023-10-25T16:15:32.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 --2- 172.21.15.177:0/2930942212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489406c160 0x7f48940cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 --2- 172.21.15.177:0/2930942212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4894140cf0 0x7f48940af5d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 -- 172.21.15.177:0/2930942212 >> 172.21.15.177:0/2930942212 conn(0x7f48940b2450 msgr2=0x7f48940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:32.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 -- 172.21.15.177:0/2930942212 shutdown_connections 2023-10-25T16:15:32.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 -- 172.21.15.177:0/2930942212 wait complete. 2023-10-25T16:15:32.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 Processor -- start 2023-10-25T16:15:32.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.918+0000 7f489966d640 1 -- start start 2023-10-25T16:15:32.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489406c160 0x7f48941567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 0x7f48941378e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894140cf0 0x7f4894156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894157030 con 0x7f489406f570 2023-10-25T16:15:32.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894156590 con 0x7f4894140cf0 2023-10-25T16:15:32.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4894137fe0 con 0x7f489406c160 2023-10-25T16:15:32.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 0x7f48941378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 0x7f48941378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41936/0 (socket says 172.21.15.177:41936) 2023-10-25T16:15:32.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 -- 172.21.15.177:0/489861072 learned_addr learned my addr 172.21.15.177:0/489861072 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:32.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f4892ffd640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489406c160 0x7f48941567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48937fe640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894140cf0 0x7f4894156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 -- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489406c160 msgr2=0x7f48941567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489406c160 0x7f48941567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 -- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894140cf0 msgr2=0x7f4894156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:32.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894140cf0 0x7f4894156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:32.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 -- 172.21.15.177:0/489861072 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009560 con 0x7f489406f570 2023-10-25T16:15:32.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48937fe640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894140cf0 0x7f4894156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:32.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f48927fc640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 0x7f48941378e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f488800c410 tx=0x7f488800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:32.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888011790 con 0x7f489406f570 2023-10-25T16:15:32.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f48880119e0 con 0x7f489406f570 2023-10-25T16:15:32.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888011e30 con 0x7f489406f570 2023-10-25T16:15:32.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48941382c0 con 0x7f489406f570 2023-10-25T16:15:32.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4894138880 con 0x7f489406f570 2023-10-25T16:15:32.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489404daf0 con 0x7f489406f570 2023-10-25T16:15:32.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4888007020 con 0x7f489406f570 2023-10-25T16:15:32.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f487b7fe640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:32.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.922+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4888083f10 con 0x7f489406f570 2023-10-25T16:15:32.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.926+0000 7f4892ffd640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:32.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.926+0000 7f4892ffd640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f48840ae000 tx=0x7f488401b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:32.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:32.926+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48880512d0 con 0x7f489406f570 2023-10-25T16:15:33.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.110+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48940ca670 con 0x7f489406f570 2023-10-25T16:15:33.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f487b7fe640 1 -- 172.21.15.177:0/489861072 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f48880548f0 con 0x7f489406f570 2023-10-25T16:15:33.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:33.119 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:33.119 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:33.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 msgr2=0x7f4880068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:33.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f48840ae000 tx=0x7f488401b030 comp rx=0 tx=0).stop 2023-10-25T16:15:33.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 msgr2=0x7f48941378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:33.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 0x7f48941378e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f488800c410 tx=0x7f488800c8d0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 shutdown_connections 2023-10-25T16:15:33.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4894140cf0 0x7f4894156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489406f570 0x7f48941378e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 --2- 172.21.15.177:0/489861072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489406c160 0x7f48941567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 >> 172.21.15.177:0/489861072 conn(0x7f48940b2450 msgr2=0x7f4894070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:33.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 shutdown_connections 2023-10-25T16:15:33.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.114+0000 7f489966d640 1 -- 172.21.15.177:0/489861072 wait complete. 2023-10-25T16:15:33.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:15:33.278 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":5859,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":44.419475267999999,"mdsmap_epoch":19,"osdmap_epoch":56,"osdmap_epoch_barrier":53,"uptime":49.080937585000001} 2023-10-25T16:15:33.279 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 5859, "mdsmap_epoch": 19, "osdmap_epoch": 56, "osdmap_epoch_barrier": 53, "rank_uptime": 44.419475268, "state": "up:active", "uptime": 49.080937585, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:15:33.279 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:15:33.280 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:33.280 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:33.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:33.287 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-25T16:15:33.705 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records in 2023-10-25T16:15:33.706 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records out 2023-10-25T16:15:33.706 INFO:teuthology.orchestra.run.smithi177.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.367434 s, 143 MB/s 2023-10-25T16:15:33.707 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:15:33.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:15:33.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:15:33.805 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:15:33.806 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:33.806 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:33.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:33.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 -- 172.21.15.177:0/3187224627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19841500f0 msgr2=0x7f19840c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:33.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 --2- 172.21.15.177:0/3187224627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19841500f0 0x7f19840c9910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1974009900 tx=0x7f197401c890 comp rx=0 tx=0).stop 2023-10-25T16:15:33.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 -- 172.21.15.177:0/3187224627 shutdown_connections 2023-10-25T16:15:33.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 --2- 172.21.15.177:0/3187224627 >> v2:172.21.15.184:3300/0 conn(0x7f19840c9e50 0x7f198406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 --2- 172.21.15.177:0/3187224627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19841500f0 0x7f19840c9910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 -- 172.21.15.177:0/3187224627 >> 172.21.15.177:0/3187224627 conn(0x7f19840b2450 msgr2=0x7f19840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:33.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 -- 172.21.15.177:0/3187224627 shutdown_connections 2023-10-25T16:15:33.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.982+0000 7f198af02640 1 -- 172.21.15.177:0/3187224627 wait complete. 2023-10-25T16:15:33.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 Processor -- start 2023-10-25T16:15:33.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- start start 2023-10-25T16:15:33.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f198406bf20 0x7f19841515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 0x7f1984151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19841500f0 0x7f1984152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840ae3f0 con 0x7f19840c9e50 2023-10-25T16:15:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984152580 con 0x7f19841500f0 2023-10-25T16:15:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840ad520 con 0x7f198406bf20 2023-10-25T16:15:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 0x7f1984151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 0x7f1984151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41952/0 (socket says 172.21.15.177:41952) 2023-10-25T16:15:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 -- 172.21.15.177:0/31236635 learned_addr learned my addr 172.21.15.177:0/31236635 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1988c9e640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f198406bf20 0x7f19841515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198949f640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19841500f0 0x7f1984152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 -- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f198406bf20 msgr2=0x7f19841515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f198406bf20 0x7f19841515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 -- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19841500f0 msgr2=0x7f1984152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19841500f0 0x7f1984152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 -- 172.21.15.177:0/31236635 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009560 con 0x7f19840c9e50 2023-10-25T16:15:33.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f1983fff640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 0x7f1984151b00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f197800e9f0 tx=0x7f197800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:33.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800ccc0 con 0x7f19840c9e50 2023-10-25T16:15:33.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19840ad770 con 0x7f19840c9e50 2023-10-25T16:15:33.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1978010430 con 0x7f19840c9e50 2023-10-25T16:15:33.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978010840 con 0x7f19840c9e50 2023-10-25T16:15:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19840add30 con 0x7f19840c9e50 2023-10-25T16:15:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.986+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19840ae530 con 0x7f19840c9e50 2023-10-25T16:15:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.990+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19780109a0 con 0x7f19840c9e50 2023-10-25T16:15:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.990+0000 7f19817fa640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19700664a0 0x7f1970068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.990+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1978014070 con 0x7f19840c9e50 2023-10-25T16:15:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.990+0000 7f1988c9e640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19700664a0 0x7f1970068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.990+0000 7f1988c9e640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19700664a0 0x7f1970068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19740af000 tx=0x7f197401b0d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:33.994+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1978050090 con 0x7f19840c9e50 2023-10-25T16:15:34.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.150+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f198404daf0 con 0x7f19840c9e50 2023-10-25T16:15:34.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.150+0000 7f19817fa640 1 -- 172.21.15.177:0/31236635 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f1978055a30 con 0x7f19840c9e50 2023-10-25T16:15:34.156 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:34.157 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":56,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:28.786188+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:34.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19700664a0 msgr2=0x7f1970068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19700664a0 0x7f1970068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19740af000 tx=0x7f197401b0d0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 msgr2=0x7f1984151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 0x7f1984151b00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f197800e9f0 tx=0x7f197800eeb0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 shutdown_connections 2023-10-25T16:15:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f19700664a0 0x7f1970068960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19841500f0 0x7f1984152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19840c9e50 0x7f1984151b00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 --2- 172.21.15.177:0/31236635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f198406bf20 0x7f19841515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 >> 172.21.15.177:0/31236635 conn(0x7f19840b2450 msgr2=0x7f19840b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 shutdown_connections 2023-10-25T16:15:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.154+0000 7f198af02640 1 -- 172.21.15.177:0/31236635 wait complete. 2023-10-25T16:15:34.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:14:46.415314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:14:47.194703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:15:34.177 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:15:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/891529309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e40047d0 msgr2=0x7fe8e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/891529309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e40047d0 0x7fe8e4004c50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00016b0 tx=0x7fe8e001c750 comp rx=0 tx=0).stop 2023-10-25T16:15:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/891529309 shutdown_connections 2023-10-25T16:15:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/891529309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8e40047d0 0x7fe8e4004c50 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/891529309 >> 172.21.15.177:0/891529309 conn(0x7fe8f80af5b0 msgr2=0x7fe8f80af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:34.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/891529309 shutdown_connections 2023-10-25T16:15:34.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/891529309 wait complete. 2023-10-25T16:15:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 Processor -- start 2023-10-25T16:15:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- start start 2023-10-25T16:15:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e40047d0 0x7fe8f814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 0x7fe8f8151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8f814a530 0x7fe8f8156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80b06a0 con 0x7fe8f81f5420 2023-10-25T16:15:34.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f814ff20 con 0x7fe8f814a530 2023-10-25T16:15:34.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8150200 con 0x7fe8e40047d0 2023-10-25T16:15:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 0x7fe8f8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 0x7fe8f8151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41958/0 (socket says 172.21.15.177:41958) 2023-10-25T16:15:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 -- 172.21.15.177:0/2565783036 learned_addr learned my addr 172.21.15.177:0/2565783036 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8f659c640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e40047d0 0x7fe8f814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 -- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e40047d0 msgr2=0x7fe8f814f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e40047d0 0x7fe8f814f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8f6d9d640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8f814a530 0x7fe8f8156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 -- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8f814a530 msgr2=0x7fe8f8156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8f814a530 0x7fe8f8156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 -- 172.21.15.177:0/2565783036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f81504e0 con 0x7fe8f81f5420 2023-10-25T16:15:34.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8f6d9d640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8f814a530 0x7fe8f8156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:34.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8effff640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 0x7fe8f8151300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001c580 tx=0x7fe8e0003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00b4070 con 0x7fe8f81f5420 2023-10-25T16:15:34.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe8e00068f0 con 0x7fe8f81f5420 2023-10-25T16:15:34.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00060b0 con 0x7fe8f81f5420 2023-10-25T16:15:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f81507c0 con 0x7fe8f81f5420 2023-10-25T16:15:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.306+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f814a9b0 con 0x7fe8f81f5420 2023-10-25T16:15:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.310+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f804daf0 con 0x7fe8f81f5420 2023-10-25T16:15:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.310+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8e00a64e0 con 0x7fe8f81f5420 2023-10-25T16:15:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.310+0000 7fe8eeffd640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8d8066470 0x7fe8d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.310+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe8e011db60 con 0x7fe8f81f5420 2023-10-25T16:15:34.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.310+0000 7fe8f659c640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8d8066470 0x7fe8d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.310+0000 7fe8f659c640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8d8066470 0x7fe8d8068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8063450 tx=0x7fe8e80091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.314+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8e00eaf20 con 0x7fe8f81f5420 2023-10-25T16:15:34.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.466+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8f8150950 con 0x7fe8f81f5420 2023-10-25T16:15:34.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8eeffd640 1 -- 172.21.15.177:0/2565783036 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8e00ee540 con 0x7fe8f81f5420 2023-10-25T16:15:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:15:34.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8d8066470 msgr2=0x7fe8d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8d8066470 0x7fe8d8068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8063450 tx=0x7fe8e80091e0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 msgr2=0x7fe8f8151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 0x7fe8f8151300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001c580 tx=0x7fe8e0003b50 comp rx=0 tx=0).stop 2023-10-25T16:15:34.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 shutdown_connections 2023-10-25T16:15:34.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8d8066470 0x7fe8d8068930 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8f814a530 0x7fe8f8156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8f81f5420 0x7fe8f8151300 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 --2- 172.21.15.177:0/2565783036 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8e40047d0 0x7fe8f814f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 >> 172.21.15.177:0/2565783036 conn(0x7fe8f80af5b0 msgr2=0x7fe8f815a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 shutdown_connections 2023-10-25T16:15:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.470+0000 7fe8fcd02640 1 -- 172.21.15.177:0/2565783036 wait complete. 2023-10-25T16:15:34.493 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:15:34.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- 172.21.15.177:0/1724457584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 msgr2=0x7f06d806ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 --2- 172.21.15.177:0/1724457584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d806ba50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0098f0 tx=0x7f06cc01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- 172.21.15.177:0/1724457584 shutdown_connections 2023-10-25T16:15:34.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 --2- 172.21.15.177:0/1724457584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d806ba50 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 --2- 172.21.15.177:0/1724457584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d8140cf0 0x7f06d80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- 172.21.15.177:0/1724457584 >> 172.21.15.177:0/1724457584 conn(0x7f06d80b2450 msgr2=0x7f06d80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:34.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- 172.21.15.177:0/1724457584 shutdown_connections 2023-10-25T16:15:34.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- 172.21.15.177:0/1724457584 wait complete. 2023-10-25T16:15:34.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 Processor -- start 2023-10-25T16:15:34.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- start start 2023-10-25T16:15:34.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d806bf90 0x7f06d80ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d813d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06d8140cf0 0x7f06d8157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d813b680 con 0x7f06d806f570 2023-10-25T16:15:34.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d815a9d0 con 0x7f06d8140cf0 2023-10-25T16:15:34.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06df21b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d813ad50 con 0x7f06d806bf90 2023-10-25T16:15:34.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d813d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d813d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41986/0 (socket says 172.21.15.177:41986) 2023-10-25T16:15:34.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06d7fff640 1 -- 172.21.15.177:0/125262798 learned_addr learned my addr 172.21.15.177:0/125262798 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:34.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06dcfb7640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d806bf90 0x7f06d80ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.622+0000 7f06dd7b8640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06d8140cf0 0x7f06d8157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d7fff640 1 -- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d806bf90 msgr2=0x7f06d80ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d7fff640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d806bf90 0x7f06d80ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d7fff640 1 -- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06d8140cf0 msgr2=0x7f06d8157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d7fff640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06d8140cf0 0x7f06d8157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d7fff640 1 -- 172.21.15.177:0/125262798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc009500 con 0x7f06d806f570 2023-10-25T16:15:34.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06dcfb7640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d806bf90 0x7f06d80ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:34.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d7fff640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d813d1c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f06cc01c620 tx=0x7f06cc0a6580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b6070 con 0x7f06d806f570 2023-10-25T16:15:34.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06cc004030 con 0x7f06d806f570 2023-10-25T16:15:34.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d813b030 con 0x7f06d806f570 2023-10-25T16:15:34.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc004440 con 0x7f06d806f570 2023-10-25T16:15:34.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d815a5f0 con 0x7f06d806f570 2023-10-25T16:15:34.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d804daf0 con 0x7f06d806f570 2023-10-25T16:15:34.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f06cc005040 con 0x7f06d806f570 2023-10-25T16:15:34.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d57fa640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f06c4066470 0x7f06c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f06cc11e290 con 0x7f06d806f570 2023-10-25T16:15:34.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06dcfb7640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f06c4066470 0x7f06c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.626+0000 7f06dcfb7640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f06c4066470 0x7f06c4068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005fd0 tx=0x7f06c8005d00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.630+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06cc0eb6d0 con 0x7f06d806f570 2023-10-25T16:15:34.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.786+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06d813ae90 con 0x7f06d806f570 2023-10-25T16:15:34.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.786+0000 7f06d57fa640 1 -- 172.21.15.177:0/125262798 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06d813ae90 con 0x7f06d806f570 2023-10-25T16:15:34.792 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:15:34.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f06c4066470 msgr2=0x7f06c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f06c4066470 0x7f06c4068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005fd0 tx=0x7f06c8005d00 comp rx=0 tx=0).stop 2023-10-25T16:15:34.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 msgr2=0x7f06d813d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d813d1c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f06cc01c620 tx=0x7f06cc0a6580 comp rx=0 tx=0).stop 2023-10-25T16:15:34.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 shutdown_connections 2023-10-25T16:15:34.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f06c4066470 0x7f06c4068930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06d8140cf0 0x7f06d8157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f06d806f570 0x7f06d813d1c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 --2- 172.21.15.177:0/125262798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06d806bf90 0x7f06d80ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 >> 172.21.15.177:0/125262798 conn(0x7f06d80b2450 msgr2=0x7f06d80cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:34.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 shutdown_connections 2023-10-25T16:15:34.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.790+0000 7f06df21b640 1 -- 172.21.15.177:0/125262798 wait complete. 2023-10-25T16:15:34.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:15:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- 172.21.15.177:0/1623214705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740047d0 msgr2=0x7fdf74004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 --2- 172.21.15.177:0/1623214705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740047d0 0x7fdf74004c50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdf80005fd0 tx=0x7fdf8001cd60 comp rx=0 tx=0).stop 2023-10-25T16:15:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- 172.21.15.177:0/1623214705 shutdown_connections 2023-10-25T16:15:34.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 --2- 172.21.15.177:0/1623214705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf740047d0 0x7fdf74004c50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- 172.21.15.177:0/1623214705 >> 172.21.15.177:0/1623214705 conn(0x7fdf8c09a570 msgr2=0x7fdf8c0d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- 172.21.15.177:0/1623214705 shutdown_connections 2023-10-25T16:15:34.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- 172.21.15.177:0/1623214705 wait complete. 2023-10-25T16:15:34.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 Processor -- start 2023-10-25T16:15:34.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- start start 2023-10-25T16:15:34.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf740047d0 0x7fdf8c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf8c150310 0x7fdf8c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 0x7fdf8c0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c14df30 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c14e1d0 con 0x7fdf740047d0 2023-10-25T16:15:34.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf909bb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c14e4b0 con 0x7fdf8c150310 2023-10-25T16:15:34.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.938+0000 7fdf8ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 0x7fdf8c0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 0x7fdf8c0c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41996/0 (socket says 172.21.15.177:41996) 2023-10-25T16:15:34.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 -- 172.21.15.177:0/3499558427 learned_addr learned my addr 172.21.15.177:0/3499558427 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:34.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8a59c640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf740047d0 0x7fdf8c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf89d9b640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf8c150310 0x7fdf8c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 -- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf8c150310 msgr2=0x7fdf8c0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf8c150310 0x7fdf8c0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 -- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf740047d0 msgr2=0x7fdf8c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf740047d0 0x7fdf8c14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 -- 172.21.15.177:0/3499558427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c14e790 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8ad9d640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 0x7fdf8c0c4ff0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c09ac80 tx=0x7fdf8400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84004de0 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf84006160 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84006570 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c14ea70 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c0caa20 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c066440 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf840066d0 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf7affd640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf6c066470 0x7fdf6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:34.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdf84084230 con 0x7fdf8c14f4d0 2023-10-25T16:15:34.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8a59c640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf6c066470 0x7fdf6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:34.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.942+0000 7fdf8a59c640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf6c066470 0x7fdf6c068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00af70 tx=0x7fdf7c00c040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:34.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:34.946+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf84051710 con 0x7fdf8c14f4d0 2023-10-25T16:15:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf8c04daf0 con 0x7fdf8c14f4d0 2023-10-25T16:15:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf7affd640 1 -- 172.21.15.177:0/3499558427 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf84054d30 con 0x7fdf8c14f4d0 2023-10-25T16:15:35.111 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:15:35.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf6c066470 msgr2=0x7fdf6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf6c066470 0x7fdf6c068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00af70 tx=0x7fdf7c00c040 comp rx=0 tx=0).stop 2023-10-25T16:15:35.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 msgr2=0x7fdf8c0c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 0x7fdf8c0c4ff0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c09ac80 tx=0x7fdf8400da80 comp rx=0 tx=0).stop 2023-10-25T16:15:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 shutdown_connections 2023-10-25T16:15:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf6c066470 0x7fdf6c068930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c14f4d0 0x7fdf8c0c4ff0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf8c150310 0x7fdf8c0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 --2- 172.21.15.177:0/3499558427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf740047d0 0x7fdf8c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 >> 172.21.15.177:0/3499558427 conn(0x7fdf8c09a570 msgr2=0x7fdf8c15a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 shutdown_connections 2023-10-25T16:15:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.106+0000 7fdf909bb640 1 -- 172.21.15.177:0/3499558427 wait complete. 2023-10-25T16:15:35.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:15:35.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 -- 172.21.15.177:0/687667941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1790003980 msgr2=0x7f1790003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/687667941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1790003980 0x7f1790003da0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f179c009ee0 tx=0x7f179c01d5d0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a3fff640 1 -- 172.21.15.177:0/687667941 reap_dead start 2023-10-25T16:15:35.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 -- 172.21.15.177:0/687667941 shutdown_connections 2023-10-25T16:15:35.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 -- 172.21.15.177:0/687667941 >> 172.21.15.177:0/687667941 conn(0x7f17a409a5c0 msgr2=0x7f17a40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:35.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 -- 172.21.15.177:0/687667941 shutdown_connections 2023-10-25T16:15:35.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 -- 172.21.15.177:0/687667941 wait complete. 2023-10-25T16:15:35.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 Processor -- start 2023-10-25T16:15:35.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.254+0000 7f17a9d5c640 1 -- start start 2023-10-25T16:15:35.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1790003980 0x7f17a415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c8380 0x7f17a40c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 0x7f17a40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4159ce0 con 0x7f17a414c5f0 2023-10-25T16:15:35.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c9ed0 con 0x7f17a40c8380 2023-10-25T16:15:35.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c88f0 con 0x7f1790003980 2023-10-25T16:15:35.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 0x7f17a40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 0x7f17a40ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42012/0 (socket says 172.21.15.177:42012) 2023-10-25T16:15:35.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 -- 172.21.15.177:0/2887234841 learned_addr learned my addr 172.21.15.177:0/2887234841 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:35.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a2ffd640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c8380 0x7f17a40c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a37fe640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1790003980 0x7f17a415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 -- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1790003980 msgr2=0x7f17a415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1790003980 0x7f17a415d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 -- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c8380 msgr2=0x7f17a40c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c8380 0x7f17a40c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 -- 172.21.15.177:0/2887234841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40c8bd0 con 0x7f17a414c5f0 2023-10-25T16:15:35.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a37fe640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1790003980 0x7f17a415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:35.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a3fff640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 0x7f17a40ca670 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f17940046e0 tx=0x7f179400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:35.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794012630 con 0x7f17a414c5f0 2023-10-25T16:15:35.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17940127b0 con 0x7f17a414c5f0 2023-10-25T16:15:35.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a40c8eb0 con 0x7f17a414c5f0 2023-10-25T16:15:35.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794012bc0 con 0x7f17a414c5f0 2023-10-25T16:15:35.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a40c9470 con 0x7f17a414c5f0 2023-10-25T16:15:35.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a40c9660 con 0x7f17a414c5f0 2023-10-25T16:15:35.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f179401d460 con 0x7f17a414c5f0 2023-10-25T16:15:35.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f179bfff640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1794083cc0 con 0x7f17a414c5f0 2023-10-25T16:15:35.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.258+0000 7f17a37fe640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.262+0000 7f17a37fe640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17840664a0 0x7f1784068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f179c0b0000 tx=0x7f179c01a370 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:35.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.262+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1794051070 con 0x7f17a414c5f0 2023-10-25T16:15:35.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17a404daf0 con 0x7f17a414c5f0 2023-10-25T16:15:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f179bfff640 1 -- 172.21.15.177:0/2887234841 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1794054690 con 0x7f17a414c5f0 2023-10-25T16:15:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:15:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17840664a0 msgr2=0x7f1784068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17840664a0 0x7f1784068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f179c0b0000 tx=0x7f179c01a370 comp rx=0 tx=0).stop 2023-10-25T16:15:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 msgr2=0x7f17a40ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 0x7f17a40ca670 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f17940046e0 tx=0x7f179400d960 comp rx=0 tx=0).stop 2023-10-25T16:15:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 shutdown_connections 2023-10-25T16:15:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a414c5f0 0x7f17a40ca670 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.430+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17a40c8380 0x7f17a40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.434+0000 7f17a9d5c640 1 --2- 172.21.15.177:0/2887234841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1790003980 0x7f17a415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.434+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 >> 172.21.15.177:0/2887234841 conn(0x7f17a409a5c0 msgr2=0x7f17a415a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.434+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 shutdown_connections 2023-10-25T16:15:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.434+0000 7f17a9d5c640 1 -- 172.21.15.177:0/2887234841 wait complete. 2023-10-25T16:15:35.453 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:15:35.454 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:35.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:15:35.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:35.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[40825]: fuse finished with error 0 and tester_r 0 2023-10-25T16:15:35.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:35.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:15:35.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:35.511 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:15:35.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:15:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:35.573 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:15:35.574 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:35.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 -- 172.21.15.177:0/1863262788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 msgr2=0x7f20600b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 --2- 172.21.15.177:0/1863262788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f20600b0f10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f206006ca10 tx=0x7f205401c7a0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 -- 172.21.15.177:0/1863262788 shutdown_connections 2023-10-25T16:15:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 --2- 172.21.15.177:0/1863262788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f20600b0f10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 --2- 172.21.15.177:0/1863262788 >> v2:172.21.15.184:3300/0 conn(0x7f206015b6a0 0x7f20600c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 -- 172.21.15.177:0/1863262788 >> 172.21.15.177:0/1863262788 conn(0x7f20600cefe0 msgr2=0x7f20600cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 -- 172.21.15.177:0/1863262788 shutdown_connections 2023-10-25T16:15:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.726+0000 7f20669ee640 1 -- 172.21.15.177:0/1863262788 wait complete. 2023-10-25T16:15:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 Processor -- start 2023-10-25T16:15:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- start start 2023-10-25T16:15:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20600af0f0 0x7f2060154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f2060148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f206015b6a0 0x7f20601566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060155090 con 0x7f20600b0a90 2023-10-25T16:15:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060158960 con 0x7f20600af0f0 2023-10-25T16:15:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206015d5a0 con 0x7f206015b6a0 2023-10-25T16:15:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f2060148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f2060148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42024/0 (socket says 172.21.15.177:42024) 2023-10-25T16:15:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 -- 172.21.15.177:0/3612671765 learned_addr learned my addr 172.21.15.177:0/3612671765 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:35.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f2064f8b640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f206015b6a0 0x7f20601566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205ffff640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20600af0f0 0x7f2060154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 -- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f206015b6a0 msgr2=0x7f20601566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f206015b6a0 0x7f20601566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 -- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20600af0f0 msgr2=0x7f2060154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20600af0f0 0x7f2060154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 -- 172.21.15.177:0/3612671765 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009560 con 0x7f20600b0a90 2023-10-25T16:15:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205f7fe640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f2060148140 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f20540b0040 tx=0x7f20540a5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054005230 con 0x7f20600b0a90 2023-10-25T16:15:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2054005480 con 0x7f20600b0a90 2023-10-25T16:15:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2060148680 con 0x7f20600b0a90 2023-10-25T16:15:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054004930 con 0x7f20600b0a90 2023-10-25T16:15:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2060148930 con 0x7f20600b0a90 2023-10-25T16:15:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206015d750 con 0x7f20600b0a90 2023-10-25T16:15:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f20540b4070 con 0x7f20600b0a90 2023-10-25T16:15:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205cff9640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f204c066470 0x7f204c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.730+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f205411e350 con 0x7f20600b0a90 2023-10-25T16:15:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.734+0000 7f205ffff640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f204c066470 0x7f204c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.734+0000 7f205ffff640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f204c066470 0x7f204c068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2058005fd0 tx=0x7f2058005dc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.734+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20540eb820 con 0x7f20600b0a90 2023-10-25T16:15:35.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.894+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f206015d710 con 0x7f20600b0a90 2023-10-25T16:15:35.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.894+0000 7f205cff9640 1 -- 172.21.15.177:0/3612671765 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f20540a5910 con 0x7f20600b0a90 2023-10-25T16:15:35.902 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:35.902 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":56,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:28.786188+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f204c066470 msgr2=0x7f204c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f204c066470 0x7f204c068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2058005fd0 tx=0x7f2058005dc0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 msgr2=0x7f2060148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f2060148140 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f20540b0040 tx=0x7f20540a5660 comp rx=0 tx=0).stop 2023-10-25T16:15:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 shutdown_connections 2023-10-25T16:15:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f204c066470 0x7f204c068930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f206015b6a0 0x7f20601566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20600b0a90 0x7f2060148140 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 --2- 172.21.15.177:0/3612671765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20600af0f0 0x7f2060154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 >> 172.21.15.177:0/3612671765 conn(0x7f20600cefe0 msgr2=0x7f2060158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:35.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 shutdown_connections 2023-10-25T16:15:35.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:35.898+0000 7f20669ee640 1 -- 172.21.15.177:0/3612671765 wait complete. 2023-10-25T16:15:35.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:14:46.415314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:14:47.194703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:15:35.921 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:15:36.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 -- 172.21.15.177:0/1003952398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e4140e90 msgr2=0x7f02e40af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 --2- 172.21.15.177:0/1003952398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e4140e90 0x7f02e40af580 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f02e40ca640 tx=0x7f02dc01c530 comp rx=0 tx=0).stop 2023-10-25T16:15:36.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 -- 172.21.15.177:0/1003952398 shutdown_connections 2023-10-25T16:15:36.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 --2- 172.21.15.177:0/1003952398 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02e406bec0 0x7f02e40aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 --2- 172.21.15.177:0/1003952398 >> v2:172.21.15.184:3300/0 conn(0x7f02e406f570 0x7f02e406b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 --2- 172.21.15.177:0/1003952398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e4140e90 0x7f02e40af580 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 -- 172.21.15.177:0/1003952398 >> 172.21.15.177:0/1003952398 conn(0x7f02e40b2450 msgr2=0x7f02e40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 -- 172.21.15.177:0/1003952398 shutdown_connections 2023-10-25T16:15:36.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.050+0000 7f02eb777640 1 -- 172.21.15.177:0/1003952398 wait complete. 2023-10-25T16:15:36.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 Processor -- start 2023-10-25T16:15:36.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- start start 2023-10-25T16:15:36.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02e406bec0 0x7f02e414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 0x7f02e4125e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02e4140e90 0x7f02e413fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e413f990 con 0x7f02e406f570 2023-10-25T16:15:36.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e413ed10 con 0x7f02e406bec0 2023-10-25T16:15:36.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e413eff0 con 0x7f02e4140e90 2023-10-25T16:15:36.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 0x7f02e4125e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 0x7f02e4125e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42038/0 (socket says 172.21.15.177:42038) 2023-10-25T16:15:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 -- 172.21.15.177:0/1095749523 learned_addr learned my addr 172.21.15.177:0/1095749523 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e9513640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02e406bec0 0x7f02e414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e9d14640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02e4140e90 0x7f02e413fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 -- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02e4140e90 msgr2=0x7f02e413fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02e4140e90 0x7f02e413fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 -- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02e406bec0 msgr2=0x7f02e414f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02e406bec0 0x7f02e414f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 -- 172.21.15.177:0/1095749523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc009560 con 0x7f02e406f570 2023-10-25T16:15:36.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e8d12640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 0x7f02e4125e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f02d800d770 tx=0x7f02d800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8009c30 con 0x7f02e406f570 2023-10-25T16:15:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f02d800de80 con 0x7f02e406f570 2023-10-25T16:15:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8005280 con 0x7f02e406f570 2023-10-25T16:15:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e413f2d0 con 0x7f02e406f570 2023-10-25T16:15:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e414fcb0 con 0x7f02e406f570 2023-10-25T16:15:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.054+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e413fc00 con 0x7f02e406f570 2023-10-25T16:15:36.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.058+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02d80053e0 con 0x7f02e406f570 2023-10-25T16:15:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.058+0000 7f02e1ffb640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02d0066470 0x7f02d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.058+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f02d8084040 con 0x7f02e406f570 2023-10-25T16:15:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.058+0000 7f02e9513640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02d0066470 0x7f02d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.058+0000 7f02e9513640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02d0066470 0x7f02d0068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0ae000 tx=0x7f02dc01ad70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.062+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02d8051510 con 0x7f02e406f570 2023-10-25T16:15:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02e404daf0 con 0x7f02e406f570 2023-10-25T16:15:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02e1ffb640 1 -- 172.21.15.177:0/1095749523 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02d80170a0 con 0x7f02e406f570 2023-10-25T16:15:36.222 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:15:36.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02d0066470 msgr2=0x7f02d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02d0066470 0x7f02d0068930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0ae000 tx=0x7f02dc01ad70 comp rx=0 tx=0).stop 2023-10-25T16:15:36.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 msgr2=0x7f02e4125e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 0x7f02e4125e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f02d800d770 tx=0x7f02d800dc30 comp rx=0 tx=0).stop 2023-10-25T16:15:36.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 shutdown_connections 2023-10-25T16:15:36.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02d0066470 0x7f02d0068930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02e4140e90 0x7f02e413fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02e406f570 0x7f02e4125e50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 --2- 172.21.15.177:0/1095749523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02e406bec0 0x7f02e414f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 >> 172.21.15.177:0/1095749523 conn(0x7f02e40b2450 msgr2=0x7f02e40aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 shutdown_connections 2023-10-25T16:15:36.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.218+0000 7f02eb777640 1 -- 172.21.15.177:0/1095749523 wait complete. 2023-10-25T16:15:36.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:15:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/2461498656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e815c230 msgr2=0x7fd5e806e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/2461498656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e815c230 0x7fd5e806e030 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009bc0 tx=0x7fd5e001cb50 comp rx=0 tx=0).stop 2023-10-25T16:15:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/2461498656 shutdown_connections 2023-10-25T16:15:36.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/2461498656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e815c230 0x7fd5e806e030 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/2461498656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e806ce30 0x7fd5e815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/2461498656 >> 172.21.15.177:0/2461498656 conn(0x7fd5e80afe20 msgr2=0x7fd5e80b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/2461498656 shutdown_connections 2023-10-25T16:15:36.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/2461498656 wait complete. 2023-10-25T16:15:36.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 Processor -- start 2023-10-25T16:15:36.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- start start 2023-10-25T16:15:36.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 0x7fd5e8139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e813b0d0 0x7fd5e8154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e815c230 0x7fd5e8157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e81610b0 con 0x7fd5e806ce30 2023-10-25T16:15:36.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e813a6a0 con 0x7fd5e815c230 2023-10-25T16:15:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e8161300 con 0x7fd5e813b0d0 2023-10-25T16:15:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 0x7fd5e8139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 0x7fd5e8139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42048/0 (socket says 172.21.15.177:42048) 2023-10-25T16:15:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 -- 172.21.15.177:0/3828330478 learned_addr learned my addr 172.21.15.177:0/3828330478 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed03d640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e813b0d0 0x7fd5e8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 -- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e813b0d0 msgr2=0x7fd5e8154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e813b0d0 0x7fd5e8154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ee03f640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e815c230 0x7fd5e8157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 -- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e815c230 msgr2=0x7fd5e8157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e815c230 0x7fd5e8157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 -- 172.21.15.177:0/3828330478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0009820 con 0x7fd5e806ce30 2023-10-25T16:15:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5ed83e640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 0x7fd5e8139b80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c430 tx=0x7fd5e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4004230 con 0x7fd5e806ce30 2023-10-25T16:15:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5e40044a0 con 0x7fd5e806ce30 2023-10-25T16:15:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e81615e0 con 0x7fd5e806ce30 2023-10-25T16:15:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4003840 con 0x7fd5e806ce30 2023-10-25T16:15:36.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e813a330 con 0x7fd5e806ce30 2023-10-25T16:15:36.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.366+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e804daf0 con 0x7fd5e806ce30 2023-10-25T16:15:36.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.370+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd5e40039a0 con 0x7fd5e806ce30 2023-10-25T16:15:36.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.370+0000 7fd5da7fc640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc066470 0x7fd5cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.370+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd5e4083850 con 0x7fd5e806ce30 2023-10-25T16:15:36.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.370+0000 7fd5ed03d640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc066470 0x7fd5cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.370+0000 7fd5ed03d640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc066470 0x7fd5cc068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0058d0 tx=0x7fd5dc005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.374+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd5e4054890 con 0x7fd5e806ce30 2023-10-25T16:15:36.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.526+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5e806de10 con 0x7fd5e806ce30 2023-10-25T16:15:36.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.526+0000 7fd5da7fc640 1 -- 172.21.15.177:0/3828330478 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5e4054420 con 0x7fd5e806ce30 2023-10-25T16:15:36.533 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:15:36.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc066470 msgr2=0x7fd5cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc066470 0x7fd5cc068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0058d0 tx=0x7fd5dc005860 comp rx=0 tx=0).stop 2023-10-25T16:15:36.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 msgr2=0x7fd5e8139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 0x7fd5e8139b80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c430 tx=0x7fd5e400c8f0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 shutdown_connections 2023-10-25T16:15:36.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd5cc066470 0x7fd5cc068930 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5e815c230 0x7fd5e8157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5e813b0d0 0x7fd5e8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 --2- 172.21.15.177:0/3828330478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5e806ce30 0x7fd5e8139b80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 >> 172.21.15.177:0/3828330478 conn(0x7fd5e80afe20 msgr2=0x7fd5e80ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 shutdown_connections 2023-10-25T16:15:36.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.530+0000 7fd5efaa2640 1 -- 172.21.15.177:0/3828330478 wait complete. 2023-10-25T16:15:36.552 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:15:36.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- 172.21.15.177:0/615101128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c070b60 msgr2=0x7f604c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 --2- 172.21.15.177:0/615101128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c070b60 0x7f604c0b2480 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f604c06f130 tx=0x7f604401caa0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- 172.21.15.177:0/615101128 shutdown_connections 2023-10-25T16:15:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 --2- 172.21.15.177:0/615101128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c070b60 0x7f604c0b2480 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 --2- 172.21.15.177:0/615101128 >> v2:172.21.15.184:3300/0 conn(0x7f604c0715f0 0x7f604c070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- 172.21.15.177:0/615101128 >> 172.21.15.177:0/615101128 conn(0x7f604c0cdf10 msgr2=0x7f604c0ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- 172.21.15.177:0/615101128 shutdown_connections 2023-10-25T16:15:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- 172.21.15.177:0/615101128 wait complete. 2023-10-25T16:15:36.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 Processor -- start 2023-10-25T16:15:36.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- start start 2023-10-25T16:15:36.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604c070b60 0x7f604c13d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f604c0715f0 0x7f604c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 0x7f604c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c13dd40 con 0x7f604c1581a0 2023-10-25T16:15:36.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604c14bf80 con 0x7f604c070b60 2023-10-25T16:15:36.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f60540de640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604c14c260 con 0x7f604c0715f0 2023-10-25T16:15:36.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 0x7f604c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 0x7f604c14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42054/0 (socket says 172.21.15.177:42054) 2023-10-25T16:15:36.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 -- 172.21.15.177:0/504503534 learned_addr learned my addr 172.21.15.177:0/504503534 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:36.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f6051679640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f604c0715f0 0x7f604c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 -- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f604c0715f0 msgr2=0x7f604c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f604c0715f0 0x7f604c0af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f6051e7a640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604c070b60 0x7f604c13d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 -- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604c070b60 msgr2=0x7f604c13d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604c070b60 0x7f604c13d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 -- 172.21.15.177:0/504503534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009820 con 0x7f604c1581a0 2023-10-25T16:15:36.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.662+0000 7f605267b640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 0x7f604c14cf90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f60440196b0 tx=0x7f60440a5990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044003b80 con 0x7f604c1581a0 2023-10-25T16:15:36.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6044003dd0 con 0x7f604c1581a0 2023-10-25T16:15:36.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f604c14c540 con 0x7f604c1581a0 2023-10-25T16:15:36.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044004290 con 0x7f604c1581a0 2023-10-25T16:15:36.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c14cb00 con 0x7f604c1581a0 2023-10-25T16:15:36.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604c145ea0 con 0x7f604c1581a0 2023-10-25T16:15:36.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60440043f0 con 0x7f604c1581a0 2023-10-25T16:15:36.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60427fc640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6030066470 0x7f6030068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f604411ea20 con 0x7f604c1581a0 2023-10-25T16:15:36.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f6051e7a640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6030066470 0x7f6030068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.666+0000 7f6051e7a640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6030066470 0x7f6030068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f604c0af200 tx=0x7f6048009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.670+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f604c145ea0 con 0x7f604c1581a0 2023-10-25T16:15:36.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.822+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f604c145ea0 con 0x7f604c1581a0 2023-10-25T16:15:36.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60427fc640 1 -- 172.21.15.177:0/504503534 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f604c145ea0 con 0x7f604c1581a0 2023-10-25T16:15:36.830 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:15:36.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6030066470 msgr2=0x7f6030068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6030066470 0x7f6030068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f604c0af200 tx=0x7f6048009040 comp rx=0 tx=0).stop 2023-10-25T16:15:36.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 msgr2=0x7f604c14cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 0x7f604c14cf90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f60440196b0 tx=0x7f60440a5990 comp rx=0 tx=0).stop 2023-10-25T16:15:36.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 shutdown_connections 2023-10-25T16:15:36.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6030066470 0x7f6030068930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f604c1581a0 0x7f604c14cf90 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f604c0715f0 0x7f604c0af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 --2- 172.21.15.177:0/504503534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f604c070b60 0x7f604c13d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 >> 172.21.15.177:0/504503534 conn(0x7f604c0cdf10 msgr2=0x7f604c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 shutdown_connections 2023-10-25T16:15:36.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.826+0000 7f60540de640 1 -- 172.21.15.177:0/504503534 wait complete. 2023-10-25T16:15:36.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:15:36.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 -- 172.21.15.177:0/850318326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 msgr2=0x7f0444003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 --2- 172.21.15.177:0/850318326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f0444003dd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f04480016b0 tx=0x7f044801c7a0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045c822640 1 -- 172.21.15.177:0/850318326 reap_dead start 2023-10-25T16:15:36.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 -- 172.21.15.177:0/850318326 shutdown_connections 2023-10-25T16:15:36.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 -- 172.21.15.177:0/850318326 >> 172.21.15.177:0/850318326 conn(0x7f04580b2450 msgr2=0x7f04580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:36.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 -- 172.21.15.177:0/850318326 shutdown_connections 2023-10-25T16:15:36.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 -- 172.21.15.177:0/850318326 wait complete. 2023-10-25T16:15:36.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 Processor -- start 2023-10-25T16:15:36.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.958+0000 7f045e285640 1 -- start start 2023-10-25T16:15:36.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f045815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0458138830 0x7f045814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f045815a850 0x7f045814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045814dee0 con 0x7f04440039b0 2023-10-25T16:15:36.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0458158210 con 0x7f0458138830 2023-10-25T16:15:36.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04581f7090 con 0x7f045815a850 2023-10-25T16:15:36.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f045815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f045815a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42086/0 (socket says 172.21.15.177:42086) 2023-10-25T16:15:36.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 -- 172.21.15.177:0/2902305837 learned_addr learned my addr 172.21.15.177:0/2902305837 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:36.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f04577fe640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0458138830 0x7f045814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045c822640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f045815a850 0x7f045814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 -- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f045815a850 msgr2=0x7f045814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f045815a850 0x7f045814e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 -- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0458138830 msgr2=0x7f045814e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:36.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0458138830 0x7f045814e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:36.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 -- 172.21.15.177:0/2902305837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04581f7370 con 0x7f04440039b0 2023-10-25T16:15:36.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045c822640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f045815a850 0x7f045814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:36.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0457fff640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f045815a310 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f04480016b0 tx=0x7f0448006a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448003980 con 0x7f04440039b0 2023-10-25T16:15:36.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0448003ae0 con 0x7f04440039b0 2023-10-25T16:15:36.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0458159830 con 0x7f04440039b0 2023-10-25T16:15:36.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448003e90 con 0x7f04440039b0 2023-10-25T16:15:36.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0458159df0 con 0x7f04440039b0 2023-10-25T16:15:36.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0458159690 con 0x7f04440039b0 2023-10-25T16:15:36.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f04480a7460 con 0x7f04440039b0 2023-10-25T16:15:36.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0454ff9640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04380664a0 0x7f0438068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:36.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f04580cc4e0 con 0x7f04440039b0 2023-10-25T16:15:36.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.962+0000 7f04577fe640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04380664a0 0x7f0438068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:36.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.966+0000 7f04577fe640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04380664a0 0x7f0438068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04400018e0 tx=0x7f0440000ee0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:36.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:36.966+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0458159690 con 0x7f04440039b0 2023-10-25T16:15:37.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.126+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0458159690 con 0x7f04440039b0 2023-10-25T16:15:37.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f0454ff9640 1 -- 172.21.15.177:0/2902305837 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0458159690 con 0x7f04440039b0 2023-10-25T16:15:37.134 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:15:37.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04380664a0 msgr2=0x7f0438068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04380664a0 0x7f0438068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04400018e0 tx=0x7f0440000ee0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 msgr2=0x7f045815a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f045815a310 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f04480016b0 tx=0x7f0448006a00 comp rx=0 tx=0).stop 2023-10-25T16:15:37.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 shutdown_connections 2023-10-25T16:15:37.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04380664a0 0x7f0438068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f045815a850 0x7f045814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0458138830 0x7f045814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 --2- 172.21.15.177:0/2902305837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04440039b0 0x7f045815a310 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 >> 172.21.15.177:0/2902305837 conn(0x7f04580b2450 msgr2=0x7f045813c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:37.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 shutdown_connections 2023-10-25T16:15:37.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.130+0000 7f045e285640 1 -- 172.21.15.177:0/2902305837 wait complete. 2023-10-25T16:15:37.152 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:15:37.153 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:15:37.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:15:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:15:37.209 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34238]: fuse finished with error 0 and tester_r 0 2023-10-25T16:15:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:15:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:37.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:15:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:15:37.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:15:37.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:37.218 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:15:37.226 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:37.226 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:37.232 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:15:37.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:15:37.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:37.234 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:15:37.278 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:15:37.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:15:37.279 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:15:37.280 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:37.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:15:37.286 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:15:37.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:15:37.287 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:15:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:15:37.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:15:37.333 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:37.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- 172.21.15.177:0/87025666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39d8004d10 msgr2=0x7f39d8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/87025666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39d8004d10 0x7f39d8005190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f39e400bb10 tx=0x7f39e401cdc0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39ebfff640 1 -- 172.21.15.177:0/87025666 reap_dead start 2023-10-25T16:15:37.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- 172.21.15.177:0/87025666 shutdown_connections 2023-10-25T16:15:37.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- 172.21.15.177:0/87025666 >> 172.21.15.177:0/87025666 conn(0x7f39ec0b2450 msgr2=0x7f39ec0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:37.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- 172.21.15.177:0/87025666 shutdown_connections 2023-10-25T16:15:37.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- 172.21.15.177:0/87025666 wait complete. 2023-10-25T16:15:37.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 Processor -- start 2023-10-25T16:15:37.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- start start 2023-10-25T16:15:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d8004d10 0x7f39ec14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 0x7f39ec1e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39ec15a410 0x7f39ec15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec15ae00 con 0x7f39ec0ab960 2023-10-25T16:15:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec1e4390 con 0x7f39d8004d10 2023-10-25T16:15:37.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39f1bdf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec1e32f0 con 0x7f39ec15a410 2023-10-25T16:15:37.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 0x7f39ec1e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 0x7f39ec1e29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42114/0 (socket says 172.21.15.177:42114) 2023-10-25T16:15:37.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 -- 172.21.15.177:0/1377743965 learned_addr learned my addr 172.21.15.177:0/1377743965 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:37.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eb7fe640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d8004d10 0x7f39ec14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39ebfff640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39ec15a410 0x7f39ec15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 -- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39ec15a410 msgr2=0x7f39ec15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39ec15a410 0x7f39ec15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 -- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d8004d10 msgr2=0x7f39ec14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d8004d10 0x7f39ec14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 -- 172.21.15.177:0/1377743965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec1e35d0 con 0x7f39ec0ab960 2023-10-25T16:15:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.458+0000 7f39eaffd640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 0x7f39ec1e29f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f39d400fa00 tx=0x7f39d400fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d400bc50 con 0x7f39ec0ab960 2023-10-25T16:15:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f39d4005030 con 0x7f39ec0ab960 2023-10-25T16:15:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec1e38b0 con 0x7f39ec0ab960 2023-10-25T16:15:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d400bea0 con 0x7f39ec0ab960 2023-10-25T16:15:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec1e3e70 con 0x7f39ec0ab960 2023-10-25T16:15:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec04daf0 con 0x7f39ec0ab960 2023-10-25T16:15:37.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39d4005440 con 0x7f39ec0ab960 2023-10-25T16:15:37.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39e3fff640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39cc0664a0 0x7f39cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f39d40848a0 con 0x7f39ec0ab960 2023-10-25T16:15:37.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39eb7fe640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39cc0664a0 0x7f39cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.462+0000 7f39eb7fe640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39cc0664a0 0x7f39cc068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001b30 tx=0x7f39dc001340 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:37.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.466+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39d4051e00 con 0x7f39ec0ab960 2023-10-25T16:15:37.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39ec0ca680 con 0x7f39ec0ab960 2023-10-25T16:15:37.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39e3fff640 1 -- 172.21.15.177:0/1377743965 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f39d4020090 con 0x7f39ec0ab960 2023-10-25T16:15:37.647 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:37.648 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:37.648 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:37.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39cc0664a0 msgr2=0x7f39cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39cc0664a0 0x7f39cc068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001b30 tx=0x7f39dc001340 comp rx=0 tx=0).stop 2023-10-25T16:15:37.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 msgr2=0x7f39ec1e29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 0x7f39ec1e29f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f39d400fa00 tx=0x7f39d400fec0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 shutdown_connections 2023-10-25T16:15:37.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39cc0664a0 0x7f39cc068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39ec15a410 0x7f39ec15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39ec0ab960 0x7f39ec1e29f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 --2- 172.21.15.177:0/1377743965 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39d8004d10 0x7f39ec14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 >> 172.21.15.177:0/1377743965 conn(0x7f39ec0b2450 msgr2=0x7f39ec1583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:37.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 shutdown_connections 2023-10-25T16:15:37.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.642+0000 7f39f1bdf640 1 -- 172.21.15.177:0/1377743965 wait complete. 2023-10-25T16:15:37.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:37.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 -- 172.21.15.177:0/2732629212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cce90 msgr2=0x7f3f5c0c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 --2- 172.21.15.177:0/2732629212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cce90 0x7f3f5c0c9b00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009840 tx=0x7f3f4c01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 -- 172.21.15.177:0/2732629212 shutdown_connections 2023-10-25T16:15:37.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 --2- 172.21.15.177:0/2732629212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cce90 0x7f3f5c0c9b00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 -- 172.21.15.177:0/2732629212 >> 172.21.15.177:0/2732629212 conn(0x7f3f5c0ce000 msgr2=0x7f3f5c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:37.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 -- 172.21.15.177:0/2732629212 shutdown_connections 2023-10-25T16:15:37.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 -- 172.21.15.177:0/2732629212 wait complete. 2023-10-25T16:15:37.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 Processor -- start 2023-10-25T16:15:37.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 -- start start 2023-10-25T16:15:37.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 0x7f3f5c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.782+0000 7f3f63001640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f5c0cce90 0x7f3f5c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f5c155db0 0x7f3f5c143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c153520 con 0x7f3f5c0cca30 2023-10-25T16:15:37.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c153800 con 0x7f3f5c155db0 2023-10-25T16:15:37.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c153ae0 con 0x7f3f5c0cce90 2023-10-25T16:15:37.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 0x7f3f5c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 0x7f3f5c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42126/0 (socket says 172.21.15.177:42126) 2023-10-25T16:15:37.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 -- 172.21.15.177:0/1801180283 learned_addr learned my addr 172.21.15.177:0/1801180283 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:37.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 -- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f5c0cce90 msgr2=0x7f3f5c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f5c0cce90 0x7f3f5c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f6159e640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f5c155db0 0x7f3f5c143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 -- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f5c155db0 msgr2=0x7f3f5c143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f5c155db0 0x7f3f5c143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 -- 172.21.15.177:0/1801180283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0094a0 con 0x7f3f5c0cca30 2023-10-25T16:15:37.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f60d9d640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 0x7f3f5c155010 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400c730 tx=0x7f3f5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:37.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54006d60 con 0x7f3f5c0cca30 2023-10-25T16:15:37.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3f5400ce40 con 0x7f3f5c0cca30 2023-10-25T16:15:37.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c153dc0 con 0x7f3f5c0cca30 2023-10-25T16:15:37.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54003be0 con 0x7f3f5c0cca30 2023-10-25T16:15:37.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c144a10 con 0x7f3f5c0cca30 2023-10-25T16:15:37.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c06fe60 con 0x7f3f5c0cca30 2023-10-25T16:15:37.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f54003d40 con 0x7f3f5c0cca30 2023-10-25T16:15:37.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f597fa640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f48066470 0x7f3f48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:37.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3f54083ce0 con 0x7f3f5c0cca30 2023-10-25T16:15:37.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f5bfff640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f48066470 0x7f3f48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:37.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.786+0000 7f3f5bfff640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f48066470 0x7f3f48068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0b4240 tx=0x7f3f50007930 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:37.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.790+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f54054c40 con 0x7f3f5c0cca30 2023-10-25T16:15:37.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.950+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f5c04daf0 con 0x7f3f5c0cca30 2023-10-25T16:15:37.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.950+0000 7f3f597fa640 1 -- 172.21.15.177:0/1801180283 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f3f540547d0 con 0x7f3f5c0cca30 2023-10-25T16:15:37.958 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:37.958 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":56,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:28.786188+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:37.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f48066470 msgr2=0x7f3f48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f48066470 0x7f3f48068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0b4240 tx=0x7f3f50007930 comp rx=0 tx=0).stop 2023-10-25T16:15:37.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 msgr2=0x7f3f5c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:37.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 0x7f3f5c155010 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400c730 tx=0x7f3f5400cbf0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 shutdown_connections 2023-10-25T16:15:37.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3f48066470 0x7f3f48068930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f5c155db0 0x7f3f5c143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f5c0cce90 0x7f3f5c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 --2- 172.21.15.177:0/1801180283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f5c0cca30 0x7f3f5c155010 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:37.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 >> 172.21.15.177:0/1801180283 conn(0x7f3f5c0ce000 msgr2=0x7f3f5c0ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:37.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 shutdown_connections 2023-10-25T16:15:37.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:37.954+0000 7f3f63001640 1 -- 172.21.15.177:0/1801180283 wait complete. 2023-10-25T16:15:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:14:46.415314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:14:47.194703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:15:37.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:15:38.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- 172.21.15.177:0/2061327654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6510004d10 msgr2=0x7f6510005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 --2- 172.21.15.177:0/2061327654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6510004d10 0x7f6510005190 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f651c00af40 tx=0x7f651c01e270 comp rx=0 tx=0).stop 2023-10-25T16:15:38.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652abc1640 1 -- 172.21.15.177:0/2061327654 reap_dead start 2023-10-25T16:15:38.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- 172.21.15.177:0/2061327654 shutdown_connections 2023-10-25T16:15:38.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- 172.21.15.177:0/2061327654 >> 172.21.15.177:0/2061327654 conn(0x7f65240b2450 msgr2=0x7f65240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:38.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- 172.21.15.177:0/2061327654 shutdown_connections 2023-10-25T16:15:38.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- 172.21.15.177:0/2061327654 wait complete. 2023-10-25T16:15:38.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 Processor -- start 2023-10-25T16:15:38.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- start start 2023-10-25T16:15:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 0x7f652406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6524150700 0x7f6524070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524071040 0x7f652414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240714d0 con 0x7f6524146050 2023-10-25T16:15:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240704c0 con 0x7f6524071040 2023-10-25T16:15:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652c624640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65241e3490 con 0x7f6524150700 2023-10-25T16:15:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 0x7f652406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 0x7f652406ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42144/0 (socket says 172.21.15.177:42144) 2023-10-25T16:15:38.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 -- 172.21.15.177:0/3996391309 learned_addr learned my addr 172.21.15.177:0/3996391309 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f6529bbf640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6524150700 0x7f6524070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652abc1640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524071040 0x7f652414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 -- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6524150700 msgr2=0x7f6524070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6524150700 0x7f6524070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 -- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524071040 msgr2=0x7f652414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524071040 0x7f652414ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652a3c0640 1 -- 172.21.15.177:0/3996391309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524156af0 con 0x7f6524146050 2023-10-25T16:15:38.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.098+0000 7f652abc1640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524071040 0x7f652414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:38.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f652a3c0640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 0x7f652406ff80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6520006fd0 tx=0x7f6520001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520011670 con 0x7f6524146050 2023-10-25T16:15:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f65200118c0 con 0x7f6524146050 2023-10-25T16:15:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6524150b90 con 0x7f6524146050 2023-10-25T16:15:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520011cb0 con 0x7f6524146050 2023-10-25T16:15:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6524151150 con 0x7f6524146050 2023-10-25T16:15:38.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652404daf0 con 0x7f6524146050 2023-10-25T16:15:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f652001a400 con 0x7f6524146050 2023-10-25T16:15:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f651affd640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f65080664a0 0x7f6508068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6520084c50 con 0x7f6524146050 2023-10-25T16:15:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f6529bbf640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f65080664a0 0x7f6508068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.102+0000 7f6529bbf640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f65080664a0 0x7f6508068960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6514001260 tx=0x7f65140011b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:38.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.106+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f652008a020 con 0x7f6524146050 2023-10-25T16:15:38.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.250+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65240b2c30 con 0x7f6524146050 2023-10-25T16:15:38.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.250+0000 7f651affd640 1 -- 172.21.15.177:0/3996391309 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6520052090 con 0x7f6524146050 2023-10-25T16:15:38.257 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:15:38.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f65080664a0 msgr2=0x7f6508068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f65080664a0 0x7f6508068960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6514001260 tx=0x7f65140011b0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 msgr2=0x7f652406ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 0x7f652406ff80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6520006fd0 tx=0x7f6520001640 comp rx=0 tx=0).stop 2023-10-25T16:15:38.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 shutdown_connections 2023-10-25T16:15:38.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f65080664a0 0x7f6508068960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6524071040 0x7f652414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6524150700 0x7f6524070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 --2- 172.21.15.177:0/3996391309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6524146050 0x7f652406ff80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 >> 172.21.15.177:0/3996391309 conn(0x7f65240b2450 msgr2=0x7f652414da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:38.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 shutdown_connections 2023-10-25T16:15:38.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.254+0000 7f652c624640 1 -- 172.21.15.177:0/3996391309 wait complete. 2023-10-25T16:15:38.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:15:38.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- 172.21.15.177:0/4080948093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600cdb10 msgr2=0x7f35600cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 --2- 172.21.15.177:0/4080948093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600cdb10 0x7f35600cdfc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3558009bc0 tx=0x7f355801caf0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- 172.21.15.177:0/4080948093 shutdown_connections 2023-10-25T16:15:38.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 --2- 172.21.15.177:0/4080948093 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600cdb10 0x7f35600cdfc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 --2- 172.21.15.177:0/4080948093 >> v2:172.21.15.184:3300/0 conn(0x7f35600b2120 0x7f35600b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- 172.21.15.177:0/4080948093 >> 172.21.15.177:0/4080948093 conn(0x7f356009a5c0 msgr2=0x7f35600d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:38.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- 172.21.15.177:0/4080948093 shutdown_connections 2023-10-25T16:15:38.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- 172.21.15.177:0/4080948093 wait complete. 2023-10-25T16:15:38.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 Processor -- start 2023-10-25T16:15:38.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- start start 2023-10-25T16:15:38.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600b2120 0x7f356015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35600cdb10 0x7f356015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 0x7f356015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600b5870 con 0x7f356015eba0 2023-10-25T16:15:38.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356015a9c0 con 0x7f35600cdb10 2023-10-25T16:15:38.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.390+0000 7f3566313640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356015aca0 con 0x7f35600b2120 2023-10-25T16:15:38.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 0x7f356015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 0x7f356015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42152/0 (socket says 172.21.15.177:42152) 2023-10-25T16:15:38.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 -- 172.21.15.177:0/2000957673 learned_addr learned my addr 172.21.15.177:0/2000957673 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:38.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355ffff640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600b2120 0x7f356015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355f7fe640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35600cdb10 0x7f356015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 -- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600b2120 msgr2=0x7f356015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600b2120 0x7f356015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 -- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35600cdb10 msgr2=0x7f356015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35600cdb10 0x7f356015d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 -- 172.21.15.177:0/2000957673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009820 con 0x7f356015eba0 2023-10-25T16:15:38.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355ffff640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600b2120 0x7f356015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:15:38.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355f7fe640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35600cdb10 0x7f356015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:15:38.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f35648b0640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 0x7f356015d5d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3558009b10 tx=0x7f35580a5860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:38.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558003980 con 0x7f356015eba0 2023-10-25T16:15:38.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3558003bd0 con 0x7f356015eba0 2023-10-25T16:15:38.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558004030 con 0x7f356015eba0 2023-10-25T16:15:38.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600b5af0 con 0x7f356015eba0 2023-10-25T16:15:38.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356015a620 con 0x7f356015eba0 2023-10-25T16:15:38.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356015ae10 con 0x7f356015eba0 2023-10-25T16:15:38.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35580b4040 con 0x7f356015eba0 2023-10-25T16:15:38.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355cff9640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f354c0664a0 0x7f354c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f355811e840 con 0x7f356015eba0 2023-10-25T16:15:38.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.394+0000 7f355ffff640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f354c0664a0 0x7f354c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.398+0000 7f355ffff640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f354c0664a0 0x7f354c068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3550001670 tx=0x7f3550009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:38.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.398+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35580ebdd0 con 0x7f356015eba0 2023-10-25T16:15:38.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f356004daf0 con 0x7f356015eba0 2023-10-25T16:15:38.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f355cff9640 1 -- 172.21.15.177:0/2000957673 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35580ef3f0 con 0x7f356015eba0 2023-10-25T16:15:38.560 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:15:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f354c0664a0 msgr2=0x7f354c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f354c0664a0 0x7f354c068960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3550001670 tx=0x7f3550009040 comp rx=0 tx=0).stop 2023-10-25T16:15:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 msgr2=0x7f356015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 0x7f356015d5d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3558009b10 tx=0x7f35580a5860 comp rx=0 tx=0).stop 2023-10-25T16:15:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 shutdown_connections 2023-10-25T16:15:38.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f354c0664a0 0x7f354c068960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f356015eba0 0x7f356015d5d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35600cdb10 0x7f356015d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 --2- 172.21.15.177:0/2000957673 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35600b2120 0x7f356015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 >> 172.21.15.177:0/2000957673 conn(0x7f356009a5c0 msgr2=0x7f356015c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:38.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 shutdown_connections 2023-10-25T16:15:38.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.554+0000 7f3566313640 1 -- 172.21.15.177:0/2000957673 wait complete. 2023-10-25T16:15:38.577 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:15:38.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/1180622734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5140c9e50 msgr2=0x7fd51406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- 172.21.15.177:0/1180622734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5140c9e50 0x7fd51406b9e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd5140ccde0 tx=0x7fd50401c590 comp rx=0 tx=0).stop 2023-10-25T16:15:38.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/1180622734 shutdown_connections 2023-10-25T16:15:38.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- 172.21.15.177:0/1180622734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd51406bf20 0x7fd5140aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- 172.21.15.177:0/1180622734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5140c9e50 0x7fd51406b9e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- 172.21.15.177:0/1180622734 >> v2:172.21.15.184:3300/0 conn(0x7fd5141500f0 0x7fd5140c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/1180622734 >> 172.21.15.177:0/1180622734 conn(0x7fd5140b2450 msgr2=0x7fd5140b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:38.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/1180622734 shutdown_connections 2023-10-25T16:15:38.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/1180622734 wait complete. 2023-10-25T16:15:38.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 Processor -- start 2023-10-25T16:15:38.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- start start 2023-10-25T16:15:38.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 0x7fd514155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5140c9e50 0x7fd51414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5141500f0 0x7fd514152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514149ab0 con 0x7fd51406bf20 2023-10-25T16:15:38.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514156300 con 0x7fd5141500f0 2023-10-25T16:15:38.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51414be30 con 0x7fd5140c9e50 2023-10-25T16:15:38.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 0x7fd514155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 0x7fd514155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42174/0 (socket says 172.21.15.177:42174) 2023-10-25T16:15:38.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 -- 172.21.15.177:0/6855773 learned_addr learned my addr 172.21.15.177:0/6855773 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:38.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519379640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5140c9e50 0x7fd51414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51a37b640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5141500f0 0x7fd514152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 -- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5140c9e50 msgr2=0x7fd51414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5140c9e50 0x7fd51414b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 -- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5141500f0 msgr2=0x7fd514152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5141500f0 0x7fd514152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 -- 172.21.15.177:0/6855773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504009500 con 0x7fd51406bf20 2023-10-25T16:15:38.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd519b7a640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 0x7fd514155c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd51000b550 tx=0x7fd51000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:38.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510010870 con 0x7fd51406bf20 2023-10-25T16:15:38.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd510010ae0 con 0x7fd51406bf20 2023-10-25T16:15:38.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd514150940 con 0x7fd51406bf20 2023-10-25T16:15:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000f3c0 con 0x7fd51406bf20 2023-10-25T16:15:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.698+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd514150f00 con 0x7fd51406bf20 2023-10-25T16:15:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.702+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514159e00 con 0x7fd51406bf20 2023-10-25T16:15:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.702+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd51000f520 con 0x7fd51406bf20 2023-10-25T16:15:38.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.702+0000 7fd50a7fc640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd4f8066470 0x7fd4f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:38.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.702+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd510084130 con 0x7fd51406bf20 2023-10-25T16:15:38.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.702+0000 7fd519379640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd4f8066470 0x7fd4f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.702+0000 7fd519379640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd4f8066470 0x7fd4f8068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd5040ae000 tx=0x7fd50401add0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:38.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.706+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd510051560 con 0x7fd51406bf20 2023-10-25T16:15:38.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.850+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd51404daf0 con 0x7fd51406bf20 2023-10-25T16:15:38.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.850+0000 7fd50a7fc640 1 -- 172.21.15.177:0/6855773 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd510054b80 con 0x7fd51406bf20 2023-10-25T16:15:38.857 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:15:38.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd4f8066470 msgr2=0x7fd4f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd4f8066470 0x7fd4f8068930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd5040ae000 tx=0x7fd50401add0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 msgr2=0x7fd514155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 0x7fd514155c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd51000b550 tx=0x7fd51000ba10 comp rx=0 tx=0).stop 2023-10-25T16:15:38.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 shutdown_connections 2023-10-25T16:15:38.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd4f8066470 0x7fd4f8068930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5141500f0 0x7fd514152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5140c9e50 0x7fd51414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 --2- 172.21.15.177:0/6855773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd51406bf20 0x7fd514155c00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 >> 172.21.15.177:0/6855773 conn(0x7fd5140b2450 msgr2=0x7fd514158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:38.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 shutdown_connections 2023-10-25T16:15:38.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.854+0000 7fd51bdde640 1 -- 172.21.15.177:0/6855773 wait complete. 2023-10-25T16:15:38.874 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:38.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- 172.21.15.177:0/929980289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 msgr2=0x7f33000d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:38.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 --2- 172.21.15.177:0/929980289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f33000d1bd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f33000b3ea0 tx=0x7f32f001c810 comp rx=0 tx=0).stop 2023-10-25T16:15:38.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- 172.21.15.177:0/929980289 shutdown_connections 2023-10-25T16:15:38.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 --2- 172.21.15.177:0/929980289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f33000d1bd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 --2- 172.21.15.177:0/929980289 >> v2:172.21.15.184:3300/0 conn(0x7f330015eba0 0x7f33000b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:38.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- 172.21.15.177:0/929980289 >> 172.21.15.177:0/929980289 conn(0x7f330009a5c0 msgr2=0x7f33000d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- 172.21.15.177:0/929980289 shutdown_connections 2023-10-25T16:15:39.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- 172.21.15.177:0/929980289 wait complete. 2023-10-25T16:15:39.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 Processor -- start 2023-10-25T16:15:39.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- start start 2023-10-25T16:15:39.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f3300158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33000cdb10 0x7f33001487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f330015eba0 0x7f330015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300159e90 con 0x7f33000b2120 2023-10-25T16:15:39.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300158f60 con 0x7f330015eba0 2023-10-25T16:15:39.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3306afb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33000b5bd0 con 0x7f33000cdb10 2023-10-25T16:15:39.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f3300158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f3300158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42190/0 (socket says 172.21.15.177:42190) 2023-10-25T16:15:39.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 -- 172.21.15.177:0/1322072246 learned_addr learned my addr 172.21.15.177:0/1322072246 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:39.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 -- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33000cdb10 msgr2=0x7f33001487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33000cdb10 0x7f33001487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 -- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f330015eba0 msgr2=0x7f330015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f330015eba0 0x7f330015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.994+0000 7f3304897640 1 -- 172.21.15.177:0/1322072246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0009560 con 0x7f33000b2120 2023-10-25T16:15:39.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f3304897640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f3300158a20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f32f400c9f0 tx=0x7f32f400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4007b50 con 0x7f33000b2120 2023-10-25T16:15:39.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f32f4007da0 con 0x7f33000b2120 2023-10-25T16:15:39.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400f6b0 con 0x7f33000b2120 2023-10-25T16:15:39.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33000b6190 con 0x7f33000b2120 2023-10-25T16:15:39.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3300156c60 con 0x7f33000b2120 2023-10-25T16:15:39.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330004daf0 con 0x7f33000b2120 2023-10-25T16:15:39.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32f400f810 con 0x7f33000b2120 2023-10-25T16:15:39.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fd7fa640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f32ec066470 0x7f32ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f32f4084630 con 0x7f33000b2120 2023-10-25T16:15:39.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fffff640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f32ec066470 0x7f32ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:38.998+0000 7f32fffff640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f32ec066470 0x7f32ec068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32f00af000 tx=0x7f32f00195b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.002+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32f4051b00 con 0x7f33000b2120 2023-10-25T16:15:39.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.186+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33000ce930 con 0x7f33000b2120 2023-10-25T16:15:39.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f32fd7fa640 1 -- 172.21.15.177:0/1322072246 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f32f4055120 con 0x7f33000b2120 2023-10-25T16:15:39.195 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:39.195 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:39.195 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:39.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f32ec066470 msgr2=0x7f32ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f32ec066470 0x7f32ec068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32f00af000 tx=0x7f32f00195b0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 msgr2=0x7f3300158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f3300158a20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f32f400c9f0 tx=0x7f32f400ceb0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 shutdown_connections 2023-10-25T16:15:39.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f32ec066470 0x7f32ec068930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f330015eba0 0x7f330015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33000cdb10 0x7f33001487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 --2- 172.21.15.177:0/1322072246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33000b2120 0x7f3300158a20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 >> 172.21.15.177:0/1322072246 conn(0x7f330009a5c0 msgr2=0x7f3300072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 shutdown_connections 2023-10-25T16:15:39.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.190+0000 7f3306afb640 1 -- 172.21.15.177:0/1322072246 wait complete. 2023-10-25T16:15:39.213 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:39.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3106449742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b015d4a0 msgr2=0x7fb1b0070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3106449742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b015d4a0 0x7fb1b0070b60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009bc0 tx=0x7fb1a801cb80 comp rx=0 tx=0).stop 2023-10-25T16:15:39.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3106449742 shutdown_connections 2023-10-25T16:15:39.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3106449742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b015d4a0 0x7fb1b0070b60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3106449742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1b0159040 0x7fb1b0070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3106449742 >> 172.21.15.177:0/3106449742 conn(0x7fb1b006a830 msgr2=0x7fb1b006ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.330+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3106449742 shutdown_connections 2023-10-25T16:15:39.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3106449742 wait complete. 2023-10-25T16:15:39.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 Processor -- start 2023-10-25T16:15:39.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- start start 2023-10-25T16:15:39.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1b0159040 0x7fb1b0153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1b015d4a0 0x7fb1b014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 0x7fb1b01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b014baf0 con 0x7fb1b0154440 2023-10-25T16:15:39.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0154f20 con 0x7fb1b015d4a0 2023-10-25T16:15:39.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0152fb0 con 0x7fb1b0159040 2023-10-25T16:15:39.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 0x7fb1b01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 0x7fb1b01548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42204/0 (socket says 172.21.15.177:42204) 2023-10-25T16:15:39.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 -- 172.21.15.177:0/3597845137 learned_addr learned my addr 172.21.15.177:0/3597845137 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:39.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 -- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1b0159040 msgr2=0x7fb1b0153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b5a1c640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1b0159040 0x7fb1b0153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b521b640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1b015d4a0 0x7fb1b014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1b0159040 0x7fb1b0153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 -- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1b015d4a0 msgr2=0x7fb1b014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1b015d4a0 0x7fb1b014b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 -- 172.21.15.177:0/3597845137 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8009820 con 0x7fb1b0154440 2023-10-25T16:15:39.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b621d640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 0x7fb1b01548d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009b10 tx=0x7fb1a80a5a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80bb070 con 0x7fb1b0154440 2023-10-25T16:15:39.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb1a8003b90 con 0x7fb1b0154440 2023-10-25T16:15:39.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00ce7f0 con 0x7fb1b0154440 2023-10-25T16:15:39.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8004030 con 0x7fb1b0154440 2023-10-25T16:15:39.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b0153570 con 0x7fb1b0154440 2023-10-25T16:15:39.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.334+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b004daf0 con 0x7fb1b0154440 2023-10-25T16:15:39.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.338+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1a80b4040 con 0x7fb1b0154440 2023-10-25T16:15:39.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.338+0000 7fb1a67fc640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb194066470 0x7fb194068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.338+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb1a811e410 con 0x7fb1b0154440 2023-10-25T16:15:39.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.338+0000 7fb1b5a1c640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb194066470 0x7fb194068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.338+0000 7fb1b5a1c640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb194066470 0x7fb194068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0058d0 tx=0x7fb1ac005c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.342+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1a80eb850 con 0x7fb1b0154440 2023-10-25T16:15:39.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.482+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b00b07c0 con 0x7fb1b0154440 2023-10-25T16:15:39.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1a67fc640 1 -- 172.21.15.177:0/3597845137 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16689 (secure 0 0 0) 0x7fb1a80eee70 con 0x7fb1b0154440 2023-10-25T16:15:39.490 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:39.491 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":56,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:28.786188+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:39.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb194066470 msgr2=0x7fb194068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb194066470 0x7fb194068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0058d0 tx=0x7fb1ac005c90 comp rx=0 tx=0).stop 2023-10-25T16:15:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 msgr2=0x7fb1b01548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 0x7fb1b01548d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009b10 tx=0x7fb1a80a5a70 comp rx=0 tx=0).stop 2023-10-25T16:15:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 shutdown_connections 2023-10-25T16:15:39.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb194066470 0x7fb194068930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1b0154440 0x7fb1b01548d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1b015d4a0 0x7fb1b014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 --2- 172.21.15.177:0/3597845137 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1b0159040 0x7fb1b0153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 >> 172.21.15.177:0/3597845137 conn(0x7fb1b006a830 msgr2=0x7fb1b00cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 shutdown_connections 2023-10-25T16:15:39.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.486+0000 7fb1b7c80640 1 -- 172.21.15.177:0/3597845137 wait complete. 2023-10-25T16:15:39.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:15:39.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:39.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- 172.21.15.177:0/3646572108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 msgr2=0x7f58840c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 --2- 172.21.15.177:0/3646572108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840c90f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f58840702e0 tx=0x7f588001cd20 comp rx=0 tx=0).stop 2023-10-25T16:15:39.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- 172.21.15.177:0/3646572108 shutdown_connections 2023-10-25T16:15:39.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 --2- 172.21.15.177:0/3646572108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840c90f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 --2- 172.21.15.177:0/3646572108 >> v2:172.21.15.184:3300/0 conn(0x7f58840ad3f0 0x7f58840cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- 172.21.15.177:0/3646572108 >> 172.21.15.177:0/3646572108 conn(0x7f58840caa30 msgr2=0x7f58840cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- 172.21.15.177:0/3646572108 shutdown_connections 2023-10-25T16:15:39.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- 172.21.15.177:0/3646572108 wait complete. 2023-10-25T16:15:39.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 Processor -- start 2023-10-25T16:15:39.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- start start 2023-10-25T16:15:39.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58840ad3f0 0x7f58841571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58840cca70 0x7f58840b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840c5820 con 0x7f58841592e0 2023-10-25T16:15:39.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58840b1160 con 0x7f58840cca70 2023-10-25T16:15:39.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588c34c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58840b1400 con 0x7f58840ad3f0 2023-10-25T16:15:39.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.622+0000 7f588a8e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42230/0 (socket says 172.21.15.177:42230) 2023-10-25T16:15:39.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 -- 172.21.15.177:0/3233031566 learned_addr learned my addr 172.21.15.177:0/3233031566 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:39.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a0e8640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58840ad3f0 0x7f58841571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f58898e7640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58840cca70 0x7f58840b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 -- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58840ad3f0 msgr2=0x7f58841571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58840ad3f0 0x7f58841571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 -- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58840cca70 msgr2=0x7f58840b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58840cca70 0x7f58840b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 -- 172.21.15.177:0/3233031566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800098e0 con 0x7f58841592e0 2023-10-25T16:15:39.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f58898e7640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58840cca70 0x7f58840b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:39.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a8e9640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840b2870 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f588001a950 tx=0x7f5880005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880004c50 con 0x7f58841592e0 2023-10-25T16:15:39.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5880003fe0 con 0x7f58841592e0 2023-10-25T16:15:39.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58840b16e0 con 0x7f58841592e0 2023-10-25T16:15:39.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880004ea0 con 0x7f58841592e0 2023-10-25T16:15:39.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58840b1ca0 con 0x7f58841592e0 2023-10-25T16:15:39.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58840c5a20 con 0x7f58841592e0 2023-10-25T16:15:39.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58800b4040 con 0x7f58841592e0 2023-10-25T16:15:39.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f587affd640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5868066470 0x7f5868068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f588011e210 con 0x7f58841592e0 2023-10-25T16:15:39.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a0e8640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5868066470 0x7f5868068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.626+0000 7f588a0e8640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5868066470 0x7f5868068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f587c003d60 tx=0x7f587c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.630+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58840c5a20 con 0x7f58841592e0 2023-10-25T16:15:39.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.802+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58840c5a20 con 0x7f58841592e0 2023-10-25T16:15:39.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f587affd640 1 -- 172.21.15.177:0/3233031566 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f58840c5a20 con 0x7f58841592e0 2023-10-25T16:15:39.810 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:39.810 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:39.811 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:39.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5868066470 msgr2=0x7f5868068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5868066470 0x7f5868068930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f587c003d60 tx=0x7f587c009040 comp rx=0 tx=0).stop 2023-10-25T16:15:39.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 msgr2=0x7f58840b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840b2870 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f588001a950 tx=0x7f5880005b00 comp rx=0 tx=0).stop 2023-10-25T16:15:39.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 shutdown_connections 2023-10-25T16:15:39.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5868066470 0x7f5868068930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58841592e0 0x7f58840b2870 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58840cca70 0x7f58840b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 --2- 172.21.15.177:0/3233031566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58840ad3f0 0x7f58841571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 >> 172.21.15.177:0/3233031566 conn(0x7f58840caa30 msgr2=0x7f5884072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 shutdown_connections 2023-10-25T16:15:39.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.806+0000 7f588c34c640 1 -- 172.21.15.177:0/3233031566 wait complete. 2023-10-25T16:15:39.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:39.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/7099931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd768140cf0 msgr2=0x7fd7680af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/7099931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd768140cf0 0x7fd7680af5d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd758009900 tx=0x7fd75801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/7099931 shutdown_connections 2023-10-25T16:15:39.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/7099931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 0x7fd76806ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/7099931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd768140cf0 0x7fd7680af5d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/7099931 >> 172.21.15.177:0/7099931 conn(0x7fd7680b2450 msgr2=0x7fd7680b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:39.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/7099931 shutdown_connections 2023-10-25T16:15:39.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/7099931 wait complete. 2023-10-25T16:15:39.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 Processor -- start 2023-10-25T16:15:39.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- start start 2023-10-25T16:15:39.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 0x7fd7680ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 0x7fd768156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd768140cf0 0x7fd76813dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76813fe20 con 0x7fd76806bf90 2023-10-25T16:15:39.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680acb70 con 0x7fd768140cf0 2023-10-25T16:15:39.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680ae360 con 0x7fd76806f570 2023-10-25T16:15:39.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 0x7fd7680ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 0x7fd7680ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42244/0 (socket says 172.21.15.177:42244) 2023-10-25T16:15:39.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 -- 172.21.15.177:0/3348254600 learned_addr learned my addr 172.21.15.177:0/3348254600 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:39.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd7667fc640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 0x7fd768156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd7677fe640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd768140cf0 0x7fd76813dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 -- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 msgr2=0x7fd768156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 0x7fd768156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 -- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd768140cf0 msgr2=0x7fd76813dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:39.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd768140cf0 0x7fd76813dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:39.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 -- 172.21.15.177:0/3348254600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009560 con 0x7fd76806bf90 2023-10-25T16:15:39.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd7677fe640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd768140cf0 0x7fd76813dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:39.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd7667fc640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 0x7fd768156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:39.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd766ffd640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 0x7fd7680ade20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd75801aea0 tx=0x7fd7580a6780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580053c0 con 0x7fd76806bf90 2023-10-25T16:15:39.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd758005610 con 0x7fd76806bf90 2023-10-25T16:15:39.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7680acd80 con 0x7fd76806bf90 2023-10-25T16:15:39.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758004930 con 0x7fd76806bf90 2023-10-25T16:15:39.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.946+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680ad340 con 0x7fd76806bf90 2023-10-25T16:15:39.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.950+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7680c9780 con 0x7fd76806bf90 2023-10-25T16:15:39.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.950+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd758004a90 con 0x7fd76806bf90 2023-10-25T16:15:39.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.950+0000 7fd74f7fe640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd754066470 0x7fd754068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:39.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.950+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd75811e790 con 0x7fd76806bf90 2023-10-25T16:15:39.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.950+0000 7fd7667fc640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd754066470 0x7fd754068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:39.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.950+0000 7fd7667fc640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd754066470 0x7fd754068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd7681f80d0 tx=0x7fd75c0082f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:39.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:39.954+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7580ebb40 con 0x7fd76806bf90 2023-10-25T16:15:40.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd76804daf0 con 0x7fd76806bf90 2023-10-25T16:15:40.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd74f7fe640 1 -- 172.21.15.177:0/3348254600 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fd7580c0090 con 0x7fd76806bf90 2023-10-25T16:15:40.132 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:40.132 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:14:48.199862+0000","modified":"2023-10-25T16:14:50.236264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5859":{"gid":5859,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/4097207198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4097207198},{"type":"v1","addr":"172.21.15.184:6837","nonce":4097207198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-10-25T16:15:40.133 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 19 2023-10-25T16:15:40.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd754066470 msgr2=0x7fd754068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd754066470 0x7fd754068930 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd7681f80d0 tx=0x7fd75c0082f0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 msgr2=0x7fd7680ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 0x7fd7680ade20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd75801aea0 tx=0x7fd7580a6780 comp rx=0 tx=0).stop 2023-10-25T16:15:40.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 shutdown_connections 2023-10-25T16:15:40.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd754066470 0x7fd754068930 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd768140cf0 0x7fd76813dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76806f570 0x7fd768156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 --2- 172.21.15.177:0/3348254600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76806bf90 0x7fd7680ade20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 >> 172.21.15.177:0/3348254600 conn(0x7fd7680b2450 msgr2=0x7fd7680cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:40.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 shutdown_connections 2023-10-25T16:15:40.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.126+0000 7fd76d4f6640 1 -- 172.21.15.177:0/3348254600 wait complete. 2023-10-25T16:15:40.148 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2679821919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a00039b0 msgr2=0x7fd7a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2679821919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a00039b0 0x7fd7a0003dd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0001680 tx=0x7fd7b001c750 comp rx=0 tx=0).stop 2023-10-25T16:15:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7ba74e640 1 -- 172.21.15.177:0/2679821919 reap_dead start 2023-10-25T16:15:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2679821919 shutdown_connections 2023-10-25T16:15:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2679821919 >> 172.21.15.177:0/2679821919 conn(0x7fd7b40b2450 msgr2=0x7fd7b40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2679821919 shutdown_connections 2023-10-25T16:15:40.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2679821919 wait complete. 2023-10-25T16:15:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 Processor -- start 2023-10-25T16:15:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.262+0000 7fd7bc1b1640 1 -- start start 2023-10-25T16:15:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a00039b0 0x7fd7b4145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 0x7fd7b415d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b415b440 0x7fd7b415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40ade60 con 0x7fd7b415cc90 2023-10-25T16:15:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b415be00 con 0x7fd7b415b440 2023-10-25T16:15:40.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40adb30 con 0x7fd7a00039b0 2023-10-25T16:15:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 0x7fd7b415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 0x7fd7b415d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42266/0 (socket says 172.21.15.177:42266) 2023-10-25T16:15:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 -- 172.21.15.177:0/2094342055 learned_addr learned my addr 172.21.15.177:0/2094342055 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:40.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b9f4d640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a00039b0 0x7fd7b4145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7ba74e640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b415b440 0x7fd7b415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 -- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a00039b0 msgr2=0x7fd7b4145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a00039b0 0x7fd7b4145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 -- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b415b440 msgr2=0x7fd7b415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b415b440 0x7fd7b415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 -- 172.21.15.177:0/2094342055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4146190 con 0x7fd7b415cc90 2023-10-25T16:15:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b974c640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 0x7fd7b415d110 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400e940 tx=0x7fd7a400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:40.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400ccc0 con 0x7fd7b415cc90 2023-10-25T16:15:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7a400ce20 con 0x7fd7b415cc90 2023-10-25T16:15:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4004a30 con 0x7fd7b415cc90 2023-10-25T16:15:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b415dfb0 con 0x7fd7b415cc90 2023-10-25T16:15:40.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b415d9f0 con 0x7fd7b415cc90 2023-10-25T16:15:40.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b404daf0 con 0x7fd7b415cc90 2023-10-25T16:15:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7a4004b90 con 0x7fd7b415cc90 2023-10-25T16:15:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7aa7fc640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd798066470 0x7fd798068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd7a4084860 con 0x7fd7b415cc90 2023-10-25T16:15:40.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.266+0000 7fd7b9f4d640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd798066470 0x7fd798068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.270+0000 7fd7b9f4d640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd798066470 0x7fd798068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00057b0 tx=0x7fd7b00194f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:40.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.270+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7a4051d30 con 0x7fd7b415cc90 2023-10-25T16:15:40.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.414+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7b415c740 con 0x7fd7b415cc90 2023-10-25T16:15:40.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7aa7fc640 1 -- 172.21.15.177:0/2094342055 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16689 (secure 0 0 0) 0x7fd7a4084030 con 0x7fd7b415cc90 2023-10-25T16:15:40.422 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:40.422 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":56,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:28.786188+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:14:46.415314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-25T16:14:47.194703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:40.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd798066470 msgr2=0x7fd798068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd798066470 0x7fd798068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00057b0 tx=0x7fd7b00194f0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 msgr2=0x7fd7b415d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 0x7fd7b415d110 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400e940 tx=0x7fd7a400ee00 comp rx=0 tx=0).stop 2023-10-25T16:15:40.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 shutdown_connections 2023-10-25T16:15:40.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd798066470 0x7fd798068930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7b415b440 0x7fd7b415b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7b415cc90 0x7fd7b415d110 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 --2- 172.21.15.177:0/2094342055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7a00039b0 0x7fd7b4145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 >> 172.21.15.177:0/2094342055 conn(0x7fd7b40b2450 msgr2=0x7fd7b40cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:40.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 shutdown_connections 2023-10-25T16:15:40.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.418+0000 7fd7bc1b1640 1 -- 172.21.15.177:0/2094342055 wait complete. 2023-10-25T16:15:40.439 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:15:40.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 -- 172.21.15.177:0/3445680271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c1592e0 msgr2=0x7fba1c0b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 --2- 172.21.15.177:0/3445680271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c1592e0 0x7fba1c0b3350 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0adc80 tx=0x7fba1401cd20 comp rx=0 tx=0).stop 2023-10-25T16:15:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 -- 172.21.15.177:0/3445680271 shutdown_connections 2023-10-25T16:15:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 --2- 172.21.15.177:0/3445680271 >> v2:172.21.15.184:3300/0 conn(0x7fba1c0b3890 0x7fba1c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 --2- 172.21.15.177:0/3445680271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c1592e0 0x7fba1c0b3350 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 -- 172.21.15.177:0/3445680271 >> 172.21.15.177:0/3445680271 conn(0x7fba1c06a830 msgr2=0x7fba1c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:40.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 -- 172.21.15.177:0/3445680271 shutdown_connections 2023-10-25T16:15:40.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 -- 172.21.15.177:0/3445680271 wait complete. 2023-10-25T16:15:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.558+0000 7fba2176f640 1 Processor -- start 2023-10-25T16:15:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- start start 2023-10-25T16:15:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 0x7fba1c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba1c1592e0 0x7fba1c133420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba1c15d2d0 0x7fba1c135de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c14f010 con 0x7fba1c0b3890 2023-10-25T16:15:40.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15b740 con 0x7fba1c1592e0 2023-10-25T16:15:40.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15ba20 con 0x7fba1c15d2d0 2023-10-25T16:15:40.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 0x7fba1c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 0x7fba1c14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36356/0 (socket says 172.21.15.177:36356) 2023-10-25T16:15:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 -- 172.21.15.177:0/82390069 learned_addr learned my addr 172.21.15.177:0/82390069 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1a7fc640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba1c1592e0 0x7fba1c133420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 -- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba1c15d2d0 msgr2=0x7fba1c135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1b7fe640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba1c15d2d0 0x7fba1c135de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba1c15d2d0 0x7fba1c135de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 -- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba1c1592e0 msgr2=0x7fba1c133420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba1c1592e0 0x7fba1c133420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 -- 172.21.15.177:0/82390069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140098e0 con 0x7fba1c0b3890 2023-10-25T16:15:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1a7fc640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba1c1592e0 0x7fba1c133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:40.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1affd640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 0x7fba1c14ead0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fba14000f90 tx=0x7fba140a5a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14004e60 con 0x7fba1c0b3890 2023-10-25T16:15:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fba14004000 con 0x7fba1c0b3890 2023-10-25T16:15:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c15bd00 con 0x7fba1c0b3890 2023-10-25T16:15:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140043f0 con 0x7fba1c0b3890 2023-10-25T16:15:40.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c133e30 con 0x7fba1c0b3890 2023-10-25T16:15:40.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c04daf0 con 0x7fba1c0b3890 2023-10-25T16:15:40.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fba140b4040 con 0x7fba1c0b3890 2023-10-25T16:15:40.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba137fe640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9fc0664a0 0x7fb9fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fba1411e2f0 con 0x7fba1c0b3890 2023-10-25T16:15:40.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.562+0000 7fba1a7fc640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9fc0664a0 0x7fb9fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.566+0000 7fba1a7fc640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9fc0664a0 0x7fb9fc068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fba04005fd0 tx=0x7fba04005d40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:40.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.566+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fba140eb730 con 0x7fba1c0b3890 2023-10-25T16:15:40.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.742+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fba1c070f50 con 0x7fba1c0b3890 2023-10-25T16:15:40.747 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:15:40.742+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:15:40.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba137fe640 1 -- 172.21.15.177:0/82390069 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7fba140bc090 con 0x7fba1c0b3890 2023-10-25T16:15:40.751 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:15:40.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9fc0664a0 msgr2=0x7fb9fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9fc0664a0 0x7fb9fc068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fba04005fd0 tx=0x7fba04005d40 comp rx=0 tx=0).stop 2023-10-25T16:15:40.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 msgr2=0x7fba1c14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 0x7fba1c14ead0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fba14000f90 tx=0x7fba140a5a70 comp rx=0 tx=0).stop 2023-10-25T16:15:40.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 shutdown_connections 2023-10-25T16:15:40.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9fc0664a0 0x7fb9fc068960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba1c15d2d0 0x7fba1c135de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba1c1592e0 0x7fba1c133420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.746+0000 7fba2176f640 1 --2- 172.21.15.177:0/82390069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba1c0b3890 0x7fba1c14ead0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.750+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 >> 172.21.15.177:0/82390069 conn(0x7fba1c06a830 msgr2=0x7fba1c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:40.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.750+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 shutdown_connections 2023-10-25T16:15:40.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.750+0000 7fba2176f640 1 -- 172.21.15.177:0/82390069 wait complete. 2023-10-25T16:15:40.767 INFO:tasks.ceph.mds.d.smithi184.stderr: -9854> 2023-10-25T16:14:54.813+0000 7f18e70f7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:15:40.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:15:40.823 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:15:40.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- 172.21.15.177:0/412532869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e80039b0 msgr2=0x7f38e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 --2- 172.21.15.177:0/412532869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e80039b0 0x7f38e8003dd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c640 tx=0x7f38f401d250 comp rx=0 tx=0).stop 2023-10-25T16:15:40.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f3901c7e640 1 -- 172.21.15.177:0/412532869 reap_dead start 2023-10-25T16:15:40.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- 172.21.15.177:0/412532869 shutdown_connections 2023-10-25T16:15:40.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- 172.21.15.177:0/412532869 >> 172.21.15.177:0/412532869 conn(0x7f38fc0cdf10 msgr2=0x7f38fc0ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:40.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- 172.21.15.177:0/412532869 shutdown_connections 2023-10-25T16:15:40.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- 172.21.15.177:0/412532869 wait complete. 2023-10-25T16:15:40.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 Processor -- start 2023-10-25T16:15:40.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- start start 2023-10-25T16:15:40.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e80039b0 0x7f38fc158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 0x7f38fc139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38fc139d30 0x7f38fc13a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc13a6f0 con 0x7f38fc138ea0 2023-10-25T16:15:40.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc1385f0 con 0x7f38fc139d30 2023-10-25T16:15:40.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f39036e1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc15a3b0 con 0x7f38e80039b0 2023-10-25T16:15:40.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f3900c7c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 0x7f38fc139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f3900c7c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 0x7f38fc139320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36376/0 (socket says 172.21.15.177:36376) 2023-10-25T16:15:40.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f3900c7c640 1 -- 172.21.15.177:0/1636904121 learned_addr learned my addr 172.21.15.177:0/1636904121 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:40.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.886+0000 7f3901c7e640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38fc139d30 0x7f38fc13a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f390147d640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e80039b0 0x7f38fc158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3900c7c640 1 -- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e80039b0 msgr2=0x7f38fc158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3900c7c640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e80039b0 0x7f38fc158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3900c7c640 1 -- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38fc139d30 msgr2=0x7f38fc13a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:40.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3900c7c640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38fc139d30 0x7f38fc13a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:40.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3900c7c640 1 -- 172.21.15.177:0/1636904121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc15b1f0 con 0x7f38fc138ea0 2023-10-25T16:15:40.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3901c7e640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38fc139d30 0x7f38fc13a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:40.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f3900c7c640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 0x7f38fc139320 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f38ec004e20 tx=0x7f38ec001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:40.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec011870 con 0x7f38fc138ea0 2023-10-25T16:15:40.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f38ec011ac0 con 0x7f38fc138ea0 2023-10-25T16:15:40.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc15b680 con 0x7f38fc138ea0 2023-10-25T16:15:40.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0103c0 con 0x7f38fc138ea0 2023-10-25T16:15:40.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc15a8c0 con 0x7f38fc138ea0 2023-10-25T16:15:40.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc15b380 con 0x7f38fc138ea0 2023-10-25T16:15:40.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f38ec010520 con 0x7f38fc138ea0 2023-10-25T16:15:40.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f38f1ffb640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38e00664a0 0x7f38e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:40.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f38ec084d10 con 0x7f38fc138ea0 2023-10-25T16:15:40.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f390147d640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38e00664a0 0x7f38e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:40.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.890+0000 7f390147d640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38e00664a0 0x7f38e0068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ac000 tx=0x7f38f4019ff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:40.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:40.894+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38ec052080 con 0x7f38fc138ea0 2023-10-25T16:15:41.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.066+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f38fc04daf0 con 0x7f38fc138ea0 2023-10-25T16:15:41.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.750+0000 7f38f1ffb640 1 -- 172.21.15.177:0/1636904121 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38ec0556a0 con 0x7f38fc138ea0 2023-10-25T16:15:41.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38e00664a0 msgr2=0x7f38e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:41.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38e00664a0 0x7f38e0068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38f40ac000 tx=0x7f38f4019ff0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 msgr2=0x7f38fc139320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:41.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 0x7f38fc139320 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f38ec004e20 tx=0x7f38ec001640 comp rx=0 tx=0).stop 2023-10-25T16:15:41.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 shutdown_connections 2023-10-25T16:15:41.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38e00664a0 0x7f38e0068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38fc139d30 0x7f38fc13a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38fc138ea0 0x7f38fc139320 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 --2- 172.21.15.177:0/1636904121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38e80039b0 0x7f38fc158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 >> 172.21.15.177:0/1636904121 conn(0x7f38fc0cdf10 msgr2=0x7f38fc06cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:41.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 shutdown_connections 2023-10-25T16:15:41.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.754+0000 7f39036e1640 1 -- 172.21.15.177:0/1636904121 wait complete. 2023-10-25T16:15:41.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:15:41.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3008017943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 msgr2=0x7ff4080cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:41.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3008017943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 0x7ff4080cd110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009930 tx=0x7ff3fc01c7a0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3008017943 shutdown_connections 2023-10-25T16:15:41.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3008017943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 0x7ff4080cd110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3008017943 >> v2:172.21.15.184:3300/0 conn(0x7ff408159360 0x7ff4080ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3008017943 >> 172.21.15.177:0/3008017943 conn(0x7ff408069920 msgr2=0x7ff408069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:41.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3008017943 shutdown_connections 2023-10-25T16:15:41.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3008017943 wait complete. 2023-10-25T16:15:41.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 Processor -- start 2023-10-25T16:15:41.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- start start 2023-10-25T16:15:41.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 0x7ff408148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:41.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4080b1430 0x7ff40814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:41.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 0x7ff408150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:41.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081519f0 con 0x7ff408159360 2023-10-25T16:15:41.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080abce0 con 0x7ff4080b1430 2023-10-25T16:15:41.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40c9e0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081532d0 con 0x7ff4080b0fd0 2023-10-25T16:15:41.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 0x7ff408150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:41.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 0x7ff408150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36380/0 (socket says 172.21.15.177:36380) 2023-10-25T16:15:41.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 -- 172.21.15.177:0/3077135494 learned_addr learned my addr 172.21.15.177:0/3077135494 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:41.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff40659c640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 0x7ff408148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:41.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff405d9b640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4080b1430 0x7ff40814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:41.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 -- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 msgr2=0x7ff408148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:41.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 0x7ff408148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 -- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4080b1430 msgr2=0x7ff40814fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:41.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4080b1430 0x7ff40814fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:41.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff406d9d640 1 -- 172.21.15.177:0/3077135494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc009560 con 0x7ff408159360 2023-10-25T16:15:41.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.906+0000 7ff405d9b640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4080b1430 0x7ff40814fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:15:41.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff406d9d640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 0x7ff408150200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff40000c7a0 tx=0x7ff40000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:41.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400003b80 con 0x7ff408159360 2023-10-25T16:15:41.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff400003ce0 con 0x7ff408159360 2023-10-25T16:15:41.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4081535b0 con 0x7ff408159360 2023-10-25T16:15:41.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000aa50 con 0x7ff408159360 2023-10-25T16:15:41.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff408153b70 con 0x7ff408159360 2023-10-25T16:15:41.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408073360 con 0x7ff408159360 2023-10-25T16:15:41.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff40000abb0 con 0x7ff408159360 2023-10-25T16:15:41.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff3f6ffd640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3e8066470 0x7ff3e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:41.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff400083db0 con 0x7ff408159360 2023-10-25T16:15:41.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff40659c640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3e8066470 0x7ff3e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:41.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.910+0000 7ff40659c640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3e8066470 0x7ff3e8068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009be0 tx=0x7ff3f80091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:41.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:41.914+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4000511b0 con 0x7ff408159360 2023-10-25T16:15:42.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.058+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff4080b1ee0 con 0x7ff408159360 2023-10-25T16:15:42.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff3f6ffd640 1 -- 172.21.15.177:0/3077135494 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff40000ae60 con 0x7ff408159360 2023-10-25T16:15:42.878 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:15:42.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3e8066470 msgr2=0x7ff3e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:42.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3e8066470 0x7ff3e8068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009be0 tx=0x7ff3f80091e0 comp rx=0 tx=0).stop 2023-10-25T16:15:42.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 msgr2=0x7ff408150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:42.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 0x7ff408150200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff40000c7a0 tx=0x7ff40000cc60 comp rx=0 tx=0).stop 2023-10-25T16:15:42.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 shutdown_connections 2023-10-25T16:15:42.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3e8066470 0x7ff3e8068930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:42.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff408159360 0x7ff408150200 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:42.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4080b1430 0x7ff40814fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:42.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 --2- 172.21.15.177:0/3077135494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4080b0fd0 0x7ff408148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:42.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 >> 172.21.15.177:0/3077135494 conn(0x7ff408069920 msgr2=0x7ff40815d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:42.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 shutdown_connections 2023-10-25T16:15:42.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:42.874+0000 7ff40c9e0640 1 -- 172.21.15.177:0/3077135494 wait complete. 2023-10-25T16:15:42.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:15:43.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 -- 172.21.15.177:0/3183900456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0afd90 msgr2=0x7f90bc0b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:43.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 --2- 172.21.15.177:0/3183900456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0afd90 0x7f90bc0b0220 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009c80 tx=0x7f90ac01cd10 comp rx=0 tx=0).stop 2023-10-25T16:15:43.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 -- 172.21.15.177:0/3183900456 shutdown_connections 2023-10-25T16:15:43.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 --2- 172.21.15.177:0/3183900456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0afd90 0x7f90bc0b0220 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 --2- 172.21.15.177:0/3183900456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90bc0c9680 0x7f90bc071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 -- 172.21.15.177:0/3183900456 >> 172.21.15.177:0/3183900456 conn(0x7f90bc069920 msgr2=0x7f90bc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:43.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 -- 172.21.15.177:0/3183900456 shutdown_connections 2023-10-25T16:15:43.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 -- 172.21.15.177:0/3183900456 wait complete. 2023-10-25T16:15:43.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 Processor -- start 2023-10-25T16:15:43.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 -- start start 2023-10-25T16:15:43.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.026+0000 7f90c0e31640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90bc06c3d0 0x7f90bc150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:43.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90bc0afd90 0x7f90bc14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:43.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 0x7f90bc0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:43.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0aee50 con 0x7f90bc0c9680 2023-10-25T16:15:43.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc150a50 con 0x7f90bc0afd90 2023-10-25T16:15:43.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0ae6c0 con 0x7f90bc06c3d0 2023-10-25T16:15:43.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 0x7f90bc0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:43.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 0x7f90bc0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36394/0 (socket says 172.21.15.177:36394) 2023-10-25T16:15:43.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 -- 172.21.15.177:0/723143629 learned_addr learned my addr 172.21.15.177:0/723143629 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:43.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90ba59c640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90bc06c3d0 0x7f90bc150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:43.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b9d9b640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90bc0afd90 0x7f90bc14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:43.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 -- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90bc06c3d0 msgr2=0x7f90bc150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:43.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90bc06c3d0 0x7f90bc150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 -- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90bc0afd90 msgr2=0x7f90bc14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:43.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90bc0afd90 0x7f90bc14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 -- 172.21.15.177:0/723143629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0098e0 con 0x7f90bc0c9680 2023-10-25T16:15:43.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90bad9d640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 0x7f90bc0b11e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f90ac01b3c0 tx=0x7f90ac0a5c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:43.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0bc070 con 0x7f90bc0c9680 2023-10-25T16:15:43.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90ac003b90 con 0x7f90bc0c9680 2023-10-25T16:15:43.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc0ad620 con 0x7f90bc0c9680 2023-10-25T16:15:43.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0ae640 con 0x7f90bc0c9680 2023-10-25T16:15:43.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc0adbe0 con 0x7f90bc0c9680 2023-10-25T16:15:43.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc073360 con 0x7f90bc0c9680 2023-10-25T16:15:43.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f90ac0b4040 con 0x7f90bc0c9680 2023-10-25T16:15:43.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b2ffd640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f909c066470 0x7f909c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:43.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f90ac11e8f0 con 0x7f90bc0c9680 2023-10-25T16:15:43.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.030+0000 7f90ba59c640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f909c066470 0x7f909c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:43.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.034+0000 7f90ba59c640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f909c066470 0x7f909c068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f90b40058d0 tx=0x7f90b4005f70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:43.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.034+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90ac0ebfc0 con 0x7f90bc0c9680 2023-10-25T16:15:43.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.186+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90bc0c9d10 con 0x7f90bc0c9680 2023-10-25T16:15:43.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.874+0000 7f90b2ffd640 1 -- 172.21.15.177:0/723143629 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f90ac0ef5e0 con 0x7f90bc0c9680 2023-10-25T16:15:43.881 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:15:43.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f909c066470 msgr2=0x7f909c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:43.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f909c066470 0x7f909c068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f90b40058d0 tx=0x7f90b4005f70 comp rx=0 tx=0).stop 2023-10-25T16:15:43.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 msgr2=0x7f90bc0b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:43.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 0x7f90bc0b11e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f90ac01b3c0 tx=0x7f90ac0a5c90 comp rx=0 tx=0).stop 2023-10-25T16:15:43.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 shutdown_connections 2023-10-25T16:15:43.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f909c066470 0x7f909c068930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90bc0c9680 0x7f90bc0b11e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90bc0afd90 0x7f90bc14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 --2- 172.21.15.177:0/723143629 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90bc06c3d0 0x7f90bc150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:43.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.878+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 >> 172.21.15.177:0/723143629 conn(0x7f90bc069920 msgr2=0x7f90bc151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:43.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.882+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 shutdown_connections 2023-10-25T16:15:43.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:43.882+0000 7f90c0e31640 1 -- 172.21.15.177:0/723143629 wait complete. 2023-10-25T16:15:43.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:15:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 -- 172.21.15.177:0/1172738089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c14e810 msgr2=0x7f676c0cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 --2- 172.21.15.177:0/1172738089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c14e810 0x7f676c0cbfa0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f676c0c9b20 tx=0x7f675c01c860 comp rx=0 tx=0).stop 2023-10-25T16:15:44.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 -- 172.21.15.177:0/1172738089 shutdown_connections 2023-10-25T16:15:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 --2- 172.21.15.177:0/1172738089 >> v2:172.21.15.184:3300/0 conn(0x7f676c15bdb0 0x7f676c0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 --2- 172.21.15.177:0/1172738089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c14e810 0x7f676c0cbfa0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 -- 172.21.15.177:0/1172738089 >> 172.21.15.177:0/1172738089 conn(0x7f676c0b2450 msgr2=0x7f676c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 -- 172.21.15.177:0/1172738089 shutdown_connections 2023-10-25T16:15:44.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 -- 172.21.15.177:0/1172738089 wait complete. 2023-10-25T16:15:44.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 Processor -- start 2023-10-25T16:15:44.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.022+0000 7f6772655640 1 -- start start 2023-10-25T16:15:44.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 0x7f676c0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676c14e810 0x7f676c148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f676c15bdb0 0x7f676c149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c144c50 con 0x7f676c0af100 2023-10-25T16:15:44.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c144ea0 con 0x7f676c14e810 2023-10-25T16:15:44.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c145180 con 0x7f676c15bdb0 2023-10-25T16:15:44.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 0x7f676c0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 0x7f676c0ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36422/0 (socket says 172.21.15.177:36422) 2023-10-25T16:15:44.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 -- 172.21.15.177:0/2266885081 learned_addr learned my addr 172.21.15.177:0/2266885081 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:44.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676b7fe640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676c14e810 0x7f676c148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 -- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f676c15bdb0 msgr2=0x7f676c149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6770bf2640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f676c15bdb0 0x7f676c149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f676c15bdb0 0x7f676c149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 -- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676c14e810 msgr2=0x7f676c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676c14e810 0x7f676c148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 -- 172.21.15.177:0/2266885081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c009560 con 0x7f676c0af100 2023-10-25T16:15:44.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676b7fe640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676c14e810 0x7f676c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:44.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676bfff640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 0x7f676c0ae500 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b0040 tx=0x7f675c0a5720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:44.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c004340 con 0x7f676c0af100 2023-10-25T16:15:44.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f675c005030 con 0x7f676c0af100 2023-10-25T16:15:44.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c145460 con 0x7f676c0af100 2023-10-25T16:15:44.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c005440 con 0x7f676c0af100 2023-10-25T16:15:44.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c145a20 con 0x7f676c0af100 2023-10-25T16:15:44.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c04daf0 con 0x7f676c0af100 2023-10-25T16:15:44.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f675c0b4070 con 0x7f676c0af100 2023-10-25T16:15:44.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6768ff9640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6758066470 0x7f6758068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f675c11d450 con 0x7f676c0af100 2023-10-25T16:15:44.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.026+0000 7f676b7fe640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6758066470 0x7f6758068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.030+0000 7f676b7fe640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6758066470 0x7f6758068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f676c151c10 tx=0x7f6760005c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:44.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.030+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f675c0eab40 con 0x7f676c0af100 2023-10-25T16:15:44.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.194+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7f676c0af550 con 0x7f676c0af100 2023-10-25T16:15:44.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6768ff9640 1 -- 172.21.15.177:0/2266885081 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v22) v1 ==== 71+0+0 (secure 0 0 0) 0x7f676c0af550 con 0x7f676c0af100 2023-10-25T16:15:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6758066470 msgr2=0x7f6758068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6758066470 0x7f6758068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f676c151c10 tx=0x7f6760005c90 comp rx=0 tx=0).stop 2023-10-25T16:15:44.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 msgr2=0x7f676c0ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 0x7f676c0ae500 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b0040 tx=0x7f675c0a5720 comp rx=0 tx=0).stop 2023-10-25T16:15:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 shutdown_connections 2023-10-25T16:15:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6758066470 0x7f6758068930 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f676c15bdb0 0x7f676c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676c14e810 0x7f676c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 --2- 172.21.15.177:0/2266885081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f676c0af100 0x7f676c0ae500 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 >> 172.21.15.177:0/2266885081 conn(0x7f676c0b2450 msgr2=0x7f676c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:44.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 shutdown_connections 2023-10-25T16:15:44.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.202+0000 7f6772655640 1 -- 172.21.15.177:0/2266885081 wait complete. 2023-10-25T16:15:44.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-10-25T16:15:44.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 -- 172.21.15.177:0/2317635329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c80cb5f0 msgr2=0x7f75c806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 --2- 172.21.15.177:0/2317635329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c80cb5f0 0x7f75c806b9e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f75c806f330 tx=0x7f75bc01c6f0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 -- 172.21.15.177:0/2317635329 shutdown_connections 2023-10-25T16:15:44.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 --2- 172.21.15.177:0/2317635329 >> v2:172.21.15.184:3300/0 conn(0x7f75c80c9910 0x7f75c806bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 --2- 172.21.15.177:0/2317635329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c80cb5f0 0x7f75c806b9e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 -- 172.21.15.177:0/2317635329 >> 172.21.15.177:0/2317635329 conn(0x7f75c80b2450 msgr2=0x7f75c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:44.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 -- 172.21.15.177:0/2317635329 shutdown_connections 2023-10-25T16:15:44.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.342+0000 7f75cd807640 1 -- 172.21.15.177:0/2317635329 wait complete. 2023-10-25T16:15:44.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 Processor -- start 2023-10-25T16:15:44.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- start start 2023-10-25T16:15:44.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75c80c9910 0x7f75c80b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75c80cb5f0 0x7f75c81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 0x7f75c815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c8156880 con 0x7f75c815b480 2023-10-25T16:15:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c8156b60 con 0x7f75c80c9910 2023-10-25T16:15:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c8156e40 con 0x7f75c80cb5f0 2023-10-25T16:15:44.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 0x7f75c815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 0x7f75c815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36438/0 (socket says 172.21.15.177:36438) 2023-10-25T16:15:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 -- 172.21.15.177:0/1221199574 learned_addr learned my addr 172.21.15.177:0/1221199574 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c67fc640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75c80cb5f0 0x7f75c81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c6ffd640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75c80c9910 0x7f75c80b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 -- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75c80cb5f0 msgr2=0x7f75c81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75c80cb5f0 0x7f75c81503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 -- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75c80c9910 msgr2=0x7f75c80b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75c80c9910 0x7f75c80b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 -- 172.21.15.177:0/1221199574 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009500 con 0x7f75c815b480 2023-10-25T16:15:44.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75c77fe640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 0x7f75c815d570 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f75c000b970 tx=0x7f75c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c000cb40 con 0x7f75c815b480 2023-10-25T16:15:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75c000cdb0 con 0x7f75c815b480 2023-10-25T16:15:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00146a0 con 0x7f75c815b480 2023-10-25T16:15:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c8157120 con 0x7f75c815b480 2023-10-25T16:15:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c8150930 con 0x7f75c815b480 2023-10-25T16:15:44.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.346+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c80c9780 con 0x7f75c815b480 2023-10-25T16:15:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.350+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75c001d3b0 con 0x7f75c815b480 2023-10-25T16:15:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.350+0000 7f75affff640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75b40664a0 0x7f75b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.350+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f75c0083d60 con 0x7f75c815b480 2023-10-25T16:15:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.350+0000 7f75c6ffd640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75b40664a0 0x7f75b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:44.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.350+0000 7f75c6ffd640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75b40664a0 0x7f75b4068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f75c80cd6f0 tx=0x7f75b8008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:44.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.354+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75c00514f0 con 0x7f75c815b480 2023-10-25T16:15:44.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.570+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f75c804daf0 con 0x7f75c815b480 2023-10-25T16:15:44.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75affff640 1 -- 172.21.15.177:0/1221199574 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v160) v1 ==== 142+0+0 (secure 0 0 0) 0x7f75c0054b10 con 0x7f75c815b480 2023-10-25T16:15:44.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75b40664a0 msgr2=0x7f75b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75b40664a0 0x7f75b4068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f75c80cd6f0 tx=0x7f75b8008040 comp rx=0 tx=0).stop 2023-10-25T16:15:44.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 msgr2=0x7f75c815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:44.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 0x7f75c815d570 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f75c000b970 tx=0x7f75c000be30 comp rx=0 tx=0).stop 2023-10-25T16:15:44.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 shutdown_connections 2023-10-25T16:15:44.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75b40664a0 0x7f75b4068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75c815b480 0x7f75c815d570 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75c80cb5f0 0x7f75c81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 --2- 172.21.15.177:0/1221199574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75c80c9910 0x7f75c80b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:44.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 >> 172.21.15.177:0/1221199574 conn(0x7f75c80b2450 msgr2=0x7f75c806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:44.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 shutdown_connections 2023-10-25T16:15:44.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:44.890+0000 7f75cd807640 1 -- 172.21.15.177:0/1221199574 wait complete. 2023-10-25T16:15:44.916 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-25T16:15:44.917 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-10-25T16:15:44.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:45.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- 172.21.15.177:0/1396879902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36340051e0 msgr2=0x7f363400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 --2- 172.21.15.177:0/1396879902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36340051e0 0x7f363400b990 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3640009e30 tx=0x7f364001d190 comp rx=0 tx=0).stop 2023-10-25T16:15:45.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- 172.21.15.177:0/1396879902 shutdown_connections 2023-10-25T16:15:45.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 --2- 172.21.15.177:0/1396879902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36340051e0 0x7f363400b990 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- 172.21.15.177:0/1396879902 >> 172.21.15.177:0/1396879902 conn(0x7f36480b2450 msgr2=0x7f36480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:45.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- 172.21.15.177:0/1396879902 shutdown_connections 2023-10-25T16:15:45.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- 172.21.15.177:0/1396879902 wait complete. 2023-10-25T16:15:45.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 Processor -- start 2023-10-25T16:15:45.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- start start 2023-10-25T16:15:45.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340051e0 0x7f36481f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3648140bc0 0x7f36481e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 0x7f364813fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36481f6300 con 0x7f36481e39d0 2023-10-25T16:15:45.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36481f5930 con 0x7f3648140bc0 2023-10-25T16:15:45.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364fe19640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36481e4300 con 0x7f36340051e0 2023-10-25T16:15:45.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 0x7f364813fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 0x7f364813fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36450/0 (socket says 172.21.15.177:36450) 2023-10-25T16:15:45.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 -- 172.21.15.177:0/1948338460 learned_addr learned my addr 172.21.15.177:0/1948338460 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:45.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364dbb5640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340051e0 0x7f36481f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364d3b4640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3648140bc0 0x7f36481e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 -- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340051e0 msgr2=0x7f36481f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340051e0 0x7f36481f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 -- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3648140bc0 msgr2=0x7f36481e1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3648140bc0 0x7f36481e1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 -- 172.21.15.177:0/1948338460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36481e45e0 con 0x7f36481e39d0 2023-10-25T16:15:45.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364dbb5640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340051e0 0x7f36481f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:15:45.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.038+0000 7f364e3b6640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 0x7f364813fa30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f364001cc00 tx=0x7f3640003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:45.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640009260 con 0x7f36481e39d0 2023-10-25T16:15:45.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3640004320 con 0x7f36481e39d0 2023-10-25T16:15:45.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36481f55c0 con 0x7f36481e39d0 2023-10-25T16:15:45.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36400046d0 con 0x7f36481e39d0 2023-10-25T16:15:45.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36481e3e80 con 0x7f36481e39d0 2023-10-25T16:15:45.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36481e40a0 con 0x7f36481e39d0 2023-10-25T16:15:45.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f36400ac440 con 0x7f36481e39d0 2023-10-25T16:15:45.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f363a7fc640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f362c0664a0 0x7f362c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f364011fc60 con 0x7f36481e39d0 2023-10-25T16:15:45.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f364dbb5640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f362c0664a0 0x7f362c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.042+0000 7f364dbb5640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f362c0664a0 0x7f362c068960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f363c000f70 tx=0x7f363c006b70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:45.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.046+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36400ed3e0 con 0x7f36481e39d0 2023-10-25T16:15:45.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.202+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36480b2db0 con 0x7f36481e39d0 2023-10-25T16:15:45.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f363a7fc640 1 -- 172.21.15.177:0/1948338460 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f36400f0a00 con 0x7f36481e39d0 2023-10-25T16:15:45.210 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:45.210 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":59,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:43.877330+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6837/4097207198":"2023-10-26T16:15:40.747336+0000","172.21.15.184:6836/4097207198":"2023-10-26T16:15:40.747336+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:45.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f362c0664a0 msgr2=0x7f362c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f362c0664a0 0x7f362c068960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f363c000f70 tx=0x7f363c006b70 comp rx=0 tx=0).stop 2023-10-25T16:15:45.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 msgr2=0x7f364813fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 0x7f364813fa30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f364001cc00 tx=0x7f3640003ef0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 shutdown_connections 2023-10-25T16:15:45.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f362c0664a0 0x7f362c068960 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36481e39d0 0x7f364813fa30 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3648140bc0 0x7f36481e1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 --2- 172.21.15.177:0/1948338460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36340051e0 0x7f36481f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 >> 172.21.15.177:0/1948338460 conn(0x7f36480b2450 msgr2=0x7f364813d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:45.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 shutdown_connections 2023-10-25T16:15:45.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.206+0000 7f364fe19640 1 -- 172.21.15.177:0/1948338460 wait complete. 2023-10-25T16:15:45.230 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:15:45.230 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:15:45.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- 172.21.15.177:0/4052849667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6204003980 msgr2=0x7f6204003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 --2- 172.21.15.177:0/4052849667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6204003980 0x7f6204003da0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f620800c290 tx=0x7f620801cfd0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f62177fe640 1 -- 172.21.15.177:0/4052849667 reap_dead start 2023-10-25T16:15:45.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- 172.21.15.177:0/4052849667 shutdown_connections 2023-10-25T16:15:45.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- 172.21.15.177:0/4052849667 >> 172.21.15.177:0/4052849667 conn(0x7f621809a570 msgr2=0x7f62180d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:45.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- 172.21.15.177:0/4052849667 shutdown_connections 2023-10-25T16:15:45.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- 172.21.15.177:0/4052849667 wait complete. 2023-10-25T16:15:45.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 Processor -- start 2023-10-25T16:15:45.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- start start 2023-10-25T16:15:45.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6204003980 0x7f621815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 0x7f621814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6218155000 0x7f6218155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621815cea0 con 0x7f62181f5170 2023-10-25T16:15:45.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180c9d80 con 0x7f6218155000 2023-10-25T16:15:45.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f621d27b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62181559c0 con 0x7f6204003980 2023-10-25T16:15:45.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f620ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 0x7f621814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f620ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 0x7f621814fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36468/0 (socket says 172.21.15.177:36468) 2023-10-25T16:15:45.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f620ffff640 1 -- 172.21.15.177:0/755662924 learned_addr learned my addr 172.21.15.177:0/755662924 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:45.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f62177fe640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6218155000 0x7f6218155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f6216ffd640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6204003980 0x7f621815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.362+0000 7f620ffff640 1 -- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6204003980 msgr2=0x7f621815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620ffff640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6204003980 0x7f621815ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620ffff640 1 -- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6218155000 msgr2=0x7f6218155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620ffff640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6218155000 0x7f6218155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620ffff640 1 -- 172.21.15.177:0/755662924 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621815c010 con 0x7f62181f5170 2023-10-25T16:15:45.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620ffff640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 0x7f621814fdd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6200011a50 tx=0x7f6200011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:45.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000fd90 con 0x7f62181f5170 2023-10-25T16:15:45.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6200012450 con 0x7f62181f5170 2023-10-25T16:15:45.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621815c2f0 con 0x7f62181f5170 2023-10-25T16:15:45.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200012800 con 0x7f62181f5170 2023-10-25T16:15:45.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621815c8b0 con 0x7f62181f5170 2023-10-25T16:15:45.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6218066440 con 0x7f62181f5170 2023-10-25T16:15:45.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6200012960 con 0x7f62181f5170 2023-10-25T16:15:45.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620f7fe640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61f8066470 0x7f61f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f62000849d0 con 0x7f62181f5170 2023-10-25T16:15:45.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f6216ffd640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61f8066470 0x7f61f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.366+0000 7f6216ffd640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61f8066470 0x7f61f8068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f62080ac000 tx=0x7f6208019d70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:45.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.370+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62000521f0 con 0x7f62181f5170 2023-10-25T16:15:45.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.522+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f621804daf0 con 0x7f62181f5170 2023-10-25T16:15:45.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f620f7fe640 1 -- 172.21.15.177:0/755662924 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f620001f0a0 con 0x7f62181f5170 2023-10-25T16:15:45.530 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:15:45.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61f8066470 msgr2=0x7f61f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61f8066470 0x7f61f8068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f62080ac000 tx=0x7f6208019d70 comp rx=0 tx=0).stop 2023-10-25T16:15:45.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 msgr2=0x7f621814fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 0x7f621814fdd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6200011a50 tx=0x7f6200011f10 comp rx=0 tx=0).stop 2023-10-25T16:15:45.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 shutdown_connections 2023-10-25T16:15:45.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61f8066470 0x7f61f8068930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6218155000 0x7f6218155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62181f5170 0x7f621814fdd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 --2- 172.21.15.177:0/755662924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6204003980 0x7f621815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 >> 172.21.15.177:0/755662924 conn(0x7f621809a570 msgr2=0x7f62180b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 shutdown_connections 2023-10-25T16:15:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.526+0000 7f621d27b640 1 -- 172.21.15.177:0/755662924 wait complete. 2023-10-25T16:15:45.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-25T16:15:45.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/3495688118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0b2120 msgr2=0x7f91bc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 --2- 172.21.15.177:0/3495688118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0b2120 0x7f91bc0b4100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009900 tx=0x7f91b001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/3495688118 shutdown_connections 2023-10-25T16:15:45.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 --2- 172.21.15.177:0/3495688118 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0cdb10 0x7f91bc0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 --2- 172.21.15.177:0/3495688118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0b2120 0x7f91bc0b4100 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/3495688118 >> 172.21.15.177:0/3495688118 conn(0x7f91bc09a5c0 msgr2=0x7f91bc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:45.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/3495688118 shutdown_connections 2023-10-25T16:15:45.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/3495688118 wait complete. 2023-10-25T16:15:45.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 Processor -- start 2023-10-25T16:15:45.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- start start 2023-10-25T16:15:45.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0b2120 0x7f91bc152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 0x7f91bc15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc15eba0 0x7f91bc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c4940 con 0x7f91bc0cdb10 2023-10-25T16:15:45.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc14fa90 con 0x7f91bc15eba0 2023-10-25T16:15:45.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc157080 con 0x7f91bc0b2120 2023-10-25T16:15:45.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 0x7f91bc15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 0x7f91bc15d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36474/0 (socket says 172.21.15.177:36474) 2023-10-25T16:15:45.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 -- 172.21.15.177:0/918958430 learned_addr learned my addr 172.21.15.177:0/918958430 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:45.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 -- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0b2120 msgr2=0x7f91bc152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0b2120 0x7f91bc152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 -- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc15eba0 msgr2=0x7f91bc15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc15eba0 0x7f91bc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 -- 172.21.15.177:0/918958430 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0009560 con 0x7f91bc0cdb10 2023-10-25T16:15:45.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91bbfff640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 0x7f91bc15d0e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f91b001aea0 tx=0x7f91b00a6670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:45.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00b6070 con 0x7f91bc0cdb10 2023-10-25T16:15:45.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91b0004030 con 0x7f91bc0cdb10 2023-10-25T16:15:45.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc1531a0 con 0x7f91bc0cdb10 2023-10-25T16:15:45.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b0004440 con 0x7f91bc0cdb10 2023-10-25T16:15:45.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.666+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc0b6140 con 0x7f91bc0cdb10 2023-10-25T16:15:45.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.670+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc04daf0 con 0x7f91bc0cdb10 2023-10-25T16:15:45.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.670+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f91b00050c0 con 0x7f91bc0cdb10 2023-10-25T16:15:45.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.670+0000 7f91b97fa640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f91a80664a0 0x7f91a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:45.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.670+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f91b011dd10 con 0x7f91bc0cdb10 2023-10-25T16:15:45.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.670+0000 7f91c0a6a640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f91a80664a0 0x7f91a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:45.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.670+0000 7f91c0a6a640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f91a80664a0 0x7f91a8068960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009670 tx=0x7f91ac006bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:45.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.674+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91b00eb3f0 con 0x7f91bc0cdb10 2023-10-25T16:15:45.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.882+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7f91bc154410 con 0x7f91bc0cdb10 2023-10-25T16:15:45.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.890+0000 7f91b97fa640 1 -- 172.21.15.177:0/918958430 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v161) v1 ==== 137+0+0 (secure 0 0 0) 0x7f91b00ac0d0 con 0x7f91bc0cdb10 2023-10-25T16:15:45.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f91a80664a0 msgr2=0x7f91a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f91a80664a0 0x7f91a8068960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009670 tx=0x7f91ac006bd0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 msgr2=0x7f91bc15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:45.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 0x7f91bc15d0e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f91b001aea0 tx=0x7f91b00a6670 comp rx=0 tx=0).stop 2023-10-25T16:15:45.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 shutdown_connections 2023-10-25T16:15:45.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f91a80664a0 0x7f91a8068960 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91bc15eba0 0x7f91bc15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91bc0cdb10 0x7f91bc15d0e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 --2- 172.21.15.177:0/918958430 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f91bc0b2120 0x7f91bc152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:45.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 >> 172.21.15.177:0/918958430 conn(0x7f91bc09a5c0 msgr2=0x7f91bc06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:45.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 shutdown_connections 2023-10-25T16:15:45.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:45.894+0000 7f91c2cce640 1 -- 172.21.15.177:0/918958430 wait complete. 2023-10-25T16:15:45.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-25T16:15:46.033 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_objectstore":"memstore"} 2023-10-25T16:15:46.033 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-25T16:15:46.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:15:46.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/1064434589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c500047d0 msgr2=0x7f1c50004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 --2- 172.21.15.177:0/1064434589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c500047d0 0x7f1c50004c50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c006fb0 tx=0x7f1c5c01cfc0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6759e640 1 -- 172.21.15.177:0/1064434589 reap_dead start 2023-10-25T16:15:46.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/1064434589 shutdown_connections 2023-10-25T16:15:46.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/1064434589 >> 172.21.15.177:0/1064434589 conn(0x7f1c6809a5c0 msgr2=0x7f1c680d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:46.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/1064434589 shutdown_connections 2023-10-25T16:15:46.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/1064434589 wait complete. 2023-10-25T16:15:46.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 Processor -- start 2023-10-25T16:15:46.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- start start 2023-10-25T16:15:46.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c500047d0 0x7f1c680c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 0x7f1c68143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c680ca3b0 0x7f1c680ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680c5d20 con 0x7f1c681430b0 2023-10-25T16:15:46.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68143f90 con 0x7f1c680ca3b0 2023-10-25T16:15:46.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680c53f0 con 0x7f1c500047d0 2023-10-25T16:15:46.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 0x7f1c68143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 0x7f1c68143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36488/0 (socket says 172.21.15.177:36488) 2023-10-25T16:15:46.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 -- 172.21.15.177:0/141029824 learned_addr learned my addr 172.21.15.177:0/141029824 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:46.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c66d9d640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c500047d0 0x7f1c680c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6759e640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c680ca3b0 0x7f1c680ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 -- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c500047d0 msgr2=0x7f1c680c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c500047d0 0x7f1c680c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 -- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c680ca3b0 msgr2=0x7f1c680ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c680ca3b0 0x7f1c680ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 -- 172.21.15.177:0/141029824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68143a70 con 0x7f1c681430b0 2023-10-25T16:15:46.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6759e640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c680ca3b0 0x7f1c680ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:15:46.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c66d9d640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c500047d0 0x7f1c680c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:15:46.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6659c640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 0x7f1c68143530 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c001940 tx=0x7f1c5c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:46.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0b3070 con 0x7f1c681430b0 2023-10-25T16:15:46.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c5c0016c0 con 0x7f1c681430b0 2023-10-25T16:15:46.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c680c5660 con 0x7f1c681430b0 2023-10-25T16:15:46.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c006440 con 0x7f1c681430b0 2023-10-25T16:15:46.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.142+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c680cb100 con 0x7f1c681430b0 2023-10-25T16:15:46.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.146+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6804daf0 con 0x7f1c681430b0 2023-10-25T16:15:46.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.146+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1c5c0ab020 con 0x7f1c681430b0 2023-10-25T16:15:46.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.146+0000 7f1c4f7fe640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c540664a0 0x7f1c54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.146+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c5c11d290 con 0x7f1c681430b0 2023-10-25T16:15:46.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.146+0000 7f1c66d9d640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c540664a0 0x7f1c54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.146+0000 7f1c66d9d640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c540664a0 0x7f1c54068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800cd00 tx=0x7f1c5800c2d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:46.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.150+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1c5c0eaaa0 con 0x7f1c681430b0 2023-10-25T16:15:46.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f1c680ce930 con 0x7f1c681430b0 2023-10-25T16:15:46.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c4f7fe640 1 -- 172.21.15.177:0/141029824 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v22) v1 ==== 59+0+1116 (secure 0 0 0) 0x7f1c5c0bd080 con 0x7f1c681430b0 2023-10-25T16:15:46.310 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:15:46.311 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:15:46.311 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:15:46.311 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:15:46.311 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:15:46.311 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:15:46.312 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:15:46.312 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:15:46.312 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:15:46.312 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:15:46.313 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:15:46.313 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:15:46.313 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:15:46.313 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:15:46.313 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:15:46.314 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:15:46.314 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:15:46.314 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:15:46.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c540664a0 msgr2=0x7f1c54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c540664a0 0x7f1c54068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800cd00 tx=0x7f1c5800c2d0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 msgr2=0x7f1c68143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 0x7f1c68143530 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c001940 tx=0x7f1c5c0014d0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 shutdown_connections 2023-10-25T16:15:46.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c540664a0 0x7f1c54068960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c680ca3b0 0x7f1c680ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c681430b0 0x7f1c68143530 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 --2- 172.21.15.177:0/141029824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c500047d0 0x7f1c680c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 >> 172.21.15.177:0/141029824 conn(0x7f1c6809a5c0 msgr2=0x7f1c680cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:46.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 shutdown_connections 2023-10-25T16:15:46.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.306+0000 7f1c6d165640 1 -- 172.21.15.177:0/141029824 wait complete. 2023-10-25T16:15:46.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:15:46.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/3623585345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa90006c090 msgr2=0x7fa900070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 --2- 172.21.15.177:0/3623585345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa90006c090 0x7fa900070510 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009bc0 tx=0x7fa8f801cb10 comp rx=0 tx=0).stop 2023-10-25T16:15:46.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/3623585345 shutdown_connections 2023-10-25T16:15:46.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 --2- 172.21.15.177:0/3623585345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa90006c090 0x7fa900070510 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/3623585345 >> 172.21.15.177:0/3623585345 conn(0x7fa9000b2450 msgr2=0x7fa9000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:46.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/3623585345 shutdown_connections 2023-10-25T16:15:46.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/3623585345 wait complete. 2023-10-25T16:15:46.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 Processor -- start 2023-10-25T16:15:46.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- start start 2023-10-25T16:15:46.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa90006c090 0x7fa900149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 0x7fa9000affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa900159230 0x7fa900146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000b09c0 con 0x7fa900071500 2023-10-25T16:15:46.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000b0ca0 con 0x7fa90006c090 2023-10-25T16:15:46.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000b0f80 con 0x7fa900159230 2023-10-25T16:15:46.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 0x7fa9000affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 0x7fa9000affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36504/0 (socket says 172.21.15.177:36504) 2023-10-25T16:15:46.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 -- 172.21.15.177:0/2262377140 learned_addr learned my addr 172.21.15.177:0/2262377140 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:46.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 -- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa900159230 msgr2=0x7fa900146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa900159230 0x7fa900146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 -- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa90006c090 msgr2=0x7fa900149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa90006c090 0x7fa900149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 -- 172.21.15.177:0/2262377140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009820 con 0x7fa900071500 2023-10-25T16:15:46.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fffff640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 0x7fa9000affe0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c4a0 tx=0x7fa8f000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:46.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0005480 con 0x7fa900071500 2023-10-25T16:15:46.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa8f0003710 con 0x7fa900071500 2023-10-25T16:15:46.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9000b1260 con 0x7fa900071500 2023-10-25T16:15:46.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0003b20 con 0x7fa900071500 2023-10-25T16:15:46.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9000b1a60 con 0x7fa900071500 2023-10-25T16:15:46.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.438+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90004daf0 con 0x7fa900071500 2023-10-25T16:15:46.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.442+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8f0003c80 con 0x7fa900071500 2023-10-25T16:15:46.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.442+0000 7fa8fd7fa640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8ec0664a0 0x7fa8ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.442+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8f0083330 con 0x7fa900071500 2023-10-25T16:15:46.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.442+0000 7fa904a56640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8ec0664a0 0x7fa8ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.442+0000 7fa904a56640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8ec0664a0 0x7fa8ec068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9001f7b40 tx=0x7fa8f4006bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:46.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.446+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8f0050b40 con 0x7fa900071500 2023-10-25T16:15:46.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.586+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa9000b1710 con 0x7fa900071500 2023-10-25T16:15:46.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.590+0000 7fa8fd7fa640 1 -- 172.21.15.177:0/2262377140 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v23)=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa8f0054160 con 0x7fa900071500 2023-10-25T16:15:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8ec0664a0 msgr2=0x7fa8ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8ec0664a0 0x7fa8ec068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9001f7b40 tx=0x7fa8f4006bd0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 msgr2=0x7fa9000affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 0x7fa9000affe0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c4a0 tx=0x7fa8f000c960 comp rx=0 tx=0).stop 2023-10-25T16:15:46.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 shutdown_connections 2023-10-25T16:15:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8ec0664a0 0x7fa8ec068960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa900159230 0x7fa900146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa900071500 0x7fa9000affe0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 --2- 172.21.15.177:0/2262377140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa90006c090 0x7fa900149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 >> 172.21.15.177:0/2262377140 conn(0x7fa9000b2450 msgr2=0x7fa90006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 shutdown_connections 2023-10-25T16:15:46.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.594+0000 7fa906cba640 1 -- 172.21.15.177:0/2262377140 wait complete. 2023-10-25T16:15:46.614 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:15:46.615 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:15:46.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:15:46.737 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:15:46.737 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:46.738 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:46.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:15:46.744 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:15:46.744 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:46.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:15:46.750 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:15:46.751 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:46.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:15:46.790 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:15:46.791 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:15:46.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:15:46.798 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:15:46.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:46.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/3627243355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2650004d10 msgr2=0x7f2650005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 --2- 172.21.15.177:0/3627243355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2650004d10 0x7f2650005190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2660009e10 tx=0x7f266001d130 comp rx=0 tx=0).stop 2023-10-25T16:15:46.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f26677fe640 1 -- 172.21.15.177:0/3627243355 reap_dead start 2023-10-25T16:15:46.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/3627243355 shutdown_connections 2023-10-25T16:15:46.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/3627243355 >> 172.21.15.177:0/3627243355 conn(0x7f266809a5c0 msgr2=0x7f26680d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:46.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/3627243355 shutdown_connections 2023-10-25T16:15:46.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/3627243355 wait complete. 2023-10-25T16:15:46.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 Processor -- start 2023-10-25T16:15:46.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- start start 2023-10-25T16:15:46.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 0x7f266814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f266815de90 0x7f26680ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26680ca8d0 0x7f26680c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2668150960 con 0x7f266814a280 2023-10-25T16:15:46.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680cad50 con 0x7f26680ca8d0 2023-10-25T16:15:46.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26681f5510 con 0x7f266815de90 2023-10-25T16:15:46.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 0x7f266814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 0x7f266814d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36526/0 (socket says 172.21.15.177:36526) 2023-10-25T16:15:46.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 -- 172.21.15.177:0/1146604344 learned_addr learned my addr 172.21.15.177:0/1146604344 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f26667fc640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f266815de90 0x7f26680ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f26677fe640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26680ca8d0 0x7f26680c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 -- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f266815de90 msgr2=0x7f26680ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f266815de90 0x7f26680ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 -- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26680ca8d0 msgr2=0x7f26680c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26680ca8d0 0x7f26680c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 -- 172.21.15.177:0/1146604344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26681f6090 con 0x7f266814a280 2023-10-25T16:15:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f26667fc640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f266815de90 0x7f26680ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f26677fe640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26680ca8d0 0x7f26680c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:46.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f2666ffd640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 0x7f266814d4e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f265800dfd0 tx=0x7f265800faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:46.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800a8f0 con 0x7f266814a280 2023-10-25T16:15:46.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f265800ab40 con 0x7f266814a280 2023-10-25T16:15:46.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26681f5760 con 0x7f266814a280 2023-10-25T16:15:46.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658012470 con 0x7f266814a280 2023-10-25T16:15:46.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.958+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26681f5d20 con 0x7f266814a280 2023-10-25T16:15:46.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.962+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266804daf0 con 0x7f266814a280 2023-10-25T16:15:46.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.962+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f26580125d0 con 0x7f266814a280 2023-10-25T16:15:46.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.962+0000 7f264f7fe640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2654066470 0x7f2654068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:46.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.962+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2658087160 con 0x7f266814a280 2023-10-25T16:15:46.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.962+0000 7f26667fc640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2654066470 0x7f2654068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:46.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.962+0000 7f26667fc640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2654066470 0x7f2654068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f265c005d10 tx=0x7f265c005f60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:46.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:46.966+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2658054970 con 0x7f266814a280 2023-10-25T16:15:47.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.138+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26680ce930 con 0x7f266814a280 2023-10-25T16:15:47.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.138+0000 7f264f7fe640 1 -- 172.21.15.177:0/1146604344 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3710 (secure 0 0 0) 0x7f2658020e90 con 0x7f266814a280 2023-10-25T16:15:47.144 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:47.145 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/531840751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":531840751},{"type":"v1","addr":"172.21.15.184:6835","nonce":531840751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3904761906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3904761906},{"type":"v1","addr":"172.21.15.177:6833","nonce":3904761906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":5847,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2440562718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2440562718},{"type":"v1","addr":"172.21.15.177:6835","nonce":2440562718}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":154997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4098303749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4098303749},{"type":"v1","addr":"172.21.15.184:6837","nonce":4098303749}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2023-10-25T16:15:47.145 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 21 2023-10-25T16:15:47.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2654066470 msgr2=0x7f2654068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:47.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2654066470 0x7f2654068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f265c005d10 tx=0x7f265c005f60 comp rx=0 tx=0).stop 2023-10-25T16:15:47.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 msgr2=0x7f266814d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:47.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 0x7f266814d4e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f265800dfd0 tx=0x7f265800faa0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 shutdown_connections 2023-10-25T16:15:47.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2654066470 0x7f2654068930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26680ca8d0 0x7f26680c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f266815de90 0x7f26680ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 --2- 172.21.15.177:0/1146604344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f266814a280 0x7f266814d4e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 >> 172.21.15.177:0/1146604344 conn(0x7f266809a5c0 msgr2=0x7f26680b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:47.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 shutdown_connections 2023-10-25T16:15:47.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.142+0000 7f266d421640 1 -- 172.21.15.177:0/1146604344 wait complete. 2023-10-25T16:15:47.162 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:15:47.162 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:15:47.163 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:15:47.163 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:15:47.164 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:15:47.164 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:15:47.164 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:15:47.165 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:15:47.165 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:15:47.165 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:15:47.165 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:15:47.166 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:15:47.166 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:15:47.166 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:15:47.167 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:15:47.167 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:15:47.172 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:15:47.173 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:15:47.174 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:15:47.174 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:15:47.179 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:15:47.179 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:15:47.181 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:15:47.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:15:47.222 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:15:47.223 DEBUG:teuthology.parallel:result is None 2023-10-25T16:15:47.224 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:15:47.224 DEBUG:teuthology.parallel:result is None 2023-10-25T16:15:47.225 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:15:47.225 DEBUG:teuthology.parallel:result is None 2023-10-25T16:15:47.226 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:15:47.227 DEBUG:teuthology.parallel:result is None 2023-10-25T16:15:47.227 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:15:47.280 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:15:47.294 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:15:47.296 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:15:47.298 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:15:47.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/2400090538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 msgr2=0x7fd3180cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:47.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- 172.21.15.177:0/2400090538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd3180cdfc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b3ea0 tx=0x7fd31001c810 comp rx=0 tx=0).stop 2023-10-25T16:15:47.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/2400090538 shutdown_connections 2023-10-25T16:15:47.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- 172.21.15.177:0/2400090538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd3180cdfc0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- 172.21.15.177:0/2400090538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3180b2120 0x7fd3180d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- 172.21.15.177:0/2400090538 >> v2:172.21.15.184:3300/0 conn(0x7fd31815eba0 0x7fd3180b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/2400090538 >> 172.21.15.177:0/2400090538 conn(0x7fd31809a5c0 msgr2=0x7fd3180d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:47.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/2400090538 shutdown_connections 2023-10-25T16:15:47.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/2400090538 wait complete. 2023-10-25T16:15:47.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 Processor -- start 2023-10-25T16:15:47.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- start start 2023-10-25T16:15:47.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3180b2120 0x7fd31806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:47.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd318153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:47.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd31815eba0 0x7fd3180c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:47.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180c7c30 con 0x7fd3180cdb10 2023-10-25T16:15:47.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31806bc60 con 0x7fd31815eba0 2023-10-25T16:15:47.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31806b3c0 con 0x7fd3180b2120 2023-10-25T16:15:47.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd318153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:47.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd318153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36576/0 (socket says 172.21.15.177:36576) 2023-10-25T16:15:47.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 -- 172.21.15.177:0/4189916901 learned_addr learned my addr 172.21.15.177:0/4189916901 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:47.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd316ffd640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3180b2120 0x7fd31806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:47.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3177fe640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd31815eba0 0x7fd3180c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:47.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 -- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3180b2120 msgr2=0x7fd31806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:47.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3180b2120 0x7fd31806ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 -- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd31815eba0 msgr2=0x7fd3180c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:47.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd31815eba0 0x7fd3180c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:47.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 -- 172.21.15.177:0/4189916901 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009560 con 0x7fd3180cdb10 2023-10-25T16:15:47.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd3167fc640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd318153d20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd30000e9f0 tx=0x7fd30000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:47.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000ccc0 con 0x7fd3180cdb10 2023-10-25T16:15:47.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd30000ce20 con 0x7fd3180cdb10 2023-10-25T16:15:47.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31806b6a0 con 0x7fd3180cdb10 2023-10-25T16:15:47.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300005280 con 0x7fd3180cdb10 2023-10-25T16:15:47.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.338+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3180c94d0 con 0x7fd3180cdb10 2023-10-25T16:15:47.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.342+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3180c96f0 con 0x7fd3180cdb10 2023-10-25T16:15:47.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.342+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3000053e0 con 0x7fd3180cdb10 2023-10-25T16:15:47.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.342+0000 7fd30f7fe640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2f8066470 0x7fd2f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:47.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.342+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd300014070 con 0x7fd3180cdb10 2023-10-25T16:15:47.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.342+0000 7fd316ffd640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2f8066470 0x7fd2f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:47.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.342+0000 7fd316ffd640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2f8066470 0x7fd2f8068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ec0 tx=0x7fd308009500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:47.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.346+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3000558f0 con 0x7fd3180cdb10 2023-10-25T16:15:47.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:47.510+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd31804daf0 con 0x7fd3180cdb10 2023-10-25T16:15:48.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.622+0000 7fd30f7fe640 1 -- 172.21.15.177:0/4189916901 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd300055480 con 0x7fd3180cdb10 2023-10-25T16:15:48.627 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:15:48.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2f8066470 msgr2=0x7fd2f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:48.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2f8066470 0x7fd2f8068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ec0 tx=0x7fd308009500 comp rx=0 tx=0).stop 2023-10-25T16:15:48.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 msgr2=0x7fd318153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:48.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd318153d20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd30000e9f0 tx=0x7fd30000eeb0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 shutdown_connections 2023-10-25T16:15:48.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2f8066470 0x7fd2f8068930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd31815eba0 0x7fd3180c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3180cdb10 0x7fd318153d20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 --2- 172.21.15.177:0/4189916901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3180b2120 0x7fd31806ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 >> 172.21.15.177:0/4189916901 conn(0x7fd31809a5c0 msgr2=0x7fd31815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:48.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 shutdown_connections 2023-10-25T16:15:48.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.626+0000 7fd31d61b640 1 -- 172.21.15.177:0/4189916901 wait complete. 2023-10-25T16:15:48.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:15:48.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 -- 172.21.15.177:0/2712735895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00c9910 msgr2=0x7fbea006bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:48.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 --2- 172.21.15.177:0/2712735895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00c9910 0x7fbea006bf20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbea00aaa40 tx=0x7fbe9801ca10 comp rx=0 tx=0).stop 2023-10-25T16:15:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 -- 172.21.15.177:0/2712735895 shutdown_connections 2023-10-25T16:15:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 --2- 172.21.15.177:0/2712735895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00c9910 0x7fbea006bf20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 --2- 172.21.15.177:0/2712735895 >> v2:172.21.15.184:3300/0 conn(0x7fbea00cb5f0 0x7fbea006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 -- 172.21.15.177:0/2712735895 >> 172.21.15.177:0/2712735895 conn(0x7fbea00b2450 msgr2=0x7fbea00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:48.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 -- 172.21.15.177:0/2712735895 shutdown_connections 2023-10-25T16:15:48.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.770+0000 7fbea6f73640 1 -- 172.21.15.177:0/2712735895 wait complete. 2023-10-25T16:15:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 Processor -- start 2023-10-25T16:15:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- start start 2023-10-25T16:15:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea00c9910 0x7fbea0151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:48.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 0x7fbea00ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbea015b480 0x7fbea00b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea01f8890 con 0x7fbea00cb5f0 2023-10-25T16:15:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0166130 con 0x7fbea00c9910 2023-10-25T16:15:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00ae3d0 con 0x7fbea015b480 2023-10-25T16:15:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 0x7fbea00ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 0x7fbea00ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36602/0 (socket says 172.21.15.177:36602) 2023-10-25T16:15:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 -- 172.21.15.177:0/3135962182 learned_addr learned my addr 172.21.15.177:0/3135962182 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea4d0f640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea00c9910 0x7fbea0151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea5510640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbea015b480 0x7fbea00b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 -- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbea015b480 msgr2=0x7fbea00b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbea015b480 0x7fbea00b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 -- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea00c9910 msgr2=0x7fbea0151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea00c9910 0x7fbea0151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 -- 172.21.15.177:0/3135962182 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009820 con 0x7fbea00cb5f0 2023-10-25T16:15:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea5510640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbea015b480 0x7fbea00b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9ffff640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 0x7fbea00ad810 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b4d0 tx=0x7fbe9400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94005c20 con 0x7fbea00cb5f0 2023-10-25T16:15:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbe94005e70 con 0x7fbea00cb5f0 2023-10-25T16:15:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea00ae0f0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940108b0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea01f84b0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.774+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea01f89d0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.778+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe94010a10 con 0x7fbea00cb5f0 2023-10-25T16:15:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.778+0000 7fbe9d7fa640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe8c0664a0 0x7fbe8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.778+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe94083910 con 0x7fbea00cb5f0 2023-10-25T16:15:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.778+0000 7fbea4d0f640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe8c0664a0 0x7fbe8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.778+0000 7fbea4d0f640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe8c0664a0 0x7fbe8c068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe900046c0 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.782+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbea01f89d0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.990+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbea01f89d0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.990+0000 7fbe9d7fa640 1 -- 172.21.15.177:0/3135962182 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbea01f89d0 con 0x7fbea00cb5f0 2023-10-25T16:15:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:48.996 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:15:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:15:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:15:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:15:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:15:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:15:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:15:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:15:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:15:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:15:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:15:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:15:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:15:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:15:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:15:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:15:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:15:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:15:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:15:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:15:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:15:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:15:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:15:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:15:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:15:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:15:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:15:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:15:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:15:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:15:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:15:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:15:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:15:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:15:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:15:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:15:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:15:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:15:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:15:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:15:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:15:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:15:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:15:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:15:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:15:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:15:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:15:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:15:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:15:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:15:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:15:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:15:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:15:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:15:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:15:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:15:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:15:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:15:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:15:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:15:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:15:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:15:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:15:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:15:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:15:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:15:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:15:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:15:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:15:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:15:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:15:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:15:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.032 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:15:49.032 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:15:49.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe8c0664a0 msgr2=0x7fbe8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe8c0664a0 0x7fbe8c068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbe900046c0 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2023-10-25T16:15:49.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 msgr2=0x7fbea00ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 0x7fbea00ad810 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b4d0 tx=0x7fbe9400b990 comp rx=0 tx=0).stop 2023-10-25T16:15:49.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 shutdown_connections 2023-10-25T16:15:49.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe8c0664a0 0x7fbe8c068960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbea015b480 0x7fbea00b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbea00cb5f0 0x7fbea00ad810 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 --2- 172.21.15.177:0/3135962182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea00c9910 0x7fbea0151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 >> 172.21.15.177:0/3135962182 conn(0x7fbea00b2450 msgr2=0x7fbea00b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 shutdown_connections 2023-10-25T16:15:49.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:48.994+0000 7fbea6f73640 1 -- 172.21.15.177:0/3135962182 wait complete. 2023-10-25T16:15:49.036 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:49.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- 172.21.15.177:0/793464480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0071500 msgr2=0x7f6ec0070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/793464480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0071500 0x7f6ec0070510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8005fd0 tx=0x7f6ea801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- 172.21.15.177:0/793464480 shutdown_connections 2023-10-25T16:15:49.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/793464480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 0x7f6ec006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/793464480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0071500 0x7f6ec0070510 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- 172.21.15.177:0/793464480 >> 172.21.15.177:0/793464480 conn(0x7f6ec00b2450 msgr2=0x7f6ec00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- 172.21.15.177:0/793464480 shutdown_connections 2023-10-25T16:15:49.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- 172.21.15.177:0/793464480 wait complete. 2023-10-25T16:15:49.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 Processor -- start 2023-10-25T16:15:49.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- start start 2023-10-25T16:15:49.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 0x7f6ec0143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 0x7f6ec0155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0159230 0x7f6ec0156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01456b0 con 0x7f6ec0071500 2023-10-25T16:15:49.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec0148010 con 0x7f6ec0159230 2023-10-25T16:15:49.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ec4d15640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec01482f0 con 0x7f6ec006b980 2023-10-25T16:15:49.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 0x7f6ec0155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 0x7f6ec0155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36610/0 (socket says 172.21.15.177:36610) 2023-10-25T16:15:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 -- 172.21.15.177:0/3852367771 learned_addr learned my addr 172.21.15.177:0/3852367771 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebed9d640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0159230 0x7f6ec0156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebe59c640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 0x7f6ec0143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 -- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 msgr2=0x7f6ec0143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 0x7f6ec0143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 -- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0159230 msgr2=0x7f6ec0156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0159230 0x7f6ec0156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 -- 172.21.15.177:0/3852367771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8009450 con 0x7f6ec0071500 2023-10-25T16:15:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebe59c640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 0x7f6ec0143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:49.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6ebdd9b640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 0x7f6ec0155d00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6ea801a400 tx=0x7f6ea8005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:49.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80046d0 con 0x7f6ec0071500 2023-10-25T16:15:49.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ea8004920 con 0x7f6ec0071500 2023-10-25T16:15:49.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.154+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8004c90 con 0x7f6ec0071500 2023-10-25T16:15:49.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec0144ff0 con 0x7f6ec0071500 2023-10-25T16:15:49.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec0144260 con 0x7f6ec0071500 2023-10-25T16:15:49.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec01457f0 con 0x7f6ec0071500 2023-10-25T16:15:49.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ea80a5690 con 0x7f6ec0071500 2023-10-25T16:15:49.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6eb6ffd640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ea0066470 0x7f6ea0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ea811ed30 con 0x7f6ec0071500 2023-10-25T16:15:49.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6ebe59c640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ea0066470 0x7f6ea0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.158+0000 7f6ebe59c640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ea0066470 0x7f6ea0068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0007fd0 tx=0x7f6eb0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:49.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.162+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ec01457f0 con 0x7f6ec0071500 2023-10-25T16:15:49.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.302+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ec01457f0 con 0x7f6ec0071500 2023-10-25T16:15:49.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6eb6ffd640 1 -- 172.21.15.177:0/3852367771 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f6ec01457f0 con 0x7f6ec0071500 2023-10-25T16:15:49.311 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:49.311 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":64,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:48.623299+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:49.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ea0066470 msgr2=0x7f6ea0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ea0066470 0x7f6ea0068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0007fd0 tx=0x7f6eb0009040 comp rx=0 tx=0).stop 2023-10-25T16:15:49.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 msgr2=0x7f6ec0155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 0x7f6ec0155d00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6ea801a400 tx=0x7f6ea8005c40 comp rx=0 tx=0).stop 2023-10-25T16:15:49.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 shutdown_connections 2023-10-25T16:15:49.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ea0066470 0x7f6ea0068930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec0159230 0x7f6ec0156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec0071500 0x7f6ec0155d00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 --2- 172.21.15.177:0/3852367771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ec006b980 0x7f6ec0143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 >> 172.21.15.177:0/3852367771 conn(0x7f6ec00b2450 msgr2=0x7f6ec015a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 shutdown_connections 2023-10-25T16:15:49.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.306+0000 7f6ec4d15640 1 -- 172.21.15.177:0/3852367771 wait complete. 2023-10-25T16:15:49.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:15:49.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:15:49.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 -- 172.21.15.177:0/3436397062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc0cdb10 msgr2=0x7fb8bc0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 --2- 172.21.15.177:0/3436397062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc0cdb10 0x7fb8bc0cdfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009bc0 tx=0x7fb8b401caf0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 -- 172.21.15.177:0/3436397062 shutdown_connections 2023-10-25T16:15:49.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 --2- 172.21.15.177:0/3436397062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc0cdb10 0x7fb8bc0cdfc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 --2- 172.21.15.177:0/3436397062 >> v2:172.21.15.184:3300/0 conn(0x7fb8bc0b2120 0x7fb8bc0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 -- 172.21.15.177:0/3436397062 >> 172.21.15.177:0/3436397062 conn(0x7fb8bc09a5c0 msgr2=0x7fb8bc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 -- 172.21.15.177:0/3436397062 shutdown_connections 2023-10-25T16:15:49.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 -- 172.21.15.177:0/3436397062 wait complete. 2023-10-25T16:15:49.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 Processor -- start 2023-10-25T16:15:49.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.442+0000 7fb8c358d640 1 -- start start 2023-10-25T16:15:49.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 0x7fb8bc0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8bc0cdb10 0x7fb8bc0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc15eba0 0x7fb8bc0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c51a0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc158b30 con 0x7fb8bc0cdb10 2023-10-25T16:15:49.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc158e10 con 0x7fb8bc15eba0 2023-10-25T16:15:49.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 0x7fb8bc0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 0x7fb8bc0c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36624/0 (socket says 172.21.15.177:36624) 2023-10-25T16:15:49.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 -- 172.21.15.177:0/2529162354 learned_addr learned my addr 172.21.15.177:0/2529162354 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:49.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c0b28640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8bc0cdb10 0x7fb8bc0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1b2a640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc15eba0 0x7fb8bc0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 -- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc15eba0 msgr2=0x7fb8bc0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc15eba0 0x7fb8bc0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 -- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8bc0cdb10 msgr2=0x7fb8bc0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8bc0cdb10 0x7fb8bc0c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 -- 172.21.15.177:0/2529162354 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009820 con 0x7fb8bc0b2120 2023-10-25T16:15:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c1329640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 0x7fb8bc0c7a80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800c3c0 tx=0x7fb8b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80052d0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb8b8003600 con 0x7fb8bc0b2120 2023-10-25T16:15:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8003a10 con 0x7fb8bc0b2120 2023-10-25T16:15:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc1590f0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc0c53b0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc0b4220 con 0x7fb8bc0b2120 2023-10-25T16:15:49.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8b8003b70 con 0x7fb8bc0b2120 2023-10-25T16:15:49.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8b1ffb640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8a0066470 0x7fb8a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8b8083240 con 0x7fb8bc0b2120 2023-10-25T16:15:49.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.446+0000 7fb8c0b28640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8a0066470 0x7fb8a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.450+0000 7fb8c0b28640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8a0066470 0x7fb8a0068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc1f8340 tx=0x7fb8ac009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:49.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.450+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8b8050aa0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8bc0d02d0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8b1ffb640 1 -- 172.21.15.177:0/2529162354 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8b80540c0 con 0x7fb8bc0b2120 2023-10-25T16:15:49.599 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:15:49.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8a0066470 msgr2=0x7fb8a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8a0066470 0x7fb8a0068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc1f8340 tx=0x7fb8ac009260 comp rx=0 tx=0).stop 2023-10-25T16:15:49.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 msgr2=0x7fb8bc0c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 0x7fb8bc0c7a80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800c3c0 tx=0x7fb8b800c880 comp rx=0 tx=0).stop 2023-10-25T16:15:49.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 shutdown_connections 2023-10-25T16:15:49.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8a0066470 0x7fb8a0068930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8bc15eba0 0x7fb8bc0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8bc0cdb10 0x7fb8bc0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 --2- 172.21.15.177:0/2529162354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8bc0b2120 0x7fb8bc0c7a80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 >> 172.21.15.177:0/2529162354 conn(0x7fb8bc09a5c0 msgr2=0x7fb8bc0d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 shutdown_connections 2023-10-25T16:15:49.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.594+0000 7fb8c358d640 1 -- 172.21.15.177:0/2529162354 wait complete. 2023-10-25T16:15:49.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:15:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- 172.21.15.177:0/4129751917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c0cc610 msgr2=0x7f691c06b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- 172.21.15.177:0/4129751917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c0cc610 0x7f691c06b980 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6914009c80 tx=0x7f691401cd10 comp rx=0 tx=0).stop 2023-10-25T16:15:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- 172.21.15.177:0/4129751917 shutdown_connections 2023-10-25T16:15:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- 172.21.15.177:0/4129751917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c0cc610 0x7f691c06b980 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- 172.21.15.177:0/4129751917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f691c070510 0x7f691c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- 172.21.15.177:0/4129751917 >> v2:172.21.15.184:3300/0 conn(0x7f691c159230 0x7f691c071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- 172.21.15.177:0/4129751917 >> 172.21.15.177:0/4129751917 conn(0x7f691c0b2450 msgr2=0x7f691c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- 172.21.15.177:0/4129751917 shutdown_connections 2023-10-25T16:15:49.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- 172.21.15.177:0/4129751917 wait complete. 2023-10-25T16:15:49.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 Processor -- start 2023-10-25T16:15:49.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- start start 2023-10-25T16:15:49.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 0x7f691c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f691c0cc610 0x7f691c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f691c159230 0x7f691c0a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c14dd00 con 0x7f691c070510 2023-10-25T16:15:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c15b620 con 0x7f691c159230 2023-10-25T16:15:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f6921c93640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c150220 con 0x7f691c0cc610 2023-10-25T16:15:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 0x7f691c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 0x7f691c1577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36648/0 (socket says 172.21.15.177:36648) 2023-10-25T16:15:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 -- 172.21.15.177:0/1432352375 learned_addr learned my addr 172.21.15.177:0/1432352375 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691bfff640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f691c159230 0x7f691c0a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 -- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f691c0cc610 msgr2=0x7f691c157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f691c0cc610 0x7f691c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 -- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f691c159230 msgr2=0x7f691c0a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f691c159230 0x7f691c0a8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.726+0000 7f691b7fe640 1 -- 172.21.15.177:0/1432352375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140098e0 con 0x7f691c070510 2023-10-25T16:15:49.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f691b7fe640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 0x7f691c1577e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f690c00b410 tx=0x7f690c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:49.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c011830 con 0x7f691c070510 2023-10-25T16:15:49.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f690c011aa0 con 0x7f691c070510 2023-10-25T16:15:49.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c150500 con 0x7f691c070510 2023-10-25T16:15:49.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c010380 con 0x7f691c070510 2023-10-25T16:15:49.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c15b900 con 0x7f691c070510 2023-10-25T16:15:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c157120 con 0x7f691c070510 2023-10-25T16:15:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f690c0104e0 con 0x7f691c070510 2023-10-25T16:15:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6903fff640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6908066470 0x7f6908068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f690c083eb0 con 0x7f691c070510 2023-10-25T16:15:49.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f691affd640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6908066470 0x7f6908068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.730+0000 7f691affd640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6908066470 0x7f6908068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f691c158f00 tx=0x7f6910005c30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:49.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.734+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f691c157120 con 0x7f691c070510 2023-10-25T16:15:49.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.886+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f691c157120 con 0x7f691c070510 2023-10-25T16:15:49.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.886+0000 7f6903fff640 1 -- 172.21.15.177:0/1432352375 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+65 (secure 0 0 0) 0x7f691c157120 con 0x7f691c070510 2023-10-25T16:15:49.891 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:49.892 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:15:49.892 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:15:49.892 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:15:49.892 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:15:49.893 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:15:49.893 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:15:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6908066470 msgr2=0x7f6908068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6908066470 0x7f6908068930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f691c158f00 tx=0x7f6910005c30 comp rx=0 tx=0).stop 2023-10-25T16:15:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 msgr2=0x7f691c1577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:49.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 0x7f691c1577e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f690c00b410 tx=0x7f690c00b8d0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 shutdown_connections 2023-10-25T16:15:49.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6908066470 0x7f6908068930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f691c159230 0x7f691c0a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f691c0cc610 0x7f691c157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 --2- 172.21.15.177:0/1432352375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f691c070510 0x7f691c1577e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:49.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 >> 172.21.15.177:0/1432352375 conn(0x7f691c0b2450 msgr2=0x7f691c0ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:49.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 shutdown_connections 2023-10-25T16:15:49.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:49.890+0000 7f6921c93640 1 -- 172.21.15.177:0/1432352375 wait complete. 2023-10-25T16:15:49.909 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:15:49.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:15:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 -- 172.21.15.177:0/2104094163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c00ccf80 msgr2=0x7f94c00cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 --2- 172.21.15.177:0/2104094163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c00ccf80 0x7f94c00cbb90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009840 tx=0x7f94b401c740 comp rx=0 tx=0).stop 2023-10-25T16:15:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 -- 172.21.15.177:0/2104094163 shutdown_connections 2023-10-25T16:15:50.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 --2- 172.21.15.177:0/2104094163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c00cc270 0x7f94c00c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 --2- 172.21.15.177:0/2104094163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c00ccf80 0x7f94c00cbb90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 -- 172.21.15.177:0/2104094163 >> 172.21.15.177:0/2104094163 conn(0x7f94c00caa40 msgr2=0x7f94c00cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 -- 172.21.15.177:0/2104094163 shutdown_connections 2023-10-25T16:15:50.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.034+0000 7f94c7853640 1 -- 172.21.15.177:0/2104094163 wait complete. 2023-10-25T16:15:50.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 Processor -- start 2023-10-25T16:15:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- start start 2023-10-25T16:15:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c00cc270 0x7f94c015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c00ccf80 0x7f94c01489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:50.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 0x7f94c01588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c01616b0 con 0x7f94c01583c0 2023-10-25T16:15:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0148ef0 con 0x7f94c00cc270 2023-10-25T16:15:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c006b2a0 con 0x7f94c00ccf80 2023-10-25T16:15:50.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 0x7f94c01588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 0x7f94c01588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36666/0 (socket says 172.21.15.177:36666) 2023-10-25T16:15:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 -- 172.21.15.177:0/1886089311 learned_addr learned my addr 172.21.15.177:0/1886089311 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c4dee640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c00ccf80 0x7f94c01489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:50.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 -- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c00ccf80 msgr2=0x7f94c01489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c00ccf80 0x7f94c01489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 -- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c00cc270 msgr2=0x7f94c015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c55ef640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c00cc270 0x7f94c015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c00cc270 0x7f94c015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 -- 172.21.15.177:0/1886089311 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40094a0 con 0x7f94c01583c0 2023-10-25T16:15:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c55ef640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c00cc270 0x7f94c015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c5df0640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 0x7f94c01588a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b970 tx=0x7f94b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000cb40 con 0x7f94c01583c0 2023-10-25T16:15:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94b000cdb0 con 0x7f94c01583c0 2023-10-25T16:15:50.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c006ace0 con 0x7f94c01583c0 2023-10-25T16:15:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00146a0 con 0x7f94c01583c0 2023-10-25T16:15:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c0161340 con 0x7f94c01583c0 2023-10-25T16:15:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c0073360 con 0x7f94c01583c0 2023-10-25T16:15:50.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.038+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94b001d3b0 con 0x7f94c01583c0 2023-10-25T16:15:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.042+0000 7f94bdffb640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.042+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94b0083d10 con 0x7f94c01583c0 2023-10-25T16:15:50.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.042+0000 7f94c55ef640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:50.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.042+0000 7f94c55ef640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f94b8000f70 tx=0x7f94b8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:50.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.046+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94b00514e0 con 0x7f94c01583c0 2023-10-25T16:15:50.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.198+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f94c00b3f40 con 0x7f94c01583c0 2023-10-25T16:15:50.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.918+0000 7f94bdffb640 1 -- 172.21.15.177:0/1886089311 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f94b0019020 con 0x7f94c01583c0 2023-10-25T16:15:50.925 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:15:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 msgr2=0x7f94ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f94b8000f70 tx=0x7f94b8009040 comp rx=0 tx=0).stop 2023-10-25T16:15:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 msgr2=0x7f94c01588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 0x7f94c01588a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b970 tx=0x7f94b000be30 comp rx=0 tx=0).stop 2023-10-25T16:15:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 shutdown_connections 2023-10-25T16:15:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94c01583c0 0x7f94c01588a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c00ccf80 0x7f94c01489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 --2- 172.21.15.177:0/1886089311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c00cc270 0x7f94c015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:50.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.922+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 >> 172.21.15.177:0/1886089311 conn(0x7f94c00caa40 msgr2=0x7f94c00ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:50.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.926+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 shutdown_connections 2023-10-25T16:15:50.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:50.926+0000 7f94c7853640 1 -- 172.21.15.177:0/1886089311 wait complete. 2023-10-25T16:15:50.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:15:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 -- 172.21.15.177:0/2646604596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c15fcb0 msgr2=0x7ff02c0cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 --2- 172.21.15.177:0/2646604596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c15fcb0 0x7ff02c0cfb50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff014009900 tx=0x7ff01401c7c0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 -- 172.21.15.177:0/2646604596 shutdown_connections 2023-10-25T16:15:51.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 --2- 172.21.15.177:0/2646604596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff02c0d11e0 0x7ff02c0d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 --2- 172.21.15.177:0/2646604596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c15fcb0 0x7ff02c0cfb50 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 -- 172.21.15.177:0/2646604596 >> 172.21.15.177:0/2646604596 conn(0x7ff02c0661e0 msgr2=0x7ff02c09a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 -- 172.21.15.177:0/2646604596 shutdown_connections 2023-10-25T16:15:51.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.090+0000 7ff030a17640 1 -- 172.21.15.177:0/2646604596 wait complete. 2023-10-25T16:15:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 Processor -- start 2023-10-25T16:15:51.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- start start 2023-10-25T16:15:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 0x7ff02c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff02c15b4e0 0x7ff02c154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff02c15fcb0 0x7ff02c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c14ba70 con 0x7ff02c0d11e0 2023-10-25T16:15:51.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c1481c0 con 0x7ff02c15fcb0 2023-10-25T16:15:51.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c156410 con 0x7ff02c15b4e0 2023-10-25T16:15:51.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 0x7ff02c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:51.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 0x7ff02c158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47722/0 (socket says 172.21.15.177:47722) 2023-10-25T16:15:51.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 -- 172.21.15.177:0/2087837512 learned_addr learned my addr 172.21.15.177:0/2087837512 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:51.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff023fff640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff02c15b4e0 0x7ff02c154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:51.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02ad9d640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff02c15fcb0 0x7ff02c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:51.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 -- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff02c15b4e0 msgr2=0x7ff02c154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:51.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff02c15b4e0 0x7ff02c154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 -- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff02c15fcb0 msgr2=0x7ff02c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:51.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff02c15fcb0 0x7ff02c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 -- 172.21.15.177:0/2087837512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009560 con 0x7ff02c0d11e0 2023-10-25T16:15:51.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff02a59c640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 0x7ff02c158da0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c450 tx=0x7ff01c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:51.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c012830 con 0x7ff02c0d11e0 2023-10-25T16:15:51.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff01c012aa0 con 0x7ff02c0d11e0 2023-10-25T16:15:51.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c1566f0 con 0x7ff02c0d11e0 2023-10-25T16:15:51.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c011380 con 0x7ff02c0d11e0 2023-10-25T16:15:51.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c156cb0 con 0x7ff02c0d11e0 2023-10-25T16:15:51.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c04db20 con 0x7ff02c0d11e0 2023-10-25T16:15:51.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.094+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff01c0114e0 con 0x7ff02c0d11e0 2023-10-25T16:15:51.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.098+0000 7ff022ffd640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff00c066470 0x7ff00c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:51.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.098+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff01c083d20 con 0x7ff02c0d11e0 2023-10-25T16:15:51.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.098+0000 7ff023fff640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff00c066470 0x7ff00c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:51.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.098+0000 7ff023fff640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff00c066470 0x7ff00c068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff0140af000 tx=0x7ff01401b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:51.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.102+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff01c051410 con 0x7ff02c0d11e0 2023-10-25T16:15:51.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.242+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff02c0b0d80 con 0x7ff02c0d11e0 2023-10-25T16:15:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.938+0000 7ff022ffd640 1 -- 172.21.15.177:0/2087837512 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff01c054a30 con 0x7ff02c0d11e0 2023-10-25T16:15:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:15:51.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff00c066470 msgr2=0x7ff00c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:51.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff00c066470 0x7ff00c068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff0140af000 tx=0x7ff01401b000 comp rx=0 tx=0).stop 2023-10-25T16:15:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 msgr2=0x7ff02c158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 0x7ff02c158da0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00c450 tx=0x7ff01c00c910 comp rx=0 tx=0).stop 2023-10-25T16:15:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 shutdown_connections 2023-10-25T16:15:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff00c066470 0x7ff00c068930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff02c15fcb0 0x7ff02c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff02c15b4e0 0x7ff02c154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 --2- 172.21.15.177:0/2087837512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02c0d11e0 0x7ff02c158da0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 >> 172.21.15.177:0/2087837512 conn(0x7ff02c0661e0 msgr2=0x7ff02c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 shutdown_connections 2023-10-25T16:15:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:51.942+0000 7ff030a17640 1 -- 172.21.15.177:0/2087837512 wait complete. 2023-10-25T16:15:51.975 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:15:52.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- 172.21.15.177:0/3591511598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b415bc70 msgr2=0x7f49b415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 --2- 172.21.15.177:0/3591511598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b415bc70 0x7f49b415c0b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009900 tx=0x7f49a801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- 172.21.15.177:0/3591511598 shutdown_connections 2023-10-25T16:15:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 --2- 172.21.15.177:0/3591511598 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b40cb710 0x7f49b40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 --2- 172.21.15.177:0/3591511598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b415bc70 0x7f49b415c0b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- 172.21.15.177:0/3591511598 >> 172.21.15.177:0/3591511598 conn(0x7f49b40cd6b0 msgr2=0x7f49b40cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:52.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- 172.21.15.177:0/3591511598 shutdown_connections 2023-10-25T16:15:52.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- 172.21.15.177:0/3591511598 wait complete. 2023-10-25T16:15:52.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 Processor -- start 2023-10-25T16:15:52.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- start start 2023-10-25T16:15:52.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 0x7f49b4145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:52.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b414f1e0 0x7f49b4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:52.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415bc70 0x7f49b406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:52.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b41579a0 con 0x7f49b40cb710 2023-10-25T16:15:52.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4152440 con 0x7f49b414f1e0 2023-10-25T16:15:52.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b9710640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b4157c60 con 0x7f49b415bc70 2023-10-25T16:15:52.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 0x7f49b4145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:52.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 0x7f49b4145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47744/0 (socket says 172.21.15.177:47744) 2023-10-25T16:15:52.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 -- 172.21.15.177:0/3951174111 learned_addr learned my addr 172.21.15.177:0/3951174111 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:52.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b27fc640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b414f1e0 0x7f49b4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:52.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b37fe640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415bc70 0x7f49b406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:52.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 -- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415bc70 msgr2=0x7f49b406fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:52.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415bc70 0x7f49b406fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 -- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b414f1e0 msgr2=0x7f49b4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:52.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b414f1e0 0x7f49b4151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.098+0000 7f49b2ffd640 1 -- 172.21.15.177:0/3951174111 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009560 con 0x7f49b40cb710 2023-10-25T16:15:52.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f49b2ffd640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 0x7f49b4145140 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c490 tx=0x7f49a4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:52.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4003600 con 0x7f49b40cb710 2023-10-25T16:15:52.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f49a4003780 con 0x7f49b40cb710 2023-10-25T16:15:52.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4003bd0 con 0x7f49b40cb710 2023-10-25T16:15:52.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b4157f40 con 0x7f49b40cb710 2023-10-25T16:15:52.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b4145680 con 0x7f49b40cb710 2023-10-25T16:15:52.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b40ccec0 con 0x7f49b40cb710 2023-10-25T16:15:52.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f49a4003d30 con 0x7f49b40cb710 2023-10-25T16:15:52.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f499b7fe640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f49a0066470 0x7f49a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:52.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f49a40830a0 con 0x7f49b40cb710 2023-10-25T16:15:52.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f49b27fc640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f49a0066470 0x7f49a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:52.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.102+0000 7f49b27fc640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f49a0066470 0x7f49a0068930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49a80af000 tx=0x7f49a801b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:52.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.106+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f49a4050610 con 0x7f49b40cb710 2023-10-25T16:15:52.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.294+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f49b404dad0 con 0x7f49b40cb710 2023-10-25T16:15:52.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.942+0000 7f499b7fe640 1 -- 172.21.15.177:0/3951174111 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7f49a4053c30 con 0x7f49b40cb710 2023-10-25T16:15:52.946 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 8 and data pool 9 2023-10-25T16:15:52.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f49a0066470 msgr2=0x7f49a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:52.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f49a0066470 0x7f49a0068930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49a80af000 tx=0x7f49a801b030 comp rx=0 tx=0).stop 2023-10-25T16:15:52.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 msgr2=0x7f49b4145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:52.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 0x7f49b4145140 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f49a400c490 tx=0x7f49a4001e80 comp rx=0 tx=0).stop 2023-10-25T16:15:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 shutdown_connections 2023-10-25T16:15:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f49a0066470 0x7f49a0068930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b415bc70 0x7f49b406fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b414f1e0 0x7f49b4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 --2- 172.21.15.177:0/3951174111 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49b40cb710 0x7f49b4145140 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:52.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 >> 172.21.15.177:0/3951174111 conn(0x7f49b40cd6b0 msgr2=0x7f49b415a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:52.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 shutdown_connections 2023-10-25T16:15:52.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:52.946+0000 7f49b9710640 1 -- 172.21.15.177:0/3951174111 wait complete. 2023-10-25T16:15:52.975 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:53.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/1838729391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb40af5d0 msgr2=0x7f9cb413b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/1838729391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb40af5d0 0x7f9cb413b860 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009920 tx=0x7f9ca401c830 comp rx=0 tx=0).stop 2023-10-25T16:15:53.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/1838729391 shutdown_connections 2023-10-25T16:15:53.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/1838729391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb40af5d0 0x7f9cb413b860 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/1838729391 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 0x7f9cb413d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/1838729391 >> 172.21.15.177:0/1838729391 conn(0x7f9cb40b2450 msgr2=0x7f9cb40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:53.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/1838729391 shutdown_connections 2023-10-25T16:15:53.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/1838729391 wait complete. 2023-10-25T16:15:53.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 Processor -- start 2023-10-25T16:15:53.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- start start 2023-10-25T16:15:53.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb40af5d0 0x7f9cb41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 0x7f9cb40ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 0x7f9cb40abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb41f7f30 con 0x7f9cb413bda0 2023-10-25T16:15:53.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb40ae460 con 0x7f9cb40af5d0 2023-10-25T16:15:53.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4157e80 con 0x7f9cb415b710 2023-10-25T16:15:53.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 0x7f9cb40ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 0x7f9cb40ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47764/0 (socket says 172.21.15.177:47764) 2023-10-25T16:15:53.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 -- 172.21.15.177:0/3445366258 learned_addr learned my addr 172.21.15.177:0/3445366258 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:53.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cba682640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 0x7f9cb40abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 -- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 msgr2=0x7f9cb40abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9e81640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb40af5d0 0x7f9cb41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 0x7f9cb40abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 -- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb40af5d0 msgr2=0x7f9cb41574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb40af5d0 0x7f9cb41574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 -- 172.21.15.177:0/3445366258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009500 con 0x7f9cb413bda0 2023-10-25T16:15:53.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cba682640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 0x7f9cb40abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:53.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cb9680640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 0x7f9cb40ab570 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4000c10 tx=0x7f9ca4005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:53.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40a58b0 con 0x7f9cb413bda0 2023-10-25T16:15:53.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ca40038f0 con 0x7f9cb413bda0 2023-10-25T16:15:53.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4003d00 con 0x7f9cb413bda0 2023-10-25T16:15:53.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb4157a00 con 0x7f9cb413bda0 2023-10-25T16:15:53.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.106+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb40adb30 con 0x7f9cb413bda0 2023-10-25T16:15:53.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.110+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb404daf0 con 0x7f9cb413bda0 2023-10-25T16:15:53.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.110+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ca40b4040 con 0x7f9cb413bda0 2023-10-25T16:15:53.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.110+0000 7f9caa7fc640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c98066470 0x7f9c98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.110+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ca411e640 con 0x7f9cb413bda0 2023-10-25T16:15:53.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.110+0000 7f9cb9e81640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c98066470 0x7f9c98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.110+0000 7f9cb9e81640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c98066470 0x7f9c98068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00058d0 tx=0x7f9cb0005bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:53.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.114+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ca40ebac0 con 0x7f9cb413bda0 2023-10-25T16:15:53.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.270+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cb40ca690 con 0x7f9cb413bda0 2023-10-25T16:15:53.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.270+0000 7f9caa7fc640 1 -- 172.21.15.177:0/3445366258 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16602 (secure 0 0 0) 0x7f9ca40b2090 con 0x7f9cb413bda0 2023-10-25T16:15:53.277 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:53.277 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":67,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:52.301599+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:53.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c98066470 msgr2=0x7f9c98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c98066470 0x7f9c98068930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00058d0 tx=0x7f9cb0005bd0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 msgr2=0x7f9cb40ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 0x7f9cb40ab570 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4000c10 tx=0x7f9ca4005e30 comp rx=0 tx=0).stop 2023-10-25T16:15:53.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 shutdown_connections 2023-10-25T16:15:53.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9c98066470 0x7f9c98068930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cb415b710 0x7f9cb40abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cb413bda0 0x7f9cb40ab570 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 --2- 172.21.15.177:0/3445366258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cb40af5d0 0x7f9cb41574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 >> 172.21.15.177:0/3445366258 conn(0x7f9cb40b2450 msgr2=0x7f9cb40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:53.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 shutdown_connections 2023-10-25T16:15:53.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.274+0000 7f9cbc0e5640 1 -- 172.21.15.177:0/3445366258 wait complete. 2023-10-25T16:15:53.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:53.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/3056229978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec003980 msgr2=0x7f9cec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 --2- 172.21.15.177:0/3056229978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9cec003980 0x7f9cec003da0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009b90 tx=0x7f9cf401d290 comp rx=0 tx=0).stop 2023-10-25T16:15:53.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 -- 172.21.15.177:0/3056229978 reap_dead start 2023-10-25T16:15:53.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/3056229978 shutdown_connections 2023-10-25T16:15:53.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/3056229978 >> 172.21.15.177:0/3056229978 conn(0x7f9d0409a5c0 msgr2=0x7f9d040d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:53.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/3056229978 shutdown_connections 2023-10-25T16:15:53.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/3056229978 wait complete. 2023-10-25T16:15:53.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 Processor -- start 2023-10-25T16:15:53.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- start start 2023-10-25T16:15:53.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d0414d750 0x7f9d041566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d040c7100 0x7f9d0415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 0x7f9d040c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0415aa90 con 0x7f9d0415a5e0 2023-10-25T16:15:53.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c6060 con 0x7f9d040c7100 2023-10-25T16:15:53.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c6340 con 0x7f9d0414d750 2023-10-25T16:15:53.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 0x7f9d040c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 0x7f9d040c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47780/0 (socket says 172.21.15.177:47780) 2023-10-25T16:15:53.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 -- 172.21.15.177:0/1969566282 learned_addr learned my addr 172.21.15.177:0/1969566282 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:53.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 -- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d0414d750 msgr2=0x7f9d041566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d0414d750 0x7f9d041566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 -- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d040c7100 msgr2=0x7f9d0415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d040c7100 0x7f9d0415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 -- 172.21.15.177:0/1969566282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040c6620 con 0x7f9d0415a5e0 2023-10-25T16:15:53.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d08cb5640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 0x7f9d040c4ca0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9d0406a0b0 tx=0x7f9cfc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:53.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004b30 con 0x7f9d0415a5e0 2023-10-25T16:15:53.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9cfc004c90 con 0x7f9d0415a5e0 2023-10-25T16:15:53.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d040c6900 con 0x7f9d0415a5e0 2023-10-25T16:15:53.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc003be0 con 0x7f9d0415a5e0 2023-10-25T16:15:53.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.414+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d041562a0 con 0x7f9d0415a5e0 2023-10-25T16:15:53.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.418+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d040d0310 con 0x7f9d0415a5e0 2023-10-25T16:15:53.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.418+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9cfc003d40 con 0x7f9d0415a5e0 2023-10-25T16:15:53.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.418+0000 7f9d00ff9640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9cf00664a0 0x7f9cf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.418+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cfc084610 con 0x7f9d0415a5e0 2023-10-25T16:15:53.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.418+0000 7f9d03fff640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9cf00664a0 0x7f9cf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.418+0000 7f9d03fff640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9cf00664a0 0x7f9cf0068960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40ae000 tx=0x7f9cec005800 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:53.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.422+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9cfc051b20 con 0x7f9d0415a5e0 2023-10-25T16:15:53.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.578+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d0404daf0 con 0x7f9d0415a5e0 2023-10-25T16:15:53.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d00ff9640 1 -- 172.21.15.177:0/1969566282 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16602 (secure 0 0 0) 0x7f9cfc055140 con 0x7f9d0415a5e0 2023-10-25T16:15:53.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:53.588 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":67,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:52.301599+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:53.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9cf00664a0 msgr2=0x7f9cf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9cf00664a0 0x7f9cf0068960 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40ae000 tx=0x7f9cec005800 comp rx=0 tx=0).stop 2023-10-25T16:15:53.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 msgr2=0x7f9d040c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 0x7f9d040c4ca0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9d0406a0b0 tx=0x7f9cfc00f3c0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 shutdown_connections 2023-10-25T16:15:53.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9cf00664a0 0x7f9cf0068960 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d0415a5e0 0x7f9d040c4ca0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d040c7100 0x7f9d0415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.582+0000 7f9d0a718640 1 --2- 172.21.15.177:0/1969566282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d0414d750 0x7f9d041566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.586+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 >> 172.21.15.177:0/1969566282 conn(0x7f9d0409a5c0 msgr2=0x7f9d0406bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:53.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.586+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 shutdown_connections 2023-10-25T16:15:53.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.586+0000 7f9d0a718640 1 -- 172.21.15.177:0/1969566282 wait complete. 2023-10-25T16:15:53.607 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:15:53.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 -- 172.21.15.177:0/2351383730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100cd5e0 msgr2=0x7f46100cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 --2- 172.21.15.177:0/2351383730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100cd5e0 0x7f46100cda70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f461006d540 tx=0x7f460801cd30 comp rx=0 tx=0).stop 2023-10-25T16:15:53.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 -- 172.21.15.177:0/2351383730 shutdown_connections 2023-10-25T16:15:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 --2- 172.21.15.177:0/2351383730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100cd5e0 0x7f46100cda70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 --2- 172.21.15.177:0/2351383730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46100afd80 0x7f46100ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 --2- 172.21.15.177:0/2351383730 >> v2:172.21.15.184:3300/0 conn(0x7f4610159210 0x7f46100ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 -- 172.21.15.177:0/2351383730 >> 172.21.15.177:0/2351383730 conn(0x7f4610097a40 msgr2=0x7f4610097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 -- 172.21.15.177:0/2351383730 shutdown_connections 2023-10-25T16:15:53.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.730+0000 7f4618601640 1 -- 172.21.15.177:0/2351383730 wait complete. 2023-10-25T16:15:53.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 Processor -- start 2023-10-25T16:15:53.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- start start 2023-10-25T16:15:53.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 0x7f46101475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46100cd5e0 0x7f46100b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4610159210 0x7f46100b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461015c6c0 con 0x7f46100afd80 2023-10-25T16:15:53.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46100b3820 con 0x7f4610159210 2023-10-25T16:15:53.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46100b3b00 con 0x7f46100cd5e0 2023-10-25T16:15:53.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 0x7f46101475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 0x7f46101475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47808/0 (socket says 172.21.15.177:47808) 2023-10-25T16:15:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 -- 172.21.15.177:0/2861166572 learned_addr learned my addr 172.21.15.177:0/2861166572 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 -- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46100cd5e0 msgr2=0x7f46100b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46100cd5e0 0x7f46100b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 -- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4610159210 msgr2=0x7f46100b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4610159210 0x7f46100b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 -- 172.21.15.177:0/2861166572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080098e0 con 0x7f46100afd80 2023-10-25T16:15:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f461639d640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 0x7f46101475b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f460c00c9f0 tx=0x7f460c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c007bb0 con 0x7f46100afd80 2023-10-25T16:15:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f460c007e00 con 0x7f46100afd80 2023-10-25T16:15:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46100b3de0 con 0x7f46100afd80 2023-10-25T16:15:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00f6b0 con 0x7f46100afd80 2023-10-25T16:15:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46100b43a0 con 0x7f46100afd80 2023-10-25T16:15:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46100b45c0 con 0x7f46100afd80 2023-10-25T16:15:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.734+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f460c00f810 con 0x7f46100afd80 2023-10-25T16:15:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.738+0000 7f4606ffd640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f4066470 0x7f45f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:53.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.738+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f460c084750 con 0x7f46100afd80 2023-10-25T16:15:53.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.738+0000 7f4615b9c640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f4066470 0x7f45f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:53.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.738+0000 7f4615b9c640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f4066470 0x7f45f4068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f46100b1b10 tx=0x7f4600005c10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:53.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.742+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f460c051bd0 con 0x7f46100afd80 2023-10-25T16:15:53.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.930+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46100b3570 con 0x7f46100afd80 2023-10-25T16:15:53.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.970+0000 7f4606ffd640 1 -- 172.21.15.177:0/2861166572 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f460c0551f0 con 0x7f46100afd80 2023-10-25T16:15:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f4066470 msgr2=0x7f45f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f4066470 0x7f45f4068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f46100b1b10 tx=0x7f4600005c10 comp rx=0 tx=0).stop 2023-10-25T16:15:53.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 msgr2=0x7f46101475b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:53.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 0x7f46101475b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f460c00c9f0 tx=0x7f460c00ceb0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 shutdown_connections 2023-10-25T16:15:53.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f4066470 0x7f45f4068930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4610159210 0x7f46100b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46100cd5e0 0x7f46100b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 --2- 172.21.15.177:0/2861166572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46100afd80 0x7f46101475b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 >> 172.21.15.177:0/2861166572 conn(0x7f4610097a40 msgr2=0x7f461006ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 shutdown_connections 2023-10-25T16:15:53.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:53.974+0000 7f4618601640 1 -- 172.21.15.177:0/2861166572 wait complete. 2023-10-25T16:15:53.996 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:15:53.997 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:15:54.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.114+0000 7f37087f0640 1 -- 172.21.15.177:0/2688565236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700140cf0 msgr2=0x7f37000af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:54.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.114+0000 7f37087f0640 1 --2- 172.21.15.177:0/2688565236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700140cf0 0x7f37000af5d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009900 tx=0x7f36fc01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.114+0000 7f37087f0640 1 -- 172.21.15.177:0/2688565236 shutdown_connections 2023-10-25T16:15:54.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.114+0000 7f37087f0640 1 --2- 172.21.15.177:0/2688565236 >> v2:172.21.15.184:3300/0 conn(0x7f370006f570 0x7f370006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.114+0000 7f37087f0640 1 --2- 172.21.15.177:0/2688565236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700140cf0 0x7f37000af5d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.114+0000 7f37087f0640 1 -- 172.21.15.177:0/2688565236 >> 172.21.15.177:0/2688565236 conn(0x7f37000b2450 msgr2=0x7f37000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:54.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- 172.21.15.177:0/2688565236 shutdown_connections 2023-10-25T16:15:54.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- 172.21.15.177:0/2688565236 wait complete. 2023-10-25T16:15:54.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 Processor -- start 2023-10-25T16:15:54.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- start start 2023-10-25T16:15:54.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 0x7f37001499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:54.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370006f570 0x7f370013b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:54.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700140cf0 0x7f370013be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700149f10 con 0x7f370006bf90 2023-10-25T16:15:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700140580 con 0x7f3700140cf0 2023-10-25T16:15:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370013d980 con 0x7f370006f570 2023-10-25T16:15:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 0x7f37001499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:54.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 0x7f37001499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47820/0 (socket says 172.21.15.177:47820) 2023-10-25T16:15:54.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 -- 172.21.15.177:0/847414689 learned_addr learned my addr 172.21.15.177:0/847414689 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:54.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f3706d8d640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700140cf0 0x7f370013be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:54.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f3705d8b640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370006f570 0x7f370013b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:54.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 -- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370006f570 msgr2=0x7f370013b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:54.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370006f570 0x7f370013b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 -- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700140cf0 msgr2=0x7f370013be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:54.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700140cf0 0x7f370013be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 -- 172.21.15.177:0/847414689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc009560 con 0x7f370006bf90 2023-10-25T16:15:54.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f370658c640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 0x7f37001499d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f36fc01aea0 tx=0x7f36fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:54.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc004430 con 0x7f370006bf90 2023-10-25T16:15:54.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f36fc005040 con 0x7f370006bf90 2023-10-25T16:15:54.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370013d6a0 con 0x7f370006bf90 2023-10-25T16:15:54.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc005430 con 0x7f370006bf90 2023-10-25T16:15:54.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370013fd80 con 0x7f370006bf90 2023-10-25T16:15:54.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.118+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370004daf0 con 0x7f370006bf90 2023-10-25T16:15:54.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.122+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f36fc005590 con 0x7f370006bf90 2023-10-25T16:15:54.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.122+0000 7f36f6ffd640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f36e4066470 0x7f36e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:54.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.122+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36fc0aa070 con 0x7f370006bf90 2023-10-25T16:15:54.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.122+0000 7f3705d8b640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f36e4066470 0x7f36e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:54.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.122+0000 7f3705d8b640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f36e4066470 0x7f36e4068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f37000ac8e0 tx=0x7f36f000a4c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:54.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.126+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f36fc0ec6b0 con 0x7f370006bf90 2023-10-25T16:15:54.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.306+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f370013f890 con 0x7f370006bf90 2023-10-25T16:15:54.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.982+0000 7f36f6ffd640 1 -- 172.21.15.177:0/847414689 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f36fc0efcd0 con 0x7f370006bf90 2023-10-25T16:15:54.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f36e4066470 msgr2=0x7f36e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:54.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f36e4066470 0x7f36e4068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f37000ac8e0 tx=0x7f36f000a4c0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 msgr2=0x7f37001499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:54.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 0x7f37001499d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f36fc01aea0 tx=0x7f36fc004040 comp rx=0 tx=0).stop 2023-10-25T16:15:54.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 shutdown_connections 2023-10-25T16:15:54.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f36e4066470 0x7f36e4068930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700140cf0 0x7f370013be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f370006f570 0x7f370013b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 --2- 172.21.15.177:0/847414689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f370006bf90 0x7f37001499d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:54.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 >> 172.21.15.177:0/847414689 conn(0x7f37000b2450 msgr2=0x7f37000c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:54.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 shutdown_connections 2023-10-25T16:15:54.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:54.986+0000 7f37087f0640 1 -- 172.21.15.177:0/847414689 wait complete. 2023-10-25T16:15:55.014 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:15:55.014 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:15:55.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/1416553472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798159230 msgr2=0x7f3798071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 --2- 172.21.15.177:0/1416553472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798159230 0x7f3798071500 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3788009840 tx=0x7f378801c790 comp rx=0 tx=0).stop 2023-10-25T16:15:55.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/1416553472 shutdown_connections 2023-10-25T16:15:55.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 --2- 172.21.15.177:0/1416553472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798159230 0x7f3798071500 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/1416553472 >> 172.21.15.177:0/1416553472 conn(0x7f37980b2450 msgr2=0x7f37980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:55.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/1416553472 shutdown_connections 2023-10-25T16:15:55.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/1416553472 wait complete. 2023-10-25T16:15:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 Processor -- start 2023-10-25T16:15:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- start start 2023-10-25T16:15:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f379806b980 0x7f37980adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 0x7f379814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3798159230 0x7f37981520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379814d190 con 0x7f3798070510 2023-10-25T16:15:55.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379814d470 con 0x7f3798159230 2023-10-25T16:15:55.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379814d750 con 0x7f379806b980 2023-10-25T16:15:55.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 0x7f379814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 0x7f379814e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47826/0 (socket says 172.21.15.177:47826) 2023-10-25T16:15:55.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 -- 172.21.15.177:0/4150115335 learned_addr learned my addr 172.21.15.177:0/4150115335 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:55.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379659c640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f379806b980 0x7f37980adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f3796d9d640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3798159230 0x7f37981520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 -- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f379806b980 msgr2=0x7f37980adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f379806b980 0x7f37980adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 -- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3798159230 msgr2=0x7f37981520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3798159230 0x7f37981520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 -- 172.21.15.177:0/4150115335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880094a0 con 0x7f3798070510 2023-10-25T16:15:55.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f3796d9d640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3798159230 0x7f37981520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:55.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378ffff640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 0x7f379814e230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f378000c400 tx=0x7f378000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:55.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37800054e0 con 0x7f3798070510 2023-10-25T16:15:55.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3780003600 con 0x7f3798070510 2023-10-25T16:15:55.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379814da30 con 0x7f3798070510 2023-10-25T16:15:55.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780003a30 con 0x7f3798070510 2023-10-25T16:15:55.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.138+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379814e770 con 0x7f3798070510 2023-10-25T16:15:55.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.142+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379814df50 con 0x7f3798070510 2023-10-25T16:15:55.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.142+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3780003b90 con 0x7f3798070510 2023-10-25T16:15:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.142+0000 7f378effd640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3778066470 0x7f3778068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.142+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3780083680 con 0x7f3798070510 2023-10-25T16:15:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.142+0000 7f379659c640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3778066470 0x7f3778068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.142+0000 7f379659c640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3778066470 0x7f3778068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f37880af000 tx=0x7f378801afd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.146+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f379814df50 con 0x7f3798070510 2023-10-25T16:15:55.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.318+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f379814df50 con 0x7f3798070510 2023-10-25T16:15:55.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.318+0000 7f378effd640 1 -- 172.21.15.177:0/4150115335 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f379814df50 con 0x7f3798070510 2023-10-25T16:15:55.323 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:55.324 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:15:55.324 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:15:55.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.318+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3778066470 msgr2=0x7f3778068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.318+0000 7f379cd89640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3778066470 0x7f3778068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f37880af000 tx=0x7f378801afd0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 msgr2=0x7f379814e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 0x7f379814e230 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f378000c400 tx=0x7f378000c8c0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 shutdown_connections 2023-10-25T16:15:55.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3778066470 0x7f3778068930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3798159230 0x7f37981520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3798070510 0x7f379814e230 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 --2- 172.21.15.177:0/4150115335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f379806b980 0x7f37980adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 >> 172.21.15.177:0/4150115335 conn(0x7f37980b2450 msgr2=0x7f37980b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:55.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 shutdown_connections 2023-10-25T16:15:55.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.322+0000 7f379cd89640 1 -- 172.21.15.177:0/4150115335 wait complete. 2023-10-25T16:15:55.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:15:55.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/2027915885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 msgr2=0x7f67600d1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 --2- 172.21.15.177:0/2027915885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f67600d1890 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6750009930 tx=0x7f675001c830 comp rx=0 tx=0).stop 2023-10-25T16:15:55.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/2027915885 shutdown_connections 2023-10-25T16:15:55.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 --2- 172.21.15.177:0/2027915885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67600cc9e0 0x7f67600cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 --2- 172.21.15.177:0/2027915885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f67600d1890 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/2027915885 >> 172.21.15.177:0/2027915885 conn(0x7f6760065f40 msgr2=0x7f676009a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:55.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/2027915885 shutdown_connections 2023-10-25T16:15:55.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/2027915885 wait complete. 2023-10-25T16:15:55.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 Processor -- start 2023-10-25T16:15:55.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- start start 2023-10-25T16:15:55.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67600cc9e0 0x7f67600ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f676014cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676015b590 0x7f676014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676015bfb0 con 0x7f67600d1420 2023-10-25T16:15:55.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600cb0e0 con 0x7f676015b590 2023-10-25T16:15:55.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676014d520 con 0x7f67600cc9e0 2023-10-25T16:15:55.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f676014cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f676014cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47848/0 (socket says 172.21.15.177:47848) 2023-10-25T16:15:55.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 -- 172.21.15.177:0/16308442 learned_addr learned my addr 172.21.15.177:0/16308442 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:55.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 -- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67600cc9e0 msgr2=0x7f67600ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67600cc9e0 0x7f67600ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 -- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676015b590 msgr2=0x7f676014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676015b590 0x7f676014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 -- 172.21.15.177:0/16308442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009560 con 0x7f67600d1420 2023-10-25T16:15:55.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6765b3c640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f676014cfe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f67500b0040 tx=0x7f67500a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:55.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750004340 con 0x7f67600d1420 2023-10-25T16:15:55.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6750003600 con 0x7f67600d1420 2023-10-25T16:15:55.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67600cab20 con 0x7f67600d1420 2023-10-25T16:15:55.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750003a10 con 0x7f67600d1420 2023-10-25T16:15:55.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.450+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676015bbd0 con 0x7f67600d1420 2023-10-25T16:15:55.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.454+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676015c0f0 con 0x7f67600d1420 2023-10-25T16:15:55.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.454+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f67500b4070 con 0x7f67600d1420 2023-10-25T16:15:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.454+0000 7f6756ffd640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6744066470 0x7f6744068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.454+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f675011e220 con 0x7f67600d1420 2023-10-25T16:15:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.454+0000 7f676633d640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6744066470 0x7f6744068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.454+0000 7f676633d640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6744066470 0x7f6744068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f675c000f70 tx=0x7f675c0079c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:55.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.458+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f676015c0f0 con 0x7f67600d1420 2023-10-25T16:15:55.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f676015c0f0 con 0x7f67600d1420 2023-10-25T16:15:55.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f6756ffd640 1 -- 172.21.15.177:0/16308442 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f676015c0f0 con 0x7f67600d1420 2023-10-25T16:15:55.615 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:55.615 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":68,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:15:53.594767+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:15:55.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6744066470 msgr2=0x7f6744068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6744066470 0x7f6744068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f675c000f70 tx=0x7f675c0079c0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 msgr2=0x7f676014cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f676014cfe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f67500b0040 tx=0x7f67500a5810 comp rx=0 tx=0).stop 2023-10-25T16:15:55.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 shutdown_connections 2023-10-25T16:15:55.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6744066470 0x7f6744068930 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f676015b590 0x7f676014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67600d1420 0x7f676014cfe0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 --2- 172.21.15.177:0/16308442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67600cc9e0 0x7f67600ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.610+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 >> 172.21.15.177:0/16308442 conn(0x7f6760065f40 msgr2=0x7f67600b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:55.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.614+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 shutdown_connections 2023-10-25T16:15:55.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.614+0000 7f67685a1640 1 -- 172.21.15.177:0/16308442 wait complete. 2023-10-25T16:15:55.633 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:15:55.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:15:55.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.750+0000 7f6b9d285640 1 -- 172.21.15.177:0/1303017844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 msgr2=0x7f6b980cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.750+0000 7f6b9d285640 1 --2- 172.21.15.177:0/1303017844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b980cdfd0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009bf0 tx=0x7f6b9001cb80 comp rx=0 tx=0).stop 2023-10-25T16:15:55.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.750+0000 7f6b9d285640 1 -- 172.21.15.177:0/1303017844 shutdown_connections 2023-10-25T16:15:55.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.750+0000 7f6b9d285640 1 --2- 172.21.15.177:0/1303017844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b980cdfd0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.750+0000 7f6b9d285640 1 --2- 172.21.15.177:0/1303017844 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b980cff00 0x7f6b980cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.750+0000 7f6b9d285640 1 -- 172.21.15.177:0/1303017844 >> 172.21.15.177:0/1303017844 conn(0x7f6b9809a570 msgr2=0x7f6b980d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:55.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- 172.21.15.177:0/1303017844 shutdown_connections 2023-10-25T16:15:55.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- 172.21.15.177:0/1303017844 wait complete. 2023-10-25T16:15:55.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 Processor -- start 2023-10-25T16:15:55.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- start start 2023-10-25T16:15:55.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b981525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b980cff00 0x7f6b98154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b9815b3a0 0x7f6b981509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980c94b0 con 0x7f6b980b6e10 2023-10-25T16:15:55.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980c96e0 con 0x7f6b980cff00 2023-10-25T16:15:55.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b98152b30 con 0x7f6b9815b3a0 2023-10-25T16:15:55.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b981525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b981525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47858/0 (socket says 172.21.15.177:47858) 2023-10-25T16:15:55.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 -- 172.21.15.177:0/3409988330 learned_addr learned my addr 172.21.15.177:0/3409988330 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:55.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b977fe640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b9815b3a0 0x7f6b981509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b967fc640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b980cff00 0x7f6b98154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 -- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b9815b3a0 msgr2=0x7f6b981509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b9815b3a0 0x7f6b981509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 -- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b980cff00 msgr2=0x7f6b98154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b980cff00 0x7f6b98154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 -- 172.21.15.177:0/3409988330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009820 con 0x7f6b980b6e10 2023-10-25T16:15:55.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b96ffd640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b981525f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800c390 tx=0x7f6b8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:55.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88004230 con 0x7f6b980b6e10 2023-10-25T16:15:55.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b880044a0 con 0x7f6b980b6e10 2023-10-25T16:15:55.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88003840 con 0x7f6b980b6e10 2023-10-25T16:15:55.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b98151d50 con 0x7f6b980b6e10 2023-10-25T16:15:55.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b98152310 con 0x7f6b980b6e10 2023-10-25T16:15:55.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.754+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b980c98e0 con 0x7f6b980b6e10 2023-10-25T16:15:55.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.758+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b880039a0 con 0x7f6b980b6e10 2023-10-25T16:15:55.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.758+0000 7f6b7f7fe640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b84066470 0x7f6b84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:55.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.758+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b88083630 con 0x7f6b980b6e10 2023-10-25T16:15:55.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.758+0000 7f6b967fc640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b84066470 0x7f6b84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:55.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.758+0000 7f6b967fc640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b84066470 0x7f6b84068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c005fd0 tx=0x7f6b8c005db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:55.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.762+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b980c98e0 con 0x7f6b980b6e10 2023-10-25T16:15:55.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.914+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b980c98b0 con 0x7f6b84066470 2023-10-25T16:15:55.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.934+0000 7f6b7f7fe640 1 -- 172.21.15.177:0/3409988330 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272414 (secure 0 0 0) 0x7f6b980c98b0 con 0x7f6b84066470 2023-10-25T16:15:55.941 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:55.944 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:15:55.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b84066470 msgr2=0x7f6b84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b84066470 0x7f6b84068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c005fd0 tx=0x7f6b8c005db0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 msgr2=0x7f6b981525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:55.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b981525f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800c390 tx=0x7f6b8800c850 comp rx=0 tx=0).stop 2023-10-25T16:15:55.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 shutdown_connections 2023-10-25T16:15:55.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b84066470 0x7f6b84068930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b9815b3a0 0x7f6b981509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b980cff00 0x7f6b98154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 --2- 172.21.15.177:0/3409988330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b980b6e10 0x7f6b981525f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:55.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 >> 172.21.15.177:0/3409988330 conn(0x7f6b9809a570 msgr2=0x7f6b9806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:55.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 shutdown_connections 2023-10-25T16:15:55.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:55.938+0000 7f6b9d285640 1 -- 172.21.15.177:0/3409988330 wait complete. 2023-10-25T16:15:55.961 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-10-25T16:15:54.662513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558796,"statfs":{"total":1600000000,"available":1596207415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001156"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-25T16:15:47.628686+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:15:47.628686+0000","last_peered":"2023-10-25T16:15:47.628686+0000","last_clean":"2023-10-25T16:15:47.628686+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:15:47.628686+0000","last_undegraded":"2023-10-25T16:15:47.628686+0000","last_fullsized":"2023-10-25T16:15:47.628686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:51.052641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.25600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93400000000000005,"5min":1.089,"15min":1.089},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.78500000000000003},"min":{"1min":0.47199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.91000000000000003,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.401,"5min":1.581,"15min":1.581},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.753},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.306,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3320000000000001,"5min":1.677,"15min":1.677},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.72999999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.256},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.198}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.149,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0109999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.3280000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1899999999999999,"5min":1.304,"15min":1.304},"last":1.121},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.4390000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.66900000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.036,"15min":1.0409999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.25,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.524},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.79900000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.367}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2470000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95499999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.115}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.872,"15min":0.85999999999999999},"min":{"1min":0.66900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.879,"15min":0.86899999999999999},"min":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1819999999999999,"5min":1.196,"15min":1.196},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.63200000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.175,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.98199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2629999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.413,"15min":1.413},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.72599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0620000000000001,"15min":1.056},"min":{"1min":0.76700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2509999999999999,"5min":1.895,"15min":1.895},"last":1.0409999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4339999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0329999999999999,"15min":1.0269999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.365,"15min":1.45},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.202,"5min":14.843,"15min":14.843},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.5189999999999999,"15min":1.6299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2410000000000001,"5min":16.439,"15min":16.439},"last":0.96799999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.4370000000000001,"15min":1.5289999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.153,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.92500000000000004,"15min":0.93799999999999994},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.119,"5min":1.226,"15min":1.226},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.95899999999999996,"15min":0.96299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2509999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.73599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.252},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.034,"5min":1.524,"15min":1.6060000000000001},"min":{"1min":0.66500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.365,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.629,"15min":1.73},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.288,"5min":15.904,"15min":15.904},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.6439999999999999,"15min":1.768},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.105,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.113}]},{"osd":6,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.5249999999999999,"15min":1.607},"min":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3009999999999999,"5min":14.567,"15min":14.567},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.73,"15min":1.8340000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4330000000000001,"5min":15.089,"15min":15.089},"last":1.077}]},{"osd":7,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.7629999999999999,"15min":1.895},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.423,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.2709999999999999,"15min":1.2969999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3939999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.05,"5min":1.262,"15min":1.262},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.95699999999999996,"15min":0.93799999999999994},"min":{"1min":0.86299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0580000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.419,"15min":1.419},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1799999999999999,"5min":1.369,"15min":1.369},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.91400000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.107}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.752},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0640000000000001,"15min":1.0629999999999999},"min":{"1min":0.753,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.151}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95099999999999996,"15min":0.94299999999999995},"min":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.872,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.436},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1,"5min":1.083,"15min":1.083},"last":0.63300000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0309999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.0569999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.86599999999999999,"15min":0.86099999999999999},"min":{"1min":0.65500000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.111,"5min":1.23,"15min":1.23},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.236,"5min":1.427,"15min":1.427},"last":0.874}]},{"osd":5,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.93600000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1399999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.369,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90000000000000002,"15min":0.90200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1990000000000001,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.99299999999999999,"15min":1.0109999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2390000000000001,"5min":1.663,"15min":1.663},"last":0.97999999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96499999999999997,"15min":0.96099999999999997},"min":{"1min":0.64900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3180000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.389,"15min":1.389},"last":1.052}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.38},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85999999999999999,"5min":1.423,"15min":1.423},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.69399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.698,"5min":12.698,"15min":12.698},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.107,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.721,"5min":12.721,"15min":12.721},"last":0.76100000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.331,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.02,"15min":1.024},"min":{"1min":0.68999999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.581,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.0740000000000001,"15min":0.97399999999999998},"min":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":14.776,"5min":14.776,"15min":14.776},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.0780000000000001,"15min":1.012},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":10.509,"5min":10.509,"15min":10.509},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.314,"5min":0.217,"15min":0.217},"max":{"1min":0.746,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.73299999999999998,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.95999999999999996,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.372,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80000000000000004,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.71199999999999997,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98799999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.161,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.103,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.139,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94099999999999995,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.103,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.97499999999999998},"min":{"1min":0.66200000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2350000000000001,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0740000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.3049999999999999,"15min":1.375},"min":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1819999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.323,"15min":1.393},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.119,"5min":11.622,"15min":11.622},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:15:55.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:15:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- 172.21.15.177:0/1523316641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 msgr2=0x7fdc9c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 --2- 172.21.15.177:0/1523316641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdc9c003da0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009ee0 tx=0x7fdca801d230 comp rx=0 tx=0).stop 2023-10-25T16:15:56.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb5cec640 1 -- 172.21.15.177:0/1523316641 reap_dead start 2023-10-25T16:15:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- 172.21.15.177:0/1523316641 shutdown_connections 2023-10-25T16:15:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- 172.21.15.177:0/1523316641 >> 172.21.15.177:0/1523316641 conn(0x7fdcb00b2450 msgr2=0x7fdcb00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- 172.21.15.177:0/1523316641 shutdown_connections 2023-10-25T16:15:56.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- 172.21.15.177:0/1523316641 wait complete. 2023-10-25T16:15:56.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 Processor -- start 2023-10-25T16:15:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- start start 2023-10-25T16:15:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdcb00ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb0157510 0x7fdcb0133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb0133780 0x7fdcb00ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb01f4cb0 con 0x7fdc9c003980 2023-10-25T16:15:56.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0138a10 con 0x7fdcb0133780 2023-10-25T16:15:56.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb774f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0138200 con 0x7fdcb0157510 2023-10-25T16:15:56.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb54eb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdcb00ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb54eb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdcb00ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47880/0 (socket says 172.21.15.177:47880) 2023-10-25T16:15:56.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.122+0000 7fdcb54eb640 1 -- 172.21.15.177:0/2134128301 learned_addr learned my addr 172.21.15.177:0/2134128301 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:56.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb54eb640 1 -- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb0157510 msgr2=0x7fdcb0133240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb54eb640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb0157510 0x7fdcb0133240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb54eb640 1 -- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb0133780 msgr2=0x7fdcb00ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb5cec640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb0133780 0x7fdcb00ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb54eb640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb0133780 0x7fdcb00ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb54eb640 1 -- 172.21.15.177:0/2134128301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0138450 con 0x7fdc9c003980 2023-10-25T16:15:56.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb54eb640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdcb00ac300 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdca801cca0 tx=0x7fdca8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:56.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca80054f0 con 0x7fdc9c003980 2023-10-25T16:15:56.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdca8005740 con 0x7fdc9c003980 2023-10-25T16:15:56.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb0138730 con 0x7fdc9c003980 2023-10-25T16:15:56.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca80b6410 con 0x7fdc9c003980 2023-10-25T16:15:56.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb00aad30 con 0x7fdc9c003980 2023-10-25T16:15:56.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb00aa8b0 con 0x7fdc9c003980 2023-10-25T16:15:56.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdca80b3070 con 0x7fdc9c003980 2023-10-25T16:15:56.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdca5ffb640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdc940664a0 0x7fdc94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdca811efb0 con 0x7fdc9c003980 2023-10-25T16:15:56.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb4cea640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdc940664a0 0x7fdc94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.126+0000 7fdcb4cea640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdc940664a0 0x7fdc94068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000c10 tx=0x7fdca0006ed0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:56.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.130+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdcb00aa8b0 con 0x7fdc9c003980 2023-10-25T16:15:56.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.274+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcb00aa8b0 con 0x7fdc940664a0 2023-10-25T16:15:56.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.294+0000 7fdca5ffb640 1 -- 172.21.15.177:0/2134128301 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272414 (secure 0 0 0) 0x7fdcb00aa8b0 con 0x7fdc940664a0 2023-10-25T16:15:56.299 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:56.302 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:15:56.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdc940664a0 msgr2=0x7fdc94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdc940664a0 0x7fdc94068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000c10 tx=0x7fdca0006ed0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 msgr2=0x7fdcb00ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdcb00ac300 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdca801cca0 tx=0x7fdca8005040 comp rx=0 tx=0).stop 2023-10-25T16:15:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 shutdown_connections 2023-10-25T16:15:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdc940664a0 0x7fdc94068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdcb0133780 0x7fdcb00ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdcb0157510 0x7fdcb0133240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 --2- 172.21.15.177:0/2134128301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc9c003980 0x7fdcb00ac300 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 >> 172.21.15.177:0/2134128301 conn(0x7fdcb00b2450 msgr2=0x7fdcb013c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 shutdown_connections 2023-10-25T16:15:56.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.298+0000 7fdcb774f640 1 -- 172.21.15.177:0/2134128301 wait complete. 2023-10-25T16:15:56.318 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-10-25T16:15:54.662513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558796,"statfs":{"total":1600000000,"available":1596207415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001156"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-25T16:15:47.628686+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:15:47.628686+0000","last_peered":"2023-10-25T16:15:47.628686+0000","last_clean":"2023-10-25T16:15:47.628686+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:15:47.628686+0000","last_undegraded":"2023-10-25T16:15:47.628686+0000","last_fullsized":"2023-10-25T16:15:47.628686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:51.052641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.25600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93400000000000005,"5min":1.089,"15min":1.089},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.78500000000000003},"min":{"1min":0.47199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.91000000000000003,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.401,"5min":1.581,"15min":1.581},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.753},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.306,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3320000000000001,"5min":1.677,"15min":1.677},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.72999999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.256},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.198}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.149,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0109999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.3280000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1899999999999999,"5min":1.304,"15min":1.304},"last":1.121},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.4390000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.66900000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.036,"15min":1.0409999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.25,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.524},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.79900000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.367}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2470000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95499999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.115}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.872,"15min":0.85999999999999999},"min":{"1min":0.66900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.879,"15min":0.86899999999999999},"min":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1819999999999999,"5min":1.196,"15min":1.196},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.63200000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.175,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.98199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2629999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.413,"15min":1.413},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.72599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0620000000000001,"15min":1.056},"min":{"1min":0.76700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2509999999999999,"5min":1.895,"15min":1.895},"last":1.0409999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4339999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0329999999999999,"15min":1.0269999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.365,"15min":1.45},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.202,"5min":14.843,"15min":14.843},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.5189999999999999,"15min":1.6299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2410000000000001,"5min":16.439,"15min":16.439},"last":0.96799999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.4370000000000001,"15min":1.5289999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.153,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.92500000000000004,"15min":0.93799999999999994},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.119,"5min":1.226,"15min":1.226},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.95899999999999996,"15min":0.96299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2509999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.73599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.252},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.034,"5min":1.524,"15min":1.6060000000000001},"min":{"1min":0.66500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.365,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.629,"15min":1.73},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.288,"5min":15.904,"15min":15.904},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.6439999999999999,"15min":1.768},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.105,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.113}]},{"osd":6,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.5249999999999999,"15min":1.607},"min":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3009999999999999,"5min":14.567,"15min":14.567},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.73,"15min":1.8340000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4330000000000001,"5min":15.089,"15min":15.089},"last":1.077}]},{"osd":7,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.7629999999999999,"15min":1.895},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.423,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.2709999999999999,"15min":1.2969999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3939999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.05,"5min":1.262,"15min":1.262},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.95699999999999996,"15min":0.93799999999999994},"min":{"1min":0.86299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0580000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.419,"15min":1.419},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1799999999999999,"5min":1.369,"15min":1.369},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.91400000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.107}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.752},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0640000000000001,"15min":1.0629999999999999},"min":{"1min":0.753,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.151}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95099999999999996,"15min":0.94299999999999995},"min":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.872,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.436},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1,"5min":1.083,"15min":1.083},"last":0.63300000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0309999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.0569999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.86599999999999999,"15min":0.86099999999999999},"min":{"1min":0.65500000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.111,"5min":1.23,"15min":1.23},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.236,"5min":1.427,"15min":1.427},"last":0.874}]},{"osd":5,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.93600000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1399999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.369,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90000000000000002,"15min":0.90200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1990000000000001,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.99299999999999999,"15min":1.0109999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2390000000000001,"5min":1.663,"15min":1.663},"last":0.97999999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96499999999999997,"15min":0.96099999999999997},"min":{"1min":0.64900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3180000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.389,"15min":1.389},"last":1.052}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.38},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85999999999999999,"5min":1.423,"15min":1.423},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.69399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.698,"5min":12.698,"15min":12.698},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.107,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.721,"5min":12.721,"15min":12.721},"last":0.76100000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.331,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.02,"15min":1.024},"min":{"1min":0.68999999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.581,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.0740000000000001,"15min":0.97399999999999998},"min":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":14.776,"5min":14.776,"15min":14.776},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.0780000000000001,"15min":1.012},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":10.509,"5min":10.509,"15min":10.509},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.314,"5min":0.217,"15min":0.217},"max":{"1min":0.746,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.73299999999999998,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.95999999999999996,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.372,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80000000000000004,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.71199999999999997,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98799999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.161,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.103,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.139,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94099999999999995,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.103,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.97499999999999998},"min":{"1min":0.66200000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2350000000000001,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0740000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.3049999999999999,"15min":1.375},"min":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1819999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.323,"15min":1.393},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.119,"5min":11.622,"15min":11.622},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:15:56.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:15:56.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/224217697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c004d10 msgr2=0x7f134c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 --2- 172.21.15.177:0/224217697 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f134c004d10 0x7f134c005190 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c260 tx=0x7f135c01cfc0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136a823640 1 -- 172.21.15.177:0/224217697 reap_dead start 2023-10-25T16:15:56.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/224217697 shutdown_connections 2023-10-25T16:15:56.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/224217697 >> 172.21.15.177:0/224217697 conn(0x7f13640b2450 msgr2=0x7f13640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:56.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/224217697 shutdown_connections 2023-10-25T16:15:56.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/224217697 wait complete. 2023-10-25T16:15:56.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 Processor -- start 2023-10-25T16:15:56.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- start start 2023-10-25T16:15:56.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13641419c0 0x7f13641458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 0x7f1364142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1364142980 0x7f1364144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364142e00 con 0x7f1364145e30 2023-10-25T16:15:56.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641463e0 con 0x7f13641419c0 2023-10-25T16:15:56.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13641466c0 con 0x7f1364142980 2023-10-25T16:15:56.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 0x7f1364142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 0x7f1364142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47896/0 (socket says 172.21.15.177:47896) 2023-10-25T16:15:56.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 -- 172.21.15.177:0/3018259766 learned_addr learned my addr 172.21.15.177:0/3018259766 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:56.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136a022640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13641419c0 0x7f13641458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 -- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1364142980 msgr2=0x7f1364144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136a823640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1364142980 0x7f1364144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1364142980 0x7f1364144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 -- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13641419c0 msgr2=0x7f13641458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13641419c0 0x7f13641458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 -- 172.21.15.177:0/3018259766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13641469a0 con 0x7f1364145e30 2023-10-25T16:15:56.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136a022640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13641419c0 0x7f13641458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:15:56.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1369821640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 0x7f1364142440 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f135800d750 tx=0x7f135800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:56.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358009bd0 con 0x7f1364145e30 2023-10-25T16:15:56.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1358009e40 con 0x7f1364145e30 2023-10-25T16:15:56.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1364146c80 con 0x7f1364145e30 2023-10-25T16:15:56.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358005280 con 0x7f1364145e30 2023-10-25T16:15:56.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13641f50c0 con 0x7f1364145e30 2023-10-25T16:15:56.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.470+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136404daf0 con 0x7f1364145e30 2023-10-25T16:15:56.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.474+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f13580053e0 con 0x7f1364145e30 2023-10-25T16:15:56.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.474+0000 7f1362ffd640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f13500664a0 0x7f1350068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.474+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1358083f60 con 0x7f1364145e30 2023-10-25T16:15:56.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.474+0000 7f136a022640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f13500664a0 0x7f1350068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.474+0000 7f136a022640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f13500664a0 0x7f1350068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e10 tx=0x7f13540093c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:56.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.478+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1358051470 con 0x7f1364145e30 2023-10-25T16:15:56.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.614+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f136414ebf0 con 0x7f13500664a0 2023-10-25T16:15:56.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f1362ffd640 1 -- 172.21.15.177:0/3018259766 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272414 (secure 0 0 0) 0x7f1354015070 con 0x7f13500664a0 2023-10-25T16:15:56.642 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:56.644 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:15:56.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f13500664a0 msgr2=0x7f1350068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f13500664a0 0x7f1350068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1354009e10 tx=0x7f13540093c0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 msgr2=0x7f1364142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 0x7f1364142440 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f135800d750 tx=0x7f135800dc10 comp rx=0 tx=0).stop 2023-10-25T16:15:56.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 shutdown_connections 2023-10-25T16:15:56.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f13500664a0 0x7f1350068960 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1364142980 0x7f1364144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1364145e30 0x7f1364142440 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 --2- 172.21.15.177:0/3018259766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13641419c0 0x7f13641458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 >> 172.21.15.177:0/3018259766 conn(0x7f13640b2450 msgr2=0x7f136406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:56.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 shutdown_connections 2023-10-25T16:15:56.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.638+0000 7f136c286640 1 -- 172.21.15.177:0/3018259766 wait complete. 2023-10-25T16:15:56.658 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-10-25T16:15:54.662513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558796,"statfs":{"total":1600000000,"available":1596207415,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001156"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:50.914031+0000","last_change":"2023-10-25T16:15:50.914031+0000","last_active":"2023-10-25T16:15:50.914031+0000","last_peered":"2023-10-25T16:15:50.914031+0000","last_clean":"2023-10-25T16:15:50.914031+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:50.914031+0000","last_undegraded":"2023-10-25T16:15:50.914031+0000","last_fullsized":"2023-10-25T16:15:50.914031+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-25T16:15:47.628686+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:15:47.628686+0000","last_peered":"2023-10-25T16:15:47.628686+0000","last_clean":"2023-10-25T16:15:47.628686+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:15:47.628686+0000","last_undegraded":"2023-10-25T16:15:47.628686+0000","last_fullsized":"2023-10-25T16:15:47.628686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:51.052641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.25600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93400000000000005,"5min":1.089,"15min":1.089},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.78500000000000003},"min":{"1min":0.47199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.91000000000000003,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.401,"5min":1.581,"15min":1.581},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.753},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.306,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3320000000000001,"5min":1.677,"15min":1.677},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.72999999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.256},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.198}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.149,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.0109999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":1.3280000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1899999999999999,"5min":1.304,"15min":1.304},"last":1.121},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.4390000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.66900000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.036,"15min":1.0409999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.25,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.524},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.79900000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.367}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2470000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95499999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.115}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.872,"15min":0.85999999999999999},"min":{"1min":0.66900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.476,"15min":1.476},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.879,"15min":0.86899999999999999},"min":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1819999999999999,"5min":1.196,"15min":1.196},"last":0.84999999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.63200000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.175,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.98199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2629999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.413,"15min":1.413},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.72599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0620000000000001,"15min":1.056},"min":{"1min":0.76700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2509999999999999,"5min":1.895,"15min":1.895},"last":1.0409999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4339999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0329999999999999,"15min":1.0269999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.91200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.365,"15min":1.45},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.202,"5min":14.843,"15min":14.843},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.5189999999999999,"15min":1.6299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2410000000000001,"5min":16.439,"15min":16.439},"last":0.96799999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.4370000000000001,"15min":1.5289999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.153,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.57099999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.92500000000000004,"15min":0.93799999999999994},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.119,"5min":1.226,"15min":1.226},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.95899999999999996,"15min":0.96299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2509999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.73599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.252},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.034,"5min":1.524,"15min":1.6060000000000001},"min":{"1min":0.66500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.365,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.629,"15min":1.73},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.288,"5min":15.904,"15min":15.904},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.6439999999999999,"15min":1.768},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.105,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.113}]},{"osd":6,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.5249999999999999,"15min":1.607},"min":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3009999999999999,"5min":14.567,"15min":14.567},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.73,"15min":1.8340000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4330000000000001,"5min":15.089,"15min":15.089},"last":1.077}]},{"osd":7,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.7629999999999999,"15min":1.895},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.423,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.2709999999999999,"15min":1.2969999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3939999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.042}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.47,"15min":1.47},"last":1},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.05,"5min":1.262,"15min":1.262},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.95699999999999996,"15min":0.93799999999999994},"min":{"1min":0.86299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0580000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.419,"15min":1.419},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1799999999999999,"5min":1.369,"15min":1.369},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.91400000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.107}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.752},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0640000000000001,"15min":1.0629999999999999},"min":{"1min":0.753,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.151}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95099999999999996,"15min":0.94299999999999995},"min":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.872,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.436},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1,"5min":1.083,"15min":1.083},"last":0.63300000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0309999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.0569999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.86599999999999999,"15min":0.86099999999999999},"min":{"1min":0.65500000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.111,"5min":1.23,"15min":1.23},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.236,"5min":1.427,"15min":1.427},"last":0.874}]},{"osd":5,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.93600000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1399999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.369,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90000000000000002,"15min":0.90200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1990000000000001,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.99299999999999999,"15min":1.0109999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2390000000000001,"5min":1.663,"15min":1.663},"last":0.97999999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96499999999999997,"15min":0.96099999999999997},"min":{"1min":0.64900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3180000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.389,"15min":1.389},"last":1.052}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194994,"statfs":{"total":200000000,"available":199674246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.38},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40799999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85999999999999999,"5min":1.423,"15min":1.423},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.69399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.698,"5min":12.698,"15min":12.698},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.107,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.721,"5min":12.721,"15min":12.721},"last":0.76100000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.331,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.02,"15min":1.024},"min":{"1min":0.68999999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.581,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.0740000000000001,"15min":0.97399999999999998},"min":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":14.776,"5min":14.776,"15min":14.776},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.0780000000000001,"15min":1.012},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":10.509,"5min":10.509,"15min":10.509},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":894,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194417,"statfs":{"total":200000000,"available":199083878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.314,"5min":0.217,"15min":0.217},"max":{"1min":0.746,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.73299999999999998,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.95999999999999996,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.372,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80000000000000004,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.71199999999999997,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98799999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.161,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.103,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.139,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94099999999999995,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.103,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.97499999999999998},"min":{"1min":0.66200000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2350000000000001,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0740000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.3049999999999999,"15min":1.375},"min":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1819999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.323,"15min":1.393},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.119,"5min":11.622,"15min":11.622},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:15:56.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-25T16:15:56.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-25T16:15:56.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-25T16:15:56.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-25T16:15:56.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-25T16:15:56.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-25T16:15:56.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-25T16:15:56.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-25T16:15:56.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-25T16:15:56.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-25T16:15:56.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-25T16:15:56.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-25T16:15:56.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-25T16:15:56.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-25T16:15:56.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-25T16:15:56.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-25T16:15:56.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-25T16:15:56.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-25T16:15:56.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-25T16:15:56.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-25T16:15:56.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-25T16:15:56.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-25T16:15:56.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-25T16:15:56.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-25T16:15:56.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-25T16:15:56.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-25T16:15:56.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-25T16:15:56.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-25T16:15:56.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-25T16:15:56.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-25T16:15:56.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-25T16:15:56.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-25T16:15:56.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-25T16:15:56.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-25T16:15:56.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-25T16:15:56.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-25T16:15:56.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-25T16:15:56.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-25T16:15:56.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-25T16:15:56.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-25T16:15:56.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-25T16:15:56.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-25T16:15:56.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-25T16:15:56.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-25T16:15:56.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-25T16:15:56.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-25T16:15:56.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-25T16:15:56.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-25T16:15:56.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-25T16:15:56.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-25T16:15:56.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-25T16:15:56.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-25T16:15:56.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-25T16:15:56.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-25T16:15:56.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-25T16:15:56.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-25T16:15:56.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-25T16:15:56.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-25T16:15:56.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-25T16:15:56.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-25T16:15:56.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-25T16:15:56.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-25T16:15:56.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-25T16:15:56.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-25T16:15:56.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-25T16:15:56.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-25T16:15:56.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-25T16:15:56.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-25T16:15:56.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-25T16:15:56.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-25T16:15:56.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-25T16:15:56.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-25T16:15:56.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-25T16:15:56.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-25T16:15:56.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-25T16:15:56.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-25T16:15:56.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-25T16:15:56.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-25T16:15:56.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-25T16:15:56.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-25T16:15:56.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-25T16:15:56.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-25T16:15:56.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-25T16:15:56.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-25T16:15:56.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-25T16:15:56.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-25T16:15:56.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-25T16:15:56.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-25T16:15:56.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-25T16:15:56.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-25T16:15:56.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-25T16:15:56.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-25T16:15:56.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-25T16:15:56.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-25T16:15:56.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-25T16:15:56.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:51.925371+0000', 'last_change': '2023-10-25T16:15:51.925371+0000', 'last_active': '2023-10-25T16:15:51.925371+0000', 'last_peered': '2023-10-25T16:15:51.925371+0000', 'last_clean': '2023-10-25T16:15:51.925371+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:51.925371+0000', 'last_undegraded': '2023-10-25T16:15:51.925371+0000', 'last_fullsized': '2023-10-25T16:15:51.925371+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:51.925371+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-25T16:15:56.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:15:50.914031+0000', 'last_change': '2023-10-25T16:15:50.914031+0000', 'last_active': '2023-10-25T16:15:50.914031+0000', 'last_peered': '2023-10-25T16:15:50.914031+0000', 'last_clean': '2023-10-25T16:15:50.914031+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:15:50.914031+0000', 'last_undegraded': '2023-10-25T16:15:50.914031+0000', 'last_fullsized': '2023-10-25T16:15:50.914031+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'last_clean_scrub_stamp': '2023-10-25T16:15:50.914031+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:15:56.743 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:15:56.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 -- 172.21.15.177:0/3811696853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00cdb10 msgr2=0x7f92b00cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 --2- 172.21.15.177:0/3811696853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00cdb10 0x7f92b00cdf80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f92b009f200 tx=0x7f92a801ccd0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 -- 172.21.15.177:0/3811696853 shutdown_connections 2023-10-25T16:15:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 --2- 172.21.15.177:0/3811696853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00cdb10 0x7f92b00cdf80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 --2- 172.21.15.177:0/3811696853 >> v2:172.21.15.184:3300/0 conn(0x7f92b00b2120 0x7f92b00b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 -- 172.21.15.177:0/3811696853 >> 172.21.15.177:0/3811696853 conn(0x7f92b009a5c0 msgr2=0x7f92b00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:56.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 -- 172.21.15.177:0/3811696853 shutdown_connections 2023-10-25T16:15:56.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.862+0000 7f92b82e1640 1 -- 172.21.15.177:0/3811696853 wait complete. 2023-10-25T16:15:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 Processor -- start 2023-10-25T16:15:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- start start 2023-10-25T16:15:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 0x7f92b0159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b00cdb10 0x7f92b00c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b015eba0 0x7f92b014f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b01598b0 con 0x7f92b00b2120 2023-10-25T16:15:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0151400 con 0x7f92b00cdb10 2023-10-25T16:15:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0159aa0 con 0x7f92b015eba0 2023-10-25T16:15:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 0x7f92b0159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 0x7f92b0159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47914/0 (socket says 172.21.15.177:47914) 2023-10-25T16:15:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 -- 172.21.15.177:0/2350206831 learned_addr learned my addr 172.21.15.177:0/2350206831 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 -- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b015eba0 msgr2=0x7f92b014f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b015eba0 0x7f92b014f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 -- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b00cdb10 msgr2=0x7f92b00c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b00cdb10 0x7f92b00c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 -- 172.21.15.177:0/2350206831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80098e0 con 0x7f92b00b2120 2023-10-25T16:15:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b607d640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 0x7f92b0159370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c450 tx=0x7f92ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac005480 con 0x7f92b00b2120 2023-10-25T16:15:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f92ac0036f0 con 0x7f92b00b2120 2023-10-25T16:15:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0159d80 con 0x7f92b00b2120 2023-10-25T16:15:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac003b00 con 0x7f92b00b2120 2023-10-25T16:15:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b015a340 con 0x7f92b00b2120 2023-10-25T16:15:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b004daf0 con 0x7f92b00b2120 2023-10-25T16:15:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92ac003c60 con 0x7f92b00b2120 2023-10-25T16:15:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92a6ffd640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9294066470 0x7f9294068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.866+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92ac0835c0 con 0x7f92b00b2120 2023-10-25T16:15:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.870+0000 7f92b587c640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9294066470 0x7f9294068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.870+0000 7f92b587c640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9294066470 0x7f9294068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f92b00c8430 tx=0x7f92a0006ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:56.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:56.870+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92ac050ad0 con 0x7f92b00b2120 2023-10-25T16:15:57.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.074+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f92b00d02d0 con 0x7f92b00b2120 2023-10-25T16:15:57.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.074+0000 7f92a6ffd640 1 -- 172.21.15.177:0/2350206831 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1243 (secure 0 0 0) 0x7f92ac0174f0 con 0x7f92b00b2120 2023-10-25T16:15:57.081 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:57.081 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"unknown","count":6}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":3948262,"bytes_avail":1596051738,"bytes_total":1600000000,"unknown_pgs_ratio":0.061855670064687729,"write_bytes_sec":2501,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6360}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-10-25T16:15:46.660250+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:15:57.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9294066470 msgr2=0x7f9294068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9294066470 0x7f9294068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f92b00c8430 tx=0x7f92a0006ca0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 msgr2=0x7f92b0159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 0x7f92b0159370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c450 tx=0x7f92ac00c910 comp rx=0 tx=0).stop 2023-10-25T16:15:57.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 shutdown_connections 2023-10-25T16:15:57.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9294066470 0x7f9294068930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92b015eba0 0x7f92b014f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b00cdb10 0x7f92b00c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 --2- 172.21.15.177:0/2350206831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92b00b2120 0x7f92b0159370 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 >> 172.21.15.177:0/2350206831 conn(0x7f92b009a5c0 msgr2=0x7f92b00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:57.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 shutdown_connections 2023-10-25T16:15:57.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.078+0000 7f92b82e1640 1 -- 172.21.15.177:0/2350206831 wait complete. 2023-10-25T16:15:57.098 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:15:57.098 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:15:57.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/782429337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89d4003f30 msgr2=0x7f89d40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 --2- 172.21.15.177:0/782429337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89d4003f30 0x7f89d40047d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f89e0006fb0 tx=0x7f89e001f720 comp rx=0 tx=0).stop 2023-10-25T16:15:57.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89eb59e640 1 -- 172.21.15.177:0/782429337 reap_dead start 2023-10-25T16:15:57.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/782429337 shutdown_connections 2023-10-25T16:15:57.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/782429337 >> 172.21.15.177:0/782429337 conn(0x7f89ec0b2450 msgr2=0x7f89ec0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:57.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/782429337 shutdown_connections 2023-10-25T16:15:57.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/782429337 wait complete. 2023-10-25T16:15:57.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 Processor -- start 2023-10-25T16:15:57.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- start start 2023-10-25T16:15:57.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d4003f30 0x7f89ec1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:57.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 0x7f89ec13d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:57.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89ec0adc60 0x7f89ec0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:57.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec13e650 con 0x7f89ec13aa00 2023-10-25T16:15:57.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0ae620 con 0x7f89d4003f30 2023-10-25T16:15:57.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec13d7a0 con 0x7f89ec0adc60 2023-10-25T16:15:57.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 0x7f89ec13d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:57.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 0x7f89ec13d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:47930/0 (socket says 172.21.15.177:47930) 2023-10-25T16:15:57.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 -- 172.21.15.177:0/3795721569 learned_addr learned my addr 172.21.15.177:0/3795721569 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:15:57.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89eb59e640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89ec0adc60 0x7f89ec0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:57.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 -- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89ec0adc60 msgr2=0x7f89ec0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ead9d640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d4003f30 0x7f89ec1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:57.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89ec0adc60 0x7f89ec0ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 -- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d4003f30 msgr2=0x7f89ec1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d4003f30 0x7f89ec1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 -- 172.21.15.177:0/3795721569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec13ae80 con 0x7f89ec13aa00 2023-10-25T16:15:57.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89ea59c640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 0x7f89ec13d260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f89e001f550 tx=0x7f89e0001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:57.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0006480 con 0x7f89ec13aa00 2023-10-25T16:15:57.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f89e0003600 con 0x7f89ec13aa00 2023-10-25T16:15:57.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec13d9d0 con 0x7f89ec13aa00 2023-10-25T16:15:57.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0003a10 con 0x7f89ec13aa00 2023-10-25T16:15:57.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.206+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec13df90 con 0x7f89ec13aa00 2023-10-25T16:15:57.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.210+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec13d020 con 0x7f89ec13aa00 2023-10-25T16:15:57.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.210+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f89e0003b70 con 0x7f89ec13aa00 2023-10-25T16:15:57.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.210+0000 7f89d37fe640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89d8066470 0x7f89d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:15:57.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.210+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89e0121760 con 0x7f89ec13aa00 2023-10-25T16:15:57.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.210+0000 7f89ead9d640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89d8066470 0x7f89d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:15:57.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.210+0000 7f89ead9d640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89d8066470 0x7f89d8068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89dc001650 tx=0x7f89dc006970 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:15:57.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.214+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f89e00eedb0 con 0x7f89ec13aa00 2023-10-25T16:15:57.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.362+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89ec141600 con 0x7f89d8066470 2023-10-25T16:15:57.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.382+0000 7f89d37fe640 1 -- 172.21.15.177:0/3795721569 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282845 (secure 0 0 0) 0x7f89dc00c050 con 0x7f89d8066470 2023-10-25T16:15:57.389 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:15:57.390 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:15:57.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89d8066470 msgr2=0x7f89d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89d8066470 0x7f89d8068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89dc001650 tx=0x7f89dc006970 comp rx=0 tx=0).stop 2023-10-25T16:15:57.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 msgr2=0x7f89ec13d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:15:57.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 0x7f89ec13d260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f89e001f550 tx=0x7f89e0001d50 comp rx=0 tx=0).stop 2023-10-25T16:15:57.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 shutdown_connections 2023-10-25T16:15:57.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89d8066470 0x7f89d8068930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89ec0adc60 0x7f89ec0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89ec13aa00 0x7f89ec13d260 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 --2- 172.21.15.177:0/3795721569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89d4003f30 0x7f89ec1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:15:57.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 >> 172.21.15.177:0/3795721569 conn(0x7f89ec0b2450 msgr2=0x7f89ec0cbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:15:57.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 shutdown_connections 2023-10-25T16:15:57.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:15:57.386+0000 7f89f1210640 1 -- 172.21.15.177:0/3795721569 wait complete. 2023-10-25T16:15:57.405 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2023-10-25T16:15:56.663079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558644,"statfs":{"total":1600000000,"available":1596051738,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.731265"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411086+0000","last_change":"2023-10-25T16:15:52.633180+0000","last_active":"2023-10-25T16:15:54.411086+0000","last_peered":"2023-10-25T16:15:54.411086+0000","last_clean":"2023-10-25T16:15:54.411086+0000","last_became_active":"2023-10-25T16:15:52.629761+0000","last_became_peered":"2023-10-25T16:15:52.629761+0000","last_unstale":"2023-10-25T16:15:54.411086+0000","last_undegraded":"2023-10-25T16:15:54.411086+0000","last_fullsized":"2023-10-25T16:15:54.411086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:32:04.069862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608566+0000","last_change":"2023-10-25T16:15:52.630997+0000","last_active":"2023-10-25T16:15:53.608566+0000","last_peered":"2023-10-25T16:15:53.608566+0000","last_clean":"2023-10-25T16:15:53.608566+0000","last_became_active":"2023-10-25T16:15:52.623947+0000","last_became_peered":"2023-10-25T16:15:52.623947+0000","last_unstale":"2023-10-25T16:15:53.608566+0000","last_undegraded":"2023-10-25T16:15:53.608566+0000","last_fullsized":"2023-10-25T16:15:53.608566+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:23.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613204+0000","last_change":"2023-10-25T16:15:52.637644+0000","last_active":"2023-10-25T16:15:53.613204+0000","last_peered":"2023-10-25T16:15:53.613204+0000","last_clean":"2023-10-25T16:15:53.613204+0000","last_became_active":"2023-10-25T16:15:52.634667+0000","last_became_peered":"2023-10-25T16:15:52.634667+0000","last_unstale":"2023-10-25T16:15:53.613204+0000","last_undegraded":"2023-10-25T16:15:53.613204+0000","last_fullsized":"2023-10-25T16:15:53.613204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:43:42.808534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054154+0000","last_change":"2023-10-25T16:15:52.623749+0000","last_active":"2023-10-25T16:15:54.054154+0000","last_peered":"2023-10-25T16:15:54.054154+0000","last_clean":"2023-10-25T16:15:54.054154+0000","last_became_active":"2023-10-25T16:15:52.619815+0000","last_became_peered":"2023-10-25T16:15:52.619815+0000","last_unstale":"2023-10-25T16:15:54.054154+0000","last_undegraded":"2023-10-25T16:15:54.054154+0000","last_fullsized":"2023-10-25T16:15:54.054154+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:18.600266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608538+0000","last_change":"2023-10-25T16:15:52.621036+0000","last_active":"2023-10-25T16:15:54.608538+0000","last_peered":"2023-10-25T16:15:54.608538+0000","last_clean":"2023-10-25T16:15:54.608538+0000","last_became_active":"2023-10-25T16:15:52.618289+0000","last_became_peered":"2023-10-25T16:15:52.618289+0000","last_unstale":"2023-10-25T16:15:54.608538+0000","last_undegraded":"2023-10-25T16:15:54.608538+0000","last_fullsized":"2023-10-25T16:15:54.608538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:39.208184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.410986+0000","last_change":"2023-10-25T16:15:52.610169+0000","last_active":"2023-10-25T16:15:54.410986+0000","last_peered":"2023-10-25T16:15:54.410986+0000","last_clean":"2023-10-25T16:15:54.410986+0000","last_became_active":"2023-10-25T16:15:52.609179+0000","last_became_peered":"2023-10-25T16:15:52.609179+0000","last_unstale":"2023-10-25T16:15:54.410986+0000","last_undegraded":"2023-10-25T16:15:54.410986+0000","last_fullsized":"2023-10-25T16:15:54.410986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:07.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608607+0000","last_change":"2023-10-25T16:15:52.621750+0000","last_active":"2023-10-25T16:15:54.608607+0000","last_peered":"2023-10-25T16:15:54.608607+0000","last_clean":"2023-10-25T16:15:54.608607+0000","last_became_active":"2023-10-25T16:15:52.620222+0000","last_became_peered":"2023-10-25T16:15:52.620222+0000","last_unstale":"2023-10-25T16:15:54.608607+0000","last_undegraded":"2023-10-25T16:15:54.608607+0000","last_fullsized":"2023-10-25T16:15:54.608607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:39.385889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607376+0000","last_change":"2023-10-25T16:15:52.628202+0000","last_active":"2023-10-25T16:15:54.607376+0000","last_peered":"2023-10-25T16:15:54.607376+0000","last_clean":"2023-10-25T16:15:54.607376+0000","last_became_active":"2023-10-25T16:15:52.625378+0000","last_became_peered":"2023-10-25T16:15:52.625378+0000","last_unstale":"2023-10-25T16:15:54.607376+0000","last_undegraded":"2023-10-25T16:15:54.607376+0000","last_fullsized":"2023-10-25T16:15:54.607376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:46.208801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607510+0000","last_change":"2023-10-25T16:15:52.632680+0000","last_active":"2023-10-25T16:15:54.607510+0000","last_peered":"2023-10-25T16:15:54.607510+0000","last_clean":"2023-10-25T16:15:54.607510+0000","last_became_active":"2023-10-25T16:15:52.630875+0000","last_became_peered":"2023-10-25T16:15:52.630875+0000","last_unstale":"2023-10-25T16:15:54.607510+0000","last_undegraded":"2023-10-25T16:15:54.607510+0000","last_fullsized":"2023-10-25T16:15:54.607510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:58:09.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612556+0000","last_change":"2023-10-25T16:15:52.619637+0000","last_active":"2023-10-25T16:15:53.612556+0000","last_peered":"2023-10-25T16:15:53.612556+0000","last_clean":"2023-10-25T16:15:53.612556+0000","last_became_active":"2023-10-25T16:15:52.618750+0000","last_became_peered":"2023-10-25T16:15:52.618750+0000","last_unstale":"2023-10-25T16:15:53.612556+0000","last_undegraded":"2023-10-25T16:15:53.612556+0000","last_fullsized":"2023-10-25T16:15:53.612556+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:37:51.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609442+0000","last_change":"2023-10-25T16:15:52.636202+0000","last_active":"2023-10-25T16:15:54.609442+0000","last_peered":"2023-10-25T16:15:54.609442+0000","last_clean":"2023-10-25T16:15:54.609442+0000","last_became_active":"2023-10-25T16:15:52.635564+0000","last_became_peered":"2023-10-25T16:15:52.635564+0000","last_unstale":"2023-10-25T16:15:54.609442+0000","last_undegraded":"2023-10-25T16:15:54.609442+0000","last_fullsized":"2023-10-25T16:15:54.609442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:58:09.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608952+0000","last_change":"2023-10-25T16:15:52.619148+0000","last_active":"2023-10-25T16:15:54.608952+0000","last_peered":"2023-10-25T16:15:54.608952+0000","last_clean":"2023-10-25T16:15:54.608952+0000","last_became_active":"2023-10-25T16:15:52.618503+0000","last_became_peered":"2023-10-25T16:15:52.618503+0000","last_unstale":"2023-10-25T16:15:54.608952+0000","last_undegraded":"2023-10-25T16:15:54.608952+0000","last_fullsized":"2023-10-25T16:15:54.608952+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:51.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609937+0000","last_change":"2023-10-25T16:15:52.626421+0000","last_active":"2023-10-25T16:15:54.609937+0000","last_peered":"2023-10-25T16:15:54.609937+0000","last_clean":"2023-10-25T16:15:54.609937+0000","last_became_active":"2023-10-25T16:15:52.625329+0000","last_became_peered":"2023-10-25T16:15:52.625329+0000","last_unstale":"2023-10-25T16:15:54.609937+0000","last_undegraded":"2023-10-25T16:15:54.609937+0000","last_fullsized":"2023-10-25T16:15:54.609937+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:47.215706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054432+0000","last_change":"2023-10-25T16:15:52.623214+0000","last_active":"2023-10-25T16:15:54.054432+0000","last_peered":"2023-10-25T16:15:54.054432+0000","last_clean":"2023-10-25T16:15:54.054432+0000","last_became_active":"2023-10-25T16:15:52.617066+0000","last_became_peered":"2023-10-25T16:15:52.617066+0000","last_unstale":"2023-10-25T16:15:54.054432+0000","last_undegraded":"2023-10-25T16:15:54.054432+0000","last_fullsized":"2023-10-25T16:15:54.054432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:31:06.060784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411426+0000","last_change":"2023-10-25T16:15:52.633896+0000","last_active":"2023-10-25T16:15:54.411426+0000","last_peered":"2023-10-25T16:15:54.411426+0000","last_clean":"2023-10-25T16:15:54.411426+0000","last_became_active":"2023-10-25T16:15:52.631844+0000","last_became_peered":"2023-10-25T16:15:52.631844+0000","last_unstale":"2023-10-25T16:15:54.411426+0000","last_undegraded":"2023-10-25T16:15:54.411426+0000","last_fullsized":"2023-10-25T16:15:54.411426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:53.598179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608912+0000","last_change":"2023-10-25T16:15:52.639923+0000","last_active":"2023-10-25T16:15:53.608912+0000","last_peered":"2023-10-25T16:15:53.608912+0000","last_clean":"2023-10-25T16:15:53.608912+0000","last_became_active":"2023-10-25T16:15:52.638398+0000","last_became_peered":"2023-10-25T16:15:52.638398+0000","last_unstale":"2023-10-25T16:15:53.608912+0000","last_undegraded":"2023-10-25T16:15:53.608912+0000","last_fullsized":"2023-10-25T16:15:53.608912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:43:42.808534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411210+0000","last_change":"2023-10-25T16:15:52.621912+0000","last_active":"2023-10-25T16:15:54.411210+0000","last_peered":"2023-10-25T16:15:54.411210+0000","last_clean":"2023-10-25T16:15:54.411210+0000","last_became_active":"2023-10-25T16:15:52.621222+0000","last_became_peered":"2023-10-25T16:15:52.621222+0000","last_unstale":"2023-10-25T16:15:54.411210+0000","last_undegraded":"2023-10-25T16:15:54.411210+0000","last_fullsized":"2023-10-25T16:15:54.411210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:40.576681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608346+0000","last_change":"2023-10-25T16:15:52.637113+0000","last_active":"2023-10-25T16:15:53.608346+0000","last_peered":"2023-10-25T16:15:53.608346+0000","last_clean":"2023-10-25T16:15:53.608346+0000","last_became_active":"2023-10-25T16:15:52.636597+0000","last_became_peered":"2023-10-25T16:15:52.636597+0000","last_unstale":"2023-10-25T16:15:53.608346+0000","last_undegraded":"2023-10-25T16:15:53.608346+0000","last_fullsized":"2023-10-25T16:15:53.608346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:24:17.091019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411748+0000","last_change":"2023-10-25T16:15:52.607996+0000","last_active":"2023-10-25T16:15:54.411748+0000","last_peered":"2023-10-25T16:15:54.411748+0000","last_clean":"2023-10-25T16:15:54.411748+0000","last_became_active":"2023-10-25T16:15:52.607376+0000","last_became_peered":"2023-10-25T16:15:52.607376+0000","last_unstale":"2023-10-25T16:15:54.411748+0000","last_undegraded":"2023-10-25T16:15:54.411748+0000","last_fullsized":"2023-10-25T16:15:54.411748+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:11.394146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609108+0000","last_change":"2023-10-25T16:15:52.639207+0000","last_active":"2023-10-25T16:15:53.609108+0000","last_peered":"2023-10-25T16:15:53.609108+0000","last_clean":"2023-10-25T16:15:53.609108+0000","last_became_active":"2023-10-25T16:15:52.630300+0000","last_became_peered":"2023-10-25T16:15:52.630300+0000","last_unstale":"2023-10-25T16:15:53.609108+0000","last_undegraded":"2023-10-25T16:15:53.609108+0000","last_fullsized":"2023-10-25T16:15:53.609108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:26:40.426881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608857+0000","last_change":"2023-10-25T16:15:52.620896+0000","last_active":"2023-10-25T16:15:54.608857+0000","last_peered":"2023-10-25T16:15:54.608857+0000","last_clean":"2023-10-25T16:15:54.608857+0000","last_became_active":"2023-10-25T16:15:52.620271+0000","last_became_peered":"2023-10-25T16:15:52.620271+0000","last_unstale":"2023-10-25T16:15:54.608857+0000","last_undegraded":"2023-10-25T16:15:54.608857+0000","last_fullsized":"2023-10-25T16:15:54.608857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:46.208801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612639+0000","last_change":"2023-10-25T16:15:52.633474+0000","last_active":"2023-10-25T16:15:53.612639+0000","last_peered":"2023-10-25T16:15:53.612639+0000","last_clean":"2023-10-25T16:15:53.612639+0000","last_became_active":"2023-10-25T16:15:52.630498+0000","last_became_peered":"2023-10-25T16:15:52.630498+0000","last_unstale":"2023-10-25T16:15:53.612639+0000","last_undegraded":"2023-10-25T16:15:53.612639+0000","last_fullsized":"2023-10-25T16:15:53.612639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:24:17.091019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.053932+0000","last_change":"2023-10-25T16:15:52.614274+0000","last_active":"2023-10-25T16:15:54.053932+0000","last_peered":"2023-10-25T16:15:54.053932+0000","last_clean":"2023-10-25T16:15:54.053932+0000","last_became_active":"2023-10-25T16:15:52.613622+0000","last_became_peered":"2023-10-25T16:15:52.613622+0000","last_unstale":"2023-10-25T16:15:54.053932+0000","last_undegraded":"2023-10-25T16:15:54.053932+0000","last_fullsized":"2023-10-25T16:15:54.053932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:19.129188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411093+0000","last_change":"2023-10-25T16:15:52.633334+0000","last_active":"2023-10-25T16:15:54.411093+0000","last_peered":"2023-10-25T16:15:54.411093+0000","last_clean":"2023-10-25T16:15:54.411093+0000","last_became_active":"2023-10-25T16:15:52.632706+0000","last_became_peered":"2023-10-25T16:15:52.632706+0000","last_unstale":"2023-10-25T16:15:54.411093+0000","last_undegraded":"2023-10-25T16:15:54.411093+0000","last_fullsized":"2023-10-25T16:15:54.411093+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:34.149121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609397+0000","last_change":"2023-10-25T16:15:52.632146+0000","last_active":"2023-10-25T16:15:53.609397+0000","last_peered":"2023-10-25T16:15:53.609397+0000","last_clean":"2023-10-25T16:15:53.609397+0000","last_became_active":"2023-10-25T16:15:52.630010+0000","last_became_peered":"2023-10-25T16:15:52.630010+0000","last_unstale":"2023-10-25T16:15:53.609397+0000","last_undegraded":"2023-10-25T16:15:53.609397+0000","last_fullsized":"2023-10-25T16:15:53.609397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:03:27.584023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:15:51.925371+0000","last_change":"2023-10-25T16:15:51.925371+0000","last_active":"2023-10-25T16:15:51.925371+0000","last_peered":"2023-10-25T16:15:51.925371+0000","last_clean":"2023-10-25T16:15:51.925371+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:15:51.925371+0000","last_undegraded":"2023-10-25T16:15:51.925371+0000","last_fullsized":"2023-10-25T16:15:51.925371+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054113+0000","last_change":"2023-10-25T16:15:52.628480+0000","last_active":"2023-10-25T16:15:54.054113+0000","last_peered":"2023-10-25T16:15:54.054113+0000","last_clean":"2023-10-25T16:15:54.054113+0000","last_became_active":"2023-10-25T16:15:52.623222+0000","last_became_peered":"2023-10-25T16:15:52.623222+0000","last_unstale":"2023-10-25T16:15:54.054113+0000","last_undegraded":"2023-10-25T16:15:54.054113+0000","last_fullsized":"2023-10-25T16:15:54.054113+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:52.377618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054069+0000","last_change":"2023-10-25T16:15:52.617729+0000","last_active":"2023-10-25T16:15:54.054069+0000","last_peered":"2023-10-25T16:15:54.054069+0000","last_clean":"2023-10-25T16:15:54.054069+0000","last_became_active":"2023-10-25T16:15:52.617113+0000","last_became_peered":"2023-10-25T16:15:52.617113+0000","last_unstale":"2023-10-25T16:15:54.054069+0000","last_undegraded":"2023-10-25T16:15:54.054069+0000","last_fullsized":"2023-10-25T16:15:54.054069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:30:10.904146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054210+0000","last_change":"2023-10-25T16:15:51.970773+0000","last_active":"2023-10-25T16:15:54.054210+0000","last_peered":"2023-10-25T16:15:54.054210+0000","last_clean":"2023-10-25T16:15:54.054210+0000","last_became_active":"2023-10-25T16:15:51.970091+0000","last_became_peered":"2023-10-25T16:15:51.970091+0000","last_unstale":"2023-10-25T16:15:54.054210+0000","last_undegraded":"2023-10-25T16:15:54.054210+0000","last_fullsized":"2023-10-25T16:15:54.054210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:58.653040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606713+0000","last_change":"2023-10-25T16:15:52.637445+0000","last_active":"2023-10-25T16:15:54.606713+0000","last_peered":"2023-10-25T16:15:54.606713+0000","last_clean":"2023-10-25T16:15:54.606713+0000","last_became_active":"2023-10-25T16:15:52.636799+0000","last_became_peered":"2023-10-25T16:15:52.636799+0000","last_unstale":"2023-10-25T16:15:54.606713+0000","last_undegraded":"2023-10-25T16:15:54.606713+0000","last_fullsized":"2023-10-25T16:15:54.606713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:44.234367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411642+0000","last_change":"2023-10-25T16:15:51.966500+0000","last_active":"2023-10-25T16:15:54.411642+0000","last_peered":"2023-10-25T16:15:54.411642+0000","last_clean":"2023-10-25T16:15:54.411642+0000","last_became_active":"2023-10-25T16:15:51.966039+0000","last_became_peered":"2023-10-25T16:15:51.966039+0000","last_unstale":"2023-10-25T16:15:54.411642+0000","last_undegraded":"2023-10-25T16:15:54.411642+0000","last_fullsized":"2023-10-25T16:15:54.411642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:17.588927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054300+0000","last_change":"2023-10-25T16:15:52.629576+0000","last_active":"2023-10-25T16:15:54.054300+0000","last_peered":"2023-10-25T16:15:54.054300+0000","last_clean":"2023-10-25T16:15:54.054300+0000","last_became_active":"2023-10-25T16:15:52.624616+0000","last_became_peered":"2023-10-25T16:15:52.624616+0000","last_unstale":"2023-10-25T16:15:54.054300+0000","last_undegraded":"2023-10-25T16:15:54.054300+0000","last_fullsized":"2023-10-25T16:15:54.054300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:39.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054067+0000","last_change":"2023-10-25T16:15:51.968394+0000","last_active":"2023-10-25T16:15:54.054067+0000","last_peered":"2023-10-25T16:15:54.054067+0000","last_clean":"2023-10-25T16:15:54.054067+0000","last_became_active":"2023-10-25T16:15:51.961599+0000","last_became_peered":"2023-10-25T16:15:51.961599+0000","last_unstale":"2023-10-25T16:15:54.054067+0000","last_undegraded":"2023-10-25T16:15:54.054067+0000","last_fullsized":"2023-10-25T16:15:54.054067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:26.403445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.053912+0000","last_change":"2023-10-25T16:15:52.613126+0000","last_active":"2023-10-25T16:15:54.053912+0000","last_peered":"2023-10-25T16:15:54.053912+0000","last_clean":"2023-10-25T16:15:54.053912+0000","last_became_active":"2023-10-25T16:15:52.611760+0000","last_became_peered":"2023-10-25T16:15:52.611760+0000","last_unstale":"2023-10-25T16:15:54.053912+0000","last_undegraded":"2023-10-25T16:15:54.053912+0000","last_fullsized":"2023-10-25T16:15:54.053912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:02:40.098049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613345+0000","last_change":"2023-10-25T16:15:51.980814+0000","last_active":"2023-10-25T16:15:53.613345+0000","last_peered":"2023-10-25T16:15:53.613345+0000","last_clean":"2023-10-25T16:15:53.613345+0000","last_became_active":"2023-10-25T16:15:51.979823+0000","last_became_peered":"2023-10-25T16:15:51.979823+0000","last_unstale":"2023-10-25T16:15:53.613345+0000","last_undegraded":"2023-10-25T16:15:53.613345+0000","last_fullsized":"2023-10-25T16:15:53.613345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:38.196845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411501+0000","last_change":"2023-10-25T16:15:52.609797+0000","last_active":"2023-10-25T16:15:54.411501+0000","last_peered":"2023-10-25T16:15:54.411501+0000","last_clean":"2023-10-25T16:15:54.411501+0000","last_became_active":"2023-10-25T16:15:52.608364+0000","last_became_peered":"2023-10-25T16:15:52.608364+0000","last_unstale":"2023-10-25T16:15:54.411501+0000","last_undegraded":"2023-10-25T16:15:54.411501+0000","last_fullsized":"2023-10-25T16:15:54.411501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:31.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609373+0000","last_change":"2023-10-25T16:15:51.970429+0000","last_active":"2023-10-25T16:15:54.609373+0000","last_peered":"2023-10-25T16:15:54.609373+0000","last_clean":"2023-10-25T16:15:54.609373+0000","last_became_active":"2023-10-25T16:15:51.968495+0000","last_became_peered":"2023-10-25T16:15:51.968495+0000","last_unstale":"2023-10-25T16:15:54.609373+0000","last_undegraded":"2023-10-25T16:15:54.609373+0000","last_fullsized":"2023-10-25T16:15:54.609373+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:15.973995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412060+0000","last_change":"2023-10-25T16:15:52.623796+0000","last_active":"2023-10-25T16:15:54.412060+0000","last_peered":"2023-10-25T16:15:54.412060+0000","last_clean":"2023-10-25T16:15:54.412060+0000","last_became_active":"2023-10-25T16:15:52.622943+0000","last_became_peered":"2023-10-25T16:15:52.622943+0000","last_unstale":"2023-10-25T16:15:54.412060+0000","last_undegraded":"2023-10-25T16:15:54.412060+0000","last_fullsized":"2023-10-25T16:15:54.412060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:30:44.325981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054327+0000","last_change":"2023-10-25T16:15:51.959582+0000","last_active":"2023-10-25T16:15:54.054327+0000","last_peered":"2023-10-25T16:15:54.054327+0000","last_clean":"2023-10-25T16:15:54.054327+0000","last_became_active":"2023-10-25T16:15:51.959038+0000","last_became_peered":"2023-10-25T16:15:51.959038+0000","last_unstale":"2023-10-25T16:15:54.054327+0000","last_undegraded":"2023-10-25T16:15:54.054327+0000","last_fullsized":"2023-10-25T16:15:54.054327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:03:26.572683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609926+0000","last_change":"2023-10-25T16:15:52.634102+0000","last_active":"2023-10-25T16:15:54.609926+0000","last_peered":"2023-10-25T16:15:54.609926+0000","last_clean":"2023-10-25T16:15:54.609926+0000","last_became_active":"2023-10-25T16:15:52.633374+0000","last_became_peered":"2023-10-25T16:15:52.633374+0000","last_unstale":"2023-10-25T16:15:54.609926+0000","last_undegraded":"2023-10-25T16:15:54.609926+0000","last_fullsized":"2023-10-25T16:15:54.609926+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:55.579915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613399+0000","last_change":"2023-10-25T16:15:51.974357+0000","last_active":"2023-10-25T16:15:53.613399+0000","last_peered":"2023-10-25T16:15:53.613399+0000","last_clean":"2023-10-25T16:15:53.613399+0000","last_became_active":"2023-10-25T16:15:51.973812+0000","last_became_peered":"2023-10-25T16:15:51.973812+0000","last_unstale":"2023-10-25T16:15:53.613399+0000","last_undegraded":"2023-10-25T16:15:53.613399+0000","last_fullsized":"2023-10-25T16:15:53.613399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:05:16.495909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411412+0000","last_change":"2023-10-25T16:15:52.626999+0000","last_active":"2023-10-25T16:15:54.411412+0000","last_peered":"2023-10-25T16:15:54.411412+0000","last_clean":"2023-10-25T16:15:54.411412+0000","last_became_active":"2023-10-25T16:15:52.626177+0000","last_became_peered":"2023-10-25T16:15:52.626177+0000","last_unstale":"2023-10-25T16:15:54.411412+0000","last_undegraded":"2023-10-25T16:15:54.411412+0000","last_fullsized":"2023-10-25T16:15:54.411412+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:35.904712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.610045+0000","last_change":"2023-10-25T16:15:51.969582+0000","last_active":"2023-10-25T16:15:54.610045+0000","last_peered":"2023-10-25T16:15:54.610045+0000","last_clean":"2023-10-25T16:15:54.610045+0000","last_became_active":"2023-10-25T16:15:51.968834+0000","last_became_peered":"2023-10-25T16:15:51.968834+0000","last_unstale":"2023-10-25T16:15:54.610045+0000","last_undegraded":"2023-10-25T16:15:54.610045+0000","last_fullsized":"2023-10-25T16:15:54.610045+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:54:42.459216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609130+0000","last_change":"2023-10-25T16:15:52.621581+0000","last_active":"2023-10-25T16:15:54.609130+0000","last_peered":"2023-10-25T16:15:54.609130+0000","last_clean":"2023-10-25T16:15:54.609130+0000","last_became_active":"2023-10-25T16:15:52.620300+0000","last_became_peered":"2023-10-25T16:15:52.620300+0000","last_unstale":"2023-10-25T16:15:54.609130+0000","last_undegraded":"2023-10-25T16:15:54.609130+0000","last_fullsized":"2023-10-25T16:15:54.609130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:12:56.777650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609712+0000","last_change":"2023-10-25T16:15:51.958227+0000","last_active":"2023-10-25T16:15:53.609712+0000","last_peered":"2023-10-25T16:15:53.609712+0000","last_clean":"2023-10-25T16:15:53.609712+0000","last_became_active":"2023-10-25T16:15:51.957511+0000","last_became_peered":"2023-10-25T16:15:51.957511+0000","last_unstale":"2023-10-25T16:15:53.609712+0000","last_undegraded":"2023-10-25T16:15:53.609712+0000","last_fullsized":"2023-10-25T16:15:53.609712+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:12:55.766311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608932+0000","last_change":"2023-10-25T16:15:52.631942+0000","last_active":"2023-10-25T16:15:53.608932+0000","last_peered":"2023-10-25T16:15:53.608932+0000","last_clean":"2023-10-25T16:15:53.608932+0000","last_became_active":"2023-10-25T16:15:52.630669+0000","last_became_peered":"2023-10-25T16:15:52.630669+0000","last_unstale":"2023-10-25T16:15:53.608932+0000","last_undegraded":"2023-10-25T16:15:53.608932+0000","last_fullsized":"2023-10-25T16:15:53.608932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.414785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.413482+0000","last_change":"2023-10-25T16:15:51.972897+0000","last_active":"2023-10-25T16:15:54.413482+0000","last_peered":"2023-10-25T16:15:54.413482+0000","last_clean":"2023-10-25T16:15:54.413482+0000","last_became_active":"2023-10-25T16:15:51.971560+0000","last_became_peered":"2023-10-25T16:15:51.971560+0000","last_unstale":"2023-10-25T16:15:54.413482+0000","last_undegraded":"2023-10-25T16:15:54.413482+0000","last_fullsized":"2023-10-25T16:15:54.413482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:10:03.372639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606407+0000","last_change":"2023-10-25T16:15:52.616913+0000","last_active":"2023-10-25T16:15:54.606407+0000","last_peered":"2023-10-25T16:15:54.606407+0000","last_clean":"2023-10-25T16:15:54.606407+0000","last_became_active":"2023-10-25T16:15:52.616278+0000","last_became_peered":"2023-10-25T16:15:52.616278+0000","last_unstale":"2023-10-25T16:15:54.606407+0000","last_undegraded":"2023-10-25T16:15:54.606407+0000","last_fullsized":"2023-10-25T16:15:54.606407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:19.020570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609449+0000","last_change":"2023-10-25T16:15:51.977470+0000","last_active":"2023-10-25T16:15:53.609449+0000","last_peered":"2023-10-25T16:15:53.609449+0000","last_clean":"2023-10-25T16:15:53.609449+0000","last_became_active":"2023-10-25T16:15:51.975996+0000","last_became_peered":"2023-10-25T16:15:51.975996+0000","last_unstale":"2023-10-25T16:15:53.609449+0000","last_undegraded":"2023-10-25T16:15:53.609449+0000","last_fullsized":"2023-10-25T16:15:53.609449+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:13:48.984461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609307+0000","last_change":"2023-10-25T16:15:52.639570+0000","last_active":"2023-10-25T16:15:53.609307+0000","last_peered":"2023-10-25T16:15:53.609307+0000","last_clean":"2023-10-25T16:15:53.609307+0000","last_became_active":"2023-10-25T16:15:52.637582+0000","last_became_peered":"2023-10-25T16:15:52.637582+0000","last_unstale":"2023-10-25T16:15:53.609307+0000","last_undegraded":"2023-10-25T16:15:53.609307+0000","last_fullsized":"2023-10-25T16:15:53.609307+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:50:34.374386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"67'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609263+0000","last_change":"2023-10-25T16:15:51.972364+0000","last_active":"2023-10-25T16:15:54.609263+0000","last_peered":"2023-10-25T16:15:54.609263+0000","last_clean":"2023-10-25T16:15:54.609263+0000","last_became_active":"2023-10-25T16:15:51.963233+0000","last_became_peered":"2023-10-25T16:15:51.963233+0000","last_unstale":"2023-10-25T16:15:54.609263+0000","last_undegraded":"2023-10-25T16:15:54.609263+0000","last_fullsized":"2023-10-25T16:15:54.609263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:18:07.528276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612976+0000","last_change":"2023-10-25T16:15:52.634000+0000","last_active":"2023-10-25T16:15:53.612976+0000","last_peered":"2023-10-25T16:15:53.612976+0000","last_clean":"2023-10-25T16:15:53.612976+0000","last_became_active":"2023-10-25T16:15:52.632790+0000","last_became_peered":"2023-10-25T16:15:52.632790+0000","last_unstale":"2023-10-25T16:15:53.612976+0000","last_undegraded":"2023-10-25T16:15:53.612976+0000","last_fullsized":"2023-10-25T16:15:53.612976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:11.374429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411593+0000","last_change":"2023-10-25T16:15:51.965621+0000","last_active":"2023-10-25T16:15:54.411593+0000","last_peered":"2023-10-25T16:15:54.411593+0000","last_clean":"2023-10-25T16:15:54.411593+0000","last_became_active":"2023-10-25T16:15:51.965212+0000","last_became_peered":"2023-10-25T16:15:51.965212+0000","last_unstale":"2023-10-25T16:15:54.411593+0000","last_undegraded":"2023-10-25T16:15:54.411593+0000","last_fullsized":"2023-10-25T16:15:54.411593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:18.117848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609064+0000","last_change":"2023-10-25T16:15:52.637053+0000","last_active":"2023-10-25T16:15:53.609064+0000","last_peered":"2023-10-25T16:15:53.609064+0000","last_clean":"2023-10-25T16:15:53.609064+0000","last_became_active":"2023-10-25T16:15:52.631221+0000","last_became_peered":"2023-10-25T16:15:52.631221+0000","last_unstale":"2023-10-25T16:15:53.609064+0000","last_undegraded":"2023-10-25T16:15:53.609064+0000","last_fullsized":"2023-10-25T16:15:53.609064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:30.715703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609325+0000","last_change":"2023-10-25T16:15:51.967878+0000","last_active":"2023-10-25T16:15:54.609325+0000","last_peered":"2023-10-25T16:15:54.609325+0000","last_clean":"2023-10-25T16:15:54.609325+0000","last_became_active":"2023-10-25T16:15:51.967265+0000","last_became_peered":"2023-10-25T16:15:51.967265+0000","last_unstale":"2023-10-25T16:15:54.609325+0000","last_undegraded":"2023-10-25T16:15:54.609325+0000","last_fullsized":"2023-10-25T16:15:54.609325+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:48:25.018018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608832+0000","last_change":"2023-10-25T16:15:52.629563+0000","last_active":"2023-10-25T16:15:54.608832+0000","last_peered":"2023-10-25T16:15:54.608832+0000","last_clean":"2023-10-25T16:15:54.608832+0000","last_became_active":"2023-10-25T16:15:52.628947+0000","last_became_peered":"2023-10-25T16:15:52.628947+0000","last_unstale":"2023-10-25T16:15:54.608832+0000","last_undegraded":"2023-10-25T16:15:54.608832+0000","last_fullsized":"2023-10-25T16:15:54.608832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:59:54.959266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613136+0000","last_change":"2023-10-25T16:15:51.969116+0000","last_active":"2023-10-25T16:15:53.613136+0000","last_peered":"2023-10-25T16:15:53.613136+0000","last_clean":"2023-10-25T16:15:53.613136+0000","last_became_active":"2023-10-25T16:15:51.968440+0000","last_became_peered":"2023-10-25T16:15:51.968440+0000","last_unstale":"2023-10-25T16:15:53.613136+0000","last_undegraded":"2023-10-25T16:15:53.613136+0000","last_fullsized":"2023-10-25T16:15:53.613136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:40.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608655+0000","last_change":"2023-10-25T16:15:52.627816+0000","last_active":"2023-10-25T16:15:53.608655+0000","last_peered":"2023-10-25T16:15:53.608655+0000","last_clean":"2023-10-25T16:15:53.608655+0000","last_became_active":"2023-10-25T16:15:52.624423+0000","last_became_peered":"2023-10-25T16:15:52.624423+0000","last_unstale":"2023-10-25T16:15:53.608655+0000","last_undegraded":"2023-10-25T16:15:53.608655+0000","last_fullsized":"2023-10-25T16:15:53.608655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:11.374429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"67'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609583+0000","last_change":"2023-10-25T16:15:51.965247+0000","last_active":"2023-10-25T16:15:53.609583+0000","last_peered":"2023-10-25T16:15:53.609583+0000","last_clean":"2023-10-25T16:15:53.609583+0000","last_became_active":"2023-10-25T16:15:51.963323+0000","last_became_peered":"2023-10-25T16:15:51.963323+0000","last_unstale":"2023-10-25T16:15:53.609583+0000","last_undegraded":"2023-10-25T16:15:53.609583+0000","last_fullsized":"2023-10-25T16:15:53.609583+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:32.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608549+0000","last_change":"2023-10-25T16:15:52.630627+0000","last_active":"2023-10-25T16:15:53.608549+0000","last_peered":"2023-10-25T16:15:53.608549+0000","last_clean":"2023-10-25T16:15:53.608549+0000","last_became_active":"2023-10-25T16:15:52.622637+0000","last_became_peered":"2023-10-25T16:15:52.622637+0000","last_unstale":"2023-10-25T16:15:53.608549+0000","last_undegraded":"2023-10-25T16:15:53.608549+0000","last_fullsized":"2023-10-25T16:15:53.608549+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:25.446910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411871+0000","last_change":"2023-10-25T16:15:51.966313+0000","last_active":"2023-10-25T16:15:54.411871+0000","last_peered":"2023-10-25T16:15:54.411871+0000","last_clean":"2023-10-25T16:15:54.411871+0000","last_became_active":"2023-10-25T16:15:51.965497+0000","last_became_peered":"2023-10-25T16:15:51.965497+0000","last_unstale":"2023-10-25T16:15:54.411871+0000","last_undegraded":"2023-10-25T16:15:54.411871+0000","last_fullsized":"2023-10-25T16:15:54.411871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:26.507051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612324+0000","last_change":"2023-10-25T16:15:52.638878+0000","last_active":"2023-10-25T16:15:53.612324+0000","last_peered":"2023-10-25T16:15:53.612324+0000","last_clean":"2023-10-25T16:15:53.612324+0000","last_became_active":"2023-10-25T16:15:52.636817+0000","last_became_peered":"2023-10-25T16:15:52.636817+0000","last_unstale":"2023-10-25T16:15:53.612324+0000","last_undegraded":"2023-10-25T16:15:53.612324+0000","last_fullsized":"2023-10-25T16:15:53.612324+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:13:49.995800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054134+0000","last_change":"2023-10-25T16:15:51.961191+0000","last_active":"2023-10-25T16:15:54.054134+0000","last_peered":"2023-10-25T16:15:54.054134+0000","last_clean":"2023-10-25T16:15:54.054134+0000","last_became_active":"2023-10-25T16:15:51.960542+0000","last_became_peered":"2023-10-25T16:15:51.960542+0000","last_unstale":"2023-10-25T16:15:54.054134+0000","last_undegraded":"2023-10-25T16:15:54.054134+0000","last_fullsized":"2023-10-25T16:15:54.054134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:26:39.415542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412363+0000","last_change":"2023-10-25T16:15:52.613123+0000","last_active":"2023-10-25T16:15:54.412363+0000","last_peered":"2023-10-25T16:15:54.412363+0000","last_clean":"2023-10-25T16:15:54.412363+0000","last_became_active":"2023-10-25T16:15:52.612376+0000","last_became_peered":"2023-10-25T16:15:52.612376+0000","last_unstale":"2023-10-25T16:15:54.412363+0000","last_undegraded":"2023-10-25T16:15:54.412363+0000","last_fullsized":"2023-10-25T16:15:54.412363+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:31:14.837507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613518+0000","last_change":"2023-10-25T16:15:51.980450+0000","last_active":"2023-10-25T16:15:53.613518+0000","last_peered":"2023-10-25T16:15:53.613518+0000","last_clean":"2023-10-25T16:15:53.613518+0000","last_became_active":"2023-10-25T16:15:51.978882+0000","last_became_peered":"2023-10-25T16:15:51.978882+0000","last_unstale":"2023-10-25T16:15:53.613518+0000","last_undegraded":"2023-10-25T16:15:53.613518+0000","last_fullsized":"2023-10-25T16:15:53.613518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:38.374549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609200+0000","last_change":"2023-10-25T16:15:52.635388+0000","last_active":"2023-10-25T16:15:53.609200+0000","last_peered":"2023-10-25T16:15:53.609200+0000","last_clean":"2023-10-25T16:15:53.609200+0000","last_became_active":"2023-10-25T16:15:52.631418+0000","last_became_peered":"2023-10-25T16:15:52.631418+0000","last_unstale":"2023-10-25T16:15:53.609200+0000","last_undegraded":"2023-10-25T16:15:53.609200+0000","last_fullsized":"2023-10-25T16:15:53.609200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:42:24.857206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054295+0000","last_change":"2023-10-25T16:15:51.971546+0000","last_active":"2023-10-25T16:15:54.054295+0000","last_peered":"2023-10-25T16:15:54.054295+0000","last_clean":"2023-10-25T16:15:54.054295+0000","last_became_active":"2023-10-25T16:15:51.971268+0000","last_became_peered":"2023-10-25T16:15:51.971268+0000","last_unstale":"2023-10-25T16:15:54.054295+0000","last_undegraded":"2023-10-25T16:15:54.054295+0000","last_fullsized":"2023-10-25T16:15:54.054295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:24.435570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612894+0000","last_change":"2023-10-25T16:15:52.638149+0000","last_active":"2023-10-25T16:15:53.612894+0000","last_peered":"2023-10-25T16:15:53.612894+0000","last_clean":"2023-10-25T16:15:53.612894+0000","last_became_active":"2023-10-25T16:15:52.635633+0000","last_became_peered":"2023-10-25T16:15:52.635633+0000","last_unstale":"2023-10-25T16:15:53.612894+0000","last_undegraded":"2023-10-25T16:15:53.612894+0000","last_fullsized":"2023-10-25T16:15:53.612894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:25.446910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412011+0000","last_change":"2023-10-25T16:15:51.965639+0000","last_active":"2023-10-25T16:15:54.412011+0000","last_peered":"2023-10-25T16:15:54.412011+0000","last_clean":"2023-10-25T16:15:54.412011+0000","last_became_active":"2023-10-25T16:15:51.965275+0000","last_became_peered":"2023-10-25T16:15:51.965275+0000","last_unstale":"2023-10-25T16:15:54.412011+0000","last_undegraded":"2023-10-25T16:15:54.412011+0000","last_fullsized":"2023-10-25T16:15:54.412011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:38.649091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054010+0000","last_change":"2023-10-25T16:15:52.633823+0000","last_active":"2023-10-25T16:15:54.054010+0000","last_peered":"2023-10-25T16:15:54.054010+0000","last_clean":"2023-10-25T16:15:54.054010+0000","last_became_active":"2023-10-25T16:15:52.631985+0000","last_became_peered":"2023-10-25T16:15:52.631985+0000","last_unstale":"2023-10-25T16:15:54.054010+0000","last_undegraded":"2023-10-25T16:15:54.054010+0000","last_fullsized":"2023-10-25T16:15:54.054010+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:02.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606938+0000","last_change":"2023-10-25T16:15:51.964429+0000","last_active":"2023-10-25T16:15:54.606938+0000","last_peered":"2023-10-25T16:15:54.606938+0000","last_clean":"2023-10-25T16:15:54.606938+0000","last_became_active":"2023-10-25T16:15:51.964007+0000","last_became_peered":"2023-10-25T16:15:51.964007+0000","last_unstale":"2023-10-25T16:15:54.606938+0000","last_undegraded":"2023-10-25T16:15:54.606938+0000","last_fullsized":"2023-10-25T16:15:54.606938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:08.305773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054005+0000","last_change":"2023-10-25T16:15:52.635736+0000","last_active":"2023-10-25T16:15:54.054005+0000","last_peered":"2023-10-25T16:15:54.054005+0000","last_clean":"2023-10-25T16:15:54.054005+0000","last_became_active":"2023-10-25T16:15:52.635142+0000","last_became_peered":"2023-10-25T16:15:52.635142+0000","last_unstale":"2023-10-25T16:15:54.054005+0000","last_undegraded":"2023-10-25T16:15:54.054005+0000","last_fullsized":"2023-10-25T16:15:54.054005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:49:05.157992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613642+0000","last_change":"2023-10-25T16:15:51.977685+0000","last_active":"2023-10-25T16:15:53.613642+0000","last_peered":"2023-10-25T16:15:53.613642+0000","last_clean":"2023-10-25T16:15:53.613642+0000","last_became_active":"2023-10-25T16:15:51.974351+0000","last_became_peered":"2023-10-25T16:15:51.974351+0000","last_unstale":"2023-10-25T16:15:53.613642+0000","last_undegraded":"2023-10-25T16:15:53.613642+0000","last_fullsized":"2023-10-25T16:15:53.613642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:59:53.947926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612447+0000","last_change":"2023-10-25T16:15:52.630859+0000","last_active":"2023-10-25T16:15:53.612447+0000","last_peered":"2023-10-25T16:15:53.612447+0000","last_clean":"2023-10-25T16:15:53.612447+0000","last_became_active":"2023-10-25T16:15:52.623263+0000","last_became_peered":"2023-10-25T16:15:52.623263+0000","last_unstale":"2023-10-25T16:15:53.612447+0000","last_undegraded":"2023-10-25T16:15:53.612447+0000","last_fullsized":"2023-10-25T16:15:53.612447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:33.137933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606716+0000","last_change":"2023-10-25T16:15:51.970511+0000","last_active":"2023-10-25T16:15:54.606716+0000","last_peered":"2023-10-25T16:15:54.606716+0000","last_clean":"2023-10-25T16:15:54.606716+0000","last_became_active":"2023-10-25T16:15:51.970189+0000","last_became_peered":"2023-10-25T16:15:51.970189+0000","last_unstale":"2023-10-25T16:15:54.606716+0000","last_undegraded":"2023-10-25T16:15:54.606716+0000","last_fullsized":"2023-10-25T16:15:54.606716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:43.170472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612918+0000","last_change":"2023-10-25T16:15:52.617117+0000","last_active":"2023-10-25T16:15:53.612918+0000","last_peered":"2023-10-25T16:15:53.612918+0000","last_clean":"2023-10-25T16:15:53.612918+0000","last_became_active":"2023-10-25T16:15:52.616258+0000","last_became_peered":"2023-10-25T16:15:52.616258+0000","last_unstale":"2023-10-25T16:15:53.612918+0000","last_undegraded":"2023-10-25T16:15:53.612918+0000","last_fullsized":"2023-10-25T16:15:53.612918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:23.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054382+0000","last_change":"2023-10-25T16:15:51.959339+0000","last_active":"2023-10-25T16:15:54.054382+0000","last_peered":"2023-10-25T16:15:54.054382+0000","last_clean":"2023-10-25T16:15:54.054382+0000","last_became_active":"2023-10-25T16:15:51.958596+0000","last_became_peered":"2023-10-25T16:15:51.958596+0000","last_unstale":"2023-10-25T16:15:54.054382+0000","last_undegraded":"2023-10-25T16:15:54.054382+0000","last_fullsized":"2023-10-25T16:15:54.054382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:11:35.435666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607562+0000","last_change":"2023-10-25T16:15:52.628647+0000","last_active":"2023-10-25T16:15:54.607562+0000","last_peered":"2023-10-25T16:15:54.607562+0000","last_clean":"2023-10-25T16:15:54.607562+0000","last_became_active":"2023-10-25T16:15:52.626298+0000","last_became_peered":"2023-10-25T16:15:52.626298+0000","last_unstale":"2023-10-25T16:15:54.607562+0000","last_undegraded":"2023-10-25T16:15:54.607562+0000","last_fullsized":"2023-10-25T16:15:54.607562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:55.579915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609086+0000","last_change":"2023-10-25T16:15:51.956478+0000","last_active":"2023-10-25T16:15:54.609086+0000","last_peered":"2023-10-25T16:15:54.609086+0000","last_clean":"2023-10-25T16:15:54.609086+0000","last_became_active":"2023-10-25T16:15:51.955782+0000","last_became_peered":"2023-10-25T16:15:51.955782+0000","last_unstale":"2023-10-25T16:15:54.609086+0000","last_undegraded":"2023-10-25T16:15:54.609086+0000","last_fullsized":"2023-10-25T16:15:54.609086+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:43.223028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054196+0000","last_change":"2023-10-25T16:15:52.636629+0000","last_active":"2023-10-25T16:15:54.054196+0000","last_peered":"2023-10-25T16:15:54.054196+0000","last_clean":"2023-10-25T16:15:54.054196+0000","last_became_active":"2023-10-25T16:15:52.635903+0000","last_became_peered":"2023-10-25T16:15:52.635903+0000","last_unstale":"2023-10-25T16:15:54.054196+0000","last_undegraded":"2023-10-25T16:15:54.054196+0000","last_fullsized":"2023-10-25T16:15:54.054196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:27.518390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612816+0000","last_change":"2023-10-25T16:15:51.969506+0000","last_active":"2023-10-25T16:15:53.612816+0000","last_peered":"2023-10-25T16:15:53.612816+0000","last_clean":"2023-10-25T16:15:53.612816+0000","last_became_active":"2023-10-25T16:15:51.968901+0000","last_became_peered":"2023-10-25T16:15:51.968901+0000","last_unstale":"2023-10-25T16:15:53.612816+0000","last_undegraded":"2023-10-25T16:15:53.612816+0000","last_fullsized":"2023-10-25T16:15:53.612816+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:54:42.459216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412822+0000","last_change":"2023-10-25T16:15:52.632630+0000","last_active":"2023-10-25T16:15:54.412822+0000","last_peered":"2023-10-25T16:15:54.412822+0000","last_clean":"2023-10-25T16:15:54.412822+0000","last_became_active":"2023-10-25T16:15:52.626288+0000","last_became_peered":"2023-10-25T16:15:52.626288+0000","last_unstale":"2023-10-25T16:15:54.412822+0000","last_undegraded":"2023-10-25T16:15:54.412822+0000","last_fullsized":"2023-10-25T16:15:54.412822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:27.700323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607621+0000","last_change":"2023-10-25T16:15:51.973333+0000","last_active":"2023-10-25T16:15:54.607621+0000","last_peered":"2023-10-25T16:15:54.607621+0000","last_clean":"2023-10-25T16:15:54.607621+0000","last_became_active":"2023-10-25T16:15:51.973055+0000","last_became_peered":"2023-10-25T16:15:51.973055+0000","last_unstale":"2023-10-25T16:15:54.607621+0000","last_undegraded":"2023-10-25T16:15:54.607621+0000","last_fullsized":"2023-10-25T16:15:54.607621+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:03:36.836279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609393+0000","last_change":"2023-10-25T16:15:52.628577+0000","last_active":"2023-10-25T16:15:53.609393+0000","last_peered":"2023-10-25T16:15:53.609393+0000","last_clean":"2023-10-25T16:15:53.609393+0000","last_became_active":"2023-10-25T16:15:52.627825+0000","last_became_peered":"2023-10-25T16:15:52.627825+0000","last_unstale":"2023-10-25T16:15:53.609393+0000","last_undegraded":"2023-10-25T16:15:53.609393+0000","last_fullsized":"2023-10-25T16:15:53.609393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:59.664379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609589+0000","last_change":"2023-10-25T16:15:51.958576+0000","last_active":"2023-10-25T16:15:54.609589+0000","last_peered":"2023-10-25T16:15:54.609589+0000","last_clean":"2023-10-25T16:15:54.609589+0000","last_became_active":"2023-10-25T16:15:51.957985+0000","last_became_peered":"2023-10-25T16:15:51.957985+0000","last_unstale":"2023-10-25T16:15:54.609589+0000","last_undegraded":"2023-10-25T16:15:54.609589+0000","last_fullsized":"2023-10-25T16:15:54.609589+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:42.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606733+0000","last_change":"2023-10-25T16:15:52.630847+0000","last_active":"2023-10-25T16:15:54.606733+0000","last_peered":"2023-10-25T16:15:54.606733+0000","last_clean":"2023-10-25T16:15:54.606733+0000","last_became_active":"2023-10-25T16:15:52.630223+0000","last_became_peered":"2023-10-25T16:15:52.630223+0000","last_unstale":"2023-10-25T16:15:54.606733+0000","last_undegraded":"2023-10-25T16:15:54.606733+0000","last_fullsized":"2023-10-25T16:15:54.606733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:24.074397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606919+0000","last_change":"2023-10-25T16:15:51.960127+0000","last_active":"2023-10-25T16:15:54.606919+0000","last_peered":"2023-10-25T16:15:54.606919+0000","last_clean":"2023-10-25T16:15:54.606919+0000","last_became_active":"2023-10-25T16:15:51.959784+0000","last_became_peered":"2023-10-25T16:15:51.959784+0000","last_unstale":"2023-10-25T16:15:54.606919+0000","last_undegraded":"2023-10-25T16:15:54.606919+0000","last_fullsized":"2023-10-25T16:15:54.606919+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:11:02.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411801+0000","last_change":"2023-10-25T16:15:52.629558+0000","last_active":"2023-10-25T16:15:54.411801+0000","last_peered":"2023-10-25T16:15:54.411801+0000","last_clean":"2023-10-25T16:15:54.411801+0000","last_became_active":"2023-10-25T16:15:52.628578+0000","last_became_peered":"2023-10-25T16:15:52.628578+0000","last_unstale":"2023-10-25T16:15:54.411801+0000","last_undegraded":"2023-10-25T16:15:54.411801+0000","last_fullsized":"2023-10-25T16:15:54.411801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:32.388491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412072+0000","last_change":"2023-10-25T16:15:51.970258+0000","last_active":"2023-10-25T16:15:54.412072+0000","last_peered":"2023-10-25T16:15:54.412072+0000","last_clean":"2023-10-25T16:15:54.412072+0000","last_became_active":"2023-10-25T16:15:51.969827+0000","last_became_peered":"2023-10-25T16:15:51.969827+0000","last_unstale":"2023-10-25T16:15:54.412072+0000","last_undegraded":"2023-10-25T16:15:54.412072+0000","last_fullsized":"2023-10-25T16:15:54.412072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:31:05.049444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411805+0000","last_change":"2023-10-25T16:15:52.623754+0000","last_active":"2023-10-25T16:15:54.411805+0000","last_peered":"2023-10-25T16:15:54.411805+0000","last_clean":"2023-10-25T16:15:54.411805+0000","last_became_active":"2023-10-25T16:15:52.623085+0000","last_became_peered":"2023-10-25T16:15:52.623085+0000","last_unstale":"2023-10-25T16:15:54.411805+0000","last_undegraded":"2023-10-25T16:15:54.411805+0000","last_fullsized":"2023-10-25T16:15:54.411805+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:28:19.961314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.610148+0000","last_change":"2023-10-25T16:15:51.966207+0000","last_active":"2023-10-25T16:15:54.610148+0000","last_peered":"2023-10-25T16:15:54.610148+0000","last_clean":"2023-10-25T16:15:54.610148+0000","last_became_active":"2023-10-25T16:15:51.965597+0000","last_became_peered":"2023-10-25T16:15:51.965597+0000","last_unstale":"2023-10-25T16:15:54.610148+0000","last_undegraded":"2023-10-25T16:15:54.610148+0000","last_fullsized":"2023-10-25T16:15:54.610148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:18.009230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-25T16:15:52.607211+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:15:52.607211+0000","last_peered":"2023-10-25T16:15:52.607211+0000","last_clean":"2023-10-25T16:15:52.607211+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:15:52.607211+0000","last_undegraded":"2023-10-25T16:15:52.607211+0000","last_fullsized":"2023-10-25T16:15:52.607211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:51.052641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.25600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93400000000000005,"5min":1.089,"15min":1.089},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.438}]},{"osd":4,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.78500000000000003},"min":{"1min":0.47199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.83499999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.91000000000000003,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.401,"5min":1.581,"15min":1.581},"last":0.89400000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.753},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.306,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3320000000000001,"5min":1.677,"15min":1.677},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.72999999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":919,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194393,"statfs":{"total":200000000,"available":199058559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.0740000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.121},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.149,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.99299999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.27},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.80100000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1899999999999999,"5min":1.304,"15min":1.304},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1899999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.627},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.66900000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.873}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.036,"15min":1.0409999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.25,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.753}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.323},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.79900000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2230000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":336,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194975,"statfs":{"total":200000000,"available":199655387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2470000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.751}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.97899999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.872,"15min":0.85999999999999999},"min":{"1min":0.66900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.476,"15min":1.476},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.879,"15min":0.86899999999999999},"min":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1819999999999999,"5min":1.196,"15min":1.196},"last":1.1220000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.63200000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.175,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2629999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.054},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.413,"15min":1.413},"last":0.69099999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.72599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0620000000000001,"15min":1.056},"min":{"1min":0.76700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2509999999999999,"5min":1.895,"15min":1.895},"last":1.085}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4339999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0329999999999999,"15min":1.0269999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.90000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":343,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199648435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.365,"15min":1.45},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.202,"5min":14.843,"15min":14.843},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.5189999999999999,"15min":1.6299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2410000000000001,"5min":16.439,"15min":16.439},"last":0.81299999999999994}]},{"osd":1,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.4370000000000001,"15min":1.5289999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.153,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.94499999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.92500000000000004,"15min":0.93799999999999994},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.119,"5min":1.226,"15min":1.226},"last":0.75},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.95899999999999996,"15min":0.96299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2509999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.73599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.252},"last":0.871},{"interface":"front","average":{"1min":1.034,"5min":1.524,"15min":1.6060000000000001},"min":{"1min":0.66500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.365,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.0009999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.629,"15min":1.73},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.288,"5min":15.904,"15min":15.904},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.6439999999999999,"15min":1.768},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.105,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.98099999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.5249999999999999,"15min":1.607},"min":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3009999999999999,"5min":14.567,"15min":14.567},"last":1.129},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.73,"15min":1.8340000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4330000000000001,"5min":15.089,"15min":15.089},"last":1.0509999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.7629999999999999,"15min":1.895},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.423,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.2709999999999999,"15min":1.2969999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3939999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.022}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":338,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194974,"statfs":{"total":200000000,"available":199653775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.47,"15min":1.47},"last":1.044},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.05,"5min":1.262,"15min":1.262},"last":0.77700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.95699999999999996,"15min":0.93799999999999994},"min":{"1min":0.86299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.171}]},{"osd":2,"last update":"Wed Oct 25 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.419,"15min":1.419},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.258}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1799999999999999,"5min":1.369,"15min":1.369},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.0960000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0640000000000001,"15min":1.0629999999999999},"min":{"1min":0.753,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.2170000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95099999999999996,"15min":0.94299999999999995},"min":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.071},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":336,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194975,"statfs":{"total":200000000,"available":199655331,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.872,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1,"5min":1.083,"15min":1.083},"last":1.077}]},{"osd":1,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0309999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.0569999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.054}]},{"osd":2,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.86599999999999999,"15min":0.86099999999999999},"min":{"1min":0.65500000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.111,"5min":1.23,"15min":1.23},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.236,"5min":1.427,"15min":1.427},"last":1.119}]},{"osd":5,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.93600000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1399999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.369,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.228}]},{"osd":6,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90000000000000002,"15min":0.90200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1990000000000001,"5min":1.456,"15min":1.456},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.99299999999999999,"15min":1.0109999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2390000000000001,"5min":1.663,"15min":1.663},"last":1.0229999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96499999999999997,"15min":0.96099999999999997},"min":{"1min":0.64900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3180000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.389,"15min":1.389},"last":1.1839999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199648997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85999999999999999,"5min":1.423,"15min":1.423},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.69399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.698,"5min":12.698,"15min":12.698},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.107,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.721,"5min":12.721,"15min":12.721},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.95899999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.331,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.999,"5min":1.02,"15min":1.024},"min":{"1min":0.68999999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.581,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.0740000000000001,"15min":0.97399999999999998},"min":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":14.776,"5min":14.776,"15min":14.776},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.0780000000000001,"15min":1.012},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":10.509,"5min":10.509,"15min":10.509},"last":0.68200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":915,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194397,"statfs":{"total":200000000,"available":199062825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.314,"5min":0.217,"15min":0.217},"max":{"1min":0.746,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.73299999999999998,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.95999999999999996,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.372,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80000000000000004,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.71199999999999997,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98799999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.161,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.103,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.139,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94099999999999995,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.103,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.97499999999999998},"min":{"1min":0.66200000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2350000000000001,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0740000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.3049999999999999,"15min":1.375},"min":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1819999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.323,"15min":1.393},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.119,"5min":11.622,"15min":11.622},"last":0.73599999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:15:57.913 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-10-25T16:15:57.910+0000 7ff861af4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:16:00.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:16:00.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:16:00.498 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:16:00.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.538+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/1649941939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 msgr2=0x7f8e80003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.538+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/1649941939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e80003da0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009b60 tx=0x7f8e9001d250 comp rx=0 tx=0).stop 2023-10-25T16:16:00.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.538+0000 7f8e99d98640 1 -- 172.21.15.177:0/1649941939 reap_dead start 2023-10-25T16:16:00.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/1649941939 shutdown_connections 2023-10-25T16:16:00.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/1649941939 >> 172.21.15.177:0/1649941939 conn(0x7f8e9409a5c0 msgr2=0x7f8e940d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:00.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/1649941939 shutdown_connections 2023-10-25T16:16:00.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/1649941939 wait complete. 2023-10-25T16:16:00.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 Processor -- start 2023-10-25T16:16:00.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- start start 2023-10-25T16:16:00.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e940cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e9415dcb0 0x7f8e94163190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e941636d0 0x7f8e94147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941474f0 con 0x7f8e80003980 2023-10-25T16:16:00.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94159e10 con 0x7f8e941636d0 2023-10-25T16:16:00.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941468e0 con 0x7f8e9415dcb0 2023-10-25T16:16:00.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e940cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e940cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56034/0 (socket says 172.21.15.177:56034) 2023-10-25T16:16:00.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 -- 172.21.15.177:0/235223160 learned_addr learned my addr 172.21.15.177:0/235223160 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:00.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e98d96640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e9415dcb0 0x7f8e94163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99d98640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e941636d0 0x7f8e94147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 -- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e9415dcb0 msgr2=0x7f8e94163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e9415dcb0 0x7f8e94163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 -- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e941636d0 msgr2=0x7f8e94147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e941636d0 0x7f8e94147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 -- 172.21.15.177:0/235223160 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94146bc0 con 0x7f8e80003980 2023-10-25T16:16:00.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e99597640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e940cacf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8e9001d080 tx=0x7f8e90005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:00.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90004a10 con 0x7f8e80003980 2023-10-25T16:16:00.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e90004c60 con 0x7f8e80003980 2023-10-25T16:16:00.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e94146ea0 con 0x7f8e80003980 2023-10-25T16:16:00.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b6410 con 0x7f8e80003980 2023-10-25T16:16:00.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9415e130 con 0x7f8e80003980 2023-10-25T16:16:00.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.542+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9404daf0 con 0x7f8e80003980 2023-10-25T16:16:00.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.546+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e900b3070 con 0x7f8e80003980 2023-10-25T16:16:00.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.546+0000 7f8e89ffb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e78066490 0x7f8e78068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.546+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e9011f070 con 0x7f8e80003980 2023-10-25T16:16:00.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.546+0000 7f8e98d96640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e78066490 0x7f8e78068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.546+0000 7f8e98d96640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e78066490 0x7f8e78068950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e84001870 tx=0x7f8e84001e60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:00.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.550+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e900ec6c0 con 0x7f8e80003980 2023-10-25T16:16:00.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.702+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e94147350 con 0x7f8e78066490 2023-10-25T16:16:00.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.726+0000 7f8e89ffb640 1 -- 172.21.15.177:0/235223160 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283635 (secure 0 0 0) 0x7f8e84006d40 con 0x7f8e78066490 2023-10-25T16:16:00.733 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:16:00.735 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:16:00.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e78066490 msgr2=0x7f8e78068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e78066490 0x7f8e78068950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e84001870 tx=0x7f8e84001e60 comp rx=0 tx=0).stop 2023-10-25T16:16:00.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 msgr2=0x7f8e940cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e940cacf0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8e9001d080 tx=0x7f8e90005620 comp rx=0 tx=0).stop 2023-10-25T16:16:00.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 shutdown_connections 2023-10-25T16:16:00.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e78066490 0x7f8e78068950 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e941636d0 0x7f8e94147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e9415dcb0 0x7f8e94163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 --2- 172.21.15.177:0/235223160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e80003980 0x7f8e940cacf0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 >> 172.21.15.177:0/235223160 conn(0x7f8e9409a5c0 msgr2=0x7f8e940b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:00.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 shutdown_connections 2023-10-25T16:16:00.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.730+0000 7f8e9b7fb640 1 -- 172.21.15.177:0/235223160 wait complete. 2023-10-25T16:16:00.752 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2023-10-25T16:16:00.664430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558600,"statfs":{"total":1600000000,"available":1596007140,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.063963"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606952+0000","last_change":"2023-10-25T16:15:52.612833+0000","last_active":"2023-10-25T16:15:54.606952+0000","last_peered":"2023-10-25T16:15:54.606952+0000","last_clean":"2023-10-25T16:15:54.606952+0000","last_became_active":"2023-10-25T16:15:52.611205+0000","last_became_peered":"2023-10-25T16:15:52.611205+0000","last_unstale":"2023-10-25T16:15:54.606952+0000","last_undegraded":"2023-10-25T16:15:54.606952+0000","last_fullsized":"2023-10-25T16:15:54.606952+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:02:13.544542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411086+0000","last_change":"2023-10-25T16:15:52.633180+0000","last_active":"2023-10-25T16:15:54.411086+0000","last_peered":"2023-10-25T16:15:54.411086+0000","last_clean":"2023-10-25T16:15:54.411086+0000","last_became_active":"2023-10-25T16:15:52.629761+0000","last_became_peered":"2023-10-25T16:15:52.629761+0000","last_unstale":"2023-10-25T16:15:54.411086+0000","last_undegraded":"2023-10-25T16:15:54.411086+0000","last_fullsized":"2023-10-25T16:15:54.411086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:32:04.069862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608566+0000","last_change":"2023-10-25T16:15:52.630997+0000","last_active":"2023-10-25T16:15:53.608566+0000","last_peered":"2023-10-25T16:15:53.608566+0000","last_clean":"2023-10-25T16:15:53.608566+0000","last_became_active":"2023-10-25T16:15:52.623947+0000","last_became_peered":"2023-10-25T16:15:52.623947+0000","last_unstale":"2023-10-25T16:15:53.608566+0000","last_undegraded":"2023-10-25T16:15:53.608566+0000","last_fullsized":"2023-10-25T16:15:53.608566+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:23.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613204+0000","last_change":"2023-10-25T16:15:52.637644+0000","last_active":"2023-10-25T16:15:53.613204+0000","last_peered":"2023-10-25T16:15:53.613204+0000","last_clean":"2023-10-25T16:15:53.613204+0000","last_became_active":"2023-10-25T16:15:52.634667+0000","last_became_peered":"2023-10-25T16:15:52.634667+0000","last_unstale":"2023-10-25T16:15:53.613204+0000","last_undegraded":"2023-10-25T16:15:53.613204+0000","last_fullsized":"2023-10-25T16:15:53.613204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:43:42.808534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606739+0000","last_change":"2023-10-25T16:15:52.624138+0000","last_active":"2023-10-25T16:15:54.606739+0000","last_peered":"2023-10-25T16:15:54.606739+0000","last_clean":"2023-10-25T16:15:54.606739+0000","last_became_active":"2023-10-25T16:15:52.622482+0000","last_became_peered":"2023-10-25T16:15:52.622482+0000","last_unstale":"2023-10-25T16:15:54.606739+0000","last_undegraded":"2023-10-25T16:15:54.606739+0000","last_fullsized":"2023-10-25T16:15:54.606739+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:25:36.242781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054154+0000","last_change":"2023-10-25T16:15:52.623749+0000","last_active":"2023-10-25T16:15:54.054154+0000","last_peered":"2023-10-25T16:15:54.054154+0000","last_clean":"2023-10-25T16:15:54.054154+0000","last_became_active":"2023-10-25T16:15:52.619815+0000","last_became_peered":"2023-10-25T16:15:52.619815+0000","last_unstale":"2023-10-25T16:15:54.054154+0000","last_undegraded":"2023-10-25T16:15:54.054154+0000","last_fullsized":"2023-10-25T16:15:54.054154+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:18.600266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608538+0000","last_change":"2023-10-25T16:15:52.621036+0000","last_active":"2023-10-25T16:15:54.608538+0000","last_peered":"2023-10-25T16:15:54.608538+0000","last_clean":"2023-10-25T16:15:54.608538+0000","last_became_active":"2023-10-25T16:15:52.618289+0000","last_became_peered":"2023-10-25T16:15:52.618289+0000","last_unstale":"2023-10-25T16:15:54.608538+0000","last_undegraded":"2023-10-25T16:15:54.608538+0000","last_fullsized":"2023-10-25T16:15:54.608538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:39.208184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.410986+0000","last_change":"2023-10-25T16:15:52.610169+0000","last_active":"2023-10-25T16:15:54.410986+0000","last_peered":"2023-10-25T16:15:54.410986+0000","last_clean":"2023-10-25T16:15:54.410986+0000","last_became_active":"2023-10-25T16:15:52.609179+0000","last_became_peered":"2023-10-25T16:15:52.609179+0000","last_unstale":"2023-10-25T16:15:54.410986+0000","last_undegraded":"2023-10-25T16:15:54.410986+0000","last_fullsized":"2023-10-25T16:15:54.410986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:07.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608607+0000","last_change":"2023-10-25T16:15:52.621750+0000","last_active":"2023-10-25T16:15:54.608607+0000","last_peered":"2023-10-25T16:15:54.608607+0000","last_clean":"2023-10-25T16:15:54.608607+0000","last_became_active":"2023-10-25T16:15:52.620222+0000","last_became_peered":"2023-10-25T16:15:52.620222+0000","last_unstale":"2023-10-25T16:15:54.608607+0000","last_undegraded":"2023-10-25T16:15:54.608607+0000","last_fullsized":"2023-10-25T16:15:54.608607+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:39.385889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607376+0000","last_change":"2023-10-25T16:15:52.628202+0000","last_active":"2023-10-25T16:15:54.607376+0000","last_peered":"2023-10-25T16:15:54.607376+0000","last_clean":"2023-10-25T16:15:54.607376+0000","last_became_active":"2023-10-25T16:15:52.625378+0000","last_became_peered":"2023-10-25T16:15:52.625378+0000","last_unstale":"2023-10-25T16:15:54.607376+0000","last_undegraded":"2023-10-25T16:15:54.607376+0000","last_fullsized":"2023-10-25T16:15:54.607376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:46.208801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607510+0000","last_change":"2023-10-25T16:15:52.632680+0000","last_active":"2023-10-25T16:15:54.607510+0000","last_peered":"2023-10-25T16:15:54.607510+0000","last_clean":"2023-10-25T16:15:54.607510+0000","last_became_active":"2023-10-25T16:15:52.630875+0000","last_became_peered":"2023-10-25T16:15:52.630875+0000","last_unstale":"2023-10-25T16:15:54.607510+0000","last_undegraded":"2023-10-25T16:15:54.607510+0000","last_fullsized":"2023-10-25T16:15:54.607510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:58:09.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612556+0000","last_change":"2023-10-25T16:15:52.619637+0000","last_active":"2023-10-25T16:15:53.612556+0000","last_peered":"2023-10-25T16:15:53.612556+0000","last_clean":"2023-10-25T16:15:53.612556+0000","last_became_active":"2023-10-25T16:15:52.618750+0000","last_became_peered":"2023-10-25T16:15:52.618750+0000","last_unstale":"2023-10-25T16:15:53.612556+0000","last_undegraded":"2023-10-25T16:15:53.612556+0000","last_fullsized":"2023-10-25T16:15:53.612556+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:37:51.611235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609442+0000","last_change":"2023-10-25T16:15:52.636202+0000","last_active":"2023-10-25T16:15:54.609442+0000","last_peered":"2023-10-25T16:15:54.609442+0000","last_clean":"2023-10-25T16:15:54.609442+0000","last_became_active":"2023-10-25T16:15:52.635564+0000","last_became_peered":"2023-10-25T16:15:52.635564+0000","last_unstale":"2023-10-25T16:15:54.609442+0000","last_undegraded":"2023-10-25T16:15:54.609442+0000","last_fullsized":"2023-10-25T16:15:54.609442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:58:09.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608952+0000","last_change":"2023-10-25T16:15:52.619148+0000","last_active":"2023-10-25T16:15:54.608952+0000","last_peered":"2023-10-25T16:15:54.608952+0000","last_clean":"2023-10-25T16:15:54.608952+0000","last_became_active":"2023-10-25T16:15:52.618503+0000","last_became_peered":"2023-10-25T16:15:52.618503+0000","last_unstale":"2023-10-25T16:15:54.608952+0000","last_undegraded":"2023-10-25T16:15:54.608952+0000","last_fullsized":"2023-10-25T16:15:54.608952+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:51.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609937+0000","last_change":"2023-10-25T16:15:52.626421+0000","last_active":"2023-10-25T16:15:54.609937+0000","last_peered":"2023-10-25T16:15:54.609937+0000","last_clean":"2023-10-25T16:15:54.609937+0000","last_became_active":"2023-10-25T16:15:52.625329+0000","last_became_peered":"2023-10-25T16:15:52.625329+0000","last_unstale":"2023-10-25T16:15:54.609937+0000","last_undegraded":"2023-10-25T16:15:54.609937+0000","last_fullsized":"2023-10-25T16:15:54.609937+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:47.215706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054432+0000","last_change":"2023-10-25T16:15:52.623214+0000","last_active":"2023-10-25T16:15:54.054432+0000","last_peered":"2023-10-25T16:15:54.054432+0000","last_clean":"2023-10-25T16:15:54.054432+0000","last_became_active":"2023-10-25T16:15:52.617066+0000","last_became_peered":"2023-10-25T16:15:52.617066+0000","last_unstale":"2023-10-25T16:15:54.054432+0000","last_undegraded":"2023-10-25T16:15:54.054432+0000","last_fullsized":"2023-10-25T16:15:54.054432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:31:06.060784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411426+0000","last_change":"2023-10-25T16:15:52.633896+0000","last_active":"2023-10-25T16:15:54.411426+0000","last_peered":"2023-10-25T16:15:54.411426+0000","last_clean":"2023-10-25T16:15:54.411426+0000","last_became_active":"2023-10-25T16:15:52.631844+0000","last_became_peered":"2023-10-25T16:15:52.631844+0000","last_unstale":"2023-10-25T16:15:54.411426+0000","last_undegraded":"2023-10-25T16:15:54.411426+0000","last_fullsized":"2023-10-25T16:15:54.411426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:40:53.598179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608912+0000","last_change":"2023-10-25T16:15:52.639923+0000","last_active":"2023-10-25T16:15:53.608912+0000","last_peered":"2023-10-25T16:15:53.608912+0000","last_clean":"2023-10-25T16:15:53.608912+0000","last_became_active":"2023-10-25T16:15:52.638398+0000","last_became_peered":"2023-10-25T16:15:52.638398+0000","last_unstale":"2023-10-25T16:15:53.608912+0000","last_undegraded":"2023-10-25T16:15:53.608912+0000","last_fullsized":"2023-10-25T16:15:53.608912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:43:42.808534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.605976+0000","last_change":"2023-10-25T16:15:52.605509+0000","last_active":"2023-10-25T16:15:54.605976+0000","last_peered":"2023-10-25T16:15:54.605976+0000","last_clean":"2023-10-25T16:15:54.605976+0000","last_became_active":"2023-10-25T16:15:52.604927+0000","last_became_peered":"2023-10-25T16:15:52.604927+0000","last_unstale":"2023-10-25T16:15:54.605976+0000","last_undegraded":"2023-10-25T16:15:54.605976+0000","last_fullsized":"2023-10-25T16:15:54.605976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:16:32.182095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411210+0000","last_change":"2023-10-25T16:15:52.621912+0000","last_active":"2023-10-25T16:15:54.411210+0000","last_peered":"2023-10-25T16:15:54.411210+0000","last_clean":"2023-10-25T16:15:54.411210+0000","last_became_active":"2023-10-25T16:15:52.621222+0000","last_became_peered":"2023-10-25T16:15:52.621222+0000","last_unstale":"2023-10-25T16:15:54.411210+0000","last_undegraded":"2023-10-25T16:15:54.411210+0000","last_fullsized":"2023-10-25T16:15:54.411210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:40.576681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608346+0000","last_change":"2023-10-25T16:15:52.637113+0000","last_active":"2023-10-25T16:15:53.608346+0000","last_peered":"2023-10-25T16:15:53.608346+0000","last_clean":"2023-10-25T16:15:53.608346+0000","last_became_active":"2023-10-25T16:15:52.636597+0000","last_became_peered":"2023-10-25T16:15:52.636597+0000","last_unstale":"2023-10-25T16:15:53.608346+0000","last_undegraded":"2023-10-25T16:15:53.608346+0000","last_fullsized":"2023-10-25T16:15:53.608346+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:24:17.091019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411748+0000","last_change":"2023-10-25T16:15:52.607996+0000","last_active":"2023-10-25T16:15:54.411748+0000","last_peered":"2023-10-25T16:15:54.411748+0000","last_clean":"2023-10-25T16:15:54.411748+0000","last_became_active":"2023-10-25T16:15:52.607376+0000","last_became_peered":"2023-10-25T16:15:52.607376+0000","last_unstale":"2023-10-25T16:15:54.411748+0000","last_undegraded":"2023-10-25T16:15:54.411748+0000","last_fullsized":"2023-10-25T16:15:54.411748+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:11.394146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609108+0000","last_change":"2023-10-25T16:15:52.639207+0000","last_active":"2023-10-25T16:15:53.609108+0000","last_peered":"2023-10-25T16:15:53.609108+0000","last_clean":"2023-10-25T16:15:53.609108+0000","last_became_active":"2023-10-25T16:15:52.630300+0000","last_became_peered":"2023-10-25T16:15:52.630300+0000","last_unstale":"2023-10-25T16:15:53.609108+0000","last_undegraded":"2023-10-25T16:15:53.609108+0000","last_fullsized":"2023-10-25T16:15:53.609108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:26:40.426881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608857+0000","last_change":"2023-10-25T16:15:52.620896+0000","last_active":"2023-10-25T16:15:54.608857+0000","last_peered":"2023-10-25T16:15:54.608857+0000","last_clean":"2023-10-25T16:15:54.608857+0000","last_became_active":"2023-10-25T16:15:52.620271+0000","last_became_peered":"2023-10-25T16:15:52.620271+0000","last_unstale":"2023-10-25T16:15:54.608857+0000","last_undegraded":"2023-10-25T16:15:54.608857+0000","last_fullsized":"2023-10-25T16:15:54.608857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:13:46.208801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607050+0000","last_change":"2023-10-25T16:15:52.624525+0000","last_active":"2023-10-25T16:15:54.607050+0000","last_peered":"2023-10-25T16:15:54.607050+0000","last_clean":"2023-10-25T16:15:54.607050+0000","last_became_active":"2023-10-25T16:15:52.623309+0000","last_became_peered":"2023-10-25T16:15:52.623309+0000","last_unstale":"2023-10-25T16:15:54.607050+0000","last_undegraded":"2023-10-25T16:15:54.607050+0000","last_fullsized":"2023-10-25T16:15:54.607050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:11:57.209746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612639+0000","last_change":"2023-10-25T16:15:52.633474+0000","last_active":"2023-10-25T16:15:53.612639+0000","last_peered":"2023-10-25T16:15:53.612639+0000","last_clean":"2023-10-25T16:15:53.612639+0000","last_became_active":"2023-10-25T16:15:52.630498+0000","last_became_peered":"2023-10-25T16:15:52.630498+0000","last_unstale":"2023-10-25T16:15:53.612639+0000","last_undegraded":"2023-10-25T16:15:53.612639+0000","last_fullsized":"2023-10-25T16:15:53.612639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:24:17.091019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.053932+0000","last_change":"2023-10-25T16:15:52.614274+0000","last_active":"2023-10-25T16:15:54.053932+0000","last_peered":"2023-10-25T16:15:54.053932+0000","last_clean":"2023-10-25T16:15:54.053932+0000","last_became_active":"2023-10-25T16:15:52.613622+0000","last_became_peered":"2023-10-25T16:15:52.613622+0000","last_unstale":"2023-10-25T16:15:54.053932+0000","last_undegraded":"2023-10-25T16:15:54.053932+0000","last_fullsized":"2023-10-25T16:15:54.053932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:19.129188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606378+0000","last_change":"2023-10-25T16:15:52.618545+0000","last_active":"2023-10-25T16:15:54.606378+0000","last_peered":"2023-10-25T16:15:54.606378+0000","last_clean":"2023-10-25T16:15:54.606378+0000","last_became_active":"2023-10-25T16:15:52.617832+0000","last_became_peered":"2023-10-25T16:15:52.617832+0000","last_unstale":"2023-10-25T16:15:54.606378+0000","last_undegraded":"2023-10-25T16:15:54.606378+0000","last_fullsized":"2023-10-25T16:15:54.606378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:45.713269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411093+0000","last_change":"2023-10-25T16:15:52.633334+0000","last_active":"2023-10-25T16:15:54.411093+0000","last_peered":"2023-10-25T16:15:54.411093+0000","last_clean":"2023-10-25T16:15:54.411093+0000","last_became_active":"2023-10-25T16:15:52.632706+0000","last_became_peered":"2023-10-25T16:15:52.632706+0000","last_unstale":"2023-10-25T16:15:54.411093+0000","last_undegraded":"2023-10-25T16:15:54.411093+0000","last_fullsized":"2023-10-25T16:15:54.411093+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:34.149121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609397+0000","last_change":"2023-10-25T16:15:52.632146+0000","last_active":"2023-10-25T16:15:53.609397+0000","last_peered":"2023-10-25T16:15:53.609397+0000","last_clean":"2023-10-25T16:15:53.609397+0000","last_became_active":"2023-10-25T16:15:52.630010+0000","last_became_peered":"2023-10-25T16:15:52.630010+0000","last_unstale":"2023-10-25T16:15:53.609397+0000","last_undegraded":"2023-10-25T16:15:53.609397+0000","last_fullsized":"2023-10-25T16:15:53.609397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:03:27.584023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607254+0000","last_change":"2023-10-25T16:15:52.623738+0000","last_active":"2023-10-25T16:15:54.607254+0000","last_peered":"2023-10-25T16:15:54.607254+0000","last_clean":"2023-10-25T16:15:54.607254+0000","last_became_active":"2023-10-25T16:15:52.623090+0000","last_became_peered":"2023-10-25T16:15:52.623090+0000","last_unstale":"2023-10-25T16:15:54.607254+0000","last_undegraded":"2023-10-25T16:15:54.607254+0000","last_fullsized":"2023-10-25T16:15:54.607254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:17:50.339307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054113+0000","last_change":"2023-10-25T16:15:52.628480+0000","last_active":"2023-10-25T16:15:54.054113+0000","last_peered":"2023-10-25T16:15:54.054113+0000","last_clean":"2023-10-25T16:15:54.054113+0000","last_became_active":"2023-10-25T16:15:52.623222+0000","last_became_peered":"2023-10-25T16:15:52.623222+0000","last_unstale":"2023-10-25T16:15:54.054113+0000","last_undegraded":"2023-10-25T16:15:54.054113+0000","last_fullsized":"2023-10-25T16:15:54.054113+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:52.377618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054069+0000","last_change":"2023-10-25T16:15:52.617729+0000","last_active":"2023-10-25T16:15:54.054069+0000","last_peered":"2023-10-25T16:15:54.054069+0000","last_clean":"2023-10-25T16:15:54.054069+0000","last_became_active":"2023-10-25T16:15:52.617113+0000","last_became_peered":"2023-10-25T16:15:52.617113+0000","last_unstale":"2023-10-25T16:15:54.054069+0000","last_undegraded":"2023-10-25T16:15:54.054069+0000","last_fullsized":"2023-10-25T16:15:54.054069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:30:10.904146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"67'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054210+0000","last_change":"2023-10-25T16:15:51.970773+0000","last_active":"2023-10-25T16:15:54.054210+0000","last_peered":"2023-10-25T16:15:54.054210+0000","last_clean":"2023-10-25T16:15:54.054210+0000","last_became_active":"2023-10-25T16:15:51.970091+0000","last_became_peered":"2023-10-25T16:15:51.970091+0000","last_unstale":"2023-10-25T16:15:54.054210+0000","last_undegraded":"2023-10-25T16:15:54.054210+0000","last_fullsized":"2023-10-25T16:15:54.054210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:58.653040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606713+0000","last_change":"2023-10-25T16:15:52.637445+0000","last_active":"2023-10-25T16:15:54.606713+0000","last_peered":"2023-10-25T16:15:54.606713+0000","last_clean":"2023-10-25T16:15:54.606713+0000","last_became_active":"2023-10-25T16:15:52.636799+0000","last_became_peered":"2023-10-25T16:15:52.636799+0000","last_unstale":"2023-10-25T16:15:54.606713+0000","last_undegraded":"2023-10-25T16:15:54.606713+0000","last_fullsized":"2023-10-25T16:15:54.606713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:44.234367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411642+0000","last_change":"2023-10-25T16:15:51.966500+0000","last_active":"2023-10-25T16:15:54.411642+0000","last_peered":"2023-10-25T16:15:54.411642+0000","last_clean":"2023-10-25T16:15:54.411642+0000","last_became_active":"2023-10-25T16:15:51.966039+0000","last_became_peered":"2023-10-25T16:15:51.966039+0000","last_unstale":"2023-10-25T16:15:54.411642+0000","last_undegraded":"2023-10-25T16:15:54.411642+0000","last_fullsized":"2023-10-25T16:15:54.411642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:26:17.588927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054300+0000","last_change":"2023-10-25T16:15:52.629576+0000","last_active":"2023-10-25T16:15:54.054300+0000","last_peered":"2023-10-25T16:15:54.054300+0000","last_clean":"2023-10-25T16:15:54.054300+0000","last_became_active":"2023-10-25T16:15:52.624616+0000","last_became_peered":"2023-10-25T16:15:52.624616+0000","last_unstale":"2023-10-25T16:15:54.054300+0000","last_undegraded":"2023-10-25T16:15:54.054300+0000","last_fullsized":"2023-10-25T16:15:54.054300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:39.660431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054067+0000","last_change":"2023-10-25T16:15:51.968394+0000","last_active":"2023-10-25T16:15:54.054067+0000","last_peered":"2023-10-25T16:15:54.054067+0000","last_clean":"2023-10-25T16:15:54.054067+0000","last_became_active":"2023-10-25T16:15:51.961599+0000","last_became_peered":"2023-10-25T16:15:51.961599+0000","last_unstale":"2023-10-25T16:15:54.054067+0000","last_undegraded":"2023-10-25T16:15:54.054067+0000","last_fullsized":"2023-10-25T16:15:54.054067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:26.403445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.053912+0000","last_change":"2023-10-25T16:15:52.613126+0000","last_active":"2023-10-25T16:15:54.053912+0000","last_peered":"2023-10-25T16:15:54.053912+0000","last_clean":"2023-10-25T16:15:54.053912+0000","last_became_active":"2023-10-25T16:15:52.611760+0000","last_became_peered":"2023-10-25T16:15:52.611760+0000","last_unstale":"2023-10-25T16:15:54.053912+0000","last_undegraded":"2023-10-25T16:15:54.053912+0000","last_fullsized":"2023-10-25T16:15:54.053912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:02:40.098049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613345+0000","last_change":"2023-10-25T16:15:51.980814+0000","last_active":"2023-10-25T16:15:53.613345+0000","last_peered":"2023-10-25T16:15:53.613345+0000","last_clean":"2023-10-25T16:15:53.613345+0000","last_became_active":"2023-10-25T16:15:51.979823+0000","last_became_peered":"2023-10-25T16:15:51.979823+0000","last_unstale":"2023-10-25T16:15:53.613345+0000","last_undegraded":"2023-10-25T16:15:53.613345+0000","last_fullsized":"2023-10-25T16:15:53.613345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:38.196845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411501+0000","last_change":"2023-10-25T16:15:52.609797+0000","last_active":"2023-10-25T16:15:54.411501+0000","last_peered":"2023-10-25T16:15:54.411501+0000","last_clean":"2023-10-25T16:15:54.411501+0000","last_became_active":"2023-10-25T16:15:52.608364+0000","last_became_peered":"2023-10-25T16:15:52.608364+0000","last_unstale":"2023-10-25T16:15:54.411501+0000","last_undegraded":"2023-10-25T16:15:54.411501+0000","last_fullsized":"2023-10-25T16:15:54.411501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:31.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609373+0000","last_change":"2023-10-25T16:15:51.970429+0000","last_active":"2023-10-25T16:15:54.609373+0000","last_peered":"2023-10-25T16:15:54.609373+0000","last_clean":"2023-10-25T16:15:54.609373+0000","last_became_active":"2023-10-25T16:15:51.968495+0000","last_became_peered":"2023-10-25T16:15:51.968495+0000","last_unstale":"2023-10-25T16:15:54.609373+0000","last_undegraded":"2023-10-25T16:15:54.609373+0000","last_fullsized":"2023-10-25T16:15:54.609373+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:02:15.973995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412060+0000","last_change":"2023-10-25T16:15:52.623796+0000","last_active":"2023-10-25T16:15:54.412060+0000","last_peered":"2023-10-25T16:15:54.412060+0000","last_clean":"2023-10-25T16:15:54.412060+0000","last_became_active":"2023-10-25T16:15:52.622943+0000","last_became_peered":"2023-10-25T16:15:52.622943+0000","last_unstale":"2023-10-25T16:15:54.412060+0000","last_undegraded":"2023-10-25T16:15:54.412060+0000","last_fullsized":"2023-10-25T16:15:54.412060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:30:44.325981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054327+0000","last_change":"2023-10-25T16:15:51.959582+0000","last_active":"2023-10-25T16:15:54.054327+0000","last_peered":"2023-10-25T16:15:54.054327+0000","last_clean":"2023-10-25T16:15:54.054327+0000","last_became_active":"2023-10-25T16:15:51.959038+0000","last_became_peered":"2023-10-25T16:15:51.959038+0000","last_unstale":"2023-10-25T16:15:54.054327+0000","last_undegraded":"2023-10-25T16:15:54.054327+0000","last_fullsized":"2023-10-25T16:15:54.054327+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:03:26.572683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609926+0000","last_change":"2023-10-25T16:15:52.634102+0000","last_active":"2023-10-25T16:15:54.609926+0000","last_peered":"2023-10-25T16:15:54.609926+0000","last_clean":"2023-10-25T16:15:54.609926+0000","last_became_active":"2023-10-25T16:15:52.633374+0000","last_became_peered":"2023-10-25T16:15:52.633374+0000","last_unstale":"2023-10-25T16:15:54.609926+0000","last_undegraded":"2023-10-25T16:15:54.609926+0000","last_fullsized":"2023-10-25T16:15:54.609926+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:55.579915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613399+0000","last_change":"2023-10-25T16:15:51.974357+0000","last_active":"2023-10-25T16:15:53.613399+0000","last_peered":"2023-10-25T16:15:53.613399+0000","last_clean":"2023-10-25T16:15:53.613399+0000","last_became_active":"2023-10-25T16:15:51.973812+0000","last_became_peered":"2023-10-25T16:15:51.973812+0000","last_unstale":"2023-10-25T16:15:53.613399+0000","last_undegraded":"2023-10-25T16:15:53.613399+0000","last_fullsized":"2023-10-25T16:15:53.613399+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:05:16.495909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411412+0000","last_change":"2023-10-25T16:15:52.626999+0000","last_active":"2023-10-25T16:15:54.411412+0000","last_peered":"2023-10-25T16:15:54.411412+0000","last_clean":"2023-10-25T16:15:54.411412+0000","last_became_active":"2023-10-25T16:15:52.626177+0000","last_became_peered":"2023-10-25T16:15:52.626177+0000","last_unstale":"2023-10-25T16:15:54.411412+0000","last_undegraded":"2023-10-25T16:15:54.411412+0000","last_fullsized":"2023-10-25T16:15:54.411412+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:35.904712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.610045+0000","last_change":"2023-10-25T16:15:51.969582+0000","last_active":"2023-10-25T16:15:54.610045+0000","last_peered":"2023-10-25T16:15:54.610045+0000","last_clean":"2023-10-25T16:15:54.610045+0000","last_became_active":"2023-10-25T16:15:51.968834+0000","last_became_peered":"2023-10-25T16:15:51.968834+0000","last_unstale":"2023-10-25T16:15:54.610045+0000","last_undegraded":"2023-10-25T16:15:54.610045+0000","last_fullsized":"2023-10-25T16:15:54.610045+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:54:42.459216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609130+0000","last_change":"2023-10-25T16:15:52.621581+0000","last_active":"2023-10-25T16:15:54.609130+0000","last_peered":"2023-10-25T16:15:54.609130+0000","last_clean":"2023-10-25T16:15:54.609130+0000","last_became_active":"2023-10-25T16:15:52.620300+0000","last_became_peered":"2023-10-25T16:15:52.620300+0000","last_unstale":"2023-10-25T16:15:54.609130+0000","last_undegraded":"2023-10-25T16:15:54.609130+0000","last_fullsized":"2023-10-25T16:15:54.609130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:12:56.777650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609712+0000","last_change":"2023-10-25T16:15:51.958227+0000","last_active":"2023-10-25T16:15:53.609712+0000","last_peered":"2023-10-25T16:15:53.609712+0000","last_clean":"2023-10-25T16:15:53.609712+0000","last_became_active":"2023-10-25T16:15:51.957511+0000","last_became_peered":"2023-10-25T16:15:51.957511+0000","last_unstale":"2023-10-25T16:15:53.609712+0000","last_undegraded":"2023-10-25T16:15:53.609712+0000","last_fullsized":"2023-10-25T16:15:53.609712+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:12:55.766311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608932+0000","last_change":"2023-10-25T16:15:52.631942+0000","last_active":"2023-10-25T16:15:53.608932+0000","last_peered":"2023-10-25T16:15:53.608932+0000","last_clean":"2023-10-25T16:15:53.608932+0000","last_became_active":"2023-10-25T16:15:52.630669+0000","last_became_peered":"2023-10-25T16:15:52.630669+0000","last_unstale":"2023-10-25T16:15:53.608932+0000","last_undegraded":"2023-10-25T16:15:53.608932+0000","last_fullsized":"2023-10-25T16:15:53.608932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.414785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.413482+0000","last_change":"2023-10-25T16:15:51.972897+0000","last_active":"2023-10-25T16:15:54.413482+0000","last_peered":"2023-10-25T16:15:54.413482+0000","last_clean":"2023-10-25T16:15:54.413482+0000","last_became_active":"2023-10-25T16:15:51.971560+0000","last_became_peered":"2023-10-25T16:15:51.971560+0000","last_unstale":"2023-10-25T16:15:54.413482+0000","last_undegraded":"2023-10-25T16:15:54.413482+0000","last_fullsized":"2023-10-25T16:15:54.413482+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:10:03.372639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606407+0000","last_change":"2023-10-25T16:15:52.616913+0000","last_active":"2023-10-25T16:15:54.606407+0000","last_peered":"2023-10-25T16:15:54.606407+0000","last_clean":"2023-10-25T16:15:54.606407+0000","last_became_active":"2023-10-25T16:15:52.616278+0000","last_became_peered":"2023-10-25T16:15:52.616278+0000","last_unstale":"2023-10-25T16:15:54.606407+0000","last_undegraded":"2023-10-25T16:15:54.606407+0000","last_fullsized":"2023-10-25T16:15:54.606407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:19.020570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"67'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609449+0000","last_change":"2023-10-25T16:15:51.977470+0000","last_active":"2023-10-25T16:15:53.609449+0000","last_peered":"2023-10-25T16:15:53.609449+0000","last_clean":"2023-10-25T16:15:53.609449+0000","last_became_active":"2023-10-25T16:15:51.975996+0000","last_became_peered":"2023-10-25T16:15:51.975996+0000","last_unstale":"2023-10-25T16:15:53.609449+0000","last_undegraded":"2023-10-25T16:15:53.609449+0000","last_fullsized":"2023-10-25T16:15:53.609449+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:13:48.984461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609307+0000","last_change":"2023-10-25T16:15:52.639570+0000","last_active":"2023-10-25T16:15:53.609307+0000","last_peered":"2023-10-25T16:15:53.609307+0000","last_clean":"2023-10-25T16:15:53.609307+0000","last_became_active":"2023-10-25T16:15:52.637582+0000","last_became_peered":"2023-10-25T16:15:52.637582+0000","last_unstale":"2023-10-25T16:15:53.609307+0000","last_undegraded":"2023-10-25T16:15:53.609307+0000","last_fullsized":"2023-10-25T16:15:53.609307+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:50:34.374386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"67'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609263+0000","last_change":"2023-10-25T16:15:51.972364+0000","last_active":"2023-10-25T16:15:54.609263+0000","last_peered":"2023-10-25T16:15:54.609263+0000","last_clean":"2023-10-25T16:15:54.609263+0000","last_became_active":"2023-10-25T16:15:51.963233+0000","last_became_peered":"2023-10-25T16:15:51.963233+0000","last_unstale":"2023-10-25T16:15:54.609263+0000","last_undegraded":"2023-10-25T16:15:54.609263+0000","last_fullsized":"2023-10-25T16:15:54.609263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:18:07.528276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612976+0000","last_change":"2023-10-25T16:15:52.634000+0000","last_active":"2023-10-25T16:15:53.612976+0000","last_peered":"2023-10-25T16:15:53.612976+0000","last_clean":"2023-10-25T16:15:53.612976+0000","last_became_active":"2023-10-25T16:15:52.632790+0000","last_became_peered":"2023-10-25T16:15:52.632790+0000","last_unstale":"2023-10-25T16:15:53.612976+0000","last_undegraded":"2023-10-25T16:15:53.612976+0000","last_fullsized":"2023-10-25T16:15:53.612976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:11.374429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411593+0000","last_change":"2023-10-25T16:15:51.965621+0000","last_active":"2023-10-25T16:15:54.411593+0000","last_peered":"2023-10-25T16:15:54.411593+0000","last_clean":"2023-10-25T16:15:54.411593+0000","last_became_active":"2023-10-25T16:15:51.965212+0000","last_became_peered":"2023-10-25T16:15:51.965212+0000","last_unstale":"2023-10-25T16:15:54.411593+0000","last_undegraded":"2023-10-25T16:15:54.411593+0000","last_fullsized":"2023-10-25T16:15:54.411593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:18.117848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609064+0000","last_change":"2023-10-25T16:15:52.637053+0000","last_active":"2023-10-25T16:15:53.609064+0000","last_peered":"2023-10-25T16:15:53.609064+0000","last_clean":"2023-10-25T16:15:53.609064+0000","last_became_active":"2023-10-25T16:15:52.631221+0000","last_became_peered":"2023-10-25T16:15:52.631221+0000","last_unstale":"2023-10-25T16:15:53.609064+0000","last_undegraded":"2023-10-25T16:15:53.609064+0000","last_fullsized":"2023-10-25T16:15:53.609064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:30.715703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609325+0000","last_change":"2023-10-25T16:15:51.967878+0000","last_active":"2023-10-25T16:15:54.609325+0000","last_peered":"2023-10-25T16:15:54.609325+0000","last_clean":"2023-10-25T16:15:54.609325+0000","last_became_active":"2023-10-25T16:15:51.967265+0000","last_became_peered":"2023-10-25T16:15:51.967265+0000","last_unstale":"2023-10-25T16:15:54.609325+0000","last_undegraded":"2023-10-25T16:15:54.609325+0000","last_fullsized":"2023-10-25T16:15:54.609325+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:48:25.018018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.608832+0000","last_change":"2023-10-25T16:15:52.629563+0000","last_active":"2023-10-25T16:15:54.608832+0000","last_peered":"2023-10-25T16:15:54.608832+0000","last_clean":"2023-10-25T16:15:54.608832+0000","last_became_active":"2023-10-25T16:15:52.628947+0000","last_became_peered":"2023-10-25T16:15:52.628947+0000","last_unstale":"2023-10-25T16:15:54.608832+0000","last_undegraded":"2023-10-25T16:15:54.608832+0000","last_fullsized":"2023-10-25T16:15:54.608832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:59:54.959266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613136+0000","last_change":"2023-10-25T16:15:51.969116+0000","last_active":"2023-10-25T16:15:53.613136+0000","last_peered":"2023-10-25T16:15:53.613136+0000","last_clean":"2023-10-25T16:15:53.613136+0000","last_became_active":"2023-10-25T16:15:51.968440+0000","last_became_peered":"2023-10-25T16:15:51.968440+0000","last_unstale":"2023-10-25T16:15:53.613136+0000","last_undegraded":"2023-10-25T16:15:53.613136+0000","last_fullsized":"2023-10-25T16:15:53.613136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:40.630685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608655+0000","last_change":"2023-10-25T16:15:52.627816+0000","last_active":"2023-10-25T16:15:53.608655+0000","last_peered":"2023-10-25T16:15:53.608655+0000","last_clean":"2023-10-25T16:15:53.608655+0000","last_became_active":"2023-10-25T16:15:52.624423+0000","last_became_peered":"2023-10-25T16:15:52.624423+0000","last_unstale":"2023-10-25T16:15:53.608655+0000","last_undegraded":"2023-10-25T16:15:53.608655+0000","last_fullsized":"2023-10-25T16:15:53.608655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:11.374429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"67'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609583+0000","last_change":"2023-10-25T16:15:51.965247+0000","last_active":"2023-10-25T16:15:53.609583+0000","last_peered":"2023-10-25T16:15:53.609583+0000","last_clean":"2023-10-25T16:15:53.609583+0000","last_became_active":"2023-10-25T16:15:51.963323+0000","last_became_peered":"2023-10-25T16:15:51.963323+0000","last_unstale":"2023-10-25T16:15:53.609583+0000","last_undegraded":"2023-10-25T16:15:53.609583+0000","last_fullsized":"2023-10-25T16:15:53.609583+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:32.126594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.608549+0000","last_change":"2023-10-25T16:15:52.630627+0000","last_active":"2023-10-25T16:15:53.608549+0000","last_peered":"2023-10-25T16:15:53.608549+0000","last_clean":"2023-10-25T16:15:53.608549+0000","last_became_active":"2023-10-25T16:15:52.622637+0000","last_became_peered":"2023-10-25T16:15:52.622637+0000","last_unstale":"2023-10-25T16:15:53.608549+0000","last_undegraded":"2023-10-25T16:15:53.608549+0000","last_fullsized":"2023-10-25T16:15:53.608549+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:25.446910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411871+0000","last_change":"2023-10-25T16:15:51.966313+0000","last_active":"2023-10-25T16:15:54.411871+0000","last_peered":"2023-10-25T16:15:54.411871+0000","last_clean":"2023-10-25T16:15:54.411871+0000","last_became_active":"2023-10-25T16:15:51.965497+0000","last_became_peered":"2023-10-25T16:15:51.965497+0000","last_unstale":"2023-10-25T16:15:54.411871+0000","last_undegraded":"2023-10-25T16:15:54.411871+0000","last_fullsized":"2023-10-25T16:15:54.411871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:26.507051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612324+0000","last_change":"2023-10-25T16:15:52.638878+0000","last_active":"2023-10-25T16:15:53.612324+0000","last_peered":"2023-10-25T16:15:53.612324+0000","last_clean":"2023-10-25T16:15:53.612324+0000","last_became_active":"2023-10-25T16:15:52.636817+0000","last_became_peered":"2023-10-25T16:15:52.636817+0000","last_unstale":"2023-10-25T16:15:53.612324+0000","last_undegraded":"2023-10-25T16:15:53.612324+0000","last_fullsized":"2023-10-25T16:15:53.612324+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:13:49.995800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054134+0000","last_change":"2023-10-25T16:15:51.961191+0000","last_active":"2023-10-25T16:15:54.054134+0000","last_peered":"2023-10-25T16:15:54.054134+0000","last_clean":"2023-10-25T16:15:54.054134+0000","last_became_active":"2023-10-25T16:15:51.960542+0000","last_became_peered":"2023-10-25T16:15:51.960542+0000","last_unstale":"2023-10-25T16:15:54.054134+0000","last_undegraded":"2023-10-25T16:15:54.054134+0000","last_fullsized":"2023-10-25T16:15:54.054134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:26:39.415542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412363+0000","last_change":"2023-10-25T16:15:52.613123+0000","last_active":"2023-10-25T16:15:54.412363+0000","last_peered":"2023-10-25T16:15:54.412363+0000","last_clean":"2023-10-25T16:15:54.412363+0000","last_became_active":"2023-10-25T16:15:52.612376+0000","last_became_peered":"2023-10-25T16:15:52.612376+0000","last_unstale":"2023-10-25T16:15:54.412363+0000","last_undegraded":"2023-10-25T16:15:54.412363+0000","last_fullsized":"2023-10-25T16:15:54.412363+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:31:14.837507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"67'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613518+0000","last_change":"2023-10-25T16:15:51.980450+0000","last_active":"2023-10-25T16:15:53.613518+0000","last_peered":"2023-10-25T16:15:53.613518+0000","last_clean":"2023-10-25T16:15:53.613518+0000","last_became_active":"2023-10-25T16:15:51.978882+0000","last_became_peered":"2023-10-25T16:15:51.978882+0000","last_unstale":"2023-10-25T16:15:53.613518+0000","last_undegraded":"2023-10-25T16:15:53.613518+0000","last_fullsized":"2023-10-25T16:15:53.613518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:38.374549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609200+0000","last_change":"2023-10-25T16:15:52.635388+0000","last_active":"2023-10-25T16:15:53.609200+0000","last_peered":"2023-10-25T16:15:53.609200+0000","last_clean":"2023-10-25T16:15:53.609200+0000","last_became_active":"2023-10-25T16:15:52.631418+0000","last_became_peered":"2023-10-25T16:15:52.631418+0000","last_unstale":"2023-10-25T16:15:53.609200+0000","last_undegraded":"2023-10-25T16:15:53.609200+0000","last_fullsized":"2023-10-25T16:15:53.609200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:42:24.857206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054295+0000","last_change":"2023-10-25T16:15:51.971546+0000","last_active":"2023-10-25T16:15:54.054295+0000","last_peered":"2023-10-25T16:15:54.054295+0000","last_clean":"2023-10-25T16:15:54.054295+0000","last_became_active":"2023-10-25T16:15:51.971268+0000","last_became_peered":"2023-10-25T16:15:51.971268+0000","last_unstale":"2023-10-25T16:15:54.054295+0000","last_undegraded":"2023-10-25T16:15:54.054295+0000","last_fullsized":"2023-10-25T16:15:54.054295+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:24.435570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612894+0000","last_change":"2023-10-25T16:15:52.638149+0000","last_active":"2023-10-25T16:15:53.612894+0000","last_peered":"2023-10-25T16:15:53.612894+0000","last_clean":"2023-10-25T16:15:53.612894+0000","last_became_active":"2023-10-25T16:15:52.635633+0000","last_became_peered":"2023-10-25T16:15:52.635633+0000","last_unstale":"2023-10-25T16:15:53.612894+0000","last_undegraded":"2023-10-25T16:15:53.612894+0000","last_fullsized":"2023-10-25T16:15:53.612894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:25.446910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412011+0000","last_change":"2023-10-25T16:15:51.965639+0000","last_active":"2023-10-25T16:15:54.412011+0000","last_peered":"2023-10-25T16:15:54.412011+0000","last_clean":"2023-10-25T16:15:54.412011+0000","last_became_active":"2023-10-25T16:15:51.965275+0000","last_became_peered":"2023-10-25T16:15:51.965275+0000","last_unstale":"2023-10-25T16:15:54.412011+0000","last_undegraded":"2023-10-25T16:15:54.412011+0000","last_fullsized":"2023-10-25T16:15:54.412011+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:38.649091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054010+0000","last_change":"2023-10-25T16:15:52.633823+0000","last_active":"2023-10-25T16:15:54.054010+0000","last_peered":"2023-10-25T16:15:54.054010+0000","last_clean":"2023-10-25T16:15:54.054010+0000","last_became_active":"2023-10-25T16:15:52.631985+0000","last_became_peered":"2023-10-25T16:15:52.631985+0000","last_unstale":"2023-10-25T16:15:54.054010+0000","last_undegraded":"2023-10-25T16:15:54.054010+0000","last_fullsized":"2023-10-25T16:15:54.054010+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:02.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606938+0000","last_change":"2023-10-25T16:15:51.964429+0000","last_active":"2023-10-25T16:15:54.606938+0000","last_peered":"2023-10-25T16:15:54.606938+0000","last_clean":"2023-10-25T16:15:54.606938+0000","last_became_active":"2023-10-25T16:15:51.964007+0000","last_became_peered":"2023-10-25T16:15:51.964007+0000","last_unstale":"2023-10-25T16:15:54.606938+0000","last_undegraded":"2023-10-25T16:15:54.606938+0000","last_fullsized":"2023-10-25T16:15:54.606938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:08.305773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054005+0000","last_change":"2023-10-25T16:15:52.635736+0000","last_active":"2023-10-25T16:15:54.054005+0000","last_peered":"2023-10-25T16:15:54.054005+0000","last_clean":"2023-10-25T16:15:54.054005+0000","last_became_active":"2023-10-25T16:15:52.635142+0000","last_became_peered":"2023-10-25T16:15:52.635142+0000","last_unstale":"2023-10-25T16:15:54.054005+0000","last_undegraded":"2023-10-25T16:15:54.054005+0000","last_fullsized":"2023-10-25T16:15:54.054005+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:49:05.157992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.613642+0000","last_change":"2023-10-25T16:15:51.977685+0000","last_active":"2023-10-25T16:15:53.613642+0000","last_peered":"2023-10-25T16:15:53.613642+0000","last_clean":"2023-10-25T16:15:53.613642+0000","last_became_active":"2023-10-25T16:15:51.974351+0000","last_became_peered":"2023-10-25T16:15:51.974351+0000","last_unstale":"2023-10-25T16:15:53.613642+0000","last_undegraded":"2023-10-25T16:15:53.613642+0000","last_fullsized":"2023-10-25T16:15:53.613642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:59:53.947926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612447+0000","last_change":"2023-10-25T16:15:52.630859+0000","last_active":"2023-10-25T16:15:53.612447+0000","last_peered":"2023-10-25T16:15:53.612447+0000","last_clean":"2023-10-25T16:15:53.612447+0000","last_became_active":"2023-10-25T16:15:52.623263+0000","last_became_peered":"2023-10-25T16:15:52.623263+0000","last_unstale":"2023-10-25T16:15:53.612447+0000","last_undegraded":"2023-10-25T16:15:53.612447+0000","last_fullsized":"2023-10-25T16:15:53.612447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:33.137933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"67'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606716+0000","last_change":"2023-10-25T16:15:51.970511+0000","last_active":"2023-10-25T16:15:54.606716+0000","last_peered":"2023-10-25T16:15:54.606716+0000","last_clean":"2023-10-25T16:15:54.606716+0000","last_became_active":"2023-10-25T16:15:51.970189+0000","last_became_peered":"2023-10-25T16:15:51.970189+0000","last_unstale":"2023-10-25T16:15:54.606716+0000","last_undegraded":"2023-10-25T16:15:54.606716+0000","last_fullsized":"2023-10-25T16:15:54.606716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:43.170472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612918+0000","last_change":"2023-10-25T16:15:52.617117+0000","last_active":"2023-10-25T16:15:53.612918+0000","last_peered":"2023-10-25T16:15:53.612918+0000","last_clean":"2023-10-25T16:15:53.612918+0000","last_became_active":"2023-10-25T16:15:52.616258+0000","last_became_peered":"2023-10-25T16:15:52.616258+0000","last_unstale":"2023-10-25T16:15:53.612918+0000","last_undegraded":"2023-10-25T16:15:53.612918+0000","last_fullsized":"2023-10-25T16:15:53.612918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:23.760241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.794534+0000","last_change":"2023-10-25T16:15:51.959339+0000","last_active":"2023-10-25T16:15:54.794534+0000","last_peered":"2023-10-25T16:15:54.794534+0000","last_clean":"2023-10-25T16:15:54.794534+0000","last_became_active":"2023-10-25T16:15:51.958596+0000","last_became_peered":"2023-10-25T16:15:51.958596+0000","last_unstale":"2023-10-25T16:15:54.794534+0000","last_undegraded":"2023-10-25T16:15:54.794534+0000","last_fullsized":"2023-10-25T16:15:54.794534+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:11:35.435666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607562+0000","last_change":"2023-10-25T16:15:52.628647+0000","last_active":"2023-10-25T16:15:54.607562+0000","last_peered":"2023-10-25T16:15:54.607562+0000","last_clean":"2023-10-25T16:15:54.607562+0000","last_became_active":"2023-10-25T16:15:52.626298+0000","last_became_peered":"2023-10-25T16:15:52.626298+0000","last_unstale":"2023-10-25T16:15:54.607562+0000","last_undegraded":"2023-10-25T16:15:54.607562+0000","last_fullsized":"2023-10-25T16:15:54.607562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:55.579915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609086+0000","last_change":"2023-10-25T16:15:51.956478+0000","last_active":"2023-10-25T16:15:54.609086+0000","last_peered":"2023-10-25T16:15:54.609086+0000","last_clean":"2023-10-25T16:15:54.609086+0000","last_became_active":"2023-10-25T16:15:51.955782+0000","last_became_peered":"2023-10-25T16:15:51.955782+0000","last_unstale":"2023-10-25T16:15:54.609086+0000","last_undegraded":"2023-10-25T16:15:54.609086+0000","last_fullsized":"2023-10-25T16:15:54.609086+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:43.223028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.054196+0000","last_change":"2023-10-25T16:15:52.636629+0000","last_active":"2023-10-25T16:15:54.054196+0000","last_peered":"2023-10-25T16:15:54.054196+0000","last_clean":"2023-10-25T16:15:54.054196+0000","last_became_active":"2023-10-25T16:15:52.635903+0000","last_became_peered":"2023-10-25T16:15:52.635903+0000","last_unstale":"2023-10-25T16:15:54.054196+0000","last_undegraded":"2023-10-25T16:15:54.054196+0000","last_fullsized":"2023-10-25T16:15:54.054196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:27.518390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.612816+0000","last_change":"2023-10-25T16:15:51.969506+0000","last_active":"2023-10-25T16:15:53.612816+0000","last_peered":"2023-10-25T16:15:53.612816+0000","last_clean":"2023-10-25T16:15:53.612816+0000","last_became_active":"2023-10-25T16:15:51.968901+0000","last_became_peered":"2023-10-25T16:15:51.968901+0000","last_unstale":"2023-10-25T16:15:53.612816+0000","last_undegraded":"2023-10-25T16:15:53.612816+0000","last_fullsized":"2023-10-25T16:15:53.612816+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:54:42.459216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412822+0000","last_change":"2023-10-25T16:15:52.632630+0000","last_active":"2023-10-25T16:15:54.412822+0000","last_peered":"2023-10-25T16:15:54.412822+0000","last_clean":"2023-10-25T16:15:54.412822+0000","last_became_active":"2023-10-25T16:15:52.626288+0000","last_became_peered":"2023-10-25T16:15:52.626288+0000","last_unstale":"2023-10-25T16:15:54.412822+0000","last_undegraded":"2023-10-25T16:15:54.412822+0000","last_fullsized":"2023-10-25T16:15:54.412822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:27.700323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.607621+0000","last_change":"2023-10-25T16:15:51.973333+0000","last_active":"2023-10-25T16:15:54.607621+0000","last_peered":"2023-10-25T16:15:54.607621+0000","last_clean":"2023-10-25T16:15:54.607621+0000","last_became_active":"2023-10-25T16:15:51.973055+0000","last_became_peered":"2023-10-25T16:15:51.973055+0000","last_unstale":"2023-10-25T16:15:54.607621+0000","last_undegraded":"2023-10-25T16:15:54.607621+0000","last_fullsized":"2023-10-25T16:15:54.607621+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:03:36.836279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:53.609393+0000","last_change":"2023-10-25T16:15:52.628577+0000","last_active":"2023-10-25T16:15:53.609393+0000","last_peered":"2023-10-25T16:15:53.609393+0000","last_clean":"2023-10-25T16:15:53.609393+0000","last_became_active":"2023-10-25T16:15:52.627825+0000","last_became_peered":"2023-10-25T16:15:52.627825+0000","last_unstale":"2023-10-25T16:15:53.609393+0000","last_undegraded":"2023-10-25T16:15:53.609393+0000","last_fullsized":"2023-10-25T16:15:53.609393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:59.664379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.609589+0000","last_change":"2023-10-25T16:15:51.958576+0000","last_active":"2023-10-25T16:15:54.609589+0000","last_peered":"2023-10-25T16:15:54.609589+0000","last_clean":"2023-10-25T16:15:54.609589+0000","last_became_active":"2023-10-25T16:15:51.957985+0000","last_became_peered":"2023-10-25T16:15:51.957985+0000","last_unstale":"2023-10-25T16:15:54.609589+0000","last_undegraded":"2023-10-25T16:15:54.609589+0000","last_fullsized":"2023-10-25T16:15:54.609589+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:42.688989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606733+0000","last_change":"2023-10-25T16:15:52.630847+0000","last_active":"2023-10-25T16:15:54.606733+0000","last_peered":"2023-10-25T16:15:54.606733+0000","last_clean":"2023-10-25T16:15:54.606733+0000","last_became_active":"2023-10-25T16:15:52.630223+0000","last_became_peered":"2023-10-25T16:15:52.630223+0000","last_unstale":"2023-10-25T16:15:54.606733+0000","last_undegraded":"2023-10-25T16:15:54.606733+0000","last_fullsized":"2023-10-25T16:15:54.606733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:24.074397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.606919+0000","last_change":"2023-10-25T16:15:51.960127+0000","last_active":"2023-10-25T16:15:54.606919+0000","last_peered":"2023-10-25T16:15:54.606919+0000","last_clean":"2023-10-25T16:15:54.606919+0000","last_became_active":"2023-10-25T16:15:51.959784+0000","last_became_peered":"2023-10-25T16:15:51.959784+0000","last_unstale":"2023-10-25T16:15:54.606919+0000","last_undegraded":"2023-10-25T16:15:54.606919+0000","last_fullsized":"2023-10-25T16:15:54.606919+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:11:02.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411801+0000","last_change":"2023-10-25T16:15:52.629558+0000","last_active":"2023-10-25T16:15:54.411801+0000","last_peered":"2023-10-25T16:15:54.411801+0000","last_clean":"2023-10-25T16:15:54.411801+0000","last_became_active":"2023-10-25T16:15:52.628578+0000","last_became_peered":"2023-10-25T16:15:52.628578+0000","last_unstale":"2023-10-25T16:15:54.411801+0000","last_undegraded":"2023-10-25T16:15:54.411801+0000","last_fullsized":"2023-10-25T16:15:54.411801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:32.388491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.412072+0000","last_change":"2023-10-25T16:15:51.970258+0000","last_active":"2023-10-25T16:15:54.412072+0000","last_peered":"2023-10-25T16:15:54.412072+0000","last_clean":"2023-10-25T16:15:54.412072+0000","last_became_active":"2023-10-25T16:15:51.969827+0000","last_became_peered":"2023-10-25T16:15:51.969827+0000","last_unstale":"2023-10-25T16:15:54.412072+0000","last_undegraded":"2023-10-25T16:15:54.412072+0000","last_fullsized":"2023-10-25T16:15:54.412072+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:31:05.049444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.411805+0000","last_change":"2023-10-25T16:15:52.623754+0000","last_active":"2023-10-25T16:15:54.411805+0000","last_peered":"2023-10-25T16:15:54.411805+0000","last_clean":"2023-10-25T16:15:54.411805+0000","last_became_active":"2023-10-25T16:15:52.623085+0000","last_became_peered":"2023-10-25T16:15:52.623085+0000","last_unstale":"2023-10-25T16:15:54.411805+0000","last_undegraded":"2023-10-25T16:15:54.411805+0000","last_fullsized":"2023-10-25T16:15:54.411805+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:51.925371+0000","last_clean_scrub_stamp":"2023-10-25T16:15:51.925371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:28:19.961314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-25T16:15:54.610148+0000","last_change":"2023-10-25T16:15:51.966207+0000","last_active":"2023-10-25T16:15:54.610148+0000","last_peered":"2023-10-25T16:15:54.610148+0000","last_clean":"2023-10-25T16:15:54.610148+0000","last_became_active":"2023-10-25T16:15:51.965597+0000","last_became_peered":"2023-10-25T16:15:51.965597+0000","last_unstale":"2023-10-25T16:15:54.610148+0000","last_undegraded":"2023-10-25T16:15:54.610148+0000","last_fullsized":"2023-10-25T16:15:54.610148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:15:50.914031+0000","last_clean_scrub_stamp":"2023-10-25T16:15:50.914031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:18.009230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-25T16:15:52.607211+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:15:52.607211+0000","last_peered":"2023-10-25T16:15:52.607211+0000","last_clean":"2023-10-25T16:15:52.607211+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:15:52.607211+0000","last_undegraded":"2023-10-25T16:15:52.607211+0000","last_fullsized":"2023-10-25T16:15:52.607211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:51.052641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199649031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.25600000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.504}]},{"osd":1,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1220000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93400000000000005,"5min":1.089,"15min":1.089},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78900000000000003,"15min":0.78500000000000003},"min":{"1min":0.47199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.96699999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.82899999999999996,"15min":0.82599999999999996},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.91000000000000003,"15min":0.91700000000000004},"min":{"1min":0.53800000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.401,"5min":1.581,"15min":1.581},"last":0.754}]},{"osd":6,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.872,"15min":0.86799999999999999},"min":{"1min":0.625,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.306,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90900000000000003,"15min":0.90700000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3320000000000001,"5min":1.677,"15min":1.677},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3080000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.92100000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":919,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194393,"statfs":{"total":200000000,"available":199058559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.0740000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.876,"15min":0.873},"min":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.121},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":0.88900000000000001},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.149,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.99299999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.81399999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.27},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.80100000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.97099999999999997,"15min":0.97499999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1899999999999999,"5min":1.304,"15min":1.304},"last":1.3740000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1899999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.86099999999999999},"min":{"1min":0.58699999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.627},{"interface":"front","average":{"1min":0.95299999999999996,"5min":1.0149999999999999,"15min":1.0249999999999999},"min":{"1min":0.66900000000000004,"5min":0.622,"15min":0.622},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.873}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0629999999999999,"15min":1.069},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.036,"15min":1.0409999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.25,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.753}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1499999999999999,"15min":1.155},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.323},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.79900000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2230000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199649087,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.86699999999999999,"15min":0.85999999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.89600000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2470000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.89100000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.88200000000000001,"15min":0.878},"min":{"1min":0.60699999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.872,"15min":0.85999999999999999},"min":{"1min":0.66900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.238,"5min":1.476,"15min":1.476},"last":1.056},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.879,"15min":0.86899999999999999},"min":{"1min":0.57299999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1819999999999999,"5min":1.196,"15min":1.196},"last":0.74299999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91700000000000004,"15min":0.91600000000000004},"min":{"1min":0.63200000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.175,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.052,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.556,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.113}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.94899999999999995,"15min":0.95599999999999996},"min":{"1min":0.57399999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2629999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.98499999999999999,"15min":0.999},"min":{"1min":0.66400000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.413,"15min":1.413},"last":0.76700000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.96399999999999997,"15min":0.96499999999999997},"min":{"1min":0.72599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3029999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0620000000000001,"15min":1.056},"min":{"1min":0.76700000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2509999999999999,"5min":1.895,"15min":1.895},"last":1.1579999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0740000000000001,"15min":1.0760000000000001},"min":{"1min":0.76700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4339999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0329999999999999,"15min":1.0269999999999999},"min":{"1min":0.82199999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.93400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":343,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199648435,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":1.365,"15min":1.45},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.202,"5min":14.843,"15min":14.843},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":1.5189999999999999,"15min":1.6299999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2410000000000001,"5min":16.439,"15min":16.439},"last":0.86199999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.4370000000000001,"15min":1.5289999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.86499999999999999,"15min":0.86099999999999999},"min":{"1min":0.621,"5min":0.496,"15min":0.496},"max":{"1min":1.153,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.92500000000000004,"15min":0.93799999999999994},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.119,"5min":1.226,"15min":1.226},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.95899999999999996,"15min":0.96299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2509999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.73599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1950000000000001,"5min":1.252,"15min":1.252},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.034,"5min":1.524,"15min":1.6060000000000001},"min":{"1min":0.66500000000000004,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.365,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.0329999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.629,"15min":1.73},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.288,"5min":15.904,"15min":15.904},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":1.6439999999999999,"15min":1.768},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.105,"5min":17.219999999999999,"15min":17.219999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.5249999999999999,"15min":1.607},"min":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3009999999999999,"5min":14.567,"15min":14.567},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.73,"15min":1.8340000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4330000000000001,"5min":15.089,"15min":15.089},"last":1.198}]},{"osd":7,"last update":"Wed Oct 25 16:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.7629999999999999,"15min":1.895},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.423,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.998},{"interface":"front","average":{"1min":1.117,"5min":1.2709999999999999,"15min":1.2969999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.3939999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.161}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":344,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194968,"statfs":{"total":200000000,"available":199647475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78900000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1319999999999999,"5min":1.47,"15min":1.47},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.05,"5min":1.262,"15min":1.262},"last":0.64600000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.95699999999999996,"15min":0.93799999999999994},"min":{"1min":0.86299999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.879}]},{"osd":2,"last update":"Wed Oct 25 16:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.419,"15min":1.419},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.90400000000000003,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1799999999999999,"5min":1.369,"15min":1.369},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.64000000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":1.073}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.98099999999999998,"15min":0.98599999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0640000000000001,"15min":1.0629999999999999},"min":{"1min":0.753,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.95099999999999996,"15min":0.94299999999999995},"min":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.113,"15min":1.109},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.84099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199649031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.872,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":1,"5min":1.083,"15min":1.083},"last":0.438}]},{"osd":1,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.0309999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.0569999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.70699999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.66500000000000004,"15min":0.66300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.86599999999999999,"15min":0.86099999999999999},"min":{"1min":0.65500000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.111,"5min":1.23,"15min":1.23},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97999999999999998},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.236,"5min":1.427,"15min":1.427},"last":0.90500000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.92300000000000004,"15min":0.93600000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1399999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93000000000000005,"15min":0.92900000000000005},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.369,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90000000000000002,"15min":0.90200000000000002},"min":{"1min":0.60799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1990000000000001,"5min":1.456,"15min":1.456},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.99299999999999999,"15min":1.0109999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2390000000000001,"5min":1.663,"15min":1.663},"last":0.98999999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.96499999999999997,"15min":0.96099999999999997},"min":{"1min":0.64900000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3180000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.93700000000000006,"15min":0.93500000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.389,"15min":1.389},"last":0.88700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194969,"statfs":{"total":200000000,"available":199648997,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.629,"15min":0.63200000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53000000000000003,"15min":0.53100000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.436},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.624},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.97499999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.73299999999999998,"15min":0.747},"min":{"1min":0.45700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85999999999999999,"5min":1.423,"15min":1.423},"last":0.78800000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.0580000000000001,"15min":0.97999999999999998},"min":{"1min":0.69399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.698,"5min":12.698,"15min":12.698},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.107,"15min":1.0289999999999999},"min":{"1min":0.76800000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":12.721,"5min":12.721,"15min":12.721},"last":0.82799999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91600000000000004,"15min":0.91200000000000003},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.65400000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93100000000000005},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.331,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.999,"5min":1.02,"15min":1.024},"min":{"1min":0.68999999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.581,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.016}]},{"osd":7,"last update":"Wed Oct 25 16:14:57 2023","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.0740000000000001,"15min":0.97399999999999998},"min":{"1min":0.63200000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":14.776,"5min":14.776,"15min":14.776},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.0780000000000001,"15min":1.012},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":10.509,"5min":10.509,"15min":10.509},"last":1.0409999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194391,"statfs":{"total":200000000,"available":199056525,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.69599999999999995,"15min":0.72699999999999998},"min":{"1min":0.314,"5min":0.217,"15min":0.217},"max":{"1min":0.746,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.73299999999999998,"15min":0.76500000000000001},"min":{"1min":0.33000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.95999999999999996,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.41199999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.372,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80000000000000004,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.71199999999999997,"15min":0.72699999999999998},"min":{"1min":0.30099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98799999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.96199999999999997,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.79100000000000004,"15min":0.80300000000000005},"min":{"1min":0.40899999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.161,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.64200000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.103,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.139,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.94099999999999995,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.103,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":0.97499999999999998},"min":{"1min":0.66200000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2350000000000001,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.877,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0740000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:14:58 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.3049999999999999,"15min":1.375},"min":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1819999999999999,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.323,"15min":1.393},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.119,"5min":11.622,"15min":11.622},"last":0.72599999999999998}]}]}],"pool_statfs":[]}} 2023-10-25T16:16:00.758 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:16:00.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:16:00.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/377929116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e00cf830 msgr2=0x7f94e00d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/377929116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e00cf830 0x7f94e00d0e90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f94e00cedd0 tx=0x7f94d801d790 comp rx=0 tx=0).stop 2023-10-25T16:16:00.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/377929116 shutdown_connections 2023-10-25T16:16:00.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/377929116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e00cf830 0x7f94e00d0e90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/377929116 >> v2:172.21.15.184:3300/0 conn(0x7f94e015b780 0x7f94e00ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/377929116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94e015b3a0 0x7f94e00cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/377929116 >> 172.21.15.177:0/377929116 conn(0x7f94e008ac90 msgr2=0x7f94e009a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:00.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/377929116 shutdown_connections 2023-10-25T16:16:00.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/377929116 wait complete. 2023-10-25T16:16:00.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 Processor -- start 2023-10-25T16:16:00.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- start start 2023-10-25T16:16:00.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e00cf830 0x7f94e0150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94e015b3a0 0x7f94e00c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 0x7f94e00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c6540 con 0x7f94e015b780 2023-10-25T16:16:00.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00cad80 con 0x7f94e00cf830 2023-10-25T16:16:00.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00cb060 con 0x7f94e015b3a0 2023-10-25T16:16:00.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 0x7f94e00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 0x7f94e00b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56050/0 (socket says 172.21.15.177:56050) 2023-10-25T16:16:00.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 -- 172.21.15.177:0/4141276525 learned_addr learned my addr 172.21.15.177:0/4141276525 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:00.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94df7fe640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e00cf830 0x7f94e0150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94deffd640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94e015b3a0 0x7f94e00c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 -- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94e015b3a0 msgr2=0x7f94e00c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94e015b3a0 0x7f94e00c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 -- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e00cf830 msgr2=0x7f94e0150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:00.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e00cf830 0x7f94e0150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:00.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 -- 172.21.15.177:0/4141276525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80098e0 con 0x7f94e015b780 2023-10-25T16:16:00.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94df7fe640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e00cf830 0x7f94e0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:00.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94dffff640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 0x7f94e00b3e00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94d801cd70 tx=0x7f94d8003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:00.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80adab0 con 0x7f94e015b780 2023-10-25T16:16:00.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94d80add00 con 0x7f94e015b780 2023-10-25T16:16:00.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80b6670 con 0x7f94e015b780 2023-10-25T16:16:00.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e00c6160 con 0x7f94e015b780 2023-10-25T16:16:00.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.918+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00c5d80 con 0x7f94e015b780 2023-10-25T16:16:00.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.922+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00c5f70 con 0x7f94e015b780 2023-10-25T16:16:00.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.922+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94d80b4040 con 0x7f94e015b780 2023-10-25T16:16:00.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.922+0000 7f94c7fff640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94cc066470 0x7f94cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:00.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.922+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d811efd0 con 0x7f94e015b780 2023-10-25T16:16:00.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.922+0000 7f94df7fe640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94cc066470 0x7f94cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:00.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.922+0000 7f94df7fe640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94cc066470 0x7f94cc068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f94d0005fd0 tx=0x7f94d0005d60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:00.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:00.926+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94d80ec430 con 0x7f94e015b780 2023-10-25T16:16:01.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.134+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f94e004db20 con 0x7f94e015b780 2023-10-25T16:16:01.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94c7fff640 1 -- 172.21.15.177:0/4141276525 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+147 (secure 0 0 0) 0x7f94d80b20e0 con 0x7f94e015b780 2023-10-25T16:16:01.146 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:16:01.146 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:16:01.146 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:16:01.146 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:16:01.147 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:16:01.148 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:16:01.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94cc066470 msgr2=0x7f94cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94cc066470 0x7f94cc068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f94d0005fd0 tx=0x7f94d0005d60 comp rx=0 tx=0).stop 2023-10-25T16:16:01.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 msgr2=0x7f94e00b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 0x7f94e00b3e00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94d801cd70 tx=0x7f94d8003bd0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 shutdown_connections 2023-10-25T16:16:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94cc066470 0x7f94cc068930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94e015b780 0x7f94e00b3e00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94e015b3a0 0x7f94e00c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 --2- 172.21.15.177:0/4141276525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94e00cf830 0x7f94e0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 >> 172.21.15.177:0/4141276525 conn(0x7f94e008ac90 msgr2=0x7f94e0156a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 shutdown_connections 2023-10-25T16:16:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.142+0000 7f94e5fc5640 1 -- 172.21.15.177:0/4141276525 wait complete. 2023-10-25T16:16:01.165 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:16:01.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- 172.21.15.177:0/729658732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f1c004d10 msgr2=0x7f7f1c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 --2- 172.21.15.177:0/729658732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f1c004d10 0x7f7f1c005190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009f10 tx=0x7f7f2801d5f0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f3639e640 1 -- 172.21.15.177:0/729658732 reap_dead start 2023-10-25T16:16:01.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- 172.21.15.177:0/729658732 shutdown_connections 2023-10-25T16:16:01.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- 172.21.15.177:0/729658732 >> 172.21.15.177:0/729658732 conn(0x7f7f30065f40 msgr2=0x7f7f3009a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:01.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- 172.21.15.177:0/729658732 shutdown_connections 2023-10-25T16:16:01.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- 172.21.15.177:0/729658732 wait complete. 2023-10-25T16:16:01.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 Processor -- start 2023-10-25T16:16:01.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- start start 2023-10-25T16:16:01.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 0x7f7f300b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:01.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f300ce460 0x7f7f300b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:01.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f3014d5e0 0x7f7f3014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:01.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f300b7080 con 0x7f7f300ce080 2023-10-25T16:16:01.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3014dfa0 con 0x7f7f300ce460 2023-10-25T16:16:01.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f37e01640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f300b6470 con 0x7f7f3014d5e0 2023-10-25T16:16:01.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 0x7f7f300b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:01.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 0x7f7f300b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56066/0 (socket says 172.21.15.177:56066) 2023-10-25T16:16:01.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 -- 172.21.15.177:0/3188651374 learned_addr learned my addr 172.21.15.177:0/3188651374 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:01.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f3539c640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f300ce460 0x7f7f300b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:01.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f3639e640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f3014d5e0 0x7f7f3014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:01.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 -- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f3014d5e0 msgr2=0x7f7f3014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f3014d5e0 0x7f7f3014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 -- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f300ce460 msgr2=0x7f7f300b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f300ce460 0x7f7f300b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.282+0000 7f7f35b9d640 1 -- 172.21.15.177:0/3188651374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f300b6750 con 0x7f7f300ce080 2023-10-25T16:16:01.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f3639e640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f3014d5e0 0x7f7f3014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:01.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f35b9d640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 0x7f7f300b5e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00f5d0 tx=0x7f7f2c00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:01.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0118a0 con 0x7f7f300ce080 2023-10-25T16:16:01.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f2c011af0 con 0x7f7f300ce080 2023-10-25T16:16:01.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c012470 con 0x7f7f300ce080 2023-10-25T16:16:01.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f300b6a30 con 0x7f7f300ce080 2023-10-25T16:16:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f300ce8e0 con 0x7f7f300ce080 2023-10-25T16:16:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3004daf0 con 0x7f7f300ce080 2023-10-25T16:16:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7f2c0125d0 con 0x7f7f300ce080 2023-10-25T16:16:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f267fc640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f140664a0 0x7f7f14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c087410 con 0x7f7f300ce080 2023-10-25T16:16:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f3539c640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f140664a0 0x7f7f14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:01.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.286+0000 7f7f3539c640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f140664a0 0x7f7f14068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7f301e60e0 tx=0x7f7f200091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:01.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.290+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7f2c054920 con 0x7f7f300ce080 2023-10-25T16:16:01.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f300cbf50 con 0x7f7f300ce080 2023-10-25T16:16:01.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f267fc640 1 -- 172.21.15.177:0/3188651374 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f7f2c020090 con 0x7f7f300ce080 2023-10-25T16:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:16:01.483 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:16:01.483 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:16:01.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f140664a0 msgr2=0x7f7f14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f140664a0 0x7f7f14068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7f301e60e0 tx=0x7f7f200091e0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 msgr2=0x7f7f300b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:01.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 0x7f7f300b5e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00f5d0 tx=0x7f7f2c00fa90 comp rx=0 tx=0).stop 2023-10-25T16:16:01.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 shutdown_connections 2023-10-25T16:16:01.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7f140664a0 0x7f7f14068960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f3014d5e0 0x7f7f3014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f300ce460 0x7f7f300b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 --2- 172.21.15.177:0/3188651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f300ce080 0x7f7f300b5e00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:01.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 >> 172.21.15.177:0/3188651374 conn(0x7f7f30065f40 msgr2=0x7f7f300cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:01.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 shutdown_connections 2023-10-25T16:16:01.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:01.478+0000 7f7f37e01640 1 -- 172.21.15.177:0/3188651374 wait complete. 2023-10-25T16:16:01.902 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:15:52.302005+0000', 'modified': '2023-10-25T16:15:54.310109+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6360}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6360': {'gid': 6360, 'name': 'c', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6835/1610672275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 1610672275}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 1610672275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:16:01.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:16:01.903 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-25T16:16:02.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- 172.21.15.177:0/624202357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d406f570 msgr2=0x7f96d40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/624202357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d406f570 0x7f96d40af5d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009bf0 tx=0x7f96cc01cab0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- 172.21.15.177:0/624202357 shutdown_connections 2023-10-25T16:16:02.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/624202357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d406f570 0x7f96d40af5d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- 172.21.15.177:0/624202357 >> 172.21.15.177:0/624202357 conn(0x7f96d40b2450 msgr2=0x7f96d40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- 172.21.15.177:0/624202357 shutdown_connections 2023-10-25T16:16:02.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- 172.21.15.177:0/624202357 wait complete. 2023-10-25T16:16:02.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 Processor -- start 2023-10-25T16:16:02.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- start start 2023-10-25T16:16:02.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96d406c160 0x7f96d4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d406f570 0x7f96d413af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 0x7f96d40abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40ac440 con 0x7f96d4140cf0 2023-10-25T16:16:02.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4156830 con 0x7f96d406f570 2023-10-25T16:16:02.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96dbf4b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4156b10 con 0x7f96d406c160 2023-10-25T16:16:02.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 0x7f96d40abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 0x7f96d40abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56074/0 (socket says 172.21.15.177:56074) 2023-10-25T16:16:02.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 -- 172.21.15.177:0/2738978514 learned_addr learned my addr 172.21.15.177:0/2738978514 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:02.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 -- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96d406c160 msgr2=0x7f96d4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96d406c160 0x7f96d4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96d406c160 0x7f96d4156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 -- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d406f570 msgr2=0x7f96d413af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d406f570 0x7f96d413af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d406f570 0x7f96d413af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.038+0000 7f96da4e8640 1 -- 172.21.15.177:0/2738978514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc009820 con 0x7f96d4140cf0 2023-10-25T16:16:02.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96da4e8640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 0x7f96d40abf00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f96cc01c520 tx=0x7f96cc0a5820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96ca7fc640 1 -- 172.21.15.177:0/2738978514 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc003b80 con 0x7f96d4140cf0 2023-10-25T16:16:02.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96ca7fc640 1 -- 172.21.15.177:0/2738978514 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96cc003dd0 con 0x7f96d4140cf0 2023-10-25T16:16:02.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d4156df0 con 0x7f96d4140cf0 2023-10-25T16:16:02.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96ca7fc640 1 -- 172.21.15.177:0/2738978514 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc004250 con 0x7f96d4140cf0 2023-10-25T16:16:02.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d41573b0 con 0x7f96d4140cf0 2023-10-25T16:16:02.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96ca7fc640 1 -- 172.21.15.177:0/2738978514 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96cc0a6d50 con 0x7f96d4140cf0 2023-10-25T16:16:02.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96ca7fc640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96b80664a0 0x7f96b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96ca7fc640 1 -- 172.21.15.177:0/2738978514 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96d40cc4e0 con 0x7f96d4140cf0 2023-10-25T16:16:02.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96b80664a0 0x7f96b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96df095000 1 Processor -- start 2023-10-25T16:16:02.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96df095000 1 -- start start 2023-10-25T16:16:02.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.042+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96b80664a0 0x7f96b8068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000f70 tx=0x7f96d0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b619c0 0x55ece6b61da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 0x55ece6b17a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b18360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece690ccc0 con 0x55ece6b622e0 2023-10-25T16:16:02.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece696f920 con 0x55ece6b619c0 2023-10-25T16:16:02.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ece696ce50 con 0x55ece6b17f80 2023-10-25T16:16:02.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 0x55ece6b17a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 0x55ece6b17a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56076/0 (socket says 172.21.15.177:56076) 2023-10-25T16:16:02.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 -- 172.21.15.177:0/2525662803 learned_addr learned my addr 172.21.15.177:0/2525662803 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:02.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b619c0 0x55ece6b61da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 -- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 msgr2=0x55ece6b18360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b18360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 -- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b619c0 msgr2=0x55ece6b61da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b619c0 0x55ece6b61da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 -- 172.21.15.177:0/2525662803 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ece6661890 con 0x55ece6b622e0 2023-10-25T16:16:02.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b619c0 0x55ece6b61da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:02.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 0x55ece6b17a40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f96c4003e00 tx=0x7f96c40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40365f3d62750718 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96b77fe640 1 -- 172.21.15.177:0/2525662803 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400db40 con 0x55ece6b622e0 2023-10-25T16:16:02.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96b77fe640 1 -- 172.21.15.177:0/2525662803 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96c4004510 con 0x55ece6b622e0 2023-10-25T16:16:02.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96b77fe640 1 -- 172.21.15.177:0/2525662803 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40123f0 con 0x55ece6b622e0 2023-10-25T16:16:02.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- 172.21.15.177:0/2525662803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 msgr2=0x55ece6b17a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 0x55ece6b17a40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f96c4003e00 tx=0x7f96c40042c0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- 172.21.15.177:0/2525662803 shutdown_connections 2023-10-25T16:16:02.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b18360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b622e0 0x55ece6b17a40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- 172.21.15.177:0/2525662803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b619c0 0x55ece6b61da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- 172.21.15.177:0/2525662803 >> 172.21.15.177:0/2525662803 conn(0x55ece6b0f2f0 msgr2=0x55ece6b16320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- 172.21.15.177:0/2525662803 shutdown_connections 2023-10-25T16:16:02.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- 172.21.15.177:0/2525662803 wait complete. 2023-10-25T16:16:02.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- start start 2023-10-25T16:16:02.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 Processor -- start 2023-10-25T16:16:02.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 0x55ece6b61410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b619c0 0x55ece6b1d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b1d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece6968740 con 0x55ece6b17f80 2023-10-25T16:16:02.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece6927d10 con 0x55ece6b622e0 2023-10-25T16:16:02.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ece69279b0 con 0x55ece6b619c0 2023-10-25T16:16:02.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 10 client.0 _ll_register_callbacks cb 0x55ece6b036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:16:02.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 0x55ece6b61410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 0x55ece6b61410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56084/0 (socket says 172.21.15.177:56084) 2023-10-25T16:16:02.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 -- 172.21.15.177:0/989501435 learned_addr learned my addr 172.21.15.177:0/989501435 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:02.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96da4e8640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b1d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 -- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b619c0 msgr2=0x55ece6b1d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d94e6640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b619c0 0x55ece6b1d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b619c0 0x55ece6b1d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 -- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 msgr2=0x55ece6b1d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b1d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 -- 172.21.15.177:0/989501435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c4003a30 con 0x55ece6b17f80 2023-10-25T16:16:02.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96da4e8640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b1d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:02.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 0x55ece6b61410 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f96d0003c90 tx=0x7f96d0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be7f3b602c3555b server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:16:02.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96b4ff9640 1 -- 172.21.15.177:0/989501435 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0021630 con 0x55ece6b17f80 2023-10-25T16:16:02.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96b4ff9640 1 -- 172.21.15.177:0/989501435 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96d0020a80 con 0x55ece6b17f80 2023-10-25T16:16:02.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.046+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ece691c370 con 0x55ece6b17f80 2023-10-25T16:16:02.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 1 -- 172.21.15.177:0/989501435 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96d0020c40 con 0x55ece6b17f80 2023-10-25T16:16:02.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 10 client.6525 fetch_fsmap learned FSMap version 25 2023-10-25T16:16:02.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55ece692a460 con 0x55ece6b17f80 2023-10-25T16:16:02.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 1 -- 172.21.15.177:0/989501435 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55ece691c370 con 0x55ece6b17f80 2023-10-25T16:16:02.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 1 -- 172.21.15.177:0/989501435 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96d0020420 con 0x55ece6b17f80 2023-10-25T16:16:02.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 10 client.6525 fetch_fsmap finished waiting for FSMap version 25 2023-10-25T16:16:02.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 10 client.6525 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-25T16:16:02.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 20 client.6525 populate_metadata read hostname 'smithi177' 2023-10-25T16:16:02.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6b24440 0x55ece6b73a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 4 client.6525 mds_command: new command op to 6360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:16:02.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 --> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ece69022d0 con 0x55ece6b24440 2023-10-25T16:16:02.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96d94e6640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6b24440 0x55ece6b73a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 10 client.6525 ms_handle_connect on v2:172.21.15.177:6834/1610672275 2023-10-25T16:16:02.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96d94e6640 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6b24440 0x55ece6b73a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ca2fc43ae3623df server_cookie=780acd103a107ba6 in_seq=0 out_seq=0 2023-10-25T16:16:02.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 1 -- 172.21.15.177:0/989501435 <== mds.0 v2:172.21.15.177:6834/1610672275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ece69022d0 con 0x55ece6b24440 2023-10-25T16:16:02.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 10 client.6525 handle_command_reply: tid=0 2023-10-25T16:16:02.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 client.6525 shutdown 2023-10-25T16:16:02.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 msgr2=0x55ece6b61410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 0x55ece6b61410 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f96d0003c90 tx=0x7f96d0000ee0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 shutdown_connections 2023-10-25T16:16:02.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6b24440 0x55ece6b73a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b1d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b619c0 0x55ece6b1d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96b4ff9640 0 client.6525 ms_handle_reset on v2:172.21.15.177:6834/1610672275 2023-10-25T16:16:02.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 --2- 172.21.15.177:0/989501435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b17f80 0x55ece6b61410 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 >> 172.21.15.177:0/989501435 conn(0x55ece6b0f2f0 msgr2=0x55ece6b16a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 shutdown_connections 2023-10-25T16:16:02.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 1 -- 172.21.15.177:0/989501435 wait complete. 2023-10-25T16:16:02.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.050+0000 7f96df095000 20 client.6525 trim_cache size 0 max 16384 2023-10-25T16:16:02.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 Processor -- start 2023-10-25T16:16:02.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- start start 2023-10-25T16:16:02.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b5fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b5ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b71a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece6622940 con 0x55ece6b619c0 2023-10-25T16:16:02.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece69675d0 con 0x55ece6b622e0 2023-10-25T16:16:02.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ece6931720 con 0x55ece6b17f80 2023-10-25T16:16:02.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b5ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b5ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56096/0 (socket says 172.21.15.177:56096) 2023-10-25T16:16:02.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 -- 172.21.15.177:0/4026086576 learned_addr learned my addr 172.21.15.177:0/4026086576 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:02.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 -- 172.21.15.177:0/4026086576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 msgr2=0x55ece6b5fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b5fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 -- 172.21.15.177:0/4026086576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 msgr2=0x55ece6b71a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b71a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 -- 172.21.15.177:0/4026086576 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ece6910760 con 0x55ece6b619c0 2023-10-25T16:16:02.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96d94e6640 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b5ff40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009010 tx=0x7f96c4003750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8230563c5e4d70a server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96b7fff640 1 -- 172.21.15.177:0/4026086576 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4023370 con 0x55ece6b619c0 2023-10-25T16:16:02.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96b7fff640 1 -- 172.21.15.177:0/4026086576 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96c40235c0 con 0x55ece6b619c0 2023-10-25T16:16:02.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96b7fff640 1 -- 172.21.15.177:0/4026086576 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40052a0 con 0x55ece6b619c0 2023-10-25T16:16:02.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- 172.21.15.177:0/4026086576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 msgr2=0x55ece6b5ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b5ff40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009010 tx=0x7f96c4003750 comp rx=0 tx=0).stop 2023-10-25T16:16:02.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- 172.21.15.177:0/4026086576 shutdown_connections 2023-10-25T16:16:02.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b71a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b5ff40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 --2- 172.21.15.177:0/4026086576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b5fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- 172.21.15.177:0/4026086576 >> 172.21.15.177:0/4026086576 conn(0x55ece6b0f2f0 msgr2=0x55ece6b23420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- 172.21.15.177:0/4026086576 shutdown_connections 2023-10-25T16:16:02.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- 172.21.15.177:0/4026086576 wait complete. 2023-10-25T16:16:02.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 -- start start 2023-10-25T16:16:02.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.066+0000 7f96df095000 1 Processor -- start 2023-10-25T16:16:02.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b74ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b7ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b7d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece6b1ad90 con 0x55ece6b619c0 2023-10-25T16:16:02.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ece69640b0 con 0x55ece6b622e0 2023-10-25T16:16:02.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ece66621b0 con 0x55ece6b17f80 2023-10-25T16:16:02.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 10 client.0 _ll_register_callbacks cb 0x55ece6966ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:16:02.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b7ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b7ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56108/0 (socket says 172.21.15.177:56108) 2023-10-25T16:16:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 -- 172.21.15.177:0/2478928161 learned_addr learned my addr 172.21.15.177:0/2478928161 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 -- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 msgr2=0x55ece6b74ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b74ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 -- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 msgr2=0x55ece6b7d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:16:02.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96da4e8640 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b7d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b7d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 -- 172.21.15.177:0/2478928161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ece6661890 con 0x55ece6b619c0 2023-10-25T16:16:02.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d94e6640 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b7ce30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f96c4025040 tx=0x7f96c4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874830150b7afb61 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:16:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 1 -- 172.21.15.177:0/2478928161 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4005240 con 0x55ece6b619c0 2023-10-25T16:16:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 1 -- 172.21.15.177:0/2478928161 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c4021070 con 0x55ece6b619c0 2023-10-25T16:16:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ece6b1a6e0 con 0x55ece6b619c0 2023-10-25T16:16:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 1 -- 172.21.15.177:0/2478928161 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96c4023430 con 0x55ece6b619c0 2023-10-25T16:16:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 10 client.6531 fetch_fsmap learned FSMap version 25 2023-10-25T16:16:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55ece6661cc0 con 0x55ece6b619c0 2023-10-25T16:16:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 1 -- 172.21.15.177:0/2478928161 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55ece6b1a6e0 con 0x55ece6b619c0 2023-10-25T16:16:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 1 -- 172.21.15.177:0/2478928161 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96c40053a0 con 0x55ece6b619c0 2023-10-25T16:16:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 10 client.6531 fetch_fsmap finished waiting for FSMap version 25 2023-10-25T16:16:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 10 client.6531 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-25T16:16:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 20 client.6531 populate_metadata read hostname 'smithi177' 2023-10-25T16:16:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6bc0260 0x55ece6bc0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 4 client.6531 mds_command: new command op to 6360 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:16:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 --> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ece69006f0 con 0x55ece6bc0260 2023-10-25T16:16:02.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6bc0260 0x55ece6bc0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 10 client.6531 ms_handle_connect on v2:172.21.15.177:6834/1610672275 2023-10-25T16:16:02.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96d9ce7640 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6bc0260 0x55ece6bc0640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a471776718e8eea4 server_cookie=9639f47094d89fa8 in_seq=0 out_seq=0 2023-10-25T16:16:02.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 1 -- 172.21.15.177:0/2478928161 <== mds.0 v2:172.21.15.177:6834/1610672275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ece69006f0 con 0x55ece6bc0260 2023-10-25T16:16:02.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 10 client.6531 handle_command_reply: tid=0 2023-10-25T16:16:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 client.6531 shutdown 2023-10-25T16:16:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 msgr2=0x55ece6b7ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b7ce30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f96c4025040 tx=0x7f96c4007db0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 shutdown_connections 2023-10-25T16:16:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:6834/1610672275,v1:172.21.15.177:6835/1610672275] conn(0x55ece6bc0260 0x55ece6bc0640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ece6b622e0 0x55ece6b7d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ece6b619c0 0x55ece6b7ce30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96b4ff9640 0 client.6531 ms_handle_reset on v2:172.21.15.177:6834/1610672275 2023-10-25T16:16:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 --2- 172.21.15.177:0/2478928161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55ece6b17f80 0x55ece6b74ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 >> 172.21.15.177:0/2478928161 conn(0x55ece6b0f2f0 msgr2=0x55ece6b5e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 shutdown_connections 2023-10-25T16:16:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 1 -- 172.21.15.177:0/2478928161 wait complete. 2023-10-25T16:16:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96df095000 20 client.6531 trim_cache size 0 max 16384 2023-10-25T16:16:02.098 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:16:02.099 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:16:02.099 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:16:02.099 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6360, 2023-10-25T16:16:02.099 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:16:02.099 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:16:02.100 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:16:02.100 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1287450480000008, 2023-10-25T16:16:02.100 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 25, 2023-10-25T16:16:02.100 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 68, 2023-10-25T16:16:02.100 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 68, 2023-10-25T16:16:02.101 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 14.780374766 2023-10-25T16:16:02.101 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:16:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96b80664a0 msgr2=0x7f96b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96b80664a0 0x7f96b8068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000f70 tx=0x7f96d0009040 comp rx=0 tx=0).stop 2023-10-25T16:16:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 msgr2=0x7f96d40abf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 0x7f96d40abf00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f96cc01c520 tx=0x7f96cc0a5820 comp rx=0 tx=0).stop 2023-10-25T16:16:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 shutdown_connections 2023-10-25T16:16:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96b80664a0 0x7f96b8068960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d4140cf0 0x7f96d40abf00 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d406f570 0x7f96d413af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 --2- 172.21.15.177:0/2738978514 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96d406c160 0x7f96d4156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 >> 172.21.15.177:0/2738978514 conn(0x7f96d40b2450 msgr2=0x7f96d40cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 shutdown_connections 2023-10-25T16:16:02.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.070+0000 7f96dbf4b640 1 -- 172.21.15.177:0/2738978514 wait complete. 2023-10-25T16:16:02.105 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:16:02.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 -- 172.21.15.177:0/777569931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 msgr2=0x7fe2e80cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/777569931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e80cb130 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009870 tx=0x7fe2d801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 -- 172.21.15.177:0/777569931 shutdown_connections 2023-10-25T16:16:02.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/777569931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2e80cd390 0x7fe2e8159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/777569931 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e80cb130 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 -- 172.21.15.177:0/777569931 >> 172.21.15.177:0/777569931 conn(0x7fe2e80cf0b0 msgr2=0x7fe2e80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 -- 172.21.15.177:0/777569931 shutdown_connections 2023-10-25T16:16:02.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.206+0000 7fe2edaf2640 1 -- 172.21.15.177:0/777569931 wait complete. 2023-10-25T16:16:02.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 Processor -- start 2023-10-25T16:16:02.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- start start 2023-10-25T16:16:02.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2e80cd390 0x7fe2e81531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e815d8e0 0x7fe2e806bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e81526f0 con 0x7fe2e8159420 2023-10-25T16:16:02.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e806b240 con 0x7fe2e815d8e0 2023-10-25T16:16:02.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e814a7a0 con 0x7fe2e80cd390 2023-10-25T16:16:02.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e806b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56122/0 (socket says 172.21.15.177:56122) 2023-10-25T16:16:02.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 -- 172.21.15.177:0/2800899322 learned_addr learned my addr 172.21.15.177:0/2800899322 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:02.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e7fff640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e815d8e0 0x7fe2e806bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e77fe640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2e80cd390 0x7fe2e81531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 -- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2e80cd390 msgr2=0x7fe2e81531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2e80cd390 0x7fe2e81531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 -- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e815d8e0 msgr2=0x7fe2e806bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e815d8e0 0x7fe2e806bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 -- 172.21.15.177:0/2800899322 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80094a0 con 0x7fe2e8159420 2023-10-25T16:16:02.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e7fff640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e815d8e0 0x7fe2e806bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:02.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2e6ffd640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e806b9b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc001ec0 tx=0x7fe2dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0054e0 con 0x7fe2e8159420 2023-10-25T16:16:02.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e81536f0 con 0x7fe2e8159420 2023-10-25T16:16:02.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe2dc003600 con 0x7fe2e8159420 2023-10-25T16:16:02.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc003a10 con 0x7fe2e8159420 2023-10-25T16:16:02.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e8151850 con 0x7fe2e8159420 2023-10-25T16:16:02.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.210+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e809d0a0 con 0x7fe2e8159420 2023-10-25T16:16:02.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.214+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2dc003b70 con 0x7fe2e8159420 2023-10-25T16:16:02.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.214+0000 7fe2cffff640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2d4066470 0x7fe2d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:02.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.214+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2dc083660 con 0x7fe2e8159420 2023-10-25T16:16:02.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.214+0000 7fe2e77fe640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2d4066470 0x7fe2d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:02.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.214+0000 7fe2e77fe640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2d4066470 0x7fe2d4068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80af000 tx=0x7fe2d801b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:02.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.218+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2dc050a50 con 0x7fe2e8159420 2023-10-25T16:16:02.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2e8071cb0 con 0x7fe2e8159420 2023-10-25T16:16:02.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2cffff640 1 -- 172.21.15.177:0/2800899322 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe2dc001130 con 0x7fe2e8159420 2023-10-25T16:16:02.398 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:16:02.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2d4066470 msgr2=0x7fe2d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2d4066470 0x7fe2d4068930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80af000 tx=0x7fe2d801b010 comp rx=0 tx=0).stop 2023-10-25T16:16:02.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 msgr2=0x7fe2e806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:02.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e806b9b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc001ec0 tx=0x7fe2dc00c8e0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 shutdown_connections 2023-10-25T16:16:02.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2d4066470 0x7fe2d4068930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2e815d8e0 0x7fe2e806bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e8159420 0x7fe2e806b9b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 --2- 172.21.15.177:0/2800899322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2e80cd390 0x7fe2e81531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:02.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 >> 172.21.15.177:0/2800899322 conn(0x7fe2e80cf0b0 msgr2=0x7fe2e80cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:02.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 shutdown_connections 2023-10-25T16:16:02.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:02.394+0000 7fe2edaf2640 1 -- 172.21.15.177:0/2800899322 wait complete. 2023-10-25T16:16:02.416 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:16:02.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:16:02.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:16:02.417 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:16:02.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:02.418 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:16:02.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:16:02.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:16:02.419 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:16:02.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.420 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:16:02.426 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:16:02.426 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:16:02.426 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:16:02.427 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.427 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:16:02.427 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.427 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:16:02.427 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:02.428 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:16:02.428 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:16:02.428 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:02.428 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:16:02.428 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:16:02.428 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:02.429 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:16:02.429 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:02.429 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:16:02.429 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42355sec preferred_lft 42355sec 2023-10-25T16:16:02.429 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:16:02.430 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.430 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:16:02.430 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:02.430 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:16:02.430 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.431 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:16:02.431 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:02.431 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:16:02.431 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.431 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:16:02.432 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.432 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:16:02.432 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:02.432 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:16:02.432 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.433 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:16:02.433 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:02.433 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:16:02.433 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:02.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.434 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:16:02.479 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:16:02.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.481 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:16:02.529 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:16:02.529 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:16:02.530 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:16:02.530 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:16:02.530 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:16:02.530 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:16:02.530 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:16:02.531 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:16:02.531 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:16:02.531 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:16:02.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.532 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:16:02.532 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:16:02.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:16:02.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:16:02.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:16:02.534 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:16:02.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.606 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:16:02.653 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:16:02.653 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:16:02.653 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:16:02.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:16:02.708 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:16:02.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:16:02.709 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:02.758 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:16:02.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:16:02.758 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:02.805 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:16:02.854 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:16:02.855 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:16:02.855 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:16:02.855 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:16:02.855 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:16:02.855 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:16:02.856 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:16:02.856 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:16:02.856 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:16:02.856 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:16:02.856 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:16:02.857 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:16:02.857 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:16:02.857 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:16:02.857 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:16:02.857 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:16:02.857 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:16:02.858 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:16:02.858 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:16:02.858 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:16:02.858 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:16:02.858 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:16:02.859 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:16:02.859 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:16:02.859 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:16:02.859 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:16:02.860 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:16:02.860 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:16:02.860 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:16:02.860 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:02.860 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:02.861 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:02.861 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:02.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.862 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:16:02.910 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:16:02.910 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:16:02.954 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:16:02.961 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:16:02.962 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:16:02.962 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:16:02.962 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:16:02.962 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:16:02.963 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:16:02.963 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:16:02.963 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:16:02.963 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:16:02.964 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:16:02.964 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:16:02.964 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:16:02.964 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:16:02.964 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:16:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:16:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:16:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:16:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:16:02.965 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:16:02.966 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:16:02.966 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:16:02.966 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:16:02.966 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:16:02.966 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:16:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:16:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:16:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:16:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:16:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:16:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:02.968 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:02.968 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:02.968 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:02.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:02.970 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:16:03.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:16:03.030+0000 7f34bf5ae580 -1 init, newargv = 0x562f8af493e0 newargc=15 2023-10-25T16:16:03.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[42787]: starting ceph client 2023-10-25T16:16:03.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[42787]: starting fuse 2023-10-25T16:16:04.119 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:16:04.128 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:16:04.129 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:16:04.129 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:16:04.129 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:16:04.129 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:16:04.129 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:16:04.130 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:16:04.130 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:16:04.130 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:16:04.130 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:16:04.133 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:16:04.133 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:16:04.133 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:16:04.133 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:16:04.134 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:16:04.134 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:16:04.134 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:16:04.134 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:16:04.134 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:16:04.135 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:16:04.135 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:16:04.135 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:16:04.135 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:16:04.135 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:16:04.135 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:16:04.136 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:16:04.136 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:16:04.136 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:16:04.136 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:16:04.136 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:16:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:16:04.137 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:04.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:04.139 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:16:04.186 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:16:04.186 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:16:04.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:16:04.187 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:16:04.187 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:16:04.188 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:16:04.188 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:16:04.189 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:04.189 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:16:04.189 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:16:04.190 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:16:04.190 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:16:04.190 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:04.191 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:16:04.191 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:16:04.192 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:16:04.192 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:16:04.193 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:04.193 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:16:04.193 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:16:04.194 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:16:04.194 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:16:04.195 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:16:04.195 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:16:04.195 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:16:04.196 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:16:04.196 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:04.196 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:16:04.197 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:16:04.311 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.42787.asok 2023-10-25T16:16:04.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:04.323 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42787.asok 2023-10-25T16:16:04.324 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:16:04.324 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.42787.asok status 2023-10-25T16:16:04.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:16:04.518 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:16:04.518 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:16:04.518 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:16:04.518 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:16:04.519 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:16:04.519 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:16:04.519 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:16:04.519 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "42787", 2023-10-25T16:16:04.519 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:16:04.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:16:04.520 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:16:04.520 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:16:04.520 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6549, 2023-10-25T16:16:04.520 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:16:04.521 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:16:04.521 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:16:04.521 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 6549 2023-10-25T16:16:04.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:16:04.521 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:16:04.522 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:16:04.522 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:16:04.522 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3584947375 2023-10-25T16:16:04.522 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:16:04.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:16:04.523 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:16:04.523 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:16:04.523 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:16:04.523 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3584947375 2023-10-25T16:16:04.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:16:04.523 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.6549 192.168.0.1:0/3584947375", 2023-10-25T16:16:04.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3584947375", 2023-10-25T16:16:04.524 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:16:04.524 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 25, 2023-10-25T16:16:04.524 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 68, 2023-10-25T16:16:04.524 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:16:04.525 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:16:04.525 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:16:04.525 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:16:04.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:04.538 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:16:04.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:16:04.538 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:04.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:16:04.583 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:16:04.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:04.590 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:04.590 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:16:04.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:16:04.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:16:04.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:04.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:16:04.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/3224613286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006f570 msgr2=0x7f3df00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:04.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 --2- 172.21.15.177:0/3224613286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006f570 0x7f3df00cb5c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009c80 tx=0x7f3de801ccb0 comp rx=0 tx=0).stop 2023-10-25T16:16:04.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/3224613286 shutdown_connections 2023-10-25T16:16:04.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 --2- 172.21.15.177:0/3224613286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006f570 0x7f3df00cb5c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:04.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 --2- 172.21.15.177:0/3224613286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3df006c160 0x7f3df00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:04.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/3224613286 >> 172.21.15.177:0/3224613286 conn(0x7f3df00b2450 msgr2=0x7f3df00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:04.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/3224613286 shutdown_connections 2023-10-25T16:16:04.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/3224613286 wait complete. 2023-10-25T16:16:04.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 Processor -- start 2023-10-25T16:16:04.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- start start 2023-10-25T16:16:04.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 0x7f3df0135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:04.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3df006f570 0x7f3df0155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:04.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3df0140cf0 0x7f3df0135e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:04.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0135cd0 con 0x7f3df006c160 2023-10-25T16:16:04.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df013fa30 con 0x7f3df0140cf0 2023-10-25T16:16:04.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df013fd10 con 0x7f3df006f570 2023-10-25T16:16:04.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 0x7f3df0135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:04.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 0x7f3df0135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56136/0 (socket says 172.21.15.177:56136) 2023-10-25T16:16:04.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 -- 172.21.15.177:0/1311589142 learned_addr learned my addr 172.21.15.177:0/1311589142 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:04.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df4dea640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3df0140cf0 0x7f3df0135e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:04.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 -- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3df006f570 msgr2=0x7f3df0155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:04.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3df006f570 0x7f3df0155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:04.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 -- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3df0140cf0 msgr2=0x7f3df0135e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:04.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3df0140cf0 0x7f3df0135e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:04.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 -- 172.21.15.177:0/1311589142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80098e0 con 0x7f3df006c160 2023-10-25T16:16:04.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3deffff640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 0x7f3df0135790 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3de000b3e0 tx=0x7f3de000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:04.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011830 con 0x7f3df006c160 2023-10-25T16:16:04.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3de0011aa0 con 0x7f3df006c160 2023-10-25T16:16:04.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df013fff0 con 0x7f3df006c160 2023-10-25T16:16:04.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0010380 con 0x7f3df006c160 2023-10-25T16:16:04.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.806+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df01387c0 con 0x7f3df006c160 2023-10-25T16:16:04.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.810+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df01389e0 con 0x7f3df006c160 2023-10-25T16:16:04.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.810+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3de00104e0 con 0x7f3df006c160 2023-10-25T16:16:04.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.810+0000 7f3ded7fa640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dd00664a0 0x7f3dd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:04.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.810+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de00847a0 con 0x7f3df006c160 2023-10-25T16:16:04.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.810+0000 7f3de77fe640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dd00664a0 0x7f3dd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:04.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.810+0000 7f3de77fe640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dd00664a0 0x7f3dd0068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800a8f0 tx=0x7f3dd8005bf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:04.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:04.814+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3de0051cb0 con 0x7f3df006c160 2023-10-25T16:16:05.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.002+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3df004daf0 con 0x7f3df006c160 2023-10-25T16:16:05.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3ded7fa640 1 -- 172.21.15.177:0/1311589142 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3de0015020 con 0x7f3df006c160 2023-10-25T16:16:05.010 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:16:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dd00664a0 msgr2=0x7f3dd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dd00664a0 0x7f3dd0068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800a8f0 tx=0x7f3dd8005bf0 comp rx=0 tx=0).stop 2023-10-25T16:16:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 msgr2=0x7f3df0135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:05.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 0x7f3df0135790 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3de000b3e0 tx=0x7f3de000b8a0 comp rx=0 tx=0).stop 2023-10-25T16:16:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 shutdown_connections 2023-10-25T16:16:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dd00664a0 0x7f3dd0068960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3df0140cf0 0x7f3df0135e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3df006f570 0x7f3df0155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:05.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 --2- 172.21.15.177:0/1311589142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df006c160 0x7f3df0135790 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:05.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 >> 172.21.15.177:0/1311589142 conn(0x7f3df00b2450 msgr2=0x7f3df00afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:05.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 shutdown_connections 2023-10-25T16:16:05.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:05.006+0000 7f3df684d640 1 -- 172.21.15.177:0/1311589142 wait complete. 2023-10-25T16:16:05.028 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:16:05.028 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:16:05.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:16:05.029 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:16:05.029 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:05.030 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:16:05.030 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:16:05.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:16:05.031 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:16:05.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.032 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:16:05.039 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:16:05.039 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:16:05.040 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:16:05.040 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.040 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:16:05.040 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.040 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:16:05.041 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:05.041 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:16:05.041 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:16:05.041 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:05.041 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:16:05.042 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:16:05.042 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:05.042 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:16:05.042 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:05.042 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:16:05.043 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42334sec preferred_lft 42334sec 2023-10-25T16:16:05.043 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:16:05.043 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.043 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:16:05.043 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:05.044 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:16:05.044 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.044 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:16:05.044 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:16:05.044 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:16:05.044 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.045 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:16:05.045 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.045 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:16:05.045 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:05.045 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:16:05.046 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.046 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:16:05.046 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:05.046 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:16:05.046 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:16:05.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.047 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:16:05.095 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:16:05.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.097 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:16:05.147 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:16:05.148 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:16:05.148 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:16:05.148 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:16:05.148 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:16:05.148 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:16:05.149 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:16:05.149 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:16:05.149 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:16:05.149 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:16:05.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.150 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:16:05.151 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:16:05.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:16:05.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:16:05.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:16:05.152 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:16:05.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.227 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:16:05.276 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:16:05.276 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:16:05.277 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:16:05.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.277 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:16:05.331 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:16:05.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:16:05.332 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:05.379 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:16:05.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:16:05.380 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:05.428 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:16:05.476 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:16:05.477 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:16:05.477 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:16:05.477 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:16:05.477 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:16:05.478 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:16:05.478 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:16:05.478 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:16:05.478 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:16:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:16:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:16:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:16:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:16:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:16:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:16:05.480 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:16:05.480 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:16:05.480 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:16:05.480 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:16:05.480 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:16:05.481 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:16:05.481 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:16:05.481 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:16:05.481 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:16:05.481 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:16:05.482 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:16:05.482 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:16:05.482 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:16:05.482 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:16:05.483 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:05.483 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:05.483 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:05.483 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:05.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.485 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:16:05.531 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:16:05.532 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:16:05.580 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:16:05.588 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:16:05.588 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:16:05.588 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:16:05.588 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:16:05.588 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:16:05.589 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:16:05.589 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:16:05.589 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:16:05.589 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:16:05.589 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:16:05.590 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:16:05.590 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:16:05.590 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:16:05.590 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:16:05.590 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:16:05.591 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:16:05.591 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:16:05.591 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:16:05.591 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:16:05.591 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:16:05.592 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:16:05.592 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:16:05.592 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:16:05.592 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:16:05.592 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:16:05.592 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:16:05.593 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:16:05.593 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:16:05.593 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:16:05.593 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:05.593 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:05.594 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:05.594 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:05.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:05.595 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:16:05.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:16:05.665+0000 7f65e199e580 -1 init, newargv = 0x5632e07a75d0 newargc=15 2023-10-25T16:16:05.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34423]: starting ceph client 2023-10-25T16:16:05.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34423]: starting fuse 2023-10-25T16:16:06.745 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:16:06.753 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:16:06.753 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:16:06.753 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:16:06.753 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:16:06.754 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:16:06.754 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:16:06.754 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:16:06.754 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:16:06.754 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:16:06.755 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:16:06.755 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:16:06.755 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:16:06.755 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:16:06.755 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:16:06.756 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:16:06.756 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:16:06.756 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:16:06.756 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:16:06.756 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:16:06.756 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:16:06.757 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:16:06.757 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:16:06.757 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:16:06.757 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:16:06.757 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:16:06.757 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:16:06.758 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:16:06.758 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:16:06.758 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:16:06.759 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:06.759 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:16:06.759 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:06.759 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:16:06.759 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:06.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:16:06.761 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:16:06.807 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:16:06.808 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:16:06.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:16:06.809 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:16:06.809 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:16:06.809 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:16:06.810 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:16:06.810 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:16:06.811 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:16:06.812 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:16:06.812 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:16:06.813 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:16:06.813 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:16:06.813 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:16:06.814 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:16:06.814 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:16:06.815 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:16:06.815 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:16:06.815 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:16:06.816 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:16:06.816 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:16:06.817 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:16:06.818 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:16:06.818 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:16:06.819 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:16:06.819 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:16:06.819 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:16:06.820 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:16:06.821 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:16:06.937 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.34423.asok 2023-10-25T16:16:06.941 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:06.949 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34423.asok 2023-10-25T16:16:06.949 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:16:06.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.34423.asok status 2023-10-25T16:16:07.040 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:16:07.145 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:16:07.145 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:16:07.146 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:16:07.146 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:16:07.146 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:16:07.146 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:16:07.146 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:16:07.147 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "34423", 2023-10-25T16:16:07.147 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:16:07.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:16:07.147 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:16:07.147 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:16:07.148 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 155105, 2023-10-25T16:16:07.148 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:16:07.148 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:16:07.148 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:16:07.148 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 155105 2023-10-25T16:16:07.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:16:07.149 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:16:07.149 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:16:07.149 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:16:07.149 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 2272113064 2023-10-25T16:16:07.149 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:16:07.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:16:07.150 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:16:07.150 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:16:07.150 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:16:07.150 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 2272113064 2023-10-25T16:16:07.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:16:07.151 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.155105 192.168.0.1:0/2272113064", 2023-10-25T16:16:07.151 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/2272113064", 2023-10-25T16:16:07.151 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:16:07.151 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 25, 2023-10-25T16:16:07.151 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 68, 2023-10-25T16:16:07.152 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:16:07.152 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:16:07.152 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:16:07.152 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:16:07.157 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:07.165 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:16:07.165 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:16:07.166 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:07.209 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:16:07.211 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:16:07.211 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:07.217 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:07.218 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:16:07.218 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:16:07.302 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:16:07.303 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:07.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:16:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/2042967691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 msgr2=0x7fdb74071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/2042967691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 0x7fdb74071500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009870 tx=0x7fdb7001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/2042967691 shutdown_connections 2023-10-25T16:16:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/2042967691 >> v2:172.21.15.184:3300/0 conn(0x7fdb74070510 0x7fdb740cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/2042967691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 0x7fdb74071500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/2042967691 >> 172.21.15.177:0/2042967691 conn(0x7fdb740b2450 msgr2=0x7fdb740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/2042967691 shutdown_connections 2023-10-25T16:16:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/2042967691 wait complete. 2023-10-25T16:16:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.442+0000 7fdb7c4f0640 1 Processor -- start 2023-10-25T16:16:07.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- start start 2023-10-25T16:16:07.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb74070510 0x7fdb7414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:07.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 0x7fdb741547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:07.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 0x7fdb740aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:07.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7414f120 con 0x7fdb740cc610 2023-10-25T16:16:07.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740adc00 con 0x7fdb74070510 2023-10-25T16:16:07.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740adea0 con 0x7fdb74159230 2023-10-25T16:16:07.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 0x7fdb741547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:07.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 0x7fdb741547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:56144/0 (socket says 172.21.15.177:56144) 2023-10-25T16:16:07.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 -- 172.21.15.177:0/1863158213 learned_addr learned my addr 172.21.15.177:0/1863158213 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:07.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7aa8d640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 0x7fdb740aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7a28c640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb74070510 0x7fdb7414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 -- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 msgr2=0x7fdb740aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 0x7fdb740aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 -- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb74070510 msgr2=0x7fdb7414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:07.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb74070510 0x7fdb7414e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 -- 172.21.15.177:0/1863158213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb700094a0 con 0x7fdb740cc610 2023-10-25T16:16:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb79a8b640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 0x7fdb741547e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400e9f0 tx=0x7fdb6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400cd80 con 0x7fdb740cc610 2023-10-25T16:16:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb740ae140 con 0x7fdb740cc610 2023-10-25T16:16:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb740ae700 con 0x7fdb740cc610 2023-10-25T16:16:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdb64010430 con 0x7fdb740cc610 2023-10-25T16:16:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640107c0 con 0x7fdb740cc610 2023-10-25T16:16:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5c005260 con 0x7fdb740cc610 2023-10-25T16:16:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb64010920 con 0x7fdb740cc610 2023-10-25T16:16:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb6affd640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb58066470 0x7fdb58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.446+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb64014070 con 0x7fdb740cc610 2023-10-25T16:16:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.450+0000 7fdb7a28c640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb58066470 0x7fdb58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.450+0000 7fdb7a28c640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb58066470 0x7fdb58068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdb700af000 tx=0x7fdb7001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.450+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb64050090 con 0x7fdb740cc610 2023-10-25T16:16:07.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb5c0050d0 con 0x7fdb740cc610 2023-10-25T16:16:07.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb6affd640 1 -- 172.21.15.177:0/1863158213 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fdb640558c0 con 0x7fdb740cc610 2023-10-25T16:16:07.638 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:16:07.639 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:16:07.639 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:16:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb58066470 msgr2=0x7fdb58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb58066470 0x7fdb58068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdb700af000 tx=0x7fdb7001b010 comp rx=0 tx=0).stop 2023-10-25T16:16:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 msgr2=0x7fdb741547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:07.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 0x7fdb741547e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400e9f0 tx=0x7fdb6400eeb0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 shutdown_connections 2023-10-25T16:16:07.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb58066470 0x7fdb58068930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb74159230 0x7fdb740aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb740cc610 0x7fdb741547e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 --2- 172.21.15.177:0/1863158213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb74070510 0x7fdb7414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:07.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 >> 172.21.15.177:0/1863158213 conn(0x7fdb740b2450 msgr2=0x7fdb74155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:07.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 shutdown_connections 2023-10-25T16:16:07.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:07.634+0000 7fdb7c4f0640 1 -- 172.21.15.177:0/1863158213 wait complete. 2023-10-25T16:16:07.656 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-25T16:16:07.783 INFO:teuthology.orchestra.run.smithi177.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":6360,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.822833762,"mdsmap_epoch":25,"osdmap_epoch":68,"osdmap_epoch_barrier":68,"uptime":20.474475195} 2023-10-25T16:16:07.783 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 6360, "mdsmap_epoch": 25, "osdmap_epoch": 68, "osdmap_epoch_barrier": 68, "rank_uptime": 14.822833762, "state": "up:active", "uptime": 20.474475195, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:16:07.784 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:16:07.914 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:16:07.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:16:07.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-25T16:16:08.047 INFO:teuthology.orchestra.run.smithi177.stdout:{"mon_tick_interval":"5"} 2023-10-25T16:16:08.048 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-25T16:16:08.048 INFO:tasks.cephfs.test_full:pool capacity 557012544, 531MB should be enough to fill it 2023-10-25T16:16:08.049 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:16:08.049 DEBUG:teuthology.orchestra.run.smithi177:> import time 2023-10-25T16:16:08.050 DEBUG:teuthology.orchestra.run.smithi177:> import datetime 2023-10-25T16:16:08.050 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:16:08.050 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:16:08.051 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.051 DEBUG:teuthology.orchestra.run.smithi177:> # Write some buffered data through before going full, all should be well 2023-10-25T16:16:08.051 DEBUG:teuthology.orchestra.run.smithi177:> print("writing some data through which we expect to succeed") 2023-10-25T16:16:08.052 DEBUG:teuthology.orchestra.run.smithi177:> bytes = 0 2023-10-25T16:16:08.052 DEBUG:teuthology.orchestra.run.smithi177:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-25T16:16:08.052 DEBUG:teuthology.orchestra.run.smithi177:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-25T16:16:08.053 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-25T16:16:08.053 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:16:08.053 DEBUG:teuthology.orchestra.run.smithi177:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-25T16:16:08.054 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.054 DEBUG:teuthology.orchestra.run.smithi177:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-25T16:16:08.054 DEBUG:teuthology.orchestra.run.smithi177:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-25T16:16:08.055 DEBUG:teuthology.orchestra.run.smithi177:> # buffered IO, the error should always only appear from fsync and not 2023-10-25T16:16:08.055 DEBUG:teuthology.orchestra.run.smithi177:> # from write 2023-10-25T16:16:08.055 DEBUG:teuthology.orchestra.run.smithi177:> full = False 2023-10-25T16:16:08.056 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.056 DEBUG:teuthology.orchestra.run.smithi177:> for n in range(0, int(531 * 0.9)): 2023-10-25T16:16:08.056 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-25T16:16:08.057 DEBUG:teuthology.orchestra.run.smithi177:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-25T16:16:08.057 DEBUG:teuthology.orchestra.run.smithi177:> print("done writing {0} bytes".format(bytes)) 2023-10-25T16:16:08.057 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.058 DEBUG:teuthology.orchestra.run.smithi177:> # OK, now we should sneak in under the full condition 2023-10-25T16:16:08.058 DEBUG:teuthology.orchestra.run.smithi177:> # due to the time it takes the OSDs to report to the 2023-10-25T16:16:08.058 DEBUG:teuthology.orchestra.run.smithi177:> # mons, and get a successful fsync on our full-making data 2023-10-25T16:16:08.059 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:16:08.059 DEBUG:teuthology.orchestra.run.smithi177:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-25T16:16:08.059 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.060 DEBUG:teuthology.orchestra.run.smithi177:> # buffered write, add more dirty data to the buffer 2023-10-25T16:16:08.060 DEBUG:teuthology.orchestra.run.smithi177:> print("starting buffered write") 2023-10-25T16:16:08.060 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:16:08.061 DEBUG:teuthology.orchestra.run.smithi177:> for n in range(0, int(531 * 0.2)): 2023-10-25T16:16:08.061 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-25T16:16:08.061 DEBUG:teuthology.orchestra.run.smithi177:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-25T16:16:08.062 DEBUG:teuthology.orchestra.run.smithi177:> time.sleep(15.0) 2023-10-25T16:16:08.062 DEBUG:teuthology.orchestra.run.smithi177:> except OSError: 2023-10-25T16:16:08.062 DEBUG:teuthology.orchestra.run.smithi177:> pass; 2023-10-25T16:16:08.063 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.063 DEBUG:teuthology.orchestra.run.smithi177:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-25T16:16:08.063 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.064 DEBUG:teuthology.orchestra.run.smithi177:> # Wait long enough for a background flush that should fail 2023-10-25T16:16:08.064 DEBUG:teuthology.orchestra.run.smithi177:> time.sleep(30) 2023-10-25T16:16:08.064 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.065 DEBUG:teuthology.orchestra.run.smithi177:> if True: 2023-10-25T16:16:08.065 DEBUG:teuthology.orchestra.run.smithi177:> # ...and check that the failed background flush is reflected in fclose 2023-10-25T16:16:08.065 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:16:08.066 DEBUG:teuthology.orchestra.run.smithi177:> os.close(f) 2023-10-25T16:16:08.066 DEBUG:teuthology.orchestra.run.smithi177:> except OSError: 2023-10-25T16:16:08.066 DEBUG:teuthology.orchestra.run.smithi177:> print("close() returned an error as expected") 2023-10-25T16:16:08.067 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:16:08.067 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("close() failed to raise error") 2023-10-25T16:16:08.067 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:16:08.068 DEBUG:teuthology.orchestra.run.smithi177:> # The kernel cephfs client does not raise errors on fclose 2023-10-25T16:16:08.068 DEBUG:teuthology.orchestra.run.smithi177:> os.close(f) 2023-10-25T16:16:08.068 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:16:08.069 DEBUG:teuthology.orchestra.run.smithi177:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-25T16:16:08.069 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:16:12.878 INFO:teuthology.orchestra.run.smithi177.stdout:writing some data through which we expect to succeed 2023-10-25T16:16:12.878 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-25T16:16:12.878 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-25T16:16:12.878 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-25T16:16:12.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-25T16:16:12.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-25T16:16:12.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-25T16:16:12.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-25T16:16:12.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-25T16:16:12.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-25T16:16:12.880 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-25T16:16:12.880 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-25T16:16:12.880 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-25T16:16:12.880 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-25T16:16:12.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-25T16:16:12.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-25T16:16:12.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-25T16:16:12.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-25T16:16:12.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-25T16:16:12.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-25T16:16:12.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-25T16:16:12.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-25T16:16:12.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-25T16:16:12.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-25T16:16:12.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-25T16:16:12.883 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-25T16:16:12.883 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-25T16:16:12.883 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-25T16:16:12.883 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-25T16:16:12.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-25T16:16:12.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-10-25T16:16:12.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-10-25T16:16:12.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-10-25T16:16:12.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-10-25T16:16:12.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-10-25T16:16:12.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-10-25T16:16:12.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-10-25T16:16:12.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-10-25T16:16:12.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-10-25T16:16:12.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-10-25T16:16:12.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-10-25T16:16:12.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-10-25T16:16:12.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-10-25T16:16:12.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-10-25T16:16:12.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-10-25T16:16:12.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-10-25T16:16:12.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-10-25T16:16:12.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-10-25T16:16:12.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-10-25T16:16:12.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-10-25T16:16:12.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-10-25T16:16:12.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-10-25T16:16:12.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-10-25T16:16:12.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-10-25T16:16:12.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-10-25T16:16:12.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-10-25T16:16:12.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-10-25T16:16:12.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-10-25T16:16:12.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-10-25T16:16:12.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-10-25T16:16:12.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-10-25T16:16:12.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-10-25T16:16:12.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-10-25T16:16:12.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-10-25T16:16:12.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-10-25T16:16:12.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-10-25T16:16:12.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-10-25T16:16:12.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-10-25T16:16:12.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-10-25T16:16:12.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-10-25T16:16:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-10-25T16:16:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-10-25T16:16:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-10-25T16:16:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-10-25T16:16:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-10-25T16:16:12.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-10-25T16:16:12.894 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-10-25T16:16:12.894 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-10-25T16:16:12.894 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-10-25T16:16:12.894 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-10-25T16:16:12.895 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-10-25T16:16:12.895 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-10-25T16:16:12.895 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-10-25T16:16:12.895 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-10-25T16:16:12.895 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-10-25T16:16:12.896 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-10-25T16:16:12.896 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-10-25T16:16:12.896 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-10-25T16:16:12.896 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-10-25T16:16:12.896 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-10-25T16:16:12.897 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-10-25T16:16:12.897 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-10-25T16:16:12.898 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-10-25T16:16:12.898 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-10-25T16:16:12.898 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-10-25T16:16:12.898 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-10-25T16:16:12.899 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-10-25T16:16:12.899 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-10-25T16:16:12.899 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-10-25T16:16:12.899 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-10-25T16:16:12.899 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-10-25T16:16:12.900 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-10-25T16:16:12.900 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-10-25T16:16:12.900 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-10-25T16:16:12.900 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-10-25T16:16:12.900 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-10-25T16:16:12.901 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-10-25T16:16:12.901 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-10-25T16:16:12.901 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-10-25T16:16:12.901 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-10-25T16:16:12.901 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-10-25T16:16:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-10-25T16:16:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-10-25T16:16:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-10-25T16:16:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-10-25T16:16:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-10-25T16:16:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-10-25T16:16:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-10-25T16:16:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-10-25T16:16:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-10-25T16:16:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-10-25T16:16:12.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-10-25T16:16:12.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-10-25T16:16:12.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-10-25T16:16:12.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-10-25T16:16:12.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-10-25T16:16:12.905 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-10-25T16:16:12.905 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-10-25T16:16:12.906 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-10-25T16:16:12.906 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-10-25T16:16:12.906 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-10-25T16:16:12.906 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-10-25T16:16:12.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-10-25T16:16:12.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-10-25T16:16:12.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-10-25T16:16:12.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-10-25T16:16:12.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-10-25T16:16:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-10-25T16:16:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-10-25T16:16:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-10-25T16:16:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-10-25T16:16:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-10-25T16:16:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-10-25T16:16:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-10-25T16:16:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-10-25T16:16:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-10-25T16:16:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-10-25T16:16:12.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-10-25T16:16:12.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-10-25T16:16:12.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-10-25T16:16:12.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-10-25T16:16:12.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-10-25T16:16:12.911 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-10-25T16:16:12.911 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-10-25T16:16:12.911 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-10-25T16:16:12.911 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-10-25T16:16:13.163 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-10-25T16:16:13.164 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-10-25T16:16:13.164 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-10-25T16:16:13.164 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-10-25T16:16:13.164 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-10-25T16:16:13.164 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-10-25T16:16:13.165 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-10-25T16:16:13.165 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-10-25T16:16:13.165 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-10-25T16:16:13.165 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-10-25T16:16:13.165 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-10-25T16:16:13.166 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-10-25T16:16:13.166 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-10-25T16:16:13.166 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-10-25T16:16:13.166 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-10-25T16:16:13.166 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-10-25T16:16:13.167 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-10-25T16:16:13.167 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-10-25T16:16:13.167 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-10-25T16:16:13.167 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-10-25T16:16:13.167 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-10-25T16:16:13.168 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-10-25T16:16:13.168 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-10-25T16:16:13.168 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-10-25T16:16:13.168 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-10-25T16:16:13.168 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-10-25T16:16:13.169 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-10-25T16:16:13.169 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-10-25T16:16:13.169 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-10-25T16:16:13.169 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-10-25T16:16:13.169 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-10-25T16:16:13.170 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-10-25T16:16:13.170 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-10-25T16:16:13.170 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-10-25T16:16:13.170 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-10-25T16:16:13.170 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-10-25T16:16:13.171 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-10-25T16:16:13.171 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-10-25T16:16:13.171 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-10-25T16:16:13.171 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-10-25T16:16:13.171 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-10-25T16:16:13.171 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-10-25T16:16:13.172 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-10-25T16:16:13.172 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-10-25T16:16:13.172 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-10-25T16:16:13.172 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-10-25T16:16:13.172 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-10-25T16:16:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-10-25T16:16:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-10-25T16:16:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-10-25T16:16:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-10-25T16:16:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-10-25T16:16:13.173 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-10-25T16:16:13.174 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-10-25T16:16:13.174 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-10-25T16:16:13.174 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-10-25T16:16:13.174 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-10-25T16:16:13.174 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-10-25T16:16:13.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-10-25T16:16:13.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-10-25T16:16:13.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-10-25T16:16:13.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-10-25T16:16:13.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-10-25T16:16:13.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-10-25T16:16:13.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-10-25T16:16:13.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-10-25T16:16:13.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-10-25T16:16:13.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-10-25T16:16:13.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-10-25T16:16:13.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-10-25T16:16:13.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-10-25T16:16:13.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-10-25T16:16:13.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-10-25T16:16:13.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-10-25T16:16:13.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-10-25T16:16:13.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-10-25T16:16:13.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-10-25T16:16:13.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-10-25T16:16:13.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-10-25T16:16:13.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-10-25T16:16:13.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-10-25T16:16:13.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-10-25T16:16:13.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-10-25T16:16:13.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-10-25T16:16:13.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-10-25T16:16:13.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-10-25T16:16:13.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-10-25T16:16:13.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-10-25T16:16:13.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-10-25T16:16:13.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-10-25T16:16:13.181 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-10-25T16:16:13.181 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-10-25T16:16:13.181 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-10-25T16:16:13.181 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-10-25T16:16:13.181 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-10-25T16:16:13.182 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-10-25T16:16:13.182 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-10-25T16:16:13.182 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-10-25T16:16:13.182 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-10-25T16:16:13.182 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-10-25T16:16:13.183 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-10-25T16:16:13.183 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-10-25T16:16:13.183 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-10-25T16:16:13.183 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-10-25T16:16:13.183 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-10-25T16:16:13.183 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-10-25T16:16:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-10-25T16:16:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-10-25T16:16:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-10-25T16:16:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-10-25T16:16:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-10-25T16:16:13.185 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-10-25T16:16:13.185 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-10-25T16:16:13.185 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-10-25T16:16:13.185 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-10-25T16:16:13.185 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-10-25T16:16:13.185 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-10-25T16:16:13.186 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-10-25T16:16:13.186 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-10-25T16:16:13.186 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-10-25T16:16:13.186 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-10-25T16:16:13.186 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-10-25T16:16:13.187 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-10-25T16:16:13.187 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-10-25T16:16:13.187 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-10-25T16:16:13.187 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-10-25T16:16:13.187 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-10-25T16:16:13.188 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-10-25T16:16:13.188 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-10-25T16:16:13.188 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-10-25T16:16:13.188 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-10-25T16:16:13.188 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-10-25T16:16:13.189 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-10-25T16:16:13.189 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-10-25T16:16:13.189 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-10-25T16:16:13.189 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-10-25T16:16:13.189 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-10-25T16:16:13.189 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-10-25T16:16:13.190 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-10-25T16:16:13.190 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-10-25T16:16:13.190 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-10-25T16:16:13.190 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-10-25T16:16:13.190 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-10-25T16:16:13.191 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-10-25T16:16:13.191 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-10-25T16:16:13.191 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-10-25T16:16:13.191 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-10-25T16:16:13.191 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-10-25T16:16:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-10-25T16:16:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-10-25T16:16:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-10-25T16:16:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-10-25T16:16:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-10-25T16:16:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-10-25T16:16:13.431 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-10-25T16:16:13.432 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-10-25T16:16:13.432 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-10-25T16:16:13.432 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-10-25T16:16:13.432 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-10-25T16:16:13.433 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-10-25T16:16:13.433 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-10-25T16:16:13.433 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-10-25T16:16:13.433 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-10-25T16:16:13.433 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-10-25T16:16:13.434 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-10-25T16:16:13.434 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-10-25T16:16:13.434 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-10-25T16:16:13.434 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-10-25T16:16:13.435 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-10-25T16:16:13.435 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-10-25T16:16:13.435 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-10-25T16:16:13.435 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-10-25T16:16:13.435 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-10-25T16:16:13.435 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-10-25T16:16:13.436 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-10-25T16:16:13.436 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-10-25T16:16:13.436 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-10-25T16:16:13.436 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-10-25T16:16:13.436 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-10-25T16:16:13.437 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-10-25T16:16:13.437 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-10-25T16:16:13.437 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-10-25T16:16:13.437 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-10-25T16:16:13.437 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-10-25T16:16:13.437 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-10-25T16:16:13.438 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-10-25T16:16:13.438 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-10-25T16:16:13.438 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-10-25T16:16:13.438 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-10-25T16:16:13.438 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-10-25T16:16:13.439 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-10-25T16:16:13.439 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-10-25T16:16:13.439 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-10-25T16:16:13.439 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-10-25T16:16:13.439 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-10-25T16:16:13.440 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-10-25T16:16:13.440 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-10-25T16:16:13.440 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-10-25T16:16:13.440 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-10-25T16:16:13.440 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-10-25T16:16:13.441 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-10-25T16:16:13.441 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-10-25T16:16:13.441 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-10-25T16:16:13.441 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-10-25T16:16:13.441 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-10-25T16:16:13.441 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-10-25T16:16:13.442 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-10-25T16:16:13.442 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-10-25T16:16:13.442 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-10-25T16:16:13.442 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-10-25T16:16:13.442 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-10-25T16:16:13.443 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-10-25T16:16:13.443 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-10-25T16:16:13.443 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-10-25T16:16:13.443 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-10-25T16:16:13.443 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-10-25T16:16:13.443 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-10-25T16:16:13.444 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-10-25T16:16:13.444 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-10-25T16:16:13.444 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-10-25T16:16:13.444 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-10-25T16:16:13.444 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-10-25T16:16:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-10-25T16:16:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-10-25T16:16:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-10-25T16:16:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-10-25T16:16:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-10-25T16:16:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-10-25T16:16:13.446 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-10-25T16:16:13.446 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-10-25T16:16:13.446 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-10-25T16:16:13.446 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-10-25T16:16:13.446 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-10-25T16:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-10-25T16:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-10-25T16:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-10-25T16:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-10-25T16:16:13.447 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-10-25T16:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-10-25T16:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-10-25T16:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-10-25T16:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-10-25T16:16:13.448 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-10-25T16:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-10-25T16:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-10-25T16:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-10-25T16:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-10-25T16:16:13.449 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-10-25T16:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-10-25T16:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-10-25T16:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-10-25T16:16:13.450 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-10-25T16:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-10-25T16:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-10-25T16:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-10-25T16:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-10-25T16:16:13.451 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-10-25T16:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-10-25T16:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-10-25T16:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-10-25T16:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-10-25T16:16:13.452 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-10-25T16:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-10-25T16:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-10-25T16:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-10-25T16:16:13.453 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-10-25T16:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-10-25T16:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-10-25T16:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-10-25T16:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-10-25T16:16:13.454 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-10-25T16:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-10-25T16:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-10-25T16:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-10-25T16:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-10-25T16:16:13.455 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-10-25T16:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-10-25T16:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-10-25T16:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-10-25T16:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-10-25T16:16:13.456 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-10-25T16:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-10-25T16:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-10-25T16:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-10-25T16:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-10-25T16:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-10-25T16:16:13.457 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-10-25T16:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-10-25T16:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-10-25T16:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-10-25T16:16:13.458 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-10-25T16:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-10-25T16:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-10-25T16:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-10-25T16:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-10-25T16:16:13.459 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-10-25T16:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-10-25T16:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-10-25T16:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-10-25T16:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-10-25T16:16:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-10-25T16:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-10-25T16:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-10-25T16:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-10-25T16:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-10-25T16:16:13.461 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-10-25T16:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-10-25T16:16:13.462 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-10-25T16:16:16.737 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:16:16.734+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-25T16:16:22.600 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:16:22.598+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-25T16:16:30.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:16:30.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:16:58.595 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-10-25T16:16:58.595 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-10-25T16:16:58.595 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-10-25T16:16:58.595 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-10-25T16:16:58.596 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-10-25T16:16:58.596 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-10-25T16:16:58.596 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-10-25T16:16:58.596 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-10-25T16:16:58.596 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-10-25T16:16:58.597 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-10-25T16:16:58.597 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-10-25T16:16:58.597 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-10-25T16:16:58.597 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-10-25T16:16:58.597 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-10-25T16:16:58.598 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-10-25T16:16:58.598 INFO:teuthology.orchestra.run.smithi177.stdout:done writing 500695040 bytes 2023-10-25T16:16:58.598 INFO:teuthology.orchestra.run.smithi177.stdout:successfully fsync'ed prior to getting full state reported 2023-10-25T16:16:58.598 INFO:teuthology.orchestra.run.smithi177.stdout:starting buffered write 2023-10-25T16:16:58.598 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:16:58.599 INFO:teuthology.orchestra.run.smithi177.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-25T16:16:58.599 INFO:teuthology.orchestra.run.smithi177.stdout:close() returned an error as expected 2023-10-25T16:16:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:16:58.615 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:16:58.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:16:58.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:16:58.720 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:16:58.720 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:16:58.721 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:16:58.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:16:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.894+0000 7fbf323ae640 1 -- 172.21.15.177:0/737751694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c15a9c0 msgr2=0x7fbf2c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.894+0000 7fbf323ae640 1 --2- 172.21.15.177:0/737751694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c070720 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fbf14005fd0 tx=0x7fbf1401c7c0 comp rx=0 tx=0).stop 2023-10-25T16:16:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.894+0000 7fbf323ae640 1 -- 172.21.15.177:0/737751694 shutdown_connections 2023-10-25T16:16:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.894+0000 7fbf323ae640 1 --2- 172.21.15.177:0/737751694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c070720 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.894+0000 7fbf323ae640 1 -- 172.21.15.177:0/737751694 >> 172.21.15.177:0/737751694 conn(0x7fbf2c0b2450 msgr2=0x7fbf2c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- 172.21.15.177:0/737751694 shutdown_connections 2023-10-25T16:16:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- 172.21.15.177:0/737751694 wait complete. 2023-10-25T16:16:58.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 Processor -- start 2023-10-25T16:16:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- start start 2023-10-25T16:16:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 0x7fbf2c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf2c070c60 0x7fbf2c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0acba0 con 0x7fbf2c06ba20 2023-10-25T16:16:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0ad3b0 con 0x7fbf2c15a9c0 2023-10-25T16:16:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c13e090 con 0x7fbf2c070c60 2023-10-25T16:16:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 0x7fbf2c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 0x7fbf2c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52922/0 (socket says 172.21.15.177:52922) 2023-10-25T16:16:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 -- 172.21.15.177:0/2385256759 learned_addr learned my addr 172.21.15.177:0/2385256759 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf3094b640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 -- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf2c070c60 msgr2=0x7fbf2c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2b7fe640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf2c070c60 0x7fbf2c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf2c070c60 0x7fbf2c0af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 -- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf2c15a9c0 msgr2=0x7fbf2c159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 -- 172.21.15.177:0/2385256759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009450 con 0x7fbf2c06ba20 2023-10-25T16:16:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf3094b640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf2bfff640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 0x7fbf2c13db50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c7a0 tx=0x7fbf1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c003d90 con 0x7fbf2c06ba20 2023-10-25T16:16:58.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf1c005070 con 0x7fbf2c06ba20 2023-10-25T16:16:58.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c0acdf0 con 0x7fbf2c06ba20 2023-10-25T16:16:58.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0054c0 con 0x7fbf2c06ba20 2023-10-25T16:16:58.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c141660 con 0x7fbf2c06ba20 2023-10-25T16:16:58.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.898+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c1414c0 con 0x7fbf2c06ba20 2023-10-25T16:16:58.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.902+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf1c005620 con 0x7fbf2c06ba20 2023-10-25T16:16:58.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.902+0000 7fbf28ff9640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf0c0664a0 0x7fbf0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:58.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.902+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf1c0835d0 con 0x7fbf2c06ba20 2023-10-25T16:16:58.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.902+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fbf0c06dfd0 con 0x7fbf2c06ba20 2023-10-25T16:16:58.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.902+0000 7fbf2b7fe640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf0c0664a0 0x7fbf0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:58.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.902+0000 7fbf2b7fe640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf0c0664a0 0x7fbf0c068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbf140ae000 tx=0x7fbf1401b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:58.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:58.906+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf2c1414c0 con 0x7fbf2c06ba20 2023-10-25T16:16:59.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.058+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf2c1414c0 con 0x7fbf2c06ba20 2023-10-25T16:16:59.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.058+0000 7fbf28ff9640 1 -- 172.21.15.177:0/2385256759 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16647 (secure 0 0 0) 0x7fbf2c1414c0 con 0x7fbf2c06ba20 2023-10-25T16:16:59.064 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:16:59.064 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:16:19.766116+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:16:59.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf0c0664a0 msgr2=0x7fbf0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf0c0664a0 0x7fbf0c068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbf140ae000 tx=0x7fbf1401b000 comp rx=0 tx=0).stop 2023-10-25T16:16:59.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 msgr2=0x7fbf2c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 0x7fbf2c13db50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c7a0 tx=0x7fbf1c00cc60 comp rx=0 tx=0).stop 2023-10-25T16:16:59.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 shutdown_connections 2023-10-25T16:16:59.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf0c0664a0 0x7fbf0c068960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf2c15a9c0 0x7fbf2c159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf2c070c60 0x7fbf2c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 --2- 172.21.15.177:0/2385256759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf2c06ba20 0x7fbf2c13db50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 >> 172.21.15.177:0/2385256759 conn(0x7fbf2c0b2450 msgr2=0x7fbf2c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 shutdown_connections 2023-10-25T16:16:59.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.062+0000 7fbf323ae640 1 -- 172.21.15.177:0/2385256759 wait complete. 2023-10-25T16:16:59.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:15:50.243421+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:15:51.285070+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:16:59.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:16:59.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- 172.21.15.177:0/2503476303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0cc0a0 msgr2=0x7f380c0ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2503476303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0cc0a0 0x7f380c0ca1d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3804009c80 tx=0x7f380401cd10 comp rx=0 tx=0).stop 2023-10-25T16:16:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- 172.21.15.177:0/2503476303 shutdown_connections 2023-10-25T16:16:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2503476303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0cc0a0 0x7f380c0ca1d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2503476303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 0x7f380c0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- 172.21.15.177:0/2503476303 >> 172.21.15.177:0/2503476303 conn(0x7f380c0983a0 msgr2=0x7f380c0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- 172.21.15.177:0/2503476303 shutdown_connections 2023-10-25T16:16:59.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- 172.21.15.177:0/2503476303 wait complete. 2023-10-25T16:16:59.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 Processor -- start 2023-10-25T16:16:59.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- start start 2023-10-25T16:16:59.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 0x7f380c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f380c0cc0a0 0x7f380c0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 0x7f380c0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c154dd0 con 0x7f380c0b0280 2023-10-25T16:16:59.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c14dd00 con 0x7f380c0cc0a0 2023-10-25T16:16:59.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3810c6e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0c9060 con 0x7f380c15ca70 2023-10-25T16:16:59.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 0x7f380c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 0x7f380c14d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52940/0 (socket says 172.21.15.177:52940) 2023-10-25T16:16:59.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 -- 172.21.15.177:0/2056153579 learned_addr learned my addr 172.21.15.177:0/2056153579 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380ad9d640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 0x7f380c0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3809d9b640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f380c0cc0a0 0x7f380c0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 -- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 msgr2=0x7f380c0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 0x7f380c0c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 -- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f380c0cc0a0 msgr2=0x7f380c0c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f380c0cc0a0 0x7f380c0c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 -- 172.21.15.177:0/2056153579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38040098e0 con 0x7f380c0b0280 2023-10-25T16:16:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380ad9d640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 0x7f380c0c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3809d9b640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f380c0cc0a0 0x7f380c0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f380a59c640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 0x7f380c14d7c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00ca20 tx=0x7f37fc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:59.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.206+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc007c70 con 0x7f380c0b0280 2023-10-25T16:16:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f37fc00f450 con 0x7f380c0b0280 2023-10-25T16:16:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0c8d80 con 0x7f380c0b0280 2023-10-25T16:16:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc00f860 con 0x7f380c0b0280 2023-10-25T16:16:59.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c1549f0 con 0x7f380c0b0280 2023-10-25T16:16:59.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c04daf0 con 0x7f380c0b0280 2023-10-25T16:16:59.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37fc00f9c0 con 0x7f380c0b0280 2023-10-25T16:16:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3802ffd640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37ec066470 0x7f37ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37fc084790 con 0x7f380c0b0280 2023-10-25T16:16:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f37ec06dfa0 con 0x7f380c0b0280 2023-10-25T16:16:59.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3809d9b640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37ec066470 0x7f37ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.210+0000 7f3809d9b640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37ec066470 0x7f37ec068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f380c152800 tx=0x7f37f4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:59.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.214+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37fc051b70 con 0x7f380c0b0280 2023-10-25T16:16:59.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f380c1539d0 con 0x7f380c0b0280 2023-10-25T16:16:59.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3802ffd640 1 -- 172.21.15.177:0/2056153579 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37fc055190 con 0x7f380c0b0280 2023-10-25T16:16:59.362 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:16:59.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37ec066470 msgr2=0x7f37ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37ec066470 0x7f37ec068930 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f380c152800 tx=0x7f37f4009040 comp rx=0 tx=0).stop 2023-10-25T16:16:59.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 msgr2=0x7f380c14d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 0x7f380c14d7c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00ca20 tx=0x7f37fc00cee0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 shutdown_connections 2023-10-25T16:16:59.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37ec066470 0x7f37ec068930 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f380c15ca70 0x7f380c0c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f380c0cc0a0 0x7f380c0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 --2- 172.21.15.177:0/2056153579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f380c0b0280 0x7f380c14d7c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 >> 172.21.15.177:0/2056153579 conn(0x7f380c0983a0 msgr2=0x7f380c0ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 shutdown_connections 2023-10-25T16:16:59.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.358+0000 7f3810c6e640 1 -- 172.21.15.177:0/2056153579 wait complete. 2023-10-25T16:16:59.379 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:16:59.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 -- 172.21.15.177:0/1500148787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0cbfa0 msgr2=0x7fc11c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 --2- 172.21.15.177:0/1500148787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0cbfa0 0x7fc11c0aebc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc110005fd0 tx=0x7fc11001c800 comp rx=0 tx=0).stop 2023-10-25T16:16:59.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 -- 172.21.15.177:0/1500148787 shutdown_connections 2023-10-25T16:16:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 --2- 172.21.15.177:0/1500148787 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11c0af100 0x7fc11c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 --2- 172.21.15.177:0/1500148787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0cbfa0 0x7fc11c0aebc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 -- 172.21.15.177:0/1500148787 >> 172.21.15.177:0/1500148787 conn(0x7fc11c0b2450 msgr2=0x7fc11c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 -- 172.21.15.177:0/1500148787 shutdown_connections 2023-10-25T16:16:59.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.502+0000 7fc120a64640 1 -- 172.21.15.177:0/1500148787 wait complete. 2023-10-25T16:16:59.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 Processor -- start 2023-10-25T16:16:59.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- start start 2023-10-25T16:16:59.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0af100 0x7fc11c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11c0cbfa0 0x7fc11c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 0x7fc11c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1525a0 con 0x7fc11c14e810 2023-10-25T16:16:59.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c152880 con 0x7fc11c0af100 2023-10-25T16:16:59.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c152b60 con 0x7fc11c0cbfa0 2023-10-25T16:16:59.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 0x7fc11c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 0x7fc11c070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52946/0 (socket says 172.21.15.177:52946) 2023-10-25T16:16:59.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 -- 172.21.15.177:0/1543512653 learned_addr learned my addr 172.21.15.177:0/1543512653 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:59.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11a59c640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0af100 0x7fc11c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc119d9b640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11c0cbfa0 0x7fc11c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 -- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11c0cbfa0 msgr2=0x7fc11c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11c0cbfa0 0x7fc11c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 -- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0af100 msgr2=0x7fc11c141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0af100 0x7fc11c141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 -- 172.21.15.177:0/1543512653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114009820 con 0x7fc11c14e810 2023-10-25T16:16:59.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11ad9d640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 0x7fc11c070b00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc11400efd0 tx=0x7fc11400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:59.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114009b80 con 0x7fc11c14e810 2023-10-25T16:16:59.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc110009450 con 0x7fc11c14e810 2023-10-25T16:16:59.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc114003b80 con 0x7fc11c14e810 2023-10-25T16:16:59.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc114004020 con 0x7fc11c14e810 2023-10-25T16:16:59.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c153120 con 0x7fc11c14e810 2023-10-25T16:16:59.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c153310 con 0x7fc11c14e810 2023-10-25T16:16:59.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc114004180 con 0x7fc11c14e810 2023-10-25T16:16:59.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0fc066470 0x7fc0fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc114014070 con 0x7fc11c14e810 2023-10-25T16:16:59.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fc0fc06dfa0 con 0x7fc11c14e810 2023-10-25T16:16:59.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.506+0000 7fc11a59c640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0fc066470 0x7fc0fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.510+0000 7fc11a59c640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0fc066470 0x7fc0fc068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc10c001280 tx=0x7fc10c007b50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:59.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.510+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc114052200 con 0x7fc11c14e810 2023-10-25T16:16:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.658+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc11c04daf0 con 0x7fc11c14e810 2023-10-25T16:16:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.658+0000 7fc10affd640 1 -- 172.21.15.177:0/1543512653 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc114055820 con 0x7fc11c14e810 2023-10-25T16:16:59.664 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:16:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0fc066470 msgr2=0x7fc0fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0fc066470 0x7fc0fc068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc10c001280 tx=0x7fc10c007b50 comp rx=0 tx=0).stop 2023-10-25T16:16:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 msgr2=0x7fc11c070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 0x7fc11c070b00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc11400efd0 tx=0x7fc11400c6a0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 shutdown_connections 2023-10-25T16:16:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0fc066470 0x7fc0fc068930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc11c14e810 0x7fc11c070b00 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc11c0cbfa0 0x7fc11c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 --2- 172.21.15.177:0/1543512653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc11c0af100 0x7fc11c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 >> 172.21.15.177:0/1543512653 conn(0x7fc11c0b2450 msgr2=0x7fc11c15a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 shutdown_connections 2023-10-25T16:16:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.662+0000 7fc120a64640 1 -- 172.21.15.177:0/1543512653 wait complete. 2023-10-25T16:16:59.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:16:59.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 -- 172.21.15.177:0/1294914236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 msgr2=0x7f9dbc0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/1294914236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc0cdf80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc09f200 tx=0x7f9db401cc90 comp rx=0 tx=0).stop 2023-10-25T16:16:59.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 -- 172.21.15.177:0/1294914236 shutdown_connections 2023-10-25T16:16:59.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/1294914236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc0cdf80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/1294914236 >> v2:172.21.15.184:3300/0 conn(0x7f9dbc0b2120 0x7f9dbc0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 -- 172.21.15.177:0/1294914236 >> 172.21.15.177:0/1294914236 conn(0x7f9dbc09a5c0 msgr2=0x7f9dbc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 -- 172.21.15.177:0/1294914236 shutdown_connections 2023-10-25T16:16:59.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 -- 172.21.15.177:0/1294914236 wait complete. 2023-10-25T16:16:59.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 Processor -- start 2023-10-25T16:16:59.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.806+0000 7f9dc15ac640 1 -- start start 2023-10-25T16:16:59.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9dbc0b2120 0x7f9dbc0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dbc15eba0 0x7f9dbc15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c8380 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c85d0 con 0x7f9dbc15eba0 2023-10-25T16:16:59.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dbc0c88b0 con 0x7f9dbc0b2120 2023-10-25T16:16:59.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52960/0 (socket says 172.21.15.177:52960) 2023-10-25T16:16:59.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 -- 172.21.15.177:0/4191162388 learned_addr learned my addr 172.21.15.177:0/4191162388 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:16:59.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dbb7fe640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dbc15eba0 0x7f9dbc15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dbaffd640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9dbc0b2120 0x7f9dbc0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 -- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9dbc0b2120 msgr2=0x7f9dbc0c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9dbc0b2120 0x7f9dbc0c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 -- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dbc15eba0 msgr2=0x7f9dbc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dbc15eba0 0x7f9dbc15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 -- 172.21.15.177:0/4191162388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40098e0 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dbaffd640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9dbc0b2120 0x7f9dbc0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dbb7fe640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dbc15eba0 0x7f9dbc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:16:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dba7fc640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc154530 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9db000d980 tx=0x7f9db000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:59.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0009c30 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9db0005020 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc0c8b90 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0005430 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dbc0c9150 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dbc04daf0 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9db00047b0 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9da8066470 0x7f9da8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:16:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9db00840f0 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.810+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f9da806dfa0 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.814+0000 7f9dbaffd640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9da8066470 0x7f9da8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:16:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.814+0000 7f9dbaffd640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9da8066470 0x7f9da8068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00a850 tx=0x7f9dac008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:16:59.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.814+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9db0017060 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9dbc0ce930 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9da37fe640 1 -- 172.21.15.177:0/4191162388 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9db0020020 con 0x7f9dbc0cdb10 2023-10-25T16:16:59.973 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:16:59.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9da8066470 msgr2=0x7f9da8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9da8066470 0x7f9da8068930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00a850 tx=0x7f9dac008040 comp rx=0 tx=0).stop 2023-10-25T16:16:59.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 msgr2=0x7f9dbc154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:16:59.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc154530 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9db000d980 tx=0x7f9db000de40 comp rx=0 tx=0).stop 2023-10-25T16:16:59.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 shutdown_connections 2023-10-25T16:16:59.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9da8066470 0x7f9da8068930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dbc15eba0 0x7f9dbc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dbc0cdb10 0x7f9dbc154530 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 --2- 172.21.15.177:0/4191162388 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9dbc0b2120 0x7f9dbc0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:16:59.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 >> 172.21.15.177:0/4191162388 conn(0x7f9dbc09a5c0 msgr2=0x7f9dbc15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:16:59.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 shutdown_connections 2023-10-25T16:16:59.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:16:59.970+0000 7f9dc15ac640 1 -- 172.21.15.177:0/4191162388 wait complete. 2023-10-25T16:16:59.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:17:00.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- 172.21.15.177:0/1251355655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 msgr2=0x7f55740ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 --2- 172.21.15.177:0/1251355655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740ccba0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5568009900 tx=0x7f556801c880 comp rx=0 tx=0).stop 2023-10-25T16:17:00.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- 172.21.15.177:0/1251355655 shutdown_connections 2023-10-25T16:17:00.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 --2- 172.21.15.177:0/1251355655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740ccba0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- 172.21.15.177:0/1251355655 >> 172.21.15.177:0/1251355655 conn(0x7f557409a580 msgr2=0x7f55740d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:00.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- 172.21.15.177:0/1251355655 shutdown_connections 2023-10-25T16:17:00.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- 172.21.15.177:0/1251355655 wait complete. 2023-10-25T16:17:00.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 Processor -- start 2023-10-25T16:17:00.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- start start 2023-10-25T16:17:00.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55740b2070 0x7f557414d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55740cfe20 0x7f55741451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557414deb0 con 0x7f557415eba0 2023-10-25T16:17:00.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557414c8d0 con 0x7f55740b2070 2023-10-25T16:17:00.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.110+0000 7f557ad0b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557414cbb0 con 0x7f55740cfe20 2023-10-25T16:17:00.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52974/0 (socket says 172.21.15.177:52974) 2023-10-25T16:17:00.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 -- 172.21.15.177:0/14545230 learned_addr learned my addr 172.21.15.177:0/14545230 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:00.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f5578aa7640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55740b2070 0x7f557414d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f5573fff640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55740cfe20 0x7f55741451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 -- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55740cfe20 msgr2=0x7f55741451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55740cfe20 0x7f55741451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 -- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55740b2070 msgr2=0x7f557414d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55740b2070 0x7f557414d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 -- 172.21.15.177:0/14545230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568009560 con 0x7f557415eba0 2023-10-25T16:17:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55792a8640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740c4900 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c770 tx=0x7f556c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c003b80 con 0x7f557415eba0 2023-10-25T16:17:00.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f556c003ce0 con 0x7f557415eba0 2023-10-25T16:17:00.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00aab0 con 0x7f557415eba0 2023-10-25T16:17:00.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740ce7c0 con 0x7f557415eba0 2023-10-25T16:17:00.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557414d170 con 0x7f557415eba0 2023-10-25T16:17:00.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557404daf0 con 0x7f557415eba0 2023-10-25T16:17:00.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f556c00ac10 con 0x7f557415eba0 2023-10-25T16:17:00.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5560066470 0x7f5560068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f556c083b70 con 0x7f557415eba0 2023-10-25T16:17:00.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f556006dfa0 con 0x7f557415eba0 2023-10-25T16:17:00.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f5578aa7640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5560066470 0x7f5560068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.114+0000 7f5578aa7640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5560066470 0x7f5560068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f55680af000 tx=0x7f556801b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:00.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.118+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f556c051080 con 0x7f557415eba0 2023-10-25T16:17:00.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.274+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55740d2150 con 0x7f557415eba0 2023-10-25T16:17:00.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.274+0000 7f55717fa640 1 -- 172.21.15.177:0/14545230 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f556c0546a0 con 0x7f557415eba0 2023-10-25T16:17:00.280 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:17:00.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5560066470 msgr2=0x7f5560068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5560066470 0x7f5560068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f55680af000 tx=0x7f556801b0c0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 msgr2=0x7f55740c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740c4900 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c770 tx=0x7f556c00cc30 comp rx=0 tx=0).stop 2023-10-25T16:17:00.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 shutdown_connections 2023-10-25T16:17:00.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5560066470 0x7f5560068930 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557415eba0 0x7f55740c4900 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f55740cfe20 0x7f55741451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 --2- 172.21.15.177:0/14545230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55740b2070 0x7f557414d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 >> 172.21.15.177:0/14545230 conn(0x7f557409a580 msgr2=0x7f55740cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:00.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 shutdown_connections 2023-10-25T16:17:00.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.278+0000 7f557ad0b640 1 -- 172.21.15.177:0/14545230 wait complete. 2023-10-25T16:17:00.297 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:17:00.298 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:00.298 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:00.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:00.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[42787]: fuse finished with error 0 and tester_r 0 2023-10-25T16:17:00.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:00.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:17:00.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:00.354 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:17:00.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:17:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:00.373 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:17:00.374 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:00.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:00.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3606370865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c06cc60 msgr2=0x7f591c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 --2- 172.21.15.177:0/3606370865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c06cc60 0x7f591c15bcf0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5904009900 tx=0x7f590401c850 comp rx=0 tx=0).stop 2023-10-25T16:17:00.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3606370865 shutdown_connections 2023-10-25T16:17:00.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 --2- 172.21.15.177:0/3606370865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c06cc60 0x7f591c15bcf0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 --2- 172.21.15.177:0/3606370865 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f591c13b0d0 0x7f591c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3606370865 >> 172.21.15.177:0/3606370865 conn(0x7f591c0afe20 msgr2=0x7f591c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:00.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3606370865 shutdown_connections 2023-10-25T16:17:00.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3606370865 wait complete. 2023-10-25T16:17:00.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 Processor -- start 2023-10-25T16:17:00.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- start start 2023-10-25T16:17:00.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f591c06cc60 0x7f591c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f591c13b0d0 0x7f591c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 0x7f591c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c155c00 con 0x7f591c15c230 2023-10-25T16:17:00.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0b1a50 con 0x7f591c06cc60 2023-10-25T16:17:00.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c153a20 con 0x7f591c13b0d0 2023-10-25T16:17:00.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 0x7f591c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 0x7f591c0b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57706/0 (socket says 172.21.15.177:57706) 2023-10-25T16:17:00.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 -- 172.21.15.177:0/3966514949 learned_addr learned my addr 172.21.15.177:0/3966514949 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:00.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591a59c640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f591c06cc60 0x7f591c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5911d9b640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f591c13b0d0 0x7f591c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 -- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f591c13b0d0 msgr2=0x7f591c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f591c13b0d0 0x7f591c156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 -- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f591c06cc60 msgr2=0x7f591c1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f591c06cc60 0x7f591c1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 -- 172.21.15.177:0/3966514949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009560 con 0x7f591c15c230 2023-10-25T16:17:00.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f591ad9d640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 0x7f591c0b0cd0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f591400b970 tx=0x7f591400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:00.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400cb40 con 0x7f591c15c230 2023-10-25T16:17:00.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f591400cd90 con 0x7f591c15c230 2023-10-25T16:17:00.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140146a0 con 0x7f591c15c230 2023-10-25T16:17:00.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c0b1770 con 0x7f591c15c230 2023-10-25T16:17:00.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.526+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c155890 con 0x7f591c15c230 2023-10-25T16:17:00.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c155410 con 0x7f591c15c230 2023-10-25T16:17:00.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f591401e440 con 0x7f591c15c230 2023-10-25T16:17:00.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f59137fe640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f58fc066470 0x7f58fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5914083f80 con 0x7f591c15c230 2023-10-25T16:17:00.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f58fc06dfa0 con 0x7f591c15c230 2023-10-25T16:17:00.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f591a59c640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f58fc066470 0x7f58fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.530+0000 7f591a59c640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f58fc066470 0x7f58fc068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f590c006fd0 tx=0x7f590c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:00.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.534+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59140b5090 con 0x7f591c15c230 2023-10-25T16:17:00.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.678+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f591c138fa0 con 0x7f591c15c230 2023-10-25T16:17:00.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.682+0000 7f59137fe640 1 -- 172.21.15.177:0/3966514949 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16647 (secure 0 0 0) 0x7f5914019060 con 0x7f591c15c230 2023-10-25T16:17:00.685 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:00.685 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:16:19.766116+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:00.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.682+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f58fc066470 msgr2=0x7f58fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.682+0000 7f5920dff640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f58fc066470 0x7f58fc068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f590c006fd0 tx=0x7f590c008040 comp rx=0 tx=0).stop 2023-10-25T16:17:00.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.682+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 msgr2=0x7f591c0b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.682+0000 7f5920dff640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 0x7f591c0b0cd0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f591400b970 tx=0x7f591400be30 comp rx=0 tx=0).stop 2023-10-25T16:17:00.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 shutdown_connections 2023-10-25T16:17:00.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f58fc066470 0x7f58fc068930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f591c15c230 0x7f591c0b0cd0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f591c13b0d0 0x7f591c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 --2- 172.21.15.177:0/3966514949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f591c06cc60 0x7f591c1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 >> 172.21.15.177:0/3966514949 conn(0x7f591c0afe20 msgr2=0x7f591c070730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:00.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 shutdown_connections 2023-10-25T16:17:00.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.686+0000 7f5920dff640 1 -- 172.21.15.177:0/3966514949 wait complete. 2023-10-25T16:17:00.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:15:50.243421+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:15:51.285070+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:17:00.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:17:00.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 -- 172.21.15.177:0/1387777258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 msgr2=0x7f2b1c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 --2- 172.21.15.177:0/1387777258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b1c004c50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800bb10 tx=0x7f2b2801cd80 comp rx=0 tx=0).stop 2023-10-25T16:17:00.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b33fff640 1 -- 172.21.15.177:0/1387777258 reap_dead start 2023-10-25T16:17:00.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 -- 172.21.15.177:0/1387777258 shutdown_connections 2023-10-25T16:17:00.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 -- 172.21.15.177:0/1387777258 >> 172.21.15.177:0/1387777258 conn(0x7f2b3409a5c0 msgr2=0x7f2b340d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:00.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 -- 172.21.15.177:0/1387777258 shutdown_connections 2023-10-25T16:17:00.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 -- 172.21.15.177:0/1387777258 wait complete. 2023-10-25T16:17:00.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 Processor -- start 2023-10-25T16:17:00.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.826+0000 7f2b39b15640 1 -- start start 2023-10-25T16:17:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b340ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b3414d750 0x7f2b34155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b341560e0 0x7f2b34166490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34156560 con 0x7f2b1c0047d0 2023-10-25T16:17:00.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340c96d0 con 0x7f2b341560e0 2023-10-25T16:17:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340c9970 con 0x7f2b3414d750 2023-10-25T16:17:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b340ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b340ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57726/0 (socket says 172.21.15.177:57726) 2023-10-25T16:17:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 -- 172.21.15.177:0/3982231854 learned_addr learned my addr 172.21.15.177:0/3982231854 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:00.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b32ffd640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b3414d750 0x7f2b34155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b33fff640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b341560e0 0x7f2b34166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 -- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b3414d750 msgr2=0x7f2b34155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b3414d750 0x7f2b34155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 -- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b341560e0 msgr2=0x7f2b34166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b341560e0 0x7f2b34166490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 -- 172.21.15.177:0/3982231854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340c9c50 con 0x7f2b1c0047d0 2023-10-25T16:17:00.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b337fe640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b340ca730 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400d6f0 tx=0x7f2b2400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:00.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400de00 con 0x7f2b1c0047d0 2023-10-25T16:17:00.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b240062e0 con 0x7f2b1c0047d0 2023-10-25T16:17:00.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b340c9f30 con 0x7f2b1c0047d0 2023-10-25T16:17:00.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400b7d0 con 0x7f2b1c0047d0 2023-10-25T16:17:00.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3414dbd0 con 0x7f2b1c0047d0 2023-10-25T16:17:00.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3404daf0 con 0x7f2b1c0047d0 2023-10-25T16:17:00.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b2400b930 con 0x7f2b1c0047d0 2023-10-25T16:17:00.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b200664a0 0x7f2b20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:00.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b240843b0 con 0x7f2b1c0047d0 2023-10-25T16:17:00.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f2b2006dfd0 con 0x7f2b1c0047d0 2023-10-25T16:17:00.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.830+0000 7f2b32ffd640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b200664a0 0x7f2b20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:00.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.834+0000 7f2b32ffd640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b200664a0 0x7f2b20068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b280b0000 tx=0x7f2b280a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:00.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.834+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b24014020 con 0x7f2b1c0047d0 2023-10-25T16:17:00.873 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:17:00.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:17:00.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.978+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b340cd630 con 0x7f2b1c0047d0 2023-10-25T16:17:00.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.978+0000 7f2b1bfff640 1 -- 172.21.15.177:0/3982231854 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b24055350 con 0x7f2b1c0047d0 2023-10-25T16:17:00.984 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:17:00.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b200664a0 msgr2=0x7f2b20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b200664a0 0x7f2b20068960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2b280b0000 tx=0x7f2b280a7040 comp rx=0 tx=0).stop 2023-10-25T16:17:00.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 msgr2=0x7f2b340ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:00.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b340ca730 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400d6f0 tx=0x7f2b2400dbb0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 shutdown_connections 2023-10-25T16:17:00.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b200664a0 0x7f2b20068960 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b341560e0 0x7f2b34166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b3414d750 0x7f2b34155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 --2- 172.21.15.177:0/3982231854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b1c0047d0 0x7f2b340ca730 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:00.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 >> 172.21.15.177:0/3982231854 conn(0x7f2b3409a5c0 msgr2=0x7f2b340b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:00.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 shutdown_connections 2023-10-25T16:17:00.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:00.982+0000 7f2b39b15640 1 -- 172.21.15.177:0/3982231854 wait complete. 2023-10-25T16:17:01.002 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:17:01.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/486649854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 msgr2=0x7fb6300af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 --2- 172.21.15.177:0/486649854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb6300af5d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fb618009900 tx=0x7fb61801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/486649854 shutdown_connections 2023-10-25T16:17:01.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 --2- 172.21.15.177:0/486649854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63006f570 0x7fb63006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 --2- 172.21.15.177:0/486649854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb6300af5d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/486649854 >> 172.21.15.177:0/486649854 conn(0x7fb6300b2450 msgr2=0x7fb6300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:01.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/486649854 shutdown_connections 2023-10-25T16:17:01.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/486649854 wait complete. 2023-10-25T16:17:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 Processor -- start 2023-10-25T16:17:01.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- start start 2023-10-25T16:17:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63006bf90 0x7fb63013ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63006f570 0x7fb630153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb630139b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63013f680 con 0x7fb630140cf0 2023-10-25T16:17:01.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630138ed0 con 0x7fb63006bf90 2023-10-25T16:17:01.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63013ed50 con 0x7fb63006f570 2023-10-25T16:17:01.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb630139b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb630139b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57752/0 (socket says 172.21.15.177:57752) 2023-10-25T16:17:01.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 -- 172.21.15.177:0/2564533450 learned_addr learned my addr 172.21.15.177:0/2564533450 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:01.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62ed9d640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63006bf90 0x7fb63013ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62e59c640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63006f570 0x7fb630153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 -- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63006f570 msgr2=0x7fb630153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63006f570 0x7fb630153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 -- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63006bf90 msgr2=0x7fb63013ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63006bf90 0x7fb63013ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 -- 172.21.15.177:0/2564533450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618009560 con 0x7fb630140cf0 2023-10-25T16:17:01.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb62f59e640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb630139b40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c780 tx=0x7fb62800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:01.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628003d90 con 0x7fb630140cf0 2023-10-25T16:17:01.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb62800ce90 con 0x7fb630140cf0 2023-10-25T16:17:01.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63013f030 con 0x7fb630140cf0 2023-10-25T16:17:01.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280052d0 con 0x7fb630140cf0 2023-10-25T16:17:01.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.142+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6301404e0 con 0x7fb630140cf0 2023-10-25T16:17:01.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63013f7f0 con 0x7fb630140cf0 2023-10-25T16:17:01.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb628005430 con 0x7fb630140cf0 2023-10-25T16:17:01.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb6277fe640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb610066470 0x7fb610068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb628083600 con 0x7fb630140cf0 2023-10-25T16:17:01.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fb61006dfa0 con 0x7fb630140cf0 2023-10-25T16:17:01.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb62ed9d640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb610066470 0x7fb610068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.146+0000 7fb62ed9d640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb610066470 0x7fb610068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6180ae000 tx=0x7fb61801b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:01.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.150+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb628017060 con 0x7fb630140cf0 2023-10-25T16:17:01.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb63004daf0 con 0x7fb630140cf0 2023-10-25T16:17:01.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6277fe640 1 -- 172.21.15.177:0/2564533450 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6280509f0 con 0x7fb630140cf0 2023-10-25T16:17:01.293 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:17:01.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb610066470 msgr2=0x7fb610068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb610066470 0x7fb610068930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6180ae000 tx=0x7fb61801b030 comp rx=0 tx=0).stop 2023-10-25T16:17:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 msgr2=0x7fb630139b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb630139b40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c780 tx=0x7fb62800cc40 comp rx=0 tx=0).stop 2023-10-25T16:17:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 shutdown_connections 2023-10-25T16:17:01.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb610066470 0x7fb610068930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb630140cf0 0x7fb630139b40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63006f570 0x7fb630153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 --2- 172.21.15.177:0/2564533450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63006bf90 0x7fb63013ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 >> 172.21.15.177:0/2564533450 conn(0x7fb6300b2450 msgr2=0x7fb630070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:01.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 shutdown_connections 2023-10-25T16:17:01.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.290+0000 7fb6351b5640 1 -- 172.21.15.177:0/2564533450 wait complete. 2023-10-25T16:17:01.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:17:01.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fbbfff640 1 -- 172.21.15.177:0/4191075835 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0ad6a0 con 0x7f9fc40af100 2023-10-25T16:17:01.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 -- 172.21.15.177:0/4191075835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 msgr2=0x7f9fc4158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 --2- 172.21.15.177:0/4191075835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc4158170 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40cdef0 tx=0x7f9fbc01ccd0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 -- 172.21.15.177:0/4191075835 shutdown_connections 2023-10-25T16:17:01.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 --2- 172.21.15.177:0/4191075835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc4158170 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 --2- 172.21.15.177:0/4191075835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 0x7f9fc40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 --2- 172.21.15.177:0/4191075835 >> v2:172.21.15.184:3300/0 conn(0x7f9fc414e810 0x7f9fc40cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 -- 172.21.15.177:0/4191075835 >> 172.21.15.177:0/4191075835 conn(0x7f9fc40b2450 msgr2=0x7f9fc40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:01.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 -- 172.21.15.177:0/4191075835 shutdown_connections 2023-10-25T16:17:01.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.438+0000 7f9fcb933640 1 -- 172.21.15.177:0/4191075835 wait complete. 2023-10-25T16:17:01.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 Processor -- start 2023-10-25T16:17:01.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- start start 2023-10-25T16:17:01.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fc414e810 0x7f9fc4159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 0x7f9fc4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc41f3b70 con 0x7f9fc40af100 2023-10-25T16:17:01.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc41f2f40 con 0x7f9fc414e810 2023-10-25T16:17:01.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc41f3240 con 0x7f9fc415bdb0 2023-10-25T16:17:01.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc414dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57778/0 (socket says 172.21.15.177:57778) 2023-10-25T16:17:01.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 -- 172.21.15.177:0/2823754345 learned_addr learned my addr 172.21.15.177:0/2823754345 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:01.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc9ed0640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 0x7f9fc4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc8ece640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fc414e810 0x7f9fc4159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 -- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 msgr2=0x7f9fc4159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 0x7f9fc4159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 -- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fc414e810 msgr2=0x7f9fc4159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fc414e810 0x7f9fc4159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 -- 172.21.15.177:0/2823754345 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0098e0 con 0x7f9fc40af100 2023-10-25T16:17:01.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc9ed0640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 0x7f9fc4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:01.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc8ece640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fc414e810 0x7f9fc4159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:01.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fc96cf640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc414dac0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000b550 tx=0x7f9fc000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:01.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0010870 con 0x7f9fc40af100 2023-10-25T16:17:01.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9fc0010ae0 con 0x7f9fc40af100 2023-10-25T16:17:01.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc41f3520 con 0x7f9fc40af100 2023-10-25T16:17:01.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc000f3c0 con 0x7f9fc40af100 2023-10-25T16:17:01.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc414e000 con 0x7f9fc40af100 2023-10-25T16:17:01.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc404daf0 con 0x7f9fc40af100 2023-10-25T16:17:01.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9fc000f520 con 0x7f9fc40af100 2023-10-25T16:17:01.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.442+0000 7f9fb9ffb640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9fa80664a0 0x7f9fa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.446+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fc0084110 con 0x7f9fc40af100 2023-10-25T16:17:01.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.446+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f9fa806dfd0 con 0x7f9fc40af100 2023-10-25T16:17:01.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.446+0000 7f9fc8ece640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9fa80664a0 0x7f9fa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.446+0000 7f9fc8ece640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9fa80664a0 0x7f9fa8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40cdad0 tx=0x7f9fb4008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:01.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.450+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9fc0014060 con 0x7f9fc40af100 2023-10-25T16:17:01.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fc414ed00 con 0x7f9fc40af100 2023-10-25T16:17:01.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fb9ffb640 1 -- 172.21.15.177:0/2823754345 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fc001e070 con 0x7f9fc40af100 2023-10-25T16:17:01.606 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:17:01.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9fa80664a0 msgr2=0x7f9fa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9fa80664a0 0x7f9fa8068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40cdad0 tx=0x7f9fb4008040 comp rx=0 tx=0).stop 2023-10-25T16:17:01.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 msgr2=0x7f9fc414dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc414dac0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000b550 tx=0x7f9fc000ba10 comp rx=0 tx=0).stop 2023-10-25T16:17:01.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 shutdown_connections 2023-10-25T16:17:01.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9fa80664a0 0x7f9fa8068960 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fc415bdb0 0x7f9fc4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fc414e810 0x7f9fc4159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 --2- 172.21.15.177:0/2823754345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fc40af100 0x7f9fc414dac0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 >> 172.21.15.177:0/2823754345 conn(0x7f9fc40b2450 msgr2=0x7f9fc40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:01.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 shutdown_connections 2023-10-25T16:17:01.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.602+0000 7f9fcb933640 1 -- 172.21.15.177:0/2823754345 wait complete. 2023-10-25T16:17:01.625 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:17:01.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 -- 172.21.15.177:0/339572918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380b2bc0 msgr2=0x7f73380b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 --2- 172.21.15.177:0/339572918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380b2bc0 0x7f73380b2fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7330009bc0 tx=0x7f733001cb50 comp rx=0 tx=0).stop 2023-10-25T16:17:01.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 -- 172.21.15.177:0/339572918 shutdown_connections 2023-10-25T16:17:01.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 --2- 172.21.15.177:0/339572918 >> v2:172.21.15.184:3300/0 conn(0x7f73380654c0 0x7f733806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 --2- 172.21.15.177:0/339572918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380b2bc0 0x7f73380b2fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 -- 172.21.15.177:0/339572918 >> 172.21.15.177:0/339572918 conn(0x7f73380af5b0 msgr2=0x7f73380af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:01.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 -- 172.21.15.177:0/339572918 shutdown_connections 2023-10-25T16:17:01.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.746+0000 7f733e18a640 1 -- 172.21.15.177:0/339572918 wait complete. 2023-10-25T16:17:01.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 Processor -- start 2023-10-25T16:17:01.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- start start 2023-10-25T16:17:01.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 0x7f733813ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73380b2bc0 0x7f73381561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380cbd10 0x7f7338146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733814f4a0 con 0x7f73380654c0 2023-10-25T16:17:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338155660 con 0x7f73380b2bc0 2023-10-25T16:17:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7338154a50 con 0x7f73380cbd10 2023-10-25T16:17:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 0x7f733813ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 0x7f733813ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57790/0 (socket says 172.21.15.177:57790) 2023-10-25T16:17:01.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 -- 172.21.15.177:0/1246540529 learned_addr learned my addr 172.21.15.177:0/1246540529 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:01.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f7336ffd640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73380b2bc0 0x7f73381561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f7337fff640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380cbd10 0x7f7338146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 -- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380cbd10 msgr2=0x7f7338146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380cbd10 0x7f7338146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 -- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73380b2bc0 msgr2=0x7f73381561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73380b2bc0 0x7f73381561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 -- 172.21.15.177:0/1246540529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330009820 con 0x7f73380654c0 2023-10-25T16:17:01.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f7337fff640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380cbd10 0x7f7338146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:01.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f73377fe640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 0x7f733813ff60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7330009b10 tx=0x7f7330009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:01.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330004200 con 0x7f73380654c0 2023-10-25T16:17:01.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7330004450 con 0x7f73380654c0 2023-10-25T16:17:01.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7338154d30 con 0x7f73380654c0 2023-10-25T16:17:01.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330004820 con 0x7f73380654c0 2023-10-25T16:17:01.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73381552f0 con 0x7f73380654c0 2023-10-25T16:17:01.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733804daf0 con 0x7f73380654c0 2023-10-25T16:17:01.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.750+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f73300b4040 con 0x7f73380654c0 2023-10-25T16:17:01.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.754+0000 7f731ffff640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7324066470 0x7f7324068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:01.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.754+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f733011dfd0 con 0x7f73380654c0 2023-10-25T16:17:01.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.754+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f732406dfa0 con 0x7f73380654c0 2023-10-25T16:17:01.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.754+0000 7f7336ffd640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7324066470 0x7f7324068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:01.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.754+0000 7f7336ffd640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7324066470 0x7f7324068930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f733814a5c0 tx=0x7f732c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:01.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.758+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73300eb450 con 0x7f73380654c0 2023-10-25T16:17:01.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.918+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73380acac0 con 0x7f73380654c0 2023-10-25T16:17:01.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.918+0000 7f731ffff640 1 -- 172.21.15.177:0/1246540529 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73300b2070 con 0x7f73380654c0 2023-10-25T16:17:01.923 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:17:01.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7324066470 msgr2=0x7f7324068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7324066470 0x7f7324068930 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f733814a5c0 tx=0x7f732c009040 comp rx=0 tx=0).stop 2023-10-25T16:17:01.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 msgr2=0x7f733813ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:01.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 0x7f733813ff60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7330009b10 tx=0x7f7330009300 comp rx=0 tx=0).stop 2023-10-25T16:17:01.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 shutdown_connections 2023-10-25T16:17:01.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7324066470 0x7f7324068930 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73380cbd10 0x7f7338146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73380b2bc0 0x7f73381561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 --2- 172.21.15.177:0/1246540529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73380654c0 0x7f733813ff60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 >> 172.21.15.177:0/1246540529 conn(0x7f73380af5b0 msgr2=0x7f73380aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 shutdown_connections 2023-10-25T16:17:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:01.922+0000 7f733e18a640 1 -- 172.21.15.177:0/1246540529 wait complete. 2023-10-25T16:17:01.940 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:17:01.941 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:01.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:01.995 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:01.995 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34423]: fuse finished with error 0 and tester_r 0 2023-10-25T16:17:01.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:02.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:17:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:02.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:17:02.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:02.004 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:17:02.013 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:17:02.013 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:02.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:17:02.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:17:02.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:02.020 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:17:02.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:17:02.065 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:17:02.065 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:17:02.066 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:02.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:17:02.072 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:17:02.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:02.072 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:17:02.118 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:17:02.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:17:02.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 -- 172.21.15.177:0/2212405703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc15bc70 msgr2=0x7f3efc15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 --2- 172.21.15.177:0/2212405703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc15bc70 0x7f3efc15c0b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009900 tx=0x7f3eec01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 -- 172.21.15.177:0/2212405703 shutdown_connections 2023-10-25T16:17:02.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 --2- 172.21.15.177:0/2212405703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3efc0cb710 0x7f3efc0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 --2- 172.21.15.177:0/2212405703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc15bc70 0x7f3efc15c0b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 -- 172.21.15.177:0/2212405703 >> 172.21.15.177:0/2212405703 conn(0x7f3efc0cd6b0 msgr2=0x7f3efc0cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:02.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 -- 172.21.15.177:0/2212405703 shutdown_connections 2023-10-25T16:17:02.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 -- 172.21.15.177:0/2212405703 wait complete. 2023-10-25T16:17:02.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 Processor -- start 2023-10-25T16:17:02.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.242+0000 7f3f04586640 1 -- start start 2023-10-25T16:17:02.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3efc0cb710 0x7f3efc158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 0x7f3efc14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3efc15bc70 0x7f3efc157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc158be0 con 0x7f3efc14f1e0 2023-10-25T16:17:02.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc158ec0 con 0x7f3efc15bc70 2023-10-25T16:17:02.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1591a0 con 0x7f3efc0cb710 2023-10-25T16:17:02.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 0x7f3efc14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 0x7f3efc14c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57804/0 (socket says 172.21.15.177:57804) 2023-10-25T16:17:02.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 -- 172.21.15.177:0/3714685961 learned_addr learned my addr 172.21.15.177:0/3714685961 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:02.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 -- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3efc0cb710 msgr2=0x7f3efc158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f02322640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3efc0cb710 0x7f3efc158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f02b23640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3efc15bc70 0x7f3efc157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3efc0cb710 0x7f3efc158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 -- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3efc15bc70 msgr2=0x7f3efc157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3efc15bc70 0x7f3efc157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 -- 172.21.15.177:0/3714685961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009560 con 0x7f3efc14f1e0 2023-10-25T16:17:02.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f01b21640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 0x7f3efc14c4d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009850 tx=0x7f3eec0a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:02.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec004340 con 0x7f3efc14f1e0 2023-10-25T16:17:02.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3eec003600 con 0x7f3efc14f1e0 2023-10-25T16:17:02.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0039d0 con 0x7f3efc14f1e0 2023-10-25T16:17:02.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc157320 con 0x7f3efc14f1e0 2023-10-25T16:17:02.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc14ca10 con 0x7f3efc14f1e0 2023-10-25T16:17:02.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc04daf0 con 0x7f3efc14f1e0 2023-10-25T16:17:02.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3eec0b4070 con 0x7f3efc14f1e0 2023-10-25T16:17:02.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3ee0066470 0x7f3ee0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3eec11df00 con 0x7f3efc14f1e0 2023-10-25T16:17:02.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7f3ee006dfa0 con 0x7f3efc14f1e0 2023-10-25T16:17:02.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.246+0000 7f3f02322640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3ee0066470 0x7f3ee0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.250+0000 7f3f02322640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3ee0066470 0x7f3ee0068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4003d60 tx=0x7f3ef4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:02.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.250+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3eec0eb4d0 con 0x7f3efc14f1e0 2023-10-25T16:17:02.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.426+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3efc04daf0 con 0x7f3efc14f1e0 2023-10-25T16:17:02.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.426+0000 7f3ef2ffd640 1 -- 172.21.15.177:0/3714685961 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f3eec0b2070 con 0x7f3efc14f1e0 2023-10-25T16:17:02.431 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:02.431 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:17:02.431 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:17:02.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3ee0066470 msgr2=0x7f3ee0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3ee0066470 0x7f3ee0068930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4003d60 tx=0x7f3ef4009040 comp rx=0 tx=0).stop 2023-10-25T16:17:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 msgr2=0x7f3efc14c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 0x7f3efc14c4d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009850 tx=0x7f3eec0a57d0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 shutdown_connections 2023-10-25T16:17:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3ee0066470 0x7f3ee0068930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3efc15bc70 0x7f3efc157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3efc14f1e0 0x7f3efc14c4d0 secure :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009850 tx=0x7f3eec0a57d0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 --2- 172.21.15.177:0/3714685961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3efc0cb710 0x7f3efc158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 >> 172.21.15.177:0/3714685961 conn(0x7f3efc0cd6b0 msgr2=0x7f3efc151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 shutdown_connections 2023-10-25T16:17:02.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.430+0000 7f3f04586640 1 -- 172.21.15.177:0/3714685961 wait complete. 2023-10-25T16:17:02.448 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:02.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/389054678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100af2d0 msgr2=0x7fc710158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 --2- 172.21.15.177:0/389054678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100af2d0 0x7fc710158170 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc708009bc0 tx=0x7fc70801cab0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/389054678 shutdown_connections 2023-10-25T16:17:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 --2- 172.21.15.177:0/389054678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100af2d0 0x7fc710158170 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/389054678 >> 172.21.15.177:0/389054678 conn(0x7fc7100b2450 msgr2=0x7fc7100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/389054678 shutdown_connections 2023-10-25T16:17:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/389054678 wait complete. 2023-10-25T16:17:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 Processor -- start 2023-10-25T16:17:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- start start 2023-10-25T16:17:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7100af2d0 0x7fc71014a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7100cbfa0 0x7fc7100cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 0x7fc7100cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71014cc80 con 0x7fc71014e810 2023-10-25T16:17:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71014ae00 con 0x7fc7100cbfa0 2023-10-25T16:17:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc710154ad0 con 0x7fc7100af2d0 2023-10-25T16:17:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 0x7fc7100cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 0x7fc7100cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57826/0 (socket says 172.21.15.177:57826) 2023-10-25T16:17:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 -- 172.21.15.177:0/3363108834 learned_addr learned my addr 172.21.15.177:0/3363108834 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc707fff640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7100cbfa0 0x7fc7100cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70e59c640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7100af2d0 0x7fc71014a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 -- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7100af2d0 msgr2=0x7fc71014a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7100af2d0 0x7fc71014a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 -- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7100cbfa0 msgr2=0x7fc7100cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7100cbfa0 0x7fc7100cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 -- 172.21.15.177:0/3363108834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708009820 con 0x7fc71014e810 2023-10-25T16:17:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc707fff640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7100cbfa0 0x7fc7100cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc70ed9d640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 0x7fc7100cd390 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc7080196c0 tx=0x7fc7080a5900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708004d10 con 0x7fc71014e810 2023-10-25T16:17:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc708003fe0 con 0x7fc71014e810 2023-10-25T16:17:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc710154db0 con 0x7fc71014e810 2023-10-25T16:17:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708004370 con 0x7fc71014e810 2023-10-25T16:17:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100ae000 con 0x7fc71014e810 2023-10-25T16:17:02.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.557+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7100a74f0 con 0x7fc71014e810 2023-10-25T16:17:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.561+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7080b4040 con 0x7fc71014e810 2023-10-25T16:17:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.561+0000 7fc706ffd640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6f0066470 0x7fc6f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.561+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc70811e0b0 con 0x7fc71014e810 2023-10-25T16:17:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.561+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7fc6f006dfa0 con 0x7fc71014e810 2023-10-25T16:17:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.561+0000 7fc70e59c640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6f0066470 0x7fc6f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.561+0000 7fc70e59c640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6f0066470 0x7fc6f0068930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc700000f70 tx=0x7fc700009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:02.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.565+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7080b2060 con 0x7fc71014e810 2023-10-25T16:17:02.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.721+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc71004daf0 con 0x7fc71014e810 2023-10-25T16:17:02.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc706ffd640 1 -- 172.21.15.177:0/3363108834 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16647 (secure 0 0 0) 0x7fc7080bc070 con 0x7fc71014e810 2023-10-25T16:17:02.728 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:02.729 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:16:19.766116+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:02.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6f0066470 msgr2=0x7fc6f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6f0066470 0x7fc6f0068930 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc700000f70 tx=0x7fc700009040 comp rx=0 tx=0).stop 2023-10-25T16:17:02.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 msgr2=0x7fc7100cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 0x7fc7100cd390 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc7080196c0 tx=0x7fc7080a5900 comp rx=0 tx=0).stop 2023-10-25T16:17:02.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 shutdown_connections 2023-10-25T16:17:02.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6f0066470 0x7fc6f0068930 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71014e810 0x7fc7100cd390 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7100cbfa0 0x7fc7100cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 --2- 172.21.15.177:0/3363108834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7100af2d0 0x7fc71014a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 >> 172.21.15.177:0/3363108834 conn(0x7fc7100b2450 msgr2=0x7fc7100afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:02.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 shutdown_connections 2023-10-25T16:17:02.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.725+0000 7fc714b39640 1 -- 172.21.15.177:0/3363108834 wait complete. 2023-10-25T16:17:02.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:15:50.243421+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:15:51.285070+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:17:02.748 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:17:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 -- 172.21.15.177:0/1352735582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 msgr2=0x7f5ac8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/1352735582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ac8003df0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0006f10 tx=0x7f5ad001ced0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 -- 172.21.15.177:0/1352735582 shutdown_connections 2023-10-25T16:17:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/1352735582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ac8003df0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 -- 172.21.15.177:0/1352735582 >> 172.21.15.177:0/1352735582 conn(0x7f5ae00b2450 msgr2=0x7f5ae00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 -- 172.21.15.177:0/1352735582 shutdown_connections 2023-10-25T16:17:02.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 -- 172.21.15.177:0/1352735582 wait complete. 2023-10-25T16:17:02.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 Processor -- start 2023-10-25T16:17:02.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.873+0000 7f5ae4f67640 1 -- start start 2023-10-25T16:17:02.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ae0147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b0a90 0x7f5ae00b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae01f49b0 0x7f5ae01f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0146270 con 0x7f5ac80039d0 2023-10-25T16:17:02.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01480a0 con 0x7f5ae00b0a90 2023-10-25T16:17:02.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01f5370 con 0x7f5ae01f49b0 2023-10-25T16:17:02.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ae0147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ae0147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57840/0 (socket says 172.21.15.177:57840) 2023-10-25T16:17:02.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 -- 172.21.15.177:0/32168927 learned_addr learned my addr 172.21.15.177:0/32168927 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:02.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5addd9b640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b0a90 0x7f5ae00b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 -- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae01f49b0 msgr2=0x7f5ae01f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae01f49b0 0x7f5ae01f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 -- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b0a90 msgr2=0x7f5ae00b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:02.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b0a90 0x7f5ae00b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:02.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 -- 172.21.15.177:0/32168927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0158db0 con 0x7f5ac80039d0 2023-10-25T16:17:02.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5addd9b640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b0a90 0x7f5ae00b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:02.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ade59c640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ae0147b60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5ad001c940 tx=0x7f5ad0001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:02.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00b3070 con 0x7f5ac80039d0 2023-10-25T16:17:02.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ad00061e0 con 0x7f5ac80039d0 2023-10-25T16:17:02.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae0146270 con 0x7f5ac80039d0 2023-10-25T16:17:02.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00065b0 con 0x7f5ac80039d0 2023-10-25T16:17:02.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae0159370 con 0x7f5ac80039d0 2023-10-25T16:17:02.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae00cd6f0 con 0x7f5ac80039d0 2023-10-25T16:17:02.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5ad00ab020 con 0x7f5ac80039d0 2023-10-25T16:17:02.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac00664a0 0x7f5ac0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:02.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ad011ddc0 con 0x7f5ac80039d0 2023-10-25T16:17:02.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f5ac006dfd0 con 0x7f5ac80039d0 2023-10-25T16:17:02.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5addd9b640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac00664a0 0x7f5ac0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:02.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.877+0000 7f5addd9b640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac00664a0 0x7f5ac0068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4000fc0 tx=0x7f5ad4006af0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:02.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:02.881+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ad00eb240 con 0x7f5ac80039d0 2023-10-25T16:17:03.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ae004daf0 con 0x7f5ac80039d0 2023-10-25T16:17:03.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5aceffd640 1 -- 172.21.15.177:0/32168927 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ad00ee860 con 0x7f5ac80039d0 2023-10-25T16:17:03.046 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:17:03.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac00664a0 msgr2=0x7f5ac0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac00664a0 0x7f5ac0068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4000fc0 tx=0x7f5ad4006af0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 msgr2=0x7f5ae0147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ae0147b60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5ad001c940 tx=0x7f5ad0001020 comp rx=0 tx=0).stop 2023-10-25T16:17:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 shutdown_connections 2023-10-25T16:17:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac00664a0 0x7f5ac0068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae01f49b0 0x7f5ae01f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b0a90 0x7f5ae00b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.041+0000 7f5ae4f67640 1 --2- 172.21.15.177:0/32168927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac80039d0 0x7f5ae0147b60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.045+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 >> 172.21.15.177:0/32168927 conn(0x7f5ae00b2450 msgr2=0x7f5ae00ad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.045+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 shutdown_connections 2023-10-25T16:17:03.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.045+0000 7f5ae4f67640 1 -- 172.21.15.177:0/32168927 wait complete. 2023-10-25T16:17:03.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:17:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/40433490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 msgr2=0x7f42d00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 --2- 172.21.15.177:0/40433490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00cb5c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009c80 tx=0x7f42c801ccb0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/40433490 shutdown_connections 2023-10-25T16:17:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 --2- 172.21.15.177:0/40433490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00cb5c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 --2- 172.21.15.177:0/40433490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42d006c090 0x7f42d00af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/40433490 >> 172.21.15.177:0/40433490 conn(0x7f42d00b2450 msgr2=0x7f42d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/40433490 shutdown_connections 2023-10-25T16:17:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/40433490 wait complete. 2023-10-25T16:17:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 Processor -- start 2023-10-25T16:17:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- start start 2023-10-25T16:17:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42d006c090 0x7f42d00aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42d0140e90 0x7f42d00ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00ac220 con 0x7f42d006f570 2023-10-25T16:17:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00ab6a0 con 0x7f42d0140e90 2023-10-25T16:17:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00ab980 con 0x7f42d006c090 2023-10-25T16:17:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57868/0 (socket says 172.21.15.177:57868) 2023-10-25T16:17:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 -- 172.21.15.177:0/3370752936 learned_addr learned my addr 172.21.15.177:0/3370752936 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42ce59c640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42d006c090 0x7f42d00aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42ced9d640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42d0140e90 0x7f42d00ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 -- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42d006c090 msgr2=0x7f42d00aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42d006c090 0x7f42d00aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 -- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42d0140e90 msgr2=0x7f42d00ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42d0140e90 0x7f42d00ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 -- 172.21.15.177:0/3370752936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c80098e0 con 0x7f42d006f570 2023-10-25T16:17:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c5d9b640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00ab050 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c920 tx=0x7f42b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8007c70 con 0x7f42d006f570 2023-10-25T16:17:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f42b8005030 con 0x7f42d006f570 2023-10-25T16:17:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d00abc60 con 0x7f42d006f570 2023-10-25T16:17:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8005440 con 0x7f42d006f570 2023-10-25T16:17:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.189+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d013ca70 con 0x7f42d006f570 2023-10-25T16:17:03.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d013dc30 con 0x7f42d006f570 2023-10-25T16:17:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f42b80047d0 con 0x7f42d006f570 2023-10-25T16:17:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42c77fe640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42b0066470 0x7f42b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42b80843f0 con 0x7f42d006f570 2023-10-25T16:17:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f42b006dfa0 con 0x7f42d006f570 2023-10-25T16:17:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42ce59c640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42b0066470 0x7f42b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.193+0000 7f42ce59c640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42b0066470 0x7f42b0068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b810 tx=0x7f42c0008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.197+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42b801d020 con 0x7f42d006f570 2023-10-25T16:17:03.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.349+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42d004daf0 con 0x7f42d006f570 2023-10-25T16:17:03.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.349+0000 7f42c77fe640 1 -- 172.21.15.177:0/3370752936 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42d013dc30 con 0x7f42d006f570 2023-10-25T16:17:03.355 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:17:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42b0066470 msgr2=0x7f42b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42b0066470 0x7f42b0068930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b810 tx=0x7f42c0008040 comp rx=0 tx=0).stop 2023-10-25T16:17:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 msgr2=0x7f42d00ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00ab050 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c920 tx=0x7f42b800cde0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 shutdown_connections 2023-10-25T16:17:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f42b0066470 0x7f42b0068930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42d0140e90 0x7f42d00ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42d006f570 0x7f42d00ab050 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 --2- 172.21.15.177:0/3370752936 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42d006c090 0x7f42d00aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 >> 172.21.15.177:0/3370752936 conn(0x7f42d00b2450 msgr2=0x7f42d0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 shutdown_connections 2023-10-25T16:17:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.353+0000 7f42d4921640 1 -- 172.21.15.177:0/3370752936 wait complete. 2023-10-25T16:17:03.374 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:17:03.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/3345639619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d1815eba0 msgr2=0x7f8d180b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/3345639619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d1815eba0 0x7f8d180b4100 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f8d180cb890 tx=0x7f8d0801cad0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/3345639619 shutdown_connections 2023-10-25T16:17:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/3345639619 >> v2:172.21.15.184:3300/0 conn(0x7f8d180cdb10 0x7f8d180cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/3345639619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d1815eba0 0x7f8d180b4100 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/3345639619 >> 172.21.15.177:0/3345639619 conn(0x7f8d1809a5c0 msgr2=0x7f8d180d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/3345639619 shutdown_connections 2023-10-25T16:17:03.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/3345639619 wait complete. 2023-10-25T16:17:03.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 Processor -- start 2023-10-25T16:17:03.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.493+0000 7f8d1f0a5640 1 -- start start 2023-10-25T16:17:03.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d180b2120 0x7f8d1815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 0x7f8d1814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d1815eba0 0x7f8d1815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1815a640 con 0x7f8d180cdb10 2023-10-25T16:17:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1814bbd0 con 0x7f8d1815eba0 2023-10-25T16:17:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180ca080 con 0x7f8d180b2120 2023-10-25T16:17:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 0x7f8d1814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 0x7f8d1814a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57890/0 (socket says 172.21.15.177:57890) 2023-10-25T16:17:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 -- 172.21.15.177:0/2615894144 learned_addr learned my addr 172.21.15.177:0/2615894144 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:03.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1ce41640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d180b2120 0x7f8d1815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1d642640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d1815eba0 0x7f8d1815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 -- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d180b2120 msgr2=0x7f8d1815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d180b2120 0x7f8d1815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 -- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d1815eba0 msgr2=0x7f8d1815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d1815eba0 0x7f8d1815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 -- 172.21.15.177:0/2615894144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08009820 con 0x7f8d180cdb10 2023-10-25T16:17:03.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d17fff640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 0x7f8d1814a280 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c430 tx=0x7f8d0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:03.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c004230 con 0x7f8d180cdb10 2023-10-25T16:17:03.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8d0c0044a0 con 0x7f8d180cdb10 2023-10-25T16:17:03.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1815bcb0 con 0x7f8d180cdb10 2023-10-25T16:17:03.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c003840 con 0x7f8d180cdb10 2023-10-25T16:17:03.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1815c270 con 0x7f8d180cdb10 2023-10-25T16:17:03.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1804daf0 con 0x7f8d180cdb10 2023-10-25T16:17:03.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d0c0039a0 con 0x7f8d180cdb10 2023-10-25T16:17:03.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d04066470 0x7f8d04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d0c083720 con 0x7f8d180cdb10 2023-10-25T16:17:03.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=74}) v3 -- 0x7f8d0406dfa0 con 0x7f8d180cdb10 2023-10-25T16:17:03.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.497+0000 7f8d1ce41640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d04066470 0x7f8d04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.501+0000 7f8d1ce41640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d04066470 0x7f8d04068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8d080af000 tx=0x7f8d0801b310 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:03.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.501+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d0c017020 con 0x7f8d180cdb10 2023-10-25T16:17:03.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.657+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d180ce930 con 0x7f8d180cdb10 2023-10-25T16:17:03.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.657+0000 7f8d157fa640 1 -- 172.21.15.177:0/2615894144 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d0c054630 con 0x7f8d180cdb10 2023-10-25T16:17:03.662 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:17:03.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d04066470 msgr2=0x7f8d04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d04066470 0x7f8d04068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8d080af000 tx=0x7f8d0801b310 comp rx=0 tx=0).stop 2023-10-25T16:17:03.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 msgr2=0x7f8d1814a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 0x7f8d1814a280 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c430 tx=0x7f8d0c00c8f0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 shutdown_connections 2023-10-25T16:17:03.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d04066470 0x7f8d04068930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d1815eba0 0x7f8d1815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d180cdb10 0x7f8d1814a280 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 --2- 172.21.15.177:0/2615894144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d180b2120 0x7f8d1815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 >> 172.21.15.177:0/2615894144 conn(0x7f8d1809a5c0 msgr2=0x7f8d1806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 shutdown_connections 2023-10-25T16:17:03.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.661+0000 7f8d1f0a5640 1 -- 172.21.15.177:0/2615894144 wait complete. 2023-10-25T16:17:03.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:03.777 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:17:03.773+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-10-25T16:17:03.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 -- 172.21.15.177:0/2642447331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e4070b60 msgr2=0x7f62e40b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 --2- 172.21.15.177:0/2642447331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e4070b60 0x7f62e40b2480 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f62e406f130 tx=0x7f62dc01caa0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 -- 172.21.15.177:0/2642447331 shutdown_connections 2023-10-25T16:17:03.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 --2- 172.21.15.177:0/2642447331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e4070b60 0x7f62e40b2480 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 --2- 172.21.15.177:0/2642447331 >> v2:172.21.15.184:3300/0 conn(0x7f62e40715f0 0x7f62e4070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 -- 172.21.15.177:0/2642447331 >> 172.21.15.177:0/2642447331 conn(0x7f62e40cdf10 msgr2=0x7f62e40ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 -- 172.21.15.177:0/2642447331 shutdown_connections 2023-10-25T16:17:03.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 -- 172.21.15.177:0/2642447331 wait complete. 2023-10-25T16:17:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 Processor -- start 2023-10-25T16:17:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.793+0000 7f62eb325640 1 -- start start 2023-10-25T16:17:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e4070b60 0x7f62e4146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e40715f0 0x7f62e41477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 0x7f62e4145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4147d20 con 0x7f62e41581a0 2023-10-25T16:17:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4159a90 con 0x7f62e40715f0 2023-10-25T16:17:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4147500 con 0x7f62e4070b60 2023-10-25T16:17:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 0x7f62e4145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 0x7f62e4145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57912/0 (socket says 172.21.15.177:57912) 2023-10-25T16:17:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 -- 172.21.15.177:0/3033213221 learned_addr learned my addr 172.21.15.177:0/3033213221 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e88c0640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e40715f0 0x7f62e41477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e90c1640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e4070b60 0x7f62e4146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 -- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e4070b60 msgr2=0x7f62e4146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e4070b60 0x7f62e4146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 -- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e40715f0 msgr2=0x7f62e41477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e40715f0 0x7f62e41477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 -- 172.21.15.177:0/3033213221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc009820 con 0x7f62e41581a0 2023-10-25T16:17:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e88c0640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e40715f0 0x7f62e41477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e98c2640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 0x7f62e4145c10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0196b0 tx=0x7f62dc0a5990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc003b80 con 0x7f62e41581a0 2023-10-25T16:17:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f62dc003dd0 con 0x7f62e41581a0 2023-10-25T16:17:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e4159cc0 con 0x7f62e41581a0 2023-10-25T16:17:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc004290 con 0x7f62e41581a0 2023-10-25T16:17:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e415a280 con 0x7f62e41581a0 2023-10-25T16:17:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e415a470 con 0x7f62e41581a0 2023-10-25T16:17:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62dc0043f0 con 0x7f62e41581a0 2023-10-25T16:17:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62c8066470 0x7f62c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62dc120200 con 0x7f62e41581a0 2023-10-25T16:17:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f62c806dfa0 con 0x7f62e41581a0 2023-10-25T16:17:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.797+0000 7f62e90c1640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62c8066470 0x7f62c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.801+0000 7f62e90c1640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62c8066470 0x7f62c8068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62e40713d0 tx=0x7f62e0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.801+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62dc0b2030 con 0x7f62e41581a0 2023-10-25T16:17:03.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.985+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62e404dad0 con 0x7f62e41581a0 2023-10-25T16:17:03.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.985+0000 7f62d9ffb640 1 -- 172.21.15.177:0/3033213221 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f62dc0b2030 con 0x7f62e41581a0 2023-10-25T16:17:03.992 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:03.992 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:17:03.993 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:17:03.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62c8066470 msgr2=0x7f62c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62c8066470 0x7f62c8068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f62e40713d0 tx=0x7f62e0009040 comp rx=0 tx=0).stop 2023-10-25T16:17:03.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 msgr2=0x7f62e4145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:03.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 0x7f62e4145c10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0196b0 tx=0x7f62dc0a5990 comp rx=0 tx=0).stop 2023-10-25T16:17:03.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 shutdown_connections 2023-10-25T16:17:03.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f62c8066470 0x7f62c8068930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f62e41581a0 0x7f62e4145c10 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e40715f0 0x7f62e41477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 --2- 172.21.15.177:0/3033213221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e4070b60 0x7f62e4146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:03.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 >> 172.21.15.177:0/3033213221 conn(0x7f62e40cdf10 msgr2=0x7f62e4156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:03.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 shutdown_connections 2023-10-25T16:17:03.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:03.989+0000 7f62eb325640 1 -- 172.21.15.177:0/3033213221 wait complete. 2023-10-25T16:17:04.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 -- 172.21.15.177:0/1023742217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880654c0 msgr2=0x7fbb88159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/1023742217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880654c0 0x7fbb88159b60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbb880cd760 tx=0x7fbb8001c830 comp rx=0 tx=0).stop 2023-10-25T16:17:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 -- 172.21.15.177:0/1023742217 shutdown_connections 2023-10-25T16:17:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/1023742217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880654c0 0x7fbb88159b60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/1023742217 >> v2:172.21.15.184:3300/0 conn(0x7fbb880cbd10 0x7fbb88159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 -- 172.21.15.177:0/1023742217 >> 172.21.15.177:0/1023742217 conn(0x7fbb880af5b0 msgr2=0x7fbb880af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 -- 172.21.15.177:0/1023742217 shutdown_connections 2023-10-25T16:17:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.113+0000 7fbb8ed17640 1 -- 172.21.15.177:0/1023742217 wait complete. 2023-10-25T16:17:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 Processor -- start 2023-10-25T16:17:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- start start 2023-10-25T16:17:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb880654c0 0x7fbb8814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb880b2bc0 0x7fbb8815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 0x7fbb8815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb881f2c70 con 0x7fbb880cbd10 2023-10-25T16:17:04.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8814e810 con 0x7fbb880b2bc0 2023-10-25T16:17:04.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8814eaf0 con 0x7fbb880654c0 2023-10-25T16:17:04.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 0x7fbb8815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 0x7fbb8815b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57926/0 (socket says 172.21.15.177:57926) 2023-10-25T16:17:04.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 -- 172.21.15.177:0/4220529717 learned_addr learned my addr 172.21.15.177:0/4220529717 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:04.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 -- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb880654c0 msgr2=0x7fbb8814e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb880654c0 0x7fbb8814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 -- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb880b2bc0 msgr2=0x7fbb8815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb880b2bc0 0x7fbb8815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 -- 172.21.15.177:0/4220529717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009560 con 0x7fbb880cbd10 2023-10-25T16:17:04.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8d2b4640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 0x7fbb8815b360 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009850 tx=0x7fbb800a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800ba070 con 0x7fbb880cbd10 2023-10-25T16:17:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb800051e0 con 0x7fbb880cbd10 2023-10-25T16:17:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8814edd0 con 0x7fbb880cbd10 2023-10-25T16:17:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800055f0 con 0x7fbb880cbd10 2023-10-25T16:17:04.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8814fc90 con 0x7fbb880cbd10 2023-10-25T16:17:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb881f2a80 con 0x7fbb880cbd10 2023-10-25T16:17:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbb800b4070 con 0x7fbb880cbd10 2023-10-25T16:17:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb680664a0 0x7fbb68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb8011e2d0 con 0x7fbb880cbd10 2023-10-25T16:17:04.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7fbb6806dfd0 con 0x7fbb880cbd10 2023-10-25T16:17:04.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.117+0000 7fbb8cab3640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb680664a0 0x7fbb68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.121+0000 7fbb8cab3640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb680664a0 0x7fbb68068960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbb78007fd0 tx=0x7fbb78007d40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:04.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.121+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb800eb7e0 con 0x7fbb880cbd10 2023-10-25T16:17:04.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.265+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb8804daf0 con 0x7fbb880cbd10 2023-10-25T16:17:04.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb857fa640 1 -- 172.21.15.177:0/4220529717 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16625 (secure 0 0 0) 0x7fbb800b2070 con 0x7fbb880cbd10 2023-10-25T16:17:04.274 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:04.274 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":74,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:03.778240+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:04.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb680664a0 msgr2=0x7fbb68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb680664a0 0x7fbb68068960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbb78007fd0 tx=0x7fbb78007d40 comp rx=0 tx=0).stop 2023-10-25T16:17:04.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 msgr2=0x7fbb8815b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 0x7fbb8815b360 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009850 tx=0x7fbb800a5710 comp rx=0 tx=0).stop 2023-10-25T16:17:04.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 shutdown_connections 2023-10-25T16:17:04.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb680664a0 0x7fbb68068960 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb880cbd10 0x7fbb8815b360 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb880b2bc0 0x7fbb8815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 --2- 172.21.15.177:0/4220529717 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb880654c0 0x7fbb8814e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 >> 172.21.15.177:0/4220529717 conn(0x7fbb880af5b0 msgr2=0x7fbb8815c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:04.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 shutdown_connections 2023-10-25T16:17:04.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.269+0000 7fbb8ed17640 1 -- 172.21.15.177:0/4220529717 wait complete. 2023-10-25T16:17:04.292 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:17:04.292 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:04.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 -- 172.21.15.177:0/3768591467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba40d1890 msgr2=0x7f7ba40cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 --2- 172.21.15.177:0/3768591467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba40d1890 0x7f7ba40cd0f0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009bf0 tx=0x7f7b9c01cab0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 -- 172.21.15.177:0/3768591467 shutdown_connections 2023-10-25T16:17:04.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 --2- 172.21.15.177:0/3768591467 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba40d1890 0x7f7ba40cd0f0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 -- 172.21.15.177:0/3768591467 >> 172.21.15.177:0/3768591467 conn(0x7f7ba4065f40 msgr2=0x7f7ba409a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:04.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 -- 172.21.15.177:0/3768591467 shutdown_connections 2023-10-25T16:17:04.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.397+0000 7f7ba9362640 1 -- 172.21.15.177:0/3768591467 wait complete. 2023-10-25T16:17:04.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 Processor -- start 2023-10-25T16:17:04.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- start start 2023-10-25T16:17:04.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba40d1420 0x7f7ba40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba40d1890 0x7f7ba40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 0x7f7ba415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba414f950 con 0x7f7ba415b590 2023-10-25T16:17:04.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba415e0c0 con 0x7f7ba40d1890 2023-10-25T16:17:04.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba415e3a0 con 0x7f7ba40d1420 2023-10-25T16:17:04.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 0x7f7ba415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 0x7f7ba415be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57940/0 (socket says 172.21.15.177:57940) 2023-10-25T16:17:04.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 -- 172.21.15.177:0/1334804212 learned_addr learned my addr 172.21.15.177:0/1334804212 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:04.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba2ffd640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba40d1420 0x7f7ba40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 -- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba40d1420 msgr2=0x7f7ba40b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba27fc640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba40d1890 0x7f7ba40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba40d1420 0x7f7ba40b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 -- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba40d1890 msgr2=0x7f7ba40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba40d1890 0x7f7ba40cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 -- 172.21.15.177:0/1334804212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c009820 con 0x7f7ba415b590 2023-10-25T16:17:04.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba37fe640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 0x7f7ba415be50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0196c0 tx=0x7f7b9c0a59b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:04.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c004d10 con 0x7f7ba415b590 2023-10-25T16:17:04.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7b9c003fe0 con 0x7f7ba415b590 2023-10-25T16:17:04.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba415e680 con 0x7f7ba415b590 2023-10-25T16:17:04.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c004370 con 0x7f7ba415b590 2023-10-25T16:17:04.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba40cb220 con 0x7f7ba415b590 2023-10-25T16:17:04.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.401+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba4150fa0 con 0x7f7ba415b590 2023-10-25T16:17:04.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.405+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b9c0b4040 con 0x7f7ba415b590 2023-10-25T16:17:04.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.405+0000 7f7b8b7fe640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7b90066470 0x7f7b90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.405+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b9c11e190 con 0x7f7ba415b590 2023-10-25T16:17:04.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.405+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7f7b9006dfa0 con 0x7f7ba415b590 2023-10-25T16:17:04.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.405+0000 7f7ba2ffd640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7b90066470 0x7f7b90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.405+0000 7f7ba2ffd640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7b90066470 0x7f7b90068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400a790 tx=0x7f7b94008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:04.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.409+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b9c0bc060 con 0x7f7ba415b590 2023-10-25T16:17:04.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ba4150fa0 con 0x7f7ba415b590 2023-10-25T16:17:04.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7b8b7fe640 1 -- 172.21.15.177:0/1334804212 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f7ba4150fa0 con 0x7f7ba415b590 2023-10-25T16:17:04.586 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:04.587 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:17:04.588 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:17:04.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7b90066470 msgr2=0x7f7b90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7b90066470 0x7f7b90068930 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400a790 tx=0x7f7b94008040 comp rx=0 tx=0).stop 2023-10-25T16:17:04.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 msgr2=0x7f7ba415be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 0x7f7ba415be50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0196c0 tx=0x7f7b9c0a59b0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 shutdown_connections 2023-10-25T16:17:04.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7b90066470 0x7f7b90068930 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ba415b590 0x7f7ba415be50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ba40d1890 0x7f7ba40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 --2- 172.21.15.177:0/1334804212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ba40d1420 0x7f7ba40b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.581+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 >> 172.21.15.177:0/1334804212 conn(0x7f7ba4065f40 msgr2=0x7f7ba40cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:04.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.585+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 shutdown_connections 2023-10-25T16:17:04.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.585+0000 7f7ba9362640 1 -- 172.21.15.177:0/1334804212 wait complete. 2023-10-25T16:17:04.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:04.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/3332344228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c159230 msgr2=0x7fcc6c071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 --2- 172.21.15.177:0/3332344228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c159230 0x7fcc6c071500 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c06c6a0 tx=0x7fcc5c01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/3332344228 shutdown_connections 2023-10-25T16:17:04.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 --2- 172.21.15.177:0/3332344228 >> v2:172.21.15.184:3300/0 conn(0x7fcc6c070510 0x7fcc6c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 --2- 172.21.15.177:0/3332344228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c159230 0x7fcc6c071500 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/3332344228 >> 172.21.15.177:0/3332344228 conn(0x7fcc6c0b2450 msgr2=0x7fcc6c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:04.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/3332344228 shutdown_connections 2023-10-25T16:17:04.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/3332344228 wait complete. 2023-10-25T16:17:04.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 Processor -- start 2023-10-25T16:17:04.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- start start 2023-10-25T16:17:04.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc6c070510 0x7fcc6c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 0x7fcc6c148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc6c159230 0x7fcc6c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c154640 con 0x7fcc6c0cc610 2023-10-25T16:17:04.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0b1230 con 0x7fcc6c159230 2023-10-25T16:17:04.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0b0a20 con 0x7fcc6c070510 2023-10-25T16:17:04.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 0x7fcc6c148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 0x7fcc6c148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57964/0 (socket says 172.21.15.177:57964) 2023-10-25T16:17:04.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 -- 172.21.15.177:0/561232686 learned_addr learned my addr 172.21.15.177:0/561232686 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:04.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc70ddb640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc6c159230 0x7fcc6c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6bfff640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc6c070510 0x7fcc6c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 -- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc6c070510 msgr2=0x7fcc6c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc6c070510 0x7fcc6c0b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 -- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc6c159230 msgr2=0x7fcc6c14c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc6c159230 0x7fcc6c14c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0094a0 con 0x7fcc6c0cc610 2023-10-25T16:17:04.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc6b7fe640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 0x7fcc6c148500 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000d950 tx=0x7fcc6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:04.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60009c30 con 0x7fcc6c0cc610 2023-10-25T16:17:04.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcc60009e80 con 0x7fcc6c0cc610 2023-10-25T16:17:04.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c154010 con 0x7fcc6c0cc610 2023-10-25T16:17:04.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc600106a0 con 0x7fcc6c0cc610 2023-10-25T16:17:04.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c0b0c70 con 0x7fcc6c0cc610 2023-10-25T16:17:04.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.725+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c04daf0 con 0x7fcc6c0cc610 2023-10-25T16:17:04.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.729+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcc60010800 con 0x7fcc6c0cc610 2023-10-25T16:17:04.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.729+0000 7fcc68ff9640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc58066470 0x7fcc58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:04.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.729+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc60084380 con 0x7fcc6c0cc610 2023-10-25T16:17:04.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.729+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=75}) v3 -- 0x7fcc5806dfa0 con 0x7fcc6c0cc610 2023-10-25T16:17:04.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.729+0000 7fcc6bfff640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc58066470 0x7fcc58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:04.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.729+0000 7fcc6bfff640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc58066470 0x7fcc58068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0af000 tx=0x7fcc5c01aff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:04.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.733+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc60017060 con 0x7fcc6c0cc610 2023-10-25T16:17:04.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.797+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 7 ==== osd_map(75..75 src has 1..75) v4 ==== 1484+0+0 (secure 0 0 0) 0x7fcc60055c50 con 0x7fcc6c0cc610 2023-10-25T16:17:04.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.797+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=76}) v3 -- 0x7fcc5806f1b0 con 0x7fcc6c0cc610 2023-10-25T16:17:04.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.925+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc6c0b2cf0 con 0x7fcc6c0cc610 2023-10-25T16:17:04.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.925+0000 7fcc68ff9640 1 -- 172.21.15.177:0/561232686 <== mon.0 v2:172.21.15.177:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fcc60021070 con 0x7fcc6c0cc610 2023-10-25T16:17:04.932 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:04.932 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:15:52.302005+0000","modified":"2023-10-25T16:15:54.310109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6360":{"gid":6360,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1610672275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1610672275},{"type":"v1","addr":"172.21.15.177:6835","nonce":1610672275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-10-25T16:17:04.932 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 25 2023-10-25T16:17:04.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc58066470 msgr2=0x7fcc58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc58066470 0x7fcc58068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0af000 tx=0x7fcc5c01aff0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 msgr2=0x7fcc6c148500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:04.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 0x7fcc6c148500 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000d950 tx=0x7fcc6000de10 comp rx=0 tx=0).stop 2023-10-25T16:17:04.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 shutdown_connections 2023-10-25T16:17:04.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcc58066470 0x7fcc58068930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc6c159230 0x7fcc6c14c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc6c0cc610 0x7fcc6c148500 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 --2- 172.21.15.177:0/561232686 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc6c070510 0x7fcc6c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:04.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 >> 172.21.15.177:0/561232686 conn(0x7fcc6c0b2450 msgr2=0x7fcc6c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:04.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 shutdown_connections 2023-10-25T16:17:04.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:04.929+0000 7fcc7283e640 1 -- 172.21.15.177:0/561232686 wait complete. 2023-10-25T16:17:04.950 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:05.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 -- 172.21.15.177:0/3557614153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 msgr2=0x7feb700af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 --2- 172.21.15.177:0/3557614153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb700af580 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009900 tx=0x7feb6c01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 -- 172.21.15.177:0/3557614153 shutdown_connections 2023-10-25T16:17:05.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 --2- 172.21.15.177:0/3557614153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb7006f570 0x7feb7006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 --2- 172.21.15.177:0/3557614153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb700af580 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 -- 172.21.15.177:0/3557614153 >> 172.21.15.177:0/3557614153 conn(0x7feb700b2450 msgr2=0x7feb700b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:05.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.069+0000 7feb77625640 1 -- 172.21.15.177:0/3557614153 shutdown_connections 2023-10-25T16:17:05.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- 172.21.15.177:0/3557614153 wait complete. 2023-10-25T16:17:05.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 Processor -- start 2023-10-25T16:17:05.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- start start 2023-10-25T16:17:05.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb7006bec0 0x7feb7013e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb7006f570 0x7feb701f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb7012e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7014e490 con 0x7feb70140e90 2023-10-25T16:17:05.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7013dc90 con 0x7feb7006bec0 2023-10-25T16:17:05.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb701f73e0 con 0x7feb7006f570 2023-10-25T16:17:05.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb7012e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb7012e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57982/0 (socket says 172.21.15.177:57982) 2023-10-25T16:17:05.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 -- 172.21.15.177:0/549565489 learned_addr learned my addr 172.21.15.177:0/549565489 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:05.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb753c1640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb7006bec0 0x7feb7013e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb74bc0640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb7006f570 0x7feb701f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 -- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb7006f570 msgr2=0x7feb701f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb7006f570 0x7feb701f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 -- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb7006bec0 msgr2=0x7feb7013e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb7006bec0 0x7feb7013e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 -- 172.21.15.177:0/549565489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c009560 con 0x7feb70140e90 2023-10-25T16:17:05.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb75bc2640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb7012e5b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb6800c780 tx=0x7feb6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:05.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68004b70 con 0x7feb70140e90 2023-10-25T16:17:05.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb6800ce90 con 0x7feb70140e90 2023-10-25T16:17:05.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7013ccd0 con 0x7feb70140e90 2023-10-25T16:17:05.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800aab0 con 0x7feb70140e90 2023-10-25T16:17:05.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7013e180 con 0x7feb70140e90 2023-10-25T16:17:05.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.073+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7004daf0 con 0x7feb70140e90 2023-10-25T16:17:05.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.077+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feb6800ac10 con 0x7feb70140e90 2023-10-25T16:17:05.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.077+0000 7feb65ffb640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb54066470 0x7feb54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.077+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb680841b0 con 0x7feb70140e90 2023-10-25T16:17:05.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.077+0000 7feb753c1640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb54066470 0x7feb54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.077+0000 7feb753c1640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb54066470 0x7feb54068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0af000 tx=0x7feb6c01b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:05.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.081+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb680516c0 con 0x7feb70140e90 2023-10-25T16:17:05.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.237+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb7015bed0 con 0x7feb70140e90 2023-10-25T16:17:05.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.237+0000 7feb65ffb640 1 -- 172.21.15.177:0/549565489 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16589 (secure 0 0 0) 0x7feb68054ce0 con 0x7feb70140e90 2023-10-25T16:17:05.243 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:05.243 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":75,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:04.788548+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:15:50.243421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-25T16:15:51.285070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:05.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb54066470 msgr2=0x7feb54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb54066470 0x7feb54068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0af000 tx=0x7feb6c01b030 comp rx=0 tx=0).stop 2023-10-25T16:17:05.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 msgr2=0x7feb7012e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb7012e5b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb6800c780 tx=0x7feb6800cc40 comp rx=0 tx=0).stop 2023-10-25T16:17:05.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 shutdown_connections 2023-10-25T16:17:05.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb54066470 0x7feb54068930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb70140e90 0x7feb7012e5b0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb7006f570 0x7feb701f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 --2- 172.21.15.177:0/549565489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb7006bec0 0x7feb7013e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 >> 172.21.15.177:0/549565489 conn(0x7feb700b2450 msgr2=0x7feb7015b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:05.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 shutdown_connections 2023-10-25T16:17:05.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.241+0000 7feb77625640 1 -- 172.21.15.177:0/549565489 wait complete. 2023-10-25T16:17:05.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:17:05.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 -- 172.21.15.177:0/1095201419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 msgr2=0x7fa5080af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/1095201419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080af5d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa5080b0f60 tx=0x7fa4f801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 -- 172.21.15.177:0/1095201419 shutdown_connections 2023-10-25T16:17:05.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/1095201419 >> v2:172.21.15.184:3300/0 conn(0x7fa50806c160 0x7fa5080cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/1095201419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080af5d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 -- 172.21.15.177:0/1095201419 >> 172.21.15.177:0/1095201419 conn(0x7fa5080b2450 msgr2=0x7fa5080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:05.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 -- 172.21.15.177:0/1095201419 shutdown_connections 2023-10-25T16:17:05.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.381+0000 7fa50dbc5640 1 -- 172.21.15.177:0/1095201419 wait complete. 2023-10-25T16:17:05.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 Processor -- start 2023-10-25T16:17:05.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- start start 2023-10-25T16:17:05.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa50806c160 0x7fa50813e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa50806f570 0x7fa508156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508157270 con 0x7fa508140cf0 2023-10-25T16:17:05.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080ad4e0 con 0x7fa50806f570 2023-10-25T16:17:05.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50813d5a0 con 0x7fa50806c160 2023-10-25T16:17:05.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57996/0 (socket says 172.21.15.177:57996) 2023-10-25T16:17:05.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 -- 172.21.15.177:0/3351667799 learned_addr learned my addr 172.21.15.177:0/3351667799 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:05.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa5077fe640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa50806c160 0x7fa50813e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa4feffd640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa50806f570 0x7fa508156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 -- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa50806c160 msgr2=0x7fa50813e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa50806c160 0x7fa50813e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 -- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa50806f570 msgr2=0x7fa508156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa50806f570 0x7fa508156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 -- 172.21.15.177:0/3351667799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8009560 con 0x7fa508140cf0 2023-10-25T16:17:05.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa507fff640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080ae530 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e9f0 tx=0x7fa50000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:05.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000cd80 con 0x7fa508140cf0 2023-10-25T16:17:05.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa500004b30 con 0x7fa508140cf0 2023-10-25T16:17:05.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50813d880 con 0x7fa508140cf0 2023-10-25T16:17:05.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500005020 con 0x7fa508140cf0 2023-10-25T16:17:05.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50813de40 con 0x7fa508140cf0 2023-10-25T16:17:05.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50804daf0 con 0x7fa508140cf0 2023-10-25T16:17:05.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa500005180 con 0x7fa508140cf0 2023-10-25T16:17:05.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.385+0000 7fa504ff9640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4e8066470 0x7fa4e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.389+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5000848c0 con 0x7fa508140cf0 2023-10-25T16:17:05.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.389+0000 7fa5077fe640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4e8066470 0x7fa4e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.389+0000 7fa5077fe640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4e8066470 0x7fa4e8068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80ae000 tx=0x7fa4f801b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:05.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.393+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa500051d40 con 0x7fa508140cf0 2023-10-25T16:17:05.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.569+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5080ca670 con 0x7fa508140cf0 2023-10-25T16:17:05.575 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:17:05.569+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:17:05.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.573+0000 7fa504ff9640 1 -- 172.21.15.177:0/3351667799 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa50001f070 con 0x7fa508140cf0 2023-10-25T16:17:05.578 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:17:05.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4e8066470 msgr2=0x7fa4e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4e8066470 0x7fa4e8068930 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80ae000 tx=0x7fa4f801b010 comp rx=0 tx=0).stop 2023-10-25T16:17:05.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 msgr2=0x7fa5080ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080ae530 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e9f0 tx=0x7fa50000eeb0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 shutdown_connections 2023-10-25T16:17:05.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4e8066470 0x7fa4e8068930 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80ae000 tx=0x7fa4f801b010 comp rx=0 tx=0).stop 2023-10-25T16:17:05.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa508140cf0 0x7fa5080ae530 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa50806f570 0x7fa508156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 --2- 172.21.15.177:0/3351667799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa50806c160 0x7fa50813e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.577+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 >> 172.21.15.177:0/3351667799 conn(0x7fa5080b2450 msgr2=0x7fa50813b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:05.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.581+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 shutdown_connections 2023-10-25T16:17:05.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.581+0000 7fa50dbc5640 1 -- 172.21.15.177:0/3351667799 wait complete. 2023-10-25T16:17:05.588 INFO:tasks.ceph.mds.c.smithi177.stderr: -7405> 2023-10-25T16:15:57.910+0000 7ff861af4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:17:05.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:17:05.619 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:17:05.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- 172.21.15.177:0/3474238670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc003fb0 msgr2=0x7f48cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 --2- 172.21.15.177:0/3474238670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc003fb0 0x7f48cc0047d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c290 tx=0x7f48d801d000 comp rx=0 tx=0).stop 2023-10-25T16:17:05.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e3fff640 1 -- 172.21.15.177:0/3474238670 reap_dead start 2023-10-25T16:17:05.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- 172.21.15.177:0/3474238670 shutdown_connections 2023-10-25T16:17:05.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- 172.21.15.177:0/3474238670 >> 172.21.15.177:0/3474238670 conn(0x7f48e4069d20 msgr2=0x7f48e406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:05.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- 172.21.15.177:0/3474238670 shutdown_connections 2023-10-25T16:17:05.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- 172.21.15.177:0/3474238670 wait complete. 2023-10-25T16:17:05.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 Processor -- start 2023-10-25T16:17:05.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- start start 2023-10-25T16:17:05.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc003fb0 0x7f48e4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 0x7f48e415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48e4147180 0x7f48e4159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e414a1d0 con 0x7f48e414a660 2023-10-25T16:17:05.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e415c9a0 con 0x7f48cc003fb0 2023-10-25T16:17:05.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48ea05b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41495c0 con 0x7f48e4147180 2023-10-25T16:17:05.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 0x7f48e415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 0x7f48e415c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58038/0 (socket says 172.21.15.177:58038) 2023-10-25T16:17:05.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 -- 172.21.15.177:0/1300027406 learned_addr learned my addr 172.21.15.177:0/1300027406 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:05.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e3fff640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48e4147180 0x7f48e4159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e37fe640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc003fb0 0x7f48e4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 -- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48e4147180 msgr2=0x7f48e4159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48e4147180 0x7f48e4159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 -- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc003fb0 msgr2=0x7f48e4148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:05.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc003fb0 0x7f48e4148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:05.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 -- 172.21.15.177:0/1300027406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e41498a0 con 0x7f48e414a660 2023-10-25T16:17:05.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e37fe640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc003fb0 0x7f48e4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:05.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.725+0000 7f48e2ffd640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 0x7f48e415c460 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f48d8001940 tx=0x7f48d8001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:05.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80b4070 con 0x7f48e414a660 2023-10-25T16:17:05.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f48d80016f0 con 0x7f48e414a660 2023-10-25T16:17:05.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e4149b80 con 0x7f48e414a660 2023-10-25T16:17:05.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8006330 con 0x7f48e414a660 2023-10-25T16:17:05.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e41475f0 con 0x7f48e414a660 2023-10-25T16:17:05.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e414a380 con 0x7f48e414a660 2023-10-25T16:17:05.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f48d8006490 con 0x7f48e414a660 2023-10-25T16:17:05.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48cbfff640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48d0066470 0x7f48d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:05.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f48d811d260 con 0x7f48e414a660 2023-10-25T16:17:05.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48e37fe640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48d0066470 0x7f48d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:05.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.729+0000 7f48e37fe640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48d0066470 0x7f48d0068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005b70 tx=0x7f48d4005a80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:05.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.733+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48e414a380 con 0x7f48e414a660 2023-10-25T16:17:05.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:05.925+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f48e41478d0 con 0x7f48e414a660 2023-10-25T16:17:06.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.577+0000 7f48cbfff640 1 -- 172.21.15.177:0/1300027406 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f48d80ea710 con 0x7f48e414a660 2023-10-25T16:17:06.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48d0066470 msgr2=0x7f48d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:06.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48d0066470 0x7f48d0068930 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f48d4005b70 tx=0x7f48d4005a80 comp rx=0 tx=0).stop 2023-10-25T16:17:06.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 msgr2=0x7f48e415c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:06.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 0x7f48e415c460 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f48d8001940 tx=0x7f48d8001440 comp rx=0 tx=0).stop 2023-10-25T16:17:06.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 shutdown_connections 2023-10-25T16:17:06.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48d0066470 0x7f48d0068930 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48e4147180 0x7f48e4159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48e414a660 0x7f48e415c460 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 --2- 172.21.15.177:0/1300027406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc003fb0 0x7f48e4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 >> 172.21.15.177:0/1300027406 conn(0x7f48e4069d20 msgr2=0x7f48e40c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:06.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 shutdown_connections 2023-10-25T16:17:06.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.581+0000 7f48ea05b640 1 -- 172.21.15.177:0/1300027406 wait complete. 2023-10-25T16:17:06.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:17:06.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- 172.21.15.177:0/3042070203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cb9c0 msgr2=0x7f489c0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:06.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3042070203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cb9c0 0x7f489c0cbe20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f489c0ccaf0 tx=0x7f489401cca0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- 172.21.15.177:0/3042070203 shutdown_connections 2023-10-25T16:17:06.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3042070203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cb9c0 0x7f489c0cbe20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3042070203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489c0ccc10 0x7f489c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3042070203 >> v2:172.21.15.184:3300/0 conn(0x7f489c0cefd0 0x7f489c0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- 172.21.15.177:0/3042070203 >> 172.21.15.177:0/3042070203 conn(0x7f489c097a40 msgr2=0x7f489c097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:06.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- 172.21.15.177:0/3042070203 shutdown_connections 2023-10-25T16:17:06.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- 172.21.15.177:0/3042070203 wait complete. 2023-10-25T16:17:06.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 Processor -- start 2023-10-25T16:17:06.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- start start 2023-10-25T16:17:06.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489c0cb9c0 0x7f489c1628e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:06.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489c0ccc10 0x7f489c146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:06.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 0x7f489c0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:06.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c162e20 con 0x7f489c0cefd0 2023-10-25T16:17:06.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0b2b30 con 0x7f489c0ccc10 2023-10-25T16:17:06.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a3faf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c146850 con 0x7f489c0cb9c0 2023-10-25T16:17:06.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 0x7f489c0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:06.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 0x7f489c0acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58048/0 (socket says 172.21.15.177:58048) 2023-10-25T16:17:06.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 -- 172.21.15.177:0/3314953055 learned_addr learned my addr 172.21.15.177:0/3314953055 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:06.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a1d4b640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489c0cb9c0 0x7f489c1628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:06.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a154a640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489c0ccc10 0x7f489c146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:06.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 -- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489c0cb9c0 msgr2=0x7f489c1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:06.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489c0cb9c0 0x7f489c1628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 -- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489c0ccc10 msgr2=0x7f489c146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:06.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489c0ccc10 0x7f489c146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:06.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 -- 172.21.15.177:0/3314953055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940098e0 con 0x7f489c0cefd0 2023-10-25T16:17:06.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48a254c640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 0x7f489c0acd00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f4894009bd0 tx=0x7f48940a5c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:06.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.789+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894004e60 con 0x7f489c0cefd0 2023-10-25T16:17:06.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f48940ad6a0 con 0x7f489c0cefd0 2023-10-25T16:17:06.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c0b1f20 con 0x7f489c0cefd0 2023-10-25T16:17:06.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940ada90 con 0x7f489c0cefd0 2023-10-25T16:17:06.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c0b24e0 con 0x7f489c0cefd0 2023-10-25T16:17:06.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c073360 con 0x7f489c0cefd0 2023-10-25T16:17:06.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f48940b4040 con 0x7f489c0cefd0 2023-10-25T16:17:06.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48927fc640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:06.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f489411e470 con 0x7f489c0cefd0 2023-10-25T16:17:06.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48a1d4b640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:06.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.793+0000 7f48a1d4b640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4898006fd0 tx=0x7f4898008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:06.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.797+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48940eb800 con 0x7f489c0cefd0 2023-10-25T16:17:06.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:06.949+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f489c0b2c70 con 0x7f489c0cefd0 2023-10-25T16:17:07.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.785+0000 7f48927fc640 1 -- 172.21.15.177:0/3314953055 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) v1 ==== 181+0+0 (secure 0 0 0) 0x7f48940b2020 con 0x7f489c0cefd0 2023-10-25T16:17:07.791 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:17:07.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 msgr2=0x7f4880068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:07.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4898006fd0 tx=0x7f4898008040 comp rx=0 tx=0).stop 2023-10-25T16:17:07.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 msgr2=0x7f489c0acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:07.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 0x7f489c0acd00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f4894009bd0 tx=0x7f48940a5c90 comp rx=0 tx=0).stop 2023-10-25T16:17:07.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 shutdown_connections 2023-10-25T16:17:07.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4880066470 0x7f4880068930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f489c0cefd0 0x7f489c0acd00 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489c0ccc10 0x7f489c146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 --2- 172.21.15.177:0/3314953055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489c0cb9c0 0x7f489c1628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 >> 172.21.15.177:0/3314953055 conn(0x7f489c097a40 msgr2=0x7f489c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:07.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 shutdown_connections 2023-10-25T16:17:07.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.793+0000 7f48a3faf640 1 -- 172.21.15.177:0/3314953055 wait complete. 2023-10-25T16:17:07.820 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:17:07.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 -- 172.21.15.177:0/3643363890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c159a30 msgr2=0x7f307c0cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:07.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 --2- 172.21.15.177:0/3643363890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c159a30 0x7f307c0cd070 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3070009840 tx=0x7f307001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 -- 172.21.15.177:0/3643363890 shutdown_connections 2023-10-25T16:17:07.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 --2- 172.21.15.177:0/3643363890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f307c0cd5b0 0x7f307c1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 --2- 172.21.15.177:0/3643363890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c159a30 0x7f307c0cd070 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 -- 172.21.15.177:0/3643363890 >> 172.21.15.177:0/3643363890 conn(0x7f307c069920 msgr2=0x7f307c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:07.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 -- 172.21.15.177:0/3643363890 shutdown_connections 2023-10-25T16:17:07.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 -- 172.21.15.177:0/3643363890 wait complete. 2023-10-25T16:17:07.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 Processor -- start 2023-10-25T16:17:07.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.945+0000 7f3081c52640 1 -- start start 2023-10-25T16:17:07.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 0x7f307c14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:07.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f307c0cd5b0 0x7f307c06c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:07.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f307c159a30 0x7f307c097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:07.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c142e20 con 0x7f307c0710e0 2023-10-25T16:17:07.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c143100 con 0x7f307c159a30 2023-10-25T16:17:07.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c1433e0 con 0x7f307c0cd5b0 2023-10-25T16:17:07.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 0x7f307c14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:07.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 0x7f307c14b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58078/0 (socket says 172.21.15.177:58078) 2023-10-25T16:17:07.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 -- 172.21.15.177:0/3673020885 learned_addr learned my addr 172.21.15.177:0/3673020885 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:07.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 -- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f307c0cd5b0 msgr2=0x7f307c06c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:07.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f307c0cd5b0 0x7f307c06c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 -- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f307c159a30 msgr2=0x7f307c097a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:07.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f307c159a30 0x7f307c097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:07.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 -- 172.21.15.177:0/3673020885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700094a0 con 0x7f307c0710e0 2023-10-25T16:17:07.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307b7fe640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 0x7f307c14b2b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f306c00cc50 tx=0x7f306c00cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:07.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c00a9f0 con 0x7f307c0710e0 2023-10-25T16:17:07.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f306c00ac40 con 0x7f307c0710e0 2023-10-25T16:17:07.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c1436c0 con 0x7f307c0710e0 2023-10-25T16:17:07.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c012680 con 0x7f307c0710e0 2023-10-25T16:17:07.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c14b7f0 con 0x7f307c0710e0 2023-10-25T16:17:07.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c073360 con 0x7f307c0710e0 2023-10-25T16:17:07.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f306c01a3b0 con 0x7f307c0710e0 2023-10-25T16:17:07.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3063fff640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30680664a0 0x7f3068068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:07.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f306c084190 con 0x7f307c0710e0 2023-10-25T16:17:07.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.949+0000 7f307affd640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30680664a0 0x7f3068068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:07.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.953+0000 7f307affd640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30680664a0 0x7f3068068960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f30700af000 tx=0x7f3070019570 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:07.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:07.953+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f306c051800 con 0x7f307c0710e0 2023-10-25T16:17:08.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.109+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f307c06fff0 con 0x7f307c0710e0 2023-10-25T16:17:08.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.805+0000 7f3063fff640 1 -- 172.21.15.177:0/3673020885 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) v1 ==== 169+0+0 (secure 0 0 0) 0x7f306c054e20 con 0x7f307c0710e0 2023-10-25T16:17:08.811 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:17:08.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30680664a0 msgr2=0x7f3068068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:08.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30680664a0 0x7f3068068960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f30700af000 tx=0x7f3070019570 comp rx=0 tx=0).stop 2023-10-25T16:17:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 msgr2=0x7f307c14b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 0x7f307c14b2b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f306c00cc50 tx=0x7f306c00cd40 comp rx=0 tx=0).stop 2023-10-25T16:17:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 shutdown_connections 2023-10-25T16:17:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f30680664a0 0x7f3068068960 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f307c159a30 0x7f307c097a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f307c0cd5b0 0x7f307c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 --2- 172.21.15.177:0/3673020885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f307c0710e0 0x7f307c14b2b0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 >> 172.21.15.177:0/3673020885 conn(0x7f307c069920 msgr2=0x7f307c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 shutdown_connections 2023-10-25T16:17:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.809+0000 7f3081c52640 1 -- 172.21.15.177:0/3673020885 wait complete. 2023-10-25T16:17:08.837 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:17:08.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9ee56e6640 1 -- 172.21.15.177:0/698392964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ec8004d10 msgr2=0x7f9ec8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:08.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/698392964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ec8004d10 0x7f9ec8005190 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00acb70 tx=0x7f9ed801cda0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9edf7fe640 1 -- 172.21.15.177:0/698392964 reap_dead start 2023-10-25T16:17:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9ee56e6640 1 -- 172.21.15.177:0/698392964 shutdown_connections 2023-10-25T16:17:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9ee56e6640 1 -- 172.21.15.177:0/698392964 >> 172.21.15.177:0/698392964 conn(0x7f9ee00b2450 msgr2=0x7f9ee00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9ee56e6640 1 -- 172.21.15.177:0/698392964 shutdown_connections 2023-10-25T16:17:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.965+0000 7f9ee56e6640 1 -- 172.21.15.177:0/698392964 wait complete. 2023-10-25T16:17:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 Processor -- start 2023-10-25T16:17:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- start start 2023-10-25T16:17:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ee0137020 0x7f9ee0135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 0x7f9ee0137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ee0137940 0x7f9ee013db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee015a160 con 0x7f9ee0135780 2023-10-25T16:17:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0159240 con 0x7f9ee0137940 2023-10-25T16:17:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee01594e0 con 0x7f9ee0137020 2023-10-25T16:17:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 0x7f9ee0137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 0x7f9ee0137400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58096/0 (socket says 172.21.15.177:58096) 2023-10-25T16:17:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 -- 172.21.15.177:0/3873926577 learned_addr learned my addr 172.21.15.177:0/3873926577 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 -- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ee0137020 msgr2=0x7f9ee0135240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ee0137020 0x7f9ee0135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 -- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ee0137940 msgr2=0x7f9ee013db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ee0137940 0x7f9ee013db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 -- 172.21.15.177:0/3873926577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee01597c0 con 0x7f9ee0135780 2023-10-25T16:17:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ede7fc640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 0x7f9ee0137400 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4001800 tx=0x7f9ed4012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4010ac0 con 0x7f9ee0135780 2023-10-25T16:17:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ed4010c40 con 0x7f9ee0135780 2023-10-25T16:17:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee0159aa0 con 0x7f9ee0135780 2023-10-25T16:17:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4012e60 con 0x7f9ee0135780 2023-10-25T16:17:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee0137dc0 con 0x7f9ee0135780 2023-10-25T16:17:08.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.969+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee004daf0 con 0x7f9ee0135780 2023-10-25T16:17:08.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.973+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ed4019020 con 0x7f9ee0135780 2023-10-25T16:17:08.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.973+0000 7f9ec77fe640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ecc066470 0x7f9ecc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:08.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.973+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9ed4087880 con 0x7f9ee0135780 2023-10-25T16:17:08.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.973+0000 7f9edeffd640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ecc066470 0x7f9ecc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:08.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.973+0000 7f9edeffd640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ecc066470 0x7f9ecc068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0005c50 tx=0x7f9ed00092b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:08.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:08.977+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ed4055000 con 0x7f9ee0135780 2023-10-25T16:17:09.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.129+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7f9ee0158110 con 0x7f9ee0135780 2023-10-25T16:17:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.137+0000 7f9ec77fe640 1 -- 172.21.15.177:0/3873926577 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v24) v1 ==== 71+0+0 (secure 0 0 0) 0x7f9ed4022070 con 0x7f9ee0135780 2023-10-25T16:17:09.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ecc066470 msgr2=0x7f9ecc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ecc066470 0x7f9ecc068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0005c50 tx=0x7f9ed00092b0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 msgr2=0x7f9ee0137400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 0x7f9ee0137400 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4001800 tx=0x7f9ed4012b20 comp rx=0 tx=0).stop 2023-10-25T16:17:09.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 shutdown_connections 2023-10-25T16:17:09.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9ecc066470 0x7f9ecc068930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ee0137940 0x7f9ee013db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0135780 0x7f9ee0137400 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 --2- 172.21.15.177:0/3873926577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ee0137020 0x7f9ee0135240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 >> 172.21.15.177:0/3873926577 conn(0x7f9ee00b2450 msgr2=0x7f9ee00cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:09.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 shutdown_connections 2023-10-25T16:17:09.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.141+0000 7f9ee56e6640 1 -- 172.21.15.177:0/3873926577 wait complete. 2023-10-25T16:17:09.163 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-10-25T16:17:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.277+0000 7fd94f409640 1 -- 172.21.15.177:0/1225216066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9340047d0 msgr2=0x7fd934004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.277+0000 7fd94f409640 1 --2- 172.21.15.177:0/1225216066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9340047d0 0x7fd934004c50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd938006fd0 tx=0x7fd93801f720 comp rx=0 tx=0).stop 2023-10-25T16:17:09.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.277+0000 7fd94f409640 1 -- 172.21.15.177:0/1225216066 shutdown_connections 2023-10-25T16:17:09.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.277+0000 7fd94f409640 1 --2- 172.21.15.177:0/1225216066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9340047d0 0x7fd934004c50 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.277+0000 7fd94f409640 1 -- 172.21.15.177:0/1225216066 >> 172.21.15.177:0/1225216066 conn(0x7fd9480b2450 msgr2=0x7fd9480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:09.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.277+0000 7fd94f409640 1 -- 172.21.15.177:0/1225216066 shutdown_connections 2023-10-25T16:17:09.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- 172.21.15.177:0/1225216066 wait complete. 2023-10-25T16:17:09.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 Processor -- start 2023-10-25T16:17:09.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- start start 2023-10-25T16:17:09.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9340047d0 0x7fd948143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd94814e180 0x7fd948155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 0x7fd948156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948147900 con 0x7fd94814e600 2023-10-25T16:17:09.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948147be0 con 0x7fd9340047d0 2023-10-25T16:17:09.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd948147ec0 con 0x7fd94814e180 2023-10-25T16:17:09.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 0x7fd948156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 0x7fd948156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58104/0 (socket says 172.21.15.177:58104) 2023-10-25T16:17:09.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 -- 172.21.15.177:0/3543974051 learned_addr learned my addr 172.21.15.177:0/3543974051 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:09.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d1a5640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9340047d0 0x7fd948143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94c9a4640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd94814e180 0x7fd948155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 -- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd94814e180 msgr2=0x7fd948155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd94814e180 0x7fd948155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 -- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9340047d0 msgr2=0x7fd948143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9340047d0 0x7fd948143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 -- 172.21.15.177:0/3543974051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9481481a0 con 0x7fd94814e600 2023-10-25T16:17:09.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94d9a6640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 0x7fd948156120 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd9480ccea0 tx=0x7fd94000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:09.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000de90 con 0x7fd94814e600 2023-10-25T16:17:09.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd940003980 con 0x7fd94814e600 2023-10-25T16:17:09.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd948148480 con 0x7fd94814e600 2023-10-25T16:17:09.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940003dd0 con 0x7fd94814e600 2023-10-25T16:17:09.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.281+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd948143f40 con 0x7fd94814e600 2023-10-25T16:17:09.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.285+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9481486c0 con 0x7fd94814e600 2023-10-25T16:17:09.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.285+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd9400050d0 con 0x7fd94814e600 2023-10-25T16:17:09.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.285+0000 7fd93dffb640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd92c066470 0x7fd92c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.285+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd940083470 con 0x7fd94814e600 2023-10-25T16:17:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.285+0000 7fd94d1a5640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd92c066470 0x7fd92c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.285+0000 7fd94d1a5640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd92c066470 0x7fd92c068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd948063450 tx=0x7fd94400d390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:09.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.289+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9481486c0 con 0x7fd94814e600 2023-10-25T16:17:09.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.497+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fd9481486c0 con 0x7fd94814e600 2023-10-25T16:17:09.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.809+0000 7fd93dffb640 1 -- 172.21.15.177:0/3543974051 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v218) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd9481486c0 con 0x7fd94814e600 2023-10-25T16:17:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd92c066470 msgr2=0x7fd92c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd92c066470 0x7fd92c068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd948063450 tx=0x7fd94400d390 comp rx=0 tx=0).stop 2023-10-25T16:17:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 msgr2=0x7fd948156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 0x7fd948156120 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd9480ccea0 tx=0x7fd94000db50 comp rx=0 tx=0).stop 2023-10-25T16:17:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 shutdown_connections 2023-10-25T16:17:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd92c066470 0x7fd92c068930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd94814e600 0x7fd948156120 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd94814e180 0x7fd948155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 --2- 172.21.15.177:0/3543974051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9340047d0 0x7fd948143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 >> 172.21.15.177:0/3543974051 conn(0x7fd9480b2450 msgr2=0x7fd948157420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 shutdown_connections 2023-10-25T16:17:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.813+0000 7fd94f409640 1 -- 172.21.15.177:0/3543974051 wait complete. 2023-10-25T16:17:09.838 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-25T16:17:09.839 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-10-25T16:17:09.839 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-10-25T16:17:09.839 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 -- 172.21.15.177:0/1618225679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 msgr2=0x7f4ef80cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1618225679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80cc0d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009840 tx=0x7f4eec01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 -- 172.21.15.177:0/1618225679 shutdown_connections 2023-10-25T16:17:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1618225679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80cc0d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1618225679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef8159230 0x7f4ef8071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 -- 172.21.15.177:0/1618225679 >> 172.21.15.177:0/1618225679 conn(0x7f4ef80b2450 msgr2=0x7f4ef80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 -- 172.21.15.177:0/1618225679 shutdown_connections 2023-10-25T16:17:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.957+0000 7f4efdda4640 1 -- 172.21.15.177:0/1618225679 wait complete. 2023-10-25T16:17:09.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 Processor -- start 2023-10-25T16:17:09.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- start start 2023-10-25T16:17:09.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef80cc610 0x7f4ef80b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef8159230 0x7f4ef8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b2020 con 0x7f4ef8070510 2023-10-25T16:17:09.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b1780 con 0x7f4ef8159230 2023-10-25T16:17:09.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b1a60 con 0x7f4ef80cc610 2023-10-25T16:17:09.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58120/0 (socket says 172.21.15.177:58120) 2023-10-25T16:17:09.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 -- 172.21.15.177:0/1690165854 learned_addr learned my addr 172.21.15.177:0/1690165854 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:09.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef6ffd640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef80cc610 0x7f4ef80b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef7fff640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef8159230 0x7f4ef8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 -- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef80cc610 msgr2=0x7f4ef80b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef80cc610 0x7f4ef80b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 -- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef8159230 msgr2=0x7f4ef8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:09.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef8159230 0x7f4ef8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:09.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 -- 172.21.15.177:0/1690165854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009450 con 0x7f4ef8070510 2023-10-25T16:17:09.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef7fff640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef8159230 0x7f4ef8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:09.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4ef77fe640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80c9770 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b410 tx=0x7f4ee800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:09.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8011830 con 0x7f4ef8070510 2023-10-25T16:17:09.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4ee8011a80 con 0x7f4ef8070510 2023-10-25T16:17:09.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80b1d40 con 0x7f4ef8070510 2023-10-25T16:17:09.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8011e90 con 0x7f4ef8070510 2023-10-25T16:17:09.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef8157c60 con 0x7f4ef8070510 2023-10-25T16:17:09.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.961+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8157eb0 con 0x7f4ef8070510 2023-10-25T16:17:09.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.965+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ee801a400 con 0x7f4ef8070510 2023-10-25T16:17:09.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.965+0000 7f4edffff640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4ee4066470 0x7f4ee4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:09.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.965+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4ee8084050 con 0x7f4ef8070510 2023-10-25T16:17:09.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.965+0000 7f4ef6ffd640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4ee4066470 0x7f4ee4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:09.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.965+0000 7f4ef6ffd640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4ee4066470 0x7f4ee4068930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0ae000 tx=0x7f4eec01aff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:09.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:09.969+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ef8157eb0 con 0x7f4ef8070510 2023-10-25T16:17:10.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.121+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef8157eb0 con 0x7f4ef8070510 2023-10-25T16:17:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4edffff640 1 -- 172.21.15.177:0/1690165854 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f4ef8157eb0 con 0x7f4ef8070510 2023-10-25T16:17:10.128 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:10.129 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":78,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:08.802594+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1610672275":"2023-10-26T16:17:05.575726+0000","172.21.15.177:6834/1610672275":"2023-10-26T16:17:05.575726+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:10.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4ee4066470 msgr2=0x7f4ee4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4ee4066470 0x7f4ee4068930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4eec0ae000 tx=0x7f4eec01aff0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 msgr2=0x7f4ef80c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80c9770 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b410 tx=0x7f4ee800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 shutdown_connections 2023-10-25T16:17:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4ee4066470 0x7f4ee4068930 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ef8159230 0x7f4ef8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ef80cc610 0x7f4ef80b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 --2- 172.21.15.177:0/1690165854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ef8070510 0x7f4ef80c9770 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 >> 172.21.15.177:0/1690165854 conn(0x7f4ef80b2450 msgr2=0x7f4ef806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 shutdown_connections 2023-10-25T16:17:10.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.125+0000 7f4efdda4640 1 -- 172.21.15.177:0/1690165854 wait complete. 2023-10-25T16:17:10.149 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:17:10.149 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:17:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- 172.21.15.177:0/2055971806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9415cdd0 msgr2=0x7fee9415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/2055971806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9415cdd0 0x7fee9415a260 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fee940cd010 tx=0x7fee9001c810 comp rx=0 tx=0).stop 2023-10-25T16:17:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- 172.21.15.177:0/2055971806 shutdown_connections 2023-10-25T16:17:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/2055971806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9415cdd0 0x7fee9415a260 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/2055971806 >> v2:172.21.15.184:3300/0 conn(0x7fee941537d0 0x7fee940caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- 172.21.15.177:0/2055971806 >> 172.21.15.177:0/2055971806 conn(0x7fee940b2450 msgr2=0x7fee940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- 172.21.15.177:0/2055971806 shutdown_connections 2023-10-25T16:17:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- 172.21.15.177:0/2055971806 wait complete. 2023-10-25T16:17:10.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 Processor -- start 2023-10-25T16:17:10.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- start start 2023-10-25T16:17:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 0x7fee94151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee941537d0 0x7fee94151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee9415cdd0 0x7fee941522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94145f00 con 0x7fee9406b9e0 2023-10-25T16:17:10.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee941461c0 con 0x7fee9415cdd0 2023-10-25T16:17:10.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9c2c7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee941464a0 con 0x7fee941537d0 2023-10-25T16:17:10.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 0x7fee94151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:10.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 0x7fee94151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58144/0 (socket says 172.21.15.177:58144) 2023-10-25T16:17:10.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 -- 172.21.15.177:0/3329797219 learned_addr learned my addr 172.21.15.177:0/3329797219 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:10.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 -- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee941537d0 msgr2=0x7fee94151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee941537d0 0x7fee94151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 -- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee9415cdd0 msgr2=0x7fee941522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee9415cdd0 0x7fee941522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 -- 172.21.15.177:0/3329797219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee90009500 con 0x7fee9406b9e0 2023-10-25T16:17:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.281+0000 7fee9a063640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 0x7fee94151870 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ccb0 tx=0x7fee8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88004b30 con 0x7fee9406b9e0 2023-10-25T16:17:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee88004da0 con 0x7fee9406b9e0 2023-10-25T16:17:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee94146780 con 0x7fee9406b9e0 2023-10-25T16:17:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88005280 con 0x7fee9406b9e0 2023-10-25T16:17:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9413d710 con 0x7fee9406b9e0 2023-10-25T16:17:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee94157400 con 0x7fee9406b9e0 2023-10-25T16:17:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee880053e0 con 0x7fee9406b9e0 2023-10-25T16:17:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee86ffd640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee78066470 0x7fee78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee88084510 con 0x7fee9406b9e0 2023-10-25T16:17:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee99862640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee78066470 0x7fee78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.285+0000 7fee99862640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee78066470 0x7fee78068930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fee900af000 tx=0x7fee900195b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.289+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee88051c90 con 0x7fee9406b9e0 2023-10-25T16:17:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee9404daf0 con 0x7fee9406b9e0 2023-10-25T16:17:10.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee86ffd640 1 -- 172.21.15.177:0/3329797219 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee8801d020 con 0x7fee9406b9e0 2023-10-25T16:17:10.449 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:17:10.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee78066470 msgr2=0x7fee78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee78066470 0x7fee78068930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fee900af000 tx=0x7fee900195b0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 msgr2=0x7fee94151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 0x7fee94151870 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ccb0 tx=0x7fee8800a620 comp rx=0 tx=0).stop 2023-10-25T16:17:10.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 shutdown_connections 2023-10-25T16:17:10.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee78066470 0x7fee78068930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee9415cdd0 0x7fee941522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee941537d0 0x7fee94151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 --2- 172.21.15.177:0/3329797219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee9406b9e0 0x7fee94151870 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 >> 172.21.15.177:0/3329797219 conn(0x7fee940b2450 msgr2=0x7fee940b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:10.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 shutdown_connections 2023-10-25T16:17:10.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.445+0000 7fee9c2c7640 1 -- 172.21.15.177:0/3329797219 wait complete. 2023-10-25T16:17:10.469 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-25T16:17:10.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.585+0000 7feef8b86640 1 -- 172.21.15.177:0/4128271455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef406c110 msgr2=0x7feef40af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.585+0000 7feef8b86640 1 --2- 172.21.15.177:0/4128271455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef406c110 0x7feef40af5a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7feedc0098f0 tx=0x7feedc01c850 comp rx=0 tx=0).stop 2023-10-25T16:17:10.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- 172.21.15.177:0/4128271455 shutdown_connections 2023-10-25T16:17:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 --2- 172.21.15.177:0/4128271455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feef40cb530 0x7feef40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 --2- 172.21.15.177:0/4128271455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef406c110 0x7feef40af5a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- 172.21.15.177:0/4128271455 >> 172.21.15.177:0/4128271455 conn(0x7feef40b2450 msgr2=0x7feef40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- 172.21.15.177:0/4128271455 shutdown_connections 2023-10-25T16:17:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- 172.21.15.177:0/4128271455 wait complete. 2023-10-25T16:17:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 Processor -- start 2023-10-25T16:17:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- start start 2023-10-25T16:17:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feef406c110 0x7feef415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 0x7feef41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feef4140db0 0x7feef413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef415e800 con 0x7feef40cb530 2023-10-25T16:17:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef415d760 con 0x7feef406c110 2023-10-25T16:17:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef415da40 con 0x7feef4140db0 2023-10-25T16:17:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 0x7feef41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 0x7feef41579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48432/0 (socket says 172.21.15.177:48432) 2023-10-25T16:17:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 -- 172.21.15.177:0/808222012 learned_addr learned my addr 172.21.15.177:0/808222012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef259c640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feef406c110 0x7feef415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef2d9d640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feef4140db0 0x7feef413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 -- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feef4140db0 msgr2=0x7feef413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feef4140db0 0x7feef413f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 -- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feef406c110 msgr2=0x7feef415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feef406c110 0x7feef415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 -- 172.21.15.177:0/808222012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc009500 con 0x7feef40cb530 2023-10-25T16:17:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef1d9b640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 0x7feef41579a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7feedc000c10 tx=0x7feedc005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a58d0 con 0x7feef40cb530 2023-10-25T16:17:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feedc0038f0 con 0x7feef40cb530 2023-10-25T16:17:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc003d00 con 0x7feef40cb530 2023-10-25T16:17:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef415dd20 con 0x7feef40cb530 2023-10-25T16:17:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.589+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef415e2e0 con 0x7feef40cb530 2023-10-25T16:17:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.593+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef415e4d0 con 0x7feef40cb530 2023-10-25T16:17:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.593+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feedc0b4040 con 0x7feef40cb530 2023-10-25T16:17:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.593+0000 7feeeaffd640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feed40664a0 0x7feed4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.593+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feedc11e8e0 con 0x7feef40cb530 2023-10-25T16:17:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.593+0000 7feef259c640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feed40664a0 0x7feed4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.593+0000 7feef259c640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feed40664a0 0x7feed4068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feee4009f20 tx=0x7feee40094d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.597+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feedc0ec0f0 con 0x7feef40cb530 2023-10-25T16:17:10.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.805+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7feef404daf0 con 0x7feef40cb530 2023-10-25T16:17:10.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.817+0000 7feeeaffd640 1 -- 172.21.15.177:0/808222012 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v219) v1 ==== 136+0+0 (secure 0 0 0) 0x7feedc003e60 con 0x7feef40cb530 2023-10-25T16:17:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feed40664a0 msgr2=0x7feed4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feed40664a0 0x7feed4068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feee4009f20 tx=0x7feee40094d0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 msgr2=0x7feef41579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 0x7feef41579a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7feedc000c10 tx=0x7feedc005e30 comp rx=0 tx=0).stop 2023-10-25T16:17:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 shutdown_connections 2023-10-25T16:17:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feed40664a0 0x7feed4068960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feef4140db0 0x7feef413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feef40cb530 0x7feef41579a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 --2- 172.21.15.177:0/808222012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feef406c110 0x7feef415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:10.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 >> 172.21.15.177:0/808222012 conn(0x7feef40b2450 msgr2=0x7feef40afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:10.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 shutdown_connections 2023-10-25T16:17:10.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:10.821+0000 7feef8b86640 1 -- 172.21.15.177:0/808222012 wait complete. 2023-10-25T16:17:10.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-25T16:17:10.960 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_objectstore":"memstore"} 2023-10-25T16:17:10.960 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-25T16:17:10.961 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:17:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f63467be640 1 -- 172.21.15.177:0/3939934388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f632c005e20 msgr2=0x7f632c0062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f63467be640 1 --2- 172.21.15.177:0/3939934388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f632c005e20 0x7f632c0062a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6338001da0 tx=0x7f633801cb20 comp rx=0 tx=0).stop 2023-10-25T16:17:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f6344d5b640 1 -- 172.21.15.177:0/3939934388 reap_dead start 2023-10-25T16:17:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f63467be640 1 -- 172.21.15.177:0/3939934388 shutdown_connections 2023-10-25T16:17:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f63467be640 1 -- 172.21.15.177:0/3939934388 >> 172.21.15.177:0/3939934388 conn(0x7f63400b2450 msgr2=0x7f63400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f63467be640 1 -- 172.21.15.177:0/3939934388 shutdown_connections 2023-10-25T16:17:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.081+0000 7f63467be640 1 -- 172.21.15.177:0/3939934388 wait complete. 2023-10-25T16:17:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 Processor -- start 2023-10-25T16:17:11.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- start start 2023-10-25T16:17:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401ecae0 0x7f63400ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 0x7f6340148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63401490e0 0x7f63401580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340149560 con 0x7f63401596b0 2023-10-25T16:17:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63401ed2c0 con 0x7f63401ecae0 2023-10-25T16:17:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63400ae560 con 0x7f63401490e0 2023-10-25T16:17:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 0x7f6340148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 0x7f6340148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48446/0 (socket says 172.21.15.177:48446) 2023-10-25T16:17:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 -- 172.21.15.177:0/773894088 learned_addr learned my addr 172.21.15.177:0/773894088 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f6344d5b640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63401490e0 0x7f63401580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f633ffff640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401ecae0 0x7f63400ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 -- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63401490e0 msgr2=0x7f63401580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63401490e0 0x7f63401580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 -- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401ecae0 msgr2=0x7f63400ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401ecae0 0x7f63400ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 -- 172.21.15.177:0/773894088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6340159c20 con 0x7f63401596b0 2023-10-25T16:17:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f633ffff640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401ecae0 0x7f63400ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63377fe640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 0x7f6340148ba0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6328001130 tx=0x7f632800df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328012070 con 0x7f63401596b0 2023-10-25T16:17:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6328006380 con 0x7f63401596b0 2023-10-25T16:17:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6340159f00 con 0x7f63401596b0 2023-10-25T16:17:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328008920 con 0x7f63401596b0 2023-10-25T16:17:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634015a4c0 con 0x7f63401596b0 2023-10-25T16:17:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.085+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63401ed430 con 0x7f63401596b0 2023-10-25T16:17:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.089+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6328008aa0 con 0x7f63401596b0 2023-10-25T16:17:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.089+0000 7f633d7fa640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6320066470 0x7f6320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.089+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6328085fd0 con 0x7f63401596b0 2023-10-25T16:17:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.089+0000 7f633ffff640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6320066470 0x7f6320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.089+0000 7f633ffff640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6320066470 0x7f6320068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6330005fd0 tx=0x7f633000e4c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.093+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63401ed430 con 0x7f63401596b0 2023-10-25T16:17:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f63401ed430 con 0x7f63401596b0 2023-10-25T16:17:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f633d7fa640 1 -- 172.21.15.177:0/773894088 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v24) v1 ==== 59+0+1116 (secure 0 0 0) 0x7f63401ed430 con 0x7f63401596b0 2023-10-25T16:17:11.249 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:17:11.249 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:17:11.249 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:17:11.250 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:17:11.250 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:17:11.250 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:17:11.250 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:17:11.250 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:17:11.251 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:17:11.251 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:17:11.251 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:17:11.251 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:17:11.251 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:17:11.252 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:17:11.252 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:17:11.252 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:17:11.252 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:17:11.252 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:17:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6320066470 msgr2=0x7f6320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6320066470 0x7f6320068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6330005fd0 tx=0x7f633000e4c0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 msgr2=0x7f6340148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 0x7f6340148ba0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6328001130 tx=0x7f632800df00 comp rx=0 tx=0).stop 2023-10-25T16:17:11.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 shutdown_connections 2023-10-25T16:17:11.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6320066470 0x7f6320068930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63401490e0 0x7f63401580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63401596b0 0x7f6340148ba0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 --2- 172.21.15.177:0/773894088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401ecae0 0x7f63400ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 >> 172.21.15.177:0/773894088 conn(0x7f63400b2450 msgr2=0x7f6340070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 shutdown_connections 2023-10-25T16:17:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.245+0000 7f63467be640 1 -- 172.21.15.177:0/773894088 wait complete. 2023-10-25T16:17:11.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:17:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 -- 172.21.15.177:0/81631104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e68003980 msgr2=0x7f0e68003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 --2- 172.21.15.177:0/81631104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e68003980 0x7f0e68003da0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400c640 tx=0x7f0e7401d380 comp rx=0 tx=0).stop 2023-10-25T16:17:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e81ccb640 1 -- 172.21.15.177:0/81631104 reap_dead start 2023-10-25T16:17:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 -- 172.21.15.177:0/81631104 shutdown_connections 2023-10-25T16:17:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 -- 172.21.15.177:0/81631104 >> 172.21.15.177:0/81631104 conn(0x7f0e7c09a5c0 msgr2=0x7f0e7c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 -- 172.21.15.177:0/81631104 shutdown_connections 2023-10-25T16:17:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 -- 172.21.15.177:0/81631104 wait complete. 2023-10-25T16:17:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 Processor -- start 2023-10-25T16:17:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.377+0000 7f0e8372e640 1 -- start start 2023-10-25T16:17:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e68003980 0x7f0e7c156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e7c0c4c60 0x7f0e7c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 0x7f0e7c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c154450 con 0x7f0e7c159910 2023-10-25T16:17:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c1546f0 con 0x7f0e7c0c4c60 2023-10-25T16:17:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c1549d0 con 0x7f0e68003980 2023-10-25T16:17:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 0x7f0e7c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 0x7f0e7c155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48462/0 (socket says 172.21.15.177:48462) 2023-10-25T16:17:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 -- 172.21.15.177:0/178247693 learned_addr learned my addr 172.21.15.177:0/178247693 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e814ca640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e68003980 0x7f0e7c156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e80cc9640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e7c0c4c60 0x7f0e7c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 -- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e68003980 msgr2=0x7f0e7c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e68003980 0x7f0e7c156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 -- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e7c0c4c60 msgr2=0x7f0e7c1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e7c0c4c60 0x7f0e7c1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 -- 172.21.15.177:0/178247693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c154cb0 con 0x7f0e7c159910 2023-10-25T16:17:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e81ccb640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 0x7f0e7c155790 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c06a0e0 tx=0x7f0e7800e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78017070 con 0x7f0e7c159910 2023-10-25T16:17:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e78005110 con 0x7f0e7c159910 2023-10-25T16:17:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c154f90 con 0x7f0e7c159910 2023-10-25T16:17:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78005520 con 0x7f0e7c159910 2023-10-25T16:17:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c157040 con 0x7f0e7c159910 2023-10-25T16:17:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c04daf0 con 0x7f0e7c159910 2023-10-25T16:17:11.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e780047b0 con 0x7f0e7c159910 2023-10-25T16:17:11.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e71ffb640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e600664a0 0x7f0e60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0e78083bc0 con 0x7f0e7c159910 2023-10-25T16:17:11.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.381+0000 7f0e814ca640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e600664a0 0x7f0e60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.385+0000 7f0e814ca640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e600664a0 0x7f0e60068960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e740ac000 tx=0x7f0e7401a120 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:11.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.385+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e78051340 con 0x7f0e7c159910 2023-10-25T16:17:11.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.529+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0e7c155440 con 0x7f0e7c159910 2023-10-25T16:17:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e71ffb640 1 -- 172.21.15.177:0/178247693 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v25)=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e78054960 con 0x7f0e7c159910 2023-10-25T16:17:11.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e600664a0 msgr2=0x7f0e60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e600664a0 0x7f0e60068960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0e740ac000 tx=0x7f0e7401a120 comp rx=0 tx=0).stop 2023-10-25T16:17:11.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 msgr2=0x7f0e7c155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 0x7f0e7c155790 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c06a0e0 tx=0x7f0e7800e9b0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 shutdown_connections 2023-10-25T16:17:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0e600664a0 0x7f0e60068960 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e7c159910 0x7f0e7c155790 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e7c0c4c60 0x7f0e7c1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 --2- 172.21.15.177:0/178247693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e68003980 0x7f0e7c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 >> 172.21.15.177:0/178247693 conn(0x7f0e7c09a5c0 msgr2=0x7f0e7c15ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 shutdown_connections 2023-10-25T16:17:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.537+0000 7f0e8372e640 1 -- 172.21.15.177:0/178247693 wait complete. 2023-10-25T16:17:11.560 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:17:11.560 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:17:11.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:17:11.656 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:17:11.656 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:17:11.657 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:11.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:17:11.662 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:17:11.662 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:11.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:17:11.707 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:17:11.707 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:11.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:17:11.712 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:17:11.713 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:11.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:17:11.759 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:17:11.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:11.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/3115867462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 msgr2=0x7f0ca8071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 --2- 172.21.15.177:0/3115867462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 0x7f0ca8071500 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009870 tx=0x7f0c9801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/3115867462 shutdown_connections 2023-10-25T16:17:11.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 --2- 172.21.15.177:0/3115867462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ca806b980 0x7f0ca806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 --2- 172.21.15.177:0/3115867462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 0x7f0ca8071500 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/3115867462 >> 172.21.15.177:0/3115867462 conn(0x7f0ca80b2450 msgr2=0x7f0ca80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:11.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/3115867462 shutdown_connections 2023-10-25T16:17:11.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/3115867462 wait complete. 2023-10-25T16:17:11.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 Processor -- start 2023-10-25T16:17:11.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- start start 2023-10-25T16:17:11.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ca806b980 0x7f0ca81480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 0x7f0ca80ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 0x7f0ca81522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8148d80 con 0x7f0ca8070510 2023-10-25T16:17:11.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8148aa0 con 0x7f0ca8159230 2023-10-25T16:17:11.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81517f0 con 0x7f0ca806b980 2023-10-25T16:17:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 0x7f0ca80ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 0x7f0ca80ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48468/0 (socket says 172.21.15.177:48468) 2023-10-25T16:17:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 -- 172.21.15.177:0/2212594941 learned_addr learned my addr 172.21.15.177:0/2212594941 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca659c640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ca806b980 0x7f0ca81480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca6d9d640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 0x7f0ca81522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 -- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ca806b980 msgr2=0x7f0ca81480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ca806b980 0x7f0ca81480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 -- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 msgr2=0x7f0ca81522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 0x7f0ca81522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 -- 172.21.15.177:0/2212594941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009820 con 0x7f0ca8070510 2023-10-25T16:17:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0ca5d9b640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 0x7f0ca80ae420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c430 tx=0x7f0c9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:11.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c011790 con 0x7f0ca8070510 2023-10-25T16:17:11.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c9c011a00 con 0x7f0ca8070510 2023-10-25T16:17:11.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c980094a0 con 0x7f0ca8070510 2023-10-25T16:17:11.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c011e10 con 0x7f0ca8070510 2023-10-25T16:17:11.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.885+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca8151db0 con 0x7f0ca8070510 2023-10-25T16:17:11.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.889+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca804daf0 con 0x7f0ca8070510 2023-10-25T16:17:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.889+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0c9c01c460 con 0x7f0ca8070510 2023-10-25T16:17:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.889+0000 7f0c96ffd640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c88066470 0x7f0c88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.889+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0c9c083d40 con 0x7f0ca8070510 2023-10-25T16:17:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.889+0000 7f0ca659c640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c88066470 0x7f0c88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.889+0000 7f0ca659c640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c88066470 0x7f0c88068930 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0c980af000 tx=0x7f0c9801b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:11.893+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c9c051610 con 0x7f0ca8070510 2023-10-25T16:17:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.085+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca815c850 con 0x7f0ca8070510 2023-10-25T16:17:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0c96ffd640 1 -- 172.21.15.177:0/2212594941 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f0c9c054c30 con 0x7f0ca8070510 2023-10-25T16:17:12.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:12.092 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5455,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/559405354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":559405354},{"type":"v1","addr":"172.21.15.184:6835","nonce":559405354}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5458,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/360499819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":360499819},{"type":"v1","addr":"172.21.15.184:6837","nonce":360499819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6348,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1688701896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1688701896},{"type":"v1","addr":"172.21.15.177:6833","nonce":1688701896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":6708,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3601750265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3601750265},{"type":"v1","addr":"172.21.15.177:6835","nonce":3601750265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[]} 2023-10-25T16:17:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 27 2023-10-25T16:17:12.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c88066470 msgr2=0x7f0c88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:12.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c88066470 0x7f0c88068930 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0c980af000 tx=0x7f0c9801b010 comp rx=0 tx=0).stop 2023-10-25T16:17:12.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 msgr2=0x7f0ca80ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:12.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 0x7f0ca80ae420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00c430 tx=0x7f0c9c00c8f0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 shutdown_connections 2023-10-25T16:17:12.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c88066470 0x7f0c88068930 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ca8159230 0x7f0ca81522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca8070510 0x7f0ca80ae420 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 --2- 172.21.15.177:0/2212594941 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ca806b980 0x7f0ca81480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 >> 172.21.15.177:0/2212594941 conn(0x7f0ca80b2450 msgr2=0x7f0ca8157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 shutdown_connections 2023-10-25T16:17:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.089+0000 7f0caca41640 1 -- 172.21.15.177:0/2212594941 wait complete. 2023-10-25T16:17:12.111 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:17:12.111 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:17:12.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:17:12.112 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:17:12.112 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:17:12.112 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:17:12.113 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:17:12.113 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:17:12.113 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:17:12.113 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:17:12.114 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:17:12.114 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:17:12.114 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:17:12.115 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:17:12.115 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:17:12.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:17:12.121 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:17:12.121 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:17:12.125 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:17:12.125 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:17:12.126 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:17:12.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:17:12.128 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:17:12.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:17:12.168 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:17:12.169 DEBUG:teuthology.parallel:result is None 2023-10-25T16:17:12.169 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:17:12.170 DEBUG:teuthology.parallel:result is None 2023-10-25T16:17:12.171 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:17:12.171 DEBUG:teuthology.parallel:result is None 2023-10-25T16:17:12.172 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:17:12.173 DEBUG:teuthology.parallel:result is None 2023-10-25T16:17:12.173 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:17:12.229 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:17:12.240 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:17:12.241 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:17:12.248 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:17:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- 172.21.15.177:0/3677780456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d015d670 msgr2=0x7fa1d006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 --2- 172.21.15.177:0/3677780456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d015d670 0x7fa1d006acb0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009c80 tx=0x7fa1c801cd40 comp rx=0 tx=0).stop 2023-10-25T16:17:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- 172.21.15.177:0/3677780456 shutdown_connections 2023-10-25T16:17:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 --2- 172.21.15.177:0/3677780456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d015d670 0x7fa1d006acb0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 --2- 172.21.15.177:0/3677780456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1d0155f50 0x7fa1d015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- 172.21.15.177:0/3677780456 >> 172.21.15.177:0/3677780456 conn(0x7fa1d00b0de0 msgr2=0x7fa1d00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- 172.21.15.177:0/3677780456 shutdown_connections 2023-10-25T16:17:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- 172.21.15.177:0/3677780456 wait complete. 2023-10-25T16:17:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 Processor -- start 2023-10-25T16:17:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- start start 2023-10-25T16:17:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d006a830 0x7fa1d00ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 0x7fa1d00acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1d015d670 0x7fa1d00c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00ad430 con 0x7fa1d0155f50 2023-10-25T16:17:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00ad710 con 0x7fa1d006a830 2023-10-25T16:17:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.285+0000 7fa1d5729640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00ad9f0 con 0x7fa1d015d670 2023-10-25T16:17:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 0x7fa1d00acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 0x7fa1d00acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48522/0 (socket says 172.21.15.177:48522) 2023-10-25T16:17:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 -- 172.21.15.177:0/802372154 learned_addr learned my addr 172.21.15.177:0/802372154 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ceffd640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d006a830 0x7fa1d00ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1cf7fe640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1d015d670 0x7fa1d00c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 -- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1d015d670 msgr2=0x7fa1d00c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1d015d670 0x7fa1d00c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 -- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d006a830 msgr2=0x7fa1d00ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d006a830 0x7fa1d00ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 -- 172.21.15.177:0/802372154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c80098e0 con 0x7fa1d0155f50 2023-10-25T16:17:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ce7fc640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 0x7fa1d00acbc0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400c450 tx=0x7fa1c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4012830 con 0x7fa1d0155f50 2023-10-25T16:17:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa1c4012aa0 con 0x7fa1d0155f50 2023-10-25T16:17:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d00adcd0 con 0x7fa1d0155f50 2023-10-25T16:17:12.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4011380 con 0x7fa1d0155f50 2023-10-25T16:17:12.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d00ad100 con 0x7fa1d0155f50 2023-10-25T16:17:12.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d00ae1f0 con 0x7fa1d0155f50 2023-10-25T16:17:12.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa1c40114e0 con 0x7fa1d0155f50 2023-10-25T16:17:12.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1b77fe640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1bc066470 0x7fa1bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:12.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa1c4083b90 con 0x7fa1d0155f50 2023-10-25T16:17:12.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ceffd640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1bc066470 0x7fa1bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:12.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.289+0000 7fa1ceffd640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1bc066470 0x7fa1bc068930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009990 tx=0x7fa1c0009110 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:12.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.293+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1d00ae1f0 con 0x7fa1d0155f50 2023-10-25T16:17:12.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:12.445+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa1d00ae1f0 con 0x7fa1d0155f50 2023-10-25T16:17:13.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.657+0000 7fa1b77fe640 1 -- 172.21.15.177:0/802372154 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa1d00ae1f0 con 0x7fa1d0155f50 2023-10-25T16:17:13.661 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:17:13.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1bc066470 msgr2=0x7fa1bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:13.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1bc066470 0x7fa1bc068930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009990 tx=0x7fa1c0009110 comp rx=0 tx=0).stop 2023-10-25T16:17:13.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 msgr2=0x7fa1d00acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:13.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 0x7fa1d00acbc0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400c450 tx=0x7fa1c400c910 comp rx=0 tx=0).stop 2023-10-25T16:17:13.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 shutdown_connections 2023-10-25T16:17:13.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1bc066470 0x7fa1bc068930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1d015d670 0x7fa1d00c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d0155f50 0x7fa1d00acbc0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 --2- 172.21.15.177:0/802372154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d006a830 0x7fa1d00ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 >> 172.21.15.177:0/802372154 conn(0x7fa1d00b0de0 msgr2=0x7fa1d00aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:13.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 shutdown_connections 2023-10-25T16:17:13.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.661+0000 7fa1d5729640 1 -- 172.21.15.177:0/802372154 wait complete. 2023-10-25T16:17:13.692 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:17:13.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/803480104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015bcc0 msgr2=0x7f2bc015c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:13.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/803480104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015bcc0 0x7f2bc015c110 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f2bc006b740 tx=0x7f2bb401c7a0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/803480104 shutdown_connections 2023-10-25T16:17:13.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/803480104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc015bcc0 0x7f2bc015c110 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/803480104 >> v2:172.21.15.184:3300/0 conn(0x7f2bc0158260 0x7f2bc00654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/803480104 >> 172.21.15.177:0/803480104 conn(0x7f2bc00cd6c0 msgr2=0x7f2bc00cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/803480104 shutdown_connections 2023-10-25T16:17:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/803480104 wait complete. 2023-10-25T16:17:13.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 Processor -- start 2023-10-25T16:17:13.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 -- start start 2023-10-25T16:17:13.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 0x7f2bc0143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:13.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bc015bcc0 0x7f2bc0157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:13.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.821+0000 7f2bc4ed8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bc015c650 0x7f2bc0143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:13.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bc4ed8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0143bc0 con 0x7f2bc0158260 2023-10-25T16:17:13.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bc4ed8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0156680 con 0x7f2bc015c650 2023-10-25T16:17:13.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bc4ed8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0156960 con 0x7f2bc015bcc0 2023-10-25T16:17:13.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 0x7f2bc0143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:13.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 0x7f2bc0143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48550/0 (socket says 172.21.15.177:48550) 2023-10-25T16:17:13.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 -- 172.21.15.177:0/653190619 learned_addr learned my addr 172.21.15.177:0/653190619 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:13.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbed9d640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bc015c650 0x7f2bc0143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:13.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 -- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bc015bcc0 msgr2=0x7f2bc0157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:13.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bc015bcc0 0x7f2bc0157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 -- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bc015c650 msgr2=0x7f2bc0143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:13.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bc015c650 0x7f2bc0143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:13.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 -- 172.21.15.177:0/653190619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4009560 con 0x7f2bc0158260 2023-10-25T16:17:13.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbed9d640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bc015c650 0x7f2bc0143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:13.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbe59c640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 0x7f2bc0143d70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000d980 tx=0x7f2bb000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:13.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0009c30 con 0x7f2bc0158260 2023-10-25T16:17:13.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2bb0005020 con 0x7f2bc0158260 2023-10-25T16:17:13.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc0156c40 con 0x7f2bc0158260 2023-10-25T16:17:13.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0005430 con 0x7f2bc0158260 2023-10-25T16:17:13.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc0157200 con 0x7f2bc0158260 2023-10-25T16:17:13.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc01573f0 con 0x7f2bc0158260 2023-10-25T16:17:13.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2bb00047b0 con 0x7f2bc0158260 2023-10-25T16:17:13.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2baeffd640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ba00664a0 0x7f2ba0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:13.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2bb0084140 con 0x7f2bc0158260 2023-10-25T16:17:13.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.825+0000 7f2bbdd9b640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ba00664a0 0x7f2ba0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:13.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.829+0000 7f2bbdd9b640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ba00664a0 0x7f2ba0068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40af000 tx=0x7f2bb4019540 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:13.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:13.829+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2bb0051a00 con 0x7f2bc0158260 2023-10-25T16:17:14.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.041+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2bc004daf0 con 0x7f2bc0158260 2023-10-25T16:17:14.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.041+0000 7f2baeffd640 1 -- 172.21.15.177:0/653190619 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2bb0017090 con 0x7f2bc0158260 2023-10-25T16:17:14.047 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:14.047 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:17:14.047 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:17:14.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.047 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:17:14.048 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:17:14.048 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.048 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.048 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:17:14.048 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:17:14.049 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.049 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.049 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.049 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:17:14.050 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:17:14.050 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.050 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.050 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:17:14.050 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:17:14.051 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.051 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.051 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:17:14.051 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:17:14.052 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.052 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.052 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:17:14.052 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:17:14.052 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.053 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.053 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.053 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.053 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:17:14.053 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:17:14.053 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.054 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.054 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:17:14.054 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:17:14.054 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.054 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:17:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:17:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.056 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.056 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.056 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.056 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.056 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.057 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:17:14.057 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:17:14.057 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.057 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.057 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:17:14.058 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:17:14.059 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.059 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.059 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.059 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.059 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.060 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.060 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.060 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:17:14.060 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:17:14.060 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.060 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.061 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.061 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.061 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.061 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.061 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.062 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:17:14.062 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:17:14.062 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.062 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.062 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.063 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.063 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.063 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:17:14.064 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:17:14.064 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.064 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.064 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.064 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.064 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.065 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.065 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:17:14.065 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:17:14.065 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.066 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.066 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.066 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.066 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.066 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.067 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.067 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:17:14.067 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:17:14.067 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.067 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:17:14.068 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:17:14.068 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.068 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.068 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.068 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.068 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:17:14.069 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:17:14.069 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.069 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.069 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:17:14.069 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:17:14.070 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.070 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.070 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.070 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:17:14.070 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:17:14.071 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.071 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.071 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:17:14.071 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:17:14.071 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:17:14.071 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.072 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.072 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.072 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:17:14.072 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:17:14.072 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.073 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.073 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:17:14.073 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:17:14.073 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:17:14.073 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.074 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.074 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.074 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:17:14.074 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:17:14.074 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.075 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:17:14.075 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:17:14.075 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:17:14.075 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:17:14.075 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.076 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.076 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.076 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:17:14.076 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:17:14.076 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.076 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:17:14.077 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:17:14.077 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:17:14.077 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.077 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.077 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.078 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:17:14.078 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:17:14.078 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.078 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:17:14.078 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:17:14.079 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.079 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.079 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:14.079 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.079 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:17:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:17:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:17:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:17:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:17:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:17:14.080 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.081 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.081 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:17:14.081 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:17:14.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ba00664a0 msgr2=0x7f2ba0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ba00664a0 0x7f2ba0068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40af000 tx=0x7f2bb4019540 comp rx=0 tx=0).stop 2023-10-25T16:17:14.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 msgr2=0x7f2bc0143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 0x7f2bc0143d70 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000d980 tx=0x7f2bb000de40 comp rx=0 tx=0).stop 2023-10-25T16:17:14.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 shutdown_connections 2023-10-25T16:17:14.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ba00664a0 0x7f2ba0068960 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bc015c650 0x7f2bc0143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2bc015bcc0 0x7f2bc0157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 --2- 172.21.15.177:0/653190619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2bc0158260 0x7f2bc0143d70 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 >> 172.21.15.177:0/653190619 conn(0x7f2bc00cd6c0 msgr2=0x7f2bc00cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 shutdown_connections 2023-10-25T16:17:14.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.045+0000 7f2bc4ed8640 1 -- 172.21.15.177:0/653190619 wait complete. 2023-10-25T16:17:14.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:14.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/3763076508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fac0039b0 msgr2=0x7f6fac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/3763076508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fac0039b0 0x7f6fac003dd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4006fa0 tx=0x7f6fb401cf10 comp rx=0 tx=0).stop 2023-10-25T16:17:14.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/3763076508 shutdown_connections 2023-10-25T16:17:14.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/3763076508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fac0039b0 0x7f6fac003dd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/3763076508 >> 172.21.15.177:0/3763076508 conn(0x7f6fc40b2450 msgr2=0x7f6fc40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/3763076508 shutdown_connections 2023-10-25T16:17:14.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/3763076508 wait complete. 2023-10-25T16:17:14.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 Processor -- start 2023-10-25T16:17:14.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- start start 2023-10-25T16:17:14.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac0039b0 0x7f6fc41f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 0x7f6fc40c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fc413c7e0 0x7f6fc40709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40c91a0 con 0x7f6fc40c2f20 2023-10-25T16:17:14.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40c33a0 con 0x7f6fac0039b0 2023-10-25T16:17:14.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc8e8e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc40c3610 con 0x7f6fc413c7e0 2023-10-25T16:17:14.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 0x7f6fc40c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc1d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 0x7f6fc40c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48570/0 (socket says 172.21.15.177:48570) 2023-10-25T16:17:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc1d9b640 1 -- 172.21.15.177:0/1747014264 learned_addr learned my addr 172.21.15.177:0/1747014264 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.205+0000 7f6fc2d9d640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fc413c7e0 0x7f6fc40709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc259c640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac0039b0 0x7f6fc41f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc1d9b640 1 -- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fc413c7e0 msgr2=0x7f6fc40709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc1d9b640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fc413c7e0 0x7f6fc40709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc1d9b640 1 -- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac0039b0 msgr2=0x7f6fc41f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc1d9b640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac0039b0 0x7f6fc41f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc1d9b640 1 -- 172.21.15.177:0/1747014264 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40c38f0 con 0x7f6fc40c2f20 2023-10-25T16:17:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc259c640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac0039b0 0x7f6fc41f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:17:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc1d9b640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 0x7f6fc40c8c60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800d580 tx=0x7f6fb800da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:14.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8006360 con 0x7f6fc40c2f20 2023-10-25T16:17:14.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6fb8003670 con 0x7f6fc40c2f20 2023-10-25T16:17:14.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8003a00 con 0x7f6fc40c2f20 2023-10-25T16:17:14.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc41f8530 con 0x7f6fc40c2f20 2023-10-25T16:17:14.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc41f8af0 con 0x7f6fc40c2f20 2023-10-25T16:17:14.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc404daf0 con 0x7f6fc40c2f20 2023-10-25T16:17:14.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6fb8003b60 con 0x7f6fc40c2f20 2023-10-25T16:17:14.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fb2ffd640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fa40664a0 0x7f6fa4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fb8083e60 con 0x7f6fc40c2f20 2023-10-25T16:17:14.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc259c640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fa40664a0 0x7f6fa4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.209+0000 7f6fc259c640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fa40664a0 0x7f6fa4068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40ac000 tx=0x7f6fb40a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:14.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.213+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fb80516c0 con 0x7f6fc40c2f20 2023-10-25T16:17:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.365+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fc40b1000 con 0x7f6fc40c2f20 2023-10-25T16:17:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fb2ffd640 1 -- 172.21.15.177:0/1747014264 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f6fb8014020 con 0x7f6fc40c2f20 2023-10-25T16:17:14.372 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:14.373 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":83,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:13.652045+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fa40664a0 msgr2=0x7f6fa4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fa40664a0 0x7f6fa4068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40ac000 tx=0x7f6fb40a7040 comp rx=0 tx=0).stop 2023-10-25T16:17:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 msgr2=0x7f6fc40c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 0x7f6fc40c8c60 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800d580 tx=0x7f6fb800da40 comp rx=0 tx=0).stop 2023-10-25T16:17:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 shutdown_connections 2023-10-25T16:17:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fa40664a0 0x7f6fa4068960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fc413c7e0 0x7f6fc40709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc40c2f20 0x7f6fc40c8c60 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 --2- 172.21.15.177:0/1747014264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fac0039b0 0x7f6fc41f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 >> 172.21.15.177:0/1747014264 conn(0x7f6fc40b2450 msgr2=0x7f6fc40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 shutdown_connections 2023-10-25T16:17:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.369+0000 7f6fc8e8e640 1 -- 172.21.15.177:0/1747014264 wait complete. 2023-10-25T16:17:14.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:17:14.391 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:17:14.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 -- 172.21.15.177:0/1935127649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb140cbfa0 msgr2=0x7fcb140aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 --2- 172.21.15.177:0/1935127649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb140cbfa0 0x7fcb140aebc0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0098f0 tx=0x7fcafc01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 -- 172.21.15.177:0/1935127649 shutdown_connections 2023-10-25T16:17:14.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 --2- 172.21.15.177:0/1935127649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb140af100 0x7fcb14158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 --2- 172.21.15.177:0/1935127649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb140cbfa0 0x7fcb140aebc0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 -- 172.21.15.177:0/1935127649 >> 172.21.15.177:0/1935127649 conn(0x7fcb140b2450 msgr2=0x7fcb140b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 -- 172.21.15.177:0/1935127649 shutdown_connections 2023-10-25T16:17:14.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.509+0000 7fcb19301640 1 -- 172.21.15.177:0/1935127649 wait complete. 2023-10-25T16:17:14.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 Processor -- start 2023-10-25T16:17:14.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- start start 2023-10-25T16:17:14.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb140af100 0x7fcb141515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb140cbfa0 0x7fcb141470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 0x7fcb14147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140ad7f0 con 0x7fcb1414e810 2023-10-25T16:17:14.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140adad0 con 0x7fcb140af100 2023-10-25T16:17:14.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140addb0 con 0x7fcb140cbfa0 2023-10-25T16:17:14.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 0x7fcb14147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 0x7fcb14147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48580/0 (socket says 172.21.15.177:48580) 2023-10-25T16:17:14.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 -- 172.21.15.177:0/1301648494 learned_addr learned my addr 172.21.15.177:0/1301648494 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:14.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb12ffd640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb140af100 0x7fcb141515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 -- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb140cbfa0 msgr2=0x7fcb141470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb0bfff640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb140cbfa0 0x7fcb141470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb140cbfa0 0x7fcb141470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 -- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb140af100 msgr2=0x7fcb141515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb140af100 0x7fcb141515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 -- 172.21.15.177:0/1301648494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc009500 con 0x7fcb1414e810 2023-10-25T16:17:14.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb12ffd640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb140af100 0x7fcb141515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:14.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb137fe640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 0x7fcb14147600 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00b970 tx=0x7fcb0c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:14.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00cb40 con 0x7fcb1414e810 2023-10-25T16:17:14.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb0c00cdb0 con 0x7fcb1414e810 2023-10-25T16:17:14.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb140ae090 con 0x7fcb1414e810 2023-10-25T16:17:14.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0146a0 con 0x7fcb1414e810 2023-10-25T16:17:14.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb14151ae0 con 0x7fcb1414e810 2023-10-25T16:17:14.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.513+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1404daf0 con 0x7fcb1414e810 2023-10-25T16:17:14.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.517+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb0c01d3b0 con 0x7fcb1414e810 2023-10-25T16:17:14.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.517+0000 7fcb0b7fe640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.517+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb0c083c30 con 0x7fcb1414e810 2023-10-25T16:17:14.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.517+0000 7fcb12ffd640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.517+0000 7fcb12ffd640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaf4066470 0x7fcaf4068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcb14155550 tx=0x7fcb04008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:14.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.521+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb0c051490 con 0x7fcb1414e810 2023-10-25T16:17:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.661+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb140c93b0 con 0x7fcb1414e810 2023-10-25T16:17:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.661+0000 7fcb0b7fe640 1 -- 172.21.15.177:0/1301648494 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb0c0190a0 con 0x7fcb1414e810 2023-10-25T16:17:14.666 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:17:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.661+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaf4066470 msgr2=0x7fcaf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.661+0000 7fcb19301640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaf4066470 0x7fcaf4068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcb14155550 tx=0x7fcb04008040 comp rx=0 tx=0).stop 2023-10-25T16:17:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 msgr2=0x7fcb14147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 0x7fcb14147600 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00b970 tx=0x7fcb0c00be30 comp rx=0 tx=0).stop 2023-10-25T16:17:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 shutdown_connections 2023-10-25T16:17:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb1414e810 0x7fcb14147600 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb140cbfa0 0x7fcb141470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 --2- 172.21.15.177:0/1301648494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb140af100 0x7fcb141515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 >> 172.21.15.177:0/1301648494 conn(0x7fcb140b2450 msgr2=0x7fcb140b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 shutdown_connections 2023-10-25T16:17:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.665+0000 7fcb19301640 1 -- 172.21.15.177:0/1301648494 wait complete. 2023-10-25T16:17:14.683 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:17:14.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- 172.21.15.177:0/872266924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 msgr2=0x7f2f78003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 --2- 172.21.15.177:0/872266924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f78003f10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c006f90 tx=0x7f2f7c01cf30 comp rx=0 tx=0).stop 2023-10-25T16:17:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- 172.21.15.177:0/872266924 shutdown_connections 2023-10-25T16:17:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 --2- 172.21.15.177:0/872266924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f78003f10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- 172.21.15.177:0/872266924 >> 172.21.15.177:0/872266924 conn(0x7f2f8c0b2450 msgr2=0x7f2f8c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- 172.21.15.177:0/872266924 shutdown_connections 2023-10-25T16:17:14.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- 172.21.15.177:0/872266924 wait complete. 2023-10-25T16:17:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 Processor -- start 2023-10-25T16:17:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- start start 2023-10-25T16:17:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f8c14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f8c1f4e60 0x7f2f8c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f8c150060 0x7f2f8c146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0adea0 con 0x7f2f78003b10 2023-10-25T16:17:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b1b80 con 0x7f2f8c1f4e60 2023-10-25T16:17:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f90c69640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b1e60 con 0x7f2f8c150060 2023-10-25T16:17:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f8c14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f8c14cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48596/0 (socket says 172.21.15.177:48596) 2023-10-25T16:17:14.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 -- 172.21.15.177:0/2553115702 learned_addr learned my addr 172.21.15.177:0/2553115702 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:14.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f89d9b640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f8c1f4e60 0x7f2f8c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 -- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f8c150060 msgr2=0x7f2f8c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f8c150060 0x7f2f8c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 -- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f8c1f4e60 msgr2=0x7f2f8c0af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f8c1f4e60 0x7f2f8c0af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f8a59c640 1 -- 172.21.15.177:0/2553115702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0adb30 con 0x7f2f78003b10 2023-10-25T16:17:14.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.801+0000 7f2f89d9b640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f8c1f4e60 0x7f2f8c0af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:14.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f8a59c640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f8c14cf20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c01cd60 tx=0x7f2f7c0a5c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:14.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c006350 con 0x7f2f78003b10 2023-10-25T16:17:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f7c0065a0 con 0x7f2f78003b10 2023-10-25T16:17:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0af9c0 con 0x7f2f78003b10 2023-10-25T16:17:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c003840 con 0x7f2f78003b10 2023-10-25T16:17:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c1506b0 con 0x7f2f78003b10 2023-10-25T16:17:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c0ad990 con 0x7f2f78003b10 2023-10-25T16:17:14.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f7c0039a0 con 0x7f2f78003b10 2023-10-25T16:17:14.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f82ffd640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f6c066470 0x7f2f6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:14.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f7c11da60 con 0x7f2f78003b10 2023-10-25T16:17:14.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f89d9b640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f6c066470 0x7f2f6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:14.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.805+0000 7f2f89d9b640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f6c066470 0x7f2f6c068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c15c240 tx=0x7f2f74005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:14.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.809+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f8c0ad990 con 0x7f2f78003b10 2023-10-25T16:17:14.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.957+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2f8c0ad990 con 0x7f2f78003b10 2023-10-25T16:17:14.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f82ffd640 1 -- 172.21.15.177:0/2553115702 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2f8c0ad990 con 0x7f2f78003b10 2023-10-25T16:17:14.965 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:14.965 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:17:14.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:17:14.965 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:17:14.965 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:17:14.966 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:14.966 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:17:14.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f6c066470 msgr2=0x7f2f6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f6c066470 0x7f2f6c068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c15c240 tx=0x7f2f74005f40 comp rx=0 tx=0).stop 2023-10-25T16:17:14.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 msgr2=0x7f2f8c14cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:14.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f8c14cf20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c01cd60 tx=0x7f2f7c0a5c30 comp rx=0 tx=0).stop 2023-10-25T16:17:14.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 shutdown_connections 2023-10-25T16:17:14.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f6c066470 0x7f2f6c068930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f8c150060 0x7f2f8c146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f8c1f4e60 0x7f2f8c0af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 --2- 172.21.15.177:0/2553115702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f78003b10 0x7f2f8c14cf20 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:14.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 >> 172.21.15.177:0/2553115702 conn(0x7f2f8c0b2450 msgr2=0x7f2f8c1548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:14.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 shutdown_connections 2023-10-25T16:17:14.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:14.961+0000 7f2f90c69640 1 -- 172.21.15.177:0/2553115702 wait complete. 2023-10-25T16:17:14.982 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:17:14.983 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:17:15.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 -- 172.21.15.177:0/1528899466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 msgr2=0x7f25e00cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:15.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 --2- 172.21.15.177:0/1528899466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 0x7f25e00cd9f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009900 tx=0x7f25d401c8c0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 -- 172.21.15.177:0/1528899466 shutdown_connections 2023-10-25T16:17:15.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 --2- 172.21.15.177:0/1528899466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 0x7f25e00cd9f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 --2- 172.21.15.177:0/1528899466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 0x7f25e0069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 -- 172.21.15.177:0/1528899466 >> 172.21.15.177:0/1528899466 conn(0x7f25e0066150 msgr2=0x7f25e0069720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:15.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 -- 172.21.15.177:0/1528899466 shutdown_connections 2023-10-25T16:17:15.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 -- 172.21.15.177:0/1528899466 wait complete. 2023-10-25T16:17:15.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 Processor -- start 2023-10-25T16:17:15.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.093+0000 7f25e4a85640 1 -- start start 2023-10-25T16:17:15.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 0x7f25e01461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:15.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 0x7f25e0149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:15.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 0x7f25e0143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:15.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e014c790 con 0x7f25e006bd10 2023-10-25T16:17:15.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0149750 con 0x7f25e00cd590 2023-10-25T16:17:15.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e014c2d0 con 0x7f25e01590e0 2023-10-25T16:17:15.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 0x7f25e01461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:15.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 0x7f25e01461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48610/0 (socket says 172.21.15.177:48610) 2023-10-25T16:17:15.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 -- 172.21.15.177:0/117448101 learned_addr learned my addr 172.21.15.177:0/117448101 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:15.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ded9d640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 0x7f25e0143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:15.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 -- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 msgr2=0x7f25e0143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:15.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 0x7f25e0143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 -- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 msgr2=0x7f25e0149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:15.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 0x7f25e0149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 -- 172.21.15.177:0/117448101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4009560 con 0x7f25e006bd10 2023-10-25T16:17:15.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ded9d640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 0x7f25e0143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:15.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25de59c640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 0x7f25e01461e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f25d800ebc0 tx=0x7f25d800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:15.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8010630 con 0x7f25e006bd10 2023-10-25T16:17:15.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f25d8010880 con 0x7f25e006bd10 2023-10-25T16:17:15.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e014c9e0 con 0x7f25e006bd10 2023-10-25T16:17:15.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8010c70 con 0x7f25e006bd10 2023-10-25T16:17:15.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e014cfa0 con 0x7f25e006bd10 2023-10-25T16:17:15.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e0073360 con 0x7f25e006bd10 2023-10-25T16:17:15.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25d8018420 con 0x7f25e006bd10 2023-10-25T16:17:15.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ceffd640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f25c0066470 0x7f25c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:15.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25d8014070 con 0x7f25e006bd10 2023-10-25T16:17:15.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.097+0000 7f25ddd9b640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f25c0066470 0x7f25c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:15.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.101+0000 7f25ddd9b640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f25c0066470 0x7f25c0068930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f25d40af000 tx=0x7f25d4019660 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:15.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.101+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25d8050090 con 0x7f25e006bd10 2023-10-25T16:17:15.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.257+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f25e015c9f0 con 0x7f25e006bd10 2023-10-25T16:17:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.861+0000 7f25ceffd640 1 -- 172.21.15.177:0/117448101 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) v1 ==== 138+0+0 (secure 0 0 0) 0x7f25d8052130 con 0x7f25e006bd10 2023-10-25T16:17:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:17:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.865+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f25c0066470 msgr2=0x7f25c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.865+0000 7f25e4a85640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f25c0066470 0x7f25c0068930 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f25d40af000 tx=0x7f25d4019660 comp rx=0 tx=0).stop 2023-10-25T16:17:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.865+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 msgr2=0x7f25e01461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.865+0000 7f25e4a85640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 0x7f25e01461e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f25d800ebc0 tx=0x7f25d800c6a0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 shutdown_connections 2023-10-25T16:17:15.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f25c0066470 0x7f25c0068930 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25e01590e0 0x7f25e0143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25e00cd590 0x7f25e0149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 --2- 172.21.15.177:0/117448101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f25e006bd10 0x7f25e01461e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:15.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 >> 172.21.15.177:0/117448101 conn(0x7f25e0066150 msgr2=0x7f25e00cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:15.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 shutdown_connections 2023-10-25T16:17:15.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:15.869+0000 7f25e4a85640 1 -- 172.21.15.177:0/117448101 wait complete. 2023-10-25T16:17:15.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:17:16.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 -- 172.21.15.177:0/2689884066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb200cc6f0 msgr2=0x7feb2006cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:16.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 --2- 172.21.15.177:0/2689884066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb200cc6f0 0x7feb2006cc00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7feb2006fab0 tx=0x7feb1001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 -- 172.21.15.177:0/2689884066 shutdown_connections 2023-10-25T16:17:16.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 --2- 172.21.15.177:0/2689884066 >> v2:172.21.15.184:3300/0 conn(0x7feb2006bd10 0x7feb200ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 --2- 172.21.15.177:0/2689884066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb200cc6f0 0x7feb2006cc00 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 -- 172.21.15.177:0/2689884066 >> 172.21.15.177:0/2689884066 conn(0x7feb20066150 msgr2=0x7feb20069720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:16.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 -- 172.21.15.177:0/2689884066 shutdown_connections 2023-10-25T16:17:16.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.025+0000 7feb26cf2640 1 -- 172.21.15.177:0/2689884066 wait complete. 2023-10-25T16:17:16.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 Processor -- start 2023-10-25T16:17:16.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- start start 2023-10-25T16:17:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb2006bd10 0x7feb20157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb200cc6f0 0x7feb201486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 0x7feb20161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2015a190 con 0x7feb20157f00 2023-10-25T16:17:16.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20159580 con 0x7feb2006bd10 2023-10-25T16:17:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb20159860 con 0x7feb200cc6f0 2023-10-25T16:17:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 0x7feb20161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 0x7feb20161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48636/0 (socket says 172.21.15.177:48636) 2023-10-25T16:17:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 -- 172.21.15.177:0/3819818312 learned_addr learned my addr 172.21.15.177:0/3819818312 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:16.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb24a8e640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb2006bd10 0x7feb20157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb1ffff640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb200cc6f0 0x7feb201486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 -- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb200cc6f0 msgr2=0x7feb201486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb200cc6f0 0x7feb201486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 -- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb2006bd10 msgr2=0x7feb20157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb2006bd10 0x7feb20157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 -- 172.21.15.177:0/3819818312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100094a0 con 0x7feb20157f00 2023-10-25T16:17:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb24a8e640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb2006bd10 0x7feb20157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb2528f640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 0x7feb20161150 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7feb1800e960 tx=0x7feb1800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18004d30 con 0x7feb20157f00 2023-10-25T16:17:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb1800cb20 con 0x7feb20157f00 2023-10-25T16:17:16.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb20159b40 con 0x7feb20157f00 2023-10-25T16:17:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18005020 con 0x7feb20157f00 2023-10-25T16:17:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb20148be0 con 0x7feb20157f00 2023-10-25T16:17:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.029+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2015a300 con 0x7feb20157f00 2023-10-25T16:17:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.033+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feb18005180 con 0x7feb20157f00 2023-10-25T16:17:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.033+0000 7feb1d7fa640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb0c066470 0x7feb0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:16.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.033+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5227+0+0 (secure 0 0 0) 0x7feb18084600 con 0x7feb20157f00 2023-10-25T16:17:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.033+0000 7feb24a8e640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb0c066470 0x7feb0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.033+0000 7feb24a8e640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb0c066470 0x7feb0c068930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb140011f0 tx=0x7feb14009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.037+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb18051c60 con 0x7feb20157f00 2023-10-25T16:17:16.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.185+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb2004db20 con 0x7feb20157f00 2023-10-25T16:17:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.873+0000 7feb1d7fa640 1 -- 172.21.15.177:0/3819818312 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) v1 ==== 170+0+0 (secure 0 0 0) 0x7feb1801f020 con 0x7feb20157f00 2023-10-25T16:17:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:17:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb0c066470 msgr2=0x7feb0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb0c066470 0x7feb0c068930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb140011f0 tx=0x7feb14009040 comp rx=0 tx=0).stop 2023-10-25T16:17:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 msgr2=0x7feb20161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 0x7feb20161150 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7feb1800e960 tx=0x7feb1800ee20 comp rx=0 tx=0).stop 2023-10-25T16:17:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 shutdown_connections 2023-10-25T16:17:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb0c066470 0x7feb0c068930 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb20157f00 0x7feb20161150 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb200cc6f0 0x7feb201486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 --2- 172.21.15.177:0/3819818312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb2006bd10 0x7feb20157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 >> 172.21.15.177:0/3819818312 conn(0x7feb20066150 msgr2=0x7feb2014cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 shutdown_connections 2023-10-25T16:17:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:16.877+0000 7feb26cf2640 1 -- 172.21.15.177:0/3819818312 wait complete. 2023-10-25T16:17:16.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:17:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- 172.21.15.177:0/562727852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c006b980 msgr2=0x7ff7c006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 --2- 172.21.15.177:0/562727852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c006b980 0x7ff7c006be10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff7c006c6a0 tx=0x7ff7b001c830 comp rx=0 tx=0).stop 2023-10-25T16:17:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- 172.21.15.177:0/562727852 shutdown_connections 2023-10-25T16:17:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 --2- 172.21.15.177:0/562727852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c006b980 0x7ff7c006be10 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 --2- 172.21.15.177:0/562727852 >> v2:172.21.15.184:3300/0 conn(0x7ff7c0071500 0x7ff7c0070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- 172.21.15.177:0/562727852 >> 172.21.15.177:0/562727852 conn(0x7ff7c00b2450 msgr2=0x7ff7c00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- 172.21.15.177:0/562727852 shutdown_connections 2023-10-25T16:17:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- 172.21.15.177:0/562727852 wait complete. 2023-10-25T16:17:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 Processor -- start 2023-10-25T16:17:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- start start 2023-10-25T16:17:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c006b980 0x7ff7c0147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c0071500 0x7ff7c0153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 0x7ff7c00abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0147ba0 con 0x7ff7c0159230 2023-10-25T16:17:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01524d0 con 0x7ff7c006b980 2023-10-25T16:17:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7c6097640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01527b0 con 0x7ff7c0071500 2023-10-25T16:17:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 0x7ff7c00abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 0x7ff7c00abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48662/0 (socket says 172.21.15.177:48662) 2023-10-25T16:17:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7bffff640 1 -- 172.21.15.177:0/3137662240 learned_addr learned my addr 172.21.15.177:0/3137662240 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.033+0000 7ff7bf7fe640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c006b980 0x7ff7c0147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7beffd640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c0071500 0x7ff7c0153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bffff640 1 -- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c0071500 msgr2=0x7ff7c0153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bffff640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c0071500 0x7ff7c0153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bffff640 1 -- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c006b980 msgr2=0x7ff7c0147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bffff640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c006b980 0x7ff7c0147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bffff640 1 -- 172.21.15.177:0/3137662240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0009560 con 0x7ff7c0159230 2023-10-25T16:17:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7beffd640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c0071500 0x7ff7c0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bffff640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 0x7ff7c00abc00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009850 tx=0x7ff7b00a5850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00042c0 con 0x7ff7c0159230 2023-10-25T16:17:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff7b0004510 con 0x7ff7c0159230 2023-10-25T16:17:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c0152a90 con 0x7ff7c0159230 2023-10-25T16:17:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003860 con 0x7ff7c0159230 2023-10-25T16:17:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c0153050 con 0x7ff7c0159230 2023-10-25T16:17:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c0153240 con 0x7ff7c0159230 2023-10-25T16:17:17.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff7b00b4070 con 0x7ff7c0159230 2023-10-25T16:17:17.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7b7fff640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7a4066470 0x7ff7a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:17.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff7b011ed20 con 0x7ff7c0159230 2023-10-25T16:17:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bf7fe640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7a4066470 0x7ff7a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.037+0000 7ff7bf7fe640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7a4066470 0x7ff7a4068930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0151de0 tx=0x7ff7b80094d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:17.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.041+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7b00ec270 con 0x7ff7c0159230 2023-10-25T16:17:17.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.249+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff7c015a110 con 0x7ff7c0159230 2023-10-25T16:17:17.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.877+0000 7ff7b7fff640 1 -- 172.21.15.177:0/3137662240 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff7b00ef890 con 0x7ff7c0159230 2023-10-25T16:17:17.881 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 10 and data pool 11 2023-10-25T16:17:17.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7a4066470 msgr2=0x7ff7a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:17.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7a4066470 0x7ff7a4068930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0151de0 tx=0x7ff7b80094d0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 msgr2=0x7ff7c00abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 0x7ff7c00abc00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009850 tx=0x7ff7b00a5850 comp rx=0 tx=0).stop 2023-10-25T16:17:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 shutdown_connections 2023-10-25T16:17:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7a4066470 0x7ff7a4068930 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c0159230 0x7ff7c00abc00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c0071500 0x7ff7c0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 --2- 172.21.15.177:0/3137662240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7c006b980 0x7ff7c0147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 >> 172.21.15.177:0/3137662240 conn(0x7ff7c00b2450 msgr2=0x7ff7c00cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 shutdown_connections 2023-10-25T16:17:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:17.881+0000 7ff7c6097640 1 -- 172.21.15.177:0/3137662240 wait complete. 2023-10-25T16:17:17.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:18.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- 172.21.15.177:0/1479722916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 msgr2=0x7fc2f40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 --2- 172.21.15.177:0/1479722916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc2f40047d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00bb20 tx=0x7fc2fc01cd30 comp rx=0 tx=0).stop 2023-10-25T16:17:18.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc310e76640 1 -- 172.21.15.177:0/1479722916 reap_dead start 2023-10-25T16:17:18.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- 172.21.15.177:0/1479722916 shutdown_connections 2023-10-25T16:17:18.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- 172.21.15.177:0/1479722916 >> 172.21.15.177:0/1479722916 conn(0x7fc30c0b2450 msgr2=0x7fc30c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:18.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- 172.21.15.177:0/1479722916 shutdown_connections 2023-10-25T16:17:18.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- 172.21.15.177:0/1479722916 wait complete. 2023-10-25T16:17:18.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 Processor -- start 2023-10-25T16:17:18.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- start start 2023-10-25T16:17:18.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc30c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30c0ad640 0x7fc30c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30c0aa8b0 0x7fc30c0aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0ab270 con 0x7fc2f4003fc0 2023-10-25T16:17:18.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c159730 con 0x7fc30c0aa8b0 2023-10-25T16:17:18.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc3128d9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c159a10 con 0x7fc30c0ad640 2023-10-25T16:17:18.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc30bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc30c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc30bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc30c159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48684/0 (socket says 172.21.15.177:48684) 2023-10-25T16:17:18.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.033+0000 7fc30bfff640 1 -- 172.21.15.177:0/268606349 learned_addr learned my addr 172.21.15.177:0/268606349 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:18.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc310e76640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30c0aa8b0 0x7fc30c0aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30bfff640 1 -- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30c0ad640 msgr2=0x7fc30c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30bfff640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30c0ad640 0x7fc30c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30bfff640 1 -- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30c0aa8b0 msgr2=0x7fc30c0aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30bfff640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30c0aa8b0 0x7fc30c0aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30bfff640 1 -- 172.21.15.177:0/268606349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c159cf0 con 0x7fc2f4003fc0 2023-10-25T16:17:18.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc310e76640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30c0aa8b0 0x7fc30c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:18.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30bfff640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc30c159050 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc30000e650 tx=0x7fc30000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300004460 con 0x7fc2f4003fc0 2023-10-25T16:17:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc30000c840 con 0x7fc2f4003fc0 2023-10-25T16:17:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000cc50 con 0x7fc2f4003fc0 2023-10-25T16:17:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c159fd0 con 0x7fc2f4003fc0 2023-10-25T16:17:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c15a340 con 0x7fc2f4003fc0 2023-10-25T16:17:18.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c04daf0 con 0x7fc2f4003fc0 2023-10-25T16:17:18.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc300003600 con 0x7fc2f4003fc0 2023-10-25T16:17:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc308ff9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2f80664a0 0x7fc2f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3000845f0 con 0x7fc2f4003fc0 2023-10-25T16:17:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30b7fe640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2f80664a0 0x7fc2f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.037+0000 7fc30b7fe640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2f80664a0 0x7fc2f8068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0b0000 tx=0x7fc2f4005800 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:18.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.041+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc300051a70 con 0x7fc2f4003fc0 2023-10-25T16:17:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.197+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc30c148c90 con 0x7fc2f4003fc0 2023-10-25T16:17:18.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.197+0000 7fc308ff9640 1 -- 172.21.15.177:0/268606349 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16605 (secure 0 0 0) 0x7fc30000cdb0 con 0x7fc2f4003fc0 2023-10-25T16:17:18.204 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:18.204 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":86,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:17.255325+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2f80664a0 msgr2=0x7fc2f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2f80664a0 0x7fc2f8068960 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0b0000 tx=0x7fc2f4005800 comp rx=0 tx=0).stop 2023-10-25T16:17:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 msgr2=0x7fc30c159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc30c159050 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc30000e650 tx=0x7fc30000eb10 comp rx=0 tx=0).stop 2023-10-25T16:17:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 shutdown_connections 2023-10-25T16:17:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2f80664a0 0x7fc2f8068960 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc30c0aa8b0 0x7fc30c0aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc30c0ad640 0x7fc30c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 --2- 172.21.15.177:0/268606349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2f4003fc0 0x7fc30c159050 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 >> 172.21.15.177:0/268606349 conn(0x7fc30c0b2450 msgr2=0x7fc30c1567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:18.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 shutdown_connections 2023-10-25T16:17:18.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.201+0000 7fc3128d9640 1 -- 172.21.15.177:0/268606349 wait complete. 2023-10-25T16:17:18.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:18.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.337+0000 7f8415bab640 1 -- 172.21.15.177:0/164333177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100b2120 msgr2=0x7f84100b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.337+0000 7f8415bab640 1 --2- 172.21.15.177:0/164333177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100b2120 0x7f84100b4100 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8404009840 tx=0x7f840401c730 comp rx=0 tx=0).stop 2023-10-25T16:17:18.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/164333177 shutdown_connections 2023-10-25T16:17:18.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 --2- 172.21.15.177:0/164333177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100b2120 0x7f84100b4100 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/164333177 >> 172.21.15.177:0/164333177 conn(0x7f841009a5c0 msgr2=0x7f84100d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:18.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/164333177 shutdown_connections 2023-10-25T16:17:18.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/164333177 wait complete. 2023-10-25T16:17:18.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 Processor -- start 2023-10-25T16:17:18.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- start start 2023-10-25T16:17:18.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100b2120 0x7f841014e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84100cdb10 0x7f841014bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 0x7f8410153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410150910 con 0x7f841015eba0 2023-10-25T16:17:18.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410152660 con 0x7f84100b2120 2023-10-25T16:17:18.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8410150250 con 0x7f84100cdb10 2023-10-25T16:17:18.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 0x7f8410153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 0x7f8410153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48700/0 (socket says 172.21.15.177:48700) 2023-10-25T16:17:18.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 -- 172.21.15.177:0/3480612491 learned_addr learned my addr 172.21.15.177:0/3480612491 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:18.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 -- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84100cdb10 msgr2=0x7f841014bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84100cdb10 0x7f841014bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 -- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100b2120 msgr2=0x7f841014e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100b2120 0x7f841014e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 -- 172.21.15.177:0/3480612491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040094a0 con 0x7f841015eba0 2023-10-25T16:17:18.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f840ffff640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 0x7f8410153a00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f840800cb40 tx=0x7f840800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:18.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840800aa50 con 0x7f841015eba0 2023-10-25T16:17:18.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f840800aca0 con 0x7f841015eba0 2023-10-25T16:17:18.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410150530 con 0x7f841015eba0 2023-10-25T16:17:18.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408012680 con 0x7f841015eba0 2023-10-25T16:17:18.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8410152bf0 con 0x7f841015eba0 2023-10-25T16:17:18.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.341+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841004daf0 con 0x7f841015eba0 2023-10-25T16:17:18.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.345+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f840801a3b0 con 0x7f841015eba0 2023-10-25T16:17:18.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.345+0000 7f83f7fff640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f83fc066470 0x7f83fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.345+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84080841a0 con 0x7f841015eba0 2023-10-25T16:17:18.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.345+0000 7f840f7fe640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f83fc066470 0x7f83fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.345+0000 7f840f7fe640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f83fc066470 0x7f83fc068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f84100d1060 tx=0x7f8400006bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:18.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.349+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84080516b0 con 0x7f841015eba0 2023-10-25T16:17:18.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.505+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8410150a50 con 0x7f841015eba0 2023-10-25T16:17:18.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f83f7fff640 1 -- 172.21.15.177:0/3480612491 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f8410150a50 con 0x7f841015eba0 2023-10-25T16:17:18.513 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:18.513 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":86,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:17.255325+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:18.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f83fc066470 msgr2=0x7f83fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f83fc066470 0x7f83fc068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f84100d1060 tx=0x7f8400006bd0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 msgr2=0x7f8410153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 0x7f8410153a00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f840800cb40 tx=0x7f840800cc30 comp rx=0 tx=0).stop 2023-10-25T16:17:18.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 shutdown_connections 2023-10-25T16:17:18.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f83fc066470 0x7f83fc068930 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f841015eba0 0x7f8410153a00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84100cdb10 0x7f841014bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 --2- 172.21.15.177:0/3480612491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100b2120 0x7f841014e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 >> 172.21.15.177:0/3480612491 conn(0x7f841009a5c0 msgr2=0x7f841006b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:18.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 shutdown_connections 2023-10-25T16:17:18.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.509+0000 7f8415bab640 1 -- 172.21.15.177:0/3480612491 wait complete. 2023-10-25T16:17:18.532 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:17:18.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- 172.21.15.177:0/2243018771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60dc004d10 msgr2=0x7f60dc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/2243018771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60dc004d10 0x7f60dc005190 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009f10 tx=0x7f60e801d5f0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60eed9d640 1 -- 172.21.15.177:0/2243018771 reap_dead start 2023-10-25T16:17:18.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- 172.21.15.177:0/2243018771 shutdown_connections 2023-10-25T16:17:18.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- 172.21.15.177:0/2243018771 >> 172.21.15.177:0/2243018771 conn(0x7f60f00b2450 msgr2=0x7f60f00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:18.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- 172.21.15.177:0/2243018771 shutdown_connections 2023-10-25T16:17:18.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- 172.21.15.177:0/2243018771 wait complete. 2023-10-25T16:17:18.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 Processor -- start 2023-10-25T16:17:18.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- start start 2023-10-25T16:17:18.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 0x7f60f014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f00ae200 0x7f60f0150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f0151010 0x7f60f0151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f014d780 con 0x7f60f01506f0 2023-10-25T16:17:18.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f014da60 con 0x7f60f00ae200 2023-10-25T16:17:18.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60f4bd0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f014dd40 con 0x7f60f0151010 2023-10-25T16:17:18.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 0x7f60f014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 0x7f60f014cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48708/0 (socket says 172.21.15.177:48708) 2023-10-25T16:17:18.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 -- 172.21.15.177:0/4046173780 learned_addr learned my addr 172.21.15.177:0/4046173780 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:18.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60e7fff640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f00ae200 0x7f60f0150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60eed9d640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f0151010 0x7f60f0151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 -- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f0151010 msgr2=0x7f60f0151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f0151010 0x7f60f0151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 -- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f00ae200 msgr2=0x7f60f0150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f00ae200 0x7f60f0150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 -- 172.21.15.177:0/4046173780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f014e020 con 0x7f60f01506f0 2023-10-25T16:17:18.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60e7fff640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f00ae200 0x7f60f0150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:18.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.653+0000 7f60ee59c640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 0x7f60f014cea0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f60e0010a10 tx=0x7f60e0010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:18.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000ece0 con 0x7f60f01506f0 2023-10-25T16:17:18.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f60e000ee40 con 0x7f60f01506f0 2023-10-25T16:17:18.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f014e300 con 0x7f60f01506f0 2023-10-25T16:17:18.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0005280 con 0x7f60f01506f0 2023-10-25T16:17:18.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f00ac980 con 0x7f60f01506f0 2023-10-25T16:17:18.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f004daf0 con 0x7f60f01506f0 2023-10-25T16:17:18.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60e00053e0 con 0x7f60f01506f0 2023-10-25T16:17:18.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e6ffd640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60d00664a0 0x7f60d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:18.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60e0016070 con 0x7f60f01506f0 2023-10-25T16:17:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e7fff640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60d00664a0 0x7f60d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.657+0000 7f60e7fff640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60d00664a0 0x7f60d0068960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f60d80018e0 tx=0x7f60d8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:18.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.661+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60e0052060 con 0x7f60f01506f0 2023-10-25T16:17:18.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.853+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f60f015c7f0 con 0x7f60f01506f0 2023-10-25T16:17:18.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.889+0000 7f60e6ffd640 1 -- 172.21.15.177:0/4046173780 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f60e0055680 con 0x7f60f01506f0 2023-10-25T16:17:18.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60d00664a0 msgr2=0x7f60d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60d00664a0 0x7f60d0068960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f60d80018e0 tx=0x7f60d8009040 comp rx=0 tx=0).stop 2023-10-25T16:17:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 msgr2=0x7f60f014cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 0x7f60f014cea0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f60e0010a10 tx=0x7f60e0010ed0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 shutdown_connections 2023-10-25T16:17:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f60d00664a0 0x7f60d0068960 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60f0151010 0x7f60f0151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60f00ae200 0x7f60f0150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 --2- 172.21.15.177:0/4046173780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60f01506f0 0x7f60f014cea0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 >> 172.21.15.177:0/4046173780 conn(0x7f60f00b2450 msgr2=0x7f60f015bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 shutdown_connections 2023-10-25T16:17:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:18.893+0000 7f60f4bd0640 1 -- 172.21.15.177:0/4046173780 wait complete. 2023-10-25T16:17:18.916 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:17:18.917 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:17:19.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/2710137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006c160 msgr2=0x7efec00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:19.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 --2- 172.21.15.177:0/2710137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006c160 0x7efec00cb5c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009c80 tx=0x7efeb801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/2710137033 shutdown_connections 2023-10-25T16:17:19.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 --2- 172.21.15.177:0/2710137033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006c160 0x7efec00cb5c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 --2- 172.21.15.177:0/2710137033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec0140cf0 0x7efec00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/2710137033 >> 172.21.15.177:0/2710137033 conn(0x7efec00b2450 msgr2=0x7efec00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:19.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/2710137033 shutdown_connections 2023-10-25T16:17:19.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/2710137033 wait complete. 2023-10-25T16:17:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 Processor -- start 2023-10-25T16:17:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- start start 2023-10-25T16:17:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec006c160 0x7efec01628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 0x7efec01f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec0140cf0 0x7efec0138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec0158060 con 0x7efec006f570 2023-10-25T16:17:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec0162e00 con 0x7efec006c160 2023-10-25T16:17:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec01f33a0 con 0x7efec0140cf0 2023-10-25T16:17:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 0x7efec01f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 0x7efec01f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48720/0 (socket says 172.21.15.177:48720) 2023-10-25T16:17:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 -- 172.21.15.177:0/3701014440 learned_addr learned my addr 172.21.15.177:0/3701014440 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec4c0a640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec006c160 0x7efec01628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec540b640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec0140cf0 0x7efec0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 -- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec0140cf0 msgr2=0x7efec0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec0140cf0 0x7efec0138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 -- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec006c160 msgr2=0x7efec01628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec006c160 0x7efec01628c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 -- 172.21.15.177:0/3701014440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80098e0 con 0x7efec006f570 2023-10-25T16:17:19.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec4c0a640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec006c160 0x7efec01628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:19.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb7fff640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 0x7efec01f2e60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efeb0001ec0 tx=0x7efeb000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:19.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00054e0 con 0x7efec006f570 2023-10-25T16:17:19.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efeb0003600 con 0x7efec006f570 2023-10-25T16:17:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec01571b0 con 0x7efec006f570 2023-10-25T16:17:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0003a50 con 0x7efec006f570 2023-10-25T16:17:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.045+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec0157730 con 0x7efec006f570 2023-10-25T16:17:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.049+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec01581d0 con 0x7efec006f570 2023-10-25T16:17:19.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.049+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efeb0003bb0 con 0x7efec006f570 2023-10-25T16:17:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.049+0000 7efeb57fa640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efeac066470 0x7efeac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.049+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efeb00834f0 con 0x7efec006f570 2023-10-25T16:17:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.049+0000 7efec4c0a640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efeac066470 0x7efeac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:19.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.049+0000 7efec4c0a640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efeac066470 0x7efeac068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efebc0058d0 tx=0x7efebc005cc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:19.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.053+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efeb0054430 con 0x7efec006f570 2023-10-25T16:17:19.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.245+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efec004daf0 con 0x7efec006f570 2023-10-25T16:17:19.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efeb57fa640 1 -- 172.21.15.177:0/3701014440 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7efeb0003e60 con 0x7efec006f570 2023-10-25T16:17:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efeac066470 msgr2=0x7efeac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efeac066470 0x7efeac068930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efebc0058d0 tx=0x7efebc005cc0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 msgr2=0x7efec01f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 0x7efec01f2e60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7efeb0001ec0 tx=0x7efeb000c8e0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 shutdown_connections 2023-10-25T16:17:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efeac066470 0x7efeac068930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efec0140cf0 0x7efec0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efec006f570 0x7efec01f2e60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 --2- 172.21.15.177:0/3701014440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efec006c160 0x7efec01628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:19.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 >> 172.21.15.177:0/3701014440 conn(0x7efec00b2450 msgr2=0x7efec0070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:19.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 shutdown_connections 2023-10-25T16:17:19.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:19.921+0000 7efec6e6e640 1 -- 172.21.15.177:0/3701014440 wait complete. 2023-10-25T16:17:19.947 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:17:19.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:20.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3745553743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c140cf0 msgr2=0x7f977c0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 --2- 172.21.15.177:0/3745553743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c140cf0 0x7f977c0af5d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f976c009900 tx=0x7f976c01c830 comp rx=0 tx=0).stop 2023-10-25T16:17:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3745553743 shutdown_connections 2023-10-25T16:17:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 --2- 172.21.15.177:0/3745553743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c06c160 0x7f977c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 --2- 172.21.15.177:0/3745553743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c140cf0 0x7f977c0af5d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3745553743 >> 172.21.15.177:0/3745553743 conn(0x7f977c0b2450 msgr2=0x7f977c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3745553743 shutdown_connections 2023-10-25T16:17:20.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3745553743 wait complete. 2023-10-25T16:17:20.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 Processor -- start 2023-10-25T16:17:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- start start 2023-10-25T16:17:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 0x7f977c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c06f570 0x7f977c06f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c140cf0 0x7f977c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c157eb0 con 0x7f977c06c160 2023-10-25T16:17:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c137e90 con 0x7f977c06f570 2023-10-25T16:17:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c140200 con 0x7f977c140cf0 2023-10-25T16:17:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 0x7f977c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 0x7f977c1598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48726/0 (socket says 172.21.15.177:48726) 2023-10-25T16:17:20.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 -- 172.21.15.177:0/3197797348 learned_addr learned my addr 172.21.15.177:0/3197797348 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:20.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977b7fe640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c140cf0 0x7f977c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977a7fc640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c06f570 0x7f977c06f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 -- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c140cf0 msgr2=0x7f977c06ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c140cf0 0x7f977c06ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 -- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c06f570 msgr2=0x7f977c06f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c06f570 0x7f977c06f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 -- 172.21.15.177:0/3197797348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009820 con 0x7f977c06c160 2023-10-25T16:17:20.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977b7fe640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c140cf0 0x7f977c06ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:17:20.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f977affd640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 0x7f977c1598b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f976c009850 tx=0x7f976c0a6580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:20.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c004240 con 0x7f977c06c160 2023-10-25T16:17:20.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f976c0043a0 con 0x7f977c06c160 2023-10-25T16:17:20.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c009560 con 0x7f977c06c160 2023-10-25T16:17:20.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c004530 con 0x7f977c06c160 2023-10-25T16:17:20.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.073+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c135400 con 0x7f977c06c160 2023-10-25T16:17:20.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.077+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c04daf0 con 0x7f977c06c160 2023-10-25T16:17:20.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.077+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f976c005280 con 0x7f977c06c160 2023-10-25T16:17:20.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.077+0000 7f97637fe640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9768066470 0x7f9768068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.077+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f976c0aa070 con 0x7f977c06c160 2023-10-25T16:17:20.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.077+0000 7f977a7fc640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9768066470 0x7f9768068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.077+0000 7f977a7fc640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9768066470 0x7f9768068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f977c158220 tx=0x7f9770009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:20.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.081+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f976c0eb4c0 con 0x7f977c06c160 2023-10-25T16:17:20.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.265+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f977c1355f0 con 0x7f977c06c160 2023-10-25T16:17:20.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f97637fe640 1 -- 172.21.15.177:0/3197797348 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f976c0eeae0 con 0x7f977c06c160 2023-10-25T16:17:20.272 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:20.273 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:17:20.273 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:17:20.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9768066470 msgr2=0x7f9768068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9768066470 0x7f9768068930 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f977c158220 tx=0x7f9770009040 comp rx=0 tx=0).stop 2023-10-25T16:17:20.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 msgr2=0x7f977c1598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 0x7f977c1598b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f976c009850 tx=0x7f976c0a6580 comp rx=0 tx=0).stop 2023-10-25T16:17:20.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 shutdown_connections 2023-10-25T16:17:20.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9768066470 0x7f9768068930 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f977c140cf0 0x7f977c06ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c06f570 0x7f977c06f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 --2- 172.21.15.177:0/3197797348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f977c06c160 0x7f977c1598b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 >> 172.21.15.177:0/3197797348 conn(0x7f977c0b2450 msgr2=0x7f977c0709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:20.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 shutdown_connections 2023-10-25T16:17:20.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.269+0000 7f9781283640 1 -- 172.21.15.177:0/3197797348 wait complete. 2023-10-25T16:17:20.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:20.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- 172.21.15.177:0/3339953423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8500cdb10 msgr2=0x7fb8500cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 --2- 172.21.15.177:0/3339953423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8500cdb10 0x7fb8500cdfc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb848009c80 tx=0x7fb84801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- 172.21.15.177:0/3339953423 shutdown_connections 2023-10-25T16:17:20.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 --2- 172.21.15.177:0/3339953423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8500cdb10 0x7fb8500cdfc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 --2- 172.21.15.177:0/3339953423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500b2120 0x7fb8500b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- 172.21.15.177:0/3339953423 >> 172.21.15.177:0/3339953423 conn(0x7fb85009a5c0 msgr2=0x7fb8500d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:20.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- 172.21.15.177:0/3339953423 shutdown_connections 2023-10-25T16:17:20.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- 172.21.15.177:0/3339953423 wait complete. 2023-10-25T16:17:20.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 Processor -- start 2023-10-25T16:17:20.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- start start 2023-10-25T16:17:20.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 0x7fb85014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500cdb10 0x7fb850151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85015eba0 0x7fb85015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85014ede0 con 0x7fb8500b2120 2023-10-25T16:17:20.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850151b70 con 0x7fb85015eba0 2023-10-25T16:17:20.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb857e0b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015b1f0 con 0x7fb8500cdb10 2023-10-25T16:17:20.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 0x7fb85014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 0x7fb85014e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48732/0 (socket says 172.21.15.177:48732) 2023-10-25T16:17:20.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 -- 172.21.15.177:0/1554444431 learned_addr learned my addr 172.21.15.177:0/1554444431 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:20.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb8553a6640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500cdb10 0x7fb850151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb8563a8640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85015eba0 0x7fb85015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 -- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500cdb10 msgr2=0x7fb850151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500cdb10 0x7fb850151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 -- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85015eba0 msgr2=0x7fb85015a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85015eba0 0x7fb85015a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb855ba7640 1 -- 172.21.15.177:0/1554444431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480098e0 con 0x7fb8500b2120 2023-10-25T16:17:20.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb8563a8640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85015eba0 0x7fb85015a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:20.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.401+0000 7fb8553a6640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500cdb10 0x7fb850151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:20.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb855ba7640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 0x7fb85014e8a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c370 tx=0x7fb84c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:20.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0052d0 con 0x7fb8500b2120 2023-10-25T16:17:20.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb84c007020 con 0x7fb8500b2120 2023-10-25T16:17:20.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85015b4d0 con 0x7fb8500b2120 2023-10-25T16:17:20.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c007430 con 0x7fb8500b2120 2023-10-25T16:17:20.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb850151760 con 0x7fb8500b2120 2023-10-25T16:17:20.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85004daf0 con 0x7fb8500b2120 2023-10-25T16:17:20.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb84c0067e0 con 0x7fb8500b2120 2023-10-25T16:17:20.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8467fc640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb834066470 0x7fb834068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb84c083490 con 0x7fb8500b2120 2023-10-25T16:17:20.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8553a6640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb834066470 0x7fb834068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.405+0000 7fb8553a6640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb834066470 0x7fb834068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb85015bfa0 tx=0x7fb8400091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:20.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.409+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb84c050910 con 0x7fb8500b2120 2023-10-25T16:17:20.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.549+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8500ce930 con 0x7fb8500b2120 2023-10-25T16:17:20.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb8467fc640 1 -- 172.21.15.177:0/1554444431 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16592 (secure 0 0 0) 0x7fb84c053f30 con 0x7fb8500b2120 2023-10-25T16:17:20.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:20.557 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":87,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:18.626065+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:20.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb834066470 msgr2=0x7fb834068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb834066470 0x7fb834068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb85015bfa0 tx=0x7fb8400091e0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 msgr2=0x7fb85014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 0x7fb85014e8a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c370 tx=0x7fb84c00c830 comp rx=0 tx=0).stop 2023-10-25T16:17:20.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 shutdown_connections 2023-10-25T16:17:20.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb834066470 0x7fb834068930 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb85015eba0 0x7fb85015a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8500cdb10 0x7fb850151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 --2- 172.21.15.177:0/1554444431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8500b2120 0x7fb85014e8a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 >> 172.21.15.177:0/1554444431 conn(0x7fb85009a5c0 msgr2=0x7fb8500cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:20.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 shutdown_connections 2023-10-25T16:17:20.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.553+0000 7fb857e0b640 1 -- 172.21.15.177:0/1554444431 wait complete. 2023-10-25T16:17:20.575 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:17:20.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:17:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/3679516589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 msgr2=0x7f0268003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 --2- 172.21.15.177:0/3679516589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f0268003dd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f0278006fb0 tx=0x7f027801cf90 comp rx=0 tx=0).stop 2023-10-25T16:17:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02820a3640 1 -- 172.21.15.177:0/3679516589 reap_dead start 2023-10-25T16:17:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/3679516589 shutdown_connections 2023-10-25T16:17:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/3679516589 >> 172.21.15.177:0/3679516589 conn(0x7f027c0afe20 msgr2=0x7f027c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/3679516589 shutdown_connections 2023-10-25T16:17:20.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/3679516589 wait complete. 2023-10-25T16:17:20.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 Processor -- start 2023-10-25T16:17:20.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- start start 2023-10-25T16:17:20.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f027c15f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c15cd70 0x7f027c14d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c152e70 0x7f027c164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c15ea50 con 0x7f02680039b0 2023-10-25T16:17:20.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c15d550 con 0x7f027c15cd70 2023-10-25T16:17:20.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c14d810 con 0x7f027c152e70 2023-10-25T16:17:20.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f027c15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f027c15f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34532/0 (socket says 172.21.15.177:34532) 2023-10-25T16:17:20.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 -- 172.21.15.177:0/1521432206 learned_addr learned my addr 172.21.15.177:0/1521432206 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:20.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02810a1640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c15cd70 0x7f027c14d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02820a3640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c152e70 0x7f027c164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 -- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c152e70 msgr2=0x7f027c164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c152e70 0x7f027c164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 -- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c15cd70 msgr2=0x7f027c14d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c15cd70 0x7f027c14d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 -- 172.21.15.177:0/1521432206 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c15d270 con 0x7f02680039b0 2023-10-25T16:17:20.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02818a2640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f027c15f760 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f027801cdc0 tx=0x7f0278001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:20.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780b3070 con 0x7f02680039b0 2023-10-25T16:17:20.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0278001500 con 0x7f02680039b0 2023-10-25T16:17:20.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c15ec80 con 0x7f02680039b0 2023-10-25T16:17:20.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278003860 con 0x7f02680039b0 2023-10-25T16:17:20.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.685+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c15f240 con 0x7f02680039b0 2023-10-25T16:17:20.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.689+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c04daf0 con 0x7f02680039b0 2023-10-25T16:17:20.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.689+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02780ab020 con 0x7f02680039b0 2023-10-25T16:17:20.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.689+0000 7f02727fc640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02600664a0 0x7f0260068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:20.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.689+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f027811d970 con 0x7f02680039b0 2023-10-25T16:17:20.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.689+0000 7f02810a1640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02600664a0 0x7f0260068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:20.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.689+0000 7f02810a1640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02600664a0 0x7f0260068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f027c152000 tx=0x7f026c00f470 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:20.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.693+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02780eadf0 con 0x7f02680039b0 2023-10-25T16:17:20.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.829+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f027c070ba0 con 0x7f02600664a0 2023-10-25T16:17:20.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.853+0000 7f02727fc640 1 -- 172.21.15.177:0/1521432206 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282406 (secure 0 0 0) 0x7f027c070ba0 con 0x7f02600664a0 2023-10-25T16:17:20.859 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:20.861 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:17:20.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02600664a0 msgr2=0x7f0260068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02600664a0 0x7f0260068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f027c152000 tx=0x7f026c00f470 comp rx=0 tx=0).stop 2023-10-25T16:17:20.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 msgr2=0x7f027c15f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:20.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f027c15f760 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f027801cdc0 tx=0x7f0278001d00 comp rx=0 tx=0).stop 2023-10-25T16:17:20.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 shutdown_connections 2023-10-25T16:17:20.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f02600664a0 0x7f0260068960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f027c152e70 0x7f027c164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f027c15cd70 0x7f027c14d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 --2- 172.21.15.177:0/1521432206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02680039b0 0x7f027c15f760 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:20.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 >> 172.21.15.177:0/1521432206 conn(0x7f027c0afe20 msgr2=0x7f027c158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:20.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 shutdown_connections 2023-10-25T16:17:20.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:20.857+0000 7f0283b06640 1 -- 172.21.15.177:0/1521432206 wait complete. 2023-10-25T16:17:20.876 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-10-25T16:17:20.691748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4753,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557746,"statfs":{"total":1600000000,"available":1595132910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821332"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632846+0000","last_change":"2023-10-25T16:17:17.664185+0000","last_active":"2023-10-25T16:17:18.632846+0000","last_peered":"2023-10-25T16:17:18.632846+0000","last_clean":"2023-10-25T16:17:18.632846+0000","last_became_active":"2023-10-25T16:17:17.662766+0000","last_became_peered":"2023-10-25T16:17:17.662766+0000","last_unstale":"2023-10-25T16:17:18.632846+0000","last_undegraded":"2023-10-25T16:17:18.632846+0000","last_fullsized":"2023-10-25T16:17:18.632846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:24.048212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711163+0000","last_change":"2023-10-25T16:17:17.657987+0000","last_active":"2023-10-25T16:17:18.711163+0000","last_peered":"2023-10-25T16:17:18.711163+0000","last_clean":"2023-10-25T16:17:18.711163+0000","last_became_active":"2023-10-25T16:17:17.657323+0000","last_became_peered":"2023-10-25T16:17:17.657323+0000","last_unstale":"2023-10-25T16:17:18.711163+0000","last_undegraded":"2023-10-25T16:17:18.711163+0000","last_fullsized":"2023-10-25T16:17:18.711163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:54.047062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221594+0000","last_change":"2023-10-25T16:17:17.641611+0000","last_active":"2023-10-25T16:17:19.221594+0000","last_peered":"2023-10-25T16:17:19.221594+0000","last_clean":"2023-10-25T16:17:19.221594+0000","last_became_active":"2023-10-25T16:17:17.640892+0000","last_became_peered":"2023-10-25T16:17:17.640892+0000","last_unstale":"2023-10-25T16:17:19.221594+0000","last_undegraded":"2023-10-25T16:17:19.221594+0000","last_fullsized":"2023-10-25T16:17:19.221594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:10.948309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706444+0000","last_change":"2023-10-25T16:17:17.668748+0000","last_active":"2023-10-25T16:17:18.706444+0000","last_peered":"2023-10-25T16:17:18.706444+0000","last_clean":"2023-10-25T16:17:18.706444+0000","last_became_active":"2023-10-25T16:17:17.667153+0000","last_became_peered":"2023-10-25T16:17:17.667153+0000","last_unstale":"2023-10-25T16:17:18.706444+0000","last_undegraded":"2023-10-25T16:17:18.706444+0000","last_fullsized":"2023-10-25T16:17:18.706444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:52.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710526+0000","last_change":"2023-10-25T16:17:17.674620+0000","last_active":"2023-10-25T16:17:18.710526+0000","last_peered":"2023-10-25T16:17:18.710526+0000","last_clean":"2023-10-25T16:17:18.710526+0000","last_became_active":"2023-10-25T16:17:17.672434+0000","last_became_peered":"2023-10-25T16:17:17.672434+0000","last_unstale":"2023-10-25T16:17:18.710526+0000","last_undegraded":"2023-10-25T16:17:18.710526+0000","last_fullsized":"2023-10-25T16:17:18.710526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709443+0000","last_change":"2023-10-25T16:17:17.663316+0000","last_active":"2023-10-25T16:17:18.709443+0000","last_peered":"2023-10-25T16:17:18.709443+0000","last_clean":"2023-10-25T16:17:18.709443+0000","last_became_active":"2023-10-25T16:17:17.660398+0000","last_became_peered":"2023-10-25T16:17:17.660398+0000","last_unstale":"2023-10-25T16:17:18.709443+0000","last_undegraded":"2023-10-25T16:17:18.709443+0000","last_fullsized":"2023-10-25T16:17:18.709443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:10:29.345764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712178+0000","last_change":"2023-10-25T16:17:17.667593+0000","last_active":"2023-10-25T16:17:18.712178+0000","last_peered":"2023-10-25T16:17:18.712178+0000","last_clean":"2023-10-25T16:17:18.712178+0000","last_became_active":"2023-10-25T16:17:17.666839+0000","last_became_peered":"2023-10-25T16:17:17.666839+0000","last_unstale":"2023-10-25T16:17:18.712178+0000","last_undegraded":"2023-10-25T16:17:18.712178+0000","last_fullsized":"2023-10-25T16:17:18.712178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:23.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711111+0000","last_change":"2023-10-25T16:17:17.669453+0000","last_active":"2023-10-25T16:17:18.711111+0000","last_peered":"2023-10-25T16:17:18.711111+0000","last_clean":"2023-10-25T16:17:18.711111+0000","last_became_active":"2023-10-25T16:17:17.665439+0000","last_became_peered":"2023-10-25T16:17:17.665439+0000","last_unstale":"2023-10-25T16:17:18.711111+0000","last_undegraded":"2023-10-25T16:17:18.711111+0000","last_fullsized":"2023-10-25T16:17:18.711111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:34.375540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633187+0000","last_change":"2023-10-25T16:17:17.640630+0000","last_active":"2023-10-25T16:17:18.633187+0000","last_peered":"2023-10-25T16:17:18.633187+0000","last_clean":"2023-10-25T16:17:18.633187+0000","last_became_active":"2023-10-25T16:17:17.639914+0000","last_became_peered":"2023-10-25T16:17:17.639914+0000","last_unstale":"2023-10-25T16:17:18.633187+0000","last_undegraded":"2023-10-25T16:17:18.633187+0000","last_fullsized":"2023-10-25T16:17:18.633187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706535+0000","last_change":"2023-10-25T16:17:17.672293+0000","last_active":"2023-10-25T16:17:18.706535+0000","last_peered":"2023-10-25T16:17:18.706535+0000","last_clean":"2023-10-25T16:17:18.706535+0000","last_became_active":"2023-10-25T16:17:17.671908+0000","last_became_peered":"2023-10-25T16:17:17.671908+0000","last_unstale":"2023-10-25T16:17:18.706535+0000","last_undegraded":"2023-10-25T16:17:18.706535+0000","last_fullsized":"2023-10-25T16:17:18.706535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:44.926052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222370+0000","last_change":"2023-10-25T16:17:17.661285+0000","last_active":"2023-10-25T16:17:19.222370+0000","last_peered":"2023-10-25T16:17:19.222370+0000","last_clean":"2023-10-25T16:17:19.222370+0000","last_became_active":"2023-10-25T16:17:17.659550+0000","last_became_peered":"2023-10-25T16:17:17.659550+0000","last_unstale":"2023-10-25T16:17:19.222370+0000","last_undegraded":"2023-10-25T16:17:19.222370+0000","last_fullsized":"2023-10-25T16:17:19.222370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222519+0000","last_change":"2023-10-25T16:17:17.656416+0000","last_active":"2023-10-25T16:17:19.222519+0000","last_peered":"2023-10-25T16:17:19.222519+0000","last_clean":"2023-10-25T16:17:19.222519+0000","last_became_active":"2023-10-25T16:17:17.655732+0000","last_became_peered":"2023-10-25T16:17:17.655732+0000","last_unstale":"2023-10-25T16:17:19.222519+0000","last_undegraded":"2023-10-25T16:17:19.222519+0000","last_fullsized":"2023-10-25T16:17:19.222519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710388+0000","last_change":"2023-10-25T16:17:17.668915+0000","last_active":"2023-10-25T16:17:18.710388+0000","last_peered":"2023-10-25T16:17:18.710388+0000","last_clean":"2023-10-25T16:17:18.710388+0000","last_became_active":"2023-10-25T16:17:17.668247+0000","last_became_peered":"2023-10-25T16:17:17.668247+0000","last_unstale":"2023-10-25T16:17:18.710388+0000","last_undegraded":"2023-10-25T16:17:18.710388+0000","last_fullsized":"2023-10-25T16:17:18.710388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:19.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706830+0000","last_change":"2023-10-25T16:17:17.664573+0000","last_active":"2023-10-25T16:17:18.706830+0000","last_peered":"2023-10-25T16:17:18.706830+0000","last_clean":"2023-10-25T16:17:18.706830+0000","last_became_active":"2023-10-25T16:17:17.663788+0000","last_became_peered":"2023-10-25T16:17:17.663788+0000","last_unstale":"2023-10-25T16:17:18.706830+0000","last_undegraded":"2023-10-25T16:17:18.706830+0000","last_fullsized":"2023-10-25T16:17:18.706830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711210+0000","last_change":"2023-10-25T16:17:17.672141+0000","last_active":"2023-10-25T16:17:18.711210+0000","last_peered":"2023-10-25T16:17:18.711210+0000","last_clean":"2023-10-25T16:17:18.711210+0000","last_became_active":"2023-10-25T16:17:17.671527+0000","last_became_peered":"2023-10-25T16:17:17.671527+0000","last_unstale":"2023-10-25T16:17:18.711210+0000","last_undegraded":"2023-10-25T16:17:18.711210+0000","last_fullsized":"2023-10-25T16:17:18.711210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:35.488420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222817+0000","last_change":"2023-10-25T16:17:17.640047+0000","last_active":"2023-10-25T16:17:19.222817+0000","last_peered":"2023-10-25T16:17:19.222817+0000","last_clean":"2023-10-25T16:17:19.222817+0000","last_became_active":"2023-10-25T16:17:17.639473+0000","last_became_peered":"2023-10-25T16:17:17.639473+0000","last_unstale":"2023-10-25T16:17:19.222817+0000","last_undegraded":"2023-10-25T16:17:19.222817+0000","last_fullsized":"2023-10-25T16:17:19.222817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710909+0000","last_change":"2023-10-25T16:17:17.646553+0000","last_active":"2023-10-25T16:17:18.710909+0000","last_peered":"2023-10-25T16:17:18.710909+0000","last_clean":"2023-10-25T16:17:18.710909+0000","last_became_active":"2023-10-25T16:17:17.645698+0000","last_became_peered":"2023-10-25T16:17:17.645698+0000","last_unstale":"2023-10-25T16:17:18.710909+0000","last_undegraded":"2023-10-25T16:17:18.710909+0000","last_fullsized":"2023-10-25T16:17:18.710909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:18:10.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710240+0000","last_change":"2023-10-25T16:17:17.660456+0000","last_active":"2023-10-25T16:17:18.710240+0000","last_peered":"2023-10-25T16:17:18.710240+0000","last_clean":"2023-10-25T16:17:18.710240+0000","last_became_active":"2023-10-25T16:17:17.658996+0000","last_became_peered":"2023-10-25T16:17:17.658996+0000","last_unstale":"2023-10-25T16:17:18.710240+0000","last_undegraded":"2023-10-25T16:17:18.710240+0000","last_fullsized":"2023-10-25T16:17:18.710240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:53.845062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632896+0000","last_change":"2023-10-25T16:17:17.641250+0000","last_active":"2023-10-25T16:17:18.632896+0000","last_peered":"2023-10-25T16:17:18.632896+0000","last_clean":"2023-10-25T16:17:18.632896+0000","last_became_active":"2023-10-25T16:17:17.640089+0000","last_became_peered":"2023-10-25T16:17:17.640089+0000","last_unstale":"2023-10-25T16:17:18.632896+0000","last_undegraded":"2023-10-25T16:17:18.632896+0000","last_fullsized":"2023-10-25T16:17:18.632896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:02.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632728+0000","last_change":"2023-10-25T16:17:17.665616+0000","last_active":"2023-10-25T16:17:18.632728+0000","last_peered":"2023-10-25T16:17:18.632728+0000","last_clean":"2023-10-25T16:17:18.632728+0000","last_became_active":"2023-10-25T16:17:17.664969+0000","last_became_peered":"2023-10-25T16:17:17.664969+0000","last_unstale":"2023-10-25T16:17:18.632728+0000","last_undegraded":"2023-10-25T16:17:18.632728+0000","last_fullsized":"2023-10-25T16:17:18.632728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:47:41.390733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711409+0000","last_change":"2023-10-25T16:17:17.646722+0000","last_active":"2023-10-25T16:17:18.711409+0000","last_peered":"2023-10-25T16:17:18.711409+0000","last_clean":"2023-10-25T16:17:18.711409+0000","last_became_active":"2023-10-25T16:17:17.645987+0000","last_became_peered":"2023-10-25T16:17:17.645987+0000","last_unstale":"2023-10-25T16:17:18.711409+0000","last_undegraded":"2023-10-25T16:17:18.711409+0000","last_fullsized":"2023-10-25T16:17:18.711409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:34.703288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710929+0000","last_change":"2023-10-25T16:17:17.670488+0000","last_active":"2023-10-25T16:17:18.710929+0000","last_peered":"2023-10-25T16:17:18.710929+0000","last_clean":"2023-10-25T16:17:18.710929+0000","last_became_active":"2023-10-25T16:17:17.669925+0000","last_became_peered":"2023-10-25T16:17:17.669925+0000","last_unstale":"2023-10-25T16:17:18.710929+0000","last_undegraded":"2023-10-25T16:17:18.710929+0000","last_fullsized":"2023-10-25T16:17:18.710929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:06.324016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222413+0000","last_change":"2023-10-25T16:17:17.641832+0000","last_active":"2023-10-25T16:17:19.222413+0000","last_peered":"2023-10-25T16:17:19.222413+0000","last_clean":"2023-10-25T16:17:19.222413+0000","last_became_active":"2023-10-25T16:17:17.641131+0000","last_became_peered":"2023-10-25T16:17:17.641131+0000","last_unstale":"2023-10-25T16:17:19.222413+0000","last_undegraded":"2023-10-25T16:17:19.222413+0000","last_fullsized":"2023-10-25T16:17:19.222413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:02.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709331+0000","last_change":"2023-10-25T16:17:17.657638+0000","last_active":"2023-10-25T16:17:18.709331+0000","last_peered":"2023-10-25T16:17:18.709331+0000","last_clean":"2023-10-25T16:17:18.709331+0000","last_became_active":"2023-10-25T16:17:17.657034+0000","last_became_peered":"2023-10-25T16:17:17.657034+0000","last_unstale":"2023-10-25T16:17:18.709331+0000","last_undegraded":"2023-10-25T16:17:18.709331+0000","last_fullsized":"2023-10-25T16:17:18.709331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:10.100210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222092+0000","last_change":"2023-10-25T16:17:17.642312+0000","last_active":"2023-10-25T16:17:19.222092+0000","last_peered":"2023-10-25T16:17:19.222092+0000","last_clean":"2023-10-25T16:17:19.222092+0000","last_became_active":"2023-10-25T16:17:17.641631+0000","last_became_peered":"2023-10-25T16:17:17.641631+0000","last_unstale":"2023-10-25T16:17:19.222092+0000","last_undegraded":"2023-10-25T16:17:19.222092+0000","last_fullsized":"2023-10-25T16:17:19.222092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:46.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711208+0000","last_change":"2023-10-25T16:17:17.658400+0000","last_active":"2023-10-25T16:17:18.711208+0000","last_peered":"2023-10-25T16:17:18.711208+0000","last_clean":"2023-10-25T16:17:18.711208+0000","last_became_active":"2023-10-25T16:17:17.657761+0000","last_became_peered":"2023-10-25T16:17:17.657761+0000","last_unstale":"2023-10-25T16:17:18.711208+0000","last_undegraded":"2023-10-25T16:17:18.711208+0000","last_fullsized":"2023-10-25T16:17:18.711208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:33:28.791708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711226+0000","last_change":"2023-10-25T16:17:17.658345+0000","last_active":"2023-10-25T16:17:18.711226+0000","last_peered":"2023-10-25T16:17:18.711226+0000","last_clean":"2023-10-25T16:17:18.711226+0000","last_became_active":"2023-10-25T16:17:17.657730+0000","last_became_peered":"2023-10-25T16:17:17.657730+0000","last_unstale":"2023-10-25T16:17:18.711226+0000","last_undegraded":"2023-10-25T16:17:18.711226+0000","last_fullsized":"2023-10-25T16:17:18.711226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:47.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711517+0000","last_change":"2023-10-25T16:17:17.665201+0000","last_active":"2023-10-25T16:17:18.711517+0000","last_peered":"2023-10-25T16:17:18.711517+0000","last_clean":"2023-10-25T16:17:18.711517+0000","last_became_active":"2023-10-25T16:17:17.664482+0000","last_became_peered":"2023-10-25T16:17:17.664482+0000","last_unstale":"2023-10-25T16:17:18.711517+0000","last_undegraded":"2023-10-25T16:17:18.711517+0000","last_fullsized":"2023-10-25T16:17:18.711517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:20.721957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633114+0000","last_change":"2023-10-25T16:17:17.663267+0000","last_active":"2023-10-25T16:17:18.633114+0000","last_peered":"2023-10-25T16:17:18.633114+0000","last_clean":"2023-10-25T16:17:18.633114+0000","last_became_active":"2023-10-25T16:17:17.662665+0000","last_became_peered":"2023-10-25T16:17:17.662665+0000","last_unstale":"2023-10-25T16:17:18.633114+0000","last_undegraded":"2023-10-25T16:17:18.633114+0000","last_fullsized":"2023-10-25T16:17:18.633114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:26:54.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"86'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633136+0000","last_change":"2023-10-25T16:17:16.904660+0000","last_active":"2023-10-25T16:17:18.633136+0000","last_peered":"2023-10-25T16:17:18.633136+0000","last_clean":"2023-10-25T16:17:18.633136+0000","last_became_active":"2023-10-25T16:17:16.903904+0000","last_became_peered":"2023-10-25T16:17:16.903904+0000","last_unstale":"2023-10-25T16:17:18.633136+0000","last_undegraded":"2023-10-25T16:17:18.633136+0000","last_fullsized":"2023-10-25T16:17:18.633136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:52:06.319525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221710+0000","last_change":"2023-10-25T16:17:16.892642+0000","last_active":"2023-10-25T16:17:19.221710+0000","last_peered":"2023-10-25T16:17:19.221710+0000","last_clean":"2023-10-25T16:17:19.221710+0000","last_became_active":"2023-10-25T16:17:16.892225+0000","last_became_peered":"2023-10-25T16:17:16.892225+0000","last_unstale":"2023-10-25T16:17:19.221710+0000","last_undegraded":"2023-10-25T16:17:19.221710+0000","last_fullsized":"2023-10-25T16:17:19.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:41.289281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710854+0000","last_change":"2023-10-25T16:17:17.673401+0000","last_active":"2023-10-25T16:17:18.710854+0000","last_peered":"2023-10-25T16:17:18.710854+0000","last_clean":"2023-10-25T16:17:18.710854+0000","last_became_active":"2023-10-25T16:17:17.667681+0000","last_became_peered":"2023-10-25T16:17:17.667681+0000","last_unstale":"2023-10-25T16:17:18.710854+0000","last_undegraded":"2023-10-25T16:17:18.710854+0000","last_fullsized":"2023-10-25T16:17:18.710854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:35.036194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712054+0000","last_change":"2023-10-25T16:17:16.916614+0000","last_active":"2023-10-25T16:17:18.712054+0000","last_peered":"2023-10-25T16:17:18.712054+0000","last_clean":"2023-10-25T16:17:18.712054+0000","last_became_active":"2023-10-25T16:17:16.914539+0000","last_became_peered":"2023-10-25T16:17:16.914539+0000","last_unstale":"2023-10-25T16:17:18.712054+0000","last_undegraded":"2023-10-25T16:17:18.712054+0000","last_fullsized":"2023-10-25T16:17:18.712054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:05.687178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633535+0000","last_change":"2023-10-25T16:17:17.641569+0000","last_active":"2023-10-25T16:17:18.633535+0000","last_peered":"2023-10-25T16:17:18.633535+0000","last_clean":"2023-10-25T16:17:18.633535+0000","last_became_active":"2023-10-25T16:17:17.640966+0000","last_became_peered":"2023-10-25T16:17:17.640966+0000","last_unstale":"2023-10-25T16:17:18.633535+0000","last_undegraded":"2023-10-25T16:17:18.633535+0000","last_fullsized":"2023-10-25T16:17:18.633535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711327+0000","last_change":"2023-10-25T16:17:16.922723+0000","last_active":"2023-10-25T16:17:18.711327+0000","last_peered":"2023-10-25T16:17:18.711327+0000","last_clean":"2023-10-25T16:17:18.711327+0000","last_became_active":"2023-10-25T16:17:16.920987+0000","last_became_peered":"2023-10-25T16:17:16.920987+0000","last_unstale":"2023-10-25T16:17:18.711327+0000","last_undegraded":"2023-10-25T16:17:18.711327+0000","last_fullsized":"2023-10-25T16:17:18.711327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:43.911566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709340+0000","last_change":"2023-10-25T16:17:17.645618+0000","last_active":"2023-10-25T16:17:18.709340+0000","last_peered":"2023-10-25T16:17:18.709340+0000","last_clean":"2023-10-25T16:17:18.709340+0000","last_became_active":"2023-10-25T16:17:17.645041+0000","last_became_peered":"2023-10-25T16:17:17.645041+0000","last_unstale":"2023-10-25T16:17:18.709340+0000","last_undegraded":"2023-10-25T16:17:18.709340+0000","last_fullsized":"2023-10-25T16:17:18.709340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:50:48.756330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222647+0000","last_change":"2023-10-25T16:17:16.900571+0000","last_active":"2023-10-25T16:17:19.222647+0000","last_peered":"2023-10-25T16:17:19.222647+0000","last_clean":"2023-10-25T16:17:19.222647+0000","last_became_active":"2023-10-25T16:17:16.900156+0000","last_became_peered":"2023-10-25T16:17:16.900156+0000","last_unstale":"2023-10-25T16:17:19.222647+0000","last_undegraded":"2023-10-25T16:17:19.222647+0000","last_fullsized":"2023-10-25T16:17:19.222647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:55.179521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710573+0000","last_change":"2023-10-25T16:17:17.643888+0000","last_active":"2023-10-25T16:17:18.710573+0000","last_peered":"2023-10-25T16:17:18.710573+0000","last_clean":"2023-10-25T16:17:18.710573+0000","last_became_active":"2023-10-25T16:17:17.643307+0000","last_became_peered":"2023-10-25T16:17:17.643307+0000","last_unstale":"2023-10-25T16:17:18.710573+0000","last_undegraded":"2023-10-25T16:17:18.710573+0000","last_fullsized":"2023-10-25T16:17:18.710573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:41:22.558797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712693+0000","last_change":"2023-10-25T16:17:16.914382+0000","last_active":"2023-10-25T16:17:18.712693+0000","last_peered":"2023-10-25T16:17:18.712693+0000","last_clean":"2023-10-25T16:17:18.712693+0000","last_became_active":"2023-10-25T16:17:16.913011+0000","last_became_peered":"2023-10-25T16:17:16.913011+0000","last_unstale":"2023-10-25T16:17:18.712693+0000","last_undegraded":"2023-10-25T16:17:18.712693+0000","last_fullsized":"2023-10-25T16:17:18.712693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:17.525133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706672+0000","last_change":"2023-10-25T16:17:16.902683+0000","last_active":"2023-10-25T16:17:18.706672+0000","last_peered":"2023-10-25T16:17:18.706672+0000","last_clean":"2023-10-25T16:17:18.706672+0000","last_became_active":"2023-10-25T16:17:16.902426+0000","last_became_peered":"2023-10-25T16:17:16.902426+0000","last_unstale":"2023-10-25T16:17:18.706672+0000","last_undegraded":"2023-10-25T16:17:18.706672+0000","last_fullsized":"2023-10-25T16:17:18.706672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:43.888268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221455+0000","last_change":"2023-10-25T16:17:17.641763+0000","last_active":"2023-10-25T16:17:19.221455+0000","last_peered":"2023-10-25T16:17:19.221455+0000","last_clean":"2023-10-25T16:17:19.221455+0000","last_became_active":"2023-10-25T16:17:17.641103+0000","last_became_peered":"2023-10-25T16:17:17.641103+0000","last_unstale":"2023-10-25T16:17:19.221455+0000","last_undegraded":"2023-10-25T16:17:19.221455+0000","last_fullsized":"2023-10-25T16:17:19.221455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870152+0000","last_change":"2023-10-25T16:17:15.870152+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870152+0000","last_undegraded":"2023-10-25T16:17:15.870152+0000","last_fullsized":"2023-10-25T16:17:15.870152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709804+0000","last_change":"2023-10-25T16:17:17.644435+0000","last_active":"2023-10-25T16:17:18.709804+0000","last_peered":"2023-10-25T16:17:18.709804+0000","last_clean":"2023-10-25T16:17:18.709804+0000","last_became_active":"2023-10-25T16:17:17.643844+0000","last_became_peered":"2023-10-25T16:17:17.643844+0000","last_unstale":"2023-10-25T16:17:18.709804+0000","last_undegraded":"2023-10-25T16:17:18.709804+0000","last_fullsized":"2023-10-25T16:17:18.709804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:26.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711119+0000","last_change":"2023-10-25T16:17:16.907112+0000","last_active":"2023-10-25T16:17:18.711119+0000","last_peered":"2023-10-25T16:17:18.711119+0000","last_clean":"2023-10-25T16:17:18.711119+0000","last_became_active":"2023-10-25T16:17:16.906553+0000","last_became_peered":"2023-10-25T16:17:16.906553+0000","last_unstale":"2023-10-25T16:17:18.711119+0000","last_undegraded":"2023-10-25T16:17:18.711119+0000","last_fullsized":"2023-10-25T16:17:18.711119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:44.314093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633375+0000","last_change":"2023-10-25T16:17:17.671535+0000","last_active":"2023-10-25T16:17:18.633375+0000","last_peered":"2023-10-25T16:17:18.633375+0000","last_clean":"2023-10-25T16:17:18.633375+0000","last_became_active":"2023-10-25T16:17:17.670757+0000","last_became_peered":"2023-10-25T16:17:17.670757+0000","last_unstale":"2023-10-25T16:17:18.633375+0000","last_undegraded":"2023-10-25T16:17:18.633375+0000","last_fullsized":"2023-10-25T16:17:18.633375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711730+0000","last_change":"2023-10-25T16:17:16.915546+0000","last_active":"2023-10-25T16:17:18.711730+0000","last_peered":"2023-10-25T16:17:18.711730+0000","last_clean":"2023-10-25T16:17:18.711730+0000","last_became_active":"2023-10-25T16:17:16.913965+0000","last_became_peered":"2023-10-25T16:17:16.913965+0000","last_unstale":"2023-10-25T16:17:18.711730+0000","last_undegraded":"2023-10-25T16:17:18.711730+0000","last_fullsized":"2023-10-25T16:17:18.711730+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:38.764460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712008+0000","last_change":"2023-10-25T16:17:17.664015+0000","last_active":"2023-10-25T16:17:18.712008+0000","last_peered":"2023-10-25T16:17:18.712008+0000","last_clean":"2023-10-25T16:17:18.712008+0000","last_became_active":"2023-10-25T16:17:17.657376+0000","last_became_peered":"2023-10-25T16:17:17.657376+0000","last_unstale":"2023-10-25T16:17:18.712008+0000","last_undegraded":"2023-10-25T16:17:18.712008+0000","last_fullsized":"2023-10-25T16:17:18.712008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:06.701664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"86'3","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222234+0000","last_change":"2023-10-25T16:17:16.889040+0000","last_active":"2023-10-25T16:17:19.222234+0000","last_peered":"2023-10-25T16:17:19.222234+0000","last_clean":"2023-10-25T16:17:19.222234+0000","last_became_active":"2023-10-25T16:17:16.888693+0000","last_became_peered":"2023-10-25T16:17:16.888693+0000","last_unstale":"2023-10-25T16:17:19.222234+0000","last_undegraded":"2023-10-25T16:17:19.222234+0000","last_fullsized":"2023-10-25T16:17:19.222234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:41.426292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"86'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706781+0000","last_change":"2023-10-25T16:17:16.895306+0000","last_active":"2023-10-25T16:17:18.706781+0000","last_peered":"2023-10-25T16:17:18.706781+0000","last_clean":"2023-10-25T16:17:18.706781+0000","last_became_active":"2023-10-25T16:17:16.894773+0000","last_became_peered":"2023-10-25T16:17:16.894773+0000","last_unstale":"2023-10-25T16:17:18.706781+0000","last_undegraded":"2023-10-25T16:17:18.706781+0000","last_fullsized":"2023-10-25T16:17:18.706781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633557+0000","last_change":"2023-10-25T16:17:17.663646+0000","last_active":"2023-10-25T16:17:18.633557+0000","last_peered":"2023-10-25T16:17:18.633557+0000","last_clean":"2023-10-25T16:17:18.633557+0000","last_became_active":"2023-10-25T16:17:17.661252+0000","last_became_peered":"2023-10-25T16:17:17.661252+0000","last_unstale":"2023-10-25T16:17:18.633557+0000","last_undegraded":"2023-10-25T16:17:18.633557+0000","last_fullsized":"2023-10-25T16:17:18.633557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706575+0000","last_change":"2023-10-25T16:17:16.902496+0000","last_active":"2023-10-25T16:17:18.706575+0000","last_peered":"2023-10-25T16:17:18.706575+0000","last_clean":"2023-10-25T16:17:18.706575+0000","last_became_active":"2023-10-25T16:17:16.902164+0000","last_became_peered":"2023-10-25T16:17:16.902164+0000","last_unstale":"2023-10-25T16:17:18.706575+0000","last_undegraded":"2023-10-25T16:17:18.706575+0000","last_fullsized":"2023-10-25T16:17:18.706575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:59.831665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711511+0000","last_change":"2023-10-25T16:17:17.647894+0000","last_active":"2023-10-25T16:17:18.711511+0000","last_peered":"2023-10-25T16:17:18.711511+0000","last_clean":"2023-10-25T16:17:18.711511+0000","last_became_active":"2023-10-25T16:17:17.647364+0000","last_became_peered":"2023-10-25T16:17:17.647364+0000","last_unstale":"2023-10-25T16:17:18.711511+0000","last_undegraded":"2023-10-25T16:17:18.711511+0000","last_fullsized":"2023-10-25T16:17:18.711511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:00.360348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711442+0000","last_change":"2023-10-25T16:17:16.922145+0000","last_active":"2023-10-25T16:17:18.711442+0000","last_peered":"2023-10-25T16:17:18.711442+0000","last_clean":"2023-10-25T16:17:18.711442+0000","last_became_active":"2023-10-25T16:17:16.919735+0000","last_became_peered":"2023-10-25T16:17:16.919735+0000","last_unstale":"2023-10-25T16:17:18.711442+0000","last_undegraded":"2023-10-25T16:17:18.711442+0000","last_fullsized":"2023-10-25T16:17:18.711442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:23.286095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222668+0000","last_change":"2023-10-25T16:17:17.660321+0000","last_active":"2023-10-25T16:17:19.222668+0000","last_peered":"2023-10-25T16:17:19.222668+0000","last_clean":"2023-10-25T16:17:19.222668+0000","last_became_active":"2023-10-25T16:17:17.657197+0000","last_became_peered":"2023-10-25T16:17:17.657197+0000","last_unstale":"2023-10-25T16:17:19.222668+0000","last_undegraded":"2023-10-25T16:17:19.222668+0000","last_fullsized":"2023-10-25T16:17:19.222668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710326+0000","last_change":"2023-10-25T16:17:16.912258+0000","last_active":"2023-10-25T16:17:18.710326+0000","last_peered":"2023-10-25T16:17:18.710326+0000","last_clean":"2023-10-25T16:17:18.710326+0000","last_became_active":"2023-10-25T16:17:16.909426+0000","last_became_peered":"2023-10-25T16:17:16.909426+0000","last_unstale":"2023-10-25T16:17:18.710326+0000","last_undegraded":"2023-10-25T16:17:18.710326+0000","last_fullsized":"2023-10-25T16:17:18.710326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:25:41.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"86'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709580+0000","last_change":"2023-10-25T16:17:16.910296+0000","last_active":"2023-10-25T16:17:18.709580+0000","last_peered":"2023-10-25T16:17:18.709580+0000","last_clean":"2023-10-25T16:17:18.709580+0000","last_became_active":"2023-10-25T16:17:16.908878+0000","last_became_peered":"2023-10-25T16:17:16.908878+0000","last_unstale":"2023-10-25T16:17:18.709580+0000","last_undegraded":"2023-10-25T16:17:18.709580+0000","last_fullsized":"2023-10-25T16:17:18.709580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:11.115383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711706+0000","last_change":"2023-10-25T16:17:17.656830+0000","last_active":"2023-10-25T16:17:18.711706+0000","last_peered":"2023-10-25T16:17:18.711706+0000","last_clean":"2023-10-25T16:17:18.711706+0000","last_became_active":"2023-10-25T16:17:17.655972+0000","last_became_peered":"2023-10-25T16:17:17.655972+0000","last_unstale":"2023-10-25T16:17:18.711706+0000","last_undegraded":"2023-10-25T16:17:18.711706+0000","last_fullsized":"2023-10-25T16:17:18.711706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:53.126893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712223+0000","last_change":"2023-10-25T16:17:16.908715+0000","last_active":"2023-10-25T16:17:18.712223+0000","last_peered":"2023-10-25T16:17:18.712223+0000","last_clean":"2023-10-25T16:17:18.712223+0000","last_became_active":"2023-10-25T16:17:16.907871+0000","last_became_peered":"2023-10-25T16:17:16.907871+0000","last_unstale":"2023-10-25T16:17:18.712223+0000","last_undegraded":"2023-10-25T16:17:18.712223+0000","last_fullsized":"2023-10-25T16:17:18.712223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:05:35.321099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633447+0000","last_change":"2023-10-25T16:17:17.668641+0000","last_active":"2023-10-25T16:17:18.633447+0000","last_peered":"2023-10-25T16:17:18.633447+0000","last_clean":"2023-10-25T16:17:18.633447+0000","last_became_active":"2023-10-25T16:17:17.667991+0000","last_became_peered":"2023-10-25T16:17:17.667991+0000","last_unstale":"2023-10-25T16:17:18.633447+0000","last_undegraded":"2023-10-25T16:17:18.633447+0000","last_fullsized":"2023-10-25T16:17:18.633447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712274+0000","last_change":"2023-10-25T16:17:16.917091+0000","last_active":"2023-10-25T16:17:18.712274+0000","last_peered":"2023-10-25T16:17:18.712274+0000","last_clean":"2023-10-25T16:17:18.712274+0000","last_became_active":"2023-10-25T16:17:16.916009+0000","last_became_peered":"2023-10-25T16:17:16.916009+0000","last_unstale":"2023-10-25T16:17:18.712274+0000","last_undegraded":"2023-10-25T16:17:18.712274+0000","last_fullsized":"2023-10-25T16:17:18.712274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:22.208994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706661+0000","last_change":"2023-10-25T16:17:17.662947+0000","last_active":"2023-10-25T16:17:18.706661+0000","last_peered":"2023-10-25T16:17:18.706661+0000","last_clean":"2023-10-25T16:17:18.706661+0000","last_became_active":"2023-10-25T16:17:17.658737+0000","last_became_peered":"2023-10-25T16:17:17.658737+0000","last_unstale":"2023-10-25T16:17:18.706661+0000","last_undegraded":"2023-10-25T16:17:18.706661+0000","last_fullsized":"2023-10-25T16:17:18.706661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:40.814420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711854+0000","last_change":"2023-10-25T16:17:16.922400+0000","last_active":"2023-10-25T16:17:18.711854+0000","last_peered":"2023-10-25T16:17:18.711854+0000","last_clean":"2023-10-25T16:17:18.711854+0000","last_became_active":"2023-10-25T16:17:16.920276+0000","last_became_peered":"2023-10-25T16:17:16.920276+0000","last_unstale":"2023-10-25T16:17:18.711854+0000","last_undegraded":"2023-10-25T16:17:18.711854+0000","last_fullsized":"2023-10-25T16:17:18.711854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:39.799934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633115+0000","last_change":"2023-10-25T16:17:16.908243+0000","last_active":"2023-10-25T16:17:18.633115+0000","last_peered":"2023-10-25T16:17:18.633115+0000","last_clean":"2023-10-25T16:17:18.633115+0000","last_became_active":"2023-10-25T16:17:16.907544+0000","last_became_peered":"2023-10-25T16:17:16.907544+0000","last_unstale":"2023-10-25T16:17:18.633115+0000","last_undegraded":"2023-10-25T16:17:18.633115+0000","last_fullsized":"2023-10-25T16:17:18.633115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:46.667209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221980+0000","last_change":"2023-10-25T16:17:17.667150+0000","last_active":"2023-10-25T16:17:19.221980+0000","last_peered":"2023-10-25T16:17:19.221980+0000","last_clean":"2023-10-25T16:17:19.221980+0000","last_became_active":"2023-10-25T16:17:17.666514+0000","last_became_peered":"2023-10-25T16:17:17.666514+0000","last_unstale":"2023-10-25T16:17:19.221980+0000","last_undegraded":"2023-10-25T16:17:19.221980+0000","last_fullsized":"2023-10-25T16:17:19.221980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:35.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712418+0000","last_change":"2023-10-25T16:17:16.902912+0000","last_active":"2023-10-25T16:17:18.712418+0000","last_peered":"2023-10-25T16:17:18.712418+0000","last_clean":"2023-10-25T16:17:18.712418+0000","last_became_active":"2023-10-25T16:17:16.901611+0000","last_became_peered":"2023-10-25T16:17:16.901611+0000","last_unstale":"2023-10-25T16:17:18.712418+0000","last_undegraded":"2023-10-25T16:17:18.712418+0000","last_fullsized":"2023-10-25T16:17:18.712418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222414+0000","last_change":"2023-10-25T16:17:17.668159+0000","last_active":"2023-10-25T16:17:19.222414+0000","last_peered":"2023-10-25T16:17:19.222414+0000","last_clean":"2023-10-25T16:17:19.222414+0000","last_became_active":"2023-10-25T16:17:17.667584+0000","last_became_peered":"2023-10-25T16:17:17.667584+0000","last_unstale":"2023-10-25T16:17:19.222414+0000","last_undegraded":"2023-10-25T16:17:19.222414+0000","last_fullsized":"2023-10-25T16:17:19.222414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:38:50.403559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711714+0000","last_change":"2023-10-25T16:17:16.899174+0000","last_active":"2023-10-25T16:17:18.711714+0000","last_peered":"2023-10-25T16:17:18.711714+0000","last_clean":"2023-10-25T16:17:18.711714+0000","last_became_active":"2023-10-25T16:17:16.897638+0000","last_became_peered":"2023-10-25T16:17:16.897638+0000","last_unstale":"2023-10-25T16:17:18.711714+0000","last_undegraded":"2023-10-25T16:17:18.711714+0000","last_fullsized":"2023-10-25T16:17:18.711714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:56.936496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221988+0000","last_change":"2023-10-25T16:17:17.661441+0000","last_active":"2023-10-25T16:17:19.221988+0000","last_peered":"2023-10-25T16:17:19.221988+0000","last_clean":"2023-10-25T16:17:19.221988+0000","last_became_active":"2023-10-25T16:17:17.660843+0000","last_became_peered":"2023-10-25T16:17:17.660843+0000","last_unstale":"2023-10-25T16:17:19.221988+0000","last_undegraded":"2023-10-25T16:17:19.221988+0000","last_fullsized":"2023-10-25T16:17:19.221988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:27.304996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221675+0000","last_change":"2023-10-25T16:17:16.891743+0000","last_active":"2023-10-25T16:17:19.221675+0000","last_peered":"2023-10-25T16:17:19.221675+0000","last_clean":"2023-10-25T16:17:19.221675+0000","last_became_active":"2023-10-25T16:17:16.891421+0000","last_became_peered":"2023-10-25T16:17:16.891421+0000","last_unstale":"2023-10-25T16:17:19.221675+0000","last_undegraded":"2023-10-25T16:17:19.221675+0000","last_fullsized":"2023-10-25T16:17:19.221675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:23.033726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222958+0000","last_change":"2023-10-25T16:17:17.660916+0000","last_active":"2023-10-25T16:17:19.222958+0000","last_peered":"2023-10-25T16:17:19.222958+0000","last_clean":"2023-10-25T16:17:19.222958+0000","last_became_active":"2023-10-25T16:17:17.658152+0000","last_became_peered":"2023-10-25T16:17:17.658152+0000","last_unstale":"2023-10-25T16:17:19.222958+0000","last_undegraded":"2023-10-25T16:17:19.222958+0000","last_fullsized":"2023-10-25T16:17:19.222958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711950+0000","last_change":"2023-10-25T16:17:16.912609+0000","last_active":"2023-10-25T16:17:18.711950+0000","last_peered":"2023-10-25T16:17:18.711950+0000","last_clean":"2023-10-25T16:17:18.711950+0000","last_became_active":"2023-10-25T16:17:16.908119+0000","last_became_peered":"2023-10-25T16:17:16.908119+0000","last_unstale":"2023-10-25T16:17:18.711950+0000","last_undegraded":"2023-10-25T16:17:18.711950+0000","last_fullsized":"2023-10-25T16:17:18.711950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:51.627276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710119+0000","last_change":"2023-10-25T16:17:17.663862+0000","last_active":"2023-10-25T16:17:18.710119+0000","last_peered":"2023-10-25T16:17:18.710119+0000","last_clean":"2023-10-25T16:17:18.710119+0000","last_became_active":"2023-10-25T16:17:17.662309+0000","last_became_peered":"2023-10-25T16:17:17.662309+0000","last_unstale":"2023-10-25T16:17:18.710119+0000","last_undegraded":"2023-10-25T16:17:18.710119+0000","last_fullsized":"2023-10-25T16:17:18.710119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:20:41.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709789+0000","last_change":"2023-10-25T16:17:16.909558+0000","last_active":"2023-10-25T16:17:18.709789+0000","last_peered":"2023-10-25T16:17:18.709789+0000","last_clean":"2023-10-25T16:17:18.709789+0000","last_became_active":"2023-10-25T16:17:16.908758+0000","last_became_peered":"2023-10-25T16:17:16.908758+0000","last_unstale":"2023-10-25T16:17:18.709789+0000","last_undegraded":"2023-10-25T16:17:18.709789+0000","last_fullsized":"2023-10-25T16:17:18.709789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:18:52.859828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633861+0000","last_change":"2023-10-25T16:17:17.660209+0000","last_active":"2023-10-25T16:17:18.633861+0000","last_peered":"2023-10-25T16:17:18.633861+0000","last_clean":"2023-10-25T16:17:18.633861+0000","last_became_active":"2023-10-25T16:17:17.659576+0000","last_became_peered":"2023-10-25T16:17:17.659576+0000","last_unstale":"2023-10-25T16:17:18.633861+0000","last_undegraded":"2023-10-25T16:17:18.633861+0000","last_fullsized":"2023-10-25T16:17:18.633861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:41:33.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870150+0000","last_change":"2023-10-25T16:17:15.870150+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870150+0000","last_undegraded":"2023-10-25T16:17:15.870150+0000","last_fullsized":"2023-10-25T16:17:15.870150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633812+0000","last_change":"2023-10-25T16:17:17.641836+0000","last_active":"2023-10-25T16:17:18.633812+0000","last_peered":"2023-10-25T16:17:18.633812+0000","last_clean":"2023-10-25T16:17:18.633812+0000","last_became_active":"2023-10-25T16:17:17.640900+0000","last_became_peered":"2023-10-25T16:17:17.640900+0000","last_unstale":"2023-10-25T16:17:18.633812+0000","last_undegraded":"2023-10-25T16:17:18.633812+0000","last_fullsized":"2023-10-25T16:17:18.633812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.223013+0000","last_change":"2023-10-25T16:17:16.907260+0000","last_active":"2023-10-25T16:17:19.223013+0000","last_peered":"2023-10-25T16:17:19.223013+0000","last_clean":"2023-10-25T16:17:19.223013+0000","last_became_active":"2023-10-25T16:17:16.907025+0000","last_became_peered":"2023-10-25T16:17:16.907025+0000","last_unstale":"2023-10-25T16:17:19.223013+0000","last_undegraded":"2023-10-25T16:17:19.223013+0000","last_fullsized":"2023-10-25T16:17:19.223013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:01.984830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870220+0000","last_change":"2023-10-25T16:17:15.870220+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870220+0000","last_undegraded":"2023-10-25T16:17:15.870220+0000","last_fullsized":"2023-10-25T16:17:15.870220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711184+0000","last_change":"2023-10-25T16:17:17.672992+0000","last_active":"2023-10-25T16:17:18.711184+0000","last_peered":"2023-10-25T16:17:18.711184+0000","last_clean":"2023-10-25T16:17:18.711184+0000","last_became_active":"2023-10-25T16:17:17.666970+0000","last_became_peered":"2023-10-25T16:17:17.666970+0000","last_unstale":"2023-10-25T16:17:18.711184+0000","last_undegraded":"2023-10-25T16:17:18.711184+0000","last_fullsized":"2023-10-25T16:17:18.711184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:31.108645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706743+0000","last_change":"2023-10-25T16:17:16.905625+0000","last_active":"2023-10-25T16:17:18.706743+0000","last_peered":"2023-10-25T16:17:18.706743+0000","last_clean":"2023-10-25T16:17:18.706743+0000","last_became_active":"2023-10-25T16:17:16.905397+0000","last_became_peered":"2023-10-25T16:17:16.905397+0000","last_unstale":"2023-10-25T16:17:18.706743+0000","last_undegraded":"2023-10-25T16:17:18.706743+0000","last_fullsized":"2023-10-25T16:17:18.706743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706602+0000","last_change":"2023-10-25T16:17:17.669175+0000","last_active":"2023-10-25T16:17:18.706602+0000","last_peered":"2023-10-25T16:17:18.706602+0000","last_clean":"2023-10-25T16:17:18.706602+0000","last_became_active":"2023-10-25T16:17:17.668211+0000","last_became_peered":"2023-10-25T16:17:17.668211+0000","last_unstale":"2023-10-25T16:17:18.706602+0000","last_undegraded":"2023-10-25T16:17:18.706602+0000","last_fullsized":"2023-10-25T16:17:18.706602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:24.300581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709817+0000","last_change":"2023-10-25T16:17:16.910651+0000","last_active":"2023-10-25T16:17:18.709817+0000","last_peered":"2023-10-25T16:17:18.709817+0000","last_clean":"2023-10-25T16:17:18.709817+0000","last_became_active":"2023-10-25T16:17:16.909696+0000","last_became_peered":"2023-10-25T16:17:16.909696+0000","last_unstale":"2023-10-25T16:17:18.709817+0000","last_undegraded":"2023-10-25T16:17:18.709817+0000","last_fullsized":"2023-10-25T16:17:18.709817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:53.032575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712481+0000","last_change":"2023-10-25T16:17:17.671027+0000","last_active":"2023-10-25T16:17:18.712481+0000","last_peered":"2023-10-25T16:17:18.712481+0000","last_clean":"2023-10-25T16:17:18.712481+0000","last_became_active":"2023-10-25T16:17:17.669539+0000","last_became_peered":"2023-10-25T16:17:17.669539+0000","last_unstale":"2023-10-25T16:17:18.712481+0000","last_undegraded":"2023-10-25T16:17:18.712481+0000","last_fullsized":"2023-10-25T16:17:18.712481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:34.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712622+0000","last_change":"2023-10-25T16:17:16.902431+0000","last_active":"2023-10-25T16:17:18.712622+0000","last_peered":"2023-10-25T16:17:18.712622+0000","last_clean":"2023-10-25T16:17:18.712622+0000","last_became_active":"2023-10-25T16:17:16.900783+0000","last_became_peered":"2023-10-25T16:17:16.900783+0000","last_unstale":"2023-10-25T16:17:18.712622+0000","last_undegraded":"2023-10-25T16:17:18.712622+0000","last_fullsized":"2023-10-25T16:17:18.712622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222267+0000","last_change":"2023-10-25T16:17:17.666667+0000","last_active":"2023-10-25T16:17:19.222267+0000","last_peered":"2023-10-25T16:17:19.222267+0000","last_clean":"2023-10-25T16:17:19.222267+0000","last_became_active":"2023-10-25T16:17:17.666071+0000","last_became_peered":"2023-10-25T16:17:17.666071+0000","last_unstale":"2023-10-25T16:17:19.222267+0000","last_undegraded":"2023-10-25T16:17:19.222267+0000","last_fullsized":"2023-10-25T16:17:19.222267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:14:54.061159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712904+0000","last_change":"2023-10-25T16:17:16.913949+0000","last_active":"2023-10-25T16:17:18.712904+0000","last_peered":"2023-10-25T16:17:18.712904+0000","last_clean":"2023-10-25T16:17:18.712904+0000","last_became_active":"2023-10-25T16:17:16.911491+0000","last_became_peered":"2023-10-25T16:17:16.911491+0000","last_unstale":"2023-10-25T16:17:18.712904+0000","last_undegraded":"2023-10-25T16:17:18.712904+0000","last_fullsized":"2023-10-25T16:17:18.712904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:55.386778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.633792+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:17:17.633792+0000","last_peered":"2023-10-25T16:17:17.633792+0000","last_clean":"2023-10-25T16:17:17.633792+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:17:17.633792+0000","last_undegraded":"2023-10-25T16:17:17.633792+0000","last_fullsized":"2023-10-25T16:17:17.633792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:15.165202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":434,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194877,"statfs":{"total":200000000,"available":199554963,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.88900000000000001,"5min":1.077,"15min":1.077},"last":0.432}]},{"osd":1,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.307,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0309999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59599999999999997,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.87,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.61599999999999999,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2529999999999999,"5min":1.345,"15min":1.345},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.1919999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83999999999999997},"min":{"1min":0.73599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.60999999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.1639999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.67900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.147,"5min":1.581,"15min":1.581},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.90200000000000002,"15min":0.878},"min":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.131,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90600000000000003,"15min":0.92700000000000005},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.155,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92300000000000004,"15min":0.91100000000000003},"min":{"1min":0.79600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.133,"5min":1.677,"15min":1.677},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95999999999999996,"15min":0.95499999999999996},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2050000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.61699999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1030,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0920000000000001,"5min":1.256,"15min":1.256},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.83099999999999996},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.91500000000000004,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.29,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.2410000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.85599999999999998,"15min":0.82999999999999996},"min":{"1min":0.58399999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1910000000000001,"5min":1.27,"15min":1.27},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.71199999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.159,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3420000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.97399999999999998,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0289999999999999,"15min":1.0389999999999999},"min":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.151},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1259999999999999},"min":{"1min":0.72399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.397,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.86399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.397,"15min":1.397},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.224,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90100000000000002,"15min":0.88500000000000001},"min":{"1min":0.626,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2090000000000001,"5min":1.302,"15min":1.302},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.754,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.119,"5min":1.476,"15min":1.476},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.018,"5min":0.92200000000000004,"15min":0.88400000000000001},"min":{"1min":0.81599999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.749},{"interface":"front","average":{"1min":1.016,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.77000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2330000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2250000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.99199999999999999},"min":{"1min":0.70599999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":1.413,"15min":1.413},"last":0.92100000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.96899999999999997},"min":{"1min":0.72899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.65800000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3400000000000001,"5min":1.895,"15min":1.895},"last":1.046}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.081,"15min":1.079},"min":{"1min":0.81799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3049999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0640000000000001,"15min":1.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.296,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.1259999999999999,"15min":1.3700000000000001},"min":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.661,"5min":14.843,"15min":14.843},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.173,"15min":1.5149999999999999},"min":{"1min":0.66100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":16.439,"15min":16.439},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.161,"15min":1.4370000000000001},"min":{"1min":0.64300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2150000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.157},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88700000000000001,"15min":0.86799999999999999},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.224,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.129}]},{"osd":2,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.91800000000000004,"15min":0.93600000000000005},"min":{"1min":0.77900000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.22,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.97099999999999997,"15min":0.96699999999999997},"min":{"1min":0.63300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2470000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.98099999999999998,"15min":0.99099999999999999},"min":{"1min":0.80300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1699999999999999,"5min":1.252,"15min":1.252},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.323,"15min":1.5389999999999999},"min":{"1min":1.0580000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8149999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3140000000000001,"15min":1.625},"min":{"1min":0.68600000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":15.904,"15min":15.904},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.3069999999999999,"15min":1.6559999999999999},"min":{"1min":0.75800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.879,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.278,"15min":1.524},"min":{"1min":0.67800000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.748,"5min":14.567,"15min":14.567},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.4450000000000001,"15min":1.7390000000000001},"min":{"1min":0.89500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.599,"5min":15.089,"15min":15.089},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.397,"15min":1.7729999999999999},"min":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7090000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1970000000000001,"15min":1.272},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9530000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82799999999999996,"15min":0.80000000000000004},"min":{"1min":0.66900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.327,"5min":1.47,"15min":1.47},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.85899999999999999,"15min":0.81799999999999995},"min":{"1min":0.71299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":1.1659999999999999,"5min":1.288,"15min":1.288},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.58899999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":0.89300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2290000000000001,"5min":1.369,"15min":1.369},"last":1.052},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.78500000000000003},"min":{"1min":0.64100000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.518,"15min":1.518},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.69499999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.121,"15min":1.121},"min":{"1min":0.91200000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.24}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":2.085,"15min":2.085},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.329}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.196,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":1.0289999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":447,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194865,"statfs":{"total":200000000,"available":199541801,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.59799999999999998,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.25700000000000001,"5min":0.222,"15min":0.222},"max":{"1min":1.004,"5min":1.083,"15min":1.083},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.255,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.99399999999999999,"15min":0.98699999999999999},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.427,"15min":1.427},"last":0.78600000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.214,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3720000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.306,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.663,"15min":1.663},"last":0.93700000000000006}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.58099999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.47,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.038},{"interface":"front","average":{"1min":1.022,"5min":0.96999999999999997,"15min":0.94599999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.252,"5min":1.389,"15min":1.389},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":455,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194856,"statfs":{"total":200000000,"available":199533385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.97099999999999997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.129,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.318}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.58899999999999997,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1499999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.318,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.371,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.034,"5min":1.423,"15min":1.423},"last":0.375}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.05,"15min":0.97699999999999998},"min":{"1min":0.69199999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":12.698,"15min":12.698},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.1000000000000001,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.214,"5min":12.721,"15min":12.721},"last":0.84699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.92900000000000005,"15min":0.91700000000000004},"min":{"1min":0.57999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2549999999999999,"5min":1.546,"15min":1.546},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2290000000000001,"5min":2.206,"15min":2.206},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":1.022},"min":{"1min":0.69199999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.381,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0980000000000001,"15min":0.98199999999999998},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.268,"5min":14.776,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.093,"15min":1.0169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4339999999999999,"5min":10.509,"15min":10.509},"last":1.0640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1023,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194288,"statfs":{"total":200000000,"available":198951545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.70499999999999996},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.94899999999999995,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.749},"min":{"1min":0.34899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0069999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84899999999999998,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95199999999999996,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.78500000000000003},"min":{"1min":0.33100000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":1.101},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.45300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1699999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.68400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0960000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.93000000000000005},"min":{"1min":0.64700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.997}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.88200000000000001,"15min":0.85299999999999998},"min":{"1min":0.73399999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2190000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91900000000000004,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.105,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.206,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93200000000000005,"15min":0.91700000000000004},"min":{"1min":0.82399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2869999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.121}]},{"osd":7,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.3220000000000001},"min":{"1min":0.81799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3080000000000001,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1619999999999999,"15min":1.339},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3360000000000001,"5min":11.622,"15min":11.622},"last":1.073}]}]}],"pool_statfs":[]}} 2023-10-25T16:17:20.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:17:21.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 -- 172.21.15.177:0/1958026466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406f570 msgr2=0x7f49140cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 --2- 172.21.15.177:0/1958026466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406f570 0x7f49140cb5c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f490c009bc0 tx=0x7f490c01caf0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 -- 172.21.15.177:0/1958026466 shutdown_connections 2023-10-25T16:17:21.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 --2- 172.21.15.177:0/1958026466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406f570 0x7f49140cb5c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 --2- 172.21.15.177:0/1958026466 >> v2:172.21.15.184:3300/0 conn(0x7f491406c090 0x7f49140af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 -- 172.21.15.177:0/1958026466 >> 172.21.15.177:0/1958026466 conn(0x7f49140b2450 msgr2=0x7f49140b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 -- 172.21.15.177:0/1958026466 shutdown_connections 2023-10-25T16:17:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 -- 172.21.15.177:0/1958026466 wait complete. 2023-10-25T16:17:21.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 Processor -- start 2023-10-25T16:17:21.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.045+0000 7f49192a9640 1 -- start start 2023-10-25T16:17:21.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406c090 0x7f4914157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f491406f570 0x7f49140adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 0x7f49140a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914157850 con 0x7f4914140e90 2023-10-25T16:17:21.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491406a450 con 0x7f491406f570 2023-10-25T16:17:21.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49140abfe0 con 0x7f491406c090 2023-10-25T16:17:21.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 0x7f49140a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 0x7f49140a80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34534/0 (socket says 172.21.15.177:34534) 2023-10-25T16:17:21.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 -- 172.21.15.177:0/278867425 learned_addr learned my addr 172.21.15.177:0/278867425 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:21.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490bfff640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f491406f570 0x7f49140adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f4912ffd640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406c090 0x7f4914157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 -- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406c090 msgr2=0x7f4914157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406c090 0x7f4914157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 -- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f491406f570 msgr2=0x7f49140adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f491406f570 0x7f49140adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 -- 172.21.15.177:0/278867425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c009820 con 0x7f4914140e90 2023-10-25T16:17:21.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49137fe640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 0x7f49140a80d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f490c01a720 tx=0x7f490c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:21.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0ba070 con 0x7f4914140e90 2023-10-25T16:17:21.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49140ac2c0 con 0x7f4914140e90 2023-10-25T16:17:21.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f490c0a5aa0 con 0x7f4914140e90 2023-10-25T16:17:21.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c004c90 con 0x7f4914140e90 2023-10-25T16:17:21.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49140aaf50 con 0x7f4914140e90 2023-10-25T16:17:21.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491404daf0 con 0x7f4914140e90 2023-10-25T16:17:21.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f490c0b4040 con 0x7f4914140e90 2023-10-25T16:17:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490b7fe640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f4066470 0x7f48f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f490c11e4f0 con 0x7f4914140e90 2023-10-25T16:17:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.049+0000 7f4912ffd640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f4066470 0x7f48f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.053+0000 7f4912ffd640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f4066470 0x7f48f4068930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49040011f0 tx=0x7f4904009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:21.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.053+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f490c0eb8f0 con 0x7f4914140e90 2023-10-25T16:17:21.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.205+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f491404daf0 con 0x7f48f4066470 2023-10-25T16:17:21.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.229+0000 7f490b7fe640 1 -- 172.21.15.177:0/278867425 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282406 (secure 0 0 0) 0x7f491404daf0 con 0x7f48f4066470 2023-10-25T16:17:21.233 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:21.236 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:17:21.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f4066470 msgr2=0x7f48f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f4066470 0x7f48f4068930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49040011f0 tx=0x7f4904009040 comp rx=0 tx=0).stop 2023-10-25T16:17:21.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 msgr2=0x7f49140a80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 0x7f49140a80d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f490c01a720 tx=0x7f490c003f60 comp rx=0 tx=0).stop 2023-10-25T16:17:21.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 shutdown_connections 2023-10-25T16:17:21.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f4066470 0x7f48f4068930 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4914140e90 0x7f49140a80d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f491406f570 0x7f49140adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 --2- 172.21.15.177:0/278867425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f491406c090 0x7f4914157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 >> 172.21.15.177:0/278867425 conn(0x7f49140b2450 msgr2=0x7f491415b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:21.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 shutdown_connections 2023-10-25T16:17:21.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.233+0000 7f49192a9640 1 -- 172.21.15.177:0/278867425 wait complete. 2023-10-25T16:17:21.254 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-10-25T16:17:20.691748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4753,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557746,"statfs":{"total":1600000000,"available":1595132910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821332"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632846+0000","last_change":"2023-10-25T16:17:17.664185+0000","last_active":"2023-10-25T16:17:18.632846+0000","last_peered":"2023-10-25T16:17:18.632846+0000","last_clean":"2023-10-25T16:17:18.632846+0000","last_became_active":"2023-10-25T16:17:17.662766+0000","last_became_peered":"2023-10-25T16:17:17.662766+0000","last_unstale":"2023-10-25T16:17:18.632846+0000","last_undegraded":"2023-10-25T16:17:18.632846+0000","last_fullsized":"2023-10-25T16:17:18.632846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:24.048212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711163+0000","last_change":"2023-10-25T16:17:17.657987+0000","last_active":"2023-10-25T16:17:18.711163+0000","last_peered":"2023-10-25T16:17:18.711163+0000","last_clean":"2023-10-25T16:17:18.711163+0000","last_became_active":"2023-10-25T16:17:17.657323+0000","last_became_peered":"2023-10-25T16:17:17.657323+0000","last_unstale":"2023-10-25T16:17:18.711163+0000","last_undegraded":"2023-10-25T16:17:18.711163+0000","last_fullsized":"2023-10-25T16:17:18.711163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:54.047062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221594+0000","last_change":"2023-10-25T16:17:17.641611+0000","last_active":"2023-10-25T16:17:19.221594+0000","last_peered":"2023-10-25T16:17:19.221594+0000","last_clean":"2023-10-25T16:17:19.221594+0000","last_became_active":"2023-10-25T16:17:17.640892+0000","last_became_peered":"2023-10-25T16:17:17.640892+0000","last_unstale":"2023-10-25T16:17:19.221594+0000","last_undegraded":"2023-10-25T16:17:19.221594+0000","last_fullsized":"2023-10-25T16:17:19.221594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:10.948309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706444+0000","last_change":"2023-10-25T16:17:17.668748+0000","last_active":"2023-10-25T16:17:18.706444+0000","last_peered":"2023-10-25T16:17:18.706444+0000","last_clean":"2023-10-25T16:17:18.706444+0000","last_became_active":"2023-10-25T16:17:17.667153+0000","last_became_peered":"2023-10-25T16:17:17.667153+0000","last_unstale":"2023-10-25T16:17:18.706444+0000","last_undegraded":"2023-10-25T16:17:18.706444+0000","last_fullsized":"2023-10-25T16:17:18.706444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:52.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710526+0000","last_change":"2023-10-25T16:17:17.674620+0000","last_active":"2023-10-25T16:17:18.710526+0000","last_peered":"2023-10-25T16:17:18.710526+0000","last_clean":"2023-10-25T16:17:18.710526+0000","last_became_active":"2023-10-25T16:17:17.672434+0000","last_became_peered":"2023-10-25T16:17:17.672434+0000","last_unstale":"2023-10-25T16:17:18.710526+0000","last_undegraded":"2023-10-25T16:17:18.710526+0000","last_fullsized":"2023-10-25T16:17:18.710526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709443+0000","last_change":"2023-10-25T16:17:17.663316+0000","last_active":"2023-10-25T16:17:18.709443+0000","last_peered":"2023-10-25T16:17:18.709443+0000","last_clean":"2023-10-25T16:17:18.709443+0000","last_became_active":"2023-10-25T16:17:17.660398+0000","last_became_peered":"2023-10-25T16:17:17.660398+0000","last_unstale":"2023-10-25T16:17:18.709443+0000","last_undegraded":"2023-10-25T16:17:18.709443+0000","last_fullsized":"2023-10-25T16:17:18.709443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:10:29.345764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712178+0000","last_change":"2023-10-25T16:17:17.667593+0000","last_active":"2023-10-25T16:17:18.712178+0000","last_peered":"2023-10-25T16:17:18.712178+0000","last_clean":"2023-10-25T16:17:18.712178+0000","last_became_active":"2023-10-25T16:17:17.666839+0000","last_became_peered":"2023-10-25T16:17:17.666839+0000","last_unstale":"2023-10-25T16:17:18.712178+0000","last_undegraded":"2023-10-25T16:17:18.712178+0000","last_fullsized":"2023-10-25T16:17:18.712178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:23.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711111+0000","last_change":"2023-10-25T16:17:17.669453+0000","last_active":"2023-10-25T16:17:18.711111+0000","last_peered":"2023-10-25T16:17:18.711111+0000","last_clean":"2023-10-25T16:17:18.711111+0000","last_became_active":"2023-10-25T16:17:17.665439+0000","last_became_peered":"2023-10-25T16:17:17.665439+0000","last_unstale":"2023-10-25T16:17:18.711111+0000","last_undegraded":"2023-10-25T16:17:18.711111+0000","last_fullsized":"2023-10-25T16:17:18.711111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:34.375540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633187+0000","last_change":"2023-10-25T16:17:17.640630+0000","last_active":"2023-10-25T16:17:18.633187+0000","last_peered":"2023-10-25T16:17:18.633187+0000","last_clean":"2023-10-25T16:17:18.633187+0000","last_became_active":"2023-10-25T16:17:17.639914+0000","last_became_peered":"2023-10-25T16:17:17.639914+0000","last_unstale":"2023-10-25T16:17:18.633187+0000","last_undegraded":"2023-10-25T16:17:18.633187+0000","last_fullsized":"2023-10-25T16:17:18.633187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706535+0000","last_change":"2023-10-25T16:17:17.672293+0000","last_active":"2023-10-25T16:17:18.706535+0000","last_peered":"2023-10-25T16:17:18.706535+0000","last_clean":"2023-10-25T16:17:18.706535+0000","last_became_active":"2023-10-25T16:17:17.671908+0000","last_became_peered":"2023-10-25T16:17:17.671908+0000","last_unstale":"2023-10-25T16:17:18.706535+0000","last_undegraded":"2023-10-25T16:17:18.706535+0000","last_fullsized":"2023-10-25T16:17:18.706535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:44.926052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222370+0000","last_change":"2023-10-25T16:17:17.661285+0000","last_active":"2023-10-25T16:17:19.222370+0000","last_peered":"2023-10-25T16:17:19.222370+0000","last_clean":"2023-10-25T16:17:19.222370+0000","last_became_active":"2023-10-25T16:17:17.659550+0000","last_became_peered":"2023-10-25T16:17:17.659550+0000","last_unstale":"2023-10-25T16:17:19.222370+0000","last_undegraded":"2023-10-25T16:17:19.222370+0000","last_fullsized":"2023-10-25T16:17:19.222370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222519+0000","last_change":"2023-10-25T16:17:17.656416+0000","last_active":"2023-10-25T16:17:19.222519+0000","last_peered":"2023-10-25T16:17:19.222519+0000","last_clean":"2023-10-25T16:17:19.222519+0000","last_became_active":"2023-10-25T16:17:17.655732+0000","last_became_peered":"2023-10-25T16:17:17.655732+0000","last_unstale":"2023-10-25T16:17:19.222519+0000","last_undegraded":"2023-10-25T16:17:19.222519+0000","last_fullsized":"2023-10-25T16:17:19.222519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710388+0000","last_change":"2023-10-25T16:17:17.668915+0000","last_active":"2023-10-25T16:17:18.710388+0000","last_peered":"2023-10-25T16:17:18.710388+0000","last_clean":"2023-10-25T16:17:18.710388+0000","last_became_active":"2023-10-25T16:17:17.668247+0000","last_became_peered":"2023-10-25T16:17:17.668247+0000","last_unstale":"2023-10-25T16:17:18.710388+0000","last_undegraded":"2023-10-25T16:17:18.710388+0000","last_fullsized":"2023-10-25T16:17:18.710388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:19.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706830+0000","last_change":"2023-10-25T16:17:17.664573+0000","last_active":"2023-10-25T16:17:18.706830+0000","last_peered":"2023-10-25T16:17:18.706830+0000","last_clean":"2023-10-25T16:17:18.706830+0000","last_became_active":"2023-10-25T16:17:17.663788+0000","last_became_peered":"2023-10-25T16:17:17.663788+0000","last_unstale":"2023-10-25T16:17:18.706830+0000","last_undegraded":"2023-10-25T16:17:18.706830+0000","last_fullsized":"2023-10-25T16:17:18.706830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711210+0000","last_change":"2023-10-25T16:17:17.672141+0000","last_active":"2023-10-25T16:17:18.711210+0000","last_peered":"2023-10-25T16:17:18.711210+0000","last_clean":"2023-10-25T16:17:18.711210+0000","last_became_active":"2023-10-25T16:17:17.671527+0000","last_became_peered":"2023-10-25T16:17:17.671527+0000","last_unstale":"2023-10-25T16:17:18.711210+0000","last_undegraded":"2023-10-25T16:17:18.711210+0000","last_fullsized":"2023-10-25T16:17:18.711210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:35.488420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222817+0000","last_change":"2023-10-25T16:17:17.640047+0000","last_active":"2023-10-25T16:17:19.222817+0000","last_peered":"2023-10-25T16:17:19.222817+0000","last_clean":"2023-10-25T16:17:19.222817+0000","last_became_active":"2023-10-25T16:17:17.639473+0000","last_became_peered":"2023-10-25T16:17:17.639473+0000","last_unstale":"2023-10-25T16:17:19.222817+0000","last_undegraded":"2023-10-25T16:17:19.222817+0000","last_fullsized":"2023-10-25T16:17:19.222817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710909+0000","last_change":"2023-10-25T16:17:17.646553+0000","last_active":"2023-10-25T16:17:18.710909+0000","last_peered":"2023-10-25T16:17:18.710909+0000","last_clean":"2023-10-25T16:17:18.710909+0000","last_became_active":"2023-10-25T16:17:17.645698+0000","last_became_peered":"2023-10-25T16:17:17.645698+0000","last_unstale":"2023-10-25T16:17:18.710909+0000","last_undegraded":"2023-10-25T16:17:18.710909+0000","last_fullsized":"2023-10-25T16:17:18.710909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:18:10.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710240+0000","last_change":"2023-10-25T16:17:17.660456+0000","last_active":"2023-10-25T16:17:18.710240+0000","last_peered":"2023-10-25T16:17:18.710240+0000","last_clean":"2023-10-25T16:17:18.710240+0000","last_became_active":"2023-10-25T16:17:17.658996+0000","last_became_peered":"2023-10-25T16:17:17.658996+0000","last_unstale":"2023-10-25T16:17:18.710240+0000","last_undegraded":"2023-10-25T16:17:18.710240+0000","last_fullsized":"2023-10-25T16:17:18.710240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:53.845062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632896+0000","last_change":"2023-10-25T16:17:17.641250+0000","last_active":"2023-10-25T16:17:18.632896+0000","last_peered":"2023-10-25T16:17:18.632896+0000","last_clean":"2023-10-25T16:17:18.632896+0000","last_became_active":"2023-10-25T16:17:17.640089+0000","last_became_peered":"2023-10-25T16:17:17.640089+0000","last_unstale":"2023-10-25T16:17:18.632896+0000","last_undegraded":"2023-10-25T16:17:18.632896+0000","last_fullsized":"2023-10-25T16:17:18.632896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:02.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632728+0000","last_change":"2023-10-25T16:17:17.665616+0000","last_active":"2023-10-25T16:17:18.632728+0000","last_peered":"2023-10-25T16:17:18.632728+0000","last_clean":"2023-10-25T16:17:18.632728+0000","last_became_active":"2023-10-25T16:17:17.664969+0000","last_became_peered":"2023-10-25T16:17:17.664969+0000","last_unstale":"2023-10-25T16:17:18.632728+0000","last_undegraded":"2023-10-25T16:17:18.632728+0000","last_fullsized":"2023-10-25T16:17:18.632728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:47:41.390733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711409+0000","last_change":"2023-10-25T16:17:17.646722+0000","last_active":"2023-10-25T16:17:18.711409+0000","last_peered":"2023-10-25T16:17:18.711409+0000","last_clean":"2023-10-25T16:17:18.711409+0000","last_became_active":"2023-10-25T16:17:17.645987+0000","last_became_peered":"2023-10-25T16:17:17.645987+0000","last_unstale":"2023-10-25T16:17:18.711409+0000","last_undegraded":"2023-10-25T16:17:18.711409+0000","last_fullsized":"2023-10-25T16:17:18.711409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:34.703288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710929+0000","last_change":"2023-10-25T16:17:17.670488+0000","last_active":"2023-10-25T16:17:18.710929+0000","last_peered":"2023-10-25T16:17:18.710929+0000","last_clean":"2023-10-25T16:17:18.710929+0000","last_became_active":"2023-10-25T16:17:17.669925+0000","last_became_peered":"2023-10-25T16:17:17.669925+0000","last_unstale":"2023-10-25T16:17:18.710929+0000","last_undegraded":"2023-10-25T16:17:18.710929+0000","last_fullsized":"2023-10-25T16:17:18.710929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:06.324016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222413+0000","last_change":"2023-10-25T16:17:17.641832+0000","last_active":"2023-10-25T16:17:19.222413+0000","last_peered":"2023-10-25T16:17:19.222413+0000","last_clean":"2023-10-25T16:17:19.222413+0000","last_became_active":"2023-10-25T16:17:17.641131+0000","last_became_peered":"2023-10-25T16:17:17.641131+0000","last_unstale":"2023-10-25T16:17:19.222413+0000","last_undegraded":"2023-10-25T16:17:19.222413+0000","last_fullsized":"2023-10-25T16:17:19.222413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:02.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709331+0000","last_change":"2023-10-25T16:17:17.657638+0000","last_active":"2023-10-25T16:17:18.709331+0000","last_peered":"2023-10-25T16:17:18.709331+0000","last_clean":"2023-10-25T16:17:18.709331+0000","last_became_active":"2023-10-25T16:17:17.657034+0000","last_became_peered":"2023-10-25T16:17:17.657034+0000","last_unstale":"2023-10-25T16:17:18.709331+0000","last_undegraded":"2023-10-25T16:17:18.709331+0000","last_fullsized":"2023-10-25T16:17:18.709331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:10.100210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222092+0000","last_change":"2023-10-25T16:17:17.642312+0000","last_active":"2023-10-25T16:17:19.222092+0000","last_peered":"2023-10-25T16:17:19.222092+0000","last_clean":"2023-10-25T16:17:19.222092+0000","last_became_active":"2023-10-25T16:17:17.641631+0000","last_became_peered":"2023-10-25T16:17:17.641631+0000","last_unstale":"2023-10-25T16:17:19.222092+0000","last_undegraded":"2023-10-25T16:17:19.222092+0000","last_fullsized":"2023-10-25T16:17:19.222092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:46.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711208+0000","last_change":"2023-10-25T16:17:17.658400+0000","last_active":"2023-10-25T16:17:18.711208+0000","last_peered":"2023-10-25T16:17:18.711208+0000","last_clean":"2023-10-25T16:17:18.711208+0000","last_became_active":"2023-10-25T16:17:17.657761+0000","last_became_peered":"2023-10-25T16:17:17.657761+0000","last_unstale":"2023-10-25T16:17:18.711208+0000","last_undegraded":"2023-10-25T16:17:18.711208+0000","last_fullsized":"2023-10-25T16:17:18.711208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:33:28.791708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711226+0000","last_change":"2023-10-25T16:17:17.658345+0000","last_active":"2023-10-25T16:17:18.711226+0000","last_peered":"2023-10-25T16:17:18.711226+0000","last_clean":"2023-10-25T16:17:18.711226+0000","last_became_active":"2023-10-25T16:17:17.657730+0000","last_became_peered":"2023-10-25T16:17:17.657730+0000","last_unstale":"2023-10-25T16:17:18.711226+0000","last_undegraded":"2023-10-25T16:17:18.711226+0000","last_fullsized":"2023-10-25T16:17:18.711226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:47.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711517+0000","last_change":"2023-10-25T16:17:17.665201+0000","last_active":"2023-10-25T16:17:18.711517+0000","last_peered":"2023-10-25T16:17:18.711517+0000","last_clean":"2023-10-25T16:17:18.711517+0000","last_became_active":"2023-10-25T16:17:17.664482+0000","last_became_peered":"2023-10-25T16:17:17.664482+0000","last_unstale":"2023-10-25T16:17:18.711517+0000","last_undegraded":"2023-10-25T16:17:18.711517+0000","last_fullsized":"2023-10-25T16:17:18.711517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:20.721957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633114+0000","last_change":"2023-10-25T16:17:17.663267+0000","last_active":"2023-10-25T16:17:18.633114+0000","last_peered":"2023-10-25T16:17:18.633114+0000","last_clean":"2023-10-25T16:17:18.633114+0000","last_became_active":"2023-10-25T16:17:17.662665+0000","last_became_peered":"2023-10-25T16:17:17.662665+0000","last_unstale":"2023-10-25T16:17:18.633114+0000","last_undegraded":"2023-10-25T16:17:18.633114+0000","last_fullsized":"2023-10-25T16:17:18.633114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:26:54.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"86'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633136+0000","last_change":"2023-10-25T16:17:16.904660+0000","last_active":"2023-10-25T16:17:18.633136+0000","last_peered":"2023-10-25T16:17:18.633136+0000","last_clean":"2023-10-25T16:17:18.633136+0000","last_became_active":"2023-10-25T16:17:16.903904+0000","last_became_peered":"2023-10-25T16:17:16.903904+0000","last_unstale":"2023-10-25T16:17:18.633136+0000","last_undegraded":"2023-10-25T16:17:18.633136+0000","last_fullsized":"2023-10-25T16:17:18.633136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:52:06.319525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221710+0000","last_change":"2023-10-25T16:17:16.892642+0000","last_active":"2023-10-25T16:17:19.221710+0000","last_peered":"2023-10-25T16:17:19.221710+0000","last_clean":"2023-10-25T16:17:19.221710+0000","last_became_active":"2023-10-25T16:17:16.892225+0000","last_became_peered":"2023-10-25T16:17:16.892225+0000","last_unstale":"2023-10-25T16:17:19.221710+0000","last_undegraded":"2023-10-25T16:17:19.221710+0000","last_fullsized":"2023-10-25T16:17:19.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:41.289281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710854+0000","last_change":"2023-10-25T16:17:17.673401+0000","last_active":"2023-10-25T16:17:18.710854+0000","last_peered":"2023-10-25T16:17:18.710854+0000","last_clean":"2023-10-25T16:17:18.710854+0000","last_became_active":"2023-10-25T16:17:17.667681+0000","last_became_peered":"2023-10-25T16:17:17.667681+0000","last_unstale":"2023-10-25T16:17:18.710854+0000","last_undegraded":"2023-10-25T16:17:18.710854+0000","last_fullsized":"2023-10-25T16:17:18.710854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:35.036194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712054+0000","last_change":"2023-10-25T16:17:16.916614+0000","last_active":"2023-10-25T16:17:18.712054+0000","last_peered":"2023-10-25T16:17:18.712054+0000","last_clean":"2023-10-25T16:17:18.712054+0000","last_became_active":"2023-10-25T16:17:16.914539+0000","last_became_peered":"2023-10-25T16:17:16.914539+0000","last_unstale":"2023-10-25T16:17:18.712054+0000","last_undegraded":"2023-10-25T16:17:18.712054+0000","last_fullsized":"2023-10-25T16:17:18.712054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:05.687178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633535+0000","last_change":"2023-10-25T16:17:17.641569+0000","last_active":"2023-10-25T16:17:18.633535+0000","last_peered":"2023-10-25T16:17:18.633535+0000","last_clean":"2023-10-25T16:17:18.633535+0000","last_became_active":"2023-10-25T16:17:17.640966+0000","last_became_peered":"2023-10-25T16:17:17.640966+0000","last_unstale":"2023-10-25T16:17:18.633535+0000","last_undegraded":"2023-10-25T16:17:18.633535+0000","last_fullsized":"2023-10-25T16:17:18.633535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711327+0000","last_change":"2023-10-25T16:17:16.922723+0000","last_active":"2023-10-25T16:17:18.711327+0000","last_peered":"2023-10-25T16:17:18.711327+0000","last_clean":"2023-10-25T16:17:18.711327+0000","last_became_active":"2023-10-25T16:17:16.920987+0000","last_became_peered":"2023-10-25T16:17:16.920987+0000","last_unstale":"2023-10-25T16:17:18.711327+0000","last_undegraded":"2023-10-25T16:17:18.711327+0000","last_fullsized":"2023-10-25T16:17:18.711327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:43.911566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709340+0000","last_change":"2023-10-25T16:17:17.645618+0000","last_active":"2023-10-25T16:17:18.709340+0000","last_peered":"2023-10-25T16:17:18.709340+0000","last_clean":"2023-10-25T16:17:18.709340+0000","last_became_active":"2023-10-25T16:17:17.645041+0000","last_became_peered":"2023-10-25T16:17:17.645041+0000","last_unstale":"2023-10-25T16:17:18.709340+0000","last_undegraded":"2023-10-25T16:17:18.709340+0000","last_fullsized":"2023-10-25T16:17:18.709340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:50:48.756330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222647+0000","last_change":"2023-10-25T16:17:16.900571+0000","last_active":"2023-10-25T16:17:19.222647+0000","last_peered":"2023-10-25T16:17:19.222647+0000","last_clean":"2023-10-25T16:17:19.222647+0000","last_became_active":"2023-10-25T16:17:16.900156+0000","last_became_peered":"2023-10-25T16:17:16.900156+0000","last_unstale":"2023-10-25T16:17:19.222647+0000","last_undegraded":"2023-10-25T16:17:19.222647+0000","last_fullsized":"2023-10-25T16:17:19.222647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:55.179521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710573+0000","last_change":"2023-10-25T16:17:17.643888+0000","last_active":"2023-10-25T16:17:18.710573+0000","last_peered":"2023-10-25T16:17:18.710573+0000","last_clean":"2023-10-25T16:17:18.710573+0000","last_became_active":"2023-10-25T16:17:17.643307+0000","last_became_peered":"2023-10-25T16:17:17.643307+0000","last_unstale":"2023-10-25T16:17:18.710573+0000","last_undegraded":"2023-10-25T16:17:18.710573+0000","last_fullsized":"2023-10-25T16:17:18.710573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:41:22.558797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712693+0000","last_change":"2023-10-25T16:17:16.914382+0000","last_active":"2023-10-25T16:17:18.712693+0000","last_peered":"2023-10-25T16:17:18.712693+0000","last_clean":"2023-10-25T16:17:18.712693+0000","last_became_active":"2023-10-25T16:17:16.913011+0000","last_became_peered":"2023-10-25T16:17:16.913011+0000","last_unstale":"2023-10-25T16:17:18.712693+0000","last_undegraded":"2023-10-25T16:17:18.712693+0000","last_fullsized":"2023-10-25T16:17:18.712693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:17.525133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706672+0000","last_change":"2023-10-25T16:17:16.902683+0000","last_active":"2023-10-25T16:17:18.706672+0000","last_peered":"2023-10-25T16:17:18.706672+0000","last_clean":"2023-10-25T16:17:18.706672+0000","last_became_active":"2023-10-25T16:17:16.902426+0000","last_became_peered":"2023-10-25T16:17:16.902426+0000","last_unstale":"2023-10-25T16:17:18.706672+0000","last_undegraded":"2023-10-25T16:17:18.706672+0000","last_fullsized":"2023-10-25T16:17:18.706672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:43.888268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221455+0000","last_change":"2023-10-25T16:17:17.641763+0000","last_active":"2023-10-25T16:17:19.221455+0000","last_peered":"2023-10-25T16:17:19.221455+0000","last_clean":"2023-10-25T16:17:19.221455+0000","last_became_active":"2023-10-25T16:17:17.641103+0000","last_became_peered":"2023-10-25T16:17:17.641103+0000","last_unstale":"2023-10-25T16:17:19.221455+0000","last_undegraded":"2023-10-25T16:17:19.221455+0000","last_fullsized":"2023-10-25T16:17:19.221455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870152+0000","last_change":"2023-10-25T16:17:15.870152+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870152+0000","last_undegraded":"2023-10-25T16:17:15.870152+0000","last_fullsized":"2023-10-25T16:17:15.870152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709804+0000","last_change":"2023-10-25T16:17:17.644435+0000","last_active":"2023-10-25T16:17:18.709804+0000","last_peered":"2023-10-25T16:17:18.709804+0000","last_clean":"2023-10-25T16:17:18.709804+0000","last_became_active":"2023-10-25T16:17:17.643844+0000","last_became_peered":"2023-10-25T16:17:17.643844+0000","last_unstale":"2023-10-25T16:17:18.709804+0000","last_undegraded":"2023-10-25T16:17:18.709804+0000","last_fullsized":"2023-10-25T16:17:18.709804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:26.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711119+0000","last_change":"2023-10-25T16:17:16.907112+0000","last_active":"2023-10-25T16:17:18.711119+0000","last_peered":"2023-10-25T16:17:18.711119+0000","last_clean":"2023-10-25T16:17:18.711119+0000","last_became_active":"2023-10-25T16:17:16.906553+0000","last_became_peered":"2023-10-25T16:17:16.906553+0000","last_unstale":"2023-10-25T16:17:18.711119+0000","last_undegraded":"2023-10-25T16:17:18.711119+0000","last_fullsized":"2023-10-25T16:17:18.711119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:44.314093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633375+0000","last_change":"2023-10-25T16:17:17.671535+0000","last_active":"2023-10-25T16:17:18.633375+0000","last_peered":"2023-10-25T16:17:18.633375+0000","last_clean":"2023-10-25T16:17:18.633375+0000","last_became_active":"2023-10-25T16:17:17.670757+0000","last_became_peered":"2023-10-25T16:17:17.670757+0000","last_unstale":"2023-10-25T16:17:18.633375+0000","last_undegraded":"2023-10-25T16:17:18.633375+0000","last_fullsized":"2023-10-25T16:17:18.633375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711730+0000","last_change":"2023-10-25T16:17:16.915546+0000","last_active":"2023-10-25T16:17:18.711730+0000","last_peered":"2023-10-25T16:17:18.711730+0000","last_clean":"2023-10-25T16:17:18.711730+0000","last_became_active":"2023-10-25T16:17:16.913965+0000","last_became_peered":"2023-10-25T16:17:16.913965+0000","last_unstale":"2023-10-25T16:17:18.711730+0000","last_undegraded":"2023-10-25T16:17:18.711730+0000","last_fullsized":"2023-10-25T16:17:18.711730+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:38.764460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712008+0000","last_change":"2023-10-25T16:17:17.664015+0000","last_active":"2023-10-25T16:17:18.712008+0000","last_peered":"2023-10-25T16:17:18.712008+0000","last_clean":"2023-10-25T16:17:18.712008+0000","last_became_active":"2023-10-25T16:17:17.657376+0000","last_became_peered":"2023-10-25T16:17:17.657376+0000","last_unstale":"2023-10-25T16:17:18.712008+0000","last_undegraded":"2023-10-25T16:17:18.712008+0000","last_fullsized":"2023-10-25T16:17:18.712008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:06.701664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"86'3","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222234+0000","last_change":"2023-10-25T16:17:16.889040+0000","last_active":"2023-10-25T16:17:19.222234+0000","last_peered":"2023-10-25T16:17:19.222234+0000","last_clean":"2023-10-25T16:17:19.222234+0000","last_became_active":"2023-10-25T16:17:16.888693+0000","last_became_peered":"2023-10-25T16:17:16.888693+0000","last_unstale":"2023-10-25T16:17:19.222234+0000","last_undegraded":"2023-10-25T16:17:19.222234+0000","last_fullsized":"2023-10-25T16:17:19.222234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:41.426292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"86'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706781+0000","last_change":"2023-10-25T16:17:16.895306+0000","last_active":"2023-10-25T16:17:18.706781+0000","last_peered":"2023-10-25T16:17:18.706781+0000","last_clean":"2023-10-25T16:17:18.706781+0000","last_became_active":"2023-10-25T16:17:16.894773+0000","last_became_peered":"2023-10-25T16:17:16.894773+0000","last_unstale":"2023-10-25T16:17:18.706781+0000","last_undegraded":"2023-10-25T16:17:18.706781+0000","last_fullsized":"2023-10-25T16:17:18.706781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633557+0000","last_change":"2023-10-25T16:17:17.663646+0000","last_active":"2023-10-25T16:17:18.633557+0000","last_peered":"2023-10-25T16:17:18.633557+0000","last_clean":"2023-10-25T16:17:18.633557+0000","last_became_active":"2023-10-25T16:17:17.661252+0000","last_became_peered":"2023-10-25T16:17:17.661252+0000","last_unstale":"2023-10-25T16:17:18.633557+0000","last_undegraded":"2023-10-25T16:17:18.633557+0000","last_fullsized":"2023-10-25T16:17:18.633557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706575+0000","last_change":"2023-10-25T16:17:16.902496+0000","last_active":"2023-10-25T16:17:18.706575+0000","last_peered":"2023-10-25T16:17:18.706575+0000","last_clean":"2023-10-25T16:17:18.706575+0000","last_became_active":"2023-10-25T16:17:16.902164+0000","last_became_peered":"2023-10-25T16:17:16.902164+0000","last_unstale":"2023-10-25T16:17:18.706575+0000","last_undegraded":"2023-10-25T16:17:18.706575+0000","last_fullsized":"2023-10-25T16:17:18.706575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:59.831665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711511+0000","last_change":"2023-10-25T16:17:17.647894+0000","last_active":"2023-10-25T16:17:18.711511+0000","last_peered":"2023-10-25T16:17:18.711511+0000","last_clean":"2023-10-25T16:17:18.711511+0000","last_became_active":"2023-10-25T16:17:17.647364+0000","last_became_peered":"2023-10-25T16:17:17.647364+0000","last_unstale":"2023-10-25T16:17:18.711511+0000","last_undegraded":"2023-10-25T16:17:18.711511+0000","last_fullsized":"2023-10-25T16:17:18.711511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:00.360348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711442+0000","last_change":"2023-10-25T16:17:16.922145+0000","last_active":"2023-10-25T16:17:18.711442+0000","last_peered":"2023-10-25T16:17:18.711442+0000","last_clean":"2023-10-25T16:17:18.711442+0000","last_became_active":"2023-10-25T16:17:16.919735+0000","last_became_peered":"2023-10-25T16:17:16.919735+0000","last_unstale":"2023-10-25T16:17:18.711442+0000","last_undegraded":"2023-10-25T16:17:18.711442+0000","last_fullsized":"2023-10-25T16:17:18.711442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:23.286095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222668+0000","last_change":"2023-10-25T16:17:17.660321+0000","last_active":"2023-10-25T16:17:19.222668+0000","last_peered":"2023-10-25T16:17:19.222668+0000","last_clean":"2023-10-25T16:17:19.222668+0000","last_became_active":"2023-10-25T16:17:17.657197+0000","last_became_peered":"2023-10-25T16:17:17.657197+0000","last_unstale":"2023-10-25T16:17:19.222668+0000","last_undegraded":"2023-10-25T16:17:19.222668+0000","last_fullsized":"2023-10-25T16:17:19.222668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710326+0000","last_change":"2023-10-25T16:17:16.912258+0000","last_active":"2023-10-25T16:17:18.710326+0000","last_peered":"2023-10-25T16:17:18.710326+0000","last_clean":"2023-10-25T16:17:18.710326+0000","last_became_active":"2023-10-25T16:17:16.909426+0000","last_became_peered":"2023-10-25T16:17:16.909426+0000","last_unstale":"2023-10-25T16:17:18.710326+0000","last_undegraded":"2023-10-25T16:17:18.710326+0000","last_fullsized":"2023-10-25T16:17:18.710326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:25:41.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"86'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709580+0000","last_change":"2023-10-25T16:17:16.910296+0000","last_active":"2023-10-25T16:17:18.709580+0000","last_peered":"2023-10-25T16:17:18.709580+0000","last_clean":"2023-10-25T16:17:18.709580+0000","last_became_active":"2023-10-25T16:17:16.908878+0000","last_became_peered":"2023-10-25T16:17:16.908878+0000","last_unstale":"2023-10-25T16:17:18.709580+0000","last_undegraded":"2023-10-25T16:17:18.709580+0000","last_fullsized":"2023-10-25T16:17:18.709580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:11.115383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711706+0000","last_change":"2023-10-25T16:17:17.656830+0000","last_active":"2023-10-25T16:17:18.711706+0000","last_peered":"2023-10-25T16:17:18.711706+0000","last_clean":"2023-10-25T16:17:18.711706+0000","last_became_active":"2023-10-25T16:17:17.655972+0000","last_became_peered":"2023-10-25T16:17:17.655972+0000","last_unstale":"2023-10-25T16:17:18.711706+0000","last_undegraded":"2023-10-25T16:17:18.711706+0000","last_fullsized":"2023-10-25T16:17:18.711706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:53.126893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712223+0000","last_change":"2023-10-25T16:17:16.908715+0000","last_active":"2023-10-25T16:17:18.712223+0000","last_peered":"2023-10-25T16:17:18.712223+0000","last_clean":"2023-10-25T16:17:18.712223+0000","last_became_active":"2023-10-25T16:17:16.907871+0000","last_became_peered":"2023-10-25T16:17:16.907871+0000","last_unstale":"2023-10-25T16:17:18.712223+0000","last_undegraded":"2023-10-25T16:17:18.712223+0000","last_fullsized":"2023-10-25T16:17:18.712223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:05:35.321099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633447+0000","last_change":"2023-10-25T16:17:17.668641+0000","last_active":"2023-10-25T16:17:18.633447+0000","last_peered":"2023-10-25T16:17:18.633447+0000","last_clean":"2023-10-25T16:17:18.633447+0000","last_became_active":"2023-10-25T16:17:17.667991+0000","last_became_peered":"2023-10-25T16:17:17.667991+0000","last_unstale":"2023-10-25T16:17:18.633447+0000","last_undegraded":"2023-10-25T16:17:18.633447+0000","last_fullsized":"2023-10-25T16:17:18.633447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712274+0000","last_change":"2023-10-25T16:17:16.917091+0000","last_active":"2023-10-25T16:17:18.712274+0000","last_peered":"2023-10-25T16:17:18.712274+0000","last_clean":"2023-10-25T16:17:18.712274+0000","last_became_active":"2023-10-25T16:17:16.916009+0000","last_became_peered":"2023-10-25T16:17:16.916009+0000","last_unstale":"2023-10-25T16:17:18.712274+0000","last_undegraded":"2023-10-25T16:17:18.712274+0000","last_fullsized":"2023-10-25T16:17:18.712274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:22.208994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706661+0000","last_change":"2023-10-25T16:17:17.662947+0000","last_active":"2023-10-25T16:17:18.706661+0000","last_peered":"2023-10-25T16:17:18.706661+0000","last_clean":"2023-10-25T16:17:18.706661+0000","last_became_active":"2023-10-25T16:17:17.658737+0000","last_became_peered":"2023-10-25T16:17:17.658737+0000","last_unstale":"2023-10-25T16:17:18.706661+0000","last_undegraded":"2023-10-25T16:17:18.706661+0000","last_fullsized":"2023-10-25T16:17:18.706661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:40.814420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711854+0000","last_change":"2023-10-25T16:17:16.922400+0000","last_active":"2023-10-25T16:17:18.711854+0000","last_peered":"2023-10-25T16:17:18.711854+0000","last_clean":"2023-10-25T16:17:18.711854+0000","last_became_active":"2023-10-25T16:17:16.920276+0000","last_became_peered":"2023-10-25T16:17:16.920276+0000","last_unstale":"2023-10-25T16:17:18.711854+0000","last_undegraded":"2023-10-25T16:17:18.711854+0000","last_fullsized":"2023-10-25T16:17:18.711854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:39.799934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633115+0000","last_change":"2023-10-25T16:17:16.908243+0000","last_active":"2023-10-25T16:17:18.633115+0000","last_peered":"2023-10-25T16:17:18.633115+0000","last_clean":"2023-10-25T16:17:18.633115+0000","last_became_active":"2023-10-25T16:17:16.907544+0000","last_became_peered":"2023-10-25T16:17:16.907544+0000","last_unstale":"2023-10-25T16:17:18.633115+0000","last_undegraded":"2023-10-25T16:17:18.633115+0000","last_fullsized":"2023-10-25T16:17:18.633115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:46.667209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221980+0000","last_change":"2023-10-25T16:17:17.667150+0000","last_active":"2023-10-25T16:17:19.221980+0000","last_peered":"2023-10-25T16:17:19.221980+0000","last_clean":"2023-10-25T16:17:19.221980+0000","last_became_active":"2023-10-25T16:17:17.666514+0000","last_became_peered":"2023-10-25T16:17:17.666514+0000","last_unstale":"2023-10-25T16:17:19.221980+0000","last_undegraded":"2023-10-25T16:17:19.221980+0000","last_fullsized":"2023-10-25T16:17:19.221980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:35.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712418+0000","last_change":"2023-10-25T16:17:16.902912+0000","last_active":"2023-10-25T16:17:18.712418+0000","last_peered":"2023-10-25T16:17:18.712418+0000","last_clean":"2023-10-25T16:17:18.712418+0000","last_became_active":"2023-10-25T16:17:16.901611+0000","last_became_peered":"2023-10-25T16:17:16.901611+0000","last_unstale":"2023-10-25T16:17:18.712418+0000","last_undegraded":"2023-10-25T16:17:18.712418+0000","last_fullsized":"2023-10-25T16:17:18.712418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222414+0000","last_change":"2023-10-25T16:17:17.668159+0000","last_active":"2023-10-25T16:17:19.222414+0000","last_peered":"2023-10-25T16:17:19.222414+0000","last_clean":"2023-10-25T16:17:19.222414+0000","last_became_active":"2023-10-25T16:17:17.667584+0000","last_became_peered":"2023-10-25T16:17:17.667584+0000","last_unstale":"2023-10-25T16:17:19.222414+0000","last_undegraded":"2023-10-25T16:17:19.222414+0000","last_fullsized":"2023-10-25T16:17:19.222414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:38:50.403559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711714+0000","last_change":"2023-10-25T16:17:16.899174+0000","last_active":"2023-10-25T16:17:18.711714+0000","last_peered":"2023-10-25T16:17:18.711714+0000","last_clean":"2023-10-25T16:17:18.711714+0000","last_became_active":"2023-10-25T16:17:16.897638+0000","last_became_peered":"2023-10-25T16:17:16.897638+0000","last_unstale":"2023-10-25T16:17:18.711714+0000","last_undegraded":"2023-10-25T16:17:18.711714+0000","last_fullsized":"2023-10-25T16:17:18.711714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:56.936496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221988+0000","last_change":"2023-10-25T16:17:17.661441+0000","last_active":"2023-10-25T16:17:19.221988+0000","last_peered":"2023-10-25T16:17:19.221988+0000","last_clean":"2023-10-25T16:17:19.221988+0000","last_became_active":"2023-10-25T16:17:17.660843+0000","last_became_peered":"2023-10-25T16:17:17.660843+0000","last_unstale":"2023-10-25T16:17:19.221988+0000","last_undegraded":"2023-10-25T16:17:19.221988+0000","last_fullsized":"2023-10-25T16:17:19.221988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:27.304996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221675+0000","last_change":"2023-10-25T16:17:16.891743+0000","last_active":"2023-10-25T16:17:19.221675+0000","last_peered":"2023-10-25T16:17:19.221675+0000","last_clean":"2023-10-25T16:17:19.221675+0000","last_became_active":"2023-10-25T16:17:16.891421+0000","last_became_peered":"2023-10-25T16:17:16.891421+0000","last_unstale":"2023-10-25T16:17:19.221675+0000","last_undegraded":"2023-10-25T16:17:19.221675+0000","last_fullsized":"2023-10-25T16:17:19.221675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:23.033726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222958+0000","last_change":"2023-10-25T16:17:17.660916+0000","last_active":"2023-10-25T16:17:19.222958+0000","last_peered":"2023-10-25T16:17:19.222958+0000","last_clean":"2023-10-25T16:17:19.222958+0000","last_became_active":"2023-10-25T16:17:17.658152+0000","last_became_peered":"2023-10-25T16:17:17.658152+0000","last_unstale":"2023-10-25T16:17:19.222958+0000","last_undegraded":"2023-10-25T16:17:19.222958+0000","last_fullsized":"2023-10-25T16:17:19.222958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711950+0000","last_change":"2023-10-25T16:17:16.912609+0000","last_active":"2023-10-25T16:17:18.711950+0000","last_peered":"2023-10-25T16:17:18.711950+0000","last_clean":"2023-10-25T16:17:18.711950+0000","last_became_active":"2023-10-25T16:17:16.908119+0000","last_became_peered":"2023-10-25T16:17:16.908119+0000","last_unstale":"2023-10-25T16:17:18.711950+0000","last_undegraded":"2023-10-25T16:17:18.711950+0000","last_fullsized":"2023-10-25T16:17:18.711950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:51.627276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710119+0000","last_change":"2023-10-25T16:17:17.663862+0000","last_active":"2023-10-25T16:17:18.710119+0000","last_peered":"2023-10-25T16:17:18.710119+0000","last_clean":"2023-10-25T16:17:18.710119+0000","last_became_active":"2023-10-25T16:17:17.662309+0000","last_became_peered":"2023-10-25T16:17:17.662309+0000","last_unstale":"2023-10-25T16:17:18.710119+0000","last_undegraded":"2023-10-25T16:17:18.710119+0000","last_fullsized":"2023-10-25T16:17:18.710119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:20:41.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709789+0000","last_change":"2023-10-25T16:17:16.909558+0000","last_active":"2023-10-25T16:17:18.709789+0000","last_peered":"2023-10-25T16:17:18.709789+0000","last_clean":"2023-10-25T16:17:18.709789+0000","last_became_active":"2023-10-25T16:17:16.908758+0000","last_became_peered":"2023-10-25T16:17:16.908758+0000","last_unstale":"2023-10-25T16:17:18.709789+0000","last_undegraded":"2023-10-25T16:17:18.709789+0000","last_fullsized":"2023-10-25T16:17:18.709789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:18:52.859828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633861+0000","last_change":"2023-10-25T16:17:17.660209+0000","last_active":"2023-10-25T16:17:18.633861+0000","last_peered":"2023-10-25T16:17:18.633861+0000","last_clean":"2023-10-25T16:17:18.633861+0000","last_became_active":"2023-10-25T16:17:17.659576+0000","last_became_peered":"2023-10-25T16:17:17.659576+0000","last_unstale":"2023-10-25T16:17:18.633861+0000","last_undegraded":"2023-10-25T16:17:18.633861+0000","last_fullsized":"2023-10-25T16:17:18.633861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:41:33.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870150+0000","last_change":"2023-10-25T16:17:15.870150+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870150+0000","last_undegraded":"2023-10-25T16:17:15.870150+0000","last_fullsized":"2023-10-25T16:17:15.870150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633812+0000","last_change":"2023-10-25T16:17:17.641836+0000","last_active":"2023-10-25T16:17:18.633812+0000","last_peered":"2023-10-25T16:17:18.633812+0000","last_clean":"2023-10-25T16:17:18.633812+0000","last_became_active":"2023-10-25T16:17:17.640900+0000","last_became_peered":"2023-10-25T16:17:17.640900+0000","last_unstale":"2023-10-25T16:17:18.633812+0000","last_undegraded":"2023-10-25T16:17:18.633812+0000","last_fullsized":"2023-10-25T16:17:18.633812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.223013+0000","last_change":"2023-10-25T16:17:16.907260+0000","last_active":"2023-10-25T16:17:19.223013+0000","last_peered":"2023-10-25T16:17:19.223013+0000","last_clean":"2023-10-25T16:17:19.223013+0000","last_became_active":"2023-10-25T16:17:16.907025+0000","last_became_peered":"2023-10-25T16:17:16.907025+0000","last_unstale":"2023-10-25T16:17:19.223013+0000","last_undegraded":"2023-10-25T16:17:19.223013+0000","last_fullsized":"2023-10-25T16:17:19.223013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:01.984830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870220+0000","last_change":"2023-10-25T16:17:15.870220+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870220+0000","last_undegraded":"2023-10-25T16:17:15.870220+0000","last_fullsized":"2023-10-25T16:17:15.870220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711184+0000","last_change":"2023-10-25T16:17:17.672992+0000","last_active":"2023-10-25T16:17:18.711184+0000","last_peered":"2023-10-25T16:17:18.711184+0000","last_clean":"2023-10-25T16:17:18.711184+0000","last_became_active":"2023-10-25T16:17:17.666970+0000","last_became_peered":"2023-10-25T16:17:17.666970+0000","last_unstale":"2023-10-25T16:17:18.711184+0000","last_undegraded":"2023-10-25T16:17:18.711184+0000","last_fullsized":"2023-10-25T16:17:18.711184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:31.108645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706743+0000","last_change":"2023-10-25T16:17:16.905625+0000","last_active":"2023-10-25T16:17:18.706743+0000","last_peered":"2023-10-25T16:17:18.706743+0000","last_clean":"2023-10-25T16:17:18.706743+0000","last_became_active":"2023-10-25T16:17:16.905397+0000","last_became_peered":"2023-10-25T16:17:16.905397+0000","last_unstale":"2023-10-25T16:17:18.706743+0000","last_undegraded":"2023-10-25T16:17:18.706743+0000","last_fullsized":"2023-10-25T16:17:18.706743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706602+0000","last_change":"2023-10-25T16:17:17.669175+0000","last_active":"2023-10-25T16:17:18.706602+0000","last_peered":"2023-10-25T16:17:18.706602+0000","last_clean":"2023-10-25T16:17:18.706602+0000","last_became_active":"2023-10-25T16:17:17.668211+0000","last_became_peered":"2023-10-25T16:17:17.668211+0000","last_unstale":"2023-10-25T16:17:18.706602+0000","last_undegraded":"2023-10-25T16:17:18.706602+0000","last_fullsized":"2023-10-25T16:17:18.706602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:24.300581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709817+0000","last_change":"2023-10-25T16:17:16.910651+0000","last_active":"2023-10-25T16:17:18.709817+0000","last_peered":"2023-10-25T16:17:18.709817+0000","last_clean":"2023-10-25T16:17:18.709817+0000","last_became_active":"2023-10-25T16:17:16.909696+0000","last_became_peered":"2023-10-25T16:17:16.909696+0000","last_unstale":"2023-10-25T16:17:18.709817+0000","last_undegraded":"2023-10-25T16:17:18.709817+0000","last_fullsized":"2023-10-25T16:17:18.709817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:53.032575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712481+0000","last_change":"2023-10-25T16:17:17.671027+0000","last_active":"2023-10-25T16:17:18.712481+0000","last_peered":"2023-10-25T16:17:18.712481+0000","last_clean":"2023-10-25T16:17:18.712481+0000","last_became_active":"2023-10-25T16:17:17.669539+0000","last_became_peered":"2023-10-25T16:17:17.669539+0000","last_unstale":"2023-10-25T16:17:18.712481+0000","last_undegraded":"2023-10-25T16:17:18.712481+0000","last_fullsized":"2023-10-25T16:17:18.712481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:34.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712622+0000","last_change":"2023-10-25T16:17:16.902431+0000","last_active":"2023-10-25T16:17:18.712622+0000","last_peered":"2023-10-25T16:17:18.712622+0000","last_clean":"2023-10-25T16:17:18.712622+0000","last_became_active":"2023-10-25T16:17:16.900783+0000","last_became_peered":"2023-10-25T16:17:16.900783+0000","last_unstale":"2023-10-25T16:17:18.712622+0000","last_undegraded":"2023-10-25T16:17:18.712622+0000","last_fullsized":"2023-10-25T16:17:18.712622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222267+0000","last_change":"2023-10-25T16:17:17.666667+0000","last_active":"2023-10-25T16:17:19.222267+0000","last_peered":"2023-10-25T16:17:19.222267+0000","last_clean":"2023-10-25T16:17:19.222267+0000","last_became_active":"2023-10-25T16:17:17.666071+0000","last_became_peered":"2023-10-25T16:17:17.666071+0000","last_unstale":"2023-10-25T16:17:19.222267+0000","last_undegraded":"2023-10-25T16:17:19.222267+0000","last_fullsized":"2023-10-25T16:17:19.222267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:14:54.061159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712904+0000","last_change":"2023-10-25T16:17:16.913949+0000","last_active":"2023-10-25T16:17:18.712904+0000","last_peered":"2023-10-25T16:17:18.712904+0000","last_clean":"2023-10-25T16:17:18.712904+0000","last_became_active":"2023-10-25T16:17:16.911491+0000","last_became_peered":"2023-10-25T16:17:16.911491+0000","last_unstale":"2023-10-25T16:17:18.712904+0000","last_undegraded":"2023-10-25T16:17:18.712904+0000","last_fullsized":"2023-10-25T16:17:18.712904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:55.386778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.633792+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:17:17.633792+0000","last_peered":"2023-10-25T16:17:17.633792+0000","last_clean":"2023-10-25T16:17:17.633792+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:17:17.633792+0000","last_undegraded":"2023-10-25T16:17:17.633792+0000","last_fullsized":"2023-10-25T16:17:17.633792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:15.165202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":434,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194877,"statfs":{"total":200000000,"available":199554963,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.88900000000000001,"5min":1.077,"15min":1.077},"last":0.432}]},{"osd":1,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.307,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0309999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59599999999999997,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.87,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.61599999999999999,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2529999999999999,"5min":1.345,"15min":1.345},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.1919999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83999999999999997},"min":{"1min":0.73599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.60999999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.1639999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.67900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.147,"5min":1.581,"15min":1.581},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.90200000000000002,"15min":0.878},"min":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.131,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90600000000000003,"15min":0.92700000000000005},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.155,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92300000000000004,"15min":0.91100000000000003},"min":{"1min":0.79600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.133,"5min":1.677,"15min":1.677},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95999999999999996,"15min":0.95499999999999996},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2050000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.61699999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1030,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0920000000000001,"5min":1.256,"15min":1.256},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.83099999999999996},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.91500000000000004,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.29,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.2410000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.85599999999999998,"15min":0.82999999999999996},"min":{"1min":0.58399999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1910000000000001,"5min":1.27,"15min":1.27},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.71199999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.159,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3420000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.97399999999999998,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0289999999999999,"15min":1.0389999999999999},"min":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.151},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1259999999999999},"min":{"1min":0.72399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.397,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.86399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.397,"15min":1.397},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.224,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90100000000000002,"15min":0.88500000000000001},"min":{"1min":0.626,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2090000000000001,"5min":1.302,"15min":1.302},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.754,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.119,"5min":1.476,"15min":1.476},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.018,"5min":0.92200000000000004,"15min":0.88400000000000001},"min":{"1min":0.81599999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.749},{"interface":"front","average":{"1min":1.016,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.77000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2330000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2250000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.99199999999999999},"min":{"1min":0.70599999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":1.413,"15min":1.413},"last":0.92100000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.96899999999999997},"min":{"1min":0.72899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.65800000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3400000000000001,"5min":1.895,"15min":1.895},"last":1.046}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.081,"15min":1.079},"min":{"1min":0.81799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3049999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0640000000000001,"15min":1.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.296,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.1259999999999999,"15min":1.3700000000000001},"min":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.661,"5min":14.843,"15min":14.843},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.173,"15min":1.5149999999999999},"min":{"1min":0.66100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":16.439,"15min":16.439},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.161,"15min":1.4370000000000001},"min":{"1min":0.64300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2150000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.157},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88700000000000001,"15min":0.86799999999999999},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.224,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.129}]},{"osd":2,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.91800000000000004,"15min":0.93600000000000005},"min":{"1min":0.77900000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.22,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.97099999999999997,"15min":0.96699999999999997},"min":{"1min":0.63300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2470000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.98099999999999998,"15min":0.99099999999999999},"min":{"1min":0.80300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1699999999999999,"5min":1.252,"15min":1.252},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.323,"15min":1.5389999999999999},"min":{"1min":1.0580000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8149999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3140000000000001,"15min":1.625},"min":{"1min":0.68600000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":15.904,"15min":15.904},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.3069999999999999,"15min":1.6559999999999999},"min":{"1min":0.75800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.879,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.278,"15min":1.524},"min":{"1min":0.67800000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.748,"5min":14.567,"15min":14.567},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.4450000000000001,"15min":1.7390000000000001},"min":{"1min":0.89500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.599,"5min":15.089,"15min":15.089},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.397,"15min":1.7729999999999999},"min":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7090000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1970000000000001,"15min":1.272},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9530000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82799999999999996,"15min":0.80000000000000004},"min":{"1min":0.66900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.327,"5min":1.47,"15min":1.47},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.85899999999999999,"15min":0.81799999999999995},"min":{"1min":0.71299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":1.1659999999999999,"5min":1.288,"15min":1.288},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.58899999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":0.89300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2290000000000001,"5min":1.369,"15min":1.369},"last":1.052},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.78500000000000003},"min":{"1min":0.64100000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.518,"15min":1.518},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.69499999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.121,"15min":1.121},"min":{"1min":0.91200000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.24}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":2.085,"15min":2.085},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.329}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.196,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":1.0289999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":447,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194865,"statfs":{"total":200000000,"available":199541801,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.59799999999999998,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.25700000000000001,"5min":0.222,"15min":0.222},"max":{"1min":1.004,"5min":1.083,"15min":1.083},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.255,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.99399999999999999,"15min":0.98699999999999999},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.427,"15min":1.427},"last":0.78600000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.214,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3720000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.306,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.663,"15min":1.663},"last":0.93700000000000006}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.58099999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.47,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.038},{"interface":"front","average":{"1min":1.022,"5min":0.96999999999999997,"15min":0.94599999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.252,"5min":1.389,"15min":1.389},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":455,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194856,"statfs":{"total":200000000,"available":199533385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.97099999999999997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.129,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.318}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.58899999999999997,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1499999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.318,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.371,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.034,"5min":1.423,"15min":1.423},"last":0.375}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.05,"15min":0.97699999999999998},"min":{"1min":0.69199999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":12.698,"15min":12.698},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.1000000000000001,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.214,"5min":12.721,"15min":12.721},"last":0.84699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.92900000000000005,"15min":0.91700000000000004},"min":{"1min":0.57999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2549999999999999,"5min":1.546,"15min":1.546},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2290000000000001,"5min":2.206,"15min":2.206},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":1.022},"min":{"1min":0.69199999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.381,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0980000000000001,"15min":0.98199999999999998},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.268,"5min":14.776,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.093,"15min":1.0169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4339999999999999,"5min":10.509,"15min":10.509},"last":1.0640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1023,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194288,"statfs":{"total":200000000,"available":198951545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.70499999999999996},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.94899999999999995,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.749},"min":{"1min":0.34899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0069999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84899999999999998,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95199999999999996,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.78500000000000003},"min":{"1min":0.33100000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":1.101},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.45300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1699999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.68400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0960000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.93000000000000005},"min":{"1min":0.64700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.997}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.88200000000000001,"15min":0.85299999999999998},"min":{"1min":0.73399999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2190000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91900000000000004,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.105,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.206,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93200000000000005,"15min":0.91700000000000004},"min":{"1min":0.82399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2869999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.121}]},{"osd":7,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.3220000000000001},"min":{"1min":0.81799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3080000000000001,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1619999999999999,"15min":1.339},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3360000000000001,"5min":11.622,"15min":11.622},"last":1.073}]}]}],"pool_statfs":[]}} 2023-10-25T16:17:21.260 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:17:21.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1811546121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a580af2d0 msgr2=0x7f4a58158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1811546121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a580af2d0 0x7f4a58158170 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4a580cdef0 tx=0x7f4a5001cd20 comp rx=0 tx=0).stop 2023-10-25T16:17:21.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1811546121 shutdown_connections 2023-10-25T16:17:21.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1811546121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a580af2d0 0x7f4a58158170 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1811546121 >> v2:172.21.15.184:3300/0 conn(0x7f4a5814e810 0x7f4a580cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1811546121 >> 172.21.15.177:0/1811546121 conn(0x7f4a580b2450 msgr2=0x7f4a580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:21.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1811546121 shutdown_connections 2023-10-25T16:17:21.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.409+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1811546121 wait complete. 2023-10-25T16:17:21.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 Processor -- start 2023-10-25T16:17:21.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- start start 2023-10-25T16:17:21.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a580af2d0 0x7f4a58141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 0x7f4a5814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a5815bdb0 0x7f4a5814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581420c0 con 0x7f4a5814e810 2023-10-25T16:17:21.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5814bab0 con 0x7f4a5815bdb0 2023-10-25T16:17:21.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5814abe0 con 0x7f4a580af2d0 2023-10-25T16:17:21.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 0x7f4a5814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 0x7f4a5814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34552/0 (socket says 172.21.15.177:34552) 2023-10-25T16:17:21.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 -- 172.21.15.177:0/1875428455 learned_addr learned my addr 172.21.15.177:0/1875428455 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:21.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 -- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a580af2d0 msgr2=0x7f4a58141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a580af2d0 0x7f4a58141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 -- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a5815bdb0 msgr2=0x7f4a5814d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a5815bdb0 0x7f4a5814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 -- 172.21.15.177:0/1875428455 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500098e0 con 0x7f4a5814e810 2023-10-25T16:17:21.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a56ffd640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 0x7f4a5814a6a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c490 tx=0x7f4a4c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:21.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c003600 con 0x7f4a5814e810 2023-10-25T16:17:21.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a4c003780 con 0x7f4a5814e810 2023-10-25T16:17:21.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5814aea0 con 0x7f4a5814e810 2023-10-25T16:17:21.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c003bd0 con 0x7f4a5814e810 2023-10-25T16:17:21.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5814b460 con 0x7f4a5814e810 2023-10-25T16:17:21.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.413+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5804daf0 con 0x7f4a5814e810 2023-10-25T16:17:21.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.417+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4a4c003d30 con 0x7f4a5814e810 2023-10-25T16:17:21.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.417+0000 7f4a3ffff640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4a440664a0 0x7f4a44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.417+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a4c083550 con 0x7f4a5814e810 2023-10-25T16:17:21.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.417+0000 7f4a577fe640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4a440664a0 0x7f4a44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.417+0000 7f4a577fe640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4a440664a0 0x7f4a44068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4a58066e50 tx=0x7f4a48005c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:21.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.421+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a4c0509d0 con 0x7f4a5814e810 2023-10-25T16:17:21.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.561+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a580aebb0 con 0x7f4a440664a0 2023-10-25T16:17:21.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a3ffff640 1 -- 172.21.15.177:0/1875428455 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282406 (secure 0 0 0) 0x7f4a580aebb0 con 0x7f4a440664a0 2023-10-25T16:17:21.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:21.589 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:17:21.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4a440664a0 msgr2=0x7f4a44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4a440664a0 0x7f4a44068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4a58066e50 tx=0x7f4a48005c00 comp rx=0 tx=0).stop 2023-10-25T16:17:21.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 msgr2=0x7f4a5814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 0x7f4a5814a6a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c490 tx=0x7f4a4c00c950 comp rx=0 tx=0).stop 2023-10-25T16:17:21.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 shutdown_connections 2023-10-25T16:17:21.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4a440664a0 0x7f4a44068960 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a5815bdb0 0x7f4a5814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a5814e810 0x7f4a5814a6a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 --2- 172.21.15.177:0/1875428455 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4a580af2d0 0x7f4a58141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 >> 172.21.15.177:0/1875428455 conn(0x7f4a580b2450 msgr2=0x7f4a580b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:21.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 shutdown_connections 2023-10-25T16:17:21.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.585+0000 7f4a5dbcb640 1 -- 172.21.15.177:0/1875428455 wait complete. 2023-10-25T16:17:21.605 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-10-25T16:17:20.691748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4753,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557746,"statfs":{"total":1600000000,"available":1595132910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821332"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632846+0000","last_change":"2023-10-25T16:17:17.664185+0000","last_active":"2023-10-25T16:17:18.632846+0000","last_peered":"2023-10-25T16:17:18.632846+0000","last_clean":"2023-10-25T16:17:18.632846+0000","last_became_active":"2023-10-25T16:17:17.662766+0000","last_became_peered":"2023-10-25T16:17:17.662766+0000","last_unstale":"2023-10-25T16:17:18.632846+0000","last_undegraded":"2023-10-25T16:17:18.632846+0000","last_fullsized":"2023-10-25T16:17:18.632846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:24.048212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711163+0000","last_change":"2023-10-25T16:17:17.657987+0000","last_active":"2023-10-25T16:17:18.711163+0000","last_peered":"2023-10-25T16:17:18.711163+0000","last_clean":"2023-10-25T16:17:18.711163+0000","last_became_active":"2023-10-25T16:17:17.657323+0000","last_became_peered":"2023-10-25T16:17:17.657323+0000","last_unstale":"2023-10-25T16:17:18.711163+0000","last_undegraded":"2023-10-25T16:17:18.711163+0000","last_fullsized":"2023-10-25T16:17:18.711163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:54.047062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221594+0000","last_change":"2023-10-25T16:17:17.641611+0000","last_active":"2023-10-25T16:17:19.221594+0000","last_peered":"2023-10-25T16:17:19.221594+0000","last_clean":"2023-10-25T16:17:19.221594+0000","last_became_active":"2023-10-25T16:17:17.640892+0000","last_became_peered":"2023-10-25T16:17:17.640892+0000","last_unstale":"2023-10-25T16:17:19.221594+0000","last_undegraded":"2023-10-25T16:17:19.221594+0000","last_fullsized":"2023-10-25T16:17:19.221594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:10.948309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706444+0000","last_change":"2023-10-25T16:17:17.668748+0000","last_active":"2023-10-25T16:17:18.706444+0000","last_peered":"2023-10-25T16:17:18.706444+0000","last_clean":"2023-10-25T16:17:18.706444+0000","last_became_active":"2023-10-25T16:17:17.667153+0000","last_became_peered":"2023-10-25T16:17:17.667153+0000","last_unstale":"2023-10-25T16:17:18.706444+0000","last_undegraded":"2023-10-25T16:17:18.706444+0000","last_fullsized":"2023-10-25T16:17:18.706444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:52.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710526+0000","last_change":"2023-10-25T16:17:17.674620+0000","last_active":"2023-10-25T16:17:18.710526+0000","last_peered":"2023-10-25T16:17:18.710526+0000","last_clean":"2023-10-25T16:17:18.710526+0000","last_became_active":"2023-10-25T16:17:17.672434+0000","last_became_peered":"2023-10-25T16:17:17.672434+0000","last_unstale":"2023-10-25T16:17:18.710526+0000","last_undegraded":"2023-10-25T16:17:18.710526+0000","last_fullsized":"2023-10-25T16:17:18.710526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709443+0000","last_change":"2023-10-25T16:17:17.663316+0000","last_active":"2023-10-25T16:17:18.709443+0000","last_peered":"2023-10-25T16:17:18.709443+0000","last_clean":"2023-10-25T16:17:18.709443+0000","last_became_active":"2023-10-25T16:17:17.660398+0000","last_became_peered":"2023-10-25T16:17:17.660398+0000","last_unstale":"2023-10-25T16:17:18.709443+0000","last_undegraded":"2023-10-25T16:17:18.709443+0000","last_fullsized":"2023-10-25T16:17:18.709443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:10:29.345764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712178+0000","last_change":"2023-10-25T16:17:17.667593+0000","last_active":"2023-10-25T16:17:18.712178+0000","last_peered":"2023-10-25T16:17:18.712178+0000","last_clean":"2023-10-25T16:17:18.712178+0000","last_became_active":"2023-10-25T16:17:17.666839+0000","last_became_peered":"2023-10-25T16:17:17.666839+0000","last_unstale":"2023-10-25T16:17:18.712178+0000","last_undegraded":"2023-10-25T16:17:18.712178+0000","last_fullsized":"2023-10-25T16:17:18.712178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:23.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711111+0000","last_change":"2023-10-25T16:17:17.669453+0000","last_active":"2023-10-25T16:17:18.711111+0000","last_peered":"2023-10-25T16:17:18.711111+0000","last_clean":"2023-10-25T16:17:18.711111+0000","last_became_active":"2023-10-25T16:17:17.665439+0000","last_became_peered":"2023-10-25T16:17:17.665439+0000","last_unstale":"2023-10-25T16:17:18.711111+0000","last_undegraded":"2023-10-25T16:17:18.711111+0000","last_fullsized":"2023-10-25T16:17:18.711111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:34.375540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633187+0000","last_change":"2023-10-25T16:17:17.640630+0000","last_active":"2023-10-25T16:17:18.633187+0000","last_peered":"2023-10-25T16:17:18.633187+0000","last_clean":"2023-10-25T16:17:18.633187+0000","last_became_active":"2023-10-25T16:17:17.639914+0000","last_became_peered":"2023-10-25T16:17:17.639914+0000","last_unstale":"2023-10-25T16:17:18.633187+0000","last_undegraded":"2023-10-25T16:17:18.633187+0000","last_fullsized":"2023-10-25T16:17:18.633187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706535+0000","last_change":"2023-10-25T16:17:17.672293+0000","last_active":"2023-10-25T16:17:18.706535+0000","last_peered":"2023-10-25T16:17:18.706535+0000","last_clean":"2023-10-25T16:17:18.706535+0000","last_became_active":"2023-10-25T16:17:17.671908+0000","last_became_peered":"2023-10-25T16:17:17.671908+0000","last_unstale":"2023-10-25T16:17:18.706535+0000","last_undegraded":"2023-10-25T16:17:18.706535+0000","last_fullsized":"2023-10-25T16:17:18.706535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:44.926052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222370+0000","last_change":"2023-10-25T16:17:17.661285+0000","last_active":"2023-10-25T16:17:19.222370+0000","last_peered":"2023-10-25T16:17:19.222370+0000","last_clean":"2023-10-25T16:17:19.222370+0000","last_became_active":"2023-10-25T16:17:17.659550+0000","last_became_peered":"2023-10-25T16:17:17.659550+0000","last_unstale":"2023-10-25T16:17:19.222370+0000","last_undegraded":"2023-10-25T16:17:19.222370+0000","last_fullsized":"2023-10-25T16:17:19.222370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222519+0000","last_change":"2023-10-25T16:17:17.656416+0000","last_active":"2023-10-25T16:17:19.222519+0000","last_peered":"2023-10-25T16:17:19.222519+0000","last_clean":"2023-10-25T16:17:19.222519+0000","last_became_active":"2023-10-25T16:17:17.655732+0000","last_became_peered":"2023-10-25T16:17:17.655732+0000","last_unstale":"2023-10-25T16:17:19.222519+0000","last_undegraded":"2023-10-25T16:17:19.222519+0000","last_fullsized":"2023-10-25T16:17:19.222519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710388+0000","last_change":"2023-10-25T16:17:17.668915+0000","last_active":"2023-10-25T16:17:18.710388+0000","last_peered":"2023-10-25T16:17:18.710388+0000","last_clean":"2023-10-25T16:17:18.710388+0000","last_became_active":"2023-10-25T16:17:17.668247+0000","last_became_peered":"2023-10-25T16:17:17.668247+0000","last_unstale":"2023-10-25T16:17:18.710388+0000","last_undegraded":"2023-10-25T16:17:18.710388+0000","last_fullsized":"2023-10-25T16:17:18.710388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:19.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706830+0000","last_change":"2023-10-25T16:17:17.664573+0000","last_active":"2023-10-25T16:17:18.706830+0000","last_peered":"2023-10-25T16:17:18.706830+0000","last_clean":"2023-10-25T16:17:18.706830+0000","last_became_active":"2023-10-25T16:17:17.663788+0000","last_became_peered":"2023-10-25T16:17:17.663788+0000","last_unstale":"2023-10-25T16:17:18.706830+0000","last_undegraded":"2023-10-25T16:17:18.706830+0000","last_fullsized":"2023-10-25T16:17:18.706830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711210+0000","last_change":"2023-10-25T16:17:17.672141+0000","last_active":"2023-10-25T16:17:18.711210+0000","last_peered":"2023-10-25T16:17:18.711210+0000","last_clean":"2023-10-25T16:17:18.711210+0000","last_became_active":"2023-10-25T16:17:17.671527+0000","last_became_peered":"2023-10-25T16:17:17.671527+0000","last_unstale":"2023-10-25T16:17:18.711210+0000","last_undegraded":"2023-10-25T16:17:18.711210+0000","last_fullsized":"2023-10-25T16:17:18.711210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:35.488420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222817+0000","last_change":"2023-10-25T16:17:17.640047+0000","last_active":"2023-10-25T16:17:19.222817+0000","last_peered":"2023-10-25T16:17:19.222817+0000","last_clean":"2023-10-25T16:17:19.222817+0000","last_became_active":"2023-10-25T16:17:17.639473+0000","last_became_peered":"2023-10-25T16:17:17.639473+0000","last_unstale":"2023-10-25T16:17:19.222817+0000","last_undegraded":"2023-10-25T16:17:19.222817+0000","last_fullsized":"2023-10-25T16:17:19.222817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710909+0000","last_change":"2023-10-25T16:17:17.646553+0000","last_active":"2023-10-25T16:17:18.710909+0000","last_peered":"2023-10-25T16:17:18.710909+0000","last_clean":"2023-10-25T16:17:18.710909+0000","last_became_active":"2023-10-25T16:17:17.645698+0000","last_became_peered":"2023-10-25T16:17:17.645698+0000","last_unstale":"2023-10-25T16:17:18.710909+0000","last_undegraded":"2023-10-25T16:17:18.710909+0000","last_fullsized":"2023-10-25T16:17:18.710909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:18:10.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710240+0000","last_change":"2023-10-25T16:17:17.660456+0000","last_active":"2023-10-25T16:17:18.710240+0000","last_peered":"2023-10-25T16:17:18.710240+0000","last_clean":"2023-10-25T16:17:18.710240+0000","last_became_active":"2023-10-25T16:17:17.658996+0000","last_became_peered":"2023-10-25T16:17:17.658996+0000","last_unstale":"2023-10-25T16:17:18.710240+0000","last_undegraded":"2023-10-25T16:17:18.710240+0000","last_fullsized":"2023-10-25T16:17:18.710240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:53.845062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632896+0000","last_change":"2023-10-25T16:17:17.641250+0000","last_active":"2023-10-25T16:17:18.632896+0000","last_peered":"2023-10-25T16:17:18.632896+0000","last_clean":"2023-10-25T16:17:18.632896+0000","last_became_active":"2023-10-25T16:17:17.640089+0000","last_became_peered":"2023-10-25T16:17:17.640089+0000","last_unstale":"2023-10-25T16:17:18.632896+0000","last_undegraded":"2023-10-25T16:17:18.632896+0000","last_fullsized":"2023-10-25T16:17:18.632896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:02.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632728+0000","last_change":"2023-10-25T16:17:17.665616+0000","last_active":"2023-10-25T16:17:18.632728+0000","last_peered":"2023-10-25T16:17:18.632728+0000","last_clean":"2023-10-25T16:17:18.632728+0000","last_became_active":"2023-10-25T16:17:17.664969+0000","last_became_peered":"2023-10-25T16:17:17.664969+0000","last_unstale":"2023-10-25T16:17:18.632728+0000","last_undegraded":"2023-10-25T16:17:18.632728+0000","last_fullsized":"2023-10-25T16:17:18.632728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:47:41.390733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711409+0000","last_change":"2023-10-25T16:17:17.646722+0000","last_active":"2023-10-25T16:17:18.711409+0000","last_peered":"2023-10-25T16:17:18.711409+0000","last_clean":"2023-10-25T16:17:18.711409+0000","last_became_active":"2023-10-25T16:17:17.645987+0000","last_became_peered":"2023-10-25T16:17:17.645987+0000","last_unstale":"2023-10-25T16:17:18.711409+0000","last_undegraded":"2023-10-25T16:17:18.711409+0000","last_fullsized":"2023-10-25T16:17:18.711409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:34.703288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710929+0000","last_change":"2023-10-25T16:17:17.670488+0000","last_active":"2023-10-25T16:17:18.710929+0000","last_peered":"2023-10-25T16:17:18.710929+0000","last_clean":"2023-10-25T16:17:18.710929+0000","last_became_active":"2023-10-25T16:17:17.669925+0000","last_became_peered":"2023-10-25T16:17:17.669925+0000","last_unstale":"2023-10-25T16:17:18.710929+0000","last_undegraded":"2023-10-25T16:17:18.710929+0000","last_fullsized":"2023-10-25T16:17:18.710929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:06.324016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222413+0000","last_change":"2023-10-25T16:17:17.641832+0000","last_active":"2023-10-25T16:17:19.222413+0000","last_peered":"2023-10-25T16:17:19.222413+0000","last_clean":"2023-10-25T16:17:19.222413+0000","last_became_active":"2023-10-25T16:17:17.641131+0000","last_became_peered":"2023-10-25T16:17:17.641131+0000","last_unstale":"2023-10-25T16:17:19.222413+0000","last_undegraded":"2023-10-25T16:17:19.222413+0000","last_fullsized":"2023-10-25T16:17:19.222413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:02.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709331+0000","last_change":"2023-10-25T16:17:17.657638+0000","last_active":"2023-10-25T16:17:18.709331+0000","last_peered":"2023-10-25T16:17:18.709331+0000","last_clean":"2023-10-25T16:17:18.709331+0000","last_became_active":"2023-10-25T16:17:17.657034+0000","last_became_peered":"2023-10-25T16:17:17.657034+0000","last_unstale":"2023-10-25T16:17:18.709331+0000","last_undegraded":"2023-10-25T16:17:18.709331+0000","last_fullsized":"2023-10-25T16:17:18.709331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:10.100210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222092+0000","last_change":"2023-10-25T16:17:17.642312+0000","last_active":"2023-10-25T16:17:19.222092+0000","last_peered":"2023-10-25T16:17:19.222092+0000","last_clean":"2023-10-25T16:17:19.222092+0000","last_became_active":"2023-10-25T16:17:17.641631+0000","last_became_peered":"2023-10-25T16:17:17.641631+0000","last_unstale":"2023-10-25T16:17:19.222092+0000","last_undegraded":"2023-10-25T16:17:19.222092+0000","last_fullsized":"2023-10-25T16:17:19.222092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:46.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711208+0000","last_change":"2023-10-25T16:17:17.658400+0000","last_active":"2023-10-25T16:17:18.711208+0000","last_peered":"2023-10-25T16:17:18.711208+0000","last_clean":"2023-10-25T16:17:18.711208+0000","last_became_active":"2023-10-25T16:17:17.657761+0000","last_became_peered":"2023-10-25T16:17:17.657761+0000","last_unstale":"2023-10-25T16:17:18.711208+0000","last_undegraded":"2023-10-25T16:17:18.711208+0000","last_fullsized":"2023-10-25T16:17:18.711208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:33:28.791708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711226+0000","last_change":"2023-10-25T16:17:17.658345+0000","last_active":"2023-10-25T16:17:18.711226+0000","last_peered":"2023-10-25T16:17:18.711226+0000","last_clean":"2023-10-25T16:17:18.711226+0000","last_became_active":"2023-10-25T16:17:17.657730+0000","last_became_peered":"2023-10-25T16:17:17.657730+0000","last_unstale":"2023-10-25T16:17:18.711226+0000","last_undegraded":"2023-10-25T16:17:18.711226+0000","last_fullsized":"2023-10-25T16:17:18.711226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:47.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711517+0000","last_change":"2023-10-25T16:17:17.665201+0000","last_active":"2023-10-25T16:17:18.711517+0000","last_peered":"2023-10-25T16:17:18.711517+0000","last_clean":"2023-10-25T16:17:18.711517+0000","last_became_active":"2023-10-25T16:17:17.664482+0000","last_became_peered":"2023-10-25T16:17:17.664482+0000","last_unstale":"2023-10-25T16:17:18.711517+0000","last_undegraded":"2023-10-25T16:17:18.711517+0000","last_fullsized":"2023-10-25T16:17:18.711517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:20.721957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633114+0000","last_change":"2023-10-25T16:17:17.663267+0000","last_active":"2023-10-25T16:17:18.633114+0000","last_peered":"2023-10-25T16:17:18.633114+0000","last_clean":"2023-10-25T16:17:18.633114+0000","last_became_active":"2023-10-25T16:17:17.662665+0000","last_became_peered":"2023-10-25T16:17:17.662665+0000","last_unstale":"2023-10-25T16:17:18.633114+0000","last_undegraded":"2023-10-25T16:17:18.633114+0000","last_fullsized":"2023-10-25T16:17:18.633114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:26:54.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"86'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633136+0000","last_change":"2023-10-25T16:17:16.904660+0000","last_active":"2023-10-25T16:17:18.633136+0000","last_peered":"2023-10-25T16:17:18.633136+0000","last_clean":"2023-10-25T16:17:18.633136+0000","last_became_active":"2023-10-25T16:17:16.903904+0000","last_became_peered":"2023-10-25T16:17:16.903904+0000","last_unstale":"2023-10-25T16:17:18.633136+0000","last_undegraded":"2023-10-25T16:17:18.633136+0000","last_fullsized":"2023-10-25T16:17:18.633136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:52:06.319525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221710+0000","last_change":"2023-10-25T16:17:16.892642+0000","last_active":"2023-10-25T16:17:19.221710+0000","last_peered":"2023-10-25T16:17:19.221710+0000","last_clean":"2023-10-25T16:17:19.221710+0000","last_became_active":"2023-10-25T16:17:16.892225+0000","last_became_peered":"2023-10-25T16:17:16.892225+0000","last_unstale":"2023-10-25T16:17:19.221710+0000","last_undegraded":"2023-10-25T16:17:19.221710+0000","last_fullsized":"2023-10-25T16:17:19.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:41.289281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710854+0000","last_change":"2023-10-25T16:17:17.673401+0000","last_active":"2023-10-25T16:17:18.710854+0000","last_peered":"2023-10-25T16:17:18.710854+0000","last_clean":"2023-10-25T16:17:18.710854+0000","last_became_active":"2023-10-25T16:17:17.667681+0000","last_became_peered":"2023-10-25T16:17:17.667681+0000","last_unstale":"2023-10-25T16:17:18.710854+0000","last_undegraded":"2023-10-25T16:17:18.710854+0000","last_fullsized":"2023-10-25T16:17:18.710854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:35.036194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712054+0000","last_change":"2023-10-25T16:17:16.916614+0000","last_active":"2023-10-25T16:17:18.712054+0000","last_peered":"2023-10-25T16:17:18.712054+0000","last_clean":"2023-10-25T16:17:18.712054+0000","last_became_active":"2023-10-25T16:17:16.914539+0000","last_became_peered":"2023-10-25T16:17:16.914539+0000","last_unstale":"2023-10-25T16:17:18.712054+0000","last_undegraded":"2023-10-25T16:17:18.712054+0000","last_fullsized":"2023-10-25T16:17:18.712054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:05.687178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633535+0000","last_change":"2023-10-25T16:17:17.641569+0000","last_active":"2023-10-25T16:17:18.633535+0000","last_peered":"2023-10-25T16:17:18.633535+0000","last_clean":"2023-10-25T16:17:18.633535+0000","last_became_active":"2023-10-25T16:17:17.640966+0000","last_became_peered":"2023-10-25T16:17:17.640966+0000","last_unstale":"2023-10-25T16:17:18.633535+0000","last_undegraded":"2023-10-25T16:17:18.633535+0000","last_fullsized":"2023-10-25T16:17:18.633535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711327+0000","last_change":"2023-10-25T16:17:16.922723+0000","last_active":"2023-10-25T16:17:18.711327+0000","last_peered":"2023-10-25T16:17:18.711327+0000","last_clean":"2023-10-25T16:17:18.711327+0000","last_became_active":"2023-10-25T16:17:16.920987+0000","last_became_peered":"2023-10-25T16:17:16.920987+0000","last_unstale":"2023-10-25T16:17:18.711327+0000","last_undegraded":"2023-10-25T16:17:18.711327+0000","last_fullsized":"2023-10-25T16:17:18.711327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:43.911566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709340+0000","last_change":"2023-10-25T16:17:17.645618+0000","last_active":"2023-10-25T16:17:18.709340+0000","last_peered":"2023-10-25T16:17:18.709340+0000","last_clean":"2023-10-25T16:17:18.709340+0000","last_became_active":"2023-10-25T16:17:17.645041+0000","last_became_peered":"2023-10-25T16:17:17.645041+0000","last_unstale":"2023-10-25T16:17:18.709340+0000","last_undegraded":"2023-10-25T16:17:18.709340+0000","last_fullsized":"2023-10-25T16:17:18.709340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:50:48.756330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222647+0000","last_change":"2023-10-25T16:17:16.900571+0000","last_active":"2023-10-25T16:17:19.222647+0000","last_peered":"2023-10-25T16:17:19.222647+0000","last_clean":"2023-10-25T16:17:19.222647+0000","last_became_active":"2023-10-25T16:17:16.900156+0000","last_became_peered":"2023-10-25T16:17:16.900156+0000","last_unstale":"2023-10-25T16:17:19.222647+0000","last_undegraded":"2023-10-25T16:17:19.222647+0000","last_fullsized":"2023-10-25T16:17:19.222647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:55.179521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710573+0000","last_change":"2023-10-25T16:17:17.643888+0000","last_active":"2023-10-25T16:17:18.710573+0000","last_peered":"2023-10-25T16:17:18.710573+0000","last_clean":"2023-10-25T16:17:18.710573+0000","last_became_active":"2023-10-25T16:17:17.643307+0000","last_became_peered":"2023-10-25T16:17:17.643307+0000","last_unstale":"2023-10-25T16:17:18.710573+0000","last_undegraded":"2023-10-25T16:17:18.710573+0000","last_fullsized":"2023-10-25T16:17:18.710573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:41:22.558797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712693+0000","last_change":"2023-10-25T16:17:16.914382+0000","last_active":"2023-10-25T16:17:18.712693+0000","last_peered":"2023-10-25T16:17:18.712693+0000","last_clean":"2023-10-25T16:17:18.712693+0000","last_became_active":"2023-10-25T16:17:16.913011+0000","last_became_peered":"2023-10-25T16:17:16.913011+0000","last_unstale":"2023-10-25T16:17:18.712693+0000","last_undegraded":"2023-10-25T16:17:18.712693+0000","last_fullsized":"2023-10-25T16:17:18.712693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:17.525133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706672+0000","last_change":"2023-10-25T16:17:16.902683+0000","last_active":"2023-10-25T16:17:18.706672+0000","last_peered":"2023-10-25T16:17:18.706672+0000","last_clean":"2023-10-25T16:17:18.706672+0000","last_became_active":"2023-10-25T16:17:16.902426+0000","last_became_peered":"2023-10-25T16:17:16.902426+0000","last_unstale":"2023-10-25T16:17:18.706672+0000","last_undegraded":"2023-10-25T16:17:18.706672+0000","last_fullsized":"2023-10-25T16:17:18.706672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:43.888268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221455+0000","last_change":"2023-10-25T16:17:17.641763+0000","last_active":"2023-10-25T16:17:19.221455+0000","last_peered":"2023-10-25T16:17:19.221455+0000","last_clean":"2023-10-25T16:17:19.221455+0000","last_became_active":"2023-10-25T16:17:17.641103+0000","last_became_peered":"2023-10-25T16:17:17.641103+0000","last_unstale":"2023-10-25T16:17:19.221455+0000","last_undegraded":"2023-10-25T16:17:19.221455+0000","last_fullsized":"2023-10-25T16:17:19.221455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870152+0000","last_change":"2023-10-25T16:17:15.870152+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870152+0000","last_undegraded":"2023-10-25T16:17:15.870152+0000","last_fullsized":"2023-10-25T16:17:15.870152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709804+0000","last_change":"2023-10-25T16:17:17.644435+0000","last_active":"2023-10-25T16:17:18.709804+0000","last_peered":"2023-10-25T16:17:18.709804+0000","last_clean":"2023-10-25T16:17:18.709804+0000","last_became_active":"2023-10-25T16:17:17.643844+0000","last_became_peered":"2023-10-25T16:17:17.643844+0000","last_unstale":"2023-10-25T16:17:18.709804+0000","last_undegraded":"2023-10-25T16:17:18.709804+0000","last_fullsized":"2023-10-25T16:17:18.709804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:26.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711119+0000","last_change":"2023-10-25T16:17:16.907112+0000","last_active":"2023-10-25T16:17:18.711119+0000","last_peered":"2023-10-25T16:17:18.711119+0000","last_clean":"2023-10-25T16:17:18.711119+0000","last_became_active":"2023-10-25T16:17:16.906553+0000","last_became_peered":"2023-10-25T16:17:16.906553+0000","last_unstale":"2023-10-25T16:17:18.711119+0000","last_undegraded":"2023-10-25T16:17:18.711119+0000","last_fullsized":"2023-10-25T16:17:18.711119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:44.314093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633375+0000","last_change":"2023-10-25T16:17:17.671535+0000","last_active":"2023-10-25T16:17:18.633375+0000","last_peered":"2023-10-25T16:17:18.633375+0000","last_clean":"2023-10-25T16:17:18.633375+0000","last_became_active":"2023-10-25T16:17:17.670757+0000","last_became_peered":"2023-10-25T16:17:17.670757+0000","last_unstale":"2023-10-25T16:17:18.633375+0000","last_undegraded":"2023-10-25T16:17:18.633375+0000","last_fullsized":"2023-10-25T16:17:18.633375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711730+0000","last_change":"2023-10-25T16:17:16.915546+0000","last_active":"2023-10-25T16:17:18.711730+0000","last_peered":"2023-10-25T16:17:18.711730+0000","last_clean":"2023-10-25T16:17:18.711730+0000","last_became_active":"2023-10-25T16:17:16.913965+0000","last_became_peered":"2023-10-25T16:17:16.913965+0000","last_unstale":"2023-10-25T16:17:18.711730+0000","last_undegraded":"2023-10-25T16:17:18.711730+0000","last_fullsized":"2023-10-25T16:17:18.711730+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:38.764460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712008+0000","last_change":"2023-10-25T16:17:17.664015+0000","last_active":"2023-10-25T16:17:18.712008+0000","last_peered":"2023-10-25T16:17:18.712008+0000","last_clean":"2023-10-25T16:17:18.712008+0000","last_became_active":"2023-10-25T16:17:17.657376+0000","last_became_peered":"2023-10-25T16:17:17.657376+0000","last_unstale":"2023-10-25T16:17:18.712008+0000","last_undegraded":"2023-10-25T16:17:18.712008+0000","last_fullsized":"2023-10-25T16:17:18.712008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:06.701664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"86'3","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222234+0000","last_change":"2023-10-25T16:17:16.889040+0000","last_active":"2023-10-25T16:17:19.222234+0000","last_peered":"2023-10-25T16:17:19.222234+0000","last_clean":"2023-10-25T16:17:19.222234+0000","last_became_active":"2023-10-25T16:17:16.888693+0000","last_became_peered":"2023-10-25T16:17:16.888693+0000","last_unstale":"2023-10-25T16:17:19.222234+0000","last_undegraded":"2023-10-25T16:17:19.222234+0000","last_fullsized":"2023-10-25T16:17:19.222234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:41.426292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"86'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706781+0000","last_change":"2023-10-25T16:17:16.895306+0000","last_active":"2023-10-25T16:17:18.706781+0000","last_peered":"2023-10-25T16:17:18.706781+0000","last_clean":"2023-10-25T16:17:18.706781+0000","last_became_active":"2023-10-25T16:17:16.894773+0000","last_became_peered":"2023-10-25T16:17:16.894773+0000","last_unstale":"2023-10-25T16:17:18.706781+0000","last_undegraded":"2023-10-25T16:17:18.706781+0000","last_fullsized":"2023-10-25T16:17:18.706781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633557+0000","last_change":"2023-10-25T16:17:17.663646+0000","last_active":"2023-10-25T16:17:18.633557+0000","last_peered":"2023-10-25T16:17:18.633557+0000","last_clean":"2023-10-25T16:17:18.633557+0000","last_became_active":"2023-10-25T16:17:17.661252+0000","last_became_peered":"2023-10-25T16:17:17.661252+0000","last_unstale":"2023-10-25T16:17:18.633557+0000","last_undegraded":"2023-10-25T16:17:18.633557+0000","last_fullsized":"2023-10-25T16:17:18.633557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706575+0000","last_change":"2023-10-25T16:17:16.902496+0000","last_active":"2023-10-25T16:17:18.706575+0000","last_peered":"2023-10-25T16:17:18.706575+0000","last_clean":"2023-10-25T16:17:18.706575+0000","last_became_active":"2023-10-25T16:17:16.902164+0000","last_became_peered":"2023-10-25T16:17:16.902164+0000","last_unstale":"2023-10-25T16:17:18.706575+0000","last_undegraded":"2023-10-25T16:17:18.706575+0000","last_fullsized":"2023-10-25T16:17:18.706575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:59.831665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711511+0000","last_change":"2023-10-25T16:17:17.647894+0000","last_active":"2023-10-25T16:17:18.711511+0000","last_peered":"2023-10-25T16:17:18.711511+0000","last_clean":"2023-10-25T16:17:18.711511+0000","last_became_active":"2023-10-25T16:17:17.647364+0000","last_became_peered":"2023-10-25T16:17:17.647364+0000","last_unstale":"2023-10-25T16:17:18.711511+0000","last_undegraded":"2023-10-25T16:17:18.711511+0000","last_fullsized":"2023-10-25T16:17:18.711511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:00.360348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711442+0000","last_change":"2023-10-25T16:17:16.922145+0000","last_active":"2023-10-25T16:17:18.711442+0000","last_peered":"2023-10-25T16:17:18.711442+0000","last_clean":"2023-10-25T16:17:18.711442+0000","last_became_active":"2023-10-25T16:17:16.919735+0000","last_became_peered":"2023-10-25T16:17:16.919735+0000","last_unstale":"2023-10-25T16:17:18.711442+0000","last_undegraded":"2023-10-25T16:17:18.711442+0000","last_fullsized":"2023-10-25T16:17:18.711442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:23.286095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222668+0000","last_change":"2023-10-25T16:17:17.660321+0000","last_active":"2023-10-25T16:17:19.222668+0000","last_peered":"2023-10-25T16:17:19.222668+0000","last_clean":"2023-10-25T16:17:19.222668+0000","last_became_active":"2023-10-25T16:17:17.657197+0000","last_became_peered":"2023-10-25T16:17:17.657197+0000","last_unstale":"2023-10-25T16:17:19.222668+0000","last_undegraded":"2023-10-25T16:17:19.222668+0000","last_fullsized":"2023-10-25T16:17:19.222668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710326+0000","last_change":"2023-10-25T16:17:16.912258+0000","last_active":"2023-10-25T16:17:18.710326+0000","last_peered":"2023-10-25T16:17:18.710326+0000","last_clean":"2023-10-25T16:17:18.710326+0000","last_became_active":"2023-10-25T16:17:16.909426+0000","last_became_peered":"2023-10-25T16:17:16.909426+0000","last_unstale":"2023-10-25T16:17:18.710326+0000","last_undegraded":"2023-10-25T16:17:18.710326+0000","last_fullsized":"2023-10-25T16:17:18.710326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:25:41.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"86'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709580+0000","last_change":"2023-10-25T16:17:16.910296+0000","last_active":"2023-10-25T16:17:18.709580+0000","last_peered":"2023-10-25T16:17:18.709580+0000","last_clean":"2023-10-25T16:17:18.709580+0000","last_became_active":"2023-10-25T16:17:16.908878+0000","last_became_peered":"2023-10-25T16:17:16.908878+0000","last_unstale":"2023-10-25T16:17:18.709580+0000","last_undegraded":"2023-10-25T16:17:18.709580+0000","last_fullsized":"2023-10-25T16:17:18.709580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:11.115383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711706+0000","last_change":"2023-10-25T16:17:17.656830+0000","last_active":"2023-10-25T16:17:18.711706+0000","last_peered":"2023-10-25T16:17:18.711706+0000","last_clean":"2023-10-25T16:17:18.711706+0000","last_became_active":"2023-10-25T16:17:17.655972+0000","last_became_peered":"2023-10-25T16:17:17.655972+0000","last_unstale":"2023-10-25T16:17:18.711706+0000","last_undegraded":"2023-10-25T16:17:18.711706+0000","last_fullsized":"2023-10-25T16:17:18.711706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:53.126893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712223+0000","last_change":"2023-10-25T16:17:16.908715+0000","last_active":"2023-10-25T16:17:18.712223+0000","last_peered":"2023-10-25T16:17:18.712223+0000","last_clean":"2023-10-25T16:17:18.712223+0000","last_became_active":"2023-10-25T16:17:16.907871+0000","last_became_peered":"2023-10-25T16:17:16.907871+0000","last_unstale":"2023-10-25T16:17:18.712223+0000","last_undegraded":"2023-10-25T16:17:18.712223+0000","last_fullsized":"2023-10-25T16:17:18.712223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:05:35.321099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633447+0000","last_change":"2023-10-25T16:17:17.668641+0000","last_active":"2023-10-25T16:17:18.633447+0000","last_peered":"2023-10-25T16:17:18.633447+0000","last_clean":"2023-10-25T16:17:18.633447+0000","last_became_active":"2023-10-25T16:17:17.667991+0000","last_became_peered":"2023-10-25T16:17:17.667991+0000","last_unstale":"2023-10-25T16:17:18.633447+0000","last_undegraded":"2023-10-25T16:17:18.633447+0000","last_fullsized":"2023-10-25T16:17:18.633447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712274+0000","last_change":"2023-10-25T16:17:16.917091+0000","last_active":"2023-10-25T16:17:18.712274+0000","last_peered":"2023-10-25T16:17:18.712274+0000","last_clean":"2023-10-25T16:17:18.712274+0000","last_became_active":"2023-10-25T16:17:16.916009+0000","last_became_peered":"2023-10-25T16:17:16.916009+0000","last_unstale":"2023-10-25T16:17:18.712274+0000","last_undegraded":"2023-10-25T16:17:18.712274+0000","last_fullsized":"2023-10-25T16:17:18.712274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:22.208994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706661+0000","last_change":"2023-10-25T16:17:17.662947+0000","last_active":"2023-10-25T16:17:18.706661+0000","last_peered":"2023-10-25T16:17:18.706661+0000","last_clean":"2023-10-25T16:17:18.706661+0000","last_became_active":"2023-10-25T16:17:17.658737+0000","last_became_peered":"2023-10-25T16:17:17.658737+0000","last_unstale":"2023-10-25T16:17:18.706661+0000","last_undegraded":"2023-10-25T16:17:18.706661+0000","last_fullsized":"2023-10-25T16:17:18.706661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:40.814420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711854+0000","last_change":"2023-10-25T16:17:16.922400+0000","last_active":"2023-10-25T16:17:18.711854+0000","last_peered":"2023-10-25T16:17:18.711854+0000","last_clean":"2023-10-25T16:17:18.711854+0000","last_became_active":"2023-10-25T16:17:16.920276+0000","last_became_peered":"2023-10-25T16:17:16.920276+0000","last_unstale":"2023-10-25T16:17:18.711854+0000","last_undegraded":"2023-10-25T16:17:18.711854+0000","last_fullsized":"2023-10-25T16:17:18.711854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:39.799934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633115+0000","last_change":"2023-10-25T16:17:16.908243+0000","last_active":"2023-10-25T16:17:18.633115+0000","last_peered":"2023-10-25T16:17:18.633115+0000","last_clean":"2023-10-25T16:17:18.633115+0000","last_became_active":"2023-10-25T16:17:16.907544+0000","last_became_peered":"2023-10-25T16:17:16.907544+0000","last_unstale":"2023-10-25T16:17:18.633115+0000","last_undegraded":"2023-10-25T16:17:18.633115+0000","last_fullsized":"2023-10-25T16:17:18.633115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:46.667209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221980+0000","last_change":"2023-10-25T16:17:17.667150+0000","last_active":"2023-10-25T16:17:19.221980+0000","last_peered":"2023-10-25T16:17:19.221980+0000","last_clean":"2023-10-25T16:17:19.221980+0000","last_became_active":"2023-10-25T16:17:17.666514+0000","last_became_peered":"2023-10-25T16:17:17.666514+0000","last_unstale":"2023-10-25T16:17:19.221980+0000","last_undegraded":"2023-10-25T16:17:19.221980+0000","last_fullsized":"2023-10-25T16:17:19.221980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:35.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712418+0000","last_change":"2023-10-25T16:17:16.902912+0000","last_active":"2023-10-25T16:17:18.712418+0000","last_peered":"2023-10-25T16:17:18.712418+0000","last_clean":"2023-10-25T16:17:18.712418+0000","last_became_active":"2023-10-25T16:17:16.901611+0000","last_became_peered":"2023-10-25T16:17:16.901611+0000","last_unstale":"2023-10-25T16:17:18.712418+0000","last_undegraded":"2023-10-25T16:17:18.712418+0000","last_fullsized":"2023-10-25T16:17:18.712418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222414+0000","last_change":"2023-10-25T16:17:17.668159+0000","last_active":"2023-10-25T16:17:19.222414+0000","last_peered":"2023-10-25T16:17:19.222414+0000","last_clean":"2023-10-25T16:17:19.222414+0000","last_became_active":"2023-10-25T16:17:17.667584+0000","last_became_peered":"2023-10-25T16:17:17.667584+0000","last_unstale":"2023-10-25T16:17:19.222414+0000","last_undegraded":"2023-10-25T16:17:19.222414+0000","last_fullsized":"2023-10-25T16:17:19.222414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:38:50.403559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711714+0000","last_change":"2023-10-25T16:17:16.899174+0000","last_active":"2023-10-25T16:17:18.711714+0000","last_peered":"2023-10-25T16:17:18.711714+0000","last_clean":"2023-10-25T16:17:18.711714+0000","last_became_active":"2023-10-25T16:17:16.897638+0000","last_became_peered":"2023-10-25T16:17:16.897638+0000","last_unstale":"2023-10-25T16:17:18.711714+0000","last_undegraded":"2023-10-25T16:17:18.711714+0000","last_fullsized":"2023-10-25T16:17:18.711714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:56.936496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221988+0000","last_change":"2023-10-25T16:17:17.661441+0000","last_active":"2023-10-25T16:17:19.221988+0000","last_peered":"2023-10-25T16:17:19.221988+0000","last_clean":"2023-10-25T16:17:19.221988+0000","last_became_active":"2023-10-25T16:17:17.660843+0000","last_became_peered":"2023-10-25T16:17:17.660843+0000","last_unstale":"2023-10-25T16:17:19.221988+0000","last_undegraded":"2023-10-25T16:17:19.221988+0000","last_fullsized":"2023-10-25T16:17:19.221988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:27.304996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221675+0000","last_change":"2023-10-25T16:17:16.891743+0000","last_active":"2023-10-25T16:17:19.221675+0000","last_peered":"2023-10-25T16:17:19.221675+0000","last_clean":"2023-10-25T16:17:19.221675+0000","last_became_active":"2023-10-25T16:17:16.891421+0000","last_became_peered":"2023-10-25T16:17:16.891421+0000","last_unstale":"2023-10-25T16:17:19.221675+0000","last_undegraded":"2023-10-25T16:17:19.221675+0000","last_fullsized":"2023-10-25T16:17:19.221675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:23.033726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222958+0000","last_change":"2023-10-25T16:17:17.660916+0000","last_active":"2023-10-25T16:17:19.222958+0000","last_peered":"2023-10-25T16:17:19.222958+0000","last_clean":"2023-10-25T16:17:19.222958+0000","last_became_active":"2023-10-25T16:17:17.658152+0000","last_became_peered":"2023-10-25T16:17:17.658152+0000","last_unstale":"2023-10-25T16:17:19.222958+0000","last_undegraded":"2023-10-25T16:17:19.222958+0000","last_fullsized":"2023-10-25T16:17:19.222958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711950+0000","last_change":"2023-10-25T16:17:16.912609+0000","last_active":"2023-10-25T16:17:18.711950+0000","last_peered":"2023-10-25T16:17:18.711950+0000","last_clean":"2023-10-25T16:17:18.711950+0000","last_became_active":"2023-10-25T16:17:16.908119+0000","last_became_peered":"2023-10-25T16:17:16.908119+0000","last_unstale":"2023-10-25T16:17:18.711950+0000","last_undegraded":"2023-10-25T16:17:18.711950+0000","last_fullsized":"2023-10-25T16:17:18.711950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:51.627276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710119+0000","last_change":"2023-10-25T16:17:17.663862+0000","last_active":"2023-10-25T16:17:18.710119+0000","last_peered":"2023-10-25T16:17:18.710119+0000","last_clean":"2023-10-25T16:17:18.710119+0000","last_became_active":"2023-10-25T16:17:17.662309+0000","last_became_peered":"2023-10-25T16:17:17.662309+0000","last_unstale":"2023-10-25T16:17:18.710119+0000","last_undegraded":"2023-10-25T16:17:18.710119+0000","last_fullsized":"2023-10-25T16:17:18.710119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:20:41.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709789+0000","last_change":"2023-10-25T16:17:16.909558+0000","last_active":"2023-10-25T16:17:18.709789+0000","last_peered":"2023-10-25T16:17:18.709789+0000","last_clean":"2023-10-25T16:17:18.709789+0000","last_became_active":"2023-10-25T16:17:16.908758+0000","last_became_peered":"2023-10-25T16:17:16.908758+0000","last_unstale":"2023-10-25T16:17:18.709789+0000","last_undegraded":"2023-10-25T16:17:18.709789+0000","last_fullsized":"2023-10-25T16:17:18.709789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:18:52.859828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633861+0000","last_change":"2023-10-25T16:17:17.660209+0000","last_active":"2023-10-25T16:17:18.633861+0000","last_peered":"2023-10-25T16:17:18.633861+0000","last_clean":"2023-10-25T16:17:18.633861+0000","last_became_active":"2023-10-25T16:17:17.659576+0000","last_became_peered":"2023-10-25T16:17:17.659576+0000","last_unstale":"2023-10-25T16:17:18.633861+0000","last_undegraded":"2023-10-25T16:17:18.633861+0000","last_fullsized":"2023-10-25T16:17:18.633861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:41:33.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870150+0000","last_change":"2023-10-25T16:17:15.870150+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870150+0000","last_undegraded":"2023-10-25T16:17:15.870150+0000","last_fullsized":"2023-10-25T16:17:15.870150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633812+0000","last_change":"2023-10-25T16:17:17.641836+0000","last_active":"2023-10-25T16:17:18.633812+0000","last_peered":"2023-10-25T16:17:18.633812+0000","last_clean":"2023-10-25T16:17:18.633812+0000","last_became_active":"2023-10-25T16:17:17.640900+0000","last_became_peered":"2023-10-25T16:17:17.640900+0000","last_unstale":"2023-10-25T16:17:18.633812+0000","last_undegraded":"2023-10-25T16:17:18.633812+0000","last_fullsized":"2023-10-25T16:17:18.633812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.223013+0000","last_change":"2023-10-25T16:17:16.907260+0000","last_active":"2023-10-25T16:17:19.223013+0000","last_peered":"2023-10-25T16:17:19.223013+0000","last_clean":"2023-10-25T16:17:19.223013+0000","last_became_active":"2023-10-25T16:17:16.907025+0000","last_became_peered":"2023-10-25T16:17:16.907025+0000","last_unstale":"2023-10-25T16:17:19.223013+0000","last_undegraded":"2023-10-25T16:17:19.223013+0000","last_fullsized":"2023-10-25T16:17:19.223013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:01.984830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870220+0000","last_change":"2023-10-25T16:17:15.870220+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870220+0000","last_undegraded":"2023-10-25T16:17:15.870220+0000","last_fullsized":"2023-10-25T16:17:15.870220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711184+0000","last_change":"2023-10-25T16:17:17.672992+0000","last_active":"2023-10-25T16:17:18.711184+0000","last_peered":"2023-10-25T16:17:18.711184+0000","last_clean":"2023-10-25T16:17:18.711184+0000","last_became_active":"2023-10-25T16:17:17.666970+0000","last_became_peered":"2023-10-25T16:17:17.666970+0000","last_unstale":"2023-10-25T16:17:18.711184+0000","last_undegraded":"2023-10-25T16:17:18.711184+0000","last_fullsized":"2023-10-25T16:17:18.711184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:31.108645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706743+0000","last_change":"2023-10-25T16:17:16.905625+0000","last_active":"2023-10-25T16:17:18.706743+0000","last_peered":"2023-10-25T16:17:18.706743+0000","last_clean":"2023-10-25T16:17:18.706743+0000","last_became_active":"2023-10-25T16:17:16.905397+0000","last_became_peered":"2023-10-25T16:17:16.905397+0000","last_unstale":"2023-10-25T16:17:18.706743+0000","last_undegraded":"2023-10-25T16:17:18.706743+0000","last_fullsized":"2023-10-25T16:17:18.706743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706602+0000","last_change":"2023-10-25T16:17:17.669175+0000","last_active":"2023-10-25T16:17:18.706602+0000","last_peered":"2023-10-25T16:17:18.706602+0000","last_clean":"2023-10-25T16:17:18.706602+0000","last_became_active":"2023-10-25T16:17:17.668211+0000","last_became_peered":"2023-10-25T16:17:17.668211+0000","last_unstale":"2023-10-25T16:17:18.706602+0000","last_undegraded":"2023-10-25T16:17:18.706602+0000","last_fullsized":"2023-10-25T16:17:18.706602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:24.300581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709817+0000","last_change":"2023-10-25T16:17:16.910651+0000","last_active":"2023-10-25T16:17:18.709817+0000","last_peered":"2023-10-25T16:17:18.709817+0000","last_clean":"2023-10-25T16:17:18.709817+0000","last_became_active":"2023-10-25T16:17:16.909696+0000","last_became_peered":"2023-10-25T16:17:16.909696+0000","last_unstale":"2023-10-25T16:17:18.709817+0000","last_undegraded":"2023-10-25T16:17:18.709817+0000","last_fullsized":"2023-10-25T16:17:18.709817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:53.032575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712481+0000","last_change":"2023-10-25T16:17:17.671027+0000","last_active":"2023-10-25T16:17:18.712481+0000","last_peered":"2023-10-25T16:17:18.712481+0000","last_clean":"2023-10-25T16:17:18.712481+0000","last_became_active":"2023-10-25T16:17:17.669539+0000","last_became_peered":"2023-10-25T16:17:17.669539+0000","last_unstale":"2023-10-25T16:17:18.712481+0000","last_undegraded":"2023-10-25T16:17:18.712481+0000","last_fullsized":"2023-10-25T16:17:18.712481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:34.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712622+0000","last_change":"2023-10-25T16:17:16.902431+0000","last_active":"2023-10-25T16:17:18.712622+0000","last_peered":"2023-10-25T16:17:18.712622+0000","last_clean":"2023-10-25T16:17:18.712622+0000","last_became_active":"2023-10-25T16:17:16.900783+0000","last_became_peered":"2023-10-25T16:17:16.900783+0000","last_unstale":"2023-10-25T16:17:18.712622+0000","last_undegraded":"2023-10-25T16:17:18.712622+0000","last_fullsized":"2023-10-25T16:17:18.712622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222267+0000","last_change":"2023-10-25T16:17:17.666667+0000","last_active":"2023-10-25T16:17:19.222267+0000","last_peered":"2023-10-25T16:17:19.222267+0000","last_clean":"2023-10-25T16:17:19.222267+0000","last_became_active":"2023-10-25T16:17:17.666071+0000","last_became_peered":"2023-10-25T16:17:17.666071+0000","last_unstale":"2023-10-25T16:17:19.222267+0000","last_undegraded":"2023-10-25T16:17:19.222267+0000","last_fullsized":"2023-10-25T16:17:19.222267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:14:54.061159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712904+0000","last_change":"2023-10-25T16:17:16.913949+0000","last_active":"2023-10-25T16:17:18.712904+0000","last_peered":"2023-10-25T16:17:18.712904+0000","last_clean":"2023-10-25T16:17:18.712904+0000","last_became_active":"2023-10-25T16:17:16.911491+0000","last_became_peered":"2023-10-25T16:17:16.911491+0000","last_unstale":"2023-10-25T16:17:18.712904+0000","last_undegraded":"2023-10-25T16:17:18.712904+0000","last_fullsized":"2023-10-25T16:17:18.712904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:55.386778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.633792+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:17:17.633792+0000","last_peered":"2023-10-25T16:17:17.633792+0000","last_clean":"2023-10-25T16:17:17.633792+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:17:17.633792+0000","last_undegraded":"2023-10-25T16:17:17.633792+0000","last_fullsized":"2023-10-25T16:17:17.633792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:15.165202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":434,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194877,"statfs":{"total":200000000,"available":199554963,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.88900000000000001,"5min":1.077,"15min":1.077},"last":0.432}]},{"osd":1,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.307,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0309999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59599999999999997,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.87,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.61599999999999999,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2529999999999999,"5min":1.345,"15min":1.345},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.1919999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83999999999999997},"min":{"1min":0.73599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.60999999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.1639999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.67900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.147,"5min":1.581,"15min":1.581},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.90200000000000002,"15min":0.878},"min":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.131,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90600000000000003,"15min":0.92700000000000005},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.155,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92300000000000004,"15min":0.91100000000000003},"min":{"1min":0.79600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.133,"5min":1.677,"15min":1.677},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95999999999999996,"15min":0.95499999999999996},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2050000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.61699999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1030,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0920000000000001,"5min":1.256,"15min":1.256},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.83099999999999996},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.91500000000000004,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.29,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.2410000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.85599999999999998,"15min":0.82999999999999996},"min":{"1min":0.58399999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1910000000000001,"5min":1.27,"15min":1.27},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.71199999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.159,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3420000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.97399999999999998,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0289999999999999,"15min":1.0389999999999999},"min":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.151},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1259999999999999},"min":{"1min":0.72399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.397,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.86399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.397,"15min":1.397},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.224,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90100000000000002,"15min":0.88500000000000001},"min":{"1min":0.626,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2090000000000001,"5min":1.302,"15min":1.302},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.754,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.119,"5min":1.476,"15min":1.476},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.018,"5min":0.92200000000000004,"15min":0.88400000000000001},"min":{"1min":0.81599999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.749},{"interface":"front","average":{"1min":1.016,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.77000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2330000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2250000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.99199999999999999},"min":{"1min":0.70599999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":1.413,"15min":1.413},"last":0.92100000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.96899999999999997},"min":{"1min":0.72899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.65800000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3400000000000001,"5min":1.895,"15min":1.895},"last":1.046}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.081,"15min":1.079},"min":{"1min":0.81799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3049999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0640000000000001,"15min":1.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.296,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.1259999999999999,"15min":1.3700000000000001},"min":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.661,"5min":14.843,"15min":14.843},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.173,"15min":1.5149999999999999},"min":{"1min":0.66100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":16.439,"15min":16.439},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.161,"15min":1.4370000000000001},"min":{"1min":0.64300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2150000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.157},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88700000000000001,"15min":0.86799999999999999},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.224,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.129}]},{"osd":2,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.91800000000000004,"15min":0.93600000000000005},"min":{"1min":0.77900000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.22,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.97099999999999997,"15min":0.96699999999999997},"min":{"1min":0.63300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2470000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.98099999999999998,"15min":0.99099999999999999},"min":{"1min":0.80300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1699999999999999,"5min":1.252,"15min":1.252},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.323,"15min":1.5389999999999999},"min":{"1min":1.0580000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8149999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3140000000000001,"15min":1.625},"min":{"1min":0.68600000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":15.904,"15min":15.904},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.3069999999999999,"15min":1.6559999999999999},"min":{"1min":0.75800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.879,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.278,"15min":1.524},"min":{"1min":0.67800000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.748,"5min":14.567,"15min":14.567},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.4450000000000001,"15min":1.7390000000000001},"min":{"1min":0.89500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.599,"5min":15.089,"15min":15.089},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.397,"15min":1.7729999999999999},"min":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7090000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1970000000000001,"15min":1.272},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9530000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82799999999999996,"15min":0.80000000000000004},"min":{"1min":0.66900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.327,"5min":1.47,"15min":1.47},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.85899999999999999,"15min":0.81799999999999995},"min":{"1min":0.71299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":1.1659999999999999,"5min":1.288,"15min":1.288},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.58899999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":0.89300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2290000000000001,"5min":1.369,"15min":1.369},"last":1.052},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.78500000000000003},"min":{"1min":0.64100000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.518,"15min":1.518},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.69499999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.121,"15min":1.121},"min":{"1min":0.91200000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.24}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":2.085,"15min":2.085},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.329}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.196,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":1.0289999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":447,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194865,"statfs":{"total":200000000,"available":199541801,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.59799999999999998,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.25700000000000001,"5min":0.222,"15min":0.222},"max":{"1min":1.004,"5min":1.083,"15min":1.083},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.255,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.99399999999999999,"15min":0.98699999999999999},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.427,"15min":1.427},"last":0.78600000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.214,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3720000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.306,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.663,"15min":1.663},"last":0.93700000000000006}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.58099999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.47,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.038},{"interface":"front","average":{"1min":1.022,"5min":0.96999999999999997,"15min":0.94599999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.252,"5min":1.389,"15min":1.389},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":455,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194856,"statfs":{"total":200000000,"available":199533385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.97099999999999997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.129,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.318}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.58899999999999997,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1499999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.318,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.371,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.034,"5min":1.423,"15min":1.423},"last":0.375}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.05,"15min":0.97699999999999998},"min":{"1min":0.69199999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":12.698,"15min":12.698},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.1000000000000001,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.214,"5min":12.721,"15min":12.721},"last":0.84699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.92900000000000005,"15min":0.91700000000000004},"min":{"1min":0.57999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2549999999999999,"5min":1.546,"15min":1.546},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2290000000000001,"5min":2.206,"15min":2.206},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":1.022},"min":{"1min":0.69199999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.381,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0980000000000001,"15min":0.98199999999999998},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.268,"5min":14.776,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.093,"15min":1.0169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4339999999999999,"5min":10.509,"15min":10.509},"last":1.0640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1023,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194288,"statfs":{"total":200000000,"available":198951545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.70499999999999996},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.94899999999999995,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.749},"min":{"1min":0.34899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0069999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84899999999999998,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95199999999999996,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.78500000000000003},"min":{"1min":0.33100000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":1.101},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.45300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1699999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.68400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0960000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.93000000000000005},"min":{"1min":0.64700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.997}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.88200000000000001,"15min":0.85299999999999998},"min":{"1min":0.73399999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2190000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91900000000000004,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.105,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.206,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93200000000000005,"15min":0.91700000000000004},"min":{"1min":0.82399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2869999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.121}]},{"osd":7,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.3220000000000001},"min":{"1min":0.81799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3080000000000001,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1619999999999999,"15min":1.339},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3360000000000001,"5min":11.622,"15min":11.622},"last":1.073}]}]}],"pool_statfs":[]}} 2023-10-25T16:17:21.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-25T16:17:21.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-25T16:17:21.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-25T16:17:21.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-25T16:17:21.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-25T16:17:21.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-25T16:17:21.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-25T16:17:21.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:17:15.870152+0000', 'last_change': '2023-10-25T16:17:15.870152+0000', 'last_active': '2023-10-25T16:17:15.852324+0000', 'last_peered': '2023-10-25T16:17:15.852324+0000', 'last_clean': '2023-10-25T16:17:15.852324+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:15.870152+0000', 'last_undegraded': '2023-10-25T16:17:15.870152+0000', 'last_fullsized': '2023-10-25T16:17:15.870152+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:17:21.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-25T16:17:21.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-25T16:17:21.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-25T16:17:21.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-25T16:17:21.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:17:15.870150+0000', 'last_change': '2023-10-25T16:17:15.870150+0000', 'last_active': '2023-10-25T16:17:15.852324+0000', 'last_peered': '2023-10-25T16:17:15.852324+0000', 'last_clean': '2023-10-25T16:17:15.852324+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:15.870150+0000', 'last_undegraded': '2023-10-25T16:17:15.870150+0000', 'last_fullsized': '2023-10-25T16:17:15.870150+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:17:21.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-25T16:17:21.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:17:16.866811+0000', 'last_change': '2023-10-25T16:17:16.866811+0000', 'last_active': '2023-10-25T16:17:16.866811+0000', 'last_peered': '2023-10-25T16:17:16.866811+0000', 'last_clean': '2023-10-25T16:17:16.866811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:16.866811+0000', 'last_undegraded': '2023-10-25T16:17:16.866811+0000', 'last_fullsized': '2023-10-25T16:17:16.866811+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:16.866811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:17:21.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-25T16:17:21.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:17:15.870220+0000', 'last_change': '2023-10-25T16:17:15.870220+0000', 'last_active': '2023-10-25T16:17:15.852324+0000', 'last_peered': '2023-10-25T16:17:15.852324+0000', 'last_clean': '2023-10-25T16:17:15.852324+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:17:15.870220+0000', 'last_undegraded': '2023-10-25T16:17:15.870220+0000', 'last_fullsized': '2023-10-25T16:17:15.870220+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'last_clean_scrub_stamp': '2023-10-25T16:17:15.852324+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:17:21.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:17:21.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde469bf640 1 -- 172.21.15.177:0/980809233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde2c004d10 msgr2=0x7fde2c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde469bf640 1 --2- 172.21.15.177:0/980809233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde2c004d10 0x7fde2c005190 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fde38009e30 tx=0x7fde3801d150 comp rx=0 tx=0).stop 2023-10-25T16:17:21.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde44f5c640 1 -- 172.21.15.177:0/980809233 reap_dead start 2023-10-25T16:17:21.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde469bf640 1 -- 172.21.15.177:0/980809233 shutdown_connections 2023-10-25T16:17:21.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde469bf640 1 -- 172.21.15.177:0/980809233 >> 172.21.15.177:0/980809233 conn(0x7fde400b2450 msgr2=0x7fde400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:21.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde469bf640 1 -- 172.21.15.177:0/980809233 shutdown_connections 2023-10-25T16:17:21.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.761+0000 7fde469bf640 1 -- 172.21.15.177:0/980809233 wait complete. 2023-10-25T16:17:21.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 Processor -- start 2023-10-25T16:17:21.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- start start 2023-10-25T16:17:21.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde2c004d10 0x7fde400c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde401363b0 0x7fde40137390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 0x7fde4013a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde40157100 con 0x7fde4013a0d0 2023-10-25T16:17:21.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4013aa90 con 0x7fde2c004d10 2023-10-25T16:17:21.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde40155cf0 con 0x7fde401363b0 2023-10-25T16:17:21.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 0x7fde4013a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 0x7fde4013a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34570/0 (socket says 172.21.15.177:34570) 2023-10-25T16:17:21.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 -- 172.21.15.177:0/2150957791 learned_addr learned my addr 172.21.15.177:0/2150957791 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:21.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3ffff640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde2c004d10 0x7fde400c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3f7fe640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde401363b0 0x7fde40137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 -- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde401363b0 msgr2=0x7fde40137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde401363b0 0x7fde40137390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 -- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde2c004d10 msgr2=0x7fde400c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde2c004d10 0x7fde400c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 -- 172.21.15.177:0/2150957791 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde401378d0 con 0x7fde4013a0d0 2023-10-25T16:17:21.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde44f5c640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 0x7fde4013a550 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fde38002240 tx=0x7fde380ad9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:21.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380bc070 con 0x7fde4013a0d0 2023-10-25T16:17:21.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde380adb30 con 0x7fde4013a0d0 2023-10-25T16:17:21.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde40136970 con 0x7fde4013a0d0 2023-10-25T16:17:21.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380add00 con 0x7fde4013a0d0 2023-10-25T16:17:21.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde40156d20 con 0x7fde4013a0d0 2023-10-25T16:17:21.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde40157240 con 0x7fde4013a0d0 2023-10-25T16:17:21.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde380b3070 con 0x7fde4013a0d0 2023-10-25T16:17:21.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.765+0000 7fde3cff9640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde20066470 0x7fde20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:21.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.769+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde380a5e40 con 0x7fde4013a0d0 2023-10-25T16:17:21.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.769+0000 7fde3ffff640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde20066470 0x7fde20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:21.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.769+0000 7fde3ffff640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde20066470 0x7fde20068930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fde30006fd0 tx=0x7fde30006af0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:21.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.769+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde380eb540 con 0x7fde4013a0d0 2023-10-25T16:17:21.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fde4015bed0 con 0x7fde4013a0d0 2023-10-25T16:17:21.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde3cff9640 1 -- 172.21.15.177:0/2150957791 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1171 (secure 0 0 0) 0x7fde380b1020 con 0x7fde4013a0d0 2023-10-25T16:17:21.985 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:21.985 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":273,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":87,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":84},{"state_name":"unknown","count":10},{"state_name":"creating+peering","count":3}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":4867090,"bytes_avail":1595132910,"bytes_total":1600000000,"unknown_pgs_ratio":0.10309278219938278,"inactive_pgs_ratio":0.030927835032343864,"write_bytes_sec":2973,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":31,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":155189}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-10-25T16:16:58.685420+0000","services":{}},"progress_events":{}} 2023-10-25T16:17:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde20066470 msgr2=0x7fde20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde20066470 0x7fde20068930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fde30006fd0 tx=0x7fde30006af0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 msgr2=0x7fde4013a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:21.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 0x7fde4013a550 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fde38002240 tx=0x7fde380ad9d0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 shutdown_connections 2023-10-25T16:17:21.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde20066470 0x7fde20068930 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde4013a0d0 0x7fde4013a550 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde401363b0 0x7fde40137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 --2- 172.21.15.177:0/2150957791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde2c004d10 0x7fde400c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:21.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 >> 172.21.15.177:0/2150957791 conn(0x7fde400b2450 msgr2=0x7fde400cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:21.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 shutdown_connections 2023-10-25T16:17:21.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:21.981+0000 7fde469bf640 1 -- 172.21.15.177:0/2150957791 wait complete. 2023-10-25T16:17:22.003 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:17:22.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:17:22.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 -- 172.21.15.177:0/2131963745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40654c0 msgr2=0x7f28d4159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:22.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 --2- 172.21.15.177:0/2131963745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40654c0 0x7f28d4159b60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009c80 tx=0x7f28cc01cd10 comp rx=0 tx=0).stop 2023-10-25T16:17:22.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 -- 172.21.15.177:0/2131963745 shutdown_connections 2023-10-25T16:17:22.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 --2- 172.21.15.177:0/2131963745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40654c0 0x7f28d4159b60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 --2- 172.21.15.177:0/2131963745 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28d40cbd10 0x7f28d4159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 -- 172.21.15.177:0/2131963745 >> 172.21.15.177:0/2131963745 conn(0x7f28d40af5b0 msgr2=0x7f28d40af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:22.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 -- 172.21.15.177:0/2131963745 shutdown_connections 2023-10-25T16:17:22.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 -- 172.21.15.177:0/2131963745 wait complete. 2023-10-25T16:17:22.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 Processor -- start 2023-10-25T16:17:22.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.121+0000 7f28d9507640 1 -- start start 2023-10-25T16:17:22.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28d40654c0 0x7f28d40b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:22.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28d40b2bc0 0x7f28d41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:22.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 0x7f28d4153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:22.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d413e810 con 0x7f28d40cbd10 2023-10-25T16:17:22.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4157b00 con 0x7f28d40b2bc0 2023-10-25T16:17:22.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4157de0 con 0x7f28d40654c0 2023-10-25T16:17:22.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 0x7f28d4153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:22.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 0x7f28d4153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34592/0 (socket says 172.21.15.177:34592) 2023-10-25T16:17:22.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 -- 172.21.15.177:0/2490259427 learned_addr learned my addr 172.21.15.177:0/2490259427 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:22.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d27fc640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28d40b2bc0 0x7f28d41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:22.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d2ffd640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28d40654c0 0x7f28d40b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:22.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 -- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28d40654c0 msgr2=0x7f28d40b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:22.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28d40654c0 0x7f28d40b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 -- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28d40b2bc0 msgr2=0x7f28d41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:22.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28d40b2bc0 0x7f28d41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 -- 172.21.15.177:0/2490259427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0098e0 con 0x7f28d40cbd10 2023-10-25T16:17:22.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d37fe640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 0x7f28d4153e30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009bd0 tx=0x7f28cc009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:22.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc004e60 con 0x7f28d40cbd10 2023-10-25T16:17:22.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f28cc004000 con 0x7f28d40cbd10 2023-10-25T16:17:22.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d41580c0 con 0x7f28d40cbd10 2023-10-25T16:17:22.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0043d0 con 0x7f28d40cbd10 2023-10-25T16:17:22.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4158680 con 0x7f28d40cbd10 2023-10-25T16:17:22.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4158870 con 0x7f28d40cbd10 2023-10-25T16:17:22.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f28cc0b4040 con 0x7f28d40cbd10 2023-10-25T16:17:22.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28cb7fe640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28b4066470 0x7f28b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:22.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28cc11e2d0 con 0x7f28d40cbd10 2023-10-25T16:17:22.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.125+0000 7f28d2ffd640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28b4066470 0x7f28b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:22.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.129+0000 7f28d2ffd640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28b4066470 0x7f28b4068930 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f28c4004e30 tx=0x7f28c4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:22.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.129+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28cc0eb750 con 0x7f28d40cbd10 2023-10-25T16:17:22.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.269+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28d404daf0 con 0x7f28b4066470 2023-10-25T16:17:22.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.293+0000 7f28cb7fe640 1 -- 172.21.15.177:0/2490259427 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282406 (secure 0 0 0) 0x7f28d404daf0 con 0x7f28b4066470 2023-10-25T16:17:22.298 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:22.300 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:17:22.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28b4066470 msgr2=0x7f28b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:22.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28b4066470 0x7f28b4068930 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f28c4004e30 tx=0x7f28c4009040 comp rx=0 tx=0).stop 2023-10-25T16:17:22.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 msgr2=0x7f28d4153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:22.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 0x7f28d4153e30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f28cc009bd0 tx=0x7f28cc009390 comp rx=0 tx=0).stop 2023-10-25T16:17:22.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 shutdown_connections 2023-10-25T16:17:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28b4066470 0x7f28b4068930 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40cbd10 0x7f28d4153e30 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28d40b2bc0 0x7f28d41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 --2- 172.21.15.177:0/2490259427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28d40654c0 0x7f28d40b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:22.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 >> 172.21.15.177:0/2490259427 conn(0x7f28d40af5b0 msgr2=0x7f28d4155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:22.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 shutdown_connections 2023-10-25T16:17:22.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:22.297+0000 7f28d9507640 1 -- 172.21.15.177:0/2490259427 wait complete. 2023-10-25T16:17:22.316 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-10-25T16:17:20.691748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4753,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557746,"statfs":{"total":1600000000,"available":1595132910,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821332"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632846+0000","last_change":"2023-10-25T16:17:17.664185+0000","last_active":"2023-10-25T16:17:18.632846+0000","last_peered":"2023-10-25T16:17:18.632846+0000","last_clean":"2023-10-25T16:17:18.632846+0000","last_became_active":"2023-10-25T16:17:17.662766+0000","last_became_peered":"2023-10-25T16:17:17.662766+0000","last_unstale":"2023-10-25T16:17:18.632846+0000","last_undegraded":"2023-10-25T16:17:18.632846+0000","last_fullsized":"2023-10-25T16:17:18.632846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:24.048212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711163+0000","last_change":"2023-10-25T16:17:17.657987+0000","last_active":"2023-10-25T16:17:18.711163+0000","last_peered":"2023-10-25T16:17:18.711163+0000","last_clean":"2023-10-25T16:17:18.711163+0000","last_became_active":"2023-10-25T16:17:17.657323+0000","last_became_peered":"2023-10-25T16:17:17.657323+0000","last_unstale":"2023-10-25T16:17:18.711163+0000","last_undegraded":"2023-10-25T16:17:18.711163+0000","last_fullsized":"2023-10-25T16:17:18.711163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:54.047062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221594+0000","last_change":"2023-10-25T16:17:17.641611+0000","last_active":"2023-10-25T16:17:19.221594+0000","last_peered":"2023-10-25T16:17:19.221594+0000","last_clean":"2023-10-25T16:17:19.221594+0000","last_became_active":"2023-10-25T16:17:17.640892+0000","last_became_peered":"2023-10-25T16:17:17.640892+0000","last_unstale":"2023-10-25T16:17:19.221594+0000","last_undegraded":"2023-10-25T16:17:19.221594+0000","last_fullsized":"2023-10-25T16:17:19.221594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:10.948309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706444+0000","last_change":"2023-10-25T16:17:17.668748+0000","last_active":"2023-10-25T16:17:18.706444+0000","last_peered":"2023-10-25T16:17:18.706444+0000","last_clean":"2023-10-25T16:17:18.706444+0000","last_became_active":"2023-10-25T16:17:17.667153+0000","last_became_peered":"2023-10-25T16:17:17.667153+0000","last_unstale":"2023-10-25T16:17:18.706444+0000","last_undegraded":"2023-10-25T16:17:18.706444+0000","last_fullsized":"2023-10-25T16:17:18.706444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:52.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710526+0000","last_change":"2023-10-25T16:17:17.674620+0000","last_active":"2023-10-25T16:17:18.710526+0000","last_peered":"2023-10-25T16:17:18.710526+0000","last_clean":"2023-10-25T16:17:18.710526+0000","last_became_active":"2023-10-25T16:17:17.672434+0000","last_became_peered":"2023-10-25T16:17:17.672434+0000","last_unstale":"2023-10-25T16:17:18.710526+0000","last_undegraded":"2023-10-25T16:17:18.710526+0000","last_fullsized":"2023-10-25T16:17:18.710526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709443+0000","last_change":"2023-10-25T16:17:17.663316+0000","last_active":"2023-10-25T16:17:18.709443+0000","last_peered":"2023-10-25T16:17:18.709443+0000","last_clean":"2023-10-25T16:17:18.709443+0000","last_became_active":"2023-10-25T16:17:17.660398+0000","last_became_peered":"2023-10-25T16:17:17.660398+0000","last_unstale":"2023-10-25T16:17:18.709443+0000","last_undegraded":"2023-10-25T16:17:18.709443+0000","last_fullsized":"2023-10-25T16:17:18.709443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:10:29.345764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712178+0000","last_change":"2023-10-25T16:17:17.667593+0000","last_active":"2023-10-25T16:17:18.712178+0000","last_peered":"2023-10-25T16:17:18.712178+0000","last_clean":"2023-10-25T16:17:18.712178+0000","last_became_active":"2023-10-25T16:17:17.666839+0000","last_became_peered":"2023-10-25T16:17:17.666839+0000","last_unstale":"2023-10-25T16:17:18.712178+0000","last_undegraded":"2023-10-25T16:17:18.712178+0000","last_fullsized":"2023-10-25T16:17:18.712178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:23.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711111+0000","last_change":"2023-10-25T16:17:17.669453+0000","last_active":"2023-10-25T16:17:18.711111+0000","last_peered":"2023-10-25T16:17:18.711111+0000","last_clean":"2023-10-25T16:17:18.711111+0000","last_became_active":"2023-10-25T16:17:17.665439+0000","last_became_peered":"2023-10-25T16:17:17.665439+0000","last_unstale":"2023-10-25T16:17:18.711111+0000","last_undegraded":"2023-10-25T16:17:18.711111+0000","last_fullsized":"2023-10-25T16:17:18.711111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:34.375540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633187+0000","last_change":"2023-10-25T16:17:17.640630+0000","last_active":"2023-10-25T16:17:18.633187+0000","last_peered":"2023-10-25T16:17:18.633187+0000","last_clean":"2023-10-25T16:17:18.633187+0000","last_became_active":"2023-10-25T16:17:17.639914+0000","last_became_peered":"2023-10-25T16:17:17.639914+0000","last_unstale":"2023-10-25T16:17:18.633187+0000","last_undegraded":"2023-10-25T16:17:18.633187+0000","last_fullsized":"2023-10-25T16:17:18.633187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706535+0000","last_change":"2023-10-25T16:17:17.672293+0000","last_active":"2023-10-25T16:17:18.706535+0000","last_peered":"2023-10-25T16:17:18.706535+0000","last_clean":"2023-10-25T16:17:18.706535+0000","last_became_active":"2023-10-25T16:17:17.671908+0000","last_became_peered":"2023-10-25T16:17:17.671908+0000","last_unstale":"2023-10-25T16:17:18.706535+0000","last_undegraded":"2023-10-25T16:17:18.706535+0000","last_fullsized":"2023-10-25T16:17:18.706535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:44.926052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222370+0000","last_change":"2023-10-25T16:17:17.661285+0000","last_active":"2023-10-25T16:17:19.222370+0000","last_peered":"2023-10-25T16:17:19.222370+0000","last_clean":"2023-10-25T16:17:19.222370+0000","last_became_active":"2023-10-25T16:17:17.659550+0000","last_became_peered":"2023-10-25T16:17:17.659550+0000","last_unstale":"2023-10-25T16:17:19.222370+0000","last_undegraded":"2023-10-25T16:17:19.222370+0000","last_fullsized":"2023-10-25T16:17:19.222370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222519+0000","last_change":"2023-10-25T16:17:17.656416+0000","last_active":"2023-10-25T16:17:19.222519+0000","last_peered":"2023-10-25T16:17:19.222519+0000","last_clean":"2023-10-25T16:17:19.222519+0000","last_became_active":"2023-10-25T16:17:17.655732+0000","last_became_peered":"2023-10-25T16:17:17.655732+0000","last_unstale":"2023-10-25T16:17:19.222519+0000","last_undegraded":"2023-10-25T16:17:19.222519+0000","last_fullsized":"2023-10-25T16:17:19.222519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710388+0000","last_change":"2023-10-25T16:17:17.668915+0000","last_active":"2023-10-25T16:17:18.710388+0000","last_peered":"2023-10-25T16:17:18.710388+0000","last_clean":"2023-10-25T16:17:18.710388+0000","last_became_active":"2023-10-25T16:17:17.668247+0000","last_became_peered":"2023-10-25T16:17:17.668247+0000","last_unstale":"2023-10-25T16:17:18.710388+0000","last_undegraded":"2023-10-25T16:17:18.710388+0000","last_fullsized":"2023-10-25T16:17:18.710388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:19.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706830+0000","last_change":"2023-10-25T16:17:17.664573+0000","last_active":"2023-10-25T16:17:18.706830+0000","last_peered":"2023-10-25T16:17:18.706830+0000","last_clean":"2023-10-25T16:17:18.706830+0000","last_became_active":"2023-10-25T16:17:17.663788+0000","last_became_peered":"2023-10-25T16:17:17.663788+0000","last_unstale":"2023-10-25T16:17:18.706830+0000","last_undegraded":"2023-10-25T16:17:18.706830+0000","last_fullsized":"2023-10-25T16:17:18.706830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711210+0000","last_change":"2023-10-25T16:17:17.672141+0000","last_active":"2023-10-25T16:17:18.711210+0000","last_peered":"2023-10-25T16:17:18.711210+0000","last_clean":"2023-10-25T16:17:18.711210+0000","last_became_active":"2023-10-25T16:17:17.671527+0000","last_became_peered":"2023-10-25T16:17:17.671527+0000","last_unstale":"2023-10-25T16:17:18.711210+0000","last_undegraded":"2023-10-25T16:17:18.711210+0000","last_fullsized":"2023-10-25T16:17:18.711210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:35.488420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222817+0000","last_change":"2023-10-25T16:17:17.640047+0000","last_active":"2023-10-25T16:17:19.222817+0000","last_peered":"2023-10-25T16:17:19.222817+0000","last_clean":"2023-10-25T16:17:19.222817+0000","last_became_active":"2023-10-25T16:17:17.639473+0000","last_became_peered":"2023-10-25T16:17:17.639473+0000","last_unstale":"2023-10-25T16:17:19.222817+0000","last_undegraded":"2023-10-25T16:17:19.222817+0000","last_fullsized":"2023-10-25T16:17:19.222817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710909+0000","last_change":"2023-10-25T16:17:17.646553+0000","last_active":"2023-10-25T16:17:18.710909+0000","last_peered":"2023-10-25T16:17:18.710909+0000","last_clean":"2023-10-25T16:17:18.710909+0000","last_became_active":"2023-10-25T16:17:17.645698+0000","last_became_peered":"2023-10-25T16:17:17.645698+0000","last_unstale":"2023-10-25T16:17:18.710909+0000","last_undegraded":"2023-10-25T16:17:18.710909+0000","last_fullsized":"2023-10-25T16:17:18.710909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:18:10.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710240+0000","last_change":"2023-10-25T16:17:17.660456+0000","last_active":"2023-10-25T16:17:18.710240+0000","last_peered":"2023-10-25T16:17:18.710240+0000","last_clean":"2023-10-25T16:17:18.710240+0000","last_became_active":"2023-10-25T16:17:17.658996+0000","last_became_peered":"2023-10-25T16:17:17.658996+0000","last_unstale":"2023-10-25T16:17:18.710240+0000","last_undegraded":"2023-10-25T16:17:18.710240+0000","last_fullsized":"2023-10-25T16:17:18.710240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:53.845062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632896+0000","last_change":"2023-10-25T16:17:17.641250+0000","last_active":"2023-10-25T16:17:18.632896+0000","last_peered":"2023-10-25T16:17:18.632896+0000","last_clean":"2023-10-25T16:17:18.632896+0000","last_became_active":"2023-10-25T16:17:17.640089+0000","last_became_peered":"2023-10-25T16:17:17.640089+0000","last_unstale":"2023-10-25T16:17:18.632896+0000","last_undegraded":"2023-10-25T16:17:18.632896+0000","last_fullsized":"2023-10-25T16:17:18.632896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:02.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632728+0000","last_change":"2023-10-25T16:17:17.665616+0000","last_active":"2023-10-25T16:17:18.632728+0000","last_peered":"2023-10-25T16:17:18.632728+0000","last_clean":"2023-10-25T16:17:18.632728+0000","last_became_active":"2023-10-25T16:17:17.664969+0000","last_became_peered":"2023-10-25T16:17:17.664969+0000","last_unstale":"2023-10-25T16:17:18.632728+0000","last_undegraded":"2023-10-25T16:17:18.632728+0000","last_fullsized":"2023-10-25T16:17:18.632728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:47:41.390733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711409+0000","last_change":"2023-10-25T16:17:17.646722+0000","last_active":"2023-10-25T16:17:18.711409+0000","last_peered":"2023-10-25T16:17:18.711409+0000","last_clean":"2023-10-25T16:17:18.711409+0000","last_became_active":"2023-10-25T16:17:17.645987+0000","last_became_peered":"2023-10-25T16:17:17.645987+0000","last_unstale":"2023-10-25T16:17:18.711409+0000","last_undegraded":"2023-10-25T16:17:18.711409+0000","last_fullsized":"2023-10-25T16:17:18.711409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:34.703288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710929+0000","last_change":"2023-10-25T16:17:17.670488+0000","last_active":"2023-10-25T16:17:18.710929+0000","last_peered":"2023-10-25T16:17:18.710929+0000","last_clean":"2023-10-25T16:17:18.710929+0000","last_became_active":"2023-10-25T16:17:17.669925+0000","last_became_peered":"2023-10-25T16:17:17.669925+0000","last_unstale":"2023-10-25T16:17:18.710929+0000","last_undegraded":"2023-10-25T16:17:18.710929+0000","last_fullsized":"2023-10-25T16:17:18.710929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:06.324016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222413+0000","last_change":"2023-10-25T16:17:17.641832+0000","last_active":"2023-10-25T16:17:19.222413+0000","last_peered":"2023-10-25T16:17:19.222413+0000","last_clean":"2023-10-25T16:17:19.222413+0000","last_became_active":"2023-10-25T16:17:17.641131+0000","last_became_peered":"2023-10-25T16:17:17.641131+0000","last_unstale":"2023-10-25T16:17:19.222413+0000","last_undegraded":"2023-10-25T16:17:19.222413+0000","last_fullsized":"2023-10-25T16:17:19.222413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:02.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709331+0000","last_change":"2023-10-25T16:17:17.657638+0000","last_active":"2023-10-25T16:17:18.709331+0000","last_peered":"2023-10-25T16:17:18.709331+0000","last_clean":"2023-10-25T16:17:18.709331+0000","last_became_active":"2023-10-25T16:17:17.657034+0000","last_became_peered":"2023-10-25T16:17:17.657034+0000","last_unstale":"2023-10-25T16:17:18.709331+0000","last_undegraded":"2023-10-25T16:17:18.709331+0000","last_fullsized":"2023-10-25T16:17:18.709331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:10.100210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222092+0000","last_change":"2023-10-25T16:17:17.642312+0000","last_active":"2023-10-25T16:17:19.222092+0000","last_peered":"2023-10-25T16:17:19.222092+0000","last_clean":"2023-10-25T16:17:19.222092+0000","last_became_active":"2023-10-25T16:17:17.641631+0000","last_became_peered":"2023-10-25T16:17:17.641631+0000","last_unstale":"2023-10-25T16:17:19.222092+0000","last_undegraded":"2023-10-25T16:17:19.222092+0000","last_fullsized":"2023-10-25T16:17:19.222092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:46.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711208+0000","last_change":"2023-10-25T16:17:17.658400+0000","last_active":"2023-10-25T16:17:18.711208+0000","last_peered":"2023-10-25T16:17:18.711208+0000","last_clean":"2023-10-25T16:17:18.711208+0000","last_became_active":"2023-10-25T16:17:17.657761+0000","last_became_peered":"2023-10-25T16:17:17.657761+0000","last_unstale":"2023-10-25T16:17:18.711208+0000","last_undegraded":"2023-10-25T16:17:18.711208+0000","last_fullsized":"2023-10-25T16:17:18.711208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:33:28.791708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711226+0000","last_change":"2023-10-25T16:17:17.658345+0000","last_active":"2023-10-25T16:17:18.711226+0000","last_peered":"2023-10-25T16:17:18.711226+0000","last_clean":"2023-10-25T16:17:18.711226+0000","last_became_active":"2023-10-25T16:17:17.657730+0000","last_became_peered":"2023-10-25T16:17:17.657730+0000","last_unstale":"2023-10-25T16:17:18.711226+0000","last_undegraded":"2023-10-25T16:17:18.711226+0000","last_fullsized":"2023-10-25T16:17:18.711226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:47.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711517+0000","last_change":"2023-10-25T16:17:17.665201+0000","last_active":"2023-10-25T16:17:18.711517+0000","last_peered":"2023-10-25T16:17:18.711517+0000","last_clean":"2023-10-25T16:17:18.711517+0000","last_became_active":"2023-10-25T16:17:17.664482+0000","last_became_peered":"2023-10-25T16:17:17.664482+0000","last_unstale":"2023-10-25T16:17:18.711517+0000","last_undegraded":"2023-10-25T16:17:18.711517+0000","last_fullsized":"2023-10-25T16:17:18.711517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:20.721957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633114+0000","last_change":"2023-10-25T16:17:17.663267+0000","last_active":"2023-10-25T16:17:18.633114+0000","last_peered":"2023-10-25T16:17:18.633114+0000","last_clean":"2023-10-25T16:17:18.633114+0000","last_became_active":"2023-10-25T16:17:17.662665+0000","last_became_peered":"2023-10-25T16:17:17.662665+0000","last_unstale":"2023-10-25T16:17:18.633114+0000","last_undegraded":"2023-10-25T16:17:18.633114+0000","last_fullsized":"2023-10-25T16:17:18.633114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:26:54.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"86'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633136+0000","last_change":"2023-10-25T16:17:16.904660+0000","last_active":"2023-10-25T16:17:18.633136+0000","last_peered":"2023-10-25T16:17:18.633136+0000","last_clean":"2023-10-25T16:17:18.633136+0000","last_became_active":"2023-10-25T16:17:16.903904+0000","last_became_peered":"2023-10-25T16:17:16.903904+0000","last_unstale":"2023-10-25T16:17:18.633136+0000","last_undegraded":"2023-10-25T16:17:18.633136+0000","last_fullsized":"2023-10-25T16:17:18.633136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:52:06.319525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221710+0000","last_change":"2023-10-25T16:17:16.892642+0000","last_active":"2023-10-25T16:17:19.221710+0000","last_peered":"2023-10-25T16:17:19.221710+0000","last_clean":"2023-10-25T16:17:19.221710+0000","last_became_active":"2023-10-25T16:17:16.892225+0000","last_became_peered":"2023-10-25T16:17:16.892225+0000","last_unstale":"2023-10-25T16:17:19.221710+0000","last_undegraded":"2023-10-25T16:17:19.221710+0000","last_fullsized":"2023-10-25T16:17:19.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:41.289281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710854+0000","last_change":"2023-10-25T16:17:17.673401+0000","last_active":"2023-10-25T16:17:18.710854+0000","last_peered":"2023-10-25T16:17:18.710854+0000","last_clean":"2023-10-25T16:17:18.710854+0000","last_became_active":"2023-10-25T16:17:17.667681+0000","last_became_peered":"2023-10-25T16:17:17.667681+0000","last_unstale":"2023-10-25T16:17:18.710854+0000","last_undegraded":"2023-10-25T16:17:18.710854+0000","last_fullsized":"2023-10-25T16:17:18.710854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:35.036194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712054+0000","last_change":"2023-10-25T16:17:16.916614+0000","last_active":"2023-10-25T16:17:18.712054+0000","last_peered":"2023-10-25T16:17:18.712054+0000","last_clean":"2023-10-25T16:17:18.712054+0000","last_became_active":"2023-10-25T16:17:16.914539+0000","last_became_peered":"2023-10-25T16:17:16.914539+0000","last_unstale":"2023-10-25T16:17:18.712054+0000","last_undegraded":"2023-10-25T16:17:18.712054+0000","last_fullsized":"2023-10-25T16:17:18.712054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:05.687178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633535+0000","last_change":"2023-10-25T16:17:17.641569+0000","last_active":"2023-10-25T16:17:18.633535+0000","last_peered":"2023-10-25T16:17:18.633535+0000","last_clean":"2023-10-25T16:17:18.633535+0000","last_became_active":"2023-10-25T16:17:17.640966+0000","last_became_peered":"2023-10-25T16:17:17.640966+0000","last_unstale":"2023-10-25T16:17:18.633535+0000","last_undegraded":"2023-10-25T16:17:18.633535+0000","last_fullsized":"2023-10-25T16:17:18.633535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711327+0000","last_change":"2023-10-25T16:17:16.922723+0000","last_active":"2023-10-25T16:17:18.711327+0000","last_peered":"2023-10-25T16:17:18.711327+0000","last_clean":"2023-10-25T16:17:18.711327+0000","last_became_active":"2023-10-25T16:17:16.920987+0000","last_became_peered":"2023-10-25T16:17:16.920987+0000","last_unstale":"2023-10-25T16:17:18.711327+0000","last_undegraded":"2023-10-25T16:17:18.711327+0000","last_fullsized":"2023-10-25T16:17:18.711327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:43.911566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709340+0000","last_change":"2023-10-25T16:17:17.645618+0000","last_active":"2023-10-25T16:17:18.709340+0000","last_peered":"2023-10-25T16:17:18.709340+0000","last_clean":"2023-10-25T16:17:18.709340+0000","last_became_active":"2023-10-25T16:17:17.645041+0000","last_became_peered":"2023-10-25T16:17:17.645041+0000","last_unstale":"2023-10-25T16:17:18.709340+0000","last_undegraded":"2023-10-25T16:17:18.709340+0000","last_fullsized":"2023-10-25T16:17:18.709340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:50:48.756330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222647+0000","last_change":"2023-10-25T16:17:16.900571+0000","last_active":"2023-10-25T16:17:19.222647+0000","last_peered":"2023-10-25T16:17:19.222647+0000","last_clean":"2023-10-25T16:17:19.222647+0000","last_became_active":"2023-10-25T16:17:16.900156+0000","last_became_peered":"2023-10-25T16:17:16.900156+0000","last_unstale":"2023-10-25T16:17:19.222647+0000","last_undegraded":"2023-10-25T16:17:19.222647+0000","last_fullsized":"2023-10-25T16:17:19.222647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:55.179521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710573+0000","last_change":"2023-10-25T16:17:17.643888+0000","last_active":"2023-10-25T16:17:18.710573+0000","last_peered":"2023-10-25T16:17:18.710573+0000","last_clean":"2023-10-25T16:17:18.710573+0000","last_became_active":"2023-10-25T16:17:17.643307+0000","last_became_peered":"2023-10-25T16:17:17.643307+0000","last_unstale":"2023-10-25T16:17:18.710573+0000","last_undegraded":"2023-10-25T16:17:18.710573+0000","last_fullsized":"2023-10-25T16:17:18.710573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:41:22.558797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712693+0000","last_change":"2023-10-25T16:17:16.914382+0000","last_active":"2023-10-25T16:17:18.712693+0000","last_peered":"2023-10-25T16:17:18.712693+0000","last_clean":"2023-10-25T16:17:18.712693+0000","last_became_active":"2023-10-25T16:17:16.913011+0000","last_became_peered":"2023-10-25T16:17:16.913011+0000","last_unstale":"2023-10-25T16:17:18.712693+0000","last_undegraded":"2023-10-25T16:17:18.712693+0000","last_fullsized":"2023-10-25T16:17:18.712693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:17.525133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706672+0000","last_change":"2023-10-25T16:17:16.902683+0000","last_active":"2023-10-25T16:17:18.706672+0000","last_peered":"2023-10-25T16:17:18.706672+0000","last_clean":"2023-10-25T16:17:18.706672+0000","last_became_active":"2023-10-25T16:17:16.902426+0000","last_became_peered":"2023-10-25T16:17:16.902426+0000","last_unstale":"2023-10-25T16:17:18.706672+0000","last_undegraded":"2023-10-25T16:17:18.706672+0000","last_fullsized":"2023-10-25T16:17:18.706672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:43.888268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221455+0000","last_change":"2023-10-25T16:17:17.641763+0000","last_active":"2023-10-25T16:17:19.221455+0000","last_peered":"2023-10-25T16:17:19.221455+0000","last_clean":"2023-10-25T16:17:19.221455+0000","last_became_active":"2023-10-25T16:17:17.641103+0000","last_became_peered":"2023-10-25T16:17:17.641103+0000","last_unstale":"2023-10-25T16:17:19.221455+0000","last_undegraded":"2023-10-25T16:17:19.221455+0000","last_fullsized":"2023-10-25T16:17:19.221455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870152+0000","last_change":"2023-10-25T16:17:15.870152+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870152+0000","last_undegraded":"2023-10-25T16:17:15.870152+0000","last_fullsized":"2023-10-25T16:17:15.870152+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709804+0000","last_change":"2023-10-25T16:17:17.644435+0000","last_active":"2023-10-25T16:17:18.709804+0000","last_peered":"2023-10-25T16:17:18.709804+0000","last_clean":"2023-10-25T16:17:18.709804+0000","last_became_active":"2023-10-25T16:17:17.643844+0000","last_became_peered":"2023-10-25T16:17:17.643844+0000","last_unstale":"2023-10-25T16:17:18.709804+0000","last_undegraded":"2023-10-25T16:17:18.709804+0000","last_fullsized":"2023-10-25T16:17:18.709804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:26.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711119+0000","last_change":"2023-10-25T16:17:16.907112+0000","last_active":"2023-10-25T16:17:18.711119+0000","last_peered":"2023-10-25T16:17:18.711119+0000","last_clean":"2023-10-25T16:17:18.711119+0000","last_became_active":"2023-10-25T16:17:16.906553+0000","last_became_peered":"2023-10-25T16:17:16.906553+0000","last_unstale":"2023-10-25T16:17:18.711119+0000","last_undegraded":"2023-10-25T16:17:18.711119+0000","last_fullsized":"2023-10-25T16:17:18.711119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:44.314093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633375+0000","last_change":"2023-10-25T16:17:17.671535+0000","last_active":"2023-10-25T16:17:18.633375+0000","last_peered":"2023-10-25T16:17:18.633375+0000","last_clean":"2023-10-25T16:17:18.633375+0000","last_became_active":"2023-10-25T16:17:17.670757+0000","last_became_peered":"2023-10-25T16:17:17.670757+0000","last_unstale":"2023-10-25T16:17:18.633375+0000","last_undegraded":"2023-10-25T16:17:18.633375+0000","last_fullsized":"2023-10-25T16:17:18.633375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711730+0000","last_change":"2023-10-25T16:17:16.915546+0000","last_active":"2023-10-25T16:17:18.711730+0000","last_peered":"2023-10-25T16:17:18.711730+0000","last_clean":"2023-10-25T16:17:18.711730+0000","last_became_active":"2023-10-25T16:17:16.913965+0000","last_became_peered":"2023-10-25T16:17:16.913965+0000","last_unstale":"2023-10-25T16:17:18.711730+0000","last_undegraded":"2023-10-25T16:17:18.711730+0000","last_fullsized":"2023-10-25T16:17:18.711730+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:38.764460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712008+0000","last_change":"2023-10-25T16:17:17.664015+0000","last_active":"2023-10-25T16:17:18.712008+0000","last_peered":"2023-10-25T16:17:18.712008+0000","last_clean":"2023-10-25T16:17:18.712008+0000","last_became_active":"2023-10-25T16:17:17.657376+0000","last_became_peered":"2023-10-25T16:17:17.657376+0000","last_unstale":"2023-10-25T16:17:18.712008+0000","last_undegraded":"2023-10-25T16:17:18.712008+0000","last_fullsized":"2023-10-25T16:17:18.712008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:06.701664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"86'3","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222234+0000","last_change":"2023-10-25T16:17:16.889040+0000","last_active":"2023-10-25T16:17:19.222234+0000","last_peered":"2023-10-25T16:17:19.222234+0000","last_clean":"2023-10-25T16:17:19.222234+0000","last_became_active":"2023-10-25T16:17:16.888693+0000","last_became_peered":"2023-10-25T16:17:16.888693+0000","last_unstale":"2023-10-25T16:17:19.222234+0000","last_undegraded":"2023-10-25T16:17:19.222234+0000","last_fullsized":"2023-10-25T16:17:19.222234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:41.426292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"86'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706781+0000","last_change":"2023-10-25T16:17:16.895306+0000","last_active":"2023-10-25T16:17:18.706781+0000","last_peered":"2023-10-25T16:17:18.706781+0000","last_clean":"2023-10-25T16:17:18.706781+0000","last_became_active":"2023-10-25T16:17:16.894773+0000","last_became_peered":"2023-10-25T16:17:16.894773+0000","last_unstale":"2023-10-25T16:17:18.706781+0000","last_undegraded":"2023-10-25T16:17:18.706781+0000","last_fullsized":"2023-10-25T16:17:18.706781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633557+0000","last_change":"2023-10-25T16:17:17.663646+0000","last_active":"2023-10-25T16:17:18.633557+0000","last_peered":"2023-10-25T16:17:18.633557+0000","last_clean":"2023-10-25T16:17:18.633557+0000","last_became_active":"2023-10-25T16:17:17.661252+0000","last_became_peered":"2023-10-25T16:17:17.661252+0000","last_unstale":"2023-10-25T16:17:18.633557+0000","last_undegraded":"2023-10-25T16:17:18.633557+0000","last_fullsized":"2023-10-25T16:17:18.633557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706575+0000","last_change":"2023-10-25T16:17:16.902496+0000","last_active":"2023-10-25T16:17:18.706575+0000","last_peered":"2023-10-25T16:17:18.706575+0000","last_clean":"2023-10-25T16:17:18.706575+0000","last_became_active":"2023-10-25T16:17:16.902164+0000","last_became_peered":"2023-10-25T16:17:16.902164+0000","last_unstale":"2023-10-25T16:17:18.706575+0000","last_undegraded":"2023-10-25T16:17:18.706575+0000","last_fullsized":"2023-10-25T16:17:18.706575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:59.831665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711511+0000","last_change":"2023-10-25T16:17:17.647894+0000","last_active":"2023-10-25T16:17:18.711511+0000","last_peered":"2023-10-25T16:17:18.711511+0000","last_clean":"2023-10-25T16:17:18.711511+0000","last_became_active":"2023-10-25T16:17:17.647364+0000","last_became_peered":"2023-10-25T16:17:17.647364+0000","last_unstale":"2023-10-25T16:17:18.711511+0000","last_undegraded":"2023-10-25T16:17:18.711511+0000","last_fullsized":"2023-10-25T16:17:18.711511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:00.360348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711442+0000","last_change":"2023-10-25T16:17:16.922145+0000","last_active":"2023-10-25T16:17:18.711442+0000","last_peered":"2023-10-25T16:17:18.711442+0000","last_clean":"2023-10-25T16:17:18.711442+0000","last_became_active":"2023-10-25T16:17:16.919735+0000","last_became_peered":"2023-10-25T16:17:16.919735+0000","last_unstale":"2023-10-25T16:17:18.711442+0000","last_undegraded":"2023-10-25T16:17:18.711442+0000","last_fullsized":"2023-10-25T16:17:18.711442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:23.286095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222668+0000","last_change":"2023-10-25T16:17:17.660321+0000","last_active":"2023-10-25T16:17:19.222668+0000","last_peered":"2023-10-25T16:17:19.222668+0000","last_clean":"2023-10-25T16:17:19.222668+0000","last_became_active":"2023-10-25T16:17:17.657197+0000","last_became_peered":"2023-10-25T16:17:17.657197+0000","last_unstale":"2023-10-25T16:17:19.222668+0000","last_undegraded":"2023-10-25T16:17:19.222668+0000","last_fullsized":"2023-10-25T16:17:19.222668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710326+0000","last_change":"2023-10-25T16:17:16.912258+0000","last_active":"2023-10-25T16:17:18.710326+0000","last_peered":"2023-10-25T16:17:18.710326+0000","last_clean":"2023-10-25T16:17:18.710326+0000","last_became_active":"2023-10-25T16:17:16.909426+0000","last_became_peered":"2023-10-25T16:17:16.909426+0000","last_unstale":"2023-10-25T16:17:18.710326+0000","last_undegraded":"2023-10-25T16:17:18.710326+0000","last_fullsized":"2023-10-25T16:17:18.710326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:25:41.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"86'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709580+0000","last_change":"2023-10-25T16:17:16.910296+0000","last_active":"2023-10-25T16:17:18.709580+0000","last_peered":"2023-10-25T16:17:18.709580+0000","last_clean":"2023-10-25T16:17:18.709580+0000","last_became_active":"2023-10-25T16:17:16.908878+0000","last_became_peered":"2023-10-25T16:17:16.908878+0000","last_unstale":"2023-10-25T16:17:18.709580+0000","last_undegraded":"2023-10-25T16:17:18.709580+0000","last_fullsized":"2023-10-25T16:17:18.709580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:11.115383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711706+0000","last_change":"2023-10-25T16:17:17.656830+0000","last_active":"2023-10-25T16:17:18.711706+0000","last_peered":"2023-10-25T16:17:18.711706+0000","last_clean":"2023-10-25T16:17:18.711706+0000","last_became_active":"2023-10-25T16:17:17.655972+0000","last_became_peered":"2023-10-25T16:17:17.655972+0000","last_unstale":"2023-10-25T16:17:18.711706+0000","last_undegraded":"2023-10-25T16:17:18.711706+0000","last_fullsized":"2023-10-25T16:17:18.711706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:53.126893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712223+0000","last_change":"2023-10-25T16:17:16.908715+0000","last_active":"2023-10-25T16:17:18.712223+0000","last_peered":"2023-10-25T16:17:18.712223+0000","last_clean":"2023-10-25T16:17:18.712223+0000","last_became_active":"2023-10-25T16:17:16.907871+0000","last_became_peered":"2023-10-25T16:17:16.907871+0000","last_unstale":"2023-10-25T16:17:18.712223+0000","last_undegraded":"2023-10-25T16:17:18.712223+0000","last_fullsized":"2023-10-25T16:17:18.712223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:05:35.321099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633447+0000","last_change":"2023-10-25T16:17:17.668641+0000","last_active":"2023-10-25T16:17:18.633447+0000","last_peered":"2023-10-25T16:17:18.633447+0000","last_clean":"2023-10-25T16:17:18.633447+0000","last_became_active":"2023-10-25T16:17:17.667991+0000","last_became_peered":"2023-10-25T16:17:17.667991+0000","last_unstale":"2023-10-25T16:17:18.633447+0000","last_undegraded":"2023-10-25T16:17:18.633447+0000","last_fullsized":"2023-10-25T16:17:18.633447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712274+0000","last_change":"2023-10-25T16:17:16.917091+0000","last_active":"2023-10-25T16:17:18.712274+0000","last_peered":"2023-10-25T16:17:18.712274+0000","last_clean":"2023-10-25T16:17:18.712274+0000","last_became_active":"2023-10-25T16:17:16.916009+0000","last_became_peered":"2023-10-25T16:17:16.916009+0000","last_unstale":"2023-10-25T16:17:18.712274+0000","last_undegraded":"2023-10-25T16:17:18.712274+0000","last_fullsized":"2023-10-25T16:17:18.712274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:22.208994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706661+0000","last_change":"2023-10-25T16:17:17.662947+0000","last_active":"2023-10-25T16:17:18.706661+0000","last_peered":"2023-10-25T16:17:18.706661+0000","last_clean":"2023-10-25T16:17:18.706661+0000","last_became_active":"2023-10-25T16:17:17.658737+0000","last_became_peered":"2023-10-25T16:17:17.658737+0000","last_unstale":"2023-10-25T16:17:18.706661+0000","last_undegraded":"2023-10-25T16:17:18.706661+0000","last_fullsized":"2023-10-25T16:17:18.706661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:40.814420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711854+0000","last_change":"2023-10-25T16:17:16.922400+0000","last_active":"2023-10-25T16:17:18.711854+0000","last_peered":"2023-10-25T16:17:18.711854+0000","last_clean":"2023-10-25T16:17:18.711854+0000","last_became_active":"2023-10-25T16:17:16.920276+0000","last_became_peered":"2023-10-25T16:17:16.920276+0000","last_unstale":"2023-10-25T16:17:18.711854+0000","last_undegraded":"2023-10-25T16:17:18.711854+0000","last_fullsized":"2023-10-25T16:17:18.711854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:39.799934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633115+0000","last_change":"2023-10-25T16:17:16.908243+0000","last_active":"2023-10-25T16:17:18.633115+0000","last_peered":"2023-10-25T16:17:18.633115+0000","last_clean":"2023-10-25T16:17:18.633115+0000","last_became_active":"2023-10-25T16:17:16.907544+0000","last_became_peered":"2023-10-25T16:17:16.907544+0000","last_unstale":"2023-10-25T16:17:18.633115+0000","last_undegraded":"2023-10-25T16:17:18.633115+0000","last_fullsized":"2023-10-25T16:17:18.633115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:46.667209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221980+0000","last_change":"2023-10-25T16:17:17.667150+0000","last_active":"2023-10-25T16:17:19.221980+0000","last_peered":"2023-10-25T16:17:19.221980+0000","last_clean":"2023-10-25T16:17:19.221980+0000","last_became_active":"2023-10-25T16:17:17.666514+0000","last_became_peered":"2023-10-25T16:17:17.666514+0000","last_unstale":"2023-10-25T16:17:19.221980+0000","last_undegraded":"2023-10-25T16:17:19.221980+0000","last_fullsized":"2023-10-25T16:17:19.221980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:35.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712418+0000","last_change":"2023-10-25T16:17:16.902912+0000","last_active":"2023-10-25T16:17:18.712418+0000","last_peered":"2023-10-25T16:17:18.712418+0000","last_clean":"2023-10-25T16:17:18.712418+0000","last_became_active":"2023-10-25T16:17:16.901611+0000","last_became_peered":"2023-10-25T16:17:16.901611+0000","last_unstale":"2023-10-25T16:17:18.712418+0000","last_undegraded":"2023-10-25T16:17:18.712418+0000","last_fullsized":"2023-10-25T16:17:18.712418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222414+0000","last_change":"2023-10-25T16:17:17.668159+0000","last_active":"2023-10-25T16:17:19.222414+0000","last_peered":"2023-10-25T16:17:19.222414+0000","last_clean":"2023-10-25T16:17:19.222414+0000","last_became_active":"2023-10-25T16:17:17.667584+0000","last_became_peered":"2023-10-25T16:17:17.667584+0000","last_unstale":"2023-10-25T16:17:19.222414+0000","last_undegraded":"2023-10-25T16:17:19.222414+0000","last_fullsized":"2023-10-25T16:17:19.222414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:38:50.403559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711714+0000","last_change":"2023-10-25T16:17:16.899174+0000","last_active":"2023-10-25T16:17:18.711714+0000","last_peered":"2023-10-25T16:17:18.711714+0000","last_clean":"2023-10-25T16:17:18.711714+0000","last_became_active":"2023-10-25T16:17:16.897638+0000","last_became_peered":"2023-10-25T16:17:16.897638+0000","last_unstale":"2023-10-25T16:17:18.711714+0000","last_undegraded":"2023-10-25T16:17:18.711714+0000","last_fullsized":"2023-10-25T16:17:18.711714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:56.936496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221988+0000","last_change":"2023-10-25T16:17:17.661441+0000","last_active":"2023-10-25T16:17:19.221988+0000","last_peered":"2023-10-25T16:17:19.221988+0000","last_clean":"2023-10-25T16:17:19.221988+0000","last_became_active":"2023-10-25T16:17:17.660843+0000","last_became_peered":"2023-10-25T16:17:17.660843+0000","last_unstale":"2023-10-25T16:17:19.221988+0000","last_undegraded":"2023-10-25T16:17:19.221988+0000","last_fullsized":"2023-10-25T16:17:19.221988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:27.304996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221675+0000","last_change":"2023-10-25T16:17:16.891743+0000","last_active":"2023-10-25T16:17:19.221675+0000","last_peered":"2023-10-25T16:17:19.221675+0000","last_clean":"2023-10-25T16:17:19.221675+0000","last_became_active":"2023-10-25T16:17:16.891421+0000","last_became_peered":"2023-10-25T16:17:16.891421+0000","last_unstale":"2023-10-25T16:17:19.221675+0000","last_undegraded":"2023-10-25T16:17:19.221675+0000","last_fullsized":"2023-10-25T16:17:19.221675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:23.033726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222958+0000","last_change":"2023-10-25T16:17:17.660916+0000","last_active":"2023-10-25T16:17:19.222958+0000","last_peered":"2023-10-25T16:17:19.222958+0000","last_clean":"2023-10-25T16:17:19.222958+0000","last_became_active":"2023-10-25T16:17:17.658152+0000","last_became_peered":"2023-10-25T16:17:17.658152+0000","last_unstale":"2023-10-25T16:17:19.222958+0000","last_undegraded":"2023-10-25T16:17:19.222958+0000","last_fullsized":"2023-10-25T16:17:19.222958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711950+0000","last_change":"2023-10-25T16:17:16.912609+0000","last_active":"2023-10-25T16:17:18.711950+0000","last_peered":"2023-10-25T16:17:18.711950+0000","last_clean":"2023-10-25T16:17:18.711950+0000","last_became_active":"2023-10-25T16:17:16.908119+0000","last_became_peered":"2023-10-25T16:17:16.908119+0000","last_unstale":"2023-10-25T16:17:18.711950+0000","last_undegraded":"2023-10-25T16:17:18.711950+0000","last_fullsized":"2023-10-25T16:17:18.711950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:51.627276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710119+0000","last_change":"2023-10-25T16:17:17.663862+0000","last_active":"2023-10-25T16:17:18.710119+0000","last_peered":"2023-10-25T16:17:18.710119+0000","last_clean":"2023-10-25T16:17:18.710119+0000","last_became_active":"2023-10-25T16:17:17.662309+0000","last_became_peered":"2023-10-25T16:17:17.662309+0000","last_unstale":"2023-10-25T16:17:18.710119+0000","last_undegraded":"2023-10-25T16:17:18.710119+0000","last_fullsized":"2023-10-25T16:17:18.710119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:20:41.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709789+0000","last_change":"2023-10-25T16:17:16.909558+0000","last_active":"2023-10-25T16:17:18.709789+0000","last_peered":"2023-10-25T16:17:18.709789+0000","last_clean":"2023-10-25T16:17:18.709789+0000","last_became_active":"2023-10-25T16:17:16.908758+0000","last_became_peered":"2023-10-25T16:17:16.908758+0000","last_unstale":"2023-10-25T16:17:18.709789+0000","last_undegraded":"2023-10-25T16:17:18.709789+0000","last_fullsized":"2023-10-25T16:17:18.709789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:18:52.859828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633861+0000","last_change":"2023-10-25T16:17:17.660209+0000","last_active":"2023-10-25T16:17:18.633861+0000","last_peered":"2023-10-25T16:17:18.633861+0000","last_clean":"2023-10-25T16:17:18.633861+0000","last_became_active":"2023-10-25T16:17:17.659576+0000","last_became_peered":"2023-10-25T16:17:17.659576+0000","last_unstale":"2023-10-25T16:17:18.633861+0000","last_undegraded":"2023-10-25T16:17:18.633861+0000","last_fullsized":"2023-10-25T16:17:18.633861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:41:33.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870150+0000","last_change":"2023-10-25T16:17:15.870150+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870150+0000","last_undegraded":"2023-10-25T16:17:15.870150+0000","last_fullsized":"2023-10-25T16:17:15.870150+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633812+0000","last_change":"2023-10-25T16:17:17.641836+0000","last_active":"2023-10-25T16:17:18.633812+0000","last_peered":"2023-10-25T16:17:18.633812+0000","last_clean":"2023-10-25T16:17:18.633812+0000","last_became_active":"2023-10-25T16:17:17.640900+0000","last_became_peered":"2023-10-25T16:17:17.640900+0000","last_unstale":"2023-10-25T16:17:18.633812+0000","last_undegraded":"2023-10-25T16:17:18.633812+0000","last_fullsized":"2023-10-25T16:17:18.633812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.223013+0000","last_change":"2023-10-25T16:17:16.907260+0000","last_active":"2023-10-25T16:17:19.223013+0000","last_peered":"2023-10-25T16:17:19.223013+0000","last_clean":"2023-10-25T16:17:19.223013+0000","last_became_active":"2023-10-25T16:17:16.907025+0000","last_became_peered":"2023-10-25T16:17:16.907025+0000","last_unstale":"2023-10-25T16:17:19.223013+0000","last_undegraded":"2023-10-25T16:17:19.223013+0000","last_fullsized":"2023-10-25T16:17:19.223013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:01.984830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:17:16.866811+0000","last_change":"2023-10-25T16:17:16.866811+0000","last_active":"2023-10-25T16:17:16.866811+0000","last_peered":"2023-10-25T16:17:16.866811+0000","last_clean":"2023-10-25T16:17:16.866811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:16.866811+0000","last_undegraded":"2023-10-25T16:17:16.866811+0000","last_fullsized":"2023-10-25T16:17:16.866811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2023-10-25T16:17:15.870220+0000","last_change":"2023-10-25T16:17:15.870220+0000","last_active":"2023-10-25T16:17:15.852324+0000","last_peered":"2023-10-25T16:17:15.852324+0000","last_clean":"2023-10-25T16:17:15.852324+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:17:15.870220+0000","last_undegraded":"2023-10-25T16:17:15.870220+0000","last_fullsized":"2023-10-25T16:17:15.870220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711184+0000","last_change":"2023-10-25T16:17:17.672992+0000","last_active":"2023-10-25T16:17:18.711184+0000","last_peered":"2023-10-25T16:17:18.711184+0000","last_clean":"2023-10-25T16:17:18.711184+0000","last_became_active":"2023-10-25T16:17:17.666970+0000","last_became_peered":"2023-10-25T16:17:17.666970+0000","last_unstale":"2023-10-25T16:17:18.711184+0000","last_undegraded":"2023-10-25T16:17:18.711184+0000","last_fullsized":"2023-10-25T16:17:18.711184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:31.108645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706743+0000","last_change":"2023-10-25T16:17:16.905625+0000","last_active":"2023-10-25T16:17:18.706743+0000","last_peered":"2023-10-25T16:17:18.706743+0000","last_clean":"2023-10-25T16:17:18.706743+0000","last_became_active":"2023-10-25T16:17:16.905397+0000","last_became_peered":"2023-10-25T16:17:16.905397+0000","last_unstale":"2023-10-25T16:17:18.706743+0000","last_undegraded":"2023-10-25T16:17:18.706743+0000","last_fullsized":"2023-10-25T16:17:18.706743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706602+0000","last_change":"2023-10-25T16:17:17.669175+0000","last_active":"2023-10-25T16:17:18.706602+0000","last_peered":"2023-10-25T16:17:18.706602+0000","last_clean":"2023-10-25T16:17:18.706602+0000","last_became_active":"2023-10-25T16:17:17.668211+0000","last_became_peered":"2023-10-25T16:17:17.668211+0000","last_unstale":"2023-10-25T16:17:18.706602+0000","last_undegraded":"2023-10-25T16:17:18.706602+0000","last_fullsized":"2023-10-25T16:17:18.706602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:24.300581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709817+0000","last_change":"2023-10-25T16:17:16.910651+0000","last_active":"2023-10-25T16:17:18.709817+0000","last_peered":"2023-10-25T16:17:18.709817+0000","last_clean":"2023-10-25T16:17:18.709817+0000","last_became_active":"2023-10-25T16:17:16.909696+0000","last_became_peered":"2023-10-25T16:17:16.909696+0000","last_unstale":"2023-10-25T16:17:18.709817+0000","last_undegraded":"2023-10-25T16:17:18.709817+0000","last_fullsized":"2023-10-25T16:17:18.709817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:53.032575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712481+0000","last_change":"2023-10-25T16:17:17.671027+0000","last_active":"2023-10-25T16:17:18.712481+0000","last_peered":"2023-10-25T16:17:18.712481+0000","last_clean":"2023-10-25T16:17:18.712481+0000","last_became_active":"2023-10-25T16:17:17.669539+0000","last_became_peered":"2023-10-25T16:17:17.669539+0000","last_unstale":"2023-10-25T16:17:18.712481+0000","last_undegraded":"2023-10-25T16:17:18.712481+0000","last_fullsized":"2023-10-25T16:17:18.712481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:34.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712622+0000","last_change":"2023-10-25T16:17:16.902431+0000","last_active":"2023-10-25T16:17:18.712622+0000","last_peered":"2023-10-25T16:17:18.712622+0000","last_clean":"2023-10-25T16:17:18.712622+0000","last_became_active":"2023-10-25T16:17:16.900783+0000","last_became_peered":"2023-10-25T16:17:16.900783+0000","last_unstale":"2023-10-25T16:17:18.712622+0000","last_undegraded":"2023-10-25T16:17:18.712622+0000","last_fullsized":"2023-10-25T16:17:18.712622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222267+0000","last_change":"2023-10-25T16:17:17.666667+0000","last_active":"2023-10-25T16:17:19.222267+0000","last_peered":"2023-10-25T16:17:19.222267+0000","last_clean":"2023-10-25T16:17:19.222267+0000","last_became_active":"2023-10-25T16:17:17.666071+0000","last_became_peered":"2023-10-25T16:17:17.666071+0000","last_unstale":"2023-10-25T16:17:19.222267+0000","last_undegraded":"2023-10-25T16:17:19.222267+0000","last_fullsized":"2023-10-25T16:17:19.222267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:14:54.061159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712904+0000","last_change":"2023-10-25T16:17:16.913949+0000","last_active":"2023-10-25T16:17:18.712904+0000","last_peered":"2023-10-25T16:17:18.712904+0000","last_clean":"2023-10-25T16:17:18.712904+0000","last_became_active":"2023-10-25T16:17:16.911491+0000","last_became_peered":"2023-10-25T16:17:16.911491+0000","last_unstale":"2023-10-25T16:17:18.712904+0000","last_undegraded":"2023-10-25T16:17:18.712904+0000","last_fullsized":"2023-10-25T16:17:18.712904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:55.386778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.633792+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:17:17.633792+0000","last_peered":"2023-10-25T16:17:17.633792+0000","last_clean":"2023-10-25T16:17:17.633792+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:17:17.633792+0000","last_undegraded":"2023-10-25T16:17:17.633792+0000","last_fullsized":"2023-10-25T16:17:17.633792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:15.165202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":434,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194877,"statfs":{"total":200000000,"available":199554963,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.88900000000000001,"5min":1.077,"15min":1.077},"last":0.432}]},{"osd":1,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.307,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0309999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59599999999999997,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.87,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.61599999999999999,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2529999999999999,"5min":1.345,"15min":1.345},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.1919999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83999999999999997},"min":{"1min":0.73599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.60999999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.1639999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.67900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.147,"5min":1.581,"15min":1.581},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.90200000000000002,"15min":0.878},"min":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.131,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90600000000000003,"15min":0.92700000000000005},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.155,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92300000000000004,"15min":0.91100000000000003},"min":{"1min":0.79600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.133,"5min":1.677,"15min":1.677},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95999999999999996,"15min":0.95499999999999996},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2050000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.61699999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1030,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0920000000000001,"5min":1.256,"15min":1.256},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.83099999999999996},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.91500000000000004,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.29,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.2410000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.85599999999999998,"15min":0.82999999999999996},"min":{"1min":0.58399999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1910000000000001,"5min":1.27,"15min":1.27},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.71199999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.159,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3420000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.97399999999999998,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0289999999999999,"15min":1.0389999999999999},"min":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.151},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1259999999999999},"min":{"1min":0.72399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.397,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.86399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.397,"15min":1.397},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.224,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90100000000000002,"15min":0.88500000000000001},"min":{"1min":0.626,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2090000000000001,"5min":1.302,"15min":1.302},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.754,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.119,"5min":1.476,"15min":1.476},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.018,"5min":0.92200000000000004,"15min":0.88400000000000001},"min":{"1min":0.81599999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.749},{"interface":"front","average":{"1min":1.016,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.77000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2330000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2250000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.99199999999999999},"min":{"1min":0.70599999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":1.413,"15min":1.413},"last":0.92100000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.96899999999999997},"min":{"1min":0.72899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.65800000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3400000000000001,"5min":1.895,"15min":1.895},"last":1.046}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.081,"15min":1.079},"min":{"1min":0.81799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3049999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0640000000000001,"15min":1.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.296,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.1259999999999999,"15min":1.3700000000000001},"min":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.661,"5min":14.843,"15min":14.843},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.173,"15min":1.5149999999999999},"min":{"1min":0.66100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":16.439,"15min":16.439},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.161,"15min":1.4370000000000001},"min":{"1min":0.64300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2150000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.157},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88700000000000001,"15min":0.86799999999999999},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.224,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.129}]},{"osd":2,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.91800000000000004,"15min":0.93600000000000005},"min":{"1min":0.77900000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.22,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.97099999999999997,"15min":0.96699999999999997},"min":{"1min":0.63300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2470000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.98099999999999998,"15min":0.99099999999999999},"min":{"1min":0.80300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1699999999999999,"5min":1.252,"15min":1.252},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.323,"15min":1.5389999999999999},"min":{"1min":1.0580000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8149999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3140000000000001,"15min":1.625},"min":{"1min":0.68600000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":15.904,"15min":15.904},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.3069999999999999,"15min":1.6559999999999999},"min":{"1min":0.75800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.879,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.278,"15min":1.524},"min":{"1min":0.67800000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.748,"5min":14.567,"15min":14.567},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.4450000000000001,"15min":1.7390000000000001},"min":{"1min":0.89500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.599,"5min":15.089,"15min":15.089},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.397,"15min":1.7729999999999999},"min":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7090000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1970000000000001,"15min":1.272},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9530000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82799999999999996,"15min":0.80000000000000004},"min":{"1min":0.66900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.327,"5min":1.47,"15min":1.47},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.85899999999999999,"15min":0.81799999999999995},"min":{"1min":0.71299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":1.1659999999999999,"5min":1.288,"15min":1.288},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.58899999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":0.89300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2290000000000001,"5min":1.369,"15min":1.369},"last":1.052},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.78500000000000003},"min":{"1min":0.64100000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.518,"15min":1.518},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.69499999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.121,"15min":1.121},"min":{"1min":0.91200000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.24}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":2.085,"15min":2.085},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.329}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.196,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":1.0289999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":447,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194865,"statfs":{"total":200000000,"available":199541801,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.59799999999999998,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.25700000000000001,"5min":0.222,"15min":0.222},"max":{"1min":1.004,"5min":1.083,"15min":1.083},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.255,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.99399999999999999,"15min":0.98699999999999999},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.427,"15min":1.427},"last":0.78600000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.214,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3720000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.306,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.663,"15min":1.663},"last":0.93700000000000006}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.58099999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.47,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.038},{"interface":"front","average":{"1min":1.022,"5min":0.96999999999999997,"15min":0.94599999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.252,"5min":1.389,"15min":1.389},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":455,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194856,"statfs":{"total":200000000,"available":199533385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.97099999999999997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.129,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.318}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.58899999999999997,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1499999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.318,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.371,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.034,"5min":1.423,"15min":1.423},"last":0.375}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.05,"15min":0.97699999999999998},"min":{"1min":0.69199999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":12.698,"15min":12.698},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.1000000000000001,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.214,"5min":12.721,"15min":12.721},"last":0.84699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.92900000000000005,"15min":0.91700000000000004},"min":{"1min":0.57999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2549999999999999,"5min":1.546,"15min":1.546},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2290000000000001,"5min":2.206,"15min":2.206},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":1.022},"min":{"1min":0.69199999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.381,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0980000000000001,"15min":0.98199999999999998},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.268,"5min":14.776,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.093,"15min":1.0169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4339999999999999,"5min":10.509,"15min":10.509},"last":1.0640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1023,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194288,"statfs":{"total":200000000,"available":198951545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.70499999999999996},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.94899999999999995,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.749},"min":{"1min":0.34899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0069999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84899999999999998,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95199999999999996,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.78500000000000003},"min":{"1min":0.33100000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":1.101},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.45300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1699999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.68400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0960000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.93000000000000005},"min":{"1min":0.64700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.997}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.88200000000000001,"15min":0.85299999999999998},"min":{"1min":0.73399999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2190000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91900000000000004,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.105,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.206,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93200000000000005,"15min":0.91700000000000004},"min":{"1min":0.82399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2869999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.121}]},{"osd":7,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.3220000000000001},"min":{"1min":0.81799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3080000000000001,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1619999999999999,"15min":1.339},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3360000000000001,"5min":11.622,"15min":11.622},"last":1.073}]}]}],"pool_statfs":[]}} 2023-10-25T16:17:22.847 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-10-25T16:17:22.848+0000 7f643457d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:17:25.322 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:17:25.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 -- 172.21.15.177:0/1377673540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 msgr2=0x7f498406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 --2- 172.21.15.177:0/1377673540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f498406be10 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f497c009bf0 tx=0x7f497c01cb50 comp rx=0 tx=0).stop 2023-10-25T16:17:25.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 -- 172.21.15.177:0/1377673540 shutdown_connections 2023-10-25T16:17:25.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 --2- 172.21.15.177:0/1377673540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f498406be10 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 --2- 172.21.15.177:0/1377673540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4984159230 0x7f4984071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 -- 172.21.15.177:0/1377673540 >> 172.21.15.177:0/1377673540 conn(0x7f49840b2450 msgr2=0x7f49840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:25.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 -- 172.21.15.177:0/1377673540 shutdown_connections 2023-10-25T16:17:25.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.449+0000 7f498a10e640 1 -- 172.21.15.177:0/1377673540 wait complete. 2023-10-25T16:17:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 Processor -- start 2023-10-25T16:17:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- start start 2023-10-25T16:17:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f4984149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4984070510 0x7f49840ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4984159230 0x7f4984153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840b0810 con 0x7f498406b980 2023-10-25T16:17:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49840acd30 con 0x7f4984159230 2023-10-25T16:17:25.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49840ad8a0 con 0x7f4984070510 2023-10-25T16:17:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f4984149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f4984149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34606/0 (socket says 172.21.15.177:34606) 2023-10-25T16:17:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 -- 172.21.15.177:0/3205758197 learned_addr learned my addr 172.21.15.177:0/3205758197 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f497affd640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4984070510 0x7f49840ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 -- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4984070510 msgr2=0x7f49840ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4984070510 0x7f49840ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f4983fff640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4984159230 0x7f4984153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 -- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4984159230 msgr2=0x7f4984153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4984159230 0x7f4984153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 -- 172.21.15.177:0/3205758197 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c009820 con 0x7f498406b980 2023-10-25T16:17:25.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f49837fe640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f4984149f20 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f49740058d0 tx=0x7f497400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:25.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974009c30 con 0x7f498406b980 2023-10-25T16:17:25.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4974009e80 con 0x7f498406b980 2023-10-25T16:17:25.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49740106a0 con 0x7f498406b980 2023-10-25T16:17:25.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49840adb80 con 0x7f498406b980 2023-10-25T16:17:25.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49840ae140 con 0x7f498406b980 2023-10-25T16:17:25.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498404daf0 con 0x7f498406b980 2023-10-25T16:17:25.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.453+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4974010800 con 0x7f498406b980 2023-10-25T16:17:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.457+0000 7f4980ff9640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4964066470 0x7f4964068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.457+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4974084320 con 0x7f498406b980 2023-10-25T16:17:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.457+0000 7f497affd640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4964066470 0x7f4964068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.457+0000 7f497affd640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4964066470 0x7f4964068930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f496c0010a0 tx=0x7f496c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:25.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.461+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f49740517a0 con 0x7f498406b980 2023-10-25T16:17:25.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.609+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49840b0950 con 0x7f4964066470 2023-10-25T16:17:25.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f4980ff9640 1 -- 172.21.15.177:0/3205758197 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283781 (secure 0 0 0) 0x7f496c001bf0 con 0x7f4964066470 2023-10-25T16:17:25.638 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:17:25.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4964066470 msgr2=0x7f4964068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4964066470 0x7f4964068930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f496c0010a0 tx=0x7f496c009040 comp rx=0 tx=0).stop 2023-10-25T16:17:25.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 msgr2=0x7f4984149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f4984149f20 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f49740058d0 tx=0x7f497400dde0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 shutdown_connections 2023-10-25T16:17:25.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4964066470 0x7f4964068930 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4984159230 0x7f4984153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4984070510 0x7f49840ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 --2- 172.21.15.177:0/3205758197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f498406b980 0x7f4984149f20 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 >> 172.21.15.177:0/3205758197 conn(0x7f49840b2450 msgr2=0x7f4984157510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:25.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 shutdown_connections 2023-10-25T16:17:25.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.633+0000 7f498a10e640 1 -- 172.21.15.177:0/3205758197 wait complete. 2023-10-25T16:17:25.656 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2023-10-25T16:17:24.693163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557726,"statfs":{"total":1600000000,"available":1595111948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.809059"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632846+0000","last_change":"2023-10-25T16:17:17.664185+0000","last_active":"2023-10-25T16:17:18.632846+0000","last_peered":"2023-10-25T16:17:18.632846+0000","last_clean":"2023-10-25T16:17:18.632846+0000","last_became_active":"2023-10-25T16:17:17.662766+0000","last_became_peered":"2023-10-25T16:17:17.662766+0000","last_unstale":"2023-10-25T16:17:18.632846+0000","last_undegraded":"2023-10-25T16:17:18.632846+0000","last_fullsized":"2023-10-25T16:17:18.632846+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:24.048212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711163+0000","last_change":"2023-10-25T16:17:17.657987+0000","last_active":"2023-10-25T16:17:18.711163+0000","last_peered":"2023-10-25T16:17:18.711163+0000","last_clean":"2023-10-25T16:17:18.711163+0000","last_became_active":"2023-10-25T16:17:17.657323+0000","last_became_peered":"2023-10-25T16:17:17.657323+0000","last_unstale":"2023-10-25T16:17:18.711163+0000","last_undegraded":"2023-10-25T16:17:18.711163+0000","last_fullsized":"2023-10-25T16:17:18.711163+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:54.047062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221594+0000","last_change":"2023-10-25T16:17:17.641611+0000","last_active":"2023-10-25T16:17:19.221594+0000","last_peered":"2023-10-25T16:17:19.221594+0000","last_clean":"2023-10-25T16:17:19.221594+0000","last_became_active":"2023-10-25T16:17:17.640892+0000","last_became_peered":"2023-10-25T16:17:17.640892+0000","last_unstale":"2023-10-25T16:17:19.221594+0000","last_undegraded":"2023-10-25T16:17:19.221594+0000","last_fullsized":"2023-10-25T16:17:19.221594+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:22:10.948309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706444+0000","last_change":"2023-10-25T16:17:17.668748+0000","last_active":"2023-10-25T16:17:18.706444+0000","last_peered":"2023-10-25T16:17:18.706444+0000","last_clean":"2023-10-25T16:17:18.706444+0000","last_became_active":"2023-10-25T16:17:17.667153+0000","last_became_peered":"2023-10-25T16:17:17.667153+0000","last_unstale":"2023-10-25T16:17:18.706444+0000","last_undegraded":"2023-10-25T16:17:18.706444+0000","last_fullsized":"2023-10-25T16:17:18.706444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:52.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634275+0000","last_change":"2023-10-25T16:17:17.656823+0000","last_active":"2023-10-25T16:17:18.634275+0000","last_peered":"2023-10-25T16:17:18.634275+0000","last_clean":"2023-10-25T16:17:18.634275+0000","last_became_active":"2023-10-25T16:17:17.655344+0000","last_became_peered":"2023-10-25T16:17:17.655344+0000","last_unstale":"2023-10-25T16:17:18.634275+0000","last_undegraded":"2023-10-25T16:17:18.634275+0000","last_fullsized":"2023-10-25T16:17:18.634275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:13:01.388445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710526+0000","last_change":"2023-10-25T16:17:17.674620+0000","last_active":"2023-10-25T16:17:18.710526+0000","last_peered":"2023-10-25T16:17:18.710526+0000","last_clean":"2023-10-25T16:17:18.710526+0000","last_became_active":"2023-10-25T16:17:17.672434+0000","last_became_peered":"2023-10-25T16:17:17.672434+0000","last_unstale":"2023-10-25T16:17:18.710526+0000","last_undegraded":"2023-10-25T16:17:18.710526+0000","last_fullsized":"2023-10-25T16:17:18.710526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709443+0000","last_change":"2023-10-25T16:17:17.663316+0000","last_active":"2023-10-25T16:17:18.709443+0000","last_peered":"2023-10-25T16:17:18.709443+0000","last_clean":"2023-10-25T16:17:18.709443+0000","last_became_active":"2023-10-25T16:17:17.660398+0000","last_became_peered":"2023-10-25T16:17:17.660398+0000","last_unstale":"2023-10-25T16:17:18.709443+0000","last_undegraded":"2023-10-25T16:17:18.709443+0000","last_fullsized":"2023-10-25T16:17:18.709443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:10:29.345764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712178+0000","last_change":"2023-10-25T16:17:17.667593+0000","last_active":"2023-10-25T16:17:18.712178+0000","last_peered":"2023-10-25T16:17:18.712178+0000","last_clean":"2023-10-25T16:17:18.712178+0000","last_became_active":"2023-10-25T16:17:17.666839+0000","last_became_peered":"2023-10-25T16:17:17.666839+0000","last_unstale":"2023-10-25T16:17:18.712178+0000","last_undegraded":"2023-10-25T16:17:18.712178+0000","last_fullsized":"2023-10-25T16:17:18.712178+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:23.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633776+0000","last_change":"2023-10-25T16:17:17.667877+0000","last_active":"2023-10-25T16:17:18.633776+0000","last_peered":"2023-10-25T16:17:18.633776+0000","last_clean":"2023-10-25T16:17:18.633776+0000","last_became_active":"2023-10-25T16:17:17.667175+0000","last_became_peered":"2023-10-25T16:17:17.667175+0000","last_unstale":"2023-10-25T16:17:18.633776+0000","last_undegraded":"2023-10-25T16:17:18.633776+0000","last_fullsized":"2023-10-25T16:17:18.633776+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:49.798646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711111+0000","last_change":"2023-10-25T16:17:17.669453+0000","last_active":"2023-10-25T16:17:18.711111+0000","last_peered":"2023-10-25T16:17:18.711111+0000","last_clean":"2023-10-25T16:17:18.711111+0000","last_became_active":"2023-10-25T16:17:17.665439+0000","last_became_peered":"2023-10-25T16:17:17.665439+0000","last_unstale":"2023-10-25T16:17:18.711111+0000","last_undegraded":"2023-10-25T16:17:18.711111+0000","last_fullsized":"2023-10-25T16:17:18.711111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:34.375540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633187+0000","last_change":"2023-10-25T16:17:17.640630+0000","last_active":"2023-10-25T16:17:18.633187+0000","last_peered":"2023-10-25T16:17:18.633187+0000","last_clean":"2023-10-25T16:17:18.633187+0000","last_became_active":"2023-10-25T16:17:17.639914+0000","last_became_peered":"2023-10-25T16:17:17.639914+0000","last_unstale":"2023-10-25T16:17:18.633187+0000","last_undegraded":"2023-10-25T16:17:18.633187+0000","last_fullsized":"2023-10-25T16:17:18.633187+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706535+0000","last_change":"2023-10-25T16:17:17.672293+0000","last_active":"2023-10-25T16:17:18.706535+0000","last_peered":"2023-10-25T16:17:18.706535+0000","last_clean":"2023-10-25T16:17:18.706535+0000","last_became_active":"2023-10-25T16:17:17.671908+0000","last_became_peered":"2023-10-25T16:17:17.671908+0000","last_unstale":"2023-10-25T16:17:18.706535+0000","last_undegraded":"2023-10-25T16:17:18.706535+0000","last_fullsized":"2023-10-25T16:17:18.706535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:44.926052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222370+0000","last_change":"2023-10-25T16:17:17.661285+0000","last_active":"2023-10-25T16:17:19.222370+0000","last_peered":"2023-10-25T16:17:19.222370+0000","last_clean":"2023-10-25T16:17:19.222370+0000","last_became_active":"2023-10-25T16:17:17.659550+0000","last_became_peered":"2023-10-25T16:17:17.659550+0000","last_unstale":"2023-10-25T16:17:19.222370+0000","last_undegraded":"2023-10-25T16:17:19.222370+0000","last_fullsized":"2023-10-25T16:17:19.222370+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634165+0000","last_change":"2023-10-25T16:17:17.660279+0000","last_active":"2023-10-25T16:17:18.634165+0000","last_peered":"2023-10-25T16:17:18.634165+0000","last_clean":"2023-10-25T16:17:18.634165+0000","last_became_active":"2023-10-25T16:17:17.659568+0000","last_became_peered":"2023-10-25T16:17:17.659568+0000","last_unstale":"2023-10-25T16:17:18.634165+0000","last_undegraded":"2023-10-25T16:17:18.634165+0000","last_fullsized":"2023-10-25T16:17:18.634165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:51:59.315826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222519+0000","last_change":"2023-10-25T16:17:17.656416+0000","last_active":"2023-10-25T16:17:19.222519+0000","last_peered":"2023-10-25T16:17:19.222519+0000","last_clean":"2023-10-25T16:17:19.222519+0000","last_became_active":"2023-10-25T16:17:17.655732+0000","last_became_peered":"2023-10-25T16:17:17.655732+0000","last_unstale":"2023-10-25T16:17:19.222519+0000","last_undegraded":"2023-10-25T16:17:19.222519+0000","last_fullsized":"2023-10-25T16:17:19.222519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710388+0000","last_change":"2023-10-25T16:17:17.668915+0000","last_active":"2023-10-25T16:17:18.710388+0000","last_peered":"2023-10-25T16:17:18.710388+0000","last_clean":"2023-10-25T16:17:18.710388+0000","last_became_active":"2023-10-25T16:17:17.668247+0000","last_became_peered":"2023-10-25T16:17:17.668247+0000","last_unstale":"2023-10-25T16:17:18.710388+0000","last_undegraded":"2023-10-25T16:17:18.710388+0000","last_fullsized":"2023-10-25T16:17:18.710388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:19.245788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634256+0000","last_change":"2023-10-25T16:17:17.671333+0000","last_active":"2023-10-25T16:17:18.634256+0000","last_peered":"2023-10-25T16:17:18.634256+0000","last_clean":"2023-10-25T16:17:18.634256+0000","last_became_active":"2023-10-25T16:17:17.669463+0000","last_became_peered":"2023-10-25T16:17:17.669463+0000","last_unstale":"2023-10-25T16:17:18.634256+0000","last_undegraded":"2023-10-25T16:17:18.634256+0000","last_fullsized":"2023-10-25T16:17:18.634256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:52.525463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706830+0000","last_change":"2023-10-25T16:17:17.664573+0000","last_active":"2023-10-25T16:17:18.706830+0000","last_peered":"2023-10-25T16:17:18.706830+0000","last_clean":"2023-10-25T16:17:18.706830+0000","last_became_active":"2023-10-25T16:17:17.663788+0000","last_became_peered":"2023-10-25T16:17:17.663788+0000","last_unstale":"2023-10-25T16:17:18.706830+0000","last_undegraded":"2023-10-25T16:17:18.706830+0000","last_fullsized":"2023-10-25T16:17:18.706830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:12.129870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711210+0000","last_change":"2023-10-25T16:17:17.672141+0000","last_active":"2023-10-25T16:17:18.711210+0000","last_peered":"2023-10-25T16:17:18.711210+0000","last_clean":"2023-10-25T16:17:18.711210+0000","last_became_active":"2023-10-25T16:17:17.671527+0000","last_became_peered":"2023-10-25T16:17:17.671527+0000","last_unstale":"2023-10-25T16:17:18.711210+0000","last_undegraded":"2023-10-25T16:17:18.711210+0000","last_fullsized":"2023-10-25T16:17:18.711210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:35.488420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222817+0000","last_change":"2023-10-25T16:17:17.640047+0000","last_active":"2023-10-25T16:17:19.222817+0000","last_peered":"2023-10-25T16:17:19.222817+0000","last_clean":"2023-10-25T16:17:19.222817+0000","last_became_active":"2023-10-25T16:17:17.639473+0000","last_became_peered":"2023-10-25T16:17:17.639473+0000","last_unstale":"2023-10-25T16:17:19.222817+0000","last_undegraded":"2023-10-25T16:17:19.222817+0000","last_fullsized":"2023-10-25T16:17:19.222817+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710909+0000","last_change":"2023-10-25T16:17:17.646553+0000","last_active":"2023-10-25T16:17:18.710909+0000","last_peered":"2023-10-25T16:17:18.710909+0000","last_clean":"2023-10-25T16:17:18.710909+0000","last_became_active":"2023-10-25T16:17:17.645698+0000","last_became_peered":"2023-10-25T16:17:17.645698+0000","last_unstale":"2023-10-25T16:17:18.710909+0000","last_undegraded":"2023-10-25T16:17:18.710909+0000","last_fullsized":"2023-10-25T16:17:18.710909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:18:10.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710240+0000","last_change":"2023-10-25T16:17:17.660456+0000","last_active":"2023-10-25T16:17:18.710240+0000","last_peered":"2023-10-25T16:17:18.710240+0000","last_clean":"2023-10-25T16:17:18.710240+0000","last_became_active":"2023-10-25T16:17:17.658996+0000","last_became_peered":"2023-10-25T16:17:17.658996+0000","last_unstale":"2023-10-25T16:17:18.710240+0000","last_undegraded":"2023-10-25T16:17:18.710240+0000","last_fullsized":"2023-10-25T16:17:18.710240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:53.845062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632896+0000","last_change":"2023-10-25T16:17:17.641250+0000","last_active":"2023-10-25T16:17:18.632896+0000","last_peered":"2023-10-25T16:17:18.632896+0000","last_clean":"2023-10-25T16:17:18.632896+0000","last_became_active":"2023-10-25T16:17:17.640089+0000","last_became_peered":"2023-10-25T16:17:17.640089+0000","last_unstale":"2023-10-25T16:17:18.632896+0000","last_undegraded":"2023-10-25T16:17:18.632896+0000","last_fullsized":"2023-10-25T16:17:18.632896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:02.999316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.632728+0000","last_change":"2023-10-25T16:17:17.665616+0000","last_active":"2023-10-25T16:17:18.632728+0000","last_peered":"2023-10-25T16:17:18.632728+0000","last_clean":"2023-10-25T16:17:18.632728+0000","last_became_active":"2023-10-25T16:17:17.664969+0000","last_became_peered":"2023-10-25T16:17:17.664969+0000","last_unstale":"2023-10-25T16:17:18.632728+0000","last_undegraded":"2023-10-25T16:17:18.632728+0000","last_fullsized":"2023-10-25T16:17:18.632728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:47:41.390733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711409+0000","last_change":"2023-10-25T16:17:17.646722+0000","last_active":"2023-10-25T16:17:18.711409+0000","last_peered":"2023-10-25T16:17:18.711409+0000","last_clean":"2023-10-25T16:17:18.711409+0000","last_became_active":"2023-10-25T16:17:17.645987+0000","last_became_peered":"2023-10-25T16:17:17.645987+0000","last_unstale":"2023-10-25T16:17:18.711409+0000","last_undegraded":"2023-10-25T16:17:18.711409+0000","last_fullsized":"2023-10-25T16:17:18.711409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:34.703288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710929+0000","last_change":"2023-10-25T16:17:17.670488+0000","last_active":"2023-10-25T16:17:18.710929+0000","last_peered":"2023-10-25T16:17:18.710929+0000","last_clean":"2023-10-25T16:17:18.710929+0000","last_became_active":"2023-10-25T16:17:17.669925+0000","last_became_peered":"2023-10-25T16:17:17.669925+0000","last_unstale":"2023-10-25T16:17:18.710929+0000","last_undegraded":"2023-10-25T16:17:18.710929+0000","last_fullsized":"2023-10-25T16:17:18.710929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:06.324016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222413+0000","last_change":"2023-10-25T16:17:17.641832+0000","last_active":"2023-10-25T16:17:19.222413+0000","last_peered":"2023-10-25T16:17:19.222413+0000","last_clean":"2023-10-25T16:17:19.222413+0000","last_became_active":"2023-10-25T16:17:17.641131+0000","last_became_peered":"2023-10-25T16:17:17.641131+0000","last_unstale":"2023-10-25T16:17:19.222413+0000","last_undegraded":"2023-10-25T16:17:19.222413+0000","last_fullsized":"2023-10-25T16:17:19.222413+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:02.908927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709331+0000","last_change":"2023-10-25T16:17:17.657638+0000","last_active":"2023-10-25T16:17:18.709331+0000","last_peered":"2023-10-25T16:17:18.709331+0000","last_clean":"2023-10-25T16:17:18.709331+0000","last_became_active":"2023-10-25T16:17:17.657034+0000","last_became_peered":"2023-10-25T16:17:17.657034+0000","last_unstale":"2023-10-25T16:17:18.709331+0000","last_undegraded":"2023-10-25T16:17:18.709331+0000","last_fullsized":"2023-10-25T16:17:18.709331+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:10.100210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222092+0000","last_change":"2023-10-25T16:17:17.642312+0000","last_active":"2023-10-25T16:17:19.222092+0000","last_peered":"2023-10-25T16:17:19.222092+0000","last_clean":"2023-10-25T16:17:19.222092+0000","last_became_active":"2023-10-25T16:17:17.641631+0000","last_became_peered":"2023-10-25T16:17:17.641631+0000","last_unstale":"2023-10-25T16:17:19.222092+0000","last_undegraded":"2023-10-25T16:17:19.222092+0000","last_fullsized":"2023-10-25T16:17:19.222092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:01:46.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711208+0000","last_change":"2023-10-25T16:17:17.658400+0000","last_active":"2023-10-25T16:17:18.711208+0000","last_peered":"2023-10-25T16:17:18.711208+0000","last_clean":"2023-10-25T16:17:18.711208+0000","last_became_active":"2023-10-25T16:17:17.657761+0000","last_became_peered":"2023-10-25T16:17:17.657761+0000","last_unstale":"2023-10-25T16:17:18.711208+0000","last_undegraded":"2023-10-25T16:17:18.711208+0000","last_fullsized":"2023-10-25T16:17:18.711208+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:33:28.791708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711226+0000","last_change":"2023-10-25T16:17:17.658345+0000","last_active":"2023-10-25T16:17:18.711226+0000","last_peered":"2023-10-25T16:17:18.711226+0000","last_clean":"2023-10-25T16:17:18.711226+0000","last_became_active":"2023-10-25T16:17:17.657730+0000","last_became_peered":"2023-10-25T16:17:17.657730+0000","last_unstale":"2023-10-25T16:17:18.711226+0000","last_undegraded":"2023-10-25T16:17:18.711226+0000","last_fullsized":"2023-10-25T16:17:18.711226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:47.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711517+0000","last_change":"2023-10-25T16:17:17.665201+0000","last_active":"2023-10-25T16:17:18.711517+0000","last_peered":"2023-10-25T16:17:18.711517+0000","last_clean":"2023-10-25T16:17:18.711517+0000","last_became_active":"2023-10-25T16:17:17.664482+0000","last_became_peered":"2023-10-25T16:17:17.664482+0000","last_unstale":"2023-10-25T16:17:18.711517+0000","last_undegraded":"2023-10-25T16:17:18.711517+0000","last_fullsized":"2023-10-25T16:17:18.711517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:20.721957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633114+0000","last_change":"2023-10-25T16:17:17.663267+0000","last_active":"2023-10-25T16:17:18.633114+0000","last_peered":"2023-10-25T16:17:18.633114+0000","last_clean":"2023-10-25T16:17:18.633114+0000","last_became_active":"2023-10-25T16:17:17.662665+0000","last_became_peered":"2023-10-25T16:17:17.662665+0000","last_unstale":"2023-10-25T16:17:18.633114+0000","last_undegraded":"2023-10-25T16:17:18.633114+0000","last_fullsized":"2023-10-25T16:17:18.633114+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:26:54.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"86'4","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633136+0000","last_change":"2023-10-25T16:17:16.904660+0000","last_active":"2023-10-25T16:17:18.633136+0000","last_peered":"2023-10-25T16:17:18.633136+0000","last_clean":"2023-10-25T16:17:18.633136+0000","last_became_active":"2023-10-25T16:17:16.903904+0000","last_became_peered":"2023-10-25T16:17:16.903904+0000","last_unstale":"2023-10-25T16:17:18.633136+0000","last_undegraded":"2023-10-25T16:17:18.633136+0000","last_fullsized":"2023-10-25T16:17:18.633136+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:52:06.319525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634189+0000","last_change":"2023-10-25T16:17:17.661539+0000","last_active":"2023-10-25T16:17:18.634189+0000","last_peered":"2023-10-25T16:17:18.634189+0000","last_clean":"2023-10-25T16:17:18.634189+0000","last_became_active":"2023-10-25T16:17:17.660845+0000","last_became_peered":"2023-10-25T16:17:17.660845+0000","last_unstale":"2023-10-25T16:17:18.634189+0000","last_undegraded":"2023-10-25T16:17:18.634189+0000","last_fullsized":"2023-10-25T16:17:18.634189+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:57:24.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221710+0000","last_change":"2023-10-25T16:17:16.892642+0000","last_active":"2023-10-25T16:17:19.221710+0000","last_peered":"2023-10-25T16:17:19.221710+0000","last_clean":"2023-10-25T16:17:19.221710+0000","last_became_active":"2023-10-25T16:17:16.892225+0000","last_became_peered":"2023-10-25T16:17:16.892225+0000","last_unstale":"2023-10-25T16:17:19.221710+0000","last_undegraded":"2023-10-25T16:17:19.221710+0000","last_fullsized":"2023-10-25T16:17:19.221710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:41.289281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710854+0000","last_change":"2023-10-25T16:17:17.673401+0000","last_active":"2023-10-25T16:17:18.710854+0000","last_peered":"2023-10-25T16:17:18.710854+0000","last_clean":"2023-10-25T16:17:18.710854+0000","last_became_active":"2023-10-25T16:17:17.667681+0000","last_became_peered":"2023-10-25T16:17:17.667681+0000","last_unstale":"2023-10-25T16:17:18.710854+0000","last_undegraded":"2023-10-25T16:17:18.710854+0000","last_fullsized":"2023-10-25T16:17:18.710854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:49:35.036194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712054+0000","last_change":"2023-10-25T16:17:16.916614+0000","last_active":"2023-10-25T16:17:18.712054+0000","last_peered":"2023-10-25T16:17:18.712054+0000","last_clean":"2023-10-25T16:17:18.712054+0000","last_became_active":"2023-10-25T16:17:16.914539+0000","last_became_peered":"2023-10-25T16:17:16.914539+0000","last_unstale":"2023-10-25T16:17:18.712054+0000","last_undegraded":"2023-10-25T16:17:18.712054+0000","last_fullsized":"2023-10-25T16:17:18.712054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:05.687178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633535+0000","last_change":"2023-10-25T16:17:17.641569+0000","last_active":"2023-10-25T16:17:18.633535+0000","last_peered":"2023-10-25T16:17:18.633535+0000","last_clean":"2023-10-25T16:17:18.633535+0000","last_became_active":"2023-10-25T16:17:17.640966+0000","last_became_peered":"2023-10-25T16:17:17.640966+0000","last_unstale":"2023-10-25T16:17:18.633535+0000","last_undegraded":"2023-10-25T16:17:18.633535+0000","last_fullsized":"2023-10-25T16:17:18.633535+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711327+0000","last_change":"2023-10-25T16:17:16.922723+0000","last_active":"2023-10-25T16:17:18.711327+0000","last_peered":"2023-10-25T16:17:18.711327+0000","last_clean":"2023-10-25T16:17:18.711327+0000","last_became_active":"2023-10-25T16:17:16.920987+0000","last_became_peered":"2023-10-25T16:17:16.920987+0000","last_unstale":"2023-10-25T16:17:18.711327+0000","last_undegraded":"2023-10-25T16:17:18.711327+0000","last_fullsized":"2023-10-25T16:17:18.711327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:43.911566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709340+0000","last_change":"2023-10-25T16:17:17.645618+0000","last_active":"2023-10-25T16:17:18.709340+0000","last_peered":"2023-10-25T16:17:18.709340+0000","last_clean":"2023-10-25T16:17:18.709340+0000","last_became_active":"2023-10-25T16:17:17.645041+0000","last_became_peered":"2023-10-25T16:17:17.645041+0000","last_unstale":"2023-10-25T16:17:18.709340+0000","last_undegraded":"2023-10-25T16:17:18.709340+0000","last_fullsized":"2023-10-25T16:17:18.709340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:50:48.756330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222647+0000","last_change":"2023-10-25T16:17:16.900571+0000","last_active":"2023-10-25T16:17:19.222647+0000","last_peered":"2023-10-25T16:17:19.222647+0000","last_clean":"2023-10-25T16:17:19.222647+0000","last_became_active":"2023-10-25T16:17:16.900156+0000","last_became_peered":"2023-10-25T16:17:16.900156+0000","last_unstale":"2023-10-25T16:17:19.222647+0000","last_undegraded":"2023-10-25T16:17:19.222647+0000","last_fullsized":"2023-10-25T16:17:19.222647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:55.179521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710573+0000","last_change":"2023-10-25T16:17:17.643888+0000","last_active":"2023-10-25T16:17:18.710573+0000","last_peered":"2023-10-25T16:17:18.710573+0000","last_clean":"2023-10-25T16:17:18.710573+0000","last_became_active":"2023-10-25T16:17:17.643307+0000","last_became_peered":"2023-10-25T16:17:17.643307+0000","last_unstale":"2023-10-25T16:17:18.710573+0000","last_undegraded":"2023-10-25T16:17:18.710573+0000","last_fullsized":"2023-10-25T16:17:18.710573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:41:22.558797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712693+0000","last_change":"2023-10-25T16:17:16.914382+0000","last_active":"2023-10-25T16:17:18.712693+0000","last_peered":"2023-10-25T16:17:18.712693+0000","last_clean":"2023-10-25T16:17:18.712693+0000","last_became_active":"2023-10-25T16:17:16.913011+0000","last_became_peered":"2023-10-25T16:17:16.913011+0000","last_unstale":"2023-10-25T16:17:18.712693+0000","last_undegraded":"2023-10-25T16:17:18.712693+0000","last_fullsized":"2023-10-25T16:17:18.712693+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:17.525133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634490+0000","last_change":"2023-10-25T16:17:17.658669+0000","last_active":"2023-10-25T16:17:18.634490+0000","last_peered":"2023-10-25T16:17:18.634490+0000","last_clean":"2023-10-25T16:17:18.634490+0000","last_became_active":"2023-10-25T16:17:17.656234+0000","last_became_peered":"2023-10-25T16:17:17.656234+0000","last_unstale":"2023-10-25T16:17:18.634490+0000","last_undegraded":"2023-10-25T16:17:18.634490+0000","last_fullsized":"2023-10-25T16:17:18.634490+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:04:05.039488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706672+0000","last_change":"2023-10-25T16:17:16.902683+0000","last_active":"2023-10-25T16:17:18.706672+0000","last_peered":"2023-10-25T16:17:18.706672+0000","last_clean":"2023-10-25T16:17:18.706672+0000","last_became_active":"2023-10-25T16:17:16.902426+0000","last_became_peered":"2023-10-25T16:17:16.902426+0000","last_unstale":"2023-10-25T16:17:18.706672+0000","last_undegraded":"2023-10-25T16:17:18.706672+0000","last_fullsized":"2023-10-25T16:17:18.706672+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:43.888268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221455+0000","last_change":"2023-10-25T16:17:17.641763+0000","last_active":"2023-10-25T16:17:19.221455+0000","last_peered":"2023-10-25T16:17:19.221455+0000","last_clean":"2023-10-25T16:17:19.221455+0000","last_became_active":"2023-10-25T16:17:17.641103+0000","last_became_peered":"2023-10-25T16:17:17.641103+0000","last_unstale":"2023-10-25T16:17:19.221455+0000","last_undegraded":"2023-10-25T16:17:19.221455+0000","last_fullsized":"2023-10-25T16:17:19.221455+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:01.055716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.653021+0000","last_change":"2023-10-25T16:17:16.892588+0000","last_active":"2023-10-25T16:17:17.653021+0000","last_peered":"2023-10-25T16:17:17.653021+0000","last_clean":"2023-10-25T16:17:17.653021+0000","last_became_active":"2023-10-25T16:17:16.892363+0000","last_became_peered":"2023-10-25T16:17:16.892363+0000","last_unstale":"2023-10-25T16:17:17.653021+0000","last_undegraded":"2023-10-25T16:17:17.653021+0000","last_fullsized":"2023-10-25T16:17:17.653021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:51.341738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709804+0000","last_change":"2023-10-25T16:17:17.644435+0000","last_active":"2023-10-25T16:17:18.709804+0000","last_peered":"2023-10-25T16:17:18.709804+0000","last_clean":"2023-10-25T16:17:18.709804+0000","last_became_active":"2023-10-25T16:17:17.643844+0000","last_became_peered":"2023-10-25T16:17:17.643844+0000","last_unstale":"2023-10-25T16:17:18.709804+0000","last_undegraded":"2023-10-25T16:17:18.709804+0000","last_fullsized":"2023-10-25T16:17:18.709804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:02:26.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711119+0000","last_change":"2023-10-25T16:17:16.907112+0000","last_active":"2023-10-25T16:17:18.711119+0000","last_peered":"2023-10-25T16:17:18.711119+0000","last_clean":"2023-10-25T16:17:18.711119+0000","last_became_active":"2023-10-25T16:17:16.906553+0000","last_became_peered":"2023-10-25T16:17:16.906553+0000","last_unstale":"2023-10-25T16:17:18.711119+0000","last_undegraded":"2023-10-25T16:17:18.711119+0000","last_fullsized":"2023-10-25T16:17:18.711119+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:44.314093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633375+0000","last_change":"2023-10-25T16:17:17.671535+0000","last_active":"2023-10-25T16:17:18.633375+0000","last_peered":"2023-10-25T16:17:18.633375+0000","last_clean":"2023-10-25T16:17:18.633375+0000","last_became_active":"2023-10-25T16:17:17.670757+0000","last_became_peered":"2023-10-25T16:17:17.670757+0000","last_unstale":"2023-10-25T16:17:18.633375+0000","last_undegraded":"2023-10-25T16:17:18.633375+0000","last_fullsized":"2023-10-25T16:17:18.633375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:09.910576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711730+0000","last_change":"2023-10-25T16:17:16.915546+0000","last_active":"2023-10-25T16:17:18.711730+0000","last_peered":"2023-10-25T16:17:18.711730+0000","last_clean":"2023-10-25T16:17:18.711730+0000","last_became_active":"2023-10-25T16:17:16.913965+0000","last_became_peered":"2023-10-25T16:17:16.913965+0000","last_unstale":"2023-10-25T16:17:18.711730+0000","last_undegraded":"2023-10-25T16:17:18.711730+0000","last_fullsized":"2023-10-25T16:17:18.711730+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:32:38.764460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712008+0000","last_change":"2023-10-25T16:17:17.664015+0000","last_active":"2023-10-25T16:17:18.712008+0000","last_peered":"2023-10-25T16:17:18.712008+0000","last_clean":"2023-10-25T16:17:18.712008+0000","last_became_active":"2023-10-25T16:17:17.657376+0000","last_became_peered":"2023-10-25T16:17:17.657376+0000","last_unstale":"2023-10-25T16:17:18.712008+0000","last_undegraded":"2023-10-25T16:17:18.712008+0000","last_fullsized":"2023-10-25T16:17:18.712008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:17:06.701664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"86'3","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222234+0000","last_change":"2023-10-25T16:17:16.889040+0000","last_active":"2023-10-25T16:17:19.222234+0000","last_peered":"2023-10-25T16:17:19.222234+0000","last_clean":"2023-10-25T16:17:19.222234+0000","last_became_active":"2023-10-25T16:17:16.888693+0000","last_became_peered":"2023-10-25T16:17:16.888693+0000","last_unstale":"2023-10-25T16:17:19.222234+0000","last_undegraded":"2023-10-25T16:17:19.222234+0000","last_fullsized":"2023-10-25T16:17:19.222234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:41.426292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634520+0000","last_change":"2023-10-25T16:17:17.666049+0000","last_active":"2023-10-25T16:17:18.634520+0000","last_peered":"2023-10-25T16:17:18.634520+0000","last_clean":"2023-10-25T16:17:18.634520+0000","last_became_active":"2023-10-25T16:17:17.665314+0000","last_became_peered":"2023-10-25T16:17:17.665314+0000","last_unstale":"2023-10-25T16:17:18.634520+0000","last_undegraded":"2023-10-25T16:17:18.634520+0000","last_fullsized":"2023-10-25T16:17:18.634520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:43:44.070628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"86'6","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706781+0000","last_change":"2023-10-25T16:17:16.895306+0000","last_active":"2023-10-25T16:17:18.706781+0000","last_peered":"2023-10-25T16:17:18.706781+0000","last_clean":"2023-10-25T16:17:18.706781+0000","last_became_active":"2023-10-25T16:17:16.894773+0000","last_became_peered":"2023-10-25T16:17:16.894773+0000","last_unstale":"2023-10-25T16:17:18.706781+0000","last_undegraded":"2023-10-25T16:17:18.706781+0000","last_fullsized":"2023-10-25T16:17:18.706781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633557+0000","last_change":"2023-10-25T16:17:17.663646+0000","last_active":"2023-10-25T16:17:18.633557+0000","last_peered":"2023-10-25T16:17:18.633557+0000","last_clean":"2023-10-25T16:17:18.633557+0000","last_became_active":"2023-10-25T16:17:17.661252+0000","last_became_peered":"2023-10-25T16:17:17.661252+0000","last_unstale":"2023-10-25T16:17:18.633557+0000","last_undegraded":"2023-10-25T16:17:18.633557+0000","last_fullsized":"2023-10-25T16:17:18.633557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:35.443446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706575+0000","last_change":"2023-10-25T16:17:16.902496+0000","last_active":"2023-10-25T16:17:18.706575+0000","last_peered":"2023-10-25T16:17:18.706575+0000","last_clean":"2023-10-25T16:17:18.706575+0000","last_became_active":"2023-10-25T16:17:16.902164+0000","last_became_peered":"2023-10-25T16:17:16.902164+0000","last_unstale":"2023-10-25T16:17:18.706575+0000","last_undegraded":"2023-10-25T16:17:18.706575+0000","last_fullsized":"2023-10-25T16:17:18.706575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:59.831665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711511+0000","last_change":"2023-10-25T16:17:17.647894+0000","last_active":"2023-10-25T16:17:18.711511+0000","last_peered":"2023-10-25T16:17:18.711511+0000","last_clean":"2023-10-25T16:17:18.711511+0000","last_became_active":"2023-10-25T16:17:17.647364+0000","last_became_peered":"2023-10-25T16:17:17.647364+0000","last_unstale":"2023-10-25T16:17:18.711511+0000","last_undegraded":"2023-10-25T16:17:18.711511+0000","last_fullsized":"2023-10-25T16:17:18.711511+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:00.360348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711442+0000","last_change":"2023-10-25T16:17:16.922145+0000","last_active":"2023-10-25T16:17:18.711442+0000","last_peered":"2023-10-25T16:17:18.711442+0000","last_clean":"2023-10-25T16:17:18.711442+0000","last_became_active":"2023-10-25T16:17:16.919735+0000","last_became_peered":"2023-10-25T16:17:16.919735+0000","last_unstale":"2023-10-25T16:17:18.711442+0000","last_undegraded":"2023-10-25T16:17:18.711442+0000","last_fullsized":"2023-10-25T16:17:18.711442+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:23.286095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222668+0000","last_change":"2023-10-25T16:17:17.660321+0000","last_active":"2023-10-25T16:17:19.222668+0000","last_peered":"2023-10-25T16:17:19.222668+0000","last_clean":"2023-10-25T16:17:19.222668+0000","last_became_active":"2023-10-25T16:17:17.657197+0000","last_became_peered":"2023-10-25T16:17:17.657197+0000","last_unstale":"2023-10-25T16:17:19.222668+0000","last_undegraded":"2023-10-25T16:17:19.222668+0000","last_fullsized":"2023-10-25T16:17:19.222668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:56:52.305034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710326+0000","last_change":"2023-10-25T16:17:16.912258+0000","last_active":"2023-10-25T16:17:18.710326+0000","last_peered":"2023-10-25T16:17:18.710326+0000","last_clean":"2023-10-25T16:17:18.710326+0000","last_became_active":"2023-10-25T16:17:16.909426+0000","last_became_peered":"2023-10-25T16:17:16.909426+0000","last_unstale":"2023-10-25T16:17:18.710326+0000","last_undegraded":"2023-10-25T16:17:18.710326+0000","last_fullsized":"2023-10-25T16:17:18.710326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:25:41.385194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634634+0000","last_change":"2023-10-25T16:17:17.670760+0000","last_active":"2023-10-25T16:17:18.634634+0000","last_peered":"2023-10-25T16:17:18.634634+0000","last_clean":"2023-10-25T16:17:18.634634+0000","last_became_active":"2023-10-25T16:17:17.668442+0000","last_became_peered":"2023-10-25T16:17:17.668442+0000","last_unstale":"2023-10-25T16:17:18.634634+0000","last_undegraded":"2023-10-25T16:17:18.634634+0000","last_fullsized":"2023-10-25T16:17:18.634634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:38:27.602423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"86'8","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709580+0000","last_change":"2023-10-25T16:17:16.910296+0000","last_active":"2023-10-25T16:17:18.709580+0000","last_peered":"2023-10-25T16:17:18.709580+0000","last_clean":"2023-10-25T16:17:18.709580+0000","last_became_active":"2023-10-25T16:17:16.908878+0000","last_became_peered":"2023-10-25T16:17:16.908878+0000","last_unstale":"2023-10-25T16:17:18.709580+0000","last_undegraded":"2023-10-25T16:17:18.709580+0000","last_fullsized":"2023-10-25T16:17:18.709580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:46:11.115383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711706+0000","last_change":"2023-10-25T16:17:17.656830+0000","last_active":"2023-10-25T16:17:18.711706+0000","last_peered":"2023-10-25T16:17:18.711706+0000","last_clean":"2023-10-25T16:17:18.711706+0000","last_became_active":"2023-10-25T16:17:17.655972+0000","last_became_peered":"2023-10-25T16:17:17.655972+0000","last_unstale":"2023-10-25T16:17:18.711706+0000","last_undegraded":"2023-10-25T16:17:18.711706+0000","last_fullsized":"2023-10-25T16:17:18.711706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:36:53.126893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712223+0000","last_change":"2023-10-25T16:17:16.908715+0000","last_active":"2023-10-25T16:17:18.712223+0000","last_peered":"2023-10-25T16:17:18.712223+0000","last_clean":"2023-10-25T16:17:18.712223+0000","last_became_active":"2023-10-25T16:17:16.907871+0000","last_became_peered":"2023-10-25T16:17:16.907871+0000","last_unstale":"2023-10-25T16:17:18.712223+0000","last_undegraded":"2023-10-25T16:17:18.712223+0000","last_fullsized":"2023-10-25T16:17:18.712223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:05:35.321099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633447+0000","last_change":"2023-10-25T16:17:17.668641+0000","last_active":"2023-10-25T16:17:18.633447+0000","last_peered":"2023-10-25T16:17:18.633447+0000","last_clean":"2023-10-25T16:17:18.633447+0000","last_became_active":"2023-10-25T16:17:17.667991+0000","last_became_peered":"2023-10-25T16:17:17.667991+0000","last_unstale":"2023-10-25T16:17:18.633447+0000","last_undegraded":"2023-10-25T16:17:18.633447+0000","last_fullsized":"2023-10-25T16:17:18.633447+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:45.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712274+0000","last_change":"2023-10-25T16:17:16.917091+0000","last_active":"2023-10-25T16:17:18.712274+0000","last_peered":"2023-10-25T16:17:18.712274+0000","last_clean":"2023-10-25T16:17:18.712274+0000","last_became_active":"2023-10-25T16:17:16.916009+0000","last_became_peered":"2023-10-25T16:17:16.916009+0000","last_unstale":"2023-10-25T16:17:18.712274+0000","last_undegraded":"2023-10-25T16:17:18.712274+0000","last_fullsized":"2023-10-25T16:17:18.712274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:42:22.208994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706661+0000","last_change":"2023-10-25T16:17:17.662947+0000","last_active":"2023-10-25T16:17:18.706661+0000","last_peered":"2023-10-25T16:17:18.706661+0000","last_clean":"2023-10-25T16:17:18.706661+0000","last_became_active":"2023-10-25T16:17:17.658737+0000","last_became_peered":"2023-10-25T16:17:17.658737+0000","last_unstale":"2023-10-25T16:17:18.706661+0000","last_undegraded":"2023-10-25T16:17:18.706661+0000","last_fullsized":"2023-10-25T16:17:18.706661+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:40.814420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"86'1","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711854+0000","last_change":"2023-10-25T16:17:16.922400+0000","last_active":"2023-10-25T16:17:18.711854+0000","last_peered":"2023-10-25T16:17:18.711854+0000","last_clean":"2023-10-25T16:17:18.711854+0000","last_became_active":"2023-10-25T16:17:16.920276+0000","last_became_peered":"2023-10-25T16:17:16.920276+0000","last_unstale":"2023-10-25T16:17:18.711854+0000","last_undegraded":"2023-10-25T16:17:18.711854+0000","last_fullsized":"2023-10-25T16:17:18.711854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:56:39.799934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634746+0000","last_change":"2023-10-25T16:17:17.662662+0000","last_active":"2023-10-25T16:17:18.634746+0000","last_peered":"2023-10-25T16:17:18.634746+0000","last_clean":"2023-10-25T16:17:18.634746+0000","last_became_active":"2023-10-25T16:17:17.661975+0000","last_became_peered":"2023-10-25T16:17:17.661975+0000","last_unstale":"2023-10-25T16:17:18.634746+0000","last_undegraded":"2023-10-25T16:17:18.634746+0000","last_fullsized":"2023-10-25T16:17:18.634746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:50:30.099432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633115+0000","last_change":"2023-10-25T16:17:16.908243+0000","last_active":"2023-10-25T16:17:18.633115+0000","last_peered":"2023-10-25T16:17:18.633115+0000","last_clean":"2023-10-25T16:17:18.633115+0000","last_became_active":"2023-10-25T16:17:16.907544+0000","last_became_peered":"2023-10-25T16:17:16.907544+0000","last_unstale":"2023-10-25T16:17:18.633115+0000","last_undegraded":"2023-10-25T16:17:18.633115+0000","last_fullsized":"2023-10-25T16:17:18.633115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:44:46.667209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221980+0000","last_change":"2023-10-25T16:17:17.667150+0000","last_active":"2023-10-25T16:17:19.221980+0000","last_peered":"2023-10-25T16:17:19.221980+0000","last_clean":"2023-10-25T16:17:19.221980+0000","last_became_active":"2023-10-25T16:17:17.666514+0000","last_became_peered":"2023-10-25T16:17:17.666514+0000","last_unstale":"2023-10-25T16:17:19.221980+0000","last_undegraded":"2023-10-25T16:17:19.221980+0000","last_fullsized":"2023-10-25T16:17:19.221980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:35.484524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712418+0000","last_change":"2023-10-25T16:17:16.902912+0000","last_active":"2023-10-25T16:17:18.712418+0000","last_peered":"2023-10-25T16:17:18.712418+0000","last_clean":"2023-10-25T16:17:18.712418+0000","last_became_active":"2023-10-25T16:17:16.901611+0000","last_became_peered":"2023-10-25T16:17:16.901611+0000","last_unstale":"2023-10-25T16:17:18.712418+0000","last_undegraded":"2023-10-25T16:17:18.712418+0000","last_fullsized":"2023-10-25T16:17:18.712418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222414+0000","last_change":"2023-10-25T16:17:17.668159+0000","last_active":"2023-10-25T16:17:19.222414+0000","last_peered":"2023-10-25T16:17:19.222414+0000","last_clean":"2023-10-25T16:17:19.222414+0000","last_became_active":"2023-10-25T16:17:17.667584+0000","last_became_peered":"2023-10-25T16:17:17.667584+0000","last_unstale":"2023-10-25T16:17:19.222414+0000","last_undegraded":"2023-10-25T16:17:19.222414+0000","last_fullsized":"2023-10-25T16:17:19.222414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:38:50.403559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711714+0000","last_change":"2023-10-25T16:17:16.899174+0000","last_active":"2023-10-25T16:17:18.711714+0000","last_peered":"2023-10-25T16:17:18.711714+0000","last_clean":"2023-10-25T16:17:18.711714+0000","last_became_active":"2023-10-25T16:17:16.897638+0000","last_became_peered":"2023-10-25T16:17:16.897638+0000","last_unstale":"2023-10-25T16:17:18.711714+0000","last_undegraded":"2023-10-25T16:17:18.711714+0000","last_fullsized":"2023-10-25T16:17:18.711714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:01:56.936496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221988+0000","last_change":"2023-10-25T16:17:17.661441+0000","last_active":"2023-10-25T16:17:19.221988+0000","last_peered":"2023-10-25T16:17:19.221988+0000","last_clean":"2023-10-25T16:17:19.221988+0000","last_became_active":"2023-10-25T16:17:17.660843+0000","last_became_peered":"2023-10-25T16:17:17.660843+0000","last_unstale":"2023-10-25T16:17:19.221988+0000","last_undegraded":"2023-10-25T16:17:19.221988+0000","last_fullsized":"2023-10-25T16:17:19.221988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:27.304996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.221675+0000","last_change":"2023-10-25T16:17:16.891743+0000","last_active":"2023-10-25T16:17:19.221675+0000","last_peered":"2023-10-25T16:17:19.221675+0000","last_clean":"2023-10-25T16:17:19.221675+0000","last_became_active":"2023-10-25T16:17:16.891421+0000","last_became_peered":"2023-10-25T16:17:16.891421+0000","last_unstale":"2023-10-25T16:17:19.221675+0000","last_undegraded":"2023-10-25T16:17:19.221675+0000","last_fullsized":"2023-10-25T16:17:19.221675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:10:23.033726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222958+0000","last_change":"2023-10-25T16:17:17.660916+0000","last_active":"2023-10-25T16:17:19.222958+0000","last_peered":"2023-10-25T16:17:19.222958+0000","last_clean":"2023-10-25T16:17:19.222958+0000","last_became_active":"2023-10-25T16:17:17.658152+0000","last_became_peered":"2023-10-25T16:17:17.658152+0000","last_unstale":"2023-10-25T16:17:19.222958+0000","last_undegraded":"2023-10-25T16:17:19.222958+0000","last_fullsized":"2023-10-25T16:17:19.222958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711950+0000","last_change":"2023-10-25T16:17:16.912609+0000","last_active":"2023-10-25T16:17:18.711950+0000","last_peered":"2023-10-25T16:17:18.711950+0000","last_clean":"2023-10-25T16:17:18.711950+0000","last_became_active":"2023-10-25T16:17:16.908119+0000","last_became_peered":"2023-10-25T16:17:16.908119+0000","last_unstale":"2023-10-25T16:17:18.711950+0000","last_undegraded":"2023-10-25T16:17:18.711950+0000","last_fullsized":"2023-10-25T16:17:18.711950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:51.627276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.710119+0000","last_change":"2023-10-25T16:17:17.663862+0000","last_active":"2023-10-25T16:17:18.710119+0000","last_peered":"2023-10-25T16:17:18.710119+0000","last_clean":"2023-10-25T16:17:18.710119+0000","last_became_active":"2023-10-25T16:17:17.662309+0000","last_became_peered":"2023-10-25T16:17:17.662309+0000","last_unstale":"2023-10-25T16:17:18.710119+0000","last_undegraded":"2023-10-25T16:17:18.710119+0000","last_fullsized":"2023-10-25T16:17:18.710119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:20:41.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709789+0000","last_change":"2023-10-25T16:17:16.909558+0000","last_active":"2023-10-25T16:17:18.709789+0000","last_peered":"2023-10-25T16:17:18.709789+0000","last_clean":"2023-10-25T16:17:18.709789+0000","last_became_active":"2023-10-25T16:17:16.908758+0000","last_became_peered":"2023-10-25T16:17:16.908758+0000","last_unstale":"2023-10-25T16:17:18.709789+0000","last_undegraded":"2023-10-25T16:17:18.709789+0000","last_fullsized":"2023-10-25T16:17:18.709789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:18:52.859828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633861+0000","last_change":"2023-10-25T16:17:17.660209+0000","last_active":"2023-10-25T16:17:18.633861+0000","last_peered":"2023-10-25T16:17:18.633861+0000","last_clean":"2023-10-25T16:17:18.633861+0000","last_became_active":"2023-10-25T16:17:17.659576+0000","last_became_peered":"2023-10-25T16:17:17.659576+0000","last_unstale":"2023-10-25T16:17:18.633861+0000","last_undegraded":"2023-10-25T16:17:18.633861+0000","last_fullsized":"2023-10-25T16:17:18.633861+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:41:33.389225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.651307+0000","last_change":"2023-10-25T16:17:16.892030+0000","last_active":"2023-10-25T16:17:17.651307+0000","last_peered":"2023-10-25T16:17:17.651307+0000","last_clean":"2023-10-25T16:17:17.651307+0000","last_became_active":"2023-10-25T16:17:16.891645+0000","last_became_peered":"2023-10-25T16:17:16.891645+0000","last_unstale":"2023-10-25T16:17:17.651307+0000","last_undegraded":"2023-10-25T16:17:17.651307+0000","last_fullsized":"2023-10-25T16:17:17.651307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:45:06.735487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.633812+0000","last_change":"2023-10-25T16:17:17.641836+0000","last_active":"2023-10-25T16:17:18.633812+0000","last_peered":"2023-10-25T16:17:18.633812+0000","last_clean":"2023-10-25T16:17:18.633812+0000","last_became_active":"2023-10-25T16:17:17.640900+0000","last_became_peered":"2023-10-25T16:17:17.640900+0000","last_unstale":"2023-10-25T16:17:18.633812+0000","last_undegraded":"2023-10-25T16:17:18.633812+0000","last_fullsized":"2023-10-25T16:17:18.633812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:33:39.965373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.223013+0000","last_change":"2023-10-25T16:17:16.907260+0000","last_active":"2023-10-25T16:17:19.223013+0000","last_peered":"2023-10-25T16:17:19.223013+0000","last_clean":"2023-10-25T16:17:19.223013+0000","last_became_active":"2023-10-25T16:17:16.907025+0000","last_became_peered":"2023-10-25T16:17:16.907025+0000","last_unstale":"2023-10-25T16:17:19.223013+0000","last_undegraded":"2023-10-25T16:17:19.223013+0000","last_fullsized":"2023-10-25T16:17:19.223013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:04:01.984830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.634944+0000","last_change":"2023-10-25T16:17:17.670353+0000","last_active":"2023-10-25T16:17:18.634944+0000","last_peered":"2023-10-25T16:17:18.634944+0000","last_clean":"2023-10-25T16:17:18.634944+0000","last_became_active":"2023-10-25T16:17:17.664361+0000","last_became_peered":"2023-10-25T16:17:17.664361+0000","last_unstale":"2023-10-25T16:17:18.634944+0000","last_undegraded":"2023-10-25T16:17:18.634944+0000","last_fullsized":"2023-10-25T16:17:18.634944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:35.845586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.654373+0000","last_change":"2023-10-25T16:17:16.900120+0000","last_active":"2023-10-25T16:17:17.654373+0000","last_peered":"2023-10-25T16:17:17.654373+0000","last_clean":"2023-10-25T16:17:17.654373+0000","last_became_active":"2023-10-25T16:17:16.899803+0000","last_became_peered":"2023-10-25T16:17:16.899803+0000","last_unstale":"2023-10-25T16:17:17.654373+0000","last_undegraded":"2023-10-25T16:17:17.654373+0000","last_fullsized":"2023-10-25T16:17:17.654373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:32:54.642656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.711184+0000","last_change":"2023-10-25T16:17:17.672992+0000","last_active":"2023-10-25T16:17:18.711184+0000","last_peered":"2023-10-25T16:17:18.711184+0000","last_clean":"2023-10-25T16:17:18.711184+0000","last_became_active":"2023-10-25T16:17:17.666970+0000","last_became_peered":"2023-10-25T16:17:17.666970+0000","last_unstale":"2023-10-25T16:17:18.711184+0000","last_undegraded":"2023-10-25T16:17:18.711184+0000","last_fullsized":"2023-10-25T16:17:18.711184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:31.108645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706743+0000","last_change":"2023-10-25T16:17:16.905625+0000","last_active":"2023-10-25T16:17:18.706743+0000","last_peered":"2023-10-25T16:17:18.706743+0000","last_clean":"2023-10-25T16:17:18.706743+0000","last_became_active":"2023-10-25T16:17:16.905397+0000","last_became_peered":"2023-10-25T16:17:16.905397+0000","last_unstale":"2023-10-25T16:17:18.706743+0000","last_undegraded":"2023-10-25T16:17:18.706743+0000","last_fullsized":"2023-10-25T16:17:18.706743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:57:56.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.706602+0000","last_change":"2023-10-25T16:17:17.669175+0000","last_active":"2023-10-25T16:17:18.706602+0000","last_peered":"2023-10-25T16:17:18.706602+0000","last_clean":"2023-10-25T16:17:18.706602+0000","last_became_active":"2023-10-25T16:17:17.668211+0000","last_became_peered":"2023-10-25T16:17:17.668211+0000","last_unstale":"2023-10-25T16:17:18.706602+0000","last_undegraded":"2023-10-25T16:17:18.706602+0000","last_fullsized":"2023-10-25T16:17:18.706602+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:28:24.300581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.709817+0000","last_change":"2023-10-25T16:17:16.910651+0000","last_active":"2023-10-25T16:17:18.709817+0000","last_peered":"2023-10-25T16:17:18.709817+0000","last_clean":"2023-10-25T16:17:18.709817+0000","last_became_active":"2023-10-25T16:17:16.909696+0000","last_became_peered":"2023-10-25T16:17:16.909696+0000","last_unstale":"2023-10-25T16:17:18.709817+0000","last_undegraded":"2023-10-25T16:17:18.709817+0000","last_fullsized":"2023-10-25T16:17:18.709817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:29:53.032575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712481+0000","last_change":"2023-10-25T16:17:17.671027+0000","last_active":"2023-10-25T16:17:18.712481+0000","last_peered":"2023-10-25T16:17:18.712481+0000","last_clean":"2023-10-25T16:17:18.712481+0000","last_became_active":"2023-10-25T16:17:17.669539+0000","last_became_peered":"2023-10-25T16:17:17.669539+0000","last_unstale":"2023-10-25T16:17:18.712481+0000","last_undegraded":"2023-10-25T16:17:18.712481+0000","last_fullsized":"2023-10-25T16:17:18.712481+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:55:34.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712622+0000","last_change":"2023-10-25T16:17:16.902431+0000","last_active":"2023-10-25T16:17:18.712622+0000","last_peered":"2023-10-25T16:17:18.712622+0000","last_clean":"2023-10-25T16:17:18.712622+0000","last_became_active":"2023-10-25T16:17:16.900783+0000","last_became_peered":"2023-10-25T16:17:16.900783+0000","last_unstale":"2023-10-25T16:17:18.712622+0000","last_undegraded":"2023-10-25T16:17:18.712622+0000","last_fullsized":"2023-10-25T16:17:18.712622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:08.252934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:19.222267+0000","last_change":"2023-10-25T16:17:17.666667+0000","last_active":"2023-10-25T16:17:19.222267+0000","last_peered":"2023-10-25T16:17:19.222267+0000","last_clean":"2023-10-25T16:17:19.222267+0000","last_became_active":"2023-10-25T16:17:17.666071+0000","last_became_peered":"2023-10-25T16:17:17.666071+0000","last_unstale":"2023-10-25T16:17:19.222267+0000","last_undegraded":"2023-10-25T16:17:19.222267+0000","last_fullsized":"2023-10-25T16:17:19.222267+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:16.866811+0000","last_clean_scrub_stamp":"2023-10-25T16:17:16.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:14:54.061159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"86'2","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-25T16:17:18.712904+0000","last_change":"2023-10-25T16:17:16.913949+0000","last_active":"2023-10-25T16:17:18.712904+0000","last_peered":"2023-10-25T16:17:18.712904+0000","last_clean":"2023-10-25T16:17:18.712904+0000","last_became_active":"2023-10-25T16:17:16.911491+0000","last_became_peered":"2023-10-25T16:17:16.911491+0000","last_unstale":"2023-10-25T16:17:18.712904+0000","last_undegraded":"2023-10-25T16:17:18.712904+0000","last_fullsized":"2023-10-25T16:17:18.712904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:17:15.852324+0000","last_clean_scrub_stamp":"2023-10-25T16:17:15.852324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:55.386778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-25T16:17:17.633792+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:17:17.633792+0000","last_peered":"2023-10-25T16:17:17.633792+0000","last_clean":"2023-10-25T16:17:17.633792+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:17:17.633792+0000","last_undegraded":"2023-10-25T16:17:17.633792+0000","last_fullsized":"2023-10-25T16:17:17.633792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:15.165202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":455,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194857,"statfs":{"total":200000000,"available":199534001,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.88900000000000001,"5min":1.077,"15min":1.077},"last":0.94099999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60299999999999998,"15min":0.56200000000000006},"min":{"1min":0.307,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.0309999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.503},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.59599999999999997,"15min":0.54200000000000004},"min":{"1min":0.373,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.87,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.61599999999999999,"15min":0.57999999999999996},"min":{"1min":0.40200000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65300000000000002,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2529999999999999,"5min":1.345,"15min":1.345},"last":0.70399999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.84699999999999998,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.1919999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.86799999999999999,"15min":0.83999999999999997},"min":{"1min":0.73599999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.032}]},{"osd":5,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.86099999999999999,"15min":0.83699999999999997},"min":{"1min":0.60999999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.1639999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.91600000000000004,"15min":0.91900000000000004},"min":{"1min":0.67900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.147,"5min":1.581,"15min":1.581},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.90200000000000002,"15min":0.878},"min":{"1min":0.61899999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.131,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.111},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.90600000000000003,"15min":0.92700000000000005},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.155,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.88100000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92300000000000004,"15min":0.91100000000000003},"min":{"1min":0.79600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.133,"5min":1.677,"15min":1.677},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95999999999999996,"15min":0.95499999999999996},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2050000000000001,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.84799999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1030,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77100000000000002,"15min":0.749},"min":{"1min":0.59799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0920000000000001,"5min":1.256,"15min":1.256},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.86199999999999999,"15min":0.83099999999999996},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89300000000000002,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0920000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.91500000000000004,"15min":0.89900000000000002},"min":{"1min":0.69599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.29,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.2410000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.85599999999999998,"15min":0.82999999999999996},"min":{"1min":0.58399999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1910000000000001,"5min":1.27,"15min":1.27},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.71199999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.159,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.96999999999999997,"15min":0.97399999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.96399999999999997,"15min":0.93799999999999994},"min":{"1min":0.57799999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3420000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.97399999999999998,"15min":1.012},"min":{"1min":0.64000000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":1.0249999999999999,"15min":1.0569999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0289999999999999,"15min":1.0389999999999999},"min":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1339999999999999,"15min":1.1499999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.151},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.119,"15min":1.1259999999999999},"min":{"1min":0.72399999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.397,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.087}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535521,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.879,"15min":0.86399999999999999},"min":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2470000000000001,"5min":1.397,"15min":1.397},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.224,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90100000000000002,"15min":0.88500000000000001},"min":{"1min":0.626,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2090000000000001,"5min":1.302,"15min":1.302},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89700000000000002,"15min":0.89500000000000002},"min":{"1min":0.64300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.163,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.754,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.119,"5min":1.476,"15min":1.476},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.018,"5min":0.92200000000000004,"15min":0.88400000000000001},"min":{"1min":0.81599999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.69999999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.749},{"interface":"front","average":{"1min":1.016,"5min":1.044,"15min":1.0429999999999999},"min":{"1min":0.77000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.2330000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.93300000000000005,"15min":0.95099999999999996},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2250000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.96299999999999997,"15min":0.99199999999999999},"min":{"1min":0.70599999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1479999999999999,"5min":1.413,"15min":1.413},"last":0.92100000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.97699999999999998,"15min":0.96899999999999997},"min":{"1min":0.72899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.042,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.65800000000000003,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3400000000000001,"5min":1.895,"15min":1.895},"last":1.046}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.081,"15min":1.079},"min":{"1min":0.81799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3049999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0640000000000001,"15min":1.0369999999999999},"min":{"1min":0.85299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.296,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535523,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":1.1259999999999999,"15min":1.3700000000000001},"min":{"1min":0.59199999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.661,"5min":14.843,"15min":14.843},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.173,"15min":1.5149999999999999},"min":{"1min":0.66100000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0549999999999999,"5min":16.439,"15min":16.439},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.161,"15min":1.4370000000000001},"min":{"1min":0.64300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2150000000000001,"5min":14.630000000000001,"15min":14.630000000000001},"last":1.157},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88700000000000001,"15min":0.86799999999999999},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.224,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.129}]},{"osd":2,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.91800000000000004,"15min":0.93600000000000005},"min":{"1min":0.77900000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.22,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.97099999999999997,"15min":0.96699999999999997},"min":{"1min":0.63300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.4399999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.2470000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.98099999999999998,"15min":0.99099999999999999},"min":{"1min":0.80300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1699999999999999,"5min":1.252,"15min":1.252},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.323,"15min":1.5389999999999999},"min":{"1min":1.0580000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8149999999999999,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3140000000000001,"15min":1.625},"min":{"1min":0.68600000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.52,"5min":15.904,"15min":15.904},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.3069999999999999,"15min":1.6559999999999999},"min":{"1min":0.75800000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.879,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.278,"15min":1.524},"min":{"1min":0.67800000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.748,"5min":14.567,"15min":14.567},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.4450000000000001,"15min":1.7390000000000001},"min":{"1min":0.89500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.599,"5min":15.089,"15min":15.089},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:17:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.397,"15min":1.7729999999999999},"min":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7090000000000001,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1970000000000001,"15min":1.272},"min":{"1min":0.77900000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.9530000000000001,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.387}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":453,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194858,"statfs":{"total":200000000,"available":199535543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.82799999999999996,"15min":0.80000000000000004},"min":{"1min":0.66900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.327,"5min":1.47,"15min":1.47},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.80500000000000005},"min":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.85899999999999999,"15min":0.81799999999999995},"min":{"1min":0.71299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":1.1659999999999999,"5min":1.288,"15min":1.288},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.58899999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1619999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":0.89300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.68200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2290000000000001,"5min":1.369,"15min":1.369},"last":1.052},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.78500000000000003},"min":{"1min":0.64100000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.069,"5min":1.518,"15min":1.518},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.96599999999999997,"15min":0.95799999999999996},"min":{"1min":0.69499999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1990000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.131,"5min":1.121,"15min":1.121},"min":{"1min":0.91200000000000003,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.24}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.143,"5min":2.085,"15min":2.085},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.101,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.71799999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3029999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.329}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.94499999999999995},"min":{"1min":0.66100000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.196,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":1.0289999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.351,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.1299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":447,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194865,"statfs":{"total":200000000,"available":199541801,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.59799999999999998,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66700000000000004,"15min":0.64300000000000002},"min":{"1min":0.25700000000000001,"5min":0.222,"15min":0.222},"max":{"1min":1.004,"5min":1.083,"15min":1.083},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.255,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.998,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.69899999999999995},"min":{"1min":0.39100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.0409999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.36299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.627},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68999999999999995,"15min":0.69499999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1719999999999999,"5min":1.23,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":0.99399999999999999,"15min":0.98699999999999999},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2390000000000001,"5min":1.427,"15min":1.427},"last":0.78600000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92100000000000004,"15min":0.93500000000000005},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.214,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3720000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59499999999999997,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.306,"5min":1.456,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.98699999999999999,"15min":1.0089999999999999},"min":{"1min":0.53100000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.282,"5min":1.663,"15min":1.663},"last":0.93700000000000006}]},{"osd":7,"last update":"Wed Oct 25 16:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.99399999999999999,"15min":0.96999999999999997},"min":{"1min":0.58099999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.47,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.038},{"interface":"front","average":{"1min":1.022,"5min":0.96999999999999997,"15min":0.94599999999999995},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.252,"5min":1.389,"15min":1.389},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":455,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194856,"statfs":{"total":200000000,"available":199533385,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.35499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.97099999999999997,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.30299999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.129,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.318}]},{"osd":2,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.58899999999999997,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1499999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.318,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.0960000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.371,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.034,"5min":1.423,"15min":1.423},"last":0.375}]},{"osd":4,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.05,"15min":0.97699999999999998},"min":{"1min":0.69199999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":12.698,"15min":12.698},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.1000000000000001,"15min":1.026},"min":{"1min":0.76200000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.214,"5min":12.721,"15min":12.721},"last":0.84699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.92900000000000005,"15min":0.91700000000000004},"min":{"1min":0.57999999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2549999999999999,"5min":1.546,"15min":1.546},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91800000000000004,"15min":0.89200000000000002},"min":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2290000000000001,"5min":2.206,"15min":2.206},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.016,"15min":1.022},"min":{"1min":0.69199999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.381,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.95699999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:17:06 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0980000000000001,"15min":0.98199999999999998},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.268,"5min":14.776,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.093,"15min":1.0169999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4339999999999999,"5min":10.509,"15min":10.509},"last":1.0640000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1023,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194288,"statfs":{"total":200000000,"available":198951545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.70499999999999996},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.94899999999999995,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.749},"min":{"1min":0.34899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0069999999999999,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.68899999999999995},"min":{"1min":0.28999999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.84899999999999998,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.71899999999999997},"min":{"1min":0.372,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95199999999999996,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.78500000000000003},"min":{"1min":0.33100000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":1.101},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.45300000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1699999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.68400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0960000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.89700000000000002,"15min":0.93000000000000005},"min":{"1min":0.64700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.149,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.997}]},{"osd":5,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.88200000000000001,"15min":0.85299999999999998},"min":{"1min":0.73399999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2190000000000001,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.91900000000000004,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.105,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.206,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.93200000000000005,"15min":0.91700000000000004},"min":{"1min":0.82399999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2869999999999999,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.121}]},{"osd":7,"last update":"Wed Oct 25 16:17:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1459999999999999,"15min":1.3220000000000001},"min":{"1min":0.81799999999999995,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3080000000000001,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.1619999999999999,"15min":1.339},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3360000000000001,"5min":11.622,"15min":11.622},"last":1.073}]}]}],"pool_statfs":[]}} 2023-10-25T16:17:25.661 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:17:25.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:17:25.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/179217983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40aff30 msgr2=0x7f3ab00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 --2- 172.21.15.177:0/179217983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac40aff30 0x7f3ab00047d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009d30 tx=0x7f3aac01d470 comp rx=0 tx=0).stop 2023-10-25T16:17:25.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac950e640 1 -- 172.21.15.177:0/179217983 reap_dead start 2023-10-25T16:17:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/179217983 shutdown_connections 2023-10-25T16:17:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/179217983 >> 172.21.15.177:0/179217983 conn(0x7f3ac40698f0 msgr2=0x7f3ac4069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/179217983 shutdown_connections 2023-10-25T16:17:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/179217983 wait complete. 2023-10-25T16:17:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 Processor -- start 2023-10-25T16:17:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- start start 2023-10-25T16:17:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ac40aff30 0x7f3ac40b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 0x7f3ac40abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac4132480 0x7f3ac4132900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ab290 con 0x7f3ac40ab860 2023-10-25T16:17:25.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ac200 con 0x7f3ac40aff30 2023-10-25T16:17:25.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40aa1f0 con 0x7f3ac4132480 2023-10-25T16:17:25.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 0x7f3ac40abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 0x7f3ac40abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34632/0 (socket says 172.21.15.177:34632) 2023-10-25T16:17:25.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 -- 172.21.15.177:0/2941663343 learned_addr learned my addr 172.21.15.177:0/2941663343 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:25.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac950e640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac4132480 0x7f3ac4132900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac8d0d640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ac40aff30 0x7f3ac40b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 -- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac4132480 msgr2=0x7f3ac4132900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac4132480 0x7f3ac4132900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 -- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ac40aff30 msgr2=0x7f3ac40b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:25.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ac40aff30 0x7f3ac40b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:25.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 -- 172.21.15.177:0/2941663343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40aa4d0 con 0x7f3ac40ab860 2023-10-25T16:17:25.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac3fff640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 0x7f3ac40abcc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009c50 tx=0x7f3aac0050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:25.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac0af030 con 0x7f3ac40ab860 2023-10-25T16:17:25.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3aac0b0040 con 0x7f3ac40ab860 2023-10-25T16:17:25.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40aa7b0 con 0x7f3ac40ab860 2023-10-25T16:17:25.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac004a10 con 0x7f3ac40ab860 2023-10-25T16:17:25.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.829+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac40aad70 con 0x7f3ac40ab860 2023-10-25T16:17:25.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.833+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac404db20 con 0x7f3ac40ab860 2023-10-25T16:17:25.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.833+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3aac004b70 con 0x7f3ac40ab860 2023-10-25T16:17:25.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.833+0000 7f3ac17fa640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3aa40664a0 0x7f3aa4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:25.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.833+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3aac11f740 con 0x7f3ac40ab860 2023-10-25T16:17:25.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.833+0000 7f3ac8d0d640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3aa40664a0 0x7f3aa4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:25.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.833+0000 7f3ac8d0d640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3aa40664a0 0x7f3aa4068960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4001380 tx=0x7f3ab4001850 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:25.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:25.837+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3aac0ecb30 con 0x7f3ac40ab860 2023-10-25T16:17:26.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.033+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3ac406d050 con 0x7f3ac40ab860 2023-10-25T16:17:26.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.037+0000 7f3ac17fa640 1 -- 172.21.15.177:0/2941663343 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3aac0f0150 con 0x7f3ac40ab860 2023-10-25T16:17:26.042 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:17:26.042 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:17:26.042 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:17:26.042 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:17:26.043 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:17:26.043 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:17:26.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3aa40664a0 msgr2=0x7f3aa4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3aa40664a0 0x7f3aa4068960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4001380 tx=0x7f3ab4001850 comp rx=0 tx=0).stop 2023-10-25T16:17:26.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 msgr2=0x7f3ac40abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 0x7f3ac40abcc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009c50 tx=0x7f3aac0050c0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 shutdown_connections 2023-10-25T16:17:26.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3aa40664a0 0x7f3aa4068960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ac4132480 0x7f3ac4132900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ac40ab860 0x7f3ac40abcc0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 --2- 172.21.15.177:0/2941663343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ac40aff30 0x7f3ac40b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 >> 172.21.15.177:0/2941663343 conn(0x7f3ac40698f0 msgr2=0x7f3ac40acba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 shutdown_connections 2023-10-25T16:17:26.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.041+0000 7f3acaf71640 1 -- 172.21.15.177:0/2941663343 wait complete. 2023-10-25T16:17:26.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:26.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa9011f1640 1 -- 172.21.15.177:0/647782327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8e4004d10 msgr2=0x7fa8e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa9011f1640 1 --2- 172.21.15.177:0/647782327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8e4004d10 0x7fa8e4005190 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c260 tx=0x7fa8f401cfc0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa8fb59e640 1 -- 172.21.15.177:0/647782327 reap_dead start 2023-10-25T16:17:26.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa9011f1640 1 -- 172.21.15.177:0/647782327 shutdown_connections 2023-10-25T16:17:26.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa9011f1640 1 -- 172.21.15.177:0/647782327 >> 172.21.15.177:0/647782327 conn(0x7fa8fc0b2450 msgr2=0x7fa8fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa9011f1640 1 -- 172.21.15.177:0/647782327 shutdown_connections 2023-10-25T16:17:26.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.165+0000 7fa9011f1640 1 -- 172.21.15.177:0/647782327 wait complete. 2023-10-25T16:17:26.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 Processor -- start 2023-10-25T16:17:26.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- start start 2023-10-25T16:17:26.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8fc145bd0 0x7fa8fc14b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 0x7fa8fc1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8fc06ff60 0x7fa8fc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc070930 con 0x7fa8fc153460 2023-10-25T16:17:26.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc145fb0 con 0x7fa8fc06ff60 2023-10-25T16:17:26.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc154bf0 con 0x7fa8fc145bd0 2023-10-25T16:17:26.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 0x7fa8fc1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 0x7fa8fc1542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34644/0 (socket says 172.21.15.177:34644) 2023-10-25T16:17:26.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 -- 172.21.15.177:0/2848870838 learned_addr learned my addr 172.21.15.177:0/2848870838 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:26.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fb59e640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8fc06ff60 0x7fa8fc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fad9d640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8fc145bd0 0x7fa8fc14b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 -- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8fc145bd0 msgr2=0x7fa8fc14b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8fc145bd0 0x7fa8fc14b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 -- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8fc06ff60 msgr2=0x7fa8fc0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8fc06ff60 0x7fa8fc0703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 -- 172.21.15.177:0/2848870838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0aa950 con 0x7fa8fc153460 2023-10-25T16:17:26.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8fa59c640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 0x7fa8fc1542f0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000d580 tx=0x7fa8f000da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0012630 con 0x7fa8fc153460 2023-10-25T16:17:26.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa8f0012790 con 0x7fa8fc153460 2023-10-25T16:17:26.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc0aac30 con 0x7fa8fc153460 2023-10-25T16:17:26.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0012ba0 con 0x7fa8fc153460 2023-10-25T16:17:26.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc0ab1f0 con 0x7fa8fc153460 2023-10-25T16:17:26.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.169+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc15bc20 con 0x7fa8fc153460 2023-10-25T16:17:26.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.173+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8f001b400 con 0x7fa8fc153460 2023-10-25T16:17:26.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.173+0000 7fa8e37fe640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8e8066470 0x7fa8e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.173+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8f00840c0 con 0x7fa8fc153460 2023-10-25T16:17:26.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.173+0000 7fa8fad9d640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8e8066470 0x7fa8e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.173+0000 7fa8fad9d640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8e8066470 0x7fa8e8068930 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0092f0 tx=0x7fa8ec009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.177+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8f0051550 con 0x7fa8fc153460 2023-10-25T16:17:26.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.357+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8fc071670 con 0x7fa8fc153460 2023-10-25T16:17:26.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.357+0000 7fa8e37fe640 1 -- 172.21.15.177:0/2848870838 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fa8f0054b70 con 0x7fa8fc153460 2023-10-25T16:17:26.362 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:26.362 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:17:26.363 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:17:26.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8e8066470 msgr2=0x7fa8e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8e8066470 0x7fa8e8068930 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0092f0 tx=0x7fa8ec009260 comp rx=0 tx=0).stop 2023-10-25T16:17:26.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 msgr2=0x7fa8fc1542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 0x7fa8fc1542f0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000d580 tx=0x7fa8f000da40 comp rx=0 tx=0).stop 2023-10-25T16:17:26.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 shutdown_connections 2023-10-25T16:17:26.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa8e8066470 0x7fa8e8068930 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8fc06ff60 0x7fa8fc0703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8fc153460 0x7fa8fc1542f0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 --2- 172.21.15.177:0/2848870838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8fc145bd0 0x7fa8fc14b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 >> 172.21.15.177:0/2848870838 conn(0x7fa8fc0b2450 msgr2=0x7fa8fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 shutdown_connections 2023-10-25T16:17:26.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.361+0000 7fa9011f1640 1 -- 172.21.15.177:0/2848870838 wait complete. 2023-10-25T16:17:26.781 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:17:17.255742+0000', 'modified': '2023-10-25T16:17:19.253083+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 155189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_155189': {'gid': 155189, 'name': 'b', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6835/887944818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 887944818}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 887944818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:17:26.782 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:17:26.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-25T16:17:26.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 -- 172.21.15.177:0/4162654235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb006b980 msgr2=0x7ffbb006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 --2- 172.21.15.177:0/4162654235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb006b980 0x7ffbb006be10 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ffbb006c6a0 tx=0x7ffba801cd30 comp rx=0 tx=0).stop 2023-10-25T16:17:26.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 -- 172.21.15.177:0/4162654235 shutdown_connections 2023-10-25T16:17:26.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 --2- 172.21.15.177:0/4162654235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb006b980 0x7ffbb006be10 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 --2- 172.21.15.177:0/4162654235 >> v2:172.21.15.184:3300/0 conn(0x7ffbb0071500 0x7ffbb0070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 -- 172.21.15.177:0/4162654235 >> 172.21.15.177:0/4162654235 conn(0x7ffbb00b2450 msgr2=0x7ffbb00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 -- 172.21.15.177:0/4162654235 shutdown_connections 2023-10-25T16:17:26.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 -- 172.21.15.177:0/4162654235 wait complete. 2023-10-25T16:17:26.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 Processor -- start 2023-10-25T16:17:26.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.909+0000 7ffbb8708640 1 -- start start 2023-10-25T16:17:26.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbb006b980 0x7ffbb00af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbb0071500 0x7ffbb01571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 0x7ffbb00b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0157710 con 0x7ffbb0159230 2023-10-25T16:17:26.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb01579b0 con 0x7ffbb0071500 2023-10-25T16:17:26.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0157c90 con 0x7ffbb006b980 2023-10-25T16:17:26.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 0x7ffbb00b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 0x7ffbb00b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34672/0 (socket says 172.21.15.177:34672) 2023-10-25T16:17:26.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 -- 172.21.15.177:0/3414215600 learned_addr learned my addr 172.21.15.177:0/3414215600 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:26.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbb0071500 0x7ffbb01571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbb006b980 0x7ffbb00af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 -- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbb006b980 msgr2=0x7ffbb00af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbb006b980 0x7ffbb00af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 -- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbb0071500 msgr2=0x7ffbb01571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbb0071500 0x7ffbb01571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 -- 172.21.15.177:0/3414215600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80098e0 con 0x7ffbb0159230 2023-10-25T16:17:26.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbb006b980 0x7ffbb00af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:26.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 0x7ffbb00b1790 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ffba8019940 tx=0x7ffba8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbaeffd640 1 -- 172.21.15.177:0/3414215600 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8004e60 con 0x7ffbb0159230 2023-10-25T16:17:26.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbaeffd640 1 -- 172.21.15.177:0/3414215600 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffba8004000 con 0x7ffbb0159230 2023-10-25T16:17:26.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbaeffd640 1 -- 172.21.15.177:0/3414215600 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba80043b0 con 0x7ffbb0159230 2023-10-25T16:17:26.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb0157f70 con 0x7ffbb0159230 2023-10-25T16:17:26.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb0158530 con 0x7ffbb0159230 2023-10-25T16:17:26.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbaeffd640 1 -- 172.21.15.177:0/3414215600 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffba80b4040 con 0x7ffbb0159230 2023-10-25T16:17:26.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbaeffd640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb9c0664a0 0x7ffb9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbaeffd640 1 -- 172.21.15.177:0/3414215600 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffba811dfa0 con 0x7ffbb0159230 2023-10-25T16:17:26.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.913+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb9c0664a0 0x7ffb9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 Processor -- start 2023-10-25T16:17:26.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- start start 2023-10-25T16:17:26.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb9c0664a0 0x7ffb9c068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffba0000f70 tx=0x7ffba0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22c9c0 0x55fb5b22cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 0x55fb5b1e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5afd7cc0 con 0x55fb5b22d2e0 2023-10-25T16:17:26.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b03a920 con 0x55fb5b1e2f80 2023-10-25T16:17:26.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b037e50 con 0x55fb5b22c9c0 2023-10-25T16:17:26.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 0x55fb5b1e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 0x55fb5b1e2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34674/0 (socket says 172.21.15.177:34674) 2023-10-25T16:17:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1815221101 learned_addr learned my addr 172.21.15.177:0/1815221101 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22c9c0 0x55fb5b22cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22c9c0 msgr2=0x55fb5b22cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22c9c0 0x55fb5b22cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 msgr2=0x55fb5b1e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1815221101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb5ad2c890 con 0x55fb5b22d2e0 2023-10-25T16:17:26.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:26.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22c9c0 0x55fb5b22cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:26.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 0x55fb5b1e2a40 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009c20 tx=0x7ffba40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c5e8531b1a69a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffb97fff640 1 -- 172.21.15.177:0/1815221101 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40096f0 con 0x55fb5b22d2e0 2023-10-25T16:17:26.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffb97fff640 1 -- 172.21.15.177:0/1815221101 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffba4012450 con 0x55fb5b22d2e0 2023-10-25T16:17:26.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffb97fff640 1 -- 172.21.15.177:0/1815221101 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4012860 con 0x55fb5b22d2e0 2023-10-25T16:17:26.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- 172.21.15.177:0/1815221101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 msgr2=0x55fb5b1e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 0x55fb5b1e2a40 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009c20 tx=0x7ffba40117b0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- 172.21.15.177:0/1815221101 shutdown_connections 2023-10-25T16:17:26.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22d2e0 0x55fb5b1e2a40 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1815221101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22c9c0 0x55fb5b22cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- 172.21.15.177:0/1815221101 >> 172.21.15.177:0/1815221101 conn(0x55fb5b1da2f0 msgr2=0x55fb5b1e1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- 172.21.15.177:0/1815221101 shutdown_connections 2023-10-25T16:17:26.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- 172.21.15.177:0/1815221101 wait complete. 2023-10-25T16:17:26.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- start start 2023-10-25T16:17:26.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 Processor -- start 2023-10-25T16:17:26.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b22ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b033740 con 0x55fb5b1e2f80 2023-10-25T16:17:26.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5aff2d10 con 0x55fb5b22c9c0 2023-10-25T16:17:26.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.917+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb5aff29b0 con 0x55fb5b22d2e0 2023-10-25T16:17:26.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 10 client.0 _ll_register_callbacks cb 0x55fb5b1ce6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:17:26.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34676/0 (socket says 172.21.15.177:34676) 2023-10-25T16:17:26.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 -- 172.21.15.177:0/1260767682 learned_addr learned my addr 172.21.15.177:0/1260767682 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:26.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b22ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 -- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 msgr2=0x55fb5b22ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b22ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 -- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 msgr2=0x55fb5b22e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 -- 172.21.15.177:0/1260767682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba4009850 con 0x55fb5b1e2f80 2023-10-25T16:17:26.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:26.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb6ca5640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b22ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:26.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:17:26.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e8770 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ffba000ddb0 tx=0x7ffba0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df16664af2fb5c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 1 -- 172.21.15.177:0/1260767682 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba001f610 con 0x55fb5b1e2f80 2023-10-25T16:17:26.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 1 -- 172.21.15.177:0/1260767682 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffba001f770 con 0x55fb5b1e2f80 2023-10-25T16:17:26.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb5afe7370 con 0x55fb5b1e2f80 2023-10-25T16:17:26.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 1 -- 172.21.15.177:0/1260767682 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffba001f970 con 0x55fb5b1e2f80 2023-10-25T16:17:26.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 10 client.6948 fetch_fsmap learned FSMap version 31 2023-10-25T16:17:26.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55fb5aff5460 con 0x55fb5b1e2f80 2023-10-25T16:17:26.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 1 -- 172.21.15.177:0/1260767682 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55fb5afe7370 con 0x55fb5b1e2f80 2023-10-25T16:17:26.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 1 -- 172.21.15.177:0/1260767682 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffba001fad0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 10 client.6948 fetch_fsmap finished waiting for FSMap version 31 2023-10-25T16:17:26.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 10 client.6948 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:17:26.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 20 client.6948 populate_metadata read hostname 'smithi177' 2023-10-25T16:17:26.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b23c8f0 0x55fb5b23ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 4 client.6948 mds_command: new command op to 155189 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:17:26.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 --> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb5afcd2d0 con 0x55fb5b23c8f0 2023-10-25T16:17:26.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b23c8f0 0x55fb5b23ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b23c8f0 0x55fb5b23ccd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e62819bc0cc66290 server_cookie=dcf7d1232fab11e9 in_seq=0 out_seq=0 2023-10-25T16:17:26.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 10 client.6948 ms_handle_connect on v2:172.21.15.184:6834/887944818 2023-10-25T16:17:26.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 1 -- 172.21.15.177:0/1260767682 <== mds.0 v2:172.21.15.184:6834/887944818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb5afcd2d0 con 0x55fb5b23c8f0 2023-10-25T16:17:26.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 10 client.6948 handle_command_reply: tid=0 2023-10-25T16:17:26.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 client.6948 shutdown 2023-10-25T16:17:26.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 msgr2=0x55fb5b1e8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e8770 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ffba000ddb0 tx=0x7ffba0000ee0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 shutdown_connections 2023-10-25T16:17:26.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b23c8f0 0x55fb5b23ccd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b22ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1260767682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b1e8770 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffb957fa640 0 client.6948 ms_handle_reset on v2:172.21.15.184:6834/887944818 2023-10-25T16:17:26.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.921+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 >> 172.21.15.177:0/1260767682 conn(0x55fb5b1da2f0 msgr2=0x55fb5b1e1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.925+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 shutdown_connections 2023-10-25T16:17:26.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.925+0000 7ffbbb852000 1 -- 172.21.15.177:0/1260767682 wait complete. 2023-10-25T16:17:26.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.925+0000 7ffbbb852000 20 client.6948 trim_cache size 0 max 16384 2023-10-25T16:17:26.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 Processor -- start 2023-10-25T16:17:26.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 -- start start 2023-10-25T16:17:26.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b22bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b246980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5aced940 con 0x55fb5b22c9c0 2023-10-25T16:17:26.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b0388b0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b1e87c0 con 0x55fb5b22d2e0 2023-10-25T16:17:26.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34678/0 (socket says 172.21.15.177:34678) 2023-10-25T16:17:26.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1605944120 learned_addr learned my addr 172.21.15.177:0/1605944120 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:26.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1605944120 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 msgr2=0x55fb5b246980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b246980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1605944120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 msgr2=0x55fb5b22bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b22bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 -- 172.21.15.177:0/1605944120 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb5afdb760 con 0x55fb5b22c9c0 2023-10-25T16:17:26.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.937+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22c2c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ffba401c040 tx=0x7ffba4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c07a280a25d6b1b server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbacff9640 1 -- 172.21.15.177:0/1605944120 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4031650 con 0x55fb5b22c9c0 2023-10-25T16:17:26.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbacff9640 1 -- 172.21.15.177:0/1605944120 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffba40317b0 con 0x55fb5b22c9c0 2023-10-25T16:17:26.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbacff9640 1 -- 172.21.15.177:0/1605944120 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4031bc0 con 0x55fb5b22c9c0 2023-10-25T16:17:26.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/1605944120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 msgr2=0x55fb5b22c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22c2c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ffba401c040 tx=0x7ffba4004740 comp rx=0 tx=0).stop 2023-10-25T16:17:26.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/1605944120 shutdown_connections 2023-10-25T16:17:26.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b246980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b22c9c0 0x55fb5b22c2c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- 172.21.15.177:0/1605944120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b1e2f80 0x55fb5b22bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/1605944120 >> 172.21.15.177:0/1605944120 conn(0x55fb5b1da2f0 msgr2=0x55fb5b22e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/1605944120 shutdown_connections 2023-10-25T16:17:26.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/1605944120 wait complete. 2023-10-25T16:17:26.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- start start 2023-10-25T16:17:26.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 Processor -- start 2023-10-25T16:17:26.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b2938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b293df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b2497e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b02f0b0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb5b037740 con 0x55fb5b22c9c0 2023-10-25T16:17:26.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb5ad2d1b0 con 0x55fb5b22d2e0 2023-10-25T16:17:26.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 10 client.0 _ll_register_callbacks cb 0x55fb5b031ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:17:26.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b2938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b2938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34688/0 (socket says 172.21.15.177:34688) 2023-10-25T16:17:26.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 -- 172.21.15.177:0/2046558656 learned_addr learned my addr 172.21.15.177:0/2046558656 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:26.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 -- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 msgr2=0x55fb5b2497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b2497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 -- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 msgr2=0x55fb5b293df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:17:26.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b293df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 -- 172.21.15.177:0/2046558656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb5ad2c890 con 0x55fb5b1e2f80 2023-10-25T16:17:26.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb64a4640 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b2938b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ffba0007270 tx=0x7ffba00072a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d0972ef7ab23c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:26.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffb957fa640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:17:26.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffb957fa640 1 -- 172.21.15.177:0/2046558656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0001450 con 0x55fb5b1e2f80 2023-10-25T16:17:26.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffb957fa640 1 -- 172.21.15.177:0/2046558656 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffba00069e0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb5b1e56e0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffb957fa640 1 -- 172.21.15.177:0/2046558656 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffba00076d0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 10 client.6954 fetch_fsmap learned FSMap version 31 2023-10-25T16:17:26.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x55fb5ad2ccc0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffb957fa640 1 -- 172.21.15.177:0/2046558656 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55fb5b1e56e0 con 0x55fb5b1e2f80 2023-10-25T16:17:26.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffb957fa640 1 -- 172.21.15.177:0/2046558656 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 31) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffba0038030 con 0x55fb5b1e2f80 2023-10-25T16:17:26.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 10 client.6954 fetch_fsmap finished waiting for FSMap version 31 2023-10-25T16:17:26.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 10 client.6954 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:17:26.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 20 client.6954 populate_metadata read hostname 'smithi177' 2023-10-25T16:17:26.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b29a780 0x55fb5b29cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:26.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 4 client.6954 mds_command: new command op to 155189 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:17:26.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 --> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb5afcb6f0 con 0x55fb5b29a780 2023-10-25T16:17:26.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.941+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b29a780 0x55fb5b29cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:26.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffb957fa640 10 client.6954 ms_handle_connect on v2:172.21.15.184:6834/887944818 2023-10-25T16:17:26.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb5ca3640 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b29a780 0x55fb5b29cb70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7f2a018d4347ab server_cookie=e981f2dd7edb4e2f in_seq=0 out_seq=0 2023-10-25T16:17:26.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffb957fa640 1 -- 172.21.15.177:0/2046558656 <== mds.0 v2:172.21.15.184:6834/887944818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55fb5afcb6f0 con 0x55fb5b29a780 2023-10-25T16:17:26.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffb957fa640 10 client.6954 handle_command_reply: tid=0 2023-10-25T16:17:26.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 client.6954 shutdown 2023-10-25T16:17:26.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 msgr2=0x55fb5b2938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b2938b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ffba0007270 tx=0x7ffba00072a0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 shutdown_connections 2023-10-25T16:17:26.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:6834/887944818,v1:172.21.15.184:6835/887944818] conn(0x55fb5b29a780 0x55fb5b29cb70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55fb5b22d2e0 0x55fb5b2497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffb957fa640 0 client.6954 ms_handle_reset on v2:172.21.15.184:6834/887944818 2023-10-25T16:17:26.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fb5b22c9c0 0x55fb5b293df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 --2- 172.21.15.177:0/2046558656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fb5b1e2f80 0x55fb5b2938b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 >> 172.21.15.177:0/2046558656 conn(0x55fb5b1da2f0 msgr2=0x55fb5b22bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 shutdown_connections 2023-10-25T16:17:26.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 1 -- 172.21.15.177:0/2046558656 wait complete. 2023-10-25T16:17:26.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbbb852000 20 client.6954 trim_cache size 0 max 16384 2023-10-25T16:17:26.968 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:17:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:17:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:17:26.968 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 155189, 2023-10-25T16:17:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:17:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:17:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:17:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.0649019519999996, 2023-10-25T16:17:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 31, 2023-10-25T16:17:26.969 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 87, 2023-10-25T16:17:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 87, 2023-10-25T16:17:26.970 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 14.706354398 2023-10-25T16:17:26.970 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:17:26.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb9c0664a0 msgr2=0x7ffb9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb9c0664a0 0x7ffb9c068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffba0000f70 tx=0x7ffba0009040 comp rx=0 tx=0).stop 2023-10-25T16:17:26.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 msgr2=0x7ffbb00b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:26.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 0x7ffbb00b1790 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ffba8019940 tx=0x7ffba8009300 comp rx=0 tx=0).stop 2023-10-25T16:17:26.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 shutdown_connections 2023-10-25T16:17:26.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb9c0664a0 0x7ffb9c068960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbb0159230 0x7ffbb00b1790 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbb0071500 0x7ffbb01571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 --2- 172.21.15.177:0/3414215600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbb006b980 0x7ffbb00af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:26.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 >> 172.21.15.177:0/3414215600 conn(0x7ffbb00b2450 msgr2=0x7ffbb00cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:26.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 shutdown_connections 2023-10-25T16:17:26.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:26.945+0000 7ffbb8708640 1 -- 172.21.15.177:0/3414215600 wait complete. 2023-10-25T16:17:26.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:17:27.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/3395333597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140c9f00 msgr2=0x7f581406ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 --2- 172.21.15.177:0/3395333597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140c9f00 0x7f581406ba20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5808009840 tx=0x7f580801c7b0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/3395333597 shutdown_connections 2023-10-25T16:17:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 --2- 172.21.15.177:0/3395333597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140c9f00 0x7f581406ba20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 --2- 172.21.15.177:0/3395333597 >> v2:172.21.15.184:3300/0 conn(0x7f58141537d0 0x7f5814159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/3395333597 >> 172.21.15.177:0/3395333597 conn(0x7f58140b2450 msgr2=0x7f58140b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:27.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/3395333597 shutdown_connections 2023-10-25T16:17:27.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/3395333597 wait complete. 2023-10-25T16:17:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 Processor -- start 2023-10-25T16:17:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- start start 2023-10-25T16:17:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140705b0 0x7f5814145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:27.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 0x7f581414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58141537d0 0x7f581414b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581415b0c0 con 0x7f58140c9f00 2023-10-25T16:17:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581415a4d0 con 0x7f58141537d0 2023-10-25T16:17:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581415b4e0 con 0x7f58140705b0 2023-10-25T16:17:27.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 0x7f581414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 0x7f581414b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34702/0 (socket says 172.21.15.177:34702) 2023-10-25T16:17:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 -- 172.21.15.177:0/2237973660 learned_addr learned my addr 172.21.15.177:0/2237973660 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5818a97640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140705b0 0x7f5814145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5819298640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58141537d0 0x7f581414b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:27.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 -- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140705b0 msgr2=0x7f5814145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140705b0 0x7f5814145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 -- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58141537d0 msgr2=0x7f581414b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58141537d0 0x7f581414b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 -- 172.21.15.177:0/2237973660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0098e0 con 0x7f58140c9f00 2023-10-25T16:17:27.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f5813fff640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 0x7f581414b400 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5808009790 tx=0x7f5808005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080046d0 con 0x7f58140c9f00 2023-10-25T16:17:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5808004920 con 0x7f58140c9f00 2023-10-25T16:17:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5808009450 con 0x7f58140c9f00 2023-10-25T16:17:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808004cd0 con 0x7f58140c9f00 2023-10-25T16:17:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.089+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581415a720 con 0x7f58140c9f00 2023-10-25T16:17:27.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.093+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581415b200 con 0x7f58140c9f00 2023-10-25T16:17:27.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.093+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58080a5610 con 0x7f58140c9f00 2023-10-25T16:17:27.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.093+0000 7f58117fa640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5800066470 0x7f5800068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:27.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.093+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f580811f220 con 0x7f58140c9f00 2023-10-25T16:17:27.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.093+0000 7f5818a97640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5800066470 0x7f5800068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:27.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.093+0000 7f5818a97640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5800066470 0x7f5800068930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f580c00f400 tx=0x7f580c0095c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:27.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.097+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58080ec8b0 con 0x7f58140c9f00 2023-10-25T16:17:27.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.277+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f581415b200 con 0x7f58140c9f00 2023-10-25T16:17:27.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.277+0000 7f58117fa640 1 -- 172.21.15.177:0/2237973660 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f581415b200 con 0x7f58140c9f00 2023-10-25T16:17:27.283 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:17:27.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5800066470 msgr2=0x7f5800068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:27.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5800066470 0x7f5800068930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f580c00f400 tx=0x7f580c0095c0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 msgr2=0x7f581414b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:27.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 0x7f581414b400 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5808009790 tx=0x7f5808005cc0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 shutdown_connections 2023-10-25T16:17:27.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5800066470 0x7f5800068930 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58141537d0 0x7f581414b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58140c9f00 0x7f581414b400 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 --2- 172.21.15.177:0/2237973660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f58140705b0 0x7f5814145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:27.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 >> 172.21.15.177:0/2237973660 conn(0x7f58140b2450 msgr2=0x7f5814149540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:27.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 shutdown_connections 2023-10-25T16:17:27.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:27.281+0000 7f581acfb640 1 -- 172.21.15.177:0/2237973660 wait complete. 2023-10-25T16:17:27.302 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:17:27.302 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:17:27.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:17:27.303 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:17:27.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:27.304 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:17:27.304 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:17:27.304 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:17:27.305 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:17:27.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.305 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:17:27.312 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:17:27.312 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:17:27.312 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:17:27.313 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.313 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:17:27.313 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.313 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:17:27.313 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:27.314 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:17:27.314 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:17:27.314 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:27.314 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:17:27.314 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:17:27.315 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:27.315 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:17:27.315 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:27.315 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:17:27.315 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42270sec preferred_lft 42270sec 2023-10-25T16:17:27.316 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:17:27.316 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.316 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:17:27.316 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:27.316 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:17:27.317 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.317 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:17:27.317 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:27.317 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:17:27.317 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.318 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:17:27.318 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.318 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:17:27.318 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:27.318 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:17:27.319 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.319 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:17:27.319 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:27.319 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:17:27.319 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:27.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.320 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:17:27.364 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:17:27.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.366 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:17:27.418 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:17:27.419 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:17:27.419 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:17:27.419 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:17:27.419 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:17:27.420 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:17:27.420 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:17:27.420 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:17:27.420 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:17:27.420 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:17:27.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.421 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:17:27.421 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:17:27.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:17:27.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:17:27.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:17:27.423 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:17:27.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.491 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:17:27.536 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:17:27.536 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:17:27.537 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:17:27.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:17:27.590 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:17:27.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:17:27.591 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:27.636 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:17:27.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:17:27.637 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:27.684 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:17:27.733 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:17:27.733 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:17:27.733 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:17:27.734 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:17:27.734 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:17:27.734 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:17:27.734 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:17:27.735 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:17:27.735 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:17:27.735 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:17:27.735 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:17:27.735 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:17:27.735 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:17:27.736 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:17:27.736 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:17:27.736 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:17:27.736 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:17:27.736 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:17:27.737 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:17:27.737 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:17:27.737 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:17:27.737 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:17:27.737 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:17:27.738 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:17:27.738 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:17:27.738 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:17:27.738 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:17:27.739 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:17:27.739 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:17:27.739 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:27.739 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:27.739 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:27.739 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:27.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.741 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:17:27.788 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:17:27.789 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:17:27.833 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:17:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:17:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:17:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:17:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:17:27.840 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:17:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:17:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:17:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:17:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:17:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:17:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:17:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:17:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:17:27.842 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:17:27.843 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:17:27.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:17:27.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:17:27.843 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:17:27.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:17:27.844 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:17:27.844 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:17:27.844 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:17:27.844 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:17:27.844 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:17:27.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:17:27.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:17:27.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:17:27.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:17:27.845 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:17:27.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:27.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:27.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:27.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:27.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:27.847 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:17:27.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:17:27.909+0000 7fdba2fa2580 -1 init, newargv = 0x557633f660d0 newargc=15 2023-10-25T16:17:27.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[44525]: starting ceph client 2023-10-25T16:17:27.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[44525]: starting fuse 2023-10-25T16:17:28.998 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:17:29.007 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:17:29.008 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:17:29.008 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:17:29.008 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:17:29.009 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:17:29.010 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:17:29.010 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:17:29.010 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:17:29.010 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:17:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:17:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:17:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:17:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:17:29.011 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:17:29.012 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:17:29.012 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:17:29.012 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:17:29.012 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:17:29.012 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:17:29.012 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:17:29.013 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:17:29.013 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:17:29.013 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:17:29.013 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:17:29.013 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:17:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:17:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:17:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:17:29.014 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:17:29.015 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:29.015 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:17:29.015 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:29.015 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:17:29.015 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:29.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:29.017 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:17:29.065 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:17:29.065 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:17:29.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:17:29.066 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:17:29.067 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:17:29.067 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:17:29.068 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:17:29.068 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:29.068 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:17:29.069 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:17:29.069 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:17:29.069 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:17:29.070 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:29.070 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:17:29.071 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:17:29.071 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:17:29.071 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:17:29.072 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:29.072 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:17:29.072 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:17:29.073 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:17:29.073 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:17:29.074 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:17:29.074 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:17:29.074 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:17:29.075 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:17:29.075 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:29.075 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:17:29.076 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:17:29.189 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.44525.asok 2023-10-25T16:17:29.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:29.200 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44525.asok 2023-10-25T16:17:29.201 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:29.201 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.44525.asok status 2023-10-25T16:17:29.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:29.393 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:17:29.393 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:17:29.393 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:17:29.394 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:17:29.394 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:17:29.394 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:17:29.394 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:17:29.394 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "44525", 2023-10-25T16:17:29.395 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:17:29.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:29.395 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:17:29.395 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:17:29.395 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 6966, 2023-10-25T16:17:29.396 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:17:29.396 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:17:29.396 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:17:29.396 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 6966 2023-10-25T16:17:29.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:29.397 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:17:29.397 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:17:29.397 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:17:29.397 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3395473477 2023-10-25T16:17:29.397 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:17:29.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:29.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:17:29.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:17:29.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:17:29.398 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3395473477 2023-10-25T16:17:29.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:17:29.399 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.6966 192.168.0.1:0/3395473477", 2023-10-25T16:17:29.399 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3395473477", 2023-10-25T16:17:29.399 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:17:29.400 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 31, 2023-10-25T16:17:29.400 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 87, 2023-10-25T16:17:29.400 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:17:29.400 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:17:29.400 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:17:29.401 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:17:29.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:29.413 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:29.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:17:29.414 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:29.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:29.507 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:17:29.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:29.514 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:29.514 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:29.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:29.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:29.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:29.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:17:29.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- 172.21.15.177:0/1545788531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec003980 msgr2=0x7fa2ec003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:29.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 --2- 172.21.15.177:0/1545788531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec003980 0x7fa2ec003d80 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc006fd0 tx=0x7fa2fc01c9e0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- 172.21.15.177:0/1545788531 shutdown_connections 2023-10-25T16:17:29.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 --2- 172.21.15.177:0/1545788531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec003980 0x7fa2ec003d80 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- 172.21.15.177:0/1545788531 >> 172.21.15.177:0/1545788531 conn(0x7fa30009a5c0 msgr2=0x7fa3000d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:29.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- 172.21.15.177:0/1545788531 shutdown_connections 2023-10-25T16:17:29.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- 172.21.15.177:0/1545788531 wait complete. 2023-10-25T16:17:29.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 Processor -- start 2023-10-25T16:17:29.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- start start 2023-10-25T16:17:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2ec003980 0x7fa3000c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 0x7fa3001f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3001f8d40 0x7fa300156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001f91f0 con 0x7fa3000c92d0 2023-10-25T16:17:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c4a70 con 0x7fa3001f8d40 2023-10-25T16:17:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa3075d8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa300157c40 con 0x7fa2ec003980 2023-10-25T16:17:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa304b73640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 0x7fa3001f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa304b73640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 0x7fa3001f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34722/0 (socket says 172.21.15.177:34722) 2023-10-25T16:17:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.733+0000 7fa304b73640 1 -- 172.21.15.177:0/3222152041 learned_addr learned my addr 172.21.15.177:0/3222152041 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa305374640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2ec003980 0x7fa3000c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa305b75640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3001f8d40 0x7fa300156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa304b73640 1 -- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2ec003980 msgr2=0x7fa3000c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa304b73640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2ec003980 0x7fa3000c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa304b73640 1 -- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3001f8d40 msgr2=0x7fa300156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:29.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa304b73640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3001f8d40 0x7fa300156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa304b73640 1 -- 172.21.15.177:0/3222152041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000c9900 con 0x7fa3000c92d0 2023-10-25T16:17:29.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa304b73640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 0x7fa3001f8800 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000d7e0 tx=0x7fa2f000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:29.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000de90 con 0x7fa3000c92d0 2023-10-25T16:17:29.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2f00052e0 con 0x7fa3000c92d0 2023-10-25T16:17:29.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000c9be0 con 0x7fa3000c92d0 2023-10-25T16:17:29.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000b8c0 con 0x7fa3000c92d0 2023-10-25T16:17:29.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3000ca1a0 con 0x7fa3000c92d0 2023-10-25T16:17:29.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30004daf0 con 0x7fa3000c92d0 2023-10-25T16:17:29.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2f000ba20 con 0x7fa3000c92d0 2023-10-25T16:17:29.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa2f5ffb640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2e40664a0 0x7fa2e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:29.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2f0083960 con 0x7fa3000c92d0 2023-10-25T16:17:29.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa305374640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2e40664a0 0x7fa2e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:29.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.737+0000 7fa305374640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2e40664a0 0x7fa2e4068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0ab000 tx=0x7fa2fc019780 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:29.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.741+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2f0050de0 con 0x7fa3000c92d0 2023-10-25T16:17:29.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.933+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3000c4bb0 con 0x7fa3000c92d0 2023-10-25T16:17:29.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.933+0000 7fa2f5ffb640 1 -- 172.21.15.177:0/3222152041 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa2f0019020 con 0x7fa3000c92d0 2023-10-25T16:17:29.938 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:17:29.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.933+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2e40664a0 msgr2=0x7fa2e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:29.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.933+0000 7fa3075d8640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2e40664a0 0x7fa2e4068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0ab000 tx=0x7fa2fc019780 comp rx=0 tx=0).stop 2023-10-25T16:17:29.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.933+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 msgr2=0x7fa3001f8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:29.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.933+0000 7fa3075d8640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 0x7fa3001f8800 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000d7e0 tx=0x7fa2f000dca0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 shutdown_connections 2023-10-25T16:17:29.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2e40664a0 0x7fa2e4068960 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3001f8d40 0x7fa300156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3000c92d0 0x7fa3001f8800 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 --2- 172.21.15.177:0/3222152041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2ec003980 0x7fa3000c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:29.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 >> 172.21.15.177:0/3222152041 conn(0x7fa30009a5c0 msgr2=0x7fa30015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:29.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 shutdown_connections 2023-10-25T16:17:29.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:29.937+0000 7fa3075d8640 1 -- 172.21.15.177:0/3222152041 wait complete. 2023-10-25T16:17:29.956 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:17:29.957 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:17:29.957 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:17:29.957 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:17:29.958 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:29.958 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:17:29.958 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:17:29.959 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:17:29.959 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:17:29.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:29.960 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:17:29.967 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:17:29.968 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:17:29.968 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:17:29.968 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.968 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:17:29.968 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.969 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:17:29.969 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:29.969 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:17:29.969 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:17:29.969 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:29.970 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:17:29.970 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:17:29.970 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:29.970 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:17:29.970 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:29.970 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:17:29.971 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42249sec preferred_lft 42249sec 2023-10-25T16:17:29.971 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:17:29.971 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.971 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:17:29.971 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:29.972 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:17:29.972 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.972 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:17:29.972 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:17:29.972 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:17:29.973 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.973 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:17:29.973 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.973 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:17:29.973 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:29.973 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:17:29.974 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.974 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:17:29.974 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:29.974 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:17:29.974 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:17:29.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:29.975 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:17:30.021 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:17:30.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:30.023 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:17:30.073 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:17:30.073 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:17:30.074 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:17:30.074 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:17:30.074 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:17:30.074 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:17:30.074 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:17:30.075 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:17:30.075 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:17:30.075 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:17:30.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:30.076 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:17:30.076 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:17:30.076 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:17:30.077 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:17:30.077 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:17:30.077 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:17:30.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:30.147 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:17:30.199 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:17:30.200 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:17:30.200 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:17:30.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:30.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:17:30.258 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:17:30.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:17:30.259 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:30.307 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:17:30.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:17:30.307 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:30.354 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:17:30.403 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:17:30.404 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:17:30.404 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:17:30.404 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:17:30.404 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:17:30.405 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:17:30.405 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:17:30.405 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:17:30.405 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:17:30.405 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:17:30.405 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:17:30.406 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:17:30.406 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:17:30.406 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:17:30.406 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:17:30.406 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:17:30.407 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:17:30.407 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:17:30.407 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:17:30.407 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:17:30.408 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:17:30.408 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:17:30.408 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:17:30.408 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:17:30.408 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:17:30.409 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:17:30.409 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:17:30.409 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:17:30.409 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:17:30.409 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:30.409 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:30.410 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:30.410 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:30.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:30.411 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:17:30.458 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:17:30.459 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:17:30.503 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:17:30.510 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:17:30.510 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:17:30.510 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:17:30.510 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:17:30.511 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:17:30.511 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:17:30.511 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:17:30.511 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:17:30.512 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:17:30.512 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:17:30.512 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:17:30.512 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:17:30.512 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:17:30.513 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:17:30.513 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:17:30.513 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:17:30.513 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:17:30.513 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:17:30.514 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:17:30.514 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:17:30.514 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:17:30.514 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:17:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:17:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:17:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:17:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:17:30.515 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:17:30.516 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:17:30.516 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:17:30.516 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:30.516 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:30.516 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:30.517 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:30.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:30.518 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:17:30.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:17:30.584+0000 7ff36d447580 -1 init, newargv = 0x5622fa4a5600 newargc=15 2023-10-25T16:17:30.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34597]: starting ceph client 2023-10-25T16:17:30.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34597]: starting fuse 2023-10-25T16:17:30.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:17:30.923 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:17:31.672 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:17:31.679 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:17:31.680 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:17:31.680 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:17:31.680 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:17:31.680 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:17:31.680 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:17:31.681 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:17:31.681 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:17:31.681 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:17:31.681 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:17:31.681 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:17:31.682 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:17:31.682 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:17:31.682 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:17:31.682 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:17:31.682 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:17:31.683 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:17:31.683 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:17:31.683 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:17:31.683 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:17:31.683 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:17:31.683 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:17:31.684 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:17:31.684 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:17:31.684 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:17:31.684 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:17:31.684 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:17:31.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:17:31.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:17:31.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:31.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:17:31.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:31.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:17:31.686 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:31.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:31.687 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:17:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:17:31.735 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:17:31.736 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:17:31.736 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:17:31.736 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:17:31.737 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:17:31.737 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:17:31.738 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:17:31.738 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:17:31.738 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:17:31.739 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:17:31.740 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:17:31.740 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:17:31.740 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:17:31.741 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:17:31.741 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:17:31.741 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:17:31.742 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:17:31.742 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:17:31.742 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:17:31.743 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:17:31.743 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:17:31.744 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:17:31.744 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:17:31.744 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:17:31.745 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:17:31.745 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:17:31.745 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:17:31.746 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:17:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.34597.asok 2023-10-25T16:17:31.867 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:31.875 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34597.asok 2023-10-25T16:17:31.875 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:31.876 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.34597.asok status 2023-10-25T16:17:31.968 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:32.070 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:17:32.070 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:17:32.070 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:17:32.070 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:17:32.071 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:17:32.071 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:17:32.071 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:17:32.071 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "34597", 2023-10-25T16:17:32.071 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:17:32.072 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:17:32.072 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:17:32.072 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:17:32.072 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 5752, 2023-10-25T16:17:32.072 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:17:32.073 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:17:32.073 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:17:32.073 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 5752 2023-10-25T16:17:32.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:17:32.073 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:17:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:17:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:17:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 482975108 2023-10-25T16:17:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:17:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:17:32.074 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:17:32.075 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:17:32.075 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:17:32.075 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 482975108 2023-10-25T16:17:32.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:17:32.075 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.5752 192.168.0.1:0/482975108", 2023-10-25T16:17:32.076 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/482975108", 2023-10-25T16:17:32.076 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:17:32.076 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 31, 2023-10-25T16:17:32.076 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 87, 2023-10-25T16:17:32.076 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:17:32.077 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:17:32.077 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:17:32.077 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:17:32.082 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:32.089 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:32.090 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:17:32.090 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:32.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:32.139 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:17:32.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:32.145 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:32.146 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:32.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:17:32.189 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:32.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:17:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:32.196 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:17:32.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- 172.21.15.177:0/3542259500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70300039b0 msgr2=0x7f7030003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:32.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 --2- 172.21.15.177:0/3542259500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70300039b0 0x7f7030003dd0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7038009b30 tx=0x7f703801d1c0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f7046d9d640 1 -- 172.21.15.177:0/3542259500 reap_dead start 2023-10-25T16:17:32.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- 172.21.15.177:0/3542259500 shutdown_connections 2023-10-25T16:17:32.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- 172.21.15.177:0/3542259500 >> 172.21.15.177:0/3542259500 conn(0x7f70480afc40 msgr2=0x7f70480b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:32.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- 172.21.15.177:0/3542259500 shutdown_connections 2023-10-25T16:17:32.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- 172.21.15.177:0/3542259500 wait complete. 2023-10-25T16:17:32.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 Processor -- start 2023-10-25T16:17:32.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- start start 2023-10-25T16:17:32.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300039b0 0x7f70480aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:32.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 0x7f7048155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:32.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70480ae810 0x7f70480aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:32.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480af1d0 con 0x7f7048140b50 2023-10-25T16:17:32.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480abc80 con 0x7f70480ae810 2023-10-25T16:17:32.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f704cf7c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480ab100 con 0x7f70300039b0 2023-10-25T16:17:32.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f7045d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 0x7f7048155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:32.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f7045d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 0x7f7048155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:46688/0 (socket says 172.21.15.177:46688) 2023-10-25T16:17:32.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.329+0000 7f7045d9b640 1 -- 172.21.15.177:0/466954851 learned_addr learned my addr 172.21.15.177:0/466954851 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:32.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f704659c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300039b0 0x7f70480aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:32.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7046d9d640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70480ae810 0x7f70480aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:32.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7045d9b640 1 -- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300039b0 msgr2=0x7f70480aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:32.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7045d9b640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300039b0 0x7f70480aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7045d9b640 1 -- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70480ae810 msgr2=0x7f70480aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:32.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7045d9b640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70480ae810 0x7f70480aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7045d9b640 1 -- 172.21.15.177:0/466954851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480ab3e0 con 0x7f7048140b50 2023-10-25T16:17:32.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7045d9b640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 0x7f7048155e20 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d5a0 tx=0x7f703c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:32.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c012630 con 0x7f7048140b50 2023-10-25T16:17:32.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f703c012790 con 0x7f7048140b50 2023-10-25T16:17:32.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70480ab6c0 con 0x7f7048140b50 2023-10-25T16:17:32.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c012be0 con 0x7f7048140b50 2023-10-25T16:17:32.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70480aadf0 con 0x7f7048140b50 2023-10-25T16:17:32.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7048066b20 con 0x7f7048140b50 2023-10-25T16:17:32.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f703c012d40 con 0x7f7048140b50 2023-10-25T16:17:32.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7036ffd640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7028066470 0x7f7028068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:32.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f703c083d30 con 0x7f7048140b50 2023-10-25T16:17:32.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f704659c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7028066470 0x7f7028068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:32.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.333+0000 7f704659c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7028066470 0x7f7028068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f70380ae000 tx=0x7f7038019f60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:32.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.337+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f703c0511b0 con 0x7f7048140b50 2023-10-25T16:17:32.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.521+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f704804daf0 con 0x7f7048140b50 2023-10-25T16:17:32.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.521+0000 7f7036ffd640 1 -- 172.21.15.177:0/466954851 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f703c0547d0 con 0x7f7048140b50 2023-10-25T16:17:32.527 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:17:32.528 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:17:32.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7028066470 msgr2=0x7f7028068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:32.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7028066470 0x7f7028068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f70380ae000 tx=0x7f7038019f60 comp rx=0 tx=0).stop 2023-10-25T16:17:32.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 msgr2=0x7f7048155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:32.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 0x7f7048155e20 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f703c00d5a0 tx=0x7f703c00da60 comp rx=0 tx=0).stop 2023-10-25T16:17:32.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 shutdown_connections 2023-10-25T16:17:32.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7028066470 0x7f7028068930 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70480ae810 0x7f70480aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7048140b50 0x7f7048155e20 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 --2- 172.21.15.177:0/466954851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70300039b0 0x7f70480aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:32.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 >> 172.21.15.177:0/466954851 conn(0x7f70480afc40 msgr2=0x7f7048069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:32.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 shutdown_connections 2023-10-25T16:17:32.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:32.525+0000 7f704cf7c640 1 -- 172.21.15.177:0/466954851 wait complete. 2023-10-25T16:17:32.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:17:32.693 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155189,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.796364638,"mdsmap_epoch":31,"osdmap_epoch":87,"osdmap_epoch_barrier":87,"uptime":20.437793395} 2023-10-25T16:17:32.694 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155189, "mdsmap_epoch": 31, "osdmap_epoch": 87, "osdmap_epoch_barrier": 87, "rank_uptime": 14.796364638, "state": "up:active", "uptime": 20.437793395, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:17:32.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:17:32.832 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:17:32.832 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:17:32.833 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-25T16:17:32.957 INFO:teuthology.orchestra.run.smithi177.stdout:{"mon_tick_interval":"5"} 2023-10-25T16:17:32.958 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-25T16:17:32.958 INFO:tasks.cephfs.test_full:pool capacity 557012544, 531MB should be enough to fill it 2023-10-25T16:17:32.959 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:17:32.959 DEBUG:teuthology.orchestra.run.smithi177:> import time 2023-10-25T16:17:32.959 DEBUG:teuthology.orchestra.run.smithi177:> import datetime 2023-10-25T16:17:32.960 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:17:32.960 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:17:32.960 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.961 DEBUG:teuthology.orchestra.run.smithi177:> # Write some buffered data through before going full, all should be well 2023-10-25T16:17:32.961 DEBUG:teuthology.orchestra.run.smithi177:> print("writing some data through which we expect to succeed") 2023-10-25T16:17:32.961 DEBUG:teuthology.orchestra.run.smithi177:> bytes = 0 2023-10-25T16:17:32.962 DEBUG:teuthology.orchestra.run.smithi177:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-25T16:17:32.962 DEBUG:teuthology.orchestra.run.smithi177:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-25T16:17:32.963 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-25T16:17:32.963 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:17:32.963 DEBUG:teuthology.orchestra.run.smithi177:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-25T16:17:32.964 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.964 DEBUG:teuthology.orchestra.run.smithi177:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-25T16:17:32.964 DEBUG:teuthology.orchestra.run.smithi177:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-25T16:17:32.965 DEBUG:teuthology.orchestra.run.smithi177:> # buffered IO, the error should always only appear from fsync and not 2023-10-25T16:17:32.965 DEBUG:teuthology.orchestra.run.smithi177:> # from write 2023-10-25T16:17:32.965 DEBUG:teuthology.orchestra.run.smithi177:> full = False 2023-10-25T16:17:32.965 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.966 DEBUG:teuthology.orchestra.run.smithi177:> for n in range(0, int(531 * 1.1)): 2023-10-25T16:17:32.966 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:17:32.967 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-25T16:17:32.967 DEBUG:teuthology.orchestra.run.smithi177:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-25T16:17:32.967 DEBUG:teuthology.orchestra.run.smithi177:> except OSError as e: 2023-10-25T16:17:32.968 DEBUG:teuthology.orchestra.run.smithi177:> if True: 2023-10-25T16:17:32.968 DEBUG:teuthology.orchestra.run.smithi177:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-25T16:17:32.968 DEBUG:teuthology.orchestra.run.smithi177:> raise 2023-10-25T16:17:32.968 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:17:32.969 DEBUG:teuthology.orchestra.run.smithi177:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-25T16:17:32.969 DEBUG:teuthology.orchestra.run.smithi177:> full = True 2023-10-25T16:17:32.969 DEBUG:teuthology.orchestra.run.smithi177:> break 2023-10-25T16:17:32.970 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.970 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:17:32.971 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:17:32.971 DEBUG:teuthology.orchestra.run.smithi177:> print("fsync'"'"'ed successfully") 2023-10-25T16:17:32.971 DEBUG:teuthology.orchestra.run.smithi177:> except OSError as e: 2023-10-25T16:17:32.972 DEBUG:teuthology.orchestra.run.smithi177:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-25T16:17:32.972 DEBUG:teuthology.orchestra.run.smithi177:> full = True 2023-10-25T16:17:32.972 DEBUG:teuthology.orchestra.run.smithi177:> break 2023-10-25T16:17:32.972 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:17:32.973 DEBUG:teuthology.orchestra.run.smithi177:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-25T16:17:32.973 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.973 DEBUG:teuthology.orchestra.run.smithi177:> if n > 531 * 0.9: 2023-10-25T16:17:32.974 DEBUG:teuthology.orchestra.run.smithi177:> # Be cautious in the last region where we expect to hit 2023-10-25T16:17:32.974 DEBUG:teuthology.orchestra.run.smithi177:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-25T16:17:32.975 DEBUG:teuthology.orchestra.run.smithi177:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-25T16:17:32.975 DEBUG:teuthology.orchestra.run.smithi177:> time.sleep(15.0) 2023-10-25T16:17:32.975 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.975 DEBUG:teuthology.orchestra.run.smithi177:> if not full: 2023-10-25T16:17:32.976 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-25T16:17:32.976 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.977 DEBUG:teuthology.orchestra.run.smithi177:> # close() should not raise an error because we already caught it in 2023-10-25T16:17:32.977 DEBUG:teuthology.orchestra.run.smithi177:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-25T16:17:32.977 DEBUG:teuthology.orchestra.run.smithi177:> # since then because all IOs got cancelled on the full flag. 2023-10-25T16:17:32.977 DEBUG:teuthology.orchestra.run.smithi177:> print("calling close") 2023-10-25T16:17:32.978 DEBUG:teuthology.orchestra.run.smithi177:> os.close(f) 2023-10-25T16:17:32.978 DEBUG:teuthology.orchestra.run.smithi177:> print("close() did not raise error") 2023-10-25T16:17:32.978 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:17:32.979 DEBUG:teuthology.orchestra.run.smithi177:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-25T16:17:32.979 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:17:38.042 INFO:teuthology.orchestra.run.smithi177.stdout:writing some data through which we expect to succeed 2023-10-25T16:17:38.043 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-25T16:17:38.043 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.043 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.043 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 1.00 MB 2023-10-25T16:17:38.044 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.044 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.044 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 2.00 MB 2023-10-25T16:17:38.044 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.044 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.045 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 3.00 MB 2023-10-25T16:17:38.045 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.045 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.045 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 4.00 MB 2023-10-25T16:17:38.045 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.046 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.046 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 5.00 MB 2023-10-25T16:17:38.046 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.046 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.046 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 6.00 MB 2023-10-25T16:17:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 7.00 MB 2023-10-25T16:17:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.048 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 8.00 MB 2023-10-25T16:17:38.048 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.048 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.048 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 9.00 MB 2023-10-25T16:17:38.048 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 10.00 MB 2023-10-25T16:17:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 11.00 MB 2023-10-25T16:17:38.050 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.050 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.050 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 12.00 MB 2023-10-25T16:17:38.050 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.050 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.051 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 13.00 MB 2023-10-25T16:17:38.051 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.051 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.051 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 14.00 MB 2023-10-25T16:17:38.051 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.052 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.052 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 15.00 MB 2023-10-25T16:17:38.052 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.052 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.052 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 16.00 MB 2023-10-25T16:17:38.053 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.053 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.053 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 17.00 MB 2023-10-25T16:17:38.053 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.053 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.054 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 18.00 MB 2023-10-25T16:17:38.054 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.054 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.054 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 19.00 MB 2023-10-25T16:17:38.054 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.055 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.055 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 20.00 MB 2023-10-25T16:17:38.055 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.055 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.055 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 21.00 MB 2023-10-25T16:17:38.055 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.056 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.056 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 22.00 MB 2023-10-25T16:17:38.056 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.056 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.056 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 23.00 MB 2023-10-25T16:17:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 24.00 MB 2023-10-25T16:17:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 25.00 MB 2023-10-25T16:17:38.058 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.058 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.058 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 26.00 MB 2023-10-25T16:17:38.058 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.058 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.059 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 27.00 MB 2023-10-25T16:17:38.059 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.059 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.059 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 28.00 MB 2023-10-25T16:17:38.059 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.060 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.060 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 29.00 MB 2023-10-25T16:17:38.060 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.060 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.061 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 30.00 MB 2023-10-25T16:17:38.061 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.061 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.061 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 31.00 MB 2023-10-25T16:17:38.061 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.062 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.062 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 32.00 MB 2023-10-25T16:17:38.062 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.062 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.062 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 33.00 MB 2023-10-25T16:17:38.063 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.063 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.063 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 34.00 MB 2023-10-25T16:17:38.063 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.063 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.064 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 35.00 MB 2023-10-25T16:17:38.064 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.064 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.064 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 36.00 MB 2023-10-25T16:17:38.064 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 37.00 MB 2023-10-25T16:17:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 38.00 MB 2023-10-25T16:17:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.066 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.066 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 39.00 MB 2023-10-25T16:17:38.066 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.066 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.066 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 40.00 MB 2023-10-25T16:17:38.067 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.067 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.067 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 41.00 MB 2023-10-25T16:17:38.067 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.067 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.068 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 42.00 MB 2023-10-25T16:17:38.068 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.068 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.068 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 43.00 MB 2023-10-25T16:17:38.069 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.069 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.069 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 44.00 MB 2023-10-25T16:17:38.069 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.069 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.069 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 45.00 MB 2023-10-25T16:17:38.070 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.070 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.070 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 46.00 MB 2023-10-25T16:17:38.070 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.070 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.071 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 47.00 MB 2023-10-25T16:17:38.071 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.071 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.071 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 48.00 MB 2023-10-25T16:17:38.071 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.072 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.072 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 49.00 MB 2023-10-25T16:17:38.072 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.072 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.072 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 50.00 MB 2023-10-25T16:17:38.073 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.073 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.073 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 51.00 MB 2023-10-25T16:17:38.073 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.073 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.074 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 52.00 MB 2023-10-25T16:17:38.074 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.074 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.074 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 53.00 MB 2023-10-25T16:17:38.074 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.075 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.075 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 54.00 MB 2023-10-25T16:17:38.075 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.075 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 55.00 MB 2023-10-25T16:17:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 56.00 MB 2023-10-25T16:17:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 57.00 MB 2023-10-25T16:17:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 58.00 MB 2023-10-25T16:17:38.078 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.078 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.078 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 59.00 MB 2023-10-25T16:17:38.078 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.078 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.079 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 60.00 MB 2023-10-25T16:17:38.079 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.079 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.079 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 61.00 MB 2023-10-25T16:17:38.079 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.079 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.080 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 62.00 MB 2023-10-25T16:17:38.080 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.080 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.080 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 63.00 MB 2023-10-25T16:17:38.080 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.081 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.081 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 64.00 MB 2023-10-25T16:17:38.081 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.081 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.081 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 65.00 MB 2023-10-25T16:17:38.082 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.082 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.082 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 66.00 MB 2023-10-25T16:17:38.082 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.082 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.083 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 67.00 MB 2023-10-25T16:17:38.083 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.083 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.083 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 68.00 MB 2023-10-25T16:17:38.083 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.084 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.084 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 69.00 MB 2023-10-25T16:17:38.084 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.084 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.084 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 70.00 MB 2023-10-25T16:17:38.085 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.085 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.085 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 71.00 MB 2023-10-25T16:17:38.085 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.085 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.086 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 72.00 MB 2023-10-25T16:17:38.086 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.086 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.086 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 73.00 MB 2023-10-25T16:17:38.086 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.087 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.087 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 74.00 MB 2023-10-25T16:17:38.087 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.087 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.087 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 75.00 MB 2023-10-25T16:17:38.087 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.088 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.088 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 76.00 MB 2023-10-25T16:17:38.088 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.088 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.088 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 77.00 MB 2023-10-25T16:17:38.089 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.089 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.089 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 78.00 MB 2023-10-25T16:17:38.089 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.089 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.090 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 79.00 MB 2023-10-25T16:17:38.090 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.090 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.090 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 80.00 MB 2023-10-25T16:17:38.842 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.842 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.842 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 81.00 MB 2023-10-25T16:17:38.843 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.843 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.843 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 82.00 MB 2023-10-25T16:17:38.843 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.844 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.844 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 83.00 MB 2023-10-25T16:17:38.844 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.844 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.844 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 84.00 MB 2023-10-25T16:17:38.844 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.845 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.845 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 85.00 MB 2023-10-25T16:17:38.845 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.845 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.846 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 86.00 MB 2023-10-25T16:17:38.846 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.846 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.846 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 87.00 MB 2023-10-25T16:17:38.847 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.847 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.847 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 88.00 MB 2023-10-25T16:17:38.847 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.847 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.848 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 89.00 MB 2023-10-25T16:17:38.848 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.848 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.848 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 90.00 MB 2023-10-25T16:17:38.849 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.849 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.849 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 91.00 MB 2023-10-25T16:17:38.849 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.849 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.850 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 92.00 MB 2023-10-25T16:17:38.850 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.850 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.850 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 93.00 MB 2023-10-25T16:17:38.850 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.850 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.851 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 94.00 MB 2023-10-25T16:17:38.851 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.851 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.851 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 95.00 MB 2023-10-25T16:17:38.851 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.852 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.852 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 96.00 MB 2023-10-25T16:17:38.852 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.852 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.852 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 97.00 MB 2023-10-25T16:17:38.852 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.853 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.853 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 98.00 MB 2023-10-25T16:17:38.853 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.853 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.853 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 99.00 MB 2023-10-25T16:17:38.854 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.854 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.854 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 100.00 MB 2023-10-25T16:17:38.854 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.854 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.855 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 101.00 MB 2023-10-25T16:17:38.855 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.855 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.855 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 102.00 MB 2023-10-25T16:17:38.855 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.855 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.856 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 103.00 MB 2023-10-25T16:17:38.856 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.856 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.856 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 104.00 MB 2023-10-25T16:17:38.856 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.857 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.857 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 105.00 MB 2023-10-25T16:17:38.857 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.857 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.857 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 106.00 MB 2023-10-25T16:17:38.858 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.858 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.858 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 107.00 MB 2023-10-25T16:17:38.858 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.861 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.861 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 108.00 MB 2023-10-25T16:17:38.861 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 109.00 MB 2023-10-25T16:17:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 110.00 MB 2023-10-25T16:17:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 111.00 MB 2023-10-25T16:17:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 112.00 MB 2023-10-25T16:17:38.864 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.864 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.864 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 113.00 MB 2023-10-25T16:17:38.864 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.864 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.865 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 114.00 MB 2023-10-25T16:17:38.865 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.865 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.865 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 115.00 MB 2023-10-25T16:17:38.865 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.865 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.866 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 116.00 MB 2023-10-25T16:17:38.866 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.866 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.866 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 117.00 MB 2023-10-25T16:17:38.866 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.867 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.867 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 118.00 MB 2023-10-25T16:17:38.867 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.867 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.867 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 119.00 MB 2023-10-25T16:17:38.868 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.868 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.868 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 120.00 MB 2023-10-25T16:17:38.868 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.868 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.868 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 121.00 MB 2023-10-25T16:17:38.869 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.869 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.869 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 122.00 MB 2023-10-25T16:17:38.869 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.869 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.870 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 123.00 MB 2023-10-25T16:17:38.870 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.870 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.870 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 124.00 MB 2023-10-25T16:17:38.870 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.871 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.871 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 125.00 MB 2023-10-25T16:17:38.871 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.871 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.871 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 126.00 MB 2023-10-25T16:17:38.871 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.872 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.872 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 127.00 MB 2023-10-25T16:17:38.872 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.872 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.872 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 128.00 MB 2023-10-25T16:17:38.873 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.873 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.873 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 129.00 MB 2023-10-25T16:17:38.873 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.873 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.874 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 130.00 MB 2023-10-25T16:17:38.874 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.874 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.874 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 131.00 MB 2023-10-25T16:17:38.874 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.874 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.875 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 132.00 MB 2023-10-25T16:17:38.875 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.875 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.875 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 133.00 MB 2023-10-25T16:17:38.875 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.876 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.876 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 134.00 MB 2023-10-25T16:17:38.876 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.876 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.876 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 135.00 MB 2023-10-25T16:17:38.877 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.877 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.877 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 136.00 MB 2023-10-25T16:17:38.877 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.877 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.877 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 137.00 MB 2023-10-25T16:17:38.878 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.878 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.878 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 138.00 MB 2023-10-25T16:17:38.878 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.878 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.879 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 139.00 MB 2023-10-25T16:17:38.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.879 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.879 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 140.00 MB 2023-10-25T16:17:38.879 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.880 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.880 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 141.00 MB 2023-10-25T16:17:38.880 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.880 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.880 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 142.00 MB 2023-10-25T16:17:38.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.881 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.881 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 143.00 MB 2023-10-25T16:17:38.881 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.881 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.882 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 144.00 MB 2023-10-25T16:17:38.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.882 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.882 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 145.00 MB 2023-10-25T16:17:38.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.883 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.883 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 146.00 MB 2023-10-25T16:17:38.883 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.883 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.883 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 147.00 MB 2023-10-25T16:17:38.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.884 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.884 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 148.00 MB 2023-10-25T16:17:38.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.884 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.884 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 149.00 MB 2023-10-25T16:17:38.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.885 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.885 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 150.00 MB 2023-10-25T16:17:38.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.885 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.886 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 151.00 MB 2023-10-25T16:17:38.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.886 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.886 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 152.00 MB 2023-10-25T16:17:38.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.887 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.887 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 153.00 MB 2023-10-25T16:17:38.887 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.887 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.887 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 154.00 MB 2023-10-25T16:17:38.887 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.888 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.888 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 155.00 MB 2023-10-25T16:17:38.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.888 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.888 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 156.00 MB 2023-10-25T16:17:38.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.889 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.889 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 157.00 MB 2023-10-25T16:17:38.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.889 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.889 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 158.00 MB 2023-10-25T16:17:38.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.890 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.890 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 159.00 MB 2023-10-25T16:17:38.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:38.890 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:38.891 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 160.00 MB 2023-10-25T16:17:38.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.618 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.619 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 161.00 MB 2023-10-25T16:17:39.619 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.619 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.619 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 162.00 MB 2023-10-25T16:17:39.620 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.620 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.620 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 163.00 MB 2023-10-25T16:17:39.620 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.621 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.621 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 164.00 MB 2023-10-25T16:17:39.621 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.621 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.621 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 165.00 MB 2023-10-25T16:17:39.622 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.622 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.622 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 166.00 MB 2023-10-25T16:17:39.622 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.623 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.623 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 167.00 MB 2023-10-25T16:17:39.623 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.623 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.623 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 168.00 MB 2023-10-25T16:17:39.624 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.624 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.624 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 169.00 MB 2023-10-25T16:17:39.624 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.624 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.625 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 170.00 MB 2023-10-25T16:17:39.625 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.625 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.625 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 171.00 MB 2023-10-25T16:17:39.625 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.626 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.626 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 172.00 MB 2023-10-25T16:17:39.626 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.626 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.627 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 173.00 MB 2023-10-25T16:17:39.627 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.627 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.627 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 174.00 MB 2023-10-25T16:17:39.627 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.628 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.628 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 175.00 MB 2023-10-25T16:17:39.628 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.628 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.629 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 176.00 MB 2023-10-25T16:17:39.629 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.629 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.629 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 177.00 MB 2023-10-25T16:17:39.629 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.630 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.630 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 178.00 MB 2023-10-25T16:17:39.630 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.630 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.630 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 179.00 MB 2023-10-25T16:17:39.631 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.631 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.631 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 180.00 MB 2023-10-25T16:17:39.631 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.632 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.632 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 181.00 MB 2023-10-25T16:17:39.632 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.632 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.632 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 182.00 MB 2023-10-25T16:17:39.633 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.633 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.633 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 183.00 MB 2023-10-25T16:17:39.633 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.633 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.634 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 184.00 MB 2023-10-25T16:17:39.634 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.634 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.634 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 185.00 MB 2023-10-25T16:17:39.635 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.635 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.635 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 186.00 MB 2023-10-25T16:17:39.635 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.635 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.636 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 187.00 MB 2023-10-25T16:17:39.636 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.636 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.636 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 188.00 MB 2023-10-25T16:17:39.636 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.637 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.637 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 189.00 MB 2023-10-25T16:17:39.637 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.637 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.638 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 190.00 MB 2023-10-25T16:17:39.638 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.638 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.638 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 191.00 MB 2023-10-25T16:17:39.638 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.639 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.639 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 192.00 MB 2023-10-25T16:17:39.639 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.639 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.639 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 193.00 MB 2023-10-25T16:17:39.640 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.640 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.640 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 194.00 MB 2023-10-25T16:17:39.640 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 195.00 MB 2023-10-25T16:17:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 196.00 MB 2023-10-25T16:17:39.642 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.642 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.642 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 197.00 MB 2023-10-25T16:17:39.642 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.642 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.643 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 198.00 MB 2023-10-25T16:17:39.643 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.643 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.643 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 199.00 MB 2023-10-25T16:17:39.643 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.644 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.644 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 200.00 MB 2023-10-25T16:17:39.644 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.644 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.645 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 201.00 MB 2023-10-25T16:17:39.645 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.645 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.645 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 202.00 MB 2023-10-25T16:17:39.645 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.646 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.646 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 203.00 MB 2023-10-25T16:17:39.646 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.646 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.646 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 204.00 MB 2023-10-25T16:17:39.647 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.647 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.647 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 205.00 MB 2023-10-25T16:17:39.647 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.647 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.648 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 206.00 MB 2023-10-25T16:17:39.648 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.648 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.648 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 207.00 MB 2023-10-25T16:17:39.649 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.649 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.649 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 208.00 MB 2023-10-25T16:17:39.649 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.649 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.650 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 209.00 MB 2023-10-25T16:17:39.650 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.650 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.650 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 210.00 MB 2023-10-25T16:17:39.650 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.651 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.651 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 211.00 MB 2023-10-25T16:17:39.651 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.651 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.652 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 212.00 MB 2023-10-25T16:17:39.652 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.652 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.652 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 213.00 MB 2023-10-25T16:17:39.652 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.653 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.653 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 214.00 MB 2023-10-25T16:17:39.653 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.653 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.653 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 215.00 MB 2023-10-25T16:17:39.654 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.654 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.654 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 216.00 MB 2023-10-25T16:17:39.654 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.654 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 217.00 MB 2023-10-25T16:17:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 218.00 MB 2023-10-25T16:17:39.655 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 219.00 MB 2023-10-25T16:17:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 220.00 MB 2023-10-25T16:17:39.657 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.657 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.657 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 221.00 MB 2023-10-25T16:17:39.657 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.657 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.658 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 222.00 MB 2023-10-25T16:17:39.658 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.658 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.658 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 223.00 MB 2023-10-25T16:17:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 224.00 MB 2023-10-25T16:17:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.659 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.660 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 225.00 MB 2023-10-25T16:17:39.660 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.660 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.660 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 226.00 MB 2023-10-25T16:17:39.660 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.661 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.661 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 227.00 MB 2023-10-25T16:17:39.661 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.661 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.661 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 228.00 MB 2023-10-25T16:17:39.662 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.662 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.662 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 229.00 MB 2023-10-25T16:17:39.662 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.662 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.663 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 230.00 MB 2023-10-25T16:17:39.663 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.663 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.663 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 231.00 MB 2023-10-25T16:17:39.663 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.664 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.664 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 232.00 MB 2023-10-25T16:17:39.664 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.664 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.664 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 233.00 MB 2023-10-25T16:17:39.665 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.665 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.665 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 234.00 MB 2023-10-25T16:17:39.665 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.666 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.666 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 235.00 MB 2023-10-25T16:17:39.666 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.666 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.666 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 236.00 MB 2023-10-25T16:17:39.667 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.667 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.667 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 237.00 MB 2023-10-25T16:17:39.667 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.667 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.668 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 238.00 MB 2023-10-25T16:17:39.668 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.668 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.668 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 239.00 MB 2023-10-25T16:17:39.668 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.669 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:39.669 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 240.00 MB 2023-10-25T16:17:39.669 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:39.669 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.342 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 241.00 MB 2023-10-25T16:17:40.342 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.342 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.343 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 242.00 MB 2023-10-25T16:17:40.343 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.343 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.343 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 243.00 MB 2023-10-25T16:17:40.343 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.344 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.344 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 244.00 MB 2023-10-25T16:17:40.344 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.344 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.344 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 245.00 MB 2023-10-25T16:17:40.345 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.345 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.345 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 246.00 MB 2023-10-25T16:17:40.345 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.345 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.346 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 247.00 MB 2023-10-25T16:17:40.346 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.346 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.346 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 248.00 MB 2023-10-25T16:17:40.347 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.347 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.347 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 249.00 MB 2023-10-25T16:17:40.347 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.347 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.348 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 250.00 MB 2023-10-25T16:17:40.348 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.348 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.348 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 251.00 MB 2023-10-25T16:17:40.349 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.349 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.349 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 252.00 MB 2023-10-25T16:17:40.349 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.349 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.350 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 253.00 MB 2023-10-25T16:17:40.350 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.350 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.350 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 254.00 MB 2023-10-25T16:17:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 255.00 MB 2023-10-25T16:17:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.352 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 256.00 MB 2023-10-25T16:17:40.352 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.352 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.352 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 257.00 MB 2023-10-25T16:17:40.352 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 258.00 MB 2023-10-25T16:17:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 259.00 MB 2023-10-25T16:17:40.354 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.354 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.354 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 260.00 MB 2023-10-25T16:17:40.354 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.355 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.355 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 261.00 MB 2023-10-25T16:17:40.355 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.355 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.355 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 262.00 MB 2023-10-25T16:17:40.356 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.356 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.356 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 263.00 MB 2023-10-25T16:17:40.356 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 264.00 MB 2023-10-25T16:17:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 265.00 MB 2023-10-25T16:17:40.358 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.358 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.358 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 266.00 MB 2023-10-25T16:17:40.358 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.358 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.359 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 267.00 MB 2023-10-25T16:17:40.359 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.359 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.359 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 268.00 MB 2023-10-25T16:17:40.360 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.360 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.360 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 269.00 MB 2023-10-25T16:17:40.360 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.360 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.361 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 270.00 MB 2023-10-25T16:17:40.361 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.361 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.361 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 271.00 MB 2023-10-25T16:17:40.361 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.362 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.362 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 272.00 MB 2023-10-25T16:17:40.362 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.362 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.363 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 273.00 MB 2023-10-25T16:17:40.363 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.363 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.363 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 274.00 MB 2023-10-25T16:17:40.363 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.364 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.364 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 275.00 MB 2023-10-25T16:17:40.364 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.364 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.364 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 276.00 MB 2023-10-25T16:17:40.365 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.365 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.365 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 277.00 MB 2023-10-25T16:17:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 278.00 MB 2023-10-25T16:17:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.367 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 279.00 MB 2023-10-25T16:17:40.367 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.367 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.367 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 280.00 MB 2023-10-25T16:17:40.367 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.368 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.368 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 281.00 MB 2023-10-25T16:17:40.368 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.368 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.369 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 282.00 MB 2023-10-25T16:17:40.369 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.369 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.369 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 283.00 MB 2023-10-25T16:17:40.369 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.370 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.370 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 284.00 MB 2023-10-25T16:17:40.370 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.370 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.370 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 285.00 MB 2023-10-25T16:17:40.371 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.371 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.371 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 286.00 MB 2023-10-25T16:17:40.371 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 287.00 MB 2023-10-25T16:17:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 288.00 MB 2023-10-25T16:17:40.373 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.373 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.373 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 289.00 MB 2023-10-25T16:17:40.373 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.373 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.374 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 290.00 MB 2023-10-25T16:17:40.374 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.374 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.374 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 291.00 MB 2023-10-25T16:17:40.374 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.375 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.375 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 292.00 MB 2023-10-25T16:17:40.375 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.375 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.375 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 293.00 MB 2023-10-25T16:17:40.376 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.376 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.376 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 294.00 MB 2023-10-25T16:17:40.376 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.376 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.377 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 295.00 MB 2023-10-25T16:17:40.377 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.377 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.377 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 296.00 MB 2023-10-25T16:17:40.378 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.378 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.378 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 297.00 MB 2023-10-25T16:17:40.378 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.378 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.379 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 298.00 MB 2023-10-25T16:17:40.379 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.379 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.379 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 299.00 MB 2023-10-25T16:17:40.379 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.380 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.380 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 300.00 MB 2023-10-25T16:17:40.380 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.380 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.380 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 301.00 MB 2023-10-25T16:17:40.381 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.381 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.381 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 302.00 MB 2023-10-25T16:17:40.381 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.381 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.382 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 303.00 MB 2023-10-25T16:17:40.382 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.382 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.382 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 304.00 MB 2023-10-25T16:17:40.383 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.383 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.383 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 305.00 MB 2023-10-25T16:17:40.383 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.383 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.384 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 306.00 MB 2023-10-25T16:17:40.384 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.384 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.384 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 307.00 MB 2023-10-25T16:17:40.384 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.385 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.385 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 308.00 MB 2023-10-25T16:17:40.385 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.385 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.386 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 309.00 MB 2023-10-25T16:17:40.386 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.386 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.386 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 310.00 MB 2023-10-25T16:17:40.386 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.387 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.387 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 311.00 MB 2023-10-25T16:17:40.387 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.387 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.387 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 312.00 MB 2023-10-25T16:17:40.388 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.388 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.388 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 313.00 MB 2023-10-25T16:17:40.388 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.388 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.389 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 314.00 MB 2023-10-25T16:17:40.389 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.389 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.389 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 315.00 MB 2023-10-25T16:17:40.389 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.390 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.390 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 316.00 MB 2023-10-25T16:17:40.390 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.390 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.391 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 317.00 MB 2023-10-25T16:17:40.391 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.391 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.391 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 318.00 MB 2023-10-25T16:17:40.391 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.392 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.392 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 319.00 MB 2023-10-25T16:17:40.392 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.392 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.392 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 320.00 MB 2023-10-25T16:17:40.393 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:40.393 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:40.393 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 321.00 MB 2023-10-25T16:17:41.061 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.061 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.061 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 322.00 MB 2023-10-25T16:17:41.062 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.062 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.062 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 323.00 MB 2023-10-25T16:17:41.062 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.062 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.063 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 324.00 MB 2023-10-25T16:17:41.063 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.063 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.063 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 325.00 MB 2023-10-25T16:17:41.064 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.064 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.064 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 326.00 MB 2023-10-25T16:17:41.064 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.064 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 327.00 MB 2023-10-25T16:17:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 328.00 MB 2023-10-25T16:17:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.066 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 329.00 MB 2023-10-25T16:17:41.066 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.066 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.066 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 330.00 MB 2023-10-25T16:17:41.066 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.067 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.067 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 331.00 MB 2023-10-25T16:17:41.067 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.067 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.067 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 332.00 MB 2023-10-25T16:17:41.068 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.068 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.068 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 333.00 MB 2023-10-25T16:17:41.068 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.068 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.069 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 334.00 MB 2023-10-25T16:17:41.069 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.069 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.069 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 335.00 MB 2023-10-25T16:17:41.069 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.070 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.070 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 336.00 MB 2023-10-25T16:17:41.070 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.070 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.070 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 337.00 MB 2023-10-25T16:17:41.071 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.071 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.071 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 338.00 MB 2023-10-25T16:17:41.071 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.071 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.072 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 339.00 MB 2023-10-25T16:17:41.072 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.072 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.072 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 340.00 MB 2023-10-25T16:17:41.072 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.072 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.073 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 341.00 MB 2023-10-25T16:17:41.073 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.073 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.073 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 342.00 MB 2023-10-25T16:17:41.073 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.074 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.074 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 343.00 MB 2023-10-25T16:17:41.074 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.074 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.074 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 344.00 MB 2023-10-25T16:17:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 345.00 MB 2023-10-25T16:17:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 346.00 MB 2023-10-25T16:17:41.076 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.076 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.076 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 347.00 MB 2023-10-25T16:17:41.076 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.076 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.077 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 348.00 MB 2023-10-25T16:17:41.077 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.077 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.077 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 349.00 MB 2023-10-25T16:17:41.077 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.078 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.078 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 350.00 MB 2023-10-25T16:17:41.078 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.078 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.078 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 351.00 MB 2023-10-25T16:17:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 352.00 MB 2023-10-25T16:17:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 353.00 MB 2023-10-25T16:17:41.080 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.080 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.080 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 354.00 MB 2023-10-25T16:17:41.080 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.080 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.081 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 355.00 MB 2023-10-25T16:17:41.081 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.081 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.081 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 356.00 MB 2023-10-25T16:17:41.081 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 357.00 MB 2023-10-25T16:17:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 358.00 MB 2023-10-25T16:17:41.083 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.083 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.083 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 359.00 MB 2023-10-25T16:17:41.083 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.083 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.084 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 360.00 MB 2023-10-25T16:17:41.084 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.084 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.084 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 361.00 MB 2023-10-25T16:17:41.084 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.085 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.085 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 362.00 MB 2023-10-25T16:17:41.085 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.085 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.085 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 363.00 MB 2023-10-25T16:17:41.086 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.086 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.086 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 364.00 MB 2023-10-25T16:17:41.086 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.086 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.086 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 365.00 MB 2023-10-25T16:17:41.087 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.087 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.087 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 366.00 MB 2023-10-25T16:17:41.087 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.087 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.088 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 367.00 MB 2023-10-25T16:17:41.088 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.088 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.088 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 368.00 MB 2023-10-25T16:17:41.088 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.089 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.089 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 369.00 MB 2023-10-25T16:17:41.089 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.089 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.089 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 370.00 MB 2023-10-25T16:17:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 371.00 MB 2023-10-25T16:17:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 372.00 MB 2023-10-25T16:17:41.091 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.091 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.091 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 373.00 MB 2023-10-25T16:17:41.091 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.091 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.092 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 374.00 MB 2023-10-25T16:17:41.092 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.092 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.092 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 375.00 MB 2023-10-25T16:17:41.092 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.093 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.093 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 376.00 MB 2023-10-25T16:17:41.093 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.093 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.093 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 377.00 MB 2023-10-25T16:17:41.093 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.094 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.094 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 378.00 MB 2023-10-25T16:17:41.094 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.094 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.094 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 379.00 MB 2023-10-25T16:17:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 380.00 MB 2023-10-25T16:17:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 381.00 MB 2023-10-25T16:17:41.096 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.096 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.096 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 382.00 MB 2023-10-25T16:17:41.096 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.096 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.097 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 383.00 MB 2023-10-25T16:17:41.097 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.097 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.097 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 384.00 MB 2023-10-25T16:17:41.097 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.098 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.098 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 385.00 MB 2023-10-25T16:17:41.098 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.098 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.098 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 386.00 MB 2023-10-25T16:17:41.098 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.099 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.099 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 387.00 MB 2023-10-25T16:17:41.099 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.099 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.099 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 388.00 MB 2023-10-25T16:17:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 389.00 MB 2023-10-25T16:17:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.100 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 390.00 MB 2023-10-25T16:17:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 391.00 MB 2023-10-25T16:17:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 392.00 MB 2023-10-25T16:17:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 393.00 MB 2023-10-25T16:17:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.103 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.103 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 394.00 MB 2023-10-25T16:17:41.103 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.103 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.103 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 395.00 MB 2023-10-25T16:17:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 396.00 MB 2023-10-25T16:17:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.104 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 397.00 MB 2023-10-25T16:17:41.105 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.105 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.105 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 398.00 MB 2023-10-25T16:17:41.105 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.105 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.105 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 399.00 MB 2023-10-25T16:17:41.106 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.106 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.106 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 400.00 MB 2023-10-25T16:17:41.106 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:41.106 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:41.107 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 401.00 MB 2023-10-25T16:17:42.797 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:17:42.797+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-25T16:17:52.632 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:17:52.633+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-25T16:17:56.882 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.883 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.883 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 402.00 MB 2023-10-25T16:17:56.883 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.883 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.884 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 403.00 MB 2023-10-25T16:17:56.884 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.884 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.884 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 404.00 MB 2023-10-25T16:17:56.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.885 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.885 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 405.00 MB 2023-10-25T16:17:56.885 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.885 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.885 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 406.00 MB 2023-10-25T16:17:56.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.886 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.886 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 407.00 MB 2023-10-25T16:17:56.886 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.886 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.887 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 408.00 MB 2023-10-25T16:17:56.887 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.887 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.887 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 409.00 MB 2023-10-25T16:17:56.887 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.888 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.888 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 410.00 MB 2023-10-25T16:17:56.888 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.888 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.888 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 411.00 MB 2023-10-25T16:17:56.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.889 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.889 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 412.00 MB 2023-10-25T16:17:56.889 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.889 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 413.00 MB 2023-10-25T16:17:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 414.00 MB 2023-10-25T16:17:56.890 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 415.00 MB 2023-10-25T16:17:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.891 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 416.00 MB 2023-10-25T16:17:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 417.00 MB 2023-10-25T16:17:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 418.00 MB 2023-10-25T16:17:56.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.893 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.893 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 419.00 MB 2023-10-25T16:17:56.893 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.893 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.894 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 420.00 MB 2023-10-25T16:17:56.894 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.894 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.894 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 421.00 MB 2023-10-25T16:17:56.894 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.895 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.895 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 422.00 MB 2023-10-25T16:17:56.895 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.895 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.895 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 423.00 MB 2023-10-25T16:17:56.896 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.896 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.896 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 424.00 MB 2023-10-25T16:17:56.897 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.898 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.898 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 425.00 MB 2023-10-25T16:17:56.898 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.899 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.899 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 426.00 MB 2023-10-25T16:17:56.899 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.899 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.899 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 427.00 MB 2023-10-25T16:17:56.901 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.901 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.901 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 428.00 MB 2023-10-25T16:17:56.902 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.902 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.902 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 429.00 MB 2023-10-25T16:17:56.902 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.902 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.903 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 430.00 MB 2023-10-25T16:17:56.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.903 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.903 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 431.00 MB 2023-10-25T16:17:56.903 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.903 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.904 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 432.00 MB 2023-10-25T16:17:56.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.904 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.904 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 433.00 MB 2023-10-25T16:17:56.904 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.905 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.905 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 434.00 MB 2023-10-25T16:17:56.905 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.905 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.905 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 435.00 MB 2023-10-25T16:17:56.906 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.906 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.906 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 436.00 MB 2023-10-25T16:17:56.906 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.906 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.907 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 437.00 MB 2023-10-25T16:17:56.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.907 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.907 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 438.00 MB 2023-10-25T16:17:56.907 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.907 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.908 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 439.00 MB 2023-10-25T16:17:56.908 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.908 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.908 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 440.00 MB 2023-10-25T16:17:56.908 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 441.00 MB 2023-10-25T16:17:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 442.00 MB 2023-10-25T16:17:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 443.00 MB 2023-10-25T16:17:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.911 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 444.00 MB 2023-10-25T16:17:56.911 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.911 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.911 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 445.00 MB 2023-10-25T16:17:56.911 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.912 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.912 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 446.00 MB 2023-10-25T16:17:56.912 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.912 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.912 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 447.00 MB 2023-10-25T16:17:56.913 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.913 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.913 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 448.00 MB 2023-10-25T16:17:56.913 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.913 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.914 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 449.00 MB 2023-10-25T16:17:56.914 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.914 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.914 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 450.00 MB 2023-10-25T16:17:56.914 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.915 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.915 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 451.00 MB 2023-10-25T16:17:56.915 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.915 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.915 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 452.00 MB 2023-10-25T16:17:56.915 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.916 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.916 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 453.00 MB 2023-10-25T16:17:56.916 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.916 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.916 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 454.00 MB 2023-10-25T16:17:56.917 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.917 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.917 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 455.00 MB 2023-10-25T16:17:56.917 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.917 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.917 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 456.00 MB 2023-10-25T16:17:56.918 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.918 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.918 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 457.00 MB 2023-10-25T16:17:56.918 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.918 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.919 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 458.00 MB 2023-10-25T16:17:56.919 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.919 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.919 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 459.00 MB 2023-10-25T16:17:56.919 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.920 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.920 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 460.00 MB 2023-10-25T16:17:56.920 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.920 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.920 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 461.00 MB 2023-10-25T16:17:56.920 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.921 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.921 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 462.00 MB 2023-10-25T16:17:56.921 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.921 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.921 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 463.00 MB 2023-10-25T16:17:56.922 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.922 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.922 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 464.00 MB 2023-10-25T16:17:56.922 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.923 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.923 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 465.00 MB 2023-10-25T16:17:56.923 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.923 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.923 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 466.00 MB 2023-10-25T16:17:56.923 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.924 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.924 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 467.00 MB 2023-10-25T16:17:56.924 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.924 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.924 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 468.00 MB 2023-10-25T16:17:56.925 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.925 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.925 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 469.00 MB 2023-10-25T16:17:56.925 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.925 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.926 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 470.00 MB 2023-10-25T16:17:56.926 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.926 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.926 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 471.00 MB 2023-10-25T16:17:56.926 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.927 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.927 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 472.00 MB 2023-10-25T16:17:56.927 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.927 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.927 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 473.00 MB 2023-10-25T16:17:56.927 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.928 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.928 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 474.00 MB 2023-10-25T16:17:56.928 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.928 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.928 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 475.00 MB 2023-10-25T16:17:56.929 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.929 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.929 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 476.00 MB 2023-10-25T16:17:56.929 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.929 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.930 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 477.00 MB 2023-10-25T16:17:56.930 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.930 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.930 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 478.00 MB 2023-10-25T16:17:56.930 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.931 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:17:56.931 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 479.00 MB 2023-10-25T16:17:56.931 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:17:56.931 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:17:56.931 INFO:teuthology.orchestra.run.smithi177.stdout:Reached fullness after 480.00 MB 2023-10-25T16:17:56.931 INFO:teuthology.orchestra.run.smithi177.stdout:calling close 2023-10-25T16:17:56.932 INFO:teuthology.orchestra.run.smithi177.stdout:close() did not raise error 2023-10-25T16:17:56.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:56.933 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:17:56.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:17:57.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:17:57.079 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:17:57.080 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:17:57.080 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:57.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:57.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- 172.21.15.177:0/1149253451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e006c160 msgr2=0x7f05e00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1149253451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e006c160 0x7f05e00cb5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009bc0 tx=0x7f05d801caf0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- 172.21.15.177:0/1149253451 shutdown_connections 2023-10-25T16:17:57.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1149253451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e006c160 0x7f05e00cb5c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1149253451 >> v2:172.21.15.184:3300/0 conn(0x7f05e0140cf0 0x7f05e00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- 172.21.15.177:0/1149253451 >> 172.21.15.177:0/1149253451 conn(0x7f05e00b2450 msgr2=0x7f05e00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:57.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- 172.21.15.177:0/1149253451 shutdown_connections 2023-10-25T16:17:57.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- 172.21.15.177:0/1149253451 wait complete. 2023-10-25T16:17:57.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 Processor -- start 2023-10-25T16:17:57.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- start start 2023-10-25T16:17:57.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 0x7f05e013aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05e006f570 0x7f05e014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e0140cf0 0x7f05e014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0071530 con 0x7f05e006c160 2023-10-25T16:17:57.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00709b0 con 0x7f05e006f570 2023-10-25T16:17:57.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e73b4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0070c90 con 0x7f05e0140cf0 2023-10-25T16:17:57.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 0x7f05e013aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 0x7f05e013aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50592/0 (socket says 172.21.15.177:50592) 2023-10-25T16:17:57.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 -- 172.21.15.177:0/1239892802 learned_addr learned my addr 172.21.15.177:0/1239892802 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:57.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e494f640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05e006f570 0x7f05e014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 -- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e0140cf0 msgr2=0x7f05e014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5951640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e0140cf0 0x7f05e014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e0140cf0 0x7f05e014fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 -- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05e006f570 msgr2=0x7f05e014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05e006f570 0x7f05e014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 -- 172.21.15.177:0/1239892802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8009820 con 0x7f05e006c160 2023-10-25T16:17:57.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e494f640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05e006f570 0x7f05e014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:57.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05e5150640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 0x7f05e013aa60 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e7a0 tx=0x7f05dc00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:57.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.257+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc009590 con 0x7f05e006c160 2023-10-25T16:17:57.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f05dc00cdb0 con 0x7f05e006c160 2023-10-25T16:17:57.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e00717d0 con 0x7f05e006c160 2023-10-25T16:17:57.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc010690 con 0x7f05e006c160 2023-10-25T16:17:57.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e0153650 con 0x7f05e006c160 2023-10-25T16:17:57.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e013ce80 con 0x7f05e006c160 2023-10-25T16:17:57.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05dc0107f0 con 0x7f05e006c160 2023-10-25T16:17:57.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05d5ffb640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f05c4066470 0x7f05c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f05dc014070 con 0x7f05e006c160 2023-10-25T16:17:57.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f05c406e060 con 0x7f05e006c160 2023-10-25T16:17:57.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05e494f640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f05c4066470 0x7f05c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.261+0000 7f05e494f640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f05c4066470 0x7f05c4068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f05e015bac0 tx=0x7f05d0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:57.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.265+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05dc050090 con 0x7f05e006c160 2023-10-25T16:17:57.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.421+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05e013c9b0 con 0x7f05e006c160 2023-10-25T16:17:57.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.421+0000 7f05d5ffb640 1 -- 172.21.15.177:0/1239892802 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16732 (secure 0 0 0) 0x7f05e013c9b0 con 0x7f05e006c160 2023-10-25T16:17:57.422 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:57.422 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":92,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:55.851947+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:57.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f05c4066470 msgr2=0x7f05c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f05c4066470 0x7f05c4068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f05e015bac0 tx=0x7f05d0009040 comp rx=0 tx=0).stop 2023-10-25T16:17:57.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 msgr2=0x7f05e013aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 0x7f05e013aa60 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e7a0 tx=0x7f05dc00ec60 comp rx=0 tx=0).stop 2023-10-25T16:17:57.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 shutdown_connections 2023-10-25T16:17:57.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f05c4066470 0x7f05c4068930 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05e0140cf0 0x7f05e014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05e006f570 0x7f05e014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 --2- 172.21.15.177:0/1239892802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05e006c160 0x7f05e013aa60 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 >> 172.21.15.177:0/1239892802 conn(0x7f05e00b2450 msgr2=0x7f05e0139660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:57.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 shutdown_connections 2023-10-25T16:17:57.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.425+0000 7f05e73b4640 1 -- 172.21.15.177:0/1239892802 wait complete. 2023-10-25T16:17:57.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:17:15.299639+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:17:16.230820+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:17:57.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:17:57.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/2050939771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 msgr2=0x7fa7c00adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/2050939771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 0x7fa7c00adeb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009840 tx=0x7fa7a801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/2050939771 shutdown_connections 2023-10-25T16:17:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/2050939771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 0x7fa7c00adeb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/2050939771 >> 172.21.15.177:0/2050939771 conn(0x7fa7c00983a0 msgr2=0x7fa7c00cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/2050939771 shutdown_connections 2023-10-25T16:17:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/2050939771 wait complete. 2023-10-25T16:17:57.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 Processor -- start 2023-10-25T16:17:57.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- start start 2023-10-25T16:17:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7c00b0280 0x7fa7c0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 0x7fa7c00c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 0x7fa7c00b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0155070 con 0x7fa7c015ca70 2023-10-25T16:17:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0155520 con 0x7fa7c00cc0a0 2023-10-25T16:17:57.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c6bcc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c00b2e90 con 0x7fa7c00b0280 2023-10-25T16:17:57.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 0x7fa7c00b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 0x7fa7c00b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50606/0 (socket says 172.21.15.177:50606) 2023-10-25T16:17:57.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 -- 172.21.15.177:0/1780011615 learned_addr learned my addr 172.21.15.177:0/1780011615 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:57.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7bffff640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 0x7fa7c00c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c4968640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7c00b0280 0x7fa7c0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 -- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7c00b0280 msgr2=0x7fa7c0154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7c00b0280 0x7fa7c0154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 -- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 msgr2=0x7fa7c00c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 0x7fa7c00c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 -- 172.21.15.177:0/1780011615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80094a0 con 0x7fa7c015ca70 2023-10-25T16:17:57.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c4968640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7c00b0280 0x7fa7c0154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:57.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.569+0000 7fa7c5169640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 0x7fa7c00b4210 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c430 tx=0x7fa7b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:57.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005220 con 0x7fa7c015ca70 2023-10-25T16:17:57.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c00b3170 con 0x7fa7c015ca70 2023-10-25T16:17:57.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa7b0005470 con 0x7fa7c015ca70 2023-10-25T16:17:57.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007290 con 0x7fa7c015ca70 2023-10-25T16:17:57.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c00b3730 con 0x7fa7c015ca70 2023-10-25T16:17:57.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c004daf0 con 0x7fa7c015ca70 2023-10-25T16:17:57.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa7b00073f0 con 0x7fa7c015ca70 2023-10-25T16:17:57.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7a0066470 0x7fa7a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa7b0083bd0 con 0x7fa7c015ca70 2023-10-25T16:17:57.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7fa7a006e060 con 0x7fa7c015ca70 2023-10-25T16:17:57.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7c4968640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7a0066470 0x7fa7a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.573+0000 7fa7c4968640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7a0066470 0x7fa7a0068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8001700 tx=0x7fa7b8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:57.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.577+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7b0051010 con 0x7fa7c015ca70 2023-10-25T16:17:57.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.737+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7c0098880 con 0x7fa7c015ca70 2023-10-25T16:17:57.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.737+0000 7fa7bd7fa640 1 -- 172.21.15.177:0/1780011615 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7b0054630 con 0x7fa7c015ca70 2023-10-25T16:17:57.737 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:17:57.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.737+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7a0066470 msgr2=0x7fa7a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.737+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7a0066470 0x7fa7a0068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8001700 tx=0x7fa7b8009040 comp rx=0 tx=0).stop 2023-10-25T16:17:57.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.737+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 msgr2=0x7fa7c00b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.737+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 0x7fa7c00b4210 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c430 tx=0x7fa7b000c8f0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 shutdown_connections 2023-10-25T16:17:57.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa7a0066470 0x7fa7a0068930 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7c015ca70 0x7fa7c00b4210 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7c00cc0a0 0x7fa7c00c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 --2- 172.21.15.177:0/1780011615 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa7c00b0280 0x7fa7c0154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 >> 172.21.15.177:0/1780011615 conn(0x7fa7c00983a0 msgr2=0x7fa7c00ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:57.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 shutdown_connections 2023-10-25T16:17:57.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.741+0000 7fa7c6bcc640 1 -- 172.21.15.177:0/1780011615 wait complete. 2023-10-25T16:17:57.757 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:17:57.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/795037117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a4159360 msgr2=0x7f80a40cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 --2- 172.21.15.177:0/795037117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a4159360 0x7f80a40cc830 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8094009840 tx=0x7f809401c800 comp rx=0 tx=0).stop 2023-10-25T16:17:57.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/795037117 shutdown_connections 2023-10-25T16:17:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 --2- 172.21.15.177:0/795037117 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a40accf0 0x7f80a406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 --2- 172.21.15.177:0/795037117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a4159360 0x7f80a40cc830 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/795037117 >> 172.21.15.177:0/795037117 conn(0x7f80a40af3f0 msgr2=0x7f80a40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/795037117 shutdown_connections 2023-10-25T16:17:57.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/795037117 wait complete. 2023-10-25T16:17:57.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 Processor -- start 2023-10-25T16:17:57.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- start start 2023-10-25T16:17:57.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a406fd80 0x7f80a40b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 0x7f80a406d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a4144360 0x7f80a4143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40ad300 con 0x7f80a40accf0 2023-10-25T16:17:57.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a415b300 con 0x7f80a4144360 2023-10-25T16:17:57.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40ad570 con 0x7f80a406fd80 2023-10-25T16:17:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 0x7f80a406d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 0x7f80a406d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50628/0 (socket says 172.21.15.177:50628) 2023-10-25T16:17:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 -- 172.21.15.177:0/268276849 learned_addr learned my addr 172.21.15.177:0/268276849 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a9d0d640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a406fd80 0x7f80a40b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80aa50e640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a4144360 0x7f80a4143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 -- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a406fd80 msgr2=0x7f80a40b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a406fd80 0x7f80a40b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 -- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a4144360 msgr2=0x7f80a4143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:57.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a4144360 0x7f80a4143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:57.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 -- 172.21.15.177:0/268276849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940094a0 con 0x7f80a40accf0 2023-10-25T16:17:57.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a9d0d640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a406fd80 0x7f80a40b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:57.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80aa50e640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a4144360 0x7f80a4143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:57.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80a950c640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 0x7f80a406d280 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8094009790 tx=0x7f80940a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:57.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094004340 con 0x7f80a40accf0 2023-10-25T16:17:57.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8094005030 con 0x7f80a40accf0 2023-10-25T16:17:57.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a40ad850 con 0x7f80a40accf0 2023-10-25T16:17:57.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094005420 con 0x7f80a40accf0 2023-10-25T16:17:57.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.885+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a415b5e0 con 0x7f80a40accf0 2023-10-25T16:17:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a404daf0 con 0x7f80a40accf0 2023-10-25T16:17:57.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f80940b4040 con 0x7f80a40accf0 2023-10-25T16:17:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f809a7fc640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8088066470 0x7f8088068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f809411d980 con 0x7f80a40accf0 2023-10-25T16:17:57.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f808806e060 con 0x7f80a40accf0 2023-10-25T16:17:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f80a9d0d640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8088066470 0x7f8088068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.889+0000 7f80a9d0d640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8088066470 0x7f8088068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f80a00046c0 tx=0x7f80a0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:57.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:57.893+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80940b2030 con 0x7f80a40accf0 2023-10-25T16:17:58.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80a4156040 con 0x7f80a40accf0 2023-10-25T16:17:58.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f809a7fc640 1 -- 172.21.15.177:0/268276849 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80940b2030 con 0x7f80a40accf0 2023-10-25T16:17:58.049 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:17:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8088066470 msgr2=0x7f8088068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8088066470 0x7f8088068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f80a00046c0 tx=0x7f80a0009040 comp rx=0 tx=0).stop 2023-10-25T16:17:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 msgr2=0x7f80a406d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 0x7f80a406d280 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8094009790 tx=0x7f80940a57c0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 shutdown_connections 2023-10-25T16:17:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8088066470 0x7f8088068930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80a4144360 0x7f80a4143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80a40accf0 0x7f80a406d280 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 --2- 172.21.15.177:0/268276849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80a406fd80 0x7f80a40b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 >> 172.21.15.177:0/268276849 conn(0x7f80a40af3f0 msgr2=0x7f80a40c71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 shutdown_connections 2023-10-25T16:17:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.049+0000 7f80abf71640 1 -- 172.21.15.177:0/268276849 wait complete. 2023-10-25T16:17:58.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:17:58.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- 172.21.15.177:0/1142457019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 msgr2=0x7fd49415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 --2- 172.21.15.177:0/1142457019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd49415bce0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fd484009900 tx=0x7fd48401c850 comp rx=0 tx=0).stop 2023-10-25T16:17:58.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- 172.21.15.177:0/1142457019 shutdown_connections 2023-10-25T16:17:58.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 --2- 172.21.15.177:0/1142457019 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd49415c220 0x7fd4940b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 --2- 172.21.15.177:0/1142457019 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd49415bce0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- 172.21.15.177:0/1142457019 >> 172.21.15.177:0/1142457019 conn(0x7fd4940afc40 msgr2=0x7fd4940b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:58.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- 172.21.15.177:0/1142457019 shutdown_connections 2023-10-25T16:17:58.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- 172.21.15.177:0/1142457019 wait complete. 2023-10-25T16:17:58.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 Processor -- start 2023-10-25T16:17:58.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- start start 2023-10-25T16:17:58.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd4941613b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd494141b50 0x7fd494134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd49415c220 0x7fd494134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49413adb0 con 0x7fd4940cb770 2023-10-25T16:17:58.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49413b090 con 0x7fd49415c220 2023-10-25T16:17:58.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd49b41c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49413b370 con 0x7fd494141b50 2023-10-25T16:17:58.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd4991b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd4941613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd4991b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd4941613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50650/0 (socket says 172.21.15.177:50650) 2023-10-25T16:17:58.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd4991b8640 1 -- 172.21.15.177:0/3010429049 learned_addr learned my addr 172.21.15.177:0/3010429049 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:58.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd4989b7640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd494141b50 0x7fd494134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.193+0000 7fd4999b9640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd49415c220 0x7fd494134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4991b8640 1 -- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd494141b50 msgr2=0x7fd494134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4991b8640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd494141b50 0x7fd494134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4991b8640 1 -- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd49415c220 msgr2=0x7fd494134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4991b8640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd49415c220 0x7fd494134ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4991b8640 1 -- 172.21.15.177:0/3010429049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009560 con 0x7fd4940cb770 2023-10-25T16:17:58.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4991b8640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd4941613b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c450 tx=0x7fd49000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:58.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490012830 con 0x7fd4940cb770 2023-10-25T16:17:58.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd490012aa0 con 0x7fd4940cb770 2023-10-25T16:17:58.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49406c820 con 0x7fd4940cb770 2023-10-25T16:17:58.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490011380 con 0x7fd4940cb770 2023-10-25T16:17:58.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4941618f0 con 0x7fd4940cb770 2023-10-25T16:17:58.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd494066b20 con 0x7fd4940cb770 2023-10-25T16:17:58.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd4900114e0 con 0x7fd4940cb770 2023-10-25T16:17:58.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd478066470 0x7fd478068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd490084060 con 0x7fd4940cb770 2023-10-25T16:17:58.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7fd47806e060 con 0x7fd4940cb770 2023-10-25T16:17:58.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4989b7640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd478066470 0x7fd478068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.197+0000 7fd4989b7640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd478066470 0x7fd478068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd4840af000 tx=0x7fd48401b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:58.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.201+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4900514a0 con 0x7fd4940cb770 2023-10-25T16:17:58.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.349+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd49404daf0 con 0x7fd4940cb770 2023-10-25T16:17:58.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.349+0000 7fd489ffb640 1 -- 172.21.15.177:0/3010429049 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd490054ac0 con 0x7fd4940cb770 2023-10-25T16:17:58.350 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:17:58.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd478066470 msgr2=0x7fd478068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd478066470 0x7fd478068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd4840af000 tx=0x7fd48401b090 comp rx=0 tx=0).stop 2023-10-25T16:17:58.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 msgr2=0x7fd4941613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd4941613b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c450 tx=0x7fd49000c910 comp rx=0 tx=0).stop 2023-10-25T16:17:58.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 shutdown_connections 2023-10-25T16:17:58.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd478066470 0x7fd478068930 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd49415c220 0x7fd494134ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd494141b50 0x7fd494134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 --2- 172.21.15.177:0/3010429049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4940cb770 0x7fd4941613b0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 >> 172.21.15.177:0/3010429049 conn(0x7fd4940afc40 msgr2=0x7fd494156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:58.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 shutdown_connections 2023-10-25T16:17:58.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.353+0000 7fd49b41c640 1 -- 172.21.15.177:0/3010429049 wait complete. 2023-10-25T16:17:58.367 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:17:58.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 -- 172.21.15.177:0/3712713011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48fc0047d0 msgr2=0x7f48fc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 --2- 172.21.15.177:0/3712713011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48fc0047d0 0x7f48fc004c50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4900009b60 tx=0x7f490001d250 comp rx=0 tx=0).stop 2023-10-25T16:17:58.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 -- 172.21.15.177:0/3712713011 shutdown_connections 2023-10-25T16:17:58.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 --2- 172.21.15.177:0/3712713011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48fc0047d0 0x7f48fc004c50 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 -- 172.21.15.177:0/3712713011 >> 172.21.15.177:0/3712713011 conn(0x7f491009a5c0 msgr2=0x7f49100d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:58.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 -- 172.21.15.177:0/3712713011 shutdown_connections 2023-10-25T16:17:58.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 -- 172.21.15.177:0/3712713011 wait complete. 2023-10-25T16:17:58.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 Processor -- start 2023-10-25T16:17:58.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.481+0000 7f49151a0640 1 -- start start 2023-10-25T16:17:58.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48fc0047d0 0x7f4910157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 0x7f49101528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101f5550 0x7f4910153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910158c10 con 0x7f49101584a0 2023-10-25T16:17:58.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491015c670 con 0x7f48fc0047d0 2023-10-25T16:17:58.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491015c950 con 0x7f49101f5550 2023-10-25T16:17:58.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 0x7f49101528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 0x7f49101528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50664/0 (socket says 172.21.15.177:50664) 2023-10-25T16:17:58.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 -- 172.21.15.177:0/93668271 learned_addr learned my addr 172.21.15.177:0/93668271 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:58.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f490ed9d640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48fc0047d0 0x7f4910157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f490f59e640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101f5550 0x7f4910153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 -- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101f5550 msgr2=0x7f4910153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101f5550 0x7f4910153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 -- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48fc0047d0 msgr2=0x7f4910157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48fc0047d0 0x7f4910157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 -- 172.21.15.177:0/93668271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491015cc30 con 0x7f49101584a0 2023-10-25T16:17:58.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f490ed9d640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48fc0047d0 0x7f4910157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:17:58.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f4907fff640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 0x7f49101528e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f490001d080 tx=0x7f4900005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:58.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900004220 con 0x7f49101584a0 2023-10-25T16:17:58.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4900004470 con 0x7f49101584a0 2023-10-25T16:17:58.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491015cf10 con 0x7f49101584a0 2023-10-25T16:17:58.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000049f0 con 0x7f49101584a0 2023-10-25T16:17:58.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4910158920 con 0x7f49101584a0 2023-10-25T16:17:58.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491015d0a0 con 0x7f49101584a0 2023-10-25T16:17:58.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f49000b3070 con 0x7f49101584a0 2023-10-25T16:17:58.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f00664a0 0x7f48f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f490011e440 con 0x7f49101584a0 2023-10-25T16:17:58.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f48f006e090 con 0x7f49101584a0 2023-10-25T16:17:58.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.485+0000 7f490ed9d640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f00664a0 0x7f48f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.489+0000 7f490ed9d640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f00664a0 0x7f48f0068960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f48f8006fd0 tx=0x7f48f8006a90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:58.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.489+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f49000eb800 con 0x7f49101584a0 2023-10-25T16:17:58.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.641+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f491004daf0 con 0x7f49101584a0 2023-10-25T16:17:58.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.641+0000 7f49077fe640 1 -- 172.21.15.177:0/93668271 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49000eee20 con 0x7f49101584a0 2023-10-25T16:17:58.643 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:17:58.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f00664a0 msgr2=0x7f48f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f00664a0 0x7f48f0068960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f48f8006fd0 tx=0x7f48f8006a90 comp rx=0 tx=0).stop 2023-10-25T16:17:58.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 msgr2=0x7f49101528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 0x7f49101528e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f490001d080 tx=0x7f4900005520 comp rx=0 tx=0).stop 2023-10-25T16:17:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 shutdown_connections 2023-10-25T16:17:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48f00664a0 0x7f48f0068960 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49101f5550 0x7f4910153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49101584a0 0x7f49101528e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 --2- 172.21.15.177:0/93668271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48fc0047d0 0x7f4910157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 >> 172.21.15.177:0/93668271 conn(0x7f491009a5c0 msgr2=0x7f49100b5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 shutdown_connections 2023-10-25T16:17:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.645+0000 7f49151a0640 1 -- 172.21.15.177:0/93668271 wait complete. 2023-10-25T16:17:58.660 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:17:58.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:17:58.661 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:17:58.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:17:58.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[44525]: fuse finished with error 0 and tester_r 0 2023-10-25T16:17:58.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:58.720 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:17:58.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:17:58.721 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:17:58.728 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:17:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:17:58.736 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:17:58.737 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:17:58.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:17:58.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 -- 172.21.15.177:0/2533998150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 msgr2=0x7fb3740c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 --2- 172.21.15.177:0/2533998150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740c9bf0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb3740b17a0 tx=0x7fb36001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 -- 172.21.15.177:0/2533998150 shutdown_connections 2023-10-25T16:17:58.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 --2- 172.21.15.177:0/2533998150 >> v2:172.21.15.184:3300/0 conn(0x7fb3741594a0 0x7fb3740cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 --2- 172.21.15.177:0/2533998150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740c9bf0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 -- 172.21.15.177:0/2533998150 >> 172.21.15.177:0/2533998150 conn(0x7fb3740cefe0 msgr2=0x7fb3740cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 -- 172.21.15.177:0/2533998150 shutdown_connections 2023-10-25T16:17:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 -- 172.21.15.177:0/2533998150 wait complete. 2023-10-25T16:17:58.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 Processor -- start 2023-10-25T16:17:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.893+0000 7fb37ad13640 1 -- start start 2023-10-25T16:17:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3741590c0 0x7fb3741535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3741594a0 0x7fb3740abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37415a1b0 con 0x7fb37415cec0 2023-10-25T16:17:58.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374153af0 con 0x7fb3741594a0 2023-10-25T16:17:58.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb374156140 con 0x7fb3741590c0 2023-10-25T16:17:58.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50674/0 (socket says 172.21.15.177:50674) 2023-10-25T16:17:58.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 -- 172.21.15.177:0/656168298 learned_addr learned my addr 172.21.15.177:0/656168298 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:58.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 -- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3741590c0 msgr2=0x7fb3741535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3741590c0 0x7fb3741535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 -- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3741594a0 msgr2=0x7fb3740abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:58.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb373fff640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3741594a0 0x7fb3740abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3741594a0 0x7fb3740abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 -- 172.21.15.177:0/656168298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360009560 con 0x7fb37415cec0 2023-10-25T16:17:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3792b0640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740ac490 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00ccb0 tx=0x7fb36c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c004b30 con 0x7fb37415cec0 2023-10-25T16:17:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb36c004da0 con 0x7fb37415cec0 2023-10-25T16:17:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb374159b60 con 0x7fb37415cec0 2023-10-25T16:17:58.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c005280 con 0x7fb37415cec0 2023-10-25T16:17:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3740c61c0 con 0x7fb37415cec0 2023-10-25T16:17:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3741599c0 con 0x7fb37415cec0 2023-10-25T16:17:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb36c0053e0 con 0x7fb37415cec0 2023-10-25T16:17:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb358066470 0x7fb358068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:58.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb36c084780 con 0x7fb37415cec0 2023-10-25T16:17:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7fb35806e060 con 0x7fb37415cec0 2023-10-25T16:17:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb378aaf640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb358066470 0x7fb358068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:58.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.897+0000 7fb378aaf640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb358066470 0x7fb358068930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb3680079a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:58.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:58.901+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb36c01d070 con 0x7fb37415cec0 2023-10-25T16:17:59.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.089+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb37404daf0 con 0x7fb37415cec0 2023-10-25T16:17:59.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb3717fa640 1 -- 172.21.15.177:0/656168298 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16732 (secure 0 0 0) 0x7fb3741599c0 con 0x7fb37415cec0 2023-10-25T16:17:59.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:17:59.093 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":92,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:17:55.851947+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:17:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb358066470 msgr2=0x7fb358068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb358066470 0x7fb358068930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb3680079a0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 msgr2=0x7fb3740ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740ac490 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00ccb0 tx=0x7fb36c00a620 comp rx=0 tx=0).stop 2023-10-25T16:17:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 shutdown_connections 2023-10-25T16:17:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb358066470 0x7fb358068930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37415cec0 0x7fb3740ac490 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3741594a0 0x7fb3740abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 --2- 172.21.15.177:0/656168298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb3741590c0 0x7fb3741535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 >> 172.21.15.177:0/656168298 conn(0x7fb3740cefe0 msgr2=0x7fb374158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:59.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 shutdown_connections 2023-10-25T16:17:59.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.093+0000 7fb37ad13640 1 -- 172.21.15.177:0/656168298 wait complete. 2023-10-25T16:17:59.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:17:15.299639+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:17:16.230820+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:17:59.111 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:17:59.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- 172.21.15.177:0/2864077885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 msgr2=0x7f3908004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 --2- 172.21.15.177:0/2864077885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f3908004c50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f390400bbb0 tx=0x7f390401cde0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- 172.21.15.177:0/2864077885 shutdown_connections 2023-10-25T16:17:59.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 --2- 172.21.15.177:0/2864077885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f3908004c50 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- 172.21.15.177:0/2864077885 >> 172.21.15.177:0/2864077885 conn(0x7f391c0b2450 msgr2=0x7f391c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:59.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- 172.21.15.177:0/2864077885 shutdown_connections 2023-10-25T16:17:59.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- 172.21.15.177:0/2864077885 wait complete. 2023-10-25T16:17:59.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 Processor -- start 2023-10-25T16:17:59.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- start start 2023-10-25T16:17:59.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f391c146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f391c150fd0 0x7f391c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391c0adab0 0x7f391c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.233+0000 7f3921de0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0aef30 con 0x7f39080047d0 2023-10-25T16:17:59.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3921de0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0af900 con 0x7f391c0adab0 2023-10-25T16:17:59.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3921de0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0ae320 con 0x7f391c150fd0 2023-10-25T16:17:59.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f391c146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f391c146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50700/0 (socket says 172.21.15.177:50700) 2023-10-25T16:17:59.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 -- 172.21.15.177:0/1713385012 learned_addr learned my addr 172.21.15.177:0/1713385012 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:59.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391affd640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f391c150fd0 0x7f391c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 -- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f391c150fd0 msgr2=0x7f391c0af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f391c150fd0 0x7f391c0af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 -- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391c0adab0 msgr2=0x7f391c14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391c0adab0 0x7f391c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 -- 172.21.15.177:0/1713385012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0ae600 con 0x7f39080047d0 2023-10-25T16:17:59.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391b7fe640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f391c146ac0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f390c0018b0 tx=0x7f390c001d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:59.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c010890 con 0x7f39080047d0 2023-10-25T16:17:59.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f390c010ae0 con 0x7f39080047d0 2023-10-25T16:17:59.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0ae8e0 con 0x7f39080047d0 2023-10-25T16:17:59.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011460 con 0x7f39080047d0 2023-10-25T16:17:59.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c151430 con 0x7f39080047d0 2023-10-25T16:17:59.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c04daf0 con 0x7f39080047d0 2023-10-25T16:17:59.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f390c0115c0 con 0x7f39080047d0 2023-10-25T16:17:59.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38fc066470 0x7f38fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f390c084a50 con 0x7f39080047d0 2023-10-25T16:17:59.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f38fc06e060 con 0x7f39080047d0 2023-10-25T16:17:59.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391affd640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38fc066470 0x7f38fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.237+0000 7f391affd640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38fc066470 0x7f38fc068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f39040af000 tx=0x7f3904019b80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:59.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.241+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f390c01f060 con 0x7f39080047d0 2023-10-25T16:17:59.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f391c147040 con 0x7f39080047d0 2023-10-25T16:17:59.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3913fff640 1 -- 172.21.15.177:0/1713385012 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f390c015020 con 0x7f39080047d0 2023-10-25T16:17:59.396 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:17:59.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38fc066470 msgr2=0x7f38fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38fc066470 0x7f38fc068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f39040af000 tx=0x7f3904019b80 comp rx=0 tx=0).stop 2023-10-25T16:17:59.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 msgr2=0x7f391c146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f391c146ac0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f390c0018b0 tx=0x7f390c001d70 comp rx=0 tx=0).stop 2023-10-25T16:17:59.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 shutdown_connections 2023-10-25T16:17:59.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38fc066470 0x7f38fc068930 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391c0adab0 0x7f391c14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f391c150fd0 0x7f391c0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 --2- 172.21.15.177:0/1713385012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39080047d0 0x7f391c146ac0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 >> 172.21.15.177:0/1713385012 conn(0x7f391c0b2450 msgr2=0x7f391c157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:59.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 shutdown_connections 2023-10-25T16:17:59.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.397+0000 7f3921de0640 1 -- 172.21.15.177:0/1713385012 wait complete. 2023-10-25T16:17:59.415 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:17:59.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 -- 172.21.15.177:0/1234822415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 msgr2=0x7fc5500aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 --2- 172.21.15.177:0/1234822415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5500aebc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fc5500afcc0 tx=0x7fc54801ca70 comp rx=0 tx=0).stop 2023-10-25T16:17:59.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 -- 172.21.15.177:0/1234822415 shutdown_connections 2023-10-25T16:17:59.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 --2- 172.21.15.177:0/1234822415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5500aebc0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 --2- 172.21.15.177:0/1234822415 >> v2:172.21.15.184:3300/0 conn(0x7fc5500c9e50 0x7fc55006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 --2- 172.21.15.177:0/1234822415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5501500f0 0x7fc5500c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 -- 172.21.15.177:0/1234822415 >> 172.21.15.177:0/1234822415 conn(0x7fc5500b2450 msgr2=0x7fc5500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:59.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 -- 172.21.15.177:0/1234822415 shutdown_connections 2023-10-25T16:17:59.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.545+0000 7fc55496a640 1 -- 172.21.15.177:0/1234822415 wait complete. 2023-10-25T16:17:59.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 Processor -- start 2023-10-25T16:17:59.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 -- start start 2023-10-25T16:17:59.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5501472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5500c9e50 0x7fc5501569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5501500f0 0x7fc550153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550152ce0 con 0x7fc55006bf20 2023-10-25T16:17:59.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550155fd0 con 0x7fc5501500f0 2023-10-25T16:17:59.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc550156f00 con 0x7fc5500c9e50 2023-10-25T16:17:59.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5501472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5501472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50716/0 (socket says 172.21.15.177:50716) 2023-10-25T16:17:59.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54ed9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5501500f0 0x7fc550153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 -- 172.21.15.177:0/3114896641 learned_addr learned my addr 172.21.15.177:0/3114896641 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:59.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54dd9b640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5500c9e50 0x7fc5501569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 -- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5500c9e50 msgr2=0x7fc5501569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5500c9e50 0x7fc5501569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 -- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5501500f0 msgr2=0x7fc550153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5501500f0 0x7fc550153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 -- 172.21.15.177:0/3114896641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480098e0 con 0x7fc55006bf20 2023-10-25T16:17:59.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc54e59c640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5501472c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c970 tx=0x7fc54000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:59.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540007c70 con 0x7fc55006bf20 2023-10-25T16:17:59.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc54000f450 con 0x7fc55006bf20 2023-10-25T16:17:59.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc550154280 con 0x7fc55006bf20 2023-10-25T16:17:59.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000f860 con 0x7fc55006bf20 2023-10-25T16:17:59.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.549+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc550154500 con 0x7fc55006bf20 2023-10-25T16:17:59.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55004daf0 con 0x7fc55006bf20 2023-10-25T16:17:59.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc54000f9c0 con 0x7fc55006bf20 2023-10-25T16:17:59.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc546ffd640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc530066470 0x7fc530068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc5400844d0 con 0x7fc55006bf20 2023-10-25T16:17:59.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7fc53006e060 con 0x7fc55006bf20 2023-10-25T16:17:59.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc54dd9b640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc530066470 0x7fc530068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.553+0000 7fc54dd9b640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc530066470 0x7fc530068930 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc55014e2c0 tx=0x7fc53800b390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:59.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.557+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc540051a50 con 0x7fc55006bf20 2023-10-25T16:17:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.709+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc550163e70 con 0x7fc55006bf20 2023-10-25T16:17:59.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.709+0000 7fc546ffd640 1 -- 172.21.15.177:0/3114896641 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc540055070 con 0x7fc55006bf20 2023-10-25T16:17:59.710 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:17:59.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc530066470 msgr2=0x7fc530068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc530066470 0x7fc530068930 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc55014e2c0 tx=0x7fc53800b390 comp rx=0 tx=0).stop 2023-10-25T16:17:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 msgr2=0x7fc5501472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5501472c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c970 tx=0x7fc54000ce30 comp rx=0 tx=0).stop 2023-10-25T16:17:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 shutdown_connections 2023-10-25T16:17:59.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc530066470 0x7fc530068930 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5501500f0 0x7fc550153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5500c9e50 0x7fc5501569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 --2- 172.21.15.177:0/3114896641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc55006bf20 0x7fc5501472c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 >> 172.21.15.177:0/3114896641 conn(0x7fc5500b2450 msgr2=0x7fc5500cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:59.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 shutdown_connections 2023-10-25T16:17:59.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.713+0000 7fc55496a640 1 -- 172.21.15.177:0/3114896641 wait complete. 2023-10-25T16:17:59.729 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:17:59.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- 172.21.15.177:0/2482720871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb4003fc0 msgr2=0x7f7fb40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2482720871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fb4003fc0 0x7f7fb40047d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc006fc0 tx=0x7f7fbc01f700 comp rx=0 tx=0).stop 2023-10-25T16:17:59.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd0aea640 1 -- 172.21.15.177:0/2482720871 reap_dead start 2023-10-25T16:17:59.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- 172.21.15.177:0/2482720871 shutdown_connections 2023-10-25T16:17:59.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- 172.21.15.177:0/2482720871 >> 172.21.15.177:0/2482720871 conn(0x7f7fcc0b2450 msgr2=0x7f7fcc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:17:59.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- 172.21.15.177:0/2482720871 shutdown_connections 2023-10-25T16:17:59.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- 172.21.15.177:0/2482720871 wait complete. 2023-10-25T16:17:59.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 Processor -- start 2023-10-25T16:17:59.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- start start 2023-10-25T16:17:59.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4003fc0 0x7f7fcc14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fcc1e1ba0 0x7f7fcc159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 0x7f7fcc15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1e2110 con 0x7f7fcc0adb00 2023-10-25T16:17:59.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1e23f0 con 0x7f7fb4003fc0 2023-10-25T16:17:59.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd254d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc1e26d0 con 0x7f7fcc1e1ba0 2023-10-25T16:17:59.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd0aea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 0x7f7fcc15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd0aea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 0x7f7fcc15a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50728/0 (socket says 172.21.15.177:50728) 2023-10-25T16:17:59.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.853+0000 7f7fd0aea640 1 -- 172.21.15.177:0/2927130316 learned_addr learned my addr 172.21.15.177:0/2927130316 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:17:59.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fcb7fe640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fcc1e1ba0 0x7f7fcc159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fcbfff640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4003fc0 0x7f7fcc14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd0aea640 1 -- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fcc1e1ba0 msgr2=0x7f7fcc159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd0aea640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fcc1e1ba0 0x7f7fcc159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd0aea640 1 -- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4003fc0 msgr2=0x7f7fcc14ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:17:59.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd0aea640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4003fc0 0x7f7fcc14ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:17:59.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd0aea640 1 -- 172.21.15.177:0/2927130316 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc1e29b0 con 0x7f7fcc0adb00 2023-10-25T16:17:59.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd0aea640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 0x7f7fcc15a060 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc06ffa0 tx=0x7f7fc400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:59.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc400dca0 con 0x7f7fcc0adb00 2023-10-25T16:17:59.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7fc4011440 con 0x7f7fcc0adb00 2023-10-25T16:17:59.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc1e2c90 con 0x7f7fcc0adb00 2023-10-25T16:17:59.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4011850 con 0x7f7fcc0adb00 2023-10-25T16:17:59.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc1e31b0 con 0x7f7fcc0adb00 2023-10-25T16:17:59.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc0ccd80 con 0x7f7fcc0adb00 2023-10-25T16:17:59.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7fc40119b0 con 0x7f7fcc0adb00 2023-10-25T16:17:59.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7fb8066470 0x7f7fb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:17:59.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7fc40843d0 con 0x7f7fcc0adb00 2023-10-25T16:17:59.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7f7fb806e060 con 0x7f7fcc0adb00 2023-10-25T16:17:59.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fcbfff640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7fb8066470 0x7f7fb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:17:59.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.857+0000 7f7fcbfff640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7fb8066470 0x7f7fb8068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc150030 tx=0x7f7fc0006bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:17:59.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:17:59.861+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7fc4051810 con 0x7f7fcc0adb00 2023-10-25T16:18:00.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.009+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fcc1e2e80 con 0x7f7fcc0adb00 2023-10-25T16:18:00.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.009+0000 7f7fc8ff9640 1 -- 172.21.15.177:0/2927130316 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fc4054e30 con 0x7f7fcc0adb00 2023-10-25T16:18:00.011 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:18:00.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7fb8066470 msgr2=0x7f7fb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7fb8066470 0x7f7fb8068930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc150030 tx=0x7f7fc0006bd0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 msgr2=0x7f7fcc15a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 0x7f7fcc15a060 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc06ffa0 tx=0x7f7fc400fe10 comp rx=0 tx=0).stop 2023-10-25T16:18:00.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 shutdown_connections 2023-10-25T16:18:00.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7fb8066470 0x7f7fb8068930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7fcc0adb00 0x7f7fcc15a060 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fcc1e1ba0 0x7f7fcc159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 --2- 172.21.15.177:0/2927130316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fb4003fc0 0x7f7fcc14ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 >> 172.21.15.177:0/2927130316 conn(0x7f7fcc0b2450 msgr2=0x7f7fcc0cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:00.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 shutdown_connections 2023-10-25T16:18:00.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.013+0000 7f7fd254d640 1 -- 172.21.15.177:0/2927130316 wait complete. 2023-10-25T16:18:00.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:18:00.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 -- 172.21.15.177:0/3147184193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad0003980 msgr2=0x7ffad0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/3147184193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad0003980 0x7ffad0003da0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009b60 tx=0x7ffad401d290 comp rx=0 tx=0).stop 2023-10-25T16:18:00.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae50f7640 1 -- 172.21.15.177:0/3147184193 reap_dead start 2023-10-25T16:18:00.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 -- 172.21.15.177:0/3147184193 shutdown_connections 2023-10-25T16:18:00.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 -- 172.21.15.177:0/3147184193 >> 172.21.15.177:0/3147184193 conn(0x7ffae009a5c0 msgr2=0x7ffae00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:00.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 -- 172.21.15.177:0/3147184193 shutdown_connections 2023-10-25T16:18:00.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 -- 172.21.15.177:0/3147184193 wait complete. 2023-10-25T16:18:00.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 Processor -- start 2023-10-25T16:18:00.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.153+0000 7ffae6b5a640 1 -- start start 2023-10-25T16:18:00.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad0003980 0x7ffae0150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffae0155a80 0x7ffae00c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 0x7ffae00b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00c5620 con 0x7ffae00c51a0 2023-10-25T16:18:00.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00c5900 con 0x7ffae0155a80 2023-10-25T16:18:00.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae00c5be0 con 0x7ffad0003980 2023-10-25T16:18:00.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 0x7ffae00b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 0x7ffae00b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50742/0 (socket says 172.21.15.177:50742) 2023-10-25T16:18:00.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 -- 172.21.15.177:0/2448880062 learned_addr learned my addr 172.21.15.177:0/2448880062 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:00.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadffff640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffae0155a80 0x7ffae00c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae48f6640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad0003980 0x7ffae0150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 -- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad0003980 msgr2=0x7ffae0150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad0003980 0x7ffae0150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 -- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffae0155a80 msgr2=0x7ffae00c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffae0155a80 0x7ffae00c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 -- 172.21.15.177:0/2448880062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae00c5ec0 con 0x7ffae00c51a0 2023-10-25T16:18:00.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae50f7640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 0x7ffae00b5790 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ffae006a0e0 tx=0x7ffad800fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:00.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8004d30 con 0x7ffae00c51a0 2023-10-25T16:18:00.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffad800eab0 con 0x7ffae00c51a0 2023-10-25T16:18:00.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae01519a0 con 0x7ffae00c51a0 2023-10-25T16:18:00.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800eec0 con 0x7ffae00c51a0 2023-10-25T16:18:00.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae00b5ea0 con 0x7ffae00c51a0 2023-10-25T16:18:00.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae00b6120 con 0x7ffae00c51a0 2023-10-25T16:18:00.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffad8011440 con 0x7ffae00c51a0 2023-10-25T16:18:00.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffac4066470 0x7ffac4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffad8084b90 con 0x7ffae00c51a0 2023-10-25T16:18:00.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7ffac406e060 con 0x7ffae00c51a0 2023-10-25T16:18:00.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.157+0000 7ffae48f6640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffac4066470 0x7ffac4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.161+0000 7ffae48f6640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffac4066470 0x7ffac4068930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffad40ae000 tx=0x7ffad401a030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:00.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.161+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffad8020060 con 0x7ffae00c51a0 2023-10-25T16:18:00.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.329+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffae0151b90 con 0x7ffae00c51a0 2023-10-25T16:18:00.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.329+0000 7ffadd7fa640 1 -- 172.21.15.177:0/2448880062 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffae00b6120 con 0x7ffae00c51a0 2023-10-25T16:18:00.330 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:18:00.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffac4066470 msgr2=0x7ffac4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffac4066470 0x7ffac4068930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ffad40ae000 tx=0x7ffad401a030 comp rx=0 tx=0).stop 2023-10-25T16:18:00.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 msgr2=0x7ffae00b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 0x7ffae00b5790 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ffae006a0e0 tx=0x7ffad800fd90 comp rx=0 tx=0).stop 2023-10-25T16:18:00.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 shutdown_connections 2023-10-25T16:18:00.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffac4066470 0x7ffac4068930 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffae00c51a0 0x7ffae00b5790 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffae0155a80 0x7ffae00c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 --2- 172.21.15.177:0/2448880062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffad0003980 0x7ffae0150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 >> 172.21.15.177:0/2448880062 conn(0x7ffae009a5c0 msgr2=0x7ffae015a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:00.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 shutdown_connections 2023-10-25T16:18:00.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.333+0000 7ffae6b5a640 1 -- 172.21.15.177:0/2448880062 wait complete. 2023-10-25T16:18:00.349 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:18:00.349 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:00.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:00.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:00.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34597]: fuse finished with error 0 and tester_r 0 2023-10-25T16:18:00.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:00.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:18:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:00.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:18:00.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:00.416 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:18:00.426 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:00.426 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:00.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:18:00.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:18:00.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:00.434 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:18:00.479 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:18:00.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:18:00.481 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:18:00.481 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:00.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:18:00.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:18:00.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:00.488 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:18:00.534 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:18:00.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:18:00.535 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:00.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3837520881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 msgr2=0x7fd8340ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3837520881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd8340ccba0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009840 tx=0x7fd81c01c800 comp rx=0 tx=0).stop 2023-10-25T16:18:00.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3837520881 shutdown_connections 2023-10-25T16:18:00.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3837520881 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340cfe20 0x7fd8340c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3837520881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd8340ccba0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3837520881 >> 172.21.15.177:0/3837520881 conn(0x7fd83409a580 msgr2=0x7fd8340d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:00.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3837520881 shutdown_connections 2023-10-25T16:18:00.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3837520881 wait complete. 2023-10-25T16:18:00.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 Processor -- start 2023-10-25T16:18:00.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- start start 2023-10-25T16:18:00.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b2070 0x7fd8340ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340cfe20 0x7fd8340b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd834154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b5bf0 con 0x7fd83415eba0 2023-10-25T16:18:00.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b4fe0 con 0x7fd8340b2070 2023-10-25T16:18:00.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b52c0 con 0x7fd8340cfe20 2023-10-25T16:18:00.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd834154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd834154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55258/0 (socket says 172.21.15.177:55258) 2023-10-25T16:18:00.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 -- 172.21.15.177:0/3641598565 learned_addr learned my addr 172.21.15.177:0/3641598565 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:00.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd831d9b640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340cfe20 0x7fd8340b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd83259c640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b2070 0x7fd8340ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 -- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340cfe20 msgr2=0x7fd8340b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340cfe20 0x7fd8340b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 -- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b2070 msgr2=0x7fd8340ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b2070 0x7fd8340ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 -- 172.21.15.177:0/3641598565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0094a0 con 0x7fd83415eba0 2023-10-25T16:18:00.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd83259c640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b2070 0x7fd8340ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:00.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd832d9d640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd834154070 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00b970 tx=0x7fd82c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:00.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00cb40 con 0x7fd83415eba0 2023-10-25T16:18:00.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd82c00cdb0 con 0x7fd83415eba0 2023-10-25T16:18:00.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340b55a0 con 0x7fd83415eba0 2023-10-25T16:18:00.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0146a0 con 0x7fd83415eba0 2023-10-25T16:18:00.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.665+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8340ca920 con 0x7fd83415eba0 2023-10-25T16:18:00.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8340b5da0 con 0x7fd83415eba0 2023-10-25T16:18:00.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd82c01d3b0 con 0x7fd83415eba0 2023-10-25T16:18:00.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd82affd640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:00.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd82c083ff0 con 0x7fd83415eba0 2023-10-25T16:18:00.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=93}) v3 -- 0x7fd81406e060 con 0x7fd83415eba0 2023-10-25T16:18:00.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd83259c640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:00.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.669+0000 7fd83259c640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0af000 tx=0x7fd81c01b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:00.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.673+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd82c019020 con 0x7fd83415eba0 2023-10-25T16:18:00.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.857+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd83404daf0 con 0x7fd83415eba0 2023-10-25T16:18:00.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.857+0000 7fd82affd640 1 -- 172.21.15.177:0/3641598565 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fd8340b5da0 con 0x7fd83415eba0 2023-10-25T16:18:00.859 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:00.859 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:18:00.860 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:18:00.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 msgr2=0x7fd814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0af000 tx=0x7fd81c01b040 comp rx=0 tx=0).stop 2023-10-25T16:18:00.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 msgr2=0x7fd834154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:00.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd834154070 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00b970 tx=0x7fd82c00be30 comp rx=0 tx=0).stop 2023-10-25T16:18:00.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 shutdown_connections 2023-10-25T16:18:00.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd814066470 0x7fd814068930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd83415eba0 0x7fd834154070 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd8340cfe20 0x7fd8340b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 --2- 172.21.15.177:0/3641598565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8340b2070 0x7fd8340ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:00.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 >> 172.21.15.177:0/3641598565 conn(0x7fd83409a580 msgr2=0x7fd83406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:00.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 shutdown_connections 2023-10-25T16:18:00.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:00.861+0000 7fd8389c8640 1 -- 172.21.15.177:0/3641598565 wait complete. 2023-10-25T16:18:00.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:00.891 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:18:00.893+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-10-25T16:18:00.892 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:18:00.893+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2023-10-25T16:18:00.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:18:00.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:18:00.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/2156387323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda680039b0 msgr2=0x7fda68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 --2- 172.21.15.177:0/2156387323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda680039b0 0x7fda68003dd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fda78006fb0 tx=0x7fda7801cfa0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 -- 172.21.15.177:0/2156387323 reap_dead start 2023-10-25T16:18:01.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/2156387323 shutdown_connections 2023-10-25T16:18:01.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/2156387323 >> 172.21.15.177:0/2156387323 conn(0x7fda7c0ca980 msgr2=0x7fda7c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/2156387323 shutdown_connections 2023-10-25T16:18:01.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/2156387323 wait complete. 2023-10-25T16:18:01.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 Processor -- start 2023-10-25T16:18:01.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- start start 2023-10-25T16:18:01.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda680039b0 0x7fda7c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c155700 0x7fda7c069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 0x7fda7c069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1369c0 con 0x7fda7c135420 2023-10-25T16:18:01.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c135920 con 0x7fda7c155700 2023-10-25T16:18:01.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c135c00 con 0x7fda680039b0 2023-10-25T16:18:01.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 0x7fda7c069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 0x7fda7c069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55278/0 (socket says 172.21.15.177:55278) 2023-10-25T16:18:01.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 -- 172.21.15.177:0/894742541 learned_addr learned my addr 172.21.15.177:0/894742541 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:01.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda81931640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c155700 0x7fda7c069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82132640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda680039b0 0x7fda7c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 -- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda680039b0 msgr2=0x7fda7c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda680039b0 0x7fda7c153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 -- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c155700 msgr2=0x7fda7c069720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c155700 0x7fda7c069720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 -- 172.21.15.177:0/894742541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c135ee0 con 0x7fda7c135420 2023-10-25T16:18:01.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda82933640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 0x7fda7c069c60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fda7c159010 tx=0x7fda740019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74011870 con 0x7fda7c135420 2023-10-25T16:18:01.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda74011ac0 con 0x7fda7c135420 2023-10-25T16:18:01.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c1361c0 con 0x7fda7c135420 2023-10-25T16:18:01.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740103c0 con 0x7fda7c135420 2023-10-25T16:18:01.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c152d10 con 0x7fda7c135420 2023-10-25T16:18:01.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.001+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c152ff0 con 0x7fda7c135420 2023-10-25T16:18:01.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.005+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda74010520 con 0x7fda7c135420 2023-10-25T16:18:01.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.005+0000 7fda72ffd640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda600664a0 0x7fda60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.005+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fda74084950 con 0x7fda7c135420 2023-10-25T16:18:01.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.005+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7fda6006e090 con 0x7fda7c135420 2023-10-25T16:18:01.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.005+0000 7fda82132640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda600664a0 0x7fda60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.005+0000 7fda82132640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda600664a0 0x7fda60068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda780ac000 tx=0x7fda780a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.009+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda74051d90 con 0x7fda7c135420 2023-10-25T16:18:01.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.161+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda7c04daf0 con 0x7fda7c135420 2023-10-25T16:18:01.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.165+0000 7fda72ffd640 1 -- 172.21.15.177:0/894742541 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16711 (secure 0 0 0) 0x7fda740553b0 con 0x7fda7c135420 2023-10-25T16:18:01.166 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:01.166 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":93,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:00.894644+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:01.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda600664a0 msgr2=0x7fda60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda600664a0 0x7fda60068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fda780ac000 tx=0x7fda780a7040 comp rx=0 tx=0).stop 2023-10-25T16:18:01.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 msgr2=0x7fda7c069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 0x7fda7c069c60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fda7c159010 tx=0x7fda740019c0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 shutdown_connections 2023-10-25T16:18:01.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda600664a0 0x7fda60068960 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda7c135420 0x7fda7c069c60 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c155700 0x7fda7c069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 --2- 172.21.15.177:0/894742541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda680039b0 0x7fda7c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 >> 172.21.15.177:0/894742541 conn(0x7fda7c0ca980 msgr2=0x7fda7c1590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 shutdown_connections 2023-10-25T16:18:01.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.169+0000 7fda84396640 1 -- 172.21.15.177:0/894742541 wait complete. 2023-10-25T16:18:01.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:17:15.299639+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:17:16.230820+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:18:01.186 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:18:01.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- 172.21.15.177:0/2420644905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2118003980 msgr2=0x7f2118003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2420644905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2118003980 0x7f2118003da0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f212000bc00 tx=0x7f212001ce80 comp rx=0 tx=0).stop 2023-10-25T16:18:01.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2135018640 1 -- 172.21.15.177:0/2420644905 reap_dead start 2023-10-25T16:18:01.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- 172.21.15.177:0/2420644905 shutdown_connections 2023-10-25T16:18:01.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- 172.21.15.177:0/2420644905 >> 172.21.15.177:0/2420644905 conn(0x7f213009a5c0 msgr2=0x7f21300d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- 172.21.15.177:0/2420644905 shutdown_connections 2023-10-25T16:18:01.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- 172.21.15.177:0/2420644905 wait complete. 2023-10-25T16:18:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 Processor -- start 2023-10-25T16:18:01.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- start start 2023-10-25T16:18:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2118003980 0x7f2130152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 0x7f2130154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213015b070 0x7f213015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213015ba60 con 0x7f2130141430 2023-10-25T16:18:01.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130152bd0 con 0x7f2118003980 2023-10-25T16:18:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2136a7b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213013f640 con 0x7f213015b070 2023-10-25T16:18:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 0x7f2130154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 0x7f2130154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55290/0 (socket says 172.21.15.177:55290) 2023-10-25T16:18:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 -- 172.21.15.177:0/2211447428 learned_addr learned my addr 172.21.15.177:0/2211447428 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:01.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2134817640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2118003980 0x7f2130152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2135018640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213015b070 0x7f213015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 -- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213015b070 msgr2=0x7f213015b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213015b070 0x7f213015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 -- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2118003980 msgr2=0x7f2130152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2118003980 0x7f2130152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f212ffff640 1 -- 172.21.15.177:0/2211447428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130155000 con 0x7f2130141430 2023-10-25T16:18:01.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.313+0000 7f2134817640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2118003980 0x7f2130152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:01.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212ffff640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 0x7f2130154ac0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f212400d7b0 tx=0x7f212400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212400de60 con 0x7f2130141430 2023-10-25T16:18:01.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21240052e0 con 0x7f2130141430 2023-10-25T16:18:01.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2130155260 con 0x7f2130141430 2023-10-25T16:18:01.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212400b8a0 con 0x7f2130141430 2023-10-25T16:18:01.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213013eff0 con 0x7f2130141430 2023-10-25T16:18:01.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213004daf0 con 0x7f2130141430 2023-10-25T16:18:01.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f212400ba00 con 0x7f2130141430 2023-10-25T16:18:01.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f211c066470 0x7f211c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2124083b50 con 0x7f2130141430 2023-10-25T16:18:01.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f211c06e060 con 0x7f2130141430 2023-10-25T16:18:01.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f2134817640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f211c066470 0x7f211c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.317+0000 7f2134817640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f211c066470 0x7f211c068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21200af000 tx=0x7f2120019c20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.321+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2124019020 con 0x7f2130141430 2023-10-25T16:18:01.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.473+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f213013f780 con 0x7f2130141430 2023-10-25T16:18:01.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.473+0000 7f212d7fa640 1 -- 172.21.15.177:0/2211447428 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2124050f90 con 0x7f2130141430 2023-10-25T16:18:01.475 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:18:01.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f211c066470 msgr2=0x7f211c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f211c066470 0x7f211c068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21200af000 tx=0x7f2120019c20 comp rx=0 tx=0).stop 2023-10-25T16:18:01.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 msgr2=0x7f2130154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 0x7f2130154ac0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f212400d7b0 tx=0x7f212400dc70 comp rx=0 tx=0).stop 2023-10-25T16:18:01.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 shutdown_connections 2023-10-25T16:18:01.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f211c066470 0x7f211c068930 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213015b070 0x7f213015b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2130141430 0x7f2130154ac0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 --2- 172.21.15.177:0/2211447428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2118003980 0x7f2130152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 >> 172.21.15.177:0/2211447428 conn(0x7f213009a5c0 msgr2=0x7f21300b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 shutdown_connections 2023-10-25T16:18:01.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.477+0000 7f2136a7b640 1 -- 172.21.15.177:0/2211447428 wait complete. 2023-10-25T16:18:01.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:18:01.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/2313279919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 msgr2=0x7f850815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 --2- 172.21.15.177:0/2313279919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f850815c810 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8500009bf0 tx=0x7f850001cb40 comp rx=0 tx=0).stop 2023-10-25T16:18:01.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/2313279919 shutdown_connections 2023-10-25T16:18:01.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 --2- 172.21.15.177:0/2313279919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f850815c810 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 --2- 172.21.15.177:0/2313279919 >> v2:172.21.15.184:3300/0 conn(0x7f850813d8f0 0x7f85080af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/2313279919 >> 172.21.15.177:0/2313279919 conn(0x7f85080b2450 msgr2=0x7f85080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/2313279919 shutdown_connections 2023-10-25T16:18:01.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/2313279919 wait complete. 2023-10-25T16:18:01.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 Processor -- start 2023-10-25T16:18:01.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- start start 2023-10-25T16:18:01.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f850813d8f0 0x7f8508137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850815b710 0x7f85080cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f85080cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85081408d0 con 0x7f850815c3a0 2023-10-25T16:18:01.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8508140030 con 0x7f850815b710 2023-10-25T16:18:01.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8508140310 con 0x7f850813d8f0 2023-10-25T16:18:01.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f85080cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f85080cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55306/0 (socket says 172.21.15.177:55306) 2023-10-25T16:18:01.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 -- 172.21.15.177:0/3126803851 learned_addr learned my addr 172.21.15.177:0/3126803851 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:01.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f8507fff640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850815b710 0x7f85080cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 -- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f850813d8f0 msgr2=0x7f8508137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f850813d8f0 0x7f8508137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 -- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850815b710 msgr2=0x7f85080cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850815b710 0x7f85080cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 -- 172.21.15.177:0/3126803851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500009820 con 0x7f850815c3a0 2023-10-25T16:18:01.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850d6f5640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f85080cd3c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f850001a770 tx=0x7f8500009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85000bc070 con 0x7f850815c3a0 2023-10-25T16:18:01.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8500003980 con 0x7f850815c3a0 2023-10-25T16:18:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85081405f0 con 0x7f850815c3a0 2023-10-25T16:18:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500003d70 con 0x7f850815c3a0 2023-10-25T16:18:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.625+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8508153330 con 0x7f850815c3a0 2023-10-25T16:18:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850804daf0 con 0x7f850815c3a0 2023-10-25T16:18:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8500003ed0 con 0x7f850815c3a0 2023-10-25T16:18:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f85057fa640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f850011e5e0 con 0x7f850815c3a0 2023-10-25T16:18:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=94}) v3 -- 0x7f84f406e060 con 0x7f850815c3a0 2023-10-25T16:18:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f850cef4640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.629+0000 7f850cef4640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f84f80011f0 tx=0x7f84f80078f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.633+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f85000ebab0 con 0x7f850815c3a0 2023-10-25T16:18:01.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.773+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85080cddb0 con 0x7f850815c3a0 2023-10-25T16:18:01.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.773+0000 7f85057fa640 1 -- 172.21.15.177:0/3126803851 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85000b20a0 con 0x7f850815c3a0 2023-10-25T16:18:01.775 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:18:01.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 msgr2=0x7f84f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f84f80011f0 tx=0x7f84f80078f0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 msgr2=0x7f85080cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f85080cd3c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f850001a770 tx=0x7f8500009330 comp rx=0 tx=0).stop 2023-10-25T16:18:01.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 shutdown_connections 2023-10-25T16:18:01.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815c3a0 0x7f85080cd3c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850815b710 0x7f85080cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 --2- 172.21.15.177:0/3126803851 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f850813d8f0 0x7f8508137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 >> 172.21.15.177:0/3126803851 conn(0x7f85080b2450 msgr2=0x7f85080aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 shutdown_connections 2023-10-25T16:18:01.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.777+0000 7f850f158640 1 -- 172.21.15.177:0/3126803851 wait complete. 2023-10-25T16:18:01.793 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:18:01.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 -- 172.21.15.177:0/554847461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 msgr2=0x7fd08c0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 --2- 172.21.15.177:0/554847461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 0x7fd08c0708f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd080009930 tx=0x7fd08001c890 comp rx=0 tx=0).stop 2023-10-25T16:18:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 -- 172.21.15.177:0/554847461 shutdown_connections 2023-10-25T16:18:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 --2- 172.21.15.177:0/554847461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 0x7fd08c0708f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 --2- 172.21.15.177:0/554847461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c13d880 0x7fd08c15bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 -- 172.21.15.177:0/554847461 >> 172.21.15.177:0/554847461 conn(0x7fd08c0ca980 msgr2=0x7fd08c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:01.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 -- 172.21.15.177:0/554847461 shutdown_connections 2023-10-25T16:18:01.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.925+0000 7fd092d5c640 1 -- 172.21.15.177:0/554847461 wait complete. 2023-10-25T16:18:01.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 Processor -- start 2023-10-25T16:18:01.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- start start 2023-10-25T16:18:01.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 0x7fd08c14a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 0x7fd08c1369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c158c30 0x7fd08c0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c148f30 con 0x7fd08c13d880 2023-10-25T16:18:01.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c14a7e0 con 0x7fd08c070490 2023-10-25T16:18:01.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c14aa60 con 0x7fd08c158c30 2023-10-25T16:18:01.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 0x7fd08c1369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 0x7fd08c1369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55312/0 (socket says 172.21.15.177:55312) 2023-10-25T16:18:01.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 -- 172.21.15.177:0/3683217814 learned_addr learned my addr 172.21.15.177:0/3683217814 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:01.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd0912f9640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c158c30 0x7fd08c0b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd090af8640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 0x7fd08c14a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 -- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c158c30 msgr2=0x7fd08c0b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c158c30 0x7fd08c0b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 -- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 msgr2=0x7fd08c14a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:01.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 0x7fd08c14a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:01.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 -- 172.21.15.177:0/3683217814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080009560 con 0x7fd08c13d880 2023-10-25T16:18:01.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd0912f9640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c158c30 0x7fd08c0b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:01.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd08bfff640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 0x7fd08c1369a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd08001a4c0 tx=0x7fd080005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080005220 con 0x7fd08c13d880 2023-10-25T16:18:01.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd080005470 con 0x7fd08c13d880 2023-10-25T16:18:01.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c14ad40 con 0x7fd08c13d880 2023-10-25T16:18:01.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800046d0 con 0x7fd08c13d880 2023-10-25T16:18:01.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c14b300 con 0x7fd08c13d880 2023-10-25T16:18:01.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c04daf0 con 0x7fd08c13d880 2023-10-25T16:18:01.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.929+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0800b4040 con 0x7fd08c13d880 2023-10-25T16:18:01.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.933+0000 7fd0897fa640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd078066470 0x7fd078068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:01.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.933+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd08011dfa0 con 0x7fd08c13d880 2023-10-25T16:18:01.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.933+0000 7fd090af8640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd078066470 0x7fd078068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:01.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.933+0000 7fd090af8640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd078066470 0x7fd078068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd084009ab0 tx=0x7fd0840091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:01.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:01.937+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0800eb3e0 con 0x7fd08c13d880 2023-10-25T16:18:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.089+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd08c066a90 con 0x7fd08c13d880 2023-10-25T16:18:02.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.089+0000 7fd0897fa640 1 -- 172.21.15.177:0/3683217814 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0800b20a0 con 0x7fd08c13d880 2023-10-25T16:18:02.091 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:18:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd078066470 msgr2=0x7fd078068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd078066470 0x7fd078068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd084009ab0 tx=0x7fd0840091e0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 msgr2=0x7fd08c1369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 0x7fd08c1369a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd08001a4c0 tx=0x7fd080005e70 comp rx=0 tx=0).stop 2023-10-25T16:18:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 shutdown_connections 2023-10-25T16:18:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd078066470 0x7fd078068930 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd08c158c30 0x7fd08c0b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd08c13d880 0x7fd08c1369a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 --2- 172.21.15.177:0/3683217814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd08c070490 0x7fd08c14a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 >> 172.21.15.177:0/3683217814 conn(0x7fd08c0ca980 msgr2=0x7fd08c13a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 shutdown_connections 2023-10-25T16:18:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.093+0000 7fd092d5c640 1 -- 172.21.15.177:0/3683217814 wait complete. 2023-10-25T16:18:02.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:02.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 -- 172.21.15.177:0/3618753338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac0ca270 msgr2=0x7f27ac0ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 --2- 172.21.15.177:0/3618753338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ca650 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f279c009900 tx=0x7f279c01c860 comp rx=0 tx=0).stop 2023-10-25T16:18:02.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 -- 172.21.15.177:0/3618753338 shutdown_connections 2023-10-25T16:18:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 --2- 172.21.15.177:0/3618753338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27ac0acd40 0x7f27ac1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 --2- 172.21.15.177:0/3618753338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ca650 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 -- 172.21.15.177:0/3618753338 >> 172.21.15.177:0/3618753338 conn(0x7f27ac0af5b0 msgr2=0x7f27ac0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 -- 172.21.15.177:0/3618753338 shutdown_connections 2023-10-25T16:18:02.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 -- 172.21.15.177:0/3618753338 wait complete. 2023-10-25T16:18:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 Processor -- start 2023-10-25T16:18:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.229+0000 7f27b2490640 1 -- start start 2023-10-25T16:18:02.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27ac0acd40 0x7f27ac14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac159600 0x7f27ac0ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac161590 con 0x7f27ac0ca270 2023-10-25T16:18:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac14b430 con 0x7f27ac159600 2023-10-25T16:18:02.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac157bb0 con 0x7f27ac0acd40 2023-10-25T16:18:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55316/0 (socket says 172.21.15.177:55316) 2023-10-25T16:18:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 -- 172.21.15.177:0/843169374 learned_addr learned my addr 172.21.15.177:0/843169374 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b0a2d640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac159600 0x7f27ac0ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27abfff640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27ac0acd40 0x7f27ac14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 -- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27ac0acd40 msgr2=0x7f27ac14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27ac0acd40 0x7f27ac14aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 -- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac159600 msgr2=0x7f27ac0ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac159600 0x7f27ac0ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 -- 172.21.15.177:0/843169374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c009560 con 0x7f27ac0ca270 2023-10-25T16:18:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27ab7fe640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ae260 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f279400e970 tx=0x7f279400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:02.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794009730 con 0x7f27ac0ca270 2023-10-25T16:18:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f279400cd80 con 0x7f27ac0ca270 2023-10-25T16:18:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac1578d0 con 0x7f27ac0ca270 2023-10-25T16:18:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794005280 con 0x7f27ac0ca270 2023-10-25T16:18:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac161220 con 0x7f27ac0ca270 2023-10-25T16:18:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac160da0 con 0x7f27ac0ca270 2023-10-25T16:18:02.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27940053e0 con 0x7f27ac0ca270 2023-10-25T16:18:02.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.233+0000 7f27a8ff9640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f278c066470 0x7f278c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.237+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2794014070 con 0x7f27ac0ca270 2023-10-25T16:18:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.237+0000 7f27abfff640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f278c066470 0x7f278c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.237+0000 7f27abfff640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f278c066470 0x7f278c068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f279c0af000 tx=0x7f279c01b0a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.237+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27ac160da0 con 0x7f27ac0ca270 2023-10-25T16:18:02.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.413+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27ac160da0 con 0x7f27ac0ca270 2023-10-25T16:18:02.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.413+0000 7f27a8ff9640 1 -- 172.21.15.177:0/843169374 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f27ac160da0 con 0x7f27ac0ca270 2023-10-25T16:18:02.414 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:02.414 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:18:02.415 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:18:02.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f278c066470 msgr2=0x7f278c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f278c066470 0x7f278c068930 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f279c0af000 tx=0x7f279c01b0a0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 msgr2=0x7f27ac0ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ae260 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f279400e970 tx=0x7f279400ee30 comp rx=0 tx=0).stop 2023-10-25T16:18:02.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 shutdown_connections 2023-10-25T16:18:02.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f278c066470 0x7f278c068930 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27ac159600 0x7f27ac0ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27ac0ca270 0x7f27ac0ae260 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 --2- 172.21.15.177:0/843169374 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27ac0acd40 0x7f27ac14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 >> 172.21.15.177:0/843169374 conn(0x7f27ac0af5b0 msgr2=0x7f27ac0afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:02.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 shutdown_connections 2023-10-25T16:18:02.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.417+0000 7f27b2490640 1 -- 172.21.15.177:0/843169374 wait complete. 2023-10-25T16:18:02.434 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:02.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/63383223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0b0280 msgr2=0x7f23fc0ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 --2- 172.21.15.177:0/63383223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0b0280 0x7f23fc0ca1d0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f23fc06a700 tx=0x7f23ec01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/63383223 shutdown_connections 2023-10-25T16:18:02.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 --2- 172.21.15.177:0/63383223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0b0280 0x7f23fc0ca1d0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 --2- 172.21.15.177:0/63383223 >> v2:172.21.15.184:3300/0 conn(0x7f23fc0cc0a0 0x7f23fc0adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/63383223 >> 172.21.15.177:0/63383223 conn(0x7f23fc0983a0 msgr2=0x7f23fc0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/63383223 shutdown_connections 2023-10-25T16:18:02.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/63383223 wait complete. 2023-10-25T16:18:02.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 Processor -- start 2023-10-25T16:18:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- start start 2023-10-25T16:18:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23fc0b0280 0x7f23fc0c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 0x7f23fc1f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23fc15ca70 0x7f23fc0abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c8ff0 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc1f6230 con 0x7f23fc15ca70 2023-10-25T16:18:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc0c5190 con 0x7f23fc0b0280 2023-10-25T16:18:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 0x7f23fc1f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 0x7f23fc1f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55336/0 (socket says 172.21.15.177:55336) 2023-10-25T16:18:02.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 -- 172.21.15.177:0/2320616840 learned_addr learned my addr 172.21.15.177:0/2320616840 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24022e9640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23fc15ca70 0x7f23fc0abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2401ae8640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23fc0b0280 0x7f23fc0c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 -- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23fc0b0280 msgr2=0x7f23fc0c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23fc0b0280 0x7f23fc0c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 -- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23fc15ca70 msgr2=0x7f23fc0abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23fc15ca70 0x7f23fc0abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 -- 172.21.15.177:0/2320616840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0094a0 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2401ae8640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23fc0b0280 0x7f23fc0c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f24012e7640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 0x7f23fc1f5cf0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f23f000ea20 tx=0x7f23f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:02.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0009710 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f23f000ce70 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc0c8a30 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0010690 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.561+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc0c4e20 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.565+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc0c4c80 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.565+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f23f00107f0 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.565+0000 7f23fa7fc640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23e80664a0 0x7f23e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.565+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f23f0014070 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.565+0000 7f2401ae8640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23e80664a0 0x7f23e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.565+0000 7f2401ae8640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23e80664a0 0x7f23e8068960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23f4001700 tx=0x7f23f4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:02.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.569+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f23f0050090 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.729+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23fc04daf0 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.729+0000 7f23fa7fc640 1 -- 172.21.15.177:0/2320616840 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f23fc0c4c80 con 0x7f23fc0cc0a0 2023-10-25T16:18:02.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:02.731 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":94,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:01.904565+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:02.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23e80664a0 msgr2=0x7f23e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23e80664a0 0x7f23e8068960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f23f4001700 tx=0x7f23f4009040 comp rx=0 tx=0).stop 2023-10-25T16:18:02.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 msgr2=0x7f23fc1f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 0x7f23fc1f5cf0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f23f000ea20 tx=0x7f23f000eee0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 shutdown_connections 2023-10-25T16:18:02.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23e80664a0 0x7f23e8068960 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23fc15ca70 0x7f23fc0abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23fc0cc0a0 0x7f23fc1f5cf0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 --2- 172.21.15.177:0/2320616840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23fc0b0280 0x7f23fc0c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 >> 172.21.15.177:0/2320616840 conn(0x7f23fc0983a0 msgr2=0x7f23fc158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:02.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 shutdown_connections 2023-10-25T16:18:02.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.733+0000 7f2403d4c640 1 -- 172.21.15.177:0/2320616840 wait complete. 2023-10-25T16:18:02.750 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:18:02.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:02.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/2136554068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 msgr2=0x7f89dc15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 --2- 172.21.15.177:0/2136554068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc15d400 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009840 tx=0x7f89d001c7c0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/2136554068 shutdown_connections 2023-10-25T16:18:02.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 --2- 172.21.15.177:0/2136554068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc15d400 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/2136554068 >> 172.21.15.177:0/2136554068 conn(0x7f89dc0af3f0 msgr2=0x7f89dc0af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:02.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/2136554068 shutdown_connections 2023-10-25T16:18:02.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/2136554068 wait complete. 2023-10-25T16:18:02.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 Processor -- start 2023-10-25T16:18:02.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- start start 2023-10-25T16:18:02.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89dc0acbf0 0x7f89dc148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89dc159280 0x7f89dc1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc14cd30 con 0x7f89dc0ca930 2023-10-25T16:18:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1542f0 con 0x7f89dc159280 2023-10-25T16:18:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc14cf80 con 0x7f89dc0acbf0 2023-10-25T16:18:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc1538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55342/0 (socket says 172.21.15.177:55342) 2023-10-25T16:18:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 -- 172.21.15.177:0/3016392049 learned_addr learned my addr 172.21.15.177:0/3016392049 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e1c1f640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89dc159280 0x7f89dc1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 -- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89dc0acbf0 msgr2=0x7f89dc148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89dc0acbf0 0x7f89dc148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 -- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89dc159280 msgr2=0x7f89dc1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89dc159280 0x7f89dc1548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 -- 172.21.15.177:0/3016392049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00094a0 con 0x7f89dc0ca930 2023-10-25T16:18:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e0c1d640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc1538a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009790 tx=0x7f89d0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00044f0 con 0x7f89dc0ca930 2023-10-25T16:18:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc14d260 con 0x7f89dc0ca930 2023-10-25T16:18:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f89d0005120 con 0x7f89dc0ca930 2023-10-25T16:18:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0005510 con 0x7f89dc0ca930 2023-10-25T16:18:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.873+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc148ab0 con 0x7f89dc0ca930 2023-10-25T16:18:02.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.877+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc04daf0 con 0x7f89dc0ca930 2023-10-25T16:18:02.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.877+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f89d00b4040 con 0x7f89dc0ca930 2023-10-25T16:18:02.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.877+0000 7f89d9ffb640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89c8066470 0x7f89c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:02.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.877+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f89d011dbe0 con 0x7f89dc0ca930 2023-10-25T16:18:02.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.877+0000 7f89e141e640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89c8066470 0x7f89c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:02.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.877+0000 7f89e141e640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89c8066470 0x7f89c8068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f89cc000f70 tx=0x7f89cc007a40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:02.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:02.881+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f89d00eb030 con 0x7f89dc0ca930 2023-10-25T16:18:03.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89dc14d710 con 0x7f89dc0ca930 2023-10-25T16:18:03.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89d9ffb640 1 -- 172.21.15.177:0/3016392049 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f89d00bc090 con 0x7f89dc0ca930 2023-10-25T16:18:03.065 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:03.065 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:18:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:18:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89c8066470 msgr2=0x7f89c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89c8066470 0x7f89c8068930 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f89cc000f70 tx=0x7f89cc007a40 comp rx=0 tx=0).stop 2023-10-25T16:18:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 msgr2=0x7f89dc1538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc1538a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009790 tx=0x7f89d0004040 comp rx=0 tx=0).stop 2023-10-25T16:18:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 shutdown_connections 2023-10-25T16:18:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f89c8066470 0x7f89c8068930 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89dc159280 0x7f89dc1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89dc0ca930 0x7f89dc1538a0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 --2- 172.21.15.177:0/3016392049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f89dc0acbf0 0x7f89dc148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 >> 172.21.15.177:0/3016392049 conn(0x7f89dc0af3f0 msgr2=0x7f89dc0b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:03.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 shutdown_connections 2023-10-25T16:18:03.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.065+0000 7f89e3682640 1 -- 172.21.15.177:0/3016392049 wait complete. 2023-10-25T16:18:03.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2306186568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac06b980 msgr2=0x7fc2ac06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2306186568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac06b980 0x7fc2ac06be10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009cb0 tx=0x7fc2a401cd50 comp rx=0 tx=0).stop 2023-10-25T16:18:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2306186568 shutdown_connections 2023-10-25T16:18:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2306186568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac06b980 0x7fc2ac06be10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2306186568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac159230 0x7fc2ac071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2306186568 >> 172.21.15.177:0/2306186568 conn(0x7fc2ac0b2450 msgr2=0x7fc2ac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2306186568 shutdown_connections 2023-10-25T16:18:03.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2306186568 wait complete. 2023-10-25T16:18:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 Processor -- start 2023-10-25T16:18:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- start start 2023-10-25T16:18:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 0x7fc2ac14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac070510 0x7fc2ac14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac159230 0x7fc2ac0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac14ed20 con 0x7fc2ac06b980 2023-10-25T16:18:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac14e110 con 0x7fc2ac070510 2023-10-25T16:18:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.209+0000 7fc2b16ff640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac14e3f0 con 0x7fc2ac159230 2023-10-25T16:18:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 0x7fc2ac14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 0x7fc2ac14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55346/0 (socket says 172.21.15.177:55346) 2023-10-25T16:18:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 -- 172.21.15.177:0/2672086556 learned_addr learned my addr 172.21.15.177:0/2672086556 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2ab7fe640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac159230 0x7fc2ac0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aa7fc640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac070510 0x7fc2ac14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 -- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac159230 msgr2=0x7fc2ac0b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac159230 0x7fc2ac0b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 -- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac070510 msgr2=0x7fc2ac14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac070510 0x7fc2ac14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 -- 172.21.15.177:0/2672086556 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40098e0 con 0x7fc2ac06b980 2023-10-25T16:18:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aaffd640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 0x7fc2ac14f1b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00e7a0 tx=0x7fc29c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c009590 con 0x7fc2ac06b980 2023-10-25T16:18:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc29c00cdb0 con 0x7fc2ac06b980 2023-10-25T16:18:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac14e6d0 con 0x7fc2ac06b980 2023-10-25T16:18:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c010690 con 0x7fc2ac06b980 2023-10-25T16:18:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac14af10 con 0x7fc2ac06b980 2023-10-25T16:18:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac04daf0 con 0x7fc2ac06b980 2023-10-25T16:18:03.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc29c0107f0 con 0x7fc2ac06b980 2023-10-25T16:18:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2937fe640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2980664a0 0x7fc298068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc29c014070 con 0x7fc2ac06b980 2023-10-25T16:18:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.213+0000 7fc2aa7fc640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2980664a0 0x7fc298068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.217+0000 7fc2aa7fc640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2980664a0 0x7fc298068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0c95f0 tx=0x7fc2a0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:03.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.217+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc29c052640 con 0x7fc2ac06b980 2023-10-25T16:18:03.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.409+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2ac0cdae0 con 0x7fc2ac06b980 2023-10-25T16:18:03.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.409+0000 7fc2937fe640 1 -- 172.21.15.177:0/2672086556 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fc29c026090 con 0x7fc2ac06b980 2023-10-25T16:18:03.412 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:03.412 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":31,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:17:17.255742+0000","modified":"2023-10-25T16:17:19.253083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155189":{"gid":155189,"name":"b","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/887944818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":887944818},{"type":"v1","addr":"172.21.15.184:6835","nonce":887944818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-10-25T16:18:03.414 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 31 2023-10-25T16:18:03.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2980664a0 msgr2=0x7fc298068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2980664a0 0x7fc298068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0c95f0 tx=0x7fc2a0009040 comp rx=0 tx=0).stop 2023-10-25T16:18:03.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 msgr2=0x7fc2ac14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 0x7fc2ac14f1b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00e7a0 tx=0x7fc29c00ec60 comp rx=0 tx=0).stop 2023-10-25T16:18:03.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 shutdown_connections 2023-10-25T16:18:03.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc2980664a0 0x7fc298068960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2ac159230 0x7fc2ac0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2ac070510 0x7fc2ac14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 --2- 172.21.15.177:0/2672086556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2ac06b980 0x7fc2ac14f1b0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 >> 172.21.15.177:0/2672086556 conn(0x7fc2ac0b2450 msgr2=0x7fc2ac14fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:03.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 shutdown_connections 2023-10-25T16:18:03.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.413+0000 7fc2b16ff640 1 -- 172.21.15.177:0/2672086556 wait complete. 2023-10-25T16:18:03.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:03.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- 172.21.15.177:0/2455956997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 msgr2=0x7f14f800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 --2- 172.21.15.177:0/2455956997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f14f800b990 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f150400c610 tx=0x7f150401d320 comp rx=0 tx=0).stop 2023-10-25T16:18:03.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- 172.21.15.177:0/2455956997 shutdown_connections 2023-10-25T16:18:03.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 --2- 172.21.15.177:0/2455956997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f14f800b990 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- 172.21.15.177:0/2455956997 >> 172.21.15.177:0/2455956997 conn(0x7f150c0afe20 msgr2=0x7f150c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:03.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- 172.21.15.177:0/2455956997 shutdown_connections 2023-10-25T16:18:03.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- 172.21.15.177:0/2455956997 wait complete. 2023-10-25T16:18:03.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 Processor -- start 2023-10-25T16:18:03.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- start start 2023-10-25T16:18:03.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f150c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f150c157020 0x7f150c12e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f150c15adb0 0x7f150c12eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0ab8e0 con 0x7f14f8005190 2023-10-25T16:18:03.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0aacd0 con 0x7f150c15adb0 2023-10-25T16:18:03.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1512790640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0aafb0 con 0x7f150c157020 2023-10-25T16:18:03.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f150c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f150c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55368/0 (socket says 172.21.15.177:55368) 2023-10-25T16:18:03.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 -- 172.21.15.177:0/1462976298 learned_addr learned my addr 172.21.15.177:0/1462976298 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:03.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f1510d2d640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f150c15adb0 0x7f150c12eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f15037fe640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f150c157020 0x7f150c12e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 -- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f150c157020 msgr2=0x7f150c12e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f150c157020 0x7f150c12e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 -- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f150c15adb0 msgr2=0x7f150c12eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f150c15adb0 0x7f150c12eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f150bfff640 1 -- 172.21.15.177:0/1462976298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0ab290 con 0x7f14f8005190 2023-10-25T16:18:03.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.557+0000 7f15037fe640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f150c157020 0x7f150c12e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:03.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f150bfff640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f150c15a870 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00d710 tx=0x7f14fc00dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:03.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc006270 con 0x7f14f8005190 2023-10-25T16:18:03.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f14fc0064c0 con 0x7f14f8005190 2023-10-25T16:18:03.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0106b0 con 0x7f14f8005190 2023-10-25T16:18:03.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c0ab570 con 0x7f14f8005190 2023-10-25T16:18:03.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c1305a0 con 0x7f14f8005190 2023-10-25T16:18:03.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c0ab700 con 0x7f14f8005190 2023-10-25T16:18:03.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14fc010810 con 0x7f14f8005190 2023-10-25T16:18:03.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15097fa640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14ec066470 0x7f14ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f14fc0845d0 con 0x7f14f8005190 2023-10-25T16:18:03.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15037fe640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14ec066470 0x7f14ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.561+0000 7f15037fe640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14ec066470 0x7f14ec068930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f150c157400 tx=0x7f14f4005d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:03.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.565+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14fc051aa0 con 0x7f14f8005190 2023-10-25T16:18:03.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.713+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f150c04daf0 con 0x7f14f8005190 2023-10-25T16:18:03.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.713+0000 7f15097fa640 1 -- 172.21.15.177:0/1462976298 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16689 (secure 0 0 0) 0x7f14fc01d090 con 0x7f14f8005190 2023-10-25T16:18:03.714 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:03.714 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":94,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:01.904565+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:17:15.299639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-25T16:17:16.230820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.4","mappings":[{"from":6,"to":0}]},{"pgid":"11.22","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:03.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14ec066470 msgr2=0x7f14ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14ec066470 0x7f14ec068930 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f150c157400 tx=0x7f14f4005d90 comp rx=0 tx=0).stop 2023-10-25T16:18:03.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 msgr2=0x7f150c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f150c15a870 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00d710 tx=0x7f14fc00dbd0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 shutdown_connections 2023-10-25T16:18:03.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14ec066470 0x7f14ec068930 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f150c15adb0 0x7f150c12eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f150c157020 0x7f150c12e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 --2- 172.21.15.177:0/1462976298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14f8005190 0x7f150c15a870 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 >> 172.21.15.177:0/1462976298 conn(0x7f150c0afe20 msgr2=0x7f150c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:03.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 shutdown_connections 2023-10-25T16:18:03.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.717+0000 7f1512790640 1 -- 172.21.15.177:0/1462976298 wait complete. 2023-10-25T16:18:03.731 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:18:03.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- 172.21.15.177:0/162229082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 msgr2=0x7f573c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- 172.21.15.177:0/162229082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0aebc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f573c0ccde0 tx=0x7f573401ca70 comp rx=0 tx=0).stop 2023-10-25T16:18:03.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- 172.21.15.177:0/162229082 shutdown_connections 2023-10-25T16:18:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- 172.21.15.177:0/162229082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0aebc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- 172.21.15.177:0/162229082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f573c0c9e50 0x7f573c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- 172.21.15.177:0/162229082 >> v2:172.21.15.184:3300/0 conn(0x7f573c1500f0 0x7f573c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- 172.21.15.177:0/162229082 >> 172.21.15.177:0/162229082 conn(0x7f573c0b2450 msgr2=0x7f573c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:03.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- 172.21.15.177:0/162229082 shutdown_connections 2023-10-25T16:18:03.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- 172.21.15.177:0/162229082 wait complete. 2023-10-25T16:18:03.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 Processor -- start 2023-10-25T16:18:03.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- start start 2023-10-25T16:18:03.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f573c0c9e50 0x7f573c1332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f573c1500f0 0x7f573c1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0ad380 con 0x7f573c06bf20 2023-10-25T16:18:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c1507a0 con 0x7f573c0c9e50 2023-10-25T16:18:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f5740b3a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c136180 con 0x7f573c1500f0 2023-10-25T16:18:03.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f573a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.845+0000 7f573a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55394/0 (socket says 172.21.15.177:55394) 2023-10-25T16:18:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 -- 172.21.15.177:0/4121189021 learned_addr learned my addr 172.21.15.177:0/4121189021 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f5739d9b640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f573c0c9e50 0x7f573c1332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 -- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f573c1500f0 msgr2=0x7f573c1473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f573c1500f0 0x7f573c1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 -- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f573c0c9e50 msgr2=0x7f573c1332e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f573c0c9e50 0x7f573c1332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 -- 172.21.15.177:0/4121189021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340098e0 con 0x7f573c06bf20 2023-10-25T16:18:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f573a59c640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0ace40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c970 tx=0x7f572c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:03.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c007bb0 con 0x7f573c06bf20 2023-10-25T16:18:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f572c007e00 con 0x7f573c06bf20 2023-10-25T16:18:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c005280 con 0x7f573c06bf20 2023-10-25T16:18:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c150a60 con 0x7f573c06bf20 2023-10-25T16:18:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c150d40 con 0x7f573c06bf20 2023-10-25T16:18:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c04daf0 con 0x7f573c06bf20 2023-10-25T16:18:03.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f572c0053e0 con 0x7f573c06bf20 2023-10-25T16:18:03.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f572affd640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f571c066470 0x7f571c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:03.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f572c084490 con 0x7f573c06bf20 2023-10-25T16:18:03.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f5739d9b640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f571c066470 0x7f571c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:03.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.849+0000 7f5739d9b640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f571c066470 0x7f571c068930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f573c15cbd0 tx=0x7f5730005c60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:03.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:03.853+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f572c0518d0 con 0x7f573c06bf20 2023-10-25T16:18:04.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.029+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f573c0ad790 con 0x7f573c06bf20 2023-10-25T16:18:04.032 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:18:04.033+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:18:04.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.033+0000 7f572affd640 1 -- 172.21.15.177:0/4121189021 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f572c01d090 con 0x7f573c06bf20 2023-10-25T16:18:04.034 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:18:04.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f571c066470 msgr2=0x7f571c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:04.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f571c066470 0x7f571c068930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f573c15cbd0 tx=0x7f5730005c60 comp rx=0 tx=0).stop 2023-10-25T16:18:04.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 msgr2=0x7f573c0ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:04.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0ace40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c970 tx=0x7f572c00ce30 comp rx=0 tx=0).stop 2023-10-25T16:18:04.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 shutdown_connections 2023-10-25T16:18:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f571c066470 0x7f571c068930 secure :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f573c15cbd0 tx=0x7f5730005c60 comp rx=0 tx=0).stop 2023-10-25T16:18:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f573c1500f0 0x7f573c1473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f573c0c9e50 0x7f573c1332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 --2- 172.21.15.177:0/4121189021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f573c06bf20 0x7f573c0ace40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 >> 172.21.15.177:0/4121189021 conn(0x7f573c0b2450 msgr2=0x7f573c14f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:04.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 shutdown_connections 2023-10-25T16:18:04.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.037+0000 7f5740b3a640 1 -- 172.21.15.177:0/4121189021 wait complete. 2023-10-25T16:18:04.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:18:04.114 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:18:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/3976778267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21840052b0 msgr2=0x7f218400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 --2- 172.21.15.177:0/3976778267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21840052b0 0x7f218400b990 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f2190001d70 tx=0x7f219001cae0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/3976778267 shutdown_connections 2023-10-25T16:18:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 --2- 172.21.15.177:0/3976778267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21840052b0 0x7f218400b990 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/3976778267 >> 172.21.15.177:0/3976778267 conn(0x7f219809a5c0 msgr2=0x7f21980d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/3976778267 shutdown_connections 2023-10-25T16:18:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/3976778267 wait complete. 2023-10-25T16:18:04.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 Processor -- start 2023-10-25T16:18:04.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- start start 2023-10-25T16:18:04.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21840052b0 0x7f2198152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:04.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 0x7f2198153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:04.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21981541b0 0x7f21980c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c6070 con 0x7f21981f1770 2023-10-25T16:18:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21981e5f20 con 0x7f21981541b0 2023-10-25T16:18:04.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c5a20 con 0x7f21840052b0 2023-10-25T16:18:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 0x7f2198153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 0x7f2198153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55414/0 (socket says 172.21.15.177:55414) 2023-10-25T16:18:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 -- 172.21.15.177:0/1099602187 learned_addr learned my addr 172.21.15.177:0/1099602187 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:04.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219e530640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21840052b0 0x7f2198152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219ed31640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21981541b0 0x7f21980c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:04.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 -- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21840052b0 msgr2=0x7f2198152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21840052b0 0x7f2198152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 -- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21981541b0 msgr2=0x7f21980c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:04.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21981541b0 0x7f21980c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:04.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 -- 172.21.15.177:0/1099602187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980c5d00 con 0x7f21981f1770 2023-10-25T16:18:04.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219ed31640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21981541b0 0x7f21980c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:04.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f219dd2f640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 0x7f2198153c70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2188001ba0 tx=0x7f2188012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188013920 con 0x7f21981f1770 2023-10-25T16:18:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2188017070 con 0x7f21981f1770 2023-10-25T16:18:04.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2198152790 con 0x7f21981f1770 2023-10-25T16:18:04.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188013d20 con 0x7f21981f1770 2023-10-25T16:18:04.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21981e6200 con 0x7f21981f1770 2023-10-25T16:18:04.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.177+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219804daf0 con 0x7f21981f1770 2023-10-25T16:18:04.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.181+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2188010480 con 0x7f21981f1770 2023-10-25T16:18:04.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.181+0000 7f218effd640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f217c066470 0x7f217c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:04.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.181+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2188087e40 con 0x7f21981f1770 2023-10-25T16:18:04.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.181+0000 7f219e530640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f217c066470 0x7f217c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:04.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.181+0000 7f219e530640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f217c066470 0x7f217c068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f219400db30 tx=0x7f219400d360 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:04.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.185+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f21880552e0 con 0x7f21981f1770 2023-10-25T16:18:04.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:04.357+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f21980c5e90 con 0x7f21981f1770 2023-10-25T16:18:05.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.045+0000 7f218effd640 1 -- 172.21.15.177:0/1099602187 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21880220a0 con 0x7f21981f1770 2023-10-25T16:18:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f217c066470 msgr2=0x7f217c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f217c066470 0x7f217c068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f219400db30 tx=0x7f219400d360 comp rx=0 tx=0).stop 2023-10-25T16:18:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 msgr2=0x7f2198153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 0x7f2198153c70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2188001ba0 tx=0x7f2188012aa0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 shutdown_connections 2023-10-25T16:18:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f217c066470 0x7f217c068930 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21981541b0 0x7f21980c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21981f1770 0x7f2198153c70 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 --2- 172.21.15.177:0/1099602187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21840052b0 0x7f2198152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 >> 172.21.15.177:0/1099602187 conn(0x7f219809a5c0 msgr2=0x7f21980b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 shutdown_connections 2023-10-25T16:18:05.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.049+0000 7f21a0794640 1 -- 172.21.15.177:0/1099602187 wait complete. 2023-10-25T16:18:05.068 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:18:05.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 -- 172.21.15.177:0/881860641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06cad0 msgr2=0x7fb63c15bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:05.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 --2- 172.21.15.177:0/881860641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06cad0 0x7fb63c15bf20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0b2460 tx=0x7fb63401cd30 comp rx=0 tx=0).stop 2023-10-25T16:18:05.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 -- 172.21.15.177:0/881860641 shutdown_connections 2023-10-25T16:18:05.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 --2- 172.21.15.177:0/881860641 >> v2:172.21.15.184:3300/0 conn(0x7fb63c1593d0 0x7fb63c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 --2- 172.21.15.177:0/881860641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c06cad0 0x7fb63c15bf20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 -- 172.21.15.177:0/881860641 >> 172.21.15.177:0/881860641 conn(0x7fb63c069920 msgr2=0x7fb63c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:05.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 -- 172.21.15.177:0/881860641 shutdown_connections 2023-10-25T16:18:05.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 -- 172.21.15.177:0/881860641 wait complete. 2023-10-25T16:18:05.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 Processor -- start 2023-10-25T16:18:05.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.197+0000 7fb641083640 1 -- start start 2023-10-25T16:18:05.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63c06cad0 0x7fb63c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:05.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 0x7fb63c157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:05.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63c1593d0 0x7fb63c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:05.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1f2620 con 0x7fb63c0cd070 2023-10-25T16:18:05.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c1506d0 con 0x7fb63c06cad0 2023-10-25T16:18:05.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c150970 con 0x7fb63c1593d0 2023-10-25T16:18:05.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 0x7fb63c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:05.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 0x7fb63c157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55444/0 (socket says 172.21.15.177:55444) 2023-10-25T16:18:05.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 -- 172.21.15.177:0/3236488846 learned_addr learned my addr 172.21.15.177:0/3236488846 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:05.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63ad9d640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63c06cad0 0x7fb63c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:05.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63b59e640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63c1593d0 0x7fb63c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:05.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 -- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63c1593d0 msgr2=0x7fb63c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:05.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63c1593d0 0x7fb63c157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 -- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63c06cad0 msgr2=0x7fb63c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63c06cad0 0x7fb63c14ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 -- 172.21.15.177:0/3236488846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340098e0 con 0x7fb63c0cd070 2023-10-25T16:18:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63a59c640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 0x7fb63c157690 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c9f0 tx=0x7fb63000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630007bb0 con 0x7fb63c0cd070 2023-10-25T16:18:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb630007e00 con 0x7fb63c0cd070 2023-10-25T16:18:05.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c150c50 con 0x7fb63c0cd070 2023-10-25T16:18:05.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000f6b0 con 0x7fb63c0cd070 2023-10-25T16:18:05.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c14efa0 con 0x7fb63c0cd070 2023-10-25T16:18:05.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c1f2790 con 0x7fb63c0cd070 2023-10-25T16:18:05.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb63000f810 con 0x7fb63c0cd070 2023-10-25T16:18:05.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb6237fe640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb628066470 0x7fb628068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:05.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb630084780 con 0x7fb63c0cd070 2023-10-25T16:18:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.201+0000 7fb63ad9d640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb628066470 0x7fb628068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.205+0000 7fb63ad9d640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb628066470 0x7fb628068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb6340af000 tx=0x7fb63401b570 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.205+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb63c1f2790 con 0x7fb63c0cd070 2023-10-25T16:18:05.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:05.361+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb63c1f2760 con 0x7fb63c0cd070 2023-10-25T16:18:06.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.049+0000 7fb6237fe640 1 -- 172.21.15.177:0/3236488846 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb630055600 con 0x7fb63c0cd070 2023-10-25T16:18:06.049 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:18:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb628066470 msgr2=0x7fb628068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb628066470 0x7fb628068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb6340af000 tx=0x7fb63401b570 comp rx=0 tx=0).stop 2023-10-25T16:18:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 msgr2=0x7fb63c157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 0x7fb63c157690 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c9f0 tx=0x7fb63000ceb0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 shutdown_connections 2023-10-25T16:18:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb628066470 0x7fb628068930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb63c1593d0 0x7fb63c157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb63c0cd070 0x7fb63c157690 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 --2- 172.21.15.177:0/3236488846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb63c06cad0 0x7fb63c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 >> 172.21.15.177:0/3236488846 conn(0x7fb63c069920 msgr2=0x7fb63c1519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 shutdown_connections 2023-10-25T16:18:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.053+0000 7fb641083640 1 -- 172.21.15.177:0/3236488846 wait complete. 2023-10-25T16:18:06.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:18:06.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 -- 172.21.15.177:0/2409723580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f100039b0 msgr2=0x7f1f10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:06.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/2409723580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f100039b0 0x7f1f10003dd0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009b30 tx=0x7f1f1801d1e0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f27fff640 1 -- 172.21.15.177:0/2409723580 reap_dead start 2023-10-25T16:18:06.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 -- 172.21.15.177:0/2409723580 shutdown_connections 2023-10-25T16:18:06.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 -- 172.21.15.177:0/2409723580 >> 172.21.15.177:0/2409723580 conn(0x7f1f28069920 msgr2=0x7f1f28069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:06.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 -- 172.21.15.177:0/2409723580 shutdown_connections 2023-10-25T16:18:06.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 -- 172.21.15.177:0/2409723580 wait complete. 2023-10-25T16:18:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 Processor -- start 2023-10-25T16:18:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.213+0000 7f1f2e08c640 1 -- start start 2023-10-25T16:18:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f100039b0 0x7f1f28142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:06.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 0x7f1f28097a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:06.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f280c98c0 0x7f1f280c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:06.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28098410 con 0x7f1f281f3ea0 2023-10-25T16:18:06.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280ca280 con 0x7f1f280c98c0 2023-10-25T16:18:06.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28142e50 con 0x7f1f100039b0 2023-10-25T16:18:06.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 0x7f1f28097a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:06.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 0x7f1f28097a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55470/0 (socket says 172.21.15.177:55470) 2023-10-25T16:18:06.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 -- 172.21.15.177:0/3817434959 learned_addr learned my addr 172.21.15.177:0/3817434959 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:06.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f277fe640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f100039b0 0x7f1f28142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:06.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f27fff640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f280c98c0 0x7f1f280c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 -- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f100039b0 msgr2=0x7f1f28142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f100039b0 0x7f1f28142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 -- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f280c98c0 msgr2=0x7f1f280c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f280c98c0 0x7f1f280c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 -- 172.21.15.177:0/3817434959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2809a360 con 0x7f1f281f3ea0 2023-10-25T16:18:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f27fff640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f280c98c0 0x7f1f280c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f26ffd640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 0x7f1f28097a80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00d590 tx=0x7f1f1c00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c012630 con 0x7f1f281f3ea0 2023-10-25T16:18:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1f1c012790 con 0x7f1f281f3ea0 2023-10-25T16:18:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2809a600 con 0x7f1f281f3ea0 2023-10-25T16:18:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c012ba0 con 0x7f1f281f3ea0 2023-10-25T16:18:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f28098620 con 0x7f1f281f3ea0 2023-10-25T16:18:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2809af60 con 0x7f1f281f3ea0 2023-10-25T16:18:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1f1c01b400 con 0x7f1f281f3ea0 2023-10-25T16:18:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f0ffff640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f140664a0 0x7f1f14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f1f1c084050 con 0x7f1f281f3ea0 2023-10-25T16:18:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.217+0000 7f1f277fe640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f140664a0 0x7f1f14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.221+0000 7f1f277fe640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f140664a0 0x7f1f14068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f180ae000 tx=0x7f1f18019f80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.221+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f1c0515f0 con 0x7f1f281f3ea0 2023-10-25T16:18:06.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:06.381+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f2806b5f0 con 0x7f1f281f3ea0 2023-10-25T16:18:07.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.057+0000 7f1f0ffff640 1 -- 172.21.15.177:0/3817434959 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1f1c054c10 con 0x7f1f281f3ea0 2023-10-25T16:18:07.059 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:18:07.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f140664a0 msgr2=0x7f1f14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f140664a0 0x7f1f14068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f180ae000 tx=0x7f1f18019f80 comp rx=0 tx=0).stop 2023-10-25T16:18:07.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 msgr2=0x7f1f28097a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 0x7f1f28097a80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00d590 tx=0x7f1f1c00da50 comp rx=0 tx=0).stop 2023-10-25T16:18:07.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 shutdown_connections 2023-10-25T16:18:07.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1f140664a0 0x7f1f14068960 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f280c98c0 0x7f1f280c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f281f3ea0 0x7f1f28097a80 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 --2- 172.21.15.177:0/3817434959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f100039b0 0x7f1f28142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 >> 172.21.15.177:0/3817434959 conn(0x7f1f28069920 msgr2=0x7f1f28159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:07.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 shutdown_connections 2023-10-25T16:18:07.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.065+0000 7f1f2e08c640 1 -- 172.21.15.177:0/3817434959 wait complete. 2023-10-25T16:18:07.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:18:07.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2854482899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006f570 msgr2=0x7fbfc00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2854482899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006f570 0x7fbfc00cb5c0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009900 tx=0x7fbfb001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2854482899 shutdown_connections 2023-10-25T16:18:07.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2854482899 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006f570 0x7fbfc00cb5c0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2854482899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfc006c090 0x7fbfc00af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2854482899 >> 172.21.15.177:0/2854482899 conn(0x7fbfc00b2450 msgr2=0x7fbfc00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:07.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2854482899 shutdown_connections 2023-10-25T16:18:07.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2854482899 wait complete. 2023-10-25T16:18:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 Processor -- start 2023-10-25T16:18:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- start start 2023-10-25T16:18:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 0x7fbfc0071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfc006f570 0x7fbfc013bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0140e90 0x7fbfc00abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00a92d0 con 0x7fbfc006c090 2023-10-25T16:18:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00ab1e0 con 0x7fbfc0140e90 2023-10-25T16:18:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc65b6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00ab7a0 con 0x7fbfc006f570 2023-10-25T16:18:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfbffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 0x7fbfc0071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfbffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 0x7fbfc0071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55500/0 (socket says 172.21.15.177:55500) 2023-10-25T16:18:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfbffff640 1 -- 172.21.15.177:0/2288091348 learned_addr learned my addr 172.21.15.177:0/2288091348 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfbf7fe640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfc006f570 0x7fbfc013bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.217+0000 7fbfc4b53640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0140e90 0x7fbfc00abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbffff640 1 -- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfc006f570 msgr2=0x7fbfc013bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbffff640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfc006f570 0x7fbfc013bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbffff640 1 -- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0140e90 msgr2=0x7fbfc00abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbffff640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0140e90 0x7fbfc00abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbffff640 1 -- 172.21.15.177:0/2288091348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009560 con 0x7fbfc006c090 2023-10-25T16:18:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbffff640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 0x7fbfc0071300 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800b410 tx=0x7fbfb800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004020 con 0x7fbfc006c090 2023-10-25T16:18:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbfb8004270 con 0x7fbfc006c090 2023-10-25T16:18:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0071840 con 0x7fbfc006c090 2023-10-25T16:18:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011890 con 0x7fbfc006c090 2023-10-25T16:18:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc00a8d10 con 0x7fbfc006c090 2023-10-25T16:18:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc004daf0 con 0x7fbfc006c090 2023-10-25T16:18:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbfb8003600 con 0x7fbfc006c090 2023-10-25T16:18:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbcff9640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbfa0066470 0x7fbfa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbfb8083bd0 con 0x7fbfc006c090 2023-10-25T16:18:07.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbf7fe640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbfa0066470 0x7fbfa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.221+0000 7fbfbf7fe640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbfa0066470 0x7fbfa0068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00c93c0 tx=0x7fbfa8009430 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:07.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.225+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbfb8051350 con 0x7fbfc006c090 2023-10-25T16:18:07.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.377+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7fbfc00ca670 con 0x7fbfc006c090 2023-10-25T16:18:07.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfbcff9640 1 -- 172.21.15.177:0/2288091348 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v26) v1 ==== 71+0+0 (secure 0 0 0) 0x7fbfb8054970 con 0x7fbfc006c090 2023-10-25T16:18:07.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbfa0066470 msgr2=0x7fbfa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbfa0066470 0x7fbfa0068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00c93c0 tx=0x7fbfa8009430 comp rx=0 tx=0).stop 2023-10-25T16:18:07.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 msgr2=0x7fbfc0071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 0x7fbfc0071300 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800b410 tx=0x7fbfb800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 shutdown_connections 2023-10-25T16:18:07.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbfa0066470 0x7fbfa0068930 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0140e90 0x7fbfc00abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbfc006f570 0x7fbfc013bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 --2- 172.21.15.177:0/2288091348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfc006c090 0x7fbfc0071300 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 >> 172.21.15.177:0/2288091348 conn(0x7fbfc00b2450 msgr2=0x7fbfc00ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:07.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 shutdown_connections 2023-10-25T16:18:07.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.389+0000 7fbfc65b6640 1 -- 172.21.15.177:0/2288091348 wait complete. 2023-10-25T16:18:07.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-10-25T16:18:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 -- 172.21.15.177:0/3124620295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406f570 msgr2=0x7fe2b40cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 --2- 172.21.15.177:0/3124620295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406f570 0x7fe2b40cb5c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40ca640 tx=0x7fe2ac01cab0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 -- 172.21.15.177:0/3124620295 shutdown_connections 2023-10-25T16:18:07.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 --2- 172.21.15.177:0/3124620295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406f570 0x7fe2b40cb5c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 --2- 172.21.15.177:0/3124620295 >> v2:172.21.15.184:3300/0 conn(0x7fe2b406c090 0x7fe2b40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 -- 172.21.15.177:0/3124620295 >> 172.21.15.177:0/3124620295 conn(0x7fe2b40b2450 msgr2=0x7fe2b40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:07.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 -- 172.21.15.177:0/3124620295 shutdown_connections 2023-10-25T16:18:07.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.529+0000 7fe2bba71640 1 -- 172.21.15.177:0/3124620295 wait complete. 2023-10-25T16:18:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 Processor -- start 2023-10-25T16:18:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- start start 2023-10-25T16:18:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 0x7fe2b413b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2b406f570 0x7fe2b40a8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2b4140e90 0x7fe2b413ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40aa9b0 con 0x7fe2b406c090 2023-10-25T16:18:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b413bf80 con 0x7fe2b4140e90 2023-10-25T16:18:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40a8900 con 0x7fe2b406f570 2023-10-25T16:18:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 0x7fe2b413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 0x7fe2b413b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55508/0 (socket says 172.21.15.177:55508) 2023-10-25T16:18:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 -- 172.21.15.177:0/969325841 learned_addr learned my addr 172.21.15.177:0/969325841 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:07.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b900c640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2b406f570 0x7fe2b40a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 -- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2b406f570 msgr2=0x7fe2b40a8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2b406f570 0x7fe2b40a8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 -- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2b4140e90 msgr2=0x7fe2b413ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:07.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2b4140e90 0x7fe2b413ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:07.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 -- 172.21.15.177:0/969325841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac009820 con 0x7fe2b406c090 2023-10-25T16:18:07.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2b980d640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 0x7fe2b413b210 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c390 tx=0x7fe2b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:07.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0011790 con 0x7fe2b406c090 2023-10-25T16:18:07.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe2b00119e0 con 0x7fe2b406c090 2023-10-25T16:18:07.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b40a8be0 con 0x7fe2b406c090 2023-10-25T16:18:07.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0011dd0 con 0x7fe2b406c090 2023-10-25T16:18:07.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b40aa1f0 con 0x7fe2b406c090 2023-10-25T16:18:07.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.533+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b40aa410 con 0x7fe2b406c090 2023-10-25T16:18:07.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.537+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2b001c460 con 0x7fe2b406c090 2023-10-25T16:18:07.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.537+0000 7fe2aa7fc640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2980664a0 0x7fe298068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:07.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.537+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2b0083dd0 con 0x7fe2b406c090 2023-10-25T16:18:07.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.537+0000 7fe2b900c640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2980664a0 0x7fe298068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:07.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.537+0000 7fe2b900c640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2980664a0 0x7fe298068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005870 tx=0x7fe2a40057e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:07.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.541+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2b00513a0 con 0x7fe2b406c090 2023-10-25T16:18:07.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:07.741+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fe2b415bf00 con 0x7fe2b406c090 2023-10-25T16:18:08.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.061+0000 7fe2aa7fc640 1 -- 172.21.15.177:0/969325841 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v265) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe2b00549c0 con 0x7fe2b406c090 2023-10-25T16:18:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2980664a0 msgr2=0x7fe298068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2980664a0 0x7fe298068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005870 tx=0x7fe2a40057e0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 msgr2=0x7fe2b413b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 0x7fe2b413b210 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c390 tx=0x7fe2b000c850 comp rx=0 tx=0).stop 2023-10-25T16:18:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 shutdown_connections 2023-10-25T16:18:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2980664a0 0x7fe298068960 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2b4140e90 0x7fe2b413ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2b406f570 0x7fe2b40a8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 --2- 172.21.15.177:0/969325841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b406c090 0x7fe2b413b210 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 >> 172.21.15.177:0/969325841 conn(0x7fe2b40b2450 msgr2=0x7fe2b40aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 shutdown_connections 2023-10-25T16:18:08.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.065+0000 7fe2bba71640 1 -- 172.21.15.177:0/969325841 wait complete. 2023-10-25T16:18:08.085 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-25T16:18:08.086 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-10-25T16:18:08.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/2688417654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d3006c0f0 msgr2=0x7f7d300706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 --2- 172.21.15.177:0/2688417654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d3006c0f0 0x7f7d300706f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009c80 tx=0x7f7d2801cd50 comp rx=0 tx=0).stop 2023-10-25T16:18:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/2688417654 shutdown_connections 2023-10-25T16:18:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 --2- 172.21.15.177:0/2688417654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d3006c0f0 0x7f7d300706f0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 --2- 172.21.15.177:0/2688417654 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d301500f0 0x7f7d300c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/2688417654 >> 172.21.15.177:0/2688417654 conn(0x7f7d300b2450 msgr2=0x7f7d300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/2688417654 shutdown_connections 2023-10-25T16:18:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/2688417654 wait complete. 2023-10-25T16:18:08.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 Processor -- start 2023-10-25T16:18:08.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- start start 2023-10-25T16:18:08.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d3006c0f0 0x7f7d300b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d300c9e50 0x7f7d301f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 0x7f7d30145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30150940 con 0x7f7d301500f0 2023-10-25T16:18:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30150c20 con 0x7f7d300c9e50 2023-10-25T16:18:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30150f00 con 0x7f7d3006c0f0 2023-10-25T16:18:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 0x7f7d30145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 0x7f7d30145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55522/0 (socket says 172.21.15.177:55522) 2023-10-25T16:18:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 -- 172.21.15.177:0/1722956938 learned_addr learned my addr 172.21.15.177:0/1722956938 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2effd640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d3006c0f0 0x7f7d300b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2e7fc640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d300c9e50 0x7f7d301f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 -- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d3006c0f0 msgr2=0x7f7d300b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d3006c0f0 0x7f7d300b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 -- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d300c9e50 msgr2=0x7f7d301f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d300c9e50 0x7f7d301f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 -- 172.21.15.177:0/1722956938 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280098e0 con 0x7f7d301500f0 2023-10-25T16:18:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2effd640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d3006c0f0 0x7f7d300b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d2f7fe640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 0x7f7d30145360 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009bd0 tx=0x7f7d280093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280bc070 con 0x7f7d301500f0 2023-10-25T16:18:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d280aeb30 con 0x7f7d301500f0 2023-10-25T16:18:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d301511e0 con 0x7f7d301500f0 2023-10-25T16:18:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28004000 con 0x7f7d301500f0 2023-10-25T16:18:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.217+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301f4e40 con 0x7f7d301500f0 2023-10-25T16:18:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.221+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3004daf0 con 0x7f7d301500f0 2023-10-25T16:18:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.221+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d280b4040 con 0x7f7d301500f0 2023-10-25T16:18:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.221+0000 7f7d177fe640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.221+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7d2811e750 con 0x7f7d301500f0 2023-10-25T16:18:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.221+0000 7f7d2effd640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.221+0000 7f7d2effd640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d1c066470 0x7f7d1c068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7d20005fd0 tx=0x7f7d20005da0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.225+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d280ebed0 con 0x7f7d301500f0 2023-10-25T16:18:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.381+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d30069e70 con 0x7f7d301500f0 2023-10-25T16:18:08.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.381+0000 7f7d177fe640 1 -- 172.21.15.177:0/1722956938 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13011 (secure 0 0 0) 0x7f7d280b2020 con 0x7f7d301500f0 2023-10-25T16:18:08.382 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:08.382 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":97,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:07.051112+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6835/887944818":"2023-10-26T16:18:04.033833+0000","172.21.15.184:6834/887944818":"2023-10-26T16:18:04.033833+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:08.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d1c066470 msgr2=0x7f7d1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d1c066470 0x7f7d1c068930 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7d20005fd0 tx=0x7f7d20005da0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 msgr2=0x7f7d30145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 0x7f7d30145360 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009bd0 tx=0x7f7d280093d0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 shutdown_connections 2023-10-25T16:18:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d1c066470 0x7f7d1c068930 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d301500f0 0x7f7d30145360 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d300c9e50 0x7f7d301f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 --2- 172.21.15.177:0/1722956938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d3006c0f0 0x7f7d300b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 >> 172.21.15.177:0/1722956938 conn(0x7f7d300b2450 msgr2=0x7f7d300b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 shutdown_connections 2023-10-25T16:18:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.385+0000 7f7d352a6640 1 -- 172.21.15.177:0/1722956938 wait complete. 2023-10-25T16:18:08.401 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:18:08.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:18:08.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/1216249095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd8004d10 msgr2=0x7f0cd8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/1216249095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cd8004d10 0x7f0cd8005190 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009ee0 tx=0x7f0ce801d5b0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 -- 172.21.15.177:0/1216249095 reap_dead start 2023-10-25T16:18:08.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/1216249095 shutdown_connections 2023-10-25T16:18:08.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/1216249095 >> 172.21.15.177:0/1216249095 conn(0x7f0cf00b2450 msgr2=0x7f0cf00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:08.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/1216249095 shutdown_connections 2023-10-25T16:18:08.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/1216249095 wait complete. 2023-10-25T16:18:08.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 Processor -- start 2023-10-25T16:18:08.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- start start 2023-10-25T16:18:08.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0cd8004d10 0x7f0cf0141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cf0144a90 0x7f0cf014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 0x7f0cf00cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf014a380 con 0x7f0cf0148e00 2023-10-25T16:18:08.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0149700 con 0x7f0cf0144a90 2023-10-25T16:18:08.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf01499e0 con 0x7f0cd8004d10 2023-10-25T16:18:08.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 0x7f0cf00cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 0x7f0cf00cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55546/0 (socket says 172.21.15.177:55546) 2023-10-25T16:18:08.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 -- 172.21.15.177:0/2163923337 learned_addr learned my addr 172.21.15.177:0/2163923337 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:08.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf49c6640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0cd8004d10 0x7f0cf0141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0ce7fff640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cf0144a90 0x7f0cf014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 -- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0cd8004d10 msgr2=0x7f0cf0141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0cd8004d10 0x7f0cf0141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 -- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cf0144a90 msgr2=0x7f0cf014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cf0144a90 0x7f0cf014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 -- 172.21.15.177:0/2163923337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0149cc0 con 0x7f0cf0148e00 2023-10-25T16:18:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf49c6640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0cd8004d10 0x7f0cf0141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf51c7640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 0x7f0cf00cad80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0ce801d020 tx=0x7f0ce8004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80b7070 con 0x7f0cf0148e00 2023-10-25T16:18:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ce8009200 con 0x7f0cf0148e00 2023-10-25T16:18:08.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf0149fa0 con 0x7f0cf0148e00 2023-10-25T16:18:08.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8003ba0 con 0x7f0cf0148e00 2023-10-25T16:18:08.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.537+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf014ace0 con 0x7f0cf0148e00 2023-10-25T16:18:08.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.541+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf014a130 con 0x7f0cf0148e00 2023-10-25T16:18:08.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.541+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ce8003d00 con 0x7f0cf0148e00 2023-10-25T16:18:08.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.541+0000 7f0ce57fa640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0cdc0664a0 0x7f0cdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.541+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0ce811ec00 con 0x7f0cf0148e00 2023-10-25T16:18:08.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.541+0000 7f0cf49c6640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0cdc0664a0 0x7f0cdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.541+0000 7f0cf49c6640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0cdc0664a0 0x7f0cdc068960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009b70 tx=0x7f0cec0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:08.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.545+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ce8125080 con 0x7f0cf0148e00 2023-10-25T16:18:08.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cf004daf0 con 0x7f0cf0148e00 2023-10-25T16:18:08.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0ce57fa640 1 -- 172.21.15.177:0/2163923337 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ce80ad0a0 con 0x7f0cf0148e00 2023-10-25T16:18:08.700 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:18:08.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0cdc0664a0 msgr2=0x7f0cdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0cdc0664a0 0x7f0cdc068960 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009b70 tx=0x7f0cec0091e0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 msgr2=0x7f0cf00cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 0x7f0cf00cad80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0ce801d020 tx=0x7f0ce8004ef0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 shutdown_connections 2023-10-25T16:18:08.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0cdc0664a0 0x7f0cdc068960 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cf0148e00 0x7f0cf00cad80 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cf0144a90 0x7f0cf014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 --2- 172.21.15.177:0/2163923337 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0cd8004d10 0x7f0cf0141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 >> 172.21.15.177:0/2163923337 conn(0x7f0cf00b2450 msgr2=0x7f0cf0156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:08.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 shutdown_connections 2023-10-25T16:18:08.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.701+0000 7f0cf6c2a640 1 -- 172.21.15.177:0/2163923337 wait complete. 2023-10-25T16:18:08.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-25T16:18:08.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- 172.21.15.177:0/3887267746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 msgr2=0x7f1c200cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3887267746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c200cdf80 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1c2009f200 tx=0x7f1c1801cc90 comp rx=0 tx=0).stop 2023-10-25T16:18:08.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- 172.21.15.177:0/3887267746 shutdown_connections 2023-10-25T16:18:08.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3887267746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c200cdf80 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3887267746 >> v2:172.21.15.184:3300/0 conn(0x7f1c200b2120 0x7f1c200b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- 172.21.15.177:0/3887267746 >> 172.21.15.177:0/3887267746 conn(0x7f1c2009a5c0 msgr2=0x7f1c200d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:08.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- 172.21.15.177:0/3887267746 shutdown_connections 2023-10-25T16:18:08.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- 172.21.15.177:0/3887267746 wait complete. 2023-10-25T16:18:08.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 Processor -- start 2023-10-25T16:18:08.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- start start 2023-10-25T16:18:08.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c200b2120 0x7f1c20151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c20159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2015eba0 0x7f1c200c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20151d60 con 0x7f1c200cdb10 2023-10-25T16:18:08.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20152940 con 0x7f1c2015eba0 2023-10-25T16:18:08.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c254f1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c20159e60 con 0x7f1c200b2120 2023-10-25T16:18:08.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c20159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c20159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55574/0 (socket says 172.21.15.177:55574) 2023-10-25T16:18:08.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 -- 172.21.15.177:0/3985111223 learned_addr learned my addr 172.21.15.177:0/3985111223 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:08.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1f7fe640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2015eba0 0x7f1c200c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1effd640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c200b2120 0x7f1c20151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 -- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c200b2120 msgr2=0x7f1c20151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c200b2120 0x7f1c20151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 -- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2015eba0 msgr2=0x7f1c200c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:08.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2015eba0 0x7f1c200c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:08.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 -- 172.21.15.177:0/3985111223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c180098e0 con 0x7f1c200cdb10 2023-10-25T16:18:08.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c1e7fc640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c20159410 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c970 tx=0x7f1c1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:08.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.841+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14007c70 con 0x7f1c200cdb10 2023-10-25T16:18:08.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c1400f450 con 0x7f1c200cdb10 2023-10-25T16:18:08.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2015a140 con 0x7f1c200cdb10 2023-10-25T16:18:08.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400f860 con 0x7f1c200cdb10 2023-10-25T16:18:08.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2015a700 con 0x7f1c200cdb10 2023-10-25T16:18:08.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c201527a0 con 0x7f1c200cdb10 2023-10-25T16:18:08.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1c14018400 con 0x7f1c200cdb10 2023-10-25T16:18:08.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c077fe640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c0c066470 0x7f1c0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:08.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c140845f0 con 0x7f1c200cdb10 2023-10-25T16:18:08.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c1effd640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c0c066470 0x7f1c0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:08.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.845+0000 7f1c1effd640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c0c066470 0x7f1c0c068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000a750 tx=0x7f1c10008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:08.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:08.849+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1c14051ee0 con 0x7f1c200cdb10 2023-10-25T16:18:09.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.057+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f1c201527a0 con 0x7f1c200cdb10 2023-10-25T16:18:09.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.077+0000 7f1c077fe640 1 -- 172.21.15.177:0/3985111223 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v266) v1 ==== 140+0+0 (secure 0 0 0) 0x7f1c201527a0 con 0x7f1c200cdb10 2023-10-25T16:18:09.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.077+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c0c066470 msgr2=0x7f1c0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.077+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c0c066470 0x7f1c0c068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000a750 tx=0x7f1c10008040 comp rx=0 tx=0).stop 2023-10-25T16:18:09.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.077+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 msgr2=0x7f1c20159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.077+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c20159410 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c970 tx=0x7f1c1400ce30 comp rx=0 tx=0).stop 2023-10-25T16:18:09.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 shutdown_connections 2023-10-25T16:18:09.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c0c066470 0x7f1c0c068930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2015eba0 0x7f1c200c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c200cdb10 0x7f1c20159410 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 --2- 172.21.15.177:0/3985111223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c200b2120 0x7f1c20151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 >> 172.21.15.177:0/3985111223 conn(0x7f1c2009a5c0 msgr2=0x7f1c2015b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:09.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 shutdown_connections 2023-10-25T16:18:09.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.081+0000 7f1c254f1640 1 -- 172.21.15.177:0/3985111223 wait complete. 2023-10-25T16:18:09.096 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-10-25T16:18:09.229 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_objectstore":"memstore"} 2023-10-25T16:18:09.230 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-10-25T16:18:09.230 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:18:09.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 -- 172.21.15.177:0/2790673980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 msgr2=0x7f123c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 --2- 172.21.15.177:0/2790673980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c0aebc0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f123c06c7b0 tx=0x7f122401c730 comp rx=0 tx=0).stop 2023-10-25T16:18:09.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 -- 172.21.15.177:0/2790673980 shutdown_connections 2023-10-25T16:18:09.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 --2- 172.21.15.177:0/2790673980 >> v2:172.21.15.184:3300/0 conn(0x7f123c0af100 0x7f123c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 --2- 172.21.15.177:0/2790673980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c0aebc0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 -- 172.21.15.177:0/2790673980 >> 172.21.15.177:0/2790673980 conn(0x7f123c0b2450 msgr2=0x7f123c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 -- 172.21.15.177:0/2790673980 shutdown_connections 2023-10-25T16:18:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 -- 172.21.15.177:0/2790673980 wait complete. 2023-10-25T16:18:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 Processor -- start 2023-10-25T16:18:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 -- start start 2023-10-25T16:18:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f123c0af100 0x7f123c1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.349+0000 7f1241f53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f123c14e810 0x7f123c14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1241f53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c14b990 con 0x7f123c0cbfa0 2023-10-25T16:18:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1241f53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c147d30 con 0x7f123c0af100 2023-10-25T16:18:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1241f53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c14ad80 con 0x7f123c14e810 2023-10-25T16:18:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55578/0 (socket says 172.21.15.177:55578) 2023-10-25T16:18:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 -- 172.21.15.177:0/618443239 learned_addr learned my addr 172.21.15.177:0/618443239 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123b7fe640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f123c0af100 0x7f123c1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 -- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f123c14e810 msgr2=0x7f123c14be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f123c14e810 0x7f123c14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 -- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f123c0af100 msgr2=0x7f123c1477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f123c0af100 0x7f123c1477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 -- 172.21.15.177:0/618443239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009450 con 0x7f123c0cbfa0 2023-10-25T16:18:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123affd640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c154be0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f1224009790 tx=0x7f1224003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240b6070 con 0x7f123c0cbfa0 2023-10-25T16:18:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1224005c40 con 0x7f123c0cbfa0 2023-10-25T16:18:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c14b060 con 0x7f123c0cbfa0 2023-10-25T16:18:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224005030 con 0x7f123c0cbfa0 2023-10-25T16:18:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c14b620 con 0x7f123c0cbfa0 2023-10-25T16:18:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c14b7b0 con 0x7f123c0cbfa0 2023-10-25T16:18:09.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1224005190 con 0x7f123c0cbfa0 2023-10-25T16:18:09.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1233fff640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f121c0664a0 0x7f121c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f122411e3c0 con 0x7f123c0cbfa0 2023-10-25T16:18:09.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123b7fe640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f121c0664a0 0x7f121c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.353+0000 7f123b7fe640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f121c0664a0 0x7f121c068960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f122c001600 tx=0x7f122c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:09.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.357+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12240ebbd0 con 0x7f123c0cbfa0 2023-10-25T16:18:09.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.501+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f123c04daf0 con 0x7f123c0cbfa0 2023-10-25T16:18:09.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1233fff640 1 -- 172.21.15.177:0/618443239 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v26) v1 ==== 59+0+1116 (secure 0 0 0) 0x7f12240ef1f0 con 0x7f123c0cbfa0 2023-10-25T16:18:09.504 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:18:09.504 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:18:09.504 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:18:09.504 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:18:09.504 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:18:09.505 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:18:09.505 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:18:09.505 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:18:09.505 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:18:09.505 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:18:09.506 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:18:09.506 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:18:09.506 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:18:09.506 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:18:09.506 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:18:09.507 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:18:09.507 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:18:09.507 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:18:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f121c0664a0 msgr2=0x7f121c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f121c0664a0 0x7f121c068960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f122c001600 tx=0x7f122c009040 comp rx=0 tx=0).stop 2023-10-25T16:18:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 msgr2=0x7f123c154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c154be0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f1224009790 tx=0x7f1224003d20 comp rx=0 tx=0).stop 2023-10-25T16:18:09.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 shutdown_connections 2023-10-25T16:18:09.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f121c0664a0 0x7f121c068960 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f123c14e810 0x7f123c14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f123c0cbfa0 0x7f123c154be0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 --2- 172.21.15.177:0/618443239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f123c0af100 0x7f123c1477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 >> 172.21.15.177:0/618443239 conn(0x7f123c0b2450 msgr2=0x7f123c0c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:09.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 shutdown_connections 2023-10-25T16:18:09.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.505+0000 7f1241f53640 1 -- 172.21.15.177:0/618443239 wait complete. 2023-10-25T16:18:09.521 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:18:09.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 -- 172.21.15.177:0/1959982467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc15b480 msgr2=0x7ff4fc15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 --2- 172.21.15.177:0/1959982467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc15b480 0x7ff4fc15c370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009900 tx=0x7ff4ec01c770 comp rx=0 tx=0).stop 2023-10-25T16:18:09.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 -- 172.21.15.177:0/1959982467 shutdown_connections 2023-10-25T16:18:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 --2- 172.21.15.177:0/1959982467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc0cb5f0 0x7ff4fc06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 --2- 172.21.15.177:0/1959982467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc15b480 0x7ff4fc15c370 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 -- 172.21.15.177:0/1959982467 >> 172.21.15.177:0/1959982467 conn(0x7ff4fc0b2450 msgr2=0x7ff4fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 -- 172.21.15.177:0/1959982467 shutdown_connections 2023-10-25T16:18:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.637+0000 7ff50086c640 1 -- 172.21.15.177:0/1959982467 wait complete. 2023-10-25T16:18:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 Processor -- start 2023-10-25T16:18:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- start start 2023-10-25T16:18:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc0c9910 0x7ff4fc14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 0x7ff4fc15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc15b480 0x7ff4fc150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc1518f0 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc14c260 con 0x7ff4fc0c9910 2023-10-25T16:18:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc14c540 con 0x7ff4fc15b480 2023-10-25T16:18:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 0x7ff4fc15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 0x7ff4fc15d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55580/0 (socket says 172.21.15.177:55580) 2023-10-25T16:18:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 -- 172.21.15.177:0/1923450788 learned_addr learned my addr 172.21.15.177:0/1923450788 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4fa59c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc0c9910 0x7ff4fc14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4fad9d640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc15b480 0x7ff4fc150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 -- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc15b480 msgr2=0x7ff4fc150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc15b480 0x7ff4fc150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 -- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc0c9910 msgr2=0x7ff4fc14d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc0c9910 0x7ff4fc14d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 -- 172.21.15.177:0/1923450788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009560 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4fa59c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc0c9910 0x7ff4fc14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4fad9d640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc15b480 0x7ff4fc150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4f9d9b640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 0x7ff4fc15d130 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e9f0 tx=0x7ff4f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0009710 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4f000ce70 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc14c820 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0010670 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc152f90 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc04daf0 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4f00107d0 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4eaffd640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.641+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4f0014070 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.645+0000 7ff4fa59c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.645+0000 7ff4fa59c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0af000 tx=0x7ff4ec01afb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.645+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4f0050090 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.793+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff4fc1660e0 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff4eaffd640 1 -- 172.21.15.177:0/1923450788 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v27)=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4f0055a90 con 0x7ff4fc0cb5f0 2023-10-25T16:18:09.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 msgr2=0x7ff4dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0af000 tx=0x7ff4ec01afb0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 msgr2=0x7ff4fc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 0x7ff4fc15d130 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000e9f0 tx=0x7ff4f000eeb0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 shutdown_connections 2023-10-25T16:18:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4fc15b480 0x7ff4fc150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4fc0cb5f0 0x7ff4fc15d130 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 --2- 172.21.15.177:0/1923450788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc0c9910 0x7ff4fc14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 >> 172.21.15.177:0/1923450788 conn(0x7ff4fc0b2450 msgr2=0x7ff4fc0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 shutdown_connections 2023-10-25T16:18:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:09.801+0000 7ff50086c640 1 -- 172.21.15.177:0/1923450788 wait complete. 2023-10-25T16:18:09.818 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:18:09.818 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:18:09.868 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:18:09.935 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:18:09.936 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:09.936 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:09.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:18:09.942 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:18:09.942 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:09.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:18:09.948 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:09.949 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:09.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:18:09.988 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:18:09.989 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:09.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:18:09.995 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:18:09.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/3116229351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 msgr2=0x7fca9815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 --2- 172.21.15.177:0/3116229351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9815afb0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fca88009930 tx=0x7fca8801c7c0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/3116229351 shutdown_connections 2023-10-25T16:18:10.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 --2- 172.21.15.177:0/3116229351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca9806c180 0x7fca980aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 --2- 172.21.15.177:0/3116229351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9815afb0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/3116229351 >> 172.21.15.177:0/3116229351 conn(0x7fca980b2450 msgr2=0x7fca980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:10.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/3116229351 shutdown_connections 2023-10-25T16:18:10.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/3116229351 wait complete. 2023-10-25T16:18:10.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 Processor -- start 2023-10-25T16:18:10.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- start start 2023-10-25T16:18:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca9806c180 0x7fca98155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca980c9df0 0x7fca981522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98153b70 con 0x7fca9815bbe0 2023-10-25T16:18:10.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98152830 con 0x7fca9806c180 2023-10-25T16:18:10.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9814e0f0 con 0x7fca980c9df0 2023-10-25T16:18:10.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:10.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55600/0 (socket says 172.21.15.177:55600) 2023-10-25T16:18:10.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 -- 172.21.15.177:0/991910806 learned_addr learned my addr 172.21.15.177:0/991910806 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:10.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca96ffd640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca980c9df0 0x7fca981522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:10.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca977fe640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca9806c180 0x7fca98155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:10.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 -- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca980c9df0 msgr2=0x7fca981522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca980c9df0 0x7fca981522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 -- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca9806c180 msgr2=0x7fca98155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca9806c180 0x7fca98155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 -- 172.21.15.177:0/991910806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009560 con 0x7fca9815bbe0 2023-10-25T16:18:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca97fff640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9814dbb0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fca9000b9e0 tx=0x7fca9000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000cb20 con 0x7fca9815bbe0 2023-10-25T16:18:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca9000cd70 con 0x7fca9815bbe0 2023-10-25T16:18:10.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca98152ad0 con 0x7fca9815bbe0 2023-10-25T16:18:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca900146a0 con 0x7fca9815bbe0 2023-10-25T16:18:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.161+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98153090 con 0x7fca9815bbe0 2023-10-25T16:18:10.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.165+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca980ca770 con 0x7fca9815bbe0 2023-10-25T16:18:10.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.165+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca9001d3b0 con 0x7fca9815bbe0 2023-10-25T16:18:10.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.165+0000 7fca8ffff640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.165+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca90083de0 con 0x7fca9815bbe0 2023-10-25T16:18:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.165+0000 7fca977fe640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.165+0000 7fca977fe640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fca880af000 tx=0x7fca8801b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:10.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.169+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca900514c0 con 0x7fca9815bbe0 2023-10-25T16:18:10.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.353+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca9804daf0 con 0x7fca9815bbe0 2023-10-25T16:18:10.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca8ffff640 1 -- 172.21.15.177:0/991910806 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3708 (secure 0 0 0) 0x7fca90019020 con 0x7fca9815bbe0 2023-10-25T16:18:10.356 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:10.356 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5650,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1300793227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":1300793227},{"type":"v1","addr":"172.21.15.184:6837","nonce":1300793227}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5851,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/400146164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":400146164},{"type":"v1","addr":"172.21.15.184:6835","nonce":400146164}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/1069998822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":1069998822},{"type":"v1","addr":"172.21.15.177:6833","nonce":1069998822}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1453638019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1453638019},{"type":"v1","addr":"172.21.15.177:6835","nonce":1453638019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-10-25T16:18:10.357 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 33 2023-10-25T16:18:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 msgr2=0x7fca78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fca880af000 tx=0x7fca8801b000 comp rx=0 tx=0).stop 2023-10-25T16:18:10.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 msgr2=0x7fca9814dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9814dbb0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fca9000b9e0 tx=0x7fca9000bea0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 shutdown_connections 2023-10-25T16:18:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca9815bbe0 0x7fca9814dbb0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca980c9df0 0x7fca981522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 --2- 172.21.15.177:0/991910806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca9806c180 0x7fca98155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 >> 172.21.15.177:0/991910806 conn(0x7fca980b2450 msgr2=0x7fca98157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:10.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 shutdown_connections 2023-10-25T16:18:10.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.357+0000 7fca9e241640 1 -- 172.21.15.177:0/991910806 wait complete. 2023-10-25T16:18:10.375 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:18:10.376 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:18:10.376 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:18:10.376 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:18:10.377 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:18:10.377 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:18:10.377 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:18:10.377 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:18:10.378 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:18:10.378 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:18:10.378 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:18:10.379 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:18:10.379 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:18:10.379 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:18:10.379 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:18:10.380 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:18:10.386 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:18:10.386 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:18:10.389 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:18:10.389 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:18:10.392 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:18:10.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:18:10.395 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:18:10.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:18:10.435 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:18:10.436 DEBUG:teuthology.parallel:result is None 2023-10-25T16:18:10.437 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:18:10.437 DEBUG:teuthology.parallel:result is None 2023-10-25T16:18:10.438 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:18:10.438 DEBUG:teuthology.parallel:result is None 2023-10-25T16:18:10.440 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:18:10.440 DEBUG:teuthology.parallel:result is None 2023-10-25T16:18:10.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:18:10.501 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:18:10.502 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:18:10.504 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:18:10.505 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:18:10.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/3915715814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 msgr2=0x7fda800d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 --2- 172.21.15.177:0/3915715814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800d1bd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009840 tx=0x7fda6c01c770 comp rx=0 tx=0).stop 2023-10-25T16:18:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/3915715814 shutdown_connections 2023-10-25T16:18:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 --2- 172.21.15.177:0/3915715814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800d1bd0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 --2- 172.21.15.177:0/3915715814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda8015eba0 0x7fda800b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/3915715814 >> 172.21.15.177:0/3915715814 conn(0x7fda8009a5c0 msgr2=0x7fda800d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/3915715814 shutdown_connections 2023-10-25T16:18:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/3915715814 wait complete. 2023-10-25T16:18:10.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 Processor -- start 2023-10-25T16:18:10.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- start start 2023-10-25T16:18:10.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda800cdb10 0x7fda80153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda8015eba0 0x7fda800c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800c94f0 con 0x7fda800b2120 2023-10-25T16:18:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800b6f00 con 0x7fda8015eba0 2023-10-25T16:18:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda800b6040 con 0x7fda800cdb10 2023-10-25T16:18:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51956/0 (socket says 172.21.15.177:51956) 2023-10-25T16:18:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 -- 172.21.15.177:0/2613088656 learned_addr learned my addr 172.21.15.177:0/2613088656 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 -- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda800cdb10 msgr2=0x7fda80153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda800cdb10 0x7fda80153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 -- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda8015eba0 msgr2=0x7fda800c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:10.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda8015eba0 0x7fda800c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:10.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 -- 172.21.15.177:0/2613088656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0094a0 con 0x7fda800b2120 2023-10-25T16:18:10.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda849fd640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800b69c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fda7400d750 tx=0x7fda7400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:10.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74009c30 con 0x7fda800b2120 2023-10-25T16:18:10.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda74009e80 con 0x7fda800b2120 2023-10-25T16:18:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74004260 con 0x7fda800b2120 2023-10-25T16:18:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800b5d60 con 0x7fda800b2120 2023-10-25T16:18:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.561+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda800c9110 con 0x7fda800b2120 2023-10-25T16:18:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.565+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8004daf0 con 0x7fda800b2120 2023-10-25T16:18:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.565+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda74005020 con 0x7fda800b2120 2023-10-25T16:18:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.565+0000 7fda7d7fa640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda640664a0 0x7fda64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:10.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.565+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fda74084020 con 0x7fda800b2120 2023-10-25T16:18:10.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.565+0000 7fda7ffff640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda640664a0 0x7fda64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:10.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.565+0000 7fda7ffff640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda640664a0 0x7fda64068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0ae000 tx=0x7fda6c019510 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:10.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.569+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda74051790 con 0x7fda800b2120 2023-10-25T16:18:10.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:10.733+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fda800c9760 con 0x7fda800b2120 2023-10-25T16:18:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.105+0000 7fda7d7fa640 1 -- 172.21.15.177:0/2613088656 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda74017070 con 0x7fda800b2120 2023-10-25T16:18:11.104 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:18:11.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda640664a0 msgr2=0x7fda64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda640664a0 0x7fda64068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0ae000 tx=0x7fda6c019510 comp rx=0 tx=0).stop 2023-10-25T16:18:11.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 msgr2=0x7fda800b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800b69c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fda7400d750 tx=0x7fda7400dc10 comp rx=0 tx=0).stop 2023-10-25T16:18:11.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 shutdown_connections 2023-10-25T16:18:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fda640664a0 0x7fda64068960 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda8015eba0 0x7fda800c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda800cdb10 0x7fda80153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 --2- 172.21.15.177:0/2613088656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda800b2120 0x7fda800b69c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 >> 172.21.15.177:0/2613088656 conn(0x7fda8009a5c0 msgr2=0x7fda800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 shutdown_connections 2023-10-25T16:18:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.109+0000 7fda86c61640 1 -- 172.21.15.177:0/2613088656 wait complete. 2023-10-25T16:18:11.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:18:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/4033238211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab680047d0 msgr2=0x7fab68004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 --2- 172.21.15.177:0/4033238211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab680047d0 0x7fab68004c50 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fab64005fd0 tx=0x7fab6401cda0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/4033238211 shutdown_connections 2023-10-25T16:18:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 --2- 172.21.15.177:0/4033238211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab680047d0 0x7fab68004c50 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/4033238211 >> 172.21.15.177:0/4033238211 conn(0x7fab7c0b2450 msgr2=0x7fab7c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/4033238211 shutdown_connections 2023-10-25T16:18:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/4033238211 wait complete. 2023-10-25T16:18:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 Processor -- start 2023-10-25T16:18:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- start start 2023-10-25T16:18:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab680047d0 0x7fab7c1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 0x7fab7c14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c1507b0 0x7fab7c0ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c151400 con 0x7fab7c14fc60 2023-10-25T16:18:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c147f10 con 0x7fab680047d0 2023-10-25T16:18:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c151120 con 0x7fab7c1507b0 2023-10-25T16:18:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 0x7fab7c14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 0x7fab7c14c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51976/0 (socket says 172.21.15.177:51976) 2023-10-25T16:18:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 -- 172.21.15.177:0/3532950860 learned_addr learned my addr 172.21.15.177:0/3532950860 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab7b7fe640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab680047d0 0x7fab7c1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab7bfff640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c1507b0 0x7fab7c0ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 -- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c1507b0 msgr2=0x7fab7c0ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c1507b0 0x7fab7c0ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 -- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab680047d0 msgr2=0x7fab7c1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab680047d0 0x7fab7c1479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 -- 172.21.15.177:0/3532950860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c14b9a0 con 0x7fab7c14fc60 2023-10-25T16:18:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab7b7fe640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab680047d0 0x7fab7c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab7bfff640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c1507b0 0x7fab7c0ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab72ffd640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 0x7fab7c14c480 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fab6400bb00 tx=0x7fab64005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640a5aa0 con 0x7fab7c14fc60 2023-10-25T16:18:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fab640a5c00 con 0x7fab7c14fc60 2023-10-25T16:18:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c14bc80 con 0x7fab7c14fc60 2023-10-25T16:18:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640046d0 con 0x7fab7c14fc60 2023-10-25T16:18:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.257+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c14c9c0 con 0x7fab7c14fc60 2023-10-25T16:18:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.261+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c14b800 con 0x7fab7c14fc60 2023-10-25T16:18:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.261+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab64004830 con 0x7fab7c14fc60 2023-10-25T16:18:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.261+0000 7fab78ff9640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fab5c066470 0x7fab5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.261+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab6411db00 con 0x7fab7c14fc60 2023-10-25T16:18:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.261+0000 7fab7b7fe640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fab5c066470 0x7fab5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.261+0000 7fab7b7fe640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fab5c066470 0x7fab5c068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fab6c001940 tx=0x7fab6c000f00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.265+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab7c14b800 con 0x7fab7c14fc60 2023-10-25T16:18:11.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.477+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fab7c14b800 con 0x7fab7c14fc60 2023-10-25T16:18:11.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.477+0000 7fab78ff9640 1 -- 172.21.15.177:0/3532950860 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fab7c14b800 con 0x7fab7c14fc60 2023-10-25T16:18:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:18:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:18:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:18:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:18:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:18:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:18:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:18:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:18:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:18:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:18:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:18:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:18:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:18:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:18:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:18:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:18:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:18:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:18:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:18:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:18:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:18:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:18:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:18:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:18:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:18:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:18:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:18:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:18:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:18:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:18:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:18:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:18:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:18:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:18:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:18:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:18:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:18:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:18:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:18:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:18:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:18:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:18:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:18:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:18:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:18:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:18:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:18:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:18:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:18:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:18:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:18:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:18:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:18:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:18:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:18:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:18:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:18:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:18:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:18:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:18:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:18:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:18:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:18:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:18:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:18:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:18:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:18:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:18:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:18:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:18:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:11.532 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:11.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fab5c066470 msgr2=0x7fab5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fab5c066470 0x7fab5c068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fab6c001940 tx=0x7fab6c000f00 comp rx=0 tx=0).stop 2023-10-25T16:18:11.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 msgr2=0x7fab7c14c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 0x7fab7c14c480 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fab6400bb00 tx=0x7fab64005280 comp rx=0 tx=0).stop 2023-10-25T16:18:11.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 shutdown_connections 2023-10-25T16:18:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fab5c066470 0x7fab5c068930 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fab7c1507b0 0x7fab7c0ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab7c14fc60 0x7fab7c14c480 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 --2- 172.21.15.177:0/3532950860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab680047d0 0x7fab7c1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 >> 172.21.15.177:0/3532950860 conn(0x7fab7c0b2450 msgr2=0x7fab7c0ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 shutdown_connections 2023-10-25T16:18:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.481+0000 7fab81bae640 1 -- 172.21.15.177:0/3532950860 wait complete. 2023-10-25T16:18:11.540 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:11.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/3359098205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c06c0f0 msgr2=0x7fac2c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 --2- 172.21.15.177:0/3359098205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c06c0f0 0x7fac2c0706f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0ccde0 tx=0x7fac2401c7e0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/3359098205 shutdown_connections 2023-10-25T16:18:11.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 --2- 172.21.15.177:0/3359098205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c06c0f0 0x7fac2c0706f0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 --2- 172.21.15.177:0/3359098205 >> v2:172.21.15.184:3300/0 conn(0x7fac2c1500f0 0x7fac2c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/3359098205 >> 172.21.15.177:0/3359098205 conn(0x7fac2c0b2450 msgr2=0x7fac2c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/3359098205 shutdown_connections 2023-10-25T16:18:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/3359098205 wait complete. 2023-10-25T16:18:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 Processor -- start 2023-10-25T16:18:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- start start 2023-10-25T16:18:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c0f0 0x7fac2c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0c9e50 0x7fac2c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 0x7fac2c141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14fa00 con 0x7fac2c1500f0 2023-10-25T16:18:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14fe90 con 0x7fac2c0c9e50 2023-10-25T16:18:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c152bd0 con 0x7fac2c06c0f0 2023-10-25T16:18:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 0x7fac2c141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 0x7fac2c141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51980/0 (socket says 172.21.15.177:51980) 2023-10-25T16:18:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 -- 172.21.15.177:0/872992719 learned_addr learned my addr 172.21.15.177:0/872992719 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac2b7fe640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0c9e50 0x7fac2c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 -- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c0f0 msgr2=0x7fac2c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac2bfff640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c0f0 0x7fac2c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c0f0 0x7fac2c14e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 -- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0c9e50 msgr2=0x7fac2c152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0c9e50 0x7fac2c152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 -- 172.21.15.177:0/872992719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009560 con 0x7fac2c1500f0 2023-10-25T16:18:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac2b7fe640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0c9e50 0x7fac2c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac30a63640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 0x7fac2c141230 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fac240193f0 tx=0x7fac24005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24003600 con 0x7fac2c1500f0 2023-10-25T16:18:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac24003850 con 0x7fac2c1500f0 2023-10-25T16:18:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c0718c0 con 0x7fac2c1500f0 2023-10-25T16:18:11.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24003c40 con 0x7fac2c1500f0 2023-10-25T16:18:11.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.669+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c14f0d0 con 0x7fac2c1500f0 2023-10-25T16:18:11.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.673+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c14fbb0 con 0x7fac2c1500f0 2023-10-25T16:18:11.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.673+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac240b4040 con 0x7fac2c1500f0 2023-10-25T16:18:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.673+0000 7fac28ff9640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac0c0664a0 0x7fac0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.673+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac2411e740 con 0x7fac2c1500f0 2023-10-25T16:18:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.673+0000 7fac2bfff640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac0c0664a0 0x7fac0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.673+0000 7fac2bfff640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac0c0664a0 0x7fac0c068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0058d0 tx=0x7fac1c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:11.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.677+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac2c14fbb0 con 0x7fac2c1500f0 2023-10-25T16:18:11.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.825+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac2c04daf0 con 0x7fac2c1500f0 2023-10-25T16:18:11.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac28ff9640 1 -- 172.21.15.177:0/872992719 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+12883 (secure 0 0 0) 0x7fac240ebf10 con 0x7fac2c1500f0 2023-10-25T16:18:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:11.828 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":101,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:11.119162+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac0c0664a0 msgr2=0x7fac0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac0c0664a0 0x7fac0c068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0058d0 tx=0x7fac1c005860 comp rx=0 tx=0).stop 2023-10-25T16:18:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 msgr2=0x7fac2c141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 0x7fac2c141230 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fac240193f0 tx=0x7fac24005de0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 shutdown_connections 2023-10-25T16:18:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac0c0664a0 0x7fac0c068960 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac2c1500f0 0x7fac2c141230 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0c9e50 0x7fac2c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 --2- 172.21.15.177:0/872992719 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac2c06c0f0 0x7fac2c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 >> 172.21.15.177:0/872992719 conn(0x7fac2c0b2450 msgr2=0x7fac2c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 shutdown_connections 2023-10-25T16:18:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.829+0000 7fac324c6640 1 -- 172.21.15.177:0/872992719 wait complete. 2023-10-25T16:18:11.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:18:11.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:18:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- 172.21.15.177:0/3850403623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea58004d10 msgr2=0x7fea58005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 --2- 172.21.15.177:0/3850403623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea58004d10 0x7fea58005190 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c590 tx=0x7fea6801faa0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea7530e640 1 -- 172.21.15.177:0/3850403623 reap_dead start 2023-10-25T16:18:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- 172.21.15.177:0/3850403623 shutdown_connections 2023-10-25T16:18:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- 172.21.15.177:0/3850403623 >> 172.21.15.177:0/3850403623 conn(0x7fea7009a5c0 msgr2=0x7fea700d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:11.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- 172.21.15.177:0/3850403623 shutdown_connections 2023-10-25T16:18:11.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- 172.21.15.177:0/3850403623 wait complete. 2023-10-25T16:18:11.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 Processor -- start 2023-10-25T16:18:11.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- start start 2023-10-25T16:18:11.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 0x7fea70156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea701583f0 0x7fea700c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea700c88c0 0x7fea700c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea700c8d40 con 0x7fea70155040 2023-10-25T16:18:11.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea70152e00 con 0x7fea700c88c0 2023-10-25T16:18:11.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea76d71640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea70156fc0 con 0x7fea701583f0 2023-10-25T16:18:11.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea74b0d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 0x7fea70156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea74b0d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 0x7fea70156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51984/0 (socket says 172.21.15.177:51984) 2023-10-25T16:18:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea74b0d640 1 -- 172.21.15.177:0/3969840410 learned_addr learned my addr 172.21.15.177:0/3969840410 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea6ffff640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea701583f0 0x7fea700c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.977+0000 7fea7530e640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea700c88c0 0x7fea700c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea74b0d640 1 -- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea701583f0 msgr2=0x7fea700c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea74b0d640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea701583f0 0x7fea700c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea74b0d640 1 -- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea700c88c0 msgr2=0x7fea700c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea74b0d640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea700c88c0 0x7fea700c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea74b0d640 1 -- 172.21.15.177:0/3969840410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70155420 con 0x7fea70155040 2023-10-25T16:18:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea74b0d640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 0x7fea70156090 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fea6000f9d0 tx=0x7fea6000fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000bcb0 con 0x7fea70155040 2023-10-25T16:18:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea60011440 con 0x7fea70155040 2023-10-25T16:18:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea70156720 con 0x7fea70155040 2023-10-25T16:18:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60011810 con 0x7fea70155040 2023-10-25T16:18:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea70156ce0 con 0x7fea70155040 2023-10-25T16:18:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7004daf0 con 0x7fea70155040 2023-10-25T16:18:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea60011970 con 0x7fea70155040 2023-10-25T16:18:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6d7fa640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea5c066470 0x7fea5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea60084810 con 0x7fea70155040 2023-10-25T16:18:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6ffff640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea5c066470 0x7fea5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.981+0000 7fea6ffff640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea5c066470 0x7fea5c068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fea70158b40 tx=0x7fea64006af0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:11.985+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea60051fe0 con 0x7fea70155040 2023-10-25T16:18:12.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea70152bd0 con 0x7fea70155040 2023-10-25T16:18:12.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea6d7fa640 1 -- 172.21.15.177:0/3969840410 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea60020070 con 0x7fea70155040 2023-10-25T16:18:12.145 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:18:12.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea5c066470 msgr2=0x7fea5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea5c066470 0x7fea5c068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fea70158b40 tx=0x7fea64006af0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 msgr2=0x7fea70156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 0x7fea70156090 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fea6000f9d0 tx=0x7fea6000fe90 comp rx=0 tx=0).stop 2023-10-25T16:18:12.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 shutdown_connections 2023-10-25T16:18:12.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea5c066470 0x7fea5c068930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea700c88c0 0x7fea700c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea701583f0 0x7fea700c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 --2- 172.21.15.177:0/3969840410 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea70155040 0x7fea70156090 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 >> 172.21.15.177:0/3969840410 conn(0x7fea7009a5c0 msgr2=0x7fea7006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:12.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 shutdown_connections 2023-10-25T16:18:12.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.145+0000 7fea76d71640 1 -- 172.21.15.177:0/3969840410 wait complete. 2023-10-25T16:18:12.163 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:18:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 -- 172.21.15.177:0/3587960108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba414e810 msgr2=0x7ffba40cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 --2- 172.21.15.177:0/3587960108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba414e810 0x7ffba40cbfa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffba40c9b20 tx=0x7ffba001c860 comp rx=0 tx=0).stop 2023-10-25T16:18:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 -- 172.21.15.177:0/3587960108 shutdown_connections 2023-10-25T16:18:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 --2- 172.21.15.177:0/3587960108 >> v2:172.21.15.184:3300/0 conn(0x7ffba415bdb0 0x7ffba406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 --2- 172.21.15.177:0/3587960108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba414e810 0x7ffba40cbfa0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 -- 172.21.15.177:0/3587960108 >> 172.21.15.177:0/3587960108 conn(0x7ffba40b2450 msgr2=0x7ffba40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 -- 172.21.15.177:0/3587960108 shutdown_connections 2023-10-25T16:18:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.285+0000 7ffbac153640 1 -- 172.21.15.177:0/3587960108 wait complete. 2023-10-25T16:18:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 Processor -- start 2023-10-25T16:18:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- start start 2023-10-25T16:18:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40aebc0 0x7ffba41430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba414e810 0x7ffba4148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 0x7ffba40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4153be0 con 0x7ffba415bdb0 2023-10-25T16:18:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4143610 con 0x7ffba40aebc0 2023-10-25T16:18:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba41488f0 con 0x7ffba414e810 2023-10-25T16:18:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 0x7ffba40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 0x7ffba40705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51998/0 (socket says 172.21.15.177:51998) 2023-10-25T16:18:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 -- 172.21.15.177:0/1873063153 learned_addr learned my addr 172.21.15.177:0/1873063153 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffba96ee640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba414e810 0x7ffba4148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffba9eef640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40aebc0 0x7ffba41430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 -- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba414e810 msgr2=0x7ffba4148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba414e810 0x7ffba4148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 -- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40aebc0 msgr2=0x7ffba41430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40aebc0 0x7ffba41430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 -- 172.21.15.177:0/1873063153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009560 con 0x7ffba415bdb0 2023-10-25T16:18:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbaa6f0640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 0x7ffba40705c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00c780 tx=0x7ffb9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c004b70 con 0x7ffba415bdb0 2023-10-25T16:18:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb9c00ce90 con 0x7ffba415bdb0 2023-10-25T16:18:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba4153520 con 0x7ffba415bdb0 2023-10-25T16:18:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00aab0 con 0x7ffba415bdb0 2023-10-25T16:18:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba4148bd0 con 0x7ffba415bdb0 2023-10-25T16:18:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba4153d20 con 0x7ffba415bdb0 2023-10-25T16:18:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.289+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb9c00ac10 con 0x7ffba415bdb0 2023-10-25T16:18:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.293+0000 7ffb9a7fc640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb88066470 0x7ffb88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.293+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb9c083f00 con 0x7ffba415bdb0 2023-10-25T16:18:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.293+0000 7ffba9eef640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb88066470 0x7ffb88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.293+0000 7ffba9eef640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb88066470 0x7ffb88068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffba00af000 tx=0x7ffba001b0a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:12.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.297+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffba4153d20 con 0x7ffba415bdb0 2023-10-25T16:18:12.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.441+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffba4153d20 con 0x7ffba415bdb0 2023-10-25T16:18:12.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.441+0000 7ffb9a7fc640 1 -- 172.21.15.177:0/1873063153 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v101) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffba4153d20 con 0x7ffba415bdb0 2023-10-25T16:18:12.442 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:12.443 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:18:12.443 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:12.443 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:18:12.443 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:18:12.444 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:12.444 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:18:12.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb88066470 msgr2=0x7ffb88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb88066470 0x7ffb88068930 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffba00af000 tx=0x7ffba001b0a0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 msgr2=0x7ffba40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 0x7ffba40705c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00c780 tx=0x7ffb9c00cc40 comp rx=0 tx=0).stop 2023-10-25T16:18:12.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 shutdown_connections 2023-10-25T16:18:12.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb88066470 0x7ffb88068930 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffba415bdb0 0x7ffba40705c0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffba414e810 0x7ffba4148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 --2- 172.21.15.177:0/1873063153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffba40aebc0 0x7ffba41430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 >> 172.21.15.177:0/1873063153 conn(0x7ffba40b2450 msgr2=0x7ffba40afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 shutdown_connections 2023-10-25T16:18:12.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.445+0000 7ffbac153640 1 -- 172.21.15.177:0/1873063153 wait complete. 2023-10-25T16:18:12.459 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:18:12.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:18:12.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- 172.21.15.177:0/180423715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 msgr2=0x7f8ab40cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 --2- 172.21.15.177:0/180423715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40cd150 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009900 tx=0x7f8aa801c890 comp rx=0 tx=0).stop 2023-10-25T16:18:12.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- 172.21.15.177:0/180423715 shutdown_connections 2023-10-25T16:18:12.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 --2- 172.21.15.177:0/180423715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 0x7f8ab406ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 --2- 172.21.15.177:0/180423715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40cd150 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- 172.21.15.177:0/180423715 >> 172.21.15.177:0/180423715 conn(0x7f8ab4069920 msgr2=0x7f8ab4069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:12.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- 172.21.15.177:0/180423715 shutdown_connections 2023-10-25T16:18:12.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- 172.21.15.177:0/180423715 wait complete. 2023-10-25T16:18:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 Processor -- start 2023-10-25T16:18:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- start start 2023-10-25T16:18:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 0x7f8ab40ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ab41582d0 0x7f8ab41456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40af840 con 0x7f8ab415cb30 2023-10-25T16:18:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab40acee0 con 0x7f8ab41582d0 2023-10-25T16:18:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab9437640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab415b8d0 con 0x7f8ab40cd690 2023-10-25T16:18:12.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52018/0 (socket says 172.21.15.177:52018) 2023-10-25T16:18:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 -- 172.21.15.177:0/1033649738 learned_addr learned my addr 172.21.15.177:0/1033649738 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab27fc640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ab41582d0 0x7f8ab41456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab2ffd640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 0x7f8ab40ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 -- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 msgr2=0x7f8ab40ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 0x7f8ab40ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 -- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ab41582d0 msgr2=0x7f8ab41456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ab41582d0 0x7f8ab41456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 -- 172.21.15.177:0/1033649738 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009560 con 0x7f8ab415cb30 2023-10-25T16:18:12.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab2ffd640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 0x7f8ab40ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:12.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.589+0000 7f8ab37fe640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40ae300 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00ea50 tx=0x7f8aac00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:12.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00cd60 con 0x7f8ab415cb30 2023-10-25T16:18:12.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8aac004b30 con 0x7f8ab415cb30 2023-10-25T16:18:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab40af180 con 0x7f8ab415cb30 2023-10-25T16:18:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac005020 con 0x7f8ab415cb30 2023-10-25T16:18:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4145be0 con 0x7f8ab415cb30 2023-10-25T16:18:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab40af980 con 0x7f8ab415cb30 2023-10-25T16:18:12.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8aac005180 con 0x7f8ab415cb30 2023-10-25T16:18:12.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8a9b7fe640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:12.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8aac084480 con 0x7f8ab415cb30 2023-10-25T16:18:12.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8ab2ffd640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:12.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.593+0000 7f8ab2ffd640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40016f0 tx=0x7f8aa4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:12.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.597+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ab40af980 con 0x7f8ab415cb30 2023-10-25T16:18:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:12.749+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8ab40af980 con 0x7f8ab415cb30 2023-10-25T16:18:13.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.653+0000 7f8a9b7fe640 1 -- 172.21.15.177:0/1033649738 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v102) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8ab40af980 con 0x7f8ab415cb30 2023-10-25T16:18:13.653 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:18:13.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 msgr2=0x7f8aa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:13.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40016f0 tx=0x7f8aa4009040 comp rx=0 tx=0).stop 2023-10-25T16:18:13.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 msgr2=0x7f8ab40ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:13.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40ae300 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00ea50 tx=0x7f8aac00ef10 comp rx=0 tx=0).stop 2023-10-25T16:18:13.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 shutdown_connections 2023-10-25T16:18:13.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa0066470 0x7f8aa0068930 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab415cb30 0x7f8ab40ae300 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ab41582d0 0x7f8ab41456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 --2- 172.21.15.177:0/1033649738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ab40cd690 0x7f8ab40ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 >> 172.21.15.177:0/1033649738 conn(0x7f8ab4069920 msgr2=0x7f8ab4155960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:13.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 shutdown_connections 2023-10-25T16:18:13.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.657+0000 7f8ab9437640 1 -- 172.21.15.177:0/1033649738 wait complete. 2023-10-25T16:18:13.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:18:13.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 -- 172.21.15.177:0/227453374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0b0220 msgr2=0x7f48ac0cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:13.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 --2- 172.21.15.177:0/227453374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0b0220 0x7f48ac0cc9f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06a7c0 tx=0x7f48a401ccd0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 -- 172.21.15.177:0/227453374 shutdown_connections 2023-10-25T16:18:13.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 --2- 172.21.15.177:0/227453374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0b0220 0x7f48ac0cc9f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 --2- 172.21.15.177:0/227453374 >> v2:172.21.15.184:3300/0 conn(0x7f48ac1595c0 0x7f48ac06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 -- 172.21.15.177:0/227453374 >> 172.21.15.177:0/227453374 conn(0x7f48ac06a830 msgr2=0x7f48ac06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:13.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 -- 172.21.15.177:0/227453374 shutdown_connections 2023-10-25T16:18:13.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 -- 172.21.15.177:0/227453374 wait complete. 2023-10-25T16:18:13.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 Processor -- start 2023-10-25T16:18:13.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 -- start start 2023-10-25T16:18:13.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ac0b0220 0x7f48ac150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:13.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.817+0000 7f48b3abb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 0x7f48ac09b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:13.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ac1595c0 0x7f48ac1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:13.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac1508a0 con 0x7f48ac0ca490 2023-10-25T16:18:13.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac153220 con 0x7f48ac1595c0 2023-10-25T16:18:13.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac15c4d0 con 0x7f48ac0b0220 2023-10-25T16:18:13.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 0x7f48ac09b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:13.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 0x7f48ac09b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52034/0 (socket says 172.21.15.177:52034) 2023-10-25T16:18:13.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 -- 172.21.15.177:0/884732053 learned_addr learned my addr 172.21.15.177:0/884732053 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:13.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b2058640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ac1595c0 0x7f48ac1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:13.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1857640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ac0b0220 0x7f48ac150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:13.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 -- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ac0b0220 msgr2=0x7f48ac150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:13.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ac0b0220 0x7f48ac150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 -- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ac1595c0 msgr2=0x7f48ac1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:13.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ac1595c0 0x7f48ac1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:13.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 -- 172.21.15.177:0/884732053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40098e0 con 0x7f48ac0ca490 2023-10-25T16:18:13.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1056640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 0x7f48ac09b9e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f489c00c500 tx=0x7f489c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:13.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c005220 con 0x7f48ac0ca490 2023-10-25T16:18:13.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f489c005470 con 0x7f48ac0ca490 2023-10-25T16:18:13.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac15c7b0 con 0x7f48ac0ca490 2023-10-25T16:18:13.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c007290 con 0x7f48ac0ca490 2023-10-25T16:18:13.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac152eb0 con 0x7f48ac0ca490 2023-10-25T16:18:13.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac1533d0 con 0x7f48ac0ca490 2023-10-25T16:18:13.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f489c0073f0 con 0x7f48ac0ca490 2023-10-25T16:18:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48a27fc640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4890066470 0x7f4890068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f489c083830 con 0x7f48ac0ca490 2023-10-25T16:18:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1857640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4890066470 0x7f4890068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:13.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.821+0000 7f48b1857640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4890066470 0x7f4890068930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f48a80058d0 tx=0x7f48a8005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:13.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.825+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48ac1533d0 con 0x7f48ac0ca490 2023-10-25T16:18:13.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:13.981+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f48ac1533d0 con 0x7f48ac0ca490 2023-10-25T16:18:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.657+0000 7f48a27fc640 1 -- 172.21.15.177:0/884732053 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v103) v1 ==== 170+0+0 (secure 0 0 0) 0x7f48ac1533d0 con 0x7f48ac0ca490 2023-10-25T16:18:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:18:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4890066470 msgr2=0x7f4890068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4890066470 0x7f4890068930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f48a80058d0 tx=0x7f48a8005860 comp rx=0 tx=0).stop 2023-10-25T16:18:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 msgr2=0x7f48ac09b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 0x7f48ac09b9e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f489c00c500 tx=0x7f489c00c9c0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 shutdown_connections 2023-10-25T16:18:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4890066470 0x7f4890068930 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48ac1595c0 0x7f48ac1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48ac0ca490 0x7f48ac09b9e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 --2- 172.21.15.177:0/884732053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48ac0b0220 0x7f48ac150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 >> 172.21.15.177:0/884732053 conn(0x7f48ac06a830 msgr2=0x7f48ac0aaf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 shutdown_connections 2023-10-25T16:18:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.661+0000 7f48b3abb640 1 -- 172.21.15.177:0/884732053 wait complete. 2023-10-25T16:18:14.691 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:18:14.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3294519294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b9815edf0 msgr2=0x7f9b980b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:14.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3294519294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b9815edf0 0x7f9b980b2440 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9b980d0ce0 tx=0x7f9b8801f090 comp rx=0 tx=0).stop 2023-10-25T16:18:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3294519294 shutdown_connections 2023-10-25T16:18:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3294519294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 0x7f9b980cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3294519294 >> v2:172.21.15.184:3300/0 conn(0x7f9b980b02c0 0x7f9b980cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3294519294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b9815edf0 0x7f9b980b2440 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3294519294 >> 172.21.15.177:0/3294519294 conn(0x7f9b9809a640 msgr2=0x7f9b980d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:14.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3294519294 shutdown_connections 2023-10-25T16:18:14.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3294519294 wait complete. 2023-10-25T16:18:14.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 Processor -- start 2023-10-25T16:18:14.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- start start 2023-10-25T16:18:14.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 0x7f9b980cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:14.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 0x7f9b980c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:14.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b98158020 0x7f9b98157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:14.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ca5e0 con 0x7f9b980b02c0 2023-10-25T16:18:14.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ca830 con 0x7f9b98158020 2023-10-25T16:18:14.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980cab10 con 0x7f9b980b2980 2023-10-25T16:18:14.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 0x7f9b980cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:14.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 0x7f9b980cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52058/0 (socket says 172.21.15.177:52058) 2023-10-25T16:18:14.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 -- 172.21.15.177:0/3383963555 learned_addr learned my addr 172.21.15.177:0/3383963555 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9d7b8640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b98158020 0x7f9b98157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b97fff640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 0x7f9b980c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 -- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 msgr2=0x7f9b980c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 0x7f9b980c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 -- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b98158020 msgr2=0x7f9b98157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b98158020 0x7f9b98157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 -- 172.21.15.177:0/3383963555 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88009560 con 0x7f9b980b02c0 2023-10-25T16:18:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9d7b8640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b98158020 0x7f9b98157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b97fff640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 0x7f9b980c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9cfb7640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 0x7f9b980cc6a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9b880b3040 tx=0x7f9b880b06a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880b0a90 con 0x7f9b980b02c0 2023-10-25T16:18:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9b880b0ce0 con 0x7f9b980b02c0 2023-10-25T16:18:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b980cadf0 con 0x7f9b980b02c0 2023-10-25T16:18:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b88005290 con 0x7f9b980b02c0 2023-10-25T16:18:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.817+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980ccbe0 con 0x7f9b980b02c0 2023-10-25T16:18:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.821+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9804daf0 con 0x7f9b980b02c0 2023-10-25T16:18:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.821+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9b880b7070 con 0x7f9b980b02c0 2023-10-25T16:18:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.821+0000 7f9b957fa640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b84066470 0x7f9b84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.821+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9b88120760 con 0x7f9b980b02c0 2023-10-25T16:18:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.821+0000 7f9b97fff640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b84066470 0x7f9b84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.821+0000 7f9b97fff640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b84066470 0x7f9b84068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9b980af640 tx=0x7f9b8c005cc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:14.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:14.825+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b880edcd0 con 0x7f9b980b02c0 2023-10-25T16:18:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.013+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9b980cb2a0 con 0x7f9b980b02c0 2023-10-25T16:18:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.721+0000 7f9b957fa640 1 -- 172.21.15.177:0/3383963555 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9b880f12f0 con 0x7f9b980b02c0 2023-10-25T16:18:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 12 and data pool 13 2023-10-25T16:18:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b84066470 msgr2=0x7f9b84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b84066470 0x7f9b84068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9b980af640 tx=0x7f9b8c005cc0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 msgr2=0x7f9b980cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 0x7f9b980cc6a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9b880b3040 tx=0x7f9b880b06a0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 shutdown_connections 2023-10-25T16:18:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b84066470 0x7f9b84068930 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b98158020 0x7f9b98157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b980b2980 0x7f9b980c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 --2- 172.21.15.177:0/3383963555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b980b02c0 0x7f9b980cc6a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 >> 172.21.15.177:0/3383963555 conn(0x7f9b9809a640 msgr2=0x7f9b9806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 shutdown_connections 2023-10-25T16:18:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.725+0000 7f9b9f21b640 1 -- 172.21.15.177:0/3383963555 wait complete. 2023-10-25T16:18:15.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 -- 172.21.15.177:0/2474699860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc0b2120 msgr2=0x7f1edc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 --2- 172.21.15.177:0/2474699860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc0b2120 0x7f1edc0b4100 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0cb890 tx=0x7f1ec401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 -- 172.21.15.177:0/2474699860 shutdown_connections 2023-10-25T16:18:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 --2- 172.21.15.177:0/2474699860 >> v2:172.21.15.184:3300/0 conn(0x7f1edc0cdb10 0x7f1edc0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 --2- 172.21.15.177:0/2474699860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc0b2120 0x7f1edc0b4100 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 -- 172.21.15.177:0/2474699860 >> 172.21.15.177:0/2474699860 conn(0x7f1edc09a5c0 msgr2=0x7f1edc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 -- 172.21.15.177:0/2474699860 shutdown_connections 2023-10-25T16:18:15.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.873+0000 7f1ee0859640 1 -- 172.21.15.177:0/2474699860 wait complete. 2023-10-25T16:18:15.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 Processor -- start 2023-10-25T16:18:15.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- start start 2023-10-25T16:18:15.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1edc0b2120 0x7f1edc0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:15.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1edc0cdb10 0x7f1edc0c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:15.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 0x7f1edc15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:15.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0ca960 con 0x7f1edc15eba0 2023-10-25T16:18:15.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc14e6c0 con 0x7f1edc0b2120 2023-10-25T16:18:15.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc159110 con 0x7f1edc0cdb10 2023-10-25T16:18:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 0x7f1edc15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 0x7f1edc15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52068/0 (socket says 172.21.15.177:52068) 2023-10-25T16:18:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 -- 172.21.15.177:0/3832158068 learned_addr learned my addr 172.21.15.177:0/3832158068 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ed3fff640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1edc0cdb10 0x7f1edc0c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1eda59c640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1edc0b2120 0x7f1edc0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:15.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 -- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1edc0cdb10 msgr2=0x7f1edc0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:15.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1edc0cdb10 0x7f1edc0c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 -- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1edc0b2120 msgr2=0x7f1edc0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:15.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1edc0b2120 0x7f1edc0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:15.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 -- 172.21.15.177:0/3832158068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec4009560 con 0x7f1edc15eba0 2023-10-25T16:18:15.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1edad9d640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 0x7f1edc15b070 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400b970 tx=0x7f1ed400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:15.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed400cb40 con 0x7f1edc15eba0 2023-10-25T16:18:15.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ed400cdb0 con 0x7f1edc15eba0 2023-10-25T16:18:15.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40146a0 con 0x7f1edc15eba0 2023-10-25T16:18:15.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc0cab70 con 0x7f1edc15eba0 2023-10-25T16:18:15.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc0cb130 con 0x7f1edc15eba0 2023-10-25T16:18:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.877+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc04daf0 con 0x7f1edc15eba0 2023-10-25T16:18:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.881+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1ed401d3b0 con 0x7f1edc15eba0 2023-10-25T16:18:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.881+0000 7f1ed2ffd640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ebc066470 0x7f1ebc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.881+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed4084010 con 0x7f1edc15eba0 2023-10-25T16:18:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.881+0000 7f1eda59c640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ebc066470 0x7f1ebc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.881+0000 7f1eda59c640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ebc066470 0x7f1ebc068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0c82e0 tx=0x7f1ecc008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:15.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:15.885+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1ed4051490 con 0x7f1edc15eba0 2023-10-25T16:18:16.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.037+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1edc0ce110 con 0x7f1edc15eba0 2023-10-25T16:18:16.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ed2ffd640 1 -- 172.21.15.177:0/3832158068 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f1ed4054ab0 con 0x7f1edc15eba0 2023-10-25T16:18:16.040 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:16.041 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":104,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:15.016593+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ebc066470 msgr2=0x7f1ebc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ebc066470 0x7f1ebc068930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0c82e0 tx=0x7f1ecc008040 comp rx=0 tx=0).stop 2023-10-25T16:18:16.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 msgr2=0x7f1edc15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 0x7f1edc15b070 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400b970 tx=0x7f1ed400be30 comp rx=0 tx=0).stop 2023-10-25T16:18:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 shutdown_connections 2023-10-25T16:18:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ebc066470 0x7f1ebc068930 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1edc15eba0 0x7f1edc15b070 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1edc0cdb10 0x7f1edc0c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 --2- 172.21.15.177:0/3832158068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1edc0b2120 0x7f1edc0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 >> 172.21.15.177:0/3832158068 conn(0x7f1edc09a5c0 msgr2=0x7f1edc15c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 shutdown_connections 2023-10-25T16:18:16.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.041+0000 7f1ee0859640 1 -- 172.21.15.177:0/3832158068 wait complete. 2023-10-25T16:18:16.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:16.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/3014306150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77a8005190 msgr2=0x7f77a800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 --2- 172.21.15.177:0/3014306150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77a8005190 0x7f77a800b990 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f77b00016b0 tx=0x7f77b001c7a0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/3014306150 shutdown_connections 2023-10-25T16:18:16.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 --2- 172.21.15.177:0/3014306150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77a8005190 0x7f77a800b990 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/3014306150 >> 172.21.15.177:0/3014306150 conn(0x7f77c00b2450 msgr2=0x7f77c00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:16.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/3014306150 shutdown_connections 2023-10-25T16:18:16.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/3014306150 wait complete. 2023-10-25T16:18:16.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 Processor -- start 2023-10-25T16:18:16.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- start start 2023-10-25T16:18:16.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77a8005190 0x7f77c00ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c00a7130 0x7f77c01f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 0x7f77c012f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00ae1b0 con 0x7f77c012f3a0 2023-10-25T16:18:16.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00ae490 con 0x7f77c00a7130 2023-10-25T16:18:16.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00ae770 con 0x7f77a8005190 2023-10-25T16:18:16.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 0x7f77c012f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 0x7f77c012f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52098/0 (socket says 172.21.15.177:52098) 2023-10-25T16:18:16.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 -- 172.21.15.177:0/1284101356 learned_addr learned my addr 172.21.15.177:0/1284101356 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:16.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77bffff640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c00a7130 0x7f77c01f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c4e0a640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77a8005190 0x7f77c00ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 -- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77a8005190 msgr2=0x7f77c00ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77a8005190 0x7f77c00ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 -- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c00a7130 msgr2=0x7f77c01f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c00a7130 0x7f77c01f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 -- 172.21.15.177:0/1284101356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00aea50 con 0x7f77c012f3a0 2023-10-25T16:18:16.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77bffff640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c00a7130 0x7f77c01f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:16.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c560b640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 0x7f77c012f850 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f77b001cc80 tx=0x7f77b0001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:16.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00038c0 con 0x7f77c012f3a0 2023-10-25T16:18:16.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77b0003b10 con 0x7f77c012f3a0 2023-10-25T16:18:16.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c00ade10 con 0x7f77c012f3a0 2023-10-25T16:18:16.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b0003ea0 con 0x7f77c012f3a0 2023-10-25T16:18:16.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.189+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c012fd90 con 0x7f77c012f3a0 2023-10-25T16:18:16.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.193+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c00aec90 con 0x7f77c012f3a0 2023-10-25T16:18:16.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.193+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77b00ab070 con 0x7f77c012f3a0 2023-10-25T16:18:16.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.193+0000 7f77bd7fa640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77ac066470 0x7f77ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.193+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77b011d7e0 con 0x7f77c012f3a0 2023-10-25T16:18:16.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.193+0000 7f77c4e0a640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77ac066470 0x7f77ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.193+0000 7f77c4e0a640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77ac066470 0x7f77ac068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009ab0 tx=0x7f77b80091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:16.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.197+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77b00eac60 con 0x7f77c012f3a0 2023-10-25T16:18:16.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.353+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77c004daf0 con 0x7f77c012f3a0 2023-10-25T16:18:16.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77bd7fa640 1 -- 172.21.15.177:0/1284101356 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16608 (secure 0 0 0) 0x7f77b00ee280 con 0x7f77c012f3a0 2023-10-25T16:18:16.356 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:16.356 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":104,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:15.016593+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:16.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77ac066470 msgr2=0x7f77ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77ac066470 0x7f77ac068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009ab0 tx=0x7f77b80091e0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 msgr2=0x7f77c012f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 0x7f77c012f850 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f77b001cc80 tx=0x7f77b0001000 comp rx=0 tx=0).stop 2023-10-25T16:18:16.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 shutdown_connections 2023-10-25T16:18:16.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77ac066470 0x7f77ac068930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c012f3a0 0x7f77c012f850 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c00a7130 0x7f77c01f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 --2- 172.21.15.177:0/1284101356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77a8005190 0x7f77c00ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 >> 172.21.15.177:0/1284101356 conn(0x7f77c00b2450 msgr2=0x7f77c0159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:16.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 shutdown_connections 2023-10-25T16:18:16.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.357+0000 7f77c706e640 1 -- 172.21.15.177:0/1284101356 wait complete. 2023-10-25T16:18:16.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:18:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 -- 172.21.15.177:0/2670878941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51c003f30 msgr2=0x7fe51c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 --2- 172.21.15.177:0/2670878941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51c003f30 0x7fe51c0047d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe528009b60 tx=0x7fe52801d250 comp rx=0 tx=0).stop 2023-10-25T16:18:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe533fff640 1 -- 172.21.15.177:0/2670878941 reap_dead start 2023-10-25T16:18:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 -- 172.21.15.177:0/2670878941 shutdown_connections 2023-10-25T16:18:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 -- 172.21.15.177:0/2670878941 >> 172.21.15.177:0/2670878941 conn(0x7fe5340af5b0 msgr2=0x7fe5340af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:16.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 -- 172.21.15.177:0/2670878941 shutdown_connections 2023-10-25T16:18:16.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 -- 172.21.15.177:0/2670878941 wait complete. 2023-10-25T16:18:16.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 Processor -- start 2023-10-25T16:18:16.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.501+0000 7fe539efd640 1 -- start start 2023-10-25T16:18:16.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 0x7fe534150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe534151300 0x7fe534152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5341530e0 0x7fe5341f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe534154450 con 0x7fe53413ea70 2023-10-25T16:18:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340a7470 con 0x7fe534151300 2023-10-25T16:18:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534151780 con 0x7fe5341530e0 2023-10-25T16:18:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 0x7fe534150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 0x7fe534150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52108/0 (socket says 172.21.15.177:52108) 2023-10-25T16:18:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 -- 172.21.15.177:0/1055312500 learned_addr learned my addr 172.21.15.177:0/1055312500 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe532ffd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe534151300 0x7fe534152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe533fff640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5341530e0 0x7fe5341f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 -- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5341530e0 msgr2=0x7fe5341f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5341530e0 0x7fe5341f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 -- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe534151300 msgr2=0x7fe534152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe534151300 0x7fe534152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 -- 172.21.15.177:0/1055312500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5341415a0 con 0x7fe53413ea70 2023-10-25T16:18:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe533fff640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5341530e0 0x7fe5341f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe5337fe640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 0x7fe534150dc0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe524004e50 tx=0x7fe524001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011670 con 0x7fe53413ea70 2023-10-25T16:18:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5240118c0 con 0x7fe53413ea70 2023-10-25T16:18:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341538d0 con 0x7fe53413ea70 2023-10-25T16:18:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011cb0 con 0x7fe53413ea70 2023-10-25T16:18:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe534153e90 con 0x7fe53413ea70 2023-10-25T16:18:16.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53404daf0 con 0x7fe53413ea70 2023-10-25T16:18:16.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe524024440 con 0x7fe53413ea70 2023-10-25T16:18:16.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe51bfff640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5200664a0 0x7fe520068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5240850a0 con 0x7fe53413ea70 2023-10-25T16:18:16.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.505+0000 7fe532ffd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5200664a0 0x7fe520068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.509+0000 7fe532ffd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5200664a0 0x7fe520068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5280ae000 tx=0x7fe528019ff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:16.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.509+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe524052580 con 0x7fe53413ea70 2023-10-25T16:18:16.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.693+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe53413f1b0 con 0x7fe53413ea70 2023-10-25T16:18:16.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.729+0000 7fe51bfff640 1 -- 172.21.15.177:0/1055312500 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe524055ba0 con 0x7fe53413ea70 2023-10-25T16:18:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5200664a0 msgr2=0x7fe520068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5200664a0 0x7fe520068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5280ae000 tx=0x7fe528019ff0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 msgr2=0x7fe534150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 0x7fe534150dc0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe524004e50 tx=0x7fe524001640 comp rx=0 tx=0).stop 2023-10-25T16:18:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 shutdown_connections 2023-10-25T16:18:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5200664a0 0x7fe520068960 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5341530e0 0x7fe5341f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe534151300 0x7fe534152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 --2- 172.21.15.177:0/1055312500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe53413ea70 0x7fe534150dc0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 >> 172.21.15.177:0/1055312500 conn(0x7fe5340af5b0 msgr2=0x7fe53406fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 shutdown_connections 2023-10-25T16:18:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.733+0000 7fe539efd640 1 -- 172.21.15.177:0/1055312500 wait complete. 2023-10-25T16:18:16.749 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:18:16.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:18:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 -- 172.21.15.177:0/12429500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef414e920 msgr2=0x7f5ef41588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 --2- 172.21.15.177:0/12429500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef414e920 0x7f5ef41588a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5ef41524d0 tx=0x7f5ee401c830 comp rx=0 tx=0).stop 2023-10-25T16:18:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 -- 172.21.15.177:0/12429500 shutdown_connections 2023-10-25T16:18:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 --2- 172.21.15.177:0/12429500 >> v2:172.21.15.184:3300/0 conn(0x7f5ef40af2d0 0x7f5ef406f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 --2- 172.21.15.177:0/12429500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef414e920 0x7f5ef41588a0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 -- 172.21.15.177:0/12429500 >> 172.21.15.177:0/12429500 conn(0x7f5ef40b2450 msgr2=0x7f5ef40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 -- 172.21.15.177:0/12429500 shutdown_connections 2023-10-25T16:18:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 -- 172.21.15.177:0/12429500 wait complete. 2023-10-25T16:18:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 Processor -- start 2023-10-25T16:18:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.877+0000 7f5efa692640 1 -- start start 2023-10-25T16:18:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 0x7f5ef41f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ef40ca7a0 0x7f5ef4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ef414e920 0x7f5ef4070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41f3b40 con 0x7f5ef40af2d0 2023-10-25T16:18:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41f32a0 con 0x7f5ef40ca7a0 2023-10-25T16:18:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef41f3580 con 0x7f5ef414e920 2023-10-25T16:18:16.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 0x7f5ef41f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 0x7f5ef41f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52134/0 (socket says 172.21.15.177:52134) 2023-10-25T16:18:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 -- 172.21.15.177:0/3380561361 learned_addr learned my addr 172.21.15.177:0/3380561361 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef37fe640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ef40ca7a0 0x7f5ef4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef8c2f640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ef414e920 0x7f5ef4070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 -- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ef414e920 msgr2=0x7f5ef4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ef414e920 0x7f5ef4070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 -- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ef40ca7a0 msgr2=0x7f5ef4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ef40ca7a0 0x7f5ef4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 -- 172.21.15.177:0/3380561361 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009560 con 0x7f5ef40af2d0 2023-10-25T16:18:16.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef37fe640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ef40ca7a0 0x7f5ef4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef3fff640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 0x7f5ef41f2ba0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40b0040 tx=0x7f5ee40a58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4004340 con 0x7f5ef40af2d0 2023-10-25T16:18:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ee4003600 con 0x7f5ef40af2d0 2023-10-25T16:18:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef41f3860 con 0x7f5ef40af2d0 2023-10-25T16:18:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4003a10 con 0x7f5ef40af2d0 2023-10-25T16:18:16.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef4070d80 con 0x7f5ef40af2d0 2023-10-25T16:18:16.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4070f70 con 0x7f5ef40af2d0 2023-10-25T16:18:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5ee40b4070 con 0x7f5ef40af2d0 2023-10-25T16:18:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef0ff9640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.881+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ee411dde0 con 0x7f5ef40af2d0 2023-10-25T16:18:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.885+0000 7f5ef37fe640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:16.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.885+0000 7f5ef37fe640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ed4066470 0x7f5ed4068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5ef41f3ca0 tx=0x7f5edc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:16.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:16.885+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ee40eb270 con 0x7f5ef40af2d0 2023-10-25T16:18:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.073+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5ef414ef80 con 0x7f5ef40af2d0 2023-10-25T16:18:17.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.733+0000 7f5ef0ff9640 1 -- 172.21.15.177:0/3380561361 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ef414ef80 con 0x7f5ef40af2d0 2023-10-25T16:18:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ed4066470 msgr2=0x7f5ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ed4066470 0x7f5ed4068930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5ef41f3ca0 tx=0x7f5edc009040 comp rx=0 tx=0).stop 2023-10-25T16:18:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 msgr2=0x7f5ef41f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 0x7f5ef41f2ba0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40b0040 tx=0x7f5ee40a58c0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 shutdown_connections 2023-10-25T16:18:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ed4066470 0x7f5ed4068930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ef414e920 0x7f5ef4070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ef40ca7a0 0x7f5ef4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 --2- 172.21.15.177:0/3380561361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ef40af2d0 0x7f5ef41f2ba0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 >> 172.21.15.177:0/3380561361 conn(0x7f5ef40b2450 msgr2=0x7f5ef40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:17.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 shutdown_connections 2023-10-25T16:18:17.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.737+0000 7f5efa692640 1 -- 172.21.15.177:0/3380561361 wait complete. 2023-10-25T16:18:17.778 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:18:17.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- 172.21.15.177:0/1021462952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006f570 msgr2=0x7f0c200cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 --2- 172.21.15.177:0/1021462952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006f570 0x7f0c200cb5c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009c80 tx=0x7f0c1801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- 172.21.15.177:0/1021462952 shutdown_connections 2023-10-25T16:18:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 --2- 172.21.15.177:0/1021462952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006f570 0x7f0c200cb5c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 --2- 172.21.15.177:0/1021462952 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c2006c160 0x7f0c200af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- 172.21.15.177:0/1021462952 >> 172.21.15.177:0/1021462952 conn(0x7f0c200b2450 msgr2=0x7f0c200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- 172.21.15.177:0/1021462952 shutdown_connections 2023-10-25T16:18:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- 172.21.15.177:0/1021462952 wait complete. 2023-10-25T16:18:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 Processor -- start 2023-10-25T16:18:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- start start 2023-10-25T16:18:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006c160 0x7f0c20157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 0x7f0c2013c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c20140cf0 0x7f0c20070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20157fc0 con 0x7f0c2006f570 2023-10-25T16:18:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2013cee0 con 0x7f0c2006c160 2023-10-25T16:18:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c27d13640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2013f920 con 0x7f0c20140cf0 2023-10-25T16:18:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 0x7f0c2013c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 0x7f0c2013c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52136/0 (socket says 172.21.15.177:52136) 2023-10-25T16:18:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 -- 172.21.15.177:0/2958749833 learned_addr learned my addr 172.21.15.177:0/2958749833 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c262b0640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c20140cf0 0x7f0c20070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c25aaf640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006c160 0x7f0c20157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 -- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c20140cf0 msgr2=0x7f0c20070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c20140cf0 0x7f0c20070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 -- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006c160 msgr2=0x7f0c20157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006c160 0x7f0c20157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 -- 172.21.15.177:0/2958749833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180098e0 con 0x7f0c2006f570 2023-10-25T16:18:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c25aaf640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006c160 0x7f0c20157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.909+0000 7f0c252ae640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 0x7f0c2013c9a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ea20 tx=0x7f0c1000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10009710 con 0x7f0c2006f570 2023-10-25T16:18:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c1000ce10 con 0x7f0c2006f570 2023-10-25T16:18:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2013ed10 con 0x7f0c2006f570 2023-10-25T16:18:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10010690 con 0x7f0c2006f570 2023-10-25T16:18:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2013f2d0 con 0x7f0c2006f570 2023-10-25T16:18:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2004daf0 con 0x7f0c2006f570 2023-10-25T16:18:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0c100107f0 con 0x7f0c2006f570 2023-10-25T16:18:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c167fc640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c04066470 0x7f0c04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c10014070 con 0x7f0c2006f570 2023-10-25T16:18:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.913+0000 7f0c25aaf640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c04066470 0x7f0c04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.917+0000 7f0c25aaf640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c04066470 0x7f0c04068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c200c9860 tx=0x7f0c1c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:17.917+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c10052790 con 0x7f0c2006f570 2023-10-25T16:18:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.105+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c200c8f10 con 0x7f0c2006f570 2023-10-25T16:18:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c167fc640 1 -- 172.21.15.177:0/2958749833 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f0c10026090 con 0x7f0c2006f570 2023-10-25T16:18:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:18.107 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:18:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:18:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c04066470 msgr2=0x7f0c04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c04066470 0x7f0c04068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c200c9860 tx=0x7f0c1c009040 comp rx=0 tx=0).stop 2023-10-25T16:18:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 msgr2=0x7f0c2013c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 0x7f0c2013c9a0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000ea20 tx=0x7f0c1000eee0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 shutdown_connections 2023-10-25T16:18:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0c04066470 0x7f0c04068930 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c20140cf0 0x7f0c20070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c2006f570 0x7f0c2013c9a0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 --2- 172.21.15.177:0/2958749833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c2006c160 0x7f0c20157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 >> 172.21.15.177:0/2958749833 conn(0x7f0c200b2450 msgr2=0x7f0c20136ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 shutdown_connections 2023-10-25T16:18:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.109+0000 7f0c27d13640 1 -- 172.21.15.177:0/2958749833 wait complete. 2023-10-25T16:18:18.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:18.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 -- 172.21.15.177:0/3093856471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b80cdb10 msgr2=0x7f50b80cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 --2- 172.21.15.177:0/3093856471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b80cdb10 0x7f50b80cdfc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c80 tx=0x7f50b001ccf0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 -- 172.21.15.177:0/3093856471 shutdown_connections 2023-10-25T16:18:18.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 --2- 172.21.15.177:0/3093856471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b80cdb10 0x7f50b80cdfc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 --2- 172.21.15.177:0/3093856471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50b815eba0 0x7f50b80b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 -- 172.21.15.177:0/3093856471 >> 172.21.15.177:0/3093856471 conn(0x7f50b809a5c0 msgr2=0x7f50b80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:18.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 -- 172.21.15.177:0/3093856471 shutdown_connections 2023-10-25T16:18:18.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 -- 172.21.15.177:0/3093856471 wait complete. 2023-10-25T16:18:18.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 Processor -- start 2023-10-25T16:18:18.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.249+0000 7f50bef40640 1 -- start start 2023-10-25T16:18:18.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 0x7f50b815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50b80cdb10 0x7f50b80b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b815eba0 0x7f50b80c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b815ae80 con 0x7f50b80b2120 2023-10-25T16:18:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b815a4b0 con 0x7f50b815eba0 2023-10-25T16:18:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b81595c0 con 0x7f50b80cdb10 2023-10-25T16:18:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 0x7f50b815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 0x7f50b815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52148/0 (socket says 172.21.15.177:52148) 2023-10-25T16:18:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 -- 172.21.15.177:0/3600816112 learned_addr learned my addr 172.21.15.177:0/3600816112 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bd4dd640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b815eba0 0x7f50b80c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b7fff640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50b80cdb10 0x7f50b80b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 -- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50b80cdb10 msgr2=0x7f50b80b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50b80cdb10 0x7f50b80b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 -- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b815eba0 msgr2=0x7f50b80c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b815eba0 0x7f50b80c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 -- 172.21.15.177:0/3600816112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00098e0 con 0x7f50b80b2120 2023-10-25T16:18:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bd4dd640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b815eba0 0x7f50b80c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bccdc640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 0x7f50b815a940 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f50a800e7a0 tx=0x7f50a800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8009590 con 0x7f50b80b2120 2023-10-25T16:18:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b81598a0 con 0x7f50b80b2120 2023-10-25T16:18:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50a800cdb0 con 0x7f50b80b2120 2023-10-25T16:18:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8010690 con 0x7f50b80b2120 2023-10-25T16:18:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b8159e60 con 0x7f50b80b2120 2023-10-25T16:18:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b804daf0 con 0x7f50b80b2120 2023-10-25T16:18:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50a80107f0 con 0x7f50b80b2120 2023-10-25T16:18:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b57fa640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50a4066470 0x7f50a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50a8014070 con 0x7f50b80b2120 2023-10-25T16:18:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.253+0000 7f50b7fff640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50a4066470 0x7f50a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.257+0000 7f50b7fff640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50a4066470 0x7f50a4068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f50b81f7f70 tx=0x7f50ac009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.257+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50a8050090 con 0x7f50b80b2120 2023-10-25T16:18:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.401+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50b80ce930 con 0x7f50b80b2120 2023-10-25T16:18:18.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50b57fa640 1 -- 172.21.15.177:0/3600816112 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16595 (secure 0 0 0) 0x7f50a8051d60 con 0x7f50b80b2120 2023-10-25T16:18:18.404 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:18.404 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":105,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:16.684336+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50a4066470 msgr2=0x7f50a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50a4066470 0x7f50a4068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f50b81f7f70 tx=0x7f50ac009040 comp rx=0 tx=0).stop 2023-10-25T16:18:18.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 msgr2=0x7f50b815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 0x7f50b815a940 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f50a800e7a0 tx=0x7f50a800ec60 comp rx=0 tx=0).stop 2023-10-25T16:18:18.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 shutdown_connections 2023-10-25T16:18:18.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f50a4066470 0x7f50a4068930 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50b815eba0 0x7f50b80c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50b80cdb10 0x7f50b80b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 --2- 172.21.15.177:0/3600816112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50b80b2120 0x7f50b815a940 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 >> 172.21.15.177:0/3600816112 conn(0x7f50b809a5c0 msgr2=0x7f50b815c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 shutdown_connections 2023-10-25T16:18:18.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.405+0000 7f50bef40640 1 -- 172.21.15.177:0/3600816112 wait complete. 2023-10-25T16:18:18.422 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:18:18.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:18:18.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/3156209474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 msgr2=0x7f5b90003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 --2- 172.21.15.177:0/3156209474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5b90003da0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400bb10 tx=0x7f5b9401cd50 comp rx=0 tx=0).stop 2023-10-25T16:18:18.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/3156209474 shutdown_connections 2023-10-25T16:18:18.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 --2- 172.21.15.177:0/3156209474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5b90003da0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/3156209474 >> 172.21.15.177:0/3156209474 conn(0x7f5ba40b2450 msgr2=0x7f5ba40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:18.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/3156209474 shutdown_connections 2023-10-25T16:18:18.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/3156209474 wait complete. 2023-10-25T16:18:18.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 Processor -- start 2023-10-25T16:18:18.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- start start 2023-10-25T16:18:18.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5ba4070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba4159d70 0x7f5ba415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba414f300 0x7f5ba414f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba414fcc0 con 0x7f5b90003980 2023-10-25T16:18:18.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4158a80 con 0x7f5ba414f300 2023-10-25T16:18:18.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4158cd0 con 0x7f5ba4159d70 2023-10-25T16:18:18.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5ba4070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5ba4070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52168/0 (socket says 172.21.15.177:52168) 2023-10-25T16:18:18.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 -- 172.21.15.177:0/2587992257 learned_addr learned my addr 172.21.15.177:0/2587992257 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:18.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba3fff640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba4159d70 0x7f5ba415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 -- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba4159d70 msgr2=0x7f5ba415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba4159d70 0x7f5ba415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 -- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba414f300 msgr2=0x7f5ba414f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba969d640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba414f300 0x7f5ba414f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba414f300 0x7f5ba414f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 -- 172.21.15.177:0/2587992257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba4158fb0 con 0x7f5b90003980 2023-10-25T16:18:18.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba8e9c640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5ba4070a00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f5b9401cb80 tx=0x7f5b94004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:18.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940be070 con 0x7f5b90003980 2023-10-25T16:18:18.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b94004510 con 0x7f5b90003980 2023-10-25T16:18:18.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba4159290 con 0x7f5b90003980 2023-10-25T16:18:18.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940052a0 con 0x7f5b90003980 2023-10-25T16:18:18.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.537+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba4159850 con 0x7f5b90003980 2023-10-25T16:18:18.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.541+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba40c9780 con 0x7f5b90003980 2023-10-25T16:18:18.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.541+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b94005400 con 0x7f5b90003980 2023-10-25T16:18:18.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.541+0000 7f5ba17fa640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b840664a0 0x7f5b84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.541+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b9411e0b0 con 0x7f5b90003980 2023-10-25T16:18:18.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.541+0000 7f5ba3fff640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b840664a0 0x7f5b84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.541+0000 7f5ba3fff640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b840664a0 0x7f5b84068960 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40aae90 tx=0x7f5b8c006de0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:18.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.545+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b940eb530 con 0x7f5b90003980 2023-10-25T16:18:18.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.693+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ba406b9e0 con 0x7f5b840664a0 2023-10-25T16:18:18.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.713+0000 7f5ba17fa640 1 -- 172.21.15.177:0/2587992257 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277949 (secure 0 0 0) 0x7f5b8c012470 con 0x7f5b840664a0 2023-10-25T16:18:18.715 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:18.717 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:18:18.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b840664a0 msgr2=0x7f5b84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b840664a0 0x7f5b84068960 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40aae90 tx=0x7f5b8c006de0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 msgr2=0x7f5ba4070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5ba4070a00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f5b9401cb80 tx=0x7f5b94004150 comp rx=0 tx=0).stop 2023-10-25T16:18:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 shutdown_connections 2023-10-25T16:18:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b840664a0 0x7f5b84068960 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba414f300 0x7f5ba414f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba4159d70 0x7f5ba415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 --2- 172.21.15.177:0/2587992257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b90003980 0x7f5ba4070a00 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 >> 172.21.15.177:0/2587992257 conn(0x7f5ba40b2450 msgr2=0x7f5ba4157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 shutdown_connections 2023-10-25T16:18:18.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.717+0000 7f5bab100640 1 -- 172.21.15.177:0/2587992257 wait complete. 2023-10-25T16:18:18.733 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-10-25T16:18:16.710897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5445,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557054,"statfs":{"total":1600000000,"available":1594423433,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001188"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676264+0000","last_change":"2023-10-25T16:18:14.676264+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676264+0000","last_undegraded":"2023-10-25T16:18:14.676264+0000","last_fullsized":"2023-10-25T16:18:14.676264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673602+0000","last_change":"2023-10-25T16:18:14.673602+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673602+0000","last_undegraded":"2023-10-25T16:18:14.673602+0000","last_fullsized":"2023-10-25T16:18:14.673602+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675766+0000","last_change":"2023-10-25T16:18:14.675766+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675766+0000","last_undegraded":"2023-10-25T16:18:14.675766+0000","last_fullsized":"2023-10-25T16:18:14.675766+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.691835+0000","last_change":"2023-10-25T16:18:14.691835+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.691835+0000","last_undegraded":"2023-10-25T16:18:14.691835+0000","last_fullsized":"2023-10-25T16:18:14.691835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668913+0000","last_change":"2023-10-25T16:18:14.668913+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668913+0000","last_undegraded":"2023-10-25T16:18:14.668913+0000","last_fullsized":"2023-10-25T16:18:14.668913+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668538+0000","last_change":"2023-10-25T16:18:14.668538+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668538+0000","last_undegraded":"2023-10-25T16:18:14.668538+0000","last_fullsized":"2023-10-25T16:18:14.668538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668347+0000","last_change":"2023-10-25T16:18:14.668347+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668347+0000","last_undegraded":"2023-10-25T16:18:14.668347+0000","last_fullsized":"2023-10-25T16:18:14.668347+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.685781+0000","last_change":"2023-10-25T16:18:14.685781+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.685781+0000","last_undegraded":"2023-10-25T16:18:14.685781+0000","last_fullsized":"2023-10-25T16:18:14.685781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668399+0000","last_change":"2023-10-25T16:18:14.668399+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668399+0000","last_undegraded":"2023-10-25T16:18:14.668399+0000","last_fullsized":"2023-10-25T16:18:14.668399+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676154+0000","last_change":"2023-10-25T16:18:14.676154+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676154+0000","last_undegraded":"2023-10-25T16:18:14.676154+0000","last_fullsized":"2023-10-25T16:18:14.676154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674843+0000","last_change":"2023-10-25T16:18:14.674843+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674843+0000","last_undegraded":"2023-10-25T16:18:14.674843+0000","last_fullsized":"2023-10-25T16:18:14.674843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673675+0000","last_change":"2023-10-25T16:18:14.673675+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673675+0000","last_undegraded":"2023-10-25T16:18:14.673675+0000","last_fullsized":"2023-10-25T16:18:14.673675+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690003+0000","last_change":"2023-10-25T16:18:14.690003+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690003+0000","last_undegraded":"2023-10-25T16:18:14.690003+0000","last_fullsized":"2023-10-25T16:18:14.690003+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690693+0000","last_change":"2023-10-25T16:18:14.690693+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690693+0000","last_undegraded":"2023-10-25T16:18:14.690693+0000","last_fullsized":"2023-10-25T16:18:14.690693+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674698+0000","last_change":"2023-10-25T16:18:14.674698+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674698+0000","last_undegraded":"2023-10-25T16:18:14.674698+0000","last_fullsized":"2023-10-25T16:18:14.674698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672981+0000","last_change":"2023-10-25T16:18:14.672981+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672981+0000","last_undegraded":"2023-10-25T16:18:14.672981+0000","last_fullsized":"2023-10-25T16:18:14.672981+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.686409+0000","last_change":"2023-10-25T16:18:14.686409+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.686409+0000","last_undegraded":"2023-10-25T16:18:14.686409+0000","last_fullsized":"2023-10-25T16:18:14.686409+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670539+0000","last_change":"2023-10-25T16:18:14.670539+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670539+0000","last_undegraded":"2023-10-25T16:18:14.670539+0000","last_fullsized":"2023-10-25T16:18:14.670539+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679076+0000","last_change":"2023-10-25T16:18:14.679076+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679076+0000","last_undegraded":"2023-10-25T16:18:14.679076+0000","last_fullsized":"2023-10-25T16:18:14.679076+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.688831+0000","last_change":"2023-10-25T16:18:14.688831+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.688831+0000","last_undegraded":"2023-10-25T16:18:14.688831+0000","last_fullsized":"2023-10-25T16:18:14.688831+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687825+0000","last_change":"2023-10-25T16:18:14.687825+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687825+0000","last_undegraded":"2023-10-25T16:18:14.687825+0000","last_fullsized":"2023-10-25T16:18:14.687825+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669945+0000","last_change":"2023-10-25T16:18:14.669945+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669945+0000","last_undegraded":"2023-10-25T16:18:14.669945+0000","last_fullsized":"2023-10-25T16:18:14.669945+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670115+0000","last_change":"2023-10-25T16:18:14.670115+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670115+0000","last_undegraded":"2023-10-25T16:18:14.670115+0000","last_fullsized":"2023-10-25T16:18:14.670115+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682089+0000","last_change":"2023-10-25T16:18:14.682089+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682089+0000","last_undegraded":"2023-10-25T16:18:14.682089+0000","last_fullsized":"2023-10-25T16:18:14.682089+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675334+0000","last_change":"2023-10-25T16:18:14.675334+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675334+0000","last_undegraded":"2023-10-25T16:18:14.675334+0000","last_fullsized":"2023-10-25T16:18:14.675334+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.683517+0000","last_change":"2023-10-25T16:18:14.683517+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.683517+0000","last_undegraded":"2023-10-25T16:18:14.683517+0000","last_fullsized":"2023-10-25T16:18:14.683517+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693719+0000","last_change":"2023-10-25T16:18:14.693474+0000","last_active":"2023-10-25T16:18:14.693719+0000","last_peered":"2023-10-25T16:18:14.693719+0000","last_clean":"2023-10-25T16:18:14.693719+0000","last_became_active":"2023-10-25T16:18:14.690705+0000","last_became_peered":"2023-10-25T16:18:14.690705+0000","last_unstale":"2023-10-25T16:18:14.693719+0000","last_undegraded":"2023-10-25T16:18:14.693719+0000","last_fullsized":"2023-10-25T16:18:14.693719+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:42:00.049478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687156+0000","last_change":"2023-10-25T16:18:14.687156+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687156+0000","last_undegraded":"2023-10-25T16:18:14.687156+0000","last_fullsized":"2023-10-25T16:18:14.687156+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678624+0000","last_change":"2023-10-25T16:18:14.678465+0000","last_active":"2023-10-25T16:18:14.678624+0000","last_peered":"2023-10-25T16:18:14.678624+0000","last_clean":"2023-10-25T16:18:14.678624+0000","last_became_active":"2023-10-25T16:18:14.677865+0000","last_became_peered":"2023-10-25T16:18:14.677865+0000","last_unstale":"2023-10-25T16:18:14.678624+0000","last_undegraded":"2023-10-25T16:18:14.678624+0000","last_fullsized":"2023-10-25T16:18:14.678624+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675189+0000","last_change":"2023-10-25T16:18:14.675189+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675189+0000","last_undegraded":"2023-10-25T16:18:14.675189+0000","last_fullsized":"2023-10-25T16:18:14.675189+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689178+0000","last_change":"2023-10-25T16:18:14.689093+0000","last_active":"2023-10-25T16:18:14.689178+0000","last_peered":"2023-10-25T16:18:14.689178+0000","last_clean":"2023-10-25T16:18:14.689178+0000","last_became_active":"2023-10-25T16:18:14.688742+0000","last_became_peered":"2023-10-25T16:18:14.688742+0000","last_unstale":"2023-10-25T16:18:14.689178+0000","last_undegraded":"2023-10-25T16:18:14.689178+0000","last_fullsized":"2023-10-25T16:18:14.689178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:20:56.322723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680592+0000","last_change":"2023-10-25T16:18:14.680592+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680592+0000","last_undegraded":"2023-10-25T16:18:14.680592+0000","last_fullsized":"2023-10-25T16:18:14.680592+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685079+0000","last_change":"2023-10-25T16:18:14.684960+0000","last_active":"2023-10-25T16:18:14.685079+0000","last_peered":"2023-10-25T16:18:14.685079+0000","last_clean":"2023-10-25T16:18:14.685079+0000","last_became_active":"2023-10-25T16:18:14.684527+0000","last_became_peered":"2023-10-25T16:18:14.684527+0000","last_unstale":"2023-10-25T16:18:14.685079+0000","last_undegraded":"2023-10-25T16:18:14.685079+0000","last_fullsized":"2023-10-25T16:18:14.685079+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:04:56.895056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669842+0000","last_change":"2023-10-25T16:18:14.669842+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669842+0000","last_undegraded":"2023-10-25T16:18:14.669842+0000","last_fullsized":"2023-10-25T16:18:14.669842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689444+0000","last_change":"2023-10-25T16:18:14.687552+0000","last_active":"2023-10-25T16:18:14.689444+0000","last_peered":"2023-10-25T16:18:14.689444+0000","last_clean":"2023-10-25T16:18:14.689444+0000","last_became_active":"2023-10-25T16:18:14.684155+0000","last_became_peered":"2023-10-25T16:18:14.684155+0000","last_unstale":"2023-10-25T16:18:14.689444+0000","last_undegraded":"2023-10-25T16:18:14.689444+0000","last_fullsized":"2023-10-25T16:18:14.689444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:34:36.744102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682021+0000","last_change":"2023-10-25T16:18:14.682021+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682021+0000","last_undegraded":"2023-10-25T16:18:14.682021+0000","last_fullsized":"2023-10-25T16:18:14.682021+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678980+0000","last_change":"2023-10-25T16:18:14.678816+0000","last_active":"2023-10-25T16:18:14.678980+0000","last_peered":"2023-10-25T16:18:14.678980+0000","last_clean":"2023-10-25T16:18:14.678980+0000","last_became_active":"2023-10-25T16:18:14.678249+0000","last_became_peered":"2023-10-25T16:18:14.678249+0000","last_unstale":"2023-10-25T16:18:14.678980+0000","last_undegraded":"2023-10-25T16:18:14.678980+0000","last_fullsized":"2023-10-25T16:18:14.678980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:32.222175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679789+0000","last_change":"2023-10-25T16:18:14.679789+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679789+0000","last_undegraded":"2023-10-25T16:18:14.679789+0000","last_fullsized":"2023-10-25T16:18:14.679789+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685689+0000","last_change":"2023-10-25T16:18:14.685624+0000","last_active":"2023-10-25T16:18:14.685689+0000","last_peered":"2023-10-25T16:18:14.685689+0000","last_clean":"2023-10-25T16:18:14.685689+0000","last_became_active":"2023-10-25T16:18:14.685386+0000","last_became_peered":"2023-10-25T16:18:14.685386+0000","last_unstale":"2023-10-25T16:18:14.685689+0000","last_undegraded":"2023-10-25T16:18:14.685689+0000","last_fullsized":"2023-10-25T16:18:14.685689+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:03.749221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672365+0000","last_change":"2023-10-25T16:18:14.672365+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672365+0000","last_undegraded":"2023-10-25T16:18:14.672365+0000","last_fullsized":"2023-10-25T16:18:14.672365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.680392+0000","last_change":"2023-10-25T16:18:14.680316+0000","last_active":"2023-10-25T16:18:14.680392+0000","last_peered":"2023-10-25T16:18:14.680392+0000","last_clean":"2023-10-25T16:18:14.680392+0000","last_became_active":"2023-10-25T16:18:14.680086+0000","last_became_peered":"2023-10-25T16:18:14.680086+0000","last_unstale":"2023-10-25T16:18:14.680392+0000","last_undegraded":"2023-10-25T16:18:14.680392+0000","last_fullsized":"2023-10-25T16:18:14.680392+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:26:39.178409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675291+0000","last_change":"2023-10-25T16:18:14.675291+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675291+0000","last_undegraded":"2023-10-25T16:18:14.675291+0000","last_fullsized":"2023-10-25T16:18:14.675291+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686050+0000","last_change":"2023-10-25T16:18:14.683993+0000","last_active":"2023-10-25T16:18:14.686050+0000","last_peered":"2023-10-25T16:18:14.686050+0000","last_clean":"2023-10-25T16:18:14.686050+0000","last_became_active":"2023-10-25T16:18:14.683418+0000","last_became_peered":"2023-10-25T16:18:14.683418+0000","last_unstale":"2023-10-25T16:18:14.686050+0000","last_undegraded":"2023-10-25T16:18:14.686050+0000","last_fullsized":"2023-10-25T16:18:14.686050+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668031+0000","last_change":"2023-10-25T16:18:14.668031+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668031+0000","last_undegraded":"2023-10-25T16:18:14.668031+0000","last_fullsized":"2023-10-25T16:18:14.668031+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691025+0000","last_change":"2023-10-25T16:18:14.690839+0000","last_active":"2023-10-25T16:18:14.691025+0000","last_peered":"2023-10-25T16:18:14.691025+0000","last_clean":"2023-10-25T16:18:14.691025+0000","last_became_active":"2023-10-25T16:18:14.689717+0000","last_became_peered":"2023-10-25T16:18:14.689717+0000","last_unstale":"2023-10-25T16:18:14.691025+0000","last_undegraded":"2023-10-25T16:18:14.691025+0000","last_fullsized":"2023-10-25T16:18:14.691025+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673812+0000","last_change":"2023-10-25T16:18:14.673812+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673812+0000","last_undegraded":"2023-10-25T16:18:14.673812+0000","last_fullsized":"2023-10-25T16:18:14.673812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.697913+0000","last_change":"2023-10-25T16:18:14.697731+0000","last_active":"2023-10-25T16:18:14.697913+0000","last_peered":"2023-10-25T16:18:14.697913+0000","last_clean":"2023-10-25T16:18:14.697913+0000","last_became_active":"2023-10-25T16:18:14.694148+0000","last_became_peered":"2023-10-25T16:18:14.694148+0000","last_unstale":"2023-10-25T16:18:14.697913+0000","last_undegraded":"2023-10-25T16:18:14.697913+0000","last_fullsized":"2023-10-25T16:18:14.697913+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:43:51.638791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681803+0000","last_change":"2023-10-25T16:18:14.681803+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681803+0000","last_undegraded":"2023-10-25T16:18:14.681803+0000","last_fullsized":"2023-10-25T16:18:14.681803+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.683164+0000","last_change":"2023-10-25T16:18:14.683000+0000","last_active":"2023-10-25T16:18:14.683164+0000","last_peered":"2023-10-25T16:18:14.683164+0000","last_clean":"2023-10-25T16:18:14.683164+0000","last_became_active":"2023-10-25T16:18:14.682375+0000","last_became_peered":"2023-10-25T16:18:14.682375+0000","last_unstale":"2023-10-25T16:18:14.683164+0000","last_undegraded":"2023-10-25T16:18:14.683164+0000","last_fullsized":"2023-10-25T16:18:14.683164+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:23.538133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675469+0000","last_change":"2023-10-25T16:18:14.675469+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675469+0000","last_undegraded":"2023-10-25T16:18:14.675469+0000","last_fullsized":"2023-10-25T16:18:14.675469+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678631+0000","last_change":"2023-10-25T16:18:14.678520+0000","last_active":"2023-10-25T16:18:14.678631+0000","last_peered":"2023-10-25T16:18:14.678631+0000","last_clean":"2023-10-25T16:18:14.678631+0000","last_became_active":"2023-10-25T16:18:14.678295+0000","last_became_peered":"2023-10-25T16:18:14.678295+0000","last_unstale":"2023-10-25T16:18:14.678631+0000","last_undegraded":"2023-10-25T16:18:14.678631+0000","last_fullsized":"2023-10-25T16:18:14.678631+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:03:04.894878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.678931+0000","last_change":"2023-10-25T16:18:14.678931+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.678931+0000","last_undegraded":"2023-10-25T16:18:14.678931+0000","last_fullsized":"2023-10-25T16:18:14.678931+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685166+0000","last_change":"2023-10-25T16:18:14.684401+0000","last_active":"2023-10-25T16:18:14.685166+0000","last_peered":"2023-10-25T16:18:14.685166+0000","last_clean":"2023-10-25T16:18:14.685166+0000","last_became_active":"2023-10-25T16:18:14.683848+0000","last_became_peered":"2023-10-25T16:18:14.683848+0000","last_unstale":"2023-10-25T16:18:14.685166+0000","last_undegraded":"2023-10-25T16:18:14.685166+0000","last_fullsized":"2023-10-25T16:18:14.685166+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:52:14.014632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670755+0000","last_change":"2023-10-25T16:18:14.670755+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670755+0000","last_undegraded":"2023-10-25T16:18:14.670755+0000","last_fullsized":"2023-10-25T16:18:14.670755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.670309+0000","last_change":"2023-10-25T16:18:14.670094+0000","last_active":"2023-10-25T16:18:14.670309+0000","last_peered":"2023-10-25T16:18:14.670309+0000","last_clean":"2023-10-25T16:18:14.670309+0000","last_became_active":"2023-10-25T16:18:14.669490+0000","last_became_peered":"2023-10-25T16:18:14.669490+0000","last_unstale":"2023-10-25T16:18:14.670309+0000","last_undegraded":"2023-10-25T16:18:14.670309+0000","last_fullsized":"2023-10-25T16:18:14.670309+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:17.496638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672419+0000","last_change":"2023-10-25T16:18:14.672419+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672419+0000","last_undegraded":"2023-10-25T16:18:14.672419+0000","last_fullsized":"2023-10-25T16:18:14.672419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678008+0000","last_change":"2023-10-25T16:18:14.677926+0000","last_active":"2023-10-25T16:18:14.678008+0000","last_peered":"2023-10-25T16:18:14.678008+0000","last_clean":"2023-10-25T16:18:14.678008+0000","last_became_active":"2023-10-25T16:18:14.677671+0000","last_became_peered":"2023-10-25T16:18:14.677671+0000","last_unstale":"2023-10-25T16:18:14.678008+0000","last_undegraded":"2023-10-25T16:18:14.678008+0000","last_fullsized":"2023-10-25T16:18:14.678008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:43.298974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.677963+0000","last_change":"2023-10-25T16:18:14.677963+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.677963+0000","last_undegraded":"2023-10-25T16:18:14.677963+0000","last_fullsized":"2023-10-25T16:18:14.677963+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.696783+0000","last_change":"2023-10-25T16:18:14.695380+0000","last_active":"2023-10-25T16:18:14.696783+0000","last_peered":"2023-10-25T16:18:14.696783+0000","last_clean":"2023-10-25T16:18:14.696783+0000","last_became_active":"2023-10-25T16:18:14.694774+0000","last_became_peered":"2023-10-25T16:18:14.694774+0000","last_unstale":"2023-10-25T16:18:14.696783+0000","last_undegraded":"2023-10-25T16:18:14.696783+0000","last_fullsized":"2023-10-25T16:18:14.696783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:39.713874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676904+0000","last_change":"2023-10-25T16:18:14.676904+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676904+0000","last_undegraded":"2023-10-25T16:18:14.676904+0000","last_fullsized":"2023-10-25T16:18:14.676904+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.681355+0000","last_change":"2023-10-25T16:18:14.681247+0000","last_active":"2023-10-25T16:18:14.681355+0000","last_peered":"2023-10-25T16:18:14.681355+0000","last_clean":"2023-10-25T16:18:14.681355+0000","last_became_active":"2023-10-25T16:18:14.680881+0000","last_became_peered":"2023-10-25T16:18:14.680881+0000","last_unstale":"2023-10-25T16:18:14.681355+0000","last_undegraded":"2023-10-25T16:18:14.681355+0000","last_fullsized":"2023-10-25T16:18:14.681355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:11.176098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681261+0000","last_change":"2023-10-25T16:18:14.681261+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681261+0000","last_undegraded":"2023-10-25T16:18:14.681261+0000","last_fullsized":"2023-10-25T16:18:14.681261+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.676442+0000","last_change":"2023-10-25T16:18:14.676353+0000","last_active":"2023-10-25T16:18:14.676442+0000","last_peered":"2023-10-25T16:18:14.676442+0000","last_clean":"2023-10-25T16:18:14.676442+0000","last_became_active":"2023-10-25T16:18:14.675995+0000","last_became_peered":"2023-10-25T16:18:14.675995+0000","last_unstale":"2023-10-25T16:18:14.676442+0000","last_undegraded":"2023-10-25T16:18:14.676442+0000","last_fullsized":"2023-10-25T16:18:14.676442+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:47.794485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686076+0000","last_change":"2023-10-25T16:18:14.685953+0000","last_active":"2023-10-25T16:18:14.686076+0000","last_peered":"2023-10-25T16:18:14.686076+0000","last_clean":"2023-10-25T16:18:14.686076+0000","last_became_active":"2023-10-25T16:18:14.685457+0000","last_became_peered":"2023-10-25T16:18:14.685457+0000","last_unstale":"2023-10-25T16:18:14.686076+0000","last_undegraded":"2023-10-25T16:18:14.686076+0000","last_fullsized":"2023-10-25T16:18:14.686076+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:50.749638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667784+0000","last_change":"2023-10-25T16:18:14.667784+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667784+0000","last_undegraded":"2023-10-25T16:18:14.667784+0000","last_fullsized":"2023-10-25T16:18:14.667784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:13.645540+0000","last_change":"2023-10-25T16:18:13.645540+0000","last_active":"2023-10-25T16:18:13.645540+0000","last_peered":"2023-10-25T16:18:13.645540+0000","last_clean":"2023-10-25T16:18:13.645540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:13.645540+0000","last_undegraded":"2023-10-25T16:18:13.645540+0000","last_fullsized":"2023-10-25T16:18:13.645540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:14.654677+0000","last_change":"2023-10-25T16:18:14.654677+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.654677+0000","last_undegraded":"2023-10-25T16:18:14.654677+0000","last_fullsized":"2023-10-25T16:18:14.654677+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:18:13.645540+0000","last_change":"2023-10-25T16:18:13.645540+0000","last_active":"2023-10-25T16:18:13.645540+0000","last_peered":"2023-10-25T16:18:13.645540+0000","last_clean":"2023-10-25T16:18:13.645540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:13.645540+0000","last_undegraded":"2023-10-25T16:18:13.645540+0000","last_fullsized":"2023-10-25T16:18:13.645540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668507+0000","last_change":"2023-10-25T16:18:14.668507+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668507+0000","last_undegraded":"2023-10-25T16:18:14.668507+0000","last_fullsized":"2023-10-25T16:18:14.668507+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685204+0000","last_change":"2023-10-25T16:18:14.684569+0000","last_active":"2023-10-25T16:18:14.685204+0000","last_peered":"2023-10-25T16:18:14.685204+0000","last_clean":"2023-10-25T16:18:14.685204+0000","last_became_active":"2023-10-25T16:18:14.684187+0000","last_became_peered":"2023-10-25T16:18:14.684187+0000","last_unstale":"2023-10-25T16:18:14.685204+0000","last_undegraded":"2023-10-25T16:18:14.685204+0000","last_fullsized":"2023-10-25T16:18:14.685204+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:30:45.612265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680982+0000","last_change":"2023-10-25T16:18:14.680982+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680982+0000","last_undegraded":"2023-10-25T16:18:14.680982+0000","last_fullsized":"2023-10-25T16:18:14.680982+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.694999+0000","last_change":"2023-10-25T16:18:14.694912+0000","last_active":"2023-10-25T16:18:14.694999+0000","last_peered":"2023-10-25T16:18:14.694999+0000","last_clean":"2023-10-25T16:18:14.694999+0000","last_became_active":"2023-10-25T16:18:14.694664+0000","last_became_peered":"2023-10-25T16:18:14.694664+0000","last_unstale":"2023-10-25T16:18:14.694999+0000","last_undegraded":"2023-10-25T16:18:14.694999+0000","last_fullsized":"2023-10-25T16:18:14.694999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:33:08.133934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674686+0000","last_change":"2023-10-25T16:18:14.674686+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674686+0000","last_undegraded":"2023-10-25T16:18:14.674686+0000","last_fullsized":"2023-10-25T16:18:14.674686+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686554+0000","last_change":"2023-10-25T16:18:14.686451+0000","last_active":"2023-10-25T16:18:14.686554+0000","last_peered":"2023-10-25T16:18:14.686554+0000","last_clean":"2023-10-25T16:18:14.686554+0000","last_became_active":"2023-10-25T16:18:14.685309+0000","last_became_peered":"2023-10-25T16:18:14.685309+0000","last_unstale":"2023-10-25T16:18:14.686554+0000","last_undegraded":"2023-10-25T16:18:14.686554+0000","last_fullsized":"2023-10-25T16:18:14.686554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:10:04.278788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684504+0000","last_change":"2023-10-25T16:18:14.684504+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684504+0000","last_undegraded":"2023-10-25T16:18:14.684504+0000","last_fullsized":"2023-10-25T16:18:14.684504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693181+0000","last_change":"2023-10-25T16:18:14.692973+0000","last_active":"2023-10-25T16:18:14.693181+0000","last_peered":"2023-10-25T16:18:14.693181+0000","last_clean":"2023-10-25T16:18:14.693181+0000","last_became_active":"2023-10-25T16:18:14.690673+0000","last_became_peered":"2023-10-25T16:18:14.690673+0000","last_unstale":"2023-10-25T16:18:14.693181+0000","last_undegraded":"2023-10-25T16:18:14.693181+0000","last_fullsized":"2023-10-25T16:18:14.693181+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680844+0000","last_change":"2023-10-25T16:18:14.680844+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680844+0000","last_undegraded":"2023-10-25T16:18:14.680844+0000","last_fullsized":"2023-10-25T16:18:14.680844+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.688377+0000","last_change":"2023-10-25T16:18:14.688218+0000","last_active":"2023-10-25T16:18:14.688377+0000","last_peered":"2023-10-25T16:18:14.688377+0000","last_clean":"2023-10-25T16:18:14.688377+0000","last_became_active":"2023-10-25T16:18:14.686762+0000","last_became_peered":"2023-10-25T16:18:14.686762+0000","last_unstale":"2023-10-25T16:18:14.688377+0000","last_undegraded":"2023-10-25T16:18:14.688377+0000","last_fullsized":"2023-10-25T16:18:14.688377+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:29.234593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667531+0000","last_change":"2023-10-25T16:18:14.667531+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667531+0000","last_undegraded":"2023-10-25T16:18:14.667531+0000","last_fullsized":"2023-10-25T16:18:14.667531+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.695037+0000","last_change":"2023-10-25T16:18:14.694936+0000","last_active":"2023-10-25T16:18:14.695037+0000","last_peered":"2023-10-25T16:18:14.695037+0000","last_clean":"2023-10-25T16:18:14.695037+0000","last_became_active":"2023-10-25T16:18:14.694778+0000","last_became_peered":"2023-10-25T16:18:14.694778+0000","last_unstale":"2023-10-25T16:18:14.695037+0000","last_undegraded":"2023-10-25T16:18:14.695037+0000","last_fullsized":"2023-10-25T16:18:14.695037+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:18.354295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675159+0000","last_change":"2023-10-25T16:18:14.675159+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675159+0000","last_undegraded":"2023-10-25T16:18:14.675159+0000","last_fullsized":"2023-10-25T16:18:14.675159+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678673+0000","last_change":"2023-10-25T16:18:14.678493+0000","last_active":"2023-10-25T16:18:14.678673+0000","last_peered":"2023-10-25T16:18:14.678673+0000","last_clean":"2023-10-25T16:18:14.678673+0000","last_became_active":"2023-10-25T16:18:14.677877+0000","last_became_peered":"2023-10-25T16:18:14.677877+0000","last_unstale":"2023-10-25T16:18:14.678673+0000","last_undegraded":"2023-10-25T16:18:14.678673+0000","last_fullsized":"2023-10-25T16:18:14.678673+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674664+0000","last_change":"2023-10-25T16:18:14.674664+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674664+0000","last_undegraded":"2023-10-25T16:18:14.674664+0000","last_fullsized":"2023-10-25T16:18:14.674664+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691935+0000","last_change":"2023-10-25T16:18:14.691770+0000","last_active":"2023-10-25T16:18:14.691935+0000","last_peered":"2023-10-25T16:18:14.691935+0000","last_clean":"2023-10-25T16:18:14.691935+0000","last_became_active":"2023-10-25T16:18:14.688844+0000","last_became_peered":"2023-10-25T16:18:14.688844+0000","last_unstale":"2023-10-25T16:18:14.691935+0000","last_undegraded":"2023-10-25T16:18:14.691935+0000","last_fullsized":"2023-10-25T16:18:14.691935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:11:38.680241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684336+0000","last_change":"2023-10-25T16:18:14.684336+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684336+0000","last_undegraded":"2023-10-25T16:18:14.684336+0000","last_fullsized":"2023-10-25T16:18:14.684336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689381+0000","last_change":"2023-10-25T16:18:14.687958+0000","last_active":"2023-10-25T16:18:14.689381+0000","last_peered":"2023-10-25T16:18:14.689381+0000","last_clean":"2023-10-25T16:18:14.689381+0000","last_became_active":"2023-10-25T16:18:14.685768+0000","last_became_peered":"2023-10-25T16:18:14.685768+0000","last_unstale":"2023-10-25T16:18:14.689381+0000","last_undegraded":"2023-10-25T16:18:14.689381+0000","last_fullsized":"2023-10-25T16:18:14.689381+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.671873+0000","last_change":"2023-10-25T16:18:14.671873+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.671873+0000","last_undegraded":"2023-10-25T16:18:14.671873+0000","last_fullsized":"2023-10-25T16:18:14.671873+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.698634+0000","last_change":"2023-10-25T16:18:14.698466+0000","last_active":"2023-10-25T16:18:14.698634+0000","last_peered":"2023-10-25T16:18:14.698634+0000","last_clean":"2023-10-25T16:18:14.698634+0000","last_became_active":"2023-10-25T16:18:14.697644+0000","last_became_peered":"2023-10-25T16:18:14.697644+0000","last_unstale":"2023-10-25T16:18:14.698634+0000","last_undegraded":"2023-10-25T16:18:14.698634+0000","last_fullsized":"2023-10-25T16:18:14.698634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:58.505243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-25T16:18:13.667831+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:18:13.667831+0000","last_peered":"2023-10-25T16:18:13.667831+0000","last_clean":"2023-10-25T16:18:13.667831+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:18:13.667831+0000","last_undegraded":"2023-10-25T16:18:13.667831+0000","last_fullsized":"2023-10-25T16:18:13.667831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:30.918156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194798,"statfs":{"total":200000000,"available":199473447,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57799999999999996,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60999999999999999,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.94099999999999995,"5min":1.077,"15min":1.077},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63100000000000001,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66400000000000003,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.61599999999999999},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.194,"5min":1.345,"15min":1.345},"last":1.081}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90100000000000002,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.89500000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.052},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":1.171}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.88900000000000001},"min":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.135},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.91200000000000003,"15min":0.92900000000000005},"min":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.86499999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.95299999999999996,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.474,"5min":1.677,"15min":1.677},"last":1.008},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.454,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.93000000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.117,"5min":1.256,"15min":1.256},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85699999999999998,"15min":0.82899999999999996},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.534,"15min":1.534},"last":0.92700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.177,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.284,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1659999999999999,"5min":1.27,"15min":1.27},"last":1.089},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":0.97499999999999998},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.222,"5min":1.446,"15min":1.446},"last":0.998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":0.94299999999999995},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.05}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.878,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0009999999999999,"15min":1.0489999999999999},"min":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.286,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.72199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.196,"5min":1.637,"15min":1.637},"last":0.88200000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":0.85899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.387,"5min":1.669,"15min":1.669},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.109,"5min":1.115,"15min":1.125},"min":{"1min":0.84399999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.286,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0229999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89200000000000002,"15min":0.88900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.083}]},{"osd":1,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.89100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1890000000000001,"5min":1.302,"15min":1.302},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.296,"5min":1.476,"15min":1.476},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93700000000000006,"15min":0.88900000000000001},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.484,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.177}]},{"osd":4,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.627},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95199999999999996,"15min":0.98799999999999999},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.97199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.056,"15min":1.054},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5720000000000001,"5min":1.895,"15min":1.895},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.69799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.139},{"interface":"front","average":{"1min":1.145,"5min":1.0880000000000001,"15min":1.0449999999999999},"min":{"1min":0.66300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0069999999999999,"15min":1.331},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":14.843,"15min":14.843},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.002,"15min":1.458},"min":{"1min":0.54600000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":16.439,"15min":16.439},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.03,"15min":1.393},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.157,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90600000000000003,"15min":0.874},"min":{"1min":0.66700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.92100000000000004,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.012,"5min":0.97999999999999998,"15min":0.96999999999999997},"min":{"1min":0.69399999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3169999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2150000000000001,"15min":1.5029999999999999},"min":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.194,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.149,"15min":1.5700000000000001},"min":{"1min":0.60299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.53,"5min":15.904,"15min":15.904},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1240000000000001,"15min":1.595},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1899999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.173,"15min":1.4890000000000001},"min":{"1min":0.91400000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":14.567,"15min":14.567},"last":1.143},{"interface":"front","average":{"1min":1.161,"5min":1.3,"15min":1.6910000000000001},"min":{"1min":0.73499999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5820000000000001,"5min":15.089,"15min":15.089},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.2030000000000001,"15min":1.708},"min":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.24,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.212,"5min":1.177,"15min":1.2649999999999999},"min":{"1min":0.96299999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2649999999999999,"5min":1.47,"15min":1.47},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.85299999999999998,"15min":0.81299999999999994},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.278,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.874,"15min":0.82299999999999995},"min":{"1min":0.55200000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.288,"15min":1.288},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.97299999999999998,"15min":0.94299999999999995},"min":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1619999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.095}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95799999999999996,"15min":0.90900000000000003},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.196,"5min":1.518,"15min":1.518},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.169,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.89000000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3180000000000001,"5min":1.431,"15min":1.431},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.64200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2430000000000001,"5min":2.085,"15min":2.085},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.089,"15min":1.071},"min":{"1min":0.69499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.92900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.94799999999999995},"min":{"1min":0.63,"5min":0.5,"15min":0.5},"max":{"1min":1.2609999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.1160000000000001},"min":{"1min":0.96699999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60399999999999998,"15min":0.55200000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.81299999999999994,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.64100000000000001},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.94099999999999995,"5min":1.083,"15min":1.083},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.32600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.1779999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73799999999999999,"15min":0.69999999999999996},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.155,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.95599999999999996,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.087},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1379999999999999,"5min":1.23,"15min":1.23},"last":1.052},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.206,"5min":1.427,"15min":1.427},"last":0.93400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89800000000000002,"15min":0.92800000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.96299999999999997,"15min":0.93999999999999995},"min":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.22,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1799999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.226,"5min":1.456,"15min":1.456},"last":0.999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1719999999999999,"5min":1.663,"15min":1.663},"last":1.028}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.99299999999999999,"15min":0.96999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.28,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97199999999999998,"15min":0.94699999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.254,"5min":1.389,"15min":1.389},"last":1.1319999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.95399999999999996,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.249,"15min":0.249},"max":{"1min":0.99099999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.157,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.39100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.048,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.375,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1899999999999999,"5min":1.423,"15min":1.423},"last":1.0269999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":0.97299999999999998},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0820000000000001,"5min":12.698,"15min":12.698},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.026},"min":{"1min":0.73099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2310000000000001,"5min":12.721,"15min":12.721},"last":1.23}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2729999999999999,"5min":1.546,"15min":1.546},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.89100000000000001},"min":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.034,"5min":2.206,"15min":2.206},"last":0.94299999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.70899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.298,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.397,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.101,"15min":0.98299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.276,"5min":14.776,"15min":14.776},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1080000000000001,"15min":1.022},"min":{"1min":0.62,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.476,"5min":10.509,"15min":10.509},"last":1.2829999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.69499999999999995},"min":{"1min":0.33100000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.74099999999999999},"min":{"1min":0.39500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.3560000000000001,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.89300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.68400000000000005},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.996,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98899999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.745}]},{"osd":3,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.194,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.407,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.036}]},{"osd":4,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3120000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.71999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6719999999999999,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90100000000000002,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.228,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92200000000000004,"15min":0.95099999999999996},"min":{"1min":0.67100000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.21,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.1379999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.278,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.94699999999999995,"15min":0.92200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.387,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.069}]},{"osd":7,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.075,"15min":1.298},"min":{"1min":0.73899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.294,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0900000000000001,"15min":1.3149999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4410000000000001,"5min":11.622,"15min":11.622},"last":1.276}]}]}],"pool_statfs":[]}} 2023-10-25T16:18:18.742 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:18:18.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/3864735032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee015b710 msgr2=0x7f5ee013d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 --2- 172.21.15.177:0/3864735032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee015b710 0x7f5ee013d8f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009930 tx=0x7f5edc01c850 comp rx=0 tx=0).stop 2023-10-25T16:18:18.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/3864735032 shutdown_connections 2023-10-25T16:18:18.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 --2- 172.21.15.177:0/3864735032 >> v2:172.21.15.184:3300/0 conn(0x7f5ee00af5d0 0x7f5ee013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 --2- 172.21.15.177:0/3864735032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee015b710 0x7f5ee013d8f0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/3864735032 >> 172.21.15.177:0/3864735032 conn(0x7f5ee00b2450 msgr2=0x7f5ee00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:18.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/3864735032 shutdown_connections 2023-10-25T16:18:18.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/3864735032 wait complete. 2023-10-25T16:18:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 Processor -- start 2023-10-25T16:18:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- start start 2023-10-25T16:18:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 0x7f5ee013e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ee013bda0 0x7f5ee00afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ee015b710 0x7f5ee00b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0140480 con 0x7f5ee00af5d0 2023-10-25T16:18:18.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee013f3e0 con 0x7f5ee013bda0 2023-10-25T16:18:18.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee013f6c0 con 0x7f5ee015b710 2023-10-25T16:18:18.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 0x7f5ee013e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 0x7f5ee013e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52196/0 (socket says 172.21.15.177:52196) 2023-10-25T16:18:18.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 -- 172.21.15.177:0/1018589167 learned_addr learned my addr 172.21.15.177:0/1018589167 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:18.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 -- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ee015b710 msgr2=0x7f5ee00b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ee015b710 0x7f5ee00b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 -- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ee013bda0 msgr2=0x7f5ee00afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:18.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ee013bda0 0x7f5ee00afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:18.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 -- 172.21.15.177:0/1018589167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc009560 con 0x7f5ee00af5d0 2023-10-25T16:18:18.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee512f640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 0x7f5ee013e990 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5edc019460 tx=0x7f5edc0a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:18.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc003800 con 0x7f5ee00af5d0 2023-10-25T16:18:18.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5edc0a5920 con 0x7f5ee00af5d0 2023-10-25T16:18:18.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee013f9a0 con 0x7f5ee00af5d0 2023-10-25T16:18:18.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc003cb0 con 0x7f5ee00af5d0 2023-10-25T16:18:18.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.897+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee013ff60 con 0x7f5ee00af5d0 2023-10-25T16:18:18.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.901+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee013d760 con 0x7f5ee00af5d0 2023-10-25T16:18:18.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.901+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5edc0b4070 con 0x7f5ee00af5d0 2023-10-25T16:18:18.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.901+0000 7f5ed5ffb640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ec40664a0 0x7f5ec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:18.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.901+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5edc11e620 con 0x7f5ee00af5d0 2023-10-25T16:18:18.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.901+0000 7f5ee492e640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ec40664a0 0x7f5ec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:18.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.901+0000 7f5ee492e640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ec40664a0 0x7f5ec4068960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5ee015b370 tx=0x7f5ed0005bf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:18.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:18.905+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5edc0ebaa0 con 0x7f5ee00af5d0 2023-10-25T16:18:19.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.045+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ee004daf0 con 0x7f5ec40664a0 2023-10-25T16:18:19.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.065+0000 7f5ed5ffb640 1 -- 172.21.15.177:0/1018589167 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279318 (secure 0 0 0) 0x7f5ee004daf0 con 0x7f5ec40664a0 2023-10-25T16:18:19.066 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:19.068 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:18:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ec40664a0 msgr2=0x7f5ec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ec40664a0 0x7f5ec4068960 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5ee015b370 tx=0x7f5ed0005bf0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 msgr2=0x7f5ee013e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 0x7f5ee013e990 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f5edc019460 tx=0x7f5edc0a5730 comp rx=0 tx=0).stop 2023-10-25T16:18:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 shutdown_connections 2023-10-25T16:18:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ec40664a0 0x7f5ec4068960 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ee015b710 0x7f5ee00b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ee013bda0 0x7f5ee00afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 --2- 172.21.15.177:0/1018589167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ee00af5d0 0x7f5ee013e990 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 >> 172.21.15.177:0/1018589167 conn(0x7f5ee00b2450 msgr2=0x7f5ee015a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:19.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 shutdown_connections 2023-10-25T16:18:19.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.069+0000 7f5ee7393640 1 -- 172.21.15.177:0/1018589167 wait complete. 2023-10-25T16:18:19.082 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-25T16:18:18.715584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5484,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557015,"statfs":{"total":1600000000,"available":1594383600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.057192"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676264+0000","last_change":"2023-10-25T16:18:14.676264+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676264+0000","last_undegraded":"2023-10-25T16:18:14.676264+0000","last_fullsized":"2023-10-25T16:18:14.676264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673602+0000","last_change":"2023-10-25T16:18:14.673602+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673602+0000","last_undegraded":"2023-10-25T16:18:14.673602+0000","last_fullsized":"2023-10-25T16:18:14.673602+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675766+0000","last_change":"2023-10-25T16:18:14.675766+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675766+0000","last_undegraded":"2023-10-25T16:18:14.675766+0000","last_fullsized":"2023-10-25T16:18:14.675766+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.723240+0000","last_change":"2023-10-25T16:18:15.722650+0000","last_active":"2023-10-25T16:18:15.723240+0000","last_peered":"2023-10-25T16:18:15.723240+0000","last_clean":"2023-10-25T16:18:15.723240+0000","last_became_active":"2023-10-25T16:18:15.721279+0000","last_became_peered":"2023-10-25T16:18:15.721279+0000","last_unstale":"2023-10-25T16:18:15.723240+0000","last_undegraded":"2023-10-25T16:18:15.723240+0000","last_fullsized":"2023-10-25T16:18:15.723240+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:16.470516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.691835+0000","last_change":"2023-10-25T16:18:14.691835+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.691835+0000","last_undegraded":"2023-10-25T16:18:14.691835+0000","last_fullsized":"2023-10-25T16:18:14.691835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668913+0000","last_change":"2023-10-25T16:18:14.668913+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668913+0000","last_undegraded":"2023-10-25T16:18:14.668913+0000","last_fullsized":"2023-10-25T16:18:14.668913+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717078+0000","last_change":"2023-10-25T16:18:15.716087+0000","last_active":"2023-10-25T16:18:15.717078+0000","last_peered":"2023-10-25T16:18:15.717078+0000","last_clean":"2023-10-25T16:18:15.717078+0000","last_became_active":"2023-10-25T16:18:15.715482+0000","last_became_peered":"2023-10-25T16:18:15.715482+0000","last_unstale":"2023-10-25T16:18:15.717078+0000","last_undegraded":"2023-10-25T16:18:15.717078+0000","last_fullsized":"2023-10-25T16:18:15.717078+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:32.163406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668538+0000","last_change":"2023-10-25T16:18:14.668538+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668538+0000","last_undegraded":"2023-10-25T16:18:14.668538+0000","last_fullsized":"2023-10-25T16:18:14.668538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668347+0000","last_change":"2023-10-25T16:18:14.668347+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668347+0000","last_undegraded":"2023-10-25T16:18:14.668347+0000","last_fullsized":"2023-10-25T16:18:14.668347+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.685781+0000","last_change":"2023-10-25T16:18:14.685781+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.685781+0000","last_undegraded":"2023-10-25T16:18:14.685781+0000","last_fullsized":"2023-10-25T16:18:14.685781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668399+0000","last_change":"2023-10-25T16:18:14.668399+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668399+0000","last_undegraded":"2023-10-25T16:18:14.668399+0000","last_fullsized":"2023-10-25T16:18:14.668399+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676154+0000","last_change":"2023-10-25T16:18:14.676154+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676154+0000","last_undegraded":"2023-10-25T16:18:14.676154+0000","last_fullsized":"2023-10-25T16:18:14.676154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674843+0000","last_change":"2023-10-25T16:18:14.674843+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674843+0000","last_undegraded":"2023-10-25T16:18:14.674843+0000","last_fullsized":"2023-10-25T16:18:14.674843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722481+0000","last_change":"2023-10-25T16:18:15.722288+0000","last_active":"2023-10-25T16:18:15.722481+0000","last_peered":"2023-10-25T16:18:15.722481+0000","last_clean":"2023-10-25T16:18:15.722481+0000","last_became_active":"2023-10-25T16:18:15.720465+0000","last_became_peered":"2023-10-25T16:18:15.720465+0000","last_unstale":"2023-10-25T16:18:15.722481+0000","last_undegraded":"2023-10-25T16:18:15.722481+0000","last_fullsized":"2023-10-25T16:18:15.722481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:11:20.814717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673675+0000","last_change":"2023-10-25T16:18:14.673675+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673675+0000","last_undegraded":"2023-10-25T16:18:14.673675+0000","last_fullsized":"2023-10-25T16:18:14.673675+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690003+0000","last_change":"2023-10-25T16:18:14.690003+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690003+0000","last_undegraded":"2023-10-25T16:18:14.690003+0000","last_fullsized":"2023-10-25T16:18:14.690003+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690693+0000","last_change":"2023-10-25T16:18:14.690693+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690693+0000","last_undegraded":"2023-10-25T16:18:14.690693+0000","last_fullsized":"2023-10-25T16:18:14.690693+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.725970+0000","last_change":"2023-10-25T16:18:15.725861+0000","last_active":"2023-10-25T16:18:15.725970+0000","last_peered":"2023-10-25T16:18:15.725970+0000","last_clean":"2023-10-25T16:18:15.725970+0000","last_became_active":"2023-10-25T16:18:15.725444+0000","last_became_peered":"2023-10-25T16:18:15.725444+0000","last_unstale":"2023-10-25T16:18:15.725970+0000","last_undegraded":"2023-10-25T16:18:15.725970+0000","last_fullsized":"2023-10-25T16:18:15.725970+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:25:28.385113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674698+0000","last_change":"2023-10-25T16:18:14.674698+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674698+0000","last_undegraded":"2023-10-25T16:18:14.674698+0000","last_fullsized":"2023-10-25T16:18:14.674698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717127+0000","last_change":"2023-10-25T16:18:15.716259+0000","last_active":"2023-10-25T16:18:15.717127+0000","last_peered":"2023-10-25T16:18:15.717127+0000","last_clean":"2023-10-25T16:18:15.717127+0000","last_became_active":"2023-10-25T16:18:15.715255+0000","last_became_peered":"2023-10-25T16:18:15.715255+0000","last_unstale":"2023-10-25T16:18:15.717127+0000","last_undegraded":"2023-10-25T16:18:15.717127+0000","last_fullsized":"2023-10-25T16:18:15.717127+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:32.491155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.724145+0000","last_change":"2023-10-25T16:18:15.723787+0000","last_active":"2023-10-25T16:18:15.724145+0000","last_peered":"2023-10-25T16:18:15.724145+0000","last_clean":"2023-10-25T16:18:15.724145+0000","last_became_active":"2023-10-25T16:18:15.722844+0000","last_became_peered":"2023-10-25T16:18:15.722844+0000","last_unstale":"2023-10-25T16:18:15.724145+0000","last_undegraded":"2023-10-25T16:18:15.724145+0000","last_fullsized":"2023-10-25T16:18:15.724145+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:33.050668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672981+0000","last_change":"2023-10-25T16:18:14.672981+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672981+0000","last_undegraded":"2023-10-25T16:18:14.672981+0000","last_fullsized":"2023-10-25T16:18:14.672981+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.686409+0000","last_change":"2023-10-25T16:18:14.686409+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.686409+0000","last_undegraded":"2023-10-25T16:18:14.686409+0000","last_fullsized":"2023-10-25T16:18:14.686409+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717169+0000","last_change":"2023-10-25T16:18:15.716805+0000","last_active":"2023-10-25T16:18:15.717169+0000","last_peered":"2023-10-25T16:18:15.717169+0000","last_clean":"2023-10-25T16:18:15.717169+0000","last_became_active":"2023-10-25T16:18:15.716162+0000","last_became_peered":"2023-10-25T16:18:15.716162+0000","last_unstale":"2023-10-25T16:18:15.717169+0000","last_undegraded":"2023-10-25T16:18:15.717169+0000","last_fullsized":"2023-10-25T16:18:15.717169+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:50.914760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670539+0000","last_change":"2023-10-25T16:18:14.670539+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670539+0000","last_undegraded":"2023-10-25T16:18:14.670539+0000","last_fullsized":"2023-10-25T16:18:14.670539+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679076+0000","last_change":"2023-10-25T16:18:14.679076+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679076+0000","last_undegraded":"2023-10-25T16:18:14.679076+0000","last_fullsized":"2023-10-25T16:18:14.679076+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.688831+0000","last_change":"2023-10-25T16:18:14.688831+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.688831+0000","last_undegraded":"2023-10-25T16:18:14.688831+0000","last_fullsized":"2023-10-25T16:18:14.688831+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687825+0000","last_change":"2023-10-25T16:18:14.687825+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687825+0000","last_undegraded":"2023-10-25T16:18:14.687825+0000","last_fullsized":"2023-10-25T16:18:14.687825+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669945+0000","last_change":"2023-10-25T16:18:14.669945+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669945+0000","last_undegraded":"2023-10-25T16:18:14.669945+0000","last_fullsized":"2023-10-25T16:18:14.669945+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670115+0000","last_change":"2023-10-25T16:18:14.670115+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670115+0000","last_undegraded":"2023-10-25T16:18:14.670115+0000","last_fullsized":"2023-10-25T16:18:14.670115+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682089+0000","last_change":"2023-10-25T16:18:14.682089+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682089+0000","last_undegraded":"2023-10-25T16:18:14.682089+0000","last_fullsized":"2023-10-25T16:18:14.682089+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675334+0000","last_change":"2023-10-25T16:18:14.675334+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675334+0000","last_undegraded":"2023-10-25T16:18:14.675334+0000","last_fullsized":"2023-10-25T16:18:14.675334+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.683517+0000","last_change":"2023-10-25T16:18:14.683517+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.683517+0000","last_undegraded":"2023-10-25T16:18:14.683517+0000","last_fullsized":"2023-10-25T16:18:14.683517+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693719+0000","last_change":"2023-10-25T16:18:14.693474+0000","last_active":"2023-10-25T16:18:14.693719+0000","last_peered":"2023-10-25T16:18:14.693719+0000","last_clean":"2023-10-25T16:18:14.693719+0000","last_became_active":"2023-10-25T16:18:14.690705+0000","last_became_peered":"2023-10-25T16:18:14.690705+0000","last_unstale":"2023-10-25T16:18:14.693719+0000","last_undegraded":"2023-10-25T16:18:14.693719+0000","last_fullsized":"2023-10-25T16:18:14.693719+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:42:00.049478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687156+0000","last_change":"2023-10-25T16:18:14.687156+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687156+0000","last_undegraded":"2023-10-25T16:18:14.687156+0000","last_fullsized":"2023-10-25T16:18:14.687156+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678624+0000","last_change":"2023-10-25T16:18:14.678465+0000","last_active":"2023-10-25T16:18:14.678624+0000","last_peered":"2023-10-25T16:18:14.678624+0000","last_clean":"2023-10-25T16:18:14.678624+0000","last_became_active":"2023-10-25T16:18:14.677865+0000","last_became_peered":"2023-10-25T16:18:14.677865+0000","last_unstale":"2023-10-25T16:18:14.678624+0000","last_undegraded":"2023-10-25T16:18:14.678624+0000","last_fullsized":"2023-10-25T16:18:14.678624+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675189+0000","last_change":"2023-10-25T16:18:14.675189+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675189+0000","last_undegraded":"2023-10-25T16:18:14.675189+0000","last_fullsized":"2023-10-25T16:18:14.675189+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689178+0000","last_change":"2023-10-25T16:18:14.689093+0000","last_active":"2023-10-25T16:18:14.689178+0000","last_peered":"2023-10-25T16:18:14.689178+0000","last_clean":"2023-10-25T16:18:14.689178+0000","last_became_active":"2023-10-25T16:18:14.688742+0000","last_became_peered":"2023-10-25T16:18:14.688742+0000","last_unstale":"2023-10-25T16:18:14.689178+0000","last_undegraded":"2023-10-25T16:18:14.689178+0000","last_fullsized":"2023-10-25T16:18:14.689178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:20:56.322723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680592+0000","last_change":"2023-10-25T16:18:14.680592+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680592+0000","last_undegraded":"2023-10-25T16:18:14.680592+0000","last_fullsized":"2023-10-25T16:18:14.680592+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685079+0000","last_change":"2023-10-25T16:18:14.684960+0000","last_active":"2023-10-25T16:18:14.685079+0000","last_peered":"2023-10-25T16:18:14.685079+0000","last_clean":"2023-10-25T16:18:14.685079+0000","last_became_active":"2023-10-25T16:18:14.684527+0000","last_became_peered":"2023-10-25T16:18:14.684527+0000","last_unstale":"2023-10-25T16:18:14.685079+0000","last_undegraded":"2023-10-25T16:18:14.685079+0000","last_fullsized":"2023-10-25T16:18:14.685079+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:04:56.895056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669842+0000","last_change":"2023-10-25T16:18:14.669842+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669842+0000","last_undegraded":"2023-10-25T16:18:14.669842+0000","last_fullsized":"2023-10-25T16:18:14.669842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689444+0000","last_change":"2023-10-25T16:18:14.687552+0000","last_active":"2023-10-25T16:18:14.689444+0000","last_peered":"2023-10-25T16:18:14.689444+0000","last_clean":"2023-10-25T16:18:14.689444+0000","last_became_active":"2023-10-25T16:18:14.684155+0000","last_became_peered":"2023-10-25T16:18:14.684155+0000","last_unstale":"2023-10-25T16:18:14.689444+0000","last_undegraded":"2023-10-25T16:18:14.689444+0000","last_fullsized":"2023-10-25T16:18:14.689444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:34:36.744102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682021+0000","last_change":"2023-10-25T16:18:14.682021+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682021+0000","last_undegraded":"2023-10-25T16:18:14.682021+0000","last_fullsized":"2023-10-25T16:18:14.682021+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678980+0000","last_change":"2023-10-25T16:18:14.678816+0000","last_active":"2023-10-25T16:18:14.678980+0000","last_peered":"2023-10-25T16:18:14.678980+0000","last_clean":"2023-10-25T16:18:14.678980+0000","last_became_active":"2023-10-25T16:18:14.678249+0000","last_became_peered":"2023-10-25T16:18:14.678249+0000","last_unstale":"2023-10-25T16:18:14.678980+0000","last_undegraded":"2023-10-25T16:18:14.678980+0000","last_fullsized":"2023-10-25T16:18:14.678980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:32.222175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679789+0000","last_change":"2023-10-25T16:18:14.679789+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679789+0000","last_undegraded":"2023-10-25T16:18:14.679789+0000","last_fullsized":"2023-10-25T16:18:14.679789+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685689+0000","last_change":"2023-10-25T16:18:14.685624+0000","last_active":"2023-10-25T16:18:14.685689+0000","last_peered":"2023-10-25T16:18:14.685689+0000","last_clean":"2023-10-25T16:18:14.685689+0000","last_became_active":"2023-10-25T16:18:14.685386+0000","last_became_peered":"2023-10-25T16:18:14.685386+0000","last_unstale":"2023-10-25T16:18:14.685689+0000","last_undegraded":"2023-10-25T16:18:14.685689+0000","last_fullsized":"2023-10-25T16:18:14.685689+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:03.749221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672365+0000","last_change":"2023-10-25T16:18:14.672365+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672365+0000","last_undegraded":"2023-10-25T16:18:14.672365+0000","last_fullsized":"2023-10-25T16:18:14.672365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.680392+0000","last_change":"2023-10-25T16:18:14.680316+0000","last_active":"2023-10-25T16:18:14.680392+0000","last_peered":"2023-10-25T16:18:14.680392+0000","last_clean":"2023-10-25T16:18:14.680392+0000","last_became_active":"2023-10-25T16:18:14.680086+0000","last_became_peered":"2023-10-25T16:18:14.680086+0000","last_unstale":"2023-10-25T16:18:14.680392+0000","last_undegraded":"2023-10-25T16:18:14.680392+0000","last_fullsized":"2023-10-25T16:18:14.680392+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:26:39.178409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675291+0000","last_change":"2023-10-25T16:18:14.675291+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675291+0000","last_undegraded":"2023-10-25T16:18:14.675291+0000","last_fullsized":"2023-10-25T16:18:14.675291+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686050+0000","last_change":"2023-10-25T16:18:14.683993+0000","last_active":"2023-10-25T16:18:14.686050+0000","last_peered":"2023-10-25T16:18:14.686050+0000","last_clean":"2023-10-25T16:18:14.686050+0000","last_became_active":"2023-10-25T16:18:14.683418+0000","last_became_peered":"2023-10-25T16:18:14.683418+0000","last_unstale":"2023-10-25T16:18:14.686050+0000","last_undegraded":"2023-10-25T16:18:14.686050+0000","last_fullsized":"2023-10-25T16:18:14.686050+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668031+0000","last_change":"2023-10-25T16:18:14.668031+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668031+0000","last_undegraded":"2023-10-25T16:18:14.668031+0000","last_fullsized":"2023-10-25T16:18:14.668031+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691025+0000","last_change":"2023-10-25T16:18:14.690839+0000","last_active":"2023-10-25T16:18:14.691025+0000","last_peered":"2023-10-25T16:18:14.691025+0000","last_clean":"2023-10-25T16:18:14.691025+0000","last_became_active":"2023-10-25T16:18:14.689717+0000","last_became_peered":"2023-10-25T16:18:14.689717+0000","last_unstale":"2023-10-25T16:18:14.691025+0000","last_undegraded":"2023-10-25T16:18:14.691025+0000","last_fullsized":"2023-10-25T16:18:14.691025+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673812+0000","last_change":"2023-10-25T16:18:14.673812+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673812+0000","last_undegraded":"2023-10-25T16:18:14.673812+0000","last_fullsized":"2023-10-25T16:18:14.673812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.697913+0000","last_change":"2023-10-25T16:18:14.697731+0000","last_active":"2023-10-25T16:18:14.697913+0000","last_peered":"2023-10-25T16:18:14.697913+0000","last_clean":"2023-10-25T16:18:14.697913+0000","last_became_active":"2023-10-25T16:18:14.694148+0000","last_became_peered":"2023-10-25T16:18:14.694148+0000","last_unstale":"2023-10-25T16:18:14.697913+0000","last_undegraded":"2023-10-25T16:18:14.697913+0000","last_fullsized":"2023-10-25T16:18:14.697913+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:43:51.638791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681803+0000","last_change":"2023-10-25T16:18:14.681803+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681803+0000","last_undegraded":"2023-10-25T16:18:14.681803+0000","last_fullsized":"2023-10-25T16:18:14.681803+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.683164+0000","last_change":"2023-10-25T16:18:14.683000+0000","last_active":"2023-10-25T16:18:14.683164+0000","last_peered":"2023-10-25T16:18:14.683164+0000","last_clean":"2023-10-25T16:18:14.683164+0000","last_became_active":"2023-10-25T16:18:14.682375+0000","last_became_peered":"2023-10-25T16:18:14.682375+0000","last_unstale":"2023-10-25T16:18:14.683164+0000","last_undegraded":"2023-10-25T16:18:14.683164+0000","last_fullsized":"2023-10-25T16:18:14.683164+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:23.538133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675469+0000","last_change":"2023-10-25T16:18:14.675469+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675469+0000","last_undegraded":"2023-10-25T16:18:14.675469+0000","last_fullsized":"2023-10-25T16:18:14.675469+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678631+0000","last_change":"2023-10-25T16:18:14.678520+0000","last_active":"2023-10-25T16:18:14.678631+0000","last_peered":"2023-10-25T16:18:14.678631+0000","last_clean":"2023-10-25T16:18:14.678631+0000","last_became_active":"2023-10-25T16:18:14.678295+0000","last_became_peered":"2023-10-25T16:18:14.678295+0000","last_unstale":"2023-10-25T16:18:14.678631+0000","last_undegraded":"2023-10-25T16:18:14.678631+0000","last_fullsized":"2023-10-25T16:18:14.678631+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:03:04.894878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.678931+0000","last_change":"2023-10-25T16:18:14.678931+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.678931+0000","last_undegraded":"2023-10-25T16:18:14.678931+0000","last_fullsized":"2023-10-25T16:18:14.678931+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685166+0000","last_change":"2023-10-25T16:18:14.684401+0000","last_active":"2023-10-25T16:18:14.685166+0000","last_peered":"2023-10-25T16:18:14.685166+0000","last_clean":"2023-10-25T16:18:14.685166+0000","last_became_active":"2023-10-25T16:18:14.683848+0000","last_became_peered":"2023-10-25T16:18:14.683848+0000","last_unstale":"2023-10-25T16:18:14.685166+0000","last_undegraded":"2023-10-25T16:18:14.685166+0000","last_fullsized":"2023-10-25T16:18:14.685166+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:52:14.014632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670755+0000","last_change":"2023-10-25T16:18:14.670755+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670755+0000","last_undegraded":"2023-10-25T16:18:14.670755+0000","last_fullsized":"2023-10-25T16:18:14.670755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.670309+0000","last_change":"2023-10-25T16:18:14.670094+0000","last_active":"2023-10-25T16:18:14.670309+0000","last_peered":"2023-10-25T16:18:14.670309+0000","last_clean":"2023-10-25T16:18:14.670309+0000","last_became_active":"2023-10-25T16:18:14.669490+0000","last_became_peered":"2023-10-25T16:18:14.669490+0000","last_unstale":"2023-10-25T16:18:14.670309+0000","last_undegraded":"2023-10-25T16:18:14.670309+0000","last_fullsized":"2023-10-25T16:18:14.670309+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:17.496638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672419+0000","last_change":"2023-10-25T16:18:14.672419+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672419+0000","last_undegraded":"2023-10-25T16:18:14.672419+0000","last_fullsized":"2023-10-25T16:18:14.672419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678008+0000","last_change":"2023-10-25T16:18:14.677926+0000","last_active":"2023-10-25T16:18:14.678008+0000","last_peered":"2023-10-25T16:18:14.678008+0000","last_clean":"2023-10-25T16:18:14.678008+0000","last_became_active":"2023-10-25T16:18:14.677671+0000","last_became_peered":"2023-10-25T16:18:14.677671+0000","last_unstale":"2023-10-25T16:18:14.678008+0000","last_undegraded":"2023-10-25T16:18:14.678008+0000","last_fullsized":"2023-10-25T16:18:14.678008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:43.298974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.677963+0000","last_change":"2023-10-25T16:18:14.677963+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.677963+0000","last_undegraded":"2023-10-25T16:18:14.677963+0000","last_fullsized":"2023-10-25T16:18:14.677963+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.696783+0000","last_change":"2023-10-25T16:18:14.695380+0000","last_active":"2023-10-25T16:18:14.696783+0000","last_peered":"2023-10-25T16:18:14.696783+0000","last_clean":"2023-10-25T16:18:14.696783+0000","last_became_active":"2023-10-25T16:18:14.694774+0000","last_became_peered":"2023-10-25T16:18:14.694774+0000","last_unstale":"2023-10-25T16:18:14.696783+0000","last_undegraded":"2023-10-25T16:18:14.696783+0000","last_fullsized":"2023-10-25T16:18:14.696783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:39.713874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676904+0000","last_change":"2023-10-25T16:18:14.676904+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676904+0000","last_undegraded":"2023-10-25T16:18:14.676904+0000","last_fullsized":"2023-10-25T16:18:14.676904+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.681355+0000","last_change":"2023-10-25T16:18:14.681247+0000","last_active":"2023-10-25T16:18:14.681355+0000","last_peered":"2023-10-25T16:18:14.681355+0000","last_clean":"2023-10-25T16:18:14.681355+0000","last_became_active":"2023-10-25T16:18:14.680881+0000","last_became_peered":"2023-10-25T16:18:14.680881+0000","last_unstale":"2023-10-25T16:18:14.681355+0000","last_undegraded":"2023-10-25T16:18:14.681355+0000","last_fullsized":"2023-10-25T16:18:14.681355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:11.176098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681261+0000","last_change":"2023-10-25T16:18:14.681261+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681261+0000","last_undegraded":"2023-10-25T16:18:14.681261+0000","last_fullsized":"2023-10-25T16:18:14.681261+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.676442+0000","last_change":"2023-10-25T16:18:14.676353+0000","last_active":"2023-10-25T16:18:14.676442+0000","last_peered":"2023-10-25T16:18:14.676442+0000","last_clean":"2023-10-25T16:18:14.676442+0000","last_became_active":"2023-10-25T16:18:14.675995+0000","last_became_peered":"2023-10-25T16:18:14.675995+0000","last_unstale":"2023-10-25T16:18:14.676442+0000","last_undegraded":"2023-10-25T16:18:14.676442+0000","last_fullsized":"2023-10-25T16:18:14.676442+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:47.794485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722327+0000","last_change":"2023-10-25T16:18:15.721910+0000","last_active":"2023-10-25T16:18:15.722327+0000","last_peered":"2023-10-25T16:18:15.722327+0000","last_clean":"2023-10-25T16:18:15.722327+0000","last_became_active":"2023-10-25T16:18:15.719630+0000","last_became_peered":"2023-10-25T16:18:15.719630+0000","last_unstale":"2023-10-25T16:18:15.722327+0000","last_undegraded":"2023-10-25T16:18:15.722327+0000","last_fullsized":"2023-10-25T16:18:15.722327+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:19:08.691030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686076+0000","last_change":"2023-10-25T16:18:14.685953+0000","last_active":"2023-10-25T16:18:14.686076+0000","last_peered":"2023-10-25T16:18:14.686076+0000","last_clean":"2023-10-25T16:18:14.686076+0000","last_became_active":"2023-10-25T16:18:14.685457+0000","last_became_peered":"2023-10-25T16:18:14.685457+0000","last_unstale":"2023-10-25T16:18:14.686076+0000","last_undegraded":"2023-10-25T16:18:14.686076+0000","last_fullsized":"2023-10-25T16:18:14.686076+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:50.749638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667784+0000","last_change":"2023-10-25T16:18:14.667784+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667784+0000","last_undegraded":"2023-10-25T16:18:14.667784+0000","last_fullsized":"2023-10-25T16:18:14.667784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.713777+0000","last_change":"2023-10-25T16:18:14.688534+0000","last_active":"2023-10-25T16:18:15.713777+0000","last_peered":"2023-10-25T16:18:15.713777+0000","last_clean":"2023-10-25T16:18:15.713777+0000","last_became_active":"2023-10-25T16:18:14.688038+0000","last_became_peered":"2023-10-25T16:18:14.688038+0000","last_unstale":"2023-10-25T16:18:15.713777+0000","last_undegraded":"2023-10-25T16:18:15.713777+0000","last_fullsized":"2023-10-25T16:18:15.713777+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:51.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722528+0000","last_change":"2023-10-25T16:18:15.722331+0000","last_active":"2023-10-25T16:18:15.722528+0000","last_peered":"2023-10-25T16:18:15.722528+0000","last_clean":"2023-10-25T16:18:15.722528+0000","last_became_active":"2023-10-25T16:18:15.721465+0000","last_became_peered":"2023-10-25T16:18:15.721465+0000","last_unstale":"2023-10-25T16:18:15.722528+0000","last_undegraded":"2023-10-25T16:18:15.722528+0000","last_fullsized":"2023-10-25T16:18:15.722528+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:35.939270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.714635+0000","last_change":"2023-10-25T16:18:14.688400+0000","last_active":"2023-10-25T16:18:15.714635+0000","last_peered":"2023-10-25T16:18:15.714635+0000","last_clean":"2023-10-25T16:18:15.714635+0000","last_became_active":"2023-10-25T16:18:14.687842+0000","last_became_peered":"2023-10-25T16:18:14.687842+0000","last_unstale":"2023-10-25T16:18:15.714635+0000","last_undegraded":"2023-10-25T16:18:15.714635+0000","last_fullsized":"2023-10-25T16:18:15.714635+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:12:59.340012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668507+0000","last_change":"2023-10-25T16:18:14.668507+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668507+0000","last_undegraded":"2023-10-25T16:18:14.668507+0000","last_fullsized":"2023-10-25T16:18:14.668507+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685204+0000","last_change":"2023-10-25T16:18:14.684569+0000","last_active":"2023-10-25T16:18:14.685204+0000","last_peered":"2023-10-25T16:18:14.685204+0000","last_clean":"2023-10-25T16:18:14.685204+0000","last_became_active":"2023-10-25T16:18:14.684187+0000","last_became_peered":"2023-10-25T16:18:14.684187+0000","last_unstale":"2023-10-25T16:18:14.685204+0000","last_undegraded":"2023-10-25T16:18:14.685204+0000","last_fullsized":"2023-10-25T16:18:14.685204+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:30:45.612265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680982+0000","last_change":"2023-10-25T16:18:14.680982+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680982+0000","last_undegraded":"2023-10-25T16:18:14.680982+0000","last_fullsized":"2023-10-25T16:18:14.680982+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.694999+0000","last_change":"2023-10-25T16:18:14.694912+0000","last_active":"2023-10-25T16:18:14.694999+0000","last_peered":"2023-10-25T16:18:14.694999+0000","last_clean":"2023-10-25T16:18:14.694999+0000","last_became_active":"2023-10-25T16:18:14.694664+0000","last_became_peered":"2023-10-25T16:18:14.694664+0000","last_unstale":"2023-10-25T16:18:14.694999+0000","last_undegraded":"2023-10-25T16:18:14.694999+0000","last_fullsized":"2023-10-25T16:18:14.694999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:33:08.133934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674686+0000","last_change":"2023-10-25T16:18:14.674686+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674686+0000","last_undegraded":"2023-10-25T16:18:14.674686+0000","last_fullsized":"2023-10-25T16:18:14.674686+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686554+0000","last_change":"2023-10-25T16:18:14.686451+0000","last_active":"2023-10-25T16:18:14.686554+0000","last_peered":"2023-10-25T16:18:14.686554+0000","last_clean":"2023-10-25T16:18:14.686554+0000","last_became_active":"2023-10-25T16:18:14.685309+0000","last_became_peered":"2023-10-25T16:18:14.685309+0000","last_unstale":"2023-10-25T16:18:14.686554+0000","last_undegraded":"2023-10-25T16:18:14.686554+0000","last_fullsized":"2023-10-25T16:18:14.686554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:10:04.278788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684504+0000","last_change":"2023-10-25T16:18:14.684504+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684504+0000","last_undegraded":"2023-10-25T16:18:14.684504+0000","last_fullsized":"2023-10-25T16:18:14.684504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693181+0000","last_change":"2023-10-25T16:18:14.692973+0000","last_active":"2023-10-25T16:18:14.693181+0000","last_peered":"2023-10-25T16:18:14.693181+0000","last_clean":"2023-10-25T16:18:14.693181+0000","last_became_active":"2023-10-25T16:18:14.690673+0000","last_became_peered":"2023-10-25T16:18:14.690673+0000","last_unstale":"2023-10-25T16:18:14.693181+0000","last_undegraded":"2023-10-25T16:18:14.693181+0000","last_fullsized":"2023-10-25T16:18:14.693181+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680844+0000","last_change":"2023-10-25T16:18:14.680844+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680844+0000","last_undegraded":"2023-10-25T16:18:14.680844+0000","last_fullsized":"2023-10-25T16:18:14.680844+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.688377+0000","last_change":"2023-10-25T16:18:14.688218+0000","last_active":"2023-10-25T16:18:14.688377+0000","last_peered":"2023-10-25T16:18:14.688377+0000","last_clean":"2023-10-25T16:18:14.688377+0000","last_became_active":"2023-10-25T16:18:14.686762+0000","last_became_peered":"2023-10-25T16:18:14.686762+0000","last_unstale":"2023-10-25T16:18:14.688377+0000","last_undegraded":"2023-10-25T16:18:14.688377+0000","last_fullsized":"2023-10-25T16:18:14.688377+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:29.234593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667531+0000","last_change":"2023-10-25T16:18:14.667531+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667531+0000","last_undegraded":"2023-10-25T16:18:14.667531+0000","last_fullsized":"2023-10-25T16:18:14.667531+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.695037+0000","last_change":"2023-10-25T16:18:14.694936+0000","last_active":"2023-10-25T16:18:14.695037+0000","last_peered":"2023-10-25T16:18:14.695037+0000","last_clean":"2023-10-25T16:18:14.695037+0000","last_became_active":"2023-10-25T16:18:14.694778+0000","last_became_peered":"2023-10-25T16:18:14.694778+0000","last_unstale":"2023-10-25T16:18:14.695037+0000","last_undegraded":"2023-10-25T16:18:14.695037+0000","last_fullsized":"2023-10-25T16:18:14.695037+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:18.354295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675159+0000","last_change":"2023-10-25T16:18:14.675159+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675159+0000","last_undegraded":"2023-10-25T16:18:14.675159+0000","last_fullsized":"2023-10-25T16:18:14.675159+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678673+0000","last_change":"2023-10-25T16:18:14.678493+0000","last_active":"2023-10-25T16:18:14.678673+0000","last_peered":"2023-10-25T16:18:14.678673+0000","last_clean":"2023-10-25T16:18:14.678673+0000","last_became_active":"2023-10-25T16:18:14.677877+0000","last_became_peered":"2023-10-25T16:18:14.677877+0000","last_unstale":"2023-10-25T16:18:14.678673+0000","last_undegraded":"2023-10-25T16:18:14.678673+0000","last_fullsized":"2023-10-25T16:18:14.678673+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674664+0000","last_change":"2023-10-25T16:18:14.674664+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674664+0000","last_undegraded":"2023-10-25T16:18:14.674664+0000","last_fullsized":"2023-10-25T16:18:14.674664+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691935+0000","last_change":"2023-10-25T16:18:14.691770+0000","last_active":"2023-10-25T16:18:14.691935+0000","last_peered":"2023-10-25T16:18:14.691935+0000","last_clean":"2023-10-25T16:18:14.691935+0000","last_became_active":"2023-10-25T16:18:14.688844+0000","last_became_peered":"2023-10-25T16:18:14.688844+0000","last_unstale":"2023-10-25T16:18:14.691935+0000","last_undegraded":"2023-10-25T16:18:14.691935+0000","last_fullsized":"2023-10-25T16:18:14.691935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:11:38.680241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684336+0000","last_change":"2023-10-25T16:18:14.684336+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684336+0000","last_undegraded":"2023-10-25T16:18:14.684336+0000","last_fullsized":"2023-10-25T16:18:14.684336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689381+0000","last_change":"2023-10-25T16:18:14.687958+0000","last_active":"2023-10-25T16:18:14.689381+0000","last_peered":"2023-10-25T16:18:14.689381+0000","last_clean":"2023-10-25T16:18:14.689381+0000","last_became_active":"2023-10-25T16:18:14.685768+0000","last_became_peered":"2023-10-25T16:18:14.685768+0000","last_unstale":"2023-10-25T16:18:14.689381+0000","last_undegraded":"2023-10-25T16:18:14.689381+0000","last_fullsized":"2023-10-25T16:18:14.689381+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.671873+0000","last_change":"2023-10-25T16:18:14.671873+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.671873+0000","last_undegraded":"2023-10-25T16:18:14.671873+0000","last_fullsized":"2023-10-25T16:18:14.671873+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.698634+0000","last_change":"2023-10-25T16:18:14.698466+0000","last_active":"2023-10-25T16:18:14.698634+0000","last_peered":"2023-10-25T16:18:14.698634+0000","last_clean":"2023-10-25T16:18:14.698634+0000","last_became_active":"2023-10-25T16:18:14.697644+0000","last_became_peered":"2023-10-25T16:18:14.697644+0000","last_unstale":"2023-10-25T16:18:14.698634+0000","last_undegraded":"2023-10-25T16:18:14.698634+0000","last_fullsized":"2023-10-25T16:18:14.698634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:58.505243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-25T16:18:13.667831+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:18:13.667831+0000","last_peered":"2023-10-25T16:18:13.667831+0000","last_clean":"2023-10-25T16:18:13.667831+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:18:13.667831+0000","last_undegraded":"2023-10-25T16:18:13.667831+0000","last_fullsized":"2023-10-25T16:18:13.667831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:30.918156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":553,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194759,"statfs":{"total":200000000,"available":199433614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57799999999999996,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60999999999999999,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.94099999999999995,"5min":1.077,"15min":1.077},"last":0.308}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63100000000000001,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66400000000000003,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.61599999999999999},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.194,"5min":1.345,"15min":1.345},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90100000000000002,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.75800000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.88900000000000001},"min":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.91200000000000003,"15min":0.92900000000000005},"min":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.95299999999999996,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.474,"5min":1.677,"15min":1.677},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.454,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.63800000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.117,"5min":1.256,"15min":1.256},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85699999999999998,"15min":0.82899999999999996},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.534,"15min":1.534},"last":0.92700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.177,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.284,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1659999999999999,"5min":1.27,"15min":1.27},"last":1.089},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":0.97499999999999998},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.222,"5min":1.446,"15min":1.446},"last":0.998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":0.94299999999999995},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.05}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.878,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0009999999999999,"15min":1.0489999999999999},"min":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.286,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.72199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.196,"5min":1.637,"15min":1.637},"last":0.88200000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":0.85899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.387,"5min":1.669,"15min":1.669},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.109,"5min":1.115,"15min":1.125},"min":{"1min":0.84399999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.286,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0229999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89200000000000002,"15min":0.88900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.083}]},{"osd":1,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.89100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1890000000000001,"5min":1.302,"15min":1.302},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.296,"5min":1.476,"15min":1.476},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93700000000000006,"15min":0.88900000000000001},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.484,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.177}]},{"osd":4,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.627},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95199999999999996,"15min":0.98799999999999999},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.97199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.056,"15min":1.054},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5720000000000001,"5min":1.895,"15min":1.895},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.69799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.139},{"interface":"front","average":{"1min":1.145,"5min":1.0880000000000001,"15min":1.0449999999999999},"min":{"1min":0.66300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0069999999999999,"15min":1.331},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":14.843,"15min":14.843},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.002,"15min":1.458},"min":{"1min":0.54600000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":16.439,"15min":16.439},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.03,"15min":1.393},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.157,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90600000000000003,"15min":0.874},"min":{"1min":0.66700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.92100000000000004,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.012,"5min":0.97999999999999998,"15min":0.96999999999999997},"min":{"1min":0.69399999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3169999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2150000000000001,"15min":1.5029999999999999},"min":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.194,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.149,"15min":1.5700000000000001},"min":{"1min":0.60299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.53,"5min":15.904,"15min":15.904},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1240000000000001,"15min":1.595},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1899999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.173,"15min":1.4890000000000001},"min":{"1min":0.91400000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":14.567,"15min":14.567},"last":1.143},{"interface":"front","average":{"1min":1.161,"5min":1.3,"15min":1.6910000000000001},"min":{"1min":0.73499999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5820000000000001,"5min":15.089,"15min":15.089},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.2030000000000001,"15min":1.708},"min":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.24,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.212,"5min":1.177,"15min":1.2649999999999999},"min":{"1min":0.96299999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2649999999999999,"5min":1.47,"15min":1.47},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.85299999999999998,"15min":0.81299999999999994},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.278,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.874,"15min":0.82299999999999995},"min":{"1min":0.55200000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.288,"15min":1.288},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.97299999999999998,"15min":0.94299999999999995},"min":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1619999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.095}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95799999999999996,"15min":0.90900000000000003},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.196,"5min":1.518,"15min":1.518},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.169,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.89000000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3180000000000001,"5min":1.431,"15min":1.431},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.64200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2430000000000001,"5min":2.085,"15min":2.085},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.089,"15min":1.071},"min":{"1min":0.69499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.92900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.94799999999999995},"min":{"1min":0.63,"5min":0.5,"15min":0.5},"max":{"1min":1.2609999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.1160000000000001},"min":{"1min":0.96699999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60399999999999998,"15min":0.55200000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.81299999999999994,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.64100000000000001},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.94099999999999995,"5min":1.083,"15min":1.083},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.32600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.1779999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73799999999999999,"15min":0.69999999999999996},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.155,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.95599999999999996,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.087},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1379999999999999,"5min":1.23,"15min":1.23},"last":1.052},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.206,"5min":1.427,"15min":1.427},"last":0.93400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89800000000000002,"15min":0.92800000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.96299999999999997,"15min":0.93999999999999995},"min":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.22,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1799999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.226,"5min":1.456,"15min":1.456},"last":0.999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1719999999999999,"5min":1.663,"15min":1.663},"last":1.028}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.99299999999999999,"15min":0.96999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.28,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97199999999999998,"15min":0.94699999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.254,"5min":1.389,"15min":1.389},"last":1.1319999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.95399999999999996,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.249,"15min":0.249},"max":{"1min":0.99099999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.157,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.39100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.048,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.375,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1899999999999999,"5min":1.423,"15min":1.423},"last":1.0269999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":0.97299999999999998},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0820000000000001,"5min":12.698,"15min":12.698},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.026},"min":{"1min":0.73099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2310000000000001,"5min":12.721,"15min":12.721},"last":1.23}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2729999999999999,"5min":1.546,"15min":1.546},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.89100000000000001},"min":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.034,"5min":2.206,"15min":2.206},"last":0.94299999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.70899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.298,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.397,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.101,"15min":0.98299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.276,"5min":14.776,"15min":14.776},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1080000000000001,"15min":1.022},"min":{"1min":0.62,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.476,"5min":10.509,"15min":10.509},"last":1.2829999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.69499999999999995},"min":{"1min":0.33100000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.74099999999999999},"min":{"1min":0.39500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.3560000000000001,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.89300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.68400000000000005},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.996,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98899999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.745}]},{"osd":3,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.194,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.407,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.036}]},{"osd":4,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3120000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.71999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6719999999999999,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90100000000000002,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.228,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92200000000000004,"15min":0.95099999999999996},"min":{"1min":0.67100000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.21,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.1379999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.278,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.94699999999999995,"15min":0.92200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.387,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.069}]},{"osd":7,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.075,"15min":1.298},"min":{"1min":0.73899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.294,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0900000000000001,"15min":1.3149999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4410000000000001,"5min":11.622,"15min":11.622},"last":1.276}]}]}],"pool_statfs":[]}} 2023-10-25T16:18:19.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:18:19.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/723434796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 msgr2=0x7f470415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 --2- 172.21.15.177:0/723434796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f470415c370 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f47040cdec0 tx=0x7f46f401c750 comp rx=0 tx=0).stop 2023-10-25T16:18:19.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/723434796 shutdown_connections 2023-10-25T16:18:19.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 --2- 172.21.15.177:0/723434796 >> v2:172.21.15.184:3300/0 conn(0x7f470406c0f0 0x7f470415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 --2- 172.21.15.177:0/723434796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f470415c370 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/723434796 >> 172.21.15.177:0/723434796 conn(0x7f47040b2450 msgr2=0x7f47040b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:19.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/723434796 shutdown_connections 2023-10-25T16:18:19.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/723434796 wait complete. 2023-10-25T16:18:19.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 Processor -- start 2023-10-25T16:18:19.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- start start 2023-10-25T16:18:19.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f470406c0f0 0x7f470414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47040cb5f0 0x7f470414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f47040adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470414e0e0 con 0x7f470415b480 2023-10-25T16:18:19.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040acba0 con 0x7f470406c0f0 2023-10-25T16:18:19.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47040ace80 con 0x7f47040cb5f0 2023-10-25T16:18:19.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f47040adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f47040adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52210/0 (socket says 172.21.15.177:52210) 2023-10-25T16:18:19.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 -- 172.21.15.177:0/2879027234 learned_addr learned my addr 172.21.15.177:0/2879027234 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:19.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f47037fe640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f470406c0f0 0x7f470414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 -- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47040cb5f0 msgr2=0x7f470414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4702ffd640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47040cb5f0 0x7f470414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47040cb5f0 0x7f470414dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 -- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f470406c0f0 msgr2=0x7f470414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f470406c0f0 0x7f470414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 -- 172.21.15.177:0/2879027234 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f4009560 con 0x7f470415b480 2023-10-25T16:18:19.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4703fff640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f47040adc40 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00da40 tx=0x7f46fc00df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:19.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00bdd0 con 0x7f470415b480 2023-10-25T16:18:19.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f46fc004c20 con 0x7f470415b480 2023-10-25T16:18:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47040ad160 con 0x7f470415b480 2023-10-25T16:18:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc003980 con 0x7f470415b480 2023-10-25T16:18:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.249+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47040ad720 con 0x7f470415b480 2023-10-25T16:18:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.253+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47040c9780 con 0x7f470415b480 2023-10-25T16:18:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.253+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46fc003ae0 con 0x7f470415b480 2023-10-25T16:18:19.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.253+0000 7f46fbfff640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46ec066460 0x7f46ec068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.253+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46fc084880 con 0x7f470415b480 2023-10-25T16:18:19.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.253+0000 7f47037fe640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46ec066460 0x7f46ec068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.253+0000 7f47037fe640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46ec066460 0x7f46ec068920 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f46f40af000 tx=0x7f46f401af90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:19.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.257+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46fc051ce0 con 0x7f470415b480 2023-10-25T16:18:19.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.405+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f470404daf0 con 0x7f46ec066460 2023-10-25T16:18:19.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.429+0000 7f46fbfff640 1 -- 172.21.15.177:0/2879027234 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279318 (secure 0 0 0) 0x7f470404daf0 con 0x7f46ec066460 2023-10-25T16:18:19.429 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:19.431 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:18:19.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.429+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46ec066460 msgr2=0x7f46ec068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.429+0000 7f4709b18640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46ec066460 0x7f46ec068920 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f46f40af000 tx=0x7f46f401af90 comp rx=0 tx=0).stop 2023-10-25T16:18:19.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.429+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 msgr2=0x7f47040adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.429+0000 7f4709b18640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f47040adc40 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00da40 tx=0x7f46fc00df00 comp rx=0 tx=0).stop 2023-10-25T16:18:19.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 shutdown_connections 2023-10-25T16:18:19.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46ec066460 0x7f46ec068920 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f470415b480 0x7f47040adc40 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47040cb5f0 0x7f470414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 --2- 172.21.15.177:0/2879027234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f470406c0f0 0x7f470414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 >> 172.21.15.177:0/2879027234 conn(0x7f47040b2450 msgr2=0x7f470415d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:19.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 shutdown_connections 2023-10-25T16:18:19.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.433+0000 7f4709b18640 1 -- 172.21.15.177:0/2879027234 wait complete. 2023-10-25T16:18:19.447 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-25T16:18:18.715584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5484,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557015,"statfs":{"total":1600000000,"available":1594383600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.057192"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676264+0000","last_change":"2023-10-25T16:18:14.676264+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676264+0000","last_undegraded":"2023-10-25T16:18:14.676264+0000","last_fullsized":"2023-10-25T16:18:14.676264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673602+0000","last_change":"2023-10-25T16:18:14.673602+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673602+0000","last_undegraded":"2023-10-25T16:18:14.673602+0000","last_fullsized":"2023-10-25T16:18:14.673602+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675766+0000","last_change":"2023-10-25T16:18:14.675766+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675766+0000","last_undegraded":"2023-10-25T16:18:14.675766+0000","last_fullsized":"2023-10-25T16:18:14.675766+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.723240+0000","last_change":"2023-10-25T16:18:15.722650+0000","last_active":"2023-10-25T16:18:15.723240+0000","last_peered":"2023-10-25T16:18:15.723240+0000","last_clean":"2023-10-25T16:18:15.723240+0000","last_became_active":"2023-10-25T16:18:15.721279+0000","last_became_peered":"2023-10-25T16:18:15.721279+0000","last_unstale":"2023-10-25T16:18:15.723240+0000","last_undegraded":"2023-10-25T16:18:15.723240+0000","last_fullsized":"2023-10-25T16:18:15.723240+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:16.470516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.691835+0000","last_change":"2023-10-25T16:18:14.691835+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.691835+0000","last_undegraded":"2023-10-25T16:18:14.691835+0000","last_fullsized":"2023-10-25T16:18:14.691835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668913+0000","last_change":"2023-10-25T16:18:14.668913+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668913+0000","last_undegraded":"2023-10-25T16:18:14.668913+0000","last_fullsized":"2023-10-25T16:18:14.668913+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717078+0000","last_change":"2023-10-25T16:18:15.716087+0000","last_active":"2023-10-25T16:18:15.717078+0000","last_peered":"2023-10-25T16:18:15.717078+0000","last_clean":"2023-10-25T16:18:15.717078+0000","last_became_active":"2023-10-25T16:18:15.715482+0000","last_became_peered":"2023-10-25T16:18:15.715482+0000","last_unstale":"2023-10-25T16:18:15.717078+0000","last_undegraded":"2023-10-25T16:18:15.717078+0000","last_fullsized":"2023-10-25T16:18:15.717078+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:32.163406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668538+0000","last_change":"2023-10-25T16:18:14.668538+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668538+0000","last_undegraded":"2023-10-25T16:18:14.668538+0000","last_fullsized":"2023-10-25T16:18:14.668538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668347+0000","last_change":"2023-10-25T16:18:14.668347+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668347+0000","last_undegraded":"2023-10-25T16:18:14.668347+0000","last_fullsized":"2023-10-25T16:18:14.668347+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.685781+0000","last_change":"2023-10-25T16:18:14.685781+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.685781+0000","last_undegraded":"2023-10-25T16:18:14.685781+0000","last_fullsized":"2023-10-25T16:18:14.685781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668399+0000","last_change":"2023-10-25T16:18:14.668399+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668399+0000","last_undegraded":"2023-10-25T16:18:14.668399+0000","last_fullsized":"2023-10-25T16:18:14.668399+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676154+0000","last_change":"2023-10-25T16:18:14.676154+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676154+0000","last_undegraded":"2023-10-25T16:18:14.676154+0000","last_fullsized":"2023-10-25T16:18:14.676154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674843+0000","last_change":"2023-10-25T16:18:14.674843+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674843+0000","last_undegraded":"2023-10-25T16:18:14.674843+0000","last_fullsized":"2023-10-25T16:18:14.674843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722481+0000","last_change":"2023-10-25T16:18:15.722288+0000","last_active":"2023-10-25T16:18:15.722481+0000","last_peered":"2023-10-25T16:18:15.722481+0000","last_clean":"2023-10-25T16:18:15.722481+0000","last_became_active":"2023-10-25T16:18:15.720465+0000","last_became_peered":"2023-10-25T16:18:15.720465+0000","last_unstale":"2023-10-25T16:18:15.722481+0000","last_undegraded":"2023-10-25T16:18:15.722481+0000","last_fullsized":"2023-10-25T16:18:15.722481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:11:20.814717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673675+0000","last_change":"2023-10-25T16:18:14.673675+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673675+0000","last_undegraded":"2023-10-25T16:18:14.673675+0000","last_fullsized":"2023-10-25T16:18:14.673675+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690003+0000","last_change":"2023-10-25T16:18:14.690003+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690003+0000","last_undegraded":"2023-10-25T16:18:14.690003+0000","last_fullsized":"2023-10-25T16:18:14.690003+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690693+0000","last_change":"2023-10-25T16:18:14.690693+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690693+0000","last_undegraded":"2023-10-25T16:18:14.690693+0000","last_fullsized":"2023-10-25T16:18:14.690693+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.725970+0000","last_change":"2023-10-25T16:18:15.725861+0000","last_active":"2023-10-25T16:18:15.725970+0000","last_peered":"2023-10-25T16:18:15.725970+0000","last_clean":"2023-10-25T16:18:15.725970+0000","last_became_active":"2023-10-25T16:18:15.725444+0000","last_became_peered":"2023-10-25T16:18:15.725444+0000","last_unstale":"2023-10-25T16:18:15.725970+0000","last_undegraded":"2023-10-25T16:18:15.725970+0000","last_fullsized":"2023-10-25T16:18:15.725970+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:25:28.385113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674698+0000","last_change":"2023-10-25T16:18:14.674698+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674698+0000","last_undegraded":"2023-10-25T16:18:14.674698+0000","last_fullsized":"2023-10-25T16:18:14.674698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717127+0000","last_change":"2023-10-25T16:18:15.716259+0000","last_active":"2023-10-25T16:18:15.717127+0000","last_peered":"2023-10-25T16:18:15.717127+0000","last_clean":"2023-10-25T16:18:15.717127+0000","last_became_active":"2023-10-25T16:18:15.715255+0000","last_became_peered":"2023-10-25T16:18:15.715255+0000","last_unstale":"2023-10-25T16:18:15.717127+0000","last_undegraded":"2023-10-25T16:18:15.717127+0000","last_fullsized":"2023-10-25T16:18:15.717127+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:32.491155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.724145+0000","last_change":"2023-10-25T16:18:15.723787+0000","last_active":"2023-10-25T16:18:15.724145+0000","last_peered":"2023-10-25T16:18:15.724145+0000","last_clean":"2023-10-25T16:18:15.724145+0000","last_became_active":"2023-10-25T16:18:15.722844+0000","last_became_peered":"2023-10-25T16:18:15.722844+0000","last_unstale":"2023-10-25T16:18:15.724145+0000","last_undegraded":"2023-10-25T16:18:15.724145+0000","last_fullsized":"2023-10-25T16:18:15.724145+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:33.050668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672981+0000","last_change":"2023-10-25T16:18:14.672981+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672981+0000","last_undegraded":"2023-10-25T16:18:14.672981+0000","last_fullsized":"2023-10-25T16:18:14.672981+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.686409+0000","last_change":"2023-10-25T16:18:14.686409+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.686409+0000","last_undegraded":"2023-10-25T16:18:14.686409+0000","last_fullsized":"2023-10-25T16:18:14.686409+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717169+0000","last_change":"2023-10-25T16:18:15.716805+0000","last_active":"2023-10-25T16:18:15.717169+0000","last_peered":"2023-10-25T16:18:15.717169+0000","last_clean":"2023-10-25T16:18:15.717169+0000","last_became_active":"2023-10-25T16:18:15.716162+0000","last_became_peered":"2023-10-25T16:18:15.716162+0000","last_unstale":"2023-10-25T16:18:15.717169+0000","last_undegraded":"2023-10-25T16:18:15.717169+0000","last_fullsized":"2023-10-25T16:18:15.717169+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:50.914760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670539+0000","last_change":"2023-10-25T16:18:14.670539+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670539+0000","last_undegraded":"2023-10-25T16:18:14.670539+0000","last_fullsized":"2023-10-25T16:18:14.670539+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679076+0000","last_change":"2023-10-25T16:18:14.679076+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679076+0000","last_undegraded":"2023-10-25T16:18:14.679076+0000","last_fullsized":"2023-10-25T16:18:14.679076+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.688831+0000","last_change":"2023-10-25T16:18:14.688831+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.688831+0000","last_undegraded":"2023-10-25T16:18:14.688831+0000","last_fullsized":"2023-10-25T16:18:14.688831+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687825+0000","last_change":"2023-10-25T16:18:14.687825+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687825+0000","last_undegraded":"2023-10-25T16:18:14.687825+0000","last_fullsized":"2023-10-25T16:18:14.687825+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669945+0000","last_change":"2023-10-25T16:18:14.669945+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669945+0000","last_undegraded":"2023-10-25T16:18:14.669945+0000","last_fullsized":"2023-10-25T16:18:14.669945+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670115+0000","last_change":"2023-10-25T16:18:14.670115+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670115+0000","last_undegraded":"2023-10-25T16:18:14.670115+0000","last_fullsized":"2023-10-25T16:18:14.670115+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682089+0000","last_change":"2023-10-25T16:18:14.682089+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682089+0000","last_undegraded":"2023-10-25T16:18:14.682089+0000","last_fullsized":"2023-10-25T16:18:14.682089+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675334+0000","last_change":"2023-10-25T16:18:14.675334+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675334+0000","last_undegraded":"2023-10-25T16:18:14.675334+0000","last_fullsized":"2023-10-25T16:18:14.675334+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.683517+0000","last_change":"2023-10-25T16:18:14.683517+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.683517+0000","last_undegraded":"2023-10-25T16:18:14.683517+0000","last_fullsized":"2023-10-25T16:18:14.683517+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693719+0000","last_change":"2023-10-25T16:18:14.693474+0000","last_active":"2023-10-25T16:18:14.693719+0000","last_peered":"2023-10-25T16:18:14.693719+0000","last_clean":"2023-10-25T16:18:14.693719+0000","last_became_active":"2023-10-25T16:18:14.690705+0000","last_became_peered":"2023-10-25T16:18:14.690705+0000","last_unstale":"2023-10-25T16:18:14.693719+0000","last_undegraded":"2023-10-25T16:18:14.693719+0000","last_fullsized":"2023-10-25T16:18:14.693719+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:42:00.049478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687156+0000","last_change":"2023-10-25T16:18:14.687156+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687156+0000","last_undegraded":"2023-10-25T16:18:14.687156+0000","last_fullsized":"2023-10-25T16:18:14.687156+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678624+0000","last_change":"2023-10-25T16:18:14.678465+0000","last_active":"2023-10-25T16:18:14.678624+0000","last_peered":"2023-10-25T16:18:14.678624+0000","last_clean":"2023-10-25T16:18:14.678624+0000","last_became_active":"2023-10-25T16:18:14.677865+0000","last_became_peered":"2023-10-25T16:18:14.677865+0000","last_unstale":"2023-10-25T16:18:14.678624+0000","last_undegraded":"2023-10-25T16:18:14.678624+0000","last_fullsized":"2023-10-25T16:18:14.678624+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675189+0000","last_change":"2023-10-25T16:18:14.675189+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675189+0000","last_undegraded":"2023-10-25T16:18:14.675189+0000","last_fullsized":"2023-10-25T16:18:14.675189+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689178+0000","last_change":"2023-10-25T16:18:14.689093+0000","last_active":"2023-10-25T16:18:14.689178+0000","last_peered":"2023-10-25T16:18:14.689178+0000","last_clean":"2023-10-25T16:18:14.689178+0000","last_became_active":"2023-10-25T16:18:14.688742+0000","last_became_peered":"2023-10-25T16:18:14.688742+0000","last_unstale":"2023-10-25T16:18:14.689178+0000","last_undegraded":"2023-10-25T16:18:14.689178+0000","last_fullsized":"2023-10-25T16:18:14.689178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:20:56.322723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680592+0000","last_change":"2023-10-25T16:18:14.680592+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680592+0000","last_undegraded":"2023-10-25T16:18:14.680592+0000","last_fullsized":"2023-10-25T16:18:14.680592+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685079+0000","last_change":"2023-10-25T16:18:14.684960+0000","last_active":"2023-10-25T16:18:14.685079+0000","last_peered":"2023-10-25T16:18:14.685079+0000","last_clean":"2023-10-25T16:18:14.685079+0000","last_became_active":"2023-10-25T16:18:14.684527+0000","last_became_peered":"2023-10-25T16:18:14.684527+0000","last_unstale":"2023-10-25T16:18:14.685079+0000","last_undegraded":"2023-10-25T16:18:14.685079+0000","last_fullsized":"2023-10-25T16:18:14.685079+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:04:56.895056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669842+0000","last_change":"2023-10-25T16:18:14.669842+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669842+0000","last_undegraded":"2023-10-25T16:18:14.669842+0000","last_fullsized":"2023-10-25T16:18:14.669842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689444+0000","last_change":"2023-10-25T16:18:14.687552+0000","last_active":"2023-10-25T16:18:14.689444+0000","last_peered":"2023-10-25T16:18:14.689444+0000","last_clean":"2023-10-25T16:18:14.689444+0000","last_became_active":"2023-10-25T16:18:14.684155+0000","last_became_peered":"2023-10-25T16:18:14.684155+0000","last_unstale":"2023-10-25T16:18:14.689444+0000","last_undegraded":"2023-10-25T16:18:14.689444+0000","last_fullsized":"2023-10-25T16:18:14.689444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:34:36.744102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682021+0000","last_change":"2023-10-25T16:18:14.682021+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682021+0000","last_undegraded":"2023-10-25T16:18:14.682021+0000","last_fullsized":"2023-10-25T16:18:14.682021+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678980+0000","last_change":"2023-10-25T16:18:14.678816+0000","last_active":"2023-10-25T16:18:14.678980+0000","last_peered":"2023-10-25T16:18:14.678980+0000","last_clean":"2023-10-25T16:18:14.678980+0000","last_became_active":"2023-10-25T16:18:14.678249+0000","last_became_peered":"2023-10-25T16:18:14.678249+0000","last_unstale":"2023-10-25T16:18:14.678980+0000","last_undegraded":"2023-10-25T16:18:14.678980+0000","last_fullsized":"2023-10-25T16:18:14.678980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:32.222175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679789+0000","last_change":"2023-10-25T16:18:14.679789+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679789+0000","last_undegraded":"2023-10-25T16:18:14.679789+0000","last_fullsized":"2023-10-25T16:18:14.679789+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685689+0000","last_change":"2023-10-25T16:18:14.685624+0000","last_active":"2023-10-25T16:18:14.685689+0000","last_peered":"2023-10-25T16:18:14.685689+0000","last_clean":"2023-10-25T16:18:14.685689+0000","last_became_active":"2023-10-25T16:18:14.685386+0000","last_became_peered":"2023-10-25T16:18:14.685386+0000","last_unstale":"2023-10-25T16:18:14.685689+0000","last_undegraded":"2023-10-25T16:18:14.685689+0000","last_fullsized":"2023-10-25T16:18:14.685689+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:03.749221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672365+0000","last_change":"2023-10-25T16:18:14.672365+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672365+0000","last_undegraded":"2023-10-25T16:18:14.672365+0000","last_fullsized":"2023-10-25T16:18:14.672365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.680392+0000","last_change":"2023-10-25T16:18:14.680316+0000","last_active":"2023-10-25T16:18:14.680392+0000","last_peered":"2023-10-25T16:18:14.680392+0000","last_clean":"2023-10-25T16:18:14.680392+0000","last_became_active":"2023-10-25T16:18:14.680086+0000","last_became_peered":"2023-10-25T16:18:14.680086+0000","last_unstale":"2023-10-25T16:18:14.680392+0000","last_undegraded":"2023-10-25T16:18:14.680392+0000","last_fullsized":"2023-10-25T16:18:14.680392+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:26:39.178409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675291+0000","last_change":"2023-10-25T16:18:14.675291+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675291+0000","last_undegraded":"2023-10-25T16:18:14.675291+0000","last_fullsized":"2023-10-25T16:18:14.675291+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686050+0000","last_change":"2023-10-25T16:18:14.683993+0000","last_active":"2023-10-25T16:18:14.686050+0000","last_peered":"2023-10-25T16:18:14.686050+0000","last_clean":"2023-10-25T16:18:14.686050+0000","last_became_active":"2023-10-25T16:18:14.683418+0000","last_became_peered":"2023-10-25T16:18:14.683418+0000","last_unstale":"2023-10-25T16:18:14.686050+0000","last_undegraded":"2023-10-25T16:18:14.686050+0000","last_fullsized":"2023-10-25T16:18:14.686050+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668031+0000","last_change":"2023-10-25T16:18:14.668031+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668031+0000","last_undegraded":"2023-10-25T16:18:14.668031+0000","last_fullsized":"2023-10-25T16:18:14.668031+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691025+0000","last_change":"2023-10-25T16:18:14.690839+0000","last_active":"2023-10-25T16:18:14.691025+0000","last_peered":"2023-10-25T16:18:14.691025+0000","last_clean":"2023-10-25T16:18:14.691025+0000","last_became_active":"2023-10-25T16:18:14.689717+0000","last_became_peered":"2023-10-25T16:18:14.689717+0000","last_unstale":"2023-10-25T16:18:14.691025+0000","last_undegraded":"2023-10-25T16:18:14.691025+0000","last_fullsized":"2023-10-25T16:18:14.691025+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673812+0000","last_change":"2023-10-25T16:18:14.673812+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673812+0000","last_undegraded":"2023-10-25T16:18:14.673812+0000","last_fullsized":"2023-10-25T16:18:14.673812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.697913+0000","last_change":"2023-10-25T16:18:14.697731+0000","last_active":"2023-10-25T16:18:14.697913+0000","last_peered":"2023-10-25T16:18:14.697913+0000","last_clean":"2023-10-25T16:18:14.697913+0000","last_became_active":"2023-10-25T16:18:14.694148+0000","last_became_peered":"2023-10-25T16:18:14.694148+0000","last_unstale":"2023-10-25T16:18:14.697913+0000","last_undegraded":"2023-10-25T16:18:14.697913+0000","last_fullsized":"2023-10-25T16:18:14.697913+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:43:51.638791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681803+0000","last_change":"2023-10-25T16:18:14.681803+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681803+0000","last_undegraded":"2023-10-25T16:18:14.681803+0000","last_fullsized":"2023-10-25T16:18:14.681803+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.683164+0000","last_change":"2023-10-25T16:18:14.683000+0000","last_active":"2023-10-25T16:18:14.683164+0000","last_peered":"2023-10-25T16:18:14.683164+0000","last_clean":"2023-10-25T16:18:14.683164+0000","last_became_active":"2023-10-25T16:18:14.682375+0000","last_became_peered":"2023-10-25T16:18:14.682375+0000","last_unstale":"2023-10-25T16:18:14.683164+0000","last_undegraded":"2023-10-25T16:18:14.683164+0000","last_fullsized":"2023-10-25T16:18:14.683164+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:23.538133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675469+0000","last_change":"2023-10-25T16:18:14.675469+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675469+0000","last_undegraded":"2023-10-25T16:18:14.675469+0000","last_fullsized":"2023-10-25T16:18:14.675469+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678631+0000","last_change":"2023-10-25T16:18:14.678520+0000","last_active":"2023-10-25T16:18:14.678631+0000","last_peered":"2023-10-25T16:18:14.678631+0000","last_clean":"2023-10-25T16:18:14.678631+0000","last_became_active":"2023-10-25T16:18:14.678295+0000","last_became_peered":"2023-10-25T16:18:14.678295+0000","last_unstale":"2023-10-25T16:18:14.678631+0000","last_undegraded":"2023-10-25T16:18:14.678631+0000","last_fullsized":"2023-10-25T16:18:14.678631+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:03:04.894878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.678931+0000","last_change":"2023-10-25T16:18:14.678931+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.678931+0000","last_undegraded":"2023-10-25T16:18:14.678931+0000","last_fullsized":"2023-10-25T16:18:14.678931+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685166+0000","last_change":"2023-10-25T16:18:14.684401+0000","last_active":"2023-10-25T16:18:14.685166+0000","last_peered":"2023-10-25T16:18:14.685166+0000","last_clean":"2023-10-25T16:18:14.685166+0000","last_became_active":"2023-10-25T16:18:14.683848+0000","last_became_peered":"2023-10-25T16:18:14.683848+0000","last_unstale":"2023-10-25T16:18:14.685166+0000","last_undegraded":"2023-10-25T16:18:14.685166+0000","last_fullsized":"2023-10-25T16:18:14.685166+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:52:14.014632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670755+0000","last_change":"2023-10-25T16:18:14.670755+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670755+0000","last_undegraded":"2023-10-25T16:18:14.670755+0000","last_fullsized":"2023-10-25T16:18:14.670755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.670309+0000","last_change":"2023-10-25T16:18:14.670094+0000","last_active":"2023-10-25T16:18:14.670309+0000","last_peered":"2023-10-25T16:18:14.670309+0000","last_clean":"2023-10-25T16:18:14.670309+0000","last_became_active":"2023-10-25T16:18:14.669490+0000","last_became_peered":"2023-10-25T16:18:14.669490+0000","last_unstale":"2023-10-25T16:18:14.670309+0000","last_undegraded":"2023-10-25T16:18:14.670309+0000","last_fullsized":"2023-10-25T16:18:14.670309+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:17.496638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672419+0000","last_change":"2023-10-25T16:18:14.672419+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672419+0000","last_undegraded":"2023-10-25T16:18:14.672419+0000","last_fullsized":"2023-10-25T16:18:14.672419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678008+0000","last_change":"2023-10-25T16:18:14.677926+0000","last_active":"2023-10-25T16:18:14.678008+0000","last_peered":"2023-10-25T16:18:14.678008+0000","last_clean":"2023-10-25T16:18:14.678008+0000","last_became_active":"2023-10-25T16:18:14.677671+0000","last_became_peered":"2023-10-25T16:18:14.677671+0000","last_unstale":"2023-10-25T16:18:14.678008+0000","last_undegraded":"2023-10-25T16:18:14.678008+0000","last_fullsized":"2023-10-25T16:18:14.678008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:43.298974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.677963+0000","last_change":"2023-10-25T16:18:14.677963+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.677963+0000","last_undegraded":"2023-10-25T16:18:14.677963+0000","last_fullsized":"2023-10-25T16:18:14.677963+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.696783+0000","last_change":"2023-10-25T16:18:14.695380+0000","last_active":"2023-10-25T16:18:14.696783+0000","last_peered":"2023-10-25T16:18:14.696783+0000","last_clean":"2023-10-25T16:18:14.696783+0000","last_became_active":"2023-10-25T16:18:14.694774+0000","last_became_peered":"2023-10-25T16:18:14.694774+0000","last_unstale":"2023-10-25T16:18:14.696783+0000","last_undegraded":"2023-10-25T16:18:14.696783+0000","last_fullsized":"2023-10-25T16:18:14.696783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:39.713874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676904+0000","last_change":"2023-10-25T16:18:14.676904+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676904+0000","last_undegraded":"2023-10-25T16:18:14.676904+0000","last_fullsized":"2023-10-25T16:18:14.676904+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.681355+0000","last_change":"2023-10-25T16:18:14.681247+0000","last_active":"2023-10-25T16:18:14.681355+0000","last_peered":"2023-10-25T16:18:14.681355+0000","last_clean":"2023-10-25T16:18:14.681355+0000","last_became_active":"2023-10-25T16:18:14.680881+0000","last_became_peered":"2023-10-25T16:18:14.680881+0000","last_unstale":"2023-10-25T16:18:14.681355+0000","last_undegraded":"2023-10-25T16:18:14.681355+0000","last_fullsized":"2023-10-25T16:18:14.681355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:11.176098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681261+0000","last_change":"2023-10-25T16:18:14.681261+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681261+0000","last_undegraded":"2023-10-25T16:18:14.681261+0000","last_fullsized":"2023-10-25T16:18:14.681261+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.676442+0000","last_change":"2023-10-25T16:18:14.676353+0000","last_active":"2023-10-25T16:18:14.676442+0000","last_peered":"2023-10-25T16:18:14.676442+0000","last_clean":"2023-10-25T16:18:14.676442+0000","last_became_active":"2023-10-25T16:18:14.675995+0000","last_became_peered":"2023-10-25T16:18:14.675995+0000","last_unstale":"2023-10-25T16:18:14.676442+0000","last_undegraded":"2023-10-25T16:18:14.676442+0000","last_fullsized":"2023-10-25T16:18:14.676442+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:47.794485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722327+0000","last_change":"2023-10-25T16:18:15.721910+0000","last_active":"2023-10-25T16:18:15.722327+0000","last_peered":"2023-10-25T16:18:15.722327+0000","last_clean":"2023-10-25T16:18:15.722327+0000","last_became_active":"2023-10-25T16:18:15.719630+0000","last_became_peered":"2023-10-25T16:18:15.719630+0000","last_unstale":"2023-10-25T16:18:15.722327+0000","last_undegraded":"2023-10-25T16:18:15.722327+0000","last_fullsized":"2023-10-25T16:18:15.722327+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:19:08.691030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686076+0000","last_change":"2023-10-25T16:18:14.685953+0000","last_active":"2023-10-25T16:18:14.686076+0000","last_peered":"2023-10-25T16:18:14.686076+0000","last_clean":"2023-10-25T16:18:14.686076+0000","last_became_active":"2023-10-25T16:18:14.685457+0000","last_became_peered":"2023-10-25T16:18:14.685457+0000","last_unstale":"2023-10-25T16:18:14.686076+0000","last_undegraded":"2023-10-25T16:18:14.686076+0000","last_fullsized":"2023-10-25T16:18:14.686076+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:50.749638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667784+0000","last_change":"2023-10-25T16:18:14.667784+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667784+0000","last_undegraded":"2023-10-25T16:18:14.667784+0000","last_fullsized":"2023-10-25T16:18:14.667784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.713777+0000","last_change":"2023-10-25T16:18:14.688534+0000","last_active":"2023-10-25T16:18:15.713777+0000","last_peered":"2023-10-25T16:18:15.713777+0000","last_clean":"2023-10-25T16:18:15.713777+0000","last_became_active":"2023-10-25T16:18:14.688038+0000","last_became_peered":"2023-10-25T16:18:14.688038+0000","last_unstale":"2023-10-25T16:18:15.713777+0000","last_undegraded":"2023-10-25T16:18:15.713777+0000","last_fullsized":"2023-10-25T16:18:15.713777+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:51.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722528+0000","last_change":"2023-10-25T16:18:15.722331+0000","last_active":"2023-10-25T16:18:15.722528+0000","last_peered":"2023-10-25T16:18:15.722528+0000","last_clean":"2023-10-25T16:18:15.722528+0000","last_became_active":"2023-10-25T16:18:15.721465+0000","last_became_peered":"2023-10-25T16:18:15.721465+0000","last_unstale":"2023-10-25T16:18:15.722528+0000","last_undegraded":"2023-10-25T16:18:15.722528+0000","last_fullsized":"2023-10-25T16:18:15.722528+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:35.939270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.714635+0000","last_change":"2023-10-25T16:18:14.688400+0000","last_active":"2023-10-25T16:18:15.714635+0000","last_peered":"2023-10-25T16:18:15.714635+0000","last_clean":"2023-10-25T16:18:15.714635+0000","last_became_active":"2023-10-25T16:18:14.687842+0000","last_became_peered":"2023-10-25T16:18:14.687842+0000","last_unstale":"2023-10-25T16:18:15.714635+0000","last_undegraded":"2023-10-25T16:18:15.714635+0000","last_fullsized":"2023-10-25T16:18:15.714635+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:12:59.340012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668507+0000","last_change":"2023-10-25T16:18:14.668507+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668507+0000","last_undegraded":"2023-10-25T16:18:14.668507+0000","last_fullsized":"2023-10-25T16:18:14.668507+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685204+0000","last_change":"2023-10-25T16:18:14.684569+0000","last_active":"2023-10-25T16:18:14.685204+0000","last_peered":"2023-10-25T16:18:14.685204+0000","last_clean":"2023-10-25T16:18:14.685204+0000","last_became_active":"2023-10-25T16:18:14.684187+0000","last_became_peered":"2023-10-25T16:18:14.684187+0000","last_unstale":"2023-10-25T16:18:14.685204+0000","last_undegraded":"2023-10-25T16:18:14.685204+0000","last_fullsized":"2023-10-25T16:18:14.685204+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:30:45.612265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680982+0000","last_change":"2023-10-25T16:18:14.680982+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680982+0000","last_undegraded":"2023-10-25T16:18:14.680982+0000","last_fullsized":"2023-10-25T16:18:14.680982+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.694999+0000","last_change":"2023-10-25T16:18:14.694912+0000","last_active":"2023-10-25T16:18:14.694999+0000","last_peered":"2023-10-25T16:18:14.694999+0000","last_clean":"2023-10-25T16:18:14.694999+0000","last_became_active":"2023-10-25T16:18:14.694664+0000","last_became_peered":"2023-10-25T16:18:14.694664+0000","last_unstale":"2023-10-25T16:18:14.694999+0000","last_undegraded":"2023-10-25T16:18:14.694999+0000","last_fullsized":"2023-10-25T16:18:14.694999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:33:08.133934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674686+0000","last_change":"2023-10-25T16:18:14.674686+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674686+0000","last_undegraded":"2023-10-25T16:18:14.674686+0000","last_fullsized":"2023-10-25T16:18:14.674686+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686554+0000","last_change":"2023-10-25T16:18:14.686451+0000","last_active":"2023-10-25T16:18:14.686554+0000","last_peered":"2023-10-25T16:18:14.686554+0000","last_clean":"2023-10-25T16:18:14.686554+0000","last_became_active":"2023-10-25T16:18:14.685309+0000","last_became_peered":"2023-10-25T16:18:14.685309+0000","last_unstale":"2023-10-25T16:18:14.686554+0000","last_undegraded":"2023-10-25T16:18:14.686554+0000","last_fullsized":"2023-10-25T16:18:14.686554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:10:04.278788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684504+0000","last_change":"2023-10-25T16:18:14.684504+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684504+0000","last_undegraded":"2023-10-25T16:18:14.684504+0000","last_fullsized":"2023-10-25T16:18:14.684504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693181+0000","last_change":"2023-10-25T16:18:14.692973+0000","last_active":"2023-10-25T16:18:14.693181+0000","last_peered":"2023-10-25T16:18:14.693181+0000","last_clean":"2023-10-25T16:18:14.693181+0000","last_became_active":"2023-10-25T16:18:14.690673+0000","last_became_peered":"2023-10-25T16:18:14.690673+0000","last_unstale":"2023-10-25T16:18:14.693181+0000","last_undegraded":"2023-10-25T16:18:14.693181+0000","last_fullsized":"2023-10-25T16:18:14.693181+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680844+0000","last_change":"2023-10-25T16:18:14.680844+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680844+0000","last_undegraded":"2023-10-25T16:18:14.680844+0000","last_fullsized":"2023-10-25T16:18:14.680844+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.688377+0000","last_change":"2023-10-25T16:18:14.688218+0000","last_active":"2023-10-25T16:18:14.688377+0000","last_peered":"2023-10-25T16:18:14.688377+0000","last_clean":"2023-10-25T16:18:14.688377+0000","last_became_active":"2023-10-25T16:18:14.686762+0000","last_became_peered":"2023-10-25T16:18:14.686762+0000","last_unstale":"2023-10-25T16:18:14.688377+0000","last_undegraded":"2023-10-25T16:18:14.688377+0000","last_fullsized":"2023-10-25T16:18:14.688377+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:29.234593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667531+0000","last_change":"2023-10-25T16:18:14.667531+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667531+0000","last_undegraded":"2023-10-25T16:18:14.667531+0000","last_fullsized":"2023-10-25T16:18:14.667531+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.695037+0000","last_change":"2023-10-25T16:18:14.694936+0000","last_active":"2023-10-25T16:18:14.695037+0000","last_peered":"2023-10-25T16:18:14.695037+0000","last_clean":"2023-10-25T16:18:14.695037+0000","last_became_active":"2023-10-25T16:18:14.694778+0000","last_became_peered":"2023-10-25T16:18:14.694778+0000","last_unstale":"2023-10-25T16:18:14.695037+0000","last_undegraded":"2023-10-25T16:18:14.695037+0000","last_fullsized":"2023-10-25T16:18:14.695037+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:18.354295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675159+0000","last_change":"2023-10-25T16:18:14.675159+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675159+0000","last_undegraded":"2023-10-25T16:18:14.675159+0000","last_fullsized":"2023-10-25T16:18:14.675159+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678673+0000","last_change":"2023-10-25T16:18:14.678493+0000","last_active":"2023-10-25T16:18:14.678673+0000","last_peered":"2023-10-25T16:18:14.678673+0000","last_clean":"2023-10-25T16:18:14.678673+0000","last_became_active":"2023-10-25T16:18:14.677877+0000","last_became_peered":"2023-10-25T16:18:14.677877+0000","last_unstale":"2023-10-25T16:18:14.678673+0000","last_undegraded":"2023-10-25T16:18:14.678673+0000","last_fullsized":"2023-10-25T16:18:14.678673+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674664+0000","last_change":"2023-10-25T16:18:14.674664+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674664+0000","last_undegraded":"2023-10-25T16:18:14.674664+0000","last_fullsized":"2023-10-25T16:18:14.674664+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691935+0000","last_change":"2023-10-25T16:18:14.691770+0000","last_active":"2023-10-25T16:18:14.691935+0000","last_peered":"2023-10-25T16:18:14.691935+0000","last_clean":"2023-10-25T16:18:14.691935+0000","last_became_active":"2023-10-25T16:18:14.688844+0000","last_became_peered":"2023-10-25T16:18:14.688844+0000","last_unstale":"2023-10-25T16:18:14.691935+0000","last_undegraded":"2023-10-25T16:18:14.691935+0000","last_fullsized":"2023-10-25T16:18:14.691935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:11:38.680241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684336+0000","last_change":"2023-10-25T16:18:14.684336+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684336+0000","last_undegraded":"2023-10-25T16:18:14.684336+0000","last_fullsized":"2023-10-25T16:18:14.684336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689381+0000","last_change":"2023-10-25T16:18:14.687958+0000","last_active":"2023-10-25T16:18:14.689381+0000","last_peered":"2023-10-25T16:18:14.689381+0000","last_clean":"2023-10-25T16:18:14.689381+0000","last_became_active":"2023-10-25T16:18:14.685768+0000","last_became_peered":"2023-10-25T16:18:14.685768+0000","last_unstale":"2023-10-25T16:18:14.689381+0000","last_undegraded":"2023-10-25T16:18:14.689381+0000","last_fullsized":"2023-10-25T16:18:14.689381+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.671873+0000","last_change":"2023-10-25T16:18:14.671873+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.671873+0000","last_undegraded":"2023-10-25T16:18:14.671873+0000","last_fullsized":"2023-10-25T16:18:14.671873+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.698634+0000","last_change":"2023-10-25T16:18:14.698466+0000","last_active":"2023-10-25T16:18:14.698634+0000","last_peered":"2023-10-25T16:18:14.698634+0000","last_clean":"2023-10-25T16:18:14.698634+0000","last_became_active":"2023-10-25T16:18:14.697644+0000","last_became_peered":"2023-10-25T16:18:14.697644+0000","last_unstale":"2023-10-25T16:18:14.698634+0000","last_undegraded":"2023-10-25T16:18:14.698634+0000","last_fullsized":"2023-10-25T16:18:14.698634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:58.505243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-25T16:18:13.667831+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:18:13.667831+0000","last_peered":"2023-10-25T16:18:13.667831+0000","last_clean":"2023-10-25T16:18:13.667831+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:18:13.667831+0000","last_undegraded":"2023-10-25T16:18:13.667831+0000","last_fullsized":"2023-10-25T16:18:13.667831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:30.918156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":553,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194759,"statfs":{"total":200000000,"available":199433614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57799999999999996,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60999999999999999,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.94099999999999995,"5min":1.077,"15min":1.077},"last":0.308}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63100000000000001,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66400000000000003,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.61599999999999999},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.194,"5min":1.345,"15min":1.345},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90100000000000002,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.75800000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.88900000000000001},"min":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.91200000000000003,"15min":0.92900000000000005},"min":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.95299999999999996,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.474,"5min":1.677,"15min":1.677},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.454,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.63800000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.117,"5min":1.256,"15min":1.256},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85699999999999998,"15min":0.82899999999999996},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.534,"15min":1.534},"last":0.92700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.177,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.284,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1659999999999999,"5min":1.27,"15min":1.27},"last":1.089},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":0.97499999999999998},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.222,"5min":1.446,"15min":1.446},"last":0.998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":0.94299999999999995},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.05}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.878,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0009999999999999,"15min":1.0489999999999999},"min":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.286,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.72199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.196,"5min":1.637,"15min":1.637},"last":0.88200000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":0.85899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.387,"5min":1.669,"15min":1.669},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.109,"5min":1.115,"15min":1.125},"min":{"1min":0.84399999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.286,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0229999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89200000000000002,"15min":0.88900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.083}]},{"osd":1,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.89100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1890000000000001,"5min":1.302,"15min":1.302},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.296,"5min":1.476,"15min":1.476},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93700000000000006,"15min":0.88900000000000001},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.484,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.177}]},{"osd":4,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.627},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95199999999999996,"15min":0.98799999999999999},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.97199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.056,"15min":1.054},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5720000000000001,"5min":1.895,"15min":1.895},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.69799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.139},{"interface":"front","average":{"1min":1.145,"5min":1.0880000000000001,"15min":1.0449999999999999},"min":{"1min":0.66300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0069999999999999,"15min":1.331},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":14.843,"15min":14.843},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.002,"15min":1.458},"min":{"1min":0.54600000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":16.439,"15min":16.439},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.03,"15min":1.393},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.157,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90600000000000003,"15min":0.874},"min":{"1min":0.66700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.92100000000000004,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.012,"5min":0.97999999999999998,"15min":0.96999999999999997},"min":{"1min":0.69399999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3169999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2150000000000001,"15min":1.5029999999999999},"min":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.194,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.149,"15min":1.5700000000000001},"min":{"1min":0.60299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.53,"5min":15.904,"15min":15.904},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1240000000000001,"15min":1.595},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1899999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.173,"15min":1.4890000000000001},"min":{"1min":0.91400000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":14.567,"15min":14.567},"last":1.143},{"interface":"front","average":{"1min":1.161,"5min":1.3,"15min":1.6910000000000001},"min":{"1min":0.73499999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5820000000000001,"5min":15.089,"15min":15.089},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.2030000000000001,"15min":1.708},"min":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.24,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.212,"5min":1.177,"15min":1.2649999999999999},"min":{"1min":0.96299999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2649999999999999,"5min":1.47,"15min":1.47},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.85299999999999998,"15min":0.81299999999999994},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.278,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.874,"15min":0.82299999999999995},"min":{"1min":0.55200000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.288,"15min":1.288},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.97299999999999998,"15min":0.94299999999999995},"min":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1619999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.095}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95799999999999996,"15min":0.90900000000000003},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.196,"5min":1.518,"15min":1.518},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.169,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.89000000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3180000000000001,"5min":1.431,"15min":1.431},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.64200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2430000000000001,"5min":2.085,"15min":2.085},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.089,"15min":1.071},"min":{"1min":0.69499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.92900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.94799999999999995},"min":{"1min":0.63,"5min":0.5,"15min":0.5},"max":{"1min":1.2609999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.1160000000000001},"min":{"1min":0.96699999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60399999999999998,"15min":0.55200000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.81299999999999994,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.64100000000000001},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.94099999999999995,"5min":1.083,"15min":1.083},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.32600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.1779999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73799999999999999,"15min":0.69999999999999996},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.155,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.95599999999999996,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.087},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1379999999999999,"5min":1.23,"15min":1.23},"last":1.052},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.206,"5min":1.427,"15min":1.427},"last":0.93400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89800000000000002,"15min":0.92800000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.96299999999999997,"15min":0.93999999999999995},"min":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.22,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1799999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.226,"5min":1.456,"15min":1.456},"last":0.999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1719999999999999,"5min":1.663,"15min":1.663},"last":1.028}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.99299999999999999,"15min":0.96999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.28,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97199999999999998,"15min":0.94699999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.254,"5min":1.389,"15min":1.389},"last":1.1319999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.95399999999999996,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.249,"15min":0.249},"max":{"1min":0.99099999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.157,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.39100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.048,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.375,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1899999999999999,"5min":1.423,"15min":1.423},"last":1.0269999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":0.97299999999999998},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0820000000000001,"5min":12.698,"15min":12.698},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.026},"min":{"1min":0.73099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2310000000000001,"5min":12.721,"15min":12.721},"last":1.23}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2729999999999999,"5min":1.546,"15min":1.546},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.89100000000000001},"min":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.034,"5min":2.206,"15min":2.206},"last":0.94299999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.70899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.298,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.397,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.101,"15min":0.98299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.276,"5min":14.776,"15min":14.776},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1080000000000001,"15min":1.022},"min":{"1min":0.62,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.476,"5min":10.509,"15min":10.509},"last":1.2829999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.69499999999999995},"min":{"1min":0.33100000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.74099999999999999},"min":{"1min":0.39500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.3560000000000001,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.89300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.68400000000000005},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.996,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98899999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.745}]},{"osd":3,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.194,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.407,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.036}]},{"osd":4,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3120000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.71999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6719999999999999,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90100000000000002,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.228,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92200000000000004,"15min":0.95099999999999996},"min":{"1min":0.67100000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.21,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.1379999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.278,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.94699999999999995,"15min":0.92200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.387,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.069}]},{"osd":7,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.075,"15min":1.298},"min":{"1min":0.73899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.294,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0900000000000001,"15min":1.3149999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4410000000000001,"5min":11.622,"15min":11.622},"last":1.276}]}]}],"pool_statfs":[]}} 2023-10-25T16:18:19.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-10-25T16:18:19.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.676264+0000', 'last_change': '2023-10-25T16:18:14.676264+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.676264+0000', 'last_undegraded': '2023-10-25T16:18:14.676264+0000', 'last_fullsized': '2023-10-25T16:18:14.676264+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-10-25T16:18:19.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.673602+0000', 'last_change': '2023-10-25T16:18:14.673602+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.673602+0000', 'last_undegraded': '2023-10-25T16:18:14.673602+0000', 'last_fullsized': '2023-10-25T16:18:14.673602+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-10-25T16:18:19.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.675766+0000', 'last_change': '2023-10-25T16:18:14.675766+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.675766+0000', 'last_undegraded': '2023-10-25T16:18:14.675766+0000', 'last_fullsized': '2023-10-25T16:18:14.675766+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-10-25T16:18:19.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.691835+0000', 'last_change': '2023-10-25T16:18:14.691835+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.691835+0000', 'last_undegraded': '2023-10-25T16:18:14.691835+0000', 'last_fullsized': '2023-10-25T16:18:14.691835+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-10-25T16:18:19.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.668913+0000', 'last_change': '2023-10-25T16:18:14.668913+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.668913+0000', 'last_undegraded': '2023-10-25T16:18:14.668913+0000', 'last_fullsized': '2023-10-25T16:18:14.668913+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-10-25T16:18:19.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.668538+0000', 'last_change': '2023-10-25T16:18:14.668538+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.668538+0000', 'last_undegraded': '2023-10-25T16:18:14.668538+0000', 'last_fullsized': '2023-10-25T16:18:14.668538+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-10-25T16:18:19.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.668347+0000', 'last_change': '2023-10-25T16:18:14.668347+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.668347+0000', 'last_undegraded': '2023-10-25T16:18:14.668347+0000', 'last_fullsized': '2023-10-25T16:18:14.668347+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-10-25T16:18:19.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.685781+0000', 'last_change': '2023-10-25T16:18:14.685781+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.685781+0000', 'last_undegraded': '2023-10-25T16:18:14.685781+0000', 'last_fullsized': '2023-10-25T16:18:14.685781+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-10-25T16:18:19.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.668399+0000', 'last_change': '2023-10-25T16:18:14.668399+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.668399+0000', 'last_undegraded': '2023-10-25T16:18:14.668399+0000', 'last_fullsized': '2023-10-25T16:18:14.668399+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-10-25T16:18:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.676154+0000', 'last_change': '2023-10-25T16:18:14.676154+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.676154+0000', 'last_undegraded': '2023-10-25T16:18:14.676154+0000', 'last_fullsized': '2023-10-25T16:18:14.676154+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-10-25T16:18:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.674843+0000', 'last_change': '2023-10-25T16:18:14.674843+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.674843+0000', 'last_undegraded': '2023-10-25T16:18:14.674843+0000', 'last_fullsized': '2023-10-25T16:18:14.674843+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-10-25T16:18:19.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.673675+0000', 'last_change': '2023-10-25T16:18:14.673675+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.673675+0000', 'last_undegraded': '2023-10-25T16:18:14.673675+0000', 'last_fullsized': '2023-10-25T16:18:14.673675+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:18:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-10-25T16:18:19.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.690003+0000', 'last_change': '2023-10-25T16:18:14.690003+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.690003+0000', 'last_undegraded': '2023-10-25T16:18:14.690003+0000', 'last_fullsized': '2023-10-25T16:18:14.690003+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-10-25T16:18:19.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.690693+0000', 'last_change': '2023-10-25T16:18:14.690693+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.690693+0000', 'last_undegraded': '2023-10-25T16:18:14.690693+0000', 'last_fullsized': '2023-10-25T16:18:14.690693+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-10-25T16:18:19.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.674698+0000', 'last_change': '2023-10-25T16:18:14.674698+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.674698+0000', 'last_undegraded': '2023-10-25T16:18:14.674698+0000', 'last_fullsized': '2023-10-25T16:18:14.674698+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:18:19.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-10-25T16:18:19.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.672981+0000', 'last_change': '2023-10-25T16:18:14.672981+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.672981+0000', 'last_undegraded': '2023-10-25T16:18:14.672981+0000', 'last_fullsized': '2023-10-25T16:18:14.672981+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-10-25T16:18:19.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.686409+0000', 'last_change': '2023-10-25T16:18:14.686409+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.686409+0000', 'last_undegraded': '2023-10-25T16:18:14.686409+0000', 'last_fullsized': '2023-10-25T16:18:14.686409+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-10-25T16:18:19.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.670539+0000', 'last_change': '2023-10-25T16:18:14.670539+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.670539+0000', 'last_undegraded': '2023-10-25T16:18:14.670539+0000', 'last_fullsized': '2023-10-25T16:18:14.670539+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-10-25T16:18:19.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.679076+0000', 'last_change': '2023-10-25T16:18:14.679076+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.679076+0000', 'last_undegraded': '2023-10-25T16:18:14.679076+0000', 'last_fullsized': '2023-10-25T16:18:14.679076+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-10-25T16:18:19.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.688831+0000', 'last_change': '2023-10-25T16:18:14.688831+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.688831+0000', 'last_undegraded': '2023-10-25T16:18:14.688831+0000', 'last_fullsized': '2023-10-25T16:18:14.688831+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-10-25T16:18:19.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.687825+0000', 'last_change': '2023-10-25T16:18:14.687825+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.687825+0000', 'last_undegraded': '2023-10-25T16:18:14.687825+0000', 'last_fullsized': '2023-10-25T16:18:14.687825+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-10-25T16:18:19.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.669945+0000', 'last_change': '2023-10-25T16:18:14.669945+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.669945+0000', 'last_undegraded': '2023-10-25T16:18:14.669945+0000', 'last_fullsized': '2023-10-25T16:18:14.669945+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-10-25T16:18:19.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.670115+0000', 'last_change': '2023-10-25T16:18:14.670115+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.670115+0000', 'last_undegraded': '2023-10-25T16:18:14.670115+0000', 'last_fullsized': '2023-10-25T16:18:14.670115+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-10-25T16:18:19.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.682089+0000', 'last_change': '2023-10-25T16:18:14.682089+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.682089+0000', 'last_undegraded': '2023-10-25T16:18:14.682089+0000', 'last_fullsized': '2023-10-25T16:18:14.682089+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-10-25T16:18:19.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.675334+0000', 'last_change': '2023-10-25T16:18:14.675334+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.675334+0000', 'last_undegraded': '2023-10-25T16:18:14.675334+0000', 'last_fullsized': '2023-10-25T16:18:14.675334+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-10-25T16:18:19.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.683517+0000', 'last_change': '2023-10-25T16:18:14.683517+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.683517+0000', 'last_undegraded': '2023-10-25T16:18:14.683517+0000', 'last_fullsized': '2023-10-25T16:18:14.683517+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-10-25T16:18:19.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.687156+0000', 'last_change': '2023-10-25T16:18:14.687156+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.687156+0000', 'last_undegraded': '2023-10-25T16:18:14.687156+0000', 'last_fullsized': '2023-10-25T16:18:14.687156+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-10-25T16:18:19.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.675189+0000', 'last_change': '2023-10-25T16:18:14.675189+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.675189+0000', 'last_undegraded': '2023-10-25T16:18:14.675189+0000', 'last_fullsized': '2023-10-25T16:18:14.675189+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-10-25T16:18:19.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.680592+0000', 'last_change': '2023-10-25T16:18:14.680592+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.680592+0000', 'last_undegraded': '2023-10-25T16:18:14.680592+0000', 'last_fullsized': '2023-10-25T16:18:14.680592+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-10-25T16:18:19.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.669842+0000', 'last_change': '2023-10-25T16:18:14.669842+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.669842+0000', 'last_undegraded': '2023-10-25T16:18:14.669842+0000', 'last_fullsized': '2023-10-25T16:18:14.669842+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-10-25T16:18:19.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.682021+0000', 'last_change': '2023-10-25T16:18:14.682021+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.682021+0000', 'last_undegraded': '2023-10-25T16:18:14.682021+0000', 'last_fullsized': '2023-10-25T16:18:14.682021+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-10-25T16:18:19.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.679789+0000', 'last_change': '2023-10-25T16:18:14.679789+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.679789+0000', 'last_undegraded': '2023-10-25T16:18:14.679789+0000', 'last_fullsized': '2023-10-25T16:18:14.679789+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-10-25T16:18:19.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.672365+0000', 'last_change': '2023-10-25T16:18:14.672365+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.672365+0000', 'last_undegraded': '2023-10-25T16:18:14.672365+0000', 'last_fullsized': '2023-10-25T16:18:14.672365+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:18:19.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-10-25T16:18:19.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.675291+0000', 'last_change': '2023-10-25T16:18:14.675291+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.675291+0000', 'last_undegraded': '2023-10-25T16:18:14.675291+0000', 'last_fullsized': '2023-10-25T16:18:14.675291+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:18:19.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-10-25T16:18:19.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.668031+0000', 'last_change': '2023-10-25T16:18:14.668031+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.668031+0000', 'last_undegraded': '2023-10-25T16:18:14.668031+0000', 'last_fullsized': '2023-10-25T16:18:14.668031+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-10-25T16:18:19.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.673812+0000', 'last_change': '2023-10-25T16:18:14.673812+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.673812+0000', 'last_undegraded': '2023-10-25T16:18:14.673812+0000', 'last_fullsized': '2023-10-25T16:18:14.673812+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:18:19.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-10-25T16:18:19.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.681803+0000', 'last_change': '2023-10-25T16:18:14.681803+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.681803+0000', 'last_undegraded': '2023-10-25T16:18:14.681803+0000', 'last_fullsized': '2023-10-25T16:18:14.681803+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-10-25T16:18:19.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.675469+0000', 'last_change': '2023-10-25T16:18:14.675469+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.675469+0000', 'last_undegraded': '2023-10-25T16:18:14.675469+0000', 'last_fullsized': '2023-10-25T16:18:14.675469+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:18:19.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-10-25T16:18:19.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.678931+0000', 'last_change': '2023-10-25T16:18:14.678931+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.678931+0000', 'last_undegraded': '2023-10-25T16:18:14.678931+0000', 'last_fullsized': '2023-10-25T16:18:14.678931+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-10-25T16:18:19.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.670755+0000', 'last_change': '2023-10-25T16:18:14.670755+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.670755+0000', 'last_undegraded': '2023-10-25T16:18:14.670755+0000', 'last_fullsized': '2023-10-25T16:18:14.670755+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-10-25T16:18:19.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.672419+0000', 'last_change': '2023-10-25T16:18:14.672419+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.672419+0000', 'last_undegraded': '2023-10-25T16:18:14.672419+0000', 'last_fullsized': '2023-10-25T16:18:14.672419+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-10-25T16:18:19.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.677963+0000', 'last_change': '2023-10-25T16:18:14.677963+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.677963+0000', 'last_undegraded': '2023-10-25T16:18:14.677963+0000', 'last_fullsized': '2023-10-25T16:18:14.677963+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-10-25T16:18:19.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.676904+0000', 'last_change': '2023-10-25T16:18:14.676904+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.676904+0000', 'last_undegraded': '2023-10-25T16:18:14.676904+0000', 'last_fullsized': '2023-10-25T16:18:14.676904+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-10-25T16:18:19.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.681261+0000', 'last_change': '2023-10-25T16:18:14.681261+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.681261+0000', 'last_undegraded': '2023-10-25T16:18:14.681261+0000', 'last_fullsized': '2023-10-25T16:18:14.681261+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-10-25T16:18:19.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.667784+0000', 'last_change': '2023-10-25T16:18:14.667784+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.667784+0000', 'last_undegraded': '2023-10-25T16:18:14.667784+0000', 'last_fullsized': '2023-10-25T16:18:14.667784+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-10-25T16:18:19.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.668507+0000', 'last_change': '2023-10-25T16:18:14.668507+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.668507+0000', 'last_undegraded': '2023-10-25T16:18:14.668507+0000', 'last_fullsized': '2023-10-25T16:18:14.668507+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-10-25T16:18:19.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.680982+0000', 'last_change': '2023-10-25T16:18:14.680982+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.680982+0000', 'last_undegraded': '2023-10-25T16:18:14.680982+0000', 'last_fullsized': '2023-10-25T16:18:14.680982+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-10-25T16:18:19.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.674686+0000', 'last_change': '2023-10-25T16:18:14.674686+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.674686+0000', 'last_undegraded': '2023-10-25T16:18:14.674686+0000', 'last_fullsized': '2023-10-25T16:18:14.674686+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-10-25T16:18:19.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.684504+0000', 'last_change': '2023-10-25T16:18:14.684504+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.684504+0000', 'last_undegraded': '2023-10-25T16:18:14.684504+0000', 'last_fullsized': '2023-10-25T16:18:14.684504+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-10-25T16:18:19.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.680844+0000', 'last_change': '2023-10-25T16:18:14.680844+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.680844+0000', 'last_undegraded': '2023-10-25T16:18:14.680844+0000', 'last_fullsized': '2023-10-25T16:18:14.680844+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:18:19.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-10-25T16:18:19.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.667531+0000', 'last_change': '2023-10-25T16:18:14.667531+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.667531+0000', 'last_undegraded': '2023-10-25T16:18:14.667531+0000', 'last_fullsized': '2023-10-25T16:18:14.667531+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:18:19.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-10-25T16:18:19.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.675159+0000', 'last_change': '2023-10-25T16:18:14.675159+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.675159+0000', 'last_undegraded': '2023-10-25T16:18:14.675159+0000', 'last_fullsized': '2023-10-25T16:18:14.675159+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:18:19.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-10-25T16:18:19.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.674664+0000', 'last_change': '2023-10-25T16:18:14.674664+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.674664+0000', 'last_undegraded': '2023-10-25T16:18:14.674664+0000', 'last_fullsized': '2023-10-25T16:18:14.674664+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:18:19.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-10-25T16:18:19.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.684336+0000', 'last_change': '2023-10-25T16:18:14.684336+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.684336+0000', 'last_undegraded': '2023-10-25T16:18:14.684336+0000', 'last_fullsized': '2023-10-25T16:18:14.684336+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:18:19.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-10-25T16:18:19.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 103, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:18:14.671873+0000', 'last_change': '2023-10-25T16:18:14.671873+0000', 'last_active': '2023-10-25T16:18:14.654677+0000', 'last_peered': '2023-10-25T16:18:14.654677+0000', 'last_clean': '2023-10-25T16:18:14.654677+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:18:14.671873+0000', 'last_undegraded': '2023-10-25T16:18:14.671873+0000', 'last_fullsized': '2023-10-25T16:18:14.671873+0000', 'mapping_epoch': 103, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 103, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'last_clean_scrub_stamp': '2023-10-25T16:18:14.654677+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:18:19.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:18:19.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 -- 172.21.15.177:0/3419760348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80159230 msgr2=0x7f9f80071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3419760348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80159230 0x7f9f80071500 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9f8006c6a0 tx=0x7f9f7001c870 comp rx=0 tx=0).stop 2023-10-25T16:18:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 -- 172.21.15.177:0/3419760348 shutdown_connections 2023-10-25T16:18:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3419760348 >> v2:172.21.15.184:3300/0 conn(0x7f9f80070510 0x7f9f800cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3419760348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80159230 0x7f9f80071500 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 -- 172.21.15.177:0/3419760348 >> 172.21.15.177:0/3419760348 conn(0x7f9f800b2450 msgr2=0x7f9f800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 -- 172.21.15.177:0/3419760348 shutdown_connections 2023-10-25T16:18:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 -- 172.21.15.177:0/3419760348 wait complete. 2023-10-25T16:18:19.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 Processor -- start 2023-10-25T16:18:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.629+0000 7f9f84f75640 1 -- start start 2023-10-25T16:18:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f80070510 0x7f9f800abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 0x7f9f800b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f80159230 0x7f9f800ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800b1580 con 0x7f9f800cc610 2023-10-25T16:18:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800aeea0 con 0x7f9f80070510 2023-10-25T16:18:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800b0be0 con 0x7f9f80159230 2023-10-25T16:18:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 0x7f9f800b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 0x7f9f800b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52226/0 (socket says 172.21.15.177:52226) 2023-10-25T16:18:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 -- 172.21.15.177:0/3201154669 learned_addr learned my addr 172.21.15.177:0/3201154669 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7e59c640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f80070510 0x7f9f800abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 -- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f80159230 msgr2=0x7f9f800ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f80159230 0x7f9f800ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 -- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f80070510 msgr2=0x7f9f800abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f80070510 0x7f9f800abe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 -- 172.21.15.177:0/3201154669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009560 con 0x7f9f800cc610 2023-10-25T16:18:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7dd9b640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 0x7f9f800b19a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400d950 tx=0x7f9f7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74009c30 con 0x7f9f800cc610 2023-10-25T16:18:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9f74009e80 con 0x7f9f800cc610 2023-10-25T16:18:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f800b0ec0 con 0x7f9f800cc610 2023-10-25T16:18:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740106a0 con 0x7f9f800cc610 2023-10-25T16:18:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f800b1ee0 con 0x7f9f800cc610 2023-10-25T16:18:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f800b16c0 con 0x7f9f800cc610 2023-10-25T16:18:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f74010800 con 0x7f9f800cc610 2023-10-25T16:18:19.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f6effd640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9f600664a0 0x7f9f60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f740843b0 con 0x7f9f800cc610 2023-10-25T16:18:19.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.633+0000 7f9f7e59c640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9f600664a0 0x7f9f60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.637+0000 7f9f7e59c640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9f600664a0 0x7f9f60068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9f700af000 tx=0x7f9f7001b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:19.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.637+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f800b16c0 con 0x7f9f800cc610 2023-10-25T16:18:19.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.845+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9f800b16c0 con 0x7f9f800cc610 2023-10-25T16:18:19.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f6effd640 1 -- 172.21.15.177:0/3201154669 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1450 (secure 0 0 0) 0x7f9f800b16c0 con 0x7f9f800cc610 2023-10-25T16:18:19.849 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:19.849 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":331,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":105,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":55},{"state_name":"active+clean","count":42}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":5616400,"bytes_avail":1594383600,"bytes_total":1600000000,"inactive_pgs_ratio":0.56701028347015381},"fsmap":{"epoch":38,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":155378}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-25T16:18:04.707414+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:18:19.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9f600664a0 msgr2=0x7f9f60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9f600664a0 0x7f9f60068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9f700af000 tx=0x7f9f7001b0b0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 msgr2=0x7f9f800b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 0x7f9f800b19a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400d950 tx=0x7f9f7400de10 comp rx=0 tx=0).stop 2023-10-25T16:18:19.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 shutdown_connections 2023-10-25T16:18:19.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9f600664a0 0x7f9f60068960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f80159230 0x7f9f800ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f800cc610 0x7f9f800b19a0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 --2- 172.21.15.177:0/3201154669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f80070510 0x7f9f800abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 >> 172.21.15.177:0/3201154669 conn(0x7f9f800b2450 msgr2=0x7f9f80149460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:19.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 shutdown_connections 2023-10-25T16:18:19.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.849+0000 7f9f84f75640 1 -- 172.21.15.177:0/3201154669 wait complete. 2023-10-25T16:18:19.865 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:18:19.866 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:18:19.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.981+0000 7ff02d401640 1 -- 172.21.15.177:0/665945938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0140039d0 msgr2=0x7ff014003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 --2- 172.21.15.177:0/665945938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0140039d0 0x7ff014003df0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff01800bb10 tx=0x7ff01801cd70 comp rx=0 tx=0).stop 2023-10-25T16:18:19.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/665945938 shutdown_connections 2023-10-25T16:18:19.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 --2- 172.21.15.177:0/665945938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0140039d0 0x7ff014003df0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/665945938 >> 172.21.15.177:0/665945938 conn(0x7ff0280afe20 msgr2=0x7ff0280b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:19.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/665945938 shutdown_connections 2023-10-25T16:18:19.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/665945938 wait complete. 2023-10-25T16:18:19.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 Processor -- start 2023-10-25T16:18:19.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- start start 2023-10-25T16:18:19.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0140039d0 0x7ff028150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff028154780 0x7ff02814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 0x7ff028156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02814af50 con 0x7ff02813da20 2023-10-25T16:18:19.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028154c10 con 0x7ff028154780 2023-10-25T16:18:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02813f620 con 0x7ff0140039d0 2023-10-25T16:18:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 0x7ff028156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 0x7ff028156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52236/0 (socket says 172.21.15.177:52236) 2023-10-25T16:18:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 -- 172.21.15.177:0/1563672275 learned_addr learned my addr 172.21.15.177:0/1563672275 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:19.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0267fc640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff028154780 0x7ff02814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff026ffd640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0140039d0 0x7ff028150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 -- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0140039d0 msgr2=0x7ff028150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0140039d0 0x7ff028150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 -- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff028154780 msgr2=0x7ff02814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:19.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff028154780 0x7ff02814aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 -- 172.21.15.177:0/1563672275 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02813f900 con 0x7ff02813da20 2023-10-25T16:18:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff0277fe640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 0x7ff028156250 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ff0280cbfd0 tx=0x7ff020006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000fa20 con 0x7ff02813da20 2023-10-25T16:18:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff02000fb80 con 0x7ff02813da20 2023-10-25T16:18:19.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02813fbe0 con 0x7ff02813da20 2023-10-25T16:18:19.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020011430 con 0x7ff02813da20 2023-10-25T16:18:19.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02813deb0 con 0x7ff02813da20 2023-10-25T16:18:19.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.985+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02813e0d0 con 0x7ff02813da20 2023-10-25T16:18:19.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.989+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff020011590 con 0x7ff02813da20 2023-10-25T16:18:19.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.989+0000 7ff01f7fe640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff008066470 0x7ff008068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:19.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.989+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0200848a0 con 0x7ff02813da20 2023-10-25T16:18:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.989+0000 7ff026ffd640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff008066470 0x7ff008068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.989+0000 7ff026ffd640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff008066470 0x7ff008068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff0180b0000 tx=0x7ff0180a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:19.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:19.993+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff02813e0d0 con 0x7ff02813da20 2023-10-25T16:18:20.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.129+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff02806cf30 con 0x7ff008066470 2023-10-25T16:18:20.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.149+0000 7ff01f7fe640 1 -- 172.21.15.177:0/1563672275 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279318 (secure 0 0 0) 0x7ff0180a5a40 con 0x7ff008066470 2023-10-25T16:18:20.152 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:20.154 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:18:20.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff008066470 msgr2=0x7ff008068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:20.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff008066470 0x7ff008068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff0180b0000 tx=0x7ff0180a7040 comp rx=0 tx=0).stop 2023-10-25T16:18:20.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 msgr2=0x7ff028156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:20.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 0x7ff028156250 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ff0280cbfd0 tx=0x7ff020006660 comp rx=0 tx=0).stop 2023-10-25T16:18:20.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 shutdown_connections 2023-10-25T16:18:20.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff008066470 0x7ff008068930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:20.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff02813da20 0x7ff028156250 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:20.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff028154780 0x7ff02814aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:20.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 --2- 172.21.15.177:0/1563672275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0140039d0 0x7ff028150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:20.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 >> 172.21.15.177:0/1563672275 conn(0x7ff0280afe20 msgr2=0x7ff0281570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:20.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 shutdown_connections 2023-10-25T16:18:20.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:20.153+0000 7ff02d401640 1 -- 172.21.15.177:0/1563672275 wait complete. 2023-10-25T16:18:20.169 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-10-25T16:18:18.715584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5484,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557015,"statfs":{"total":1600000000,"available":1594383600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.057192"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676264+0000","last_change":"2023-10-25T16:18:14.676264+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676264+0000","last_undegraded":"2023-10-25T16:18:14.676264+0000","last_fullsized":"2023-10-25T16:18:14.676264+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673602+0000","last_change":"2023-10-25T16:18:14.673602+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673602+0000","last_undegraded":"2023-10-25T16:18:14.673602+0000","last_fullsized":"2023-10-25T16:18:14.673602+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675766+0000","last_change":"2023-10-25T16:18:14.675766+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675766+0000","last_undegraded":"2023-10-25T16:18:14.675766+0000","last_fullsized":"2023-10-25T16:18:14.675766+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.723240+0000","last_change":"2023-10-25T16:18:15.722650+0000","last_active":"2023-10-25T16:18:15.723240+0000","last_peered":"2023-10-25T16:18:15.723240+0000","last_clean":"2023-10-25T16:18:15.723240+0000","last_became_active":"2023-10-25T16:18:15.721279+0000","last_became_peered":"2023-10-25T16:18:15.721279+0000","last_unstale":"2023-10-25T16:18:15.723240+0000","last_undegraded":"2023-10-25T16:18:15.723240+0000","last_fullsized":"2023-10-25T16:18:15.723240+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:16.470516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.691835+0000","last_change":"2023-10-25T16:18:14.691835+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.691835+0000","last_undegraded":"2023-10-25T16:18:14.691835+0000","last_fullsized":"2023-10-25T16:18:14.691835+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668913+0000","last_change":"2023-10-25T16:18:14.668913+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668913+0000","last_undegraded":"2023-10-25T16:18:14.668913+0000","last_fullsized":"2023-10-25T16:18:14.668913+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717078+0000","last_change":"2023-10-25T16:18:15.716087+0000","last_active":"2023-10-25T16:18:15.717078+0000","last_peered":"2023-10-25T16:18:15.717078+0000","last_clean":"2023-10-25T16:18:15.717078+0000","last_became_active":"2023-10-25T16:18:15.715482+0000","last_became_peered":"2023-10-25T16:18:15.715482+0000","last_unstale":"2023-10-25T16:18:15.717078+0000","last_undegraded":"2023-10-25T16:18:15.717078+0000","last_fullsized":"2023-10-25T16:18:15.717078+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:32.163406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668538+0000","last_change":"2023-10-25T16:18:14.668538+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668538+0000","last_undegraded":"2023-10-25T16:18:14.668538+0000","last_fullsized":"2023-10-25T16:18:14.668538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668347+0000","last_change":"2023-10-25T16:18:14.668347+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668347+0000","last_undegraded":"2023-10-25T16:18:14.668347+0000","last_fullsized":"2023-10-25T16:18:14.668347+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.685781+0000","last_change":"2023-10-25T16:18:14.685781+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.685781+0000","last_undegraded":"2023-10-25T16:18:14.685781+0000","last_fullsized":"2023-10-25T16:18:14.685781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668399+0000","last_change":"2023-10-25T16:18:14.668399+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668399+0000","last_undegraded":"2023-10-25T16:18:14.668399+0000","last_fullsized":"2023-10-25T16:18:14.668399+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676154+0000","last_change":"2023-10-25T16:18:14.676154+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676154+0000","last_undegraded":"2023-10-25T16:18:14.676154+0000","last_fullsized":"2023-10-25T16:18:14.676154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674843+0000","last_change":"2023-10-25T16:18:14.674843+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674843+0000","last_undegraded":"2023-10-25T16:18:14.674843+0000","last_fullsized":"2023-10-25T16:18:14.674843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722481+0000","last_change":"2023-10-25T16:18:15.722288+0000","last_active":"2023-10-25T16:18:15.722481+0000","last_peered":"2023-10-25T16:18:15.722481+0000","last_clean":"2023-10-25T16:18:15.722481+0000","last_became_active":"2023-10-25T16:18:15.720465+0000","last_became_peered":"2023-10-25T16:18:15.720465+0000","last_unstale":"2023-10-25T16:18:15.722481+0000","last_undegraded":"2023-10-25T16:18:15.722481+0000","last_fullsized":"2023-10-25T16:18:15.722481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:11:20.814717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673675+0000","last_change":"2023-10-25T16:18:14.673675+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673675+0000","last_undegraded":"2023-10-25T16:18:14.673675+0000","last_fullsized":"2023-10-25T16:18:14.673675+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690003+0000","last_change":"2023-10-25T16:18:14.690003+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690003+0000","last_undegraded":"2023-10-25T16:18:14.690003+0000","last_fullsized":"2023-10-25T16:18:14.690003+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.690693+0000","last_change":"2023-10-25T16:18:14.690693+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.690693+0000","last_undegraded":"2023-10-25T16:18:14.690693+0000","last_fullsized":"2023-10-25T16:18:14.690693+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.725970+0000","last_change":"2023-10-25T16:18:15.725861+0000","last_active":"2023-10-25T16:18:15.725970+0000","last_peered":"2023-10-25T16:18:15.725970+0000","last_clean":"2023-10-25T16:18:15.725970+0000","last_became_active":"2023-10-25T16:18:15.725444+0000","last_became_peered":"2023-10-25T16:18:15.725444+0000","last_unstale":"2023-10-25T16:18:15.725970+0000","last_undegraded":"2023-10-25T16:18:15.725970+0000","last_fullsized":"2023-10-25T16:18:15.725970+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:25:28.385113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674698+0000","last_change":"2023-10-25T16:18:14.674698+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674698+0000","last_undegraded":"2023-10-25T16:18:14.674698+0000","last_fullsized":"2023-10-25T16:18:14.674698+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717127+0000","last_change":"2023-10-25T16:18:15.716259+0000","last_active":"2023-10-25T16:18:15.717127+0000","last_peered":"2023-10-25T16:18:15.717127+0000","last_clean":"2023-10-25T16:18:15.717127+0000","last_became_active":"2023-10-25T16:18:15.715255+0000","last_became_peered":"2023-10-25T16:18:15.715255+0000","last_unstale":"2023-10-25T16:18:15.717127+0000","last_undegraded":"2023-10-25T16:18:15.717127+0000","last_fullsized":"2023-10-25T16:18:15.717127+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:32.491155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.724145+0000","last_change":"2023-10-25T16:18:15.723787+0000","last_active":"2023-10-25T16:18:15.724145+0000","last_peered":"2023-10-25T16:18:15.724145+0000","last_clean":"2023-10-25T16:18:15.724145+0000","last_became_active":"2023-10-25T16:18:15.722844+0000","last_became_peered":"2023-10-25T16:18:15.722844+0000","last_unstale":"2023-10-25T16:18:15.724145+0000","last_undegraded":"2023-10-25T16:18:15.724145+0000","last_fullsized":"2023-10-25T16:18:15.724145+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:43:33.050668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672981+0000","last_change":"2023-10-25T16:18:14.672981+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672981+0000","last_undegraded":"2023-10-25T16:18:14.672981+0000","last_fullsized":"2023-10-25T16:18:14.672981+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.686409+0000","last_change":"2023-10-25T16:18:14.686409+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.686409+0000","last_undegraded":"2023-10-25T16:18:14.686409+0000","last_fullsized":"2023-10-25T16:18:14.686409+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.717169+0000","last_change":"2023-10-25T16:18:15.716805+0000","last_active":"2023-10-25T16:18:15.717169+0000","last_peered":"2023-10-25T16:18:15.717169+0000","last_clean":"2023-10-25T16:18:15.717169+0000","last_became_active":"2023-10-25T16:18:15.716162+0000","last_became_peered":"2023-10-25T16:18:15.716162+0000","last_unstale":"2023-10-25T16:18:15.717169+0000","last_undegraded":"2023-10-25T16:18:15.717169+0000","last_fullsized":"2023-10-25T16:18:15.717169+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:50.914760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670539+0000","last_change":"2023-10-25T16:18:14.670539+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670539+0000","last_undegraded":"2023-10-25T16:18:14.670539+0000","last_fullsized":"2023-10-25T16:18:14.670539+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679076+0000","last_change":"2023-10-25T16:18:14.679076+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679076+0000","last_undegraded":"2023-10-25T16:18:14.679076+0000","last_fullsized":"2023-10-25T16:18:14.679076+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.688831+0000","last_change":"2023-10-25T16:18:14.688831+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.688831+0000","last_undegraded":"2023-10-25T16:18:14.688831+0000","last_fullsized":"2023-10-25T16:18:14.688831+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687825+0000","last_change":"2023-10-25T16:18:14.687825+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687825+0000","last_undegraded":"2023-10-25T16:18:14.687825+0000","last_fullsized":"2023-10-25T16:18:14.687825+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669945+0000","last_change":"2023-10-25T16:18:14.669945+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669945+0000","last_undegraded":"2023-10-25T16:18:14.669945+0000","last_fullsized":"2023-10-25T16:18:14.669945+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670115+0000","last_change":"2023-10-25T16:18:14.670115+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670115+0000","last_undegraded":"2023-10-25T16:18:14.670115+0000","last_fullsized":"2023-10-25T16:18:14.670115+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682089+0000","last_change":"2023-10-25T16:18:14.682089+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682089+0000","last_undegraded":"2023-10-25T16:18:14.682089+0000","last_fullsized":"2023-10-25T16:18:14.682089+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675334+0000","last_change":"2023-10-25T16:18:14.675334+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675334+0000","last_undegraded":"2023-10-25T16:18:14.675334+0000","last_fullsized":"2023-10-25T16:18:14.675334+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.683517+0000","last_change":"2023-10-25T16:18:14.683517+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.683517+0000","last_undegraded":"2023-10-25T16:18:14.683517+0000","last_fullsized":"2023-10-25T16:18:14.683517+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693719+0000","last_change":"2023-10-25T16:18:14.693474+0000","last_active":"2023-10-25T16:18:14.693719+0000","last_peered":"2023-10-25T16:18:14.693719+0000","last_clean":"2023-10-25T16:18:14.693719+0000","last_became_active":"2023-10-25T16:18:14.690705+0000","last_became_peered":"2023-10-25T16:18:14.690705+0000","last_unstale":"2023-10-25T16:18:14.693719+0000","last_undegraded":"2023-10-25T16:18:14.693719+0000","last_fullsized":"2023-10-25T16:18:14.693719+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:42:00.049478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.687156+0000","last_change":"2023-10-25T16:18:14.687156+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.687156+0000","last_undegraded":"2023-10-25T16:18:14.687156+0000","last_fullsized":"2023-10-25T16:18:14.687156+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678624+0000","last_change":"2023-10-25T16:18:14.678465+0000","last_active":"2023-10-25T16:18:14.678624+0000","last_peered":"2023-10-25T16:18:14.678624+0000","last_clean":"2023-10-25T16:18:14.678624+0000","last_became_active":"2023-10-25T16:18:14.677865+0000","last_became_peered":"2023-10-25T16:18:14.677865+0000","last_unstale":"2023-10-25T16:18:14.678624+0000","last_undegraded":"2023-10-25T16:18:14.678624+0000","last_fullsized":"2023-10-25T16:18:14.678624+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675189+0000","last_change":"2023-10-25T16:18:14.675189+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675189+0000","last_undegraded":"2023-10-25T16:18:14.675189+0000","last_fullsized":"2023-10-25T16:18:14.675189+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689178+0000","last_change":"2023-10-25T16:18:14.689093+0000","last_active":"2023-10-25T16:18:14.689178+0000","last_peered":"2023-10-25T16:18:14.689178+0000","last_clean":"2023-10-25T16:18:14.689178+0000","last_became_active":"2023-10-25T16:18:14.688742+0000","last_became_peered":"2023-10-25T16:18:14.688742+0000","last_unstale":"2023-10-25T16:18:14.689178+0000","last_undegraded":"2023-10-25T16:18:14.689178+0000","last_fullsized":"2023-10-25T16:18:14.689178+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:20:56.322723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680592+0000","last_change":"2023-10-25T16:18:14.680592+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680592+0000","last_undegraded":"2023-10-25T16:18:14.680592+0000","last_fullsized":"2023-10-25T16:18:14.680592+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685079+0000","last_change":"2023-10-25T16:18:14.684960+0000","last_active":"2023-10-25T16:18:14.685079+0000","last_peered":"2023-10-25T16:18:14.685079+0000","last_clean":"2023-10-25T16:18:14.685079+0000","last_became_active":"2023-10-25T16:18:14.684527+0000","last_became_peered":"2023-10-25T16:18:14.684527+0000","last_unstale":"2023-10-25T16:18:14.685079+0000","last_undegraded":"2023-10-25T16:18:14.685079+0000","last_fullsized":"2023-10-25T16:18:14.685079+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:04:56.895056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.669842+0000","last_change":"2023-10-25T16:18:14.669842+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.669842+0000","last_undegraded":"2023-10-25T16:18:14.669842+0000","last_fullsized":"2023-10-25T16:18:14.669842+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689444+0000","last_change":"2023-10-25T16:18:14.687552+0000","last_active":"2023-10-25T16:18:14.689444+0000","last_peered":"2023-10-25T16:18:14.689444+0000","last_clean":"2023-10-25T16:18:14.689444+0000","last_became_active":"2023-10-25T16:18:14.684155+0000","last_became_peered":"2023-10-25T16:18:14.684155+0000","last_unstale":"2023-10-25T16:18:14.689444+0000","last_undegraded":"2023-10-25T16:18:14.689444+0000","last_fullsized":"2023-10-25T16:18:14.689444+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:34:36.744102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.682021+0000","last_change":"2023-10-25T16:18:14.682021+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.682021+0000","last_undegraded":"2023-10-25T16:18:14.682021+0000","last_fullsized":"2023-10-25T16:18:14.682021+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678980+0000","last_change":"2023-10-25T16:18:14.678816+0000","last_active":"2023-10-25T16:18:14.678980+0000","last_peered":"2023-10-25T16:18:14.678980+0000","last_clean":"2023-10-25T16:18:14.678980+0000","last_became_active":"2023-10-25T16:18:14.678249+0000","last_became_peered":"2023-10-25T16:18:14.678249+0000","last_unstale":"2023-10-25T16:18:14.678980+0000","last_undegraded":"2023-10-25T16:18:14.678980+0000","last_fullsized":"2023-10-25T16:18:14.678980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:32.222175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.679789+0000","last_change":"2023-10-25T16:18:14.679789+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.679789+0000","last_undegraded":"2023-10-25T16:18:14.679789+0000","last_fullsized":"2023-10-25T16:18:14.679789+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685689+0000","last_change":"2023-10-25T16:18:14.685624+0000","last_active":"2023-10-25T16:18:14.685689+0000","last_peered":"2023-10-25T16:18:14.685689+0000","last_clean":"2023-10-25T16:18:14.685689+0000","last_became_active":"2023-10-25T16:18:14.685386+0000","last_became_peered":"2023-10-25T16:18:14.685386+0000","last_unstale":"2023-10-25T16:18:14.685689+0000","last_undegraded":"2023-10-25T16:18:14.685689+0000","last_fullsized":"2023-10-25T16:18:14.685689+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:03.749221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672365+0000","last_change":"2023-10-25T16:18:14.672365+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672365+0000","last_undegraded":"2023-10-25T16:18:14.672365+0000","last_fullsized":"2023-10-25T16:18:14.672365+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.680392+0000","last_change":"2023-10-25T16:18:14.680316+0000","last_active":"2023-10-25T16:18:14.680392+0000","last_peered":"2023-10-25T16:18:14.680392+0000","last_clean":"2023-10-25T16:18:14.680392+0000","last_became_active":"2023-10-25T16:18:14.680086+0000","last_became_peered":"2023-10-25T16:18:14.680086+0000","last_unstale":"2023-10-25T16:18:14.680392+0000","last_undegraded":"2023-10-25T16:18:14.680392+0000","last_fullsized":"2023-10-25T16:18:14.680392+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:26:39.178409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675291+0000","last_change":"2023-10-25T16:18:14.675291+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675291+0000","last_undegraded":"2023-10-25T16:18:14.675291+0000","last_fullsized":"2023-10-25T16:18:14.675291+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686050+0000","last_change":"2023-10-25T16:18:14.683993+0000","last_active":"2023-10-25T16:18:14.686050+0000","last_peered":"2023-10-25T16:18:14.686050+0000","last_clean":"2023-10-25T16:18:14.686050+0000","last_became_active":"2023-10-25T16:18:14.683418+0000","last_became_peered":"2023-10-25T16:18:14.683418+0000","last_unstale":"2023-10-25T16:18:14.686050+0000","last_undegraded":"2023-10-25T16:18:14.686050+0000","last_fullsized":"2023-10-25T16:18:14.686050+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:04.111694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668031+0000","last_change":"2023-10-25T16:18:14.668031+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668031+0000","last_undegraded":"2023-10-25T16:18:14.668031+0000","last_fullsized":"2023-10-25T16:18:14.668031+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691025+0000","last_change":"2023-10-25T16:18:14.690839+0000","last_active":"2023-10-25T16:18:14.691025+0000","last_peered":"2023-10-25T16:18:14.691025+0000","last_clean":"2023-10-25T16:18:14.691025+0000","last_became_active":"2023-10-25T16:18:14.689717+0000","last_became_peered":"2023-10-25T16:18:14.689717+0000","last_unstale":"2023-10-25T16:18:14.691025+0000","last_undegraded":"2023-10-25T16:18:14.691025+0000","last_fullsized":"2023-10-25T16:18:14.691025+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.673812+0000","last_change":"2023-10-25T16:18:14.673812+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.673812+0000","last_undegraded":"2023-10-25T16:18:14.673812+0000","last_fullsized":"2023-10-25T16:18:14.673812+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.697913+0000","last_change":"2023-10-25T16:18:14.697731+0000","last_active":"2023-10-25T16:18:14.697913+0000","last_peered":"2023-10-25T16:18:14.697913+0000","last_clean":"2023-10-25T16:18:14.697913+0000","last_became_active":"2023-10-25T16:18:14.694148+0000","last_became_peered":"2023-10-25T16:18:14.694148+0000","last_unstale":"2023-10-25T16:18:14.697913+0000","last_undegraded":"2023-10-25T16:18:14.697913+0000","last_fullsized":"2023-10-25T16:18:14.697913+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:43:51.638791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681803+0000","last_change":"2023-10-25T16:18:14.681803+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681803+0000","last_undegraded":"2023-10-25T16:18:14.681803+0000","last_fullsized":"2023-10-25T16:18:14.681803+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.683164+0000","last_change":"2023-10-25T16:18:14.683000+0000","last_active":"2023-10-25T16:18:14.683164+0000","last_peered":"2023-10-25T16:18:14.683164+0000","last_clean":"2023-10-25T16:18:14.683164+0000","last_became_active":"2023-10-25T16:18:14.682375+0000","last_became_peered":"2023-10-25T16:18:14.682375+0000","last_unstale":"2023-10-25T16:18:14.683164+0000","last_undegraded":"2023-10-25T16:18:14.683164+0000","last_fullsized":"2023-10-25T16:18:14.683164+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:23.538133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675469+0000","last_change":"2023-10-25T16:18:14.675469+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675469+0000","last_undegraded":"2023-10-25T16:18:14.675469+0000","last_fullsized":"2023-10-25T16:18:14.675469+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678631+0000","last_change":"2023-10-25T16:18:14.678520+0000","last_active":"2023-10-25T16:18:14.678631+0000","last_peered":"2023-10-25T16:18:14.678631+0000","last_clean":"2023-10-25T16:18:14.678631+0000","last_became_active":"2023-10-25T16:18:14.678295+0000","last_became_peered":"2023-10-25T16:18:14.678295+0000","last_unstale":"2023-10-25T16:18:14.678631+0000","last_undegraded":"2023-10-25T16:18:14.678631+0000","last_fullsized":"2023-10-25T16:18:14.678631+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:03:04.894878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.678931+0000","last_change":"2023-10-25T16:18:14.678931+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.678931+0000","last_undegraded":"2023-10-25T16:18:14.678931+0000","last_fullsized":"2023-10-25T16:18:14.678931+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685166+0000","last_change":"2023-10-25T16:18:14.684401+0000","last_active":"2023-10-25T16:18:14.685166+0000","last_peered":"2023-10-25T16:18:14.685166+0000","last_clean":"2023-10-25T16:18:14.685166+0000","last_became_active":"2023-10-25T16:18:14.683848+0000","last_became_peered":"2023-10-25T16:18:14.683848+0000","last_unstale":"2023-10-25T16:18:14.685166+0000","last_undegraded":"2023-10-25T16:18:14.685166+0000","last_fullsized":"2023-10-25T16:18:14.685166+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:52:14.014632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.670755+0000","last_change":"2023-10-25T16:18:14.670755+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.670755+0000","last_undegraded":"2023-10-25T16:18:14.670755+0000","last_fullsized":"2023-10-25T16:18:14.670755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.670309+0000","last_change":"2023-10-25T16:18:14.670094+0000","last_active":"2023-10-25T16:18:14.670309+0000","last_peered":"2023-10-25T16:18:14.670309+0000","last_clean":"2023-10-25T16:18:14.670309+0000","last_became_active":"2023-10-25T16:18:14.669490+0000","last_became_peered":"2023-10-25T16:18:14.669490+0000","last_unstale":"2023-10-25T16:18:14.670309+0000","last_undegraded":"2023-10-25T16:18:14.670309+0000","last_fullsized":"2023-10-25T16:18:14.670309+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:17.496638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.672419+0000","last_change":"2023-10-25T16:18:14.672419+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.672419+0000","last_undegraded":"2023-10-25T16:18:14.672419+0000","last_fullsized":"2023-10-25T16:18:14.672419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678008+0000","last_change":"2023-10-25T16:18:14.677926+0000","last_active":"2023-10-25T16:18:14.678008+0000","last_peered":"2023-10-25T16:18:14.678008+0000","last_clean":"2023-10-25T16:18:14.678008+0000","last_became_active":"2023-10-25T16:18:14.677671+0000","last_became_peered":"2023-10-25T16:18:14.677671+0000","last_unstale":"2023-10-25T16:18:14.678008+0000","last_undegraded":"2023-10-25T16:18:14.678008+0000","last_fullsized":"2023-10-25T16:18:14.678008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:43.298974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.677963+0000","last_change":"2023-10-25T16:18:14.677963+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.677963+0000","last_undegraded":"2023-10-25T16:18:14.677963+0000","last_fullsized":"2023-10-25T16:18:14.677963+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.696783+0000","last_change":"2023-10-25T16:18:14.695380+0000","last_active":"2023-10-25T16:18:14.696783+0000","last_peered":"2023-10-25T16:18:14.696783+0000","last_clean":"2023-10-25T16:18:14.696783+0000","last_became_active":"2023-10-25T16:18:14.694774+0000","last_became_peered":"2023-10-25T16:18:14.694774+0000","last_unstale":"2023-10-25T16:18:14.696783+0000","last_undegraded":"2023-10-25T16:18:14.696783+0000","last_fullsized":"2023-10-25T16:18:14.696783+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:39.713874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.676904+0000","last_change":"2023-10-25T16:18:14.676904+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.676904+0000","last_undegraded":"2023-10-25T16:18:14.676904+0000","last_fullsized":"2023-10-25T16:18:14.676904+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.681355+0000","last_change":"2023-10-25T16:18:14.681247+0000","last_active":"2023-10-25T16:18:14.681355+0000","last_peered":"2023-10-25T16:18:14.681355+0000","last_clean":"2023-10-25T16:18:14.681355+0000","last_became_active":"2023-10-25T16:18:14.680881+0000","last_became_peered":"2023-10-25T16:18:14.680881+0000","last_unstale":"2023-10-25T16:18:14.681355+0000","last_undegraded":"2023-10-25T16:18:14.681355+0000","last_fullsized":"2023-10-25T16:18:14.681355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:11.176098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.681261+0000","last_change":"2023-10-25T16:18:14.681261+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.681261+0000","last_undegraded":"2023-10-25T16:18:14.681261+0000","last_fullsized":"2023-10-25T16:18:14.681261+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.676442+0000","last_change":"2023-10-25T16:18:14.676353+0000","last_active":"2023-10-25T16:18:14.676442+0000","last_peered":"2023-10-25T16:18:14.676442+0000","last_clean":"2023-10-25T16:18:14.676442+0000","last_became_active":"2023-10-25T16:18:14.675995+0000","last_became_peered":"2023-10-25T16:18:14.675995+0000","last_unstale":"2023-10-25T16:18:14.676442+0000","last_undegraded":"2023-10-25T16:18:14.676442+0000","last_fullsized":"2023-10-25T16:18:14.676442+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:47.794485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722327+0000","last_change":"2023-10-25T16:18:15.721910+0000","last_active":"2023-10-25T16:18:15.722327+0000","last_peered":"2023-10-25T16:18:15.722327+0000","last_clean":"2023-10-25T16:18:15.722327+0000","last_became_active":"2023-10-25T16:18:15.719630+0000","last_became_peered":"2023-10-25T16:18:15.719630+0000","last_unstale":"2023-10-25T16:18:15.722327+0000","last_undegraded":"2023-10-25T16:18:15.722327+0000","last_fullsized":"2023-10-25T16:18:15.722327+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:19:08.691030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686076+0000","last_change":"2023-10-25T16:18:14.685953+0000","last_active":"2023-10-25T16:18:14.686076+0000","last_peered":"2023-10-25T16:18:14.686076+0000","last_clean":"2023-10-25T16:18:14.686076+0000","last_became_active":"2023-10-25T16:18:14.685457+0000","last_became_peered":"2023-10-25T16:18:14.685457+0000","last_unstale":"2023-10-25T16:18:14.686076+0000","last_undegraded":"2023-10-25T16:18:14.686076+0000","last_fullsized":"2023-10-25T16:18:14.686076+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:09:50.749638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667784+0000","last_change":"2023-10-25T16:18:14.667784+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667784+0000","last_undegraded":"2023-10-25T16:18:14.667784+0000","last_fullsized":"2023-10-25T16:18:14.667784+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.713777+0000","last_change":"2023-10-25T16:18:14.688534+0000","last_active":"2023-10-25T16:18:15.713777+0000","last_peered":"2023-10-25T16:18:15.713777+0000","last_clean":"2023-10-25T16:18:15.713777+0000","last_became_active":"2023-10-25T16:18:14.688038+0000","last_became_peered":"2023-10-25T16:18:14.688038+0000","last_unstale":"2023-10-25T16:18:15.713777+0000","last_undegraded":"2023-10-25T16:18:15.713777+0000","last_fullsized":"2023-10-25T16:18:15.713777+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:51.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.722528+0000","last_change":"2023-10-25T16:18:15.722331+0000","last_active":"2023-10-25T16:18:15.722528+0000","last_peered":"2023-10-25T16:18:15.722528+0000","last_clean":"2023-10-25T16:18:15.722528+0000","last_became_active":"2023-10-25T16:18:15.721465+0000","last_became_peered":"2023-10-25T16:18:15.721465+0000","last_unstale":"2023-10-25T16:18:15.722528+0000","last_undegraded":"2023-10-25T16:18:15.722528+0000","last_fullsized":"2023-10-25T16:18:15.722528+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:35.939270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.714635+0000","last_change":"2023-10-25T16:18:14.688400+0000","last_active":"2023-10-25T16:18:15.714635+0000","last_peered":"2023-10-25T16:18:15.714635+0000","last_clean":"2023-10-25T16:18:15.714635+0000","last_became_active":"2023-10-25T16:18:14.687842+0000","last_became_peered":"2023-10-25T16:18:14.687842+0000","last_unstale":"2023-10-25T16:18:15.714635+0000","last_undegraded":"2023-10-25T16:18:15.714635+0000","last_fullsized":"2023-10-25T16:18:15.714635+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:12:59.340012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.668507+0000","last_change":"2023-10-25T16:18:14.668507+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.668507+0000","last_undegraded":"2023-10-25T16:18:14.668507+0000","last_fullsized":"2023-10-25T16:18:14.668507+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.685204+0000","last_change":"2023-10-25T16:18:14.684569+0000","last_active":"2023-10-25T16:18:14.685204+0000","last_peered":"2023-10-25T16:18:14.685204+0000","last_clean":"2023-10-25T16:18:14.685204+0000","last_became_active":"2023-10-25T16:18:14.684187+0000","last_became_peered":"2023-10-25T16:18:14.684187+0000","last_unstale":"2023-10-25T16:18:14.685204+0000","last_undegraded":"2023-10-25T16:18:14.685204+0000","last_fullsized":"2023-10-25T16:18:14.685204+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:30:45.612265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680982+0000","last_change":"2023-10-25T16:18:14.680982+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680982+0000","last_undegraded":"2023-10-25T16:18:14.680982+0000","last_fullsized":"2023-10-25T16:18:14.680982+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.694999+0000","last_change":"2023-10-25T16:18:14.694912+0000","last_active":"2023-10-25T16:18:14.694999+0000","last_peered":"2023-10-25T16:18:14.694999+0000","last_clean":"2023-10-25T16:18:14.694999+0000","last_became_active":"2023-10-25T16:18:14.694664+0000","last_became_peered":"2023-10-25T16:18:14.694664+0000","last_unstale":"2023-10-25T16:18:14.694999+0000","last_undegraded":"2023-10-25T16:18:14.694999+0000","last_fullsized":"2023-10-25T16:18:14.694999+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:33:08.133934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674686+0000","last_change":"2023-10-25T16:18:14.674686+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674686+0000","last_undegraded":"2023-10-25T16:18:14.674686+0000","last_fullsized":"2023-10-25T16:18:14.674686+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.686554+0000","last_change":"2023-10-25T16:18:14.686451+0000","last_active":"2023-10-25T16:18:14.686554+0000","last_peered":"2023-10-25T16:18:14.686554+0000","last_clean":"2023-10-25T16:18:14.686554+0000","last_became_active":"2023-10-25T16:18:14.685309+0000","last_became_peered":"2023-10-25T16:18:14.685309+0000","last_unstale":"2023-10-25T16:18:14.686554+0000","last_undegraded":"2023-10-25T16:18:14.686554+0000","last_fullsized":"2023-10-25T16:18:14.686554+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:10:04.278788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684504+0000","last_change":"2023-10-25T16:18:14.684504+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684504+0000","last_undegraded":"2023-10-25T16:18:14.684504+0000","last_fullsized":"2023-10-25T16:18:14.684504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.693181+0000","last_change":"2023-10-25T16:18:14.692973+0000","last_active":"2023-10-25T16:18:14.693181+0000","last_peered":"2023-10-25T16:18:14.693181+0000","last_clean":"2023-10-25T16:18:14.693181+0000","last_became_active":"2023-10-25T16:18:14.690673+0000","last_became_peered":"2023-10-25T16:18:14.690673+0000","last_unstale":"2023-10-25T16:18:14.693181+0000","last_undegraded":"2023-10-25T16:18:14.693181+0000","last_fullsized":"2023-10-25T16:18:14.693181+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.680844+0000","last_change":"2023-10-25T16:18:14.680844+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.680844+0000","last_undegraded":"2023-10-25T16:18:14.680844+0000","last_fullsized":"2023-10-25T16:18:14.680844+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.688377+0000","last_change":"2023-10-25T16:18:14.688218+0000","last_active":"2023-10-25T16:18:14.688377+0000","last_peered":"2023-10-25T16:18:14.688377+0000","last_clean":"2023-10-25T16:18:14.688377+0000","last_became_active":"2023-10-25T16:18:14.686762+0000","last_became_peered":"2023-10-25T16:18:14.686762+0000","last_unstale":"2023-10-25T16:18:14.688377+0000","last_undegraded":"2023-10-25T16:18:14.688377+0000","last_fullsized":"2023-10-25T16:18:14.688377+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:29.234593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.667531+0000","last_change":"2023-10-25T16:18:14.667531+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.667531+0000","last_undegraded":"2023-10-25T16:18:14.667531+0000","last_fullsized":"2023-10-25T16:18:14.667531+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.695037+0000","last_change":"2023-10-25T16:18:14.694936+0000","last_active":"2023-10-25T16:18:14.695037+0000","last_peered":"2023-10-25T16:18:14.695037+0000","last_clean":"2023-10-25T16:18:14.695037+0000","last_became_active":"2023-10-25T16:18:14.694778+0000","last_became_peered":"2023-10-25T16:18:14.694778+0000","last_unstale":"2023-10-25T16:18:14.695037+0000","last_undegraded":"2023-10-25T16:18:14.695037+0000","last_fullsized":"2023-10-25T16:18:14.695037+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:18.354295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.675159+0000","last_change":"2023-10-25T16:18:14.675159+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.675159+0000","last_undegraded":"2023-10-25T16:18:14.675159+0000","last_fullsized":"2023-10-25T16:18:14.675159+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.678673+0000","last_change":"2023-10-25T16:18:14.678493+0000","last_active":"2023-10-25T16:18:14.678673+0000","last_peered":"2023-10-25T16:18:14.678673+0000","last_clean":"2023-10-25T16:18:14.678673+0000","last_became_active":"2023-10-25T16:18:14.677877+0000","last_became_peered":"2023-10-25T16:18:14.677877+0000","last_unstale":"2023-10-25T16:18:14.678673+0000","last_undegraded":"2023-10-25T16:18:14.678673+0000","last_fullsized":"2023-10-25T16:18:14.678673+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:42:30.167954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.674664+0000","last_change":"2023-10-25T16:18:14.674664+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.674664+0000","last_undegraded":"2023-10-25T16:18:14.674664+0000","last_fullsized":"2023-10-25T16:18:14.674664+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.691935+0000","last_change":"2023-10-25T16:18:14.691770+0000","last_active":"2023-10-25T16:18:14.691935+0000","last_peered":"2023-10-25T16:18:14.691935+0000","last_clean":"2023-10-25T16:18:14.691935+0000","last_became_active":"2023-10-25T16:18:14.688844+0000","last_became_peered":"2023-10-25T16:18:14.688844+0000","last_unstale":"2023-10-25T16:18:14.691935+0000","last_undegraded":"2023-10-25T16:18:14.691935+0000","last_fullsized":"2023-10-25T16:18:14.691935+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:11:38.680241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.684336+0000","last_change":"2023-10-25T16:18:14.684336+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.684336+0000","last_undegraded":"2023-10-25T16:18:14.684336+0000","last_fullsized":"2023-10-25T16:18:14.684336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.689381+0000","last_change":"2023-10-25T16:18:14.687958+0000","last_active":"2023-10-25T16:18:14.689381+0000","last_peered":"2023-10-25T16:18:14.689381+0000","last_clean":"2023-10-25T16:18:14.689381+0000","last_became_active":"2023-10-25T16:18:14.685768+0000","last_became_peered":"2023-10-25T16:18:14.685768+0000","last_unstale":"2023-10-25T16:18:14.689381+0000","last_undegraded":"2023-10-25T16:18:14.689381+0000","last_fullsized":"2023-10-25T16:18:14.689381+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:49.223056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-10-25T16:18:14.671873+0000","last_change":"2023-10-25T16:18:14.671873+0000","last_active":"2023-10-25T16:18:14.654677+0000","last_peered":"2023-10-25T16:18:14.654677+0000","last_clean":"2023-10-25T16:18:14.654677+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:18:14.671873+0000","last_undegraded":"2023-10-25T16:18:14.671873+0000","last_fullsized":"2023-10-25T16:18:14.671873+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-10-25T16:18:14.698634+0000","last_change":"2023-10-25T16:18:14.698466+0000","last_active":"2023-10-25T16:18:14.698634+0000","last_peered":"2023-10-25T16:18:14.698634+0000","last_clean":"2023-10-25T16:18:14.698634+0000","last_became_active":"2023-10-25T16:18:14.697644+0000","last_became_peered":"2023-10-25T16:18:14.697644+0000","last_unstale":"2023-10-25T16:18:14.698634+0000","last_undegraded":"2023-10-25T16:18:14.698634+0000","last_fullsized":"2023-10-25T16:18:14.698634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:58.505243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":102,"state":"active+clean","last_fresh":"2023-10-25T16:18:13.667831+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:18:13.667831+0000","last_peered":"2023-10-25T16:18:13.667831+0000","last_clean":"2023-10-25T16:18:13.667831+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:18:13.667831+0000","last_undegraded":"2023-10-25T16:18:13.667831+0000","last_fullsized":"2023-10-25T16:18:13.667831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:30.918156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542211,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":553,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194759,"statfs":{"total":200000000,"available":199433614,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57799999999999996,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60999999999999999,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.94099999999999995,"5min":1.077,"15min":1.077},"last":0.308}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63100000000000001,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66400000000000003,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.61599999999999999},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.194,"5min":1.345,"15min":1.345},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90100000000000002,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.75800000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.88900000000000001},"min":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.91200000000000003,"15min":0.92900000000000005},"min":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.95299999999999996,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.474,"5min":1.677,"15min":1.677},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.454,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.63800000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.117,"5min":1.256,"15min":1.256},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85699999999999998,"15min":0.82899999999999996},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.534,"15min":1.534},"last":0.92700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.177,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.284,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1659999999999999,"5min":1.27,"15min":1.27},"last":1.089},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":0.97499999999999998},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.222,"5min":1.446,"15min":1.446},"last":0.998},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":0.94299999999999995},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.05}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.878,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0009999999999999,"15min":1.0489999999999999},"min":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.286,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.72199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.196,"5min":1.637,"15min":1.637},"last":0.88200000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":0.85899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.387,"5min":1.669,"15min":1.669},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.109,"5min":1.115,"15min":1.125},"min":{"1min":0.84399999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.286,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.0229999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89200000000000002,"15min":0.88900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.083}]},{"osd":1,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.89100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1890000000000001,"5min":1.302,"15min":1.302},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.296,"5min":1.476,"15min":1.476},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93700000000000006,"15min":0.88900000000000001},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.484,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.177}]},{"osd":4,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.627},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95199999999999996,"15min":0.98799999999999999},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.80600000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.97199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.056,"15min":1.054},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5720000000000001,"5min":1.895,"15min":1.895},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.69799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.139},{"interface":"front","average":{"1min":1.145,"5min":1.0880000000000001,"15min":1.0449999999999999},"min":{"1min":0.66300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0069999999999999,"15min":1.331},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":14.843,"15min":14.843},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.002,"15min":1.458},"min":{"1min":0.54600000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":16.439,"15min":16.439},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.03,"15min":1.393},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.157,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90600000000000003,"15min":0.874},"min":{"1min":0.66700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.92100000000000004,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.012,"5min":0.97999999999999998,"15min":0.96999999999999997},"min":{"1min":0.69399999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3169999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.81200000000000006}]},{"osd":3,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2150000000000001,"15min":1.5029999999999999},"min":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.194,"5min":14.954000000000001,"15min":14.954000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.149,"15min":1.5700000000000001},"min":{"1min":0.60299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.53,"5min":15.904,"15min":15.904},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1240000000000001,"15min":1.595},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1899999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.173,"15min":1.4890000000000001},"min":{"1min":0.91400000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":14.567,"15min":14.567},"last":1.143},{"interface":"front","average":{"1min":1.161,"5min":1.3,"15min":1.6910000000000001},"min":{"1min":0.73499999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5820000000000001,"5min":15.089,"15min":15.089},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.2030000000000001,"15min":1.708},"min":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.24,"5min":17.492000000000001,"15min":17.492000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.212,"5min":1.177,"15min":1.2649999999999999},"min":{"1min":0.96299999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2649999999999999,"5min":1.47,"15min":1.47},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.85299999999999998,"15min":0.81299999999999994},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.278,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.874,"15min":0.82299999999999995},"min":{"1min":0.55200000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.288,"15min":1.288},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.97299999999999998,"15min":0.94299999999999995},"min":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1619999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.095}]},{"osd":2,"last update":"Wed Oct 25 16:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.85499999999999998,"15min":0.83099999999999996},"min":{"1min":0.59099999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.157,"5min":1.419,"15min":1.419},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.86499999999999999},"min":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.242,"5min":1.258,"15min":1.258},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95799999999999996,"15min":0.90900000000000003},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.196,"5min":1.518,"15min":1.518},"last":0.72599999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.169,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.89000000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3180000000000001,"5min":1.431,"15min":1.431},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.64200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2430000000000001,"5min":2.085,"15min":2.085},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.089,"15min":1.071},"min":{"1min":0.69499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.92900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.94799999999999995},"min":{"1min":0.63,"5min":0.5,"15min":0.5},"max":{"1min":1.2609999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.1160000000000001},"min":{"1min":0.96699999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60399999999999998,"15min":0.55200000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.81299999999999994,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.64100000000000001},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.94099999999999995,"5min":1.083,"15min":1.083},"last":0.71399999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.32600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.1779999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73799999999999999,"15min":0.69999999999999996},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.155,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.88600000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.95599999999999996,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.087},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1379999999999999,"5min":1.23,"15min":1.23},"last":1.052},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.206,"5min":1.427,"15min":1.427},"last":0.93400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89800000000000002,"15min":0.92800000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.96299999999999997,"15min":0.93999999999999995},"min":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.22,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1799999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.226,"5min":1.456,"15min":1.456},"last":0.999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1719999999999999,"5min":1.663,"15min":1.663},"last":1.028}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.99299999999999999,"15min":0.96999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.28,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97199999999999998,"15min":0.94699999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.254,"5min":1.389,"15min":1.389},"last":1.1319999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":539,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194772,"statfs":{"total":200000000,"available":199447246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.95399999999999996,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.249,"15min":0.249},"max":{"1min":0.99099999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.157,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.39100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.048,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.375,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1899999999999999,"5min":1.423,"15min":1.423},"last":1.0269999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":0.97299999999999998},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0820000000000001,"5min":12.698,"15min":12.698},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.026},"min":{"1min":0.73099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2310000000000001,"5min":12.721,"15min":12.721},"last":1.23}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2729999999999999,"5min":1.546,"15min":1.546},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.89100000000000001},"min":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.034,"5min":2.206,"15min":2.206},"last":0.94299999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.70899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.298,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.397,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.101,"15min":0.98299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.276,"5min":14.776,"15min":14.776},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1080000000000001,"15min":1.022},"min":{"1min":0.62,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.476,"5min":10.509,"15min":10.509},"last":1.2829999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194196,"statfs":{"total":200000000,"available":198856878,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.69499999999999995},"min":{"1min":0.33100000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.74099999999999999},"min":{"1min":0.39500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.3560000000000001,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.89300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.68400000000000005},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.996,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98899999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.745}]},{"osd":3,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.194,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.407,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.036}]},{"osd":4,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3120000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.71999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6719999999999999,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90100000000000002,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.228,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92200000000000004,"15min":0.95099999999999996},"min":{"1min":0.67100000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.21,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":1.1379999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.278,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.94699999999999995,"15min":0.92200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.387,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.069}]},{"osd":7,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.075,"15min":1.298},"min":{"1min":0.73899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.294,"5min":11.891999999999999,"15min":11.891999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0900000000000001,"15min":1.3149999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4410000000000001,"5min":11.622,"15min":11.622},"last":1.276}]}]}],"pool_statfs":[]}} 2023-10-25T16:18:21.109 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-10-25T16:18:21.108+0000 7f8ddc941640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:18:23.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:18:23.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- 172.21.15.177:0/2220509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa47415b480 msgr2=0x7fa47415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 --2- 172.21.15.177:0/2220509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa47415b480 0x7fa47415c370 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa464009900 tx=0x7fa46401c770 comp rx=0 tx=0).stop 2023-10-25T16:18:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- 172.21.15.177:0/2220509837 shutdown_connections 2023-10-25T16:18:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 --2- 172.21.15.177:0/2220509837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa47406c0f0 0x7fa47415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 --2- 172.21.15.177:0/2220509837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa47415b480 0x7fa47415c370 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- 172.21.15.177:0/2220509837 >> 172.21.15.177:0/2220509837 conn(0x7fa4740b2450 msgr2=0x7fa4740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- 172.21.15.177:0/2220509837 shutdown_connections 2023-10-25T16:18:23.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- 172.21.15.177:0/2220509837 wait complete. 2023-10-25T16:18:23.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 Processor -- start 2023-10-25T16:18:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- start start 2023-10-25T16:18:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa47406c0f0 0x7fa474147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 0x7fa474148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa47415b480 0x7fa474157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741588f0 con 0x7fa4740cb5f0 2023-10-25T16:18:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474147840 con 0x7fa47406c0f0 2023-10-25T16:18:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa474158610 con 0x7fa47415b480 2023-10-25T16:18:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 0x7fa474148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 0x7fa474148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53672/0 (socket says 172.21.15.177:53672) 2023-10-25T16:18:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 -- 172.21.15.177:0/1195739828 learned_addr learned my addr 172.21.15.177:0/1195739828 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa4737fe640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa47406c0f0 0x7fa474147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa473fff640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa47415b480 0x7fa474157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 -- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa47415b480 msgr2=0x7fa474157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa47415b480 0x7fa474157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 -- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa47406c0f0 msgr2=0x7fa474147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa47406c0f0 0x7fa474147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 -- 172.21.15.177:0/1195739828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464009560 con 0x7fa4740cb5f0 2023-10-25T16:18:23.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa472ffd640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 0x7fa474148530 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c550 tx=0x7fa46800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:23.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468005480 con 0x7fa4740cb5f0 2023-10-25T16:18:23.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa468003710 con 0x7fa4740cb5f0 2023-10-25T16:18:23.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468003b20 con 0x7fa4740cb5f0 2023-10-25T16:18:23.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.317+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa474147a50 con 0x7fa4740cb5f0 2023-10-25T16:18:23.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa474148010 con 0x7fa4740cb5f0 2023-10-25T16:18:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4740c9780 con 0x7fa4740cb5f0 2023-10-25T16:18:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa468003c80 con 0x7fa4740cb5f0 2023-10-25T16:18:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa45bfff640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa460066470 0x7fa460068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa468083670 con 0x7fa4740cb5f0 2023-10-25T16:18:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa4737fe640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa460066470 0x7fa460068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.321+0000 7fa4737fe640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa460066470 0x7fa460068930 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa4640af000 tx=0x7fa46401afb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.325+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa468050c40 con 0x7fa4740cb5f0 2023-10-25T16:18:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.477+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa47404daf0 con 0x7fa460066470 2023-10-25T16:18:23.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.497+0000 7fa45bfff640 1 -- 172.21.15.177:0/1195739828 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283952 (secure 0 0 0) 0x7fa47404daf0 con 0x7fa460066470 2023-10-25T16:18:23.501 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:23.503 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:18:23.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.501+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa460066470 msgr2=0x7fa460068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.501+0000 7fa47a211640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa460066470 0x7fa460068930 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa4640af000 tx=0x7fa46401afb0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.501+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 msgr2=0x7fa474148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.501+0000 7fa47a211640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 0x7fa474148530 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa46800c550 tx=0x7fa46800ca10 comp rx=0 tx=0).stop 2023-10-25T16:18:23.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 shutdown_connections 2023-10-25T16:18:23.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa460066470 0x7fa460068930 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa47415b480 0x7fa474157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4740cb5f0 0x7fa474148530 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 --2- 172.21.15.177:0/1195739828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa47406c0f0 0x7fa474147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 >> 172.21.15.177:0/1195739828 conn(0x7fa4740b2450 msgr2=0x7fa47406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 shutdown_connections 2023-10-25T16:18:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.505+0000 7fa47a211640 1 -- 172.21.15.177:0/1195739828 wait complete. 2023-10-25T16:18:23.520 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-10-25T16:18:22.717213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556872,"statfs":{"total":1600000000,"available":1594237612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.006933"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.221814+0000","last_change":"2023-10-25T16:18:15.717573+0000","last_active":"2023-10-25T16:18:17.221814+0000","last_peered":"2023-10-25T16:18:17.221814+0000","last_clean":"2023-10-25T16:18:17.221814+0000","last_became_active":"2023-10-25T16:18:15.715939+0000","last_became_peered":"2023-10-25T16:18:15.715939+0000","last_unstale":"2023-10-25T16:18:17.221814+0000","last_undegraded":"2023-10-25T16:18:17.221814+0000","last_fullsized":"2023-10-25T16:18:17.221814+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:00.696793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.692441+0000","last_change":"2023-10-25T16:18:15.727700+0000","last_active":"2023-10-25T16:18:16.692441+0000","last_peered":"2023-10-25T16:18:16.692441+0000","last_clean":"2023-10-25T16:18:16.692441+0000","last_became_active":"2023-10-25T16:18:15.727408+0000","last_became_peered":"2023-10-25T16:18:15.727408+0000","last_unstale":"2023-10-25T16:18:16.692441+0000","last_undegraded":"2023-10-25T16:18:16.692441+0000","last_fullsized":"2023-10-25T16:18:16.692441+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:38:40.091634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233408+0000","last_change":"2023-10-25T16:18:15.713162+0000","last_active":"2023-10-25T16:18:17.233408+0000","last_peered":"2023-10-25T16:18:17.233408+0000","last_clean":"2023-10-25T16:18:17.233408+0000","last_became_active":"2023-10-25T16:18:15.712518+0000","last_became_peered":"2023-10-25T16:18:15.712518+0000","last_unstale":"2023-10-25T16:18:17.233408+0000","last_undegraded":"2023-10-25T16:18:17.233408+0000","last_fullsized":"2023-10-25T16:18:17.233408+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:52:34.958859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.332906+0000","last_change":"2023-10-25T16:18:15.722650+0000","last_active":"2023-10-25T16:18:18.332906+0000","last_peered":"2023-10-25T16:18:18.332906+0000","last_clean":"2023-10-25T16:18:18.332906+0000","last_became_active":"2023-10-25T16:18:15.721279+0000","last_became_peered":"2023-10-25T16:18:15.721279+0000","last_unstale":"2023-10-25T16:18:18.332906+0000","last_undegraded":"2023-10-25T16:18:18.332906+0000","last_fullsized":"2023-10-25T16:18:18.332906+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:48:28.339860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.335303+0000","last_change":"2023-10-25T16:18:15.718244+0000","last_active":"2023-10-25T16:18:18.335303+0000","last_peered":"2023-10-25T16:18:18.335303+0000","last_clean":"2023-10-25T16:18:18.335303+0000","last_became_active":"2023-10-25T16:18:15.717573+0000","last_became_peered":"2023-10-25T16:18:15.717573+0000","last_unstale":"2023-10-25T16:18:18.335303+0000","last_undegraded":"2023-10-25T16:18:18.335303+0000","last_fullsized":"2023-10-25T16:18:18.335303+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:40.228645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334625+0000","last_change":"2023-10-25T16:18:15.727285+0000","last_active":"2023-10-25T16:18:18.334625+0000","last_peered":"2023-10-25T16:18:18.334625+0000","last_clean":"2023-10-25T16:18:18.334625+0000","last_became_active":"2023-10-25T16:18:15.726734+0000","last_became_peered":"2023-10-25T16:18:15.726734+0000","last_unstale":"2023-10-25T16:18:18.334625+0000","last_undegraded":"2023-10-25T16:18:18.334625+0000","last_fullsized":"2023-10-25T16:18:18.334625+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:26.765127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334328+0000","last_change":"2023-10-25T16:18:15.716087+0000","last_active":"2023-10-25T16:18:18.334328+0000","last_peered":"2023-10-25T16:18:18.334328+0000","last_clean":"2023-10-25T16:18:18.334328+0000","last_became_active":"2023-10-25T16:18:15.715482+0000","last_became_peered":"2023-10-25T16:18:15.715482+0000","last_unstale":"2023-10-25T16:18:18.334328+0000","last_undegraded":"2023-10-25T16:18:18.334328+0000","last_fullsized":"2023-10-25T16:18:18.334328+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:10:05.287925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334330+0000","last_change":"2023-10-25T16:18:15.708479+0000","last_active":"2023-10-25T16:18:18.334330+0000","last_peered":"2023-10-25T16:18:18.334330+0000","last_clean":"2023-10-25T16:18:18.334330+0000","last_became_active":"2023-10-25T16:18:15.707601+0000","last_became_peered":"2023-10-25T16:18:15.707601+0000","last_unstale":"2023-10-25T16:18:18.334330+0000","last_undegraded":"2023-10-25T16:18:18.334330+0000","last_fullsized":"2023-10-25T16:18:18.334330+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:42.315161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334415+0000","last_change":"2023-10-25T16:18:15.702820+0000","last_active":"2023-10-25T16:18:18.334415+0000","last_peered":"2023-10-25T16:18:18.334415+0000","last_clean":"2023-10-25T16:18:18.334415+0000","last_became_active":"2023-10-25T16:18:15.701576+0000","last_became_peered":"2023-10-25T16:18:15.701576+0000","last_unstale":"2023-10-25T16:18:18.334415+0000","last_undegraded":"2023-10-25T16:18:18.334415+0000","last_fullsized":"2023-10-25T16:18:18.334415+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:49:23.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.221901+0000","last_change":"2023-10-25T16:18:15.713868+0000","last_active":"2023-10-25T16:18:17.221901+0000","last_peered":"2023-10-25T16:18:17.221901+0000","last_clean":"2023-10-25T16:18:17.221901+0000","last_became_active":"2023-10-25T16:18:15.711900+0000","last_became_peered":"2023-10-25T16:18:15.711900+0000","last_unstale":"2023-10-25T16:18:17.221901+0000","last_undegraded":"2023-10-25T16:18:17.221901+0000","last_fullsized":"2023-10-25T16:18:17.221901+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:49:23.768921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.692070+0000","last_change":"2023-10-25T16:18:15.709838+0000","last_active":"2023-10-25T16:18:16.692070+0000","last_peered":"2023-10-25T16:18:16.692070+0000","last_clean":"2023-10-25T16:18:16.692070+0000","last_became_active":"2023-10-25T16:18:15.708848+0000","last_became_peered":"2023-10-25T16:18:15.708848+0000","last_unstale":"2023-10-25T16:18:16.692070+0000","last_undegraded":"2023-10-25T16:18:16.692070+0000","last_fullsized":"2023-10-25T16:18:16.692070+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:49.673232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.221909+0000","last_change":"2023-10-25T16:18:15.720188+0000","last_active":"2023-10-25T16:18:17.221909+0000","last_peered":"2023-10-25T16:18:17.221909+0000","last_clean":"2023-10-25T16:18:17.221909+0000","last_became_active":"2023-10-25T16:18:15.719578+0000","last_became_peered":"2023-10-25T16:18:15.719578+0000","last_unstale":"2023-10-25T16:18:17.221909+0000","last_undegraded":"2023-10-25T16:18:17.221909+0000","last_fullsized":"2023-10-25T16:18:17.221909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:08:42.315161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233814+0000","last_change":"2023-10-25T16:18:15.701464+0000","last_active":"2023-10-25T16:18:17.233814+0000","last_peered":"2023-10-25T16:18:17.233814+0000","last_clean":"2023-10-25T16:18:17.233814+0000","last_became_active":"2023-10-25T16:18:15.700864+0000","last_became_peered":"2023-10-25T16:18:15.700864+0000","last_unstale":"2023-10-25T16:18:17.233814+0000","last_undegraded":"2023-10-25T16:18:17.233814+0000","last_fullsized":"2023-10-25T16:18:17.233814+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:45:17.609831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333245+0000","last_change":"2023-10-25T16:18:15.722288+0000","last_active":"2023-10-25T16:18:18.333245+0000","last_peered":"2023-10-25T16:18:18.333245+0000","last_clean":"2023-10-25T16:18:18.333245+0000","last_became_active":"2023-10-25T16:18:15.720465+0000","last_became_peered":"2023-10-25T16:18:15.720465+0000","last_unstale":"2023-10-25T16:18:18.333245+0000","last_undegraded":"2023-10-25T16:18:18.333245+0000","last_fullsized":"2023-10-25T16:18:18.333245+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:55.962824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333836+0000","last_change":"2023-10-25T16:18:15.712239+0000","last_active":"2023-10-25T16:18:18.333836+0000","last_peered":"2023-10-25T16:18:18.333836+0000","last_clean":"2023-10-25T16:18:18.333836+0000","last_became_active":"2023-10-25T16:18:15.711616+0000","last_became_peered":"2023-10-25T16:18:15.711616+0000","last_unstale":"2023-10-25T16:18:18.333836+0000","last_undegraded":"2023-10-25T16:18:18.333836+0000","last_fullsized":"2023-10-25T16:18:18.333836+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:16:41.300662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.335887+0000","last_change":"2023-10-25T16:18:15.719319+0000","last_active":"2023-10-25T16:18:18.335887+0000","last_peered":"2023-10-25T16:18:18.335887+0000","last_clean":"2023-10-25T16:18:18.335887+0000","last_became_active":"2023-10-25T16:18:15.717229+0000","last_became_peered":"2023-10-25T16:18:15.717229+0000","last_unstale":"2023-10-25T16:18:18.335887+0000","last_undegraded":"2023-10-25T16:18:18.335887+0000","last_fullsized":"2023-10-25T16:18:18.335887+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:56:33.272390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.335292+0000","last_change":"2023-10-25T16:18:15.724134+0000","last_active":"2023-10-25T16:18:18.335292+0000","last_peered":"2023-10-25T16:18:18.335292+0000","last_clean":"2023-10-25T16:18:18.335292+0000","last_became_active":"2023-10-25T16:18:15.722642+0000","last_became_peered":"2023-10-25T16:18:15.722642+0000","last_unstale":"2023-10-25T16:18:18.335292+0000","last_undegraded":"2023-10-25T16:18:18.335292+0000","last_fullsized":"2023-10-25T16:18:18.335292+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:21:56.482715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334257+0000","last_change":"2023-10-25T16:18:15.725861+0000","last_active":"2023-10-25T16:18:18.334257+0000","last_peered":"2023-10-25T16:18:18.334257+0000","last_clean":"2023-10-25T16:18:18.334257+0000","last_became_active":"2023-10-25T16:18:15.725444+0000","last_became_peered":"2023-10-25T16:18:15.725444+0000","last_unstale":"2023-10-25T16:18:18.334257+0000","last_undegraded":"2023-10-25T16:18:18.334257+0000","last_fullsized":"2023-10-25T16:18:18.334257+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:51.662181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.690241+0000","last_change":"2023-10-25T16:18:15.713942+0000","last_active":"2023-10-25T16:18:16.690241+0000","last_peered":"2023-10-25T16:18:16.690241+0000","last_clean":"2023-10-25T16:18:16.690241+0000","last_became_active":"2023-10-25T16:18:15.711377+0000","last_became_peered":"2023-10-25T16:18:15.711377+0000","last_unstale":"2023-10-25T16:18:16.690241+0000","last_undegraded":"2023-10-25T16:18:16.690241+0000","last_fullsized":"2023-10-25T16:18:16.690241+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:47:24.520653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334329+0000","last_change":"2023-10-25T16:18:15.716259+0000","last_active":"2023-10-25T16:18:18.334329+0000","last_peered":"2023-10-25T16:18:18.334329+0000","last_clean":"2023-10-25T16:18:18.334329+0000","last_became_active":"2023-10-25T16:18:15.715255+0000","last_became_peered":"2023-10-25T16:18:15.715255+0000","last_unstale":"2023-10-25T16:18:18.334329+0000","last_undegraded":"2023-10-25T16:18:18.334329+0000","last_fullsized":"2023-10-25T16:18:18.334329+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:42:21.565937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333562+0000","last_change":"2023-10-25T16:18:15.723787+0000","last_active":"2023-10-25T16:18:18.333562+0000","last_peered":"2023-10-25T16:18:18.333562+0000","last_clean":"2023-10-25T16:18:18.333562+0000","last_became_active":"2023-10-25T16:18:15.722844+0000","last_became_peered":"2023-10-25T16:18:15.722844+0000","last_unstale":"2023-10-25T16:18:18.333562+0000","last_undegraded":"2023-10-25T16:18:18.333562+0000","last_fullsized":"2023-10-25T16:18:18.333562+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:18:04.160065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.692620+0000","last_change":"2023-10-25T16:18:15.709038+0000","last_active":"2023-10-25T16:18:16.692620+0000","last_peered":"2023-10-25T16:18:16.692620+0000","last_clean":"2023-10-25T16:18:16.692620+0000","last_became_active":"2023-10-25T16:18:15.707575+0000","last_became_peered":"2023-10-25T16:18:15.707575+0000","last_unstale":"2023-10-25T16:18:16.692620+0000","last_undegraded":"2023-10-25T16:18:16.692620+0000","last_fullsized":"2023-10-25T16:18:16.692620+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:13:12.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.222414+0000","last_change":"2023-10-25T16:18:15.714832+0000","last_active":"2023-10-25T16:18:17.222414+0000","last_peered":"2023-10-25T16:18:17.222414+0000","last_clean":"2023-10-25T16:18:17.222414+0000","last_became_active":"2023-10-25T16:18:15.710864+0000","last_became_peered":"2023-10-25T16:18:15.710864+0000","last_unstale":"2023-10-25T16:18:17.222414+0000","last_undegraded":"2023-10-25T16:18:17.222414+0000","last_fullsized":"2023-10-25T16:18:17.222414+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:44.308112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333628+0000","last_change":"2023-10-25T16:18:15.716805+0000","last_active":"2023-10-25T16:18:18.333628+0000","last_peered":"2023-10-25T16:18:18.333628+0000","last_clean":"2023-10-25T16:18:18.333628+0000","last_became_active":"2023-10-25T16:18:15.716162+0000","last_became_peered":"2023-10-25T16:18:15.716162+0000","last_unstale":"2023-10-25T16:18:18.333628+0000","last_undegraded":"2023-10-25T16:18:18.333628+0000","last_fullsized":"2023-10-25T16:18:18.333628+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:50:56.399122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.693517+0000","last_change":"2023-10-25T16:18:15.714895+0000","last_active":"2023-10-25T16:18:16.693517+0000","last_peered":"2023-10-25T16:18:16.693517+0000","last_clean":"2023-10-25T16:18:16.693517+0000","last_became_active":"2023-10-25T16:18:15.714262+0000","last_became_peered":"2023-10-25T16:18:15.714262+0000","last_unstale":"2023-10-25T16:18:16.693517+0000","last_undegraded":"2023-10-25T16:18:16.693517+0000","last_fullsized":"2023-10-25T16:18:16.693517+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:05:00.787183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233577+0000","last_change":"2023-10-25T16:18:15.709515+0000","last_active":"2023-10-25T16:18:17.233577+0000","last_peered":"2023-10-25T16:18:17.233577+0000","last_clean":"2023-10-25T16:18:17.233577+0000","last_became_active":"2023-10-25T16:18:15.708752+0000","last_became_peered":"2023-10-25T16:18:15.708752+0000","last_unstale":"2023-10-25T16:18:17.233577+0000","last_undegraded":"2023-10-25T16:18:17.233577+0000","last_fullsized":"2023-10-25T16:18:17.233577+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:44.407271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.336009+0000","last_change":"2023-10-25T16:18:15.704008+0000","last_active":"2023-10-25T16:18:18.336009+0000","last_peered":"2023-10-25T16:18:18.336009+0000","last_clean":"2023-10-25T16:18:18.336009+0000","last_became_active":"2023-10-25T16:18:15.702907+0000","last_became_peered":"2023-10-25T16:18:15.702907+0000","last_unstale":"2023-10-25T16:18:18.336009+0000","last_undegraded":"2023-10-25T16:18:18.336009+0000","last_fullsized":"2023-10-25T16:18:18.336009+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:23:25.092863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.221654+0000","last_change":"2023-10-25T16:18:15.718031+0000","last_active":"2023-10-25T16:18:17.221654+0000","last_peered":"2023-10-25T16:18:17.221654+0000","last_clean":"2023-10-25T16:18:17.221654+0000","last_became_active":"2023-10-25T16:18:15.715456+0000","last_became_peered":"2023-10-25T16:18:15.715456+0000","last_unstale":"2023-10-25T16:18:17.221654+0000","last_undegraded":"2023-10-25T16:18:17.221654+0000","last_fullsized":"2023-10-25T16:18:17.221654+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:39:48.191425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.691552+0000","last_change":"2023-10-25T16:18:15.704552+0000","last_active":"2023-10-25T16:18:16.691552+0000","last_peered":"2023-10-25T16:18:16.691552+0000","last_clean":"2023-10-25T16:18:16.691552+0000","last_became_active":"2023-10-25T16:18:15.703941+0000","last_became_peered":"2023-10-25T16:18:15.703941+0000","last_unstale":"2023-10-25T16:18:16.691552+0000","last_undegraded":"2023-10-25T16:18:16.691552+0000","last_fullsized":"2023-10-25T16:18:16.691552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:41:35.942816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.693761+0000","last_change":"2023-10-25T16:18:15.717938+0000","last_active":"2023-10-25T16:18:16.693761+0000","last_peered":"2023-10-25T16:18:16.693761+0000","last_clean":"2023-10-25T16:18:16.693761+0000","last_became_active":"2023-10-25T16:18:15.717247+0000","last_became_peered":"2023-10-25T16:18:15.717247+0000","last_unstale":"2023-10-25T16:18:16.693761+0000","last_undegraded":"2023-10-25T16:18:16.693761+0000","last_fullsized":"2023-10-25T16:18:16.693761+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:52.631597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.336329+0000","last_change":"2023-10-25T16:18:15.713339+0000","last_active":"2023-10-25T16:18:18.336329+0000","last_peered":"2023-10-25T16:18:18.336329+0000","last_clean":"2023-10-25T16:18:18.336329+0000","last_became_active":"2023-10-25T16:18:15.708344+0000","last_became_peered":"2023-10-25T16:18:15.708344+0000","last_unstale":"2023-10-25T16:18:18.336329+0000","last_undegraded":"2023-10-25T16:18:18.336329+0000","last_fullsized":"2023-10-25T16:18:18.336329+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:15:51.849026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.222175+0000","last_change":"2023-10-25T16:18:15.731741+0000","last_active":"2023-10-25T16:18:17.222175+0000","last_peered":"2023-10-25T16:18:17.222175+0000","last_clean":"2023-10-25T16:18:17.222175+0000","last_became_active":"2023-10-25T16:18:15.730750+0000","last_became_peered":"2023-10-25T16:18:15.730750+0000","last_unstale":"2023-10-25T16:18:17.222175+0000","last_undegraded":"2023-10-25T16:18:17.222175+0000","last_fullsized":"2023-10-25T16:18:17.222175+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:04:57.904194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334000+0000","last_change":"2023-10-25T16:18:15.716033+0000","last_active":"2023-10-25T16:18:18.334000+0000","last_peered":"2023-10-25T16:18:18.334000+0000","last_clean":"2023-10-25T16:18:18.334000+0000","last_became_active":"2023-10-25T16:18:15.713804+0000","last_became_peered":"2023-10-25T16:18:15.713804+0000","last_unstale":"2023-10-25T16:18:18.334000+0000","last_undegraded":"2023-10-25T16:18:18.334000+0000","last_fullsized":"2023-10-25T16:18:18.334000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:35:17.365889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"104'4","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.741505+0000","last_change":"2023-10-25T16:18:14.693474+0000","last_active":"2023-10-25T16:18:15.741505+0000","last_peered":"2023-10-25T16:18:15.741505+0000","last_clean":"2023-10-25T16:18:15.741505+0000","last_became_active":"2023-10-25T16:18:14.690705+0000","last_became_peered":"2023-10-25T16:18:14.690705+0000","last_unstale":"2023-10-25T16:18:15.741505+0000","last_undegraded":"2023-10-25T16:18:15.741505+0000","last_fullsized":"2023-10-25T16:18:15.741505+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:21:55.473578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.222053+0000","last_change":"2023-10-25T16:18:15.716232+0000","last_active":"2023-10-25T16:18:17.222053+0000","last_peered":"2023-10-25T16:18:17.222053+0000","last_clean":"2023-10-25T16:18:17.222053+0000","last_became_active":"2023-10-25T16:18:15.714183+0000","last_became_peered":"2023-10-25T16:18:15.714183+0000","last_unstale":"2023-10-25T16:18:17.222053+0000","last_undegraded":"2023-10-25T16:18:17.222053+0000","last_fullsized":"2023-10-25T16:18:17.222053+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:26.765127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"104'1","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.737180+0000","last_change":"2023-10-25T16:18:14.678465+0000","last_active":"2023-10-25T16:18:15.737180+0000","last_peered":"2023-10-25T16:18:15.737180+0000","last_clean":"2023-10-25T16:18:15.737180+0000","last_became_active":"2023-10-25T16:18:14.677865+0000","last_became_peered":"2023-10-25T16:18:14.677865+0000","last_unstale":"2023-10-25T16:18:15.737180+0000","last_undegraded":"2023-10-25T16:18:15.737180+0000","last_fullsized":"2023-10-25T16:18:15.737180+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:19:21.072397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.222194+0000","last_change":"2023-10-25T16:18:15.724354+0000","last_active":"2023-10-25T16:18:17.222194+0000","last_peered":"2023-10-25T16:18:17.222194+0000","last_clean":"2023-10-25T16:18:17.222194+0000","last_became_active":"2023-10-25T16:18:15.723688+0000","last_became_peered":"2023-10-25T16:18:15.723688+0000","last_unstale":"2023-10-25T16:18:17.222194+0000","last_undegraded":"2023-10-25T16:18:17.222194+0000","last_fullsized":"2023-10-25T16:18:17.222194+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:48.803622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"104'2","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.739277+0000","last_change":"2023-10-25T16:18:14.689093+0000","last_active":"2023-10-25T16:18:15.739277+0000","last_peered":"2023-10-25T16:18:15.739277+0000","last_clean":"2023-10-25T16:18:15.739277+0000","last_became_active":"2023-10-25T16:18:14.688742+0000","last_became_peered":"2023-10-25T16:18:14.688742+0000","last_unstale":"2023-10-25T16:18:15.739277+0000","last_undegraded":"2023-10-25T16:18:15.739277+0000","last_fullsized":"2023-10-25T16:18:15.739277+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:06:43.876757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233869+0000","last_change":"2023-10-25T16:18:15.721636+0000","last_active":"2023-10-25T16:18:17.233869+0000","last_peered":"2023-10-25T16:18:17.233869+0000","last_clean":"2023-10-25T16:18:17.233869+0000","last_became_active":"2023-10-25T16:18:15.721070+0000","last_became_peered":"2023-10-25T16:18:15.721070+0000","last_unstale":"2023-10-25T16:18:17.233869+0000","last_undegraded":"2023-10-25T16:18:17.233869+0000","last_fullsized":"2023-10-25T16:18:17.233869+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:46:56.517721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"104'2","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.736821+0000","last_change":"2023-10-25T16:18:14.684960+0000","last_active":"2023-10-25T16:18:15.736821+0000","last_peered":"2023-10-25T16:18:15.736821+0000","last_clean":"2023-10-25T16:18:15.736821+0000","last_became_active":"2023-10-25T16:18:14.684527+0000","last_became_peered":"2023-10-25T16:18:14.684527+0000","last_unstale":"2023-10-25T16:18:15.736821+0000","last_undegraded":"2023-10-25T16:18:15.736821+0000","last_fullsized":"2023-10-25T16:18:15.736821+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:01:12.065227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.691990+0000","last_change":"2023-10-25T16:18:15.726091+0000","last_active":"2023-10-25T16:18:16.691990+0000","last_peered":"2023-10-25T16:18:16.691990+0000","last_clean":"2023-10-25T16:18:16.691990+0000","last_became_active":"2023-10-25T16:18:15.725808+0000","last_became_peered":"2023-10-25T16:18:15.725808+0000","last_unstale":"2023-10-25T16:18:16.691990+0000","last_undegraded":"2023-10-25T16:18:16.691990+0000","last_fullsized":"2023-10-25T16:18:16.691990+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:32:30.737159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"104'1","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.738517+0000","last_change":"2023-10-25T16:18:14.687552+0000","last_active":"2023-10-25T16:18:15.738517+0000","last_peered":"2023-10-25T16:18:15.738517+0000","last_clean":"2023-10-25T16:18:15.738517+0000","last_became_active":"2023-10-25T16:18:14.684155+0000","last_became_peered":"2023-10-25T16:18:14.684155+0000","last_unstale":"2023-10-25T16:18:15.738517+0000","last_undegraded":"2023-10-25T16:18:15.738517+0000","last_fullsized":"2023-10-25T16:18:15.738517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:14:50.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.335538+0000","last_change":"2023-10-25T16:18:15.723470+0000","last_active":"2023-10-25T16:18:18.335538+0000","last_peered":"2023-10-25T16:18:18.335538+0000","last_clean":"2023-10-25T16:18:18.335538+0000","last_became_active":"2023-10-25T16:18:15.721665+0000","last_became_peered":"2023-10-25T16:18:15.721665+0000","last_unstale":"2023-10-25T16:18:18.335538+0000","last_undegraded":"2023-10-25T16:18:18.335538+0000","last_fullsized":"2023-10-25T16:18:18.335538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:23:08.736176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"104'1","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.737051+0000","last_change":"2023-10-25T16:18:14.678816+0000","last_active":"2023-10-25T16:18:15.737051+0000","last_peered":"2023-10-25T16:18:15.737051+0000","last_clean":"2023-10-25T16:18:15.737051+0000","last_became_active":"2023-10-25T16:18:14.678249+0000","last_became_peered":"2023-10-25T16:18:14.678249+0000","last_unstale":"2023-10-25T16:18:15.737051+0000","last_undegraded":"2023-10-25T16:18:15.737051+0000","last_fullsized":"2023-10-25T16:18:15.737051+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:49:39.613910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233443+0000","last_change":"2023-10-25T16:18:15.713951+0000","last_active":"2023-10-25T16:18:17.233443+0000","last_peered":"2023-10-25T16:18:17.233443+0000","last_clean":"2023-10-25T16:18:17.233443+0000","last_became_active":"2023-10-25T16:18:15.703391+0000","last_became_peered":"2023-10-25T16:18:15.703391+0000","last_unstale":"2023-10-25T16:18:17.233443+0000","last_undegraded":"2023-10-25T16:18:17.233443+0000","last_fullsized":"2023-10-25T16:18:17.233443+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:58.365155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.696720+0000","last_change":"2023-10-25T16:18:14.685624+0000","last_active":"2023-10-25T16:18:15.696720+0000","last_peered":"2023-10-25T16:18:15.696720+0000","last_clean":"2023-10-25T16:18:15.696720+0000","last_became_active":"2023-10-25T16:18:14.685386+0000","last_became_peered":"2023-10-25T16:18:14.685386+0000","last_unstale":"2023-10-25T16:18:15.696720+0000","last_undegraded":"2023-10-25T16:18:15.696720+0000","last_fullsized":"2023-10-25T16:18:15.696720+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:49:37.832419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333182+0000","last_change":"2023-10-25T16:18:15.700514+0000","last_active":"2023-10-25T16:18:18.333182+0000","last_peered":"2023-10-25T16:18:18.333182+0000","last_clean":"2023-10-25T16:18:18.333182+0000","last_became_active":"2023-10-25T16:18:15.699830+0000","last_became_peered":"2023-10-25T16:18:15.699830+0000","last_unstale":"2023-10-25T16:18:18.333182+0000","last_undegraded":"2023-10-25T16:18:18.333182+0000","last_fullsized":"2023-10-25T16:18:18.333182+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:07:57.469214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.702890+0000","last_change":"2023-10-25T16:18:14.680316+0000","last_active":"2023-10-25T16:18:15.702890+0000","last_peered":"2023-10-25T16:18:15.702890+0000","last_clean":"2023-10-25T16:18:15.702890+0000","last_became_active":"2023-10-25T16:18:14.680086+0000","last_became_peered":"2023-10-25T16:18:14.680086+0000","last_unstale":"2023-10-25T16:18:15.702890+0000","last_undegraded":"2023-10-25T16:18:15.702890+0000","last_fullsized":"2023-10-25T16:18:15.702890+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:57.139077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333120+0000","last_change":"2023-10-25T16:18:15.710764+0000","last_active":"2023-10-25T16:18:18.333120+0000","last_peered":"2023-10-25T16:18:18.333120+0000","last_clean":"2023-10-25T16:18:18.333120+0000","last_became_active":"2023-10-25T16:18:15.710085+0000","last_became_peered":"2023-10-25T16:18:15.710085+0000","last_unstale":"2023-10-25T16:18:18.333120+0000","last_undegraded":"2023-10-25T16:18:18.333120+0000","last_fullsized":"2023-10-25T16:18:18.333120+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:38:09.562685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.706587+0000","last_change":"2023-10-25T16:18:14.683993+0000","last_active":"2023-10-25T16:18:15.706587+0000","last_peered":"2023-10-25T16:18:15.706587+0000","last_clean":"2023-10-25T16:18:15.706587+0000","last_became_active":"2023-10-25T16:18:14.683418+0000","last_became_peered":"2023-10-25T16:18:14.683418+0000","last_unstale":"2023-10-25T16:18:15.706587+0000","last_undegraded":"2023-10-25T16:18:15.706587+0000","last_fullsized":"2023-10-25T16:18:15.706587+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:35:16.356752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334914+0000","last_change":"2023-10-25T16:18:15.727085+0000","last_active":"2023-10-25T16:18:18.334914+0000","last_peered":"2023-10-25T16:18:18.334914+0000","last_clean":"2023-10-25T16:18:18.334914+0000","last_became_active":"2023-10-25T16:18:15.726372+0000","last_became_peered":"2023-10-25T16:18:15.726372+0000","last_unstale":"2023-10-25T16:18:18.334914+0000","last_undegraded":"2023-10-25T16:18:18.334914+0000","last_fullsized":"2023-10-25T16:18:18.334914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:04.758358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.709911+0000","last_change":"2023-10-25T16:18:14.690839+0000","last_active":"2023-10-25T16:18:15.709911+0000","last_peered":"2023-10-25T16:18:15.709911+0000","last_clean":"2023-10-25T16:18:15.709911+0000","last_became_active":"2023-10-25T16:18:14.689717+0000","last_became_peered":"2023-10-25T16:18:14.689717+0000","last_unstale":"2023-10-25T16:18:15.709911+0000","last_undegraded":"2023-10-25T16:18:15.709911+0000","last_fullsized":"2023-10-25T16:18:15.709911+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:56:32.263253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.689731+0000","last_change":"2023-10-25T16:18:15.714309+0000","last_active":"2023-10-25T16:18:16.689731+0000","last_peered":"2023-10-25T16:18:16.689731+0000","last_clean":"2023-10-25T16:18:16.689731+0000","last_became_active":"2023-10-25T16:18:15.712210+0000","last_became_peered":"2023-10-25T16:18:15.712210+0000","last_unstale":"2023-10-25T16:18:16.689731+0000","last_undegraded":"2023-10-25T16:18:16.689731+0000","last_fullsized":"2023-10-25T16:18:16.689731+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:30:34.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"104'3","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.737562+0000","last_change":"2023-10-25T16:18:14.697731+0000","last_active":"2023-10-25T16:18:15.737562+0000","last_peered":"2023-10-25T16:18:15.737562+0000","last_clean":"2023-10-25T16:18:15.737562+0000","last_became_active":"2023-10-25T16:18:14.694148+0000","last_became_peered":"2023-10-25T16:18:14.694148+0000","last_unstale":"2023-10-25T16:18:15.737562+0000","last_undegraded":"2023-10-25T16:18:15.737562+0000","last_fullsized":"2023-10-25T16:18:15.737562+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:23:07.727038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334500+0000","last_change":"2023-10-25T16:18:15.699130+0000","last_active":"2023-10-25T16:18:18.334500+0000","last_peered":"2023-10-25T16:18:18.334500+0000","last_clean":"2023-10-25T16:18:18.334500+0000","last_became_active":"2023-10-25T16:18:15.698378+0000","last_became_peered":"2023-10-25T16:18:15.698378+0000","last_unstale":"2023-10-25T16:18:18.334500+0000","last_undegraded":"2023-10-25T16:18:18.334500+0000","last_fullsized":"2023-10-25T16:18:18.334500+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:18.505775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"104'6","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.742264+0000","last_change":"2023-10-25T16:18:14.683000+0000","last_active":"2023-10-25T16:18:15.742264+0000","last_peered":"2023-10-25T16:18:15.742264+0000","last_clean":"2023-10-25T16:18:15.742264+0000","last_became_active":"2023-10-25T16:18:14.682375+0000","last_became_peered":"2023-10-25T16:18:14.682375+0000","last_unstale":"2023-10-25T16:18:15.742264+0000","last_undegraded":"2023-10-25T16:18:15.742264+0000","last_fullsized":"2023-10-25T16:18:15.742264+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:56:32.263253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.690072+0000","last_change":"2023-10-25T16:18:15.714197+0000","last_active":"2023-10-25T16:18:16.690072+0000","last_peered":"2023-10-25T16:18:16.690072+0000","last_clean":"2023-10-25T16:18:16.690072+0000","last_became_active":"2023-10-25T16:18:15.713459+0000","last_became_peered":"2023-10-25T16:18:15.713459+0000","last_unstale":"2023-10-25T16:18:16.690072+0000","last_undegraded":"2023-10-25T16:18:16.690072+0000","last_fullsized":"2023-10-25T16:18:16.690072+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:28:38.648312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"104'2","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.737431+0000","last_change":"2023-10-25T16:18:14.678520+0000","last_active":"2023-10-25T16:18:15.737431+0000","last_peered":"2023-10-25T16:18:15.737431+0000","last_clean":"2023-10-25T16:18:15.737431+0000","last_became_active":"2023-10-25T16:18:14.678295+0000","last_became_peered":"2023-10-25T16:18:14.678295+0000","last_unstale":"2023-10-25T16:18:15.737431+0000","last_undegraded":"2023-10-25T16:18:15.737431+0000","last_fullsized":"2023-10-25T16:18:15.737431+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:53:43.079166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233660+0000","last_change":"2023-10-25T16:18:15.714415+0000","last_active":"2023-10-25T16:18:17.233660+0000","last_peered":"2023-10-25T16:18:17.233660+0000","last_clean":"2023-10-25T16:18:17.233660+0000","last_became_active":"2023-10-25T16:18:15.710232+0000","last_became_peered":"2023-10-25T16:18:15.710232+0000","last_unstale":"2023-10-25T16:18:17.233660+0000","last_undegraded":"2023-10-25T16:18:17.233660+0000","last_fullsized":"2023-10-25T16:18:17.233660+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:55:02.120818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.693710+0000","last_change":"2023-10-25T16:18:14.684401+0000","last_active":"2023-10-25T16:18:15.693710+0000","last_peered":"2023-10-25T16:18:15.693710+0000","last_clean":"2023-10-25T16:18:15.693710+0000","last_became_active":"2023-10-25T16:18:14.683848+0000","last_became_peered":"2023-10-25T16:18:14.683848+0000","last_unstale":"2023-10-25T16:18:15.693710+0000","last_undegraded":"2023-10-25T16:18:15.693710+0000","last_fullsized":"2023-10-25T16:18:15.693710+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:44.385885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.691670+0000","last_change":"2023-10-25T16:18:15.727072+0000","last_active":"2023-10-25T16:18:16.691670+0000","last_peered":"2023-10-25T16:18:16.691670+0000","last_clean":"2023-10-25T16:18:16.691670+0000","last_became_active":"2023-10-25T16:18:15.726791+0000","last_became_peered":"2023-10-25T16:18:15.726791+0000","last_unstale":"2023-10-25T16:18:16.691670+0000","last_undegraded":"2023-10-25T16:18:16.691670+0000","last_fullsized":"2023-10-25T16:18:16.691670+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:26.406451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.694540+0000","last_change":"2023-10-25T16:18:14.670094+0000","last_active":"2023-10-25T16:18:15.694540+0000","last_peered":"2023-10-25T16:18:15.694540+0000","last_clean":"2023-10-25T16:18:15.694540+0000","last_became_active":"2023-10-25T16:18:14.669490+0000","last_became_peered":"2023-10-25T16:18:14.669490+0000","last_unstale":"2023-10-25T16:18:15.694540+0000","last_undegraded":"2023-10-25T16:18:15.694540+0000","last_fullsized":"2023-10-25T16:18:15.694540+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:26:59.687656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.692793+0000","last_change":"2023-10-25T16:18:15.727603+0000","last_active":"2023-10-25T16:18:16.692793+0000","last_peered":"2023-10-25T16:18:16.692793+0000","last_clean":"2023-10-25T16:18:16.692793+0000","last_became_active":"2023-10-25T16:18:15.727053+0000","last_became_peered":"2023-10-25T16:18:15.727053+0000","last_unstale":"2023-10-25T16:18:16.692793+0000","last_undegraded":"2023-10-25T16:18:16.692793+0000","last_fullsized":"2023-10-25T16:18:16.692793+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:39.178599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"104'8","reported_seq":20,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.738292+0000","last_change":"2023-10-25T16:18:14.677926+0000","last_active":"2023-10-25T16:18:15.738292+0000","last_peered":"2023-10-25T16:18:15.738292+0000","last_clean":"2023-10-25T16:18:15.738292+0000","last_became_active":"2023-10-25T16:18:14.677671+0000","last_became_peered":"2023-10-25T16:18:14.677671+0000","last_unstale":"2023-10-25T16:18:15.738292+0000","last_undegraded":"2023-10-25T16:18:15.738292+0000","last_fullsized":"2023-10-25T16:18:15.738292+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:03:24.604603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.234070+0000","last_change":"2023-10-25T16:18:15.720043+0000","last_active":"2023-10-25T16:18:17.234070+0000","last_peered":"2023-10-25T16:18:17.234070+0000","last_clean":"2023-10-25T16:18:17.234070+0000","last_became_active":"2023-10-25T16:18:15.713292+0000","last_became_peered":"2023-10-25T16:18:15.713292+0000","last_unstale":"2023-10-25T16:18:17.234070+0000","last_undegraded":"2023-10-25T16:18:17.234070+0000","last_fullsized":"2023-10-25T16:18:17.234070+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:45.370334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"104'1","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.736814+0000","last_change":"2023-10-25T16:18:14.695380+0000","last_active":"2023-10-25T16:18:15.736814+0000","last_peered":"2023-10-25T16:18:15.736814+0000","last_clean":"2023-10-25T16:18:15.736814+0000","last_became_active":"2023-10-25T16:18:14.694774+0000","last_became_peered":"2023-10-25T16:18:14.694774+0000","last_unstale":"2023-10-25T16:18:15.736814+0000","last_undegraded":"2023-10-25T16:18:15.736814+0000","last_fullsized":"2023-10-25T16:18:15.736814+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:17.496638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.221330+0000","last_change":"2023-10-25T16:18:15.713240+0000","last_active":"2023-10-25T16:18:17.221330+0000","last_peered":"2023-10-25T16:18:17.221330+0000","last_clean":"2023-10-25T16:18:17.221330+0000","last_became_active":"2023-10-25T16:18:15.710989+0000","last_became_peered":"2023-10-25T16:18:15.710989+0000","last_unstale":"2023-10-25T16:18:17.221330+0000","last_undegraded":"2023-10-25T16:18:17.221330+0000","last_fullsized":"2023-10-25T16:18:17.221330+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:15:51.849026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"104'2","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.738760+0000","last_change":"2023-10-25T16:18:14.681247+0000","last_active":"2023-10-25T16:18:15.738760+0000","last_peered":"2023-10-25T16:18:15.738760+0000","last_clean":"2023-10-25T16:18:15.738760+0000","last_became_active":"2023-10-25T16:18:14.680881+0000","last_became_peered":"2023-10-25T16:18:14.680881+0000","last_unstale":"2023-10-25T16:18:15.738760+0000","last_undegraded":"2023-10-25T16:18:15.738760+0000","last_fullsized":"2023-10-25T16:18:15.738760+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:34:50.572953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.336059+0000","last_change":"2023-10-25T16:18:15.719637+0000","last_active":"2023-10-25T16:18:18.336059+0000","last_peered":"2023-10-25T16:18:18.336059+0000","last_clean":"2023-10-25T16:18:18.336059+0000","last_became_active":"2023-10-25T16:18:15.718583+0000","last_became_peered":"2023-10-25T16:18:15.718583+0000","last_unstale":"2023-10-25T16:18:18.336059+0000","last_undegraded":"2023-10-25T16:18:18.336059+0000","last_fullsized":"2023-10-25T16:18:18.336059+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:44.174399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.695622+0000","last_change":"2023-10-25T16:18:14.676353+0000","last_active":"2023-10-25T16:18:15.695622+0000","last_peered":"2023-10-25T16:18:15.695622+0000","last_clean":"2023-10-25T16:18:15.695622+0000","last_became_active":"2023-10-25T16:18:14.675995+0000","last_became_peered":"2023-10-25T16:18:14.675995+0000","last_unstale":"2023-10-25T16:18:15.695622+0000","last_undegraded":"2023-10-25T16:18:15.695622+0000","last_fullsized":"2023-10-25T16:18:15.695622+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:58.505243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333937+0000","last_change":"2023-10-25T16:18:15.721910+0000","last_active":"2023-10-25T16:18:18.333937+0000","last_peered":"2023-10-25T16:18:18.333937+0000","last_clean":"2023-10-25T16:18:18.333937+0000","last_became_active":"2023-10-25T16:18:15.719630+0000","last_became_peered":"2023-10-25T16:18:15.719630+0000","last_unstale":"2023-10-25T16:18:18.333937+0000","last_undegraded":"2023-10-25T16:18:18.333937+0000","last_fullsized":"2023-10-25T16:18:18.333937+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:57:28.107674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"104'2","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.738815+0000","last_change":"2023-10-25T16:18:14.685953+0000","last_active":"2023-10-25T16:18:15.738815+0000","last_peered":"2023-10-25T16:18:15.738815+0000","last_clean":"2023-10-25T16:18:15.738815+0000","last_became_active":"2023-10-25T16:18:14.685457+0000","last_became_peered":"2023-10-25T16:18:14.685457+0000","last_unstale":"2023-10-25T16:18:15.738815+0000","last_undegraded":"2023-10-25T16:18:15.738815+0000","last_fullsized":"2023-10-25T16:18:15.738815+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:22:48.954604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334699+0000","last_change":"2023-10-25T16:18:15.699118+0000","last_active":"2023-10-25T16:18:18.334699+0000","last_peered":"2023-10-25T16:18:18.334699+0000","last_clean":"2023-10-25T16:18:18.334699+0000","last_became_active":"2023-10-25T16:18:15.698471+0000","last_became_peered":"2023-10-25T16:18:15.698471+0000","last_unstale":"2023-10-25T16:18:18.334699+0000","last_undegraded":"2023-10-25T16:18:18.334699+0000","last_fullsized":"2023-10-25T16:18:18.334699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:04:57.904194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.800782+0000","last_change":"2023-10-25T16:18:14.688534+0000","last_active":"2023-10-25T16:18:16.800782+0000","last_peered":"2023-10-25T16:18:16.800782+0000","last_clean":"2023-10-25T16:18:16.800782+0000","last_became_active":"2023-10-25T16:18:14.688038+0000","last_became_peered":"2023-10-25T16:18:14.688038+0000","last_unstale":"2023-10-25T16:18:16.800782+0000","last_undegraded":"2023-10-25T16:18:16.800782+0000","last_fullsized":"2023-10-25T16:18:16.800782+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:51.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.333689+0000","last_change":"2023-10-25T16:18:15.722331+0000","last_active":"2023-10-25T16:18:18.333689+0000","last_peered":"2023-10-25T16:18:18.333689+0000","last_clean":"2023-10-25T16:18:18.333689+0000","last_became_active":"2023-10-25T16:18:15.721465+0000","last_became_peered":"2023-10-25T16:18:15.721465+0000","last_unstale":"2023-10-25T16:18:18.333689+0000","last_undegraded":"2023-10-25T16:18:18.333689+0000","last_fullsized":"2023-10-25T16:18:18.333689+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:10:03.396574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.800880+0000","last_change":"2023-10-25T16:18:14.688400+0000","last_active":"2023-10-25T16:18:16.800880+0000","last_peered":"2023-10-25T16:18:16.800880+0000","last_clean":"2023-10-25T16:18:16.800880+0000","last_became_active":"2023-10-25T16:18:14.687842+0000","last_became_peered":"2023-10-25T16:18:14.687842+0000","last_unstale":"2023-10-25T16:18:16.800880+0000","last_undegraded":"2023-10-25T16:18:16.800880+0000","last_fullsized":"2023-10-25T16:18:16.800880+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:12:59.340012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.335240+0000","last_change":"2023-10-25T16:18:15.701689+0000","last_active":"2023-10-25T16:18:18.335240+0000","last_peered":"2023-10-25T16:18:18.335240+0000","last_clean":"2023-10-25T16:18:18.335240+0000","last_became_active":"2023-10-25T16:18:15.700745+0000","last_became_peered":"2023-10-25T16:18:15.700745+0000","last_unstale":"2023-10-25T16:18:18.335240+0000","last_undegraded":"2023-10-25T16:18:18.335240+0000","last_fullsized":"2023-10-25T16:18:18.335240+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:44.308112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.694070+0000","last_change":"2023-10-25T16:18:14.684569+0000","last_active":"2023-10-25T16:18:15.694070+0000","last_peered":"2023-10-25T16:18:15.694070+0000","last_clean":"2023-10-25T16:18:15.694070+0000","last_became_active":"2023-10-25T16:18:14.684187+0000","last_became_peered":"2023-10-25T16:18:14.684187+0000","last_unstale":"2023-10-25T16:18:15.694070+0000","last_undegraded":"2023-10-25T16:18:15.694070+0000","last_fullsized":"2023-10-25T16:18:15.694070+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:30:23.693865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334843+0000","last_change":"2023-10-25T16:18:15.697779+0000","last_active":"2023-10-25T16:18:18.334843+0000","last_peered":"2023-10-25T16:18:18.334843+0000","last_clean":"2023-10-25T16:18:18.334843+0000","last_became_active":"2023-10-25T16:18:15.696101+0000","last_became_peered":"2023-10-25T16:18:15.696101+0000","last_unstale":"2023-10-25T16:18:18.334843+0000","last_undegraded":"2023-10-25T16:18:18.334843+0000","last_fullsized":"2023-10-25T16:18:18.334843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:24.547270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"104'2","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.739151+0000","last_change":"2023-10-25T16:18:14.694912+0000","last_active":"2023-10-25T16:18:15.739151+0000","last_peered":"2023-10-25T16:18:15.739151+0000","last_clean":"2023-10-25T16:18:15.739151+0000","last_became_active":"2023-10-25T16:18:14.694664+0000","last_became_peered":"2023-10-25T16:18:14.694664+0000","last_unstale":"2023-10-25T16:18:15.739151+0000","last_undegraded":"2023-10-25T16:18:15.739151+0000","last_fullsized":"2023-10-25T16:18:15.739151+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:07:11.332031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233502+0000","last_change":"2023-10-25T16:18:15.714412+0000","last_active":"2023-10-25T16:18:17.233502+0000","last_peered":"2023-10-25T16:18:17.233502+0000","last_clean":"2023-10-25T16:18:17.233502+0000","last_became_active":"2023-10-25T16:18:15.712727+0000","last_became_peered":"2023-10-25T16:18:15.712727+0000","last_unstale":"2023-10-25T16:18:17.233502+0000","last_undegraded":"2023-10-25T16:18:17.233502+0000","last_fullsized":"2023-10-25T16:18:17.233502+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:04:34.460354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.703969+0000","last_change":"2023-10-25T16:18:14.686451+0000","last_active":"2023-10-25T16:18:15.703969+0000","last_peered":"2023-10-25T16:18:15.703969+0000","last_clean":"2023-10-25T16:18:15.703969+0000","last_became_active":"2023-10-25T16:18:14.685309+0000","last_became_peered":"2023-10-25T16:18:14.685309+0000","last_unstale":"2023-10-25T16:18:15.703969+0000","last_undegraded":"2023-10-25T16:18:15.703969+0000","last_fullsized":"2023-10-25T16:18:15.703969+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:26:02.296922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.222259+0000","last_change":"2023-10-25T16:18:15.721027+0000","last_active":"2023-10-25T16:18:17.222259+0000","last_peered":"2023-10-25T16:18:17.222259+0000","last_clean":"2023-10-25T16:18:17.222259+0000","last_became_active":"2023-10-25T16:18:15.720487+0000","last_became_peered":"2023-10-25T16:18:15.720487+0000","last_unstale":"2023-10-25T16:18:17.222259+0000","last_undegraded":"2023-10-25T16:18:17.222259+0000","last_fullsized":"2023-10-25T16:18:17.222259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:02:04.758358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.708121+0000","last_change":"2023-10-25T16:18:14.692973+0000","last_active":"2023-10-25T16:18:15.708121+0000","last_peered":"2023-10-25T16:18:15.708121+0000","last_clean":"2023-10-25T16:18:15.708121+0000","last_became_active":"2023-10-25T16:18:14.690673+0000","last_became_peered":"2023-10-25T16:18:14.690673+0000","last_unstale":"2023-10-25T16:18:15.708121+0000","last_undegraded":"2023-10-25T16:18:15.708121+0000","last_fullsized":"2023-10-25T16:18:15.708121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:45:39.219507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334367+0000","last_change":"2023-10-25T16:18:15.702655+0000","last_active":"2023-10-25T16:18:18.334367+0000","last_peered":"2023-10-25T16:18:18.334367+0000","last_clean":"2023-10-25T16:18:18.334367+0000","last_became_active":"2023-10-25T16:18:15.701867+0000","last_became_peered":"2023-10-25T16:18:15.701867+0000","last_unstale":"2023-10-25T16:18:18.334367+0000","last_undegraded":"2023-10-25T16:18:18.334367+0000","last_fullsized":"2023-10-25T16:18:18.334367+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:58:54.096139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.706028+0000","last_change":"2023-10-25T16:18:14.688218+0000","last_active":"2023-10-25T16:18:15.706028+0000","last_peered":"2023-10-25T16:18:15.706028+0000","last_clean":"2023-10-25T16:18:15.706028+0000","last_became_active":"2023-10-25T16:18:14.686762+0000","last_became_peered":"2023-10-25T16:18:14.686762+0000","last_unstale":"2023-10-25T16:18:15.706028+0000","last_undegraded":"2023-10-25T16:18:15.706028+0000","last_fullsized":"2023-10-25T16:18:15.706028+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:03:55.696392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:18.334718+0000","last_change":"2023-10-25T16:18:15.703724+0000","last_active":"2023-10-25T16:18:18.334718+0000","last_peered":"2023-10-25T16:18:18.334718+0000","last_clean":"2023-10-25T16:18:18.334718+0000","last_became_active":"2023-10-25T16:18:15.703066+0000","last_became_peered":"2023-10-25T16:18:15.703066+0000","last_unstale":"2023-10-25T16:18:18.334718+0000","last_undegraded":"2023-10-25T16:18:18.334718+0000","last_fullsized":"2023-10-25T16:18:18.334718+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:42:48.803622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.698165+0000","last_change":"2023-10-25T16:18:14.694936+0000","last_active":"2023-10-25T16:18:15.698165+0000","last_peered":"2023-10-25T16:18:15.698165+0000","last_clean":"2023-10-25T16:18:15.698165+0000","last_became_active":"2023-10-25T16:18:14.694778+0000","last_became_peered":"2023-10-25T16:18:14.694778+0000","last_unstale":"2023-10-25T16:18:15.698165+0000","last_undegraded":"2023-10-25T16:18:15.698165+0000","last_fullsized":"2023-10-25T16:18:15.698165+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:43:41.683497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.690410+0000","last_change":"2023-10-25T16:18:15.709537+0000","last_active":"2023-10-25T16:18:16.690410+0000","last_peered":"2023-10-25T16:18:16.690410+0000","last_clean":"2023-10-25T16:18:16.690410+0000","last_became_active":"2023-10-25T16:18:15.708898+0000","last_became_peered":"2023-10-25T16:18:15.708898+0000","last_unstale":"2023-10-25T16:18:16.690410+0000","last_undegraded":"2023-10-25T16:18:16.690410+0000","last_fullsized":"2023-10-25T16:18:16.690410+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:28.845454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.698766+0000","last_change":"2023-10-25T16:18:14.678493+0000","last_active":"2023-10-25T16:18:15.698766+0000","last_peered":"2023-10-25T16:18:15.698766+0000","last_clean":"2023-10-25T16:18:15.698766+0000","last_became_active":"2023-10-25T16:18:14.677877+0000","last_became_peered":"2023-10-25T16:18:14.677877+0000","last_unstale":"2023-10-25T16:18:15.698766+0000","last_undegraded":"2023-10-25T16:18:15.698766+0000","last_fullsized":"2023-10-25T16:18:15.698766+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:41:52.972736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.233554+0000","last_change":"2023-10-25T16:18:15.706238+0000","last_active":"2023-10-25T16:18:17.233554+0000","last_peered":"2023-10-25T16:18:17.233554+0000","last_clean":"2023-10-25T16:18:17.233554+0000","last_became_active":"2023-10-25T16:18:15.705581+0000","last_became_peered":"2023-10-25T16:18:15.705581+0000","last_unstale":"2023-10-25T16:18:17.233554+0000","last_undegraded":"2023-10-25T16:18:17.233554+0000","last_fullsized":"2023-10-25T16:18:17.233554+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:14:08.495587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.710152+0000","last_change":"2023-10-25T16:18:14.691770+0000","last_active":"2023-10-25T16:18:15.710152+0000","last_peered":"2023-10-25T16:18:15.710152+0000","last_clean":"2023-10-25T16:18:15.710152+0000","last_became_active":"2023-10-25T16:18:14.688844+0000","last_became_peered":"2023-10-25T16:18:14.688844+0000","last_unstale":"2023-10-25T16:18:15.710152+0000","last_undegraded":"2023-10-25T16:18:15.710152+0000","last_fullsized":"2023-10-25T16:18:15.710152+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:23:24.083725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:17.222869+0000","last_change":"2023-10-25T16:18:15.728616+0000","last_active":"2023-10-25T16:18:17.222869+0000","last_peered":"2023-10-25T16:18:17.222869+0000","last_clean":"2023-10-25T16:18:17.222869+0000","last_became_active":"2023-10-25T16:18:15.728271+0000","last_became_peered":"2023-10-25T16:18:15.728271+0000","last_unstale":"2023-10-25T16:18:17.222869+0000","last_undegraded":"2023-10-25T16:18:17.222869+0000","last_fullsized":"2023-10-25T16:18:17.222869+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:20:57.331861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.691630+0000","last_change":"2023-10-25T16:18:14.687958+0000","last_active":"2023-10-25T16:18:15.691630+0000","last_peered":"2023-10-25T16:18:15.691630+0000","last_clean":"2023-10-25T16:18:15.691630+0000","last_became_active":"2023-10-25T16:18:14.685768+0000","last_became_peered":"2023-10-25T16:18:14.685768+0000","last_unstale":"2023-10-25T16:18:15.691630+0000","last_undegraded":"2023-10-25T16:18:15.691630+0000","last_fullsized":"2023-10-25T16:18:15.691630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:49:48.700840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-10-25T16:18:16.693036+0000","last_change":"2023-10-25T16:18:15.726016+0000","last_active":"2023-10-25T16:18:16.693036+0000","last_peered":"2023-10-25T16:18:16.693036+0000","last_clean":"2023-10-25T16:18:16.693036+0000","last_became_active":"2023-10-25T16:18:15.708420+0000","last_became_peered":"2023-10-25T16:18:15.708420+0000","last_unstale":"2023-10-25T16:18:16.693036+0000","last_undegraded":"2023-10-25T16:18:16.693036+0000","last_fullsized":"2023-10-25T16:18:16.693036+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:14.654677+0000","last_clean_scrub_stamp":"2023-10-25T16:18:14.654677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:11:21.836078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"104'1","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.740209+0000","last_change":"2023-10-25T16:18:14.698466+0000","last_active":"2023-10-25T16:18:15.740209+0000","last_peered":"2023-10-25T16:18:15.740209+0000","last_clean":"2023-10-25T16:18:15.740209+0000","last_became_active":"2023-10-25T16:18:14.697644+0000","last_became_peered":"2023-10-25T16:18:14.697644+0000","last_unstale":"2023-10-25T16:18:15.740209+0000","last_undegraded":"2023-10-25T16:18:15.740209+0000","last_fullsized":"2023-10-25T16:18:15.740209+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:18:13.645540+0000","last_clean_scrub_stamp":"2023-10-25T16:18:13.645540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:27.836316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-10-25T16:18:15.694979+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:18:15.694979+0000","last_peered":"2023-10-25T16:18:15.694979+0000","last_clean":"2023-10-25T16:18:15.694979+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:18:15.694979+0000","last_undegraded":"2023-10-25T16:18:15.694979+0000","last_fullsized":"2023-10-25T16:18:15.694979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:37:30.918156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542212,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":559,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194753,"statfs":{"total":200000000,"available":199427314,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57799999999999996,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.60999999999999999,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.94099999999999995,"5min":1.077,"15min":1.077},"last":0.89300000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.63100000000000001,"15min":0.57099999999999995},"min":{"1min":0.32300000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.1100000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73099999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.66400000000000003,"15min":0.59599999999999997},"min":{"1min":0.41499999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.69899999999999995,"15min":0.61599999999999999},"min":{"1min":0.35799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.194,"5min":1.345,"15min":1.345},"last":0.84999999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.88500000000000001,"15min":0.81699999999999995},"min":{"1min":0.55500000000000005,"5min":0.438,"15min":0.438},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.032},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90100000000000002,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.0029999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.60499999999999998,"5min":0.504,"15min":0.504},"max":{"1min":1.1519999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.94399999999999995,"15min":0.92800000000000005},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.77600000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.93600000000000005,"15min":0.88900000000000001},"min":{"1min":0.66200000000000003,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.165},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.91200000000000003,"15min":0.92900000000000005},"min":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5409999999999999,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0740000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.95299999999999996,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.474,"5min":1.677,"15min":1.677},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97799999999999998,"15min":0.96099999999999997},"min":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.454,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.1419999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194177,"statfs":{"total":200000000,"available":198837458,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78500000000000003,"15min":0.754},"min":{"1min":0.58699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.117,"5min":1.256,"15min":1.256},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.85699999999999998,"15min":0.82899999999999996},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.171,"5min":1.534,"15min":1.534},"last":0.71499999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.53300000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.177,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93100000000000005,"15min":0.90500000000000003},"min":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.284,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.82199999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.83199999999999996},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1659999999999999,"5min":1.27,"15min":1.27},"last":1.105},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.54700000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.173,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.002}]},{"osd":3,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":0.97499999999999998},"min":{"1min":0.60999999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.222,"5min":1.446,"15min":1.446},"last":1.177},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":0.94299999999999995},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1619999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.2649999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.878,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.0029999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1379999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.3939999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.0009999999999999,"15min":1.0489999999999999},"min":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.286,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.72199999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.196,"5min":1.637,"15min":1.637},"last":1.044}]},{"osd":6,"last update":"Wed Oct 25 16:18:06 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.145},"min":{"1min":0.85899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.387,"5min":1.669,"15min":1.669},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.115,"15min":1.125},"min":{"1min":0.84399999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.286,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.3420000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":559,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194753,"statfs":{"total":200000000,"available":199427202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88700000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.395,"5min":1.397,"15min":1.397},"last":0.875},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.89200000000000002,"15min":0.88900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.113}]},{"osd":1,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.89100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1890000000000001,"5min":1.302,"15min":1.302},"last":1.081},{"interface":"front","average":{"1min":0.996,"5min":0.91800000000000004,"15min":0.90200000000000002},"min":{"1min":0.624,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.95199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.92500000000000004,"15min":0.877},"min":{"1min":0.55000000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.296,"5min":1.476,"15min":1.476},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93700000000000006,"15min":0.88900000000000001},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.0349999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93400000000000005,"15min":0.92200000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0449999999999999,"15min":1.0429999999999999},"min":{"1min":0.77100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.484,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.93700000000000006,"15min":0.95199999999999996},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95199999999999996,"15min":0.98799999999999999},"min":{"1min":0.58399999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82199999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.97199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.056,"15min":1.054},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5720000000000001,"5min":1.895,"15min":1.895},"last":1.004}]},{"osd":7,"last update":"Wed Oct 25 16:18:07 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.0960000000000001,"15min":1.0840000000000001},"min":{"1min":0.69799999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.0880000000000001,"15min":1.0449999999999999},"min":{"1min":0.66300000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.3100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":560,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194752,"statfs":{"total":200000000,"available":199426262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.0069999999999999,"15min":1.331},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":14.843,"15min":14.843},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":1.002,"15min":1.458},"min":{"1min":0.54600000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":16.439,"15min":16.439},"last":0.73899999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.03,"15min":1.393},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.157,"5min":14.630000000000001,"15min":14.630000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90600000000000003,"15min":0.874},"min":{"1min":0.66700000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0760000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.92100000000000004,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.012,"5min":0.97999999999999998,"15min":0.96999999999999997},"min":{"1min":0.69399999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3169999999999999,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":0.98399999999999999,"15min":0.99199999999999999},"min":{"1min":0.69699999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.2150000000000001,"15min":1.5029999999999999},"min":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.194,"5min":14.954000000000001,"15min":14.954000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":1.149,"15min":1.5700000000000001},"min":{"1min":0.60299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.53,"5min":15.904,"15min":15.904},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.1240000000000001,"15min":1.595},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1899999999999999,"5min":17.219999999999999,"15min":17.219999999999999},"last":0.90000000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.173,"15min":1.4890000000000001},"min":{"1min":0.91400000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3720000000000001,"5min":14.567,"15min":14.567},"last":1.171},{"interface":"front","average":{"1min":1.161,"5min":1.3,"15min":1.6910000000000001},"min":{"1min":0.73499999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5820000000000001,"5min":15.089,"15min":15.089},"last":1.1080000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.2030000000000001,"15min":1.708},"min":{"1min":0.64100000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.24,"5min":17.492000000000001,"15min":17.492000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.177,"15min":1.2649999999999999},"min":{"1min":0.96299999999999997,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.444,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":1.1299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":558,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194753,"statfs":{"total":200000000,"available":199427896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.80300000000000005},"min":{"1min":0.55100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2649999999999999,"5min":1.47,"15min":1.47},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.85299999999999998,"15min":0.81299999999999994},"min":{"1min":0.71099999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.278,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.89100000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.874,"15min":0.82299999999999995},"min":{"1min":0.55200000000000005,"5min":0.498,"15min":0.498},"max":{"1min":1.1639999999999999,"5min":1.288,"15min":1.288},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.97299999999999998,"15min":0.94299999999999995},"min":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1619999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.62}]},{"osd":2,"last update":"Wed Oct 25 16:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86599999999999999,"15min":0.83399999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.046,"5min":1.419,"15min":1.419},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.91000000000000003,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95799999999999996,"15min":0.90900000000000003},"min":{"1min":0.74099999999999999,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.84599999999999997,"15min":0.79200000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.196,"5min":1.518,"15min":1.518},"last":0.66000000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95599999999999996},"min":{"1min":0.58699999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.169,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.89000000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3180000000000001,"5min":1.431,"15min":1.431},"last":0.86399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.96899999999999997,"15min":0.98199999999999998},"min":{"1min":0.64200000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2430000000000001,"5min":2.085,"15min":2.085},"last":1.012},{"interface":"front","average":{"1min":1.079,"5min":1.089,"15min":1.071},"min":{"1min":0.69499999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3859999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96499999999999997,"15min":0.94799999999999995},"min":{"1min":0.63,"5min":0.5,"15min":0.5},"max":{"1min":1.2609999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.133,"15min":1.1160000000000001},"min":{"1min":0.96699999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.0960000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":560,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194752,"statfs":{"total":200000000,"available":199426284,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.60399999999999998,"15min":0.55200000000000005},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.81299999999999994,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66300000000000003,"15min":0.64100000000000001},"min":{"1min":0.30199999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.94099999999999995,"5min":1.083,"15min":1.083},"last":0.317}]},{"osd":1,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.32600000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.1779999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.247},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73799999999999999,"15min":0.69999999999999996},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":1.155,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.30299999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68700000000000006,"15min":0.67000000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.95599999999999996,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.69299999999999995},"min":{"1min":0.36599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.28899999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89500000000000002,"15min":0.871},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1379999999999999,"5min":1.23,"15min":1.23},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.206,"5min":1.427,"15min":1.427},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89800000000000002,"15min":0.92800000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2709999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.96299999999999997,"15min":0.93999999999999995},"min":{"1min":0.59899999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.22,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.47499999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.89700000000000002,"15min":0.90100000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.226,"5min":1.456,"15min":1.456},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.96799999999999997,"15min":1.002},"min":{"1min":0.51500000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.1719999999999999,"5min":1.663,"15min":1.663},"last":0.54700000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.99299999999999999,"15min":0.96999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.28,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.97199999999999998,"15min":0.94699999999999995},"min":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.254,"5min":1.389,"15min":1.389},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":558,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194753,"statfs":{"total":200000000,"available":199427702,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.33500000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.95399999999999996,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.379},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.249,"15min":0.249},"max":{"1min":0.99099999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60499999999999998,"15min":0.55600000000000005},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.157,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.39100000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.443}]},{"osd":3,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65900000000000003,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.048,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.375,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1899999999999999,"5min":1.423,"15min":1.423},"last":0.47399999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":1.0389999999999999,"15min":0.97299999999999998},"min":{"1min":0.56299999999999994,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0820000000000001,"5min":12.698,"15min":12.698},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.099,"15min":1.026},"min":{"1min":0.73099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2310000000000001,"5min":12.721,"15min":12.721},"last":0.66700000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93000000000000005,"15min":0.91700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2729999999999999,"5min":1.546,"15min":1.546},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.91400000000000003,"15min":0.89100000000000001},"min":{"1min":0.64600000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.034,"5min":2.206,"15min":2.206},"last":0.749}]},{"osd":6,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.70899999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.298,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.397,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.101,"15min":0.98299999999999998},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.276,"5min":14.776,"15min":14.776},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1080000000000001,"15min":1.022},"min":{"1min":0.62,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.476,"5min":10.509,"15min":10.509},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574915,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194177,"statfs":{"total":200000000,"available":198837494,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60099999999999998,"15min":0.69499999999999995},"min":{"1min":0.33100000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.79700000000000004,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.74099999999999999},"min":{"1min":0.39500000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.3560000000000001,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":0.66200000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61399999999999999,"15min":0.68400000000000005},"min":{"1min":0.30599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.996,"5min":4.2320000000000002,"15min":4.2320000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.98899999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.751,"15min":0.78500000000000003},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.194,"5min":4.1219999999999999,"15min":4.1219999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81899999999999995},"min":{"1min":0.45100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.407,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.58099999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3120000000000001,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.996,"5min":0.90700000000000003,"15min":0.93300000000000005},"min":{"1min":0.71999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6719999999999999,"5min":3.4510000000000001,"15min":3.4510000000000001},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.90100000000000002,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.228,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.92200000000000004,"15min":0.95099999999999996},"min":{"1min":0.67100000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.21,"5min":3.5430000000000001,"15min":3.5430000000000001},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.66000000000000003,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.278,"5min":3.1349999999999998,"15min":3.1349999999999998},"last":1.016},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.94699999999999995,"15min":0.92200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.387,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.747}]},{"osd":7,"last update":"Wed Oct 25 16:18:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.075,"15min":1.298},"min":{"1min":0.73899999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.294,"5min":11.891999999999999,"15min":11.891999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0900000000000001,"15min":1.3149999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4410000000000001,"5min":11.622,"15min":11.622},"last":0.94999999999999996}]}]}],"pool_statfs":[]}} 2023-10-25T16:18:23.527 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:18:23.529 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:18:23.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 -- 172.21.15.177:0/2666028186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f902413c280 msgr2=0x7f902415d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 --2- 172.21.15.177:0/2666028186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f902413c280 0x7f902415d650 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f9020009900 tx=0x7f902001c770 comp rx=0 tx=0).stop 2023-10-25T16:18:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 -- 172.21.15.177:0/2666028186 shutdown_connections 2023-10-25T16:18:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 --2- 172.21.15.177:0/2666028186 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 0x7f90240cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 --2- 172.21.15.177:0/2666028186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f902413c280 0x7f902415d650 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 -- 172.21.15.177:0/2666028186 >> 172.21.15.177:0/2666028186 conn(0x7f902406dc70 msgr2=0x7f902406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 -- 172.21.15.177:0/2666028186 shutdown_connections 2023-10-25T16:18:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.701+0000 7f902b314640 1 -- 172.21.15.177:0/2666028186 wait complete. 2023-10-25T16:18:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 Processor -- start 2023-10-25T16:18:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 -- start start 2023-10-25T16:18:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f902413c280 0x7f902414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 0x7f9024152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 0x7f9024152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9024138750 con 0x7f9024159bb0 2023-10-25T16:18:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902414c520 con 0x7f902413c280 2023-10-25T16:18:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9024149be0 con 0x7f9024159730 2023-10-25T16:18:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 0x7f9024152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 0x7f9024152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53686/0 (socket says 172.21.15.177:53686) 2023-10-25T16:18:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 -- 172.21.15.177:0/278077971 learned_addr learned my addr 172.21.15.177:0/278077971 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90288af640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 0x7f9024152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90290b0640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f902413c280 0x7f902414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 -- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 msgr2=0x7f9024152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 0x7f9024152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 -- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f902413c280 msgr2=0x7f902414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f902413c280 0x7f902414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 -- 172.21.15.177:0/278077971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009560 con 0x7f9024159bb0 2023-10-25T16:18:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90288af640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 0x7f9024152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90290b0640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f902413c280 0x7f902414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f90298b1640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 0x7f9024152b90 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f901c00c770 tx=0x7f901c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c003b80 con 0x7f9024159bb0 2023-10-25T16:18:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f901c003ce0 con 0x7f9024159bb0 2023-10-25T16:18:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00aab0 con 0x7f9024159bb0 2023-10-25T16:18:23.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9024149ec0 con 0x7f9024159bb0 2023-10-25T16:18:23.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.705+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90241389a0 con 0x7f9024159bb0 2023-10-25T16:18:23.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.709+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902414a3e0 con 0x7f9024159bb0 2023-10-25T16:18:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.709+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f901c00ac10 con 0x7f9024159bb0 2023-10-25T16:18:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.709+0000 7f9019ffb640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9008066470 0x7f9008068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.709+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f901c083aa0 con 0x7f9024159bb0 2023-10-25T16:18:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.709+0000 7f90290b0640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9008066470 0x7f9008068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.709+0000 7f90290b0640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9008066470 0x7f9008068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f90200af000 tx=0x7f902001afb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.713+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f901c050fb0 con 0x7f9024159bb0 2023-10-25T16:18:23.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.917+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f902404db20 con 0x7f9024159bb0 2023-10-25T16:18:23.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.921+0000 7f9019ffb640 1 -- 172.21.15.177:0/278077971 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) v1 ==== 190+0+147 (secure 0 0 0) 0x7f901c0545d0 con 0x7f9024159bb0 2023-10-25T16:18:23.921 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:18:23.921 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:18:23.922 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:18:23.922 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:18:23.922 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:18:23.923 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:18:23.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9008066470 msgr2=0x7f9008068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9008066470 0x7f9008068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f90200af000 tx=0x7f902001afb0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 msgr2=0x7f9024152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:23.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 0x7f9024152b90 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f901c00c770 tx=0x7f901c00cc30 comp rx=0 tx=0).stop 2023-10-25T16:18:23.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 shutdown_connections 2023-10-25T16:18:23.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9008066470 0x7f9008068930 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9024159bb0 0x7f9024152b90 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9024159730 0x7f9024152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 --2- 172.21.15.177:0/278077971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f902413c280 0x7f902414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:23.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 >> 172.21.15.177:0/278077971 conn(0x7f902406dc70 msgr2=0x7f902414cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:23.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 shutdown_connections 2023-10-25T16:18:23.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:23.925+0000 7f902b314640 1 -- 172.21.15.177:0/278077971 wait complete. 2023-10-25T16:18:23.942 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:24.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 -- 172.21.15.177:0/2888465095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300d1b30 msgr2=0x7f93300cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 --2- 172.21.15.177:0/2888465095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300d1b30 0x7f93300cc9e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9328009bc0 tx=0x7f932801cab0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 -- 172.21.15.177:0/2888465095 shutdown_connections 2023-10-25T16:18:24.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 --2- 172.21.15.177:0/2888465095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300d1b30 0x7f93300cc9e0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 --2- 172.21.15.177:0/2888465095 >> v2:172.21.15.184:3300/0 conn(0x7f933015b590 0x7f93300b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 -- 172.21.15.177:0/2888465095 >> 172.21.15.177:0/2888465095 conn(0x7f9330065f40 msgr2=0x7f933009a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 -- 172.21.15.177:0/2888465095 shutdown_connections 2023-10-25T16:18:24.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.061+0000 7f9336fc4640 1 -- 172.21.15.177:0/2888465095 wait complete. 2023-10-25T16:18:24.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 Processor -- start 2023-10-25T16:18:24.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- start start 2023-10-25T16:18:24.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 0x7f93300cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93300d1b30 0x7f933014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f933015b590 0x7f93300c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300c9c70 con 0x7f93300b2330 2023-10-25T16:18:24.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9330151050 con 0x7f933015b590 2023-10-25T16:18:24.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300cb570 con 0x7f93300d1b30 2023-10-25T16:18:24.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 0x7f93300cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 0x7f93300cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53704/0 (socket says 172.21.15.177:53704) 2023-10-25T16:18:24.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 -- 172.21.15.177:0/907317064 learned_addr learned my addr 172.21.15.177:0/907317064 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 -- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93300d1b30 msgr2=0x7f933014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93300d1b30 0x7f933014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9335561640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f933015b590 0x7f93300c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 -- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f933015b590 msgr2=0x7f93300c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f933015b590 0x7f93300c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 -- 172.21.15.177:0/907317064 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328009820 con 0x7f93300b2330 2023-10-25T16:18:24.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9334d60640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 0x7f93300cb030 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f93200058d0 tx=0x7f932000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320009c30 con 0x7f93300b2330 2023-10-25T16:18:24.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933006b130 con 0x7f93300b2330 2023-10-25T16:18:24.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9320009e80 con 0x7f93300b2330 2023-10-25T16:18:24.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200106a0 con 0x7f93300b2330 2023-10-25T16:18:24.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933006ab70 con 0x7f93300b2330 2023-10-25T16:18:24.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933004daf0 con 0x7f93300b2330 2023-10-25T16:18:24.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9320010800 con 0x7f93300b2330 2023-10-25T16:18:24.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f932d7fa640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f931c066470 0x7f931c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.065+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93200844a0 con 0x7f93300b2330 2023-10-25T16:18:24.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.069+0000 7f932ffff640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f931c066470 0x7f931c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.069+0000 7f932ffff640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f931c066470 0x7f931c068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f93240011f0 tx=0x7f9324007970 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.073+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93200518a0 con 0x7f93300b2330 2023-10-25T16:18:24.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.253+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93300c4720 con 0x7f93300b2330 2023-10-25T16:18:24.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f932d7fa640 1 -- 172.21.15.177:0/907317064 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f9320054ec0 con 0x7f93300b2330 2023-10-25T16:18:24.255 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:24.255 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:18:24.256 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:18:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f931c066470 msgr2=0x7f931c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f931c066470 0x7f931c068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f93240011f0 tx=0x7f9324007970 comp rx=0 tx=0).stop 2023-10-25T16:18:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 msgr2=0x7f93300cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 0x7f93300cb030 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f93200058d0 tx=0x7f932000dde0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 shutdown_connections 2023-10-25T16:18:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f931c066470 0x7f931c068930 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f933015b590 0x7f93300c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f93300d1b30 0x7f933014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 --2- 172.21.15.177:0/907317064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93300b2330 0x7f93300cb030 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 >> 172.21.15.177:0/907317064 conn(0x7f9330065f40 msgr2=0x7f9330072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 shutdown_connections 2023-10-25T16:18:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.257+0000 7f9336fc4640 1 -- 172.21.15.177:0/907317064 wait complete. 2023-10-25T16:18:24.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:18:15.017330+0000', 'modified': '2023-10-25T16:18:17.078126+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 155378}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_155378': {'gid': 155378, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/583400505', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 583400505}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 583400505}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:18:24.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:18:24.677 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-25T16:18:24.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 -- 172.21.15.177:0/1349888577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd764005190 msgr2=0x7fd76400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 --2- 172.21.15.177:0/1349888577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd764005190 0x7fd76400b990 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c590 tx=0x7fd77001d340 comp rx=0 tx=0).stop 2023-10-25T16:18:24.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 -- 172.21.15.177:0/1349888577 shutdown_connections 2023-10-25T16:18:24.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 --2- 172.21.15.177:0/1349888577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd764005190 0x7fd76400b990 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 -- 172.21.15.177:0/1349888577 >> 172.21.15.177:0/1349888577 conn(0x7fd7780afe20 msgr2=0x7fd7780b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 -- 172.21.15.177:0/1349888577 shutdown_connections 2023-10-25T16:18:24.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 -- 172.21.15.177:0/1349888577 wait complete. 2023-10-25T16:18:24.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 Processor -- start 2023-10-25T16:18:24.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.813+0000 7fd7806ea640 1 -- start start 2023-10-25T16:18:24.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd764005190 0x7fd7781f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7781400b0 0x7fd778069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 0x7fd778069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd778155530 con 0x7fd778140530 2023-10-25T16:18:24.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780cbab0 con 0x7fd7781400b0 2023-10-25T16:18:24.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7780cbd50 con 0x7fd764005190 2023-10-25T16:18:24.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 0x7fd778069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 0x7fd778069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53724/0 (socket says 172.21.15.177:53724) 2023-10-25T16:18:24.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 -- 172.21.15.177:0/3272320440 learned_addr learned my addr 172.21.15.177:0/3272320440 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77e486640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd764005190 0x7fd7781f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77dc85640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7781400b0 0x7fd778069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 -- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd764005190 msgr2=0x7fd7781f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd764005190 0x7fd7781f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 -- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7781400b0 msgr2=0x7fd778069720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7781400b0 0x7fd778069720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 -- 172.21.15.177:0/3272320440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7780cc030 con 0x7fd778140530 2023-10-25T16:18:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77e486640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd764005190 0x7fd7781f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77ec87640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 0x7fd778069c60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd77001d170 tx=0x7fd770001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd76effd640 1 -- 172.21.15.177:0/3272320440 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700b5070 con 0x7fd778140530 2023-10-25T16:18:24.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd76effd640 1 -- 172.21.15.177:0/3272320440 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd770001880 con 0x7fd778140530 2023-10-25T16:18:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7780cc310 con 0x7fd778140530 2023-10-25T16:18:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd76effd640 1 -- 172.21.15.177:0/3272320440 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770003980 con 0x7fd778140530 2023-10-25T16:18:24.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7781f2b30 con 0x7fd778140530 2023-10-25T16:18:24.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd76effd640 1 -- 172.21.15.177:0/3272320440 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7700ab030 con 0x7fd778140530 2023-10-25T16:18:24.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd76effd640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd75c066470 0x7fd75c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd76effd640 1 -- 172.21.15.177:0/3272320440 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd77011cb90 con 0x7fd778140530 2023-10-25T16:18:24.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd77e486640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd75c066470 0x7fd75c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd783834000 1 Processor -- start 2023-10-25T16:18:24.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.817+0000 7fd783834000 1 -- start start 2023-10-25T16:18:24.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77e486640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd75c066470 0x7fd75c068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd77815b9e0 tx=0x7fd7680091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c492191da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c492147a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492148360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491f3ccc0 con 0x55c4921922e0 2023-10-25T16:18:24.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491f9f920 con 0x55c4921919c0 2023-10-25T16:18:24.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c491f9ce50 con 0x55c492147f80 2023-10-25T16:18:24.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c492147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c492147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53738/0 (socket says 172.21.15.177:53738) 2023-10-25T16:18:24.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 -- 172.21.15.177:0/2688428315 learned_addr learned my addr 172.21.15.177:0/2688428315 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77e486640 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c492191da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 -- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 msgr2=0x55c492148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 -- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 msgr2=0x55c492191da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c492191da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 -- 172.21.15.177:0/2688428315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c491c91890 con 0x55c4921922e0 2023-10-25T16:18:24.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:24.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c492147a40 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd774006410 tx=0x7fd7740049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbccc794137c353 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd75bfff640 1 -- 172.21.15.177:0/2688428315 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774011900 con 0x55c4921922e0 2023-10-25T16:18:24.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd75bfff640 1 -- 172.21.15.177:0/2688428315 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd774011b50 con 0x55c4921922e0 2023-10-25T16:18:24.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd75bfff640 1 -- 172.21.15.177:0/2688428315 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740103c0 con 0x55c4921922e0 2023-10-25T16:18:24.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- 172.21.15.177:0/2688428315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 msgr2=0x55c492147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c492147a40 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd774006410 tx=0x7fd7740049e0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- 172.21.15.177:0/2688428315 shutdown_connections 2023-10-25T16:18:24.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c492147a40 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- 172.21.15.177:0/2688428315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c492191da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- 172.21.15.177:0/2688428315 >> 172.21.15.177:0/2688428315 conn(0x55c49213f2f0 msgr2=0x55c492146320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- 172.21.15.177:0/2688428315 shutdown_connections 2023-10-25T16:18:24.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- 172.21.15.177:0/2688428315 wait complete. 2023-10-25T16:18:24.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- start start 2023-10-25T16:18:24.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 Processor -- start 2023-10-25T16:18:24.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492191410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c49214d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c49214d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491f98740 con 0x55c4921922e0 2023-10-25T16:18:24.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491f57d10 con 0x55c4921919c0 2023-10-25T16:18:24.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c491f579b0 con 0x55c492147f80 2023-10-25T16:18:24.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd783834000 10 client.0 _ll_register_callbacks cb 0x55c4921336c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:18:24.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c49214d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c49214d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53742/0 (socket says 172.21.15.177:53742) 2023-10-25T16:18:24.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 -- 172.21.15.177:0/2945691512 learned_addr learned my addr 172.21.15.177:0/2945691512 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 -- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 msgr2=0x55c492191410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77e486640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492191410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492191410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77dc85640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c49214d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 -- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 msgr2=0x55c49214d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c49214d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.821+0000 7fd77ec87640 1 -- 172.21.15.177:0/2945691512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77815ca60 con 0x55c4921922e0 2023-10-25T16:18:24.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd77ec87640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c49214d890 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd7700f5a00 tx=0x7fd7700ee470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba302a4ef7957402 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:18:24.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 1 -- 172.21.15.177:0/2945691512 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700f5f30 con 0x55c4921922e0 2023-10-25T16:18:24.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c491f4c370 con 0x55c4921922e0 2023-10-25T16:18:24.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 1 -- 172.21.15.177:0/2945691512 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7700ea340 con 0x55c4921922e0 2023-10-25T16:18:24.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 1 -- 172.21.15.177:0/2945691512 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7700ea500 con 0x55c4921922e0 2023-10-25T16:18:24.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 10 client.7371 fetch_fsmap learned FSMap version 38 2023-10-25T16:18:24.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55c491f5a460 con 0x55c4921922e0 2023-10-25T16:18:24.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 1 -- 172.21.15.177:0/2945691512 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55c491f4c370 con 0x55c4921922e0 2023-10-25T16:18:24.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 1 -- 172.21.15.177:0/2945691512 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd7700f5aa0 con 0x55c4921922e0 2023-10-25T16:18:24.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 10 client.7371 fetch_fsmap finished waiting for FSMap version 38 2023-10-25T16:18:24.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 10 client.7371 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:18:24.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 20 client.7371 populate_metadata read hostname 'smithi177' 2023-10-25T16:18:24.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c492154440 0x55c4921a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 4 client.7371 mds_command: new command op to 155378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:18:24.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 --> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c491f322d0 con 0x55c492154440 2023-10-25T16:18:24.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd77e486640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c492154440 0x55c4921a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 10 client.7371 ms_handle_connect on v2:172.21.15.184:6835/583400505 2023-10-25T16:18:24.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd77e486640 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c492154440 0x55c4921a3a70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=459cca885af77150 server_cookie=961dd85a2a593f30 in_seq=0 out_seq=0 2023-10-25T16:18:24.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 1 -- 172.21.15.177:0/2945691512 <== mds.0 v2:172.21.15.184:6835/583400505 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c491f322d0 con 0x55c492154440 2023-10-25T16:18:24.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 10 client.7371 handle_command_reply: tid=0 2023-10-25T16:18:24.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 client.7371 shutdown 2023-10-25T16:18:24.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 msgr2=0x55c49214d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c49214d890 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd7700f5a00 tx=0x7fd7700ee470 comp rx=0 tx=0).stop 2023-10-25T16:18:24.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 shutdown_connections 2023-10-25T16:18:24.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c492154440 0x55c4921a3a70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921922e0 0x55c49214d890 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c49214d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 --2- 172.21.15.177:0/2945691512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c492147f80 0x55c492191410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd7597fa640 0 client.7371 ms_handle_reset on v2:172.21.15.184:6835/583400505 2023-10-25T16:18:24.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 >> 172.21.15.177:0/2945691512 conn(0x55c49213f2f0 msgr2=0x55c492146a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 shutdown_connections 2023-10-25T16:18:24.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 1 -- 172.21.15.177:0/2945691512 wait complete. 2023-10-25T16:18:24.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.825+0000 7fd783834000 20 client.7371 trim_cache size 0 max 16384 2023-10-25T16:18:24.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 Processor -- start 2023-10-25T16:18:24.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 -- start start 2023-10-25T16:18:24.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c492147f80 0x55c49218fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 0x55c49218ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 0x55c4921a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491c52940 con 0x55c4921919c0 2023-10-25T16:18:24.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491f9b2a0 con 0x55c492147f80 2023-10-25T16:18:24.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c491f98740 con 0x55c4921922e0 2023-10-25T16:18:24.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 0x55c49218ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 0x55c49218ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53752/0 (socket says 172.21.15.177:53752) 2023-10-25T16:18:24.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 -- 172.21.15.177:0/1503831358 learned_addr learned my addr 172.21.15.177:0/1503831358 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 -- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 msgr2=0x55c4921a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77e486640 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c492147f80 0x55c49218fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 0x55c4921a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 -- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c492147f80 msgr2=0x55c49218fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c492147f80 0x55c49218fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 -- 172.21.15.177:0/1503831358 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c491f40760 con 0x55c4921919c0 2023-10-25T16:18:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.841+0000 7fd77dc85640 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 0x55c49218ff40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd774014000 tx=0x7fd774001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2ab2c271d39118 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd76cff9640 1 -- 172.21.15.177:0/1503831358 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740119c0 con 0x55c4921919c0 2023-10-25T16:18:24.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd76cff9640 1 -- 172.21.15.177:0/1503831358 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd774011c30 con 0x55c4921919c0 2023-10-25T16:18:24.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd76cff9640 1 -- 172.21.15.177:0/1503831358 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774026460 con 0x55c4921919c0 2023-10-25T16:18:24.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/1503831358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 msgr2=0x55c49218ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 0x55c49218ff40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd774014000 tx=0x7fd774001130 comp rx=0 tx=0).stop 2023-10-25T16:18:24.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/1503831358 shutdown_connections 2023-10-25T16:18:24.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 0x55c4921a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c4921919c0 0x55c49218ff40 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- 172.21.15.177:0/1503831358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c492147f80 0x55c49218fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/1503831358 >> 172.21.15.177:0/1503831358 conn(0x55c49213f2f0 msgr2=0x55c492153420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/1503831358 shutdown_connections 2023-10-25T16:18:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/1503831358 wait complete. 2023-10-25T16:18:24.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- start start 2023-10-25T16:18:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 Processor -- start 2023-10-25T16:18:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 0x55c4921a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c4921ace30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 0x55c4921ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49214ad90 con 0x55c492147f80 2023-10-25T16:18:24.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c491f61720 con 0x55c4921919c0 2023-10-25T16:18:24.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c491c921b0 con 0x55c4921922e0 2023-10-25T16:18:24.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 10 client.0 _ll_register_callbacks cb 0x55c491f96ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:18:24.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 0x55c4921a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 0x55c4921a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53768/0 (socket says 172.21.15.177:53768) 2023-10-25T16:18:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 -- 172.21.15.177:0/3882174718 learned_addr learned my addr 172.21.15.177:0/3882174718 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 -- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 msgr2=0x55c4921ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 0x55c4921ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77dc85640 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c4921ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 -- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 msgr2=0x55c4921ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:18:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c4921ace30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 -- 172.21.15.177:0/3882174718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c491c91890 con 0x55c492147f80 2023-10-25T16:18:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77e486640 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 0x55c4921a4ae0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fd768011e70 tx=0x7fd7680046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd63b6ebe5710763 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:24.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd7597fa640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:18:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd7597fa640 1 -- 172.21.15.177:0/3882174718 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768004030 con 0x55c492147f80 2023-10-25T16:18:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd7597fa640 1 -- 172.21.15.177:0/3882174718 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd768018070 con 0x55c492147f80 2023-10-25T16:18:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c49214a6e0 con 0x55c492147f80 2023-10-25T16:18:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd7597fa640 1 -- 172.21.15.177:0/3882174718 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd768004190 con 0x55c492147f80 2023-10-25T16:18:24.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 10 client.7377 fetch_fsmap learned FSMap version 38 2023-10-25T16:18:24.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55c491c91cc0 con 0x55c492147f80 2023-10-25T16:18:24.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd7597fa640 1 -- 172.21.15.177:0/3882174718 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55c49214a6e0 con 0x55c492147f80 2023-10-25T16:18:24.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd7597fa640 1 -- 172.21.15.177:0/3882174718 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd7680042f0 con 0x55c492147f80 2023-10-25T16:18:24.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 10 client.7377 fetch_fsmap finished waiting for FSMap version 38 2023-10-25T16:18:24.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 10 client.7377 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:18:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 20 client.7377 populate_metadata read hostname 'smithi177' 2023-10-25T16:18:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c4921f6290 0x55c4921f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 4 client.7377 mds_command: new command op to 155378 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:18:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 --> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c491f306f0 con 0x55c4921f6290 2023-10-25T16:18:24.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.845+0000 7fd77dc85640 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c4921f6290 0x55c4921f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd77dc85640 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c4921f6290 0x55c4921f8680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94498ea0817b30d server_cookie=e94b5b4fff861690 in_seq=0 out_seq=0 2023-10-25T16:18:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7597fa640 10 client.7377 ms_handle_connect on v2:172.21.15.184:6835/583400505 2023-10-25T16:18:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7597fa640 1 -- 172.21.15.177:0/3882174718 <== mds.0 v2:172.21.15.184:6835/583400505 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55c491f306f0 con 0x55c4921f6290 2023-10-25T16:18:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7597fa640 10 client.7377 handle_command_reply: tid=0 2023-10-25T16:18:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 client.7377 shutdown 2023-10-25T16:18:24.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 msgr2=0x55c4921a4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 0x55c4921a4ae0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fd768011e70 tx=0x7fd7680046d0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 shutdown_connections 2023-10-25T16:18:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c4921922e0 0x55c4921ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c4921919c0 0x55c4921ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.184:6835/583400505,v1:172.21.15.184:6837/583400505] conn(0x55c4921f6290 0x55c4921f8680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 --2- 172.21.15.177:0/3882174718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c492147f80 0x55c4921a4ae0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7597fa640 0 client.7377 ms_handle_reset on v2:172.21.15.184:6835/583400505 2023-10-25T16:18:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 >> 172.21.15.177:0/3882174718 conn(0x55c49213f2f0 msgr2=0x55c49218e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 shutdown_connections 2023-10-25T16:18:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 1 -- 172.21.15.177:0/3882174718 wait complete. 2023-10-25T16:18:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd783834000 20 client.7377 trim_cache size 0 max 16384 2023-10-25T16:18:24.867 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:24.867 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:24.868 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:18:24.868 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 155378, 2023-10-25T16:18:24.868 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:18:24.868 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:18:24.868 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:18:24.869 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1249235629999994, 2023-10-25T16:18:24.869 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 38, 2023-10-25T16:18:24.869 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 105, 2023-10-25T16:18:24.869 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 105, 2023-10-25T16:18:24.869 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 14.341101904 2023-10-25T16:18:24.870 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd75c066470 msgr2=0x7fd75c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd75c066470 0x7fd75c068930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd77815b9e0 tx=0x7fd7680091e0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 msgr2=0x7fd778069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 0x7fd778069c60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd77001d170 tx=0x7fd770001260 comp rx=0 tx=0).stop 2023-10-25T16:18:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 shutdown_connections 2023-10-25T16:18:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd75c066470 0x7fd75c068930 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd778140530 0x7fd778069c60 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7781400b0 0x7fd778069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 --2- 172.21.15.177:0/3272320440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd764005190 0x7fd7781f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 >> 172.21.15.177:0/3272320440 conn(0x7fd7780afe20 msgr2=0x7fd778070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 shutdown_connections 2023-10-25T16:18:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.849+0000 7fd7806ea640 1 -- 172.21.15.177:0/3272320440 wait complete. 2023-10-25T16:18:24.874 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:18:24.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- 172.21.15.177:0/3860404037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140cc9e0 msgr2=0x7f09140cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 --2- 172.21.15.177:0/3860404037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140cc9e0 0x7f09140cce70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f090c009cb0 tx=0x7f090c01ccb0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- 172.21.15.177:0/3860404037 shutdown_connections 2023-10-25T16:18:24.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 --2- 172.21.15.177:0/3860404037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140cc9e0 0x7f09140cce70 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 --2- 172.21.15.177:0/3860404037 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09140d1420 0x7f09140d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- 172.21.15.177:0/3860404037 >> 172.21.15.177:0/3860404037 conn(0x7f0914065f40 msgr2=0x7f091409a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:24.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- 172.21.15.177:0/3860404037 shutdown_connections 2023-10-25T16:18:24.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- 172.21.15.177:0/3860404037 wait complete. 2023-10-25T16:18:24.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 Processor -- start 2023-10-25T16:18:24.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- start start 2023-10-25T16:18:24.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09140cc9e0 0x7f09140c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 0x7f09140c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f091415b590 0x7f091414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:24.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0914158f50 con 0x7f09140d1420 2023-10-25T16:18:24.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140c7c80 con 0x7f09140cc9e0 2023-10-25T16:18:24.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f091987f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0914159160 con 0x7f091415b590 2023-10-25T16:18:24.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 0x7f09140c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 0x7f09140c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53792/0 (socket says 172.21.15.177:53792) 2023-10-25T16:18:24.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 -- 172.21.15.177:0/2342275055 learned_addr learned my addr 172.21.15.177:0/2342275055 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:24.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 -- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f091415b590 msgr2=0x7f091414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f091415b590 0x7f091414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 -- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09140cc9e0 msgr2=0x7f09140c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:24.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f0912ffd640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09140cc9e0 0x7f09140c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:24.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09140cc9e0 0x7f09140c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:24.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f090bfff640 1 -- 172.21.15.177:0/2342275055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0098e0 con 0x7f09140d1420 2023-10-25T16:18:25.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.993+0000 7f0912ffd640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09140cc9e0 0x7f09140c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:25.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f090bfff640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 0x7f09140c5710 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00c970 tx=0x7f08fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:25.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc007bb0 con 0x7f09140d1420 2023-10-25T16:18:25.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f08fc007e20 con 0x7f09140d1420 2023-10-25T16:18:25.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0914159440 con 0x7f09140d1420 2023-10-25T16:18:25.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc005280 con 0x7f09140d1420 2023-10-25T16:18:25.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091414e7c0 con 0x7f09140d1420 2023-10-25T16:18:25.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091414eaa0 con 0x7f09140d1420 2023-10-25T16:18:25.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f08fc0053e0 con 0x7f09140d1420 2023-10-25T16:18:25.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0910ff9640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f08f4066470 0x7f08f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08fc0847c0 con 0x7f09140d1420 2023-10-25T16:18:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0912ffd640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f08f4066470 0x7f08f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:25.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:24.997+0000 7f0912ffd640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f08f4066470 0x7f08f4068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f090400a850 tx=0x7f0904008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:25.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.001+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08fc051c40 con 0x7f09140d1420 2023-10-25T16:18:25.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.181+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f091404daf0 con 0x7f09140d1420 2023-10-25T16:18:25.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f0910ff9640 1 -- 172.21.15.177:0/2342275055 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08fc01d070 con 0x7f09140d1420 2023-10-25T16:18:25.183 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:18:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f08f4066470 msgr2=0x7f08f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f08f4066470 0x7f08f4068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f090400a850 tx=0x7f0904008040 comp rx=0 tx=0).stop 2023-10-25T16:18:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 msgr2=0x7f09140c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:25.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 0x7f09140c5710 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00c970 tx=0x7f08fc00ce30 comp rx=0 tx=0).stop 2023-10-25T16:18:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 shutdown_connections 2023-10-25T16:18:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f08f4066470 0x7f08f4068930 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f091415b590 0x7f091414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09140d1420 0x7f09140c5710 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 --2- 172.21.15.177:0/2342275055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09140cc9e0 0x7f09140c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 >> 172.21.15.177:0/2342275055 conn(0x7f0914065f40 msgr2=0x7f091406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 shutdown_connections 2023-10-25T16:18:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:25.185+0000 7f091987f640 1 -- 172.21.15.177:0/2342275055 wait complete. 2023-10-25T16:18:25.200 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:18:25.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:18:25.202 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:18:25.202 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:18:25.203 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:25.203 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:18:25.203 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:18:25.204 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:18:25.204 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:18:25.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.205 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:18:25.211 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:18:25.212 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:18:25.212 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:18:25.212 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.212 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:18:25.213 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.213 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:18:25.213 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:25.213 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:18:25.213 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:18:25.214 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:25.214 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:18:25.214 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:18:25.214 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:25.215 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:18:25.215 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:25.215 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:18:25.215 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42213sec preferred_lft 42213sec 2023-10-25T16:18:25.215 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:18:25.216 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.216 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:18:25.216 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:25.216 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:18:25.216 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.217 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:18:25.217 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:25.217 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:18:25.217 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.217 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:18:25.218 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.218 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:18:25.218 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:25.218 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:18:25.218 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.219 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:18:25.219 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:25.219 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:18:25.219 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:25.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.220 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:18:25.264 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:18:25.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.266 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:18:25.314 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:18:25.315 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:18:25.315 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:18:25.315 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:18:25.315 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:18:25.315 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:18:25.316 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:18:25.316 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:18:25.316 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:18:25.316 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:18:25.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.317 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:18:25.317 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:18:25.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:18:25.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:18:25.319 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:18:25.319 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:18:25.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.391 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:18:25.439 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:18:25.440 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:18:25.440 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:18:25.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:18:25.495 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:18:25.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:18:25.496 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:25.544 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:18:25.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:18:25.545 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:25.591 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:18:25.641 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:18:25.642 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:18:25.642 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:18:25.642 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:18:25.642 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:18:25.643 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:18:25.643 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:18:25.643 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:18:25.643 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:18:25.643 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:18:25.644 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:18:25.644 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:18:25.644 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:18:25.644 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:18:25.644 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:18:25.645 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:18:25.645 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:18:25.645 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:18:25.646 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:18:25.646 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:18:25.647 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:18:25.647 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:18:25.647 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:18:25.648 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:18:25.648 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:18:25.648 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:18:25.649 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:18:25.649 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:18:25.650 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:18:25.650 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:25.650 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:25.651 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:25.651 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:25.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.653 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:18:25.700 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:18:25.700 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:18:25.744 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:18:25.751 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:18:25.751 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:18:25.751 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:18:25.752 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:18:25.752 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:18:25.752 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:18:25.752 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:18:25.752 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:18:25.753 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:18:25.753 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:18:25.753 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:18:25.753 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:18:25.754 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:18:25.754 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:18:25.754 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:18:25.754 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:18:25.754 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:18:25.755 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:18:25.755 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:18:25.755 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:18:25.755 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:18:25.755 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:18:25.756 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:18:25.756 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:18:25.756 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:18:25.756 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:18:25.756 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:18:25.757 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:18:25.757 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:18:25.757 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:25.757 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:25.757 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:25.758 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:25.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:25.759 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:18:25.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:18:25.825+0000 7fc8b9591580 -1 init, newargv = 0x5610020da0b0 newargc=15 2023-10-25T16:18:25.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[46230]: starting ceph client 2023-10-25T16:18:25.830 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[46230]: starting fuse 2023-10-25T16:18:26.909 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:18:26.918 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:18:26.918 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:18:26.918 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:18:26.918 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:18:26.919 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:18:26.919 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:18:26.919 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:18:26.920 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:18:26.920 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:18:26.920 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:18:26.921 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:18:26.921 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:18:26.921 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:18:26.922 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:18:26.922 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:18:26.922 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:18:26.923 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:18:26.923 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:18:26.923 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:18:26.924 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:18:26.924 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:18:26.925 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:18:26.925 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:18:26.925 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:18:26.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:18:26.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:18:26.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:18:26.926 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:18:26.926 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:18:26.927 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:26.927 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:18:26.927 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:26.927 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:18:26.928 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:26.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:26.929 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:18:26.975 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:18:26.976 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:18:26.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:18:26.977 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:18:26.977 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:18:26.978 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:18:26.978 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:18:26.979 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:18:26.979 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:18:26.979 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:18:26.980 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:18:26.980 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:18:26.980 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:18:26.981 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:18:26.981 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:18:26.982 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:18:26.982 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:18:26.983 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:18:26.983 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:18:26.983 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:18:26.984 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:18:26.985 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:18:26.985 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:18:26.986 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:18:26.986 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:18:26.987 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:18:26.987 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:18:26.988 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:18:26.989 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:18:27.100 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.46230.asok 2023-10-25T16:18:27.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:27.112 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46230.asok 2023-10-25T16:18:27.113 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:27.113 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.46230.asok status 2023-10-25T16:18:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:27.302 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:27.302 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:18:27.303 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:18:27.303 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:18:27.303 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:18:27.303 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:18:27.303 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:18:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "46230", 2023-10-25T16:18:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:18:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:18:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:18:27.304 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7392, 2023-10-25T16:18:27.305 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:18:27.305 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:18:27.305 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:18:27.305 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 7392 2023-10-25T16:18:27.305 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:27.306 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:18:27.306 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:27.306 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:18:27.306 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2850521879 2023-10-25T16:18:27.306 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:27.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:27.307 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:18:27.307 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:27.307 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:18:27.307 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2850521879 2023-10-25T16:18:27.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:27.308 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.7392 192.168.0.1:0/2850521879", 2023-10-25T16:18:27.308 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/2850521879", 2023-10-25T16:18:27.308 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:18:27.308 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 38, 2023-10-25T16:18:27.308 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 105, 2023-10-25T16:18:27.309 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:18:27.309 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:18:27.309 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:18:27.309 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:27.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:27.322 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:27.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:18:27.323 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:27.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:27.374 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:18:27.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:27.381 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:27.381 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:27.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:27.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:27.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:27.438 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:18:27.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 -- 172.21.15.177:0/3652258979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 msgr2=0x7fb850070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 --2- 172.21.15.177:0/3652258979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 0x7fb850070640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb848009bc0 tx=0x7fb84801cb80 comp rx=0 tx=0).stop 2023-10-25T16:18:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 -- 172.21.15.177:0/3652258979 shutdown_connections 2023-10-25T16:18:27.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 --2- 172.21.15.177:0/3652258979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 0x7fb850070640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 --2- 172.21.15.177:0/3652258979 >> v2:172.21.15.184:3300/0 conn(0x7fb850069e30 0x7fb850142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 -- 172.21.15.177:0/3652258979 >> 172.21.15.177:0/3652258979 conn(0x7fb8500ce000 msgr2=0x7fb8500ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:27.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 -- 172.21.15.177:0/3652258979 shutdown_connections 2023-10-25T16:18:27.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.565+0000 7fb855bf2640 1 -- 172.21.15.177:0/3652258979 wait complete. 2023-10-25T16:18:27.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 Processor -- start 2023-10-25T16:18:27.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- start start 2023-10-25T16:18:27.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850069e30 0x7fb850156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:27.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 0x7fb85015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:27.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 0x7fb8500c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:27.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850156d80 con 0x7fb850142130 2023-10-25T16:18:27.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015c860 con 0x7fb850069e30 2023-10-25T16:18:27.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85015c2a0 con 0x7fb850142ba0 2023-10-25T16:18:27.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 0x7fb85015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:27.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 0x7fb85015bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53798/0 (socket says 172.21.15.177:53798) 2023-10-25T16:18:27.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 -- 172.21.15.177:0/1073171090 learned_addr learned my addr 172.21.15.177:0/1073171090 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:27.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84f7fe640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850069e30 0x7fb850156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:27.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84ffff640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 0x7fb8500c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:27.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 -- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 msgr2=0x7fb8500c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:27.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 0x7fb8500c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 -- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850069e30 msgr2=0x7fb850156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:27.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850069e30 0x7fb850156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 -- 172.21.15.177:0/1073171090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440094a0 con 0x7fb850142130 2023-10-25T16:18:27.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb84effd640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 0x7fb85015bba0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb84400ea40 tx=0x7fb84400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:27.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400ce40 con 0x7fb850142130 2023-10-25T16:18:27.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb844004020 con 0x7fb850142130 2023-10-25T16:18:27.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb848009820 con 0x7fb850142130 2023-10-25T16:18:27.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844004430 con 0x7fb850142130 2023-10-25T16:18:27.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb850071980 con 0x7fb850142130 2023-10-25T16:18:27.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.569+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85004daf0 con 0x7fb850142130 2023-10-25T16:18:27.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.573+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb844003600 con 0x7fb850142130 2023-10-25T16:18:27.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.573+0000 7fb837fff640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb83c066470 0x7fb83c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:27.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.573+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb844014070 con 0x7fb850142130 2023-10-25T16:18:27.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.573+0000 7fb84f7fe640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb83c066470 0x7fb83c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:27.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.573+0000 7fb84f7fe640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb83c066470 0x7fb83c068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb8400046c0 tx=0x7fb840009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:27.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.577+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb844051f00 con 0x7fb850142130 2023-10-25T16:18:27.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb85006a560 con 0x7fb850142130 2023-10-25T16:18:27.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb837fff640 1 -- 172.21.15.177:0/1073171090 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb844055520 con 0x7fb850142130 2023-10-25T16:18:27.769 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:18:27.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb83c066470 msgr2=0x7fb83c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:27.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb83c066470 0x7fb83c068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb8400046c0 tx=0x7fb840009040 comp rx=0 tx=0).stop 2023-10-25T16:18:27.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 msgr2=0x7fb85015bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:27.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 0x7fb85015bba0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fb84400ea40 tx=0x7fb84400ef00 comp rx=0 tx=0).stop 2023-10-25T16:18:27.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 shutdown_connections 2023-10-25T16:18:27.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb83c066470 0x7fb83c068930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb850142ba0 0x7fb8500c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb850142130 0x7fb85015bba0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 --2- 172.21.15.177:0/1073171090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850069e30 0x7fb850156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:27.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 >> 172.21.15.177:0/1073171090 conn(0x7fb8500ce000 msgr2=0x7fb8500aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:27.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 shutdown_connections 2023-10-25T16:18:27.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:27.769+0000 7fb855bf2640 1 -- 172.21.15.177:0/1073171090 wait complete. 2023-10-25T16:18:27.787 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:18:27.788 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:18:27.788 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:18:27.788 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:18:27.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:27.789 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:18:27.789 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:18:27.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:18:27.790 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:18:27.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:27.791 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:18:27.798 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:18:27.798 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:18:27.799 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:18:27.799 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.799 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:18:27.799 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.799 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:18:27.800 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:27.800 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:18:27.800 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:18:27.800 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:27.800 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:18:27.801 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:18:27.801 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:27.801 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:18:27.801 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:27.801 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:18:27.802 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42191sec preferred_lft 42191sec 2023-10-25T16:18:27.802 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:18:27.802 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.802 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:18:27.802 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:27.803 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:18:27.803 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.803 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:18:27.803 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:18:27.803 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:18:27.804 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.804 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:18:27.804 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.804 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:18:27.804 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:27.804 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:18:27.805 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.805 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:18:27.805 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:27.805 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:18:27.805 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:18:27.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:27.806 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:18:27.853 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:18:27.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:27.855 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:18:27.908 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:18:27.909 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:18:27.909 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:18:27.909 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:18:27.909 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:18:27.909 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:18:27.910 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:18:27.910 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:18:27.910 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:18:27.910 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:18:27.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:27.911 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:18:27.911 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:18:27.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:18:27.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:18:27.913 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:18:27.913 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:18:27.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:27.982 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:18:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:18:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:18:28.030 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:18:28.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:28.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:18:28.086 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:18:28.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:18:28.087 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:28.134 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:18:28.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:18:28.135 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:28.182 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:18:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:18:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:18:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:18:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:18:28.233 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:18:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:18:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:18:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:18:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:18:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:18:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:18:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:18:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:18:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:18:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:18:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:18:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:18:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:18:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:18:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:18:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:18:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:18:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:18:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:18:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:18:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:18:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:18:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:18:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:18:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:28.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:28.241 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:18:28.290 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:18:28.290 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:18:28.335 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:18:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:18:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:18:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:18:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:18:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:18:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:18:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:18:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:18:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:18:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:18:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:18:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:18:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:18:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:18:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:18:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:18:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:18:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:18:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:18:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:18:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:18:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:18:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:18:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:18:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:18:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:18:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:18:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:18:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:18:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:28.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:28.349 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:18:28.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:18:28.416+0000 7f3969781580 -1 init, newargv = 0x55f86d6d25d0 newargc=15 2023-10-25T16:18:28.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34784]: starting ceph client 2023-10-25T16:18:28.421 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34784]: starting fuse 2023-10-25T16:18:29.499 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:18:29.507 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:18:29.507 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:18:29.507 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:18:29.507 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:18:29.507 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:18:29.508 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:18:29.508 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:18:29.508 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:18:29.508 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:18:29.508 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:18:29.509 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:18:29.509 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:18:29.509 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:18:29.509 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:18:29.509 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:18:29.509 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:18:29.510 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:18:29.510 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:18:29.510 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:18:29.510 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:18:29.510 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:18:29.511 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:18:29.511 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:18:29.511 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:18:29.511 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:18:29.511 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:18:29.512 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:18:29.512 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:18:29.512 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:18:29.512 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:29.512 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:18:29.513 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:29.513 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:18:29.513 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:29.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:29.514 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:18:29.562 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:18:29.562 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:18:29.563 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:18:29.563 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:18:29.564 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:18:29.564 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:18:29.564 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:18:29.565 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:18:29.565 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:18:29.566 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:18:29.566 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:18:29.566 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:18:29.567 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:18:29.567 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:18:29.568 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:18:29.569 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:18:29.569 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:18:29.569 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:18:29.570 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:18:29.570 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:18:29.571 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:18:29.571 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:18:29.571 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:18:29.572 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:18:29.572 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:18:29.572 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:18:29.573 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:18:29.573 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:18:29.574 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:18:29.686 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.34784.asok 2023-10-25T16:18:29.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:29.699 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34784.asok 2023-10-25T16:18:29.699 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:29.700 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.34784.asok status 2023-10-25T16:18:29.786 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:29.889 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:18:29.890 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:18:29.890 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:18:29.890 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:18:29.890 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:18:29.891 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:18:29.891 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:18:29.891 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "34784", 2023-10-25T16:18:29.891 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:18:29.891 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:18:29.892 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:18:29.892 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:18:29.892 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 155444, 2023-10-25T16:18:29.892 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:18:29.892 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:18:29.893 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:18:29.893 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 155444 2023-10-25T16:18:29.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:18:29.893 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:18:29.893 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:18:29.893 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:18:29.894 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 3213826427 2023-10-25T16:18:29.894 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:18:29.894 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:18:29.894 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:18:29.894 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:18:29.895 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:18:29.895 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 3213826427 2023-10-25T16:18:29.895 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:18:29.895 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.155444 192.168.0.1:0/3213826427", 2023-10-25T16:18:29.895 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/3213826427", 2023-10-25T16:18:29.896 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:18:29.896 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 38, 2023-10-25T16:18:29.896 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 105, 2023-10-25T16:18:29.896 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:18:29.896 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:18:29.897 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:18:29.897 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:18:29.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:29.909 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:29.909 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:18:29.910 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:29.959 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:29.960 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:18:29.960 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:29.967 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:29.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:29.968 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:30.010 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:30.011 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:30.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- 172.21.15.177:0/1469132386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 msgr2=0x7ff4f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/1469132386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff4f0004c50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff50406f990 tx=0x7ff50001c6d0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- 172.21.15.177:0/1469132386 shutdown_connections 2023-10-25T16:18:30.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/1469132386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff4f0004c50 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- 172.21.15.177:0/1469132386 >> 172.21.15.177:0/1469132386 conn(0x7ff5040b2450 msgr2=0x7ff5040b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- 172.21.15.177:0/1469132386 shutdown_connections 2023-10-25T16:18:30.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- 172.21.15.177:0/1469132386 wait complete. 2023-10-25T16:18:30.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 Processor -- start 2023-10-25T16:18:30.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- start start 2023-10-25T16:18:30.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff5041578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:30.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5041f3000 0x7ff50412e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:30.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5041f3680 0x7ff5040aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:30.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040a7150 con 0x7ff4f00047d0 2023-10-25T16:18:30.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040a6540 con 0x7ff5041f3000 2023-10-25T16:18:30.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50bd1d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040a6820 con 0x7ff5041f3680 2023-10-25T16:18:30.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff5041578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:30.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff5041578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53816/0 (socket says 172.21.15.177:53816) 2023-10-25T16:18:30.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 -- 172.21.15.177:0/3347990110 learned_addr learned my addr 172.21.15.177:0/3347990110 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:30.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff50a2ba640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5041f3680 0x7ff5040aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:30.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff5092b8640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5041f3000 0x7ff50412e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:30.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 -- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5041f3680 msgr2=0x7ff5040aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:30.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5041f3680 0x7ff5040aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 -- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5041f3000 msgr2=0x7ff50412e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:30.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5041f3000 0x7ff50412e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 -- 172.21.15.177:0/3347990110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040a6b00 con 0x7ff4f00047d0 2023-10-25T16:18:30.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.157+0000 7ff509ab9640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff5041578f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4010910 tx=0x7ff4f4010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:30.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f40095f0 con 0x7ff4f00047d0 2023-10-25T16:18:30.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4f400ece0 con 0x7ff4f00047d0 2023-10-25T16:18:30.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5040a6de0 con 0x7ff4f00047d0 2023-10-25T16:18:30.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4004280 con 0x7ff4f00047d0 2023-10-25T16:18:30.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50412ea60 con 0x7ff4f00047d0 2023-10-25T16:18:30.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50404daf0 con 0x7ff4f00047d0 2023-10-25T16:18:30.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4f4003620 con 0x7ff4f00047d0 2023-10-25T16:18:30.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff4fa7fc640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4e8066470 0x7ff4e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:30.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4f4016070 con 0x7ff4f00047d0 2023-10-25T16:18:30.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff5092b8640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4e8066470 0x7ff4e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:30.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.161+0000 7ff5092b8640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4e8066470 0x7ff4e8068930 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff5000ab000 tx=0x7ff5000aa040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:30.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.165+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4f4052020 con 0x7ff4f00047d0 2023-10-25T16:18:30.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.353+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff504070690 con 0x7ff4f00047d0 2023-10-25T16:18:30.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.353+0000 7ff4fa7fc640 1 -- 172.21.15.177:0/3347990110 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7ff4f4055640 con 0x7ff4f00047d0 2023-10-25T16:18:30.354 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:30.354 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:18:30.354 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:18:30.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4e8066470 msgr2=0x7ff4e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:30.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4e8066470 0x7ff4e8068930 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff5000ab000 tx=0x7ff5000aa040 comp rx=0 tx=0).stop 2023-10-25T16:18:30.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 msgr2=0x7ff5041578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:30.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff5041578f0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4010910 tx=0x7ff4f4010dd0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 shutdown_connections 2023-10-25T16:18:30.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4e8066470 0x7ff4e8068930 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5041f3680 0x7ff5040aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5041f3000 0x7ff50412e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 --2- 172.21.15.177:0/3347990110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f00047d0 0x7ff5041578f0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:30.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 >> 172.21.15.177:0/3347990110 conn(0x7ff5040b2450 msgr2=0x7ff504158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:30.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 shutdown_connections 2023-10-25T16:18:30.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:30.357+0000 7ff50bd1d640 1 -- 172.21.15.177:0/3347990110 wait complete. 2023-10-25T16:18:30.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:18:30.517 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155378,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.780884064,"mdsmap_epoch":38,"osdmap_epoch":105,"osdmap_epoch_barrier":105,"uptime":19.997073721} 2023-10-25T16:18:30.517 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155378, "mdsmap_epoch": 38, "osdmap_epoch": 105, "osdmap_epoch_barrier": 105, "rank_uptime": 14.780884064, "state": "up:active", "uptime": 19.997073721, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:18:30.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:18:30.656 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:18:30.657 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:18:30.657 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-10-25T16:18:30.658 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:30.658 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:30.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:30.664 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-10-25T16:18:31.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:18:31.103 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:18:33.294 INFO:teuthology.orchestra.run.smithi177.stderr:265+0 records in 2023-10-25T16:18:33.295 INFO:teuthology.orchestra.run.smithi177.stderr:265+0 records out 2023-10-25T16:18:33.295 INFO:teuthology.orchestra.run.smithi177.stderr:277872640 bytes (278 MB, 265 MiB) copied, 2.57597 s, 108 MB/s 2023-10-25T16:18:33.296 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:33.296 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:33.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:33.304 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-10-25T16:18:35.619 INFO:teuthology.orchestra.run.smithi177.stderr:292+0 records in 2023-10-25T16:18:35.619 INFO:teuthology.orchestra.run.smithi177.stderr:292+0 records out 2023-10-25T16:18:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.26073 s, 135 MB/s 2023-10-25T16:18:35.621 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-25T16:18:35.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:35.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.753+0000 7fce60ba2640 1 -- 172.21.15.177:0/2593918021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c070d30 msgr2=0x7fce5c164120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:35.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.753+0000 7fce60ba2640 1 --2- 172.21.15.177:0/2593918021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c070d30 0x7fce5c164120 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009840 tx=0x7fce4c01c7c0 comp rx=0 tx=0).stop 2023-10-25T16:18:35.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.753+0000 7fce60ba2640 1 -- 172.21.15.177:0/2593918021 shutdown_connections 2023-10-25T16:18:35.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.753+0000 7fce60ba2640 1 --2- 172.21.15.177:0/2593918021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c070d30 0x7fce5c164120 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:35.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- 172.21.15.177:0/2593918021 >> 172.21.15.177:0/2593918021 conn(0x7fce5c06a830 msgr2=0x7fce5c06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:35.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- 172.21.15.177:0/2593918021 shutdown_connections 2023-10-25T16:18:35.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- 172.21.15.177:0/2593918021 wait complete. 2023-10-25T16:18:35.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 Processor -- start 2023-10-25T16:18:35.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- start start 2023-10-25T16:18:35.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c070d30 0x7fce5c1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:35.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c159040 0x7fce5c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:35.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 0x7fce5c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:35.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c155f00 con 0x7fce5c155510 2023-10-25T16:18:35.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c15b750 con 0x7fce5c159040 2023-10-25T16:18:35.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c15ba30 con 0x7fce5c070d30 2023-10-25T16:18:35.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 0x7fce5c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:35.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 0x7fce5c1559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:40048/0 (socket says 172.21.15.177:40048) 2023-10-25T16:18:35.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 -- 172.21.15.177:0/1012701826 learned_addr learned my addr 172.21.15.177:0/1012701826 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:35.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce59d9b640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c159040 0x7fce5c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:35.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 -- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c070d30 msgr2=0x7fce5c1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:35.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5a59c640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c070d30 0x7fce5c1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:35.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c070d30 0x7fce5c1478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:35.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 -- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c159040 msgr2=0x7fce5c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:35.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c159040 0x7fce5c159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:35.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 -- 172.21.15.177:0/1012701826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0094a0 con 0x7fce5c155510 2023-10-25T16:18:35.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce59d9b640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c159040 0x7fce5c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:35.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce5ad9d640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 0x7fce5c1559c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0193d0 tx=0x7fce4c0a57b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:35.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0052f0 con 0x7fce5c155510 2023-10-25T16:18:35.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce4c005540 con 0x7fce5c155510 2023-10-25T16:18:35.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c15bd10 con 0x7fce5c155510 2023-10-25T16:18:35.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0048f0 con 0x7fce5c155510 2023-10-25T16:18:35.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c15c2d0 con 0x7fce5c155510 2023-10-25T16:18:35.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.757+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c15c4c0 con 0x7fce5c155510 2023-10-25T16:18:35.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.761+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce4c0b4040 con 0x7fce5c155510 2023-10-25T16:18:35.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.761+0000 7fce52ffd640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce3c066470 0x7fce3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:35.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.761+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce4c11e010 con 0x7fce5c155510 2023-10-25T16:18:35.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.761+0000 7fce5a59c640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce3c066470 0x7fce3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:35.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.761+0000 7fce5a59c640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce3c066470 0x7fce3c068930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fce54003d60 tx=0x7fce54009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:35.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.765+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce4c0eb400 con 0x7fce5c155510 2023-10-25T16:18:35.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.921+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fce5c04daf0 con 0x7fce5c155510 2023-10-25T16:18:35.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce52ffd640 1 -- 172.21.15.177:0/1012701826 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) v1 ==== 81+0+34111 (secure 0 0 0) 0x7fce4c0b2020 con 0x7fce5c155510 2023-10-25T16:18:35.924 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:35.924 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:35.924 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 106, 2023-10-25T16:18:35.925 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:35.925 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:35.925 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:35.779285+0000", 2023-10-25T16:18:35.925 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:35.925 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:35.926 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:35.926 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:35.926 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:35.926 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:35.926 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:35.927 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:35.927 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:35.927 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:35.927 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:35.927 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:35.927 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:35.928 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:35.928 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:35.928 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:35.928 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:35.928 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:35.929 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:35.929 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:35.929 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:35.929 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:35.929 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.929 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:35.930 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:35.930 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:35.930 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 4097, 2023-10-25T16:18:35.930 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,backfillfull", 2023-10-25T16:18:35.930 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:35.931 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:35.931 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:35.931 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:35.931 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:35.931 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:35.932 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:35.932 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:35.932 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:35.932 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:35.932 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:35.933 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:35.933 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:35.933 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:35.933 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:35.933 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:35.934 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:35.934 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:35.934 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:35.934 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:35.934 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:35.935 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:35.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.935 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "106", 2023-10-25T16:18:35.935 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:35.935 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:35.936 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:35.936 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:35.936 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:35.936 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:35.936 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:35.936 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:35.937 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:35.937 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:35.937 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:35.937 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:35.937 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:35.937 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:35.938 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:35.938 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:35.938 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:35.938 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:35.939 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:35.939 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:35.939 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:35.939 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:35.939 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:35.939 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:35.940 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:35.940 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:35.940 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.940 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:35.940 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:35.940 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:35.941 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:35.941 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:35.941 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:35.941 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:35.941 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:35.942 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:35.942 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:35.942 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:35.942 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:35.942 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:35.943 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:35.943 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.943 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:35.943 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:35.943 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.944 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:35.944 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:35.944 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:35.944 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:35.944 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:35.945 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:35.945 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:35.945 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:35.945 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:35.945 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.947 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.947 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:35.947 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:35.947 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:35.948 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 4097, 2023-10-25T16:18:35.948 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,backfillfull", 2023-10-25T16:18:35.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:35.948 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:35.948 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:35.949 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:35.949 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:35.949 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:35.949 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:35.949 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:35.950 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:35.950 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:35.950 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:35.950 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:35.950 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:35.951 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:35.951 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:35.951 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:35.951 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:35.951 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:35.951 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:35.952 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:35.952 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:35.952 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:35.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.952 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "106", 2023-10-25T16:18:35.953 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:35.953 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:35.953 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:35.953 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:35.953 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:35.954 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:35.954 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:35.954 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:35.954 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:35.954 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:35.955 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:35.955 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:35.955 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:35.955 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:35.955 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:35.956 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:35.956 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:35.956 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:35.956 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:35.956 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:35.957 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:35.957 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:35.957 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:35.957 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:35.957 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:35.957 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:35.958 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.958 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:35.958 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:35.958 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:35.958 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:35.959 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:35.959 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:35.959 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:35.959 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:35.959 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:35.960 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:35.960 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:35.960 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:35.960 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:35.960 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:35.961 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:35.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.961 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:35.961 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:35.961 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:35.961 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.962 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:35.962 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:35.962 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:35.962 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:35.963 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:35.963 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:35.963 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:35.963 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:35.963 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 4097, 2023-10-25T16:18:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,backfillfull", 2023-10-25T16:18:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "106", 2023-10-25T16:18:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:36.009 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.009 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:18:36.009 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.009 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.009 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.010 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:36.010 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:36.010 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:36.011 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:36.011 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:36.011 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:36.011 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:36.011 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:36.011 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:36.012 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:36.012 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:36.012 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:36.012 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:36.012 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.013 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.013 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:36.013 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.014 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.014 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:36.014 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.014 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.014 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.015 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.015 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.015 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.016 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:36.016 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.016 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.017 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:36.017 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.017 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.018 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.018 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.018 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:36.019 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.019 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.019 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:36.019 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.020 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.020 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.020 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.020 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.021 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.021 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:36.021 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.022 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.022 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:36.022 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:36.022 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.022 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.023 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:36.023 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:36.023 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:36.023 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:36.024 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.024 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.024 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.024 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.025 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:36.025 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:36.025 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:36.025 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:36.025 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:36.026 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:36.026 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:36.026 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:36.026 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:36.026 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:36.027 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:36.027 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:36.027 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:36.027 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.027 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.028 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:36.028 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.028 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.029 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:36.029 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.029 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.029 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.030 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.030 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.030 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:36.030 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.031 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.031 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:36.031 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.031 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.032 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.032 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.032 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.033 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.033 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:36.033 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.033 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.034 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:36.034 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.034 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.034 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.035 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.035 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.035 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:36.036 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.036 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.036 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:36.037 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:36.037 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.037 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.037 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:36.037 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:36.038 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:36.038 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:36.038 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.038 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.038 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.039 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.039 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.039 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:36.039 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:36.039 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:36.042 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:36.042 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:36.042 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:36.042 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:36.042 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:36.043 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:36.043 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:36.043 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:36.043 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:36.043 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:36.044 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.044 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.044 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.044 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:36.044 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.044 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.045 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.045 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:36.045 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.045 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.046 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.046 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.046 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.046 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.046 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.046 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.047 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:36.047 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.047 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.048 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:36.048 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.048 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.048 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.048 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.049 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.049 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.049 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:36.049 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.050 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.050 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.050 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.050 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:36.050 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.051 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.051 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.051 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.051 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.051 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.051 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.052 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.052 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:36.052 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.053 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.053 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:36.053 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:36.053 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.053 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.054 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.054 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:36.054 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:36.054 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:36.054 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:36.054 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.055 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.055 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.055 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.055 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.055 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:36.056 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:36.057 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:36.057 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:36.057 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:36.057 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:36.057 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:36.057 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:36.058 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:36.058 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.058 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.058 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.058 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:36.059 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.059 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.059 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.059 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.059 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:36.059 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.060 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.060 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.060 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.060 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.060 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.061 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.061 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.061 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:36.061 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.061 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.061 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.062 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.062 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:36.062 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.062 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.062 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.063 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.063 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.063 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.063 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.064 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:36.064 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.064 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.064 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.064 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.064 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:36.065 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.065 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.065 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.065 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.065 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.066 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.066 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.066 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.066 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:36.066 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:36.067 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.068 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.068 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.068 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:36.068 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:36.068 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:36.069 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:36.069 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.069 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.069 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.069 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.069 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.070 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.070 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:36.070 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:36.070 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:36.070 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:36.071 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:36.071 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:36.071 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:36.071 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:36.071 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:36.072 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:36.072 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:36.072 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:36.072 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:36.072 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.072 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.073 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.073 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:36.073 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.073 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.073 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.074 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.074 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:36.074 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.074 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.074 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.075 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.075 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.075 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.075 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.075 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.076 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:36.076 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.076 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.076 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.076 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.076 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:36.077 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.077 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.077 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.077 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.078 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.078 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.078 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.078 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:36.078 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.078 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.079 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.079 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.079 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:36.079 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.079 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.080 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.080 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.080 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.080 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.080 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.080 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.081 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:36.081 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.081 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.081 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.081 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.082 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:36.082 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:36.082 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.082 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.082 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.083 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:36.083 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:36.083 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:36.083 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:36.083 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.083 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.084 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.084 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.084 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.084 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.084 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:36.085 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:36.085 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:36.085 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:36.085 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:36.085 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:36.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:36.086 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:36.086 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:36.086 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:36.086 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:36.086 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:36.087 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:36.087 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.087 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.087 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.087 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:36.087 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.088 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.088 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.088 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.088 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:36.088 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.089 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.089 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.089 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:36.089 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.089 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.090 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.090 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:36.090 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.090 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.091 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.091 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:36.091 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.091 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.091 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.092 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.092 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:36.092 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.092 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.092 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.093 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:36.094 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.094 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.094 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.094 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.094 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:36.095 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:36.095 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.095 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:36.095 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:36.095 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.095 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.096 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.096 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:36.096 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:36.096 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:36.096 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.097 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.097 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:36.097 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:36.097 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:36.098 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:36.098 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:36.098 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:36.098 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:36.098 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:36.098 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.099 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:36.099 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:36.099 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.099 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:36.099 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.100 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.100 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.100 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.100 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.100 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:36.101 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.101 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.101 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:36.101 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.101 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.102 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.102 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.102 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:36.102 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.103 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.103 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.103 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:36.103 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.103 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.104 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.104 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.104 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.104 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:36.104 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.104 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.105 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.105 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:36.105 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.105 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.105 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.106 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.106 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.106 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:36.106 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.106 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.106 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.107 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:36.107 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.107 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.107 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.107 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.108 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.108 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:36.108 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.108 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.108 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.108 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:36.109 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.109 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.109 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.109 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.109 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.110 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:36.110 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.110 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.110 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:36.110 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.111 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.111 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.111 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.111 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.111 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:36.112 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.112 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:36.112 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:36.112 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:36.113 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:36.113 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:36.113 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:36.113 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:36.113 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:36.113 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:36.114 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.114 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:36.114 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:36.114 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:36.114 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:36.115 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:36.115 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:36.115 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:36.115 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:36.115 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:36.116 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:36.116 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:36.116 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:36.116 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:36.116 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:36.116 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:36.117 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:36.118 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:36.118 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:36.118 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:36.118 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:36.118 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:36.119 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:36.119 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:36.119 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:36.119 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:36.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce3c066470 msgr2=0x7fce3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:36.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce3c066470 0x7fce3c068930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fce54003d60 tx=0x7fce54009040 comp rx=0 tx=0).stop 2023-10-25T16:18:36.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 msgr2=0x7fce5c1559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:36.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 0x7fce5c1559c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0193d0 tx=0x7fce4c0a57b0 comp rx=0 tx=0).stop 2023-10-25T16:18:36.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 shutdown_connections 2023-10-25T16:18:36.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fce3c066470 0x7fce3c068930 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:36.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5c155510 0x7fce5c1559c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:36.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce5c159040 0x7fce5c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:36.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 --2- 172.21.15.177:0/1012701826 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce5c070d30 0x7fce5c1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:36.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 >> 172.21.15.177:0/1012701826 conn(0x7fce5c06a830 msgr2=0x7fce5c070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:36.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 shutdown_connections 2023-10-25T16:18:36.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:35.925+0000 7fce60ba2640 1 -- 172.21.15.177:0/1012701826 wait complete. 2023-10-25T16:18:36.124 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:18:36.790 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:18:36.793+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-10-25T16:18:41.125 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:41.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/236156385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 msgr2=0x7f24d0158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 --2- 172.21.15.177:0/236156385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 0x7f24d0158170 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009c80 tx=0x7f24c801cd80 comp rx=0 tx=0).stop 2023-10-25T16:18:41.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/236156385 shutdown_connections 2023-10-25T16:18:41.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 --2- 172.21.15.177:0/236156385 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 0x7f24d0158170 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 --2- 172.21.15.177:0/236156385 >> v2:172.21.15.184:3300/0 conn(0x7f24d00cbfa0 0x7f24d00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/236156385 >> 172.21.15.177:0/236156385 conn(0x7f24d00b2450 msgr2=0x7f24d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:41.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/236156385 shutdown_connections 2023-10-25T16:18:41.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/236156385 wait complete. 2023-10-25T16:18:41.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 Processor -- start 2023-10-25T16:18:41.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- start start 2023-10-25T16:18:41.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 0x7f24d0153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24d00cbfa0 0x7f24d0144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 0x7f24d01540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0152f40 con 0x7f24d014e810 2023-10-25T16:18:41.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0154610 con 0x7f24d00cbfa0 2023-10-25T16:18:41.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d01f3800 con 0x7f24d00af100 2023-10-25T16:18:41.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 0x7f24d01540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 0x7f24d01540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38696/0 (socket says 172.21.15.177:38696) 2023-10-25T16:18:41.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 -- 172.21.15.177:0/1236717400 learned_addr learned my addr 172.21.15.177:0/1236717400 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:41.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5527640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 0x7f24d0153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d4d26640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24d00cbfa0 0x7f24d0144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 -- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 msgr2=0x7f24d0153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 0x7f24d0153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 -- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24d00cbfa0 msgr2=0x7f24d0144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24d00cbfa0 0x7f24d0144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 -- 172.21.15.177:0/1236717400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80098e0 con 0x7f24d014e810 2023-10-25T16:18:41.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d5d28640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 0x7f24d01540d0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f24c801a9b0 tx=0x7f24c80a59d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:41.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8003d90 con 0x7f24d014e810 2023-10-25T16:18:41.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f24c80a5bc0 con 0x7f24d014e810 2023-10-25T16:18:41.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d01525a0 con 0x7f24d014e810 2023-10-25T16:18:41.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8004290 con 0x7f24d014e810 2023-10-25T16:18:41.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.265+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d0152b60 con 0x7f24d014e810 2023-10-25T16:18:41.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d004daf0 con 0x7f24d014e810 2023-10-25T16:18:41.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24c80b4040 con 0x7f24d014e810 2023-10-25T16:18:41.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24c5ffb640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f24b4066470 0x7f24b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24c811dfb0 con 0x7f24d014e810 2023-10-25T16:18:41.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=111}) v3 -- 0x7f24b406dfa0 con 0x7f24d014e810 2023-10-25T16:18:41.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24d5527640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f24b4066470 0x7f24b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.269+0000 7f24d5527640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f24b4066470 0x7f24b4068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24cc001770 tx=0x7f24cc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:41.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.273+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24c80eb450 con 0x7f24d014e810 2023-10-25T16:18:41.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.425+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f24d01620a0 con 0x7f24d014e810 2023-10-25T16:18:41.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.429+0000 7f24c5ffb640 1 -- 172.21.15.177:0/1236717400 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+34198 (secure 0 0 0) 0x7f24c80b2070 con 0x7f24d014e810 2023-10-25T16:18:41.429 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:41.429 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:41.429 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 110, 2023-10-25T16:18:41.429 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:41.429 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:41.430 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:40.829373+0000", 2023-10-25T16:18:41.430 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:41.430 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:41.430 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:41.431 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:41.431 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:41.431 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:41.431 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:41.431 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:41.431 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:41.432 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:41.432 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:41.432 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:41.432 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:41.432 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:41.433 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:41.433 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:41.433 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:41.433 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:41.433 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:41.434 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:41.434 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:41.434 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:41.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.434 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:41.435 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:41.435 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:41.435 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:41.435 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:41.435 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:41.435 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:41.436 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:41.436 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:41.436 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:41.436 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:41.436 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:41.437 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:41.437 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:41.437 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:41.437 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:41.437 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:41.438 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:41.438 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:41.438 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:41.438 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:41.438 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:41.439 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:41.439 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:41.439 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:41.439 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:41.439 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:41.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.440 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:41.440 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:41.440 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:41.440 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:41.441 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:41.441 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:41.441 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:41.441 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:41.441 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:41.442 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:41.442 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:41.442 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:41.442 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:41.442 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:41.443 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:41.443 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:41.443 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:41.443 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:41.443 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:41.443 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:41.444 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:41.444 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:41.444 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:41.444 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:41.444 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:41.444 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:41.445 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:41.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.445 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:41.445 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:41.445 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:41.446 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:41.446 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:41.446 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:41.446 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:41.446 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:41.447 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:41.447 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:41.447 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:41.447 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:41.447 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:41.448 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:41.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.448 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:41.448 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:41.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.449 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:41.450 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:41.450 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:41.450 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:41.450 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:41.451 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:41.451 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:41.451 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:41.451 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:41.452 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.452 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.452 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:41.452 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:41.452 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:41.453 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:41.453 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:41.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:41.453 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:41.453 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:41.454 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:41.454 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:41.454 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:41.454 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:41.455 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:41.455 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:41.455 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:41.455 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:41.455 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:41.456 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:41.456 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:41.456 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:41.456 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:41.456 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:41.456 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:41.457 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:41.457 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:41.457 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:41.457 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:41.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.458 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:41.458 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:41.458 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:41.458 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:41.458 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:41.459 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:41.459 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:41.459 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:41.459 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:41.459 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:41.460 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:41.460 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:41.460 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:41.460 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:41.460 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:41.461 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:41.461 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:41.461 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:41.461 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:41.461 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:41.462 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:41.462 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:41.462 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:41.462 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:41.462 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:41.463 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:41.463 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:41.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.463 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:41.463 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:41.464 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:41.464 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:41.464 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:41.464 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:41.464 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:41.465 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:41.465 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:41.465 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:41.465 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:41.465 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:41.465 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:41.466 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:41.466 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:41.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.466 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:41.467 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:41.467 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:41.467 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.467 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:41.467 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:41.468 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:41.468 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:41.468 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:41.468 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:41.468 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:41.469 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:41.469 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:41.469 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.470 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:41.470 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:41.470 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:41.470 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:41.470 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:41.471 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:41.471 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:41.471 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:41.471 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:41.471 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:41.472 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:41.472 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:41.472 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:41.472 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:41.472 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:41.473 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:41.473 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:41.473 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:41.473 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:41.473 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:41.473 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:41.474 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:41.474 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:41.474 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:41.474 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:41.474 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:41.475 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:41.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.475 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:41.475 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:41.475 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:41.476 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:41.476 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:41.476 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:41.476 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:41.476 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:41.477 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:41.477 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:41.477 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:41.477 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:41.477 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:41.477 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:41.478 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:41.478 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:41.478 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:41.478 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:41.478 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:41.479 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:41.479 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:41.479 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:41.479 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:41.479 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:41.480 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:41.480 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:41.480 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:41.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.480 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:41.480 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:41.481 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:41.481 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:41.481 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:41.481 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:41.481 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:41.482 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:41.482 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:41.482 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:41.482 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:41.482 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:41.483 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:41.483 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:41.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.483 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:41.483 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:41.483 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:41.484 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.484 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:41.484 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:41.484 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:41.485 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:41.485 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:41.485 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:41.485 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:41.485 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:41.485 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:41.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.486 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:41.486 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:41.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.487 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.488 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.488 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.488 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.488 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.488 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.489 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.489 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.489 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.489 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.489 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:41.490 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.490 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.490 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:41.491 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.491 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.492 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.492 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:41.492 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.493 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:41.493 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.494 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.494 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.494 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.494 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.495 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.495 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:41.495 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.496 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:41.496 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.497 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.497 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.497 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.498 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.498 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:41.498 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.498 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.499 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.499 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:41.499 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:41.499 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.499 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.500 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:41.500 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:41.500 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:41.500 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:41.501 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.501 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.501 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:41.501 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.502 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.502 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:41.502 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.503 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.503 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.503 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.503 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.503 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.504 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.504 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.504 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.504 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.504 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.504 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.505 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.505 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.505 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:41.505 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.506 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.506 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:41.506 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.507 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.507 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.507 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.507 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.508 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.508 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:41.508 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.509 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.509 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:41.509 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.509 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.509 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.510 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.510 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.510 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.511 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:41.511 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.511 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.511 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:41.512 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.512 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.512 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.513 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.513 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.513 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:41.513 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.514 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.514 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:41.514 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:41.515 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.515 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.515 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:41.515 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:41.516 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:41.516 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:41.516 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.516 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.516 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:41.516 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.517 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.517 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:41.517 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.518 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.518 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.518 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.518 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.518 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.519 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.519 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:41.519 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.519 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.519 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.520 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.520 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.520 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.520 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:41.520 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.521 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.521 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:41.521 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.522 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.522 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.522 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.522 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.523 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.523 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:41.523 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.524 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:41.524 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.524 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.524 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.525 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.525 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:41.526 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.526 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:41.527 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.527 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.527 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.528 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.528 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.528 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.528 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:41.529 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.529 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.529 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:41.529 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:41.530 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.530 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.530 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:41.530 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:41.531 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:41.531 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:41.531 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.531 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.531 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:41.532 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.532 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.532 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:41.533 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.533 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.533 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.533 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.533 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.534 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.534 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.534 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.534 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.534 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.534 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.535 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.535 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.535 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:41.537 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.537 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.537 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.537 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.538 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.538 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.538 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:41.538 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.539 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:41.539 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.540 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.540 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.540 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.540 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.541 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.541 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:41.541 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.542 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.542 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:41.542 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.542 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.542 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.543 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.543 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.543 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.544 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:41.544 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.544 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.544 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:41.545 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:41.545 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.545 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.545 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:41.545 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:41.546 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:41.546 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:41.546 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.546 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:41.547 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.548 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.548 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.548 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.548 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.548 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.549 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.549 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.549 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.549 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.549 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.549 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.550 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.550 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.550 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:41.550 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.551 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.551 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.551 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:41.551 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.552 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.552 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.552 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.552 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.553 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.553 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:41.553 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.553 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.554 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:41.554 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.554 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.554 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.555 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.555 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.555 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.555 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:41.556 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.556 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.556 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:41.556 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.557 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.557 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.557 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.557 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.558 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.558 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:41.558 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.559 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.559 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:41.559 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:41.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.560 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:41.560 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:41.561 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.562 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.562 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:41.563 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.563 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.563 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.563 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.563 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.563 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.564 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.565 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.565 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.566 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.566 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.566 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.566 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.566 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.567 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.567 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:41.567 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.568 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.568 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:41.568 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.568 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.568 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.569 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.569 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.569 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.569 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:41.570 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.570 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.570 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:41.571 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.571 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.571 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.572 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.572 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.572 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:41.572 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.573 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.573 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:41.573 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.573 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.574 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.574 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.574 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.574 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.575 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:41.575 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.575 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.575 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.576 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:41.576 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:41.576 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.576 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.577 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:41.577 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:41.577 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:41.577 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:41.577 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.578 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.578 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.578 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.578 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.579 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:41.579 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.579 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.579 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.579 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.580 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.580 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.580 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.580 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.580 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.580 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.581 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.581 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.581 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.581 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.582 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:41.582 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.582 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.583 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:41.583 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.583 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.583 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.584 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.584 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.584 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.584 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:41.585 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.585 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.585 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:41.586 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.586 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.586 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.586 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.587 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.587 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.587 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:41.587 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.588 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.588 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:41.588 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.588 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.589 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.589 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.589 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.589 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.590 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:41.590 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.591 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:41.591 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:41.591 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.591 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.592 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:41.592 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:41.592 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:41.592 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:41.593 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.593 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.593 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:41.593 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.593 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.594 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:41.594 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:41.594 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:41.595 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:41.595 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:41.595 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:41.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:41.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:41.596 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:41.596 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:41.596 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:41.596 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:41.596 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:41.596 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.597 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.597 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:41.597 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.598 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.598 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:41.598 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.598 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.599 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.599 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:41.599 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.600 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:41.600 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.601 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:41.601 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.601 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.601 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.602 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:41.602 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.602 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.602 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:41.603 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.603 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.603 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:41.603 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.604 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.604 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.604 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:41.604 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:41.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.605 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:41.605 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:41.605 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.606 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:41.606 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:41.606 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:41.606 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.607 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.607 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:41.607 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:41.607 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:41.608 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:41.608 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:41.608 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:18:41.608 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:41.608 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:41.609 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:41.609 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.609 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:41.609 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:41.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.609 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:41.610 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.610 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.610 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.610 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.611 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.611 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:41.611 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.611 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:41.612 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.612 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.612 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.612 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.612 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.613 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:41.613 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.613 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:41.613 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.614 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.614 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.614 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.614 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.614 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:41.615 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.615 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:41.615 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.616 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.616 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.616 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.616 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.616 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:41.616 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.617 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:41.617 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.617 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.618 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.618 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.618 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.618 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:41.618 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.619 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:41.619 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.619 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.619 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.620 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.620 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.620 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:41.620 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.621 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:41.621 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.621 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.621 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.622 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.622 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.622 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:41.622 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:41.623 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:41.623 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:41.623 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:41.623 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:41.624 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:41.624 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:41.624 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:41.624 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:41.624 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.624 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:41.625 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:41.625 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:41.625 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:41.625 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:41.625 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:41.626 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:41.626 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:41.626 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:41.626 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:41.626 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:41.627 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:41.627 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:41.627 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:41.627 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:41.627 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:41.628 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:41.628 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:41.628 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:41.628 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:41.628 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:41.629 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:41.629 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:41.629 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:41.629 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:41.629 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:41.630 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:41.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:41.630 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:41.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.429+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f24b4066470 msgr2=0x7f24b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.429+0000 7f24d778b640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f24b4066470 0x7f24b4068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24cc001770 tx=0x7f24cc009040 comp rx=0 tx=0).stop 2023-10-25T16:18:41.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.429+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 msgr2=0x7f24d01540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.429+0000 7f24d778b640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 0x7f24d01540d0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f24c801a9b0 tx=0x7f24c80a59d0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.429+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 shutdown_connections 2023-10-25T16:18:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f24b4066470 0x7f24b4068930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d014e810 0x7f24d01540d0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24d00cbfa0 0x7f24d0144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 --2- 172.21.15.177:0/1236717400 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24d00af100 0x7f24d0153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 >> 172.21.15.177:0/1236717400 conn(0x7f24d00b2450 msgr2=0x7f24d006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 shutdown_connections 2023-10-25T16:18:41.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.433+0000 7f24d778b640 1 -- 172.21.15.177:0/1236717400 wait complete. 2023-10-25T16:18:41.635 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-25T16:18:41.635 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:41.636 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:41.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:41.642 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-10-25T16:18:41.794 INFO:teuthology.orchestra.run.smithi177.stderr:dd: error writing 'large_file_b': No space left on device 2023-10-25T16:18:41.794 INFO:teuthology.orchestra.run.smithi177.stderr:dd: closing output file 'large_file_b': No space left on device 2023-10-25T16:18:41.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:18:41.796 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:41.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/3997093536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53780047d0 msgr2=0x7f5378004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 --2- 172.21.15.177:0/3997093536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53780047d0 0x7f5378004c50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f537c005fd0 tx=0x7f537c01cae0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 -- 172.21.15.177:0/3997093536 reap_dead start 2023-10-25T16:18:41.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/3997093536 shutdown_connections 2023-10-25T16:18:41.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/3997093536 >> 172.21.15.177:0/3997093536 conn(0x7f538c0b2450 msgr2=0x7f538c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:41.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/3997093536 shutdown_connections 2023-10-25T16:18:41.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/3997093536 wait complete. 2023-10-25T16:18:41.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 Processor -- start 2023-10-25T16:18:41.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- start start 2023-10-25T16:18:41.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53780047d0 0x7f538c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f538c0aeac0 0x7f538c1ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 0x7f538c1400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0afb20 con 0x7f538c13fc60 2023-10-25T16:18:41.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c15bd50 con 0x7f538c0aeac0 2023-10-25T16:18:41.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c1ef8d0 con 0x7f53780047d0 2023-10-25T16:18:41.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 0x7f538c1400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 0x7f538c1400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38710/0 (socket says 172.21.15.177:38710) 2023-10-25T16:18:41.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 -- 172.21.15.177:0/2852895878 learned_addr learned my addr 172.21.15.177:0/2852895878 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:41.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f538b7fe640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f538c0aeac0 0x7f538c1ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f538bfff640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53780047d0 0x7f538c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 -- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53780047d0 msgr2=0x7f538c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53780047d0 0x7f538c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 -- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f538c0aeac0 msgr2=0x7f538c1ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f538c0aeac0 0x7f538c1ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:41.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 -- 172.21.15.177:0/2852895878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0af280 con 0x7f538c13fc60 2023-10-25T16:18:41.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f538bfff640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53780047d0 0x7f538c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:41.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5390fa8640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 0x7f538c1400e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f538c15cc40 tx=0x7f5384011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:41.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384013920 con 0x7f538c13fc60 2023-10-25T16:18:41.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5384013bb0 con 0x7f538c13fc60 2023-10-25T16:18:41.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c0af560 con 0x7f538c13fc60 2023-10-25T16:18:41.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384012440 con 0x7f538c13fc60 2023-10-25T16:18:41.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.929+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c13f740 con 0x7f538c13fc60 2023-10-25T16:18:41.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c13f590 con 0x7f538c13fc60 2023-10-25T16:18:41.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f53840125a0 con 0x7f538c13fc60 2023-10-25T16:18:41.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f5388ff9640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f536c0664a0 0x7f536c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:41.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5384088310 con 0x7f538c13fc60 2023-10-25T16:18:41.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=111}) v3 -- 0x7f536c06dfd0 con 0x7f538c13fc60 2023-10-25T16:18:41.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f538bfff640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f536c0664a0 0x7f536c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:41.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.933+0000 7f538bfff640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f536c0664a0 0x7f536c068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f537400e9f0 tx=0x7f537400e3f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:41.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:41.937+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5384055930 con 0x7f538c13fc60 2023-10-25T16:18:42.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.093+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f538c06c370 con 0x7f538c13fc60 2023-10-25T16:18:42.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.093+0000 7f5388ff9640 1 -- 172.21.15.177:0/2852895878 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+34198 (secure 0 0 0) 0x7f538c06c370 con 0x7f538c13fc60 2023-10-25T16:18:42.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:42.095 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:42.095 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 110, 2023-10-25T16:18:42.095 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:42.096 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:42.096 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:40.829373+0000", 2023-10-25T16:18:42.096 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:42.096 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:42.096 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:42.097 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:42.097 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:42.097 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:42.097 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:42.097 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:42.098 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:42.098 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:42.098 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:42.098 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:42.098 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:42.098 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:42.099 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:42.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:42.099 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:42.099 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:42.099 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:42.100 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:42.100 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:42.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:42.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:42.101 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:42.101 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:42.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:42.101 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:42.101 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:42.102 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:42.102 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:42.102 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:42.102 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:42.103 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:42.103 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:42.103 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:42.103 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:42.103 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:42.104 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:42.104 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:42.104 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:42.104 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:42.104 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:42.105 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:42.105 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:42.105 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:42.105 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:42.105 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:42.106 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:42.106 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:42.106 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.106 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:42.106 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:42.107 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:42.107 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:42.107 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:42.107 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:42.107 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:42.107 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:42.108 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:42.108 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:42.108 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:42.108 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:42.108 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:42.109 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:42.109 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:42.109 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:42.109 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:42.109 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:42.110 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:42.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:42.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:42.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:42.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:42.111 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:42.111 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:42.111 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:42.111 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:42.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.111 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:42.112 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:42.112 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:42.112 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:42.112 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:42.112 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:42.113 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:42.113 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:42.113 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:42.113 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:42.114 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:42.114 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:42.114 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:42.114 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:42.114 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.115 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:42.115 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:42.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.115 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:42.115 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:42.115 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:42.116 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:42.116 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:42.116 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:42.116 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:42.116 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:42.117 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:42.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.117 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:42.118 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:42.118 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:42.118 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:42.118 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:42.118 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:42.119 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:42.119 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:42.119 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:42.119 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:42.119 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:42.119 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:42.120 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:42.120 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:42.120 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:42.120 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:42.120 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:42.121 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:42.121 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:42.121 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:42.121 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:42.121 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:42.122 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:42.122 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:42.122 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:42.122 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:42.122 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:42.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:42.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:42.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:42.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:42.123 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:42.124 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:42.124 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:42.124 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:42.124 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:42.124 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:42.125 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:42.126 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:42.126 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:42.126 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:42.126 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:42.126 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:42.127 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:42.127 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:42.127 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:42.127 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:42.127 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:42.128 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:42.128 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.128 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:42.128 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:42.128 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:42.129 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:42.129 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:42.129 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:42.129 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:42.129 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:42.129 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:42.130 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:42.130 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:42.130 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:42.130 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:42.130 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:42.131 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:42.131 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.131 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:42.131 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:42.131 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:42.132 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.132 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:42.132 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:42.132 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:42.132 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:42.133 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:42.133 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:42.133 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:42.133 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:42.133 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:42.134 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.134 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.134 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.134 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:42.134 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:42.135 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:42.135 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:42.135 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:42.135 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:42.135 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:42.136 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:42.136 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:42.136 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:42.136 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:42.136 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:42.137 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:42.137 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:42.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:42.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:42.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:42.137 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:42.138 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:42.138 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:42.138 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:42.138 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:42.138 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:42.139 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:42.139 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:42.139 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:42.139 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:42.139 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.139 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:42.140 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:42.140 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:42.140 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:42.140 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:42.140 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:42.141 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:42.141 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:42.141 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:42.141 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:42.141 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:42.142 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:42.142 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:42.142 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:42.142 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:42.142 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:42.143 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:42.143 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:42.143 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:42.143 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:42.143 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:42.144 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:42.144 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:42.144 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:42.144 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:42.144 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:42.145 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:42.145 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.145 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:42.145 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:42.145 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:42.146 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:42.146 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:42.146 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:42.146 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:42.146 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:42.146 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:42.150 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:42.150 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:42.150 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:42.150 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:42.150 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:42.151 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.151 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.151 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:42.151 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:42.151 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.151 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:42.152 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.152 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.152 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.152 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.152 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.153 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.153 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.153 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.153 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.153 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.154 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.154 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.154 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.154 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.155 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:42.155 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.155 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.155 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.155 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.156 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:42.156 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.156 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.156 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.157 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.157 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.157 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.157 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:42.158 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.158 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.158 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.158 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.158 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:42.159 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.159 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.159 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.159 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.159 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.160 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.160 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.160 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:42.160 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.161 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.161 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.161 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.161 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:42.161 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.161 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.162 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.162 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.162 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.162 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.162 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.163 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:42.163 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.163 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.163 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.164 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.164 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:42.164 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:42.164 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.164 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.165 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.165 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:42.165 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:42.165 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:42.165 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:42.166 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.166 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.166 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:42.166 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.166 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.167 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.167 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.167 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:42.167 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.167 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.168 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.168 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.168 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.168 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.168 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.168 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.169 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.169 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.169 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.169 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.169 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.170 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.170 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.170 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:42.170 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.170 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.171 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.171 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.171 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:42.171 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.171 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.172 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.172 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.172 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.172 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.172 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.173 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.173 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:42.173 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.173 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.173 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.174 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.174 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:42.174 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.174 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.174 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.175 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.175 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.175 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.175 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.177 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:42.177 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.177 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.177 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.178 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.178 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:42.178 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.178 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.178 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.179 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.179 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.179 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.179 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.179 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.180 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:42.180 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.180 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.180 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.181 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:42.181 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:42.181 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.181 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.181 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.182 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:42.182 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:42.182 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:42.182 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:42.182 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.183 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.183 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:42.183 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.183 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.183 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.184 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.184 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:42.184 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.184 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.184 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:42.185 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.186 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.186 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.186 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.186 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.187 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.187 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:42.187 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.187 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.188 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.188 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:42.188 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.188 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.188 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.189 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.189 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.189 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.190 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:42.190 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.190 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.190 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.191 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:42.191 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.191 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.191 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.192 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.192 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.192 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.192 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:42.193 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.193 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.193 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.193 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:42.193 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.194 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.194 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.194 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.194 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.195 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.195 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:42.195 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.196 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.196 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:42.196 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:42.196 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.197 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.197 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.197 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:42.197 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:42.197 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:42.198 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:42.198 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.198 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.198 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:42.198 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.199 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.199 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:42.199 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.199 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.200 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.200 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.200 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.200 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.200 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.201 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.201 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.201 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.201 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.201 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.202 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.202 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.202 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.202 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:42.203 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.203 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:42.204 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.204 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.204 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.204 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.204 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.205 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:42.205 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.206 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.206 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:42.207 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.207 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.207 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.207 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.208 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.209 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:42.209 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.209 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.210 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.210 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.210 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.210 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.211 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.211 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:42.211 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.211 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.211 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.212 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.212 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:42.212 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:42.212 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.212 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.213 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:42.213 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:42.213 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:42.213 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:42.213 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.214 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.214 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.214 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.215 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:42.215 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.215 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.215 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.215 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.215 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.216 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.216 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.216 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.216 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.216 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.217 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.217 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.217 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.217 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.218 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:42.218 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.218 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.219 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:42.219 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.219 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.219 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.220 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:42.221 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.221 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:42.222 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.222 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.222 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.222 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.223 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:42.223 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.224 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.224 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.224 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:42.224 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.224 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.225 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.225 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.225 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.226 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.226 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:42.226 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.226 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.227 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:42.227 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:42.227 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.227 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.228 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:42.228 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:42.228 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:42.228 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:42.228 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.229 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.229 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:42.229 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.229 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.230 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:42.230 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.230 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.230 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.230 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.231 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.231 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.231 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.231 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.231 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.232 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.232 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.232 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.232 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.233 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.233 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:42.233 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.233 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.233 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.234 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:42.234 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.234 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.234 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.235 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.235 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:42.236 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.236 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.236 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:42.237 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.237 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.237 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.237 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.237 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.238 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.238 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:42.238 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.239 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.239 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:42.239 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.239 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.240 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.240 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.240 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.241 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.241 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:42.241 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.241 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.241 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.242 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:42.242 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:42.242 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.242 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.242 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.243 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:42.243 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:42.243 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:42.243 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:42.243 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.244 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.244 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.244 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.244 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.244 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.244 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:42.245 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.245 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.245 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.245 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.245 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.246 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.246 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.246 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.246 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.246 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.247 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.247 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.247 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.247 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.247 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:42.248 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.248 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.248 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:42.249 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.249 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.249 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.249 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.250 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.250 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.250 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.250 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:42.250 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.251 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:42.251 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.251 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.252 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.252 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.252 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.252 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.253 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:42.253 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.254 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.254 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:42.254 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.254 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.254 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.255 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.255 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.255 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.255 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.255 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:42.256 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.256 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.256 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.256 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.256 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:42.257 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:42.257 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.257 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.257 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.257 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:42.258 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:42.258 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:42.258 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:42.258 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.258 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.259 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:42.259 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.259 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.259 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.259 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.260 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:42.260 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:42.260 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:42.260 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:42.260 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:42.261 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:42.261 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:42.261 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:42.261 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:42.261 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:42.262 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:42.262 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:42.262 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:42.262 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.262 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.263 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.263 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:42.263 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.263 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.263 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.263 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.264 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:42.264 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.264 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.264 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.264 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.265 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:42.265 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.265 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.265 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.265 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:42.265 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.266 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.266 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.266 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:42.266 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.267 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.267 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.267 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.267 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:42.267 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.268 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.268 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.268 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:42.268 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.268 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.269 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.269 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.269 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:42.269 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.269 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.270 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:42.271 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:42.271 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.271 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.271 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.271 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:42.272 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:42.272 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:42.272 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.272 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.272 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.273 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:42.273 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:42.273 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:42.273 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:42.273 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:42.274 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:18:42.274 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:42.274 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:42.274 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:42.274 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.274 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:42.275 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:42.275 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.275 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:42.275 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.275 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.276 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.276 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.276 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.276 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:42.276 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.277 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.277 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.277 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:42.277 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.277 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.277 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.278 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.278 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.278 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:42.278 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.278 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.279 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.279 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:42.279 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.279 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.279 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.280 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.280 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.280 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:42.280 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.280 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.281 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.281 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:42.281 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.281 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.281 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.282 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.282 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.282 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:42.282 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.282 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.282 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.283 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:42.283 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.283 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.283 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.283 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.284 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.284 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:42.284 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.284 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.284 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.285 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:42.285 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.285 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.285 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.285 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.286 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.286 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:42.286 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.286 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.286 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.287 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:42.287 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.287 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.287 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.287 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.288 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.288 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:42.288 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.288 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.288 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:42.288 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:42.289 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:42.289 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:42.289 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:42.289 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:42.289 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:42.290 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:42.290 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:42.290 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.290 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:42.290 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:42.291 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:42.291 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:42.291 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:42.291 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:42.291 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:42.292 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:42.292 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:42.292 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:42.292 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:42.292 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:42.292 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:42.293 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:42.293 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:42.293 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.293 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:42.293 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:42.294 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:42.294 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:42.294 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:42.294 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:42.294 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:42.295 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:42.295 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:42.295 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:42.295 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:42.295 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:42.295 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:42.296 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:42.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f536c0664a0 msgr2=0x7f536c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f536c0664a0 0x7f536c068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f537400e9f0 tx=0x7f537400e3f0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 msgr2=0x7f538c1400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 0x7f538c1400e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f538c15cc40 tx=0x7f5384011a30 comp rx=0 tx=0).stop 2023-10-25T16:18:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 shutdown_connections 2023-10-25T16:18:42.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f536c0664a0 0x7f536c068960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f538c13fc60 0x7f538c1400e0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f538c0aeac0 0x7f538c1ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 --2- 172.21.15.177:0/2852895878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53780047d0 0x7f538c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 >> 172.21.15.177:0/2852895878 conn(0x7f538c0b2450 msgr2=0x7f538c158d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:42.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 shutdown_connections 2023-10-25T16:18:42.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.097+0000 7f5392a0b640 1 -- 172.21.15.177:0/2852895878 wait complete. 2023-10-25T16:18:42.301 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:42.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/1225688731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396406f570 msgr2=0x7f396406b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 --2- 172.21.15.177:0/1225688731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396406f570 0x7f396406b980 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f3958009c70 tx=0x7f395801cc70 comp rx=0 tx=0).stop 2023-10-25T16:18:42.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/1225688731 shutdown_connections 2023-10-25T16:18:42.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 --2- 172.21.15.177:0/1225688731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f396406f570 0x7f396406b980 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 --2- 172.21.15.177:0/1225688731 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3964140e90 0x7f39640af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/1225688731 >> 172.21.15.177:0/1225688731 conn(0x7f39640b2450 msgr2=0x7f39640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:42.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/1225688731 shutdown_connections 2023-10-25T16:18:42.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/1225688731 wait complete. 2023-10-25T16:18:42.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 Processor -- start 2023-10-25T16:18:42.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- start start 2023-10-25T16:18:42.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406bec0 0x7f3964158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:42.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396406f570 0x7f39640cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:42.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 0x7f3964156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:42.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640a7a90 con 0x7f3964140e90 2023-10-25T16:18:42.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39640a69f0 con 0x7f396406bec0 2023-10-25T16:18:42.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39640a6cd0 con 0x7f396406f570 2023-10-25T16:18:42.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 0x7f3964156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:42.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 0x7f3964156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38728/0 (socket says 172.21.15.177:38728) 2023-10-25T16:18:42.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 -- 172.21.15.177:0/2071128758 learned_addr learned my addr 172.21.15.177:0/2071128758 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:42.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3963fff640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406bec0 0x7f3964158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:42.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f39637fe640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396406f570 0x7f39640cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:42.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 -- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396406f570 msgr2=0x7f39640cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396406f570 0x7f39640cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 -- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406bec0 msgr2=0x7f3964158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406bec0 0x7f3964158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 -- 172.21.15.177:0/2071128758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009880 con 0x7f3964140e90 2023-10-25T16:18:42.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3968fdb640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 0x7f3964156410 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c430 tx=0x7f395c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:42.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c005220 con 0x7f3964140e90 2023-10-25T16:18:42.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f395c005470 con 0x7f3964140e90 2023-10-25T16:18:42.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39640a6fb0 con 0x7f3964140e90 2023-10-25T16:18:42.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c007290 con 0x7f3964140e90 2023-10-25T16:18:42.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.433+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39640a7570 con 0x7f3964140e90 2023-10-25T16:18:42.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396404daf0 con 0x7f3964140e90 2023-10-25T16:18:42.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f395c0073f0 con 0x7f3964140e90 2023-10-25T16:18:42.440 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f3960ff9640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3950066470 0x7f3950068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:42.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f395c083da0 con 0x7f3964140e90 2023-10-25T16:18:42.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=111}) v3 -- 0x7f395006dfa0 con 0x7f3964140e90 2023-10-25T16:18:42.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f3963fff640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3950066470 0x7f3950068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:42.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.437+0000 7f3963fff640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3950066470 0x7f3950068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39540058d0 tx=0x7f3954005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:42.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.441+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f395c051300 con 0x7f3964140e90 2023-10-25T16:18:42.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.632+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39640ca670 con 0x7f3964140e90 2023-10-25T16:18:42.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.632+0000 7f3960ff9640 1 -- 172.21.15.177:0/2071128758 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f395c054920 con 0x7f3964140e90 2023-10-25T16:18:42.633 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:42.633 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:18:42.634 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:18:42.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3950066470 msgr2=0x7f3950068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3950066470 0x7f3950068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39540058d0 tx=0x7f3954005860 comp rx=0 tx=0).stop 2023-10-25T16:18:42.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 msgr2=0x7f3964156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:42.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 0x7f3964156410 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c430 tx=0x7f395c00c8f0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 shutdown_connections 2023-10-25T16:18:42.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3950066470 0x7f3950068930 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3964140e90 0x7f3964156410 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f396406f570 0x7f39640cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 --2- 172.21.15.177:0/2071128758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f396406bec0 0x7f3964158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:42.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 >> 172.21.15.177:0/2071128758 conn(0x7f39640b2450 msgr2=0x7f396415b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:42.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 shutdown_connections 2023-10-25T16:18:42.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:42.636+0000 7f396aa3e640 1 -- 172.21.15.177:0/2071128758 wait complete. 2023-10-25T16:18:42.650 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:18:42.652+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-10-25T16:18:42.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:18:42.797 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155378,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":27.061630327,"mdsmap_epoch":38,"osdmap_epoch":110,"osdmap_epoch_barrier":105,"uptime":32.277810893999998} 2023-10-25T16:18:42.798 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155378, "mdsmap_epoch": 38, "osdmap_epoch": 110, "osdmap_epoch_barrier": 105, "rank_uptime": 27.061630327, "state": "up:active", "uptime": 32.277810894, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:18:42.798 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:18:42.799 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:42.799 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:42.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:42.806 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-25T16:18:42.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:18:42.852+0000 7fc89effd640 -1 client.7392 handle_client_reply no pending request on tid 14 safe is:1 2023-10-25T16:18:42.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:18:42.855 INFO:teuthology.orchestra.run.smithi177.stderr:dd: failed to open 'small_file_1': Permission denied 2023-10-25T16:18:42.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:42.856 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-25T16:18:42.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:42.914 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-25T16:18:42.997 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:43.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/60095885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc710141b80 msgr2=0x7fc71015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:43.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 --2- 172.21.15.177:0/60095885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc710141b80 0x7fc71015ccb0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fc704009900 tx=0x7fc70401c8c0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/60095885 shutdown_connections 2023-10-25T16:18:43.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 --2- 172.21.15.177:0/60095885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7100cbe10 0x7fc71015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 --2- 172.21.15.177:0/60095885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc710141b80 0x7fc71015ccb0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/60095885 >> 172.21.15.177:0/60095885 conn(0x7fc7100cdf10 msgr2=0x7fc7100ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:43.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/60095885 shutdown_connections 2023-10-25T16:18:43.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/60095885 wait complete. 2023-10-25T16:18:43.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 Processor -- start 2023-10-25T16:18:43.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- start start 2023-10-25T16:18:43.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710069720 0x7fc71015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:43.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 0x7fc71015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:43.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc710141b80 0x7fc7101f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:43.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710135e40 con 0x7fc7100cbe10 2023-10-25T16:18:43.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc710142090 con 0x7fc710069720 2023-10-25T16:18:43.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc710142610 con 0x7fc710141b80 2023-10-25T16:18:43.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 0x7fc71015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:43.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 0x7fc71015be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38746/0 (socket says 172.21.15.177:38746) 2023-10-25T16:18:43.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 -- 172.21.15.177:0/3801033288 learned_addr learned my addr 172.21.15.177:0/3801033288 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:43.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc714ebb640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710069720 0x7fc71015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:43.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc7156bc640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc710141b80 0x7fc7101f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:43.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 -- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc710141b80 msgr2=0x7fc7101f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:43.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc710141b80 0x7fc7101f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 -- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710069720 msgr2=0x7fc71015a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:43.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710069720 0x7fc71015a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 -- 172.21.15.177:0/3801033288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704009560 con 0x7fc7100cbe10 2023-10-25T16:18:43.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc7156bc640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc710141b80 0x7fc7101f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:43.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70ffff640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 0x7fc71015be40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fc70000d980 tx=0x7fc70000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:43.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700009c30 con 0x7fc7100cbe10 2023-10-25T16:18:43.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc700005020 con 0x7fc7100cbe10 2023-10-25T16:18:43.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7101358e0 con 0x7fc7100cbe10 2023-10-25T16:18:43.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700005430 con 0x7fc7100cbe10 2023-10-25T16:18:43.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.172+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc710135510 con 0x7fc7100cbe10 2023-10-25T16:18:43.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71004daf0 con 0x7fc7100cbe10 2023-10-25T16:18:43.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7000047b0 con 0x7fc7100cbe10 2023-10-25T16:18:43.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc70d7fa640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6fc066470 0x7fc6fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:43.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc700084170 con 0x7fc7100cbe10 2023-10-25T16:18:43.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=111}) v3 -- 0x7fc6fc06dfa0 con 0x7fc7100cbe10 2023-10-25T16:18:43.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc714ebb640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6fc066470 0x7fc6fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:43.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.176+0000 7fc714ebb640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6fc066470 0x7fc6fc068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc7040af000 tx=0x7fc70401b100 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:43.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.180+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc700017060 con 0x7fc7100cbe10 2023-10-25T16:18:43.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.336+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc71015eb30 con 0x7fc7100cbe10 2023-10-25T16:18:43.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc70d7fa640 1 -- 172.21.15.177:0/3801033288 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+34198 (secure 0 0 0) 0x7fc700020020 con 0x7fc7100cbe10 2023-10-25T16:18:43.339 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:43.339 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:43.339 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 110, 2023-10-25T16:18:43.339 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:43.340 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:43.340 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:40.829373+0000", 2023-10-25T16:18:43.340 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:43.340 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:43.340 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:43.341 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:43.341 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:43.341 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:43.341 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:43.342 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:43.342 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:43.342 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:43.342 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:43.342 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:43.343 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:43.343 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:43.343 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:43.343 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:43.343 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:43.343 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:43.344 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:43.344 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:43.344 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:43.344 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:43.344 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.345 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:43.345 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:43.345 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:43.345 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:43.345 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:43.346 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:43.346 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:43.346 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:43.346 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:43.346 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:43.346 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:43.347 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:43.347 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:43.347 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:43.347 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:43.347 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:43.348 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:43.348 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:43.348 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:43.348 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:43.348 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:43.348 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:43.349 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:43.349 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:43.349 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:43.349 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:43.349 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:43.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.350 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:43.350 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:43.350 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:43.350 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:43.351 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:43.351 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:43.351 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:43.351 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:43.351 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:43.351 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:43.352 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:43.352 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:43.352 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:43.352 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:43.352 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:43.353 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:43.353 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:43.353 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:43.353 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:43.353 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:43.354 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:43.354 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:43.354 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:43.354 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:43.354 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:43.355 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:43.355 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:43.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.355 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:43.355 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:43.355 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:43.356 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:43.356 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:43.356 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:43.356 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:43.356 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:43.357 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:43.357 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:43.357 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:43.357 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:43.357 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:43.357 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:43.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.358 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:43.358 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:43.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.358 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:43.359 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:43.359 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:43.359 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:43.359 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:43.359 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:43.360 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:43.360 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:43.360 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:43.360 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.360 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:43.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:43.361 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:43.361 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:43.361 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:43.362 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:43.362 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:43.362 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:43.362 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:43.362 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:43.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:43.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:43.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:43.363 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:43.363 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:43.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:43.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:43.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:43.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:43.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:43.365 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:43.365 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:43.365 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:43.365 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:43.365 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:43.366 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:43.366 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:43.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.366 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:43.366 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:43.366 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:43.367 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:43.367 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:43.367 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:43.367 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:43.367 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:43.368 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:43.368 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:43.368 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:43.368 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:43.368 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:43.369 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:43.369 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:43.369 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:43.369 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:43.369 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:43.369 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:43.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:43.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:43.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:43.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:43.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:43.371 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:43.371 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:43.371 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:43.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.371 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:43.372 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:43.372 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:43.372 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:43.372 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:43.372 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:43.373 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:43.373 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:43.373 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:43.373 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:43.373 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:43.373 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:43.374 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:43.374 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:43.374 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:43.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.374 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:43.375 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:43.375 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:43.375 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.375 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:43.376 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:43.376 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:43.376 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:43.376 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:43.376 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:43.377 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:43.377 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:43.377 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:43.377 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.378 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:43.378 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:43.378 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:43.378 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:43.378 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:43.379 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:43.379 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:43.379 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:43.379 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:43.379 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:43.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:43.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:43.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:43.380 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:43.380 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:43.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:43.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:43.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:43.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:43.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:43.381 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:43.382 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:43.382 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:43.382 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:43.382 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:43.382 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:43.383 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:43.383 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:43.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:43.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:43.384 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:43.384 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:43.384 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:43.384 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:43.384 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:43.384 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:43.385 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:43.385 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:43.385 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:43.385 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:43.385 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:43.386 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:43.386 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:43.386 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:43.386 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:43.386 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:43.387 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:43.387 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:43.387 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:43.387 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:43.387 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:43.388 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:43.388 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:43.388 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:43.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.388 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:43.388 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:43.389 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:43.389 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:43.389 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:43.389 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:43.389 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:43.390 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:43.390 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:43.390 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:43.390 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:43.390 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:43.391 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:43.391 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:43.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.391 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:43.391 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:43.391 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:43.392 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.392 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:43.392 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:43.392 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:43.393 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:43.393 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:43.393 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:43.393 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:43.393 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:43.394 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:43.394 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.394 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.394 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:43.394 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:43.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.395 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:43.395 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.395 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.395 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.395 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.396 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.396 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.396 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.396 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.396 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.397 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.397 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.397 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.397 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:43.398 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.398 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.399 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:43.399 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.401 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.401 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.402 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.402 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.402 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.402 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:43.402 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.403 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.403 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:43.403 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.404 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.404 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.404 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.404 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.405 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.405 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:43.405 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.406 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.406 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:43.406 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.406 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.407 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.407 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.407 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.407 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.408 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:43.408 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.408 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.409 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:43.409 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:43.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.409 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.410 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:43.410 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:43.410 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:43.410 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:43.410 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.411 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.411 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:43.411 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.411 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.412 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:43.412 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.412 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.412 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.412 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.413 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.413 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.413 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.413 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.413 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.414 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.414 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.414 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.414 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.415 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.415 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:43.415 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.415 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.416 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:43.416 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.416 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.416 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.417 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.417 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.417 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.417 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:43.418 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.418 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.418 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:43.418 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.419 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.419 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.419 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.420 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.420 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:43.420 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.421 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.421 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:43.421 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.421 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.422 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.422 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.422 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.423 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:43.423 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.423 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.424 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:43.424 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:43.424 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.424 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.424 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:43.425 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:43.425 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:43.425 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:43.425 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.425 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.426 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:43.426 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.426 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.426 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:43.427 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.427 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.427 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.427 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.427 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.428 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.428 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.428 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:43.428 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.428 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.429 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.429 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.429 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.429 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.429 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:43.430 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.430 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.430 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:43.431 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.431 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.431 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.431 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.431 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.432 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.432 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.432 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:43.432 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.434 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.434 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.434 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.435 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.435 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:43.435 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.436 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.436 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:43.436 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.436 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.436 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.437 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:43.438 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.438 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.438 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:43.439 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:43.439 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.439 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.439 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:43.440 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:43.440 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:43.440 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:43.440 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.440 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.440 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:43.441 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.441 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.441 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:43.442 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.442 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.442 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.442 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.442 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.443 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.443 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.443 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.443 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.443 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.443 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.444 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.444 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.444 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.444 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:43.445 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.445 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.445 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.445 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:43.445 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.446 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.446 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.446 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.446 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.447 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.447 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:43.447 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.449 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.449 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.449 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.450 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:43.450 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.451 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:43.451 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.451 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.451 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.451 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.452 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:43.452 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.453 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:43.453 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:43.453 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.454 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.454 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:43.454 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:43.454 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:43.455 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:43.455 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.455 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.455 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.455 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.456 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:43.456 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.456 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.457 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.457 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.457 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.457 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.457 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.457 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.458 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.458 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.458 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.458 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.458 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.459 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.459 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:43.459 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.460 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.460 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.460 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:43.460 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.460 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.460 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.461 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.461 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.461 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.462 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:43.462 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.462 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.463 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:43.463 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.463 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.463 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.463 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.464 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.464 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.464 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:43.464 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.465 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.465 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:43.465 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.466 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.466 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.466 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.466 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.467 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.467 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:43.467 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.468 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.468 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:43.468 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:43.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.468 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.469 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:43.469 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:43.469 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:43.469 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:43.469 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.470 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.470 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:43.470 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.470 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.471 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:43.471 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.471 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.471 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.471 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.472 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.472 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.472 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.472 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.472 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.473 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.473 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.473 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.473 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.473 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.474 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:43.474 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.474 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.475 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:43.475 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.475 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.475 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.475 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.476 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.476 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.476 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:43.476 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.477 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.477 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:43.477 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.477 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.478 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.478 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.478 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.479 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.479 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:43.479 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.480 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.480 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:43.480 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.480 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.480 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.481 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.481 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.481 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.481 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:43.482 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.482 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.482 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:43.483 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:43.483 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.483 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.483 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:43.483 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:43.484 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:43.484 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:43.484 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.484 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.484 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.485 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.485 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:43.485 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.485 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.486 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.486 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.486 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.486 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.486 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.487 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.487 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.487 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.487 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.487 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.487 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.488 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.488 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:43.488 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.489 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.489 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.489 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:43.489 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.489 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.490 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.490 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.490 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.490 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.491 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:43.491 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.491 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.492 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:43.492 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.492 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.492 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.492 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.493 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:43.493 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.494 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.494 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:43.494 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.495 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.495 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.495 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.496 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:43.496 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.497 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.497 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:43.497 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:43.497 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.497 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.498 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:43.498 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:43.498 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:43.498 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:43.498 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.499 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.499 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:43.499 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.499 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:43.501 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:43.501 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:43.501 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:43.501 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:43.501 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:43.501 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:43.502 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:43.502 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:43.502 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.502 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.503 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:43.503 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.503 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.504 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:43.504 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.504 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.504 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.504 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.504 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:43.505 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.505 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.505 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:43.505 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.506 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.506 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:43.506 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.506 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.507 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.507 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:43.507 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.508 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.508 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:43.508 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.508 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.509 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:43.509 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.509 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.509 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.510 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:43.510 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:43.510 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.510 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:43.510 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:43.511 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.511 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:43.511 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:43.511 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:43.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.512 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.512 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:43.512 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:43.513 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:43.513 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:43.513 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:43.513 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:18:43.513 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:43.513 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:43.514 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:43.514 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.514 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:43.514 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:43.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.515 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:43.515 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.515 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.515 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.515 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.517 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:43.517 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.517 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.517 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.517 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.518 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.518 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:43.518 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.519 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:43.519 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.519 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.519 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.519 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.519 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.520 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:43.520 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.520 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:43.521 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.521 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.521 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.521 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.521 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.521 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:43.522 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.522 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:43.522 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.523 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.523 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.523 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.523 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.523 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:43.524 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.524 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:43.524 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.524 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.525 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.525 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.525 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.525 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:43.525 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.526 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:43.526 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.526 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.526 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.527 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.527 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.527 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:43.527 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:43.528 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:43.528 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:43.528 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:43.528 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:43.528 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:43.529 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:43.529 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:43.529 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:43.529 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.529 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:43.530 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:43.530 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:43.530 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:43.530 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:43.530 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:43.531 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:43.531 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:43.531 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:43.531 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:43.531 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:43.531 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:43.532 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:43.532 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:43.532 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:43.532 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:43.533 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:43.533 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:43.533 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:43.533 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:43.533 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:43.534 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:43.534 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:43.534 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:43.534 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:43.534 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:43.534 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:43.535 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:43.535 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6fc066470 msgr2=0x7fc6fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6fc066470 0x7fc6fc068930 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc7040af000 tx=0x7fc70401b100 comp rx=0 tx=0).stop 2023-10-25T16:18:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 msgr2=0x7fc71015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 0x7fc71015be40 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fc70000d980 tx=0x7fc70000de40 comp rx=0 tx=0).stop 2023-10-25T16:18:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 shutdown_connections 2023-10-25T16:18:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6fc066470 0x7fc6fc068930 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc710141b80 0x7fc7101f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100cbe10 0x7fc71015be40 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 --2- 172.21.15.177:0/3801033288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc710069720 0x7fc71015a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 >> 172.21.15.177:0/3801033288 conn(0x7fc7100cdf10 msgr2=0x7fc71013ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 shutdown_connections 2023-10-25T16:18:43.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:43.340+0000 7fc71711f640 1 -- 172.21.15.177:0/3801033288 wait complete. 2023-10-25T16:18:43.539 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:18:47.652 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:18:47.652+0000 7fdcb2845640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-10-25T16:18:48.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:48.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2540527615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc15eba0 msgr2=0x7fd9bc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:48.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2540527615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc15eba0 0x7fd9bc0b4100 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc09f200 tx=0x7fd9b001c810 comp rx=0 tx=0).stop 2023-10-25T16:18:48.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2540527615 shutdown_connections 2023-10-25T16:18:48.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2540527615 >> v2:172.21.15.184:3300/0 conn(0x7fd9bc0b2120 0x7fd9bc0d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:48.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2540527615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc15eba0 0x7fd9bc0b4100 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:48.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2540527615 >> 172.21.15.177:0/2540527615 conn(0x7fd9bc09a5c0 msgr2=0x7fd9bc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:48.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2540527615 shutdown_connections 2023-10-25T16:18:48.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2540527615 wait complete. 2023-10-25T16:18:48.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 Processor -- start 2023-10-25T16:18:48.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- start start 2023-10-25T16:18:48.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 0x7fd9bc1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:48.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9bc0cdb10 0x7fd9bc15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:48.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9bc15eba0 0x7fd9bc150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:48.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc157720 con 0x7fd9bc0b2120 2023-10-25T16:18:48.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1f5640 con 0x7fd9bc0cdb10 2023-10-25T16:18:48.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9c0b53640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1f5920 con 0x7fd9bc15eba0 2023-10-25T16:18:48.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 0x7fd9bc1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:48.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 0x7fd9bc1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38756/0 (socket says 172.21.15.177:38756) 2023-10-25T16:18:48.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 -- 172.21.15.177:0/2193372121 learned_addr learned my addr 172.21.15.177:0/2193372121 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:48.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9bad9d640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9bc15eba0 0x7fd9bc150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:48.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9b9d9b640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9bc0cdb10 0x7fd9bc15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:48.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 -- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9bc15eba0 msgr2=0x7fd9bc150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9bc15eba0 0x7fd9bc150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 -- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9bc0cdb10 msgr2=0x7fd9bc15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9bc0cdb10 0x7fd9bc15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:48.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9ba59c640 1 -- 172.21.15.177:0/2193372121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009560 con 0x7fd9bc0b2120 2023-10-25T16:18:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9bad9d640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9bc15eba0 0x7fd9bc150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.684+0000 7fd9b9d9b640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9bc0cdb10 0x7fd9bc15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9ba59c640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 0x7fd9bc1571e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00b0040 tx=0x7fd9b0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0004430 con 0x7fd9bc0b2120 2023-10-25T16:18:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd9b0005030 con 0x7fd9bc0b2120 2023-10-25T16:18:48.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc1f5c00 con 0x7fd9bc0b2120 2023-10-25T16:18:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0005400 con 0x7fd9bc0b2120 2023-10-25T16:18:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc1f61c0 con 0x7fd9bc0b2120 2023-10-25T16:18:48.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc1f63b0 con 0x7fd9bc0b2120 2023-10-25T16:18:48.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd9b0005560 con 0x7fd9bc0b2120 2023-10-25T16:18:48.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd99c066470 0x7fd99c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:48.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9b00aa070 con 0x7fd9bc0b2120 2023-10-25T16:18:48.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=113}) v3 -- 0x7fd99c06dfa0 con 0x7fd9bc0b2120 2023-10-25T16:18:48.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9b9d9b640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd99c066470 0x7fd99c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:48.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.688+0000 7fd9b9d9b640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd99c066470 0x7fd99c068930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc1f6670 tx=0x7fd9ac008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:48.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.692+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9b00ec360 con 0x7fd9bc0b2120 2023-10-25T16:18:48.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.848+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd9bc1f5a60 con 0x7fd9bc0b2120 2023-10-25T16:18:48.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.848+0000 7fd9aaffd640 1 -- 172.21.15.177:0/2193372121 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v112) v1 ==== 81+0+34182 (secure 0 0 0) 0x7fd9bc1f5a60 con 0x7fd9bc0b2120 2023-10-25T16:18:48.850 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:48.851 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:48.851 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 112, 2023-10-25T16:18:48.851 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:48.851 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:48.852 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:47.873313+0000", 2023-10-25T16:18:48.852 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:48.852 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:48.852 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:48.852 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:48.852 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:48.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:48.853 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:48.853 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:48.853 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:48.853 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:48.854 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:48.854 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:48.854 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:48.854 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:48.854 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:48.855 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:48.855 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:48.855 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:48.855 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:48.855 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:48.856 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:48.856 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:48.856 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.856 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:48.856 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:48.857 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:48.857 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:48.857 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:48.857 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:48.857 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:48.858 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:48.858 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:48.858 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:48.858 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:48.858 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:48.859 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:48.859 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:48.859 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:48.859 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:48.859 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:48.859 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:48.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:48.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:48.860 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:48.860 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:48.860 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.861 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:48.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:48.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:48.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:48.862 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:48.862 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:48.863 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:48.863 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:48.863 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:48.863 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:48.863 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:48.864 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:48.864 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:48.864 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:48.864 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:48.865 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:48.865 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:48.865 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:48.866 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:48.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:48.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:48.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:48.867 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:48.867 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:48.867 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:48.868 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:48.868 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:48.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.869 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:48.869 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:48.869 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:48.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:48.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:48.871 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:48.871 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:48.871 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:48.872 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:48.872 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:48.872 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:48.873 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:48.873 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:48.873 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:48.874 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.874 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:48.874 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:48.875 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.875 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:48.875 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:48.876 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:48.876 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:48.877 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:48.877 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:48.877 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:48.877 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:48.877 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:48.878 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:48.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:48.879 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:48.879 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:48.879 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:48.879 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:48.879 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:48.880 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:48.880 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:48.880 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:48.880 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:48.880 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:48.881 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:48.881 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:48.881 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:48.881 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:48.881 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:48.881 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:48.882 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:48.882 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:48.882 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:48.882 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:48.882 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:48.883 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:48.883 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:48.883 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:48.883 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:48.883 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:48.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:48.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:48.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:48.884 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:48.885 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:48.885 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:48.885 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:48.885 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:48.885 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:48.885 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:48.886 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:48.886 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:48.886 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:48.886 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:48.887 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:48.887 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:48.887 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:48.887 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:48.887 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:48.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:48.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:48.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:48.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:48.888 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:48.888 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:48.889 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:48.889 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.889 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:48.889 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:48.889 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:48.889 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:48.890 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:48.890 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:48.890 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:48.890 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:48.890 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:48.891 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:48.891 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:48.891 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:48.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:48.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:48.891 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:48.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.892 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:48.892 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:48.892 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:48.892 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.893 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:48.893 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:48.893 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:48.893 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:48.893 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:48.894 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:48.894 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:48.894 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:48.894 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:48.894 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.895 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.895 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:48.895 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:48.895 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:48.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 3, 2023-10-25T16:18:48.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full", 2023-10-25T16:18:48.896 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:48.896 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:48.896 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:48.897 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:48.897 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:48.897 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:48.897 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:48.897 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:48.897 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:48.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:48.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:48.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:48.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:48.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:48.899 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:48.899 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:48.899 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:48.899 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:48.899 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:48.900 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:48.900 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:48.900 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:48.900 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.900 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "107", 2023-10-25T16:18:48.900 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:48.901 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:48.902 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:48.903 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:48.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:48.905 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:48.906 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:48.907 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:48.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.909 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:48.910 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.911 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:48.912 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:48.913 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:48.914 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.916 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.917 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.918 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:48.920 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:48.921 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:48.922 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.924 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:48.925 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:48.926 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:48.927 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:48.928 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:48.929 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.931 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.932 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:48.935 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:48.936 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.939 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.940 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.940 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:48.940 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:48.940 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:48.940 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:48.940 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:48.941 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:48.941 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:48.941 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.941 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.941 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.942 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:48.942 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:48.942 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:48.942 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:48.942 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:48.943 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:48.943 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:48.943 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:48.943 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:48.943 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:48.944 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:48.944 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:48.944 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:48.944 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.944 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.945 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.945 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:48.945 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.945 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.945 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.946 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.946 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:48.946 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.946 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.946 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.947 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:48.947 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.947 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.947 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.947 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:48.948 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.948 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.948 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.948 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:48.949 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.949 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.949 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.949 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.949 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:48.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.950 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.950 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.950 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:48.950 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.950 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.951 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.951 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.951 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:48.951 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.951 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.952 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.952 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:48.952 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.952 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.953 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.953 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:48.953 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.953 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.953 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.953 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:48.954 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:48.954 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.954 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.954 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.955 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:48.955 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:48.955 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:48.955 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:48.955 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:48.956 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:48.956 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:48.956 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:48.956 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.956 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.957 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:48.957 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:48.957 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:48.957 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:48.957 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:48.958 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:48.958 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:48.958 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:48.958 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:48.958 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:48.959 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:48.959 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:48.959 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:48.959 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.959 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.959 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.960 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:48.960 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.960 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.960 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.960 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.961 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:48.961 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.961 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.961 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.962 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:48.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:48.962 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:48.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.964 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.964 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:48.964 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.965 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.965 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:48.965 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.966 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.966 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:48.966 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.966 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.966 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:48.968 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.968 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:48.969 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:48.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.969 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.969 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:48.969 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:48.970 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:48.970 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:48.970 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:48.970 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:48.970 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:48.971 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.971 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:48.971 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:48.972 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:48.972 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:48.972 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:48.972 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:48.972 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:48.972 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:48.973 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:48.973 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:48.973 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:48.973 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:48.973 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:48.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.974 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:48.974 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.975 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.975 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:48.975 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.975 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.976 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.976 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:48.976 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.977 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:48.977 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.978 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.978 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:48.978 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.978 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.978 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.979 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:48.979 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.979 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.979 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:48.980 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.980 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.980 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:48.981 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.981 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.981 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.981 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:48.981 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.982 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.982 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:48.982 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.983 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.983 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:48.983 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:48.983 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.984 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.984 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:48.984 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:48.984 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:48.984 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:48.985 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:48.985 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:18:48.985 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:48.985 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:48.985 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.986 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:48.986 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:48.986 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:48.986 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:48.987 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:48.987 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:48.987 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:48.987 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:48.987 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:48.988 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:48.988 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:48.988 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:48.988 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:48.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:48.989 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.990 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.990 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:48.990 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.990 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.991 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:48.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.991 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:48.992 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.992 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:48.992 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.993 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.993 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.993 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:48.993 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.994 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.994 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:48.994 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.995 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.995 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:48.995 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:48.997 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:48.998 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:48.999 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:49.000 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:49.001 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:49.002 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:49.003 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.004 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.006 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.008 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:49.009 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:49.010 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.012 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:49.013 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "full", 2023-10-25T16:18:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:49.015 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:49.020 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:49.021 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:49.025 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:49.026 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:49.027 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull", 2023-10-25T16:18:49.028 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:49.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.030 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.031 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:49.032 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.032 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.032 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.032 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.032 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.033 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:49.033 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.033 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:49.033 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.034 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.034 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.034 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.034 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.034 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:49.035 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.035 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:49.035 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.035 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.036 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.036 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.036 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.036 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:49.036 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.037 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.037 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:49.037 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.037 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.037 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.038 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.038 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.038 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:49.038 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.039 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:49.039 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.039 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.039 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.040 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.040 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.040 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:49.040 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.041 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:49.041 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.041 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.041 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.041 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.042 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.042 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:49.042 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:49.042 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:49.043 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:49.043 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:49.043 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:49.043 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:49.043 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:49.044 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:49.044 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:49.044 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.044 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:49.044 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:49.044 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:49.045 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:49.045 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:49.045 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:49.045 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:49.045 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:49.046 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:49.046 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:49.046 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:49.046 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:49.046 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:49.046 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:49.047 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:49.047 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:49.047 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:49.047 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:49.048 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:49.048 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:49.048 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:49.048 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:49.048 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:49.048 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:49.049 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:49.049 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:49.049 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:49.049 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:49.049 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:49.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd99c066470 msgr2=0x7fd99c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:49.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd99c066470 0x7fd99c068930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc1f6670 tx=0x7fd9ac008040 comp rx=0 tx=0).stop 2023-10-25T16:18:49.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 msgr2=0x7fd9bc1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:49.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 0x7fd9bc1571e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00b0040 tx=0x7fd9b0004040 comp rx=0 tx=0).stop 2023-10-25T16:18:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 shutdown_connections 2023-10-25T16:18:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd99c066470 0x7fd99c068930 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9bc15eba0 0x7fd9bc150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9bc0cdb10 0x7fd9bc15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 --2- 172.21.15.177:0/2193372121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9bc0b2120 0x7fd9bc1571e0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:49.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 >> 172.21.15.177:0/2193372121 conn(0x7fd9bc09a5c0 msgr2=0x7fd9bc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:49.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 shutdown_connections 2023-10-25T16:18:49.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:48.852+0000 7fd9c0b53640 1 -- 172.21.15.177:0/2193372121 wait complete. 2023-10-25T16:18:49.054 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:18:54.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:54.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/4263127424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c815bdb0 msgr2=0x7f43c80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/4263127424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c815bdb0 0x7f43c80aebc0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f43c80cdef0 tx=0x7f43c001cc80 comp rx=0 tx=0).stop 2023-10-25T16:18:54.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/4263127424 shutdown_connections 2023-10-25T16:18:54.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/4263127424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c815bdb0 0x7f43c80aebc0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/4263127424 >> v2:172.21.15.184:3300/0 conn(0x7f43c814e810 0x7f43c80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/4263127424 >> 172.21.15.177:0/4263127424 conn(0x7f43c80b2450 msgr2=0x7f43c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:54.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/4263127424 shutdown_connections 2023-10-25T16:18:54.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/4263127424 wait complete. 2023-10-25T16:18:54.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 Processor -- start 2023-10-25T16:18:54.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- start start 2023-10-25T16:18:54.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 0x7f43c813f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43c814e810 0x7f43c8149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43c815bdb0 0x7f43c80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c813ff00 con 0x7f43c80af100 2023-10-25T16:18:54.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8156a50 con 0x7f43c814e810 2023-10-25T16:18:54.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80ad650 con 0x7f43c815bdb0 2023-10-25T16:18:54.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 0x7f43c813f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 0x7f43c813f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33358/0 (socket says 172.21.15.177:33358) 2023-10-25T16:18:54.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 -- 172.21.15.177:0/1484269260 learned_addr learned my addr 172.21.15.177:0/1484269260 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:54.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43cd450640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43c815bdb0 0x7f43c80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43c814e810 0x7f43c8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 -- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43c815bdb0 msgr2=0x7f43c80ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43c815bdb0 0x7f43c80ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 -- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43c814e810 msgr2=0x7f43c8149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43c814e810 0x7f43c8149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 -- 172.21.15.177:0/1484269260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009880 con 0x7f43c80af100 2023-10-25T16:18:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43c814e810 0x7f43c8149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ccc4f640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 0x7f43c813f9c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c970 tx=0x7f43b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8007c70 con 0x7f43c80af100 2023-10-25T16:18:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f43b800f450 con 0x7f43c80af100 2023-10-25T16:18:54.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c80ad930 con 0x7f43c80af100 2023-10-25T16:18:54.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800f860 con 0x7f43c80af100 2023-10-25T16:18:54.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.192+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c80adef0 con 0x7f43c80af100 2023-10-25T16:18:54.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.196+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c80ae0e0 con 0x7f43c80af100 2023-10-25T16:18:54.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.196+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43b800f9c0 con 0x7f43c80af100 2023-10-25T16:18:54.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.196+0000 7f43c57fa640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43ac066470 0x7f43ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.196+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b8084710 con 0x7f43c80af100 2023-10-25T16:18:54.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.196+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43ac066470 0x7f43ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.196+0000 7f43c7fff640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43ac066470 0x7f43ac068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f43c00af000 tx=0x7f43c001b4c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:54.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.200+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43b8051c20 con 0x7f43c80af100 2023-10-25T16:18:54.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.352+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f43c8158d50 con 0x7f43c80af100 2023-10-25T16:18:54.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43c57fa640 1 -- 172.21.15.177:0/1484269260 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+34031 (secure 0 0 0) 0x7f43b8055240 con 0x7f43c80af100 2023-10-25T16:18:54.355 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:54.355 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:54.356 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 115, 2023-10-25T16:18:54.356 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:54.356 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:54.356 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:51.923205+0000", 2023-10-25T16:18:54.356 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:54.357 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:54.357 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:54.357 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:54.357 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:54.357 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:54.358 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:54.358 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:54.358 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:54.358 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:54.358 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:54.359 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:54.359 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:54.359 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:54.359 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:54.359 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:54.360 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:54.360 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:54.360 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:54.360 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:54.360 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:54.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:54.361 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:54.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:54.361 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:54.361 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:18:54.362 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:18:54.362 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:54.362 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:54.362 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:54.363 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:54.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:54.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:54.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:54.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:54.364 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:54.365 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:54.365 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:54.365 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:54.365 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:54.365 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:54.366 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:54.366 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:54.366 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:54.366 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.366 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:18:54.367 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:54.367 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:54.367 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:54.367 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:54.367 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:54.368 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:54.368 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:54.368 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:54.368 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:54.368 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:54.368 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:54.369 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:54.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:54.371 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:54.372 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:54.373 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:54.374 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:54.374 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:54.374 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:54.374 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:54.374 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:54.375 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:54.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.375 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:54.375 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:54.375 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.376 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:54.376 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:54.376 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:54.376 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:54.376 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:54.377 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:54.377 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:54.377 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:54.377 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:54.377 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.378 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.378 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.378 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:54.378 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:54.378 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:54.379 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:18:54.379 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:18:54.379 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:54.379 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:54.379 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:54.380 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:54.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:54.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:54.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:54.380 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:54.381 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:54.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:54.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:54.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:54.381 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:54.382 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:54.382 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:54.382 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:54.382 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:54.383 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:54.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:54.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:54.383 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:54.383 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:54.384 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.384 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:18:54.384 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:54.384 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:54.384 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:54.385 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:54.385 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:54.385 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:54.385 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:54.385 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:54.386 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:54.386 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:54.386 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:54.386 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:54.386 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:54.387 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:54.388 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:54.388 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:54.388 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:54.388 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:54.388 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:54.389 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:54.389 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:54.389 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:54.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.389 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:54.390 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:54.390 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:54.390 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:54.390 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:54.390 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:54.391 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:54.391 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:54.391 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:54.391 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:54.391 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:54.392 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:54.392 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:54.392 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:54.392 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:54.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.393 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:54.393 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:54.393 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:54.393 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.394 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:54.394 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:54.394 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:54.394 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:54.395 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:54.395 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:54.395 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:54.395 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:54.395 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:54.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.396 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.396 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:54.396 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:54.396 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:54.397 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:18:54.397 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:18:54.397 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:54.397 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:54.397 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:54.398 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:54.398 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:54.398 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:54.398 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:54.398 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:54.399 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:54.399 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:54.399 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:54.399 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:54.399 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:54.399 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:54.400 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:54.400 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:54.400 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:54.400 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:54.400 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:54.401 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:54.401 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:54.401 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:54.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.401 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:18:54.401 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:54.402 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:54.402 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:54.402 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:54.402 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:54.402 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:54.403 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:54.403 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:54.403 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:54.403 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:54.403 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:54.404 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:54.404 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:54.404 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:54.404 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:54.404 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:54.405 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:54.405 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:54.405 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:54.405 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:54.405 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:54.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.407 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:54.407 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:54.407 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:54.407 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:54.408 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:54.408 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:54.408 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:54.408 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:54.408 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:54.408 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:54.409 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:54.409 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:54.409 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:54.409 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:54.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.410 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:54.410 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:54.410 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:54.410 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.411 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:54.411 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:54.411 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:54.411 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:54.411 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:54.412 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:54.412 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:54.412 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:54.412 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:54.412 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.413 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.413 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:54.413 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:54.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.413 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:54.413 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.414 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.414 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.414 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.414 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.414 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.415 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.415 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.415 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.415 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.415 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.416 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.416 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.416 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.416 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:54.417 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.417 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.417 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:54.418 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.418 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.418 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.418 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.419 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:54.419 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.420 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.420 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:54.420 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.421 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.421 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.421 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.422 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.422 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:54.422 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.422 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.423 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.423 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:54.423 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.423 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.424 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.424 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.424 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.425 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.425 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:54.425 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.426 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.426 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:54.426 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.426 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.427 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.427 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:54.427 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:54.427 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:54.428 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:54.428 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.428 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.428 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.428 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.429 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.430 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.430 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.430 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.430 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.430 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.431 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.431 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.431 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.431 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.431 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.432 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.432 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:54.432 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.433 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.433 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:54.433 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.433 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.434 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.434 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.434 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.434 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.435 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:54.435 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.435 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.436 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:54.436 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.436 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.436 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.437 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:54.438 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.438 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.438 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:54.439 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.439 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.439 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.439 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.439 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.440 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.440 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:54.440 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.441 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.441 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:54.441 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.441 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.442 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.442 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:54.442 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:54.442 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:54.443 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:54.443 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.443 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.443 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.443 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.444 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:54.444 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.444 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.444 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.445 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.445 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.445 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.445 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.445 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:54.446 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.446 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.446 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.446 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.446 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.447 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.447 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:54.447 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.448 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.448 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:54.448 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.448 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.449 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.449 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.449 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.450 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:54.450 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.451 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:54.451 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.451 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.451 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.452 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.453 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:54.453 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.454 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.454 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.454 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:54.454 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.455 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.455 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.455 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.455 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.456 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.456 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:54.456 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.457 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.457 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:54.457 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.457 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.457 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.458 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:54.458 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:54.458 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:54.458 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:54.458 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.459 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.459 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.459 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.459 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.460 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:54.460 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.460 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.460 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.460 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.461 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.461 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.461 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.461 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.461 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.462 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.462 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.462 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.462 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.463 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.463 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:54.463 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.463 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.464 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.464 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:54.464 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.464 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.464 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.464 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.465 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.465 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.465 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.465 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:54.466 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.466 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.466 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:54.467 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.467 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.467 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.467 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.469 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.469 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:54.469 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.469 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.470 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.470 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.470 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.471 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.471 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:54.471 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.471 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.472 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.472 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:54.472 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.472 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.472 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.473 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:54.473 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:54.473 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:54.473 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:54.474 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.474 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.474 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.474 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.474 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.475 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:54.475 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.475 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.475 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.475 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.476 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.476 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.476 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.476 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.476 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.477 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.477 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.477 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.477 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.478 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.478 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:54.478 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.478 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.479 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.479 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:54.479 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.479 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.479 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.480 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.480 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.480 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.481 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:54.481 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.481 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.482 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:54.482 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.482 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.482 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.483 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.483 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.483 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.483 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.484 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:54.484 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.484 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.485 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:54.485 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.485 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.485 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.486 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.486 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.486 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.487 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:54.487 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.487 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.487 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.487 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.487 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:54.488 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.488 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.488 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.488 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.489 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.490 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.490 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.490 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.490 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:54.491 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.491 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.491 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.491 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.491 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.492 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.492 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.492 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.492 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.492 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.493 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.493 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.493 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:54.494 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.494 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.494 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:54.495 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.495 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.495 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.496 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.496 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:54.496 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.497 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.497 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:54.497 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.498 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.498 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.498 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.498 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.499 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.499 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:54.499 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.500 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.500 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:54.500 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.501 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.501 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.501 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.501 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.502 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:54.502 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.502 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.502 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.503 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:54.503 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.503 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.503 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.504 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:54.504 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:54.504 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:54.504 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:54.504 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.505 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.505 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.505 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.505 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:54.506 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.506 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.506 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.506 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.506 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.507 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.508 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.509 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:54.509 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.509 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.509 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:54.510 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.510 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.510 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.510 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.511 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.511 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.511 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:54.511 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.512 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.512 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:54.512 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.512 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.513 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.513 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.513 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.513 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.514 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.514 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:54.514 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.515 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.515 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:54.515 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.515 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.515 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.516 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.516 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.516 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.516 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:54.517 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.517 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.517 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:54.518 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:54.518 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.518 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.518 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:54.519 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:54.519 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:54.519 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:54.519 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.519 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.520 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.520 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.520 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.520 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:54.521 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.521 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.521 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.521 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.521 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.522 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.522 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.522 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.522 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.522 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.523 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.523 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.523 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.523 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.523 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.523 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:54.524 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.524 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.524 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:54.525 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.525 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.525 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.525 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.526 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:54.526 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.527 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:54.527 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.527 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.528 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.529 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.529 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.529 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.530 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:54.530 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.530 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.531 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:54.531 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.531 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.532 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.532 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.532 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.532 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:54.533 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.533 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.533 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:54.533 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:54.534 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.534 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.534 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:54.534 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:54.535 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:54.535 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:54.535 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.535 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.535 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.536 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.536 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.536 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:54.536 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:54.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.536 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:54.537 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.537 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.537 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.537 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.537 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.538 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:54.538 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.538 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:54.539 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.539 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.539 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.539 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.539 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.540 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:54.540 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.540 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:54.541 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.541 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.541 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.541 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.541 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.541 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:54.542 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.542 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:54.542 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.543 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.543 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.543 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.543 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.543 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:54.544 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.544 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.544 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:54.544 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.544 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.545 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.545 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.545 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.545 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:54.545 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.546 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.546 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:54.546 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.546 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.547 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.547 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.547 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.547 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:54.547 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.548 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:54.548 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.549 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.549 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.549 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.549 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.549 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:54.550 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.550 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:54.550 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:54.551 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:54.551 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:54.551 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:54.551 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:54.551 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:54.551 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:54.552 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.552 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:54.552 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:54.552 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:54.552 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:54.553 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:54.553 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:54.553 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:54.553 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:54.553 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:54.553 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:54.554 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:54.554 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:54.554 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:54.554 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:54.554 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:54.555 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.555 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:54.555 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:54.555 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:54.555 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:54.556 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:54.556 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:54.556 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:54.556 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:54.556 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:54.557 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:54.557 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:54.557 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.557 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:54.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43ac066470 msgr2=0x7f43ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43ac066470 0x7f43ac068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f43c00af000 tx=0x7f43c001b4c0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 msgr2=0x7f43c813f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 0x7f43c813f9c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c970 tx=0x7f43b800ce30 comp rx=0 tx=0).stop 2023-10-25T16:18:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 shutdown_connections 2023-10-25T16:18:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f43ac066470 0x7f43ac068930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43c815bdb0 0x7f43c80ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43c814e810 0x7f43c8149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 --2- 172.21.15.177:0/1484269260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80af100 0x7f43c813f9c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 >> 172.21.15.177:0/1484269260 conn(0x7f43c80b2450 msgr2=0x7f43c80afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:54.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 shutdown_connections 2023-10-25T16:18:54.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.356+0000 7f43ceeb3640 1 -- 172.21.15.177:0/1484269260 wait complete. 2023-10-25T16:18:54.562 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-25T16:18:54.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:18:54.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- 172.21.15.177:0/1309239427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 msgr2=0x7fd3640aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/1309239427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd3640aca30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fd354009840 tx=0x7fd35401c740 comp rx=0 tx=0).stop 2023-10-25T16:18:54.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- 172.21.15.177:0/1309239427 shutdown_connections 2023-10-25T16:18:54.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/1309239427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd36415bc70 0x7fd36415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/1309239427 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd3640aca30 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- 172.21.15.177:0/1309239427 >> 172.21.15.177:0/1309239427 conn(0x7fd3640cd6b0 msgr2=0x7fd3640cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:54.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- 172.21.15.177:0/1309239427 shutdown_connections 2023-10-25T16:18:54.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- 172.21.15.177:0/1309239427 wait complete. 2023-10-25T16:18:54.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 Processor -- start 2023-10-25T16:18:54.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- start start 2023-10-25T16:18:54.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd364144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd364158680 0x7fd3641f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd36415bc70 0x7fd364151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641f5690 con 0x7fd36414f1e0 2023-10-25T16:18:54.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364152320 con 0x7fd36415bc70 2023-10-25T16:18:54.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd36a0e3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd364152570 con 0x7fd364158680 2023-10-25T16:18:54.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd364144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd364144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33380/0 (socket says 172.21.15.177:33380) 2023-10-25T16:18:54.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 -- 172.21.15.177:0/2675563830 learned_addr learned my addr 172.21.15.177:0/2675563830 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:54.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd363fff640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd36415bc70 0x7fd364151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd35affd640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd364158680 0x7fd3641f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 -- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd364158680 msgr2=0x7fd3641f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd364158680 0x7fd3641f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 -- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd36415bc70 msgr2=0x7fd364151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:54.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.696+0000 7fd3637fe640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd36415bc70 0x7fd364151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:54.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd3637fe640 1 -- 172.21.15.177:0/2675563830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540094a0 con 0x7fd36414f1e0 2023-10-25T16:18:54.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd3637fe640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd364144fd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd354098320 tx=0x7fd3540a58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:54.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3540052c0 con 0x7fd36414f1e0 2023-10-25T16:18:54.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd354005510 con 0x7fd36414f1e0 2023-10-25T16:18:54.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3540056a0 con 0x7fd36414f1e0 2023-10-25T16:18:54.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36415b780 con 0x7fd36414f1e0 2023-10-25T16:18:54.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd364159ba0 con 0x7fd36414f1e0 2023-10-25T16:18:54.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36404daf0 con 0x7fd36414f1e0 2023-10-25T16:18:54.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3540b4040 con 0x7fd36414f1e0 2023-10-25T16:18:54.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd360ff9640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3440664a0 0x7fd344068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:54.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd35411ed10 con 0x7fd36414f1e0 2023-10-25T16:18:54.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd35affd640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3440664a0 0x7fd344068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:54.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.700+0000 7fd35affd640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3440664a0 0x7fd344068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0058d0 tx=0x7fd34c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:54.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.704+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3540ec2c0 con 0x7fd36414f1e0 2023-10-25T16:18:54.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.860+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd36406daa0 con 0x7fd36414f1e0 2023-10-25T16:18:54.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.864+0000 7fd360ff9640 1 -- 172.21.15.177:0/2675563830 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v115) v1 ==== 81+0+34031 (secure 0 0 0) 0x7fd3540b2020 con 0x7fd36414f1e0 2023-10-25T16:18:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:54.866 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:18:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 115, 2023-10-25T16:18:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:18:54.866 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:18:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:18:51.923205+0000", 2023-10-25T16:18:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:18:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:18:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:18:54.867 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:18:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:18:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:18:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:18:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:18:54.868 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:18:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:18:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:18:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:18:54.869 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:18:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:18:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 13, 2023-10-25T16:18:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:18:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:18:54.870 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:18:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:18:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:18:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:18:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.871 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:18:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:18:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:18:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:18:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:18:54.872 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:54.873 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:54.874 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:18:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:18:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:18:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:18:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:18:54.875 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:54.876 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:18:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:54.877 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:54.878 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:54.879 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:54.880 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:54.882 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:54.883 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:54.884 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:18:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:18:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:18:54.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.886 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:54.886 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:18:54.886 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:18:54.886 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:18:54.886 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:54.887 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:54.887 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:54.887 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:54.887 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:54.887 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.888 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.888 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 12, 2023-10-25T16:18:54.888 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:18:54.888 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:12.791580+0000", 2023-10-25T16:18:54.888 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:18:54.889 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:18:54.889 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:54.889 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:54.889 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:54.889 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:54.890 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:54.890 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:54.890 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:54.890 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:54.890 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:54.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:54.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:18:54.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:18:54.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:18:54.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:18:54.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:18:54.892 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:54.892 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:54.892 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:54.892 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:54.892 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:54.893 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:54.893 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:54.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.893 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:18:54.893 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:54.894 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:54.894 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:54.894 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:54.894 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:54.894 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:54.894 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:54.895 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:54.895 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:54.895 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:54.895 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:54.895 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:54.896 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:54.896 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:54.896 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:54.896 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:54.896 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:54.897 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:54.898 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:54.898 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:54.898 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:54.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.898 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:54.899 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:54.899 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:54.899 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:54.899 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:54.899 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:54.900 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:54.900 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:54.900 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:54.900 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:54.900 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:54.901 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:54.901 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:18:54.901 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:18:54.901 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:18:54.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.902 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:54.902 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:54.902 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:18:54.902 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.903 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:54.903 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:18:54.903 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:18:54.903 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:54.903 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:18:54.904 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:18:54.904 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:54.904 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:54.904 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:54.904 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.905 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 13, 2023-10-25T16:18:54.905 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:18:54.905 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:18:14.020998+0000", 2023-10-25T16:18:54.905 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:18:54.906 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:18:54.906 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:18:54.906 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:18:54.906 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:18:54.906 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:18:54.907 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:18:54.907 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:18:54.907 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:18:54.907 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:18:54.907 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:18:54.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:18:54.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:18:54.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:18:54.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:18:54.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:18:54.909 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:18:54.909 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:18:54.909 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:18:54.909 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:18:54.909 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:18:54.909 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:18:54.910 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:18:54.910 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:18:54.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.910 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:18:54.910 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:18:54.911 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:18:54.911 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:18:54.911 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:18:54.911 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:18:54.911 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:18:54.912 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:18:54.912 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:18:54.912 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:18:54.912 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:18:54.912 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:18:54.913 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:18:54.913 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:18:54.913 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:18:54.913 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:18:54.913 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:18:54.914 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:18:54.914 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:18:54.914 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:18:54.914 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:18:54.914 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:18:54.914 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:18:54.915 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:18:54.915 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:18:54.915 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:18:54.915 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:18:54.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.916 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:18:54.916 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:18:54.916 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:18:54.916 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:18:54.916 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:18:54.917 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:18:54.917 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:18:54.917 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:18:54.917 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:18:54.917 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:18:54.917 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:18:54.918 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:18:54.918 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:18:54.918 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:18:54.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.918 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:18:54.919 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:18:54.919 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:18:54.919 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.919 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:18:54.920 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:18:54.920 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:18:54.920 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:18:54.920 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:18:54.920 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:18:54.920 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:18:54.921 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:18:54.921 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:18:54.921 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.921 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.921 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:54.922 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:18:54.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.922 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:54.922 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.922 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.923 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.923 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.923 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.923 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.923 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.923 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.924 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.924 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.924 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.924 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.925 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.925 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:18:54.925 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.926 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.926 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:18:54.926 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.926 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.926 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.927 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.927 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.927 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.928 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:18:54.928 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.928 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.928 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.929 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:18:54.929 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.929 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.929 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.929 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.930 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:18:54.930 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.931 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.931 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:18:54.931 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.932 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.932 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.932 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.932 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:18:54.933 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.934 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.934 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:18:54.934 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:18:54.934 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.934 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.935 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:18:54.935 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:18:54.935 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:18:54.935 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:18:54.936 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.936 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.936 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.936 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.937 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:54.937 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.937 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.937 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.937 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.938 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.938 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.938 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.938 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.938 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.939 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.939 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.939 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.939 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.940 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.940 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:18:54.940 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.940 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.940 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.941 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.941 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:18:54.941 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.941 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.941 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.942 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.942 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.942 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.942 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.942 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:18:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.943 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:18:54.944 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.944 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.944 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.944 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.944 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.945 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.945 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.945 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.945 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:18:54.945 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.945 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.946 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.946 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.946 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:18:54.946 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.946 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.947 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.947 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.947 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.947 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.948 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:18:54.948 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.948 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.948 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:18:54.949 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:18:54.949 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.949 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.949 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.950 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:18:54.950 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:18:54.950 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:18:54.950 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:18:54.950 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.950 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.951 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.951 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.951 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.951 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.951 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:54.952 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.952 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.952 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.952 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.952 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.953 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.953 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.953 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:18:54.953 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.953 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.954 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.954 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.954 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.954 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:18:54.955 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.955 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.955 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.955 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.955 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:18:54.956 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.956 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.956 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.956 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.956 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.957 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.957 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.957 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:18:54.957 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.957 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.958 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.958 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.958 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:18:54.958 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.958 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.959 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.959 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.959 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.959 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.959 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.960 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:18:54.960 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.960 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.960 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.960 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.961 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:18:54.961 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.961 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.961 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.961 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:18:54.962 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:18:54.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:18:54.964 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.964 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.964 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:18:54.964 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:18:54.964 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:18:54.965 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:18:54.965 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.965 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.965 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.965 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.966 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:54.966 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.966 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.967 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.967 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.967 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.967 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.967 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.967 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.968 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.968 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.968 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.968 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.969 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.969 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:18:54.969 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.970 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.970 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:18:54.970 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.970 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.970 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.971 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.971 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.971 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.972 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:18:54.972 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.972 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.973 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:18:54.973 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.973 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.973 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.973 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.974 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.974 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:18:54.974 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.975 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.975 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:18:54.975 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.976 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.976 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.976 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.976 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.977 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:18:54.977 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.978 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.978 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:18:54.978 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:18:54.978 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.979 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.979 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:18:54.979 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:18:54.979 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:18:54.980 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:18:54.980 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.980 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.980 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.980 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.981 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:54.981 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.981 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.981 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.982 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.982 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.982 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.982 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.983 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.983 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.983 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.983 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.983 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.983 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.984 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.984 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:18:54.984 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.985 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.985 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:18:54.985 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.985 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.986 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.986 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:54.986 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.986 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.987 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:18:54.987 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.987 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:18:54.988 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.988 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.988 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:18:54.989 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.990 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.990 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:18:54.990 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.992 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:18:54.992 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.993 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.993 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:18:54.993 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:18:54.993 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:54.993 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.994 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:18:54.994 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:18:54.994 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:18:54.994 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:18:54.995 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:54.995 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:54.995 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:54.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:54.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.996 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:54.996 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:54.996 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:54.996 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:54.996 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:54.997 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:54.997 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:54.997 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:54.997 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:54.997 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:54.997 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:54.998 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:54.998 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:54.998 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:54.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.998 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:54.999 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:18:54.999 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:54.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:54.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:54.999 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:54.999 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:18:55.000 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.000 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.000 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.000 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.000 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:18:55.001 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.002 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.002 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:18:55.002 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.002 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.003 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.003 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:55.003 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:18:55.004 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:18:55.005 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.005 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.006 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:55.006 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.006 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.006 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:18:55.006 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.007 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.007 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.007 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:18:55.007 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:18:55.008 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.008 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.008 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:18:55.008 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:18:55.008 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:18:55.009 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:18:55.009 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:55.009 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:55.009 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:55.009 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.010 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:55.010 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:55.010 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:55.011 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:55.011 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:55.011 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:55.011 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:55.011 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:55.011 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:55.012 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:55.012 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:55.012 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:55.012 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:55.012 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.013 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.013 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:18:55.013 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.014 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.014 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:18:55.014 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.014 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.014 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.015 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:55.015 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.015 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.016 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:18:55.016 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.016 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.016 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.016 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:18:55.017 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.017 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.017 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:55.018 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.018 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:18:55.018 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.019 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.019 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:18:55.019 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.020 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.020 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:55.020 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.020 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.021 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:18:55.021 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.021 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.022 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:18:55.022 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:18:55.022 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.022 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.023 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:18:55.023 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:18:55.023 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:18:55.023 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:18:55.023 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:55.023 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:55.024 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:55.024 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.024 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.024 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:55.025 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:18:55.025 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:18:55.025 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:18:55.025 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:18:55.025 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:18:55.025 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:18:55.026 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:18:55.026 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:18:55.026 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 103, 2023-10-25T16:18:55.026 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:18:55.026 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:18:55.027 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:18:55.027 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.027 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.027 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.027 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:18:55.028 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.028 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.028 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.028 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.028 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:18:55.028 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.029 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.029 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.029 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.029 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:18:55.029 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.030 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.030 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:18:55.030 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.030 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.030 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.031 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.031 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:18:55.031 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.031 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.031 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.032 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.032 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:18:55.032 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.032 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.032 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.032 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:18:55.033 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.033 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.033 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:18:55.034 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.034 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.034 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.034 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:18:55.035 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:18:55.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.035 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:18:55.035 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:18:55.035 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.035 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.036 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:18:55.036 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:18:55.036 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:18:55.036 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.037 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.037 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.037 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:18:55.037 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:18:55.037 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:18:55.038 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:18:55.038 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:18:55.038 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:18:55.038 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:18:55.038 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:18:55.039 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.039 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:55.039 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:18:55.039 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.039 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:18:55.040 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.040 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.040 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.040 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.040 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.040 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:18:55.041 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.041 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.041 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:18:55.041 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.042 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.042 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.042 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.042 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.042 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:18:55.043 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.043 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.043 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.043 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:18:55.043 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.044 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.044 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.044 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.044 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.044 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:18:55.044 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.045 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.045 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.045 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:18:55.045 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.045 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.046 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.046 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.046 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.046 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:18:55.046 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:18:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.048 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.048 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.048 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:18:55.048 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.049 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.049 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:18:55.049 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.049 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.049 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.050 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.050 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.050 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:18:55.050 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.050 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.050 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.051 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:18:55.051 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.051 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.051 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.051 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.052 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.052 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:18:55.052 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.052 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.052 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:18:55.052 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:18:55.053 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:18:55.053 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:18:55.053 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:18:55.053 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:18:55.053 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:18:55.054 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:18:55.054 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:18:55.054 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.054 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:18:55.054 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:18:55.055 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:18:55.055 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:18:55.055 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:18:55.055 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:18:55.055 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:18:55.055 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:18:55.056 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:18:55.056 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:18:55.056 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:18:55.056 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:18:55.056 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:18:55.056 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:18:55.057 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:18:55.057 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.057 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:18:55.057 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:18:55.057 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:18:55.058 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:18:55.058 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:18:55.058 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:18:55.058 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:18:55.058 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:18:55.059 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:18:55.059 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:18:55.059 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:18:55.059 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:18:55.059 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:18:55.060 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:18:55.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.864+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3440664a0 msgr2=0x7fd344068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.864+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3440664a0 0x7fd344068960 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0058d0 tx=0x7fd34c005860 comp rx=0 tx=0).stop 2023-10-25T16:18:55.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.864+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 msgr2=0x7fd364144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.864+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd364144fd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fd354098320 tx=0x7fd3540a58c0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 shutdown_connections 2023-10-25T16:18:55.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3440664a0 0x7fd344068960 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd36415bc70 0x7fd364151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd364158680 0x7fd3641f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 --2- 172.21.15.177:0/2675563830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd36414f1e0 0x7fd364144fd0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 >> 172.21.15.177:0/2675563830 conn(0x7fd3640cd6b0 msgr2=0x7fd364158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:55.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 shutdown_connections 2023-10-25T16:18:55.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:54.868+0000 7fd36a0e3640 1 -- 172.21.15.177:0/2675563830 wait complete. 2023-10-25T16:18:55.064 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:55.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- 172.21.15.177:0/3422577644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80c9f90 msgr2=0x7fc9c815b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 --2- 172.21.15.177:0/3422577644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80c9f90 0x7fc9c815b1f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009c80 tx=0x7fc9c001cd40 comp rx=0 tx=0).stop 2023-10-25T16:18:55.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- 172.21.15.177:0/3422577644 shutdown_connections 2023-10-25T16:18:55.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 --2- 172.21.15.177:0/3422577644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80c9f90 0x7fc9c815b1f0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 --2- 172.21.15.177:0/3422577644 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9c8156e60 0x7fc9c80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- 172.21.15.177:0/3422577644 >> 172.21.15.177:0/3422577644 conn(0x7fc9c80b0de0 msgr2=0x7fc9c80b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:55.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- 172.21.15.177:0/3422577644 shutdown_connections 2023-10-25T16:18:55.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- 172.21.15.177:0/3422577644 wait complete. 2023-10-25T16:18:55.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 Processor -- start 2023-10-25T16:18:55.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- start start 2023-10-25T16:18:55.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9c80c9f90 0x7fc9c81479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:55.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 0x7fc9c8154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:55.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9c8156e60 0x7fc9c80b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:55.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8147f10 con 0x7fc9c80cbd20 2023-10-25T16:18:55.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c814d650 con 0x7fc9c8156e60 2023-10-25T16:18:55.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cef43640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8150750 con 0x7fc9c80c9f90 2023-10-25T16:18:55.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 0x7fc9c8154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:55.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 0x7fc9c8154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33408/0 (socket says 172.21.15.177:33408) 2023-10-25T16:18:55.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 -- 172.21.15.177:0/2406210742 learned_addr learned my addr 172.21.15.177:0/2406210742 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:55.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cccdf640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9c80c9f90 0x7fc9c81479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:55.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9cd4e0640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9c8156e60 0x7fc9c80b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:55.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 -- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9c80c9f90 msgr2=0x7fc9c81479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9c80c9f90 0x7fc9c81479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 -- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9c8156e60 msgr2=0x7fc9c80b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9c8156e60 0x7fc9c80b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.196+0000 7fc9c7fff640 1 -- 172.21.15.177:0/2406210742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00098e0 con 0x7fc9c80cbd20 2023-10-25T16:18:55.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c7fff640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 0x7fc9c8154380 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c450 tx=0x7fc9bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:55.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc012830 con 0x7fc9c80cbd20 2023-10-25T16:18:55.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc9bc012aa0 con 0x7fc9c80cbd20 2023-10-25T16:18:55.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c8150a30 con 0x7fc9c80cbd20 2023-10-25T16:18:55.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc011380 con 0x7fc9c80cbd20 2023-10-25T16:18:55.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c8150d10 con 0x7fc9c80cbd20 2023-10-25T16:18:55.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c804daf0 con 0x7fc9c80cbd20 2023-10-25T16:18:55.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc9bc0114e0 con 0x7fc9c80cbd20 2023-10-25T16:18:55.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c57fa640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc9b4066470 0x7fc9b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:55.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc9bc083fb0 con 0x7fc9c80cbd20 2023-10-25T16:18:55.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9cccdf640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc9b4066470 0x7fc9b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:55.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.200+0000 7fc9cccdf640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc9b4066470 0x7fc9b4068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80058d0 tx=0x7fc9b8005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:55.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.204+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc9bc0b5090 con 0x7fc9c80cbd20 2023-10-25T16:18:55.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.388+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9c8065cf0 con 0x7fc9c80cbd20 2023-10-25T16:18:55.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.388+0000 7fc9c57fa640 1 -- 172.21.15.177:0/2406210742 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fc9bc051410 con 0x7fc9c80cbd20 2023-10-25T16:18:55.389 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:55.389 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:18:55.389 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:18:55.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc9b4066470 msgr2=0x7fc9b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc9b4066470 0x7fc9b4068930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80058d0 tx=0x7fc9b8005860 comp rx=0 tx=0).stop 2023-10-25T16:18:55.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 msgr2=0x7fc9c8154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:55.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 0x7fc9c8154380 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c450 tx=0x7fc9bc00c910 comp rx=0 tx=0).stop 2023-10-25T16:18:55.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 shutdown_connections 2023-10-25T16:18:55.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc9b4066470 0x7fc9b4068930 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9c8156e60 0x7fc9c80b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9c80cbd20 0x7fc9c8154380 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 --2- 172.21.15.177:0/2406210742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9c80c9f90 0x7fc9c81479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:55.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 >> 172.21.15.177:0/2406210742 conn(0x7fc9c80b0de0 msgr2=0x7fc9c8159890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:55.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 shutdown_connections 2023-10-25T16:18:55.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:55.392+0000 7fc9cef43640 1 -- 172.21.15.177:0/2406210742 wait complete. 2023-10-25T16:18:55.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:18:55.553 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155378,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":39.815906693000002,"mdsmap_epoch":38,"osdmap_epoch":116,"osdmap_epoch_barrier":110,"uptime":45.032086333999999} 2023-10-25T16:18:55.554 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155378, "mdsmap_epoch": 38, "osdmap_epoch": 116, "osdmap_epoch_barrier": 110, "rank_uptime": 39.815906693, "state": "up:active", "uptime": 45.032086334, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:18:55.554 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:18:55.555 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:55.555 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:55.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:55.563 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-25T16:18:55.961 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records in 2023-10-25T16:18:55.961 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records out 2023-10-25T16:18:55.961 INFO:teuthology.orchestra.run.smithi177.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.346028 s, 152 MB/s 2023-10-25T16:18:55.962 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:18:55.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:18:56.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:18:56.055 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:18:56.055 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:56.056 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:56.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- 172.21.15.177:0/3179251890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf40cb530 msgr2=0x7fecf40cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/3179251890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf40cb530 0x7fecf40cb960 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fecec009c80 tx=0x7fecec01cd10 comp rx=0 tx=0).stop 2023-10-25T16:18:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- 172.21.15.177:0/3179251890 shutdown_connections 2023-10-25T16:18:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/3179251890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf40cb530 0x7fecf40cb960 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/3179251890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf406c110 0x7fecf40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- 172.21.15.177:0/3179251890 >> 172.21.15.177:0/3179251890 conn(0x7fecf40b2450 msgr2=0x7fecf40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- 172.21.15.177:0/3179251890 shutdown_connections 2023-10-25T16:18:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- 172.21.15.177:0/3179251890 wait complete. 2023-10-25T16:18:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 Processor -- start 2023-10-25T16:18:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- start start 2023-10-25T16:18:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 0x7fecf4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf40cb530 0x7fecf4070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecf4140db0 0x7fecf4130e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf412e1e0 con 0x7fecf406c110 2023-10-25T16:18:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf412e4c0 con 0x7fecf4140db0 2023-10-25T16:18:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.232+0000 7fecf9ffa640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf412e7a0 con 0x7fecf40cb530 2023-10-25T16:18:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 0x7fecf4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 0x7fecf4157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33416/0 (socket says 172.21.15.177:33416) 2023-10-25T16:18:56.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 -- 172.21.15.177:0/319945869 learned_addr learned my addr 172.21.15.177:0/319945869 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:56.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf3fff640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecf4140db0 0x7fecf4130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf2ffd640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf40cb530 0x7fecf4070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 -- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf40cb530 msgr2=0x7fecf4070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf40cb530 0x7fecf4070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 -- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecf4140db0 msgr2=0x7fecf4130e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecf4140db0 0x7fecf4130e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 -- 172.21.15.177:0/319945869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0098e0 con 0x7fecf406c110 2023-10-25T16:18:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf2ffd640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf40cb530 0x7fecf4070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf37fe640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 0x7fecf4157910 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fece400b410 tx=0x7fece400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4004020 con 0x7fecf406c110 2023-10-25T16:18:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fece4004270 con 0x7fecf406c110 2023-10-25T16:18:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf412ea80 con 0x7fecf406c110 2023-10-25T16:18:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4011890 con 0x7fecf406c110 2023-10-25T16:18:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf4158090 con 0x7fecf406c110 2023-10-25T16:18:56.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf404daf0 con 0x7fecf406c110 2023-10-25T16:18:56.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fece4003600 con 0x7fecf406c110 2023-10-25T16:18:56.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecdbfff640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fece00664a0 0x7fece0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fece4083d00 con 0x7fecf406c110 2023-10-25T16:18:56.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.236+0000 7fecf2ffd640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fece00664a0 0x7fece0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.240+0000 7fecf2ffd640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fece00664a0 0x7fece0068960 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fecf4070180 tx=0x7fece800a5c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:56.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.240+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fece40511f0 con 0x7fecf406c110 2023-10-25T16:18:56.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.396+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecf406f700 con 0x7fecf406c110 2023-10-25T16:18:56.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.400+0000 7fecdbfff640 1 -- 172.21.15.177:0/319945869 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fece4054810 con 0x7fecf406c110 2023-10-25T16:18:56.400 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:56.401 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":117,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:55.953293+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:56.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fece00664a0 msgr2=0x7fece0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fece00664a0 0x7fece0068960 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fecf4070180 tx=0x7fece800a5c0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 msgr2=0x7fecf4157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 0x7fecf4157910 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fece400b410 tx=0x7fece400b8d0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 shutdown_connections 2023-10-25T16:18:56.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fece00664a0 0x7fece0068960 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecf4140db0 0x7fecf4130e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fecf40cb530 0x7fecf4070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 --2- 172.21.15.177:0/319945869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fecf406c110 0x7fecf4157910 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 >> 172.21.15.177:0/319945869 conn(0x7fecf40b2450 msgr2=0x7fecf415ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:56.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 shutdown_connections 2023-10-25T16:18:56.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.404+0000 7fecf9ffa640 1 -- 172.21.15.177:0/319945869 wait complete. 2023-10-25T16:18:56.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:18:12.791580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:18:14.020998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:18:56.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:18:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- 172.21.15.177:0/2000419086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a806c160 msgr2=0x7fe4a80af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 --2- 172.21.15.177:0/2000419086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a806c160 0x7fe4a80af5d0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe498009860 tx=0x7fe49801c750 comp rx=0 tx=0).stop 2023-10-25T16:18:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- 172.21.15.177:0/2000419086 shutdown_connections 2023-10-25T16:18:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 --2- 172.21.15.177:0/2000419086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a806c160 0x7fe4a80af5d0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- 172.21.15.177:0/2000419086 >> 172.21.15.177:0/2000419086 conn(0x7fe4a80b2450 msgr2=0x7fe4a80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- 172.21.15.177:0/2000419086 shutdown_connections 2023-10-25T16:18:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- 172.21.15.177:0/2000419086 wait complete. 2023-10-25T16:18:56.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 Processor -- start 2023-10-25T16:18:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- start start 2023-10-25T16:18:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4a806c160 0x7fe4a80aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4a806f570 0x7fe4a8154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 0x7fe4a80adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8140510 con 0x7fe4a8140cf0 2023-10-25T16:18:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8139a90 con 0x7fe4a806c160 2023-10-25T16:18:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4afb89640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a81553e0 con 0x7fe4a806f570 2023-10-25T16:18:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 0x7fe4a80adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 0x7fe4a80adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33444/0 (socket says 172.21.15.177:33444) 2023-10-25T16:18:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 -- 172.21.15.177:0/3105413106 learned_addr learned my addr 172.21.15.177:0/3105413106 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ad124640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4a806f570 0x7fe4a8154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ad925640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4a806c160 0x7fe4a80aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 -- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4a806f570 msgr2=0x7fe4a8154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4a806f570 0x7fe4a8154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 -- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4a806c160 msgr2=0x7fe4a80aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4a806c160 0x7fe4a80aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 -- 172.21.15.177:0/3105413106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe498009440 con 0x7fe4a8140cf0 2023-10-25T16:18:56.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe4ae126640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 0x7fe4a80adbf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000cbc0 tx=0x7fe4a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:56.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000aa50 con 0x7fe4a8140cf0 2023-10-25T16:18:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe4a000aca0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.552+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0012680 con 0x7fe4a8140cf0 2023-10-25T16:18:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a813a7c0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a813ffe0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a8139bd0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe4a001b400 con 0x7fe4a8140cf0 2023-10-25T16:18:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe49e7fc640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe48c066470 0x7fe48c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe4a0084660 con 0x7fe4a8140cf0 2023-10-25T16:18:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe4ad925640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe48c066470 0x7fe48c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.556+0000 7fe4ad925640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe48c066470 0x7fe48c068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40015b0 tx=0x7fe4a4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:56.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.560+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4a8139bd0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.716+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4a8139bd0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.716+0000 7fe49e7fc640 1 -- 172.21.15.177:0/3105413106 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4a8139bd0 con 0x7fe4a8140cf0 2023-10-25T16:18:56.718 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:18:56.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe48c066470 msgr2=0x7fe48c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe48c066470 0x7fe48c068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40015b0 tx=0x7fe4a4009040 comp rx=0 tx=0).stop 2023-10-25T16:18:56.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 msgr2=0x7fe4a80adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 0x7fe4a80adbf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000cbc0 tx=0x7fe4a000ccb0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 shutdown_connections 2023-10-25T16:18:56.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe48c066470 0x7fe48c068930 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4a8140cf0 0x7fe4a80adbf0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4a806f570 0x7fe4a8154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 --2- 172.21.15.177:0/3105413106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4a806c160 0x7fe4a80aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 >> 172.21.15.177:0/3105413106 conn(0x7fe4a80b2450 msgr2=0x7fe4a81386c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:56.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 shutdown_connections 2023-10-25T16:18:56.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.720+0000 7fe4afb89640 1 -- 172.21.15.177:0/3105413106 wait complete. 2023-10-25T16:18:56.737 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:18:56.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 -- 172.21.15.177:0/2868885160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 msgr2=0x7fd8840af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2868885160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd8840af5d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0098f0 tx=0x7fd86c01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 -- 172.21.15.177:0/2868885160 shutdown_connections 2023-10-25T16:18:56.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2868885160 >> v2:172.21.15.184:3300/0 conn(0x7fd88406f570 0x7fd8840cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2868885160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd8840af5d0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 -- 172.21.15.177:0/2868885160 >> 172.21.15.177:0/2868885160 conn(0x7fd8840b2450 msgr2=0x7fd8840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 -- 172.21.15.177:0/2868885160 shutdown_connections 2023-10-25T16:18:56.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 -- 172.21.15.177:0/2868885160 wait complete. 2023-10-25T16:18:56.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 Processor -- start 2023-10-25T16:18:56.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 -- start start 2023-10-25T16:18:56.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.868+0000 7fd889f0d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd884136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd88406f570 0x7fd88415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd884140cf0 0x7fd884137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841594b0 con 0x7fd88406c160 2023-10-25T16:18:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd884159790 con 0x7fd884140cf0 2023-10-25T16:18:56.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd884159a70 con 0x7fd88406f570 2023-10-25T16:18:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd884136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd884136100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33456/0 (socket says 172.21.15.177:33456) 2023-10-25T16:18:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 -- 172.21.15.177:0/2423902415 learned_addr learned my addr 172.21.15.177:0/2423902415 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd87bfff640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd88406f570 0x7fd88415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd883fff640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd884140cf0 0x7fd884137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 -- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd88406f570 msgr2=0x7fd88415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd88406f570 0x7fd88415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 -- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd884140cf0 msgr2=0x7fd884137a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd884140cf0 0x7fd884137a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:56.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 -- 172.21.15.177:0/2423902415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c009500 con 0x7fd88406c160 2023-10-25T16:18:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd87bfff640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd88406f570 0x7fd88415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:18:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd8837fe640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd884136100 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd87400b410 tx=0x7fd87400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874004020 con 0x7fd88406c160 2023-10-25T16:18:56.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd874004270 con 0x7fd88406c160 2023-10-25T16:18:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd884159d50 con 0x7fd88406c160 2023-10-25T16:18:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874011890 con 0x7fd88406c160 2023-10-25T16:18:56.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd884136640 con 0x7fd88406c160 2023-10-25T16:18:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8840c9780 con 0x7fd88406c160 2023-10-25T16:18:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd874003600 con 0x7fd88406c160 2023-10-25T16:18:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd880ff9640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8640664a0 0x7fd864068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:56.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd874083f10 con 0x7fd88406c160 2023-10-25T16:18:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.872+0000 7fd87bfff640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8640664a0 0x7fd864068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.876+0000 7fd87bfff640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8640664a0 0x7fd864068960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0ae000 tx=0x7fd86c0b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:56.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:56.876+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8740512e0 con 0x7fd88406c160 2023-10-25T16:18:57.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.032+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd88404daf0 con 0x7fd88406c160 2023-10-25T16:18:57.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.032+0000 7fd880ff9640 1 -- 172.21.15.177:0/2423902415 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd874054900 con 0x7fd88406c160 2023-10-25T16:18:57.033 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:18:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8640664a0 msgr2=0x7fd864068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8640664a0 0x7fd864068960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0ae000 tx=0x7fd86c0b3040 comp rx=0 tx=0).stop 2023-10-25T16:18:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 msgr2=0x7fd884136100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd884136100 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd87400b410 tx=0x7fd87400b8d0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 shutdown_connections 2023-10-25T16:18:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd8640664a0 0x7fd864068960 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd884140cf0 0x7fd884137a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd88406f570 0x7fd88415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 --2- 172.21.15.177:0/2423902415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd88406c160 0x7fd884136100 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 >> 172.21.15.177:0/2423902415 conn(0x7fd8840b2450 msgr2=0x7fd8840cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 shutdown_connections 2023-10-25T16:18:57.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.036+0000 7fd889f0d640 1 -- 172.21.15.177:0/2423902415 wait complete. 2023-10-25T16:18:57.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:18:57.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 -- 172.21.15.177:0/1468982918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c006f570 msgr2=0x7f28c006ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/1468982918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c006f570 0x7f28c006ba50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f28b4005fd0 tx=0x7f28b401c730 comp rx=0 tx=0).stop 2023-10-25T16:18:57.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 -- 172.21.15.177:0/1468982918 shutdown_connections 2023-10-25T16:18:57.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/1468982918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c006f570 0x7f28c006ba50 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/1468982918 >> v2:172.21.15.184:3300/0 conn(0x7f28c0140cf0 0x7f28c00af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 -- 172.21.15.177:0/1468982918 >> 172.21.15.177:0/1468982918 conn(0x7f28c00b2450 msgr2=0x7f28c00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:57.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 -- 172.21.15.177:0/1468982918 shutdown_connections 2023-10-25T16:18:57.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.180+0000 7f28c4b2e640 1 -- 172.21.15.177:0/1468982918 wait complete. 2023-10-25T16:18:57.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 Processor -- start 2023-10-25T16:18:57.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- start start 2023-10-25T16:18:57.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28c006bf90 0x7f28c015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28c006f570 0x7f28c01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 0x7f28c0158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0159e10 con 0x7f28c0140cf0 2023-10-25T16:18:57.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c015a7e0 con 0x7f28c006bf90 2023-10-25T16:18:57.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0159200 con 0x7f28c006f570 2023-10-25T16:18:57.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 0x7f28c0158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 0x7f28c0158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33472/0 (socket says 172.21.15.177:33472) 2023-10-25T16:18:57.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 -- 172.21.15.177:0/360965161 learned_addr learned my addr 172.21.15.177:0/360965161 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:57.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28be59c640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28c006bf90 0x7f28c015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bdd9b640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28c006f570 0x7f28c01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 -- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28c006f570 msgr2=0x7f28c01577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28c006f570 0x7f28c01577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 -- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28c006bf90 msgr2=0x7f28c015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28c006bf90 0x7f28c015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 -- 172.21.15.177:0/360965161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009450 con 0x7f28c0140cf0 2023-10-25T16:18:57.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bdd9b640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28c006f570 0x7f28c01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:57.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28be59c640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28c006bf90 0x7f28c015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:57.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28bed9d640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 0x7f28c0158860 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f28b800cb40 tx=0x7f28b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:57.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800aa50 con 0x7f28c0140cf0 2023-10-25T16:18:57.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f28b800aca0 con 0x7f28c0140cf0 2023-10-25T16:18:57.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8012680 con 0x7f28c0140cf0 2023-10-25T16:18:57.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c01594e0 con 0x7f28c0140cf0 2023-10-25T16:18:57.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c0159aa0 con 0x7f28c0140cf0 2023-10-25T16:18:57.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.184+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c0159f80 con 0x7f28c0140cf0 2023-10-25T16:18:57.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.188+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f28b801a3b0 con 0x7f28c0140cf0 2023-10-25T16:18:57.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.188+0000 7f28aeffd640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28a0066470 0x7f28a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.188+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f28b8084040 con 0x7f28c0140cf0 2023-10-25T16:18:57.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.188+0000 7f28be59c640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28a0066470 0x7f28a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.188+0000 7f28be59c640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28a0066470 0x7f28a0068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f28b0005fd0 tx=0x7f28b0005dc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:57.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.192+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28b8051530 con 0x7f28c0140cf0 2023-10-25T16:18:57.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.344+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28c006c3a0 con 0x7f28c0140cf0 2023-10-25T16:18:57.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.344+0000 7f28aeffd640 1 -- 172.21.15.177:0/360965161 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28b8016020 con 0x7f28c0140cf0 2023-10-25T16:18:57.345 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:18:57.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28a0066470 msgr2=0x7f28a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28a0066470 0x7f28a0068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f28b0005fd0 tx=0x7f28b0005dc0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 msgr2=0x7f28c0158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 0x7f28c0158860 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f28b800cb40 tx=0x7f28b800cc30 comp rx=0 tx=0).stop 2023-10-25T16:18:57.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 shutdown_connections 2023-10-25T16:18:57.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f28a0066470 0x7f28a0068930 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28c0140cf0 0x7f28c0158860 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28c006f570 0x7f28c01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 --2- 172.21.15.177:0/360965161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28c006bf90 0x7f28c015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 >> 172.21.15.177:0/360965161 conn(0x7f28c00b2450 msgr2=0x7f28c00cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:57.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 shutdown_connections 2023-10-25T16:18:57.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.348+0000 7f28c4b2e640 1 -- 172.21.15.177:0/360965161 wait complete. 2023-10-25T16:18:57.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:18:57.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2993843105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 msgr2=0x7fd8480b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2993843105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd8480b11e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd840009c80 tx=0x7fd84001f580 comp rx=0 tx=0).stop 2023-10-25T16:18:57.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2993843105 shutdown_connections 2023-10-25T16:18:57.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2993843105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd8480b11e0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2993843105 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 0x7fd8480b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2993843105 >> 172.21.15.177:0/2993843105 conn(0x7fd84809a5a0 msgr2=0x7fd8480d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:57.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2993843105 shutdown_connections 2023-10-25T16:18:57.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2993843105 wait complete. 2023-10-25T16:18:57.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 Processor -- start 2023-10-25T16:18:57.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- start start 2023-10-25T16:18:57.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8480cf0a0 0x7fd8480c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd848158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 0x7fd8480af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c8530 con 0x7fd8480cffb0 2023-10-25T16:18:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c8810 con 0x7fd8480cf0a0 2023-10-25T16:18:57.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c8af0 con 0x7fd84815b6c0 2023-10-25T16:18:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd848158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd848158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33486/0 (socket says 172.21.15.177:33486) 2023-10-25T16:18:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 -- 172.21.15.177:0/2955859166 learned_addr learned my addr 172.21.15.177:0/2955859166 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd846ffd640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8480cf0a0 0x7fd8480c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd8477fe640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 0x7fd8480af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 -- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 msgr2=0x7fd8480af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 0x7fd8480af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 -- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8480cf0a0 msgr2=0x7fd8480c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8480cf0a0 0x7fd8480c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 -- 172.21.15.177:0/2955859166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400098e0 con 0x7fd8480cffb0 2023-10-25T16:18:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd8477fe640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 0x7fd8480af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83e7fc640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd848158ac0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c500 tx=0x7fd83000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830005220 con 0x7fd8480cffb0 2023-10-25T16:18:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd830005470 con 0x7fd8480cffb0 2023-10-25T16:18:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830007290 con 0x7fd8480cffb0 2023-10-25T16:18:57.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c8dd0 con 0x7fd8480cffb0 2023-10-25T16:18:57.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.488+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480af850 con 0x7fd8480cffb0 2023-10-25T16:18:57.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.492+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480c9b10 con 0x7fd8480cffb0 2023-10-25T16:18:57.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.492+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8300073f0 con 0x7fd8480cffb0 2023-10-25T16:18:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.492+0000 7fd83ffff640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd828066470 0x7fd828068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.492+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd830084430 con 0x7fd8480cffb0 2023-10-25T16:18:57.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.492+0000 7fd846ffd640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd828066470 0x7fd828068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.492+0000 7fd846ffd640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd828066470 0x7fd828068930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd8380058d0 tx=0x7fd838005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:57.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.496+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd830051920 con 0x7fd8480cffb0 2023-10-25T16:18:57.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd8480c9280 con 0x7fd8480cffb0 2023-10-25T16:18:57.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd83ffff640 1 -- 172.21.15.177:0/2955859166 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd830054f40 con 0x7fd8480cffb0 2023-10-25T16:18:57.648 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:18:57.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd828066470 msgr2=0x7fd828068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd828066470 0x7fd828068930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd8380058d0 tx=0x7fd838005860 comp rx=0 tx=0).stop 2023-10-25T16:18:57.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 msgr2=0x7fd848158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd848158ac0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c500 tx=0x7fd83000c9c0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 shutdown_connections 2023-10-25T16:18:57.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd828066470 0x7fd828068930 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd84815b6c0 0x7fd8480af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8480cffb0 0x7fd848158ac0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 --2- 172.21.15.177:0/2955859166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8480cf0a0 0x7fd8480c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 >> 172.21.15.177:0/2955859166 conn(0x7fd84809a5a0 msgr2=0x7fd8480ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:57.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 shutdown_connections 2023-10-25T16:18:57.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.648+0000 7fd84d54a640 1 -- 172.21.15.177:0/2955859166 wait complete. 2023-10-25T16:18:57.665 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:18:57.666 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:57.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:18:57.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:57.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[46230]: fuse finished with error 0 and tester_r 0 2023-10-25T16:18:57.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:57.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:18:57.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:57.724 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:18:57.793 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:18:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:57.800 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:18:57.800 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:57.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:57.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 -- 172.21.15.177:0/2848892034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3998070510 msgr2=0x7f39980cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2848892034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3998070510 0x7f39980cc0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3980009840 tx=0x7f398001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 -- 172.21.15.177:0/2848892034 shutdown_connections 2023-10-25T16:18:57.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2848892034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3998070510 0x7f39980cc0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2848892034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3998159230 0x7f3998071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 -- 172.21.15.177:0/2848892034 >> 172.21.15.177:0/2848892034 conn(0x7f39980b2450 msgr2=0x7f39980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:57.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 -- 172.21.15.177:0/2848892034 shutdown_connections 2023-10-25T16:18:57.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 -- 172.21.15.177:0/2848892034 wait complete. 2023-10-25T16:18:57.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.960+0000 7f399d8f6640 1 Processor -- start 2023-10-25T16:18:57.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- start start 2023-10-25T16:18:57.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3998070510 0x7f399814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39980cc610 0x7f39980b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 0x7f3998154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39980b1bb0 con 0x7f3998159230 2023-10-25T16:18:57.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399814a780 con 0x7f39980cc610 2023-10-25T16:18:57.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39980b0f30 con 0x7f3998070510 2023-10-25T16:18:57.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 0x7f3998154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 0x7f3998154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33488/0 (socket says 172.21.15.177:33488) 2023-10-25T16:18:57.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 -- 172.21.15.177:0/2013856516 learned_addr learned my addr 172.21.15.177:0/2013856516 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:57.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39967fc640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39980cc610 0x7f39980b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f3996ffd640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3998070510 0x7f399814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 -- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3998070510 msgr2=0x7f399814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3998070510 0x7f399814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 -- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39980cc610 msgr2=0x7f39980b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:57.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39980cc610 0x7f39980b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:57.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 -- 172.21.15.177:0/2013856516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880098e0 con 0x7f3998159230 2023-10-25T16:18:57.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f39977fe640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 0x7f3998154900 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f399000c390 tx=0x7f399000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:57.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900052d0 con 0x7f3998159230 2023-10-25T16:18:57.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3990007020 con 0x7f3998159230 2023-10-25T16:18:57.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3980009450 con 0x7f3998159230 2023-10-25T16:18:57.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990007410 con 0x7f3998159230 2023-10-25T16:18:57.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39980b14f0 con 0x7f3998159230 2023-10-25T16:18:57.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39980b1cf0 con 0x7f3998159230 2023-10-25T16:18:57.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3990007570 con 0x7f3998159230 2023-10-25T16:18:57.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f398ffff640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3978066470 0x7f3978068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:57.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3990083490 con 0x7f3998159230 2023-10-25T16:18:57.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.964+0000 7f3996ffd640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3978066470 0x7f3978068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:57.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.968+0000 7f3996ffd640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3978066470 0x7f3978068930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3998158820 tx=0x7f39880095c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:57.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:57.968+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39980b1cf0 con 0x7f3998159230 2023-10-25T16:18:58.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.112+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39980b1cf0 con 0x7f3998159230 2023-10-25T16:18:58.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f398ffff640 1 -- 172.21.15.177:0/2013856516 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f39980b1cf0 con 0x7f3998159230 2023-10-25T16:18:58.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:58.115 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":117,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:55.953293+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:18:58.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3978066470 msgr2=0x7f3978068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3978066470 0x7f3978068930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3998158820 tx=0x7f39880095c0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 msgr2=0x7f3998154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 0x7f3998154900 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f399000c390 tx=0x7f399000c850 comp rx=0 tx=0).stop 2023-10-25T16:18:58.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 shutdown_connections 2023-10-25T16:18:58.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3978066470 0x7f3978068930 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3998159230 0x7f3998154900 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39980cc610 0x7f39980b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 --2- 172.21.15.177:0/2013856516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3998070510 0x7f399814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 >> 172.21.15.177:0/2013856516 conn(0x7f39980b2450 msgr2=0x7f399806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:58.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 shutdown_connections 2023-10-25T16:18:58.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.116+0000 7f399d8f6640 1 -- 172.21.15.177:0/2013856516 wait complete. 2023-10-25T16:18:58.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:18:12.791580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:18:14.020998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:18:58.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:18:58.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 -- 172.21.15.177:0/3034270081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef1015b1f0 msgr2=0x7fef1015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 --2- 172.21.15.177:0/3034270081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef1015b1f0 0x7fef1015b660 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fef08009c80 tx=0x7fef0801cd80 comp rx=0 tx=0).stop 2023-10-25T16:18:58.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 -- 172.21.15.177:0/3034270081 shutdown_connections 2023-10-25T16:18:58.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 --2- 172.21.15.177:0/3034270081 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef1015b1f0 0x7fef1015b660 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 --2- 172.21.15.177:0/3034270081 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef100c9880 0x7fef100c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 -- 172.21.15.177:0/3034270081 >> 172.21.15.177:0/3034270081 conn(0x7fef100b0de0 msgr2=0x7fef100b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:58.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 -- 172.21.15.177:0/3034270081 shutdown_connections 2023-10-25T16:18:58.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.264+0000 7fef16eff640 1 -- 172.21.15.177:0/3034270081 wait complete. 2023-10-25T16:18:58.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 Processor -- start 2023-10-25T16:18:58.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- start start 2023-10-25T16:18:58.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef100c9880 0x7fef100b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 0x7fef100afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef1015b1f0 0x7fef100b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100ce560 con 0x7fef10156e60 2023-10-25T16:18:58.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef100ce840 con 0x7fef100c9880 2023-10-25T16:18:58.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100ceb20 con 0x7fef1015b1f0 2023-10-25T16:18:58.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 0x7fef100afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 0x7fef100afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33508/0 (socket says 172.21.15.177:33508) 2023-10-25T16:18:58.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 -- 172.21.15.177:0/3490220082 learned_addr learned my addr 172.21.15.177:0/3490220082 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:58.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef1549c640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef1015b1f0 0x7fef100b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef14c9b640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef100c9880 0x7fef100b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 -- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef1015b1f0 msgr2=0x7fef100b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef1015b1f0 0x7fef100b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 -- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef100c9880 msgr2=0x7fef100b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef100c9880 0x7fef100b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 -- 172.21.15.177:0/3490220082 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef080098e0 con 0x7fef10156e60 2023-10-25T16:18:58.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef1549c640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef1015b1f0 0x7fef100b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:58.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef07fff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 0x7fef100afed0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fef0000d980 tx=0x7fef0000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:58.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00009c30 con 0x7fef10156e60 2023-10-25T16:18:58.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef00005020 con 0x7fef10156e60 2023-10-25T16:18:58.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00005430 con 0x7fef10156e60 2023-10-25T16:18:58.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef100cee00 con 0x7fef10156e60 2023-10-25T16:18:58.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef100ce180 con 0x7fef10156e60 2023-10-25T16:18:58.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1004daf0 con 0x7fef10156e60 2023-10-25T16:18:58.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.268+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fef000047b0 con 0x7fef10156e60 2023-10-25T16:18:58.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.272+0000 7fef057fa640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feefc066470 0x7feefc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.272+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fef000840f0 con 0x7fef10156e60 2023-10-25T16:18:58.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.272+0000 7fef14c9b640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feefc066470 0x7feefc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.272+0000 7fef14c9b640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feefc066470 0x7feefc068930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000f70 tx=0x7fef0c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:58.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.276+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef00051550 con 0x7fef10156e60 2023-10-25T16:18:58.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef10065cf0 con 0x7fef10156e60 2023-10-25T16:18:58.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef057fa640 1 -- 172.21.15.177:0/3490220082 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef00017020 con 0x7fef10156e60 2023-10-25T16:18:58.428 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:18:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feefc066470 msgr2=0x7feefc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feefc066470 0x7feefc068930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fef0c000f70 tx=0x7fef0c009040 comp rx=0 tx=0).stop 2023-10-25T16:18:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 msgr2=0x7fef100afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 0x7fef100afed0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fef0000d980 tx=0x7fef0000de40 comp rx=0 tx=0).stop 2023-10-25T16:18:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 shutdown_connections 2023-10-25T16:18:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feefc066470 0x7feefc068930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef1015b1f0 0x7fef100b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef10156e60 0x7fef100afed0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 --2- 172.21.15.177:0/3490220082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef100c9880 0x7fef100b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 >> 172.21.15.177:0/3490220082 conn(0x7fef100b0de0 msgr2=0x7fef10158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 shutdown_connections 2023-10-25T16:18:58.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.428+0000 7fef16eff640 1 -- 172.21.15.177:0/3490220082 wait complete. 2023-10-25T16:18:58.447 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:18:58.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- 172.21.15.177:0/4223991971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 msgr2=0x7fe11c0ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 --2- 172.21.15.177:0/4223991971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0ae700 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fe110009840 tx=0x7fe11001c740 comp rx=0 tx=0).stop 2023-10-25T16:18:58.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- 172.21.15.177:0/4223991971 shutdown_connections 2023-10-25T16:18:58.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 --2- 172.21.15.177:0/4223991971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe11c0afd80 0x7fe11c0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 --2- 172.21.15.177:0/4223991971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0ae700 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- 172.21.15.177:0/4223991971 >> 172.21.15.177:0/4223991971 conn(0x7fe11c097a40 msgr2=0x7fe11c097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:58.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- 172.21.15.177:0/4223991971 shutdown_connections 2023-10-25T16:18:58.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- 172.21.15.177:0/4223991971 wait complete. 2023-10-25T16:18:58.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 Processor -- start 2023-10-25T16:18:58.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- start start 2023-10-25T16:18:58.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe11c0afd80 0x7fe11c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe11c159210 0x7fe11c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0c46e0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c151930 con 0x7fe11c0afd80 2023-10-25T16:18:58.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe121d50640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c151c10 con 0x7fe11c159210 2023-10-25T16:18:58.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe11affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe11affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33524/0 (socket says 172.21.15.177:33524) 2023-10-25T16:18:58.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe11affd640 1 -- 172.21.15.177:0/1996885962 learned_addr learned my addr 172.21.15.177:0/1996885962 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:58.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe11bfff640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe11c159210 0x7fe11c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.572+0000 7fe11b7fe640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe11c0afd80 0x7fe11c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11affd640 1 -- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe11c159210 msgr2=0x7fe11c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11affd640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe11c159210 0x7fe11c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11affd640 1 -- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe11c0afd80 msgr2=0x7fe11c150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11affd640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe11c0afd80 0x7fe11c150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11affd640 1 -- 172.21.15.177:0/1996885962 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100094a0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11b7fe640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe11c0afd80 0x7fe11c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11affd640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0c2b90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe110009790 tx=0x7fe1100a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100043c0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe110005020 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c151ef0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110005410 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c1524b0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c1526a0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe1100b4040 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe103fff640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe108066470 0x7fe108068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe11011dd30 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11b7fe640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe108066470 0x7fe108068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.576+0000 7fe11b7fe640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe108066470 0x7fe108068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe10c000f70 tx=0x7fe10c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:58.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.580+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe1100eb180 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe11c04daf0 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe103fff640 1 -- 172.21.15.177:0/1996885962 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1100b2020 con 0x7fe11c0cdcf0 2023-10-25T16:18:58.723 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:18:58.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe108066470 msgr2=0x7fe108068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe108066470 0x7fe108068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe10c000f70 tx=0x7fe10c009040 comp rx=0 tx=0).stop 2023-10-25T16:18:58.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 msgr2=0x7fe11c0c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0c2b90 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe110009790 tx=0x7fe1100a5890 comp rx=0 tx=0).stop 2023-10-25T16:18:58.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 shutdown_connections 2023-10-25T16:18:58.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe108066470 0x7fe108068930 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe11c159210 0x7fe11c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11c0cdcf0 0x7fe11c0c2b90 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 --2- 172.21.15.177:0/1996885962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe11c0afd80 0x7fe11c150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 >> 172.21.15.177:0/1996885962 conn(0x7fe11c097a40 msgr2=0x7fe11c15b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:58.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 shutdown_connections 2023-10-25T16:18:58.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.724+0000 7fe121d50640 1 -- 172.21.15.177:0/1996885962 wait complete. 2023-10-25T16:18:58.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:18:58.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/728722102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac9406bd50 msgr2=0x7fac94155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 --2- 172.21.15.177:0/728722102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac9406bd50 0x7fac94155880 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fac940caba0 tx=0x7fac8c01ccd0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/728722102 shutdown_connections 2023-10-25T16:18:58.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 --2- 172.21.15.177:0/728722102 >> v2:172.21.15.184:3300/0 conn(0x7fac9406c130 0x7fac94155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 --2- 172.21.15.177:0/728722102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac9406bd50 0x7fac94155880 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/728722102 >> 172.21.15.177:0/728722102 conn(0x7fac940b2450 msgr2=0x7fac940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:58.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/728722102 shutdown_connections 2023-10-25T16:18:58.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/728722102 wait complete. 2023-10-25T16:18:58.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 Processor -- start 2023-10-25T16:18:58.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- start start 2023-10-25T16:18:58.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac9406bd50 0x7fac94154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac9406c130 0x7fac94133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 0x7fac94157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94156730 con 0x7fac94158a70 2023-10-25T16:18:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94156a10 con 0x7fac9406c130 2023-10-25T16:18:58.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac94156cf0 con 0x7fac9406bd50 2023-10-25T16:18:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 0x7fac94157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 0x7fac94157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33530/0 (socket says 172.21.15.177:33530) 2023-10-25T16:18:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 -- 172.21.15.177:0/1709518578 learned_addr learned my addr 172.21.15.177:0/1709518578 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac937fe640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac9406c130 0x7fac94133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac93fff640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac9406bd50 0x7fac94154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 -- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac9406bd50 msgr2=0x7fac94154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac9406bd50 0x7fac94154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 -- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac9406c130 msgr2=0x7fac94133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac9406c130 0x7fac94133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:58.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 -- 172.21.15.177:0/1709518578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0098e0 con 0x7fac94158a70 2023-10-25T16:18:58.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac937fe640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac9406c130 0x7fac94133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:58.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac988bc640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 0x7fac94157ab0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fac8400c410 tx=0x7fac8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:58.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840054e0 con 0x7fac94158a70 2023-10-25T16:18:58.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac84003600 con 0x7fac94158a70 2023-10-25T16:18:58.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840039f0 con 0x7fac94158a70 2023-10-25T16:18:58.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac94156fd0 con 0x7fac94158a70 2023-10-25T16:18:58.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.864+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac94157590 con 0x7fac94158a70 2023-10-25T16:18:58.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.868+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9404daf0 con 0x7fac94158a70 2023-10-25T16:18:58.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.868+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac84003b50 con 0x7fac94158a70 2023-10-25T16:18:58.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.868+0000 7fac90ff9640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac800664a0 0x7fac80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:58.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.868+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fac84083530 con 0x7fac94158a70 2023-10-25T16:18:58.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.868+0000 7fac93fff640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac800664a0 0x7fac80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:58.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.868+0000 7fac93fff640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac800664a0 0x7fac80068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0af000 tx=0x7fac8c01b510 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:58.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:58.872+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac84054570 con 0x7fac94158a70 2023-10-25T16:18:59.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.024+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac940ca670 con 0x7fac94158a70 2023-10-25T16:18:59.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.024+0000 7fac90ff9640 1 -- 172.21.15.177:0/1709518578 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac840170a0 con 0x7fac94158a70 2023-10-25T16:18:59.025 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:18:59.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac800664a0 msgr2=0x7fac80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac800664a0 0x7fac80068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0af000 tx=0x7fac8c01b510 comp rx=0 tx=0).stop 2023-10-25T16:18:59.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 msgr2=0x7fac94157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 0x7fac94157ab0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fac8400c410 tx=0x7fac8400c8d0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 shutdown_connections 2023-10-25T16:18:59.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac800664a0 0x7fac80068960 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac94158a70 0x7fac94157ab0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac9406c130 0x7fac94133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 --2- 172.21.15.177:0/1709518578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac9406bd50 0x7fac94154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 >> 172.21.15.177:0/1709518578 conn(0x7fac940b2450 msgr2=0x7fac9415ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:59.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 shutdown_connections 2023-10-25T16:18:59.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.028+0000 7fac9a31f640 1 -- 172.21.15.177:0/1709518578 wait complete. 2023-10-25T16:18:59.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:18:59.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- 172.21.15.177:0/631860021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5078004d10 msgr2=0x7f5078005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 --2- 172.21.15.177:0/631860021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5078004d10 0x7f5078005190 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f508400c590 tx=0x7f508401faa0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f508b7fe640 1 -- 172.21.15.177:0/631860021 reap_dead start 2023-10-25T16:18:59.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- 172.21.15.177:0/631860021 shutdown_connections 2023-10-25T16:18:59.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- 172.21.15.177:0/631860021 >> 172.21.15.177:0/631860021 conn(0x7f508c09a5c0 msgr2=0x7f508c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:59.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- 172.21.15.177:0/631860021 shutdown_connections 2023-10-25T16:18:59.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- 172.21.15.177:0/631860021 wait complete. 2023-10-25T16:18:59.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 Processor -- start 2023-10-25T16:18:59.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- start start 2023-10-25T16:18:59.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5078004d10 0x7f508c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 0x7f508c1f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f508c1f2190 0x7f508c1f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1f2b50 con 0x7f508c0c4b70 2023-10-25T16:18:59.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0c52e0 con 0x7f508c1f2190 2023-10-25T16:18:59.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f50919c9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0c55c0 con 0x7f5078004d10 2023-10-25T16:18:59.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 0x7f508c1f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 0x7f508c1f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33544/0 (socket says 172.21.15.177:33544) 2023-10-25T16:18:59.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 -- 172.21.15.177:0/3088525843 learned_addr learned my addr 172.21.15.177:0/3088525843 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:59.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f508affd640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5078004d10 0x7f508c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f508b7fe640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f508c1f2190 0x7f508c1f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 -- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5078004d10 msgr2=0x7f508c0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5078004d10 0x7f508c0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 -- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f508c1f2190 msgr2=0x7f508c1f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f508c1f2190 0x7f508c1f2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 -- 172.21.15.177:0/3088525843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0c58a0 con 0x7f508c0c4b70 2023-10-25T16:18:59.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f508b7fe640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f508c1f2190 0x7f508c1f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:59.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f508affd640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5078004d10 0x7f508c0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:18:59.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.164+0000 7f5083fff640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 0x7f508c1f1c50 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f507400e970 tx=0x7f507400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:59.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074009720 con 0x7f508c0c4b70 2023-10-25T16:18:59.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f507400cce0 con 0x7f508c0c4b70 2023-10-25T16:18:59.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c0c5b80 con 0x7f508c0c4b70 2023-10-25T16:18:59.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074005280 con 0x7f508c0c4b70 2023-10-25T16:18:59.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c0c4ff0 con 0x7f508c0c4b70 2023-10-25T16:18:59.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c0d00e0 con 0x7f508c0c4b70 2023-10-25T16:18:59.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50740053e0 con 0x7f508c0c4b70 2023-10-25T16:18:59.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f5088ff9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f506c066470 0x7f506c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5074014070 con 0x7f508c0c4b70 2023-10-25T16:18:59.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f508affd640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f506c066470 0x7f506c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.168+0000 7f508affd640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f506c066470 0x7f506c068930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f507c006fd0 tx=0x7f507c006a90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:59.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.172+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5074055870 con 0x7f508c0c4b70 2023-10-25T16:18:59.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.324+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f508c04daf0 con 0x7f508c0c4b70 2023-10-25T16:18:59.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.324+0000 7f5088ff9640 1 -- 172.21.15.177:0/3088525843 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5074055400 con 0x7f508c0c4b70 2023-10-25T16:18:59.325 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:18:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f506c066470 msgr2=0x7f506c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f506c066470 0x7f506c068930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f507c006fd0 tx=0x7f507c006a90 comp rx=0 tx=0).stop 2023-10-25T16:18:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 msgr2=0x7f508c1f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 0x7f508c1f1c50 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f507400e970 tx=0x7f507400ed70 comp rx=0 tx=0).stop 2023-10-25T16:18:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 shutdown_connections 2023-10-25T16:18:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f506c066470 0x7f506c068930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f508c1f2190 0x7f508c1f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f508c0c4b70 0x7f508c1f1c50 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 --2- 172.21.15.177:0/3088525843 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5078004d10 0x7f508c0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 >> 172.21.15.177:0/3088525843 conn(0x7f508c09a5c0 msgr2=0x7f508c0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 shutdown_connections 2023-10-25T16:18:59.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.328+0000 7f50919c9640 1 -- 172.21.15.177:0/3088525843 wait complete. 2023-10-25T16:18:59.341 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:18:59.342 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:18:59.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:18:59.397 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:18:59.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34784]: fuse finished with error 0 and tester_r 0 2023-10-25T16:18:59.399 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:18:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:59.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:18:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:18:59.407 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:18:59.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:59.407 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:18:59.415 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:18:59.415 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:59.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:18:59.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:18:59.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:59.422 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:18:59.470 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:18:59.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:18:59.472 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:18:59.472 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:18:59.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:18:59.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:18:59.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:18:59.479 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:18:59.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:18:59.527 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:18:59.527 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:18:59.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- 172.21.15.177:0/869716593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c14e810 msgr2=0x7f748c0cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- 172.21.15.177:0/869716593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c14e810 0x7f748c0cbfa0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f748c0c9b20 tx=0x7f748801c8a0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- 172.21.15.177:0/869716593 shutdown_connections 2023-10-25T16:18:59.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- 172.21.15.177:0/869716593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c0af100 0x7f748c158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- 172.21.15.177:0/869716593 >> v2:172.21.15.184:3300/0 conn(0x7f748c15bdb0 0x7f748c0aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- 172.21.15.177:0/869716593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c14e810 0x7f748c0cbfa0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- 172.21.15.177:0/869716593 >> 172.21.15.177:0/869716593 conn(0x7f748c0b2450 msgr2=0x7f748c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:59.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- 172.21.15.177:0/869716593 shutdown_connections 2023-10-25T16:18:59.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- 172.21.15.177:0/869716593 wait complete. 2023-10-25T16:18:59.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 Processor -- start 2023-10-25T16:18:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- start start 2023-10-25T16:18:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c0af100 0x7f748c148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c14e810 0x7f748c147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 0x7f748c14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c149390 con 0x7f748c15bdb0 2023-10-25T16:18:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c149670 con 0x7f748c0af100 2023-10-25T16:18:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7493833640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c149950 con 0x7f748c14e810 2023-10-25T16:18:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 0x7f748c14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 0x7f748c14a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33564/0 (socket says 172.21.15.177:33564) 2023-10-25T16:18:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 -- 172.21.15.177:0/392762573 learned_addr learned my addr 172.21.15.177:0/392762573 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:59.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f74915cf640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c0af100 0x7f748c148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7490dce640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c14e810 0x7f748c147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 -- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c14e810 msgr2=0x7f748c147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c14e810 0x7f748c147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 -- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c0af100 msgr2=0x7f748c148db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c0af100 0x7f748c148db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.656+0000 7f7491dd0640 1 -- 172.21.15.177:0/392762573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009560 con 0x7f748c15bdb0 2023-10-25T16:18:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7491dd0640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 0x7f748c14a430 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f748400ea20 tx=0x7f748400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748400cde0 con 0x7f748c15bdb0 2023-10-25T16:18:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c149c30 con 0x7f748c15bdb0 2023-10-25T16:18:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7484004c40 con 0x7f748c15bdb0 2023-10-25T16:18:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484005020 con 0x7f748c15bdb0 2023-10-25T16:18:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c144d70 con 0x7f748c15bdb0 2023-10-25T16:18:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c04daf0 con 0x7f748c15bdb0 2023-10-25T16:18:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7484005180 con 0x7f748c15bdb0 2023-10-25T16:18:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7481ffb640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7470066470 0x7f7470068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7484084d00 con 0x7f748c15bdb0 2023-10-25T16:18:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f74915cf640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7470066470 0x7f7470068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.660+0000 7f74915cf640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7470066470 0x7f7470068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f74880af000 tx=0x7f748801b0e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.664+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7484052200 con 0x7f748c15bdb0 2023-10-25T16:18:59.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.836+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c0ca5e0 con 0x7f748c15bdb0 2023-10-25T16:18:59.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.836+0000 7f7481ffb640 1 -- 172.21.15.177:0/392762573 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f7484055820 con 0x7f748c15bdb0 2023-10-25T16:18:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:18:59.838 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:18:59.838 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:18:59.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7470066470 msgr2=0x7f7470068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7470066470 0x7f7470068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f74880af000 tx=0x7f748801b0e0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 msgr2=0x7f748c14a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 0x7f748c14a430 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f748400ea20 tx=0x7f748400eee0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 shutdown_connections 2023-10-25T16:18:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7470066470 0x7f7470068930 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f748c15bdb0 0x7f748c14a430 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748c14e810 0x7f748c147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 --2- 172.21.15.177:0/392762573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f748c0af100 0x7f748c148db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 >> 172.21.15.177:0/392762573 conn(0x7f748c0b2450 msgr2=0x7f748c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:59.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 shutdown_connections 2023-10-25T16:18:59.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.840+0000 7f7493833640 1 -- 172.21.15.177:0/392762573 wait complete. 2023-10-25T16:18:59.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:18:59.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.976+0000 7f01a9bfa640 1 -- 172.21.15.177:0/2625319715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4158090 msgr2=0x7f01a40c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.976+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/2625319715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4158090 0x7f01a40c93d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0194009840 tx=0x7f019401c800 comp rx=0 tx=0).stop 2023-10-25T16:18:59.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.976+0000 7f01a9bfa640 1 -- 172.21.15.177:0/2625319715 shutdown_connections 2023-10-25T16:18:59.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/2625319715 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01a40aca70 0x7f01a40cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/2625319715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4158090 0x7f01a40c93d0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- 172.21.15.177:0/2625319715 >> 172.21.15.177:0/2625319715 conn(0x7f01a40af3f0 msgr2=0x7f01a40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:18:59.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- 172.21.15.177:0/2625319715 shutdown_connections 2023-10-25T16:18:59.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- 172.21.15.177:0/2625319715 wait complete. 2023-10-25T16:18:59.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 Processor -- start 2023-10-25T16:18:59.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- start start 2023-10-25T16:18:59.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 0x7f01a414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01a4158090 0x7f01a4145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01a4157510 0x7f01a406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a414ab20 con 0x7f01a4070da0 2023-10-25T16:18:59.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a414c300 con 0x7f01a4158090 2023-10-25T16:18:59.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a414c5e0 con 0x7f01a4157510 2023-10-25T16:18:59.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 0x7f01a414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 0x7f01a414a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33570/0 (socket says 172.21.15.177:33570) 2023-10-25T16:18:59.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 -- 172.21.15.177:0/3974416369 learned_addr learned my addr 172.21.15.177:0/3974416369 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:18:59.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 -- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01a4157510 msgr2=0x7f01a406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01a4157510 0x7f01a406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 -- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01a4158090 msgr2=0x7f01a4145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:18:59.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01a4158090 0x7f01a4145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:18:59.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 -- 172.21.15.177:0/3974416369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940094a0 con 0x7f01a4070da0 2023-10-25T16:18:59.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a37fe640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 0x7f01a414a5e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f0194000c10 tx=0x7f01940050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:59.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940bc070 con 0x7f01a4070da0 2023-10-25T16:18:59.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f01940053a0 con 0x7f01a4070da0 2023-10-25T16:18:59.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a414c8c0 con 0x7f01a4070da0 2023-10-25T16:18:59.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940046d0 con 0x7f01a4070da0 2023-10-25T16:18:59.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a414ce80 con 0x7f01a4070da0 2023-10-25T16:18:59.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.980+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a4162b30 con 0x7f01a4070da0 2023-10-25T16:18:59.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.984+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f01940b4040 con 0x7f01a4070da0 2023-10-25T16:18:59.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.984+0000 7f018bfff640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f01900664a0 0x7f0190068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:18:59.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.984+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f019411eda0 con 0x7f01a4070da0 2023-10-25T16:18:59.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.984+0000 7f01a2ffd640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f01900664a0 0x7f0190068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:18:59.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.984+0000 7f01a2ffd640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f01900664a0 0x7f0190068960 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f01a4151090 tx=0x7f0198005c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:18:59.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:18:59.984+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f01940ec1e0 con 0x7f01a4070da0 2023-10-25T16:19:00.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.128+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01a414d070 con 0x7f01a4070da0 2023-10-25T16:19:00.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f018bfff640 1 -- 172.21.15.177:0/3974416369 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f01940b2090 con 0x7f01a4070da0 2023-10-25T16:19:00.131 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:00.131 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":117,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:55.953293+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:00.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f01900664a0 msgr2=0x7f0190068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f01900664a0 0x7f0190068960 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f01a4151090 tx=0x7f0198005c00 comp rx=0 tx=0).stop 2023-10-25T16:19:00.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 msgr2=0x7f01a414a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 0x7f01a414a5e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f0194000c10 tx=0x7f01940050c0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 shutdown_connections 2023-10-25T16:19:00.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f01900664a0 0x7f0190068960 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01a4157510 0x7f01a406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01a4158090 0x7f01a4145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 --2- 172.21.15.177:0/3974416369 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01a4070da0 0x7f01a414a5e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 >> 172.21.15.177:0/3974416369 conn(0x7f01a40af3f0 msgr2=0x7f01a40ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:00.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 shutdown_connections 2023-10-25T16:19:00.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.132+0000 7f01a9bfa640 1 -- 172.21.15.177:0/3974416369 wait complete. 2023-10-25T16:19:00.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:18:12.791580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:18:14.020998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:00.149 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:00.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2922310264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f597415eba0 msgr2=0x7f59740ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 --2- 172.21.15.177:0/2922310264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f597415eba0 0x7f59740ccba0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f596401c880 comp rx=0 tx=0).stop 2023-10-25T16:19:00.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2922310264 shutdown_connections 2023-10-25T16:19:00.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 --2- 172.21.15.177:0/2922310264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 0x7f59740c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 --2- 172.21.15.177:0/2922310264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f597415eba0 0x7f59740ccba0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2922310264 >> 172.21.15.177:0/2922310264 conn(0x7f597409a580 msgr2=0x7f59740d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:00.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2922310264 shutdown_connections 2023-10-25T16:19:00.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2922310264 wait complete. 2023-10-25T16:19:00.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 Processor -- start 2023-10-25T16:19:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- start start 2023-10-25T16:19:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 0x7f597415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 0x7f5974154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597415eba0 0x7f59740b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597415d6d0 con 0x7f59740b2070 2023-10-25T16:19:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974154f70 con 0x7f597415eba0 2023-10-25T16:19:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974155180 con 0x7f59740cfe20 2023-10-25T16:19:00.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 0x7f597415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 0x7f597415d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33580/0 (socket says 172.21.15.177:33580) 2023-10-25T16:19:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 -- 172.21.15.177:0/2833747330 learned_addr learned my addr 172.21.15.177:0/2833747330 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f596bfff640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 0x7f5974154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59737fe640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597415eba0 0x7f59740b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 -- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 msgr2=0x7f5974154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 0x7f5974154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 -- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597415eba0 msgr2=0x7f59740b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597415eba0 0x7f59740b6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 -- 172.21.15.177:0/2833747330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964009560 con 0x7f59740b2070 2023-10-25T16:19:00.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f596bfff640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 0x7f5974154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59737fe640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597415eba0 0x7f59740b6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5972ffd640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 0x7f597415d190 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f596401af30 tx=0x7f5964005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59640a5920 con 0x7f59740b2070 2023-10-25T16:19:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f59640038f0 con 0x7f59740b2070 2023-10-25T16:19:00.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974155460 con 0x7f59740b2070 2023-10-25T16:19:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964003d00 con 0x7f59740b2070 2023-10-25T16:19:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.268+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974155a20 con 0x7f59740b2070 2023-10-25T16:19:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.272+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597404daf0 con 0x7f59740b2070 2023-10-25T16:19:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.272+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59640b4070 con 0x7f59740b2070 2023-10-25T16:19:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.272+0000 7f5970ff9640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59540664a0 0x7f5954068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.272+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f596411e060 con 0x7f59740b2070 2023-10-25T16:19:00.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.272+0000 7f596bfff640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59540664a0 0x7f5954068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.272+0000 7f596bfff640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59540664a0 0x7f5954068960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5974152bc0 tx=0x7f595c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:00.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.276+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59640eb550 con 0x7f59740b2070 2023-10-25T16:19:00.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59740d2150 con 0x7f59740b2070 2023-10-25T16:19:00.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f5970ff9640 1 -- 172.21.15.177:0/2833747330 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59640eeb70 con 0x7f59740b2070 2023-10-25T16:19:00.420 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:00.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59540664a0 msgr2=0x7f5954068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59540664a0 0x7f5954068960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5974152bc0 tx=0x7f595c009040 comp rx=0 tx=0).stop 2023-10-25T16:19:00.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 msgr2=0x7f597415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 0x7f597415d190 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f596401af30 tx=0x7f5964005790 comp rx=0 tx=0).stop 2023-10-25T16:19:00.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 shutdown_connections 2023-10-25T16:19:00.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f59540664a0 0x7f5954068960 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f597415eba0 0x7f59740b6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59740cfe20 0x7f5974154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 --2- 172.21.15.177:0/2833747330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59740b2070 0x7f597415d190 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 >> 172.21.15.177:0/2833747330 conn(0x7f597409a580 msgr2=0x7f5974150260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:00.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 shutdown_connections 2023-10-25T16:19:00.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.420+0000 7f59799fb640 1 -- 172.21.15.177:0/2833747330 wait complete. 2023-10-25T16:19:00.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:19:00.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 -- 172.21.15.177:0/4217684619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2410159230 msgr2=0x7f2410071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 --2- 172.21.15.177:0/4217684619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2410159230 0x7f2410071500 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f241006c6a0 tx=0x7f240c01c870 comp rx=0 tx=0).stop 2023-10-25T16:19:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 -- 172.21.15.177:0/4217684619 shutdown_connections 2023-10-25T16:19:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 --2- 172.21.15.177:0/4217684619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24100cc610 0x7f241006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 --2- 172.21.15.177:0/4217684619 >> v2:172.21.15.184:3300/0 conn(0x7f2410070510 0x7f24100cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 --2- 172.21.15.177:0/4217684619 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2410159230 0x7f2410071500 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 -- 172.21.15.177:0/4217684619 >> 172.21.15.177:0/4217684619 conn(0x7f24100b2450 msgr2=0x7f24100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:00.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 -- 172.21.15.177:0/4217684619 shutdown_connections 2023-10-25T16:19:00.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 -- 172.21.15.177:0/4217684619 wait complete. 2023-10-25T16:19:00.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 Processor -- start 2023-10-25T16:19:00.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.564+0000 7f2418277640 1 -- start start 2023-10-25T16:19:00.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2410070510 0x7f24100abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 0x7f241014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2410159230 0x7f2410153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2410150100 con 0x7f24100cc610 2023-10-25T16:19:00.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24100ac290 con 0x7f2410159230 2023-10-25T16:19:00.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24100b0030 con 0x7f2410070510 2023-10-25T16:19:00.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 0x7f241014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 0x7f241014d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57028/0 (socket says 172.21.15.177:57028) 2023-10-25T16:19:00.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 -- 172.21.15.177:0/1608291144 learned_addr learned my addr 172.21.15.177:0/1608291144 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:00.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2416013640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2410070510 0x7f24100abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2416814640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2410159230 0x7f2410153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 -- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2410070510 msgr2=0x7f24100abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2410070510 0x7f24100abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 -- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2410159230 msgr2=0x7f2410153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2410159230 0x7f2410153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 -- 172.21.15.177:0/1608291144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c009560 con 0x7f24100cc610 2023-10-25T16:19:00.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2416814640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2410159230 0x7f2410153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:00.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2415812640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 0x7f241014d9a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f240000ea20 tx=0x7f240000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:00.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400009690 con 0x7f24100cc610 2023-10-25T16:19:00.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f240000ce70 con 0x7f24100cc610 2023-10-25T16:19:00.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24100b0bb0 con 0x7f24100cc610 2023-10-25T16:19:00.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400010690 con 0x7f24100cc610 2023-10-25T16:19:00.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24100b0560 con 0x7f24100cc610 2023-10-25T16:19:00.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241004daf0 con 0x7f24100cc610 2023-10-25T16:19:00.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24000107f0 con 0x7f24100cc610 2023-10-25T16:19:00.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2406ffd640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23f4066470 0x7f23f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2400014070 con 0x7f24100cc610 2023-10-25T16:19:00.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.568+0000 7f2416013640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23f4066470 0x7f23f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.572+0000 7f2416013640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23f4066470 0x7f23f4068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f240c0af000 tx=0x7f240c01b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:00.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.572+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24000561a0 con 0x7f24100cc610 2023-10-25T16:19:00.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.724+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24100cd9e0 con 0x7f24100cc610 2023-10-25T16:19:00.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2406ffd640 1 -- 172.21.15.177:0/1608291144 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24000260a0 con 0x7f24100cc610 2023-10-25T16:19:00.726 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:19:00.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23f4066470 msgr2=0x7f23f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23f4066470 0x7f23f4068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f240c0af000 tx=0x7f240c01b0b0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 msgr2=0x7f241014d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 0x7f241014d9a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f240000ea20 tx=0x7f240000eee0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 shutdown_connections 2023-10-25T16:19:00.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f23f4066470 0x7f23f4068930 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2410159230 0x7f2410153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24100cc610 0x7f241014d9a0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 --2- 172.21.15.177:0/1608291144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2410070510 0x7f24100abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 >> 172.21.15.177:0/1608291144 conn(0x7f24100b2450 msgr2=0x7f24100ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:00.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 shutdown_connections 2023-10-25T16:19:00.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.728+0000 7f2418277640 1 -- 172.21.15.177:0/1608291144 wait complete. 2023-10-25T16:19:00.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:19:00.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/861541630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406c160 msgr2=0x7f6dd40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/861541630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406c160 0x7f6dd40af5d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4005fd0 tx=0x7f6dc401c770 comp rx=0 tx=0).stop 2023-10-25T16:19:00.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/861541630 shutdown_connections 2023-10-25T16:19:00.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/861541630 >> v2:172.21.15.184:3300/0 conn(0x7f6dd406f570 0x7f6dd40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/861541630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406c160 0x7f6dd40af5d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/861541630 >> 172.21.15.177:0/861541630 conn(0x7f6dd40b2450 msgr2=0x7f6dd40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:00.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/861541630 shutdown_connections 2023-10-25T16:19:00.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/861541630 wait complete. 2023-10-25T16:19:00.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 Processor -- start 2023-10-25T16:19:00.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- start start 2023-10-25T16:19:00.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 0x7f6dd4157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406f570 0x7f6dd41399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd4140cf0 0x7f6dd413db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41574d0 con 0x7f6dd406c160 2023-10-25T16:19:00.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd413e0c0 con 0x7f6dd4140cf0 2023-10-25T16:19:00.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6ddb8cc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4159f80 con 0x7f6dd406f570 2023-10-25T16:19:00.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6dd9668640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 0x7f6dd4157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6dd9668640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 0x7f6dd4157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57034/0 (socket says 172.21.15.177:57034) 2023-10-25T16:19:00.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.876+0000 7f6dd9668640 1 -- 172.21.15.177:0/3503290692 learned_addr learned my addr 172.21.15.177:0/3503290692 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:00.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9e69640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd4140cf0 0x7f6dd413db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd8e67640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406f570 0x7f6dd41399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9668640 1 -- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406f570 msgr2=0x7f6dd41399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9668640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406f570 0x7f6dd41399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9668640 1 -- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd4140cf0 msgr2=0x7f6dd413db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:00.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9668640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd4140cf0 0x7f6dd413db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:00.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9668640 1 -- 172.21.15.177:0/3503290692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc4009450 con 0x7f6dd406c160 2023-10-25T16:19:00.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9e69640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd4140cf0 0x7f6dd413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:00.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd9668640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 0x7f6dd4157660 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c390 tx=0x7f6dd000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:00.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0004230 con 0x7f6dd406c160 2023-10-25T16:19:00.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6dd00044a0 con 0x7f6dd406c160 2023-10-25T16:19:00.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd415a260 con 0x7f6dd406c160 2023-10-25T16:19:00.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0003840 con 0x7f6dd406c160 2023-10-25T16:19:00.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd415a820 con 0x7f6dd406c160 2023-10-25T16:19:00.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd404daf0 con 0x7f6dd406c160 2023-10-25T16:19:00.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6dd00039a0 con 0x7f6dd406c160 2023-10-25T16:19:00.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dc9ffb640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6db8066470 0x7f6db8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:00.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6dd00835f0 con 0x7f6dd406c160 2023-10-25T16:19:00.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd8e67640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6db8066470 0x7f6db8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:00.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.880+0000 7f6dd8e67640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6db8066470 0x7f6db8068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40ad000 tx=0x7f6dc40a9040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:00.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:00.884+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6dd0050ae0 con 0x7f6dd406c160 2023-10-25T16:19:01.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.036+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6dd40ca3d0 con 0x7f6dd406c160 2023-10-25T16:19:01.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6dc9ffb640 1 -- 172.21.15.177:0/3503290692 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6dd0054100 con 0x7f6dd406c160 2023-10-25T16:19:01.038 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:19:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6db8066470 msgr2=0x7f6db8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6db8066470 0x7f6db8068930 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40ad000 tx=0x7f6dc40a9040 comp rx=0 tx=0).stop 2023-10-25T16:19:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 msgr2=0x7f6dd4157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 0x7f6dd4157660 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000c390 tx=0x7f6dd000c850 comp rx=0 tx=0).stop 2023-10-25T16:19:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 shutdown_connections 2023-10-25T16:19:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6db8066470 0x7f6db8068930 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6dd4140cf0 0x7f6dd413db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6dd406f570 0x7f6dd41399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 --2- 172.21.15.177:0/3503290692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6dd406c160 0x7f6dd4157660 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 >> 172.21.15.177:0/3503290692 conn(0x7f6dd40b2450 msgr2=0x7f6dd40b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 shutdown_connections 2023-10-25T16:19:01.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.040+0000 7f6ddb8cc640 1 -- 172.21.15.177:0/3503290692 wait complete. 2023-10-25T16:19:01.058 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:01.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/425331394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 msgr2=0x7fc6d00b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/425331394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d00b35f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0155910 tx=0x7fc6b801db60 comp rx=0 tx=0).stop 2023-10-25T16:19:01.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/425331394 shutdown_connections 2023-10-25T16:19:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/425331394 >> v2:172.21.15.184:3300/0 conn(0x7fc6d006ce50 0x7fc6d00cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/425331394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d00b35f0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/425331394 >> 172.21.15.177:0/425331394 conn(0x7fc6d00af5b0 msgr2=0x7fc6d00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:01.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/425331394 shutdown_connections 2023-10-25T16:19:01.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/425331394 wait complete. 2023-10-25T16:19:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 Processor -- start 2023-10-25T16:19:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- start start 2023-10-25T16:19:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d01503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d006ce50 0x7fc6d0147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d0151db0 0x7fc6d0147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d0148ee0 con 0x7fc6d006c4f0 2023-10-25T16:19:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d014f550 con 0x7fc6d0151db0 2023-10-25T16:19:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d01482d0 con 0x7fc6d006ce50 2023-10-25T16:19:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d01503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d01503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57048/0 (socket says 172.21.15.177:57048) 2023-10-25T16:19:01.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 -- 172.21.15.177:0/2262521210 learned_addr learned my addr 172.21.15.177:0/2262521210 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:01.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 -- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d006ce50 msgr2=0x7fc6d0147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d006ce50 0x7fc6d0147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 -- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d0151db0 msgr2=0x7fc6d0147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d0151db0 0x7fc6d0147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 -- 172.21.15.177:0/2262521210 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b800a670 con 0x7fc6d006c4f0 2023-10-25T16:19:01.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6ce59c640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d01503c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b410 tx=0x7fc6c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:01.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0004020 con 0x7fc6d006c4f0 2023-10-25T16:19:01.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc6c0004270 con 0x7fc6d006c4f0 2023-10-25T16:19:01.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d01485b0 con 0x7fc6d006c4f0 2023-10-25T16:19:01.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0011890 con 0x7fc6d006c4f0 2023-10-25T16:19:01.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.180+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d0148b70 con 0x7fc6d006c4f0 2023-10-25T16:19:01.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.184+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d0153120 con 0x7fc6d006c4f0 2023-10-25T16:19:01.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.184+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6c0003600 con 0x7fc6d006c4f0 2023-10-25T16:19:01.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.184+0000 7fc6c77fe640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b0066470 0x7fc6b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.184+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc6c0083ec0 con 0x7fc6d006c4f0 2023-10-25T16:19:01.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.184+0000 7fc6c5d9b640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b0066470 0x7fc6b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.184+0000 7fc6c5d9b640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b0066470 0x7fc6b0068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80b0000 tx=0x7fc6b801a900 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:01.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.188+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6c0051320 con 0x7fc6d006c4f0 2023-10-25T16:19:01.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:19:01.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:19:01.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.376+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6d004daf0 con 0x7fc6d006c4f0 2023-10-25T16:19:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.376+0000 7fc6c77fe640 1 -- 172.21.15.177:0/2262521210 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fc6c0054940 con 0x7fc6d006c4f0 2023-10-25T16:19:01.378 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:01.378 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:19:01.378 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:19:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b0066470 msgr2=0x7fc6b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b0066470 0x7fc6b0068930 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80b0000 tx=0x7fc6b801a900 comp rx=0 tx=0).stop 2023-10-25T16:19:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 msgr2=0x7fc6d01503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d01503c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000b410 tx=0x7fc6c000b8d0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 shutdown_connections 2023-10-25T16:19:01.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b0066470 0x7fc6b0068930 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d0151db0 0x7fc6d0147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d006ce50 0x7fc6d0147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 --2- 172.21.15.177:0/2262521210 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d006c4f0 0x7fc6d01503c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 >> 172.21.15.177:0/2262521210 conn(0x7fc6d00af5b0 msgr2=0x7fc6d00b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:01.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 shutdown_connections 2023-10-25T16:19:01.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.380+0000 7fc6d4ab6640 1 -- 172.21.15.177:0/2262521210 wait complete. 2023-10-25T16:19:01.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:01.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 -- 172.21.15.177:0/2298377577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f777415cdd0 msgr2=0x7f77740caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 --2- 172.21.15.177:0/2298377577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f777415cdd0 0x7f77740caf90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f777415d280 tx=0x7f776801c810 comp rx=0 tx=0).stop 2023-10-25T16:19:01.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 -- 172.21.15.177:0/2298377577 shutdown_connections 2023-10-25T16:19:01.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 --2- 172.21.15.177:0/2298377577 >> v2:172.21.15.184:3300/0 conn(0x7f777406b9e0 0x7f777406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 --2- 172.21.15.177:0/2298377577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f777415cdd0 0x7f77740caf90 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 -- 172.21.15.177:0/2298377577 >> 172.21.15.177:0/2298377577 conn(0x7f77740b2450 msgr2=0x7f77740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:01.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 -- 172.21.15.177:0/2298377577 shutdown_connections 2023-10-25T16:19:01.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.544+0000 7f777ab80640 1 -- 172.21.15.177:0/2298377577 wait complete. 2023-10-25T16:19:01.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 Processor -- start 2023-10-25T16:19:01.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- start start 2023-10-25T16:19:01.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777406b9e0 0x7f77741427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 0x7f777414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777415cdd0 0x7f7774142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774151740 con 0x7f77741537d0 2023-10-25T16:19:01.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77740acba0 con 0x7f777406b9e0 2023-10-25T16:19:01.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777414a8c0 con 0x7f777415cdd0 2023-10-25T16:19:01.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 0x7f777414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 0x7f777414c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57074/0 (socket says 172.21.15.177:57074) 2023-10-25T16:19:01.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 -- 172.21.15.177:0/508645861 learned_addr learned my addr 172.21.15.177:0/508645861 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:01.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777891c640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777406b9e0 0x7f77741427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 -- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777415cdd0 msgr2=0x7f7774142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777415cdd0 0x7f7774142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 -- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777406b9e0 msgr2=0x7f77741427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777406b9e0 0x7f77741427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 -- 172.21.15.177:0/508645861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7768009500 con 0x7f77741537d0 2023-10-25T16:19:01.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f7773fff640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 0x7f777414c130 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7768000c10 tx=0x7f77680a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:01.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680ba070 con 0x7f77741537d0 2023-10-25T16:19:01.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7768005140 con 0x7f77741537d0 2023-10-25T16:19:01.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768005550 con 0x7f77741537d0 2023-10-25T16:19:01.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77740afaf0 con 0x7f77741537d0 2023-10-25T16:19:01.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77740af810 con 0x7f77741537d0 2023-10-25T16:19:01.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7774151880 con 0x7f77741537d0 2023-10-25T16:19:01.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77680b4040 con 0x7f77741537d0 2023-10-25T16:19:01.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f77717fa640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7760066470 0x7f7760068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.548+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f776811e0d0 con 0x7f77741537d0 2023-10-25T16:19:01.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.552+0000 7f777891c640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7760066470 0x7f7760068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.552+0000 7f777891c640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7760066470 0x7f7760068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7764003da0 tx=0x7f7764009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:01.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.552+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7774151880 con 0x7f77741537d0 2023-10-25T16:19:01.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.696+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7774151880 con 0x7f77741537d0 2023-10-25T16:19:01.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f77717fa640 1 -- 172.21.15.177:0/508645861 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f7774151880 con 0x7f77741537d0 2023-10-25T16:19:01.699 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:01.699 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":117,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:55.953293+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:01.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7760066470 msgr2=0x7f7760068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7760066470 0x7f7760068930 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7764003da0 tx=0x7f7764009040 comp rx=0 tx=0).stop 2023-10-25T16:19:01.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 msgr2=0x7f777414c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 0x7f777414c130 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7768000c10 tx=0x7f77680a56d0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 shutdown_connections 2023-10-25T16:19:01.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7760066470 0x7f7760068930 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f777415cdd0 0x7f7774142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77741537d0 0x7f777414c130 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 --2- 172.21.15.177:0/508645861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f777406b9e0 0x7f77741427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 >> 172.21.15.177:0/508645861 conn(0x7f77740b2450 msgr2=0x7f77740b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:01.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 shutdown_connections 2023-10-25T16:19:01.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.700+0000 7f777ab80640 1 -- 172.21.15.177:0/508645861 wait complete. 2023-10-25T16:19:01.716 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:19:01.716 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:01.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 -- 172.21.15.177:0/1443271100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00b2120 msgr2=0x7fd0d00d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1443271100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00b2120 0x7fd0d00d1bd0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fd0d00b3ea0 tx=0x7fd0c401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 -- 172.21.15.177:0/1443271100 shutdown_connections 2023-10-25T16:19:01.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1443271100 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00b2120 0x7fd0d00d1bd0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1443271100 >> v2:172.21.15.184:3300/0 conn(0x7fd0d015eba0 0x7fd0d00b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 -- 172.21.15.177:0/1443271100 >> 172.21.15.177:0/1443271100 conn(0x7fd0d009a5c0 msgr2=0x7fd0d00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:01.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 -- 172.21.15.177:0/1443271100 shutdown_connections 2023-10-25T16:19:01.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.836+0000 7fd0d6065640 1 -- 172.21.15.177:0/1443271100 wait complete. 2023-10-25T16:19:01.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 Processor -- start 2023-10-25T16:19:01.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- start start 2023-10-25T16:19:01.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0d00b2120 0x7fd0d01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 0x7fd0d014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d015eba0 0x7fd0d01532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0150490 con 0x7fd0d00cdb10 2023-10-25T16:19:01.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0150770 con 0x7fd0d015eba0 2023-10-25T16:19:01.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0150a50 con 0x7fd0d00b2120 2023-10-25T16:19:01.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 0x7fd0d014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 0x7fd0d014f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57082/0 (socket says 172.21.15.177:57082) 2023-10-25T16:19:01.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 -- 172.21.15.177:0/1542512065 learned_addr learned my addr 172.21.15.177:0/1542512065 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:01.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0d00b2120 0x7fd0d01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0cffff640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d015eba0 0x7fd0d01532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 -- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0d00b2120 msgr2=0x7fd0d01565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0d00b2120 0x7fd0d01565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 -- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d015eba0 msgr2=0x7fd0d01532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:01.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d015eba0 0x7fd0d01532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:01.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 -- 172.21.15.177:0/1542512065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009560 con 0x7fd0d00cdb10 2023-10-25T16:19:01.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0cffff640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d015eba0 0x7fd0d01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:01.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0ceffd640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 0x7fd0d014f9f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009850 tx=0x7fd0c40a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:01.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40b6070 con 0x7fd0d00cdb10 2023-10-25T16:19:01.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0c4004030 con 0x7fd0d00cdb10 2023-10-25T16:19:01.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4004440 con 0x7fd0d00cdb10 2023-10-25T16:19:01.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d0152db0 con 0x7fd0d00cdb10 2023-10-25T16:19:01.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d014f6d0 con 0x7fd0d00cdb10 2023-10-25T16:19:01.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.840+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0152c10 con 0x7fd0d00cdb10 2023-10-25T16:19:01.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.844+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0c40050c0 con 0x7fd0d00cdb10 2023-10-25T16:19:01.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.844+0000 7fd0b7fff640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0bc066470 0x7fd0bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:01.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.844+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd0c411e5b0 con 0x7fd0d00cdb10 2023-10-25T16:19:01.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.844+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0bc066470 0x7fd0bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:01.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.844+0000 7fd0cf7fe640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0bc066470 0x7fd0bc068930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005c50 tx=0x7fd0c0005be0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:01.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:01.848+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0d0152c10 con 0x7fd0d00cdb10 2023-10-25T16:19:02.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.024+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0d0152c10 con 0x7fd0d00cdb10 2023-10-25T16:19:02.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0b7fff640 1 -- 172.21.15.177:0/1542512065 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fd0d0152c10 con 0x7fd0d00cdb10 2023-10-25T16:19:02.026 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:02.026 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:19:02.027 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:19:02.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0bc066470 msgr2=0x7fd0bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0bc066470 0x7fd0bc068930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005c50 tx=0x7fd0c0005be0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 msgr2=0x7fd0d014f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 0x7fd0d014f9f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009850 tx=0x7fd0c40a6600 comp rx=0 tx=0).stop 2023-10-25T16:19:02.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 shutdown_connections 2023-10-25T16:19:02.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0bc066470 0x7fd0bc068930 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0d015eba0 0x7fd0d01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0d00cdb10 0x7fd0d014f9f0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 --2- 172.21.15.177:0/1542512065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0d00b2120 0x7fd0d01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 >> 172.21.15.177:0/1542512065 conn(0x7fd0d009a5c0 msgr2=0x7fd0d00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 shutdown_connections 2023-10-25T16:19:02.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.028+0000 7fd0d6065640 1 -- 172.21.15.177:0/1542512065 wait complete. 2023-10-25T16:19:02.044 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:02.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/2941847567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100b0280 msgr2=0x7f2d100ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 --2- 172.21.15.177:0/2941847567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100b0280 0x7f2d100ca1d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009bc0 tx=0x7f2d0801cb50 comp rx=0 tx=0).stop 2023-10-25T16:19:02.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/2941847567 shutdown_connections 2023-10-25T16:19:02.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 --2- 172.21.15.177:0/2941847567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100b0280 0x7f2d100ca1d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 --2- 172.21.15.177:0/2941847567 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100cc0a0 0x7f2d100adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/2941847567 >> 172.21.15.177:0/2941847567 conn(0x7f2d100983a0 msgr2=0x7f2d100cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/2941847567 shutdown_connections 2023-10-25T16:19:02.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/2941847567 wait complete. 2023-10-25T16:19:02.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 Processor -- start 2023-10-25T16:19:02.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- start start 2023-10-25T16:19:02.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100b0280 0x7f2d101585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100cc0a0 0x7f2d100ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 0x7f2d1006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015b900 con 0x7f2d1015ca70 2023-10-25T16:19:02.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100add50 con 0x7f2d100cc0a0 2023-10-25T16:19:02.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100ad790 con 0x7f2d100b0280 2023-10-25T16:19:02.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 0x7f2d1006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 0x7f2d1006e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57090/0 (socket says 172.21.15.177:57090) 2023-10-25T16:19:02.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 -- 172.21.15.177:0/1480235376 learned_addr learned my addr 172.21.15.177:0/1480235376 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:02.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d1583f640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100cc0a0 0x7f2d100ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16040640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100b0280 0x7f2d101585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 -- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100b0280 msgr2=0x7f2d101585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100b0280 0x7f2d101585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 -- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100cc0a0 msgr2=0x7f2d100ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100cc0a0 0x7f2d100ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 -- 172.21.15.177:0/1480235376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08009820 con 0x7f2d1015ca70 2023-10-25T16:19:02.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16040640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100b0280 0x7f2d101585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:02.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d16841640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 0x7f2d1006e2b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801b200 tx=0x7f2d080a5aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:02.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08003b80 con 0x7f2d1015ca70 2023-10-25T16:19:02.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2d08003ce0 con 0x7f2d1015ca70 2023-10-25T16:19:02.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d100ada70 con 0x7f2d1015ca70 2023-10-25T16:19:02.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08004290 con 0x7f2d1015ca70 2023-10-25T16:19:02.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.164+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1015a460 con 0x7f2d1015ca70 2023-10-25T16:19:02.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.168+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1004daf0 con 0x7f2d1015ca70 2023-10-25T16:19:02.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.168+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d080b4040 con 0x7f2d1015ca70 2023-10-25T16:19:02.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.168+0000 7f2d02ffd640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2cf4066470 0x7f2cf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.168+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2d0811f550 con 0x7f2d1015ca70 2023-10-25T16:19:02.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.168+0000 7f2d16040640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2cf4066470 0x7f2cf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.168+0000 7f2d16040640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2cf4066470 0x7f2cf4068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2d1009cf00 tx=0x7f2d0c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:02.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.172+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d080eca90 con 0x7f2d1015ca70 2023-10-25T16:19:02.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d10098880 con 0x7f2d1015ca70 2023-10-25T16:19:02.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d02ffd640 1 -- 172.21.15.177:0/1480235376 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f2d080b2090 con 0x7f2d1015ca70 2023-10-25T16:19:02.347 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:02.347 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:18:15.017330+0000","modified":"2023-10-25T16:18:17.078126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155378":{"gid":155378,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/583400505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":583400505},{"type":"v1","addr":"172.21.15.184:6837","nonce":583400505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-10-25T16:19:02.348 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 38 2023-10-25T16:19:02.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2cf4066470 msgr2=0x7f2cf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2cf4066470 0x7f2cf4068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2d1009cf00 tx=0x7f2d0c009040 comp rx=0 tx=0).stop 2023-10-25T16:19:02.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 msgr2=0x7f2d1006e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 0x7f2d1006e2b0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f2d0801b200 tx=0x7f2d080a5aa0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 shutdown_connections 2023-10-25T16:19:02.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2cf4066470 0x7f2cf4068930 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d1015ca70 0x7f2d1006e2b0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d100cc0a0 0x7f2d100ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 --2- 172.21.15.177:0/1480235376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d100b0280 0x7f2d101585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 >> 172.21.15.177:0/1480235376 conn(0x7f2d100983a0 msgr2=0x7f2d100cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 shutdown_connections 2023-10-25T16:19:02.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.348+0000 7f2d182a4640 1 -- 172.21.15.177:0/1480235376 wait complete. 2023-10-25T16:19:02.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 -- 172.21.15.177:0/3667414151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb9015eba0 msgr2=0x7fbb900b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 --2- 172.21.15.177:0/3667414151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb9015eba0 0x7fbb900b4100 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbb9009f200 tx=0x7fbb8001c810 comp rx=0 tx=0).stop 2023-10-25T16:19:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 -- 172.21.15.177:0/3667414151 shutdown_connections 2023-10-25T16:19:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 --2- 172.21.15.177:0/3667414151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb900cdb10 0x7fbb900cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 --2- 172.21.15.177:0/3667414151 >> v2:172.21.15.184:3300/0 conn(0x7fbb900b2120 0x7fbb900d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 --2- 172.21.15.177:0/3667414151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb9015eba0 0x7fbb900b4100 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.476+0000 7fbb96a80640 1 -- 172.21.15.177:0/3667414151 >> 172.21.15.177:0/3667414151 conn(0x7fbb9009a5c0 msgr2=0x7fbb900d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- 172.21.15.177:0/3667414151 shutdown_connections 2023-10-25T16:19:02.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- 172.21.15.177:0/3667414151 wait complete. 2023-10-25T16:19:02.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 Processor -- start 2023-10-25T16:19:02.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- start start 2023-10-25T16:19:02.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb900b2120 0x7fbb90152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 0x7fbb90157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9015eba0 0x7fbb90157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90153150 con 0x7fbb900cdb10 2023-10-25T16:19:02.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900c5d90 con 0x7fbb9015eba0 2023-10-25T16:19:02.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900c5180 con 0x7fbb900b2120 2023-10-25T16:19:02.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 0x7fbb90157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 0x7fbb90157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57118/0 (socket says 172.21.15.177:57118) 2023-10-25T16:19:02.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 -- 172.21.15.177:0/2029791580 learned_addr learned my addr 172.21.15.177:0/2029791580 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:02.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb9481c640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb900b2120 0x7fbb90152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 -- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb900b2120 msgr2=0x7fbb90152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb900b2120 0x7fbb90152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 -- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9015eba0 msgr2=0x7fbb90157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb9501d640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9015eba0 0x7fbb90157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9015eba0 0x7fbb90157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 -- 172.21.15.177:0/2029791580 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009560 con 0x7fbb900cdb10 2023-10-25T16:19:02.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8ffff640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 0x7fbb90157940 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c970 tx=0x7fbb8400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84007bb0 con 0x7fbb900cdb10 2023-10-25T16:19:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb84007e20 con 0x7fbb900cdb10 2023-10-25T16:19:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb900c5460 con 0x7fbb900cdb10 2023-10-25T16:19:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84005280 con 0x7fbb900cdb10 2023-10-25T16:19:02.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb900c5a20 con 0x7fbb900cdb10 2023-10-25T16:19:02.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.480+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9004daf0 con 0x7fbb900cdb10 2023-10-25T16:19:02.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.484+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbb840053e0 con 0x7fbb900cdb10 2023-10-25T16:19:02.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.484+0000 7fbb8d7fa640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb7c066470 0x7fbb7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.484+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbb84084830 con 0x7fbb900cdb10 2023-10-25T16:19:02.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.484+0000 7fbb9481c640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb7c066470 0x7fbb7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.484+0000 7fbb9481c640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb7c066470 0x7fbb7c068930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbb800ae000 tx=0x7fbb8001b050 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:02.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.488+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb84051c70 con 0x7fbb900cdb10 2023-10-25T16:19:02.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.628+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb900ce930 con 0x7fbb900cdb10 2023-10-25T16:19:02.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb8d7fa640 1 -- 172.21.15.177:0/2029791580 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fbb8401d070 con 0x7fbb900cdb10 2023-10-25T16:19:02.631 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:02.631 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":117,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:18:55.953293+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:18:12.791580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-25T16:18:14.020998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.10","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:02.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb7c066470 msgr2=0x7fbb7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb7c066470 0x7fbb7c068930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbb800ae000 tx=0x7fbb8001b050 comp rx=0 tx=0).stop 2023-10-25T16:19:02.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 msgr2=0x7fbb90157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 0x7fbb90157940 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c970 tx=0x7fbb8400ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:02.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 shutdown_connections 2023-10-25T16:19:02.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb7c066470 0x7fbb7c068930 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb9015eba0 0x7fbb90157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb900cdb10 0x7fbb90157940 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 --2- 172.21.15.177:0/2029791580 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb900b2120 0x7fbb90152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 >> 172.21.15.177:0/2029791580 conn(0x7fbb9009a5c0 msgr2=0x7fbb900b5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 shutdown_connections 2023-10-25T16:19:02.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.632+0000 7fbb96a80640 1 -- 172.21.15.177:0/2029791580 wait complete. 2023-10-25T16:19:02.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:19:02.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- 172.21.15.177:0/284611205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73780047d0 msgr2=0x7f7378004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 --2- 172.21.15.177:0/284611205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73780047d0 0x7f7378004c50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f7384006fd0 tx=0x7f738401f720 comp rx=0 tx=0).stop 2023-10-25T16:19:02.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738ed9d640 1 -- 172.21.15.177:0/284611205 reap_dead start 2023-10-25T16:19:02.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- 172.21.15.177:0/284611205 shutdown_connections 2023-10-25T16:19:02.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- 172.21.15.177:0/284611205 >> 172.21.15.177:0/284611205 conn(0x7f73900b2450 msgr2=0x7f73900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- 172.21.15.177:0/284611205 shutdown_connections 2023-10-25T16:19:02.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- 172.21.15.177:0/284611205 wait complete. 2023-10-25T16:19:02.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 Processor -- start 2023-10-25T16:19:02.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- start start 2023-10-25T16:19:02.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 0x7f73900a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7390155e10 0x7f7390156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73900aefd0 0x7f73900af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73901567d0 con 0x7f7390146fa0 2023-10-25T16:19:02.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73900af990 con 0x7f7390155e10 2023-10-25T16:19:02.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f7394b8b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73900a6b90 con 0x7f73900aefd0 2023-10-25T16:19:02.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 0x7f73900a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 0x7f73900a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57144/0 (socket says 172.21.15.177:57144) 2023-10-25T16:19:02.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 -- 172.21.15.177:0/2918138421 learned_addr learned my addr 172.21.15.177:0/2918138421 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:02.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738dd9b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7390155e10 0x7f7390156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738ed9d640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73900aefd0 0x7f73900af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 -- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73900aefd0 msgr2=0x7f73900af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73900aefd0 0x7f73900af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 -- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7390155e10 msgr2=0x7f7390156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7390155e10 0x7f7390156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 -- 172.21.15.177:0/2918138421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390147f20 con 0x7f7390146fa0 2023-10-25T16:19:02.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738ed9d640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73900aefd0 0x7f73900af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:02.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.768+0000 7f738e59c640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 0x7f73900a7020 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f738000c8a0 tx=0x7f738000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:02.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7380007bb0 con 0x7f7390146fa0 2023-10-25T16:19:02.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7380007e00 con 0x7f7390146fa0 2023-10-25T16:19:02.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73901569f0 con 0x7f7390146fa0 2023-10-25T16:19:02.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738000f6b0 con 0x7f7390146fa0 2023-10-25T16:19:02.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73900a6820 con 0x7f7390146fa0 2023-10-25T16:19:02.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739004daf0 con 0x7f7390146fa0 2023-10-25T16:19:02.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f738000f810 con 0x7f7390146fa0 2023-10-25T16:19:02.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f737effd640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7370066470 0x7f7370068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:02.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7380084670 con 0x7f7390146fa0 2023-10-25T16:19:02.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f738dd9b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7370066470 0x7f7370068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:02.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.772+0000 7f738dd9b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7370066470 0x7f7370068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f73840b0000 tx=0x7f7384005040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:02.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.776+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7380051ac0 con 0x7f7390146fa0 2023-10-25T16:19:02.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.952+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f73900cd990 con 0x7f7390146fa0 2023-10-25T16:19:02.952 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:19:02.952+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:19:02.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.956+0000 7f737effd640 1 -- 172.21.15.177:0/2918138421 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f73800550e0 con 0x7f7390146fa0 2023-10-25T16:19:02.956 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:19:02.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7370066470 msgr2=0x7f7370068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7370066470 0x7f7370068930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f73840b0000 tx=0x7f7384005040 comp rx=0 tx=0).stop 2023-10-25T16:19:02.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 msgr2=0x7f73900a7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:02.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 0x7f73900a7020 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f738000c8a0 tx=0x7f738000cd60 comp rx=0 tx=0).stop 2023-10-25T16:19:02.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 shutdown_connections 2023-10-25T16:19:02.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7370066470 0x7f7370068930 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73900aefd0 0x7f73900af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7390155e10 0x7f7390156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 --2- 172.21.15.177:0/2918138421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7390146fa0 0x7f73900a7020 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:02.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 >> 172.21.15.177:0/2918138421 conn(0x7f73900b2450 msgr2=0x7f7390157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:02.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 shutdown_connections 2023-10-25T16:19:02.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:02.960+0000 7f7394b8b640 1 -- 172.21.15.177:0/2918138421 wait complete. 2023-10-25T16:19:02.973 INFO:tasks.ceph.mds.b.smithi184.stderr: -9767> 2023-10-25T16:18:21.108+0000 7f8ddc941640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:19:02.976 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:19:03.051 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:19:03.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 -- 172.21.15.177:0/2362768749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 msgr2=0x7fddd80ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:03.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 --2- 172.21.15.177:0/2362768749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd80ccfa0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ce750 tx=0x7fddc001cd30 comp rx=0 tx=0).stop 2023-10-25T16:19:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 -- 172.21.15.177:0/2362768749 shutdown_connections 2023-10-25T16:19:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 --2- 172.21.15.177:0/2362768749 >> v2:172.21.15.184:3300/0 conn(0x7fddd80cd5e0 0x7fddd80cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 --2- 172.21.15.177:0/2362768749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd80ccfa0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 --2- 172.21.15.177:0/2362768749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddd8159210 0x7fddd80ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 -- 172.21.15.177:0/2362768749 >> 172.21.15.177:0/2362768749 conn(0x7fddd8097a40 msgr2=0x7fddd8097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 -- 172.21.15.177:0/2362768749 shutdown_connections 2023-10-25T16:19:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 -- 172.21.15.177:0/2362768749 wait complete. 2023-10-25T16:19:03.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 Processor -- start 2023-10-25T16:19:03.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.104+0000 7fdddf036640 1 -- start start 2023-10-25T16:19:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd814b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddd80cd5e0 0x7fddd8151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddd8159210 0x7fddd80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd81f5740 con 0x7fddd80afd80 2023-10-25T16:19:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd814bcf0 con 0x7fddd80cd5e0 2023-10-25T16:19:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80c6310 con 0x7fddd8159210 2023-10-25T16:19:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd814b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd814b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57160/0 (socket says 172.21.15.177:57160) 2023-10-25T16:19:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 -- 172.21.15.177:0/1862322687 learned_addr learned my addr 172.21.15.177:0/1862322687 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd7fff640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddd80cd5e0 0x7fddd8151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 -- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddd8159210 msgr2=0x7fddd80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddd5d3640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddd8159210 0x7fddd80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddd8159210 0x7fddd80b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 -- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddd80cd5e0 msgr2=0x7fddd8151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddd80cd5e0 0x7fddd8151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 -- 172.21.15.177:0/1862322687 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00098e0 con 0x7fddd80afd80 2023-10-25T16:19:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd7fff640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddd80cd5e0 0x7fddd8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddcdd2640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd814b7b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fddd00058d0 tx=0x7fddd000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0009c30 con 0x7fddd80afd80 2023-10-25T16:19:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fddd0009e80 con 0x7fddd80afd80 2023-10-25T16:19:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd81515d0 con 0x7fddd80afd80 2023-10-25T16:19:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd00106a0 con 0x7fddd80afd80 2023-10-25T16:19:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd814bf90 con 0x7fddd80afd80 2023-10-25T16:19:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd804daf0 con 0x7fddd80afd80 2023-10-25T16:19:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fddd0010800 con 0x7fddd80afd80 2023-10-25T16:19:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd57fa640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fddb80664a0 0x7fddb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fddd0084320 con 0x7fddd80afd80 2023-10-25T16:19:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.108+0000 7fddd7fff640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fddb80664a0 0x7fddb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.112+0000 7fddd7fff640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fddb80664a0 0x7fddb8068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fddc00af000 tx=0x7fddc001b570 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.112+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fddd0051730 con 0x7fddd80afd80 2023-10-25T16:19:03.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:03.308+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fddd8156810 con 0x7fddd80afd80 2023-10-25T16:19:04.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.016+0000 7fddd57fa640 1 -- 172.21.15.177:0/1862322687 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fddd0054d50 con 0x7fddd80afd80 2023-10-25T16:19:04.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fddb80664a0 msgr2=0x7fddb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:04.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fddb80664a0 0x7fddb8068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fddc00af000 tx=0x7fddc001b570 comp rx=0 tx=0).stop 2023-10-25T16:19:04.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 msgr2=0x7fddd814b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:04.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd814b7b0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fddd00058d0 tx=0x7fddd000dde0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 shutdown_connections 2023-10-25T16:19:04.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fddb80664a0 0x7fddb8068960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddd8159210 0x7fddd80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddd80cd5e0 0x7fddd8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 --2- 172.21.15.177:0/1862322687 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddd80afd80 0x7fddd814b7b0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 >> 172.21.15.177:0/1862322687 conn(0x7fddd8097a40 msgr2=0x7fddd815bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:04.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 shutdown_connections 2023-10-25T16:19:04.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.020+0000 7fdddf036640 1 -- 172.21.15.177:0/1862322687 wait complete. 2023-10-25T16:19:04.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:19:04.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 -- 172.21.15.177:0/3937040378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54880cf830 msgr2=0x7f54880cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:04.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 --2- 172.21.15.177:0/3937040378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54880cf830 0x7f54880cfcc0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f54880718c0 tx=0x7f548001cd30 comp rx=0 tx=0).stop 2023-10-25T16:19:04.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 -- 172.21.15.177:0/3937040378 shutdown_connections 2023-10-25T16:19:04.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 --2- 172.21.15.177:0/3937040378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54880cf830 0x7f54880cfcc0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 --2- 172.21.15.177:0/3937040378 >> v2:172.21.15.184:3300/0 conn(0x7f54880ccf00 0x7f54880d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 --2- 172.21.15.177:0/3937040378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f548815b6f0 0x7f548815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 -- 172.21.15.177:0/3937040378 >> 172.21.15.177:0/3937040378 conn(0x7f548809a5b0 msgr2=0x7f54880d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:04.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 -- 172.21.15.177:0/3937040378 shutdown_connections 2023-10-25T16:19:04.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 -- 172.21.15.177:0/3937040378 wait complete. 2023-10-25T16:19:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 Processor -- start 2023-10-25T16:19:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.168+0000 7f548d91d640 1 -- start start 2023-10-25T16:19:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54880ccf00 0x7f548814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:04.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54880cf830 0x7f5488158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 0x7f54880b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488156fa0 con 0x7f548815b6f0 2023-10-25T16:19:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5488157280 con 0x7f54880ccf00 2023-10-25T16:19:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5488157560 con 0x7f54880cf830 2023-10-25T16:19:04.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 0x7f54880b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 0x7f54880b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57174/0 (socket says 172.21.15.177:57174) 2023-10-25T16:19:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 -- 172.21.15.177:0/1578552742 learned_addr learned my addr 172.21.15.177:0/1578552742 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f5486ffd640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54880ccf00 0x7f548814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:04.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54867fc640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54880cf830 0x7f5488158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 -- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54880cf830 msgr2=0x7f5488158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54880cf830 0x7f5488158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 -- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54880ccf00 msgr2=0x7f548814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54880ccf00 0x7f548814e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:04.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 -- 172.21.15.177:0/1578552742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800098e0 con 0x7f548815b6f0 2023-10-25T16:19:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54867fc640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54880cf830 0x7f5488158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f54877fe640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 0x7f54880b4cb0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f548001b3e0 tx=0x7f5480004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800bb070 con 0x7f548815b6f0 2023-10-25T16:19:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5480003c80 con 0x7f548815b6f0 2023-10-25T16:19:04.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5488157840 con 0x7f548815b6f0 2023-10-25T16:19:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800ad900 con 0x7f548815b6f0 2023-10-25T16:19:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548814e540 con 0x7f548815b6f0 2023-10-25T16:19:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5488157d60 con 0x7f548815b6f0 2023-10-25T16:19:04.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f54800b4040 con 0x7f548815b6f0 2023-10-25T16:19:04.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f546ffff640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5474066470 0x7f5474068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:04.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f548011e950 con 0x7f548815b6f0 2023-10-25T16:19:04.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f5486ffd640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5474066470 0x7f5474068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:04.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.172+0000 7f5486ffd640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5474066470 0x7f5474068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5478005fd0 tx=0x7f5478005d10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:04.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.176+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5488157d60 con 0x7f548815b6f0 2023-10-25T16:19:04.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:04.332+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5488157d60 con 0x7f548815b6f0 2023-10-25T16:19:05.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.056+0000 7f546ffff640 1 -- 172.21.15.177:0/1578552742 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5488157d60 con 0x7f548815b6f0 2023-10-25T16:19:05.057 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:19:05.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5474066470 msgr2=0x7f5474068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:05.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5474066470 0x7f5474068930 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5478005fd0 tx=0x7f5478005d10 comp rx=0 tx=0).stop 2023-10-25T16:19:05.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 msgr2=0x7f54880b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:05.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 0x7f54880b4cb0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f548001b3e0 tx=0x7f5480004dc0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 shutdown_connections 2023-10-25T16:19:05.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5474066470 0x7f5474068930 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f548815b6f0 0x7f54880b4cb0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54880cf830 0x7f5488158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 --2- 172.21.15.177:0/1578552742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54880ccf00 0x7f548814e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 >> 172.21.15.177:0/1578552742 conn(0x7f548809a5b0 msgr2=0x7f548815e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:05.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 shutdown_connections 2023-10-25T16:19:05.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.060+0000 7f548d91d640 1 -- 172.21.15.177:0/1578552742 wait complete. 2023-10-25T16:19:05.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:19:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 -- 172.21.15.177:0/4118094245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc005190 msgr2=0x7f3ebc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 --2- 172.21.15.177:0/4118094245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc005190 0x7f3ebc00b990 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009b40 tx=0x7f3ec001d270 comp rx=0 tx=0).stop 2023-10-25T16:19:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 -- 172.21.15.177:0/4118094245 shutdown_connections 2023-10-25T16:19:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 --2- 172.21.15.177:0/4118094245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ebc005190 0x7f3ebc00b990 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 -- 172.21.15.177:0/4118094245 >> 172.21.15.177:0/4118094245 conn(0x7f3ed00caa40 msgr2=0x7f3ed00cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:05.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 -- 172.21.15.177:0/4118094245 shutdown_connections 2023-10-25T16:19:05.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 -- 172.21.15.177:0/4118094245 wait complete. 2023-10-25T16:19:05.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 Processor -- start 2023-10-25T16:19:05.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.212+0000 7f3ed4861640 1 -- start start 2023-10-25T16:19:05.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc005190 0x7f3ed01ef350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:05.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed00c7ea0 0x7f3ed01589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:05.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 0x7f3ed00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:05.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00c9d60 con 0x7f3ed00c9370 2023-10-25T16:19:05.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0158f00 con 0x7f3ebc005190 2023-10-25T16:19:05.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00c6e00 con 0x7f3ed00c7ea0 2023-10-25T16:19:05.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 0x7f3ed00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:05.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 0x7f3ed00c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57190/0 (socket says 172.21.15.177:57190) 2023-10-25T16:19:05.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 -- 172.21.15.177:0/3866148768 learned_addr learned my addr 172.21.15.177:0/3866148768 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:05.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ece59c640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc005190 0x7f3ed01ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:05.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ecdd9b640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed00c7ea0 0x7f3ed01589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:05.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 -- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed00c7ea0 msgr2=0x7f3ed01589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:05.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed00c7ea0 0x7f3ed01589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 -- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc005190 msgr2=0x7f3ed01ef350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:05.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc005190 0x7f3ed01ef350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:05.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 -- 172.21.15.177:0/3866148768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00c70e0 con 0x7f3ed00c9370 2023-10-25T16:19:05.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ecdd9b640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed00c7ea0 0x7f3ed01589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:05.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3eced9d640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 0x7f3ed00c9820 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3ec001d0a0 tx=0x7f3ec0005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:05.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00bb070 con 0x7f3ed00c9370 2023-10-25T16:19:05.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ec00046d0 con 0x7f3ed00c9370 2023-10-25T16:19:05.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed00c73c0 con 0x7f3ed00c9370 2023-10-25T16:19:05.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00048c0 con 0x7f3ed00c9370 2023-10-25T16:19:05.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00c7980 con 0x7f3ed00c9370 2023-10-25T16:19:05.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed0159040 con 0x7f3ed00c9370 2023-10-25T16:19:05.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ec0004a20 con 0x7f3ed00c9370 2023-10-25T16:19:05.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ec6ffd640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3eb0066470 0x7f3eb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:05.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f3ec011e200 con 0x7f3ed00c9370 2023-10-25T16:19:05.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.216+0000 7f3ece59c640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3eb0066470 0x7f3eb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:05.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.220+0000 7f3ece59c640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3eb0066470 0x7f3eb0068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80020f0 tx=0x7f3ec8001af0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:05.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.220+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ec00eb7d0 con 0x7f3ed00c9370 2023-10-25T16:19:05.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:05.376+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ed00c7b70 con 0x7f3ed00c9370 2023-10-25T16:19:06.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.060+0000 7f3ec6ffd640 1 -- 172.21.15.177:0/3866148768 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3ec0004cd0 con 0x7f3ed00c9370 2023-10-25T16:19:06.060 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:19:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3eb0066470 msgr2=0x7f3eb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3eb0066470 0x7f3eb0068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80020f0 tx=0x7f3ec8001af0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 msgr2=0x7f3ed00c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 0x7f3ed00c9820 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3ec001d0a0 tx=0x7f3ec0005600 comp rx=0 tx=0).stop 2023-10-25T16:19:06.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 shutdown_connections 2023-10-25T16:19:06.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3eb0066470 0x7f3eb0068930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ed00c9370 0x7f3ed00c9820 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ed00c7ea0 0x7f3ed01589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 --2- 172.21.15.177:0/3866148768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ebc005190 0x7f3ed01ef350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 >> 172.21.15.177:0/3866148768 conn(0x7f3ed00caa40 msgr2=0x7f3ed00ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:06.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 shutdown_connections 2023-10-25T16:19:06.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.064+0000 7f3ed4861640 1 -- 172.21.15.177:0/3866148768 wait complete. 2023-10-25T16:19:06.087 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:19:06.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 -- 172.21.15.177:0/897051951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c0b2120 msgr2=0x7f317c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 --2- 172.21.15.177:0/897051951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c0b2120 0x7f317c0b4100 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3170009900 tx=0x7f317001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 -- 172.21.15.177:0/897051951 shutdown_connections 2023-10-25T16:19:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 --2- 172.21.15.177:0/897051951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c0cdb10 0x7f317c0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 --2- 172.21.15.177:0/897051951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c0b2120 0x7f317c0b4100 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 -- 172.21.15.177:0/897051951 >> 172.21.15.177:0/897051951 conn(0x7f317c09a5c0 msgr2=0x7f317c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:06.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 -- 172.21.15.177:0/897051951 shutdown_connections 2023-10-25T16:19:06.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 -- 172.21.15.177:0/897051951 wait complete. 2023-10-25T16:19:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 Processor -- start 2023-10-25T16:19:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.216+0000 7f31821cc640 1 -- start start 2023-10-25T16:19:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c0b2120 0x7f317c159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0cdb10 0x7f317c150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 0x7f317c157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c158ba0 con 0x7f317c15eba0 2023-10-25T16:19:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c158e80 con 0x7f317c0cdb10 2023-10-25T16:19:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c159160 con 0x7f317c0b2120 2023-10-25T16:19:06.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 0x7f317c157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 0x7f317c157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57210/0 (socket says 172.21.15.177:57210) 2023-10-25T16:19:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 -- 172.21.15.177:0/4187222710 learned_addr learned my addr 172.21.15.177:0/4187222710 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317b7fe640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c0b2120 0x7f317c159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317affd640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0cdb10 0x7f317c150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 -- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c0b2120 msgr2=0x7f317c159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c0b2120 0x7f317c159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 -- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0cdb10 msgr2=0x7f317c150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0cdb10 0x7f317c150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 -- 172.21.15.177:0/4187222710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170009560 con 0x7f317c15eba0 2023-10-25T16:19:06.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317bfff640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 0x7f317c157570 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f317400cce0 tx=0x7f317400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317400f450 con 0x7f317c15eba0 2023-10-25T16:19:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f317400f6c0 con 0x7f317c15eba0 2023-10-25T16:19:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c159440 con 0x7f317c15eba0 2023-10-25T16:19:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317400fad0 con 0x7f317c15eba0 2023-10-25T16:19:06.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c15a180 con 0x7f317c15eba0 2023-10-25T16:19:06.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c04daf0 con 0x7f317c15eba0 2023-10-25T16:19:06.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3174004b30 con 0x7f317c15eba0 2023-10-25T16:19:06.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f3163fff640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3168066470 0x7f3168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31740848c0 con 0x7f317c15eba0 2023-10-25T16:19:06.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.220+0000 7f317b7fe640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3168066470 0x7f3168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.224+0000 7f317b7fe640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3168066470 0x7f3168068930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f317c1552e0 tx=0x7f316c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:06.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.224+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31740520b0 con 0x7f317c15eba0 2023-10-25T16:19:06.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.384+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7f317c1598f0 con 0x7f317c15eba0 2023-10-25T16:19:06.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f3163fff640 1 -- 172.21.15.177:0/4187222710 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v28) v1 ==== 71+0+0 (secure 0 0 0) 0x7f31740556d0 con 0x7f317c15eba0 2023-10-25T16:19:06.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3168066470 msgr2=0x7f3168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3168066470 0x7f3168068930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f317c1552e0 tx=0x7f316c008040 comp rx=0 tx=0).stop 2023-10-25T16:19:06.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 msgr2=0x7f317c157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 0x7f317c157570 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f317400cce0 tx=0x7f317400a620 comp rx=0 tx=0).stop 2023-10-25T16:19:06.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 shutdown_connections 2023-10-25T16:19:06.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3168066470 0x7f3168068930 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f317c15eba0 0x7f317c157570 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0cdb10 0x7f317c150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 --2- 172.21.15.177:0/4187222710 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c0b2120 0x7f317c159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 >> 172.21.15.177:0/4187222710 conn(0x7f317c09a5c0 msgr2=0x7f317c158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:06.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 shutdown_connections 2023-10-25T16:19:06.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.396+0000 7f31821cc640 1 -- 172.21.15.177:0/4187222710 wait complete. 2023-10-25T16:19:06.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-10-25T16:19:06.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/3887943951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce806c0f0 msgr2=0x7f2ce80706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 --2- 172.21.15.177:0/3887943951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce806c0f0 0x7f2ce80706f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009c80 tx=0x7f2ce001cd70 comp rx=0 tx=0).stop 2023-10-25T16:19:06.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/3887943951 shutdown_connections 2023-10-25T16:19:06.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 --2- 172.21.15.177:0/3887943951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce806c0f0 0x7f2ce80706f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 --2- 172.21.15.177:0/3887943951 >> v2:172.21.15.184:3300/0 conn(0x7f2ce81500f0 0x7f2ce80c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/3887943951 >> 172.21.15.177:0/3887943951 conn(0x7f2ce80b2450 msgr2=0x7f2ce80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:06.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/3887943951 shutdown_connections 2023-10-25T16:19:06.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/3887943951 wait complete. 2023-10-25T16:19:06.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 Processor -- start 2023-10-25T16:19:06.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- start start 2023-10-25T16:19:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 0x7f2ce8141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce80c9e50 0x7f2ce81635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce81500f0 0x7f2ce8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81631b0 con 0x7f2ce806c0f0 2023-10-25T16:19:06.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8162be0 con 0x7f2ce81500f0 2023-10-25T16:19:06.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80b0840 con 0x7f2ce80c9e50 2023-10-25T16:19:06.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 0x7f2ce8141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 0x7f2ce8141b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57214/0 (socket says 172.21.15.177:57214) 2023-10-25T16:19:06.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 -- 172.21.15.177:0/995033148 learned_addr learned my addr 172.21.15.177:0/995033148 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2ced40e640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce80c9e50 0x7f2ce81635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cee410640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce81500f0 0x7f2ce8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 -- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce80c9e50 msgr2=0x7f2ce81635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce80c9e50 0x7f2ce81635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 -- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce81500f0 msgr2=0x7f2ce8158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:06.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce81500f0 0x7f2ce8158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 -- 172.21.15.177:0/995033148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00098e0 con 0x7f2ce806c0f0 2023-10-25T16:19:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cedc0f640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 0x7f2ce8141b00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400e9f0 tx=0x7f2ce400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4009710 con 0x7f2ce806c0f0 2023-10-25T16:19:06.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2ce400ce70 con 0x7f2ce806c0f0 2023-10-25T16:19:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce80b0030 con 0x7f2ce806c0f0 2023-10-25T16:19:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4010690 con 0x7f2ce806c0f0 2023-10-25T16:19:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.528+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80b0560 con 0x7f2ce806c0f0 2023-10-25T16:19:06.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.532+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce8163420 con 0x7f2ce806c0f0 2023-10-25T16:19:06.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.532+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ce40107f0 con 0x7f2ce806c0f0 2023-10-25T16:19:06.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.532+0000 7f2cde7fc640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ccc066470 0x7f2ccc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:06.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.532+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ce4014070 con 0x7f2ce806c0f0 2023-10-25T16:19:06.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.532+0000 7f2ced40e640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ccc066470 0x7f2ccc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:06.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.532+0000 7f2ced40e640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ccc066470 0x7f2ccc068930 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2ce814d6e0 tx=0x7f2cd8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:06.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.536+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ce4050090 con 0x7f2ce806c0f0 2023-10-25T16:19:06.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:06.740+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f2ce804daf0 con 0x7f2ce806c0f0 2023-10-25T16:19:07.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.076+0000 7f2cde7fc640 1 -- 172.21.15.177:0/995033148 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v317) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2ce4055a20 con 0x7f2ce806c0f0 2023-10-25T16:19:07.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ccc066470 msgr2=0x7f2ccc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ccc066470 0x7f2ccc068930 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2ce814d6e0 tx=0x7f2cd8009040 comp rx=0 tx=0).stop 2023-10-25T16:19:07.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 msgr2=0x7f2ce8141b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 0x7f2ce8141b00 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400e9f0 tx=0x7f2ce400eeb0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 shutdown_connections 2023-10-25T16:19:07.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ccc066470 0x7f2ccc068930 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ce81500f0 0x7f2ce8158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ce80c9e50 0x7f2ce81635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 --2- 172.21.15.177:0/995033148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ce806c0f0 0x7f2ce8141b00 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 >> 172.21.15.177:0/995033148 conn(0x7f2ce80b2450 msgr2=0x7f2ce80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:07.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 shutdown_connections 2023-10-25T16:19:07.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.080+0000 7f2cefe73640 1 -- 172.21.15.177:0/995033148 wait complete. 2023-10-25T16:19:07.099 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-10-25T16:19:07.100 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-10-25T16:19:07.100 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-10-25T16:19:07.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:07.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/2106440574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 msgr2=0x7fd28c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/2106440574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd28c004c50 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd288006f10 tx=0x7fd28801cec0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/2106440574 shutdown_connections 2023-10-25T16:19:07.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/2106440574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd28c004c50 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/2106440574 >> 172.21.15.177:0/2106440574 conn(0x7fd2a009a5c0 msgr2=0x7fd2a00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:07.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/2106440574 shutdown_connections 2023-10-25T16:19:07.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/2106440574 wait complete. 2023-10-25T16:19:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 Processor -- start 2023-10-25T16:19:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- start start 2023-10-25T16:19:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd2a0152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2a00c6d70 0x7fd2a014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2a00c71f0 0x7fd2a014d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a014ddf0 con 0x7fd28c0047d0 2023-10-25T16:19:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0154de0 con 0x7fd2a00c6d70 2023-10-25T16:19:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00c8760 con 0x7fd2a00c71f0 2023-10-25T16:19:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd2a0152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd29ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2a00c6d70 0x7fd2a014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd2a0152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57232/0 (socket says 172.21.15.177:57232) 2023-10-25T16:19:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd29ffff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2a00c6d70 0x7fd2a014d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.177:57358/0 (socket says 172.21.15.177:57358) 2023-10-25T16:19:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 -- 172.21.15.177:0/4106000989 learned_addr learned my addr 172.21.15.177:0/4106000989 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a54c5640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2a00c71f0 0x7fd2a014d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 -- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2a00c71f0 msgr2=0x7fd2a014d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2a00c71f0 0x7fd2a014d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 -- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2a00c6d70 msgr2=0x7fd2a014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2a00c6d70 0x7fd2a014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 -- 172.21.15.177:0/4106000989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00c8a40 con 0x7fd28c0047d0 2023-10-25T16:19:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a4cc4640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd2a0152f50 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd290011b80 tx=0x7fd29000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290012650 con 0x7fd28c0047d0 2023-10-25T16:19:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd2900127b0 con 0x7fd28c0047d0 2023-10-25T16:19:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290012bc0 con 0x7fd28c0047d0 2023-10-25T16:19:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a00c8d20 con 0x7fd28c0047d0 2023-10-25T16:19:07.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.220+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a00c92e0 con 0x7fd28c0047d0 2023-10-25T16:19:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.224+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a004daf0 con 0x7fd28c0047d0 2023-10-25T16:19:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.224+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd290012d20 con 0x7fd28c0047d0 2023-10-25T16:19:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.224+0000 7fd29d7fa640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2800664a0 0x7fd280068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.224+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd290084cf0 con 0x7fd28c0047d0 2023-10-25T16:19:07.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.224+0000 7fd29ffff640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2800664a0 0x7fd280068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.224+0000 7fd29ffff640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2800664a0 0x7fd280068960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd288006ee0 tx=0x7fd288005040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:07.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.228+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd290089070 con 0x7fd28c0047d0 2023-10-25T16:19:07.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.380+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2a00ce930 con 0x7fd28c0047d0 2023-10-25T16:19:07.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd29d7fa640 1 -- 172.21.15.177:0/4106000989 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+13021 (secure 0 0 0) 0x7fd2900525b0 con 0x7fd28c0047d0 2023-10-25T16:19:07.384 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:07.384 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":120,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:06.059261+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6837/583400505":"2023-10-26T16:19:02.954963+0000","172.21.15.184:6835/583400505":"2023-10-26T16:19:02.954963+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:07.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2800664a0 msgr2=0x7fd280068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2800664a0 0x7fd280068960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd288006ee0 tx=0x7fd288005040 comp rx=0 tx=0).stop 2023-10-25T16:19:07.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 msgr2=0x7fd2a0152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd2a0152f50 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd290011b80 tx=0x7fd29000f730 comp rx=0 tx=0).stop 2023-10-25T16:19:07.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 shutdown_connections 2023-10-25T16:19:07.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2800664a0 0x7fd280068960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2a00c71f0 0x7fd2a014d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2a00c6d70 0x7fd2a014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 --2- 172.21.15.177:0/4106000989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd28c0047d0 0x7fd2a0152f50 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.384+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 >> 172.21.15.177:0/4106000989 conn(0x7fd2a009a5c0 msgr2=0x7fd2a00b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:07.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.388+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 shutdown_connections 2023-10-25T16:19:07.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.388+0000 7fd2a6f28640 1 -- 172.21.15.177:0/4106000989 wait complete. 2023-10-25T16:19:07.404 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:07.404 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:07.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 -- 172.21.15.177:0/3465041624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600cbfa0 msgr2=0x7f5b600aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 --2- 172.21.15.177:0/3465041624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600cbfa0 0x7f5b600aebc0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5b6006c7b0 tx=0x7f5b5001c880 comp rx=0 tx=0).stop 2023-10-25T16:19:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 -- 172.21.15.177:0/3465041624 shutdown_connections 2023-10-25T16:19:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 --2- 172.21.15.177:0/3465041624 >> v2:172.21.15.184:3300/0 conn(0x7f5b600af100 0x7f5b60158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 --2- 172.21.15.177:0/3465041624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600cbfa0 0x7f5b600aebc0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 -- 172.21.15.177:0/3465041624 >> 172.21.15.177:0/3465041624 conn(0x7f5b600b2450 msgr2=0x7f5b600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:07.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 -- 172.21.15.177:0/3465041624 shutdown_connections 2023-10-25T16:19:07.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.520+0000 7f5b684be640 1 -- 172.21.15.177:0/3465041624 wait complete. 2023-10-25T16:19:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 Processor -- start 2023-10-25T16:19:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- start start 2023-10-25T16:19:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 0x7f5b601411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b600cbfa0 0x7f5b6014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6014e810 0x7f5b60151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60141b30 con 0x7f5b600af100 2023-10-25T16:19:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b601505a0 con 0x7f5b600cbfa0 2023-10-25T16:19:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60150880 con 0x7f5b6014e810 2023-10-25T16:19:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 0x7f5b601411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 0x7f5b601411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57256/0 (socket says 172.21.15.177:57256) 2023-10-25T16:19:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 -- 172.21.15.177:0/3552920038 learned_addr learned my addr 172.21.15.177:0/3552920038 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b65a59640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b600cbfa0 0x7f5b6014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b66a5b640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6014e810 0x7f5b60151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 -- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6014e810 msgr2=0x7f5b60151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6014e810 0x7f5b60151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 -- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b600cbfa0 msgr2=0x7f5b6014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b600cbfa0 0x7f5b6014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 -- 172.21.15.177:0/3552920038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b50009500 con 0x7f5b600af100 2023-10-25T16:19:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b6625a640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 0x7f5b601411d0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c3c0 tx=0x7f5b5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0052d0 con 0x7f5b600af100 2023-10-25T16:19:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b5c003600 con 0x7f5b600af100 2023-10-25T16:19:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c003a10 con 0x7f5b600af100 2023-10-25T16:19:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b60150b60 con 0x7f5b600af100 2023-10-25T16:19:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b60141710 con 0x7f5b600af100 2023-10-25T16:19:07.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6004daf0 con 0x7f5b600af100 2023-10-25T16:19:07.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.524+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b5c003b70 con 0x7f5b600af100 2023-10-25T16:19:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.528+0000 7f5b56ffd640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b44066470 0x7f5b44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.528+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5b5c083210 con 0x7f5b600af100 2023-10-25T16:19:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.528+0000 7f5b65a59640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b44066470 0x7f5b44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.528+0000 7f5b65a59640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b44066470 0x7f5b44068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b500af000 tx=0x7f5b5001b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:07.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.532+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b5c050900 con 0x7f5b600af100 2023-10-25T16:19:07.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b600af550 con 0x7f5b600af100 2023-10-25T16:19:07.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b56ffd640 1 -- 172.21.15.177:0/3552920038 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b5c017020 con 0x7f5b600af100 2023-10-25T16:19:07.672 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:07.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b44066470 msgr2=0x7f5b44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b44066470 0x7f5b44068930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5b500af000 tx=0x7f5b5001b0c0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 msgr2=0x7f5b601411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 0x7f5b601411d0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c3c0 tx=0x7f5b5c00c880 comp rx=0 tx=0).stop 2023-10-25T16:19:07.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 shutdown_connections 2023-10-25T16:19:07.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b44066470 0x7f5b44068930 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b6014e810 0x7f5b60151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b600cbfa0 0x7f5b6014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 --2- 172.21.15.177:0/3552920038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b600af100 0x7f5b601411d0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 >> 172.21.15.177:0/3552920038 conn(0x7f5b600b2450 msgr2=0x7f5b6006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:07.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 shutdown_connections 2023-10-25T16:19:07.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.672+0000 7f5b684be640 1 -- 172.21.15.177:0/3552920038 wait complete. 2023-10-25T16:19:07.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-25T16:19:07.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- 172.21.15.177:0/837616145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 msgr2=0x7fc0b40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 --2- 172.21.15.177:0/837616145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40af5d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0098f0 tx=0x7fc09c01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- 172.21.15.177:0/837616145 shutdown_connections 2023-10-25T16:19:07.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 --2- 172.21.15.177:0/837616145 >> v2:172.21.15.184:3300/0 conn(0x7fc0b406f570 0x7fc0b40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 --2- 172.21.15.177:0/837616145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40af5d0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- 172.21.15.177:0/837616145 >> 172.21.15.177:0/837616145 conn(0x7fc0b40b2450 msgr2=0x7fc0b40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:07.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- 172.21.15.177:0/837616145 shutdown_connections 2023-10-25T16:19:07.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- 172.21.15.177:0/837616145 wait complete. 2023-10-25T16:19:07.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 Processor -- start 2023-10-25T16:19:07.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- start start 2023-10-25T16:19:07.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b406f570 0x7fc0b4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b4140cf0 0x7fc0b413c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b413b8b0 con 0x7fc0b406c160 2023-10-25T16:19:07.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40a8060 con 0x7fc0b406f570 2023-10-25T16:19:07.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0bae39640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40a8340 con 0x7fc0b4140cf0 2023-10-25T16:19:07.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.812+0000 7fc0b8bd5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40abe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57268/0 (socket says 172.21.15.177:57268) 2023-10-25T16:19:07.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 -- 172.21.15.177:0/3307150939 learned_addr learned my addr 172.21.15.177:0/3307150939 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:07.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b3fff640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b406f570 0x7fc0b4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b93d6640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b4140cf0 0x7fc0b413c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 -- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b4140cf0 msgr2=0x7fc0b413c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b4140cf0 0x7fc0b413c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 -- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b406f570 msgr2=0x7fc0b4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:07.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b406f570 0x7fc0b4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:07.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 -- 172.21.15.177:0/3307150939 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009500 con 0x7fc0b406c160 2023-10-25T16:19:07.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b8bd5640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40abe60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400ba50 tx=0x7fc0a400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:07.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400cbe0 con 0x7fc0b406c160 2023-10-25T16:19:07.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc0a400ce70 con 0x7fc0b406c160 2023-10-25T16:19:07.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b40a8620 con 0x7fc0b406c160 2023-10-25T16:19:07.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4014680 con 0x7fc0b406c160 2023-10-25T16:19:07.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b4156a60 con 0x7fc0b406c160 2023-10-25T16:19:07.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b404daf0 con 0x7fc0b406c160 2023-10-25T16:19:07.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0a40147e0 con 0x7fc0b406c160 2023-10-25T16:19:07.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b17fa640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc094066470 0x7fc094068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:07.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc0a4083d00 con 0x7fc0b406c160 2023-10-25T16:19:07.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.816+0000 7fc0b3fff640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc094066470 0x7fc094068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:07.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.820+0000 7fc0b3fff640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc094066470 0x7fc094068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0ae000 tx=0x7fc09c0b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:07.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:07.820+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0a4051530 con 0x7fc0b406c160 2023-10-25T16:19:08.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.016+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fc0b40ca670 con 0x7fc0b406c160 2023-10-25T16:19:08.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0b17fa640 1 -- 172.21.15.177:0/3307150939 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v318) v1 ==== 131+0+0 (secure 0 0 0) 0x7fc0a4054b50 con 0x7fc0b406c160 2023-10-25T16:19:08.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc094066470 msgr2=0x7fc094068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc094066470 0x7fc094068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0ae000 tx=0x7fc09c0b3040 comp rx=0 tx=0).stop 2023-10-25T16:19:08.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 msgr2=0x7fc0b40abe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40abe60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400ba50 tx=0x7fc0a400bf10 comp rx=0 tx=0).stop 2023-10-25T16:19:08.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 shutdown_connections 2023-10-25T16:19:08.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc094066470 0x7fc094068930 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0b4140cf0 0x7fc0b413c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b406f570 0x7fc0b4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 --2- 172.21.15.177:0/3307150939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b406c160 0x7fc0b40abe60 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 >> 172.21.15.177:0/3307150939 conn(0x7fc0b40b2450 msgr2=0x7fc0b415af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:08.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 shutdown_connections 2023-10-25T16:19:08.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.080+0000 7fc0bae39640 1 -- 172.21.15.177:0/3307150939 wait complete. 2023-10-25T16:19:08.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:19:08.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 -- 172.21.15.177:0/2085017061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 msgr2=0x7ff2340cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 --2- 172.21.15.177:0/2085017061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff2340cdf80 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7ff2340b3ea0 tx=0x7ff22c01ccd0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 -- 172.21.15.177:0/2085017061 shutdown_connections 2023-10-25T16:19:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 --2- 172.21.15.177:0/2085017061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff2340cdf80 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 --2- 172.21.15.177:0/2085017061 >> v2:172.21.15.184:3300/0 conn(0x7ff23415eba0 0x7ff2340b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 -- 172.21.15.177:0/2085017061 >> 172.21.15.177:0/2085017061 conn(0x7ff23409a5c0 msgr2=0x7ff2340d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:08.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 -- 172.21.15.177:0/2085017061 shutdown_connections 2023-10-25T16:19:08.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 -- 172.21.15.177:0/2085017061 wait complete. 2023-10-25T16:19:08.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 Processor -- start 2023-10-25T16:19:08.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.216+0000 7ff23c681640 1 -- start start 2023-10-25T16:19:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2340b2120 0x7ff2340b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff234159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23415eba0 0x7ff234149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340ca350 con 0x7ff2340cdb10 2023-10-25T16:19:08.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c96d0 con 0x7ff2340b2120 2023-10-25T16:19:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c99b0 con 0x7ff23415eba0 2023-10-25T16:19:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff234159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff234159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57280/0 (socket says 172.21.15.177:57280) 2023-10-25T16:19:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 -- 172.21.15.177:0/1246768315 learned_addr learned my addr 172.21.15.177:0/1246768315 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:08.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23a41d640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2340b2120 0x7ff2340b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23ac1e640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23415eba0 0x7ff234149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 -- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23415eba0 msgr2=0x7ff234149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23415eba0 0x7ff234149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 -- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2340b2120 msgr2=0x7ff2340b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2340b2120 0x7ff2340b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 -- 172.21.15.177:0/1246768315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0098e0 con 0x7ff2340cdb10 2023-10-25T16:19:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23ac1e640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23415eba0 0x7ff234149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23a41d640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2340b2120 0x7ff2340b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:08.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff239c1c640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff234159f40 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c4d0 tx=0x7ff22400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005480 con 0x7ff2340cdb10 2023-10-25T16:19:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff2240036f0 con 0x7ff2340cdb10 2023-10-25T16:19:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2340c9c90 con 0x7ff2340cdb10 2023-10-25T16:19:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224003b00 con 0x7ff2340cdb10 2023-10-25T16:19:08.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2340ca770 con 0x7ff2340cdb10 2023-10-25T16:19:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23409ab90 con 0x7ff2340cdb10 2023-10-25T16:19:08.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff224003c60 con 0x7ff2340cdb10 2023-10-25T16:19:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff22affd640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff218066470 0x7ff218068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff224083380 con 0x7ff2340cdb10 2023-10-25T16:19:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.220+0000 7ff23a41d640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff218066470 0x7ff218068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.224+0000 7ff23a41d640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff218066470 0x7ff218068930 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff230005fd0 tx=0x7ff230005f00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:08.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.224+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff224050c50 con 0x7ff2340cdb10 2023-10-25T16:19:08.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.380+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7ff2340ca490 con 0x7ff2340cdb10 2023-10-25T16:19:08.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.380+0000 7ff22affd640 1 -- 172.21.15.177:0/1246768315 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v28) v1 ==== 59+0+1116 (secure 0 0 0) 0x7ff2340ca490 con 0x7ff2340cdb10 2023-10-25T16:19:08.380 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:19:08.381 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:19:08.381 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:19:08.381 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:19:08.381 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:19:08.381 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:19:08.381 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:19:08.382 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:19:08.382 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:19:08.382 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:19:08.382 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:19:08.382 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:19:08.383 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:19:08.383 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:19:08.383 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:19:08.383 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:19:08.383 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:19:08.384 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:19:08.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff218066470 msgr2=0x7ff218068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff218066470 0x7ff218068930 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff230005fd0 tx=0x7ff230005f00 comp rx=0 tx=0).stop 2023-10-25T16:19:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 msgr2=0x7ff234159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff234159f40 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c4d0 tx=0x7ff22400c990 comp rx=0 tx=0).stop 2023-10-25T16:19:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 shutdown_connections 2023-10-25T16:19:08.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff218066470 0x7ff218068930 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff23415eba0 0x7ff234149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2340cdb10 0x7ff234159f40 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 --2- 172.21.15.177:0/1246768315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2340b2120 0x7ff2340b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 >> 172.21.15.177:0/1246768315 conn(0x7ff23409a5c0 msgr2=0x7ff2340d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:08.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 shutdown_connections 2023-10-25T16:19:08.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.384+0000 7ff23c681640 1 -- 172.21.15.177:0/1246768315 wait complete. 2023-10-25T16:19:08.398 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:19:08.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/2073771819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 msgr2=0x7f8b8c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 --2- 172.21.15.177:0/2073771819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8b8c00b990 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00c8330 tx=0x7f8b9801d1d0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/2073771819 shutdown_connections 2023-10-25T16:19:08.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 --2- 172.21.15.177:0/2073771819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8b8c00b990 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/2073771819 >> 172.21.15.177:0/2073771819 conn(0x7f8ba009a5c0 msgr2=0x7f8ba00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:08.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/2073771819 shutdown_connections 2023-10-25T16:19:08.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/2073771819 wait complete. 2023-10-25T16:19:08.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 Processor -- start 2023-10-25T16:19:08.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- start start 2023-10-25T16:19:08.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8ba014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba00caaf0 0x7f8ba00c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ba00caf70 0x7f8ba00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00c9a50 con 0x7f8b8c0052b0 2023-10-25T16:19:08.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00c9d30 con 0x7f8ba00caaf0 2023-10-25T16:19:08.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba00ca010 con 0x7f8ba00caf70 2023-10-25T16:19:08.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8ba014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8ba014a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57300/0 (socket says 172.21.15.177:57300) 2023-10-25T16:19:08.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 -- 172.21.15.177:0/258546930 learned_addr learned my addr 172.21.15.177:0/258546930 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:08.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba55ab640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba00caaf0 0x7f8ba00c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 -- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ba00caf70 msgr2=0x7f8ba00c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ba00caf70 0x7f8ba00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 -- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba00caaf0 msgr2=0x7f8ba00c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba00caaf0 0x7f8ba00c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 -- 172.21.15.177:0/258546930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba00ca2f0 con 0x7f8b8c0052b0 2023-10-25T16:19:08.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba55ab640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba00caaf0 0x7f8ba00c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:08.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba5dac640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8ba014a5a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00d600 tx=0x7f8b9c00da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:08.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00f880 con 0x7f8b8c0052b0 2023-10-25T16:19:08.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8b9c00faf0 con 0x7f8b8c0052b0 2023-10-25T16:19:08.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba00ca5d0 con 0x7f8b8c0052b0 2023-10-25T16:19:08.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c010450 con 0x7f8b8c0052b0 2023-10-25T16:19:08.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.516+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba00c9720 con 0x7f8b8c0052b0 2023-10-25T16:19:08.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.520+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba00ca810 con 0x7f8b8c0052b0 2023-10-25T16:19:08.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.520+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b9c0105b0 con 0x7f8b8c0052b0 2023-10-25T16:19:08.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.520+0000 7f8b967fc640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b84066470 0x7f8b84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:08.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.520+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b9c084190 con 0x7f8b8c0052b0 2023-10-25T16:19:08.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.520+0000 7f8ba55ab640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b84066470 0x7f8b84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:08.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.520+0000 7f8ba55ab640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b84066470 0x7f8b84068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8b900017b0 tx=0x7f8b90000ee0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:08.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.524+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ba00ca810 con 0x7f8b8c0052b0 2023-10-25T16:19:08.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.672+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8ba00ca810 con 0x7f8b8c0052b0 2023-10-25T16:19:08.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.680+0000 7f8b967fc640 1 -- 172.21.15.177:0/258546930 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v29)=0 v29) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ba00ca810 con 0x7f8b8c0052b0 2023-10-25T16:19:08.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b84066470 msgr2=0x7f8b84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b84066470 0x7f8b84068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8b900017b0 tx=0x7f8b90000ee0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 msgr2=0x7f8ba014a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:08.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8ba014a5a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00d600 tx=0x7f8b9c00da00 comp rx=0 tx=0).stop 2023-10-25T16:19:08.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 shutdown_connections 2023-10-25T16:19:08.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b84066470 0x7f8b84068930 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ba00caf70 0x7f8ba00c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ba00caaf0 0x7f8ba00c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 --2- 172.21.15.177:0/258546930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b8c0052b0 0x7f8ba014a5a0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:08.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 >> 172.21.15.177:0/258546930 conn(0x7f8ba009a5c0 msgr2=0x7f8ba006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:08.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 shutdown_connections 2023-10-25T16:19:08.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:08.684+0000 7f8ba8010640 1 -- 172.21.15.177:0/258546930 wait complete. 2023-10-25T16:19:08.698 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:19:08.699 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:19:08.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:19:08.775 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:19:08.775 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:19:08.776 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:08.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:19:08.787 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:19:08.787 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:08.824 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:19:08.824 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:19:08.825 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:08.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:19:08.841 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:19:08.841 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:08.878 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:19:08.879 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:19:08.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:09.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- 172.21.15.177:0/3089808649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4815c400 msgr2=0x7fef4806e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 --2- 172.21.15.177:0/3089808649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4815c400 0x7fef4806e030 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fef480b3810 tx=0x7fef3001c830 comp rx=0 tx=0).stop 2023-10-25T16:19:09.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- 172.21.15.177:0/3089808649 shutdown_connections 2023-10-25T16:19:09.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 --2- 172.21.15.177:0/3089808649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4815c400 0x7fef4806e030 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 --2- 172.21.15.177:0/3089808649 >> v2:172.21.15.184:3300/0 conn(0x7fef4813b0d0 0x7fef4806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- 172.21.15.177:0/3089808649 >> 172.21.15.177:0/3089808649 conn(0x7fef480afe20 msgr2=0x7fef480b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:09.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- 172.21.15.177:0/3089808649 shutdown_connections 2023-10-25T16:19:09.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- 172.21.15.177:0/3089808649 wait complete. 2023-10-25T16:19:09.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 Processor -- start 2023-10-25T16:19:09.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- start start 2023-10-25T16:19:09.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 0x7fef48154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef4813b0d0 0x7fef480cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef4815c400 0x7fef481575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480cd980 con 0x7fef4806cc60 2023-10-25T16:19:09.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef480ccd00 con 0x7fef4813b0d0 2023-10-25T16:19:09.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef4d901640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef480ccfe0 con 0x7fef4815c400 2023-10-25T16:19:09.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 0x7fef48154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 0x7fef48154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57322/0 (socket says 172.21.15.177:57322) 2023-10-25T16:19:09.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 -- 172.21.15.177:0/3658888552 learned_addr learned my addr 172.21.15.177:0/3658888552 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:09.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef467fc640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef4813b0d0 0x7fef480cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef477fe640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef4815c400 0x7fef481575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 -- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef4815c400 msgr2=0x7fef481575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef4815c400 0x7fef481575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 -- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef4813b0d0 msgr2=0x7fef480cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef4813b0d0 0x7fef480cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef46ffd640 1 -- 172.21.15.177:0/3658888552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009560 con 0x7fef4806cc60 2023-10-25T16:19:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.012+0000 7fef467fc640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef4813b0d0 0x7fef480cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef46ffd640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 0x7fef48154790 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d950 tx=0x7fef4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:09.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40009c30 con 0x7fef4806cc60 2023-10-25T16:19:09.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef40009e80 con 0x7fef4806cc60 2023-10-25T16:19:09.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef480cd2c0 con 0x7fef4806cc60 2023-10-25T16:19:09.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400106c0 con 0x7fef4806cc60 2023-10-25T16:19:09.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef480cbd80 con 0x7fef4806cc60 2023-10-25T16:19:09.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4804daf0 con 0x7fef4806cc60 2023-10-25T16:19:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fef40010820 con 0x7fef4806cc60 2023-10-25T16:19:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef3ffff640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef2c066470 0x7fef2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fef40084000 con 0x7fef4806cc60 2023-10-25T16:19:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef467fc640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef2c066470 0x7fef2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.016+0000 7fef467fc640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef2c066470 0x7fef2c068930 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fef380045c0 tx=0x7fef38009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:09.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.020+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef40051780 con 0x7fef4806cc60 2023-10-25T16:19:09.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.208+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef4812e710 con 0x7fef4806cc60 2023-10-25T16:19:09.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef3ffff640 1 -- 172.21.15.177:0/3658888552 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3710 (secure 0 0 0) 0x7fef40017e90 con 0x7fef4806cc60 2023-10-25T16:19:09.211 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:09.211 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7206,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3073638964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3073638964},{"type":"v1","addr":"172.21.15.177:6834","nonce":3073638964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7209,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2117505084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2117505084},{"type":"v1","addr":"172.21.15.177:6835","nonce":2117505084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7212,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/578583940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":578583940},{"type":"v1","addr":"172.21.15.184:6836","nonce":578583940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":155537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/1151753071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":1151753071},{"type":"v1","addr":"172.21.15.184:6837","nonce":1151753071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[]} 2023-10-25T16:19:09.211 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 40 2023-10-25T16:19:09.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef2c066470 msgr2=0x7fef2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef2c066470 0x7fef2c068930 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fef380045c0 tx=0x7fef38009040 comp rx=0 tx=0).stop 2023-10-25T16:19:09.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 msgr2=0x7fef48154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 0x7fef48154790 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d950 tx=0x7fef4000de10 comp rx=0 tx=0).stop 2023-10-25T16:19:09.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 shutdown_connections 2023-10-25T16:19:09.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fef2c066470 0x7fef2c068930 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fef4815c400 0x7fef481575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef4813b0d0 0x7fef480cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 --2- 172.21.15.177:0/3658888552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fef4806cc60 0x7fef48154790 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 >> 172.21.15.177:0/3658888552 conn(0x7fef480afe20 msgr2=0x7fef48155070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 shutdown_connections 2023-10-25T16:19:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.212+0000 7fef4d901640 1 -- 172.21.15.177:0/3658888552 wait complete. 2023-10-25T16:19:09.230 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:19:09.230 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:19:09.231 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:19:09.231 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:09.231 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:19:09.232 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:19:09.232 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:19:09.232 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:09.232 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:19:09.233 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:19:09.233 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:19:09.233 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:09.234 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:19:09.234 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:19:09.234 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:19:09.235 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:09.242 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:19:09.243 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:19:09.244 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:19:09.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:19:09.248 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:19:09.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:19:09.250 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:19:09.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:19:09.287 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:19:09.288 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:09.289 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:19:09.289 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:09.291 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:19:09.292 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:09.293 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:19:09.293 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:09.293 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:19:09.348 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:19:09.354 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:19:09.364 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:19:09.366 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:19:09.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 -- 172.21.15.177:0/96230154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0006cc60 msgr2=0x7fba0015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 --2- 172.21.15.177:0/96230154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0006cc60 0x7fba0015bcf0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fba000b3810 tx=0x7fb9f401c870 comp rx=0 tx=0).stop 2023-10-25T16:19:09.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 -- 172.21.15.177:0/96230154 shutdown_connections 2023-10-25T16:19:09.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 --2- 172.21.15.177:0/96230154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0006cc60 0x7fba0015bcf0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 --2- 172.21.15.177:0/96230154 >> v2:172.21.15.184:3300/0 conn(0x7fba0013b0d0 0x7fba0006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 -- 172.21.15.177:0/96230154 >> 172.21.15.177:0/96230154 conn(0x7fba000afe20 msgr2=0x7fba000b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:09.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 -- 172.21.15.177:0/96230154 shutdown_connections 2023-10-25T16:19:09.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.408+0000 7fba0669a640 1 -- 172.21.15.177:0/96230154 wait complete. 2023-10-25T16:19:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 Processor -- start 2023-10-25T16:19:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- start start 2023-10-25T16:19:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba0006cc60 0x7fba00139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba0013b0d0 0x7fba000b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 0x7fba001535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b2310 con 0x7fba0015c230 2023-10-25T16:19:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b1690 con 0x7fba0006cc60 2023-10-25T16:19:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b1970 con 0x7fba0013b0d0 2023-10-25T16:19:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 0x7fba001535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 0x7fba001535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:57372/0 (socket says 172.21.15.177:57372) 2023-10-25T16:19:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 -- 172.21.15.177:0/3800101964 learned_addr learned my addr 172.21.15.177:0/3800101964 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9fffff640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba0006cc60 0x7fba00139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9ff7fe640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba0013b0d0 0x7fba000b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 -- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba0013b0d0 msgr2=0x7fba000b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba0013b0d0 0x7fba000b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 -- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba0006cc60 msgr2=0x7fba00139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba0006cc60 0x7fba00139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 -- 172.21.15.177:0/3800101964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4009560 con 0x7fba0015c230 2023-10-25T16:19:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba04c37640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 0x7fba001535b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8001570 tx=0x7fb9f800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8003db0 con 0x7fba0015c230 2023-10-25T16:19:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb9f8005070 con 0x7fba0015c230 2023-10-25T16:19:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba000b1c50 con 0x7fba0015c230 2023-10-25T16:19:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8005480 con 0x7fba0015c230 2023-10-25T16:19:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba001628c0 con 0x7fba0015c230 2023-10-25T16:19:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0004daf0 con 0x7fba0015c230 2023-10-25T16:19:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9f80055e0 con 0x7fba0015c230 2023-10-25T16:19:09.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.412+0000 7fb9fcff9640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9ec066470 0x7fb9ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:09.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.416+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb9f80835e0 con 0x7fba0015c230 2023-10-25T16:19:09.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.416+0000 7fb9fffff640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9ec066470 0x7fb9ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:09.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.416+0000 7fb9fffff640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9ec066470 0x7fb9ec068930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000bc00 tx=0x7fb9f000b390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:09.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.420+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9f8050ea0 con 0x7fba0015c230 2023-10-25T16:19:09.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:09.568+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fba0015b840 con 0x7fba0015c230 2023-10-25T16:19:10.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.716+0000 7fb9fcff9640 1 -- 172.21.15.177:0/3800101964 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v125) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb9f8017020 con 0x7fba0015c230 2023-10-25T16:19:10.716 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:19:10.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9ec066470 msgr2=0x7fb9ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:10.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9ec066470 0x7fb9ec068930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000bc00 tx=0x7fb9f000b390 comp rx=0 tx=0).stop 2023-10-25T16:19:10.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 msgr2=0x7fba001535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:10.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 0x7fba001535b0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8001570 tx=0x7fb9f800cd20 comp rx=0 tx=0).stop 2023-10-25T16:19:10.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 shutdown_connections 2023-10-25T16:19:10.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb9ec066470 0x7fb9ec068930 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba0015c230 0x7fba001535b0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba0013b0d0 0x7fba000b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 --2- 172.21.15.177:0/3800101964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba0006cc60 0x7fba00139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 >> 172.21.15.177:0/3800101964 conn(0x7fba000afe20 msgr2=0x7fba000add90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:10.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 shutdown_connections 2023-10-25T16:19:10.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.720+0000 7fba0669a640 1 -- 172.21.15.177:0/3800101964 wait complete. 2023-10-25T16:19:10.742 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:19:10.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e6959c640 1 -- 172.21.15.177:0/3668322394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 msgr2=0x7f6e4c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:10.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e6959c640 1 --2- 172.21.15.177:0/3668322394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e4c003dd0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f6e54009b60 tx=0x7f6e5401d1d0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e637fe640 1 -- 172.21.15.177:0/3668322394 reap_dead start 2023-10-25T16:19:10.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e6959c640 1 -- 172.21.15.177:0/3668322394 shutdown_connections 2023-10-25T16:19:10.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e6959c640 1 -- 172.21.15.177:0/3668322394 >> 172.21.15.177:0/3668322394 conn(0x7f6e640b2450 msgr2=0x7f6e640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:10.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e6959c640 1 -- 172.21.15.177:0/3668322394 shutdown_connections 2023-10-25T16:19:10.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.868+0000 7f6e6959c640 1 -- 172.21.15.177:0/3668322394 wait complete. 2023-10-25T16:19:10.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 Processor -- start 2023-10-25T16:19:10.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- start start 2023-10-25T16:19:10.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e6414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:10.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e640abdb0 0x7f6e6413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:10.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e640ab0a0 0x7f6e640ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:10.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6414b310 con 0x7f6e4c0039b0 2023-10-25T16:19:10.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6414b5f0 con 0x7f6e640ab0a0 2023-10-25T16:19:10.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6414b8d0 con 0x7f6e640abdb0 2023-10-25T16:19:10.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e6414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:10.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e6414ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41884/0 (socket says 172.21.15.177:41884) 2023-10-25T16:19:10.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 -- 172.21.15.177:0/2505704667 learned_addr learned my addr 172.21.15.177:0/2505704667 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:10.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e637fe640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e640ab0a0 0x7f6e640ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:10.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e627fc640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e640abdb0 0x7f6e6413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:10.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 -- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e640abdb0 msgr2=0x7f6e6413c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:10.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e640abdb0 0x7f6e6413c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 -- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e640ab0a0 msgr2=0x7f6e640ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:10.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e640ab0a0 0x7f6e640ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:10.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 -- 172.21.15.177:0/2505704667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6414bbb0 con 0x7f6e4c0039b0 2023-10-25T16:19:10.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e62ffd640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e6414ad30 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f6e5401d000 tx=0x7f6e54005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:10.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540bb070 con 0x7f6e4c0039b0 2023-10-25T16:19:10.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e54004140 con 0x7f6e4c0039b0 2023-10-25T16:19:10.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e540046d0 con 0x7f6e4c0039b0 2023-10-25T16:19:10.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6414be90 con 0x7f6e4c0039b0 2023-10-25T16:19:10.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e640ac230 con 0x7f6e4c0039b0 2023-10-25T16:19:10.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.872+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e640c9780 con 0x7f6e4c0039b0 2023-10-25T16:19:10.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.876+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e540b3070 con 0x7f6e4c0039b0 2023-10-25T16:19:10.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.876+0000 7f6e4b7fe640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e50066470 0x7f6e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:10.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.876+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e640cc4e0 con 0x7f6e4c0039b0 2023-10-25T16:19:10.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.876+0000 7f6e627fc640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e50066470 0x7f6e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:10.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.876+0000 7f6e627fc640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e50066470 0x7f6e50068930 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6e641f61f0 tx=0x7f6e58009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:10.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:10.880+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e540eb530 con 0x7f6e4c0039b0 2023-10-25T16:19:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e6404daf0 con 0x7f6e4c0039b0 2023-10-25T16:19:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e4b7fe640 1 -- 172.21.15.177:0/2505704667 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6e540b1070 con 0x7f6e4c0039b0 2023-10-25T16:19:11.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:11.092 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:11.093 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:19:11.093 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.093 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:19:11.093 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:19:11.093 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.094 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.094 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:11.094 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:11.094 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.095 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.095 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.095 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.095 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:19:11.095 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:19:11.096 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.096 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.096 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:11.096 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:11.096 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.097 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.097 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.097 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.097 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:19:11.098 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:19:11.098 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.098 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.098 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:11.098 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:11.099 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.099 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.099 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.100 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.100 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:19:11.100 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:19:11.100 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.101 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.101 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:11.101 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:11.101 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.101 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.102 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:19:11.102 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:19:11.102 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.103 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.103 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.103 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.103 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.103 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.104 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.104 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:19:11.104 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:19:11.104 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.104 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.105 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.105 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.105 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.105 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.105 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.106 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:19:11.106 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:19:11.106 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.106 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.106 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.107 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.107 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.107 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.107 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:19:11.108 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:19:11.108 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.108 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.108 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.109 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.109 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.109 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.109 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.109 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:19:11.110 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:19:11.110 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.110 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.110 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.111 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.111 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.111 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.111 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.111 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:19:11.112 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:19:11.112 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.112 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.112 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.113 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.113 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.113 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.113 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:19:11.114 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:19:11.114 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.114 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.114 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.115 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.115 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.115 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.116 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:19:11.116 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:19:11.116 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.116 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:11.116 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:11.117 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.117 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.117 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:19:11.118 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:19:11.118 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.118 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.118 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:19:11.118 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:19:11.119 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.119 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:19:11.119 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:19:11.120 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.120 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.120 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:19:11.120 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:19:11.121 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:19:11.121 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.121 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:19:11.122 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:19:11.122 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.122 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.122 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:19:11.122 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:19:11.123 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:19:11.123 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.123 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.124 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:19:11.124 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:19:11.124 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.124 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:11.124 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:19:11.124 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:19:11.125 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:19:11.125 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.125 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:19:11.126 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:19:11.126 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.126 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:19:11.126 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:11.126 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:11.127 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.127 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.127 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.127 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:19:11.128 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:19:11.128 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.128 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:19:11.128 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:19:11.128 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.129 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:11.129 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:11.129 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:19:11.129 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:19:11.130 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:11.130 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:19:11.130 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:19:11.131 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:11.131 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.131 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:11.131 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:19:11.132 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:11.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e50066470 msgr2=0x7f6e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e50066470 0x7f6e50068930 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6e641f61f0 tx=0x7f6e58009040 comp rx=0 tx=0).stop 2023-10-25T16:19:11.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 msgr2=0x7f6e6414ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e6414ad30 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f6e5401d000 tx=0x7f6e54005590 comp rx=0 tx=0).stop 2023-10-25T16:19:11.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 shutdown_connections 2023-10-25T16:19:11.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e50066470 0x7f6e50068930 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e640ab0a0 0x7f6e640ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e640abdb0 0x7f6e6413c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 --2- 172.21.15.177:0/2505704667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e4c0039b0 0x7f6e6414ad30 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 >> 172.21.15.177:0/2505704667 conn(0x7f6e640b2450 msgr2=0x7f6e640aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:11.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 shutdown_connections 2023-10-25T16:19:11.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.092+0000 7f6e6959c640 1 -- 172.21.15.177:0/2505704667 wait complete. 2023-10-25T16:19:11.137 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 -- 172.21.15.177:0/4208629723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 msgr2=0x7fdfa80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 --2- 172.21.15.177:0/4208629723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa80b4100 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009840 tx=0x7fdfa401c600 comp rx=0 tx=0).stop 2023-10-25T16:19:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 -- 172.21.15.177:0/4208629723 shutdown_connections 2023-10-25T16:19:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 --2- 172.21.15.177:0/4208629723 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa80b2120 0x7fdfa80d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 --2- 172.21.15.177:0/4208629723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa80b4100 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 -- 172.21.15.177:0/4208629723 >> 172.21.15.177:0/4208629723 conn(0x7fdfa809a5c0 msgr2=0x7fdfa80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 -- 172.21.15.177:0/4208629723 shutdown_connections 2023-10-25T16:19:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.264+0000 7fdfafa95640 1 -- 172.21.15.177:0/4208629723 wait complete. 2023-10-25T16:19:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 Processor -- start 2023-10-25T16:19:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- start start 2023-10-25T16:19:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80b2120 0x7fdfa81f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa80cdb10 0x7fdfa815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa81f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80c5b10 con 0x7fdfa815eba0 2023-10-25T16:19:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80c6690 con 0x7fdfa80b2120 2023-10-25T16:19:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80c5d60 con 0x7fdfa80cdb10 2023-10-25T16:19:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa81f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa81f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41914/0 (socket says 172.21.15.177:41914) 2023-10-25T16:19:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 -- 172.21.15.177:0/1465408560 learned_addr learned my addr 172.21.15.177:0/1465408560 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfad030640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa80cdb10 0x7fdfa815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 -- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa80cdb10 msgr2=0x7fdfa815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfad831640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80b2120 0x7fdfa81f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa80cdb10 0x7fdfa815db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 -- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80b2120 msgr2=0x7fdfa81f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80b2120 0x7fdfa81f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 -- 172.21.15.177:0/1465408560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40094a0 con 0x7fdfa815eba0 2023-10-25T16:19:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfae032640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa81f1850 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e780 tx=0x7fdfa000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000f930 con 0x7fdfa815eba0 2023-10-25T16:19:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdfa000fb80 con 0x7fdfa815eba0 2023-10-25T16:19:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa80c6040 con 0x7fdfa815eba0 2023-10-25T16:19:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0017440 con 0x7fdfa815eba0 2023-10-25T16:19:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa815e070 con 0x7fdfa815eba0 2023-10-25T16:19:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.268+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa80c6800 con 0x7fdfa815eba0 2023-10-25T16:19:11.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.272+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdfa00203b0 con 0x7fdfa815eba0 2023-10-25T16:19:11.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.272+0000 7fdf9e7fc640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf8c066470 0x7fdf8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.272+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdfa0086670 con 0x7fdfa815eba0 2023-10-25T16:19:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.272+0000 7fdfad831640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf8c066470 0x7fdf8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.272+0000 7fdfad831640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf8c066470 0x7fdf8c068930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40ae000 tx=0x7fdfa401ae40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.276+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdfa0053e30 con 0x7fdfa815eba0 2023-10-25T16:19:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.428+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfa804daf0 con 0x7fdfa815eba0 2023-10-25T16:19:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.428+0000 7fdf9e7fc640 1 -- 172.21.15.177:0/1465408560 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+12892 (secure 0 0 0) 0x7fdfa001c090 con 0x7fdfa815eba0 2023-10-25T16:19:11.430 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:11.430 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":125,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:10.715250+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:11.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf8c066470 msgr2=0x7fdf8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf8c066470 0x7fdf8c068930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40ae000 tx=0x7fdfa401ae40 comp rx=0 tx=0).stop 2023-10-25T16:19:11.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 msgr2=0x7fdfa81f1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa81f1850 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e780 tx=0x7fdfa000ec40 comp rx=0 tx=0).stop 2023-10-25T16:19:11.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 shutdown_connections 2023-10-25T16:19:11.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdf8c066470 0x7fdf8c068930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfa815eba0 0x7fdfa81f1850 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdfa80cdb10 0x7fdfa815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 --2- 172.21.15.177:0/1465408560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfa80b2120 0x7fdfa81f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 >> 172.21.15.177:0/1465408560 conn(0x7fdfa809a5c0 msgr2=0x7fdfa80b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:11.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 shutdown_connections 2023-10-25T16:19:11.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.432+0000 7fdfafa95640 1 -- 172.21.15.177:0/1465408560 wait complete. 2023-10-25T16:19:11.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:11.450 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:11.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- 172.21.15.177:0/707535997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806c090 msgr2=0x7f96e8070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 --2- 172.21.15.177:0/707535997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806c090 0x7f96e8070510 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009c80 tx=0x7f96e001cd10 comp rx=0 tx=0).stop 2023-10-25T16:19:11.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- 172.21.15.177:0/707535997 shutdown_connections 2023-10-25T16:19:11.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 --2- 172.21.15.177:0/707535997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806c090 0x7f96e8070510 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- 172.21.15.177:0/707535997 >> 172.21.15.177:0/707535997 conn(0x7f96e80b2450 msgr2=0x7f96e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:11.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- 172.21.15.177:0/707535997 shutdown_connections 2023-10-25T16:19:11.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- 172.21.15.177:0/707535997 wait complete. 2023-10-25T16:19:11.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 Processor -- start 2023-10-25T16:19:11.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- start start 2023-10-25T16:19:11.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96e806c090 0x7f96e80af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 0x7f96e814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e8159230 0x7f96e814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80afa60 con 0x7f96e8071500 2023-10-25T16:19:11.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81421a0 con 0x7f96e806c090 2023-10-25T16:19:11.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96eddbd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80b0790 con 0x7f96e8159230 2023-10-25T16:19:11.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 0x7f96e814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 0x7f96e814d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41932/0 (socket says 172.21.15.177:41932) 2023-10-25T16:19:11.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 -- 172.21.15.177:0/2528277959 learned_addr learned my addr 172.21.15.177:0/2528277959 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 -- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e8159230 msgr2=0x7f96e814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e8159230 0x7f96e814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 -- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96e806c090 msgr2=0x7f96e80af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e77fe640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96e806c090 0x7f96e80af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96e806c090 0x7f96e80af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 -- 172.21.15.177:0/2528277959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00098e0 con 0x7f96e8071500 2023-10-25T16:19:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.580+0000 7f96e6ffd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 0x7f96e814d6e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c450 tx=0x7f96d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0005480 con 0x7f96e8071500 2023-10-25T16:19:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96d0003600 con 0x7f96e8071500 2023-10-25T16:19:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e81564d0 con 0x7f96e8071500 2023-10-25T16:19:11.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0003a30 con 0x7f96e8071500 2023-10-25T16:19:11.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e80b0140 con 0x7f96e8071500 2023-10-25T16:19:11.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e804daf0 con 0x7f96e8071500 2023-10-25T16:19:11.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96d0003b90 con 0x7f96e8071500 2023-10-25T16:19:11.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96dffff640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96c8066470 0x7f96c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96d00832a0 con 0x7f96e8071500 2023-10-25T16:19:11.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96e77fe640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96c8066470 0x7f96c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.584+0000 7f96e77fe640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96c8066470 0x7f96c8068930 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a750 tx=0x7f96d8008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:11.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.588+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96d0050b00 con 0x7f96e8071500 2023-10-25T16:19:11.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.732+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96e815bec0 con 0x7f96e8071500 2023-10-25T16:19:11.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.732+0000 7f96dffff640 1 -- 172.21.15.177:0/2528277959 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96d00170a0 con 0x7f96e8071500 2023-10-25T16:19:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:11.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96c8066470 msgr2=0x7f96c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96c8066470 0x7f96c8068930 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96d800a750 tx=0x7f96d8008040 comp rx=0 tx=0).stop 2023-10-25T16:19:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 msgr2=0x7f96e814d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 0x7f96e814d6e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c450 tx=0x7f96d000c910 comp rx=0 tx=0).stop 2023-10-25T16:19:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 shutdown_connections 2023-10-25T16:19:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96c8066470 0x7f96c8068930 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e8159230 0x7f96e814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e8071500 0x7f96e814d6e0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 --2- 172.21.15.177:0/2528277959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96e806c090 0x7f96e80af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 >> 172.21.15.177:0/2528277959 conn(0x7f96e80b2450 msgr2=0x7f96e806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 shutdown_connections 2023-10-25T16:19:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.736+0000 7f96eddbd640 1 -- 172.21.15.177:0/2528277959 wait complete. 2023-10-25T16:19:11.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:19:11.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 -- 172.21.15.177:0/710123054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015eba0 msgr2=0x7f0b000b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 --2- 172.21.15.177:0/710123054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015eba0 0x7f0b000b4100 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0b0009f200 tx=0x7f0af001c810 comp rx=0 tx=0).stop 2023-10-25T16:19:11.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 -- 172.21.15.177:0/710123054 shutdown_connections 2023-10-25T16:19:11.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 --2- 172.21.15.177:0/710123054 >> v2:172.21.15.184:3300/0 conn(0x7f0b000b2120 0x7f0b000d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 --2- 172.21.15.177:0/710123054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b0015eba0 0x7f0b000b4100 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 -- 172.21.15.177:0/710123054 >> 172.21.15.177:0/710123054 conn(0x7f0b0009a5c0 msgr2=0x7f0b000d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:11.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 -- 172.21.15.177:0/710123054 shutdown_connections 2023-10-25T16:19:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.876+0000 7f0b0581e640 1 -- 172.21.15.177:0/710123054 wait complete. 2023-10-25T16:19:11.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 Processor -- start 2023-10-25T16:19:11.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- start start 2023-10-25T16:19:11.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 0x7f0b000c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b000cdb10 0x7f0b000ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b0015eba0 0x7f0b0015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c9500 con 0x7f0b000b2120 2023-10-25T16:19:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c97e0 con 0x7f0b000cdb10 2023-10-25T16:19:11.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c9ac0 con 0x7f0b0015eba0 2023-10-25T16:19:11.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 0x7f0b000c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 0x7f0b000c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41948/0 (socket says 172.21.15.177:41948) 2023-10-25T16:19:11.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 -- 172.21.15.177:0/1085916432 learned_addr learned my addr 172.21.15.177:0/1085916432 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:11.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 -- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b0015eba0 msgr2=0x7f0b0015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b0015eba0 0x7f0b0015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 -- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b000cdb10 msgr2=0x7f0b000ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:11.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b000cdb10 0x7f0b000ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:11.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 -- 172.21.15.177:0/1085916432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0009560 con 0x7f0b000b2120 2023-10-25T16:19:11.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afeffd640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 0x7f0b000c7540 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0af00b0040 tx=0x7f0af00a66c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:11.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00042c0 con 0x7f0b000b2120 2023-10-25T16:19:11.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0af0004510 con 0x7f0b000b2120 2023-10-25T16:19:11.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000c9da0 con 0x7f0b000b2120 2023-10-25T16:19:11.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00052a0 con 0x7f0b000b2120 2023-10-25T16:19:11.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b000c7a80 con 0x7f0b000b2120 2023-10-25T16:19:11.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b000c9c00 con 0x7f0b000b2120 2023-10-25T16:19:11.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0af0005400 con 0x7f0b000b2120 2023-10-25T16:19:11.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afcff9640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ae0066470 0x7f0ae0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:11.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0af00aa070 con 0x7f0b000b2120 2023-10-25T16:19:11.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.880+0000 7f0af67fc640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ae0066470 0x7f0ae0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:11.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.884+0000 7f0af67fc640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ae0066470 0x7f0ae0068930 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80058d0 tx=0x7f0ae8005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:11.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:11.884+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b000c9c00 con 0x7f0b000b2120 2023-10-25T16:19:12.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.040+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b000c9c00 con 0x7f0b000b2120 2023-10-25T16:19:12.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.040+0000 7f0afcff9640 1 -- 172.21.15.177:0/1085916432 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0b000c9c00 con 0x7f0b000b2120 2023-10-25T16:19:12.040 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:12.041 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:19:12.041 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:12.041 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:19:12.041 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:19:12.041 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:12.042 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:19:12.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ae0066470 msgr2=0x7f0ae0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:12.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ae0066470 0x7f0ae0068930 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80058d0 tx=0x7f0ae8005860 comp rx=0 tx=0).stop 2023-10-25T16:19:12.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 msgr2=0x7f0b000c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:12.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 0x7f0b000c7540 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f0af00b0040 tx=0x7f0af00a66c0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 shutdown_connections 2023-10-25T16:19:12.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ae0066470 0x7f0ae0068930 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b0015eba0 0x7f0b0015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b000cdb10 0x7f0b000ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 --2- 172.21.15.177:0/1085916432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b000b2120 0x7f0b000c7540 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 >> 172.21.15.177:0/1085916432 conn(0x7f0b0009a5c0 msgr2=0x7f0b000b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 shutdown_connections 2023-10-25T16:19:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.044+0000 7f0b0581e640 1 -- 172.21.15.177:0/1085916432 wait complete. 2023-10-25T16:19:12.057 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:19:12.058 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:19:12.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 -- 172.21.15.177:0/663959938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180afd90 msgr2=0x7f54180b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:12.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 --2- 172.21.15.177:0/663959938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180afd90 0x7f54180b0220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5410009bc0 tx=0x7f541001cb50 comp rx=0 tx=0).stop 2023-10-25T16:19:12.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 -- 172.21.15.177:0/663959938 shutdown_connections 2023-10-25T16:19:12.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 --2- 172.21.15.177:0/663959938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180afd90 0x7f54180b0220 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 --2- 172.21.15.177:0/663959938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180c9680 0x7f5418071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 -- 172.21.15.177:0/663959938 >> 172.21.15.177:0/663959938 conn(0x7f5418069920 msgr2=0x7f5418069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:12.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 -- 172.21.15.177:0/663959938 shutdown_connections 2023-10-25T16:19:12.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 -- 172.21.15.177:0/663959938 wait complete. 2023-10-25T16:19:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 Processor -- start 2023-10-25T16:19:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.180+0000 7f541faad640 1 -- start start 2023-10-25T16:19:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 0x7f54180af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180afd90 0x7f541814aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180c9680 0x7f5418150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541814eb50 con 0x7f541806c3d0 2023-10-25T16:19:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180ae000 con 0x7f54180c9680 2023-10-25T16:19:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54180ae2e0 con 0x7f54180afd90 2023-10-25T16:19:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 0x7f54180af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 0x7f54180af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41954/0 (socket says 172.21.15.177:41954) 2023-10-25T16:19:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 -- 172.21.15.177:0/212724742 learned_addr learned my addr 172.21.15.177:0/212724742 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d048640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180afd90 0x7f541814aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541e04a640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180c9680 0x7f5418150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 -- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180afd90 msgr2=0x7f541814aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180afd90 0x7f541814aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 -- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180c9680 msgr2=0x7f5418150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180c9680 0x7f5418150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 -- 172.21.15.177:0/212724742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5414009560 con 0x7f541806c3d0 2023-10-25T16:19:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d048640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180afd90 0x7f541814aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d849640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 0x7f54180af5a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400cd80 con 0x7f541806c3d0 2023-10-25T16:19:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5414004020 con 0x7f541806c3d0 2023-10-25T16:19:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410009820 con 0x7f541806c3d0 2023-10-25T16:19:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414004430 con 0x7f541806c3d0 2023-10-25T16:19:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541814afd0 con 0x7f541806c3d0 2023-10-25T16:19:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5418073360 con 0x7f541806c3d0 2023-10-25T16:19:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5414003600 con 0x7f541806c3d0 2023-10-25T16:19:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f540e7fc640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f53fc066470 0x7f53fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5414014070 con 0x7f541806c3d0 2023-10-25T16:19:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d048640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f53fc066470 0x7f53fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.184+0000 7f541d048640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f53fc066470 0x7f53fc068930 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5418157360 tx=0x7f5408009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.188+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5414051ee0 con 0x7f541806c3d0 2023-10-25T16:19:12.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:12.328+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f541806bf30 con 0x7f541806c3d0 2023-10-25T16:19:13.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.112+0000 7f540e7fc640 1 -- 172.21.15.177:0/212724742 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5414055500 con 0x7f541806c3d0 2023-10-25T16:19:13.111 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:19:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f53fc066470 msgr2=0x7f53fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f53fc066470 0x7f53fc068930 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5418157360 tx=0x7f5408009040 comp rx=0 tx=0).stop 2023-10-25T16:19:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 msgr2=0x7f54180af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:13.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 0x7f54180af5a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400edf0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 shutdown_connections 2023-10-25T16:19:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f53fc066470 0x7f53fc068930 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54180c9680 0x7f5418150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54180afd90 0x7f541814aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 --2- 172.21.15.177:0/212724742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f541806c3d0 0x7f54180af5a0 secure :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400edf0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 >> 172.21.15.177:0/212724742 conn(0x7f5418069920 msgr2=0x7f5418157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 shutdown_connections 2023-10-25T16:19:13.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.116+0000 7f541faad640 1 -- 172.21.15.177:0/212724742 wait complete. 2023-10-25T16:19:13.139 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:19:13.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 -- 172.21.15.177:0/2602129796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f81573e0 msgr2=0x7fc7f80aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:13.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/2602129796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f81573e0 0x7fc7f80aef70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009900 tx=0x7fc7f401c850 comp rx=0 tx=0).stop 2023-10-25T16:19:13.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 -- 172.21.15.177:0/2602129796 shutdown_connections 2023-10-25T16:19:13.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/2602129796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f80af4b0 0x7fc7f80b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/2602129796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f81573e0 0x7fc7f80aef70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 -- 172.21.15.177:0/2602129796 >> 172.21.15.177:0/2602129796 conn(0x7fc7f80698f0 msgr2=0x7fc7f8069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:13.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 -- 172.21.15.177:0/2602129796 shutdown_connections 2023-10-25T16:19:13.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.272+0000 7fc7ffaef640 1 -- 172.21.15.177:0/2602129796 wait complete. 2023-10-25T16:19:13.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 Processor -- start 2023-10-25T16:19:13.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 -- start start 2023-10-25T16:19:13.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 0x7fc7f813d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:13.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f80aff30 0x7fc7f8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:13.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f81573e0 0x7fc7f8159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:13.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81f3290 con 0x7fc7f80af4b0 2023-10-25T16:19:13.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8159eb0 con 0x7fc7f80aff30 2023-10-25T16:19:13.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f815a190 con 0x7fc7f81573e0 2023-10-25T16:19:13.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 0x7fc7f813d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:13.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 0x7fc7f813d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41966/0 (socket says 172.21.15.177:41966) 2023-10-25T16:19:13.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 -- 172.21.15.177:0/738353978 learned_addr learned my addr 172.21.15.177:0/738353978 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:13.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fe08c640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f81573e0 0x7fc7f8159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:13.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 -- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f81573e0 msgr2=0x7fc7f8159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:13.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd08a640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f80aff30 0x7fc7f8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:13.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f81573e0 0x7fc7f8159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 -- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f80aff30 msgr2=0x7fc7f8159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:13.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f80aff30 0x7fc7f8159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:13.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 -- 172.21.15.177:0/738353978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4009560 con 0x7fc7f80af4b0 2023-10-25T16:19:13.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7fd88b640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 0x7fc7f813d8b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc7f401af00 tx=0x7fc7f40a56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:13.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4003800 con 0x7fc7f80af4b0 2023-10-25T16:19:13.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7f40a58e0 con 0x7fc7f80af4b0 2023-10-25T16:19:13.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f815a470 con 0x7fc7f80af4b0 2023-10-25T16:19:13.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4003cb0 con 0x7fc7f80af4b0 2023-10-25T16:19:13.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.276+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f8159bc0 con 0x7fc7f80af4b0 2023-10-25T16:19:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.280+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f804db20 con 0x7fc7f80af4b0 2023-10-25T16:19:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.280+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7f40b4040 con 0x7fc7f80af4b0 2023-10-25T16:19:13.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.280+0000 7fc7ee7fc640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7dc066470 0x7fc7dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:13.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.280+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc7f411df80 con 0x7fc7f80af4b0 2023-10-25T16:19:13.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.280+0000 7fc7fd08a640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7dc066470 0x7fc7dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:13.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.280+0000 7fc7fd08a640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7dc066470 0x7fc7dc068930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8152760 tx=0x7fc7e8008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:13.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.284+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7f40eb530 con 0x7fc7f80af4b0 2023-10-25T16:19:13.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:13.436+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc7f81f3720 con 0x7fc7f80af4b0 2023-10-25T16:19:14.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ee7fc640 1 -- 172.21.15.177:0/738353978 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc7f40b2020 con 0x7fc7f80af4b0 2023-10-25T16:19:14.123 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:19:14.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7dc066470 msgr2=0x7fc7dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:14.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7dc066470 0x7fc7dc068930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8152760 tx=0x7fc7e8008040 comp rx=0 tx=0).stop 2023-10-25T16:19:14.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 msgr2=0x7fc7f813d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:14.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 0x7fc7f813d8b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc7f401af00 tx=0x7fc7f40a56f0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 shutdown_connections 2023-10-25T16:19:14.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7dc066470 0x7fc7dc068930 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f81573e0 0x7fc7f8159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f80aff30 0x7fc7f8159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 --2- 172.21.15.177:0/738353978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f80af4b0 0x7fc7f813d8b0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.124+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 >> 172.21.15.177:0/738353978 conn(0x7fc7f80698f0 msgr2=0x7fc7f80cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:14.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.128+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 shutdown_connections 2023-10-25T16:19:14.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.128+0000 7fc7ffaef640 1 -- 172.21.15.177:0/738353978 wait complete. 2023-10-25T16:19:14.154 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:19:14.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1105478382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 msgr2=0x7f450000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1105478382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f450000b990 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f450c001d70 tx=0x7f450c01cae0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1105478382 shutdown_connections 2023-10-25T16:19:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1105478382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f450000b990 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1105478382 >> 172.21.15.177:0/1105478382 conn(0x7f45140b2450 msgr2=0x7f45140b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:14.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1105478382 shutdown_connections 2023-10-25T16:19:14.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1105478382 wait complete. 2023-10-25T16:19:14.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 Processor -- start 2023-10-25T16:19:14.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- start start 2023-10-25T16:19:14.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f45141449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:14.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4514152450 0x7f45141581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:14.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4514152ad0 0x7f4514152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:14.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141534c0 con 0x7f4500005190 2023-10-25T16:19:14.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514156a50 con 0x7f4514152ad0 2023-10-25T16:19:14.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514154f30 con 0x7f4514152450 2023-10-25T16:19:14.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f45141449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:14.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f45141449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41988/0 (socket says 172.21.15.177:41988) 2023-10-25T16:19:14.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 -- 172.21.15.177:0/1549445461 learned_addr learned my addr 172.21.15.177:0/1549445461 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:14.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4518988640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4514152450 0x7f45141581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:14.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451998a640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4514152ad0 0x7f4514152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:14.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 -- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4514152450 msgr2=0x7f45141581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:14.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4514152450 0x7f45141581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 -- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4514152ad0 msgr2=0x7f4514152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:14.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4514152ad0 0x7f4514152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:14.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 -- 172.21.15.177:0/1549445461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514144ee0 con 0x7f4500005190 2023-10-25T16:19:14.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4518988640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4514152450 0x7f45141581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:14.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4519189640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f45141449a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f4510011820 tx=0x7f4510011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:14.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510004460 con 0x7f4500005190 2023-10-25T16:19:14.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f451000f940 con 0x7f4500005190 2023-10-25T16:19:14.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514155180 con 0x7f4500005190 2023-10-25T16:19:14.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000fcb0 con 0x7f4500005190 2023-10-25T16:19:14.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.280+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514155510 con 0x7f4500005190 2023-10-25T16:19:14.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.284+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451404daf0 con 0x7f4500005190 2023-10-25T16:19:14.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.284+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4510003600 con 0x7f4500005190 2023-10-25T16:19:14.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.284+0000 7f4509ffb640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44f8066470 0x7f44f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:14.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.284+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4510084c20 con 0x7f4500005190 2023-10-25T16:19:14.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.284+0000 7f4518988640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44f8066470 0x7f44f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:14.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.284+0000 7f4518988640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44f8066470 0x7f44f8068930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f45140cc890 tx=0x7f4504000f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:14.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.288+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4510052100 con 0x7f4500005190 2023-10-25T16:19:14.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:14.476+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45140cdc10 con 0x7f4500005190 2023-10-25T16:19:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.156+0000 7f4509ffb640 1 -- 172.21.15.177:0/1549445461 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4510055720 con 0x7f4500005190 2023-10-25T16:19:15.159 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 14 and data pool 15 2023-10-25T16:19:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.164+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44f8066470 msgr2=0x7f44f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.164+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44f8066470 0x7f44f8068930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f45140cc890 tx=0x7f4504000f40 comp rx=0 tx=0).stop 2023-10-25T16:19:15.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.164+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 msgr2=0x7f45141449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.164+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f45141449a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f4510011820 tx=0x7f4510011ce0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 shutdown_connections 2023-10-25T16:19:15.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44f8066470 0x7f44f8068930 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4514152ad0 0x7f4514152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4514152450 0x7f45141581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 --2- 172.21.15.177:0/1549445461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4500005190 0x7f45141449a0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 >> 172.21.15.177:0/1549445461 conn(0x7f45140b2450 msgr2=0x7f451414f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 shutdown_connections 2023-10-25T16:19:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.168+0000 7f451b3ed640 1 -- 172.21.15.177:0/1549445461 wait complete. 2023-10-25T16:19:15.190 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:15.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/3828812683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 msgr2=0x7fd1180cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/3828812683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd1180cdf80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd1180b3ea0 tx=0x7fd10801c810 comp rx=0 tx=0).stop 2023-10-25T16:19:15.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/3828812683 shutdown_connections 2023-10-25T16:19:15.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/3828812683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd1180cdf80 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/3828812683 >> v2:172.21.15.184:3300/0 conn(0x7fd11815eba0 0x7fd1180b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/3828812683 >> 172.21.15.177:0/3828812683 conn(0x7fd11809a5c0 msgr2=0x7fd1180d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/3828812683 shutdown_connections 2023-10-25T16:19:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/3828812683 wait complete. 2023-10-25T16:19:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 Processor -- start 2023-10-25T16:19:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- start start 2023-10-25T16:19:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1180b2120 0x7fd11814e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd11814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd11815eba0 0x7fd1181534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c8380 con 0x7fd1180cdb10 2023-10-25T16:19:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11814e5a0 con 0x7fd1180b2120 2023-10-25T16:19:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11814f0d0 con 0x7fd11815eba0 2023-10-25T16:19:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd11814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd11814e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42008/0 (socket says 172.21.15.177:42008) 2023-10-25T16:19:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 -- 172.21.15.177:0/2064193397 learned_addr learned my addr 172.21.15.177:0/2064193397 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11da7d640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd11815eba0 0x7fd1181534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11d27c640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1180b2120 0x7fd11814e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 -- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd11815eba0 msgr2=0x7fd1181534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd11815eba0 0x7fd1181534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 -- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1180b2120 msgr2=0x7fd11814e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1180b2120 0x7fd11814e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 -- 172.21.15.177:0/2064193397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009560 con 0x7fd1180cdb10 2023-10-25T16:19:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11ca7b640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd11814e7d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd11000c7f0 tx=0x7fd11000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110003b80 con 0x7fd1180cdb10 2023-10-25T16:19:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd110003ce0 con 0x7fd1180cdb10 2023-10-25T16:19:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11814f3b0 con 0x7fd1180cdb10 2023-10-25T16:19:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000aab0 con 0x7fd1180cdb10 2023-10-25T16:19:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.312+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11814f970 con 0x7fd1180cdb10 2023-10-25T16:19:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.316+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1180c84f0 con 0x7fd1180cdb10 2023-10-25T16:19:15.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.316+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd11000ac10 con 0x7fd1180cdb10 2023-10-25T16:19:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.316+0000 7fd10dffb640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0fc066470 0x7fd0fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.316+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd110083e70 con 0x7fd1180cdb10 2023-10-25T16:19:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.316+0000 7fd11d27c640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0fc066470 0x7fd0fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.316+0000 7fd11d27c640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0fc066470 0x7fd0fc068930 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd1140058d0 tx=0x7fd114005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:15.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.320+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd110051360 con 0x7fd1180cdb10 2023-10-25T16:19:15.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.472+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd11804daf0 con 0x7fd1180cdb10 2023-10-25T16:19:15.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.476+0000 7fd10dffb640 1 -- 172.21.15.177:0/2064193397 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16557 (secure 0 0 0) 0x7fd110054980 con 0x7fd1180cdb10 2023-10-25T16:19:15.476 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:15.477 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":128,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:14.479869+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:15.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0fc066470 msgr2=0x7fd0fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0fc066470 0x7fd0fc068930 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd1140058d0 tx=0x7fd114005860 comp rx=0 tx=0).stop 2023-10-25T16:19:15.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 msgr2=0x7fd11814e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd11814e7d0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd11000c7f0 tx=0x7fd11000ccb0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 shutdown_connections 2023-10-25T16:19:15.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0fc066470 0x7fd0fc068930 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd11815eba0 0x7fd1181534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1180cdb10 0x7fd11814e7d0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 --2- 172.21.15.177:0/2064193397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1180b2120 0x7fd11814e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 >> 172.21.15.177:0/2064193397 conn(0x7fd11809a5c0 msgr2=0x7fd11815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:15.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 shutdown_connections 2023-10-25T16:19:15.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.480+0000 7fd11f4e0640 1 -- 172.21.15.177:0/2064193397 wait complete. 2023-10-25T16:19:15.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:15.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe59cfa6640 1 -- 172.21.15.177:0/2729687307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5800047d0 msgr2=0x7fe580004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/2729687307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5800047d0 0x7fe580004c50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001190 tx=0x7fe58c01f690 comp rx=0 tx=0).stop 2023-10-25T16:19:15.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe596d9d640 1 -- 172.21.15.177:0/2729687307 reap_dead start 2023-10-25T16:19:15.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe59cfa6640 1 -- 172.21.15.177:0/2729687307 shutdown_connections 2023-10-25T16:19:15.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe59cfa6640 1 -- 172.21.15.177:0/2729687307 >> 172.21.15.177:0/2729687307 conn(0x7fe5980b2450 msgr2=0x7fe5980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:15.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe59cfa6640 1 -- 172.21.15.177:0/2729687307 shutdown_connections 2023-10-25T16:19:15.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.620+0000 7fe59cfa6640 1 -- 172.21.15.177:0/2729687307 wait complete. 2023-10-25T16:19:15.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 Processor -- start 2023-10-25T16:19:15.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- start start 2023-10-25T16:19:15.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5800047d0 0x7fe598143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 0x7fe5981440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe598144620 0x7fe5981572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598145790 con 0x7fe598145c20 2023-10-25T16:19:15.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598144b80 con 0x7fe5800047d0 2023-10-25T16:19:15.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe598144e60 con 0x7fe598144620 2023-10-25T16:19:15.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 0x7fe5981440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 0x7fe5981440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42030/0 (socket says 172.21.15.177:42030) 2023-10-25T16:19:15.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 -- 172.21.15.177:0/161074782 learned_addr learned my addr 172.21.15.177:0/161074782 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:15.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe596d9d640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe598144620 0x7fe5981572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59659c640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5800047d0 0x7fe598143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 -- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe598144620 msgr2=0x7fe5981572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe598144620 0x7fe5981572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 -- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5800047d0 msgr2=0x7fe598143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5800047d0 0x7fe598143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 -- 172.21.15.177:0/161074782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598145140 con 0x7fe598145c20 2023-10-25T16:19:15.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe595d9b640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 0x7fe5981440e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001a70 tx=0x7fe58c000f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:15.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0062f0 con 0x7fe598145c20 2023-10-25T16:19:15.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe58c0036f0 con 0x7fe598145c20 2023-10-25T16:19:15.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598145420 con 0x7fe598145c20 2023-10-25T16:19:15.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c003b00 con 0x7fe598145c20 2023-10-25T16:19:15.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe598143c80 con 0x7fe598145c20 2023-10-25T16:19:15.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.624+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598145900 con 0x7fe598145c20 2023-10-25T16:19:15.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.628+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe58c003c60 con 0x7fe598145c20 2023-10-25T16:19:15.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.628+0000 7fe586ffd640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe578066470 0x7fe578068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.628+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe58c121bd0 con 0x7fe598145c20 2023-10-25T16:19:15.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.628+0000 7fe59659c640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe578066470 0x7fe578068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.628+0000 7fe59659c640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe578066470 0x7fe578068930 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe588009f20 tx=0x7fe588009500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:15.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.632+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe58c0ef0a0 con 0x7fe598145c20 2023-10-25T16:19:15.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.784+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe59804daf0 con 0x7fe598145c20 2023-10-25T16:19:15.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe586ffd640 1 -- 172.21.15.177:0/161074782 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16557 (secure 0 0 0) 0x7fe58c0f26c0 con 0x7fe598145c20 2023-10-25T16:19:15.787 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:15.787 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":128,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:14.479869+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:15.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe578066470 msgr2=0x7fe578068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe578066470 0x7fe578068930 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe588009f20 tx=0x7fe588009500 comp rx=0 tx=0).stop 2023-10-25T16:19:15.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 msgr2=0x7fe5981440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 0x7fe5981440e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001a70 tx=0x7fe58c000f80 comp rx=0 tx=0).stop 2023-10-25T16:19:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 shutdown_connections 2023-10-25T16:19:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe578066470 0x7fe578068930 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe598144620 0x7fe5981572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe598145c20 0x7fe5981440e0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 --2- 172.21.15.177:0/161074782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5800047d0 0x7fe598143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 >> 172.21.15.177:0/161074782 conn(0x7fe5980b2450 msgr2=0x7fe598159610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 shutdown_connections 2023-10-25T16:19:15.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.788+0000 7fe59cfa6640 1 -- 172.21.15.177:0/161074782 wait complete. 2023-10-25T16:19:15.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:19:15.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 -- 172.21.15.177:0/997103988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5cc005e20 msgr2=0x7fe5cc0062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 --2- 172.21.15.177:0/997103988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5cc005e20 0x7fe5cc0062a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009ec0 tx=0x7fe5d801d5d0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e6bee640 1 -- 172.21.15.177:0/997103988 reap_dead start 2023-10-25T16:19:15.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 -- 172.21.15.177:0/997103988 shutdown_connections 2023-10-25T16:19:15.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 -- 172.21.15.177:0/997103988 >> 172.21.15.177:0/997103988 conn(0x7fe5e00b2450 msgr2=0x7fe5e00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:15.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 -- 172.21.15.177:0/997103988 shutdown_connections 2023-10-25T16:19:15.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 -- 172.21.15.177:0/997103988 wait complete. 2023-10-25T16:19:15.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 Processor -- start 2023-10-25T16:19:15.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.940+0000 7fe5e8651640 1 -- start start 2023-10-25T16:19:15.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5cc005e20 0x7fe5e0142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 0x7fe5e01433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5e00ae4f0 0x7fe5e0143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00adc70 con 0x7fe5e00ae090 2023-10-25T16:19:15.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e0142f50 con 0x7fe5cc005e20 2023-10-25T16:19:15.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e0156ec0 con 0x7fe5e00ae4f0 2023-10-25T16:19:15.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 0x7fe5e01433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 0x7fe5e01433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42048/0 (socket says 172.21.15.177:42048) 2023-10-25T16:19:15.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 -- 172.21.15.177:0/3823836688 learned_addr learned my addr 172.21.15.177:0/3823836688 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:15.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e63ed640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5cc005e20 0x7fe5e0142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 -- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5e00ae4f0 msgr2=0x7fe5e0143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e6bee640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5e00ae4f0 0x7fe5e0143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5e00ae4f0 0x7fe5e0143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 -- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5cc005e20 msgr2=0x7fe5e0142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:15.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5cc005e20 0x7fe5e0142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:15.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 -- 172.21.15.177:0/3823836688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e01571a0 con 0x7fe5e00ae090 2023-10-25T16:19:15.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e63ed640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5cc005e20 0x7fe5e0142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:15.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e5bec640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 0x7fe5e01433e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000ffd0 tx=0x7fe5d000d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:15.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0012740 con 0x7fe5e00ae090 2023-10-25T16:19:15.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5d0012990 con 0x7fe5e00ae090 2023-10-25T16:19:15.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e00ad890 con 0x7fe5e00ae090 2023-10-25T16:19:15.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0012d20 con 0x7fe5e00ae090 2023-10-25T16:19:15.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e01e3170 con 0x7fe5e00ae090 2023-10-25T16:19:15.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e00ae8d0 con 0x7fe5e00ae090 2023-10-25T16:19:15.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe5d00113d0 con 0x7fe5e00ae090 2023-10-25T16:19:15.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.944+0000 7fe5d6ffd640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5c4066470 0x7fe5c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:15.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.948+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5d0087500 con 0x7fe5e00ae090 2023-10-25T16:19:15.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.948+0000 7fe5e63ed640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5c4066470 0x7fe5c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:15.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.948+0000 7fe5e63ed640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5c4066470 0x7fe5c4068930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc006fd0 tx=0x7fe5dc006a90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:15.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:15.952+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5e00ae8d0 con 0x7fe5e00ae090 2023-10-25T16:19:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.144+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe5e00addb0 con 0x7fe5e00ae090 2023-10-25T16:19:16.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.164+0000 7fe5d6ffd640 1 -- 172.21.15.177:0/3823836688 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe5e00addb0 con 0x7fe5e00ae090 2023-10-25T16:19:16.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5c4066470 msgr2=0x7fe5c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:16.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5c4066470 0x7fe5c4068930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc006fd0 tx=0x7fe5dc006a90 comp rx=0 tx=0).stop 2023-10-25T16:19:16.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 msgr2=0x7fe5e01433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:16.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 0x7fe5e01433e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000ffd0 tx=0x7fe5d000d780 comp rx=0 tx=0).stop 2023-10-25T16:19:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 shutdown_connections 2023-10-25T16:19:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe5c4066470 0x7fe5c4068930 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5e00ae4f0 0x7fe5e0143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5e00ae090 0x7fe5e01433e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 --2- 172.21.15.177:0/3823836688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5cc005e20 0x7fe5e0142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 >> 172.21.15.177:0/3823836688 conn(0x7fe5e00b2450 msgr2=0x7fe5e006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:16.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 shutdown_connections 2023-10-25T16:19:16.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.168+0000 7fe5e8651640 1 -- 172.21.15.177:0/3823836688 wait complete. 2023-10-25T16:19:16.184 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:19:16.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:19:16.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- 172.21.15.177:0/2021447430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4800b2120 msgr2=0x7ff4800d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:16.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 --2- 172.21.15.177:0/2021447430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4800b2120 0x7ff4800d1bd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ff4800b3ea0 tx=0x7ff47401c750 comp rx=0 tx=0).stop 2023-10-25T16:19:16.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- 172.21.15.177:0/2021447430 shutdown_connections 2023-10-25T16:19:16.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 --2- 172.21.15.177:0/2021447430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4800b2120 0x7ff4800d1bd0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 --2- 172.21.15.177:0/2021447430 >> v2:172.21.15.184:3300/0 conn(0x7ff48015eba0 0x7ff4800b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- 172.21.15.177:0/2021447430 >> 172.21.15.177:0/2021447430 conn(0x7ff48009a5c0 msgr2=0x7ff4800d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:16.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- 172.21.15.177:0/2021447430 shutdown_connections 2023-10-25T16:19:16.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- 172.21.15.177:0/2021447430 wait complete. 2023-10-25T16:19:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 Processor -- start 2023-10-25T16:19:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- start start 2023-10-25T16:19:16.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4800b2120 0x7ff48014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4800cdb10 0x7ff4800b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 0x7ff48015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800b5720 con 0x7ff48015eba0 2023-10-25T16:19:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800b5970 con 0x7ff4800b2120 2023-10-25T16:19:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff486cba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800b5c50 con 0x7ff4800cdb10 2023-10-25T16:19:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff485257640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 0x7ff48015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff485257640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 0x7ff48015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42062/0 (socket says 172.21.15.177:42062) 2023-10-25T16:19:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.316+0000 7ff485257640 1 -- 172.21.15.177:0/1132490434 learned_addr learned my addr 172.21.15.177:0/1132490434 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff484a56640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4800b2120 0x7ff48014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47ffff640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4800cdb10 0x7ff4800b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff485257640 1 -- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4800cdb10 msgr2=0x7ff4800b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff485257640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4800cdb10 0x7ff4800b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff485257640 1 -- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4800b2120 msgr2=0x7ff48014ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff485257640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4800b2120 0x7ff48014ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff485257640 1 -- 172.21.15.177:0/1132490434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740094a0 con 0x7ff48015eba0 2023-10-25T16:19:16.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff485257640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 0x7ff48015b070 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff47800cb40 tx=0x7ff47800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:16.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800aa50 con 0x7ff48015eba0 2023-10-25T16:19:16.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff47800aca0 con 0x7ff48015eba0 2023-10-25T16:19:16.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4800b5f30 con 0x7ff48015eba0 2023-10-25T16:19:16.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478012680 con 0x7ff48015eba0 2023-10-25T16:19:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4800b64f0 con 0x7ff48015eba0 2023-10-25T16:19:16.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48004daf0 con 0x7ff48015eba0 2023-10-25T16:19:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff47801b400 con 0x7ff48015eba0 2023-10-25T16:19:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47d7fa640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff46c066470 0x7ff46c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff478084a50 con 0x7ff48015eba0 2023-10-25T16:19:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff484a56640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff46c066470 0x7ff46c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:16.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.320+0000 7ff484a56640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff46c066470 0x7ff46c068930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff470006fd0 tx=0x7ff470008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.324+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff478051fb0 con 0x7ff48015eba0 2023-10-25T16:19:16.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:16.516+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff4800b66e0 con 0x7ff48015eba0 2023-10-25T16:19:17.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.180+0000 7ff47d7fa640 1 -- 172.21.15.177:0/1132490434 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4780840c0 con 0x7ff48015eba0 2023-10-25T16:19:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff46c066470 msgr2=0x7ff46c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff46c066470 0x7ff46c068930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff470006fd0 tx=0x7ff470008040 comp rx=0 tx=0).stop 2023-10-25T16:19:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 msgr2=0x7ff48015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 0x7ff48015b070 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff47800cb40 tx=0x7ff47800cc30 comp rx=0 tx=0).stop 2023-10-25T16:19:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 shutdown_connections 2023-10-25T16:19:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff46c066470 0x7ff46c068930 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff48015eba0 0x7ff48015b070 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4800cdb10 0x7ff4800b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 --2- 172.21.15.177:0/1132490434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4800b2120 0x7ff48014ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 >> 172.21.15.177:0/1132490434 conn(0x7ff48009a5c0 msgr2=0x7ff480072bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 shutdown_connections 2023-10-25T16:19:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.184+0000 7ff486cba640 1 -- 172.21.15.177:0/1132490434 wait complete. 2023-10-25T16:19:17.204 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:19:17.205 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:17.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf46eb640 1 -- 172.21.15.177:0/4010837616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbd8003980 msgr2=0x7fdbd8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/4010837616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbd8003980 0x7fdbd8003da0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009b90 tx=0x7fdbe801d250 comp rx=0 tx=0).stop 2023-10-25T16:19:17.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf2c88640 1 -- 172.21.15.177:0/4010837616 reap_dead start 2023-10-25T16:19:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf46eb640 1 -- 172.21.15.177:0/4010837616 shutdown_connections 2023-10-25T16:19:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf46eb640 1 -- 172.21.15.177:0/4010837616 >> 172.21.15.177:0/4010837616 conn(0x7fdbec09a5c0 msgr2=0x7fdbec0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf46eb640 1 -- 172.21.15.177:0/4010837616 shutdown_connections 2023-10-25T16:19:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.332+0000 7fdbf46eb640 1 -- 172.21.15.177:0/4010837616 wait complete. 2023-10-25T16:19:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 Processor -- start 2023-10-25T16:19:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- start start 2023-10-25T16:19:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8003980 0x7fdbec165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbec14ca10 0x7fdbec15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 0x7fdbec163480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec15c930 con 0x7fdbec15a780 2023-10-25T16:19:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec15ac10 con 0x7fdbd8003980 2023-10-25T16:19:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec15b890 con 0x7fdbec14ca10 2023-10-25T16:19:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 0x7fdbec163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 0x7fdbec163480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42078/0 (socket says 172.21.15.177:42078) 2023-10-25T16:19:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 -- 172.21.15.177:0/2190334123 learned_addr learned my addr 172.21.15.177:0/2190334123 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf1c86640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbec14ca10 0x7fdbec15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2487640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8003980 0x7fdbec165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 -- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbec14ca10 msgr2=0x7fdbec15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbec14ca10 0x7fdbec15a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 -- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8003980 msgr2=0x7fdbec165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8003980 0x7fdbec165210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 -- 172.21.15.177:0/2190334123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec15bb70 con 0x7fdbec15a780 2023-10-25T16:19:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf2c88640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 0x7fdbec163480 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0b3ea0 tx=0x7fdbe400eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400c970 con 0x7fdbec15a780 2023-10-25T16:19:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbe400cbe0 con 0x7fdbec15a780 2023-10-25T16:19:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec15be50 con 0x7fdbec15a780 2023-10-25T16:19:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4011460 con 0x7fdbec15a780 2023-10-25T16:19:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec15c410 con 0x7fdbec15a780 2023-10-25T16:19:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec04daf0 con 0x7fdbec15a780 2023-10-25T16:19:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdbe40115c0 con 0x7fdbec15a780 2023-10-25T16:19:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.336+0000 7fdbe2ffd640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbd00664a0 0x7fdbd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.340+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbe40844a0 con 0x7fdbec15a780 2023-10-25T16:19:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.340+0000 7fdbf2487640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbd00664a0 0x7fdbd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.340+0000 7fdbf2487640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbd00664a0 0x7fdbd0068960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80ae000 tx=0x7fdbe8019ff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.344+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbe4051900 con 0x7fdbec15a780 2023-10-25T16:19:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbec08b370 con 0x7fdbec15a780 2023-10-25T16:19:17.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbe2ffd640 1 -- 172.21.15.177:0/2190334123 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fdbe4054f20 con 0x7fdbec15a780 2023-10-25T16:19:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:17.524 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:17.524 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:17.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbd00664a0 msgr2=0x7fdbd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbd00664a0 0x7fdbd0068960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80ae000 tx=0x7fdbe8019ff0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.525 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 msgr2=0x7fdbec163480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 0x7fdbec163480 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0b3ea0 tx=0x7fdbe400eae0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 shutdown_connections 2023-10-25T16:19:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbd00664a0 0x7fdbd0068960 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbec15a780 0x7fdbec163480 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbec14ca10 0x7fdbec15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 --2- 172.21.15.177:0/2190334123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8003980 0x7fdbec165210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 >> 172.21.15.177:0/2190334123 conn(0x7fdbec09a5c0 msgr2=0x7fdbec0d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 shutdown_connections 2023-10-25T16:19:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.524+0000 7fdbf46eb640 1 -- 172.21.15.177:0/2190334123 wait complete. 2023-10-25T16:19:17.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:17.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/1753045215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 msgr2=0x7fee580b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/1753045215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee580b4100 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fee48009900 tx=0x7fee4801c830 comp rx=0 tx=0).stop 2023-10-25T16:19:17.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/1753045215 shutdown_connections 2023-10-25T16:19:17.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/1753045215 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee580b2120 0x7fee580d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/1753045215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee580b4100 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/1753045215 >> 172.21.15.177:0/1753045215 conn(0x7fee5809a5c0 msgr2=0x7fee580d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:17.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/1753045215 shutdown_connections 2023-10-25T16:19:17.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/1753045215 wait complete. 2023-10-25T16:19:17.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 Processor -- start 2023-10-25T16:19:17.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- start start 2023-10-25T16:19:17.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee580b2120 0x7fee580c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee580cdb10 0x7fee580caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee581534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5806bc80 con 0x7fee5815eba0 2023-10-25T16:19:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee580c6740 con 0x7fee580b2120 2023-10-25T16:19:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee580c6a20 con 0x7fee580cdb10 2023-10-25T16:19:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee581534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee581534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42094/0 (socket says 172.21.15.177:42094) 2023-10-25T16:19:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 -- 172.21.15.177:0/2605539858 learned_addr learned my addr 172.21.15.177:0/2605539858 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee57fff640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee580b2120 0x7fee580c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 -- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee580cdb10 msgr2=0x7fee580caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee577fe640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee580cdb10 0x7fee580caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee580cdb10 0x7fee580caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 -- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee580b2120 msgr2=0x7fee580c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee580b2120 0x7fee580c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 -- 172.21.15.177:0/2605539858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48009560 con 0x7fee5815eba0 2023-10-25T16:19:17.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5cd5f640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee581534e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fee50001570 tx=0x7fee5000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:17.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50003db0 con 0x7fee5815eba0 2023-10-25T16:19:17.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee50005070 con 0x7fee5815eba0 2023-10-25T16:19:17.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50005480 con 0x7fee5815eba0 2023-10-25T16:19:17.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee580c6d00 con 0x7fee5815eba0 2023-10-25T16:19:17.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.652+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee580c72c0 con 0x7fee5815eba0 2023-10-25T16:19:17.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.656+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee580c74e0 con 0x7fee5815eba0 2023-10-25T16:19:17.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.656+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee500055e0 con 0x7fee5815eba0 2023-10-25T16:19:17.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.656+0000 7fee54ff9640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee44066470 0x7fee44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.656+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee500839f0 con 0x7fee5815eba0 2023-10-25T16:19:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.656+0000 7fee57fff640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee44066470 0x7fee44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.656+0000 7fee57fff640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee44066470 0x7fee44068930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fee480af000 tx=0x7fee4801b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.660+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee50050e70 con 0x7fee5815eba0 2023-10-25T16:19:17.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.804+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee5804daf0 con 0x7fee5815eba0 2023-10-25T16:19:17.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee54ff9640 1 -- 172.21.15.177:0/2605539858 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16544 (secure 0 0 0) 0x7fee50017070 con 0x7fee5815eba0 2023-10-25T16:19:17.806 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:17.806 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":129,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:16.128518+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:17.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee44066470 msgr2=0x7fee44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee44066470 0x7fee44068930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fee480af000 tx=0x7fee4801b070 comp rx=0 tx=0).stop 2023-10-25T16:19:17.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 msgr2=0x7fee581534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee581534e0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fee50001570 tx=0x7fee5000cd20 comp rx=0 tx=0).stop 2023-10-25T16:19:17.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 shutdown_connections 2023-10-25T16:19:17.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee44066470 0x7fee44068930 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5815eba0 0x7fee581534e0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee580cdb10 0x7fee580caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 --2- 172.21.15.177:0/2605539858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee580b2120 0x7fee580c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 >> 172.21.15.177:0/2605539858 conn(0x7fee5809a5c0 msgr2=0x7fee58157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:17.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 shutdown_connections 2023-10-25T16:19:17.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.808+0000 7fee5e7c2640 1 -- 172.21.15.177:0/2605539858 wait complete. 2023-10-25T16:19:17.823 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:19:17.824 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- 172.21.15.177:0/271851185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c15c3a0 msgr2=0x7fa42c15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 --2- 172.21.15.177:0/271851185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c15c3a0 0x7fa42c15c830 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa424009bc0 tx=0x7fa42401cb80 comp rx=0 tx=0).stop 2023-10-25T16:19:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- 172.21.15.177:0/271851185 shutdown_connections 2023-10-25T16:19:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 --2- 172.21.15.177:0/271851185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c15c3a0 0x7fa42c15c830 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 --2- 172.21.15.177:0/271851185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42c13d8f0 0x7fa42c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- 172.21.15.177:0/271851185 >> 172.21.15.177:0/271851185 conn(0x7fa42c0b2450 msgr2=0x7fa42c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- 172.21.15.177:0/271851185 shutdown_connections 2023-10-25T16:19:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- 172.21.15.177:0/271851185 wait complete. 2023-10-25T16:19:17.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 Processor -- start 2023-10-25T16:19:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- start start 2023-10-25T16:19:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c13d8f0 0x7fa42c13a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42c15b710 0x7fa42c140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 0x7fa42c0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c13ea30 con 0x7fa42c15c3a0 2023-10-25T16:19:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c151da0 con 0x7fa42c13d8f0 2023-10-25T16:19:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa4334e3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c152080 con 0x7fa42c15b710 2023-10-25T16:19:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa431a80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 0x7fa42c0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa431a80640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 0x7fa42c0cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42104/0 (socket says 172.21.15.177:42104) 2023-10-25T16:19:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa431a80640 1 -- 172.21.15.177:0/3072093872 learned_addr learned my addr 172.21.15.177:0/3072093872 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.940+0000 7fa43127f640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c13d8f0 0x7fa42c13a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa430a7e640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42c15b710 0x7fa42c140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa431a80640 1 -- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42c15b710 msgr2=0x7fa42c140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa431a80640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42c15b710 0x7fa42c140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa431a80640 1 -- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c13d8f0 msgr2=0x7fa42c13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa431a80640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c13d8f0 0x7fa42c13a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa431a80640 1 -- 172.21.15.177:0/3072093872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424009820 con 0x7fa42c15c3a0 2023-10-25T16:19:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa431a80640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 0x7fa42c0cce80 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa42401a7b0 tx=0x7fa424009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424004c50 con 0x7fa42c15c3a0 2023-10-25T16:19:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa4240a5b00 con 0x7fa42c15c3a0 2023-10-25T16:19:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c152360 con 0x7fa42c15c3a0 2023-10-25T16:19:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424004ea0 con 0x7fa42c15c3a0 2023-10-25T16:19:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c152640 con 0x7fa42c15c3a0 2023-10-25T16:19:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c04daf0 con 0x7fa42c15c3a0 2023-10-25T16:19:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa4240b4040 con 0x7fa42c15c3a0 2023-10-25T16:19:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa421ffb640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa410066470 0x7fa410068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:17.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa42411df30 con 0x7fa42c15c3a0 2023-10-25T16:19:17.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa43127f640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa410066470 0x7fa410068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:17.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.944+0000 7fa43127f640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa410066470 0x7fa410068930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa42c1f5f10 tx=0x7fa428009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:17.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:17.948+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4240eb310 con 0x7fa42c15c3a0 2023-10-25T16:19:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.100+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa42c0c9800 con 0x7fa410066470 2023-10-25T16:19:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.120+0000 7fa421ffb640 1 -- 172.21.15.177:0/3072093872 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277759 (secure 0 0 0) 0x7fa42c0c9800 con 0x7fa410066470 2023-10-25T16:19:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:18.123 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:18.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa410066470 msgr2=0x7fa410068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa410066470 0x7fa410068930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa42c1f5f10 tx=0x7fa428009040 comp rx=0 tx=0).stop 2023-10-25T16:19:18.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 msgr2=0x7fa42c0cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 0x7fa42c0cce80 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa42401a7b0 tx=0x7fa424009260 comp rx=0 tx=0).stop 2023-10-25T16:19:18.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 shutdown_connections 2023-10-25T16:19:18.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa410066470 0x7fa410068930 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c15c3a0 0x7fa42c0cce80 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa42c15b710 0x7fa42c140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 --2- 172.21.15.177:0/3072093872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa42c13d8f0 0x7fa42c13a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 >> 172.21.15.177:0/3072093872 conn(0x7fa42c0b2450 msgr2=0x7fa42c0b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:18.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 shutdown_connections 2023-10-25T16:19:18.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.124+0000 7fa4334e3640 1 -- 172.21.15.177:0/3072093872 wait complete. 2023-10-25T16:19:18.140 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2023-10-25T16:19:16.736844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555874,"statfs":{"total":1600000000,"available":1593215834,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001090"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143836+0000","last_change":"2023-10-25T16:19:14.143836+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143836+0000","last_undegraded":"2023-10-25T16:19:14.143836+0000","last_fullsized":"2023-10-25T16:19:14.143836+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136001+0000","last_change":"2023-10-25T16:19:14.136001+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136001+0000","last_undegraded":"2023-10-25T16:19:14.136001+0000","last_fullsized":"2023-10-25T16:19:14.136001+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136341+0000","last_change":"2023-10-25T16:19:14.136341+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136341+0000","last_undegraded":"2023-10-25T16:19:14.136341+0000","last_fullsized":"2023-10-25T16:19:14.136341+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134837+0000","last_change":"2023-10-25T16:19:14.134837+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134837+0000","last_undegraded":"2023-10-25T16:19:14.134837+0000","last_fullsized":"2023-10-25T16:19:14.134837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143456+0000","last_change":"2023-10-25T16:19:14.143456+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143456+0000","last_undegraded":"2023-10-25T16:19:14.143456+0000","last_fullsized":"2023-10-25T16:19:14.143456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144981+0000","last_change":"2023-10-25T16:19:14.144981+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144981+0000","last_undegraded":"2023-10-25T16:19:14.144981+0000","last_fullsized":"2023-10-25T16:19:14.144981+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142492+0000","last_change":"2023-10-25T16:19:14.142492+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142492+0000","last_undegraded":"2023-10-25T16:19:14.142492+0000","last_fullsized":"2023-10-25T16:19:14.142492+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137041+0000","last_change":"2023-10-25T16:19:14.137041+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137041+0000","last_undegraded":"2023-10-25T16:19:14.137041+0000","last_fullsized":"2023-10-25T16:19:14.137041+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137924+0000","last_change":"2023-10-25T16:19:14.137924+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137924+0000","last_undegraded":"2023-10-25T16:19:14.137924+0000","last_fullsized":"2023-10-25T16:19:14.137924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142709+0000","last_change":"2023-10-25T16:19:14.142709+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142709+0000","last_undegraded":"2023-10-25T16:19:14.142709+0000","last_fullsized":"2023-10-25T16:19:14.142709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144213+0000","last_change":"2023-10-25T16:19:14.144213+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144213+0000","last_undegraded":"2023-10-25T16:19:14.144213+0000","last_fullsized":"2023-10-25T16:19:14.144213+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136650+0000","last_change":"2023-10-25T16:19:14.136650+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136650+0000","last_undegraded":"2023-10-25T16:19:14.136650+0000","last_fullsized":"2023-10-25T16:19:14.136650+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135308+0000","last_change":"2023-10-25T16:19:14.135308+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135308+0000","last_undegraded":"2023-10-25T16:19:14.135308+0000","last_fullsized":"2023-10-25T16:19:14.135308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138150+0000","last_change":"2023-10-25T16:19:14.138150+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138150+0000","last_undegraded":"2023-10-25T16:19:14.138150+0000","last_fullsized":"2023-10-25T16:19:14.138150+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143474+0000","last_change":"2023-10-25T16:19:14.143474+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143474+0000","last_undegraded":"2023-10-25T16:19:14.143474+0000","last_fullsized":"2023-10-25T16:19:14.143474+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135565+0000","last_change":"2023-10-25T16:19:14.135565+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135565+0000","last_undegraded":"2023-10-25T16:19:14.135565+0000","last_fullsized":"2023-10-25T16:19:14.135565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134900+0000","last_change":"2023-10-25T16:19:14.134900+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134900+0000","last_undegraded":"2023-10-25T16:19:14.134900+0000","last_fullsized":"2023-10-25T16:19:14.134900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141186+0000","last_change":"2023-10-25T16:19:14.141186+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141186+0000","last_undegraded":"2023-10-25T16:19:14.141186+0000","last_fullsized":"2023-10-25T16:19:14.141186+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135113+0000","last_change":"2023-10-25T16:19:14.135113+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135113+0000","last_undegraded":"2023-10-25T16:19:14.135113+0000","last_fullsized":"2023-10-25T16:19:14.135113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136653+0000","last_change":"2023-10-25T16:19:14.136653+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136653+0000","last_undegraded":"2023-10-25T16:19:14.136653+0000","last_fullsized":"2023-10-25T16:19:14.136653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143590+0000","last_change":"2023-10-25T16:19:14.143590+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143590+0000","last_undegraded":"2023-10-25T16:19:14.143590+0000","last_fullsized":"2023-10-25T16:19:14.143590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141938+0000","last_change":"2023-10-25T16:19:14.141938+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141938+0000","last_undegraded":"2023-10-25T16:19:14.141938+0000","last_fullsized":"2023-10-25T16:19:14.141938+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136063+0000","last_change":"2023-10-25T16:19:14.136063+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136063+0000","last_undegraded":"2023-10-25T16:19:14.136063+0000","last_fullsized":"2023-10-25T16:19:14.136063+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141642+0000","last_change":"2023-10-25T16:19:14.141642+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141642+0000","last_undegraded":"2023-10-25T16:19:14.141642+0000","last_fullsized":"2023-10-25T16:19:14.141642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138195+0000","last_change":"2023-10-25T16:19:14.138195+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138195+0000","last_undegraded":"2023-10-25T16:19:14.138195+0000","last_fullsized":"2023-10-25T16:19:14.138195+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134076+0000","last_change":"2023-10-25T16:19:14.134076+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134076+0000","last_undegraded":"2023-10-25T16:19:14.134076+0000","last_fullsized":"2023-10-25T16:19:14.134076+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136619+0000","last_change":"2023-10-25T16:19:14.136619+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136619+0000","last_undegraded":"2023-10-25T16:19:14.136619+0000","last_fullsized":"2023-10-25T16:19:14.136619+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139591+0000","last_change":"2023-10-25T16:19:14.139591+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139591+0000","last_undegraded":"2023-10-25T16:19:14.139591+0000","last_fullsized":"2023-10-25T16:19:14.139591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145052+0000","last_change":"2023-10-25T16:19:14.144947+0000","last_active":"2023-10-25T16:19:14.145052+0000","last_peered":"2023-10-25T16:19:14.145052+0000","last_clean":"2023-10-25T16:19:14.145052+0000","last_became_active":"2023-10-25T16:19:14.144069+0000","last_became_peered":"2023-10-25T16:19:14.144069+0000","last_unstale":"2023-10-25T16:19:14.145052+0000","last_undegraded":"2023-10-25T16:19:14.145052+0000","last_fullsized":"2023-10-25T16:19:14.145052+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134451+0000","last_change":"2023-10-25T16:19:14.134451+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134451+0000","last_undegraded":"2023-10-25T16:19:14.134451+0000","last_fullsized":"2023-10-25T16:19:14.134451+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155211+0000","last_change":"2023-10-25T16:19:14.154975+0000","last_active":"2023-10-25T16:19:14.155211+0000","last_peered":"2023-10-25T16:19:14.155211+0000","last_clean":"2023-10-25T16:19:14.155211+0000","last_became_active":"2023-10-25T16:19:14.153747+0000","last_became_peered":"2023-10-25T16:19:14.153747+0000","last_unstale":"2023-10-25T16:19:14.155211+0000","last_undegraded":"2023-10-25T16:19:14.155211+0000","last_fullsized":"2023-10-25T16:19:14.155211+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143377+0000","last_change":"2023-10-25T16:19:14.143377+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143377+0000","last_undegraded":"2023-10-25T16:19:14.143377+0000","last_fullsized":"2023-10-25T16:19:14.143377+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145180+0000","last_change":"2023-10-25T16:19:14.145066+0000","last_active":"2023-10-25T16:19:14.145180+0000","last_peered":"2023-10-25T16:19:14.145180+0000","last_clean":"2023-10-25T16:19:14.145180+0000","last_became_active":"2023-10-25T16:19:14.144640+0000","last_became_peered":"2023-10-25T16:19:14.144640+0000","last_unstale":"2023-10-25T16:19:14.145180+0000","last_undegraded":"2023-10-25T16:19:14.145180+0000","last_fullsized":"2023-10-25T16:19:14.145180+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136708+0000","last_change":"2023-10-25T16:19:14.136708+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136708+0000","last_undegraded":"2023-10-25T16:19:14.136708+0000","last_fullsized":"2023-10-25T16:19:14.136708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153495+0000","last_change":"2023-10-25T16:19:14.153400+0000","last_active":"2023-10-25T16:19:14.153495+0000","last_peered":"2023-10-25T16:19:14.153495+0000","last_clean":"2023-10-25T16:19:14.153495+0000","last_became_active":"2023-10-25T16:19:14.153175+0000","last_became_peered":"2023-10-25T16:19:14.153175+0000","last_unstale":"2023-10-25T16:19:14.153495+0000","last_undegraded":"2023-10-25T16:19:14.153495+0000","last_fullsized":"2023-10-25T16:19:14.153495+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139245+0000","last_change":"2023-10-25T16:19:14.139245+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139245+0000","last_undegraded":"2023-10-25T16:19:14.139245+0000","last_fullsized":"2023-10-25T16:19:14.139245+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145957+0000","last_change":"2023-10-25T16:19:14.145874+0000","last_active":"2023-10-25T16:19:14.145957+0000","last_peered":"2023-10-25T16:19:14.145957+0000","last_clean":"2023-10-25T16:19:14.145957+0000","last_became_active":"2023-10-25T16:19:14.145602+0000","last_became_peered":"2023-10-25T16:19:14.145602+0000","last_unstale":"2023-10-25T16:19:14.145957+0000","last_undegraded":"2023-10-25T16:19:14.145957+0000","last_fullsized":"2023-10-25T16:19:14.145957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:58:43.843147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.140694+0000","last_change":"2023-10-25T16:19:14.140694+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.140694+0000","last_undegraded":"2023-10-25T16:19:14.140694+0000","last_fullsized":"2023-10-25T16:19:14.140694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147302+0000","last_change":"2023-10-25T16:19:14.147250+0000","last_active":"2023-10-25T16:19:14.147302+0000","last_peered":"2023-10-25T16:19:14.147302+0000","last_clean":"2023-10-25T16:19:14.147302+0000","last_became_active":"2023-10-25T16:19:14.147036+0000","last_became_peered":"2023-10-25T16:19:14.147036+0000","last_unstale":"2023-10-25T16:19:14.147302+0000","last_undegraded":"2023-10-25T16:19:14.147302+0000","last_fullsized":"2023-10-25T16:19:14.147302+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133682+0000","last_change":"2023-10-25T16:19:14.133682+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133682+0000","last_undegraded":"2023-10-25T16:19:14.133682+0000","last_fullsized":"2023-10-25T16:19:14.133682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145524+0000","last_change":"2023-10-25T16:19:14.145346+0000","last_active":"2023-10-25T16:19:14.145524+0000","last_peered":"2023-10-25T16:19:14.145524+0000","last_clean":"2023-10-25T16:19:14.145524+0000","last_became_active":"2023-10-25T16:19:14.143452+0000","last_became_peered":"2023-10-25T16:19:14.143452+0000","last_unstale":"2023-10-25T16:19:14.145524+0000","last_undegraded":"2023-10-25T16:19:14.145524+0000","last_fullsized":"2023-10-25T16:19:14.145524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:11.865110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136516+0000","last_change":"2023-10-25T16:19:14.136516+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136516+0000","last_undegraded":"2023-10-25T16:19:14.136516+0000","last_fullsized":"2023-10-25T16:19:14.136516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145000+0000","last_change":"2023-10-25T16:19:14.144655+0000","last_active":"2023-10-25T16:19:14.145000+0000","last_peered":"2023-10-25T16:19:14.145000+0000","last_clean":"2023-10-25T16:19:14.145000+0000","last_became_active":"2023-10-25T16:19:14.144338+0000","last_became_peered":"2023-10-25T16:19:14.144338+0000","last_unstale":"2023-10-25T16:19:14.145000+0000","last_undegraded":"2023-10-25T16:19:14.145000+0000","last_fullsized":"2023-10-25T16:19:14.145000+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:31:23.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134678+0000","last_change":"2023-10-25T16:19:14.134678+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134678+0000","last_undegraded":"2023-10-25T16:19:14.134678+0000","last_fullsized":"2023-10-25T16:19:14.134678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150868+0000","last_change":"2023-10-25T16:19:14.150828+0000","last_active":"2023-10-25T16:19:14.150868+0000","last_peered":"2023-10-25T16:19:14.150868+0000","last_clean":"2023-10-25T16:19:14.150868+0000","last_became_active":"2023-10-25T16:19:14.150521+0000","last_became_peered":"2023-10-25T16:19:14.150521+0000","last_unstale":"2023-10-25T16:19:14.150868+0000","last_undegraded":"2023-10-25T16:19:14.150868+0000","last_fullsized":"2023-10-25T16:19:14.150868+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:16:42.600065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136798+0000","last_change":"2023-10-25T16:19:14.136798+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136798+0000","last_undegraded":"2023-10-25T16:19:14.136798+0000","last_fullsized":"2023-10-25T16:19:14.136798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.141446+0000","last_change":"2023-10-25T16:19:14.141102+0000","last_active":"2023-10-25T16:19:14.141446+0000","last_peered":"2023-10-25T16:19:14.141446+0000","last_clean":"2023-10-25T16:19:14.141446+0000","last_became_active":"2023-10-25T16:19:14.140878+0000","last_became_peered":"2023-10-25T16:19:14.140878+0000","last_unstale":"2023-10-25T16:19:14.141446+0000","last_undegraded":"2023-10-25T16:19:14.141446+0000","last_fullsized":"2023-10-25T16:19:14.141446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141971+0000","last_change":"2023-10-25T16:19:14.141971+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141971+0000","last_undegraded":"2023-10-25T16:19:14.141971+0000","last_fullsized":"2023-10-25T16:19:14.141971+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.156446+0000","last_change":"2023-10-25T16:19:14.156141+0000","last_active":"2023-10-25T16:19:14.156446+0000","last_peered":"2023-10-25T16:19:14.156446+0000","last_clean":"2023-10-25T16:19:14.156446+0000","last_became_active":"2023-10-25T16:19:14.155549+0000","last_became_peered":"2023-10-25T16:19:14.155549+0000","last_unstale":"2023-10-25T16:19:14.156446+0000","last_undegraded":"2023-10-25T16:19:14.156446+0000","last_fullsized":"2023-10-25T16:19:14.156446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141621+0000","last_change":"2023-10-25T16:19:14.141621+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141621+0000","last_undegraded":"2023-10-25T16:19:14.141621+0000","last_fullsized":"2023-10-25T16:19:14.141621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154773+0000","last_change":"2023-10-25T16:19:14.154628+0000","last_active":"2023-10-25T16:19:14.154773+0000","last_peered":"2023-10-25T16:19:14.154773+0000","last_clean":"2023-10-25T16:19:14.154773+0000","last_became_active":"2023-10-25T16:19:14.153323+0000","last_became_peered":"2023-10-25T16:19:14.153323+0000","last_unstale":"2023-10-25T16:19:14.154773+0000","last_undegraded":"2023-10-25T16:19:14.154773+0000","last_fullsized":"2023-10-25T16:19:14.154773+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:55:01.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133526+0000","last_change":"2023-10-25T16:19:14.133526+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133526+0000","last_undegraded":"2023-10-25T16:19:14.133526+0000","last_fullsized":"2023-10-25T16:19:14.133526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:13.102801+0000","last_change":"2023-10-25T16:19:13.102801+0000","last_active":"2023-10-25T16:19:13.102801+0000","last_peered":"2023-10-25T16:19:13.102801+0000","last_clean":"2023-10-25T16:19:13.102801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:13.102801+0000","last_undegraded":"2023-10-25T16:19:13.102801+0000","last_fullsized":"2023-10-25T16:19:13.102801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137170+0000","last_change":"2023-10-25T16:19:14.137170+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137170+0000","last_undegraded":"2023-10-25T16:19:14.137170+0000","last_fullsized":"2023-10-25T16:19:14.137170+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:13.102801+0000","last_change":"2023-10-25T16:19:13.102801+0000","last_active":"2023-10-25T16:19:13.102801+0000","last_peered":"2023-10-25T16:19:13.102801+0000","last_clean":"2023-10-25T16:19:13.102801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:13.102801+0000","last_undegraded":"2023-10-25T16:19:13.102801+0000","last_fullsized":"2023-10-25T16:19:13.102801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135843+0000","last_change":"2023-10-25T16:19:14.135843+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135843+0000","last_undegraded":"2023-10-25T16:19:14.135843+0000","last_fullsized":"2023-10-25T16:19:14.135843+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.158390+0000","last_change":"2023-10-25T16:19:14.158176+0000","last_active":"2023-10-25T16:19:14.158390+0000","last_peered":"2023-10-25T16:19:14.158390+0000","last_clean":"2023-10-25T16:19:14.158390+0000","last_became_active":"2023-10-25T16:19:14.157135+0000","last_became_peered":"2023-10-25T16:19:14.157135+0000","last_unstale":"2023-10-25T16:19:14.158390+0000","last_undegraded":"2023-10-25T16:19:14.158390+0000","last_fullsized":"2023-10-25T16:19:14.158390+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:39.362616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150981+0000","last_change":"2023-10-25T16:19:14.150925+0000","last_active":"2023-10-25T16:19:14.150981+0000","last_peered":"2023-10-25T16:19:14.150981+0000","last_clean":"2023-10-25T16:19:14.150981+0000","last_became_active":"2023-10-25T16:19:14.150509+0000","last_became_peered":"2023-10-25T16:19:14.150509+0000","last_unstale":"2023-10-25T16:19:14.150981+0000","last_undegraded":"2023-10-25T16:19:14.150981+0000","last_fullsized":"2023-10-25T16:19:14.150981+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:18.180629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141220+0000","last_change":"2023-10-25T16:19:14.141220+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141220+0000","last_undegraded":"2023-10-25T16:19:14.141220+0000","last_fullsized":"2023-10-25T16:19:14.141220+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.157146+0000","last_change":"2023-10-25T16:19:14.156944+0000","last_active":"2023-10-25T16:19:14.157146+0000","last_peered":"2023-10-25T16:19:14.157146+0000","last_clean":"2023-10-25T16:19:14.157146+0000","last_became_active":"2023-10-25T16:19:14.156080+0000","last_became_peered":"2023-10-25T16:19:14.156080+0000","last_unstale":"2023-10-25T16:19:14.157146+0000","last_undegraded":"2023-10-25T16:19:14.157146+0000","last_fullsized":"2023-10-25T16:19:14.157146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:54.206890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141667+0000","last_change":"2023-10-25T16:19:14.141667+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141667+0000","last_undegraded":"2023-10-25T16:19:14.141667+0000","last_fullsized":"2023-10-25T16:19:14.141667+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.148899+0000","last_change":"2023-10-25T16:19:14.148729+0000","last_active":"2023-10-25T16:19:14.148899+0000","last_peered":"2023-10-25T16:19:14.148899+0000","last_clean":"2023-10-25T16:19:14.148899+0000","last_became_active":"2023-10-25T16:19:14.148088+0000","last_became_peered":"2023-10-25T16:19:14.148088+0000","last_unstale":"2023-10-25T16:19:14.148899+0000","last_undegraded":"2023-10-25T16:19:14.148899+0000","last_fullsized":"2023-10-25T16:19:14.148899+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:52:20.145806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142361+0000","last_change":"2023-10-25T16:19:14.142361+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142361+0000","last_undegraded":"2023-10-25T16:19:14.142361+0000","last_fullsized":"2023-10-25T16:19:14.142361+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155825+0000","last_change":"2023-10-25T16:19:14.155751+0000","last_active":"2023-10-25T16:19:14.155825+0000","last_peered":"2023-10-25T16:19:14.155825+0000","last_clean":"2023-10-25T16:19:14.155825+0000","last_became_active":"2023-10-25T16:19:14.155504+0000","last_became_peered":"2023-10-25T16:19:14.155504+0000","last_unstale":"2023-10-25T16:19:14.155825+0000","last_undegraded":"2023-10-25T16:19:14.155825+0000","last_fullsized":"2023-10-25T16:19:14.155825+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146639+0000","last_change":"2023-10-25T16:19:14.146477+0000","last_active":"2023-10-25T16:19:14.146639+0000","last_peered":"2023-10-25T16:19:14.146639+0000","last_clean":"2023-10-25T16:19:14.146639+0000","last_became_active":"2023-10-25T16:19:14.144690+0000","last_became_peered":"2023-10-25T16:19:14.144690+0000","last_unstale":"2023-10-25T16:19:14.146639+0000","last_undegraded":"2023-10-25T16:19:14.146639+0000","last_fullsized":"2023-10-25T16:19:14.146639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:06:45.355521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153652+0000","last_change":"2023-10-25T16:19:14.153459+0000","last_active":"2023-10-25T16:19:14.153652+0000","last_peered":"2023-10-25T16:19:14.153652+0000","last_clean":"2023-10-25T16:19:14.153652+0000","last_became_active":"2023-10-25T16:19:14.152828+0000","last_became_peered":"2023-10-25T16:19:14.152828+0000","last_unstale":"2023-10-25T16:19:14.153652+0000","last_undegraded":"2023-10-25T16:19:14.153652+0000","last_fullsized":"2023-10-25T16:19:14.153652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:53.897110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.144410+0000","last_change":"2023-10-25T16:19:14.144093+0000","last_active":"2023-10-25T16:19:14.144410+0000","last_peered":"2023-10-25T16:19:14.144410+0000","last_clean":"2023-10-25T16:19:14.144410+0000","last_became_active":"2023-10-25T16:19:14.143541+0000","last_became_peered":"2023-10-25T16:19:14.143541+0000","last_unstale":"2023-10-25T16:19:14.144410+0000","last_undegraded":"2023-10-25T16:19:14.144410+0000","last_fullsized":"2023-10-25T16:19:14.144410+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:52.045235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134221+0000","last_change":"2023-10-25T16:19:14.134221+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134221+0000","last_undegraded":"2023-10-25T16:19:14.134221+0000","last_fullsized":"2023-10-25T16:19:14.134221+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147784+0000","last_change":"2023-10-25T16:19:14.147714+0000","last_active":"2023-10-25T16:19:14.147784+0000","last_peered":"2023-10-25T16:19:14.147784+0000","last_clean":"2023-10-25T16:19:14.147784+0000","last_became_active":"2023-10-25T16:19:14.147202+0000","last_became_peered":"2023-10-25T16:19:14.147202+0000","last_unstale":"2023-10-25T16:19:14.147784+0000","last_undegraded":"2023-10-25T16:19:14.147784+0000","last_fullsized":"2023-10-25T16:19:14.147784+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:30.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135496+0000","last_change":"2023-10-25T16:19:14.135496+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135496+0000","last_undegraded":"2023-10-25T16:19:14.135496+0000","last_fullsized":"2023-10-25T16:19:14.135496+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.159273+0000","last_change":"2023-10-25T16:19:14.159133+0000","last_active":"2023-10-25T16:19:14.159273+0000","last_peered":"2023-10-25T16:19:14.159273+0000","last_clean":"2023-10-25T16:19:14.159273+0000","last_became_active":"2023-10-25T16:19:14.158596+0000","last_became_peered":"2023-10-25T16:19:14.158596+0000","last_unstale":"2023-10-25T16:19:14.159273+0000","last_undegraded":"2023-10-25T16:19:14.159273+0000","last_fullsized":"2023-10-25T16:19:14.159273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:35:24.246693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139072+0000","last_change":"2023-10-25T16:19:14.139072+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139072+0000","last_undegraded":"2023-10-25T16:19:14.139072+0000","last_fullsized":"2023-10-25T16:19:14.139072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146621+0000","last_change":"2023-10-25T16:19:14.145106+0000","last_active":"2023-10-25T16:19:14.146621+0000","last_peered":"2023-10-25T16:19:14.146621+0000","last_clean":"2023-10-25T16:19:14.146621+0000","last_became_active":"2023-10-25T16:19:14.144380+0000","last_became_peered":"2023-10-25T16:19:14.144380+0000","last_unstale":"2023-10-25T16:19:14.146621+0000","last_undegraded":"2023-10-25T16:19:14.146621+0000","last_fullsized":"2023-10-25T16:19:14.146621+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:06.413087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136598+0000","last_change":"2023-10-25T16:19:14.136598+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136598+0000","last_undegraded":"2023-10-25T16:19:14.136598+0000","last_fullsized":"2023-10-25T16:19:14.136598+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153818+0000","last_change":"2023-10-25T16:19:14.153739+0000","last_active":"2023-10-25T16:19:14.153818+0000","last_peered":"2023-10-25T16:19:14.153818+0000","last_clean":"2023-10-25T16:19:14.153818+0000","last_became_active":"2023-10-25T16:19:14.153488+0000","last_became_peered":"2023-10-25T16:19:14.153488+0000","last_unstale":"2023-10-25T16:19:14.153818+0000","last_undegraded":"2023-10-25T16:19:14.153818+0000","last_fullsized":"2023-10-25T16:19:14.153818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:02.709932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134522+0000","last_change":"2023-10-25T16:19:14.134522+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134522+0000","last_undegraded":"2023-10-25T16:19:14.134522+0000","last_fullsized":"2023-10-25T16:19:14.134522+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.151530+0000","last_change":"2023-10-25T16:19:14.151321+0000","last_active":"2023-10-25T16:19:14.151530+0000","last_peered":"2023-10-25T16:19:14.151530+0000","last_clean":"2023-10-25T16:19:14.151530+0000","last_became_active":"2023-10-25T16:19:14.150384+0000","last_became_peered":"2023-10-25T16:19:14.150384+0000","last_unstale":"2023-10-25T16:19:14.151530+0000","last_undegraded":"2023-10-25T16:19:14.151530+0000","last_fullsized":"2023-10-25T16:19:14.151530+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:39:27.242739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.140976+0000","last_change":"2023-10-25T16:19:14.140911+0000","last_active":"2023-10-25T16:19:14.140976+0000","last_peered":"2023-10-25T16:19:14.140976+0000","last_clean":"2023-10-25T16:19:14.140976+0000","last_became_active":"2023-10-25T16:19:14.140640+0000","last_became_peered":"2023-10-25T16:19:14.140640+0000","last_unstale":"2023-10-25T16:19:14.140976+0000","last_undegraded":"2023-10-25T16:19:14.140976+0000","last_fullsized":"2023-10-25T16:19:14.140976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:14.936794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135822+0000","last_change":"2023-10-25T16:19:14.135822+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135822+0000","last_undegraded":"2023-10-25T16:19:14.135822+0000","last_fullsized":"2023-10-25T16:19:14.135822+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154966+0000","last_change":"2023-10-25T16:19:14.154725+0000","last_active":"2023-10-25T16:19:14.154966+0000","last_peered":"2023-10-25T16:19:14.154966+0000","last_clean":"2023-10-25T16:19:14.154966+0000","last_became_active":"2023-10-25T16:19:14.152704+0000","last_became_peered":"2023-10-25T16:19:14.152704+0000","last_unstale":"2023-10-25T16:19:14.154966+0000","last_undegraded":"2023-10-25T16:19:14.154966+0000","last_fullsized":"2023-10-25T16:19:14.154966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:53.073111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146034+0000","last_change":"2023-10-25T16:19:14.145472+0000","last_active":"2023-10-25T16:19:14.146034+0000","last_peered":"2023-10-25T16:19:14.146034+0000","last_clean":"2023-10-25T16:19:14.146034+0000","last_became_active":"2023-10-25T16:19:14.145146+0000","last_became_peered":"2023-10-25T16:19:14.145146+0000","last_unstale":"2023-10-25T16:19:14.146034+0000","last_undegraded":"2023-10-25T16:19:14.146034+0000","last_fullsized":"2023-10-25T16:19:14.146034+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134053+0000","last_change":"2023-10-25T16:19:14.134053+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134053+0000","last_undegraded":"2023-10-25T16:19:14.134053+0000","last_fullsized":"2023-10-25T16:19:14.134053+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:13.102801+0000","last_change":"2023-10-25T16:19:13.102801+0000","last_active":"2023-10-25T16:19:13.102801+0000","last_peered":"2023-10-25T16:19:13.102801+0000","last_clean":"2023-10-25T16:19:13.102801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:13.102801+0000","last_undegraded":"2023-10-25T16:19:13.102801+0000","last_fullsized":"2023-10-25T16:19:13.102801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150325+0000","last_change":"2023-10-25T16:19:14.150096+0000","last_active":"2023-10-25T16:19:14.150325+0000","last_peered":"2023-10-25T16:19:14.150325+0000","last_clean":"2023-10-25T16:19:14.150325+0000","last_became_active":"2023-10-25T16:19:14.149275+0000","last_became_peered":"2023-10-25T16:19:14.149275+0000","last_unstale":"2023-10-25T16:19:14.150325+0000","last_undegraded":"2023-10-25T16:19:14.150325+0000","last_fullsized":"2023-10-25T16:19:14.150325+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-25T16:19:13.116826+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:13.116826+0000","last_peered":"2023-10-25T16:19:13.116826+0000","last_clean":"2023-10-25T16:19:13.116826+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:13.116826+0000","last_undegraded":"2023-10-25T16:19:13.116826+0000","last_fullsized":"2023-10-25T16:19:13.116826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":675,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194637,"statfs":{"total":200000000,"available":199308583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.72999999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":1.103},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":1.159},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":1.2729999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.45},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.298},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":1.518}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.97699999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.226},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.4139999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.90700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":1.0389999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.268}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.84299999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":1.3500000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.131},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.85599999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":0.76700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":1.032},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.0089999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.0760000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":1.05},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86599999999999999,"15min":0.83399999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.046,"5min":1.419,"15min":1.419},"last":1.159},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.91000000000000003,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.103},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.218}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.367},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3360000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.78900000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.143}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":1.3109999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.2150000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.111},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":1.077}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.54200000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":0.75},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":0.92400000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":1.056}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":1.02}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":0.872}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":1.266}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:18.146 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:18.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/1144654815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 msgr2=0x7f9488003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 --2- 172.21.15.177:0/1144654815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f9488003da0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9490001680 tx=0x7f949001c750 comp rx=0 tx=0).stop 2023-10-25T16:19:18.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/1144654815 shutdown_connections 2023-10-25T16:19:18.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 --2- 172.21.15.177:0/1144654815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f9488003da0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/1144654815 >> 172.21.15.177:0/1144654815 conn(0x7f94a00b2450 msgr2=0x7f94a00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:18.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/1144654815 shutdown_connections 2023-10-25T16:19:18.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/1144654815 wait complete. 2023-10-25T16:19:18.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 Processor -- start 2023-10-25T16:19:18.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- start start 2023-10-25T16:19:18.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f94a00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a013f8f0 0x7f94a013fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a013a4c0 0x7f94a013a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a013ae80 con 0x7f9488003980 2023-10-25T16:19:18.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a013e5d0 con 0x7f94a013a4c0 2023-10-25T16:19:18.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a013e8b0 con 0x7f94a013f8f0 2023-10-25T16:19:18.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f94a00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f94a00710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42130/0 (socket says 172.21.15.177:42130) 2023-10-25T16:19:18.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 -- 172.21.15.177:0/4200674125 learned_addr learned my addr 172.21.15.177:0/4200674125 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:18.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949f7fe640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a013f8f0 0x7f94a013fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a4fc6640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a013a4c0 0x7f94a013a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 -- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a013f8f0 msgr2=0x7f94a013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a013f8f0 0x7f94a013fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 -- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a013a4c0 msgr2=0x7f94a013a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a013a4c0 0x7f94a013a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 -- 172.21.15.177:0/4200674125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a013eb90 con 0x7f9488003980 2023-10-25T16:19:18.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949ffff640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f94a00710e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f949001c580 tx=0x7f9490003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:18.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900a9040 con 0x7f9488003980 2023-10-25T16:19:18.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9490003e50 con 0x7f9488003980 2023-10-25T16:19:18.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a013ee70 con 0x7f9488003980 2023-10-25T16:19:18.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900a5790 con 0x7f9488003980 2023-10-25T16:19:18.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.308+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a013e210 con 0x7f9488003980 2023-10-25T16:19:18.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.312+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a004daf0 con 0x7f9488003980 2023-10-25T16:19:18.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.312+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94900b5020 con 0x7f9488003980 2023-10-25T16:19:18.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.312+0000 7f949cff9640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f948c0664a0 0x7f948c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.312+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94900aa070 con 0x7f9488003980 2023-10-25T16:19:18.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.312+0000 7f949f7fe640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f948c0664a0 0x7f948c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.312+0000 7f949f7fe640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f948c0664a0 0x7f948c068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9494005fd0 tx=0x7f9494005aa0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:18.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.316+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94900eb140 con 0x7f9488003980 2023-10-25T16:19:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.464+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94a00b0740 con 0x7f948c0664a0 2023-10-25T16:19:18.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.488+0000 7f949cff9640 1 -- 172.21.15.177:0/4200674125 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277759 (secure 0 0 0) 0x7f94940096b0 con 0x7f948c0664a0 2023-10-25T16:19:18.488 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:18.490 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:18.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f948c0664a0 msgr2=0x7f948c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f948c0664a0 0x7f948c068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9494005fd0 tx=0x7f9494005aa0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 msgr2=0x7f94a00710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f94a00710e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f949001c580 tx=0x7f9490003c60 comp rx=0 tx=0).stop 2023-10-25T16:19:18.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 shutdown_connections 2023-10-25T16:19:18.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f948c0664a0 0x7f948c068960 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94a013a4c0 0x7f94a013a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94a013f8f0 0x7f94a013fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 --2- 172.21.15.177:0/4200674125 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9488003980 0x7f94a00710e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 >> 172.21.15.177:0/4200674125 conn(0x7f94a00b2450 msgr2=0x7f94a00ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:18.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 shutdown_connections 2023-10-25T16:19:18.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.492+0000 7f94a6a29640 1 -- 172.21.15.177:0/4200674125 wait complete. 2023-10-25T16:19:18.508 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2023-10-25T16:19:16.736844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555874,"statfs":{"total":1600000000,"available":1593215834,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001090"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143836+0000","last_change":"2023-10-25T16:19:14.143836+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143836+0000","last_undegraded":"2023-10-25T16:19:14.143836+0000","last_fullsized":"2023-10-25T16:19:14.143836+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136001+0000","last_change":"2023-10-25T16:19:14.136001+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136001+0000","last_undegraded":"2023-10-25T16:19:14.136001+0000","last_fullsized":"2023-10-25T16:19:14.136001+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136341+0000","last_change":"2023-10-25T16:19:14.136341+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136341+0000","last_undegraded":"2023-10-25T16:19:14.136341+0000","last_fullsized":"2023-10-25T16:19:14.136341+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134837+0000","last_change":"2023-10-25T16:19:14.134837+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134837+0000","last_undegraded":"2023-10-25T16:19:14.134837+0000","last_fullsized":"2023-10-25T16:19:14.134837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143456+0000","last_change":"2023-10-25T16:19:14.143456+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143456+0000","last_undegraded":"2023-10-25T16:19:14.143456+0000","last_fullsized":"2023-10-25T16:19:14.143456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144981+0000","last_change":"2023-10-25T16:19:14.144981+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144981+0000","last_undegraded":"2023-10-25T16:19:14.144981+0000","last_fullsized":"2023-10-25T16:19:14.144981+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142492+0000","last_change":"2023-10-25T16:19:14.142492+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142492+0000","last_undegraded":"2023-10-25T16:19:14.142492+0000","last_fullsized":"2023-10-25T16:19:14.142492+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137041+0000","last_change":"2023-10-25T16:19:14.137041+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137041+0000","last_undegraded":"2023-10-25T16:19:14.137041+0000","last_fullsized":"2023-10-25T16:19:14.137041+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137924+0000","last_change":"2023-10-25T16:19:14.137924+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137924+0000","last_undegraded":"2023-10-25T16:19:14.137924+0000","last_fullsized":"2023-10-25T16:19:14.137924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142709+0000","last_change":"2023-10-25T16:19:14.142709+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142709+0000","last_undegraded":"2023-10-25T16:19:14.142709+0000","last_fullsized":"2023-10-25T16:19:14.142709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144213+0000","last_change":"2023-10-25T16:19:14.144213+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144213+0000","last_undegraded":"2023-10-25T16:19:14.144213+0000","last_fullsized":"2023-10-25T16:19:14.144213+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136650+0000","last_change":"2023-10-25T16:19:14.136650+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136650+0000","last_undegraded":"2023-10-25T16:19:14.136650+0000","last_fullsized":"2023-10-25T16:19:14.136650+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135308+0000","last_change":"2023-10-25T16:19:14.135308+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135308+0000","last_undegraded":"2023-10-25T16:19:14.135308+0000","last_fullsized":"2023-10-25T16:19:14.135308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138150+0000","last_change":"2023-10-25T16:19:14.138150+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138150+0000","last_undegraded":"2023-10-25T16:19:14.138150+0000","last_fullsized":"2023-10-25T16:19:14.138150+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143474+0000","last_change":"2023-10-25T16:19:14.143474+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143474+0000","last_undegraded":"2023-10-25T16:19:14.143474+0000","last_fullsized":"2023-10-25T16:19:14.143474+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135565+0000","last_change":"2023-10-25T16:19:14.135565+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135565+0000","last_undegraded":"2023-10-25T16:19:14.135565+0000","last_fullsized":"2023-10-25T16:19:14.135565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134900+0000","last_change":"2023-10-25T16:19:14.134900+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134900+0000","last_undegraded":"2023-10-25T16:19:14.134900+0000","last_fullsized":"2023-10-25T16:19:14.134900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141186+0000","last_change":"2023-10-25T16:19:14.141186+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141186+0000","last_undegraded":"2023-10-25T16:19:14.141186+0000","last_fullsized":"2023-10-25T16:19:14.141186+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135113+0000","last_change":"2023-10-25T16:19:14.135113+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135113+0000","last_undegraded":"2023-10-25T16:19:14.135113+0000","last_fullsized":"2023-10-25T16:19:14.135113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136653+0000","last_change":"2023-10-25T16:19:14.136653+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136653+0000","last_undegraded":"2023-10-25T16:19:14.136653+0000","last_fullsized":"2023-10-25T16:19:14.136653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143590+0000","last_change":"2023-10-25T16:19:14.143590+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143590+0000","last_undegraded":"2023-10-25T16:19:14.143590+0000","last_fullsized":"2023-10-25T16:19:14.143590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141938+0000","last_change":"2023-10-25T16:19:14.141938+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141938+0000","last_undegraded":"2023-10-25T16:19:14.141938+0000","last_fullsized":"2023-10-25T16:19:14.141938+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136063+0000","last_change":"2023-10-25T16:19:14.136063+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136063+0000","last_undegraded":"2023-10-25T16:19:14.136063+0000","last_fullsized":"2023-10-25T16:19:14.136063+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141642+0000","last_change":"2023-10-25T16:19:14.141642+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141642+0000","last_undegraded":"2023-10-25T16:19:14.141642+0000","last_fullsized":"2023-10-25T16:19:14.141642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138195+0000","last_change":"2023-10-25T16:19:14.138195+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138195+0000","last_undegraded":"2023-10-25T16:19:14.138195+0000","last_fullsized":"2023-10-25T16:19:14.138195+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134076+0000","last_change":"2023-10-25T16:19:14.134076+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134076+0000","last_undegraded":"2023-10-25T16:19:14.134076+0000","last_fullsized":"2023-10-25T16:19:14.134076+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136619+0000","last_change":"2023-10-25T16:19:14.136619+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136619+0000","last_undegraded":"2023-10-25T16:19:14.136619+0000","last_fullsized":"2023-10-25T16:19:14.136619+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139591+0000","last_change":"2023-10-25T16:19:14.139591+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139591+0000","last_undegraded":"2023-10-25T16:19:14.139591+0000","last_fullsized":"2023-10-25T16:19:14.139591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145052+0000","last_change":"2023-10-25T16:19:14.144947+0000","last_active":"2023-10-25T16:19:14.145052+0000","last_peered":"2023-10-25T16:19:14.145052+0000","last_clean":"2023-10-25T16:19:14.145052+0000","last_became_active":"2023-10-25T16:19:14.144069+0000","last_became_peered":"2023-10-25T16:19:14.144069+0000","last_unstale":"2023-10-25T16:19:14.145052+0000","last_undegraded":"2023-10-25T16:19:14.145052+0000","last_fullsized":"2023-10-25T16:19:14.145052+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134451+0000","last_change":"2023-10-25T16:19:14.134451+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134451+0000","last_undegraded":"2023-10-25T16:19:14.134451+0000","last_fullsized":"2023-10-25T16:19:14.134451+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155211+0000","last_change":"2023-10-25T16:19:14.154975+0000","last_active":"2023-10-25T16:19:14.155211+0000","last_peered":"2023-10-25T16:19:14.155211+0000","last_clean":"2023-10-25T16:19:14.155211+0000","last_became_active":"2023-10-25T16:19:14.153747+0000","last_became_peered":"2023-10-25T16:19:14.153747+0000","last_unstale":"2023-10-25T16:19:14.155211+0000","last_undegraded":"2023-10-25T16:19:14.155211+0000","last_fullsized":"2023-10-25T16:19:14.155211+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143377+0000","last_change":"2023-10-25T16:19:14.143377+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143377+0000","last_undegraded":"2023-10-25T16:19:14.143377+0000","last_fullsized":"2023-10-25T16:19:14.143377+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145180+0000","last_change":"2023-10-25T16:19:14.145066+0000","last_active":"2023-10-25T16:19:14.145180+0000","last_peered":"2023-10-25T16:19:14.145180+0000","last_clean":"2023-10-25T16:19:14.145180+0000","last_became_active":"2023-10-25T16:19:14.144640+0000","last_became_peered":"2023-10-25T16:19:14.144640+0000","last_unstale":"2023-10-25T16:19:14.145180+0000","last_undegraded":"2023-10-25T16:19:14.145180+0000","last_fullsized":"2023-10-25T16:19:14.145180+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136708+0000","last_change":"2023-10-25T16:19:14.136708+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136708+0000","last_undegraded":"2023-10-25T16:19:14.136708+0000","last_fullsized":"2023-10-25T16:19:14.136708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153495+0000","last_change":"2023-10-25T16:19:14.153400+0000","last_active":"2023-10-25T16:19:14.153495+0000","last_peered":"2023-10-25T16:19:14.153495+0000","last_clean":"2023-10-25T16:19:14.153495+0000","last_became_active":"2023-10-25T16:19:14.153175+0000","last_became_peered":"2023-10-25T16:19:14.153175+0000","last_unstale":"2023-10-25T16:19:14.153495+0000","last_undegraded":"2023-10-25T16:19:14.153495+0000","last_fullsized":"2023-10-25T16:19:14.153495+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139245+0000","last_change":"2023-10-25T16:19:14.139245+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139245+0000","last_undegraded":"2023-10-25T16:19:14.139245+0000","last_fullsized":"2023-10-25T16:19:14.139245+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145957+0000","last_change":"2023-10-25T16:19:14.145874+0000","last_active":"2023-10-25T16:19:14.145957+0000","last_peered":"2023-10-25T16:19:14.145957+0000","last_clean":"2023-10-25T16:19:14.145957+0000","last_became_active":"2023-10-25T16:19:14.145602+0000","last_became_peered":"2023-10-25T16:19:14.145602+0000","last_unstale":"2023-10-25T16:19:14.145957+0000","last_undegraded":"2023-10-25T16:19:14.145957+0000","last_fullsized":"2023-10-25T16:19:14.145957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:58:43.843147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.140694+0000","last_change":"2023-10-25T16:19:14.140694+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.140694+0000","last_undegraded":"2023-10-25T16:19:14.140694+0000","last_fullsized":"2023-10-25T16:19:14.140694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147302+0000","last_change":"2023-10-25T16:19:14.147250+0000","last_active":"2023-10-25T16:19:14.147302+0000","last_peered":"2023-10-25T16:19:14.147302+0000","last_clean":"2023-10-25T16:19:14.147302+0000","last_became_active":"2023-10-25T16:19:14.147036+0000","last_became_peered":"2023-10-25T16:19:14.147036+0000","last_unstale":"2023-10-25T16:19:14.147302+0000","last_undegraded":"2023-10-25T16:19:14.147302+0000","last_fullsized":"2023-10-25T16:19:14.147302+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133682+0000","last_change":"2023-10-25T16:19:14.133682+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133682+0000","last_undegraded":"2023-10-25T16:19:14.133682+0000","last_fullsized":"2023-10-25T16:19:14.133682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145524+0000","last_change":"2023-10-25T16:19:14.145346+0000","last_active":"2023-10-25T16:19:14.145524+0000","last_peered":"2023-10-25T16:19:14.145524+0000","last_clean":"2023-10-25T16:19:14.145524+0000","last_became_active":"2023-10-25T16:19:14.143452+0000","last_became_peered":"2023-10-25T16:19:14.143452+0000","last_unstale":"2023-10-25T16:19:14.145524+0000","last_undegraded":"2023-10-25T16:19:14.145524+0000","last_fullsized":"2023-10-25T16:19:14.145524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:11.865110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136516+0000","last_change":"2023-10-25T16:19:14.136516+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136516+0000","last_undegraded":"2023-10-25T16:19:14.136516+0000","last_fullsized":"2023-10-25T16:19:14.136516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145000+0000","last_change":"2023-10-25T16:19:14.144655+0000","last_active":"2023-10-25T16:19:14.145000+0000","last_peered":"2023-10-25T16:19:14.145000+0000","last_clean":"2023-10-25T16:19:14.145000+0000","last_became_active":"2023-10-25T16:19:14.144338+0000","last_became_peered":"2023-10-25T16:19:14.144338+0000","last_unstale":"2023-10-25T16:19:14.145000+0000","last_undegraded":"2023-10-25T16:19:14.145000+0000","last_fullsized":"2023-10-25T16:19:14.145000+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:31:23.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134678+0000","last_change":"2023-10-25T16:19:14.134678+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134678+0000","last_undegraded":"2023-10-25T16:19:14.134678+0000","last_fullsized":"2023-10-25T16:19:14.134678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150868+0000","last_change":"2023-10-25T16:19:14.150828+0000","last_active":"2023-10-25T16:19:14.150868+0000","last_peered":"2023-10-25T16:19:14.150868+0000","last_clean":"2023-10-25T16:19:14.150868+0000","last_became_active":"2023-10-25T16:19:14.150521+0000","last_became_peered":"2023-10-25T16:19:14.150521+0000","last_unstale":"2023-10-25T16:19:14.150868+0000","last_undegraded":"2023-10-25T16:19:14.150868+0000","last_fullsized":"2023-10-25T16:19:14.150868+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:16:42.600065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136798+0000","last_change":"2023-10-25T16:19:14.136798+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136798+0000","last_undegraded":"2023-10-25T16:19:14.136798+0000","last_fullsized":"2023-10-25T16:19:14.136798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.141446+0000","last_change":"2023-10-25T16:19:14.141102+0000","last_active":"2023-10-25T16:19:14.141446+0000","last_peered":"2023-10-25T16:19:14.141446+0000","last_clean":"2023-10-25T16:19:14.141446+0000","last_became_active":"2023-10-25T16:19:14.140878+0000","last_became_peered":"2023-10-25T16:19:14.140878+0000","last_unstale":"2023-10-25T16:19:14.141446+0000","last_undegraded":"2023-10-25T16:19:14.141446+0000","last_fullsized":"2023-10-25T16:19:14.141446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141971+0000","last_change":"2023-10-25T16:19:14.141971+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141971+0000","last_undegraded":"2023-10-25T16:19:14.141971+0000","last_fullsized":"2023-10-25T16:19:14.141971+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.156446+0000","last_change":"2023-10-25T16:19:14.156141+0000","last_active":"2023-10-25T16:19:14.156446+0000","last_peered":"2023-10-25T16:19:14.156446+0000","last_clean":"2023-10-25T16:19:14.156446+0000","last_became_active":"2023-10-25T16:19:14.155549+0000","last_became_peered":"2023-10-25T16:19:14.155549+0000","last_unstale":"2023-10-25T16:19:14.156446+0000","last_undegraded":"2023-10-25T16:19:14.156446+0000","last_fullsized":"2023-10-25T16:19:14.156446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141621+0000","last_change":"2023-10-25T16:19:14.141621+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141621+0000","last_undegraded":"2023-10-25T16:19:14.141621+0000","last_fullsized":"2023-10-25T16:19:14.141621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154773+0000","last_change":"2023-10-25T16:19:14.154628+0000","last_active":"2023-10-25T16:19:14.154773+0000","last_peered":"2023-10-25T16:19:14.154773+0000","last_clean":"2023-10-25T16:19:14.154773+0000","last_became_active":"2023-10-25T16:19:14.153323+0000","last_became_peered":"2023-10-25T16:19:14.153323+0000","last_unstale":"2023-10-25T16:19:14.154773+0000","last_undegraded":"2023-10-25T16:19:14.154773+0000","last_fullsized":"2023-10-25T16:19:14.154773+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:55:01.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133526+0000","last_change":"2023-10-25T16:19:14.133526+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133526+0000","last_undegraded":"2023-10-25T16:19:14.133526+0000","last_fullsized":"2023-10-25T16:19:14.133526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:13.102801+0000","last_change":"2023-10-25T16:19:13.102801+0000","last_active":"2023-10-25T16:19:13.102801+0000","last_peered":"2023-10-25T16:19:13.102801+0000","last_clean":"2023-10-25T16:19:13.102801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:13.102801+0000","last_undegraded":"2023-10-25T16:19:13.102801+0000","last_fullsized":"2023-10-25T16:19:13.102801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137170+0000","last_change":"2023-10-25T16:19:14.137170+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137170+0000","last_undegraded":"2023-10-25T16:19:14.137170+0000","last_fullsized":"2023-10-25T16:19:14.137170+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:13.102801+0000","last_change":"2023-10-25T16:19:13.102801+0000","last_active":"2023-10-25T16:19:13.102801+0000","last_peered":"2023-10-25T16:19:13.102801+0000","last_clean":"2023-10-25T16:19:13.102801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:13.102801+0000","last_undegraded":"2023-10-25T16:19:13.102801+0000","last_fullsized":"2023-10-25T16:19:13.102801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135843+0000","last_change":"2023-10-25T16:19:14.135843+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135843+0000","last_undegraded":"2023-10-25T16:19:14.135843+0000","last_fullsized":"2023-10-25T16:19:14.135843+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.158390+0000","last_change":"2023-10-25T16:19:14.158176+0000","last_active":"2023-10-25T16:19:14.158390+0000","last_peered":"2023-10-25T16:19:14.158390+0000","last_clean":"2023-10-25T16:19:14.158390+0000","last_became_active":"2023-10-25T16:19:14.157135+0000","last_became_peered":"2023-10-25T16:19:14.157135+0000","last_unstale":"2023-10-25T16:19:14.158390+0000","last_undegraded":"2023-10-25T16:19:14.158390+0000","last_fullsized":"2023-10-25T16:19:14.158390+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:39.362616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150981+0000","last_change":"2023-10-25T16:19:14.150925+0000","last_active":"2023-10-25T16:19:14.150981+0000","last_peered":"2023-10-25T16:19:14.150981+0000","last_clean":"2023-10-25T16:19:14.150981+0000","last_became_active":"2023-10-25T16:19:14.150509+0000","last_became_peered":"2023-10-25T16:19:14.150509+0000","last_unstale":"2023-10-25T16:19:14.150981+0000","last_undegraded":"2023-10-25T16:19:14.150981+0000","last_fullsized":"2023-10-25T16:19:14.150981+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:18.180629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141220+0000","last_change":"2023-10-25T16:19:14.141220+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141220+0000","last_undegraded":"2023-10-25T16:19:14.141220+0000","last_fullsized":"2023-10-25T16:19:14.141220+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.157146+0000","last_change":"2023-10-25T16:19:14.156944+0000","last_active":"2023-10-25T16:19:14.157146+0000","last_peered":"2023-10-25T16:19:14.157146+0000","last_clean":"2023-10-25T16:19:14.157146+0000","last_became_active":"2023-10-25T16:19:14.156080+0000","last_became_peered":"2023-10-25T16:19:14.156080+0000","last_unstale":"2023-10-25T16:19:14.157146+0000","last_undegraded":"2023-10-25T16:19:14.157146+0000","last_fullsized":"2023-10-25T16:19:14.157146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:54.206890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141667+0000","last_change":"2023-10-25T16:19:14.141667+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141667+0000","last_undegraded":"2023-10-25T16:19:14.141667+0000","last_fullsized":"2023-10-25T16:19:14.141667+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.148899+0000","last_change":"2023-10-25T16:19:14.148729+0000","last_active":"2023-10-25T16:19:14.148899+0000","last_peered":"2023-10-25T16:19:14.148899+0000","last_clean":"2023-10-25T16:19:14.148899+0000","last_became_active":"2023-10-25T16:19:14.148088+0000","last_became_peered":"2023-10-25T16:19:14.148088+0000","last_unstale":"2023-10-25T16:19:14.148899+0000","last_undegraded":"2023-10-25T16:19:14.148899+0000","last_fullsized":"2023-10-25T16:19:14.148899+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:52:20.145806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142361+0000","last_change":"2023-10-25T16:19:14.142361+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142361+0000","last_undegraded":"2023-10-25T16:19:14.142361+0000","last_fullsized":"2023-10-25T16:19:14.142361+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155825+0000","last_change":"2023-10-25T16:19:14.155751+0000","last_active":"2023-10-25T16:19:14.155825+0000","last_peered":"2023-10-25T16:19:14.155825+0000","last_clean":"2023-10-25T16:19:14.155825+0000","last_became_active":"2023-10-25T16:19:14.155504+0000","last_became_peered":"2023-10-25T16:19:14.155504+0000","last_unstale":"2023-10-25T16:19:14.155825+0000","last_undegraded":"2023-10-25T16:19:14.155825+0000","last_fullsized":"2023-10-25T16:19:14.155825+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146639+0000","last_change":"2023-10-25T16:19:14.146477+0000","last_active":"2023-10-25T16:19:14.146639+0000","last_peered":"2023-10-25T16:19:14.146639+0000","last_clean":"2023-10-25T16:19:14.146639+0000","last_became_active":"2023-10-25T16:19:14.144690+0000","last_became_peered":"2023-10-25T16:19:14.144690+0000","last_unstale":"2023-10-25T16:19:14.146639+0000","last_undegraded":"2023-10-25T16:19:14.146639+0000","last_fullsized":"2023-10-25T16:19:14.146639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:06:45.355521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153652+0000","last_change":"2023-10-25T16:19:14.153459+0000","last_active":"2023-10-25T16:19:14.153652+0000","last_peered":"2023-10-25T16:19:14.153652+0000","last_clean":"2023-10-25T16:19:14.153652+0000","last_became_active":"2023-10-25T16:19:14.152828+0000","last_became_peered":"2023-10-25T16:19:14.152828+0000","last_unstale":"2023-10-25T16:19:14.153652+0000","last_undegraded":"2023-10-25T16:19:14.153652+0000","last_fullsized":"2023-10-25T16:19:14.153652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:53.897110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.144410+0000","last_change":"2023-10-25T16:19:14.144093+0000","last_active":"2023-10-25T16:19:14.144410+0000","last_peered":"2023-10-25T16:19:14.144410+0000","last_clean":"2023-10-25T16:19:14.144410+0000","last_became_active":"2023-10-25T16:19:14.143541+0000","last_became_peered":"2023-10-25T16:19:14.143541+0000","last_unstale":"2023-10-25T16:19:14.144410+0000","last_undegraded":"2023-10-25T16:19:14.144410+0000","last_fullsized":"2023-10-25T16:19:14.144410+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:52.045235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134221+0000","last_change":"2023-10-25T16:19:14.134221+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134221+0000","last_undegraded":"2023-10-25T16:19:14.134221+0000","last_fullsized":"2023-10-25T16:19:14.134221+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147784+0000","last_change":"2023-10-25T16:19:14.147714+0000","last_active":"2023-10-25T16:19:14.147784+0000","last_peered":"2023-10-25T16:19:14.147784+0000","last_clean":"2023-10-25T16:19:14.147784+0000","last_became_active":"2023-10-25T16:19:14.147202+0000","last_became_peered":"2023-10-25T16:19:14.147202+0000","last_unstale":"2023-10-25T16:19:14.147784+0000","last_undegraded":"2023-10-25T16:19:14.147784+0000","last_fullsized":"2023-10-25T16:19:14.147784+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:30.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135496+0000","last_change":"2023-10-25T16:19:14.135496+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135496+0000","last_undegraded":"2023-10-25T16:19:14.135496+0000","last_fullsized":"2023-10-25T16:19:14.135496+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.159273+0000","last_change":"2023-10-25T16:19:14.159133+0000","last_active":"2023-10-25T16:19:14.159273+0000","last_peered":"2023-10-25T16:19:14.159273+0000","last_clean":"2023-10-25T16:19:14.159273+0000","last_became_active":"2023-10-25T16:19:14.158596+0000","last_became_peered":"2023-10-25T16:19:14.158596+0000","last_unstale":"2023-10-25T16:19:14.159273+0000","last_undegraded":"2023-10-25T16:19:14.159273+0000","last_fullsized":"2023-10-25T16:19:14.159273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:35:24.246693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139072+0000","last_change":"2023-10-25T16:19:14.139072+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139072+0000","last_undegraded":"2023-10-25T16:19:14.139072+0000","last_fullsized":"2023-10-25T16:19:14.139072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146621+0000","last_change":"2023-10-25T16:19:14.145106+0000","last_active":"2023-10-25T16:19:14.146621+0000","last_peered":"2023-10-25T16:19:14.146621+0000","last_clean":"2023-10-25T16:19:14.146621+0000","last_became_active":"2023-10-25T16:19:14.144380+0000","last_became_peered":"2023-10-25T16:19:14.144380+0000","last_unstale":"2023-10-25T16:19:14.146621+0000","last_undegraded":"2023-10-25T16:19:14.146621+0000","last_fullsized":"2023-10-25T16:19:14.146621+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:06.413087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136598+0000","last_change":"2023-10-25T16:19:14.136598+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136598+0000","last_undegraded":"2023-10-25T16:19:14.136598+0000","last_fullsized":"2023-10-25T16:19:14.136598+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153818+0000","last_change":"2023-10-25T16:19:14.153739+0000","last_active":"2023-10-25T16:19:14.153818+0000","last_peered":"2023-10-25T16:19:14.153818+0000","last_clean":"2023-10-25T16:19:14.153818+0000","last_became_active":"2023-10-25T16:19:14.153488+0000","last_became_peered":"2023-10-25T16:19:14.153488+0000","last_unstale":"2023-10-25T16:19:14.153818+0000","last_undegraded":"2023-10-25T16:19:14.153818+0000","last_fullsized":"2023-10-25T16:19:14.153818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:02.709932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134522+0000","last_change":"2023-10-25T16:19:14.134522+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134522+0000","last_undegraded":"2023-10-25T16:19:14.134522+0000","last_fullsized":"2023-10-25T16:19:14.134522+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.151530+0000","last_change":"2023-10-25T16:19:14.151321+0000","last_active":"2023-10-25T16:19:14.151530+0000","last_peered":"2023-10-25T16:19:14.151530+0000","last_clean":"2023-10-25T16:19:14.151530+0000","last_became_active":"2023-10-25T16:19:14.150384+0000","last_became_peered":"2023-10-25T16:19:14.150384+0000","last_unstale":"2023-10-25T16:19:14.151530+0000","last_undegraded":"2023-10-25T16:19:14.151530+0000","last_fullsized":"2023-10-25T16:19:14.151530+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:39:27.242739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.140976+0000","last_change":"2023-10-25T16:19:14.140911+0000","last_active":"2023-10-25T16:19:14.140976+0000","last_peered":"2023-10-25T16:19:14.140976+0000","last_clean":"2023-10-25T16:19:14.140976+0000","last_became_active":"2023-10-25T16:19:14.140640+0000","last_became_peered":"2023-10-25T16:19:14.140640+0000","last_unstale":"2023-10-25T16:19:14.140976+0000","last_undegraded":"2023-10-25T16:19:14.140976+0000","last_fullsized":"2023-10-25T16:19:14.140976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:14.936794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135822+0000","last_change":"2023-10-25T16:19:14.135822+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135822+0000","last_undegraded":"2023-10-25T16:19:14.135822+0000","last_fullsized":"2023-10-25T16:19:14.135822+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154966+0000","last_change":"2023-10-25T16:19:14.154725+0000","last_active":"2023-10-25T16:19:14.154966+0000","last_peered":"2023-10-25T16:19:14.154966+0000","last_clean":"2023-10-25T16:19:14.154966+0000","last_became_active":"2023-10-25T16:19:14.152704+0000","last_became_peered":"2023-10-25T16:19:14.152704+0000","last_unstale":"2023-10-25T16:19:14.154966+0000","last_undegraded":"2023-10-25T16:19:14.154966+0000","last_fullsized":"2023-10-25T16:19:14.154966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:53.073111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146034+0000","last_change":"2023-10-25T16:19:14.145472+0000","last_active":"2023-10-25T16:19:14.146034+0000","last_peered":"2023-10-25T16:19:14.146034+0000","last_clean":"2023-10-25T16:19:14.146034+0000","last_became_active":"2023-10-25T16:19:14.145146+0000","last_became_peered":"2023-10-25T16:19:14.145146+0000","last_unstale":"2023-10-25T16:19:14.146034+0000","last_undegraded":"2023-10-25T16:19:14.146034+0000","last_fullsized":"2023-10-25T16:19:14.146034+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134053+0000","last_change":"2023-10-25T16:19:14.134053+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134053+0000","last_undegraded":"2023-10-25T16:19:14.134053+0000","last_fullsized":"2023-10-25T16:19:14.134053+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:13.102801+0000","last_change":"2023-10-25T16:19:13.102801+0000","last_active":"2023-10-25T16:19:13.102801+0000","last_peered":"2023-10-25T16:19:13.102801+0000","last_clean":"2023-10-25T16:19:13.102801+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:13.102801+0000","last_undegraded":"2023-10-25T16:19:13.102801+0000","last_fullsized":"2023-10-25T16:19:13.102801+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:14.114202+0000","last_change":"2023-10-25T16:19:14.114202+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.114202+0000","last_undegraded":"2023-10-25T16:19:14.114202+0000","last_fullsized":"2023-10-25T16:19:14.114202+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150325+0000","last_change":"2023-10-25T16:19:14.150096+0000","last_active":"2023-10-25T16:19:14.150325+0000","last_peered":"2023-10-25T16:19:14.150325+0000","last_clean":"2023-10-25T16:19:14.150325+0000","last_became_active":"2023-10-25T16:19:14.149275+0000","last_became_peered":"2023-10-25T16:19:14.149275+0000","last_unstale":"2023-10-25T16:19:14.150325+0000","last_undegraded":"2023-10-25T16:19:14.150325+0000","last_fullsized":"2023-10-25T16:19:14.150325+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-25T16:19:13.116826+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:13.116826+0000","last_peered":"2023-10-25T16:19:13.116826+0000","last_clean":"2023-10-25T16:19:13.116826+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:13.116826+0000","last_undegraded":"2023-10-25T16:19:13.116826+0000","last_fullsized":"2023-10-25T16:19:13.116826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":675,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194637,"statfs":{"total":200000000,"available":199308583,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.72999999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":1.103},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":1.159},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":1.2729999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.45},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.90800000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.298},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":1.518}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.97699999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.226},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.4139999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.90700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":1.0389999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.268}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.84299999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":1.3500000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.131},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.85599999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":0.76700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":1.032},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.0089999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.0760000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":1.05},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86599999999999999,"15min":0.83399999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.046,"5min":1.419,"15min":1.419},"last":1.159},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.91000000000000003,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.103},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.218}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.367},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3360000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.78900000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.143}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":1.3109999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.2150000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.111},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":1.077}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.54200000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":0.75},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":0.92400000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":1.056}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":1.02}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":0.872}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":1.266}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:18.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:18.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.668+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2076087618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406be90 msgr2=0x7f4e84070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.668+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2076087618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406be90 0x7f4e84070e00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009c80 tx=0x7f4e7c01cd10 comp rx=0 tx=0).stop 2023-10-25T16:19:18.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.668+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2076087618 shutdown_connections 2023-10-25T16:19:18.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.668+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2076087618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406be90 0x7f4e84070e00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.668+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2076087618 >> 172.21.15.177:0/2076087618 conn(0x7f4e840b2450 msgr2=0x7f4e840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:18.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2076087618 shutdown_connections 2023-10-25T16:19:18.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2076087618 wait complete. 2023-10-25T16:19:18.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 Processor -- start 2023-10-25T16:19:18.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- start start 2023-10-25T16:19:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 0x7f4e84147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8406be90 0x7f4e840cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e841500f0 0x7f4e841442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840b0030 con 0x7f4e8406b9e0 2023-10-25T16:19:18.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84147c80 con 0x7f4e841500f0 2023-10-25T16:19:18.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840b0240 con 0x7f4e8406be90 2023-10-25T16:19:18.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 0x7f4e84147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 0x7f4e84147450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42148/0 (socket says 172.21.15.177:42148) 2023-10-25T16:19:18.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 -- 172.21.15.177:0/2560553257 learned_addr learned my addr 172.21.15.177:0/2560553257 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:18.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 -- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8406be90 msgr2=0x7f4e840cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e83fff640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e841500f0 0x7f4e841442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e82ffd640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8406be90 0x7f4e840cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8406be90 0x7f4e840cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 -- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e841500f0 msgr2=0x7f4e841442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e841500f0 0x7f4e841442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 -- 172.21.15.177:0/2560553257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0098e0 con 0x7f4e8406b9e0 2023-10-25T16:19:18.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e837fe640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 0x7f4e84147450 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c500 tx=0x7f4e7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:18.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74005220 con 0x7f4e8406b9e0 2023-10-25T16:19:18.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e74005470 con 0x7f4e8406b9e0 2023-10-25T16:19:18.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840b0520 con 0x7f4e8406b9e0 2023-10-25T16:19:18.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74007290 con 0x7f4e8406b9e0 2023-10-25T16:19:18.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e84147990 con 0x7f4e8406b9e0 2023-10-25T16:19:18.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.672+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e84157110 con 0x7f4e8406b9e0 2023-10-25T16:19:18.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.676+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e740073f0 con 0x7f4e8406b9e0 2023-10-25T16:19:18.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.676+0000 7f4e6bfff640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e70066470 0x7f4e70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:18.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.676+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e74083ab0 con 0x7f4e8406b9e0 2023-10-25T16:19:18.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.676+0000 7f4e82ffd640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e70066470 0x7f4e70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:18.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.676+0000 7f4e82ffd640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e70066470 0x7f4e70068930 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4e840cd710 tx=0x7f4e78009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:18.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.680+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e74050ea0 con 0x7f4e8406b9e0 2023-10-25T16:19:18.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.820+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e841678c0 con 0x7f4e70066470 2023-10-25T16:19:18.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.840+0000 7f4e6bfff640 1 -- 172.21.15.177:0/2560553257 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279623 (secure 0 0 0) 0x7f4e780050d0 con 0x7f4e70066470 2023-10-25T16:19:18.842 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:18.843 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:18.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e70066470 msgr2=0x7f4e70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e70066470 0x7f4e70068930 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4e840cd710 tx=0x7f4e78009040 comp rx=0 tx=0).stop 2023-10-25T16:19:18.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 msgr2=0x7f4e84147450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:18.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 0x7f4e84147450 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c500 tx=0x7f4e7400c9c0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 shutdown_connections 2023-10-25T16:19:18.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e70066470 0x7f4e70068930 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e841500f0 0x7f4e841442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e8406be90 0x7f4e840cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 --2- 172.21.15.177:0/2560553257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b9e0 0x7f4e84147450 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:18.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 >> 172.21.15.177:0/2560553257 conn(0x7f4e840b2450 msgr2=0x7f4e84148b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:18.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 shutdown_connections 2023-10-25T16:19:18.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:18.844+0000 7f4e8a0ae640 1 -- 172.21.15.177:0/2560553257 wait complete. 2023-10-25T16:19:18.860 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-25T16:19:18.737425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555856,"statfs":{"total":1600000000,"available":1593196933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.620726"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143836+0000","last_change":"2023-10-25T16:19:14.143836+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143836+0000","last_undegraded":"2023-10-25T16:19:14.143836+0000","last_fullsized":"2023-10-25T16:19:14.143836+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136001+0000","last_change":"2023-10-25T16:19:14.136001+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136001+0000","last_undegraded":"2023-10-25T16:19:14.136001+0000","last_fullsized":"2023-10-25T16:19:14.136001+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136341+0000","last_change":"2023-10-25T16:19:14.136341+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136341+0000","last_undegraded":"2023-10-25T16:19:14.136341+0000","last_fullsized":"2023-10-25T16:19:14.136341+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134837+0000","last_change":"2023-10-25T16:19:14.134837+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134837+0000","last_undegraded":"2023-10-25T16:19:14.134837+0000","last_fullsized":"2023-10-25T16:19:14.134837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143456+0000","last_change":"2023-10-25T16:19:14.143456+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143456+0000","last_undegraded":"2023-10-25T16:19:14.143456+0000","last_fullsized":"2023-10-25T16:19:14.143456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144981+0000","last_change":"2023-10-25T16:19:14.144981+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144981+0000","last_undegraded":"2023-10-25T16:19:14.144981+0000","last_fullsized":"2023-10-25T16:19:14.144981+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142492+0000","last_change":"2023-10-25T16:19:14.142492+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142492+0000","last_undegraded":"2023-10-25T16:19:14.142492+0000","last_fullsized":"2023-10-25T16:19:14.142492+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137041+0000","last_change":"2023-10-25T16:19:14.137041+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137041+0000","last_undegraded":"2023-10-25T16:19:14.137041+0000","last_fullsized":"2023-10-25T16:19:14.137041+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137924+0000","last_change":"2023-10-25T16:19:14.137924+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137924+0000","last_undegraded":"2023-10-25T16:19:14.137924+0000","last_fullsized":"2023-10-25T16:19:14.137924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142709+0000","last_change":"2023-10-25T16:19:14.142709+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142709+0000","last_undegraded":"2023-10-25T16:19:14.142709+0000","last_fullsized":"2023-10-25T16:19:14.142709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144213+0000","last_change":"2023-10-25T16:19:14.144213+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144213+0000","last_undegraded":"2023-10-25T16:19:14.144213+0000","last_fullsized":"2023-10-25T16:19:14.144213+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136650+0000","last_change":"2023-10-25T16:19:14.136650+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136650+0000","last_undegraded":"2023-10-25T16:19:14.136650+0000","last_fullsized":"2023-10-25T16:19:14.136650+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135308+0000","last_change":"2023-10-25T16:19:14.135308+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135308+0000","last_undegraded":"2023-10-25T16:19:14.135308+0000","last_fullsized":"2023-10-25T16:19:14.135308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632268+0000","last_change":"2023-10-25T16:19:15.168716+0000","last_active":"2023-10-25T16:19:16.632268+0000","last_peered":"2023-10-25T16:19:16.632268+0000","last_clean":"2023-10-25T16:19:16.632268+0000","last_became_active":"2023-10-25T16:19:15.165847+0000","last_became_peered":"2023-10-25T16:19:15.165847+0000","last_unstale":"2023-10-25T16:19:16.632268+0000","last_undegraded":"2023-10-25T16:19:16.632268+0000","last_fullsized":"2023-10-25T16:19:16.632268+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:21:33.092448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138150+0000","last_change":"2023-10-25T16:19:14.138150+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138150+0000","last_undegraded":"2023-10-25T16:19:14.138150+0000","last_fullsized":"2023-10-25T16:19:14.138150+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143474+0000","last_change":"2023-10-25T16:19:14.143474+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143474+0000","last_undegraded":"2023-10-25T16:19:14.143474+0000","last_fullsized":"2023-10-25T16:19:14.143474+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135565+0000","last_change":"2023-10-25T16:19:14.135565+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135565+0000","last_undegraded":"2023-10-25T16:19:14.135565+0000","last_fullsized":"2023-10-25T16:19:14.135565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134900+0000","last_change":"2023-10-25T16:19:14.134900+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134900+0000","last_undegraded":"2023-10-25T16:19:14.134900+0000","last_fullsized":"2023-10-25T16:19:14.134900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635326+0000","last_change":"2023-10-25T16:19:15.168471+0000","last_active":"2023-10-25T16:19:16.635326+0000","last_peered":"2023-10-25T16:19:16.635326+0000","last_clean":"2023-10-25T16:19:16.635326+0000","last_became_active":"2023-10-25T16:19:15.164987+0000","last_became_peered":"2023-10-25T16:19:15.164987+0000","last_unstale":"2023-10-25T16:19:16.635326+0000","last_undegraded":"2023-10-25T16:19:16.635326+0000","last_fullsized":"2023-10-25T16:19:16.635326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:48:23.980178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141186+0000","last_change":"2023-10-25T16:19:14.141186+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141186+0000","last_undegraded":"2023-10-25T16:19:14.141186+0000","last_fullsized":"2023-10-25T16:19:14.141186+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634615+0000","last_change":"2023-10-25T16:19:15.162774+0000","last_active":"2023-10-25T16:19:16.634615+0000","last_peered":"2023-10-25T16:19:16.634615+0000","last_clean":"2023-10-25T16:19:16.634615+0000","last_became_active":"2023-10-25T16:19:15.162139+0000","last_became_peered":"2023-10-25T16:19:15.162139+0000","last_unstale":"2023-10-25T16:19:16.634615+0000","last_undegraded":"2023-10-25T16:19:16.634615+0000","last_fullsized":"2023-10-25T16:19:16.634615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:24.330887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135113+0000","last_change":"2023-10-25T16:19:14.135113+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135113+0000","last_undegraded":"2023-10-25T16:19:14.135113+0000","last_fullsized":"2023-10-25T16:19:14.135113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136653+0000","last_change":"2023-10-25T16:19:14.136653+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136653+0000","last_undegraded":"2023-10-25T16:19:14.136653+0000","last_fullsized":"2023-10-25T16:19:14.136653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143590+0000","last_change":"2023-10-25T16:19:14.143590+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143590+0000","last_undegraded":"2023-10-25T16:19:14.143590+0000","last_fullsized":"2023-10-25T16:19:14.143590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141938+0000","last_change":"2023-10-25T16:19:14.141938+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141938+0000","last_undegraded":"2023-10-25T16:19:14.141938+0000","last_fullsized":"2023-10-25T16:19:14.141938+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136063+0000","last_change":"2023-10-25T16:19:14.136063+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136063+0000","last_undegraded":"2023-10-25T16:19:14.136063+0000","last_fullsized":"2023-10-25T16:19:14.136063+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141642+0000","last_change":"2023-10-25T16:19:14.141642+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141642+0000","last_undegraded":"2023-10-25T16:19:14.141642+0000","last_fullsized":"2023-10-25T16:19:14.141642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138195+0000","last_change":"2023-10-25T16:19:14.138195+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138195+0000","last_undegraded":"2023-10-25T16:19:14.138195+0000","last_fullsized":"2023-10-25T16:19:14.138195+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134076+0000","last_change":"2023-10-25T16:19:14.134076+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134076+0000","last_undegraded":"2023-10-25T16:19:14.134076+0000","last_fullsized":"2023-10-25T16:19:14.134076+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635488+0000","last_change":"2023-10-25T16:19:15.166088+0000","last_active":"2023-10-25T16:19:16.635488+0000","last_peered":"2023-10-25T16:19:16.635488+0000","last_clean":"2023-10-25T16:19:16.635488+0000","last_became_active":"2023-10-25T16:19:15.164449+0000","last_became_peered":"2023-10-25T16:19:15.164449+0000","last_unstale":"2023-10-25T16:19:16.635488+0000","last_undegraded":"2023-10-25T16:19:16.635488+0000","last_fullsized":"2023-10-25T16:19:16.635488+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:28.304979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136619+0000","last_change":"2023-10-25T16:19:14.136619+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136619+0000","last_undegraded":"2023-10-25T16:19:14.136619+0000","last_fullsized":"2023-10-25T16:19:14.136619+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139591+0000","last_change":"2023-10-25T16:19:14.139591+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139591+0000","last_undegraded":"2023-10-25T16:19:14.139591+0000","last_fullsized":"2023-10-25T16:19:14.139591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635504+0000","last_change":"2023-10-25T16:19:15.165446+0000","last_active":"2023-10-25T16:19:16.635504+0000","last_peered":"2023-10-25T16:19:16.635504+0000","last_clean":"2023-10-25T16:19:16.635504+0000","last_became_active":"2023-10-25T16:19:15.160950+0000","last_became_peered":"2023-10-25T16:19:15.160950+0000","last_unstale":"2023-10-25T16:19:16.635504+0000","last_undegraded":"2023-10-25T16:19:16.635504+0000","last_fullsized":"2023-10-25T16:19:16.635504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:07:56.725551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145052+0000","last_change":"2023-10-25T16:19:14.144947+0000","last_active":"2023-10-25T16:19:14.145052+0000","last_peered":"2023-10-25T16:19:14.145052+0000","last_clean":"2023-10-25T16:19:14.145052+0000","last_became_active":"2023-10-25T16:19:14.144069+0000","last_became_peered":"2023-10-25T16:19:14.144069+0000","last_unstale":"2023-10-25T16:19:14.145052+0000","last_undegraded":"2023-10-25T16:19:14.145052+0000","last_fullsized":"2023-10-25T16:19:14.145052+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134451+0000","last_change":"2023-10-25T16:19:14.134451+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134451+0000","last_undegraded":"2023-10-25T16:19:14.134451+0000","last_fullsized":"2023-10-25T16:19:14.134451+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155211+0000","last_change":"2023-10-25T16:19:14.154975+0000","last_active":"2023-10-25T16:19:14.155211+0000","last_peered":"2023-10-25T16:19:14.155211+0000","last_clean":"2023-10-25T16:19:14.155211+0000","last_became_active":"2023-10-25T16:19:14.153747+0000","last_became_peered":"2023-10-25T16:19:14.153747+0000","last_unstale":"2023-10-25T16:19:14.155211+0000","last_undegraded":"2023-10-25T16:19:14.155211+0000","last_fullsized":"2023-10-25T16:19:14.155211+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143377+0000","last_change":"2023-10-25T16:19:14.143377+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143377+0000","last_undegraded":"2023-10-25T16:19:14.143377+0000","last_fullsized":"2023-10-25T16:19:14.143377+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145180+0000","last_change":"2023-10-25T16:19:14.145066+0000","last_active":"2023-10-25T16:19:14.145180+0000","last_peered":"2023-10-25T16:19:14.145180+0000","last_clean":"2023-10-25T16:19:14.145180+0000","last_became_active":"2023-10-25T16:19:14.144640+0000","last_became_peered":"2023-10-25T16:19:14.144640+0000","last_unstale":"2023-10-25T16:19:14.145180+0000","last_undegraded":"2023-10-25T16:19:14.145180+0000","last_fullsized":"2023-10-25T16:19:14.145180+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136708+0000","last_change":"2023-10-25T16:19:14.136708+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136708+0000","last_undegraded":"2023-10-25T16:19:14.136708+0000","last_fullsized":"2023-10-25T16:19:14.136708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153495+0000","last_change":"2023-10-25T16:19:14.153400+0000","last_active":"2023-10-25T16:19:14.153495+0000","last_peered":"2023-10-25T16:19:14.153495+0000","last_clean":"2023-10-25T16:19:14.153495+0000","last_became_active":"2023-10-25T16:19:14.153175+0000","last_became_peered":"2023-10-25T16:19:14.153175+0000","last_unstale":"2023-10-25T16:19:14.153495+0000","last_undegraded":"2023-10-25T16:19:14.153495+0000","last_fullsized":"2023-10-25T16:19:14.153495+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139245+0000","last_change":"2023-10-25T16:19:14.139245+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139245+0000","last_undegraded":"2023-10-25T16:19:14.139245+0000","last_fullsized":"2023-10-25T16:19:14.139245+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145957+0000","last_change":"2023-10-25T16:19:14.145874+0000","last_active":"2023-10-25T16:19:14.145957+0000","last_peered":"2023-10-25T16:19:14.145957+0000","last_clean":"2023-10-25T16:19:14.145957+0000","last_became_active":"2023-10-25T16:19:14.145602+0000","last_became_peered":"2023-10-25T16:19:14.145602+0000","last_unstale":"2023-10-25T16:19:14.145957+0000","last_undegraded":"2023-10-25T16:19:14.145957+0000","last_fullsized":"2023-10-25T16:19:14.145957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:58:43.843147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.140694+0000","last_change":"2023-10-25T16:19:14.140694+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.140694+0000","last_undegraded":"2023-10-25T16:19:14.140694+0000","last_fullsized":"2023-10-25T16:19:14.140694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147302+0000","last_change":"2023-10-25T16:19:14.147250+0000","last_active":"2023-10-25T16:19:14.147302+0000","last_peered":"2023-10-25T16:19:14.147302+0000","last_clean":"2023-10-25T16:19:14.147302+0000","last_became_active":"2023-10-25T16:19:14.147036+0000","last_became_peered":"2023-10-25T16:19:14.147036+0000","last_unstale":"2023-10-25T16:19:14.147302+0000","last_undegraded":"2023-10-25T16:19:14.147302+0000","last_fullsized":"2023-10-25T16:19:14.147302+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133682+0000","last_change":"2023-10-25T16:19:14.133682+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133682+0000","last_undegraded":"2023-10-25T16:19:14.133682+0000","last_fullsized":"2023-10-25T16:19:14.133682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145524+0000","last_change":"2023-10-25T16:19:14.145346+0000","last_active":"2023-10-25T16:19:14.145524+0000","last_peered":"2023-10-25T16:19:14.145524+0000","last_clean":"2023-10-25T16:19:14.145524+0000","last_became_active":"2023-10-25T16:19:14.143452+0000","last_became_peered":"2023-10-25T16:19:14.143452+0000","last_unstale":"2023-10-25T16:19:14.145524+0000","last_undegraded":"2023-10-25T16:19:14.145524+0000","last_fullsized":"2023-10-25T16:19:14.145524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:11.865110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136516+0000","last_change":"2023-10-25T16:19:14.136516+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136516+0000","last_undegraded":"2023-10-25T16:19:14.136516+0000","last_fullsized":"2023-10-25T16:19:14.136516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145000+0000","last_change":"2023-10-25T16:19:14.144655+0000","last_active":"2023-10-25T16:19:14.145000+0000","last_peered":"2023-10-25T16:19:14.145000+0000","last_clean":"2023-10-25T16:19:14.145000+0000","last_became_active":"2023-10-25T16:19:14.144338+0000","last_became_peered":"2023-10-25T16:19:14.144338+0000","last_unstale":"2023-10-25T16:19:14.145000+0000","last_undegraded":"2023-10-25T16:19:14.145000+0000","last_fullsized":"2023-10-25T16:19:14.145000+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:31:23.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134678+0000","last_change":"2023-10-25T16:19:14.134678+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134678+0000","last_undegraded":"2023-10-25T16:19:14.134678+0000","last_fullsized":"2023-10-25T16:19:14.134678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150868+0000","last_change":"2023-10-25T16:19:14.150828+0000","last_active":"2023-10-25T16:19:14.150868+0000","last_peered":"2023-10-25T16:19:14.150868+0000","last_clean":"2023-10-25T16:19:14.150868+0000","last_became_active":"2023-10-25T16:19:14.150521+0000","last_became_peered":"2023-10-25T16:19:14.150521+0000","last_unstale":"2023-10-25T16:19:14.150868+0000","last_undegraded":"2023-10-25T16:19:14.150868+0000","last_fullsized":"2023-10-25T16:19:14.150868+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:16:42.600065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136798+0000","last_change":"2023-10-25T16:19:14.136798+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136798+0000","last_undegraded":"2023-10-25T16:19:14.136798+0000","last_fullsized":"2023-10-25T16:19:14.136798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.141446+0000","last_change":"2023-10-25T16:19:14.141102+0000","last_active":"2023-10-25T16:19:14.141446+0000","last_peered":"2023-10-25T16:19:14.141446+0000","last_clean":"2023-10-25T16:19:14.141446+0000","last_became_active":"2023-10-25T16:19:14.140878+0000","last_became_peered":"2023-10-25T16:19:14.140878+0000","last_unstale":"2023-10-25T16:19:14.141446+0000","last_undegraded":"2023-10-25T16:19:14.141446+0000","last_fullsized":"2023-10-25T16:19:14.141446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141971+0000","last_change":"2023-10-25T16:19:14.141971+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141971+0000","last_undegraded":"2023-10-25T16:19:14.141971+0000","last_fullsized":"2023-10-25T16:19:14.141971+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.156446+0000","last_change":"2023-10-25T16:19:14.156141+0000","last_active":"2023-10-25T16:19:14.156446+0000","last_peered":"2023-10-25T16:19:14.156446+0000","last_clean":"2023-10-25T16:19:14.156446+0000","last_became_active":"2023-10-25T16:19:14.155549+0000","last_became_peered":"2023-10-25T16:19:14.155549+0000","last_unstale":"2023-10-25T16:19:14.156446+0000","last_undegraded":"2023-10-25T16:19:14.156446+0000","last_fullsized":"2023-10-25T16:19:14.156446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141621+0000","last_change":"2023-10-25T16:19:14.141621+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141621+0000","last_undegraded":"2023-10-25T16:19:14.141621+0000","last_fullsized":"2023-10-25T16:19:14.141621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154773+0000","last_change":"2023-10-25T16:19:14.154628+0000","last_active":"2023-10-25T16:19:14.154773+0000","last_peered":"2023-10-25T16:19:14.154773+0000","last_clean":"2023-10-25T16:19:14.154773+0000","last_became_active":"2023-10-25T16:19:14.153323+0000","last_became_peered":"2023-10-25T16:19:14.153323+0000","last_unstale":"2023-10-25T16:19:14.154773+0000","last_undegraded":"2023-10-25T16:19:14.154773+0000","last_fullsized":"2023-10-25T16:19:14.154773+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:55:01.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133526+0000","last_change":"2023-10-25T16:19:14.133526+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133526+0000","last_undegraded":"2023-10-25T16:19:14.133526+0000","last_fullsized":"2023-10-25T16:19:14.133526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"128'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635693+0000","last_change":"2023-10-25T16:19:14.156380+0000","last_active":"2023-10-25T16:19:16.635693+0000","last_peered":"2023-10-25T16:19:16.635693+0000","last_clean":"2023-10-25T16:19:16.635693+0000","last_became_active":"2023-10-25T16:19:14.156233+0000","last_became_peered":"2023-10-25T16:19:14.156233+0000","last_unstale":"2023-10-25T16:19:16.635693+0000","last_undegraded":"2023-10-25T16:19:16.635693+0000","last_fullsized":"2023-10-25T16:19:16.635693+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:35:50.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137170+0000","last_change":"2023-10-25T16:19:14.137170+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137170+0000","last_undegraded":"2023-10-25T16:19:14.137170+0000","last_fullsized":"2023-10-25T16:19:14.137170+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635148+0000","last_change":"2023-10-25T16:19:14.148704+0000","last_active":"2023-10-25T16:19:16.635148+0000","last_peered":"2023-10-25T16:19:16.635148+0000","last_clean":"2023-10-25T16:19:16.635148+0000","last_became_active":"2023-10-25T16:19:14.148550+0000","last_became_peered":"2023-10-25T16:19:14.148550+0000","last_unstale":"2023-10-25T16:19:16.635148+0000","last_undegraded":"2023-10-25T16:19:16.635148+0000","last_fullsized":"2023-10-25T16:19:16.635148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:03.206482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135843+0000","last_change":"2023-10-25T16:19:14.135843+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135843+0000","last_undegraded":"2023-10-25T16:19:14.135843+0000","last_fullsized":"2023-10-25T16:19:14.135843+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.158390+0000","last_change":"2023-10-25T16:19:14.158176+0000","last_active":"2023-10-25T16:19:14.158390+0000","last_peered":"2023-10-25T16:19:14.158390+0000","last_clean":"2023-10-25T16:19:14.158390+0000","last_became_active":"2023-10-25T16:19:14.157135+0000","last_became_peered":"2023-10-25T16:19:14.157135+0000","last_unstale":"2023-10-25T16:19:14.158390+0000","last_undegraded":"2023-10-25T16:19:14.158390+0000","last_fullsized":"2023-10-25T16:19:14.158390+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:39.362616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634295+0000","last_change":"2023-10-25T16:19:15.161990+0000","last_active":"2023-10-25T16:19:16.634295+0000","last_peered":"2023-10-25T16:19:16.634295+0000","last_clean":"2023-10-25T16:19:16.634295+0000","last_became_active":"2023-10-25T16:19:15.161462+0000","last_became_peered":"2023-10-25T16:19:15.161462+0000","last_unstale":"2023-10-25T16:19:16.634295+0000","last_undegraded":"2023-10-25T16:19:16.634295+0000","last_fullsized":"2023-10-25T16:19:16.634295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:38.301081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150981+0000","last_change":"2023-10-25T16:19:14.150925+0000","last_active":"2023-10-25T16:19:14.150981+0000","last_peered":"2023-10-25T16:19:14.150981+0000","last_clean":"2023-10-25T16:19:14.150981+0000","last_became_active":"2023-10-25T16:19:14.150509+0000","last_became_peered":"2023-10-25T16:19:14.150509+0000","last_unstale":"2023-10-25T16:19:14.150981+0000","last_undegraded":"2023-10-25T16:19:14.150981+0000","last_fullsized":"2023-10-25T16:19:14.150981+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:18.180629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141220+0000","last_change":"2023-10-25T16:19:14.141220+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141220+0000","last_undegraded":"2023-10-25T16:19:14.141220+0000","last_fullsized":"2023-10-25T16:19:14.141220+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.157146+0000","last_change":"2023-10-25T16:19:14.156944+0000","last_active":"2023-10-25T16:19:14.157146+0000","last_peered":"2023-10-25T16:19:14.157146+0000","last_clean":"2023-10-25T16:19:14.157146+0000","last_became_active":"2023-10-25T16:19:14.156080+0000","last_became_peered":"2023-10-25T16:19:14.156080+0000","last_unstale":"2023-10-25T16:19:14.157146+0000","last_undegraded":"2023-10-25T16:19:14.157146+0000","last_fullsized":"2023-10-25T16:19:14.157146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:54.206890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141667+0000","last_change":"2023-10-25T16:19:14.141667+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141667+0000","last_undegraded":"2023-10-25T16:19:14.141667+0000","last_fullsized":"2023-10-25T16:19:14.141667+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.148899+0000","last_change":"2023-10-25T16:19:14.148729+0000","last_active":"2023-10-25T16:19:14.148899+0000","last_peered":"2023-10-25T16:19:14.148899+0000","last_clean":"2023-10-25T16:19:14.148899+0000","last_became_active":"2023-10-25T16:19:14.148088+0000","last_became_peered":"2023-10-25T16:19:14.148088+0000","last_unstale":"2023-10-25T16:19:14.148899+0000","last_undegraded":"2023-10-25T16:19:14.148899+0000","last_fullsized":"2023-10-25T16:19:14.148899+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:52:20.145806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142361+0000","last_change":"2023-10-25T16:19:14.142361+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142361+0000","last_undegraded":"2023-10-25T16:19:14.142361+0000","last_fullsized":"2023-10-25T16:19:14.142361+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155825+0000","last_change":"2023-10-25T16:19:14.155751+0000","last_active":"2023-10-25T16:19:14.155825+0000","last_peered":"2023-10-25T16:19:14.155825+0000","last_clean":"2023-10-25T16:19:14.155825+0000","last_became_active":"2023-10-25T16:19:14.155504+0000","last_became_peered":"2023-10-25T16:19:14.155504+0000","last_unstale":"2023-10-25T16:19:14.155825+0000","last_undegraded":"2023-10-25T16:19:14.155825+0000","last_fullsized":"2023-10-25T16:19:14.155825+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635678+0000","last_change":"2023-10-25T16:19:15.164082+0000","last_active":"2023-10-25T16:19:16.635678+0000","last_peered":"2023-10-25T16:19:16.635678+0000","last_clean":"2023-10-25T16:19:16.635678+0000","last_became_active":"2023-10-25T16:19:15.160195+0000","last_became_peered":"2023-10-25T16:19:15.160195+0000","last_unstale":"2023-10-25T16:19:16.635678+0000","last_undegraded":"2023-10-25T16:19:16.635678+0000","last_fullsized":"2023-10-25T16:19:16.635678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:53:34.418384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146639+0000","last_change":"2023-10-25T16:19:14.146477+0000","last_active":"2023-10-25T16:19:14.146639+0000","last_peered":"2023-10-25T16:19:14.146639+0000","last_clean":"2023-10-25T16:19:14.146639+0000","last_became_active":"2023-10-25T16:19:14.144690+0000","last_became_peered":"2023-10-25T16:19:14.144690+0000","last_unstale":"2023-10-25T16:19:14.146639+0000","last_undegraded":"2023-10-25T16:19:14.146639+0000","last_fullsized":"2023-10-25T16:19:14.146639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:06:45.355521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635018+0000","last_change":"2023-10-25T16:19:15.171435+0000","last_active":"2023-10-25T16:19:16.635018+0000","last_peered":"2023-10-25T16:19:16.635018+0000","last_clean":"2023-10-25T16:19:16.635018+0000","last_became_active":"2023-10-25T16:19:15.171216+0000","last_became_peered":"2023-10-25T16:19:15.171216+0000","last_unstale":"2023-10-25T16:19:16.635018+0000","last_undegraded":"2023-10-25T16:19:16.635018+0000","last_fullsized":"2023-10-25T16:19:16.635018+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:31:34.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153652+0000","last_change":"2023-10-25T16:19:14.153459+0000","last_active":"2023-10-25T16:19:14.153652+0000","last_peered":"2023-10-25T16:19:14.153652+0000","last_clean":"2023-10-25T16:19:14.153652+0000","last_became_active":"2023-10-25T16:19:14.152828+0000","last_became_peered":"2023-10-25T16:19:14.152828+0000","last_unstale":"2023-10-25T16:19:14.153652+0000","last_undegraded":"2023-10-25T16:19:14.153652+0000","last_fullsized":"2023-10-25T16:19:14.153652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:53.897110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634935+0000","last_change":"2023-10-25T16:19:15.153350+0000","last_active":"2023-10-25T16:19:16.634935+0000","last_peered":"2023-10-25T16:19:16.634935+0000","last_clean":"2023-10-25T16:19:16.634935+0000","last_became_active":"2023-10-25T16:19:15.152653+0000","last_became_peered":"2023-10-25T16:19:15.152653+0000","last_unstale":"2023-10-25T16:19:16.634935+0000","last_undegraded":"2023-10-25T16:19:16.634935+0000","last_fullsized":"2023-10-25T16:19:16.634935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:44:42.152160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.144410+0000","last_change":"2023-10-25T16:19:14.144093+0000","last_active":"2023-10-25T16:19:14.144410+0000","last_peered":"2023-10-25T16:19:14.144410+0000","last_clean":"2023-10-25T16:19:14.144410+0000","last_became_active":"2023-10-25T16:19:14.143541+0000","last_became_peered":"2023-10-25T16:19:14.143541+0000","last_unstale":"2023-10-25T16:19:14.144410+0000","last_undegraded":"2023-10-25T16:19:14.144410+0000","last_fullsized":"2023-10-25T16:19:14.144410+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:52.045235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134221+0000","last_change":"2023-10-25T16:19:14.134221+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134221+0000","last_undegraded":"2023-10-25T16:19:14.134221+0000","last_fullsized":"2023-10-25T16:19:14.134221+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147784+0000","last_change":"2023-10-25T16:19:14.147714+0000","last_active":"2023-10-25T16:19:14.147784+0000","last_peered":"2023-10-25T16:19:14.147784+0000","last_clean":"2023-10-25T16:19:14.147784+0000","last_became_active":"2023-10-25T16:19:14.147202+0000","last_became_peered":"2023-10-25T16:19:14.147202+0000","last_unstale":"2023-10-25T16:19:14.147784+0000","last_undegraded":"2023-10-25T16:19:14.147784+0000","last_fullsized":"2023-10-25T16:19:14.147784+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:30.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135496+0000","last_change":"2023-10-25T16:19:14.135496+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135496+0000","last_undegraded":"2023-10-25T16:19:14.135496+0000","last_fullsized":"2023-10-25T16:19:14.135496+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.159273+0000","last_change":"2023-10-25T16:19:14.159133+0000","last_active":"2023-10-25T16:19:14.159273+0000","last_peered":"2023-10-25T16:19:14.159273+0000","last_clean":"2023-10-25T16:19:14.159273+0000","last_became_active":"2023-10-25T16:19:14.158596+0000","last_became_peered":"2023-10-25T16:19:14.158596+0000","last_unstale":"2023-10-25T16:19:14.159273+0000","last_undegraded":"2023-10-25T16:19:14.159273+0000","last_fullsized":"2023-10-25T16:19:14.159273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:35:24.246693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139072+0000","last_change":"2023-10-25T16:19:14.139072+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139072+0000","last_undegraded":"2023-10-25T16:19:14.139072+0000","last_fullsized":"2023-10-25T16:19:14.139072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146621+0000","last_change":"2023-10-25T16:19:14.145106+0000","last_active":"2023-10-25T16:19:14.146621+0000","last_peered":"2023-10-25T16:19:14.146621+0000","last_clean":"2023-10-25T16:19:14.146621+0000","last_became_active":"2023-10-25T16:19:14.144380+0000","last_became_peered":"2023-10-25T16:19:14.144380+0000","last_unstale":"2023-10-25T16:19:14.146621+0000","last_undegraded":"2023-10-25T16:19:14.146621+0000","last_fullsized":"2023-10-25T16:19:14.146621+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:06.413087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136598+0000","last_change":"2023-10-25T16:19:14.136598+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136598+0000","last_undegraded":"2023-10-25T16:19:14.136598+0000","last_fullsized":"2023-10-25T16:19:14.136598+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153818+0000","last_change":"2023-10-25T16:19:14.153739+0000","last_active":"2023-10-25T16:19:14.153818+0000","last_peered":"2023-10-25T16:19:14.153818+0000","last_clean":"2023-10-25T16:19:14.153818+0000","last_became_active":"2023-10-25T16:19:14.153488+0000","last_became_peered":"2023-10-25T16:19:14.153488+0000","last_unstale":"2023-10-25T16:19:14.153818+0000","last_undegraded":"2023-10-25T16:19:14.153818+0000","last_fullsized":"2023-10-25T16:19:14.153818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:02.709932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134522+0000","last_change":"2023-10-25T16:19:14.134522+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134522+0000","last_undegraded":"2023-10-25T16:19:14.134522+0000","last_fullsized":"2023-10-25T16:19:14.134522+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.151530+0000","last_change":"2023-10-25T16:19:14.151321+0000","last_active":"2023-10-25T16:19:14.151530+0000","last_peered":"2023-10-25T16:19:14.151530+0000","last_clean":"2023-10-25T16:19:14.151530+0000","last_became_active":"2023-10-25T16:19:14.150384+0000","last_became_peered":"2023-10-25T16:19:14.150384+0000","last_unstale":"2023-10-25T16:19:14.151530+0000","last_undegraded":"2023-10-25T16:19:14.151530+0000","last_fullsized":"2023-10-25T16:19:14.151530+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:39:27.242739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634617+0000","last_change":"2023-10-25T16:19:15.161843+0000","last_active":"2023-10-25T16:19:16.634617+0000","last_peered":"2023-10-25T16:19:16.634617+0000","last_clean":"2023-10-25T16:19:16.634617+0000","last_became_active":"2023-10-25T16:19:15.161148+0000","last_became_peered":"2023-10-25T16:19:15.161148+0000","last_unstale":"2023-10-25T16:19:16.634617+0000","last_undegraded":"2023-10-25T16:19:16.634617+0000","last_fullsized":"2023-10-25T16:19:16.634617+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:02:12.533890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.140976+0000","last_change":"2023-10-25T16:19:14.140911+0000","last_active":"2023-10-25T16:19:14.140976+0000","last_peered":"2023-10-25T16:19:14.140976+0000","last_clean":"2023-10-25T16:19:14.140976+0000","last_became_active":"2023-10-25T16:19:14.140640+0000","last_became_peered":"2023-10-25T16:19:14.140640+0000","last_unstale":"2023-10-25T16:19:14.140976+0000","last_undegraded":"2023-10-25T16:19:14.140976+0000","last_fullsized":"2023-10-25T16:19:14.140976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:14.936794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135822+0000","last_change":"2023-10-25T16:19:14.135822+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135822+0000","last_undegraded":"2023-10-25T16:19:14.135822+0000","last_fullsized":"2023-10-25T16:19:14.135822+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154966+0000","last_change":"2023-10-25T16:19:14.154725+0000","last_active":"2023-10-25T16:19:14.154966+0000","last_peered":"2023-10-25T16:19:14.154966+0000","last_clean":"2023-10-25T16:19:14.154966+0000","last_became_active":"2023-10-25T16:19:14.152704+0000","last_became_peered":"2023-10-25T16:19:14.152704+0000","last_unstale":"2023-10-25T16:19:14.154966+0000","last_undegraded":"2023-10-25T16:19:14.154966+0000","last_fullsized":"2023-10-25T16:19:14.154966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:53.073111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635841+0000","last_change":"2023-10-25T16:19:15.166303+0000","last_active":"2023-10-25T16:19:16.635841+0000","last_peered":"2023-10-25T16:19:16.635841+0000","last_clean":"2023-10-25T16:19:16.635841+0000","last_became_active":"2023-10-25T16:19:15.163694+0000","last_became_peered":"2023-10-25T16:19:15.163694+0000","last_unstale":"2023-10-25T16:19:16.635841+0000","last_undegraded":"2023-10-25T16:19:16.635841+0000","last_fullsized":"2023-10-25T16:19:16.635841+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:57.824680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146034+0000","last_change":"2023-10-25T16:19:14.145472+0000","last_active":"2023-10-25T16:19:14.146034+0000","last_peered":"2023-10-25T16:19:14.146034+0000","last_clean":"2023-10-25T16:19:14.146034+0000","last_became_active":"2023-10-25T16:19:14.145146+0000","last_became_peered":"2023-10-25T16:19:14.145146+0000","last_unstale":"2023-10-25T16:19:14.146034+0000","last_undegraded":"2023-10-25T16:19:14.146034+0000","last_fullsized":"2023-10-25T16:19:14.146034+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134053+0000","last_change":"2023-10-25T16:19:14.134053+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134053+0000","last_undegraded":"2023-10-25T16:19:14.134053+0000","last_fullsized":"2023-10-25T16:19:14.134053+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635951+0000","last_change":"2023-10-25T16:19:14.140357+0000","last_active":"2023-10-25T16:19:16.635951+0000","last_peered":"2023-10-25T16:19:16.635951+0000","last_clean":"2023-10-25T16:19:16.635951+0000","last_became_active":"2023-10-25T16:19:14.140115+0000","last_became_peered":"2023-10-25T16:19:14.140115+0000","last_unstale":"2023-10-25T16:19:16.635951+0000","last_undegraded":"2023-10-25T16:19:16.635951+0000","last_fullsized":"2023-10-25T16:19:16.635951+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:57.962504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635308+0000","last_change":"2023-10-25T16:19:15.159472+0000","last_active":"2023-10-25T16:19:16.635308+0000","last_peered":"2023-10-25T16:19:16.635308+0000","last_clean":"2023-10-25T16:19:16.635308+0000","last_became_active":"2023-10-25T16:19:15.158856+0000","last_became_peered":"2023-10-25T16:19:15.158856+0000","last_unstale":"2023-10-25T16:19:16.635308+0000","last_undegraded":"2023-10-25T16:19:16.635308+0000","last_fullsized":"2023-10-25T16:19:16.635308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:29:38.107837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150325+0000","last_change":"2023-10-25T16:19:14.150096+0000","last_active":"2023-10-25T16:19:14.150325+0000","last_peered":"2023-10-25T16:19:14.150325+0000","last_clean":"2023-10-25T16:19:14.150325+0000","last_became_active":"2023-10-25T16:19:14.149275+0000","last_became_peered":"2023-10-25T16:19:14.149275+0000","last_unstale":"2023-10-25T16:19:14.150325+0000","last_undegraded":"2023-10-25T16:19:14.150325+0000","last_fullsized":"2023-10-25T16:19:14.150325+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-25T16:19:13.116826+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:13.116826+0000","last_peered":"2023-10-25T16:19:13.116826+0000","last_clean":"2023-10-25T16:19:13.116826+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:13.116826+0000","last_undegraded":"2023-10-25T16:19:13.116826+0000","last_fullsized":"2023-10-25T16:19:13.116826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542223,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289682,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.0660000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.878}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.0069999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.90700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":1.0389999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.268}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.84299999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":1.3500000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.131},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.85599999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":0.76700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":1.032},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.0089999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.0760000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":1.05},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86599999999999999,"15min":0.83399999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.046,"5min":1.419,"15min":1.419},"last":1.159},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.91000000000000003,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.103},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.218}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.367},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3360000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.78900000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.143}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":1.3109999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.2150000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.111},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":1.077}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.54200000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":0.75},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":0.92400000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":1.056}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":1.02}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":0.872}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":1.266}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:18.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-25T16:19:18.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.143836+0000', 'last_change': '2023-10-25T16:19:14.143836+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.143836+0000', 'last_undegraded': '2023-10-25T16:19:14.143836+0000', 'last_fullsized': '2023-10-25T16:19:14.143836+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-25T16:19:18.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136001+0000', 'last_change': '2023-10-25T16:19:14.136001+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136001+0000', 'last_undegraded': '2023-10-25T16:19:14.136001+0000', 'last_fullsized': '2023-10-25T16:19:14.136001+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-25T16:19:18.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136341+0000', 'last_change': '2023-10-25T16:19:14.136341+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136341+0000', 'last_undegraded': '2023-10-25T16:19:14.136341+0000', 'last_fullsized': '2023-10-25T16:19:14.136341+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-25T16:19:18.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134837+0000', 'last_change': '2023-10-25T16:19:14.134837+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134837+0000', 'last_undegraded': '2023-10-25T16:19:14.134837+0000', 'last_fullsized': '2023-10-25T16:19:14.134837+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-25T16:19:18.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.143456+0000', 'last_change': '2023-10-25T16:19:14.143456+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.143456+0000', 'last_undegraded': '2023-10-25T16:19:14.143456+0000', 'last_fullsized': '2023-10-25T16:19:14.143456+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-25T16:19:18.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.144981+0000', 'last_change': '2023-10-25T16:19:14.144981+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.144981+0000', 'last_undegraded': '2023-10-25T16:19:14.144981+0000', 'last_fullsized': '2023-10-25T16:19:14.144981+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-25T16:19:18.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.142492+0000', 'last_change': '2023-10-25T16:19:14.142492+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.142492+0000', 'last_undegraded': '2023-10-25T16:19:14.142492+0000', 'last_fullsized': '2023-10-25T16:19:14.142492+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-25T16:19:18.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.137041+0000', 'last_change': '2023-10-25T16:19:14.137041+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.137041+0000', 'last_undegraded': '2023-10-25T16:19:14.137041+0000', 'last_fullsized': '2023-10-25T16:19:14.137041+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-25T16:19:18.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.137924+0000', 'last_change': '2023-10-25T16:19:14.137924+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.137924+0000', 'last_undegraded': '2023-10-25T16:19:14.137924+0000', 'last_fullsized': '2023-10-25T16:19:14.137924+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-25T16:19:18.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.142709+0000', 'last_change': '2023-10-25T16:19:14.142709+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.142709+0000', 'last_undegraded': '2023-10-25T16:19:14.142709+0000', 'last_fullsized': '2023-10-25T16:19:14.142709+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-25T16:19:18.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.144213+0000', 'last_change': '2023-10-25T16:19:14.144213+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.144213+0000', 'last_undegraded': '2023-10-25T16:19:14.144213+0000', 'last_fullsized': '2023-10-25T16:19:14.144213+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-25T16:19:18.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136650+0000', 'last_change': '2023-10-25T16:19:14.136650+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136650+0000', 'last_undegraded': '2023-10-25T16:19:14.136650+0000', 'last_fullsized': '2023-10-25T16:19:14.136650+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-25T16:19:18.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.135308+0000', 'last_change': '2023-10-25T16:19:14.135308+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.135308+0000', 'last_undegraded': '2023-10-25T16:19:14.135308+0000', 'last_fullsized': '2023-10-25T16:19:14.135308+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-25T16:19:18.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.138150+0000', 'last_change': '2023-10-25T16:19:14.138150+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.138150+0000', 'last_undegraded': '2023-10-25T16:19:14.138150+0000', 'last_fullsized': '2023-10-25T16:19:14.138150+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-25T16:19:18.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.143474+0000', 'last_change': '2023-10-25T16:19:14.143474+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.143474+0000', 'last_undegraded': '2023-10-25T16:19:14.143474+0000', 'last_fullsized': '2023-10-25T16:19:14.143474+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-25T16:19:18.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.135565+0000', 'last_change': '2023-10-25T16:19:14.135565+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.135565+0000', 'last_undegraded': '2023-10-25T16:19:14.135565+0000', 'last_fullsized': '2023-10-25T16:19:14.135565+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-25T16:19:18.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134900+0000', 'last_change': '2023-10-25T16:19:14.134900+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134900+0000', 'last_undegraded': '2023-10-25T16:19:14.134900+0000', 'last_fullsized': '2023-10-25T16:19:14.134900+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-25T16:19:18.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141186+0000', 'last_change': '2023-10-25T16:19:14.141186+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141186+0000', 'last_undegraded': '2023-10-25T16:19:14.141186+0000', 'last_fullsized': '2023-10-25T16:19:14.141186+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-25T16:19:18.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.135113+0000', 'last_change': '2023-10-25T16:19:14.135113+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.135113+0000', 'last_undegraded': '2023-10-25T16:19:14.135113+0000', 'last_fullsized': '2023-10-25T16:19:14.135113+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-25T16:19:18.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136653+0000', 'last_change': '2023-10-25T16:19:14.136653+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136653+0000', 'last_undegraded': '2023-10-25T16:19:14.136653+0000', 'last_fullsized': '2023-10-25T16:19:14.136653+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-25T16:19:18.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.143590+0000', 'last_change': '2023-10-25T16:19:14.143590+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.143590+0000', 'last_undegraded': '2023-10-25T16:19:14.143590+0000', 'last_fullsized': '2023-10-25T16:19:14.143590+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-25T16:19:18.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141938+0000', 'last_change': '2023-10-25T16:19:14.141938+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141938+0000', 'last_undegraded': '2023-10-25T16:19:14.141938+0000', 'last_fullsized': '2023-10-25T16:19:14.141938+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-25T16:19:18.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136063+0000', 'last_change': '2023-10-25T16:19:14.136063+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136063+0000', 'last_undegraded': '2023-10-25T16:19:14.136063+0000', 'last_fullsized': '2023-10-25T16:19:14.136063+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-25T16:19:18.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141642+0000', 'last_change': '2023-10-25T16:19:14.141642+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141642+0000', 'last_undegraded': '2023-10-25T16:19:14.141642+0000', 'last_fullsized': '2023-10-25T16:19:14.141642+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-25T16:19:18.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.138195+0000', 'last_change': '2023-10-25T16:19:14.138195+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.138195+0000', 'last_undegraded': '2023-10-25T16:19:14.138195+0000', 'last_fullsized': '2023-10-25T16:19:14.138195+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-25T16:19:18.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134076+0000', 'last_change': '2023-10-25T16:19:14.134076+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134076+0000', 'last_undegraded': '2023-10-25T16:19:14.134076+0000', 'last_fullsized': '2023-10-25T16:19:14.134076+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-25T16:19:18.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136619+0000', 'last_change': '2023-10-25T16:19:14.136619+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136619+0000', 'last_undegraded': '2023-10-25T16:19:14.136619+0000', 'last_fullsized': '2023-10-25T16:19:14.136619+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-25T16:19:18.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.139591+0000', 'last_change': '2023-10-25T16:19:14.139591+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.139591+0000', 'last_undegraded': '2023-10-25T16:19:14.139591+0000', 'last_fullsized': '2023-10-25T16:19:14.139591+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-25T16:19:18.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134451+0000', 'last_change': '2023-10-25T16:19:14.134451+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134451+0000', 'last_undegraded': '2023-10-25T16:19:14.134451+0000', 'last_fullsized': '2023-10-25T16:19:14.134451+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-25T16:19:18.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.143377+0000', 'last_change': '2023-10-25T16:19:14.143377+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.143377+0000', 'last_undegraded': '2023-10-25T16:19:14.143377+0000', 'last_fullsized': '2023-10-25T16:19:14.143377+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-25T16:19:18.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136708+0000', 'last_change': '2023-10-25T16:19:14.136708+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136708+0000', 'last_undegraded': '2023-10-25T16:19:14.136708+0000', 'last_fullsized': '2023-10-25T16:19:14.136708+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-25T16:19:18.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.139245+0000', 'last_change': '2023-10-25T16:19:14.139245+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.139245+0000', 'last_undegraded': '2023-10-25T16:19:14.139245+0000', 'last_fullsized': '2023-10-25T16:19:14.139245+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:19:18.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-25T16:19:18.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.140694+0000', 'last_change': '2023-10-25T16:19:14.140694+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.140694+0000', 'last_undegraded': '2023-10-25T16:19:14.140694+0000', 'last_fullsized': '2023-10-25T16:19:14.140694+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-25T16:19:18.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.133682+0000', 'last_change': '2023-10-25T16:19:14.133682+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.133682+0000', 'last_undegraded': '2023-10-25T16:19:14.133682+0000', 'last_fullsized': '2023-10-25T16:19:14.133682+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-25T16:19:18.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136516+0000', 'last_change': '2023-10-25T16:19:14.136516+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136516+0000', 'last_undegraded': '2023-10-25T16:19:14.136516+0000', 'last_fullsized': '2023-10-25T16:19:14.136516+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-25T16:19:18.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134678+0000', 'last_change': '2023-10-25T16:19:14.134678+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134678+0000', 'last_undegraded': '2023-10-25T16:19:14.134678+0000', 'last_fullsized': '2023-10-25T16:19:14.134678+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-25T16:19:18.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136798+0000', 'last_change': '2023-10-25T16:19:14.136798+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136798+0000', 'last_undegraded': '2023-10-25T16:19:14.136798+0000', 'last_fullsized': '2023-10-25T16:19:14.136798+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-25T16:19:18.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141971+0000', 'last_change': '2023-10-25T16:19:14.141971+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141971+0000', 'last_undegraded': '2023-10-25T16:19:14.141971+0000', 'last_fullsized': '2023-10-25T16:19:14.141971+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-25T16:19:18.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141621+0000', 'last_change': '2023-10-25T16:19:14.141621+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141621+0000', 'last_undegraded': '2023-10-25T16:19:14.141621+0000', 'last_fullsized': '2023-10-25T16:19:14.141621+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-25T16:19:18.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.133526+0000', 'last_change': '2023-10-25T16:19:14.133526+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.133526+0000', 'last_undegraded': '2023-10-25T16:19:14.133526+0000', 'last_fullsized': '2023-10-25T16:19:14.133526+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:19:18.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-25T16:19:18.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.137170+0000', 'last_change': '2023-10-25T16:19:14.137170+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.137170+0000', 'last_undegraded': '2023-10-25T16:19:14.137170+0000', 'last_fullsized': '2023-10-25T16:19:14.137170+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-25T16:19:18.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.135843+0000', 'last_change': '2023-10-25T16:19:14.135843+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.135843+0000', 'last_undegraded': '2023-10-25T16:19:14.135843+0000', 'last_fullsized': '2023-10-25T16:19:14.135843+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-25T16:19:18.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141220+0000', 'last_change': '2023-10-25T16:19:14.141220+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141220+0000', 'last_undegraded': '2023-10-25T16:19:14.141220+0000', 'last_fullsized': '2023-10-25T16:19:14.141220+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-25T16:19:18.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.141667+0000', 'last_change': '2023-10-25T16:19:14.141667+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.141667+0000', 'last_undegraded': '2023-10-25T16:19:14.141667+0000', 'last_fullsized': '2023-10-25T16:19:14.141667+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:19:18.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-25T16:19:18.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.142361+0000', 'last_change': '2023-10-25T16:19:14.142361+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.142361+0000', 'last_undegraded': '2023-10-25T16:19:14.142361+0000', 'last_fullsized': '2023-10-25T16:19:14.142361+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:19:18.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-25T16:19:18.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134221+0000', 'last_change': '2023-10-25T16:19:14.134221+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134221+0000', 'last_undegraded': '2023-10-25T16:19:14.134221+0000', 'last_fullsized': '2023-10-25T16:19:14.134221+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-25T16:19:18.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.135496+0000', 'last_change': '2023-10-25T16:19:14.135496+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.135496+0000', 'last_undegraded': '2023-10-25T16:19:14.135496+0000', 'last_fullsized': '2023-10-25T16:19:14.135496+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:19:18.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-25T16:19:18.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.139072+0000', 'last_change': '2023-10-25T16:19:14.139072+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.139072+0000', 'last_undegraded': '2023-10-25T16:19:14.139072+0000', 'last_fullsized': '2023-10-25T16:19:14.139072+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-25T16:19:18.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.136598+0000', 'last_change': '2023-10-25T16:19:14.136598+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.136598+0000', 'last_undegraded': '2023-10-25T16:19:14.136598+0000', 'last_fullsized': '2023-10-25T16:19:14.136598+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:19:18.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-25T16:19:18.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134522+0000', 'last_change': '2023-10-25T16:19:14.134522+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134522+0000', 'last_undegraded': '2023-10-25T16:19:14.134522+0000', 'last_fullsized': '2023-10-25T16:19:14.134522+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-25T16:19:18.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.135822+0000', 'last_change': '2023-10-25T16:19:14.135822+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.135822+0000', 'last_undegraded': '2023-10-25T16:19:14.135822+0000', 'last_fullsized': '2023-10-25T16:19:14.135822+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:19:18.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-25T16:19:18.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:19:14.134053+0000', 'last_change': '2023-10-25T16:19:14.134053+0000', 'last_active': '2023-10-25T16:19:14.114202+0000', 'last_peered': '2023-10-25T16:19:14.114202+0000', 'last_clean': '2023-10-25T16:19:14.114202+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:14.134053+0000', 'last_undegraded': '2023-10-25T16:19:14.134053+0000', 'last_fullsized': '2023-10-25T16:19:14.134053+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:14.114202+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:19:18.919 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:19:19.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- 172.21.15.177:0/266241025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc140e90 msgr2=0x7fd6cc0af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 --2- 172.21.15.177:0/266241025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc140e90 0x7fd6cc0af580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009bc0 tx=0x7fd6bc01caf0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- 172.21.15.177:0/266241025 shutdown_connections 2023-10-25T16:19:19.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 --2- 172.21.15.177:0/266241025 >> v2:172.21.15.184:3300/0 conn(0x7fd6cc06c090 0x7fd6cc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 --2- 172.21.15.177:0/266241025 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc140e90 0x7fd6cc0af580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- 172.21.15.177:0/266241025 >> 172.21.15.177:0/266241025 conn(0x7fd6cc0b2450 msgr2=0x7fd6cc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:19.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- 172.21.15.177:0/266241025 shutdown_connections 2023-10-25T16:19:19.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- 172.21.15.177:0/266241025 wait complete. 2023-10-25T16:19:19.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 Processor -- start 2023-10-25T16:19:19.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- start start 2023-10-25T16:19:19.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 0x7fd6cc0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc06f570 0x7fd6cc158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6cc140e90 0x7fd6cc0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc159500 con 0x7fd6cc06c090 2023-10-25T16:19:19.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc158650 con 0x7fd6cc140e90 2023-10-25T16:19:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d2895640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc1588f0 con 0x7fd6cc06f570 2023-10-25T16:19:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 0x7fd6cc0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 0x7fd6cc0ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42152/0 (socket says 172.21.15.177:42152) 2023-10-25T16:19:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 -- 172.21.15.177:0/3449832248 learned_addr learned my addr 172.21.15.177:0/3449832248 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:19.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d0e32640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6cc140e90 0x7fd6cc0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cb7fe640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc06f570 0x7fd6cc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 -- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc06f570 msgr2=0x7fd6cc158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc06f570 0x7fd6cc158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 -- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6cc140e90 msgr2=0x7fd6cc0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6cc140e90 0x7fd6cc0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 -- 172.21.15.177:0/3449832248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009820 con 0x7fd6cc06c090 2023-10-25T16:19:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cb7fe640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc06f570 0x7fd6cc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6d0e32640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6cc140e90 0x7fd6cc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6cbfff640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 0x7fd6cc0ae0b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc000f90 tx=0x7fd6bc0a5930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.048+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc003980 con 0x7fd6cc06c090 2023-10-25T16:19:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd6bc003bd0 con 0x7fd6cc06c090 2023-10-25T16:19:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc004030 con 0x7fd6cc06c090 2023-10-25T16:19:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc158bd0 con 0x7fd6cc06c090 2023-10-25T16:19:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc159190 con 0x7fd6cc06c090 2023-10-25T16:19:19.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc04daf0 con 0x7fd6cc06c090 2023-10-25T16:19:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd6bc0b4040 con 0x7fd6cc06c090 2023-10-25T16:19:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6c8ff9640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd6ac0664a0 0x7fd6ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6bc11ea40 con 0x7fd6cc06c090 2023-10-25T16:19:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6cb7fe640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd6ac0664a0 0x7fd6ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.052+0000 7fd6cb7fe640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd6ac0664a0 0x7fd6ac068960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc1f8050 tx=0x7fd6b4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:19.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.056+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6bc120e60 con 0x7fd6cc06c090 2023-10-25T16:19:19.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.252+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd6cc0ca670 con 0x7fd6cc06c090 2023-10-25T16:19:19.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.252+0000 7fd6c8ff9640 1 -- 172.21.15.177:0/3449832248 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1512 (secure 0 0 0) 0x7fd6bc0ec070 con 0x7fd6cc06c090 2023-10-25T16:19:19.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:19.252 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":390,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":52},{"state_name":"active+clean","count":45}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590402,"bytes_used":6803067,"bytes_avail":1593196933,"bytes_total":1600000000,"inactive_pgs_ratio":0.53608244657516479,"write_bytes_sec":1275,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7683}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-10-25T16:18:04.707414+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:19:19.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd6ac0664a0 msgr2=0x7fd6ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd6ac0664a0 0x7fd6ac068960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc1f8050 tx=0x7fd6b4009040 comp rx=0 tx=0).stop 2023-10-25T16:19:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 msgr2=0x7fd6cc0ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 0x7fd6cc0ae0b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc000f90 tx=0x7fd6bc0a5930 comp rx=0 tx=0).stop 2023-10-25T16:19:19.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 shutdown_connections 2023-10-25T16:19:19.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd6ac0664a0 0x7fd6ac068960 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6cc140e90 0x7fd6cc0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6cc06f570 0x7fd6cc158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 --2- 172.21.15.177:0/3449832248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6cc06c090 0x7fd6cc0ae0b0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 >> 172.21.15.177:0/3449832248 conn(0x7fd6cc0b2450 msgr2=0x7fd6cc0acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:19.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 shutdown_connections 2023-10-25T16:19:19.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.256+0000 7fd6d2895640 1 -- 172.21.15.177:0/3449832248 wait complete. 2023-10-25T16:19:19.271 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:19:19.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:19.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/1351768440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8500b11a0 msgr2=0x7fa8500c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 --2- 172.21.15.177:0/1351768440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8500b11a0 0x7fa8500c9630 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa840009840 tx=0x7fa84001c740 comp rx=0 tx=0).stop 2023-10-25T16:19:19.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/1351768440 shutdown_connections 2023-10-25T16:19:19.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 --2- 172.21.15.177:0/1351768440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa8500b11a0 0x7fa8500c9630 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/1351768440 >> 172.21.15.177:0/1351768440 conn(0x7fa8500cefe0 msgr2=0x7fa8500cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:19.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/1351768440 shutdown_connections 2023-10-25T16:19:19.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/1351768440 wait complete. 2023-10-25T16:19:19.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 Processor -- start 2023-10-25T16:19:19.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- start start 2023-10-25T16:19:19.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8500af0f0 0x7fa850147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8500b11a0 0x7fa8500c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 0x7fa850150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa850147cc0 con 0x7fa85015b6a0 2023-10-25T16:19:19.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85015c7f0 con 0x7fa8500af0f0 2023-10-25T16:19:19.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85015c4f0 con 0x7fa8500b11a0 2023-10-25T16:19:19.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 0x7fa850150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 0x7fa850150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:42176/0 (socket says 172.21.15.177:42176) 2023-10-25T16:19:19.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 -- 172.21.15.177:0/226872011 learned_addr learned my addr 172.21.15.177:0/226872011 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:19.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84f7fe640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8500b11a0 0x7fa8500c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84ffff640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8500af0f0 0x7fa850147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 -- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8500b11a0 msgr2=0x7fa8500c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8500b11a0 0x7fa8500c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 -- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8500af0f0 msgr2=0x7fa850147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8500af0f0 0x7fa850147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 -- 172.21.15.177:0/226872011 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400094a0 con 0x7fa85015b6a0 2023-10-25T16:19:19.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84ffff640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8500af0f0 0x7fa850147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:19.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84f7fe640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8500b11a0 0x7fa8500c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:19.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa854878640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 0x7fa850150d90 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa84800cbf0 tx=0x7fa84800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:19.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800aa50 con 0x7fa85015b6a0 2023-10-25T16:19:19.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa84800aca0 con 0x7fa85015b6a0 2023-10-25T16:19:19.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8500c47f0 con 0x7fa85015b6a0 2023-10-25T16:19:19.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848012680 con 0x7fa85015b6a0 2023-10-25T16:19:19.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.392+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8500c4db0 con 0x7fa85015b6a0 2023-10-25T16:19:19.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.396+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8500c4fa0 con 0x7fa85015b6a0 2023-10-25T16:19:19.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.396+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa84801b400 con 0x7fa85015b6a0 2023-10-25T16:19:19.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.396+0000 7fa84cff9640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa830066470 0x7fa830068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:19.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.396+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa848084610 con 0x7fa85015b6a0 2023-10-25T16:19:19.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.396+0000 7fa84ffff640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa830066470 0x7fa830068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:19.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.396+0000 7fa84ffff640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa830066470 0x7fa830068930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa8501f8460 tx=0x7fa838009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:19.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.400+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa848051b20 con 0x7fa85015b6a0 2023-10-25T16:19:19.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.544+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8500cebc0 con 0x7fa830066470 2023-10-25T16:19:19.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.564+0000 7fa84cff9640 1 -- 172.21.15.177:0/226872011 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279623 (secure 0 0 0) 0x7fa838001ca0 con 0x7fa830066470 2023-10-25T16:19:19.569 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:19.570 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:19.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa830066470 msgr2=0x7fa830068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa830066470 0x7fa830068930 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa8501f8460 tx=0x7fa838009040 comp rx=0 tx=0).stop 2023-10-25T16:19:19.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 msgr2=0x7fa850150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:19.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 0x7fa850150d90 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa84800cbf0 tx=0x7fa84800cce0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 shutdown_connections 2023-10-25T16:19:19.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa830066470 0x7fa830068930 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa85015b6a0 0x7fa850150d90 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa8500b11a0 0x7fa8500c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 --2- 172.21.15.177:0/226872011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8500af0f0 0x7fa850147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:19.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 >> 172.21.15.177:0/226872011 conn(0x7fa8500cefe0 msgr2=0x7fa850154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:19.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 shutdown_connections 2023-10-25T16:19:19.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:19.568+0000 7fa8562db640 1 -- 172.21.15.177:0/226872011 wait complete. 2023-10-25T16:19:19.585 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-25T16:19:18.737425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6643,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555856,"statfs":{"total":1600000000,"available":1593196933,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.620726"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143836+0000","last_change":"2023-10-25T16:19:14.143836+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143836+0000","last_undegraded":"2023-10-25T16:19:14.143836+0000","last_fullsized":"2023-10-25T16:19:14.143836+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136001+0000","last_change":"2023-10-25T16:19:14.136001+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136001+0000","last_undegraded":"2023-10-25T16:19:14.136001+0000","last_fullsized":"2023-10-25T16:19:14.136001+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136341+0000","last_change":"2023-10-25T16:19:14.136341+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136341+0000","last_undegraded":"2023-10-25T16:19:14.136341+0000","last_fullsized":"2023-10-25T16:19:14.136341+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134837+0000","last_change":"2023-10-25T16:19:14.134837+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134837+0000","last_undegraded":"2023-10-25T16:19:14.134837+0000","last_fullsized":"2023-10-25T16:19:14.134837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143456+0000","last_change":"2023-10-25T16:19:14.143456+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143456+0000","last_undegraded":"2023-10-25T16:19:14.143456+0000","last_fullsized":"2023-10-25T16:19:14.143456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144981+0000","last_change":"2023-10-25T16:19:14.144981+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144981+0000","last_undegraded":"2023-10-25T16:19:14.144981+0000","last_fullsized":"2023-10-25T16:19:14.144981+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142492+0000","last_change":"2023-10-25T16:19:14.142492+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142492+0000","last_undegraded":"2023-10-25T16:19:14.142492+0000","last_fullsized":"2023-10-25T16:19:14.142492+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137041+0000","last_change":"2023-10-25T16:19:14.137041+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137041+0000","last_undegraded":"2023-10-25T16:19:14.137041+0000","last_fullsized":"2023-10-25T16:19:14.137041+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137924+0000","last_change":"2023-10-25T16:19:14.137924+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137924+0000","last_undegraded":"2023-10-25T16:19:14.137924+0000","last_fullsized":"2023-10-25T16:19:14.137924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142709+0000","last_change":"2023-10-25T16:19:14.142709+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142709+0000","last_undegraded":"2023-10-25T16:19:14.142709+0000","last_fullsized":"2023-10-25T16:19:14.142709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.144213+0000","last_change":"2023-10-25T16:19:14.144213+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.144213+0000","last_undegraded":"2023-10-25T16:19:14.144213+0000","last_fullsized":"2023-10-25T16:19:14.144213+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136650+0000","last_change":"2023-10-25T16:19:14.136650+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136650+0000","last_undegraded":"2023-10-25T16:19:14.136650+0000","last_fullsized":"2023-10-25T16:19:14.136650+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135308+0000","last_change":"2023-10-25T16:19:14.135308+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135308+0000","last_undegraded":"2023-10-25T16:19:14.135308+0000","last_fullsized":"2023-10-25T16:19:14.135308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632268+0000","last_change":"2023-10-25T16:19:15.168716+0000","last_active":"2023-10-25T16:19:16.632268+0000","last_peered":"2023-10-25T16:19:16.632268+0000","last_clean":"2023-10-25T16:19:16.632268+0000","last_became_active":"2023-10-25T16:19:15.165847+0000","last_became_peered":"2023-10-25T16:19:15.165847+0000","last_unstale":"2023-10-25T16:19:16.632268+0000","last_undegraded":"2023-10-25T16:19:16.632268+0000","last_fullsized":"2023-10-25T16:19:16.632268+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:21:33.092448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138150+0000","last_change":"2023-10-25T16:19:14.138150+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138150+0000","last_undegraded":"2023-10-25T16:19:14.138150+0000","last_fullsized":"2023-10-25T16:19:14.138150+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143474+0000","last_change":"2023-10-25T16:19:14.143474+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143474+0000","last_undegraded":"2023-10-25T16:19:14.143474+0000","last_fullsized":"2023-10-25T16:19:14.143474+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135565+0000","last_change":"2023-10-25T16:19:14.135565+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135565+0000","last_undegraded":"2023-10-25T16:19:14.135565+0000","last_fullsized":"2023-10-25T16:19:14.135565+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134900+0000","last_change":"2023-10-25T16:19:14.134900+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134900+0000","last_undegraded":"2023-10-25T16:19:14.134900+0000","last_fullsized":"2023-10-25T16:19:14.134900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635326+0000","last_change":"2023-10-25T16:19:15.168471+0000","last_active":"2023-10-25T16:19:16.635326+0000","last_peered":"2023-10-25T16:19:16.635326+0000","last_clean":"2023-10-25T16:19:16.635326+0000","last_became_active":"2023-10-25T16:19:15.164987+0000","last_became_peered":"2023-10-25T16:19:15.164987+0000","last_unstale":"2023-10-25T16:19:16.635326+0000","last_undegraded":"2023-10-25T16:19:16.635326+0000","last_fullsized":"2023-10-25T16:19:16.635326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:48:23.980178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141186+0000","last_change":"2023-10-25T16:19:14.141186+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141186+0000","last_undegraded":"2023-10-25T16:19:14.141186+0000","last_fullsized":"2023-10-25T16:19:14.141186+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634615+0000","last_change":"2023-10-25T16:19:15.162774+0000","last_active":"2023-10-25T16:19:16.634615+0000","last_peered":"2023-10-25T16:19:16.634615+0000","last_clean":"2023-10-25T16:19:16.634615+0000","last_became_active":"2023-10-25T16:19:15.162139+0000","last_became_peered":"2023-10-25T16:19:15.162139+0000","last_unstale":"2023-10-25T16:19:16.634615+0000","last_undegraded":"2023-10-25T16:19:16.634615+0000","last_fullsized":"2023-10-25T16:19:16.634615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:24.330887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135113+0000","last_change":"2023-10-25T16:19:14.135113+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135113+0000","last_undegraded":"2023-10-25T16:19:14.135113+0000","last_fullsized":"2023-10-25T16:19:14.135113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136653+0000","last_change":"2023-10-25T16:19:14.136653+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136653+0000","last_undegraded":"2023-10-25T16:19:14.136653+0000","last_fullsized":"2023-10-25T16:19:14.136653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143590+0000","last_change":"2023-10-25T16:19:14.143590+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143590+0000","last_undegraded":"2023-10-25T16:19:14.143590+0000","last_fullsized":"2023-10-25T16:19:14.143590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141938+0000","last_change":"2023-10-25T16:19:14.141938+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141938+0000","last_undegraded":"2023-10-25T16:19:14.141938+0000","last_fullsized":"2023-10-25T16:19:14.141938+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136063+0000","last_change":"2023-10-25T16:19:14.136063+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136063+0000","last_undegraded":"2023-10-25T16:19:14.136063+0000","last_fullsized":"2023-10-25T16:19:14.136063+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141642+0000","last_change":"2023-10-25T16:19:14.141642+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141642+0000","last_undegraded":"2023-10-25T16:19:14.141642+0000","last_fullsized":"2023-10-25T16:19:14.141642+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.138195+0000","last_change":"2023-10-25T16:19:14.138195+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.138195+0000","last_undegraded":"2023-10-25T16:19:14.138195+0000","last_fullsized":"2023-10-25T16:19:14.138195+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134076+0000","last_change":"2023-10-25T16:19:14.134076+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134076+0000","last_undegraded":"2023-10-25T16:19:14.134076+0000","last_fullsized":"2023-10-25T16:19:14.134076+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635488+0000","last_change":"2023-10-25T16:19:15.166088+0000","last_active":"2023-10-25T16:19:16.635488+0000","last_peered":"2023-10-25T16:19:16.635488+0000","last_clean":"2023-10-25T16:19:16.635488+0000","last_became_active":"2023-10-25T16:19:15.164449+0000","last_became_peered":"2023-10-25T16:19:15.164449+0000","last_unstale":"2023-10-25T16:19:16.635488+0000","last_undegraded":"2023-10-25T16:19:16.635488+0000","last_fullsized":"2023-10-25T16:19:16.635488+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:28.304979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136619+0000","last_change":"2023-10-25T16:19:14.136619+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136619+0000","last_undegraded":"2023-10-25T16:19:14.136619+0000","last_fullsized":"2023-10-25T16:19:14.136619+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139591+0000","last_change":"2023-10-25T16:19:14.139591+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139591+0000","last_undegraded":"2023-10-25T16:19:14.139591+0000","last_fullsized":"2023-10-25T16:19:14.139591+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635504+0000","last_change":"2023-10-25T16:19:15.165446+0000","last_active":"2023-10-25T16:19:16.635504+0000","last_peered":"2023-10-25T16:19:16.635504+0000","last_clean":"2023-10-25T16:19:16.635504+0000","last_became_active":"2023-10-25T16:19:15.160950+0000","last_became_peered":"2023-10-25T16:19:15.160950+0000","last_unstale":"2023-10-25T16:19:16.635504+0000","last_undegraded":"2023-10-25T16:19:16.635504+0000","last_fullsized":"2023-10-25T16:19:16.635504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:07:56.725551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145052+0000","last_change":"2023-10-25T16:19:14.144947+0000","last_active":"2023-10-25T16:19:14.145052+0000","last_peered":"2023-10-25T16:19:14.145052+0000","last_clean":"2023-10-25T16:19:14.145052+0000","last_became_active":"2023-10-25T16:19:14.144069+0000","last_became_peered":"2023-10-25T16:19:14.144069+0000","last_unstale":"2023-10-25T16:19:14.145052+0000","last_undegraded":"2023-10-25T16:19:14.145052+0000","last_fullsized":"2023-10-25T16:19:14.145052+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134451+0000","last_change":"2023-10-25T16:19:14.134451+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134451+0000","last_undegraded":"2023-10-25T16:19:14.134451+0000","last_fullsized":"2023-10-25T16:19:14.134451+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155211+0000","last_change":"2023-10-25T16:19:14.154975+0000","last_active":"2023-10-25T16:19:14.155211+0000","last_peered":"2023-10-25T16:19:14.155211+0000","last_clean":"2023-10-25T16:19:14.155211+0000","last_became_active":"2023-10-25T16:19:14.153747+0000","last_became_peered":"2023-10-25T16:19:14.153747+0000","last_unstale":"2023-10-25T16:19:14.155211+0000","last_undegraded":"2023-10-25T16:19:14.155211+0000","last_fullsized":"2023-10-25T16:19:14.155211+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:27.952848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.143377+0000","last_change":"2023-10-25T16:19:14.143377+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.143377+0000","last_undegraded":"2023-10-25T16:19:14.143377+0000","last_fullsized":"2023-10-25T16:19:14.143377+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145180+0000","last_change":"2023-10-25T16:19:14.145066+0000","last_active":"2023-10-25T16:19:14.145180+0000","last_peered":"2023-10-25T16:19:14.145180+0000","last_clean":"2023-10-25T16:19:14.145180+0000","last_became_active":"2023-10-25T16:19:14.144640+0000","last_became_peered":"2023-10-25T16:19:14.144640+0000","last_unstale":"2023-10-25T16:19:14.145180+0000","last_undegraded":"2023-10-25T16:19:14.145180+0000","last_fullsized":"2023-10-25T16:19:14.145180+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136708+0000","last_change":"2023-10-25T16:19:14.136708+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136708+0000","last_undegraded":"2023-10-25T16:19:14.136708+0000","last_fullsized":"2023-10-25T16:19:14.136708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153495+0000","last_change":"2023-10-25T16:19:14.153400+0000","last_active":"2023-10-25T16:19:14.153495+0000","last_peered":"2023-10-25T16:19:14.153495+0000","last_clean":"2023-10-25T16:19:14.153495+0000","last_became_active":"2023-10-25T16:19:14.153175+0000","last_became_peered":"2023-10-25T16:19:14.153175+0000","last_unstale":"2023-10-25T16:19:14.153495+0000","last_undegraded":"2023-10-25T16:19:14.153495+0000","last_fullsized":"2023-10-25T16:19:14.153495+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139245+0000","last_change":"2023-10-25T16:19:14.139245+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139245+0000","last_undegraded":"2023-10-25T16:19:14.139245+0000","last_fullsized":"2023-10-25T16:19:14.139245+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145957+0000","last_change":"2023-10-25T16:19:14.145874+0000","last_active":"2023-10-25T16:19:14.145957+0000","last_peered":"2023-10-25T16:19:14.145957+0000","last_clean":"2023-10-25T16:19:14.145957+0000","last_became_active":"2023-10-25T16:19:14.145602+0000","last_became_peered":"2023-10-25T16:19:14.145602+0000","last_unstale":"2023-10-25T16:19:14.145957+0000","last_undegraded":"2023-10-25T16:19:14.145957+0000","last_fullsized":"2023-10-25T16:19:14.145957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:58:43.843147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.140694+0000","last_change":"2023-10-25T16:19:14.140694+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.140694+0000","last_undegraded":"2023-10-25T16:19:14.140694+0000","last_fullsized":"2023-10-25T16:19:14.140694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147302+0000","last_change":"2023-10-25T16:19:14.147250+0000","last_active":"2023-10-25T16:19:14.147302+0000","last_peered":"2023-10-25T16:19:14.147302+0000","last_clean":"2023-10-25T16:19:14.147302+0000","last_became_active":"2023-10-25T16:19:14.147036+0000","last_became_peered":"2023-10-25T16:19:14.147036+0000","last_unstale":"2023-10-25T16:19:14.147302+0000","last_undegraded":"2023-10-25T16:19:14.147302+0000","last_fullsized":"2023-10-25T16:19:14.147302+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133682+0000","last_change":"2023-10-25T16:19:14.133682+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133682+0000","last_undegraded":"2023-10-25T16:19:14.133682+0000","last_fullsized":"2023-10-25T16:19:14.133682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145524+0000","last_change":"2023-10-25T16:19:14.145346+0000","last_active":"2023-10-25T16:19:14.145524+0000","last_peered":"2023-10-25T16:19:14.145524+0000","last_clean":"2023-10-25T16:19:14.145524+0000","last_became_active":"2023-10-25T16:19:14.143452+0000","last_became_peered":"2023-10-25T16:19:14.143452+0000","last_unstale":"2023-10-25T16:19:14.145524+0000","last_undegraded":"2023-10-25T16:19:14.145524+0000","last_fullsized":"2023-10-25T16:19:14.145524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:11.865110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136516+0000","last_change":"2023-10-25T16:19:14.136516+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136516+0000","last_undegraded":"2023-10-25T16:19:14.136516+0000","last_fullsized":"2023-10-25T16:19:14.136516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.145000+0000","last_change":"2023-10-25T16:19:14.144655+0000","last_active":"2023-10-25T16:19:14.145000+0000","last_peered":"2023-10-25T16:19:14.145000+0000","last_clean":"2023-10-25T16:19:14.145000+0000","last_became_active":"2023-10-25T16:19:14.144338+0000","last_became_peered":"2023-10-25T16:19:14.144338+0000","last_unstale":"2023-10-25T16:19:14.145000+0000","last_undegraded":"2023-10-25T16:19:14.145000+0000","last_fullsized":"2023-10-25T16:19:14.145000+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:31:23.151127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134678+0000","last_change":"2023-10-25T16:19:14.134678+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134678+0000","last_undegraded":"2023-10-25T16:19:14.134678+0000","last_fullsized":"2023-10-25T16:19:14.134678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150868+0000","last_change":"2023-10-25T16:19:14.150828+0000","last_active":"2023-10-25T16:19:14.150868+0000","last_peered":"2023-10-25T16:19:14.150868+0000","last_clean":"2023-10-25T16:19:14.150868+0000","last_became_active":"2023-10-25T16:19:14.150521+0000","last_became_peered":"2023-10-25T16:19:14.150521+0000","last_unstale":"2023-10-25T16:19:14.150868+0000","last_undegraded":"2023-10-25T16:19:14.150868+0000","last_fullsized":"2023-10-25T16:19:14.150868+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:16:42.600065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136798+0000","last_change":"2023-10-25T16:19:14.136798+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136798+0000","last_undegraded":"2023-10-25T16:19:14.136798+0000","last_fullsized":"2023-10-25T16:19:14.136798+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.141446+0000","last_change":"2023-10-25T16:19:14.141102+0000","last_active":"2023-10-25T16:19:14.141446+0000","last_peered":"2023-10-25T16:19:14.141446+0000","last_clean":"2023-10-25T16:19:14.141446+0000","last_became_active":"2023-10-25T16:19:14.140878+0000","last_became_peered":"2023-10-25T16:19:14.140878+0000","last_unstale":"2023-10-25T16:19:14.141446+0000","last_undegraded":"2023-10-25T16:19:14.141446+0000","last_fullsized":"2023-10-25T16:19:14.141446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141971+0000","last_change":"2023-10-25T16:19:14.141971+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141971+0000","last_undegraded":"2023-10-25T16:19:14.141971+0000","last_fullsized":"2023-10-25T16:19:14.141971+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.156446+0000","last_change":"2023-10-25T16:19:14.156141+0000","last_active":"2023-10-25T16:19:14.156446+0000","last_peered":"2023-10-25T16:19:14.156446+0000","last_clean":"2023-10-25T16:19:14.156446+0000","last_became_active":"2023-10-25T16:19:14.155549+0000","last_became_peered":"2023-10-25T16:19:14.155549+0000","last_unstale":"2023-10-25T16:19:14.156446+0000","last_undegraded":"2023-10-25T16:19:14.156446+0000","last_fullsized":"2023-10-25T16:19:14.156446+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:55.013612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141621+0000","last_change":"2023-10-25T16:19:14.141621+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141621+0000","last_undegraded":"2023-10-25T16:19:14.141621+0000","last_fullsized":"2023-10-25T16:19:14.141621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154773+0000","last_change":"2023-10-25T16:19:14.154628+0000","last_active":"2023-10-25T16:19:14.154773+0000","last_peered":"2023-10-25T16:19:14.154773+0000","last_clean":"2023-10-25T16:19:14.154773+0000","last_became_active":"2023-10-25T16:19:14.153323+0000","last_became_peered":"2023-10-25T16:19:14.153323+0000","last_unstale":"2023-10-25T16:19:14.154773+0000","last_undegraded":"2023-10-25T16:19:14.154773+0000","last_fullsized":"2023-10-25T16:19:14.154773+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:55:01.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.133526+0000","last_change":"2023-10-25T16:19:14.133526+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.133526+0000","last_undegraded":"2023-10-25T16:19:14.133526+0000","last_fullsized":"2023-10-25T16:19:14.133526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"128'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635693+0000","last_change":"2023-10-25T16:19:14.156380+0000","last_active":"2023-10-25T16:19:16.635693+0000","last_peered":"2023-10-25T16:19:16.635693+0000","last_clean":"2023-10-25T16:19:16.635693+0000","last_became_active":"2023-10-25T16:19:14.156233+0000","last_became_peered":"2023-10-25T16:19:14.156233+0000","last_unstale":"2023-10-25T16:19:16.635693+0000","last_undegraded":"2023-10-25T16:19:16.635693+0000","last_fullsized":"2023-10-25T16:19:16.635693+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:35:50.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.137170+0000","last_change":"2023-10-25T16:19:14.137170+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.137170+0000","last_undegraded":"2023-10-25T16:19:14.137170+0000","last_fullsized":"2023-10-25T16:19:14.137170+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635148+0000","last_change":"2023-10-25T16:19:14.148704+0000","last_active":"2023-10-25T16:19:16.635148+0000","last_peered":"2023-10-25T16:19:16.635148+0000","last_clean":"2023-10-25T16:19:16.635148+0000","last_became_active":"2023-10-25T16:19:14.148550+0000","last_became_peered":"2023-10-25T16:19:14.148550+0000","last_unstale":"2023-10-25T16:19:16.635148+0000","last_undegraded":"2023-10-25T16:19:16.635148+0000","last_fullsized":"2023-10-25T16:19:16.635148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:03.206482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135843+0000","last_change":"2023-10-25T16:19:14.135843+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135843+0000","last_undegraded":"2023-10-25T16:19:14.135843+0000","last_fullsized":"2023-10-25T16:19:14.135843+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.158390+0000","last_change":"2023-10-25T16:19:14.158176+0000","last_active":"2023-10-25T16:19:14.158390+0000","last_peered":"2023-10-25T16:19:14.158390+0000","last_clean":"2023-10-25T16:19:14.158390+0000","last_became_active":"2023-10-25T16:19:14.157135+0000","last_became_peered":"2023-10-25T16:19:14.157135+0000","last_unstale":"2023-10-25T16:19:14.158390+0000","last_undegraded":"2023-10-25T16:19:14.158390+0000","last_fullsized":"2023-10-25T16:19:14.158390+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:39.362616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634295+0000","last_change":"2023-10-25T16:19:15.161990+0000","last_active":"2023-10-25T16:19:16.634295+0000","last_peered":"2023-10-25T16:19:16.634295+0000","last_clean":"2023-10-25T16:19:16.634295+0000","last_became_active":"2023-10-25T16:19:15.161462+0000","last_became_peered":"2023-10-25T16:19:15.161462+0000","last_unstale":"2023-10-25T16:19:16.634295+0000","last_undegraded":"2023-10-25T16:19:16.634295+0000","last_fullsized":"2023-10-25T16:19:16.634295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:38.301081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150981+0000","last_change":"2023-10-25T16:19:14.150925+0000","last_active":"2023-10-25T16:19:14.150981+0000","last_peered":"2023-10-25T16:19:14.150981+0000","last_clean":"2023-10-25T16:19:14.150981+0000","last_became_active":"2023-10-25T16:19:14.150509+0000","last_became_peered":"2023-10-25T16:19:14.150509+0000","last_unstale":"2023-10-25T16:19:14.150981+0000","last_undegraded":"2023-10-25T16:19:14.150981+0000","last_fullsized":"2023-10-25T16:19:14.150981+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:18.180629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141220+0000","last_change":"2023-10-25T16:19:14.141220+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141220+0000","last_undegraded":"2023-10-25T16:19:14.141220+0000","last_fullsized":"2023-10-25T16:19:14.141220+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.157146+0000","last_change":"2023-10-25T16:19:14.156944+0000","last_active":"2023-10-25T16:19:14.157146+0000","last_peered":"2023-10-25T16:19:14.157146+0000","last_clean":"2023-10-25T16:19:14.157146+0000","last_became_active":"2023-10-25T16:19:14.156080+0000","last_became_peered":"2023-10-25T16:19:14.156080+0000","last_unstale":"2023-10-25T16:19:14.157146+0000","last_undegraded":"2023-10-25T16:19:14.157146+0000","last_fullsized":"2023-10-25T16:19:14.157146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:54.206890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.141667+0000","last_change":"2023-10-25T16:19:14.141667+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.141667+0000","last_undegraded":"2023-10-25T16:19:14.141667+0000","last_fullsized":"2023-10-25T16:19:14.141667+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.148899+0000","last_change":"2023-10-25T16:19:14.148729+0000","last_active":"2023-10-25T16:19:14.148899+0000","last_peered":"2023-10-25T16:19:14.148899+0000","last_clean":"2023-10-25T16:19:14.148899+0000","last_became_active":"2023-10-25T16:19:14.148088+0000","last_became_peered":"2023-10-25T16:19:14.148088+0000","last_unstale":"2023-10-25T16:19:14.148899+0000","last_undegraded":"2023-10-25T16:19:14.148899+0000","last_fullsized":"2023-10-25T16:19:14.148899+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:52:20.145806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.142361+0000","last_change":"2023-10-25T16:19:14.142361+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.142361+0000","last_undegraded":"2023-10-25T16:19:14.142361+0000","last_fullsized":"2023-10-25T16:19:14.142361+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.155825+0000","last_change":"2023-10-25T16:19:14.155751+0000","last_active":"2023-10-25T16:19:14.155825+0000","last_peered":"2023-10-25T16:19:14.155825+0000","last_clean":"2023-10-25T16:19:14.155825+0000","last_became_active":"2023-10-25T16:19:14.155504+0000","last_became_peered":"2023-10-25T16:19:14.155504+0000","last_unstale":"2023-10-25T16:19:14.155825+0000","last_undegraded":"2023-10-25T16:19:14.155825+0000","last_fullsized":"2023-10-25T16:19:14.155825+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:13.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635678+0000","last_change":"2023-10-25T16:19:15.164082+0000","last_active":"2023-10-25T16:19:16.635678+0000","last_peered":"2023-10-25T16:19:16.635678+0000","last_clean":"2023-10-25T16:19:16.635678+0000","last_became_active":"2023-10-25T16:19:15.160195+0000","last_became_peered":"2023-10-25T16:19:15.160195+0000","last_unstale":"2023-10-25T16:19:16.635678+0000","last_undegraded":"2023-10-25T16:19:16.635678+0000","last_fullsized":"2023-10-25T16:19:16.635678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:53:34.418384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146639+0000","last_change":"2023-10-25T16:19:14.146477+0000","last_active":"2023-10-25T16:19:14.146639+0000","last_peered":"2023-10-25T16:19:14.146639+0000","last_clean":"2023-10-25T16:19:14.146639+0000","last_became_active":"2023-10-25T16:19:14.144690+0000","last_became_peered":"2023-10-25T16:19:14.144690+0000","last_unstale":"2023-10-25T16:19:14.146639+0000","last_undegraded":"2023-10-25T16:19:14.146639+0000","last_fullsized":"2023-10-25T16:19:14.146639+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:06:45.355521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635018+0000","last_change":"2023-10-25T16:19:15.171435+0000","last_active":"2023-10-25T16:19:16.635018+0000","last_peered":"2023-10-25T16:19:16.635018+0000","last_clean":"2023-10-25T16:19:16.635018+0000","last_became_active":"2023-10-25T16:19:15.171216+0000","last_became_peered":"2023-10-25T16:19:15.171216+0000","last_unstale":"2023-10-25T16:19:16.635018+0000","last_undegraded":"2023-10-25T16:19:16.635018+0000","last_fullsized":"2023-10-25T16:19:16.635018+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:31:34.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153652+0000","last_change":"2023-10-25T16:19:14.153459+0000","last_active":"2023-10-25T16:19:14.153652+0000","last_peered":"2023-10-25T16:19:14.153652+0000","last_clean":"2023-10-25T16:19:14.153652+0000","last_became_active":"2023-10-25T16:19:14.152828+0000","last_became_peered":"2023-10-25T16:19:14.152828+0000","last_unstale":"2023-10-25T16:19:14.153652+0000","last_undegraded":"2023-10-25T16:19:14.153652+0000","last_fullsized":"2023-10-25T16:19:14.153652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:52:53.897110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634935+0000","last_change":"2023-10-25T16:19:15.153350+0000","last_active":"2023-10-25T16:19:16.634935+0000","last_peered":"2023-10-25T16:19:16.634935+0000","last_clean":"2023-10-25T16:19:16.634935+0000","last_became_active":"2023-10-25T16:19:15.152653+0000","last_became_peered":"2023-10-25T16:19:15.152653+0000","last_unstale":"2023-10-25T16:19:16.634935+0000","last_undegraded":"2023-10-25T16:19:16.634935+0000","last_fullsized":"2023-10-25T16:19:16.634935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:44:42.152160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.144410+0000","last_change":"2023-10-25T16:19:14.144093+0000","last_active":"2023-10-25T16:19:14.144410+0000","last_peered":"2023-10-25T16:19:14.144410+0000","last_clean":"2023-10-25T16:19:14.144410+0000","last_became_active":"2023-10-25T16:19:14.143541+0000","last_became_peered":"2023-10-25T16:19:14.143541+0000","last_unstale":"2023-10-25T16:19:14.144410+0000","last_undegraded":"2023-10-25T16:19:14.144410+0000","last_fullsized":"2023-10-25T16:19:14.144410+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:52.045235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134221+0000","last_change":"2023-10-25T16:19:14.134221+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134221+0000","last_undegraded":"2023-10-25T16:19:14.134221+0000","last_fullsized":"2023-10-25T16:19:14.134221+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.147784+0000","last_change":"2023-10-25T16:19:14.147714+0000","last_active":"2023-10-25T16:19:14.147784+0000","last_peered":"2023-10-25T16:19:14.147784+0000","last_clean":"2023-10-25T16:19:14.147784+0000","last_became_active":"2023-10-25T16:19:14.147202+0000","last_became_peered":"2023-10-25T16:19:14.147202+0000","last_unstale":"2023-10-25T16:19:14.147784+0000","last_undegraded":"2023-10-25T16:19:14.147784+0000","last_fullsized":"2023-10-25T16:19:14.147784+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:30.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135496+0000","last_change":"2023-10-25T16:19:14.135496+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135496+0000","last_undegraded":"2023-10-25T16:19:14.135496+0000","last_fullsized":"2023-10-25T16:19:14.135496+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.159273+0000","last_change":"2023-10-25T16:19:14.159133+0000","last_active":"2023-10-25T16:19:14.159273+0000","last_peered":"2023-10-25T16:19:14.159273+0000","last_clean":"2023-10-25T16:19:14.159273+0000","last_became_active":"2023-10-25T16:19:14.158596+0000","last_became_peered":"2023-10-25T16:19:14.158596+0000","last_unstale":"2023-10-25T16:19:14.159273+0000","last_undegraded":"2023-10-25T16:19:14.159273+0000","last_fullsized":"2023-10-25T16:19:14.159273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:35:24.246693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.139072+0000","last_change":"2023-10-25T16:19:14.139072+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.139072+0000","last_undegraded":"2023-10-25T16:19:14.139072+0000","last_fullsized":"2023-10-25T16:19:14.139072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146621+0000","last_change":"2023-10-25T16:19:14.145106+0000","last_active":"2023-10-25T16:19:14.146621+0000","last_peered":"2023-10-25T16:19:14.146621+0000","last_clean":"2023-10-25T16:19:14.146621+0000","last_became_active":"2023-10-25T16:19:14.144380+0000","last_became_peered":"2023-10-25T16:19:14.144380+0000","last_unstale":"2023-10-25T16:19:14.146621+0000","last_undegraded":"2023-10-25T16:19:14.146621+0000","last_fullsized":"2023-10-25T16:19:14.146621+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:06.413087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.136598+0000","last_change":"2023-10-25T16:19:14.136598+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.136598+0000","last_undegraded":"2023-10-25T16:19:14.136598+0000","last_fullsized":"2023-10-25T16:19:14.136598+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.153818+0000","last_change":"2023-10-25T16:19:14.153739+0000","last_active":"2023-10-25T16:19:14.153818+0000","last_peered":"2023-10-25T16:19:14.153818+0000","last_clean":"2023-10-25T16:19:14.153818+0000","last_became_active":"2023-10-25T16:19:14.153488+0000","last_became_peered":"2023-10-25T16:19:14.153488+0000","last_unstale":"2023-10-25T16:19:14.153818+0000","last_undegraded":"2023-10-25T16:19:14.153818+0000","last_fullsized":"2023-10-25T16:19:14.153818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:02.709932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134522+0000","last_change":"2023-10-25T16:19:14.134522+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134522+0000","last_undegraded":"2023-10-25T16:19:14.134522+0000","last_fullsized":"2023-10-25T16:19:14.134522+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.151530+0000","last_change":"2023-10-25T16:19:14.151321+0000","last_active":"2023-10-25T16:19:14.151530+0000","last_peered":"2023-10-25T16:19:14.151530+0000","last_clean":"2023-10-25T16:19:14.151530+0000","last_became_active":"2023-10-25T16:19:14.150384+0000","last_became_peered":"2023-10-25T16:19:14.150384+0000","last_unstale":"2023-10-25T16:19:14.151530+0000","last_undegraded":"2023-10-25T16:19:14.151530+0000","last_fullsized":"2023-10-25T16:19:14.151530+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:39:27.242739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634617+0000","last_change":"2023-10-25T16:19:15.161843+0000","last_active":"2023-10-25T16:19:16.634617+0000","last_peered":"2023-10-25T16:19:16.634617+0000","last_clean":"2023-10-25T16:19:16.634617+0000","last_became_active":"2023-10-25T16:19:15.161148+0000","last_became_peered":"2023-10-25T16:19:15.161148+0000","last_unstale":"2023-10-25T16:19:16.634617+0000","last_undegraded":"2023-10-25T16:19:16.634617+0000","last_fullsized":"2023-10-25T16:19:16.634617+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:02:12.533890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.140976+0000","last_change":"2023-10-25T16:19:14.140911+0000","last_active":"2023-10-25T16:19:14.140976+0000","last_peered":"2023-10-25T16:19:14.140976+0000","last_clean":"2023-10-25T16:19:14.140976+0000","last_became_active":"2023-10-25T16:19:14.140640+0000","last_became_peered":"2023-10-25T16:19:14.140640+0000","last_unstale":"2023-10-25T16:19:14.140976+0000","last_undegraded":"2023-10-25T16:19:14.140976+0000","last_fullsized":"2023-10-25T16:19:14.140976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:14.936794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.135822+0000","last_change":"2023-10-25T16:19:14.135822+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.135822+0000","last_undegraded":"2023-10-25T16:19:14.135822+0000","last_fullsized":"2023-10-25T16:19:14.135822+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.154966+0000","last_change":"2023-10-25T16:19:14.154725+0000","last_active":"2023-10-25T16:19:14.154966+0000","last_peered":"2023-10-25T16:19:14.154966+0000","last_clean":"2023-10-25T16:19:14.154966+0000","last_became_active":"2023-10-25T16:19:14.152704+0000","last_became_peered":"2023-10-25T16:19:14.152704+0000","last_unstale":"2023-10-25T16:19:14.154966+0000","last_undegraded":"2023-10-25T16:19:14.154966+0000","last_fullsized":"2023-10-25T16:19:14.154966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:53.073111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635841+0000","last_change":"2023-10-25T16:19:15.166303+0000","last_active":"2023-10-25T16:19:16.635841+0000","last_peered":"2023-10-25T16:19:16.635841+0000","last_clean":"2023-10-25T16:19:16.635841+0000","last_became_active":"2023-10-25T16:19:15.163694+0000","last_became_peered":"2023-10-25T16:19:15.163694+0000","last_unstale":"2023-10-25T16:19:16.635841+0000","last_undegraded":"2023-10-25T16:19:16.635841+0000","last_fullsized":"2023-10-25T16:19:16.635841+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:57.824680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.146034+0000","last_change":"2023-10-25T16:19:14.145472+0000","last_active":"2023-10-25T16:19:14.146034+0000","last_peered":"2023-10-25T16:19:14.146034+0000","last_clean":"2023-10-25T16:19:14.146034+0000","last_became_active":"2023-10-25T16:19:14.145146+0000","last_became_peered":"2023-10-25T16:19:14.145146+0000","last_unstale":"2023-10-25T16:19:14.146034+0000","last_undegraded":"2023-10-25T16:19:14.146034+0000","last_fullsized":"2023-10-25T16:19:14.146034+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-10-25T16:19:14.134053+0000","last_change":"2023-10-25T16:19:14.134053+0000","last_active":"2023-10-25T16:19:14.114202+0000","last_peered":"2023-10-25T16:19:14.114202+0000","last_clean":"2023-10-25T16:19:14.114202+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:14.134053+0000","last_undegraded":"2023-10-25T16:19:14.134053+0000","last_fullsized":"2023-10-25T16:19:14.134053+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635951+0000","last_change":"2023-10-25T16:19:14.140357+0000","last_active":"2023-10-25T16:19:16.635951+0000","last_peered":"2023-10-25T16:19:16.635951+0000","last_clean":"2023-10-25T16:19:16.635951+0000","last_became_active":"2023-10-25T16:19:14.140115+0000","last_became_peered":"2023-10-25T16:19:14.140115+0000","last_unstale":"2023-10-25T16:19:16.635951+0000","last_undegraded":"2023-10-25T16:19:16.635951+0000","last_fullsized":"2023-10-25T16:19:16.635951+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:57.962504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635308+0000","last_change":"2023-10-25T16:19:15.159472+0000","last_active":"2023-10-25T16:19:16.635308+0000","last_peered":"2023-10-25T16:19:16.635308+0000","last_clean":"2023-10-25T16:19:16.635308+0000","last_became_active":"2023-10-25T16:19:15.158856+0000","last_became_peered":"2023-10-25T16:19:15.158856+0000","last_unstale":"2023-10-25T16:19:16.635308+0000","last_undegraded":"2023-10-25T16:19:16.635308+0000","last_fullsized":"2023-10-25T16:19:16.635308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:29:38.107837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-10-25T16:19:14.150325+0000","last_change":"2023-10-25T16:19:14.150096+0000","last_active":"2023-10-25T16:19:14.150325+0000","last_peered":"2023-10-25T16:19:14.150325+0000","last_clean":"2023-10-25T16:19:14.150325+0000","last_became_active":"2023-10-25T16:19:14.149275+0000","last_became_peered":"2023-10-25T16:19:14.149275+0000","last_unstale":"2023-10-25T16:19:14.150325+0000","last_undegraded":"2023-10-25T16:19:14.150325+0000","last_fullsized":"2023-10-25T16:19:14.150325+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:34.327709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":268,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-10-25T16:19:13.116826+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:13.116826+0000","last_peered":"2023-10-25T16:19:13.116826+0000","last_clean":"2023-10-25T16:19:13.116826+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:13.116826+0000","last_undegraded":"2023-10-25T16:19:13.116826+0000","last_fullsized":"2023-10-25T16:19:13.116826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542223,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289682,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.0660000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.66500000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.878}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":0.92500000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.0069999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.90700000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":1.0389999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0960000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.98299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.268}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.84299999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":0.76200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.0389999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":1.3500000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.131},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.85599999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":0.76700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":1.032},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.0089999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.0760000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":1.05},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86599999999999999,"15min":0.83399999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.046,"5min":1.419,"15min":1.419},"last":1.159},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.91000000000000003,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.103},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.218}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.3029999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.367},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3360000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.78900000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.143}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":1.3109999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.2150000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.111},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":1.077}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":680,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194631,"statfs":{"total":200000000,"available":199302766,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.54200000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.5},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.48299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":0.76200000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.70199999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":0.79900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1263,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194048,"statfs":{"total":200000000,"available":198706123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":0.75},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":0.92400000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":1.056}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":1.02}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":1.167},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":0.872}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":1.0920000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":1.266}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:20.099 INFO:tasks.ceph.mds.c.smithi177.stderr:2023-10-25T16:19:20.100+0000 7f5895d24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:19:22.592 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:22.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- 172.21.15.177:0/3886686447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 msgr2=0x7f507815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:22.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- 172.21.15.177:0/3886686447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815c370 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f50780cba50 tx=0x7f507401c750 comp rx=0 tx=0).stop 2023-10-25T16:19:22.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- 172.21.15.177:0/3886686447 shutdown_connections 2023-10-25T16:19:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- 172.21.15.177:0/3886686447 >> v2:172.21.15.184:3300/0 conn(0x7f50780c9910 0x7f507806bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- 172.21.15.177:0/3886686447 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50780cb5f0 0x7f507806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- 172.21.15.177:0/3886686447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815c370 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- 172.21.15.177:0/3886686447 >> 172.21.15.177:0/3886686447 conn(0x7f50780b2450 msgr2=0x7f50780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:22.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- 172.21.15.177:0/3886686447 shutdown_connections 2023-10-25T16:19:22.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- 172.21.15.177:0/3886686447 wait complete. 2023-10-25T16:19:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 Processor -- start 2023-10-25T16:19:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- start start 2023-10-25T16:19:22.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50780c9910 0x7f507814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50780cb5f0 0x7f507815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507815a170 con 0x7f507815b480 2023-10-25T16:19:22.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507814a830 con 0x7f50780cb5f0 2023-10-25T16:19:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f508057a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507815a600 con 0x7f50780c9910 2023-10-25T16:19:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38410/0 (socket says 172.21.15.177:38410) 2023-10-25T16:19:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 -- 172.21.15.177:0/2172526223 learned_addr learned my addr 172.21.15.177:0/2172526223 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:22.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507e316640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50780c9910 0x7f507814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:22.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507db15640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50780cb5f0 0x7f507815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:22.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 -- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50780c9910 msgr2=0x7f507814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:22.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50780c9910 0x7f507814a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 -- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50780cb5f0 msgr2=0x7f507815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50780cb5f0 0x7f507815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 -- 172.21.15.177:0/2172526223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074009560 con 0x7f507815b480 2023-10-25T16:19:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f507eb17640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815e130 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f507000ca60 tx=0x7f507000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507000adc0 con 0x7f507815b480 2023-10-25T16:19:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.728+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5070004c40 con 0x7f507815b480 2023-10-25T16:19:22.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078159560 con 0x7f507815b480 2023-10-25T16:19:22.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070005280 con 0x7f507815b480 2023-10-25T16:19:22.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5078159b20 con 0x7f507815b480 2023-10-25T16:19:22.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507815a2e0 con 0x7f507815b480 2023-10-25T16:19:22.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f50700053e0 con 0x7f507815b480 2023-10-25T16:19:22.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f506effd640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f505c066470 0x7f505c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:22.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5070084660 con 0x7f507815b480 2023-10-25T16:19:22.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f507e316640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f505c066470 0x7f505c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:22.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.732+0000 7f507e316640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f505c066470 0x7f505c068930 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f50740af000 tx=0x7f507401af90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:22.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.736+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5070051b90 con 0x7f507815b480 2023-10-25T16:19:22.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.892+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50780aebc0 con 0x7f505c066470 2023-10-25T16:19:22.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.912+0000 7f506effd640 1 -- 172.21.15.177:0/2172526223 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283932 (secure 0 0 0) 0x7f50740a6c20 con 0x7f505c066470 2023-10-25T16:19:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:22.916 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:22.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f505c066470 msgr2=0x7f505c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:22.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f505c066470 0x7f505c068930 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f50740af000 tx=0x7f507401af90 comp rx=0 tx=0).stop 2023-10-25T16:19:22.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 msgr2=0x7f507815e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:22.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815e130 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f507000ca60 tx=0x7f507000cf20 comp rx=0 tx=0).stop 2023-10-25T16:19:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 shutdown_connections 2023-10-25T16:19:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f505c066470 0x7f505c068930 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f507815b480 0x7f507815e130 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50780cb5f0 0x7f507815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 --2- 172.21.15.177:0/2172526223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f50780c9910 0x7f507814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 >> 172.21.15.177:0/2172526223 conn(0x7f50780b2450 msgr2=0x7f50780b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 shutdown_connections 2023-10-25T16:19:22.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:22.916+0000 7f508057a640 1 -- 172.21.15.177:0/2172526223 wait complete. 2023-10-25T16:19:22.933 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2023-10-25T16:19:22.739041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6756,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555743,"statfs":{"total":1600000000,"available":1593081772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002791"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633530+0000","last_change":"2023-10-25T16:19:15.165898+0000","last_active":"2023-10-25T16:19:16.633530+0000","last_peered":"2023-10-25T16:19:16.633530+0000","last_clean":"2023-10-25T16:19:16.633530+0000","last_became_active":"2023-10-25T16:19:15.165535+0000","last_became_peered":"2023-10-25T16:19:15.165535+0000","last_unstale":"2023-10-25T16:19:16.633530+0000","last_undegraded":"2023-10-25T16:19:16.633530+0000","last_fullsized":"2023-10-25T16:19:16.633530+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:40:41.445439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632529+0000","last_change":"2023-10-25T16:19:15.167441+0000","last_active":"2023-10-25T16:19:16.632529+0000","last_peered":"2023-10-25T16:19:16.632529+0000","last_clean":"2023-10-25T16:19:16.632529+0000","last_became_active":"2023-10-25T16:19:15.166715+0000","last_became_peered":"2023-10-25T16:19:15.166715+0000","last_unstale":"2023-10-25T16:19:16.632529+0000","last_undegraded":"2023-10-25T16:19:16.632529+0000","last_fullsized":"2023-10-25T16:19:16.632529+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:31.408875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632612+0000","last_change":"2023-10-25T16:19:15.166381+0000","last_active":"2023-10-25T16:19:16.632612+0000","last_peered":"2023-10-25T16:19:16.632612+0000","last_clean":"2023-10-25T16:19:16.632612+0000","last_became_active":"2023-10-25T16:19:15.166089+0000","last_became_peered":"2023-10-25T16:19:15.166089+0000","last_unstale":"2023-10-25T16:19:16.632612+0000","last_undegraded":"2023-10-25T16:19:16.632612+0000","last_fullsized":"2023-10-25T16:19:16.632612+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:05:11.113023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.134767+0000","last_change":"2023-10-25T16:19:15.163308+0000","last_active":"2023-10-25T16:19:16.134767+0000","last_peered":"2023-10-25T16:19:16.134767+0000","last_clean":"2023-10-25T16:19:16.134767+0000","last_became_active":"2023-10-25T16:19:15.163061+0000","last_became_peered":"2023-10-25T16:19:15.163061+0000","last_unstale":"2023-10-25T16:19:16.134767+0000","last_undegraded":"2023-10-25T16:19:16.134767+0000","last_fullsized":"2023-10-25T16:19:16.134767+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:57.331777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137517+0000","last_change":"2023-10-25T16:19:15.180545+0000","last_active":"2023-10-25T16:19:16.137517+0000","last_peered":"2023-10-25T16:19:16.137517+0000","last_clean":"2023-10-25T16:19:16.137517+0000","last_became_active":"2023-10-25T16:19:15.162706+0000","last_became_peered":"2023-10-25T16:19:15.162706+0000","last_unstale":"2023-10-25T16:19:16.137517+0000","last_undegraded":"2023-10-25T16:19:16.137517+0000","last_fullsized":"2023-10-25T16:19:16.137517+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:58:14.964782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634782+0000","last_change":"2023-10-25T16:19:15.169849+0000","last_active":"2023-10-25T16:19:16.634782+0000","last_peered":"2023-10-25T16:19:16.634782+0000","last_clean":"2023-10-25T16:19:16.634782+0000","last_became_active":"2023-10-25T16:19:15.163536+0000","last_became_peered":"2023-10-25T16:19:15.163536+0000","last_unstale":"2023-10-25T16:19:16.634782+0000","last_undegraded":"2023-10-25T16:19:16.634782+0000","last_fullsized":"2023-10-25T16:19:16.634782+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:59:29.574883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632340+0000","last_change":"2023-10-25T16:19:15.162230+0000","last_active":"2023-10-25T16:19:16.632340+0000","last_peered":"2023-10-25T16:19:16.632340+0000","last_clean":"2023-10-25T16:19:16.632340+0000","last_became_active":"2023-10-25T16:19:15.161430+0000","last_became_peered":"2023-10-25T16:19:15.161430+0000","last_unstale":"2023-10-25T16:19:16.632340+0000","last_undegraded":"2023-10-25T16:19:16.632340+0000","last_fullsized":"2023-10-25T16:19:16.632340+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:59:45.504301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632661+0000","last_change":"2023-10-25T16:19:15.167613+0000","last_active":"2023-10-25T16:19:16.632661+0000","last_peered":"2023-10-25T16:19:16.632661+0000","last_clean":"2023-10-25T16:19:16.632661+0000","last_became_active":"2023-10-25T16:19:15.162486+0000","last_became_peered":"2023-10-25T16:19:15.162486+0000","last_unstale":"2023-10-25T16:19:16.632661+0000","last_undegraded":"2023-10-25T16:19:16.632661+0000","last_fullsized":"2023-10-25T16:19:16.632661+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:29:42.720910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633206+0000","last_change":"2023-10-25T16:19:15.150696+0000","last_active":"2023-10-25T16:19:16.633206+0000","last_peered":"2023-10-25T16:19:16.633206+0000","last_clean":"2023-10-25T16:19:16.633206+0000","last_became_active":"2023-10-25T16:19:15.150051+0000","last_became_peered":"2023-10-25T16:19:15.150051+0000","last_unstale":"2023-10-25T16:19:16.633206+0000","last_undegraded":"2023-10-25T16:19:16.633206+0000","last_fullsized":"2023-10-25T16:19:16.633206+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:47:35.339110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137768+0000","last_change":"2023-10-25T16:19:15.182443+0000","last_active":"2023-10-25T16:19:16.137768+0000","last_peered":"2023-10-25T16:19:16.137768+0000","last_clean":"2023-10-25T16:19:16.137768+0000","last_became_active":"2023-10-25T16:19:15.179344+0000","last_became_peered":"2023-10-25T16:19:15.179344+0000","last_unstale":"2023-10-25T16:19:16.137768+0000","last_undegraded":"2023-10-25T16:19:16.137768+0000","last_fullsized":"2023-10-25T16:19:16.137768+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:44:43.471932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635101+0000","last_change":"2023-10-25T16:19:15.150855+0000","last_active":"2023-10-25T16:19:16.635101+0000","last_peered":"2023-10-25T16:19:16.635101+0000","last_clean":"2023-10-25T16:19:16.635101+0000","last_became_active":"2023-10-25T16:19:15.150181+0000","last_became_peered":"2023-10-25T16:19:15.150181+0000","last_unstale":"2023-10-25T16:19:16.635101+0000","last_undegraded":"2023-10-25T16:19:16.635101+0000","last_fullsized":"2023-10-25T16:19:16.635101+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:30:53.113779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634121+0000","last_change":"2023-10-25T16:19:15.158755+0000","last_active":"2023-10-25T16:19:16.634121+0000","last_peered":"2023-10-25T16:19:16.634121+0000","last_clean":"2023-10-25T16:19:16.634121+0000","last_became_active":"2023-10-25T16:19:15.153658+0000","last_became_peered":"2023-10-25T16:19:15.153658+0000","last_unstale":"2023-10-25T16:19:16.634121+0000","last_undegraded":"2023-10-25T16:19:16.634121+0000","last_fullsized":"2023-10-25T16:19:16.634121+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:29.963169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.134280+0000","last_change":"2023-10-25T16:19:15.147623+0000","last_active":"2023-10-25T16:19:16.134280+0000","last_peered":"2023-10-25T16:19:16.134280+0000","last_clean":"2023-10-25T16:19:16.134280+0000","last_became_active":"2023-10-25T16:19:15.146983+0000","last_became_peered":"2023-10-25T16:19:15.146983+0000","last_unstale":"2023-10-25T16:19:16.134280+0000","last_undegraded":"2023-10-25T16:19:16.134280+0000","last_fullsized":"2023-10-25T16:19:16.134280+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:39:28.254140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632268+0000","last_change":"2023-10-25T16:19:15.168716+0000","last_active":"2023-10-25T16:19:16.632268+0000","last_peered":"2023-10-25T16:19:16.632268+0000","last_clean":"2023-10-25T16:19:16.632268+0000","last_became_active":"2023-10-25T16:19:15.165847+0000","last_became_peered":"2023-10-25T16:19:15.165847+0000","last_unstale":"2023-10-25T16:19:16.632268+0000","last_undegraded":"2023-10-25T16:19:16.632268+0000","last_fullsized":"2023-10-25T16:19:16.632268+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:21:33.092448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.135519+0000","last_change":"2023-10-25T16:19:15.142936+0000","last_active":"2023-10-25T16:19:16.135519+0000","last_peered":"2023-10-25T16:19:16.135519+0000","last_clean":"2023-10-25T16:19:16.135519+0000","last_became_active":"2023-10-25T16:19:15.141869+0000","last_became_peered":"2023-10-25T16:19:15.141869+0000","last_unstale":"2023-10-25T16:19:16.135519+0000","last_undegraded":"2023-10-25T16:19:16.135519+0000","last_fullsized":"2023-10-25T16:19:16.135519+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:38:18.307418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635407+0000","last_change":"2023-10-25T16:19:15.176207+0000","last_active":"2023-10-25T16:19:16.635407+0000","last_peered":"2023-10-25T16:19:16.635407+0000","last_clean":"2023-10-25T16:19:16.635407+0000","last_became_active":"2023-10-25T16:19:15.164655+0000","last_became_peered":"2023-10-25T16:19:15.164655+0000","last_unstale":"2023-10-25T16:19:16.635407+0000","last_undegraded":"2023-10-25T16:19:16.635407+0000","last_fullsized":"2023-10-25T16:19:16.635407+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:57.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632874+0000","last_change":"2023-10-25T16:19:15.149047+0000","last_active":"2023-10-25T16:19:16.632874+0000","last_peered":"2023-10-25T16:19:16.632874+0000","last_clean":"2023-10-25T16:19:16.632874+0000","last_became_active":"2023-10-25T16:19:15.148411+0000","last_became_peered":"2023-10-25T16:19:15.148411+0000","last_unstale":"2023-10-25T16:19:16.632874+0000","last_undegraded":"2023-10-25T16:19:16.632874+0000","last_fullsized":"2023-10-25T16:19:16.632874+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:58:14.964782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.134604+0000","last_change":"2023-10-25T16:19:15.160186+0000","last_active":"2023-10-25T16:19:16.134604+0000","last_peered":"2023-10-25T16:19:16.134604+0000","last_clean":"2023-10-25T16:19:16.134604+0000","last_became_active":"2023-10-25T16:19:15.159360+0000","last_became_peered":"2023-10-25T16:19:15.159360+0000","last_unstale":"2023-10-25T16:19:16.134604+0000","last_undegraded":"2023-10-25T16:19:16.134604+0000","last_fullsized":"2023-10-25T16:19:16.134604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:35:02.268982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635326+0000","last_change":"2023-10-25T16:19:15.168471+0000","last_active":"2023-10-25T16:19:16.635326+0000","last_peered":"2023-10-25T16:19:16.635326+0000","last_clean":"2023-10-25T16:19:16.635326+0000","last_became_active":"2023-10-25T16:19:15.164987+0000","last_became_peered":"2023-10-25T16:19:15.164987+0000","last_unstale":"2023-10-25T16:19:16.635326+0000","last_undegraded":"2023-10-25T16:19:16.635326+0000","last_fullsized":"2023-10-25T16:19:16.635326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:48:23.980178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632963+0000","last_change":"2023-10-25T16:19:15.152420+0000","last_active":"2023-10-25T16:19:16.632963+0000","last_peered":"2023-10-25T16:19:16.632963+0000","last_clean":"2023-10-25T16:19:16.632963+0000","last_became_active":"2023-10-25T16:19:15.151694+0000","last_became_peered":"2023-10-25T16:19:15.151694+0000","last_unstale":"2023-10-25T16:19:16.632963+0000","last_undegraded":"2023-10-25T16:19:16.632963+0000","last_fullsized":"2023-10-25T16:19:16.632963+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:17:28.964249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634615+0000","last_change":"2023-10-25T16:19:15.162774+0000","last_active":"2023-10-25T16:19:16.634615+0000","last_peered":"2023-10-25T16:19:16.634615+0000","last_clean":"2023-10-25T16:19:16.634615+0000","last_became_active":"2023-10-25T16:19:15.162139+0000","last_became_peered":"2023-10-25T16:19:15.162139+0000","last_unstale":"2023-10-25T16:19:16.634615+0000","last_undegraded":"2023-10-25T16:19:16.634615+0000","last_fullsized":"2023-10-25T16:19:16.634615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:24.330887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633705+0000","last_change":"2023-10-25T16:19:15.167687+0000","last_active":"2023-10-25T16:19:16.633705+0000","last_peered":"2023-10-25T16:19:16.633705+0000","last_clean":"2023-10-25T16:19:16.633705+0000","last_became_active":"2023-10-25T16:19:15.167166+0000","last_became_peered":"2023-10-25T16:19:15.167166+0000","last_unstale":"2023-10-25T16:19:16.633705+0000","last_undegraded":"2023-10-25T16:19:16.633705+0000","last_fullsized":"2023-10-25T16:19:16.633705+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:42:58.321979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632985+0000","last_change":"2023-10-25T16:19:15.169884+0000","last_active":"2023-10-25T16:19:16.632985+0000","last_peered":"2023-10-25T16:19:16.632985+0000","last_clean":"2023-10-25T16:19:16.632985+0000","last_became_active":"2023-10-25T16:19:15.169520+0000","last_became_peered":"2023-10-25T16:19:15.169520+0000","last_unstale":"2023-10-25T16:19:16.632985+0000","last_undegraded":"2023-10-25T16:19:16.632985+0000","last_fullsized":"2023-10-25T16:19:16.632985+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:00:24.719181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632415+0000","last_change":"2023-10-25T16:19:15.151244+0000","last_active":"2023-10-25T16:19:16.632415+0000","last_peered":"2023-10-25T16:19:16.632415+0000","last_clean":"2023-10-25T16:19:16.632415+0000","last_became_active":"2023-10-25T16:19:15.150584+0000","last_became_peered":"2023-10-25T16:19:15.150584+0000","last_unstale":"2023-10-25T16:19:16.632415+0000","last_undegraded":"2023-10-25T16:19:16.632415+0000","last_fullsized":"2023-10-25T16:19:16.632415+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:29:11.059711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137964+0000","last_change":"2023-10-25T16:19:15.182054+0000","last_active":"2023-10-25T16:19:16.137964+0000","last_peered":"2023-10-25T16:19:16.137964+0000","last_clean":"2023-10-25T16:19:16.137964+0000","last_became_active":"2023-10-25T16:19:15.168202+0000","last_became_peered":"2023-10-25T16:19:15.168202+0000","last_unstale":"2023-10-25T16:19:16.137964+0000","last_undegraded":"2023-10-25T16:19:16.137964+0000","last_fullsized":"2023-10-25T16:19:16.137964+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:56.971880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633422+0000","last_change":"2023-10-25T16:19:15.159363+0000","last_active":"2023-10-25T16:19:16.633422+0000","last_peered":"2023-10-25T16:19:16.633422+0000","last_clean":"2023-10-25T16:19:16.633422+0000","last_became_active":"2023-10-25T16:19:15.159065+0000","last_became_peered":"2023-10-25T16:19:15.159065+0000","last_unstale":"2023-10-25T16:19:16.633422+0000","last_undegraded":"2023-10-25T16:19:16.633422+0000","last_fullsized":"2023-10-25T16:19:16.633422+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:56.971880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632708+0000","last_change":"2023-10-25T16:19:15.158487+0000","last_active":"2023-10-25T16:19:16.632708+0000","last_peered":"2023-10-25T16:19:16.632708+0000","last_clean":"2023-10-25T16:19:16.632708+0000","last_became_active":"2023-10-25T16:19:15.157802+0000","last_became_peered":"2023-10-25T16:19:15.157802+0000","last_unstale":"2023-10-25T16:19:16.632708+0000","last_undegraded":"2023-10-25T16:19:16.632708+0000","last_fullsized":"2023-10-25T16:19:16.632708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:22:59.411507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137345+0000","last_change":"2023-10-25T16:19:15.166237+0000","last_active":"2023-10-25T16:19:16.137345+0000","last_peered":"2023-10-25T16:19:16.137345+0000","last_clean":"2023-10-25T16:19:16.137345+0000","last_became_active":"2023-10-25T16:19:15.165247+0000","last_became_peered":"2023-10-25T16:19:15.165247+0000","last_unstale":"2023-10-25T16:19:16.137345+0000","last_undegraded":"2023-10-25T16:19:16.137345+0000","last_fullsized":"2023-10-25T16:19:16.137345+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:29:42.720910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.632138+0000","last_change":"2023-10-25T16:19:15.156044+0000","last_active":"2023-10-25T16:19:16.632138+0000","last_peered":"2023-10-25T16:19:16.632138+0000","last_clean":"2023-10-25T16:19:16.632138+0000","last_became_active":"2023-10-25T16:19:15.155302+0000","last_became_peered":"2023-10-25T16:19:15.155302+0000","last_unstale":"2023-10-25T16:19:16.632138+0000","last_undegraded":"2023-10-25T16:19:16.632138+0000","last_fullsized":"2023-10-25T16:19:16.632138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:57.191516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635488+0000","last_change":"2023-10-25T16:19:15.166088+0000","last_active":"2023-10-25T16:19:16.635488+0000","last_peered":"2023-10-25T16:19:16.635488+0000","last_clean":"2023-10-25T16:19:16.635488+0000","last_became_active":"2023-10-25T16:19:15.164449+0000","last_became_peered":"2023-10-25T16:19:15.164449+0000","last_unstale":"2023-10-25T16:19:16.635488+0000","last_undegraded":"2023-10-25T16:19:16.635488+0000","last_fullsized":"2023-10-25T16:19:16.635488+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:28.304979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.134263+0000","last_change":"2023-10-25T16:19:15.160768+0000","last_active":"2023-10-25T16:19:16.134263+0000","last_peered":"2023-10-25T16:19:16.134263+0000","last_clean":"2023-10-25T16:19:16.134263+0000","last_became_active":"2023-10-25T16:19:15.160532+0000","last_became_peered":"2023-10-25T16:19:15.160532+0000","last_unstale":"2023-10-25T16:19:16.134263+0000","last_undegraded":"2023-10-25T16:19:16.134263+0000","last_fullsized":"2023-10-25T16:19:16.134263+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:12.876511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634630+0000","last_change":"2023-10-25T16:19:15.146267+0000","last_active":"2023-10-25T16:19:16.634630+0000","last_peered":"2023-10-25T16:19:16.634630+0000","last_clean":"2023-10-25T16:19:16.634630+0000","last_became_active":"2023-10-25T16:19:15.144660+0000","last_became_peered":"2023-10-25T16:19:15.144660+0000","last_unstale":"2023-10-25T16:19:16.634630+0000","last_undegraded":"2023-10-25T16:19:16.634630+0000","last_fullsized":"2023-10-25T16:19:16.634630+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:46:05.590495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635504+0000","last_change":"2023-10-25T16:19:15.165446+0000","last_active":"2023-10-25T16:19:16.635504+0000","last_peered":"2023-10-25T16:19:16.635504+0000","last_clean":"2023-10-25T16:19:16.635504+0000","last_became_active":"2023-10-25T16:19:15.160950+0000","last_became_peered":"2023-10-25T16:19:15.160950+0000","last_unstale":"2023-10-25T16:19:16.635504+0000","last_undegraded":"2023-10-25T16:19:16.635504+0000","last_fullsized":"2023-10-25T16:19:16.635504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:07:56.725551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"128'4","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.175920+0000","last_change":"2023-10-25T16:19:14.144947+0000","last_active":"2023-10-25T16:19:15.175920+0000","last_peered":"2023-10-25T16:19:15.175920+0000","last_clean":"2023-10-25T16:19:15.175920+0000","last_became_active":"2023-10-25T16:19:14.144069+0000","last_became_peered":"2023-10-25T16:19:14.144069+0000","last_unstale":"2023-10-25T16:19:15.175920+0000","last_undegraded":"2023-10-25T16:19:15.175920+0000","last_fullsized":"2023-10-25T16:19:15.175920+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:52:19.798229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.134956+0000","last_change":"2023-10-25T16:19:15.159698+0000","last_active":"2023-10-25T16:19:16.134956+0000","last_peered":"2023-10-25T16:19:16.134956+0000","last_clean":"2023-10-25T16:19:16.134956+0000","last_became_active":"2023-10-25T16:19:15.158843+0000","last_became_peered":"2023-10-25T16:19:15.158843+0000","last_unstale":"2023-10-25T16:19:16.134956+0000","last_undegraded":"2023-10-25T16:19:16.134956+0000","last_fullsized":"2023-10-25T16:19:16.134956+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:44.799896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.178994+0000","last_change":"2023-10-25T16:19:14.154975+0000","last_active":"2023-10-25T16:19:15.178994+0000","last_peered":"2023-10-25T16:19:15.178994+0000","last_clean":"2023-10-25T16:19:15.178994+0000","last_became_active":"2023-10-25T16:19:14.153747+0000","last_became_peered":"2023-10-25T16:19:14.153747+0000","last_unstale":"2023-10-25T16:19:15.178994+0000","last_undegraded":"2023-10-25T16:19:15.178994+0000","last_fullsized":"2023-10-25T16:19:15.178994+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:05.040795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633891+0000","last_change":"2023-10-25T16:19:15.145871+0000","last_active":"2023-10-25T16:19:16.633891+0000","last_peered":"2023-10-25T16:19:16.633891+0000","last_clean":"2023-10-25T16:19:16.633891+0000","last_became_active":"2023-10-25T16:19:15.145221+0000","last_became_peered":"2023-10-25T16:19:15.145221+0000","last_unstale":"2023-10-25T16:19:16.633891+0000","last_undegraded":"2023-10-25T16:19:16.633891+0000","last_fullsized":"2023-10-25T16:19:16.633891+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:31.417184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.172098+0000","last_change":"2023-10-25T16:19:14.145066+0000","last_active":"2023-10-25T16:19:15.172098+0000","last_peered":"2023-10-25T16:19:15.172098+0000","last_clean":"2023-10-25T16:19:15.172098+0000","last_became_active":"2023-10-25T16:19:14.144640+0000","last_became_peered":"2023-10-25T16:19:14.144640+0000","last_unstale":"2023-10-25T16:19:15.172098+0000","last_undegraded":"2023-10-25T16:19:15.172098+0000","last_fullsized":"2023-10-25T16:19:15.172098+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:02:28.951768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633322+0000","last_change":"2023-10-25T16:19:15.166923+0000","last_active":"2023-10-25T16:19:16.633322+0000","last_peered":"2023-10-25T16:19:16.633322+0000","last_clean":"2023-10-25T16:19:16.633322+0000","last_became_active":"2023-10-25T16:19:15.166177+0000","last_became_peered":"2023-10-25T16:19:15.166177+0000","last_unstale":"2023-10-25T16:19:16.633322+0000","last_undegraded":"2023-10-25T16:19:16.633322+0000","last_fullsized":"2023-10-25T16:19:16.633322+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:33:56.025013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.175046+0000","last_change":"2023-10-25T16:19:14.153400+0000","last_active":"2023-10-25T16:19:15.175046+0000","last_peered":"2023-10-25T16:19:15.175046+0000","last_clean":"2023-10-25T16:19:15.175046+0000","last_became_active":"2023-10-25T16:19:14.153175+0000","last_became_peered":"2023-10-25T16:19:14.153175+0000","last_unstale":"2023-10-25T16:19:15.175046+0000","last_undegraded":"2023-10-25T16:19:15.175046+0000","last_fullsized":"2023-10-25T16:19:15.175046+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:11.865110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633045+0000","last_change":"2023-10-25T16:19:15.164399+0000","last_active":"2023-10-25T16:19:16.633045+0000","last_peered":"2023-10-25T16:19:16.633045+0000","last_clean":"2023-10-25T16:19:16.633045+0000","last_became_active":"2023-10-25T16:19:15.163774+0000","last_became_peered":"2023-10-25T16:19:15.163774+0000","last_unstale":"2023-10-25T16:19:16.633045+0000","last_undegraded":"2023-10-25T16:19:16.633045+0000","last_fullsized":"2023-10-25T16:19:16.633045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:48:25.098609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.176510+0000","last_change":"2023-10-25T16:19:14.145874+0000","last_active":"2023-10-25T16:19:15.176510+0000","last_peered":"2023-10-25T16:19:15.176510+0000","last_clean":"2023-10-25T16:19:15.176510+0000","last_became_active":"2023-10-25T16:19:14.145602+0000","last_became_peered":"2023-10-25T16:19:14.145602+0000","last_unstale":"2023-10-25T16:19:15.176510+0000","last_undegraded":"2023-10-25T16:19:15.176510+0000","last_fullsized":"2023-10-25T16:19:15.176510+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:11:06.134023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633039+0000","last_change":"2023-10-25T16:19:15.169640+0000","last_active":"2023-10-25T16:19:16.633039+0000","last_peered":"2023-10-25T16:19:16.633039+0000","last_clean":"2023-10-25T16:19:16.633039+0000","last_became_active":"2023-10-25T16:19:15.169019+0000","last_became_peered":"2023-10-25T16:19:15.169019+0000","last_unstale":"2023-10-25T16:19:16.633039+0000","last_undegraded":"2023-10-25T16:19:16.633039+0000","last_fullsized":"2023-10-25T16:19:16.633039+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:52:20.809630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.174426+0000","last_change":"2023-10-25T16:19:14.147250+0000","last_active":"2023-10-25T16:19:15.174426+0000","last_peered":"2023-10-25T16:19:15.174426+0000","last_clean":"2023-10-25T16:19:15.174426+0000","last_became_active":"2023-10-25T16:19:14.147036+0000","last_became_peered":"2023-10-25T16:19:14.147036+0000","last_unstale":"2023-10-25T16:19:15.174426+0000","last_undegraded":"2023-10-25T16:19:15.174426+0000","last_fullsized":"2023-10-25T16:19:15.174426+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:36:49.448584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.135907+0000","last_change":"2023-10-25T16:19:15.142436+0000","last_active":"2023-10-25T16:19:16.135907+0000","last_peered":"2023-10-25T16:19:16.135907+0000","last_clean":"2023-10-25T16:19:16.135907+0000","last_became_active":"2023-10-25T16:19:15.141328+0000","last_became_peered":"2023-10-25T16:19:15.141328+0000","last_unstale":"2023-10-25T16:19:16.135907+0000","last_undegraded":"2023-10-25T16:19:16.135907+0000","last_fullsized":"2023-10-25T16:19:16.135907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:59:45.504301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.147889+0000","last_change":"2023-10-25T16:19:14.145346+0000","last_active":"2023-10-25T16:19:15.147889+0000","last_peered":"2023-10-25T16:19:15.147889+0000","last_clean":"2023-10-25T16:19:15.147889+0000","last_became_active":"2023-10-25T16:19:14.143452+0000","last_became_peered":"2023-10-25T16:19:14.143452+0000","last_unstale":"2023-10-25T16:19:15.147889+0000","last_undegraded":"2023-10-25T16:19:15.147889+0000","last_fullsized":"2023-10-25T16:19:15.147889+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:29:10.048310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634016+0000","last_change":"2023-10-25T16:19:15.154953+0000","last_active":"2023-10-25T16:19:16.634016+0000","last_peered":"2023-10-25T16:19:16.634016+0000","last_clean":"2023-10-25T16:19:16.634016+0000","last_became_active":"2023-10-25T16:19:15.154327+0000","last_became_peered":"2023-10-25T16:19:15.154327+0000","last_unstale":"2023-10-25T16:19:16.634016+0000","last_undegraded":"2023-10-25T16:19:16.634016+0000","last_fullsized":"2023-10-25T16:19:16.634016+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:20.167393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.138291+0000","last_change":"2023-10-25T16:19:14.144655+0000","last_active":"2023-10-25T16:19:15.138291+0000","last_peered":"2023-10-25T16:19:15.138291+0000","last_clean":"2023-10-25T16:19:15.138291+0000","last_became_active":"2023-10-25T16:19:14.144338+0000","last_became_peered":"2023-10-25T16:19:14.144338+0000","last_unstale":"2023-10-25T16:19:15.138291+0000","last_undegraded":"2023-10-25T16:19:15.138291+0000","last_fullsized":"2023-10-25T16:19:15.138291+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:11:02.162089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633171+0000","last_change":"2023-10-25T16:19:15.159675+0000","last_active":"2023-10-25T16:19:16.633171+0000","last_peered":"2023-10-25T16:19:16.633171+0000","last_clean":"2023-10-25T16:19:16.633171+0000","last_became_active":"2023-10-25T16:19:15.158836+0000","last_became_peered":"2023-10-25T16:19:15.158836+0000","last_unstale":"2023-10-25T16:19:16.633171+0000","last_undegraded":"2023-10-25T16:19:16.633171+0000","last_fullsized":"2023-10-25T16:19:16.633171+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:44:43.471932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.137158+0000","last_change":"2023-10-25T16:19:14.150828+0000","last_active":"2023-10-25T16:19:15.137158+0000","last_peered":"2023-10-25T16:19:15.137158+0000","last_clean":"2023-10-25T16:19:15.137158+0000","last_became_active":"2023-10-25T16:19:14.150521+0000","last_became_peered":"2023-10-25T16:19:14.150521+0000","last_unstale":"2023-10-25T16:19:15.137158+0000","last_undegraded":"2023-10-25T16:19:15.137158+0000","last_fullsized":"2023-10-25T16:19:15.137158+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:00.235626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634318+0000","last_change":"2023-10-25T16:19:15.166944+0000","last_active":"2023-10-25T16:19:16.634318+0000","last_peered":"2023-10-25T16:19:16.634318+0000","last_clean":"2023-10-25T16:19:16.634318+0000","last_became_active":"2023-10-25T16:19:15.166372+0000","last_became_peered":"2023-10-25T16:19:15.166372+0000","last_unstale":"2023-10-25T16:19:16.634318+0000","last_undegraded":"2023-10-25T16:19:16.634318+0000","last_fullsized":"2023-10-25T16:19:16.634318+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:21:31.151780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.131498+0000","last_change":"2023-10-25T16:19:14.141102+0000","last_active":"2023-10-25T16:19:15.131498+0000","last_peered":"2023-10-25T16:19:15.131498+0000","last_clean":"2023-10-25T16:19:15.131498+0000","last_became_active":"2023-10-25T16:19:14.140878+0000","last_became_peered":"2023-10-25T16:19:14.140878+0000","last_unstale":"2023-10-25T16:19:15.131498+0000","last_undegraded":"2023-10-25T16:19:15.131498+0000","last_fullsized":"2023-10-25T16:19:15.131498+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:06:45.355521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137306+0000","last_change":"2023-10-25T16:19:15.163886+0000","last_active":"2023-10-25T16:19:16.137306+0000","last_peered":"2023-10-25T16:19:16.137306+0000","last_clean":"2023-10-25T16:19:16.137306+0000","last_became_active":"2023-10-25T16:19:15.163266+0000","last_became_peered":"2023-10-25T16:19:15.163266+0000","last_unstale":"2023-10-25T16:19:16.137306+0000","last_undegraded":"2023-10-25T16:19:16.137306+0000","last_fullsized":"2023-10-25T16:19:16.137306+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:31.408875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"128'3","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.183940+0000","last_change":"2023-10-25T16:19:14.156141+0000","last_active":"2023-10-25T16:19:15.183940+0000","last_peered":"2023-10-25T16:19:15.183940+0000","last_clean":"2023-10-25T16:19:15.183940+0000","last_became_active":"2023-10-25T16:19:14.155549+0000","last_became_peered":"2023-10-25T16:19:14.155549+0000","last_unstale":"2023-10-25T16:19:15.183940+0000","last_undegraded":"2023-10-25T16:19:15.183940+0000","last_fullsized":"2023-10-25T16:19:15.183940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:38:17.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633811+0000","last_change":"2023-10-25T16:19:15.160049+0000","last_active":"2023-10-25T16:19:16.633811+0000","last_peered":"2023-10-25T16:19:16.633811+0000","last_clean":"2023-10-25T16:19:16.633811+0000","last_became_active":"2023-10-25T16:19:15.159380+0000","last_became_peered":"2023-10-25T16:19:15.159380+0000","last_unstale":"2023-10-25T16:19:16.633811+0000","last_undegraded":"2023-10-25T16:19:16.633811+0000","last_fullsized":"2023-10-25T16:19:16.633811+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:36:50.459985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"128'6","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.180710+0000","last_change":"2023-10-25T16:19:14.154628+0000","last_active":"2023-10-25T16:19:15.180710+0000","last_peered":"2023-10-25T16:19:15.180710+0000","last_clean":"2023-10-25T16:19:15.180710+0000","last_became_active":"2023-10-25T16:19:14.153323+0000","last_became_peered":"2023-10-25T16:19:14.153323+0000","last_unstale":"2023-10-25T16:19:15.180710+0000","last_undegraded":"2023-10-25T16:19:15.180710+0000","last_fullsized":"2023-10-25T16:19:15.180710+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:30.876047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.134489+0000","last_change":"2023-10-25T16:19:15.144801+0000","last_active":"2023-10-25T16:19:16.134489+0000","last_peered":"2023-10-25T16:19:16.134489+0000","last_clean":"2023-10-25T16:19:16.134489+0000","last_became_active":"2023-10-25T16:19:15.144132+0000","last_became_peered":"2023-10-25T16:19:15.144132+0000","last_unstale":"2023-10-25T16:19:16.134489+0000","last_undegraded":"2023-10-25T16:19:16.134489+0000","last_fullsized":"2023-10-25T16:19:16.134489+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:14:11.571283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"128'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635693+0000","last_change":"2023-10-25T16:19:14.156380+0000","last_active":"2023-10-25T16:19:16.635693+0000","last_peered":"2023-10-25T16:19:16.635693+0000","last_clean":"2023-10-25T16:19:16.635693+0000","last_became_active":"2023-10-25T16:19:14.156233+0000","last_became_peered":"2023-10-25T16:19:14.156233+0000","last_unstale":"2023-10-25T16:19:16.635693+0000","last_undegraded":"2023-10-25T16:19:16.635693+0000","last_fullsized":"2023-10-25T16:19:16.635693+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:35:50.030215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633810+0000","last_change":"2023-10-25T16:19:15.161666+0000","last_active":"2023-10-25T16:19:16.633810+0000","last_peered":"2023-10-25T16:19:16.633810+0000","last_clean":"2023-10-25T16:19:16.633810+0000","last_became_active":"2023-10-25T16:19:15.161261+0000","last_became_peered":"2023-10-25T16:19:15.161261+0000","last_unstale":"2023-10-25T16:19:16.633810+0000","last_undegraded":"2023-10-25T16:19:16.633810+0000","last_fullsized":"2023-10-25T16:19:16.633810+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:59:45.784838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635148+0000","last_change":"2023-10-25T16:19:14.148704+0000","last_active":"2023-10-25T16:19:16.635148+0000","last_peered":"2023-10-25T16:19:16.635148+0000","last_clean":"2023-10-25T16:19:16.635148+0000","last_became_active":"2023-10-25T16:19:14.148550+0000","last_became_peered":"2023-10-25T16:19:14.148550+0000","last_unstale":"2023-10-25T16:19:16.635148+0000","last_undegraded":"2023-10-25T16:19:16.635148+0000","last_fullsized":"2023-10-25T16:19:16.635148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:03.206482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634223+0000","last_change":"2023-10-25T16:19:15.167841+0000","last_active":"2023-10-25T16:19:16.634223+0000","last_peered":"2023-10-25T16:19:16.634223+0000","last_clean":"2023-10-25T16:19:16.634223+0000","last_became_active":"2023-10-25T16:19:15.166891+0000","last_became_peered":"2023-10-25T16:19:15.166891+0000","last_unstale":"2023-10-25T16:19:16.634223+0000","last_undegraded":"2023-10-25T16:19:16.634223+0000","last_fullsized":"2023-10-25T16:19:16.634223+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:06.052196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.143164+0000","last_change":"2023-10-25T16:19:14.158176+0000","last_active":"2023-10-25T16:19:15.143164+0000","last_peered":"2023-10-25T16:19:15.143164+0000","last_clean":"2023-10-25T16:19:15.143164+0000","last_became_active":"2023-10-25T16:19:14.157135+0000","last_became_peered":"2023-10-25T16:19:14.157135+0000","last_unstale":"2023-10-25T16:19:15.143164+0000","last_undegraded":"2023-10-25T16:19:15.143164+0000","last_fullsized":"2023-10-25T16:19:15.143164+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:11.670376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634295+0000","last_change":"2023-10-25T16:19:15.161990+0000","last_active":"2023-10-25T16:19:16.634295+0000","last_peered":"2023-10-25T16:19:16.634295+0000","last_clean":"2023-10-25T16:19:16.634295+0000","last_became_active":"2023-10-25T16:19:15.161462+0000","last_became_peered":"2023-10-25T16:19:15.161462+0000","last_unstale":"2023-10-25T16:19:16.634295+0000","last_undegraded":"2023-10-25T16:19:16.634295+0000","last_fullsized":"2023-10-25T16:19:16.634295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:38.301081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"128'8","reported_seq":20,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.181277+0000","last_change":"2023-10-25T16:19:14.150925+0000","last_active":"2023-10-25T16:19:15.181277+0000","last_peered":"2023-10-25T16:19:15.181277+0000","last_clean":"2023-10-25T16:19:15.181277+0000","last_became_active":"2023-10-25T16:19:14.150509+0000","last_became_peered":"2023-10-25T16:19:14.150509+0000","last_unstale":"2023-10-25T16:19:15.181277+0000","last_undegraded":"2023-10-25T16:19:15.181277+0000","last_fullsized":"2023-10-25T16:19:15.181277+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:08:55.917338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137722+0000","last_change":"2023-10-25T16:19:15.156994+0000","last_active":"2023-10-25T16:19:16.137722+0000","last_peered":"2023-10-25T16:19:16.137722+0000","last_clean":"2023-10-25T16:19:16.137722+0000","last_became_active":"2023-10-25T16:19:15.156353+0000","last_became_peered":"2023-10-25T16:19:15.156353+0000","last_unstale":"2023-10-25T16:19:16.137722+0000","last_undegraded":"2023-10-25T16:19:16.137722+0000","last_fullsized":"2023-10-25T16:19:16.137722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:00:24.719181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.174687+0000","last_change":"2023-10-25T16:19:14.156944+0000","last_active":"2023-10-25T16:19:15.174687+0000","last_peered":"2023-10-25T16:19:15.174687+0000","last_clean":"2023-10-25T16:19:15.174687+0000","last_became_active":"2023-10-25T16:19:14.156080+0000","last_became_peered":"2023-10-25T16:19:14.156080+0000","last_unstale":"2023-10-25T16:19:15.174687+0000","last_undegraded":"2023-10-25T16:19:15.174687+0000","last_fullsized":"2023-10-25T16:19:15.174687+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:06.413087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634302+0000","last_change":"2023-10-25T16:19:15.172699+0000","last_active":"2023-10-25T16:19:16.634302+0000","last_peered":"2023-10-25T16:19:16.634302+0000","last_clean":"2023-10-25T16:19:16.634302+0000","last_became_active":"2023-10-25T16:19:15.169558+0000","last_became_peered":"2023-10-25T16:19:15.169558+0000","last_unstale":"2023-10-25T16:19:16.634302+0000","last_undegraded":"2023-10-25T16:19:16.634302+0000","last_fullsized":"2023-10-25T16:19:16.634302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:31:38.235545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.175560+0000","last_change":"2023-10-25T16:19:14.148729+0000","last_active":"2023-10-25T16:19:15.175560+0000","last_peered":"2023-10-25T16:19:15.175560+0000","last_clean":"2023-10-25T16:19:15.175560+0000","last_became_active":"2023-10-25T16:19:14.148088+0000","last_became_peered":"2023-10-25T16:19:14.148088+0000","last_unstale":"2023-10-25T16:19:15.175560+0000","last_undegraded":"2023-10-25T16:19:15.175560+0000","last_fullsized":"2023-10-25T16:19:15.175560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:59:28.563482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635731+0000","last_change":"2023-10-25T16:19:15.168969+0000","last_active":"2023-10-25T16:19:16.635731+0000","last_peered":"2023-10-25T16:19:16.635731+0000","last_clean":"2023-10-25T16:19:16.635731+0000","last_became_active":"2023-10-25T16:19:15.161374+0000","last_became_peered":"2023-10-25T16:19:15.161374+0000","last_unstale":"2023-10-25T16:19:16.635731+0000","last_undegraded":"2023-10-25T16:19:16.635731+0000","last_fullsized":"2023-10-25T16:19:16.635731+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:16:31.408875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.142144+0000","last_change":"2023-10-25T16:19:14.155751+0000","last_active":"2023-10-25T16:19:15.142144+0000","last_peered":"2023-10-25T16:19:15.142144+0000","last_clean":"2023-10-25T16:19:15.142144+0000","last_became_active":"2023-10-25T16:19:14.155504+0000","last_became_peered":"2023-10-25T16:19:14.155504+0000","last_unstale":"2023-10-25T16:19:15.142144+0000","last_undegraded":"2023-10-25T16:19:15.142144+0000","last_fullsized":"2023-10-25T16:19:15.142144+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:59:44.492900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635678+0000","last_change":"2023-10-25T16:19:15.164082+0000","last_active":"2023-10-25T16:19:16.635678+0000","last_peered":"2023-10-25T16:19:16.635678+0000","last_clean":"2023-10-25T16:19:16.635678+0000","last_became_active":"2023-10-25T16:19:15.160195+0000","last_became_peered":"2023-10-25T16:19:15.160195+0000","last_unstale":"2023-10-25T16:19:16.635678+0000","last_undegraded":"2023-10-25T16:19:16.635678+0000","last_fullsized":"2023-10-25T16:19:16.635678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:53:34.418384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.174078+0000","last_change":"2023-10-25T16:19:14.146477+0000","last_active":"2023-10-25T16:19:15.174078+0000","last_peered":"2023-10-25T16:19:15.174078+0000","last_clean":"2023-10-25T16:19:15.174078+0000","last_became_active":"2023-10-25T16:19:14.144690+0000","last_became_peered":"2023-10-25T16:19:14.144690+0000","last_unstale":"2023-10-25T16:19:15.174078+0000","last_undegraded":"2023-10-25T16:19:15.174078+0000","last_fullsized":"2023-10-25T16:19:15.174078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:59:28.563482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635018+0000","last_change":"2023-10-25T16:19:15.171435+0000","last_active":"2023-10-25T16:19:16.635018+0000","last_peered":"2023-10-25T16:19:16.635018+0000","last_clean":"2023-10-25T16:19:16.635018+0000","last_became_active":"2023-10-25T16:19:15.171216+0000","last_became_peered":"2023-10-25T16:19:15.171216+0000","last_unstale":"2023-10-25T16:19:16.635018+0000","last_undegraded":"2023-10-25T16:19:16.635018+0000","last_fullsized":"2023-10-25T16:19:16.635018+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:31:34.223480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.146742+0000","last_change":"2023-10-25T16:19:14.153459+0000","last_active":"2023-10-25T16:19:15.146742+0000","last_peered":"2023-10-25T16:19:15.146742+0000","last_clean":"2023-10-25T16:19:15.146742+0000","last_became_active":"2023-10-25T16:19:14.152828+0000","last_became_peered":"2023-10-25T16:19:14.152828+0000","last_unstale":"2023-10-25T16:19:15.146742+0000","last_undegraded":"2023-10-25T16:19:15.146742+0000","last_fullsized":"2023-10-25T16:19:15.146742+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:35.760155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634935+0000","last_change":"2023-10-25T16:19:15.153350+0000","last_active":"2023-10-25T16:19:16.634935+0000","last_peered":"2023-10-25T16:19:16.634935+0000","last_clean":"2023-10-25T16:19:16.634935+0000","last_became_active":"2023-10-25T16:19:15.152653+0000","last_became_peered":"2023-10-25T16:19:15.152653+0000","last_unstale":"2023-10-25T16:19:16.634935+0000","last_undegraded":"2023-10-25T16:19:16.634935+0000","last_fullsized":"2023-10-25T16:19:16.634935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:44:42.152160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.154747+0000","last_change":"2023-10-25T16:19:14.144093+0000","last_active":"2023-10-25T16:19:15.154747+0000","last_peered":"2023-10-25T16:19:15.154747+0000","last_clean":"2023-10-25T16:19:15.154747+0000","last_became_active":"2023-10-25T16:19:14.143541+0000","last_became_peered":"2023-10-25T16:19:14.143541+0000","last_unstale":"2023-10-25T16:19:15.154747+0000","last_undegraded":"2023-10-25T16:19:15.154747+0000","last_fullsized":"2023-10-25T16:19:15.154747+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:04.305925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.138146+0000","last_change":"2023-10-25T16:19:15.181134+0000","last_active":"2023-10-25T16:19:16.138146+0000","last_peered":"2023-10-25T16:19:16.138146+0000","last_clean":"2023-10-25T16:19:16.138146+0000","last_became_active":"2023-10-25T16:19:15.165406+0000","last_became_peered":"2023-10-25T16:19:15.165406+0000","last_unstale":"2023-10-25T16:19:16.138146+0000","last_undegraded":"2023-10-25T16:19:16.138146+0000","last_fullsized":"2023-10-25T16:19:16.138146+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:52:34.757244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.140861+0000","last_change":"2023-10-25T16:19:14.147714+0000","last_active":"2023-10-25T16:19:15.140861+0000","last_peered":"2023-10-25T16:19:15.140861+0000","last_clean":"2023-10-25T16:19:15.140861+0000","last_became_active":"2023-10-25T16:19:14.147202+0000","last_became_peered":"2023-10-25T16:19:14.147202+0000","last_unstale":"2023-10-25T16:19:15.140861+0000","last_undegraded":"2023-10-25T16:19:15.140861+0000","last_fullsized":"2023-10-25T16:19:15.140861+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:35:01.257581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.633297+0000","last_change":"2023-10-25T16:19:15.168131+0000","last_active":"2023-10-25T16:19:16.633297+0000","last_peered":"2023-10-25T16:19:16.633297+0000","last_clean":"2023-10-25T16:19:16.633297+0000","last_became_active":"2023-10-25T16:19:15.163972+0000","last_became_peered":"2023-10-25T16:19:15.163972+0000","last_unstale":"2023-10-25T16:19:16.633297+0000","last_undegraded":"2023-10-25T16:19:16.633297+0000","last_fullsized":"2023-10-25T16:19:16.633297+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:13.532356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.180908+0000","last_change":"2023-10-25T16:19:14.159133+0000","last_active":"2023-10-25T16:19:15.180908+0000","last_peered":"2023-10-25T16:19:15.180908+0000","last_clean":"2023-10-25T16:19:15.180908+0000","last_became_active":"2023-10-25T16:19:14.158596+0000","last_became_peered":"2023-10-25T16:19:14.158596+0000","last_unstale":"2023-10-25T16:19:15.180908+0000","last_undegraded":"2023-10-25T16:19:15.180908+0000","last_fullsized":"2023-10-25T16:19:15.180908+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:20:23.129985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634893+0000","last_change":"2023-10-25T16:19:15.159903+0000","last_active":"2023-10-25T16:19:16.634893+0000","last_peered":"2023-10-25T16:19:16.634893+0000","last_clean":"2023-10-25T16:19:16.634893+0000","last_became_active":"2023-10-25T16:19:15.158195+0000","last_became_peered":"2023-10-25T16:19:15.158195+0000","last_unstale":"2023-10-25T16:19:16.634893+0000","last_undegraded":"2023-10-25T16:19:16.634893+0000","last_fullsized":"2023-10-25T16:19:16.634893+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:35:25.258094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"129'1","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634253+0000","last_change":"2023-10-25T16:19:14.145106+0000","last_active":"2023-10-25T16:19:16.634253+0000","last_peered":"2023-10-25T16:19:16.634253+0000","last_clean":"2023-10-25T16:19:16.634253+0000","last_became_active":"2023-10-25T16:19:14.144380+0000","last_became_peered":"2023-10-25T16:19:14.144380+0000","last_unstale":"2023-10-25T16:19:16.634253+0000","last_undegraded":"2023-10-25T16:19:16.634253+0000","last_fullsized":"2023-10-25T16:19:16.634253+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:30:52.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634136+0000","last_change":"2023-10-25T16:19:15.165450+0000","last_active":"2023-10-25T16:19:16.634136+0000","last_peered":"2023-10-25T16:19:16.634136+0000","last_clean":"2023-10-25T16:19:16.634136+0000","last_became_active":"2023-10-25T16:19:15.165028+0000","last_became_peered":"2023-10-25T16:19:15.165028+0000","last_unstale":"2023-10-25T16:19:16.634136+0000","last_undegraded":"2023-10-25T16:19:16.634136+0000","last_fullsized":"2023-10-25T16:19:16.634136+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:25.155917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.140497+0000","last_change":"2023-10-25T16:19:14.153739+0000","last_active":"2023-10-25T16:19:15.140497+0000","last_peered":"2023-10-25T16:19:15.140497+0000","last_clean":"2023-10-25T16:19:15.140497+0000","last_became_active":"2023-10-25T16:19:14.153488+0000","last_became_peered":"2023-10-25T16:19:14.153488+0000","last_unstale":"2023-10-25T16:19:15.140497+0000","last_undegraded":"2023-10-25T16:19:15.140497+0000","last_fullsized":"2023-10-25T16:19:15.140497+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:52:20.145806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.138063+0000","last_change":"2023-10-25T16:19:15.152596+0000","last_active":"2023-10-25T16:19:16.138063+0000","last_peered":"2023-10-25T16:19:16.138063+0000","last_clean":"2023-10-25T16:19:16.138063+0000","last_became_active":"2023-10-25T16:19:15.149713+0000","last_became_peered":"2023-10-25T16:19:15.149713+0000","last_unstale":"2023-10-25T16:19:16.138063+0000","last_undegraded":"2023-10-25T16:19:16.138063+0000","last_fullsized":"2023-10-25T16:19:16.138063+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:42:58.321979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.156376+0000","last_change":"2023-10-25T16:19:14.151321+0000","last_active":"2023-10-25T16:19:15.156376+0000","last_peered":"2023-10-25T16:19:15.156376+0000","last_clean":"2023-10-25T16:19:15.156376+0000","last_became_active":"2023-10-25T16:19:14.150384+0000","last_became_peered":"2023-10-25T16:19:14.150384+0000","last_unstale":"2023-10-25T16:19:15.156376+0000","last_undegraded":"2023-10-25T16:19:15.156376+0000","last_fullsized":"2023-10-25T16:19:15.156376+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:30:52.102378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634617+0000","last_change":"2023-10-25T16:19:15.161843+0000","last_active":"2023-10-25T16:19:16.634617+0000","last_peered":"2023-10-25T16:19:16.634617+0000","last_clean":"2023-10-25T16:19:16.634617+0000","last_became_active":"2023-10-25T16:19:15.161148+0000","last_became_peered":"2023-10-25T16:19:15.161148+0000","last_unstale":"2023-10-25T16:19:16.634617+0000","last_undegraded":"2023-10-25T16:19:16.634617+0000","last_fullsized":"2023-10-25T16:19:16.634617+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:02:12.533890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.141206+0000","last_change":"2023-10-25T16:19:14.140911+0000","last_active":"2023-10-25T16:19:15.141206+0000","last_peered":"2023-10-25T16:19:15.141206+0000","last_clean":"2023-10-25T16:19:15.141206+0000","last_became_active":"2023-10-25T16:19:14.140640+0000","last_became_peered":"2023-10-25T16:19:14.140640+0000","last_unstale":"2023-10-25T16:19:15.141206+0000","last_undegraded":"2023-10-25T16:19:15.141206+0000","last_fullsized":"2023-10-25T16:19:15.141206+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:56.320376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.634599+0000","last_change":"2023-10-25T16:19:15.159999+0000","last_active":"2023-10-25T16:19:16.634599+0000","last_peered":"2023-10-25T16:19:16.634599+0000","last_clean":"2023-10-25T16:19:16.634599+0000","last_became_active":"2023-10-25T16:19:15.159319+0000","last_became_peered":"2023-10-25T16:19:15.159319+0000","last_unstale":"2023-10-25T16:19:16.634599+0000","last_undegraded":"2023-10-25T16:19:16.634599+0000","last_fullsized":"2023-10-25T16:19:16.634599+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:54.084512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.157135+0000","last_change":"2023-10-25T16:19:14.154725+0000","last_active":"2023-10-25T16:19:15.157135+0000","last_peered":"2023-10-25T16:19:15.157135+0000","last_clean":"2023-10-25T16:19:15.157135+0000","last_became_active":"2023-10-25T16:19:14.152704+0000","last_became_peered":"2023-10-25T16:19:14.152704+0000","last_unstale":"2023-10-25T16:19:15.157135+0000","last_undegraded":"2023-10-25T16:19:15.157135+0000","last_fullsized":"2023-10-25T16:19:15.157135+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:05:56.180115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635841+0000","last_change":"2023-10-25T16:19:15.166303+0000","last_active":"2023-10-25T16:19:16.635841+0000","last_peered":"2023-10-25T16:19:16.635841+0000","last_clean":"2023-10-25T16:19:16.635841+0000","last_became_active":"2023-10-25T16:19:15.163694+0000","last_became_peered":"2023-10-25T16:19:15.163694+0000","last_unstale":"2023-10-25T16:19:16.635841+0000","last_undegraded":"2023-10-25T16:19:16.635841+0000","last_fullsized":"2023-10-25T16:19:16.635841+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:57.824680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.133808+0000","last_change":"2023-10-25T16:19:14.145472+0000","last_active":"2023-10-25T16:19:15.133808+0000","last_peered":"2023-10-25T16:19:15.133808+0000","last_clean":"2023-10-25T16:19:15.133808+0000","last_became_active":"2023-10-25T16:19:14.145146+0000","last_became_peered":"2023-10-25T16:19:14.145146+0000","last_unstale":"2023-10-25T16:19:15.133808+0000","last_undegraded":"2023-10-25T16:19:15.133808+0000","last_fullsized":"2023-10-25T16:19:15.133808+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:52:20.145806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.137922+0000","last_change":"2023-10-25T16:19:15.154422+0000","last_active":"2023-10-25T16:19:16.137922+0000","last_peered":"2023-10-25T16:19:16.137922+0000","last_clean":"2023-10-25T16:19:16.137922+0000","last_became_active":"2023-10-25T16:19:15.153821+0000","last_became_peered":"2023-10-25T16:19:15.153821+0000","last_unstale":"2023-10-25T16:19:16.137922+0000","last_undegraded":"2023-10-25T16:19:16.137922+0000","last_fullsized":"2023-10-25T16:19:16.137922+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:13.532356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635951+0000","last_change":"2023-10-25T16:19:14.140357+0000","last_active":"2023-10-25T16:19:16.635951+0000","last_peered":"2023-10-25T16:19:16.635951+0000","last_clean":"2023-10-25T16:19:16.635951+0000","last_became_active":"2023-10-25T16:19:14.140115+0000","last_became_peered":"2023-10-25T16:19:14.140115+0000","last_unstale":"2023-10-25T16:19:16.635951+0000","last_undegraded":"2023-10-25T16:19:16.635951+0000","last_fullsized":"2023-10-25T16:19:16.635951+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:57.962504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-10-25T16:19:16.635308+0000","last_change":"2023-10-25T16:19:15.159472+0000","last_active":"2023-10-25T16:19:16.635308+0000","last_peered":"2023-10-25T16:19:16.635308+0000","last_clean":"2023-10-25T16:19:16.635308+0000","last_became_active":"2023-10-25T16:19:15.158856+0000","last_became_peered":"2023-10-25T16:19:15.158856+0000","last_unstale":"2023-10-25T16:19:16.635308+0000","last_undegraded":"2023-10-25T16:19:16.635308+0000","last_fullsized":"2023-10-25T16:19:16.635308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:14.114202+0000","last_clean_scrub_stamp":"2023-10-25T16:19:14.114202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:29:38.107837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.179926+0000","last_change":"2023-10-25T16:19:14.150096+0000","last_active":"2023-10-25T16:19:15.179926+0000","last_peered":"2023-10-25T16:19:15.179926+0000","last_clean":"2023-10-25T16:19:15.179926+0000","last_became_active":"2023-10-25T16:19:14.149275+0000","last_became_peered":"2023-10-25T16:19:14.149275+0000","last_unstale":"2023-10-25T16:19:15.179926+0000","last_undegraded":"2023-10-25T16:19:15.179926+0000","last_fullsized":"2023-10-25T16:19:15.179926+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:13.102801+0000","last_clean_scrub_stamp":"2023-10-25T16:19:13.102801+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:21:30.140379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":270,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-25T16:19:15.140805+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:15.140805+0000","last_peered":"2023-10-25T16:19:15.140805+0000","last_clean":"2023-10-25T16:19:15.140805+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:15.140805+0000","last_undegraded":"2023-10-25T16:19:15.140805+0000","last_fullsized":"2023-10-25T16:19:15.140805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542224,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194612,"statfs":{"total":200000000,"available":199283382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.83399999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64400000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":1.022}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.109},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.871},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.159},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":1.6639999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.94599999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1276,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194036,"statfs":{"total":200000000,"available":198692936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.82499999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.038}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0129999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":1.155}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.119},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0880000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":700,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194612,"statfs":{"total":200000000,"available":199282764,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":1.353},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":1.036}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":1.2569999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1919999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.446},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.389}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":1.1000000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":0.89600000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.157}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194612,"statfs":{"total":200000000,"available":199283346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.86099999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":1.014},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":1.0840000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":0.90400000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":0.97199999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.046}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199281680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.85599999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.1839999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.86599999999999999,"15min":0.83399999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.046,"5min":1.419,"15min":1.419},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.91000000000000003,"15min":0.873},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.99099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.103},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":0.89700000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2849999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.212},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.343}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.236},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3149999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":701,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194611,"statfs":{"total":200000000,"available":199281782,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.76400000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":1.109},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":1.1379999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.2210000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":1.1639999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":699,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194612,"statfs":{"total":200000000,"available":199283416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.504},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.90100000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.81000000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":0.92800000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":0.996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.83799999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":1.25}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":1.198},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":1.075}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1276,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194035,"statfs":{"total":200000000,"available":198692466,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":0.45700000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":0.437},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":0.871}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":0.96399999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":0.84499999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:22.940 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:19:22.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:19:23.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 -- 172.21.15.177:0/2915962695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af0141940 msgr2=0x7f9af00cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 --2- 172.21.15.177:0/2915962695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af0141940 0x7f9af00cbc70 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f9af00719e0 tx=0x7f9ae001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 -- 172.21.15.177:0/2915962695 shutdown_connections 2023-10-25T16:19:23.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 --2- 172.21.15.177:0/2915962695 >> v2:172.21.15.184:3300/0 conn(0x7f9af0141d20 0x7f9af00aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 --2- 172.21.15.177:0/2915962695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af0141940 0x7f9af00cbc70 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 -- 172.21.15.177:0/2915962695 >> 172.21.15.177:0/2915962695 conn(0x7f9af00698f0 msgr2=0x7f9af0069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:23.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 -- 172.21.15.177:0/2915962695 shutdown_connections 2023-10-25T16:19:23.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.116+0000 7f9af5728640 1 -- 172.21.15.177:0/2915962695 wait complete. 2023-10-25T16:19:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 Processor -- start 2023-10-25T16:19:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- start start 2023-10-25T16:19:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 0x7f9af0151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9af0141940 0x7f9af014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9af0141d20 0x7f9af01378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01524f0 con 0x7f9af00af4b0 2023-10-25T16:19:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01f6200 con 0x7f9af0141d20 2023-10-25T16:19:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01f5680 con 0x7f9af0141940 2023-10-25T16:19:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 0x7f9af0151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:23.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 0x7f9af0151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38432/0 (socket says 172.21.15.177:38432) 2023-10-25T16:19:23.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 -- 172.21.15.177:0/757017761 learned_addr learned my addr 172.21.15.177:0/757017761 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:23.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aef7fe640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9af0141d20 0x7f9af01378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:23.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aee7fc640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9af0141940 0x7f9af014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:23.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 -- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9af0141940 msgr2=0x7f9af014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9af0141940 0x7f9af014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 -- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9af0141d20 msgr2=0x7f9af01378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9af0141d20 0x7f9af01378c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 -- 172.21.15.177:0/757017761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0009560 con 0x7f9af00af4b0 2023-10-25T16:19:23.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9aeeffd640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 0x7f9af0151fb0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00b0040 tx=0x7f9ae0005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:23.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00ba070 con 0x7f9af00af4b0 2023-10-25T16:19:23.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ae0005030 con 0x7f9af00af4b0 2023-10-25T16:19:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0005440 con 0x7f9af00af4b0 2023-10-25T16:19:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af01f5960 con 0x7f9af00af4b0 2023-10-25T16:19:23.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af01f5f20 con 0x7f9af00af4b0 2023-10-25T16:19:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.120+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af004db20 con 0x7f9af00af4b0 2023-10-25T16:19:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.124+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ae00b4070 con 0x7f9af00af4b0 2023-10-25T16:19:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.124+0000 7f9ad77fe640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9adc066470 0x7f9adc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.124+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae011e420 con 0x7f9af00af4b0 2023-10-25T16:19:23.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.124+0000 7f9aee7fc640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9adc066470 0x7f9adc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:23.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.124+0000 7f9aee7fc640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9adc066470 0x7f9adc068930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40058d0 tx=0x7f9ae4005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:23.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.124+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ae00eba10 con 0x7f9af00af4b0 2023-10-25T16:19:23.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.336+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9af00c96f0 con 0x7f9af00af4b0 2023-10-25T16:19:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.340+0000 7f9ad77fe640 1 -- 172.21.15.177:0/757017761 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9ae00ef030 con 0x7f9af00af4b0 2023-10-25T16:19:23.341 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:19:23.341 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:19:23.341 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:19:23.341 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:19:23.342 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:19:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:19:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9adc066470 msgr2=0x7f9adc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9adc066470 0x7f9adc068930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40058d0 tx=0x7f9ae4005860 comp rx=0 tx=0).stop 2023-10-25T16:19:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 msgr2=0x7f9af0151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 0x7f9af0151fb0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00b0040 tx=0x7f9ae0005e90 comp rx=0 tx=0).stop 2023-10-25T16:19:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 shutdown_connections 2023-10-25T16:19:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9adc066470 0x7f9adc068930 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9af0141d20 0x7f9af01378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9af0141940 0x7f9af014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 --2- 172.21.15.177:0/757017761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9af00af4b0 0x7f9af0151fb0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 >> 172.21.15.177:0/757017761 conn(0x7f9af00698f0 msgr2=0x7f9af0153870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 shutdown_connections 2023-10-25T16:19:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.344+0000 7f9af5728640 1 -- 172.21.15.177:0/757017761 wait complete. 2023-10-25T16:19:23.360 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:23.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 -- 172.21.15.177:0/4123220083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815eba0 msgr2=0x7fb6280b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 --2- 172.21.15.177:0/4123220083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815eba0 0x7fb6280b4100 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fb62809f200 tx=0x7fb61801c670 comp rx=0 tx=0).stop 2023-10-25T16:19:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 -- 172.21.15.177:0/4123220083 shutdown_connections 2023-10-25T16:19:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 --2- 172.21.15.177:0/4123220083 >> v2:172.21.15.184:3300/0 conn(0x7fb6280b2120 0x7fb6280d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 --2- 172.21.15.177:0/4123220083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815eba0 0x7fb6280b4100 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 -- 172.21.15.177:0/4123220083 >> 172.21.15.177:0/4123220083 conn(0x7fb62809a5c0 msgr2=0x7fb6280d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 -- 172.21.15.177:0/4123220083 shutdown_connections 2023-10-25T16:19:23.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 -- 172.21.15.177:0/4123220083 wait complete. 2023-10-25T16:19:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 Processor -- start 2023-10-25T16:19:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.476+0000 7fb62e480640 1 -- start start 2023-10-25T16:19:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 0x7fb6281518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6280cdb10 0x7fb628159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb62815eba0 0x7fb62806b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628151df0 con 0x7fb6280b2120 2023-10-25T16:19:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281540c0 con 0x7fb6280cdb10 2023-10-25T16:19:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281543a0 con 0x7fb62815eba0 2023-10-25T16:19:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 0x7fb6281518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 0x7fb6281518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38460/0 (socket says 172.21.15.177:38460) 2023-10-25T16:19:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 -- 172.21.15.177:0/2591071083 learned_addr learned my addr 172.21.15.177:0/2591071083 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 -- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb62815eba0 msgr2=0x7fb62806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb62815eba0 0x7fb62806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 -- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6280cdb10 msgr2=0x7fb628159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6280cdb10 0x7fb628159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 -- 172.21.15.177:0/2591071083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180094a0 con 0x7fb6280b2120 2023-10-25T16:19:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb627fff640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 0x7fb6281518b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fb618009790 tx=0x7fb618005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180aa9c0 con 0x7fb6280b2120 2023-10-25T16:19:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6180b9070 con 0x7fb6280b2120 2023-10-25T16:19:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628154680 con 0x7fb6280b2120 2023-10-25T16:19:23.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6180aad60 con 0x7fb6280b2120 2023-10-25T16:19:23.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb628159950 con 0x7fb6280b2120 2023-10-25T16:19:23.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb628154e80 con 0x7fb6280b2120 2023-10-25T16:19:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6180bb030 con 0x7fb6280b2120 2023-10-25T16:19:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb624ff9640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb614066470 0x7fb614068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6180a6040 con 0x7fb6280b2120 2023-10-25T16:19:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.480+0000 7fb6277fe640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb614066470 0x7fb614068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.484+0000 7fb6277fe640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb614066470 0x7fb614068930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0058d0 tx=0x7fb61c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.484+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6180ec760 con 0x7fb6280b2120 2023-10-25T16:19:23.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.672+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6280c4ce0 con 0x7fb6280b2120 2023-10-25T16:19:23.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.676+0000 7fb624ff9640 1 -- 172.21.15.177:0/2591071083 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fb6180efd80 con 0x7fb6280b2120 2023-10-25T16:19:23.677 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:23.678 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:23.678 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb614066470 msgr2=0x7fb614068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb614066470 0x7fb614068930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb61c0058d0 tx=0x7fb61c005860 comp rx=0 tx=0).stop 2023-10-25T16:19:23.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 msgr2=0x7fb6281518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 0x7fb6281518b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fb618009790 tx=0x7fb618005d20 comp rx=0 tx=0).stop 2023-10-25T16:19:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 shutdown_connections 2023-10-25T16:19:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb614066470 0x7fb614068930 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb62815eba0 0x7fb62806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6280cdb10 0x7fb628159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 --2- 172.21.15.177:0/2591071083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6280b2120 0x7fb6281518b0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 >> 172.21.15.177:0/2591071083 conn(0x7fb62809a5c0 msgr2=0x7fb6280cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 shutdown_connections 2023-10-25T16:19:23.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:23.680+0000 7fb62e480640 1 -- 172.21.15.177:0/2591071083 wait complete. 2023-10-25T16:19:24.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:19:14.480595+0000', 'modified': '2023-10-25T16:19:16.520519+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7683}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7683': {'gid': 7683, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6835/2032322363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 2032322363}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 2032322363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:19:24.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:19:24.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-25T16:19:24.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 -- 172.21.15.177:0/1981148726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c0c9910 msgr2=0x7f147c06bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 --2- 172.21.15.177:0/1981148726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c0c9910 0x7f147c06bf20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1474009840 tx=0x7f147401c6b0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 -- 172.21.15.177:0/1981148726 shutdown_connections 2023-10-25T16:19:24.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 --2- 172.21.15.177:0/1981148726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c0c9910 0x7f147c06bf20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 --2- 172.21.15.177:0/1981148726 >> v2:172.21.15.184:3300/0 conn(0x7f147c0cb5f0 0x7f147c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 -- 172.21.15.177:0/1981148726 >> 172.21.15.177:0/1981148726 conn(0x7f147c0b2450 msgr2=0x7f147c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 -- 172.21.15.177:0/1981148726 shutdown_connections 2023-10-25T16:19:24.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.236+0000 7f14825c5640 1 -- 172.21.15.177:0/1981148726 wait complete. 2023-10-25T16:19:24.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 Processor -- start 2023-10-25T16:19:24.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 -- start start 2023-10-25T16:19:24.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 0x7f147c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f147c0cb5f0 0x7f147c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c15b480 0x7f147c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c15c880 con 0x7f147c0c9910 2023-10-25T16:19:24.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c96d0 con 0x7f147c0cb5f0 2023-10-25T16:19:24.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c14fa30 con 0x7f147c15b480 2023-10-25T16:19:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 0x7f147c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 0x7f147c14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38470/0 (socket says 172.21.15.177:38470) 2023-10-25T16:19:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 -- 172.21.15.177:0/3410470579 learned_addr learned my addr 172.21.15.177:0/3410470579 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147b7fe640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f147c0cb5f0 0x7f147c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f1480b62640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c15b480 0x7f147c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 -- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c15b480 msgr2=0x7f147c150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c15b480 0x7f147c150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 -- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f147c0cb5f0 msgr2=0x7f147c152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f147c0cb5f0 0x7f147c152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 -- 172.21.15.177:0/3410470579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740094a0 con 0x7f147c0c9910 2023-10-25T16:19:24.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147b7fe640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f147c0cb5f0 0x7f147c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:24.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f147bfff640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 0x7f147c14ec70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f146c00cb80 tx=0x7f146c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f1478ff9640 1 -- 172.21.15.177:0/3410470579 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00aa50 con 0x7f147c0c9910 2023-10-25T16:19:24.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f1478ff9640 1 -- 172.21.15.177:0/3410470579 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f146c00aca0 con 0x7f147c0c9910 2023-10-25T16:19:24.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c14f1b0 con 0x7f147c0c9910 2023-10-25T16:19:24.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f1478ff9640 1 -- 172.21.15.177:0/3410470579 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c012680 con 0x7f147c0c9910 2023-10-25T16:19:24.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.240+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c14f750 con 0x7f147c0c9910 2023-10-25T16:19:24.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1478ff9640 1 -- 172.21.15.177:0/3410470579 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f146c01a3b0 con 0x7f147c0c9910 2023-10-25T16:19:24.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1478ff9640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1468066470 0x7f1468068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1478ff9640 1 -- 172.21.15.177:0/3410470579 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f146c084260 con 0x7f147c0c9910 2023-10-25T16:19:24.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147b7fe640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1468066470 0x7f1468068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 Processor -- start 2023-10-25T16:19:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 -- start start 2023-10-25T16:19:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147b7fe640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1468066470 0x7f1468068930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b2f40 tx=0x7f1470005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976ff4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff52e0 0x563976faaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x563976fab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976d9fcc0 con 0x563976ff49c0 2023-10-25T16:19:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976e02920 con 0x563976ff52e0 2023-10-25T16:19:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563976dffe50 con 0x563976faaf80 2023-10-25T16:19:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976ff4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976ff4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38474/0 (socket says 172.21.15.177:38474) 2023-10-25T16:19:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 -- 172.21.15.177:0/3330038711 learned_addr learned my addr 172.21.15.177:0/3330038711 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1480b62640 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x563976fab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147b7fe640 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff52e0 0x563976faaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 -- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 msgr2=0x563976fab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x563976fab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 -- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff52e0 msgr2=0x563976faaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff52e0 0x563976faaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 -- 172.21.15.177:0/3330038711 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563976af4890 con 0x563976ff49c0 2023-10-25T16:19:24.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147b7fe640 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff52e0 0x563976faaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f147bfff640 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976ff4da0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f146c082840 tx=0x7f146c054e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e29fc5d94a36e server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1461ffb640 1 -- 172.21.15.177:0/3330038711 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c059580 con 0x563976ff49c0 2023-10-25T16:19:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1461ffb640 1 -- 172.21.15.177:0/3330038711 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f146c084070 con 0x563976ff49c0 2023-10-25T16:19:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.244+0000 7f1461ffb640 1 -- 172.21.15.177:0/3330038711 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c051b40 con 0x563976ff49c0 2023-10-25T16:19:24.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/3330038711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 msgr2=0x563976ff4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976ff4da0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f146c082840 tx=0x7f146c054e50 comp rx=0 tx=0).stop 2023-10-25T16:19:24.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/3330038711 shutdown_connections 2023-10-25T16:19:24.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x563976fab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff52e0 0x563976faaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- 172.21.15.177:0/3330038711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976ff4da0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/3330038711 >> 172.21.15.177:0/3330038711 conn(0x563976fa22f0 msgr2=0x563976fa9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/3330038711 shutdown_connections 2023-10-25T16:19:24.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/3330038711 wait complete. 2023-10-25T16:19:24.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- start start 2023-10-25T16:19:24.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 Processor -- start 2023-10-25T16:19:24.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976faaf80 0x563976ff4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976fb0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563976fb0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976dfb740 con 0x563976ff49c0 2023-10-25T16:19:24.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976dbad10 con 0x563976faaf80 2023-10-25T16:19:24.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563976dba9b0 con 0x563976ff52e0 2023-10-25T16:19:24.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 10 client.0 _ll_register_callbacks cb 0x563976f966c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:19:24.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976fb0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976fb0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38478/0 (socket says 172.21.15.177:38478) 2023-10-25T16:19:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 -- 172.21.15.177:0/1794071402 learned_addr learned my addr 172.21.15.177:0/1794071402 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f1480b62640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563976fb0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147bfff640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976faaf80 0x563976ff4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 -- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 msgr2=0x563976fb0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563976fb0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 -- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976faaf80 msgr2=0x563976ff4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976faaf80 0x563976ff4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 -- 172.21.15.177:0/1794071402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c14f750 con 0x563976ff49c0 2023-10-25T16:19:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f1480b62640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563976fb0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147b7fe640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976fb0320 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1470012960 tx=0x7f1470004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9d049d94c2fd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:19:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 1 -- 172.21.15.177:0/1794071402 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147001ed40 con 0x563976ff49c0 2023-10-25T16:19:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 1 -- 172.21.15.177:0/1794071402 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1470018070 con 0x563976ff49c0 2023-10-25T16:19:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563976daf370 con 0x563976ff49c0 2023-10-25T16:19:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 1 -- 172.21.15.177:0/1794071402 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f147001eea0 con 0x563976ff49c0 2023-10-25T16:19:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 10 client.7854 fetch_fsmap learned FSMap version 44 2023-10-25T16:19:24.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x563976dbd460 con 0x563976ff49c0 2023-10-25T16:19:24.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 1 -- 172.21.15.177:0/1794071402 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x563976daf370 con 0x563976ff49c0 2023-10-25T16:19:24.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 1 -- 172.21.15.177:0/1794071402 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f147001f420 con 0x563976ff49c0 2023-10-25T16:19:24.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 10 client.7854 fetch_fsmap finished waiting for FSMap version 44 2023-10-25T16:19:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 10 client.7854 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-25T16:19:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 20 client.7854 populate_metadata read hostname 'smithi177' 2023-10-25T16:19:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563976fb7440 0x563977006a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 4 client.7854 mds_command: new command op to 7683 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:19:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 --> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563976d952d0 con 0x563976fb7440 2023-10-25T16:19:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147bfff640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563976fb7440 0x563977006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 10 client.7854 ms_handle_connect on v2:172.21.15.177:6834/2032322363 2023-10-25T16:19:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f147bfff640 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563976fb7440 0x563977006a70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbea316668fd2d32 server_cookie=f82a835c7d861eee in_seq=0 out_seq=0 2023-10-25T16:19:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.248+0000 7f145affd640 1 -- 172.21.15.177:0/1794071402 <== mds.0 v2:172.21.15.177:6834/2032322363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563976d952d0 con 0x563976fb7440 2023-10-25T16:19:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f145affd640 10 client.7854 handle_command_reply: tid=0 2023-10-25T16:19:24.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 client.7854 shutdown 2023-10-25T16:19:24.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 msgr2=0x563976fb0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976fb0320 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1470012960 tx=0x7f1470004740 comp rx=0 tx=0).stop 2023-10-25T16:19:24.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 shutdown_connections 2023-10-25T16:19:24.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563976fb7440 0x563977006a70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563976fb0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff49c0 0x563976fb0320 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f145affd640 0 client.7854 ms_handle_reset on v2:172.21.15.177:6834/2032322363 2023-10-25T16:19:24.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 --2- 172.21.15.177:0/1794071402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976faaf80 0x563976ff4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 >> 172.21.15.177:0/1794071402 conn(0x563976fa22f0 msgr2=0x563976fa9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 shutdown_connections 2023-10-25T16:19:24.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 1 -- 172.21.15.177:0/1794071402 wait complete. 2023-10-25T16:19:24.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.252+0000 7f148570f000 20 client.7854 trim_cache size 0 max 16384 2023-10-25T16:19:24.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.264+0000 7f148570f000 1 Processor -- start 2023-10-25T16:19:24.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.264+0000 7f148570f000 1 -- start start 2023-10-25T16:19:24.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 0x563976ff2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x563976ff2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563977004a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976ab5940 con 0x563976faaf80 2023-10-25T16:19:24.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976dfe2a0 con 0x563976ff49c0 2023-10-25T16:19:24.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563976af51b0 con 0x563976ff52e0 2023-10-25T16:19:24.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 0x563976ff2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 0x563976ff2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38482/0 (socket says 172.21.15.177:38482) 2023-10-25T16:19:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 -- 172.21.15.177:0/2562059150 learned_addr learned my addr 172.21.15.177:0/2562059150 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 -- 172.21.15.177:0/2562059150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 msgr2=0x563977004a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563977004a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 -- 172.21.15.177:0/2562059150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 msgr2=0x563976ff2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x563976ff2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 -- 172.21.15.177:0/2562059150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563976da3760 con 0x563976faaf80 2023-10-25T16:19:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 0x563976ff2a00 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f146c055370 tx=0x7f146c0014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2210b41a690777 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f14627fc640 1 -- 172.21.15.177:0/2562059150 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c05d7b0 con 0x563976faaf80 2023-10-25T16:19:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f14627fc640 1 -- 172.21.15.177:0/2562059150 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f146c073320 con 0x563976faaf80 2023-10-25T16:19:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f14627fc640 1 -- 172.21.15.177:0/2562059150 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c059580 con 0x563976faaf80 2023-10-25T16:19:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- 172.21.15.177:0/2562059150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 msgr2=0x563976ff2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 0x563976ff2a00 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f146c055370 tx=0x7f146c0014e0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- 172.21.15.177:0/2562059150 shutdown_connections 2023-10-25T16:19:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976ff52e0 0x563977004a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x563976ff2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- 172.21.15.177:0/2562059150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976faaf80 0x563976ff2a00 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- 172.21.15.177:0/2562059150 >> 172.21.15.177:0/2562059150 conn(0x563976fa22f0 msgr2=0x563976fb5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- 172.21.15.177:0/2562059150 shutdown_connections 2023-10-25T16:19:24.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- 172.21.15.177:0/2562059150 wait complete. 2023-10-25T16:19:24.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- start start 2023-10-25T16:19:24.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 Processor -- start 2023-10-25T16:19:24.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x56397705b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x56397705b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 0x563977006f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976dfa5d0 con 0x563976ff52e0 2023-10-25T16:19:24.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563976dd1a10 con 0x563976ff49c0 2023-10-25T16:19:24.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x563976dff740 con 0x563976faaf80 2023-10-25T16:19:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 10 client.0 _ll_register_callbacks cb 0x563976df9ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:19:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 0x563977006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 0x563977006f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38488/0 (socket says 172.21.15.177:38488) 2023-10-25T16:19:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 -- 172.21.15.177:0/2591635714 learned_addr learned my addr 172.21.15.177:0/2591635714 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:24.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147b7fe640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x56397705b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 -- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 msgr2=0x56397705b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147bfff640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x56397705b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x56397705b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 -- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 msgr2=0x56397705b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:19:24.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x56397705b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 -- 172.21.15.177:0/2591635714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563976af4890 con 0x563976ff52e0 2023-10-25T16:19:24.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f147b7fe640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x56397705b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:24.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f1480b62640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 0x563977006f60 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f14740b0040 tx=0x7f14740a5bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c427ae0501a1db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f145affd640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:19:24.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f145affd640 1 -- 172.21.15.177:0/2591635714 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474004240 con 0x563976ff52e0 2023-10-25T16:19:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f145affd640 1 -- 172.21.15.177:0/2591635714 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14740043a0 con 0x563976ff52e0 2023-10-25T16:19:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563976d936f0 con 0x563976ff52e0 2023-10-25T16:19:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.268+0000 7f145affd640 1 -- 172.21.15.177:0/2591635714 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1474005040 con 0x563976ff52e0 2023-10-25T16:19:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 10 client.7860 fetch_fsmap learned FSMap version 44 2023-10-25T16:19:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x563976af4cc0 con 0x563976ff52e0 2023-10-25T16:19:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f145affd640 1 -- 172.21.15.177:0/2591635714 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x563976d936f0 con 0x563976ff52e0 2023-10-25T16:19:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f145affd640 1 -- 172.21.15.177:0/2591635714 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 44) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f14740bd060 con 0x563976ff52e0 2023-10-25T16:19:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 10 client.7860 fetch_fsmap finished waiting for FSMap version 44 2023-10-25T16:19:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 10 client.7860 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-25T16:19:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 20 client.7860 populate_metadata read hostname 'smithi177' 2023-10-25T16:19:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563977061ec0 0x5639770642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 4 client.7860 mds_command: new command op to 7683 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:19:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 --> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563976df4720 con 0x563977061ec0 2023-10-25T16:19:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f147bfff640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563977061ec0 0x5639770642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f147bfff640 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563977061ec0 0x5639770642b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2957eebc729625b2 server_cookie=52e1348032f8089c in_seq=0 out_seq=0 2023-10-25T16:19:24.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f145affd640 10 client.7860 ms_handle_connect on v2:172.21.15.177:6834/2032322363 2023-10-25T16:19:24.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f145affd640 1 -- 172.21.15.177:0/2591635714 <== mds.0 v2:172.21.15.177:6834/2032322363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x563976df4720 con 0x563977061ec0 2023-10-25T16:19:24.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f145affd640 10 client.7860 handle_command_reply: tid=0 2023-10-25T16:19:24.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 client.7860 shutdown 2023-10-25T16:19:24.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 msgr2=0x563977006f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 0x563977006f60 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f14740b0040 tx=0x7f14740a5bc0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 shutdown_connections 2023-10-25T16:19:24.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:6834/2032322363,v1:172.21.15.177:6835/2032322363] conn(0x563977061ec0 0x5639770642b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563976ff52e0 0x563977006f60 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563976ff49c0 0x56397705b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f145affd640 0 client.7860 ms_handle_reset on v2:172.21.15.177:6834/2032322363 2023-10-25T16:19:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 --2- 172.21.15.177:0/2591635714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x563976faaf80 0x56397705b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 >> 172.21.15.177:0/2591635714 conn(0x563976fa22f0 msgr2=0x563976fb6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 shutdown_connections 2023-10-25T16:19:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 1 -- 172.21.15.177:0/2591635714 wait complete. 2023-10-25T16:19:24.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f148570f000 20 client.7860 trim_cache size 0 max 16384 2023-10-25T16:19:24.300 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:24.300 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:19:24.300 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:19:24.301 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7683, 2023-10-25T16:19:24.301 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:19:24.301 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:19:24.301 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:19:24.301 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1190682859999992, 2023-10-25T16:19:24.302 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 44, 2023-10-25T16:19:24.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 129, 2023-10-25T16:19:24.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 129, 2023-10-25T16:19:24.302 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 14.915084519000001 2023-10-25T16:19:24.302 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1468066470 msgr2=0x7f1468068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1468066470 0x7f1468068930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b2f40 tx=0x7f1470005f40 comp rx=0 tx=0).stop 2023-10-25T16:19:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 msgr2=0x7f147c14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 0x7f147c14ec70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f146c00cb80 tx=0x7f146c00cc70 comp rx=0 tx=0).stop 2023-10-25T16:19:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 shutdown_connections 2023-10-25T16:19:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1468066470 0x7f1468068930 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f147c15b480 0x7f147c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f147c0cb5f0 0x7f147c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 --2- 172.21.15.177:0/3410470579 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f147c0c9910 0x7f147c14ec70 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 >> 172.21.15.177:0/3410470579 conn(0x7f147c0b2450 msgr2=0x7f147c1581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 shutdown_connections 2023-10-25T16:19:24.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.272+0000 7f14825c5640 1 -- 172.21.15.177:0/3410470579 wait complete. 2023-10-25T16:19:24.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:19:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- 172.21.15.177:0/1353470913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80cbfa0 msgr2=0x7f40f80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 --2- 172.21.15.177:0/1353470913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80cbfa0 0x7f40f80aebc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40f4005fd0 tx=0x7f40f401c800 comp rx=0 tx=0).stop 2023-10-25T16:19:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- 172.21.15.177:0/1353470913 shutdown_connections 2023-10-25T16:19:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 --2- 172.21.15.177:0/1353470913 >> v2:172.21.15.184:3300/0 conn(0x7f40f80af100 0x7f40f8158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 --2- 172.21.15.177:0/1353470913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80cbfa0 0x7f40f80aebc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- 172.21.15.177:0/1353470913 >> 172.21.15.177:0/1353470913 conn(0x7f40f80b2450 msgr2=0x7f40f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- 172.21.15.177:0/1353470913 shutdown_connections 2023-10-25T16:19:24.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- 172.21.15.177:0/1353470913 wait complete. 2023-10-25T16:19:24.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 Processor -- start 2023-10-25T16:19:24.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- start start 2023-10-25T16:19:24.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80af100 0x7f40f8146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 0x7f40f8149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40f814e810 0x7f40f8149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81473c0 con 0x7f40f80cbfa0 2023-10-25T16:19:24.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81483d0 con 0x7f40f814e810 2023-10-25T16:19:24.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fff9c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f814b8b0 con 0x7f40f80af100 2023-10-25T16:19:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fd537640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 0x7f40f8149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fd537640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 0x7f40f8149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38492/0 (socket says 172.21.15.177:38492) 2023-10-25T16:19:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.416+0000 7f40fd537640 1 -- 172.21.15.177:0/3260784897 learned_addr learned my addr 172.21.15.177:0/3260784897 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fdd38640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80af100 0x7f40f8146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fe539640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40f814e810 0x7f40f8149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fd537640 1 -- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80af100 msgr2=0x7f40f8146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fd537640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80af100 0x7f40f8146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fd537640 1 -- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40f814e810 msgr2=0x7f40f8149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fd537640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40f814e810 0x7f40f8149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fd537640 1 -- 172.21.15.177:0/3260784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4009450 con 0x7f40f80cbfa0 2023-10-25T16:19:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fd537640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 0x7f40f8149750 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f40f401d0a0 tx=0x7f40f4003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f40b5070 con 0x7f40f80cbfa0 2023-10-25T16:19:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f40f4003e80 con 0x7f40f80cbfa0 2023-10-25T16:19:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f8148670 con 0x7f40f80cbfa0 2023-10-25T16:19:24.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4004230 con 0x7f40f80cbfa0 2023-10-25T16:19:24.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f814bb90 con 0x7f40f80cbfa0 2023-10-25T16:19:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f80af8f0 con 0x7f40f80cbfa0 2023-10-25T16:19:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40f4005030 con 0x7f40f80cbfa0 2023-10-25T16:19:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40ee7fc640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f40dc066470 0x7f40dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:24.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40f411e430 con 0x7f40f80cbfa0 2023-10-25T16:19:24.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fdd38640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f40dc066470 0x7f40dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:24.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.420+0000 7f40fdd38640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f40dc066470 0x7f40dc068930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007fd0 tx=0x7f40e8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:24.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.424+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40f40eb920 con 0x7f40f80cbfa0 2023-10-25T16:19:24.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.596+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40f804daf0 con 0x7f40f80cbfa0 2023-10-25T16:19:24.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.596+0000 7f40ee7fc640 1 -- 172.21.15.177:0/3260784897 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40f4005c40 con 0x7f40f80cbfa0 2023-10-25T16:19:24.597 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:19:24.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f40dc066470 msgr2=0x7f40dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f40dc066470 0x7f40dc068930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007fd0 tx=0x7f40e8009040 comp rx=0 tx=0).stop 2023-10-25T16:19:24.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 msgr2=0x7f40f8149750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:24.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 0x7f40f8149750 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f40f401d0a0 tx=0x7f40f4003c90 comp rx=0 tx=0).stop 2023-10-25T16:19:24.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 shutdown_connections 2023-10-25T16:19:24.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f40dc066470 0x7f40dc068930 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40f814e810 0x7f40f8149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f80cbfa0 0x7f40f8149750 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 --2- 172.21.15.177:0/3260784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f40f80af100 0x7f40f8146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:24.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 >> 172.21.15.177:0/3260784897 conn(0x7f40f80b2450 msgr2=0x7f40f80cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:24.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 shutdown_connections 2023-10-25T16:19:24.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:24.600+0000 7f40fff9c640 1 -- 172.21.15.177:0/3260784897 wait complete. 2023-10-25T16:19:24.614 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:19:24.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:19:24.615 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:19:24.615 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:19:24.616 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:24.616 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:19:24.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:19:24.617 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:19:24.617 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:19:24.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:24.618 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:19:24.624 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:19:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:19:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:19:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:19:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.625 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:19:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:19:24.626 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:19:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:19:24.627 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:19:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:24.627 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:19:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:19:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42153sec preferred_lft 42153sec 2023-10-25T16:19:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:19:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.628 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:19:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:19:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.629 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:19:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:19:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:19:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.630 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:19:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:19:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.631 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:19:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:19:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:24.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:24.632 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:19:24.674 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:19:24.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:24.676 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:19:24.726 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:19:24.726 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:19:24.726 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:19:24.727 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:19:24.727 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:19:24.728 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:19:24.728 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:19:24.729 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:19:24.729 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:19:24.730 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:19:24.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:24.732 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:19:24.732 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:19:24.733 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:19:24.734 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:19:24.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:19:24.736 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:19:24.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:24.803 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:19:24.850 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:19:24.850 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:19:24.851 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:19:24.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:24.852 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:19:24.904 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:19:24.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:19:24.905 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:24.950 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:19:24.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:19:24.951 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:24.998 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:19:25.048 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:19:25.049 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:19:25.049 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:19:25.049 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:19:25.049 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:19:25.050 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:19:25.050 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:19:25.050 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:19:25.050 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:19:25.050 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:19:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:19:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:19:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:19:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:19:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:19:25.052 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:19:25.052 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:19:25.052 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:19:25.052 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:19:25.052 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:19:25.053 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:19:25.053 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:19:25.053 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:19:25.053 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:19:25.053 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:19:25.054 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:19:25.054 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:19:25.054 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:19:25.054 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:19:25.054 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:25.055 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:25.055 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:25.055 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:25.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:25.056 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:19:25.103 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:19:25.104 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:19:25.147 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:19:25.154 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:19:25.154 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:19:25.154 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:19:25.154 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:19:25.155 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:19:25.155 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:19:25.155 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:19:25.155 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:19:25.155 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:19:25.156 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:19:25.156 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:19:25.156 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:19:25.156 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:19:25.156 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:19:25.157 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:19:25.157 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:19:25.157 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:19:25.157 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:19:25.157 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:19:25.158 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:19:25.158 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:19:25.158 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:19:25.158 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:19:25.158 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:19:25.159 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:19:25.159 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:19:25.159 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:19:25.159 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:19:25.159 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:19:25.160 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:25.160 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:25.160 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:25.160 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:25.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:25.162 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:19:25.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:19:25.228+0000 7ff590f14580 -1 init, newargv = 0x560c197a35c0 newargc=15 2023-10-25T16:19:25.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[48190]: starting ceph client 2023-10-25T16:19:25.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[48190]: starting fuse 2023-10-25T16:19:26.311 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:19:26.319 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:19:26.319 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:19:26.319 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:19:26.320 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:19:26.320 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:19:26.320 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:19:26.320 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:19:26.320 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:19:26.321 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:19:26.321 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:19:26.321 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:19:26.322 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:19:26.323 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:19:26.323 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:19:26.323 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:19:26.324 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:19:26.324 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:19:26.324 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:19:26.324 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:19:26.324 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:19:26.324 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:19:26.325 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:19:26.325 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:19:26.325 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:19:26.325 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:19:26.325 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:19:26.326 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:19:26.326 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:19:26.326 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:19:26.326 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:26.326 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:19:26.327 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:26.327 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:19:26.327 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:26.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:26.328 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:19:26.374 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:19:26.375 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:19:26.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:19:26.376 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:19:26.376 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:19:26.376 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:26.377 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:19:26.377 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:26.378 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:19:26.379 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:19:26.379 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:19:26.380 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:19:26.380 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:26.380 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:19:26.381 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:19:26.381 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:19:26.381 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:19:26.382 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:26.382 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:19:26.383 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:19:26.383 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:19:26.383 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:19:26.384 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:19:26.384 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:19:26.385 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:19:26.385 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:19:26.385 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:26.386 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:19:26.386 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:26.499 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:26.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:26.511 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:26.512 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:26.512 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.48190.asok status 2023-10-25T16:19:26.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:26.700 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:19:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:19:26.700 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:19:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:19:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:19:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:19:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "48190", 2023-10-25T16:19:26.701 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:19:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:19:26.702 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:19:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7872, 2023-10-25T16:19:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:19:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:19:26.703 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:19:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 7872 2023-10-25T16:19:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:26.704 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:26.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:26.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.7872 192.168.0.1:0/1529612569", 2023-10-25T16:19:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1529612569", 2023-10-25T16:19:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:19:26.707 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 44, 2023-10-25T16:19:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 129, 2023-10-25T16:19:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:19:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:19:26.708 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:19:26.709 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:26.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:26.720 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:26.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:19:26.721 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:26.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:26.765 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:19:26.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:26.771 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:26.772 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:26.772 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:26.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:26.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:26.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:19:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 -- 172.21.15.177:0/95443668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c06c180 msgr2=0x7fe99c0aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/95443668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c06c180 0x7fe99c0aeca0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fe994009cb0 tx=0x7fe99401cc80 comp rx=0 tx=0).stop 2023-10-25T16:19:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 -- 172.21.15.177:0/95443668 shutdown_connections 2023-10-25T16:19:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/95443668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c06c180 0x7fe99c0aeca0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/95443668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c15bbe0 0x7fe99c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 -- 172.21.15.177:0/95443668 >> 172.21.15.177:0/95443668 conn(0x7fe99c0b2450 msgr2=0x7fe99c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 -- 172.21.15.177:0/95443668 shutdown_connections 2023-10-25T16:19:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.040+0000 7fe9a11a4640 1 -- 172.21.15.177:0/95443668 wait complete. 2023-10-25T16:19:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 Processor -- start 2023-10-25T16:19:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- start start 2023-10-25T16:19:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c06c180 0x7fe99c163c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0c9df0 0x7fe99c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 0x7fe99c14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c14eea0 con 0x7fe99c15bbe0 2023-10-25T16:19:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c155fb0 con 0x7fe99c0c9df0 2023-10-25T16:19:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c15d7f0 con 0x7fe99c06c180 2023-10-25T16:19:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 0x7fe99c14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 0x7fe99c14e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38510/0 (socket says 172.21.15.177:38510) 2023-10-25T16:19:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 -- 172.21.15.177:0/4293689845 learned_addr learned my addr 172.21.15.177:0/4293689845 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 -- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c06c180 msgr2=0x7fe99c163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99ad9d640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c06c180 0x7fe99c163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99a59c640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0c9df0 0x7fe99c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c06c180 0x7fe99c163c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 -- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0c9df0 msgr2=0x7fe99c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0c9df0 0x7fe99c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 -- 172.21.15.177:0/4293689845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940098e0 con 0x7fe99c15bbe0 2023-10-25T16:19:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99a59c640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0c9df0 0x7fe99c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:27.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99ad9d640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c06c180 0x7fe99c163c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:27.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe99b59e640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 0x7fe99c14e1a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fe994009bd0 tx=0x7fe9940a5b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:27.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994004e60 con 0x7fe99c15bbe0 2023-10-25T16:19:27.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe994004000 con 0x7fe99c15bbe0 2023-10-25T16:19:27.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c163250 con 0x7fe99c15bbe0 2023-10-25T16:19:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994004410 con 0x7fe99c15bbe0 2023-10-25T16:19:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c160e90 con 0x7fe99c15bbe0 2023-10-25T16:19:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.044+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c04daf0 con 0x7fe99c15bbe0 2023-10-25T16:19:27.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.048+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9940b4040 con 0x7fe99c15bbe0 2023-10-25T16:19:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.048+0000 7fe9837fe640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe988066470 0x7fe988068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:27.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.048+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe99411e4a0 con 0x7fe99c15bbe0 2023-10-25T16:19:27.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.048+0000 7fe99ad9d640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe988066470 0x7fe988068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:27.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.048+0000 7fe99ad9d640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe988066470 0x7fe988068930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe99c15b200 tx=0x7fe98c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:27.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.052+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9940eb880 con 0x7fe99c15bbe0 2023-10-25T16:19:27.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.244+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe99c154dc0 con 0x7fe99c15bbe0 2023-10-25T16:19:27.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.244+0000 7fe9837fe640 1 -- 172.21.15.177:0/4293689845 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe9940b2060 con 0x7fe99c15bbe0 2023-10-25T16:19:27.244 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:19:27.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe988066470 msgr2=0x7fe988068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:27.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe988066470 0x7fe988068930 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe99c15b200 tx=0x7fe98c008040 comp rx=0 tx=0).stop 2023-10-25T16:19:27.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 msgr2=0x7fe99c14e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:27.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 0x7fe99c14e1a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fe994009bd0 tx=0x7fe9940a5b30 comp rx=0 tx=0).stop 2023-10-25T16:19:27.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 shutdown_connections 2023-10-25T16:19:27.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe988066470 0x7fe988068930 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c15bbe0 0x7fe99c14e1a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0c9df0 0x7fe99c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 --2- 172.21.15.177:0/4293689845 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe99c06c180 0x7fe99c163c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:27.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 >> 172.21.15.177:0/4293689845 conn(0x7fe99c0b2450 msgr2=0x7fe99c14fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:27.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 shutdown_connections 2023-10-25T16:19:27.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:27.248+0000 7fe9a11a4640 1 -- 172.21.15.177:0/4293689845 wait complete. 2023-10-25T16:19:27.263 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:19:27.263 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:19:27.263 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:19:27.264 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:19:27.264 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:27.264 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:19:27.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:19:27.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:19:27.265 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:19:27.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.266 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:19:27.274 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:19:27.275 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:19:27.275 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:19:27.275 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.276 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:19:27.276 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.276 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:19:27.276 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:27.277 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:19:27.277 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:19:27.277 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:27.277 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:19:27.277 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:19:27.278 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:27.278 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:19:27.278 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:27.278 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:19:27.278 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42132sec preferred_lft 42132sec 2023-10-25T16:19:27.279 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:19:27.279 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.279 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:19:27.279 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:27.279 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:19:27.279 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.280 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:19:27.280 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:19:27.280 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:19:27.280 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.280 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:19:27.281 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.281 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:19:27.281 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:27.281 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:19:27.282 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.282 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:19:27.282 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:27.282 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:19:27.282 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:19:27.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.283 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:19:27.329 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:19:27.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.332 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:19:27.385 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:19:27.385 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:19:27.386 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:19:27.386 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:19:27.386 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:19:27.386 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:19:27.386 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:19:27.387 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:19:27.387 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:19:27.387 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:19:27.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.388 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:19:27.388 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:19:27.389 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:19:27.389 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:19:27.389 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:19:27.390 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:19:27.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.465 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:19:27.519 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:19:27.520 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:19:27.520 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:19:27.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:19:27.575 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:19:27.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:19:27.576 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:27.623 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:19:27.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:19:27.624 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:27.671 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:19:27.720 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:19:27.721 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:19:27.721 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:19:27.721 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:19:27.721 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:19:27.722 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:19:27.722 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:19:27.722 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:19:27.722 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:19:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:19:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:19:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:19:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:19:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:19:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:19:27.724 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:19:27.724 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:19:27.724 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:19:27.724 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:19:27.725 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:19:27.725 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:19:27.725 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:19:27.725 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:19:27.726 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:19:27.726 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:19:27.726 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:19:27.726 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:19:27.726 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:19:27.727 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:19:27.727 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:27.727 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:27.727 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:27.727 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:27.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.729 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:19:27.774 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:19:27.774 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:19:27.820 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:19:27.830 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:19:27.831 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:19:27.831 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:19:27.832 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:19:27.832 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:19:27.832 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:19:27.833 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:19:27.833 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:19:27.833 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:19:27.834 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:19:27.834 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:19:27.835 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:19:27.835 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:19:27.835 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:19:27.836 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:19:27.836 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:19:27.836 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:19:27.837 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:19:27.837 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:19:27.838 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:19:27.838 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:19:27.838 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:19:27.839 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:19:27.839 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:19:27.839 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:19:27.840 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:19:27.840 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:19:27.840 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:19:27.840 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:19:27.840 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:27.841 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:27.841 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:27.841 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:27.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:27.843 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:19:27.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:19:27.902+0000 7f26f1149580 -1 init, newargv = 0x555f63f9d3e0 newargc=15 2023-10-25T16:19:27.902 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34972]: starting ceph client 2023-10-25T16:19:27.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34972]: starting fuse 2023-10-25T16:19:28.995 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:19:29.003 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:19:29.003 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:19:29.003 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:19:29.003 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:19:29.004 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:19:29.004 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:19:29.004 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:19:29.004 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:19:29.004 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:19:29.005 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:19:29.005 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:19:29.005 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:19:29.005 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:19:29.005 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:19:29.005 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:19:29.006 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:19:29.006 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:19:29.006 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:19:29.006 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:19:29.006 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:19:29.007 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:19:29.007 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:19:29.007 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:19:29.007 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:19:29.007 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:19:29.008 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:19:29.008 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:19:29.008 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:19:29.008 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:19:29.008 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:29.008 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:19:29.009 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:29.009 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:19:29.009 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:29.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:29.010 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:19:29.058 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:19:29.058 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:19:29.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:19:29.059 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:19:29.060 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:19:29.060 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:19:29.061 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:19:29.061 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:19:29.062 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:19:29.062 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:19:29.063 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:19:29.063 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:19:29.064 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:19:29.064 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:19:29.064 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:19:29.065 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:19:29.065 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:19:29.066 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:19:29.066 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:19:29.066 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:19:29.067 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:19:29.067 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:19:29.067 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:19:29.068 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:19:29.068 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:19:29.069 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:19:29.069 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:19:29.069 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:19:29.070 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:19:29.183 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.34972.asok 2023-10-25T16:19:29.186 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:29.194 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34972.asok 2023-10-25T16:19:29.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:29.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.34972.asok status 2023-10-25T16:19:29.288 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:29.393 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:19:29.394 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:19:29.394 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:19:29.394 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:19:29.394 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:19:29.394 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:19:29.395 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:19:29.395 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "34972", 2023-10-25T16:19:29.395 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:19:29.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:19:29.395 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:19:29.396 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:19:29.396 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 155645, 2023-10-25T16:19:29.396 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:19:29.396 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:19:29.396 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:19:29.397 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 155645 2023-10-25T16:19:29.397 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:19:29.397 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:19:29.397 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:19:29.398 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:29.398 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 4248689770 2023-10-25T16:19:29.398 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:19:29.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:19:29.398 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:19:29.399 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:19:29.399 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:29.399 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 4248689770 2023-10-25T16:19:29.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:19:29.399 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.155645 192.168.0.1:0/4248689770", 2023-10-25T16:19:29.400 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/4248689770", 2023-10-25T16:19:29.400 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:19:29.400 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 44, 2023-10-25T16:19:29.400 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 129, 2023-10-25T16:19:29.400 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:19:29.401 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:19:29.401 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:19:29.401 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:19:29.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:29.414 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:29.416 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:19:29.416 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:29.461 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:29.462 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:19:29.462 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:29.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:29.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:29.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:29.554 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:29.555 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:29.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:29.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- 172.21.15.177:0/2339920816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 msgr2=0x7fad9c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:29.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2339920816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fad9c005190 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fadac001da0 tx=0x7fadac01cb20 comp rx=0 tx=0).stop 2023-10-25T16:19:29.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb2d9d640 1 -- 172.21.15.177:0/2339920816 reap_dead start 2023-10-25T16:19:29.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- 172.21.15.177:0/2339920816 shutdown_connections 2023-10-25T16:19:29.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- 172.21.15.177:0/2339920816 >> 172.21.15.177:0/2339920816 conn(0x7fadb40b2450 msgr2=0x7fadb40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:29.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- 172.21.15.177:0/2339920816 shutdown_connections 2023-10-25T16:19:29.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- 172.21.15.177:0/2339920816 wait complete. 2023-10-25T16:19:29.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 Processor -- start 2023-10-25T16:19:29.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- start start 2023-10-25T16:19:29.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fadb41e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:29.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadb414b580 0x7fadb414ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:29.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadb414df10 0x7fadb414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:29.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb41e2f30 con 0x7fad9c004d10 2023-10-25T16:19:29.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb414bf40 con 0x7fadb414b580 2023-10-25T16:19:29.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb8f71640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4139560 con 0x7fadb414df10 2023-10-25T16:19:29.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fadb41e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:29.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fadb41e29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38526/0 (socket says 172.21.15.177:38526) 2023-10-25T16:19:29.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 -- 172.21.15.177:0/2670431198 learned_addr learned my addr 172.21.15.177:0/2670431198 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:29.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb1d9b640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadb414b580 0x7fadb414ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:29.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb2d9d640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadb414df10 0x7fadb414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:29.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 -- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadb414df10 msgr2=0x7fadb414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:29.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadb414df10 0x7fadb414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:29.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 -- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadb414b580 msgr2=0x7fadb414ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:29.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadb414b580 0x7fadb414ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:29.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb259c640 1 -- 172.21.15.177:0/2670431198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb414e8d0 con 0x7fad9c004d10 2023-10-25T16:19:29.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.700+0000 7fadb1d9b640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadb414b580 0x7fadb414ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:29.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fadb259c640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fadb41e29f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fada4011a50 tx=0x7fada4011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:29.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada400fd90 con 0x7fad9c004d10 2023-10-25T16:19:29.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fada4012450 con 0x7fad9c004d10 2023-10-25T16:19:29.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb41e3120 con 0x7fad9c004d10 2023-10-25T16:19:29.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada4012860 con 0x7fad9c004d10 2023-10-25T16:19:29.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb41e36e0 con 0x7fad9c004d10 2023-10-25T16:19:29.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb404daf0 con 0x7fad9c004d10 2023-10-25T16:19:29.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fada40129c0 con 0x7fad9c004d10 2023-10-25T16:19:29.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fada2ffd640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fad940664a0 0x7fad94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:29.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fada4084d90 con 0x7fad9c004d10 2023-10-25T16:19:29.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fadb1d9b640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fad940664a0 0x7fad94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:29.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.704+0000 7fadb1d9b640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fad940664a0 0x7fad94068960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fada8001190 tx=0x7fada8001000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:29.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.708+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fada40522c0 con 0x7fad9c004d10 2023-10-25T16:19:29.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.892+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadb40cd2c0 con 0x7fad9c004d10 2023-10-25T16:19:29.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.892+0000 7fada2ffd640 1 -- 172.21.15.177:0/2670431198 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fada401f090 con 0x7fad9c004d10 2023-10-25T16:19:29.892 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:29.893 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:29.893 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:29.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fad940664a0 msgr2=0x7fad94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:29.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fad940664a0 0x7fad94068960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fada8001190 tx=0x7fada8001000 comp rx=0 tx=0).stop 2023-10-25T16:19:29.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 msgr2=0x7fadb41e29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:29.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fadb41e29f0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fada4011a50 tx=0x7fada4011f10 comp rx=0 tx=0).stop 2023-10-25T16:19:29.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 shutdown_connections 2023-10-25T16:19:29.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fad940664a0 0x7fad94068960 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:29.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadb414df10 0x7fadb414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:29.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadb414b580 0x7fadb414ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:29.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 --2- 172.21.15.177:0/2670431198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad9c004d10 0x7fadb41e29f0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:29.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 >> 172.21.15.177:0/2670431198 conn(0x7fadb40b2450 msgr2=0x7fadb4158560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:29.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 shutdown_connections 2023-10-25T16:19:29.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:29.896+0000 7fadb8f71640 1 -- 172.21.15.177:0/2670431198 wait complete. 2023-10-25T16:19:29.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-10-25T16:19:30.045 INFO:teuthology.orchestra.run.smithi177.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":7683,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.879959676,"mdsmap_epoch":44,"osdmap_epoch":129,"osdmap_epoch_barrier":129,"uptime":20.675981847999999} 2023-10-25T16:19:30.046 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 7683, "mdsmap_epoch": 44, "osdmap_epoch": 129, "osdmap_epoch_barrier": 129, "rank_uptime": 14.879959676, "state": "up:active", "uptime": 20.675981848, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:19:30.046 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-25T16:19:30.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 -- 172.21.15.177:0/1103345197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d815c890 msgr2=0x7f38d815d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:30.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 --2- 172.21.15.177:0/1103345197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d815c890 0x7f38d815d0d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f38d80d1200 tx=0x7f38d401cd60 comp rx=0 tx=0).stop 2023-10-25T16:19:30.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 -- 172.21.15.177:0/1103345197 shutdown_connections 2023-10-25T16:19:30.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 --2- 172.21.15.177:0/1103345197 >> v2:172.21.15.184:3300/0 conn(0x7f38d80cbdf0 0x7f38d80cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 --2- 172.21.15.177:0/1103345197 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80cdbb0 0x7f38d80ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 --2- 172.21.15.177:0/1103345197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d815c890 0x7f38d815d0d0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 -- 172.21.15.177:0/1103345197 >> 172.21.15.177:0/1103345197 conn(0x7f38d809a590 msgr2=0x7f38d80d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:30.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 -- 172.21.15.177:0/1103345197 shutdown_connections 2023-10-25T16:19:30.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 -- 172.21.15.177:0/1103345197 wait complete. 2023-10-25T16:19:30.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 Processor -- start 2023-10-25T16:19:30.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.176+0000 7f38e07ae640 1 -- start start 2023-10-25T16:19:30.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80cbdf0 0x7f38d80b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:30.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 0x7f38d80b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:30.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d815c890 0x7f38d8159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:30.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d81591a0 con 0x7f38d80cdbb0 2023-10-25T16:19:30.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8151c60 con 0x7f38d815c890 2023-10-25T16:19:30.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8158be0 con 0x7f38d80cbdf0 2023-10-25T16:19:30.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 0x7f38d80b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:30.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 0x7f38d80b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38554/0 (socket says 172.21.15.177:38554) 2023-10-25T16:19:30.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 -- 172.21.15.177:0/678437516 learned_addr learned my addr 172.21.15.177:0/678437516 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:30.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ded4b640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d815c890 0x7f38d8159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:30.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38de54a640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80cbdf0 0x7f38d80b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:30.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 -- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80cbdf0 msgr2=0x7f38d80b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:30.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80cbdf0 0x7f38d80b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 -- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d815c890 msgr2=0x7f38d8159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:30.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d815c890 0x7f38d8159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 -- 172.21.15.177:0/678437516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40098e0 con 0x7f38d80cdbb0 2023-10-25T16:19:30.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38ddd49640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 0x7f38d80b5c20 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c9a0 tx=0x7f38d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:30.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0007bb0 con 0x7f38d80cdbb0 2023-10-25T16:19:30.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f38d0007e20 con 0x7f38d80cdbb0 2023-10-25T16:19:30.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d8158ec0 con 0x7f38d80cdbb0 2023-10-25T16:19:30.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0005280 con 0x7f38d80cdbb0 2023-10-25T16:19:30.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d81518f0 con 0x7f38d80cdbb0 2023-10-25T16:19:30.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d8151470 con 0x7f38d80cdbb0 2023-10-25T16:19:30.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f38d00053e0 con 0x7f38d80cdbb0 2023-10-25T16:19:30.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38caffd640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38bc066470 0x7f38bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:30.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38d0084790 con 0x7f38d80cdbb0 2023-10-25T16:19:30.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.180+0000 7f38de54a640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38bc066470 0x7f38bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:30.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.184+0000 7f38de54a640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38bc066470 0x7f38bc068930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f38d40af000 tx=0x7f38d401b5a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:30.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.184+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38d8151470 con 0x7f38d80cdbb0 2023-10-25T16:19:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.344+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f38d8151470 con 0x7f38d80cdbb0 2023-10-25T16:19:30.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.812+0000 7f38caffd640 1 -- 172.21.15.177:0/678437516 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v130) v1 ==== 181+0+0 (secure 0 0 0) 0x7f38d8151470 con 0x7f38d80cdbb0 2023-10-25T16:19:30.812 INFO:teuthology.orchestra.run.smithi177.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-25T16:19:30.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38bc066470 msgr2=0x7f38bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:30.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38bc066470 0x7f38bc068930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f38d40af000 tx=0x7f38d401b5a0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 msgr2=0x7f38d80b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:30.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 0x7f38d80b5c20 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c9a0 tx=0x7f38d000ce60 comp rx=0 tx=0).stop 2023-10-25T16:19:30.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 shutdown_connections 2023-10-25T16:19:30.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f38bc066470 0x7f38bc068930 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d815c890 0x7f38d8159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d80cdbb0 0x7f38d80b5c20 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 --2- 172.21.15.177:0/678437516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d80cbdf0 0x7f38d80b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:30.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 >> 172.21.15.177:0/678437516 conn(0x7f38d809a590 msgr2=0x7f38d80d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:30.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 shutdown_connections 2023-10-25T16:19:30.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30.816+0000 7f38e07ae640 1 -- 172.21.15.177:0/678437516 wait complete. 2023-10-25T16:19:30.840 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:19:30.840 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:30.840 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-25T16:19:30.841 DEBUG:teuthology.orchestra.run.smithi177:> os.fchmod(fd, 0O666) 2023-10-25T16:19:30.841 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(fd) 2023-10-25T16:19:30.841 DEBUG:teuthology.orchestra.run.smithi177:> os.close(fd) 2023-10-25T16:19:30.842 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:30.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:30.924 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:19:30.924 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:19:30.925 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:19:30.925 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:30.925 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:19:30.926 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:30.926 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:19:30.926 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:19:30.927 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:19:30.927 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:19:30.927 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:30.928 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:19:30.928 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:19:30.928 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:19:30.929 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:19:30.929 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:30.930 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:19:30.930 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:19:30.930 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:19:30.931 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:19:30.931 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:19:30.931 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:19:30.932 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:19:30.932 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:19:30.932 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:30.933 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:19:30.933 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:31.042 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:31.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:31.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:31.054 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:31.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.48190.asok status 2023-10-25T16:19:31.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:31.247 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:31.247 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:19:31.248 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:19:31.248 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:19:31.248 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:19:31.248 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:19:31.248 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:19:31.249 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "48190", 2023-10-25T16:19:31.249 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:19:31.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:31.249 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 1, 2023-10-25T16:19:31.249 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:19:31.250 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7872, 2023-10-25T16:19:31.250 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:19:31.250 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:19:31.250 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:19:31.250 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 7872 2023-10-25T16:19:31.251 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:31.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:31.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:31.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:31.251 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:31.252 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:31.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:31.252 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:31.252 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:31.252 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:31.253 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:31.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:31.253 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.7872 192.168.0.1:0/1529612569", 2023-10-25T16:19:31.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1529612569", 2023-10-25T16:19:31.254 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 2, 2023-10-25T16:19:31.254 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 44, 2023-10-25T16:19:31.254 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 129, 2023-10-25T16:19:31.254 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 129, 2023-10-25T16:19:31.255 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:19:31.255 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:19:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:31.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:31.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-10-25T16:19:31.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:19:31.375 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:19:31.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 -- 172.21.15.177:0/1176430922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c0c93f0 msgr2=0x7fe88c0c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 --2- 172.21.15.177:0/1176430922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c0c93f0 0x7fe88c0c97f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0cdd20 tx=0x7fe87c01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 -- 172.21.15.177:0/1176430922 shutdown_connections 2023-10-25T16:19:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 --2- 172.21.15.177:0/1176430922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c0c93f0 0x7fe88c0c97f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 --2- 172.21.15.177:0/1176430922 >> v2:172.21.15.184:3300/0 conn(0x7fe88c0cca30 0x7fe88c0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 -- 172.21.15.177:0/1176430922 >> 172.21.15.177:0/1176430922 conn(0x7fe88c0ce000 msgr2=0x7fe88c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 -- 172.21.15.177:0/1176430922 shutdown_connections 2023-10-25T16:19:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 -- 172.21.15.177:0/1176430922 wait complete. 2023-10-25T16:19:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 Processor -- start 2023-10-25T16:19:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.396+0000 7fe8910b2640 1 -- start start 2023-10-25T16:19:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0c93f0 0x7fe88c145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0cca30 0x7fe88c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 0x7fe88c0c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c151920 con 0x7fe88c155db0 2023-10-25T16:19:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c151c00 con 0x7fe88c0c93f0 2023-10-25T16:19:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c151ee0 con 0x7fe88c0cca30 2023-10-25T16:19:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 0x7fe88c0c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 0x7fe88c0c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53750/0 (socket says 172.21.15.177:53750) 2023-10-25T16:19:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 -- 172.21.15.177:0/600297902 learned_addr learned my addr 172.21.15.177:0/600297902 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88ad9d640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0c93f0 0x7fe88c145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 -- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0cca30 msgr2=0x7fe88c1571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0cca30 0x7fe88c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 -- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0c93f0 msgr2=0x7fe88c145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0c93f0 0x7fe88c145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 -- 172.21.15.177:0/600297902 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0094a0 con 0x7fe88c155db0 2023-10-25T16:19:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88b59e640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 0x7fe88c0c7330 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009790 tx=0x7fe87c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:31.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c003800 con 0x7fe88c155db0 2023-10-25T16:19:31.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe87c003a50 con 0x7fe88c155db0 2023-10-25T16:19:31.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c1521c0 con 0x7fe88c155db0 2023-10-25T16:19:31.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c003e60 con 0x7fe88c155db0 2023-10-25T16:19:31.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c146630 con 0x7fe88c155db0 2023-10-25T16:19:31.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c06fe60 con 0x7fe88c155db0 2023-10-25T16:19:31.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe87c0a57f0 con 0x7fe88c155db0 2023-10-25T16:19:31.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8737fe640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8780664a0 0x7fe878068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe87c11ea90 con 0x7fe88c155db0 2023-10-25T16:19:31.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.400+0000 7fe88ad9d640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8780664a0 0x7fe878068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.404+0000 7fe88ad9d640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8780664a0 0x7fe878068960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8840020a0 tx=0x7fe884009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:31.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.404+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe87c0ebf10 con 0x7fe88c155db0 2023-10-25T16:19:31.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.568+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7fe88c04daf0 con 0x7fe88c155db0 2023-10-25T16:19:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.824+0000 7fe8737fe640 1 -- 172.21.15.177:0/600297902 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v131) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe87c0b2080 con 0x7fe88c155db0 2023-10-25T16:19:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:pauserd,pausewr is set 2023-10-25T16:19:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8780664a0 msgr2=0x7fe878068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8780664a0 0x7fe878068960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe8840020a0 tx=0x7fe884009040 comp rx=0 tx=0).stop 2023-10-25T16:19:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 msgr2=0x7fe88c0c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 0x7fe88c0c7330 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009790 tx=0x7fe87c005dc0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 shutdown_connections 2023-10-25T16:19:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8780664a0 0x7fe878068960 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe88c155db0 0x7fe88c0c7330 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe88c0cca30 0x7fe88c1571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 --2- 172.21.15.177:0/600297902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe88c0c93f0 0x7fe88c145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 >> 172.21.15.177:0/600297902 conn(0x7fe88c0ce000 msgr2=0x7fe88c14fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 shutdown_connections 2023-10-25T16:19:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.828+0000 7fe8910b2640 1 -- 172.21.15.177:0/600297902 wait complete. 2023-10-25T16:19:31.849 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-10-25T16:19:31.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/1123561963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e24005190 msgr2=0x7f6e2400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/1123561963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e24005190 0x7f6e2400b990 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6e30001da0 tx=0x7f6e3001cb20 comp rx=0 tx=0).stop 2023-10-25T16:19:31.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/1123561963 shutdown_connections 2023-10-25T16:19:31.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/1123561963 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e24005190 0x7f6e2400b990 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/1123561963 >> 172.21.15.177:0/1123561963 conn(0x7f6e380b2450 msgr2=0x7f6e380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:31.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/1123561963 shutdown_connections 2023-10-25T16:19:31.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/1123561963 wait complete. 2023-10-25T16:19:31.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 Processor -- start 2023-10-25T16:19:31.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- start start 2023-10-25T16:19:31.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e24005190 0x7f6e3814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e3814ee90 0x7f6e380ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 0x7f6e381e4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380cd530 con 0x7f6e380cd0b0 2023-10-25T16:19:31.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e381595b0 con 0x7f6e24005190 2023-10-25T16:19:31.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38159890 con 0x7f6e3814ee90 2023-10-25T16:19:31.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 0x7f6e381e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 0x7f6e381e4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53760/0 (socket says 172.21.15.177:53760) 2023-10-25T16:19:31.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 -- 172.21.15.177:0/3341778028 learned_addr learned my addr 172.21.15.177:0/3341778028 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:31.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3d33f640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e24005190 0x7f6e3814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3cb3e640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e3814ee90 0x7f6e380ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 -- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e3814ee90 msgr2=0x7f6e380ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e3814ee90 0x7f6e380ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 -- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e24005190 msgr2=0x7f6e3814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:31.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e24005190 0x7f6e3814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:31.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38159b70 con 0x7f6e380cd0b0 2023-10-25T16:19:31.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3db40640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 0x7f6e381e4850 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001d3c0 tx=0x7f6e300a6f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:31.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30003b80 con 0x7f6e380cd0b0 2023-10-25T16:19:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e30003ce0 con 0x7f6e380cd0b0 2023-10-25T16:19:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e38159e50 con 0x7f6e380cd0b0 2023-10-25T16:19:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30006380 con 0x7f6e380cd0b0 2023-10-25T16:19:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.984+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e381e5560 con 0x7f6e380cd0b0 2023-10-25T16:19:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e380b0120 con 0x7f6e380cd0b0 2023-10-25T16:19:31.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e300064e0 con 0x7f6e380cd0b0 2023-10-25T16:19:31.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e2dffb640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e1c0664a0 0x7f6e1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:31.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e3011eec0 con 0x7f6e380cd0b0 2023-10-25T16:19:31.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=132+}) v3 -- 0x7f6e1c06dfd0 con 0x7f6e380cd0b0 2023-10-25T16:19:31.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e3d33f640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e1c0664a0 0x7f6e1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:31.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.988+0000 7f6e3d33f640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e1c0664a0 0x7f6e1c068960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c10 tx=0x7f6e34001610 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:31.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:31.992+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e300ec480 con 0x7f6e380cd0b0 2023-10-25T16:19:32.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.156+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f6e3804daf0 con 0x7f6e380cd0b0 2023-10-25T16:19:32.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.824+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v132) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e300efaa0 con 0x7f6e380cd0b0 2023-10-25T16:19:32.826 INFO:teuthology.orchestra.run.smithi177.stderr:pauserd,pausewr is unset 2023-10-25T16:19:32.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.828+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(132..132 src has 1..132) v4 ==== 288+0+0 (secure 0 0 0) 0x7f6e300f0140 con 0x7f6e380cd0b0 2023-10-25T16:19:32.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.828+0000 7f6e2dffb640 1 -- 172.21.15.177:0/3341778028 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=133}) v3 -- 0x7f6e1c06e890 con 0x7f6e380cd0b0 2023-10-25T16:19:32.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e1c0664a0 msgr2=0x7f6e1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:32.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e1c0664a0 0x7f6e1c068960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6e34000c10 tx=0x7f6e34001610 comp rx=0 tx=0).stop 2023-10-25T16:19:32.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 msgr2=0x7f6e381e4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:32.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 0x7f6e381e4850 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001d3c0 tx=0x7f6e300a6f00 comp rx=0 tx=0).stop 2023-10-25T16:19:32.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 shutdown_connections 2023-10-25T16:19:32.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e1c0664a0 0x7f6e1c068960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e380cd0b0 0x7f6e381e4850 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e3814ee90 0x7f6e380ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 --2- 172.21.15.177:0/3341778028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e24005190 0x7f6e3814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 >> 172.21.15.177:0/3341778028 conn(0x7f6e380b2450 msgr2=0x7f6e380ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:32.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 shutdown_connections 2023-10-25T16:19:32.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.832+0000 7f6e3f5a3640 1 -- 172.21.15.177:0/3341778028 wait complete. 2023-10-25T16:19:32.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:32.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.980+0000 7fb1ef067640 1 -- 172.21.15.177:0/2183437604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 msgr2=0x7fb1e815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:32.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.980+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2183437604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e815afb0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800ad80 tx=0x7fb1d801dfc0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2183437604 shutdown_connections 2023-10-25T16:19:32.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2183437604 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e80c9df0 0x7fb1e80af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2183437604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e815afb0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2183437604 >> 172.21.15.177:0/2183437604 conn(0x7fb1e80b2450 msgr2=0x7fb1e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:32.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2183437604 shutdown_connections 2023-10-25T16:19:32.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2183437604 wait complete. 2023-10-25T16:19:32.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 Processor -- start 2023-10-25T16:19:32.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- start start 2023-10-25T16:19:32.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e806d660 0x7fb1e813cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:32.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e80c9df0 0x7fb1e813a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:32.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:32.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e8070480 con 0x7fb1e815bbe0 2023-10-25T16:19:32.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e813ac10 con 0x7fb1e806d660 2023-10-25T16:19:32.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e813d1e0 con 0x7fb1e80c9df0 2023-10-25T16:19:32.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:32.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53770/0 (socket says 172.21.15.177:53770) 2023-10-25T16:19:32.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 -- 172.21.15.177:0/2747472229 learned_addr learned my addr 172.21.15.177:0/2747472229 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:32.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1e7fff640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e80c9df0 0x7fb1e813a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:32.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ece03640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e806d660 0x7fb1e813cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:32.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 -- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e80c9df0 msgr2=0x7fb1e813a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:32.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e80c9df0 0x7fb1e813a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 -- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e806d660 msgr2=0x7fb1e813cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:32.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e806d660 0x7fb1e813cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:32.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 -- 172.21.15.177:0/2747472229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d800a990 con 0x7fb1e815bbe0 2023-10-25T16:19:32.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ed604640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e806ff40 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c940 tx=0x7fb1e000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:32.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0004220 con 0x7fb1e815bbe0 2023-10-25T16:19:32.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb1e0004470 con 0x7fb1e815bbe0 2023-10-25T16:19:32.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0007bf0 con 0x7fb1e815bbe0 2023-10-25T16:19:32.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e813d4c0 con 0x7fb1e815bbe0 2023-10-25T16:19:32.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e813da80 con 0x7fb1e815bbe0 2023-10-25T16:19:32.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.984+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e813ade0 con 0x7fb1e815bbe0 2023-10-25T16:19:32.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.988+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1e0007d50 con 0x7fb1e815bbe0 2023-10-25T16:19:32.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.988+0000 7fb1e57fa640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1d40664a0 0x7fb1d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:32.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.988+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1e0083fa0 con 0x7fb1e815bbe0 2023-10-25T16:19:32.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.988+0000 7fb1ece03640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1d40664a0 0x7fb1d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:32.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.988+0000 7fb1ece03640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1d40664a0 0x7fb1d4068960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0016c0 tx=0x7fb1dc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:32.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:32.992+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1e00b5090 con 0x7fb1e815bbe0 2023-10-25T16:19:33.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.148+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1e804daf0 con 0x7fb1e815bbe0 2023-10-25T16:19:33.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1e57fa640 1 -- 172.21.15.177:0/2747472229 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16551 (secure 0 0 0) 0x7fb1e001d020 con 0x7fb1e815bbe0 2023-10-25T16:19:33.150 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:33.151 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":132,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:32.826137+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1d40664a0 msgr2=0x7fb1d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1d40664a0 0x7fb1d4068960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0016c0 tx=0x7fb1dc009040 comp rx=0 tx=0).stop 2023-10-25T16:19:33.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 msgr2=0x7fb1e806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e806ff40 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c940 tx=0x7fb1e000ce00 comp rx=0 tx=0).stop 2023-10-25T16:19:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 shutdown_connections 2023-10-25T16:19:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1d40664a0 0x7fb1d4068960 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e815bbe0 0x7fb1e806ff40 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1e80c9df0 0x7fb1e813a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 --2- 172.21.15.177:0/2747472229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1e806d660 0x7fb1e813cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 >> 172.21.15.177:0/2747472229 conn(0x7fb1e80b2450 msgr2=0x7fb1e80acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:33.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 shutdown_connections 2023-10-25T16:19:33.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.152+0000 7fb1ef067640 1 -- 172.21.15.177:0/2747472229 wait complete. 2023-10-25T16:19:33.169 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:19:33.170 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:33.170 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-25T16:19:33.170 DEBUG:teuthology.orchestra.run.smithi177:> os.fchmod(fd, 0O666) 2023-10-25T16:19:33.171 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(fd) 2023-10-25T16:19:33.171 DEBUG:teuthology.orchestra.run.smithi177:> os.close(fd) 2023-10-25T16:19:33.171 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:33.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:33.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:19:33.240 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:19:33.240 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:19:33.240 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:33.241 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:19:33.241 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:33.241 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:19:33.242 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:19:33.242 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:19:33.242 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:19:33.243 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:33.243 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:19:33.244 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:19:33.244 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:19:33.244 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:19:33.245 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:33.245 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:19:33.245 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:19:33.246 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:19:33.246 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:19:33.246 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:19:33.247 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:19:33.247 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:19:33.247 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:19:33.248 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:33.248 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:19:33.249 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:33.351 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:33.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:33.362 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:33.363 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:33.363 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.48190.asok status 2023-10-25T16:19:33.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:33.558 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:33.558 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:19:33.559 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:19:33.559 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:19:33.559 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:19:33.559 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:19:33.559 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:19:33.560 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "48190", 2023-10-25T16:19:33.560 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:19:33.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:33.560 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 1, 2023-10-25T16:19:33.561 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:19:33.561 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7872, 2023-10-25T16:19:33.561 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:19:33.561 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:19:33.562 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:19:33.562 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 7872 2023-10-25T16:19:33.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:33.562 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:33.563 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:33.563 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:33.563 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:33.563 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:33.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:33.564 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:33.564 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:33.564 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:33.564 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:33.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:33.565 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.7872 192.168.0.1:0/1529612569", 2023-10-25T16:19:33.565 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1529612569", 2023-10-25T16:19:33.565 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 2, 2023-10-25T16:19:33.565 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 44, 2023-10-25T16:19:33.566 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 129, 2023-10-25T16:19:33.566 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 129, 2023-10-25T16:19:33.566 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:19:33.567 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:19:33.567 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:33.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:33.579 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:33.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- 172.21.15.177:0/379735122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 msgr2=0x7fb1e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 --2- 172.21.15.177:0/379735122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1e8003dd0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00bb10 tx=0x7fb1ec01cd80 comp rx=0 tx=0).stop 2023-10-25T16:19:33.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fad9d640 1 -- 172.21.15.177:0/379735122 reap_dead start 2023-10-25T16:19:33.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- 172.21.15.177:0/379735122 shutdown_connections 2023-10-25T16:19:33.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- 172.21.15.177:0/379735122 >> 172.21.15.177:0/379735122 conn(0x7fb1fc09a5c0 msgr2=0x7fb1fc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:33.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- 172.21.15.177:0/379735122 shutdown_connections 2023-10-25T16:19:33.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- 172.21.15.177:0/379735122 wait complete. 2023-10-25T16:19:33.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 Processor -- start 2023-10-25T16:19:33.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- start start 2023-10-25T16:19:33.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1fc14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:33.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1fc0b5b00 0x7fb1fc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:33.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1fc0ca300 0x7fb1fc0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:33.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0b64c0 con 0x7fb1e80039b0 2023-10-25T16:19:33.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1573e0 con 0x7fb1fc0b5b00 2023-10-25T16:19:33.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb200f2a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc156af0 con 0x7fb1fc0ca300 2023-10-25T16:19:33.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1fc14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:33.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1fc14e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53788/0 (socket says 172.21.15.177:53788) 2023-10-25T16:19:33.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 -- 172.21.15.177:0/2973644368 learned_addr learned my addr 172.21.15.177:0/2973644368 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:33.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1f3fff640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1fc0b5b00 0x7fb1fc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:33.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 -- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1fc0ca300 msgr2=0x7fb1fc0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fad9d640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1fc0ca300 0x7fb1fc0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:33.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1fc0ca300 0x7fb1fc0ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 -- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1fc0b5b00 msgr2=0x7fb1fc0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.704+0000 7fb1fa59c640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1fc0b5b00 0x7fb1fc0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1fa59c640 1 -- 172.21.15.177:0/2973644368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc156d90 con 0x7fb1e80039b0 2023-10-25T16:19:33.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1fa59c640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1fc14e810 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec01cbb0 tx=0x7fb1ec0a5f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:33.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec004020 con 0x7fb1e80039b0 2023-10-25T16:19:33.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb1ec004270 con 0x7fb1e80039b0 2023-10-25T16:19:33.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc157070 con 0x7fb1e80039b0 2023-10-25T16:19:33.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec005180 con 0x7fb1e80039b0 2023-10-25T16:19:33.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc14ed50 con 0x7fb1e80039b0 2023-10-25T16:19:33.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc04daf0 con 0x7fb1e80039b0 2023-10-25T16:19:33.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1ec005300 con 0x7fb1e80039b0 2023-10-25T16:19:33.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f2ffd640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:33.714 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1ec11e6d0 con 0x7fb1e80039b0 2023-10-25T16:19:33.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f3fff640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:33.715 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.708+0000 7fb1f3fff640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1dc0664a0 0x7fb1dc068960 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0b6e70 tx=0x7fb1e4006af0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:33.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.712+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1ec0ebb60 con 0x7fb1e80039b0 2023-10-25T16:19:33.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.900+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1fc0ce930 con 0x7fb1e80039b0 2023-10-25T16:19:33.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.900+0000 7fb1f2ffd640 1 -- 172.21.15.177:0/2973644368 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7fb1ec0ef180 con 0x7fb1e80039b0 2023-10-25T16:19:33.901 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:33.901 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:33.901 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:33.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1dc0664a0 msgr2=0x7fb1dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1dc0664a0 0x7fb1dc068960 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0b6e70 tx=0x7fb1e4006af0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 msgr2=0x7fb1fc14e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:33.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1fc14e810 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec01cbb0 tx=0x7fb1ec0a5f00 comp rx=0 tx=0).stop 2023-10-25T16:19:33.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 shutdown_connections 2023-10-25T16:19:33.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1fc0ca300 0x7fb1fc0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1fc0b5b00 0x7fb1fc0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 --2- 172.21.15.177:0/2973644368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1e80039b0 0x7fb1fc14e810 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:33.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 >> 172.21.15.177:0/2973644368 conn(0x7fb1fc09a5c0 msgr2=0x7fb1fc156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:33.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 shutdown_connections 2023-10-25T16:19:33.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:33.904+0000 7fb200f2a640 1 -- 172.21.15.177:0/2973644368 wait complete. 2023-10-25T16:19:33.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 132 2023-10-25T16:19:34.055 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-25T16:19:34.055 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:19:34.056 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:34.056 DEBUG:teuthology.orchestra.run.smithi177:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-10-25T16:19:34.057 DEBUG:teuthology.orchestra.run.smithi177:> os.fchmod(fd, 0O666) 2023-10-25T16:19:34.057 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(fd) 2023-10-25T16:19:34.058 DEBUG:teuthology.orchestra.run.smithi177:> os.close(fd) 2023-10-25T16:19:34.058 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:34.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:34.137 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:19:34.138 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:19:34.138 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:19:34.138 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:34.139 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:19:34.139 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.139 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:19:34.140 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:19:34.140 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:19:34.141 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:19:34.141 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.141 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:19:34.142 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:19:34.142 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:19:34.143 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:19:34.143 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.143 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:19:34.144 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:19:34.144 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:19:34.144 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:19:34.145 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:19:34.145 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:19:34.146 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:19:34.146 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:19:34.146 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.147 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:19:34.147 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:34.259 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:34.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:34.271 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:34.271 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:34.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.48190.asok status 2023-10-25T16:19:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:34.453 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:34.454 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:19:34.454 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:19:34.454 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:19:34.455 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:19:34.455 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:19:34.455 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:19:34.455 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "48190", 2023-10-25T16:19:34.455 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:19:34.456 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.456 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 2, 2023-10-25T16:19:34.456 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:19:34.456 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7872, 2023-10-25T16:19:34.456 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:19:34.457 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:19:34.457 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:19:34.457 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 7872 2023-10-25T16:19:34.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.457 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:34.457 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:34.458 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:34.458 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:34.458 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:34.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.459 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:34.459 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:34.459 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:34.459 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:34.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.460 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.7872 192.168.0.1:0/1529612569", 2023-10-25T16:19:34.460 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1529612569", 2023-10-25T16:19:34.460 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 3, 2023-10-25T16:19:34.460 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 44, 2023-10-25T16:19:34.460 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 132, 2023-10-25T16:19:34.461 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 132, 2023-10-25T16:19:34.461 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:19:34.461 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:19:34.461 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:34.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:34.473 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:19:34.473 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:19:34.474 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:19:34.474 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:19:34.475 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:19:34.475 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.475 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:19:34.476 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:19:34.476 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:19:34.476 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:19:34.477 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.477 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:19:34.478 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:19:34.478 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:19:34.478 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:19:34.479 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.479 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:19:34.479 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:19:34.480 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:19:34.480 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:19:34.481 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:19:34.481 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:19:34.481 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:19:34.482 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:19:34.482 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:19:34.483 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:19:34.483 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:19:34.557 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:34.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:34.568 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48190.asok 2023-10-25T16:19:34.569 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:34.569 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.48190.asok status 2023-10-25T16:19:34.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:34.758 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:34.758 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:19:34.758 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:19:34.759 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:19:34.759 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:19:34.759 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:19:34.759 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:19:34.759 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "48190", 2023-10-25T16:19:34.760 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:19:34.760 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.760 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 2, 2023-10-25T16:19:34.760 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:19:34.761 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 7872, 2023-10-25T16:19:34.761 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:19:34.761 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:19:34.761 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:19:34.761 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 7872 2023-10-25T16:19:34.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.762 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:34.762 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:34.762 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:34.762 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:34.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:34.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.763 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:19:34.763 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:19:34.764 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:19:34.764 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1529612569 2023-10-25T16:19:34.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:34.764 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.7872 192.168.0.1:0/1529612569", 2023-10-25T16:19:34.764 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1529612569", 2023-10-25T16:19:34.765 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 3, 2023-10-25T16:19:34.765 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 44, 2023-10-25T16:19:34.765 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 132, 2023-10-25T16:19:34.765 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 132, 2023-10-25T16:19:34.765 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:19:34.765 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:19:34.766 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:34.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:34.777 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:19:34.778 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:19:34.778 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:19:34.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:19:34.880 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:19:34.881 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:19:34.881 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:34.887 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:35.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/780058935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d815eba0 msgr2=0x7fb6d80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 --2- 172.21.15.177:0/780058935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d815eba0 0x7fb6d80b4100 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009900 tx=0x7fb6c801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/780058935 shutdown_connections 2023-10-25T16:19:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 --2- 172.21.15.177:0/780058935 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6d80b2120 0x7fb6d80d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 --2- 172.21.15.177:0/780058935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d815eba0 0x7fb6d80b4100 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/780058935 >> 172.21.15.177:0/780058935 conn(0x7fb6d809a5c0 msgr2=0x7fb6d80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/780058935 shutdown_connections 2023-10-25T16:19:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/780058935 wait complete. 2023-10-25T16:19:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 Processor -- start 2023-10-25T16:19:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- start start 2023-10-25T16:19:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 0x7fb6d815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6d80cdb10 0x7fb6d80cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6d815eba0 0x7fb6d8150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80cb100 con 0x7fb6d80b2120 2023-10-25T16:19:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d80c8380 con 0x7fb6d80cdb10 2023-10-25T16:19:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d8151350 con 0x7fb6d815eba0 2023-10-25T16:19:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 0x7fb6d815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 0x7fb6d815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53816/0 (socket says 172.21.15.177:53816) 2023-10-25T16:19:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 -- 172.21.15.177:0/3007720155 learned_addr learned my addr 172.21.15.177:0/3007720155 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6ceffd640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6d80cdb10 0x7fb6d80cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d7fff640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6d815eba0 0x7fb6d8150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 -- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6d815eba0 msgr2=0x7fb6d8150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6d815eba0 0x7fb6d8150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 -- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6d80cdb10 msgr2=0x7fb6d80cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6d80cdb10 0x7fb6d80cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 -- 172.21.15.177:0/3007720155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c8009560 con 0x7fb6d80b2120 2023-10-25T16:19:35.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d77fe640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 0x7fb6d815aa40 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fb6c801aea0 tx=0x7fb6c80a66f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:35.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8004230 con 0x7fb6d80b2120 2023-10-25T16:19:35.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6c8004480 con 0x7fb6d80b2120 2023-10-25T16:19:35.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d80c85d0 con 0x7fb6d80b2120 2023-10-25T16:19:35.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c80053a0 con 0x7fb6d80b2120 2023-10-25T16:19:35.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.060+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d80c8b90 con 0x7fb6d80b2120 2023-10-25T16:19:35.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.064+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d804daf0 con 0x7fb6d80b2120 2023-10-25T16:19:35.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.064+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6c8005500 con 0x7fb6d80b2120 2023-10-25T16:19:35.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.064+0000 7fb6d4ff9640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb6b8066470 0x7fb6b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.064+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6c811df90 con 0x7fb6d80b2120 2023-10-25T16:19:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.064+0000 7fb6ceffd640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb6b8066470 0x7fb6b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.064+0000 7fb6ceffd640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb6b8066470 0x7fb6b8068930 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005fd0 tx=0x7fb6c0005db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:35.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.068+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6c80eb4a0 con 0x7fb6d80b2120 2023-10-25T16:19:35.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.224+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6d80ce930 con 0x7fb6d80b2120 2023-10-25T16:19:35.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.224+0000 7fb6d4ff9640 1 -- 172.21.15.177:0/3007720155 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16551 (secure 0 0 0) 0x7fb6c80ac020 con 0x7fb6d80b2120 2023-10-25T16:19:35.225 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:35.225 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":132,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:32.826137+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:35.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb6b8066470 msgr2=0x7fb6b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb6b8066470 0x7fb6b8068930 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0005fd0 tx=0x7fb6c0005db0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 msgr2=0x7fb6d815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 0x7fb6d815aa40 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fb6c801aea0 tx=0x7fb6c80a66f0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 shutdown_connections 2023-10-25T16:19:35.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb6b8066470 0x7fb6b8068930 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6d815eba0 0x7fb6d8150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6d80cdb10 0x7fb6d80cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 --2- 172.21.15.177:0/3007720155 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6d80b2120 0x7fb6d815aa40 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 >> 172.21.15.177:0/3007720155 conn(0x7fb6d809a5c0 msgr2=0x7fb6d80b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:35.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 shutdown_connections 2023-10-25T16:19:35.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.228+0000 7fb6de261640 1 -- 172.21.15.177:0/3007720155 wait complete. 2023-10-25T16:19:35.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:19:12.371023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:19:13.475690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:35.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 -- 172.21.15.177:0/3904209275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 msgr2=0x7fde68070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 --2- 172.21.15.177:0/3904209275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde68070510 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0098f0 tx=0x7fde5c01c890 comp rx=0 tx=0).stop 2023-10-25T16:19:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 -- 172.21.15.177:0/3904209275 shutdown_connections 2023-10-25T16:19:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 --2- 172.21.15.177:0/3904209275 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 0x7fde6806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 --2- 172.21.15.177:0/3904209275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde68070510 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 -- 172.21.15.177:0/3904209275 >> 172.21.15.177:0/3904209275 conn(0x7fde680b2450 msgr2=0x7fde680b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 -- 172.21.15.177:0/3904209275 shutdown_connections 2023-10-25T16:19:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 -- 172.21.15.177:0/3904209275 wait complete. 2023-10-25T16:19:35.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 Processor -- start 2023-10-25T16:19:35.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.380+0000 7fde6c84a640 1 -- start start 2023-10-25T16:19:35.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 0x7fde680ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde680af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde68159230 0x7fde68149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6814c6b0 con 0x7fde68071500 2023-10-25T16:19:35.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68149b50 con 0x7fde68159230 2023-10-25T16:19:35.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde68149e20 con 0x7fde6806b980 2023-10-25T16:19:35.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde680af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde680af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53834/0 (socket says 172.21.15.177:53834) 2023-10-25T16:19:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 -- 172.21.15.177:0/1903521170 learned_addr learned my addr 172.21.15.177:0/1903521170 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6659c640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 0x7fde680ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 -- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 msgr2=0x7fde680ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 0x7fde680ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde66d9d640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde68159230 0x7fde68149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 -- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde68159230 msgr2=0x7fde68149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde68159230 0x7fde68149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 -- 172.21.15.177:0/1903521170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009500 con 0x7fde68071500 2023-10-25T16:19:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6659c640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 0x7fde680ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde65d9b640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde680af680 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c10 tx=0x7fde5c0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0ba070 con 0x7fde68071500 2023-10-25T16:19:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde5c005030 con 0x7fde68071500 2023-10-25T16:19:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6814c060 con 0x7fde68071500 2023-10-25T16:19:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c005420 con 0x7fde68071500 2023-10-25T16:19:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6814bcc0 con 0x7fde68071500 2023-10-25T16:19:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6814c820 con 0x7fde68071500 2023-10-25T16:19:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde5c0b4040 con 0x7fde68071500 2023-10-25T16:19:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde56ffd640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde480664a0 0x7fde48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde5c11e370 con 0x7fde68071500 2023-10-25T16:19:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.384+0000 7fde6659c640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde480664a0 0x7fde48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.388+0000 7fde6659c640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde480664a0 0x7fde48068960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fde58000f70 tx=0x7fde58009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:35.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.388+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde5c0eb7f0 con 0x7fde68071500 2023-10-25T16:19:35.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.544+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde6804daf0 con 0x7fde68071500 2023-10-25T16:19:35.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.544+0000 7fde56ffd640 1 -- 172.21.15.177:0/1903521170 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde5c0eee10 con 0x7fde68071500 2023-10-25T16:19:35.544 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde480664a0 msgr2=0x7fde48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde480664a0 0x7fde48068960 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fde58000f70 tx=0x7fde58009040 comp rx=0 tx=0).stop 2023-10-25T16:19:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 msgr2=0x7fde680af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde680af680 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c10 tx=0x7fde5c0057a0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 shutdown_connections 2023-10-25T16:19:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde480664a0 0x7fde48068960 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde68159230 0x7fde68149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde68071500 0x7fde680af680 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 --2- 172.21.15.177:0/1903521170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6806b980 0x7fde680ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 >> 172.21.15.177:0/1903521170 conn(0x7fde680b2450 msgr2=0x7fde68156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:35.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 shutdown_connections 2023-10-25T16:19:35.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.548+0000 7fde6c84a640 1 -- 172.21.15.177:0/1903521170 wait complete. 2023-10-25T16:19:35.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:19:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- 172.21.15.177:0/3789920373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099414e810 msgr2=0x7f09940cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 --2- 172.21.15.177:0/3789920373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099414e810 0x7f09940cbfa0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f0984009c80 tx=0x7f098401cd40 comp rx=0 tx=0).stop 2023-10-25T16:19:35.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- 172.21.15.177:0/3789920373 shutdown_connections 2023-10-25T16:19:35.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 --2- 172.21.15.177:0/3789920373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099414e810 0x7f09940cbfa0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- 172.21.15.177:0/3789920373 >> 172.21.15.177:0/3789920373 conn(0x7f09940b2450 msgr2=0x7f09940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- 172.21.15.177:0/3789920373 shutdown_connections 2023-10-25T16:19:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- 172.21.15.177:0/3789920373 wait complete. 2023-10-25T16:19:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 Processor -- start 2023-10-25T16:19:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- start start 2023-10-25T16:19:35.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09940aebc0 0x7f099414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f099414e810 0x7f0994144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 0x7f099413d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994143fe0 con 0x7f099415bdb0 2023-10-25T16:19:35.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099414c3d0 con 0x7f09940aebc0 2023-10-25T16:19:35.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0998be0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099414c6b0 con 0x7f099414e810 2023-10-25T16:19:35.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 0x7f099413d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 0x7f099413d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53850/0 (socket says 172.21.15.177:53850) 2023-10-25T16:19:35.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 -- 172.21.15.177:0/954557243 learned_addr learned my addr 172.21.15.177:0/954557243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:35.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0991d9b640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f099414e810 0x7f0994144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f099259c640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09940aebc0 0x7f099414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 -- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f099414e810 msgr2=0x7f0994144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f099414e810 0x7f0994144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 -- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09940aebc0 msgr2=0x7f099414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09940aebc0 0x7f099414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 -- 172.21.15.177:0/954557243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840098e0 con 0x7f099415bdb0 2023-10-25T16:19:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f099259c640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09940aebc0 0x7f099414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.696+0000 7f0992d9d640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 0x7f099413d620 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c410 tx=0x7f098c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0054e0 con 0x7f099415bdb0 2023-10-25T16:19:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f098c003600 con 0x7f099415bdb0 2023-10-25T16:19:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0994143c00 con 0x7f099415bdb0 2023-10-25T16:19:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0039f0 con 0x7f099415bdb0 2023-10-25T16:19:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099413ebf0 con 0x7f099415bdb0 2023-10-25T16:19:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099413eed0 con 0x7f099415bdb0 2023-10-25T16:19:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f098c003b50 con 0x7f099415bdb0 2023-10-25T16:19:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0982ffd640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0974066470 0x7f0974068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f098c083490 con 0x7f099415bdb0 2023-10-25T16:19:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f099259c640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0974066470 0x7f0974068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.700+0000 7f099259c640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0974066470 0x7f0974068930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09840af000 tx=0x7f098401b580 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:35.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.704+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f098c0545a0 con 0x7f099415bdb0 2023-10-25T16:19:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.856+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0994143a60 con 0x7f099415bdb0 2023-10-25T16:19:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.856+0000 7f0982ffd640 1 -- 172.21.15.177:0/954557243 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f098c017020 con 0x7f099415bdb0 2023-10-25T16:19:35.857 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:19:35.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0974066470 msgr2=0x7f0974068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0974066470 0x7f0974068930 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f09840af000 tx=0x7f098401b580 comp rx=0 tx=0).stop 2023-10-25T16:19:35.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 msgr2=0x7f099413d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:35.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 0x7f099413d620 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c410 tx=0x7f098c00c8d0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 shutdown_connections 2023-10-25T16:19:35.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0974066470 0x7f0974068930 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f099415bdb0 0x7f099413d620 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f099414e810 0x7f0994144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 --2- 172.21.15.177:0/954557243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09940aebc0 0x7f099414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:35.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 >> 172.21.15.177:0/954557243 conn(0x7f09940b2450 msgr2=0x7f09940c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:35.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 shutdown_connections 2023-10-25T16:19:35.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:35.860+0000 7f0998be0640 1 -- 172.21.15.177:0/954557243 wait complete. 2023-10-25T16:19:35.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:19:36.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/3856683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40af100 msgr2=0x7f2ad4158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 --2- 172.21.15.177:0/3856683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40af100 0x7f2ad4158170 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009c80 tx=0x7f2acc01cd40 comp rx=0 tx=0).stop 2023-10-25T16:19:36.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/3856683 shutdown_connections 2023-10-25T16:19:36.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 --2- 172.21.15.177:0/3856683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40af100 0x7f2ad4158170 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 --2- 172.21.15.177:0/3856683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40cbfa0 0x7f2ad40aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/3856683 >> 172.21.15.177:0/3856683 conn(0x7f2ad40b2450 msgr2=0x7f2ad40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:36.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/3856683 shutdown_connections 2023-10-25T16:19:36.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/3856683 wait complete. 2023-10-25T16:19:36.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 Processor -- start 2023-10-25T16:19:36.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- start start 2023-10-25T16:19:36.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40af100 0x7f2ad4147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 0x7f2ad4141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad414e810 0x7f2ad4142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4148920 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad414a560 con 0x7f2ad414e810 2023-10-25T16:19:36.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4141a70 con 0x7f2ad40af100 2023-10-25T16:19:36.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 0x7f2ad4141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 0x7f2ad4141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53878/0 (socket says 172.21.15.177:53878) 2023-10-25T16:19:36.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 -- 172.21.15.177:0/2471498243 learned_addr learned my addr 172.21.15.177:0/2471498243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:36.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad951a640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40af100 0x7f2ad4147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad9d1b640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad414e810 0x7f2ad4142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 -- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40af100 msgr2=0x7f2ad4147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40af100 0x7f2ad4147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 -- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad414e810 msgr2=0x7f2ad4142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad414e810 0x7f2ad4142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 -- 172.21.15.177:0/2471498243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0098e0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad951a640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40af100 0x7f2ad4147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:36.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ad8d19640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 0x7f2ad4141530 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c970 tx=0x7f2ad000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:36.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0007bb0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2ad0007e00 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4148360 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0005290 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.008+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad414a180 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.012+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4149fe0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.012+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ad00053f0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.012+0000 7f2ac5ffb640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ab8066470 0x7f2ab8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.012+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ad00843e0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.012+0000 7f2ad951a640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ab8066470 0x7f2ab8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.012+0000 7f2ad951a640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ab8066470 0x7f2ab8068930 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800a850 tx=0x7f2ac8008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:36.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.016+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ad4149fe0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.168+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ad4149fe0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.168+0000 7f2ac5ffb640 1 -- 172.21.15.177:0/2471498243 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ad4149fe0 con 0x7f2ad40cbfa0 2023-10-25T16:19:36.169 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:19:36.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ab8066470 msgr2=0x7f2ab8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ab8066470 0x7f2ab8068930 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800a850 tx=0x7f2ac8008040 comp rx=0 tx=0).stop 2023-10-25T16:19:36.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 msgr2=0x7f2ad4141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 0x7f2ad4141530 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c970 tx=0x7f2ad000ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:36.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 shutdown_connections 2023-10-25T16:19:36.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ab8066470 0x7f2ab8068930 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad414e810 0x7f2ad4142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ad40cbfa0 0x7f2ad4141530 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 --2- 172.21.15.177:0/2471498243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad40af100 0x7f2ad4147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 >> 172.21.15.177:0/2471498243 conn(0x7f2ad40b2450 msgr2=0x7f2ad4158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:36.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 shutdown_connections 2023-10-25T16:19:36.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.172+0000 7f2adb77e640 1 -- 172.21.15.177:0/2471498243 wait complete. 2023-10-25T16:19:36.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:19:36.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- 172.21.15.177:0/3035721831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 msgr2=0x7fb6800cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 --2- 172.21.15.177:0/3035721831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 0x7fb6800cb100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb678009bf0 tx=0x7fb67801cb50 comp rx=0 tx=0).stop 2023-10-25T16:19:36.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- 172.21.15.177:0/3035721831 shutdown_connections 2023-10-25T16:19:36.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 --2- 172.21.15.177:0/3035721831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 0x7fb6800cb100 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 --2- 172.21.15.177:0/3035721831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6801537d0 0x7fb680159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- 172.21.15.177:0/3035721831 >> 172.21.15.177:0/3035721831 conn(0x7fb6800b2450 msgr2=0x7fb6800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:36.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- 172.21.15.177:0/3035721831 shutdown_connections 2023-10-25T16:19:36.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- 172.21.15.177:0/3035721831 wait complete. 2023-10-25T16:19:36.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 Processor -- start 2023-10-25T16:19:36.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- start start 2023-10-25T16:19:36.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 0x7fb68014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 0x7fb6800aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6801537d0 0x7fb680146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68014ccb0 con 0x7fb6800c9f00 2023-10-25T16:19:36.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801451f0 con 0x7fb68006c130 2023-10-25T16:19:36.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.312+0000 7fb684f59640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801454d0 con 0x7fb6801537d0 2023-10-25T16:19:36.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 0x7fb6800aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 0x7fb6800aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53890/0 (socket says 172.21.15.177:53890) 2023-10-25T16:19:36.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 -- 172.21.15.177:0/3594070033 learned_addr learned my addr 172.21.15.177:0/3594070033 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:36.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb67e59c640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 0x7fb68014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb67ed9d640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6801537d0 0x7fb680146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 -- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6801537d0 msgr2=0x7fb680146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6801537d0 0x7fb680146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 -- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 msgr2=0x7fb68014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 0x7fb68014c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 -- 172.21.15.177:0/3594070033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009560 con 0x7fb6800c9f00 2023-10-25T16:19:36.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb677fff640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 0x7fb6800aec10 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c450 tx=0x7fb66800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:36.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680052d0 con 0x7fb6800c9f00 2023-10-25T16:19:36.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb668005430 con 0x7fb6800c9f00 2023-10-25T16:19:36.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678009820 con 0x7fb6800c9f00 2023-10-25T16:19:36.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680038b0 con 0x7fb6800c9f00 2023-10-25T16:19:36.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb680145a90 con 0x7fb6800c9f00 2023-10-25T16:19:36.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68004daf0 con 0x7fb6800c9f00 2023-10-25T16:19:36.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb668003a10 con 0x7fb6800c9f00 2023-10-25T16:19:36.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb676ffd640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb660066470 0x7fb660068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6680846e0 con 0x7fb6800c9f00 2023-10-25T16:19:36.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.316+0000 7fb67e59c640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb660066470 0x7fb660068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.320+0000 7fb67e59c640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb660066470 0x7fb660068930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb6800af6a0 tx=0x7fb670009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:36.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.320+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb668051ac0 con 0x7fb6800c9f00 2023-10-25T16:19:36.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.472+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb68006a730 con 0x7fb6800c9f00 2023-10-25T16:19:36.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.472+0000 7fb676ffd640 1 -- 172.21.15.177:0/3594070033 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb6680550e0 con 0x7fb6800c9f00 2023-10-25T16:19:36.473 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:19:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb660066470 msgr2=0x7fb660068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb660066470 0x7fb660068930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb6800af6a0 tx=0x7fb670009260 comp rx=0 tx=0).stop 2023-10-25T16:19:36.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 msgr2=0x7fb6800aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 0x7fb6800aec10 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c450 tx=0x7fb66800c910 comp rx=0 tx=0).stop 2023-10-25T16:19:36.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 shutdown_connections 2023-10-25T16:19:36.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb660066470 0x7fb660068930 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6801537d0 0x7fb680146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6800c9f00 0x7fb6800aec10 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 --2- 172.21.15.177:0/3594070033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb68006c130 0x7fb68014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 >> 172.21.15.177:0/3594070033 conn(0x7fb6800b2450 msgr2=0x7fb6800cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 shutdown_connections 2023-10-25T16:19:36.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.476+0000 7fb684f59640 1 -- 172.21.15.177:0/3594070033 wait complete. 2023-10-25T16:19:36.491 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:19:36.491 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:36.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:19:36.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:36.541 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[48190]: fuse finished with error 0 and tester_r 0 2023-10-25T16:19:36.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:36.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:19:36.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:36.557 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:19:36.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:19:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:36.580 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:19:36.580 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:36.589 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:36.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/2872214935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80047d0 msgr2=0x7f84d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 --2- 172.21.15.177:0/2872214935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80047d0 0x7f84d8004c50 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f84e0005fd0 tx=0x7f84e001cd40 comp rx=0 tx=0).stop 2023-10-25T16:19:36.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f4be3640 1 -- 172.21.15.177:0/2872214935 reap_dead start 2023-10-25T16:19:36.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/2872214935 shutdown_connections 2023-10-25T16:19:36.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/2872214935 >> 172.21.15.177:0/2872214935 conn(0x7f84f009a5c0 msgr2=0x7f84f00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:36.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/2872214935 shutdown_connections 2023-10-25T16:19:36.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/2872214935 wait complete. 2023-10-25T16:19:36.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 Processor -- start 2023-10-25T16:19:36.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- start start 2023-10-25T16:19:36.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84d80047d0 0x7f84f015f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 0x7f84f006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84f00ca520 0x7f84f00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f01602f0 con 0x7f84f006b680 2023-10-25T16:19:36.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f006c040 con 0x7f84f00ca520 2023-10-25T16:19:36.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f015f670 con 0x7f84d80047d0 2023-10-25T16:19:36.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 0x7f84f006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 0x7f84f006bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53908/0 (socket says 172.21.15.177:53908) 2023-10-25T16:19:36.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 -- 172.21.15.177:0/3952292237 learned_addr learned my addr 172.21.15.177:0/3952292237 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:36.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84effff640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84d80047d0 0x7f84f015f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f4be3640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84f00ca520 0x7f84f00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 -- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84d80047d0 msgr2=0x7f84f015f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84d80047d0 0x7f84f015f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 -- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84f00ca520 msgr2=0x7f84f00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84f00ca520 0x7f84f00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 -- 172.21.15.177:0/3952292237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f015f950 con 0x7f84f006b680 2023-10-25T16:19:36.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ef7fe640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 0x7f84f006bb00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f84e000ba60 tx=0x7f84e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:36.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e00be070 con 0x7f84f006b680 2023-10-25T16:19:36.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84e00a6b00 con 0x7f84f006b680 2023-10-25T16:19:36.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f015fc30 con 0x7f84f006b680 2023-10-25T16:19:36.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0005040 con 0x7f84f006b680 2023-10-25T16:19:36.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f00caee0 con 0x7f84f006b680 2023-10-25T16:19:36.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.732+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f0151170 con 0x7f84f006b680 2023-10-25T16:19:36.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.736+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f84e00051a0 con 0x7f84f006b680 2023-10-25T16:19:36.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.736+0000 7f84ecff9640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84dc0664a0 0x7f84dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:36.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.736+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84e011e130 con 0x7f84f006b680 2023-10-25T16:19:36.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.736+0000 7f84effff640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84dc0664a0 0x7f84dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:36.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.736+0000 7f84effff640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84dc0664a0 0x7f84dc068960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f84e4005fd0 tx=0x7f84e4005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:36.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.740+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84e00eb510 con 0x7f84f006b680 2023-10-25T16:19:36.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.884+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84f0160430 con 0x7f84f006b680 2023-10-25T16:19:36.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.884+0000 7f84ecff9640 1 -- 172.21.15.177:0/3952292237 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16551 (secure 0 0 0) 0x7f84f0160430 con 0x7f84f006b680 2023-10-25T16:19:36.884 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:36.884 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":132,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:32.826137+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:36.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84dc0664a0 msgr2=0x7f84dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84dc0664a0 0x7f84dc068960 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f84e4005fd0 tx=0x7f84e4005f40 comp rx=0 tx=0).stop 2023-10-25T16:19:36.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 msgr2=0x7f84f006bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:36.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 0x7f84f006bb00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f84e000ba60 tx=0x7f84e0005880 comp rx=0 tx=0).stop 2023-10-25T16:19:36.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 shutdown_connections 2023-10-25T16:19:36.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84dc0664a0 0x7f84dc068960 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84f00ca520 0x7f84f00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84f006b680 0x7f84f006bb00 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 --2- 172.21.15.177:0/3952292237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84d80047d0 0x7f84f015f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:36.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 >> 172.21.15.177:0/3952292237 conn(0x7f84f009a5c0 msgr2=0x7f84f006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:36.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 shutdown_connections 2023-10-25T16:19:36.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:36.888+0000 7f84f6646640 1 -- 172.21.15.177:0/3952292237 wait complete. 2023-10-25T16:19:36.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:19:12.371023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:19:13.475690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:36.902 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:37.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 -- 172.21.15.177:0/3939413577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06f570 msgr2=0x7f7a5c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 --2- 172.21.15.177:0/3939413577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06f570 0x7f7a5c0cb5c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009bc0 tx=0x7f7a5401cab0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 -- 172.21.15.177:0/3939413577 shutdown_connections 2023-10-25T16:19:37.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 --2- 172.21.15.177:0/3939413577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06f570 0x7f7a5c0cb5c0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 --2- 172.21.15.177:0/3939413577 >> v2:172.21.15.184:3300/0 conn(0x7f7a5c06c160 0x7f7a5c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 -- 172.21.15.177:0/3939413577 >> 172.21.15.177:0/3939413577 conn(0x7f7a5c0b2450 msgr2=0x7f7a5c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 -- 172.21.15.177:0/3939413577 shutdown_connections 2023-10-25T16:19:37.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.016+0000 7f7a61e10640 1 -- 172.21.15.177:0/3939413577 wait complete. 2023-10-25T16:19:37.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 Processor -- start 2023-10-25T16:19:37.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- start start 2023-10-25T16:19:37.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 0x7f7a5c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c06f570 0x7f7a5c138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a5c140cf0 0x7f7a5c1386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c157e30 con 0x7f7a5c06c160 2023-10-25T16:19:37.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c158370 con 0x7f7a5c06f570 2023-10-25T16:19:37.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c13ffe0 con 0x7f7a5c140cf0 2023-10-25T16:19:37.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 0x7f7a5c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 0x7f7a5c1578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53928/0 (socket says 172.21.15.177:53928) 2023-10-25T16:19:37.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 -- 172.21.15.177:0/136860773 learned_addr learned my addr 172.21.15.177:0/136860773 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:37.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5bfff640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a5c140cf0 0x7f7a5c1386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a52ffd640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c06f570 0x7f7a5c138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 -- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a5c140cf0 msgr2=0x7f7a5c1386d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a5c140cf0 0x7f7a5c1386d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 -- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c06f570 msgr2=0x7f7a5c138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c06f570 0x7f7a5c138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 -- 172.21.15.177:0/136860773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54009820 con 0x7f7a5c06c160 2023-10-25T16:19:37.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a52ffd640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c06f570 0x7f7a5c138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:37.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5bfff640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a5c140cf0 0x7f7a5c1386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:37.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a5b7fe640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 0x7f7a5c1578f0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00e710 tx=0x7f7a4c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c004230 con 0x7f7a5c06c160 2023-10-25T16:19:37.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a4c0044a0 con 0x7f7a5c06c160 2023-10-25T16:19:37.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c001ac0 con 0x7f7a5c06c160 2023-10-25T16:19:37.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c13d1c0 con 0x7f7a5c06c160 2023-10-25T16:19:37.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c13d780 con 0x7f7a5c06c160 2023-10-25T16:19:37.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.020+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c04daf0 con 0x7f7a5c06c160 2023-10-25T16:19:37.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.024+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a4c001c20 con 0x7f7a5c06c160 2023-10-25T16:19:37.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.024+0000 7f7a58ff9640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a3c0664a0 0x7f7a3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.024+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a4c086070 con 0x7f7a5c06c160 2023-10-25T16:19:37.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.024+0000 7f7a52ffd640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a3c0664a0 0x7f7a3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.024+0000 7f7a52ffd640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a3c0664a0 0x7f7a3c068960 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0c9150 tx=0x7f7a44005d30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.028+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a4c0b7090 con 0x7f7a5c06c160 2023-10-25T16:19:37.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.176+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a5c0ca670 con 0x7f7a5c06c160 2023-10-25T16:19:37.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a58ff9640 1 -- 172.21.15.177:0/136860773 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a4c01f0a0 con 0x7f7a5c06c160 2023-10-25T16:19:37.178 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:37.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a3c0664a0 msgr2=0x7f7a3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a3c0664a0 0x7f7a3c068960 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0c9150 tx=0x7f7a44005d30 comp rx=0 tx=0).stop 2023-10-25T16:19:37.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 msgr2=0x7f7a5c1578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 0x7f7a5c1578f0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00e710 tx=0x7f7a4c00ebd0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 shutdown_connections 2023-10-25T16:19:37.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a3c0664a0 0x7f7a3c068960 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a5c140cf0 0x7f7a5c1386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c06f570 0x7f7a5c138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 --2- 172.21.15.177:0/136860773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a5c06c160 0x7f7a5c1578f0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 >> 172.21.15.177:0/136860773 conn(0x7f7a5c0b2450 msgr2=0x7f7a5c0ad830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 shutdown_connections 2023-10-25T16:19:37.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.180+0000 7f7a61e10640 1 -- 172.21.15.177:0/136860773 wait complete. 2023-10-25T16:19:37.195 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:19:37.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/2782464299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 msgr2=0x7f47a406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 --2- 172.21.15.177:0/2782464299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a406be10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f479c009bc0 tx=0x7f479c01cb50 comp rx=0 tx=0).stop 2023-10-25T16:19:37.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/2782464299 shutdown_connections 2023-10-25T16:19:37.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 --2- 172.21.15.177:0/2782464299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a406be10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 --2- 172.21.15.177:0/2782464299 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a4071500 0x7f47a4070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/2782464299 >> 172.21.15.177:0/2782464299 conn(0x7f47a40b2450 msgr2=0x7f47a40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/2782464299 shutdown_connections 2023-10-25T16:19:37.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/2782464299 wait complete. 2023-10-25T16:19:37.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 Processor -- start 2023-10-25T16:19:37.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- start start 2023-10-25T16:19:37.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a4153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a4071500 0x7f47a413c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 0x7f47a40ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a414eea0 con 0x7f47a4159230 2023-10-25T16:19:37.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a414a2b0 con 0x7f47a406b980 2023-10-25T16:19:37.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a413cd40 con 0x7f47a4071500 2023-10-25T16:19:37.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 0x7f47a40ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 0x7f47a40ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53930/0 (socket says 172.21.15.177:53930) 2023-10-25T16:19:37.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 -- 172.21.15.177:0/3930783551 learned_addr learned my addr 172.21.15.177:0/3930783551 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:37.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a2ffd640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a4153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a27fc640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a4071500 0x7f47a413c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 -- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a4071500 msgr2=0x7f47a413c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a4071500 0x7f47a413c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 -- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 msgr2=0x7f47a4153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a4153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 -- 172.21.15.177:0/3930783551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c009820 con 0x7f47a4159230 2023-10-25T16:19:37.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a2ffd640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:37.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a37fe640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 0x7f47a40ac980 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f479c01b200 tx=0x7f479c0a59d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0bb070 con 0x7f47a4159230 2023-10-25T16:19:37.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a414e220 con 0x7f47a4159230 2023-10-25T16:19:37.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f479c003a70 con 0x7f47a4159230 2023-10-25T16:19:37.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c003e80 con 0x7f47a4159230 2023-10-25T16:19:37.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.320+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a414e7e0 con 0x7f47a4159230 2023-10-25T16:19:37.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.324+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a414efe0 con 0x7f47a4159230 2023-10-25T16:19:37.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.324+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f479c0b4040 con 0x7f47a4159230 2023-10-25T16:19:37.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.324+0000 7f478b7fe640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4790066470 0x7f4790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.324+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f479c11e4c0 con 0x7f47a4159230 2023-10-25T16:19:37.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.324+0000 7f47a2ffd640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4790066470 0x7f4790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.324+0000 7f47a2ffd640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4790066470 0x7f4790068930 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4794001650 tx=0x7f4794009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.328+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f47a414efe0 con 0x7f47a4159230 2023-10-25T16:19:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.468+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47a414efe0 con 0x7f47a4159230 2023-10-25T16:19:37.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.468+0000 7f478b7fe640 1 -- 172.21.15.177:0/3930783551 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47a414efe0 con 0x7f47a4159230 2023-10-25T16:19:37.468 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:19:37.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.468+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4790066470 msgr2=0x7f4790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.468+0000 7f47a9423640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4790066470 0x7f4790068930 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4794001650 tx=0x7f4794009040 comp rx=0 tx=0).stop 2023-10-25T16:19:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 msgr2=0x7f47a40ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 0x7f47a40ac980 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f479c01b200 tx=0x7f479c0a59d0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 shutdown_connections 2023-10-25T16:19:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4790066470 0x7f4790068930 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47a4159230 0x7f47a40ac980 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47a4071500 0x7f47a413c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 --2- 172.21.15.177:0/3930783551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47a406b980 0x7f47a4153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 >> 172.21.15.177:0/3930783551 conn(0x7f47a40b2450 msgr2=0x7f47a40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 shutdown_connections 2023-10-25T16:19:37.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.472+0000 7f47a9423640 1 -- 172.21.15.177:0/3930783551 wait complete. 2023-10-25T16:19:37.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:19:37.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/585124344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 msgr2=0x7f114c06be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 --2- 172.21.15.177:0/585124344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c06be90 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f1144009bf0 tx=0x7f114401cb50 comp rx=0 tx=0).stop 2023-10-25T16:19:37.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/585124344 shutdown_connections 2023-10-25T16:19:37.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 --2- 172.21.15.177:0/585124344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c06be90 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 --2- 172.21.15.177:0/585124344 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f114c159230 0x7f114c071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/585124344 >> 172.21.15.177:0/585124344 conn(0x7f114c0b2450 msgr2=0x7f114c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/585124344 shutdown_connections 2023-10-25T16:19:37.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/585124344 wait complete. 2023-10-25T16:19:37.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 Processor -- start 2023-10-25T16:19:37.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- start start 2023-10-25T16:19:37.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c14a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f114c070510 0x7f114c149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f114c159230 0x7f114c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0b20b0 con 0x7f114c06ba00 2023-10-25T16:19:37.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0aaae0 con 0x7f114c070510 2023-10-25T16:19:37.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0b1b30 con 0x7f114c159230 2023-10-25T16:19:37.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c14a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c14a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53952/0 (socket says 172.21.15.177:53952) 2023-10-25T16:19:37.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 -- 172.21.15.177:0/393075849 learned_addr learned my addr 172.21.15.177:0/393075849 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:37.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114bfff640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f114c159230 0x7f114c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114affd640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f114c070510 0x7f114c149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 -- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f114c159230 msgr2=0x7f114c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f114c159230 0x7f114c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 -- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f114c070510 msgr2=0x7f114c149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f114c070510 0x7f114c149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 -- 172.21.15.177:0/393075849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1144009820 con 0x7f114c06ba00 2023-10-25T16:19:37.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f114b7fe640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c14a220 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c970 tx=0x7f113c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c004220 con 0x7f114c06ba00 2023-10-25T16:19:37.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f113c004470 con 0x7f114c06ba00 2023-10-25T16:19:37.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c0b1dd0 con 0x7f114c06ba00 2023-10-25T16:19:37.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c007c10 con 0x7f114c06ba00 2023-10-25T16:19:37.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.604+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c0b0030 con 0x7f114c06ba00 2023-10-25T16:19:37.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.608+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114c04daf0 con 0x7f114c06ba00 2023-10-25T16:19:37.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.608+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f113c003600 con 0x7f114c06ba00 2023-10-25T16:19:37.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.608+0000 7f1133fff640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f11380664a0 0x7f1138068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.608+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f113c0840e0 con 0x7f114c06ba00 2023-10-25T16:19:37.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.608+0000 7f114affd640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f11380664a0 0x7f1138068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.608+0000 7f114affd640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f11380664a0 0x7f1138068960 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1140007fd0 tx=0x7f1140009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.612+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f113c0514e0 con 0x7f114c06ba00 2023-10-25T16:19:37.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.752+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f114c15a0c0 con 0x7f114c06ba00 2023-10-25T16:19:37.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.752+0000 7f1133fff640 1 -- 172.21.15.177:0/393075849 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f113c054b00 con 0x7f114c06ba00 2023-10-25T16:19:37.753 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:19:37.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f11380664a0 msgr2=0x7f1138068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f11380664a0 0x7f1138068960 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1140007fd0 tx=0x7f1140009040 comp rx=0 tx=0).stop 2023-10-25T16:19:37.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 msgr2=0x7f114c14a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c14a220 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f113c00c970 tx=0x7f113c00ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:37.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 shutdown_connections 2023-10-25T16:19:37.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f11380664a0 0x7f1138068960 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f114c159230 0x7f114c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f114c070510 0x7f114c149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 --2- 172.21.15.177:0/393075849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f114c06ba00 0x7f114c14a220 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 >> 172.21.15.177:0/393075849 conn(0x7f114c0b2450 msgr2=0x7f114c157670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 shutdown_connections 2023-10-25T16:19:37.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.756+0000 7f1151db4640 1 -- 172.21.15.177:0/393075849 wait complete. 2023-10-25T16:19:37.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:19:37.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- 172.21.15.177:0/1002121254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1600cdb50 msgr2=0x7fb16006c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 --2- 172.21.15.177:0/1002121254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1600cdb50 0x7fb16006c820 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fb158009840 tx=0x7fb15801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- 172.21.15.177:0/1002121254 shutdown_connections 2023-10-25T16:19:37.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 --2- 172.21.15.177:0/1002121254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1600cdb50 0x7fb16006c820 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 --2- 172.21.15.177:0/1002121254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb160069e30 0x7fb160071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- 172.21.15.177:0/1002121254 >> 172.21.15.177:0/1002121254 conn(0x7fb1600afc40 msgr2=0x7fb1600b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:37.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- 172.21.15.177:0/1002121254 shutdown_connections 2023-10-25T16:19:37.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- 172.21.15.177:0/1002121254 wait complete. 2023-10-25T16:19:37.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 Processor -- start 2023-10-25T16:19:37.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- start start 2023-10-25T16:19:37.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb160069e30 0x7fb160155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1600cdb50 0x7fb160138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 0x7fb1601390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16013e6f0 con 0x7fb160142410 2023-10-25T16:19:37.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160156dc0 con 0x7fb160069e30 2023-10-25T16:19:37.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.896+0000 7fb1683b1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1601396f0 con 0x7fb1600cdb50 2023-10-25T16:19:37.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 0x7fb1601390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 0x7fb1601390c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53962/0 (socket says 172.21.15.177:53962) 2023-10-25T16:19:37.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 -- 172.21.15.177:0/968746003 learned_addr learned my addr 172.21.15.177:0/968746003 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:37.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16594c640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1600cdb50 0x7fb160138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16614d640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb160069e30 0x7fb160155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 -- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1600cdb50 msgr2=0x7fb160138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1600cdb50 0x7fb160138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 -- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb160069e30 msgr2=0x7fb160155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:37.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb160069e30 0x7fb160155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:37.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 -- 172.21.15.177:0/968746003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580094a0 con 0x7fb160142410 2023-10-25T16:19:37.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16614d640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb160069e30 0x7fb160155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:37.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16694e640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 0x7fb1601390c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb15801a400 tx=0x7fb1580a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580ba070 con 0x7fb160142410 2023-10-25T16:19:37.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb158005020 con 0x7fb160142410 2023-10-25T16:19:37.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1601399d0 con 0x7fb160142410 2023-10-25T16:19:37.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580053d0 con 0x7fb160142410 2023-10-25T16:19:37.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160139f90 con 0x7fb160142410 2023-10-25T16:19:37.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb160066b20 con 0x7fb160142410 2023-10-25T16:19:37.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1580b4040 con 0x7fb160142410 2023-10-25T16:19:37.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb15effd640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb14c066470 0x7fb14c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:37.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb15811e340 con 0x7fb160142410 2023-10-25T16:19:37.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16614d640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb14c066470 0x7fb14c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:37.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.900+0000 7fb16614d640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb14c066470 0x7fb14c068930 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb150001570 tx=0x7fb150009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:37.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:37.904+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1580eb850 con 0x7fb160142410 2023-10-25T16:19:38.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb16004daf0 con 0x7fb160142410 2023-10-25T16:19:38.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb15effd640 1 -- 172.21.15.177:0/968746003 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v132) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1580b2080 con 0x7fb160142410 2023-10-25T16:19:38.071 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:19:38.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb14c066470 msgr2=0x7fb14c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb14c066470 0x7fb14c068930 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb150001570 tx=0x7fb150009040 comp rx=0 tx=0).stop 2023-10-25T16:19:38.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 msgr2=0x7fb1601390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 0x7fb1601390c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb15801a400 tx=0x7fb1580a56b0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 shutdown_connections 2023-10-25T16:19:38.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb14c066470 0x7fb14c068930 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb160142410 0x7fb1601390c0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1600cdb50 0x7fb160138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 --2- 172.21.15.177:0/968746003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb160069e30 0x7fb160155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 >> 172.21.15.177:0/968746003 conn(0x7fb1600afc40 msgr2=0x7fb1600adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:38.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 shutdown_connections 2023-10-25T16:19:38.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.072+0000 7fb1683b1640 1 -- 172.21.15.177:0/968746003 wait complete. 2023-10-25T16:19:38.089 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:19:38.089 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:19:38.090 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:19:38.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:19:38.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[34972]: fuse finished with error 0 and tester_r 0 2023-10-25T16:19:38.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:19:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:38.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:19:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:19:38.157 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:19:38.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:38.158 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:19:38.164 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:19:38.164 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:38.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:19:38.171 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:19:38.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:38.172 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:19:38.217 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:19:38.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:19:38.219 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:19:38.220 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:38.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:19:38.226 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:19:38.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:19:38.227 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:19:38.274 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:19:38.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:19:38.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:38.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- 172.21.15.177:0/735077201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e4003980 msgr2=0x7f75e4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 --2- 172.21.15.177:0/735077201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e4003980 0x7f75e4003da0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009e00 tx=0x7f75f001d0e0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- 172.21.15.177:0/735077201 shutdown_connections 2023-10-25T16:19:38.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 --2- 172.21.15.177:0/735077201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75e4003980 0x7f75e4003da0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- 172.21.15.177:0/735077201 >> 172.21.15.177:0/735077201 conn(0x7f75f80b2450 msgr2=0x7f75f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:38.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- 172.21.15.177:0/735077201 shutdown_connections 2023-10-25T16:19:38.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- 172.21.15.177:0/735077201 wait complete. 2023-10-25T16:19:38.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 Processor -- start 2023-10-25T16:19:38.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- start start 2023-10-25T16:19:38.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75e4003980 0x7f75f814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 0x7f75f80b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75f80b0cd0 0x7f75f80b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8155310 con 0x7f75f8152010 2023-10-25T16:19:38.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80aa8b0 con 0x7f75f80b0cd0 2023-10-25T16:19:38.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75fce08640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8152510 con 0x7f75e4003980 2023-10-25T16:19:38.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 0x7f75f80b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 0x7f75f80b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53980/0 (socket says 172.21.15.177:53980) 2023-10-25T16:19:38.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 -- 172.21.15.177:0/1597244618 learned_addr learned my addr 172.21.15.177:0/1597244618 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:38.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f6d9d640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75f80b0cd0 0x7f75f80b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f659c640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75e4003980 0x7f75f814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 -- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75e4003980 msgr2=0x7f75f814aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75e4003980 0x7f75f814aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 -- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75f80b0cd0 msgr2=0x7f75f80b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75f80b0cd0 0x7f75f80b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 -- 172.21.15.177:0/1597244618 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f81527f0 con 0x7f75f8152010 2023-10-25T16:19:38.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.412+0000 7f75f5d9b640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 0x7f75f80b0790 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f75e0004df0 tx=0x7f75e0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:38.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00107d0 con 0x7f75f8152010 2023-10-25T16:19:38.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75e0010a40 con 0x7f75f8152010 2023-10-25T16:19:38.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f8152ad0 con 0x7f75f8152010 2023-10-25T16:19:38.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0010e50 con 0x7f75f8152010 2023-10-25T16:19:38.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80b04e0 con 0x7f75f8152010 2023-10-25T16:19:38.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f804daf0 con 0x7f75f8152010 2023-10-25T16:19:38.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75e001b460 con 0x7f75f8152010 2023-10-25T16:19:38.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75eeffd640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75d80664a0 0x7f75d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75e0084820 con 0x7f75f8152010 2023-10-25T16:19:38.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75f659c640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75d80664a0 0x7f75d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.416+0000 7f75f659c640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75d80664a0 0x7f75d8068960 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f75f00ae000 tx=0x7f75f0019e80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:38.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.420+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75e0051ca0 con 0x7f75f8152010 2023-10-25T16:19:38.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.592+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f80cd970 con 0x7f75f8152010 2023-10-25T16:19:38.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.592+0000 7f75eeffd640 1 -- 172.21.15.177:0/1597244618 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f75e0084030 con 0x7f75f8152010 2023-10-25T16:19:38.592 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:38.592 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:38.593 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:38.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75d80664a0 msgr2=0x7f75d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75d80664a0 0x7f75d8068960 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f75f00ae000 tx=0x7f75f0019e80 comp rx=0 tx=0).stop 2023-10-25T16:19:38.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 msgr2=0x7f75f80b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 0x7f75f80b0790 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f75e0004df0 tx=0x7f75e0001630 comp rx=0 tx=0).stop 2023-10-25T16:19:38.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 shutdown_connections 2023-10-25T16:19:38.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75d80664a0 0x7f75d8068960 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75f80b0cd0 0x7f75f80b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f8152010 0x7f75f80b0790 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 --2- 172.21.15.177:0/1597244618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75e4003980 0x7f75f814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 >> 172.21.15.177:0/1597244618 conn(0x7f75f80b2450 msgr2=0x7f75f815b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:38.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 shutdown_connections 2023-10-25T16:19:38.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.596+0000 7f75fce08640 1 -- 172.21.15.177:0/1597244618 wait complete. 2023-10-25T16:19:38.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:38.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- 172.21.15.177:0/3351258896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff370004d10 msgr2=0x7ff370005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/3351258896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff370004d10 0x7ff370005190 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7ff380009eb0 tx=0x7ff38001d5d0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 -- 172.21.15.177:0/3351258896 reap_dead start 2023-10-25T16:19:38.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- 172.21.15.177:0/3351258896 shutdown_connections 2023-10-25T16:19:38.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- 172.21.15.177:0/3351258896 >> 172.21.15.177:0/3351258896 conn(0x7ff3880b2450 msgr2=0x7ff3880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:38.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- 172.21.15.177:0/3351258896 shutdown_connections 2023-10-25T16:19:38.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- 172.21.15.177:0/3351258896 wait complete. 2023-10-25T16:19:38.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 Processor -- start 2023-10-25T16:19:38.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- start start 2023-10-25T16:19:38.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff370004d10 0x7ff3880ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff388157030 0x7ff3880ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 0x7ff3880aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388156ea0 con 0x7ff3880cd430 2023-10-25T16:19:38.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881f5160 con 0x7ff370004d10 2023-10-25T16:19:38.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ef3d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881f5440 con 0x7ff388157030 2023-10-25T16:19:38.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 0x7ff3880aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 0x7ff3880aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53988/0 (socket says 172.21.15.177:53988) 2023-10-25T16:19:38.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 -- 172.21.15.177:0/2741422666 learned_addr learned my addr 172.21.15.177:0/2741422666 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:38.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff387fff640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff388157030 0x7ff3880ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38ccd9640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff370004d10 0x7ff3880ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 -- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff388157030 msgr2=0x7ff3880ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff388157030 0x7ff3880ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 -- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff370004d10 msgr2=0x7ff3880ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff370004d10 0x7ff3880ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.736+0000 7ff38d4da640 1 -- 172.21.15.177:0/2741422666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3881f5720 con 0x7ff3880cd430 2023-10-25T16:19:38.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff38d4da640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 0x7ff3880aec30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff380009eb0 tx=0x7ff380009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:38.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3800b6070 con 0x7ff3880cd430 2023-10-25T16:19:38.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff3800a99e0 con 0x7ff3880cd430 2023-10-25T16:19:38.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3881f5a00 con 0x7ff3880cd430 2023-10-25T16:19:38.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3800a9d50 con 0x7ff3880cd430 2023-10-25T16:19:38.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388135ec0 con 0x7ff3880cd430 2023-10-25T16:19:38.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3881f5b90 con 0x7ff3880cd430 2023-10-25T16:19:38.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff380003980 con 0x7ff3880cd430 2023-10-25T16:19:38.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff3857fa640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3740664a0 0x7ff374068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:38.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff38011f110 con 0x7ff3880cd430 2023-10-25T16:19:38.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff38ccd9640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3740664a0 0x7ff374068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:38.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.740+0000 7ff38ccd9640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3740664a0 0x7ff374068960 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff378001060 tx=0x7ff378001180 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:38.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.744+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff3800ec4f0 con 0x7ff3880cd430 2023-10-25T16:19:38.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.904+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff38804daf0 con 0x7ff3880cd430 2023-10-25T16:19:38.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff3857fa640 1 -- 172.21.15.177:0/2741422666 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16551 (secure 0 0 0) 0x7ff3800c0090 con 0x7ff3880cd430 2023-10-25T16:19:38.906 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:38.906 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":132,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:32.826137+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:38.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3740664a0 msgr2=0x7ff374068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3740664a0 0x7ff374068960 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff378001060 tx=0x7ff378001180 comp rx=0 tx=0).stop 2023-10-25T16:19:38.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 msgr2=0x7ff3880aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:38.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 0x7ff3880aec30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff380009eb0 tx=0x7ff380009780 comp rx=0 tx=0).stop 2023-10-25T16:19:38.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 shutdown_connections 2023-10-25T16:19:38.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff3740664a0 0x7ff374068960 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3880cd430 0x7ff3880aec30 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff388157030 0x7ff3880ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 --2- 172.21.15.177:0/2741422666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff370004d10 0x7ff3880ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:38.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 >> 172.21.15.177:0/2741422666 conn(0x7ff3880b2450 msgr2=0x7ff38813b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:38.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 shutdown_connections 2023-10-25T16:19:38.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:38.908+0000 7ff38ef3d640 1 -- 172.21.15.177:0/2741422666 wait complete. 2023-10-25T16:19:38.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:19:12.371023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:19:13.475690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:38.926 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:39.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 -- 172.21.15.177:0/2927427702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 msgr2=0x7fb7300d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2927427702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300d1bd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fb7300b3ea0 tx=0x7fb72001c810 comp rx=0 tx=0).stop 2023-10-25T16:19:39.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 -- 172.21.15.177:0/2927427702 shutdown_connections 2023-10-25T16:19:39.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2927427702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7300cdb10 0x7fb7300cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2927427702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300d1bd0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2927427702 >> v2:172.21.15.184:3300/0 conn(0x7fb73015eba0 0x7fb7300b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 -- 172.21.15.177:0/2927427702 >> 172.21.15.177:0/2927427702 conn(0x7fb73009a5c0 msgr2=0x7fb7300d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 -- 172.21.15.177:0/2927427702 shutdown_connections 2023-10-25T16:19:39.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.052+0000 7fb737e5c640 1 -- 172.21.15.177:0/2927427702 wait complete. 2023-10-25T16:19:39.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 Processor -- start 2023-10-25T16:19:39.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- start start 2023-10-25T16:19:39.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7300cdb10 0x7fb730153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73015eba0 0x7fb730153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730157d50 con 0x7fb7300b2120 2023-10-25T16:19:39.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730158010 con 0x7fb7300cdb10 2023-10-25T16:19:39.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7301582f0 con 0x7fb73015eba0 2023-10-25T16:19:39.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54008/0 (socket says 172.21.15.177:54008) 2023-10-25T16:19:39.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 -- 172.21.15.177:0/2993380051 learned_addr learned my addr 172.21.15.177:0/2993380051 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:39.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb7353f7640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7300cdb10 0x7fb730153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb7363f9640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73015eba0 0x7fb730153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 -- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73015eba0 msgr2=0x7fb730153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73015eba0 0x7fb730153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 -- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7300cdb10 msgr2=0x7fb730153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7300cdb10 0x7fb730153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 -- 172.21.15.177:0/2993380051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009560 con 0x7fb7300b2120 2023-10-25T16:19:39.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb735bf8640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300caf90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c9f0 tx=0x7fb72c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c007bb0 con 0x7fb7300b2120 2023-10-25T16:19:39.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb72c007e00 con 0x7fb7300b2120 2023-10-25T16:19:39.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00f6b0 con 0x7fb7300b2120 2023-10-25T16:19:39.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7301585d0 con 0x7fb7300b2120 2023-10-25T16:19:39.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7300cb4d0 con 0x7fb7300b2120 2023-10-25T16:19:39.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.056+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73004daf0 con 0x7fb7300b2120 2023-10-25T16:19:39.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.060+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb72c00f810 con 0x7fb7300b2120 2023-10-25T16:19:39.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.060+0000 7fb7267fc640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb714066470 0x7fb714068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.060+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb72c084640 con 0x7fb7300b2120 2023-10-25T16:19:39.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.060+0000 7fb7353f7640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb714066470 0x7fb714068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.060+0000 7fb7353f7640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb714066470 0x7fb714068930 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb7200ae000 tx=0x7fb7200b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.064+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb72c051b50 con 0x7fb7300b2120 2023-10-25T16:19:39.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.220+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7300ce930 con 0x7fb7300b2120 2023-10-25T16:19:39.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.220+0000 7fb7267fc640 1 -- 172.21.15.177:0/2993380051 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb72c055170 con 0x7fb7300b2120 2023-10-25T16:19:39.220 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb714066470 msgr2=0x7fb714068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb714066470 0x7fb714068930 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb7200ae000 tx=0x7fb7200b3040 comp rx=0 tx=0).stop 2023-10-25T16:19:39.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 msgr2=0x7fb7300caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300caf90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c9f0 tx=0x7fb72c00ceb0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 shutdown_connections 2023-10-25T16:19:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb714066470 0x7fb714068930 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73015eba0 0x7fb730153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7300cdb10 0x7fb730153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 --2- 172.21.15.177:0/2993380051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7300b2120 0x7fb7300caf90 secure :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c9f0 tx=0x7fb72c00ceb0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 >> 172.21.15.177:0/2993380051 conn(0x7fb73009a5c0 msgr2=0x7fb7300cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 shutdown_connections 2023-10-25T16:19:39.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.224+0000 7fb737e5c640 1 -- 172.21.15.177:0/2993380051 wait complete. 2023-10-25T16:19:39.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:19:39.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/837009649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5380b2070 msgr2=0x7ff5380c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 --2- 172.21.15.177:0/837009649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5380b2070 0x7ff5380c8850 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff530009c80 tx=0x7ff53001cd40 comp rx=0 tx=0).stop 2023-10-25T16:19:39.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/837009649 shutdown_connections 2023-10-25T16:19:39.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 --2- 172.21.15.177:0/837009649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5380b2070 0x7ff5380c8850 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 --2- 172.21.15.177:0/837009649 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5380cfe20 0x7ff5380c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/837009649 >> 172.21.15.177:0/837009649 conn(0x7ff53809a580 msgr2=0x7ff5380d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/837009649 shutdown_connections 2023-10-25T16:19:39.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/837009649 wait complete. 2023-10-25T16:19:39.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 Processor -- start 2023-10-25T16:19:39.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- start start 2023-10-25T16:19:39.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5380b2070 0x7ff5380c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5380cfe20 0x7ff5380b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 0x7ff53814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53814c550 con 0x7ff53815eba0 2023-10-25T16:19:39.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380b3f70 con 0x7ff5380b2070 2023-10-25T16:19:39.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53815a930 con 0x7ff5380cfe20 2023-10-25T16:19:39.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 0x7ff53814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 0x7ff53814c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54022/0 (socket says 172.21.15.177:54022) 2023-10-25T16:19:39.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 -- 172.21.15.177:0/3835465 learned_addr learned my addr 172.21.15.177:0/3835465 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:39.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff536d9d640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5380b2070 0x7ff5380c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53659c640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5380cfe20 0x7ff5380b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 -- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5380cfe20 msgr2=0x7ff5380b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5380cfe20 0x7ff5380b68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 -- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5380b2070 msgr2=0x7ff5380c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5380b2070 0x7ff5380c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 -- 172.21.15.177:0/3835465 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300098e0 con 0x7ff53815eba0 2023-10-25T16:19:39.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff536d9d640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5380b2070 0x7ff5380c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:39.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53759e640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 0x7ff53814c010 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff530009bd0 tx=0x7ff5300ae890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300bc070 con 0x7ff53815eba0 2023-10-25T16:19:39.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff5300aed80 con 0x7ff53815eba0 2023-10-25T16:19:39.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53814c760 con 0x7ff53815eba0 2023-10-25T16:19:39.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530003be0 con 0x7ff53815eba0 2023-10-25T16:19:39.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.368+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5380c5e20 con 0x7ff53815eba0 2023-10-25T16:19:39.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.372+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53804daf0 con 0x7ff53815eba0 2023-10-25T16:19:39.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.372+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff5300b4040 con 0x7ff53815eba0 2023-10-25T16:19:39.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.372+0000 7ff52f7fe640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff518066470 0x7ff518068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.372+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff53011ebb0 con 0x7ff53815eba0 2023-10-25T16:19:39.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.372+0000 7ff536d9d640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff518066470 0x7ff518068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.372+0000 7ff536d9d640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff518066470 0x7ff518068930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff52800a850 tx=0x7ff528008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.376+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5300ec0c0 con 0x7ff53815eba0 2023-10-25T16:19:39.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5380d2150 con 0x7ff53815eba0 2023-10-25T16:19:39.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff52f7fe640 1 -- 172.21.15.177:0/3835465 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5300ef6e0 con 0x7ff53815eba0 2023-10-25T16:19:39.530 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:19:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff518066470 msgr2=0x7ff518068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff518066470 0x7ff518068930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff52800a850 tx=0x7ff528008040 comp rx=0 tx=0).stop 2023-10-25T16:19:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 msgr2=0x7ff53814c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 0x7ff53814c010 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff530009bd0 tx=0x7ff5300ae890 comp rx=0 tx=0).stop 2023-10-25T16:19:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 shutdown_connections 2023-10-25T16:19:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff518066470 0x7ff518068930 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53815eba0 0x7ff53814c010 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5380cfe20 0x7ff5380b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 --2- 172.21.15.177:0/3835465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5380b2070 0x7ff5380c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 >> 172.21.15.177:0/3835465 conn(0x7ff53809a580 msgr2=0x7ff5380c8310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 shutdown_connections 2023-10-25T16:19:39.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.532+0000 7ff53d024640 1 -- 172.21.15.177:0/3835465 wait complete. 2023-10-25T16:19:39.550 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:19:39.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1351261336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580b0160 msgr2=0x7f1a580ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1351261336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580b0160 0x7f1a580ab3f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f1a5806f0f0 tx=0x7f1a4801c870 comp rx=0 tx=0).stop 2023-10-25T16:19:39.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1351261336 shutdown_connections 2023-10-25T16:19:39.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1351261336 >> v2:172.21.15.184:3300/0 conn(0x7f1a580ab930 0x7f1a580c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1351261336 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580b0160 0x7f1a580ab3f0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1351261336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a58158320 0x7f1a580cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1351261336 >> 172.21.15.177:0/1351261336 conn(0x7f1a580b2680 msgr2=0x7f1a580b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1351261336 shutdown_connections 2023-10-25T16:19:39.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1351261336 wait complete. 2023-10-25T16:19:39.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 Processor -- start 2023-10-25T16:19:39.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- start start 2023-10-25T16:19:39.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 0x7f1a580aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a580b0160 0x7f1a5814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a58158320 0x7f1a58150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58151f60 con 0x7f1a580ab930 2023-10-25T16:19:39.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58151350 con 0x7f1a58158320 2023-10-25T16:19:39.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.676+0000 7f1a5f3a8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58151630 con 0x7f1a580b0160 2023-10-25T16:19:39.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 0x7f1a580aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 0x7f1a580aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54030/0 (socket says 172.21.15.177:54030) 2023-10-25T16:19:39.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 -- 172.21.15.177:0/1244459351 learned_addr learned my addr 172.21.15.177:0/1244459351 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:39.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d945640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a58158320 0x7f1a58150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5c943640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a580b0160 0x7f1a5814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 -- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a580b0160 msgr2=0x7f1a5814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a580b0160 0x7f1a5814a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 -- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a58158320 msgr2=0x7f1a58150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a58158320 0x7f1a58150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 -- 172.21.15.177:0/1244459351 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a48009560 con 0x7f1a580ab930 2023-10-25T16:19:39.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5c943640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a580b0160 0x7f1a5814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:39.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5d144640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 0x7f1a580aefe0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c9f0 tx=0x7f1a5400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54007bb0 con 0x7f1a580ab930 2023-10-25T16:19:39.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a58151910 con 0x7f1a580ab930 2023-10-25T16:19:39.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1a54007e00 con 0x7f1a580ab930 2023-10-25T16:19:39.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5400f6b0 con 0x7f1a580ab930 2023-10-25T16:19:39.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5814acb0 con 0x7f1a580ab930 2023-10-25T16:19:39.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5804daf0 con 0x7f1a580ab930 2023-10-25T16:19:39.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a5400f810 con 0x7f1a580ab930 2023-10-25T16:19:39.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a4dffb640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1a3c066470 0x7f1a3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a540847b0 con 0x7f1a580ab930 2023-10-25T16:19:39.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5c943640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1a3c066470 0x7f1a3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.680+0000 7f1a5c943640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1a3c066470 0x7f1a3c068930 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1a480af000 tx=0x7f1a4801b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.684+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a54051bb0 con 0x7f1a580ab930 2023-10-25T16:19:39.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a58066a90 con 0x7f1a580ab930 2023-10-25T16:19:39.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a4dffb640 1 -- 172.21.15.177:0/1244459351 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a540551d0 con 0x7f1a580ab930 2023-10-25T16:19:39.839 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:19:39.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1a3c066470 msgr2=0x7f1a3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1a3c066470 0x7f1a3c068930 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1a480af000 tx=0x7f1a4801b0b0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 msgr2=0x7f1a580aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 0x7f1a580aefe0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c9f0 tx=0x7f1a5400ceb0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 shutdown_connections 2023-10-25T16:19:39.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1a3c066470 0x7f1a3c068930 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a58158320 0x7f1a58150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a580b0160 0x7f1a5814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 --2- 172.21.15.177:0/1244459351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a580ab930 0x7f1a580aefe0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 >> 172.21.15.177:0/1244459351 conn(0x7f1a580b2680 msgr2=0x7f1a5806d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 shutdown_connections 2023-10-25T16:19:39.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.840+0000 7f1a5f3a8640 1 -- 172.21.15.177:0/1244459351 wait complete. 2023-10-25T16:19:39.859 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:39.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/921339219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d000aaac0 msgr2=0x7f1d000aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 --2- 172.21.15.177:0/921339219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d000aaac0 0x7f1d000aaf50 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f1d0006b140 tx=0x7f1ce801cbd0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/921339219 shutdown_connections 2023-10-25T16:19:39.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 --2- 172.21.15.177:0/921339219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d000aaac0 0x7f1d000aaf50 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 --2- 172.21.15.177:0/921339219 >> v2:172.21.15.184:3300/0 conn(0x7f1d0015b640 0x7f1d0006e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/921339219 >> 172.21.15.177:0/921339219 conn(0x7f1d000cd6c0 msgr2=0x7f1d000cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:39.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/921339219 shutdown_connections 2023-10-25T16:19:39.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/921339219 wait complete. 2023-10-25T16:19:39.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 Processor -- start 2023-10-25T16:19:39.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- start start 2023-10-25T16:19:39.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d000aaac0 0x7f1d000b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d000cb9a0 0x7f1d0014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 0x7f1d000ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000b20c0 con 0x7f1d0015b640 2023-10-25T16:19:39.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000b1490 con 0x7f1d000cb9a0 2023-10-25T16:19:39.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0014c190 con 0x7f1d000aaac0 2023-10-25T16:19:39.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 0x7f1d000ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 0x7f1d000ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54052/0 (socket says 172.21.15.177:54052) 2023-10-25T16:19:39.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 -- 172.21.15.177:0/1289662923 learned_addr learned my addr 172.21.15.177:0/1289662923 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:39.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfeffd640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d000cb9a0 0x7f1d0014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cff7fe640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d000aaac0 0x7f1d000b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 -- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d000aaac0 msgr2=0x7f1d000b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d000aaac0 0x7f1d000b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 -- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d000cb9a0 msgr2=0x7f1d0014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:39.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d000cb9a0 0x7f1d0014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:39.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 -- 172.21.15.177:0/1289662923 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80098e0 con 0x7f1d0015b640 2023-10-25T16:19:39.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfeffd640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d000cb9a0 0x7f1d0014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:39.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cfffff640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 0x7f1d000ae170 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800c440 tx=0x7f1cf800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8003600 con 0x7f1d0015b640 2023-10-25T16:19:39.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1cf8003780 con 0x7f1d0015b640 2023-10-25T16:19:39.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0014cd10 con 0x7f1d0015b640 2023-10-25T16:19:39.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8003b90 con 0x7f1d0015b640 2023-10-25T16:19:39.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0014c3e0 con 0x7f1d0015b640 2023-10-25T16:19:39.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.988+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0014cea0 con 0x7f1d0015b640 2023-10-25T16:19:39.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.992+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1cf8003cf0 con 0x7f1d0015b640 2023-10-25T16:19:39.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.992+0000 7f1cf7fff640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ce00664a0 0x7f1ce0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:39.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.992+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cf8083120 con 0x7f1d0015b640 2023-10-25T16:19:39.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.992+0000 7f1cff7fe640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ce00664a0 0x7f1ce0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:39.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.992+0000 7f1cff7fe640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ce00664a0 0x7f1ce0068960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000b9a0 tx=0x7f1cf0005c30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:39.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:39.996+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1cf8050520 con 0x7f1d0015b640 2023-10-25T16:19:40.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.180+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d00066a90 con 0x7f1d0015b640 2023-10-25T16:19:40.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.180+0000 7f1cf7fff640 1 -- 172.21.15.177:0/1289662923 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f1cf8053b40 con 0x7f1d0015b640 2023-10-25T16:19:40.181 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:40.181 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:40.181 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:40.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ce00664a0 msgr2=0x7f1ce0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ce00664a0 0x7f1ce0068960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000b9a0 tx=0x7f1cf0005c30 comp rx=0 tx=0).stop 2023-10-25T16:19:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 msgr2=0x7f1d000ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 0x7f1d000ae170 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800c440 tx=0x7f1cf800c900 comp rx=0 tx=0).stop 2023-10-25T16:19:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 shutdown_connections 2023-10-25T16:19:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ce00664a0 0x7f1ce0068960 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d0015b640 0x7f1d000ae170 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d000cb9a0 0x7f1d0014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 --2- 172.21.15.177:0/1289662923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d000aaac0 0x7f1d000b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 >> 172.21.15.177:0/1289662923 conn(0x7f1d000cd6c0 msgr2=0x7f1d000cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:40.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 shutdown_connections 2023-10-25T16:19:40.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.184+0000 7f1d0621c640 1 -- 172.21.15.177:0/1289662923 wait complete. 2023-10-25T16:19:40.198 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:40.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- 172.21.15.177:0/1144754817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0350003980 msgr2=0x7f0350003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 --2- 172.21.15.177:0/1144754817 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0350003980 0x7f0350003da0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f035c009b60 tx=0x7f035c01d290 comp rx=0 tx=0).stop 2023-10-25T16:19:40.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0366d9d640 1 -- 172.21.15.177:0/1144754817 reap_dead start 2023-10-25T16:19:40.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- 172.21.15.177:0/1144754817 shutdown_connections 2023-10-25T16:19:40.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- 172.21.15.177:0/1144754817 >> 172.21.15.177:0/1144754817 conn(0x7f036809a5c0 msgr2=0x7f03680d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:40.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- 172.21.15.177:0/1144754817 shutdown_connections 2023-10-25T16:19:40.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- 172.21.15.177:0/1144754817 wait complete. 2023-10-25T16:19:40.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 Processor -- start 2023-10-25T16:19:40.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- start start 2023-10-25T16:19:40.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f036814d750 0x7f03681566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 0x7f036815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f036815a5e0 0x7f03680c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036815aa90 con 0x7f03680c7100 2023-10-25T16:19:40.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03680c6060 con 0x7f036814d750 2023-10-25T16:19:40.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036cae6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03680c6340 con 0x7f036815a5e0 2023-10-25T16:19:40.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 0x7f036815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 0x7f036815a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:54076/0 (socket says 172.21.15.177:54076) 2023-10-25T16:19:40.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 -- 172.21.15.177:0/3865404785 learned_addr learned my addr 172.21.15.177:0/3865404785 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:40.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036659c640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f036814d750 0x7f03681566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0366d9d640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f036815a5e0 0x7f03680c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 -- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f036815a5e0 msgr2=0x7f03680c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f036815a5e0 0x7f03680c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 -- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f036814d750 msgr2=0x7f03681566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f036814d750 0x7f03681566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 -- 172.21.15.177:0/3865404785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03680c6620 con 0x7f03680c7100 2023-10-25T16:19:40.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f036659c640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f036814d750 0x7f03681566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:40.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0365d9b640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 0x7f036815a0a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f035800e600 tx=0x7f035800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:40.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.312+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035800c9a0 con 0x7f03680c7100 2023-10-25T16:19:40.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f035800cbf0 con 0x7f03680c7100 2023-10-25T16:19:40.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03680c6900 con 0x7f03680c7100 2023-10-25T16:19:40.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358011460 con 0x7f03680c7100 2023-10-25T16:19:40.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03681562a0 con 0x7f03680c7100 2023-10-25T16:19:40.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036804daf0 con 0x7f03680c7100 2023-10-25T16:19:40.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f03580115c0 con 0x7f03680c7100 2023-10-25T16:19:40.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f0356ffd640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03480664a0 0x7f0348068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0358084660 con 0x7f03680c7100 2023-10-25T16:19:40.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f036659c640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03480664a0 0x7f0348068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.316+0000 7f036659c640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03480664a0 0x7f0348068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f035c0ae000 tx=0x7f035c01a030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:40.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.320+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0358055600 con 0x7f03680c7100 2023-10-25T16:19:40.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.472+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03680c6db0 con 0x7f03680c7100 2023-10-25T16:19:40.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.472+0000 7f0356ffd640 1 -- 172.21.15.177:0/3865404785 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16551 (secure 0 0 0) 0x7f0358015090 con 0x7f03680c7100 2023-10-25T16:19:40.473 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:40.473 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":132,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:32.826137+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:40.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03480664a0 msgr2=0x7f0348068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03480664a0 0x7f0348068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f035c0ae000 tx=0x7f035c01a030 comp rx=0 tx=0).stop 2023-10-25T16:19:40.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 msgr2=0x7f036815a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 0x7f036815a0a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f035800e600 tx=0x7f035800eac0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 shutdown_connections 2023-10-25T16:19:40.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03480664a0 0x7f0348068960 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f036815a5e0 0x7f03680c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03680c7100 0x7f036815a0a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 --2- 172.21.15.177:0/3865404785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f036814d750 0x7f03681566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 >> 172.21.15.177:0/3865404785 conn(0x7f036809a5c0 msgr2=0x7f036806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 shutdown_connections 2023-10-25T16:19:40.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.476+0000 7f036cae6640 1 -- 172.21.15.177:0/3865404785 wait complete. 2023-10-25T16:19:40.491 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:19:40.493 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:40.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/3616341177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc15eb90 msgr2=0x7f48cc0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/3616341177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc15eb90 0x7f48cc0cf940 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009900 tx=0x7f48c001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/3616341177 shutdown_connections 2023-10-25T16:19:40.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/3616341177 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 0x7f48cc0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/3616341177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc15eb90 0x7f48cc0cf940 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/3616341177 >> 172.21.15.177:0/3616341177 conn(0x7f48cc0983a0 msgr2=0x7f48cc0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:40.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/3616341177 shutdown_connections 2023-10-25T16:19:40.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/3616341177 wait complete. 2023-10-25T16:19:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 Processor -- start 2023-10-25T16:19:40.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- start start 2023-10-25T16:19:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 0x7f48cc144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 0x7f48cc0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc15eb90 0x7f48cc0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc1449c0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0c3a90 con 0x7f48cc15eb90 2023-10-25T16:19:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0c3d70 con 0x7f48cc0ca930 2023-10-25T16:19:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 0x7f48cc0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 0x7f48cc0c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33540/0 (socket says 172.21.15.177:33540) 2023-10-25T16:19:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 -- 172.21.15.177:0/315651789 learned_addr learned my addr 172.21.15.177:0/315651789 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:40.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48ca59c640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 0x7f48cc144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48cad9d640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc15eb90 0x7f48cc0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 -- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 msgr2=0x7f48cc144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 0x7f48cc144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 -- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc15eb90 msgr2=0x7f48cc0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc15eb90 0x7f48cc0c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 -- 172.21.15.177:0/315651789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c0009560 con 0x7f48cc0cbf40 2023-10-25T16:19:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48ca59c640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 0x7f48cc144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48cad9d640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc15eb90 0x7f48cc0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48c9d9b640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 0x7f48cc0c4d70 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00c970 tx=0x7f48bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:40.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc007bb0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f48bc007e20 con 0x7f48cc0cbf40 2023-10-25T16:19:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc005280 con 0x7f48cc0cbf40 2023-10-25T16:19:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc0c4050 con 0x7f48cc0cbf40 2023-10-25T16:19:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.608+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc0c6bd0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.612+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc04daf0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.612+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f48bc0053e0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.612+0000 7f48baffd640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48ac066470 0x7f48ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.612+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48bc0846d0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.612+0000 7f48ca59c640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48ac066470 0x7f48ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.612+0000 7f48ca59c640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48ac066470 0x7f48ac068930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f48c00ae000 tx=0x7f48c001b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:40.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.616+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48bc051be0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48cc0c94f0 con 0x7f48cc0cbf40 2023-10-25T16:19:40.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48baffd640 1 -- 172.21.15.177:0/315651789 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f48bc01d020 con 0x7f48cc0cbf40 2023-10-25T16:19:40.795 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:40.795 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:40.796 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:40.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48ac066470 msgr2=0x7f48ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48ac066470 0x7f48ac068930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f48c00ae000 tx=0x7f48c001b030 comp rx=0 tx=0).stop 2023-10-25T16:19:40.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 msgr2=0x7f48cc0c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 0x7f48cc0c4d70 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00c970 tx=0x7f48bc00ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:40.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 shutdown_connections 2023-10-25T16:19:40.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f48ac066470 0x7f48ac068930 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc15eb90 0x7f48cc0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48cc0cbf40 0x7f48cc0c4d70 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 --2- 172.21.15.177:0/315651789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48cc0ca930 0x7f48cc144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 >> 172.21.15.177:0/315651789 conn(0x7f48cc0983a0 msgr2=0x7f48cc15c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:40.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 shutdown_connections 2023-10-25T16:19:40.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.796+0000 7f48d0fe3640 1 -- 172.21.15.177:0/315651789 wait complete. 2023-10-25T16:19:40.812 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:40.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.936+0000 7f27303e6640 1 -- 172.21.15.177:0/535189403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2728140db0 msgr2=0x7f27280af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.936+0000 7f27303e6640 1 --2- 172.21.15.177:0/535189403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2728140db0 0x7f27280af5a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f2718009900 tx=0x7f271801c880 comp rx=0 tx=0).stop 2023-10-25T16:19:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- 172.21.15.177:0/535189403 shutdown_connections 2023-10-25T16:19:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 --2- 172.21.15.177:0/535189403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2728140db0 0x7f27280af5a0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- 172.21.15.177:0/535189403 >> 172.21.15.177:0/535189403 conn(0x7f27280b2450 msgr2=0x7f27280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:40.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- 172.21.15.177:0/535189403 shutdown_connections 2023-10-25T16:19:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- 172.21.15.177:0/535189403 wait complete. 2023-10-25T16:19:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 Processor -- start 2023-10-25T16:19:40.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- start start 2023-10-25T16:19:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272806ba00 0x7f27280aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.941 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 0x7f27280ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2728140db0 0x7f2728159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280aae20 con 0x7f272806be90 2023-10-25T16:19:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280ab100 con 0x7f272806ba00 2023-10-25T16:19:40.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27280ab3e0 con 0x7f2728140db0 2023-10-25T16:19:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 0x7f27280ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 0x7f27280ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33562/0 (socket says 172.21.15.177:33562) 2023-10-25T16:19:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 -- 172.21.15.177:0/2427250088 learned_addr learned my addr 172.21.15.177:0/2427250088 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272e983640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2728140db0 0x7f2728159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272e182640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272806ba00 0x7f27280aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 -- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2728140db0 msgr2=0x7f2728159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2728140db0 0x7f2728159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 -- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272806ba00 msgr2=0x7f27280aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272806ba00 0x7f27280aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 -- 172.21.15.177:0/2427250088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718009560 con 0x7f272806be90 2023-10-25T16:19:40.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272e983640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2728140db0 0x7f2728159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272e182640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272806ba00 0x7f27280aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f272d981640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 0x7f27280ad7e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f271c001ec0 tx=0x7f271c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0054e0 con 0x7f272806be90 2023-10-25T16:19:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f271c003600 con 0x7f272806be90 2023-10-25T16:19:40.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c003a70 con 0x7f272806be90 2023-10-25T16:19:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27280ab6c0 con 0x7f272806be90 2023-10-25T16:19:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.940+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27280add20 con 0x7f272806be90 2023-10-25T16:19:40.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.944+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272804daf0 con 0x7f272806be90 2023-10-25T16:19:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.944+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f271c003bd0 con 0x7f272806be90 2023-10-25T16:19:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.944+0000 7f2726ffd640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2714066470 0x7f2714068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:40.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.944+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f271c083130 con 0x7f272806be90 2023-10-25T16:19:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.944+0000 7f272e182640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2714066470 0x7f2714068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.944+0000 7f272e182640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2714066470 0x7f2714068930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f27180af000 tx=0x7f271801b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:40.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:40.948+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f271c050640 con 0x7f272806be90 2023-10-25T16:19:41.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.116+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27280abb70 con 0x7f272806be90 2023-10-25T16:19:41.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f2726ffd640 1 -- 172.21.15.177:0/2427250088 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4927 (secure 0 0 0) 0x7f271c053c60 con 0x7f272806be90 2023-10-25T16:19:41.660 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:41.660 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":44,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:14.480595+0000","modified":"2023-10-25T16:19:16.520519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7683},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7683":{"gid":7683,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/2032322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2032322363},{"type":"v1","addr":"172.21.15.177:6835","nonce":2032322363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-10-25T16:19:41.661 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 44 2023-10-25T16:19:41.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2714066470 msgr2=0x7f2714068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2714066470 0x7f2714068930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f27180af000 tx=0x7f271801b0c0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 msgr2=0x7f27280ad7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 0x7f27280ad7e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f271c001ec0 tx=0x7f271c00c820 comp rx=0 tx=0).stop 2023-10-25T16:19:41.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 shutdown_connections 2023-10-25T16:19:41.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2714066470 0x7f2714068930 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2728140db0 0x7f2728159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f272806be90 0x7f27280ad7e0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 --2- 172.21.15.177:0/2427250088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272806ba00 0x7f27280aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 >> 172.21.15.177:0/2427250088 conn(0x7f27280b2450 msgr2=0x7f27280afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:41.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 shutdown_connections 2023-10-25T16:19:41.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.120+0000 7f27303e6640 1 -- 172.21.15.177:0/2427250088 wait complete. 2023-10-25T16:19:41.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:41.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/706269377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f806c180 msgr2=0x7fc4f815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/706269377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f806c180 0x7fc4f815afb0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009840 tx=0x7fc4e801c720 comp rx=0 tx=0).stop 2023-10-25T16:19:41.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/706269377 shutdown_connections 2023-10-25T16:19:41.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/706269377 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 0x7fc4f80aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/706269377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f806c180 0x7fc4f815afb0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/706269377 >> 172.21.15.177:0/706269377 conn(0x7fc4f80b2450 msgr2=0x7fc4f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:41.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/706269377 shutdown_connections 2023-10-25T16:19:41.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/706269377 wait complete. 2023-10-25T16:19:41.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 Processor -- start 2023-10-25T16:19:41.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- start start 2023-10-25T16:19:41.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4f806c180 0x7fc4f8151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:41.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 0x7fc4f8135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:41.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 0x7fc4f8154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:41.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f814ee10 con 0x7fc4f815bbe0 2023-10-25T16:19:41.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f814f0f0 con 0x7fc4f806c180 2023-10-25T16:19:41.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4ffdf8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f8155640 con 0x7fc4f80c9df0 2023-10-25T16:19:41.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 0x7fc4f8154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:41.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 0x7fc4f8154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33586/0 (socket says 172.21.15.177:33586) 2023-10-25T16:19:41.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 -- 172.21.15.177:0/1306780677 learned_addr learned my addr 172.21.15.177:0/1306780677 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:41.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fd393640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 0x7fc4f8135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:41.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fdb94640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4f806c180 0x7fc4f8151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:41.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 -- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 msgr2=0x7fc4f8135a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 0x7fc4f8135a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 -- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4f806c180 msgr2=0x7fc4f8151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4f806c180 0x7fc4f8151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 -- 172.21.15.177:0/1306780677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8009450 con 0x7fc4f815bbe0 2023-10-25T16:19:41.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fd393640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 0x7fc4f8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:41.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fdb94640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4f806c180 0x7fc4f8151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:41.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.800+0000 7fc4fe395640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 0x7fc4f8154140 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000ea20 tx=0x7fc4f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:41.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f000cde0 con 0x7fc4f815bbe0 2023-10-25T16:19:41.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc4f0004c40 con 0x7fc4f815bbe0 2023-10-25T16:19:41.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f8155920 con 0x7fc4f815bbe0 2023-10-25T16:19:41.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0005020 con 0x7fc4f815bbe0 2023-10-25T16:19:41.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f8135f80 con 0x7fc4f815bbe0 2023-10-25T16:19:41.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f8155b60 con 0x7fc4f815bbe0 2023-10-25T16:19:41.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc4f0005180 con 0x7fc4f815bbe0 2023-10-25T16:19:41.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ee7fc640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc4dc066470 0x7fc4dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:41.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4f0084820 con 0x7fc4f815bbe0 2023-10-25T16:19:41.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4fdb94640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc4dc066470 0x7fc4dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:41.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.804+0000 7fc4fdb94640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc4dc066470 0x7fc4dc068930 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4000f70 tx=0x7fc4f4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:41.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.808+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4f8155b60 con 0x7fc4f815bbe0 2023-10-25T16:19:41.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.964+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f8155b60 con 0x7fc4f815bbe0 2023-10-25T16:19:41.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ee7fc640 1 -- 172.21.15.177:0/1306780677 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+16551 (secure 0 0 0) 0x7fc4f8155b60 con 0x7fc4f815bbe0 2023-10-25T16:19:41.967 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":132,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:32.826137+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:12.371023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:13.475690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:41.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc4dc066470 msgr2=0x7fc4dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc4dc066470 0x7fc4dc068930 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4000f70 tx=0x7fc4f4009040 comp rx=0 tx=0).stop 2023-10-25T16:19:41.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 msgr2=0x7fc4f8154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:41.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 0x7fc4f8154140 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000ea20 tx=0x7fc4f000eee0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 shutdown_connections 2023-10-25T16:19:41.971 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc4dc066470 0x7fc4dc068930 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4f815bbe0 0x7fc4f8154140 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4f80c9df0 0x7fc4f8135a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 --2- 172.21.15.177:0/1306780677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4f806c180 0x7fc4f8151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:41.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 >> 172.21.15.177:0/1306780677 conn(0x7fc4f80b2450 msgr2=0x7fc4f81634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:41.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 shutdown_connections 2023-10-25T16:19:41.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:41.968+0000 7fc4ffdf8640 1 -- 172.21.15.177:0/1306780677 wait complete. 2023-10-25T16:19:41.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:19:42.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 -- 172.21.15.177:0/4074810116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde580cdb10 msgr2=0x7fde580cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 --2- 172.21.15.177:0/4074810116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde580cdb10 0x7fde580cdf80 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fde580b3ea0 tx=0x7fde5001cc90 comp rx=0 tx=0).stop 2023-10-25T16:19:42.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 -- 172.21.15.177:0/4074810116 shutdown_connections 2023-10-25T16:19:42.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 --2- 172.21.15.177:0/4074810116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde580cdb10 0x7fde580cdf80 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 --2- 172.21.15.177:0/4074810116 >> v2:172.21.15.184:3300/0 conn(0x7fde5815eba0 0x7fde580b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 -- 172.21.15.177:0/4074810116 >> 172.21.15.177:0/4074810116 conn(0x7fde5809a5c0 msgr2=0x7fde580d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:42.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 -- 172.21.15.177:0/4074810116 shutdown_connections 2023-10-25T16:19:42.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 -- 172.21.15.177:0/4074810116 wait complete. 2023-10-25T16:19:42.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 Processor -- start 2023-10-25T16:19:42.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.104+0000 7fde60030640 1 -- start start 2023-10-25T16:19:42.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde580b2120 0x7fde580b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde580cdb10 0x7fde580b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 0x7fde581502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b51c0 con 0x7fde5815eba0 2023-10-25T16:19:42.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b5fd0 con 0x7fde580b2120 2023-10-25T16:19:42.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b53c0 con 0x7fde580cdb10 2023-10-25T16:19:42.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 0x7fde581502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 0x7fde581502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33600/0 (socket says 172.21.15.177:33600) 2023-10-25T16:19:42.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 -- 172.21.15.177:0/3304801547 learned_addr learned my addr 172.21.15.177:0/3304801547 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:42.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5d5cb640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde580cdb10 0x7fde580b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5ddcc640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde580b2120 0x7fde580b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 -- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde580cdb10 msgr2=0x7fde580b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde580cdb10 0x7fde580b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 -- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde580b2120 msgr2=0x7fde580b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde580b2120 0x7fde580b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 -- 172.21.15.177:0/3304801547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500098e0 con 0x7fde5815eba0 2023-10-25T16:19:42.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5ddcc640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde580b2120 0x7fde580b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:42.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5e5cd640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 0x7fde581502e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fde5001a8c0 tx=0x7fde500a5ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:42.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50004e60 con 0x7fde5815eba0 2023-10-25T16:19:42.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde50004050 con 0x7fde5815eba0 2023-10-25T16:19:42.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50004420 con 0x7fde5815eba0 2023-10-25T16:19:42.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580b56a0 con 0x7fde5815eba0 2023-10-25T16:19:42.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580b5c60 con 0x7fde5815eba0 2023-10-25T16:19:42.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde580b6180 con 0x7fde5815eba0 2023-10-25T16:19:42.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde500b4040 con 0x7fde5815eba0 2023-10-25T16:19:42.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde4e7fc640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde3c066470 0x7fde3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde5011df20 con 0x7fde5815eba0 2023-10-25T16:19:42.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.108+0000 7fde5ddcc640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde3c066470 0x7fde3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.112+0000 7fde5ddcc640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde3c066470 0x7fde3c068930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fde540058d0 tx=0x7fde54005ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:42.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.112+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde580b6180 con 0x7fde5815eba0 2023-10-25T16:19:42.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.288+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fde580b6180 con 0x7fde5815eba0 2023-10-25T16:19:42.290 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:19:42.292+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:19:42.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde4e7fc640 1 -- 172.21.15.177:0/3304801547 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7fde580b6180 con 0x7fde5815eba0 2023-10-25T16:19:42.294 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:19:42.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde3c066470 msgr2=0x7fde3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde3c066470 0x7fde3c068930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fde540058d0 tx=0x7fde54005ca0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 msgr2=0x7fde581502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 0x7fde581502e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fde5001a8c0 tx=0x7fde500a5ac0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 shutdown_connections 2023-10-25T16:19:42.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fde3c066470 0x7fde3c068930 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde5815eba0 0x7fde581502e0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde580cdb10 0x7fde580b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 --2- 172.21.15.177:0/3304801547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde580b2120 0x7fde580b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.296+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 >> 172.21.15.177:0/3304801547 conn(0x7fde5809a5c0 msgr2=0x7fde5806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:42.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.300+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 shutdown_connections 2023-10-25T16:19:42.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.300+0000 7fde60030640 1 -- 172.21.15.177:0/3304801547 wait complete. 2023-10-25T16:19:42.301 INFO:tasks.ceph.mds.c.smithi177.stderr: -3339> 2023-10-25T16:19:20.100+0000 7f5895d24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:19:42.317 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:19:42.339 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:19:42.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/263925204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc8140e90 msgr2=0x7ffbc80af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/263925204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc8140e90 0x7ffbc80af580 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80ca640 tx=0x7ffbb801c7b0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/263925204 shutdown_connections 2023-10-25T16:19:42.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/263925204 >> v2:172.21.15.184:3300/0 conn(0x7ffbc806f570 0x7ffbc806b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/263925204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc8140e90 0x7ffbc80af580 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/263925204 >> 172.21.15.177:0/263925204 conn(0x7ffbc80b2450 msgr2=0x7ffbc80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:42.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/263925204 shutdown_connections 2023-10-25T16:19:42.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/263925204 wait complete. 2023-10-25T16:19:42.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 Processor -- start 2023-10-25T16:19:42.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- start start 2023-10-25T16:19:42.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc806bec0 0x7ffbc814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 0x7ffbc8158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc8140e90 0x7ffbc8158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc814b870 con 0x7ffbc806f570 2023-10-25T16:19:42.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc814abf0 con 0x7ffbc806bec0 2023-10-25T16:19:42.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc814aed0 con 0x7ffbc8140e90 2023-10-25T16:19:42.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 0x7ffbc8158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 0x7ffbc8158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33636/0 (socket says 172.21.15.177:33636) 2023-10-25T16:19:42.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 -- 172.21.15.177:0/2727686367 learned_addr learned my addr 172.21.15.177:0/2727686367 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:42.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 -- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc8140e90 msgr2=0x7ffbc8158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc8140e90 0x7ffbc8158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 -- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc806bec0 msgr2=0x7ffbc814bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:42.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc6ffd640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc806bec0 0x7ffbc814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc806bec0 0x7ffbc814bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:42.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 -- 172.21.15.177:0/2727686367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8009560 con 0x7ffbc806f570 2023-10-25T16:19:42.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbc67fc640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 0x7ffbc8158a50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00b450 tx=0x7ffbbc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:42.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011890 con 0x7ffbc806f570 2023-10-25T16:19:42.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffbbc011b00 con 0x7ffbc806f570 2023-10-25T16:19:42.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0103e0 con 0x7ffbc806f570 2023-10-25T16:19:42.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc814b1b0 con 0x7ffbc806f570 2023-10-25T16:19:42.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.440+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc81594d0 con 0x7ffbc806f570 2023-10-25T16:19:42.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.444+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc814b9b0 con 0x7ffbc806f570 2023-10-25T16:19:42.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.444+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffbbc010540 con 0x7ffbc806f570 2023-10-25T16:19:42.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.444+0000 7ffbaf7fe640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffbb4066470 0x7ffbb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:42.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.444+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ffbbc084570 con 0x7ffbc806f570 2023-10-25T16:19:42.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.444+0000 7ffbc6ffd640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffbb4066470 0x7ffbb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:42.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.444+0000 7ffbc6ffd640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffbb4066470 0x7ffbb4068930 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80ae000 tx=0x7ffbb801aff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:42.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.448+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbc814b9b0 con 0x7ffbc806f570 2023-10-25T16:19:42.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:42.640+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffbc814b9b0 con 0x7ffbc806f570 2023-10-25T16:19:43.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.296+0000 7ffbaf7fe640 1 -- 172.21.15.177:0/2727686367 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffbc814b9b0 con 0x7ffbc806f570 2023-10-25T16:19:43.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffbb4066470 msgr2=0x7ffbb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:43.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffbb4066470 0x7ffbb4068930 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80ae000 tx=0x7ffbb801aff0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 msgr2=0x7ffbc8158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:43.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 0x7ffbc8158a50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00b450 tx=0x7ffbbc00b910 comp rx=0 tx=0).stop 2023-10-25T16:19:43.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 shutdown_connections 2023-10-25T16:19:43.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffbb4066470 0x7ffbb4068930 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffbc8140e90 0x7ffbc8158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffbc806f570 0x7ffbc8158a50 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 --2- 172.21.15.177:0/2727686367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffbc806bec0 0x7ffbc814bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 >> 172.21.15.177:0/2727686367 conn(0x7ffbc80b2450 msgr2=0x7ffbc813c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:43.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 shutdown_connections 2023-10-25T16:19:43.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.300+0000 7ffbcd4d0640 1 -- 172.21.15.177:0/2727686367 wait complete. 2023-10-25T16:19:43.322 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:19:43.499 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 -- 172.21.15.177:0/874393378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e64097a40 msgr2=0x7f5e64097ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:43.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 --2- 172.21.15.177:0/874393378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e64097a40 0x7f5e64097ed0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f5e64071360 tx=0x7f5e5401c830 comp rx=0 tx=0).stop 2023-10-25T16:19:43.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 -- 172.21.15.177:0/874393378 shutdown_connections 2023-10-25T16:19:43.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 --2- 172.21.15.177:0/874393378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e64097a40 0x7f5e64097ed0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.500 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 --2- 172.21.15.177:0/874393378 >> v2:172.21.15.184:3300/0 conn(0x7f5e64159690 0x7f5e640b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 -- 172.21.15.177:0/874393378 >> 172.21.15.177:0/874393378 conn(0x7f5e640b0b50 msgr2=0x7f5e640b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:43.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 -- 172.21.15.177:0/874393378 shutdown_connections 2023-10-25T16:19:43.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 -- 172.21.15.177:0/874393378 wait complete. 2023-10-25T16:19:43.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 Processor -- start 2023-10-25T16:19:43.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.500+0000 7f5e69aad640 1 -- start start 2023-10-25T16:19:43.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e64097a40 0x7f5e6414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:43.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e64159690 0x7f5e640c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:43.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 0x7f5e6415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:43.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6415af00 con 0x7f5e640c8d70 2023-10-25T16:19:43.504 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6415b1e0 con 0x7f5e64097a40 2023-10-25T16:19:43.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6415b4c0 con 0x7f5e64159690 2023-10-25T16:19:43.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 0x7f5e6415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:43.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 0x7f5e6415bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33662/0 (socket says 172.21.15.177:33662) 2023-10-25T16:19:43.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 -- 172.21.15.177:0/710531194 learned_addr learned my addr 172.21.15.177:0/710531194 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:43.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e637fe640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e64097a40 0x7f5e6414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:43.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e62ffd640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e64159690 0x7f5e640c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:43.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 -- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e64159690 msgr2=0x7f5e640c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:43.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e64159690 0x7f5e640c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 -- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e64097a40 msgr2=0x7f5e6414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:43.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e64097a40 0x7f5e6414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:43.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 -- 172.21.15.177:0/710531194 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009560 con 0x7f5e640c8d70 2023-10-25T16:19:43.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e63fff640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 0x7f5e6415bca0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009850 tx=0x7f5e540a57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:43.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540ba070 con 0x7f5e640c8d70 2023-10-25T16:19:43.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5e540051e0 con 0x7f5e640c8d70 2023-10-25T16:19:43.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e640ae470 con 0x7f5e640c8d70 2023-10-25T16:19:43.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540055f0 con 0x7f5e640c8d70 2023-10-25T16:19:43.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6414f060 con 0x7f5e640c8d70 2023-10-25T16:19:43.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e64073360 con 0x7f5e640c8d70 2023-10-25T16:19:43.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5e540b4070 con 0x7f5e640c8d70 2023-10-25T16:19:43.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e5bfff640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e44066470 0x7f5e44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:43.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.504+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e5411e3f0 con 0x7f5e640c8d70 2023-10-25T16:19:43.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.508+0000 7f5e637fe640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e44066470 0x7f5e44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:43.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.508+0000 7f5e637fe640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e44066470 0x7f5e44068930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005c50 tx=0x7f5e5c00a390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:43.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.508+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e540eb810 con 0x7f5e640c8d70 2023-10-25T16:19:43.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:43.660+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e6415b040 con 0x7f5e640c8d70 2023-10-25T16:19:44.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.300+0000 7f5e5bfff640 1 -- 172.21.15.177:0/710531194 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5e6415b040 con 0x7f5e640c8d70 2023-10-25T16:19:44.300 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:19:44.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e44066470 msgr2=0x7f5e44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:44.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e44066470 0x7f5e44068930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005c50 tx=0x7f5e5c00a390 comp rx=0 tx=0).stop 2023-10-25T16:19:44.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 msgr2=0x7f5e6415bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:44.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 0x7f5e6415bca0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009850 tx=0x7f5e540a57e0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 shutdown_connections 2023-10-25T16:19:44.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5e44066470 0x7f5e44068930 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640c8d70 0x7f5e6415bca0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5e64159690 0x7f5e640c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 --2- 172.21.15.177:0/710531194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5e64097a40 0x7f5e6414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 >> 172.21.15.177:0/710531194 conn(0x7f5e640b0b50 msgr2=0x7f5e640ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:44.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 shutdown_connections 2023-10-25T16:19:44.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.304+0000 7f5e69aad640 1 -- 172.21.15.177:0/710531194 wait complete. 2023-10-25T16:19:44.324 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:19:44.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/2979358425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a5815d730 msgr2=0x7f8a5815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:44.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/2979358425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a5815d730 0x7f8a5815dbc0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009c80 tx=0x7f8a5001cc80 comp rx=0 tx=0).stop 2023-10-25T16:19:44.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/2979358425 shutdown_connections 2023-10-25T16:19:44.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/2979358425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a5815d730 0x7f8a5815dbc0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/2979358425 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a580ac220 0x7f8a58159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/2979358425 >> 172.21.15.177:0/2979358425 conn(0x7f8a58069920 msgr2=0x7f8a58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:44.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/2979358425 shutdown_connections 2023-10-25T16:19:44.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/2979358425 wait complete. 2023-10-25T16:19:44.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 Processor -- start 2023-10-25T16:19:44.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- start start 2023-10-25T16:19:44.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 0x7f8a5813c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:44.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a580ac220 0x7f8a58070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:44.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a5815d730 0x7f8a5806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:44.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580709b0 con 0x7f8a58071080 2023-10-25T16:19:44.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5814ba70 con 0x7f8a5815d730 2023-10-25T16:19:44.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5e8c3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5814c230 con 0x7f8a580ac220 2023-10-25T16:19:44.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 0x7f8a5813c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:44.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 0x7f8a5813c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33672/0 (socket says 172.21.15.177:33672) 2023-10-25T16:19:44.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 -- 172.21.15.177:0/692632003 learned_addr learned my addr 172.21.15.177:0/692632003 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:44.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5ce60640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a5815d730 0x7f8a5806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:44.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 -- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a580ac220 msgr2=0x7f8a58070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:44.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a577fe640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a580ac220 0x7f8a58070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:44.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a580ac220 0x7f8a58070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 -- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a5815d730 msgr2=0x7f8a5806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:44.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a5815d730 0x7f8a5806f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:44.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a57fff640 1 -- 172.21.15.177:0/692632003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500098e0 con 0x7f8a58071080 2023-10-25T16:19:44.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.456+0000 7f8a5ce60640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a5815d730 0x7f8a5806f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:44.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a57fff640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 0x7f8a5813c840 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800c970 tx=0x7f8a4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:44.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48007bb0 con 0x7f8a58071080 2023-10-25T16:19:44.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a48007e20 con 0x7f8a58071080 2023-10-25T16:19:44.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5814ae60 con 0x7f8a58071080 2023-10-25T16:19:44.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48005280 con 0x7f8a58071080 2023-10-25T16:19:44.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5814b420 con 0x7f8a58071080 2023-10-25T16:19:44.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a58073360 con 0x7f8a58071080 2023-10-25T16:19:44.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8a480053e0 con 0x7f8a58071080 2023-10-25T16:19:44.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a54ff9640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8a44066470 0x7f8a44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:44.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f8a480846b0 con 0x7f8a58071080 2023-10-25T16:19:44.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a577fe640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8a44066470 0x7f8a44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:44.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.460+0000 7f8a577fe640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8a44066470 0x7f8a44068930 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8a58159610 tx=0x7f8a4c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:44.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.464+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8a48051c90 con 0x7f8a58071080 2023-10-25T16:19:44.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:44.604+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a5814bbb0 con 0x7f8a58071080 2023-10-25T16:19:45.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a54ff9640 1 -- 172.21.15.177:0/692632003 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8a4801d020 con 0x7f8a58071080 2023-10-25T16:19:45.314 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:19:45.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8a44066470 msgr2=0x7f8a44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8a44066470 0x7f8a44068930 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8a58159610 tx=0x7f8a4c009040 comp rx=0 tx=0).stop 2023-10-25T16:19:45.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 msgr2=0x7f8a5813c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 0x7f8a5813c840 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800c970 tx=0x7f8a4800ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:45.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 shutdown_connections 2023-10-25T16:19:45.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8a44066470 0x7f8a44068930 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a5815d730 0x7f8a5806f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a580ac220 0x7f8a58070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 --2- 172.21.15.177:0/692632003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a58071080 0x7f8a5813c840 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 >> 172.21.15.177:0/692632003 conn(0x7f8a58069920 msgr2=0x7f8a5815b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:45.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 shutdown_connections 2023-10-25T16:19:45.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.316+0000 7f8a5e8c3640 1 -- 172.21.15.177:0/692632003 wait complete. 2023-10-25T16:19:45.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:19:45.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- 172.21.15.177:0/3972946357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 msgr2=0x7fc8640cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3972946357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc8640cbeb0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc858009900 tx=0x7fc85801c850 comp rx=0 tx=0).stop 2023-10-25T16:19:45.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- 172.21.15.177:0/3972946357 shutdown_connections 2023-10-25T16:19:45.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3972946357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc8640cbeb0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- 172.21.15.177:0/3972946357 >> 172.21.15.177:0/3972946357 conn(0x7fc8640b2680 msgr2=0x7fc8640b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:45.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- 172.21.15.177:0/3972946357 shutdown_connections 2023-10-25T16:19:45.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- 172.21.15.177:0/3972946357 wait complete. 2023-10-25T16:19:45.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 Processor -- start 2023-10-25T16:19:45.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- start start 2023-10-25T16:19:45.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864066d10 0x7fc86414c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cc3f0 0x7fc864161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc864160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641609b0 con 0x7fc864158350 2023-10-25T16:19:45.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8641f7c50 con 0x7fc864066d10 2023-10-25T16:19:45.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc8689ca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86414c590 con 0x7fc8640cc3f0 2023-10-25T16:19:45.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc862d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc864160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc862d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc864160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33696/0 (socket says 172.21.15.177:33696) 2023-10-25T16:19:45.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.472+0000 7fc862d9d640 1 -- 172.21.15.177:0/3984293531 learned_addr learned my addr 172.21.15.177:0/3984293531 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:45.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc86259c640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864066d10 0x7fc86414c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc861d9b640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cc3f0 0x7fc864161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc862d9d640 1 -- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cc3f0 msgr2=0x7fc864161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc862d9d640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cc3f0 0x7fc864161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc862d9d640 1 -- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864066d10 msgr2=0x7fc86414c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc862d9d640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864066d10 0x7fc86414c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc862d9d640 1 -- 172.21.15.177:0/3984293531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009560 con 0x7fc864158350 2023-10-25T16:19:45.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc861d9b640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cc3f0 0x7fc864161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:45.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc862d9d640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc864160e40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c3f0 tx=0x7fc85400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:45.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854011790 con 0x7fc864158350 2023-10-25T16:19:45.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc8540119e0 con 0x7fc864158350 2023-10-25T16:19:45.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640cd470 con 0x7fc864158350 2023-10-25T16:19:45.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854011df0 con 0x7fc864158350 2023-10-25T16:19:45.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc864152f10 con 0x7fc864158350 2023-10-25T16:19:45.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc864160b20 con 0x7fc864158350 2023-10-25T16:19:45.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc85401c460 con 0x7fc864158350 2023-10-25T16:19:45.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc852ffd640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc844066470 0x7fc844068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc854083cc0 con 0x7fc864158350 2023-10-25T16:19:45.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc86259c640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc844066470 0x7fc844068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.476+0000 7fc86259c640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc844066470 0x7fc844068930 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0012f0 tx=0x7fc85c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:45.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.480+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc854051440 con 0x7fc864158350 2023-10-25T16:19:45.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.636+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7fc86404daf0 con 0x7fc864158350 2023-10-25T16:19:45.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc852ffd640 1 -- 172.21.15.177:0/3984293531 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v30) v1 ==== 71+0+0 (secure 0 0 0) 0x7fc854003810 con 0x7fc864158350 2023-10-25T16:19:45.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc844066470 msgr2=0x7fc844068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc844066470 0x7fc844068930 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0012f0 tx=0x7fc85c009040 comp rx=0 tx=0).stop 2023-10-25T16:19:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 msgr2=0x7fc864160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc864160e40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c3f0 tx=0x7fc85400c8b0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 shutdown_connections 2023-10-25T16:19:45.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc844066470 0x7fc844068930 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc864158350 0x7fc864160e40 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8640cc3f0 0x7fc864161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 --2- 172.21.15.177:0/3984293531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc864066d10 0x7fc86414c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 >> 172.21.15.177:0/3984293531 conn(0x7fc8640b2680 msgr2=0x7fc86414d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:45.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 shutdown_connections 2023-10-25T16:19:45.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.644+0000 7fc8689ca640 1 -- 172.21.15.177:0/3984293531 wait complete. 2023-10-25T16:19:45.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-10-25T16:19:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 -- 172.21.15.177:0/3370880633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d40047d0 msgr2=0x7f96d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 --2- 172.21.15.177:0/3370880633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d40047d0 0x7f96d4004c50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f96d80016b0 tx=0x7f96d801c740 comp rx=0 tx=0).stop 2023-10-25T16:19:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 -- 172.21.15.177:0/3370880633 shutdown_connections 2023-10-25T16:19:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 --2- 172.21.15.177:0/3370880633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96d40047d0 0x7f96d4004c50 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 -- 172.21.15.177:0/3370880633 >> 172.21.15.177:0/3370880633 conn(0x7f96e80983a0 msgr2=0x7f96e80cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 -- 172.21.15.177:0/3370880633 shutdown_connections 2023-10-25T16:19:45.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 -- 172.21.15.177:0/3370880633 wait complete. 2023-10-25T16:19:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 Processor -- start 2023-10-25T16:19:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 -- start start 2023-10-25T16:19:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.788+0000 7f96efe05640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d40047d0 0x7f96e8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 0x7f96e80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e80ca680 0x7f96e80c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e806b420 con 0x7f96e806b840 2023-10-25T16:19:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80cab00 con 0x7f96d40047d0 2023-10-25T16:19:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e806a830 con 0x7f96e80ca680 2023-10-25T16:19:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 0x7f96e80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 0x7f96e80ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33720/0 (socket says 172.21.15.177:33720) 2023-10-25T16:19:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 -- 172.21.15.177:0/1051677084 learned_addr learned my addr 172.21.15.177:0/1051677084 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ee3a2640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e80ca680 0x7f96e80c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96edba1640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d40047d0 0x7f96e8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 -- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e80ca680 msgr2=0x7f96e80c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e80ca680 0x7f96e80c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 -- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d40047d0 msgr2=0x7f96e8155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d40047d0 0x7f96e8155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 -- 172.21.15.177:0/1051677084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80cd770 con 0x7f96e806b840 2023-10-25T16:19:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96ed3a0640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 0x7f96e80ca140 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f96d801c570 tx=0x7f96d8003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80a9040 con 0x7f96e806b840 2023-10-25T16:19:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96d80a5870 con 0x7f96e806b840 2023-10-25T16:19:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8155e80 con 0x7f96e806b840 2023-10-25T16:19:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80a5c60 con 0x7f96e806b840 2023-10-25T16:19:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e806ad60 con 0x7f96e806b840 2023-10-25T16:19:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e806b690 con 0x7f96e806b840 2023-10-25T16:19:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96d80b5020 con 0x7f96e806b840 2023-10-25T16:19:45.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96de7fc640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96cc0664a0 0x7f96cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:45.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f96d80aa070 con 0x7f96e806b840 2023-10-25T16:19:45.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.792+0000 7f96edba1640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96cc0664a0 0x7f96cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:45.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.796+0000 7f96edba1640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96cc0664a0 0x7f96cc068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f96e4005c50 tx=0x7f96e4005be0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:45.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:45.796+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96d80eb320 con 0x7f96e806b840 2023-10-25T16:19:46.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.000+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f96e804daf0 con 0x7f96e806b840 2023-10-25T16:19:46.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.316+0000 7f96de7fc640 1 -- 172.21.15.177:0/1051677084 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v352) v1 ==== 128+0+0 (secure 0 0 0) 0x7f96d80bd020 con 0x7f96e806b840 2023-10-25T16:19:46.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96cc0664a0 msgr2=0x7f96cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96cc0664a0 0x7f96cc068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f96e4005c50 tx=0x7f96e4005be0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 msgr2=0x7f96e80ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 0x7f96e80ca140 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f96d801c570 tx=0x7f96d8003c60 comp rx=0 tx=0).stop 2023-10-25T16:19:46.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 shutdown_connections 2023-10-25T16:19:46.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f96cc0664a0 0x7f96cc068960 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96e80ca680 0x7f96e80c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96e806b840 0x7f96e80ca140 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 --2- 172.21.15.177:0/1051677084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96d40047d0 0x7f96e8155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 >> 172.21.15.177:0/1051677084 conn(0x7f96e80983a0 msgr2=0x7f96e806e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:46.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 shutdown_connections 2023-10-25T16:19:46.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.320+0000 7f96efe05640 1 -- 172.21.15.177:0/1051677084 wait complete. 2023-10-25T16:19:46.342 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-10-25T16:19:46.343 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-25T16:19:46.343 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:46.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- 172.21.15.177:0/3127240082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 msgr2=0x7f9b8c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 --2- 172.21.15.177:0/3127240082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9b8c004c50 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800bb10 tx=0x7f9b9801cd80 comp rx=0 tx=0).stop 2023-10-25T16:19:46.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- 172.21.15.177:0/3127240082 shutdown_connections 2023-10-25T16:19:46.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 --2- 172.21.15.177:0/3127240082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9b8c004c50 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- 172.21.15.177:0/3127240082 >> 172.21.15.177:0/3127240082 conn(0x7f9ba409a640 msgr2=0x7f9ba40d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:46.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- 172.21.15.177:0/3127240082 shutdown_connections 2023-10-25T16:19:46.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- 172.21.15.177:0/3127240082 wait complete. 2023-10-25T16:19:46.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 Processor -- start 2023-10-25T16:19:46.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- start start 2023-10-25T16:19:46.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9ba40c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ba40caed0 0x7f9ba40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ba40c9770 0x7f9ba40c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40b71b0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba415e1a0 con 0x7f9ba40caed0 2023-10-25T16:19:46.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9bab327640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40b6480 con 0x7f9ba40c9770 2023-10-25T16:19:46.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9ba40c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9ba40c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33732/0 (socket says 172.21.15.177:33732) 2023-10-25T16:19:46.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 -- 172.21.15.177:0/921643270 learned_addr learned my addr 172.21.15.177:0/921643270 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:46.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba98c4640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ba40c9770 0x7f9ba40c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba88c2640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ba40caed0 0x7f9ba40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 -- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ba40c9770 msgr2=0x7f9ba40c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ba40c9770 0x7f9ba40c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 -- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ba40caed0 msgr2=0x7f9ba40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ba40caed0 0x7f9ba40c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 -- 172.21.15.177:0/921643270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40cb3d0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba98c4640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ba40c9770 0x7f9ba40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:46.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba88c2640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ba40caed0 0x7f9ba40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:46.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.476+0000 7f9ba90c3640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9ba40c88a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400d8c0 tx=0x7f9b9400dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:46.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400b8d0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9b9400ba30 con 0x7f9b8c0047d0 2023-10-25T16:19:46.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba40b66d0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400bda0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba40b6c90 con 0x7f9b8c0047d0 2023-10-25T16:19:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba415d490 con 0x7f9b8c0047d0 2023-10-25T16:19:46.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9b9401a3b0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba1ffb640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b90066470 0x7f9b90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9b94083dc0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba88c2640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b90066470 0x7f9b90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.480+0000 7f9ba88c2640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b90066470 0x7f9b90068930 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9b980b0000 tx=0x7f9b98019b20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:46.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.484+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b940515d0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.640+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ba404daf0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9ba1ffb640 1 -- 172.21.15.177:0/921643270 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+13023 (secure 0 0 0) 0x7f9b94054bf0 con 0x7f9b8c0047d0 2023-10-25T16:19:46.642 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:46.643 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":135,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:45.304276+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/2032322363":"2023-10-26T16:19:42.293740+0000","172.21.15.177:6834/2032322363":"2023-10-26T16:19:42.293740+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:46.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b90066470 msgr2=0x7f9b90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b90066470 0x7f9b90068930 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9b980b0000 tx=0x7f9b98019b20 comp rx=0 tx=0).stop 2023-10-25T16:19:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 msgr2=0x7f9ba40c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9ba40c88a0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400d8c0 tx=0x7f9b9400dd80 comp rx=0 tx=0).stop 2023-10-25T16:19:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 shutdown_connections 2023-10-25T16:19:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9b90066470 0x7f9b90068930 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ba40c9770 0x7f9ba40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ba40caed0 0x7f9ba40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 --2- 172.21.15.177:0/921643270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9b8c0047d0 0x7f9ba40c88a0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 >> 172.21.15.177:0/921643270 conn(0x7f9ba409a640 msgr2=0x7f9ba40b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:46.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 shutdown_connections 2023-10-25T16:19:46.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.644+0000 7f9bab327640 1 -- 172.21.15.177:0/921643270 wait complete. 2023-10-25T16:19:46.661 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:46.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:46.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 -- 172.21.15.177:0/3089780551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c4003980 msgr2=0x7f17c4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/3089780551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c4003980 0x7f17c4003d80 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c700 tx=0x7f17cc01c680 comp rx=0 tx=0).stop 2023-10-25T16:19:46.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 -- 172.21.15.177:0/3089780551 shutdown_connections 2023-10-25T16:19:46.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/3089780551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c4003980 0x7f17c4003d80 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 -- 172.21.15.177:0/3089780551 >> 172.21.15.177:0/3089780551 conn(0x7f17dc09a5c0 msgr2=0x7f17dc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:46.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 -- 172.21.15.177:0/3089780551 shutdown_connections 2023-10-25T16:19:46.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 -- 172.21.15.177:0/3089780551 wait complete. 2023-10-25T16:19:46.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 Processor -- start 2023-10-25T16:19:46.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.788+0000 7f17e0d6d640 1 -- start start 2023-10-25T16:19:46.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c4003980 0x7f17dc1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17dc0c8d90 0x7f17dc154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 0x7f17dc0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0cb1f0 con 0x7f17dc0ca800 2023-10-25T16:19:46.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc151d10 con 0x7f17dc0c8d90 2023-10-25T16:19:46.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0c92c0 con 0x7f17c4003980 2023-10-25T16:19:46.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 0x7f17dc0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 0x7f17dc0cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33754/0 (socket says 172.21.15.177:33754) 2023-10-25T16:19:46.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 -- 172.21.15.177:0/513445417 learned_addr learned my addr 172.21.15.177:0/513445417 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:46.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17d9d9b640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17dc0c8d90 0x7f17dc154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17da59c640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c4003980 0x7f17dc1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 -- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c4003980 msgr2=0x7f17dc1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c4003980 0x7f17dc1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 -- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17dc0c8d90 msgr2=0x7f17dc154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17dc0c8d90 0x7f17dc154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 -- 172.21.15.177:0/513445417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0c95a0 con 0x7f17dc0ca800 2023-10-25T16:19:46.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17da59c640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c4003980 0x7f17dc1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:46.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17dad9d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 0x7f17dc0cacb0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f17d40012f0 tx=0x7f17d400df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:46.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4003b90 con 0x7f17dc0ca800 2023-10-25T16:19:46.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17d4003d10 con 0x7f17dc0ca800 2023-10-25T16:19:46.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc0c9880 con 0x7f17dc0ca800 2023-10-25T16:19:46.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4005290 con 0x7f17dc0ca800 2023-10-25T16:19:46.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc0c9e40 con 0x7f17dc0ca800 2023-10-25T16:19:46.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc04daf0 con 0x7f17dc0ca800 2023-10-25T16:19:46.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17d40053f0 con 0x7f17dc0ca800 2023-10-25T16:19:46.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17caffd640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:46.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17d40837e0 con 0x7f17dc0ca800 2023-10-25T16:19:46.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.792+0000 7f17da59c640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:46.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.796+0000 7f17da59c640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f17c40057b0 tx=0x7f17cc019420 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:46.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.796+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17d4050fd0 con 0x7f17dc0ca800 2023-10-25T16:19:46.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.956+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17dc0b6d00 con 0x7f17dc0ca800 2023-10-25T16:19:46.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17caffd640 1 -- 172.21.15.177:0/513445417 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17d4018020 con 0x7f17dc0ca800 2023-10-25T16:19:46.957 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:46.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 msgr2=0x7f17bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f17c40057b0 tx=0x7f17cc019420 comp rx=0 tx=0).stop 2023-10-25T16:19:46.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 msgr2=0x7f17dc0cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:46.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 0x7f17dc0cacb0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f17d40012f0 tx=0x7f17d400df00 comp rx=0 tx=0).stop 2023-10-25T16:19:46.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 shutdown_connections 2023-10-25T16:19:46.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17bc0664a0 0x7f17bc068960 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17dc0ca800 0x7f17dc0cacb0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17dc0c8d90 0x7f17dc154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 --2- 172.21.15.177:0/513445417 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f17c4003980 0x7f17dc1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:46.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 >> 172.21.15.177:0/513445417 conn(0x7f17dc09a5c0 msgr2=0x7f17dc0b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:46.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 shutdown_connections 2023-10-25T16:19:46.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:46.960+0000 7f17e0d6d640 1 -- 172.21.15.177:0/513445417 wait complete. 2023-10-25T16:19:46.976 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-25T16:19:47.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 -- 172.21.15.177:0/3646053154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 msgr2=0x7f967806ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:47.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 --2- 172.21.15.177:0/3646053154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f967806ba50 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9678141ee0 tx=0x7f966c01c530 comp rx=0 tx=0).stop 2023-10-25T16:19:47.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 -- 172.21.15.177:0/3646053154 shutdown_connections 2023-10-25T16:19:47.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 --2- 172.21.15.177:0/3646053154 >> v2:172.21.15.184:3300/0 conn(0x7f967806bf90 0x7f96780aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:47.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 --2- 172.21.15.177:0/3646053154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f967806ba50 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:47.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 --2- 172.21.15.177:0/3646053154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9678140cf0 0x7f96780af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:47.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 -- 172.21.15.177:0/3646053154 >> 172.21.15.177:0/3646053154 conn(0x7f96780b2450 msgr2=0x7f96780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:47.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.100+0000 7f967d63f640 1 -- 172.21.15.177:0/3646053154 shutdown_connections 2023-10-25T16:19:47.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- 172.21.15.177:0/3646053154 wait complete. 2023-10-25T16:19:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 Processor -- start 2023-10-25T16:19:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- start start 2023-10-25T16:19:47.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f967806bf90 0x7f967813a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f96781f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9678140cf0 0x7f967813f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967813aef0 con 0x7f967806f570 2023-10-25T16:19:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96781f7240 con 0x7f9678140cf0 2023-10-25T16:19:47.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96781f2e10 con 0x7f967806bf90 2023-10-25T16:19:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f96781f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f96781f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33774/0 (socket says 172.21.15.177:33774) 2023-10-25T16:19:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 -- 172.21.15.177:0/2460942849 learned_addr learned my addr 172.21.15.177:0/2460942849 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f9676ffd640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f967806bf90 0x7f967813a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:47.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96777fe640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9678140cf0 0x7f967813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:47.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 -- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f967806bf90 msgr2=0x7f967813a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:47.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f967806bf90 0x7f967813a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:47.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 -- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9678140cf0 msgr2=0x7f967813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:47.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9678140cf0 0x7f967813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:47.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 -- 172.21.15.177:0/2460942849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c009500 con 0x7f967806f570 2023-10-25T16:19:47.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96777fe640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9678140cf0 0x7f967813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:47.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f9676ffd640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f967806bf90 0x7f967813a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:47.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f96767fc640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f96781f6d00 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f966c009840 tx=0x7f966c0aa560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:47.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c004300 con 0x7f967806f570 2023-10-25T16:19:47.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f966c005020 con 0x7f967806f570 2023-10-25T16:19:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96781f30f0 con 0x7f967806f570 2023-10-25T16:19:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c005410 con 0x7f967806f570 2023-10-25T16:19:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96781f36b0 con 0x7f967806f570 2023-10-25T16:19:47.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.104+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96781f38a0 con 0x7f967806f570 2023-10-25T16:19:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.108+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f966c0bb070 con 0x7f967806f570 2023-10-25T16:19:47.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.108+0000 7f965f7fe640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9664066470 0x7f9664068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.108+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f966c11ee30 con 0x7f967806f570 2023-10-25T16:19:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.108+0000 7f9676ffd640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9664066470 0x7f9664068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.108+0000 7f9676ffd640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9664066470 0x7f9664068930 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f96680058d0 tx=0x7f9668005e10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:47.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.112+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f966c0ec740 con 0x7f967806f570 2023-10-25T16:19:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:47.316+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f96781f2f50 con 0x7f967806f570 2023-10-25T16:19:48.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.332+0000 7f965f7fe640 1 -- 172.21.15.177:0/2460942849 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v354) v1 ==== 143+0+0 (secure 0 0 0) 0x7f96781f2f50 con 0x7f967806f570 2023-10-25T16:19:48.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.332+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9664066470 msgr2=0x7f9664068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.332+0000 7f967d63f640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9664066470 0x7f9664068930 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f96680058d0 tx=0x7f9668005e10 comp rx=0 tx=0).stop 2023-10-25T16:19:48.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.332+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 msgr2=0x7f96781f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.332+0000 7f967d63f640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f96781f6d00 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f966c009840 tx=0x7f966c0aa560 comp rx=0 tx=0).stop 2023-10-25T16:19:48.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.332+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 shutdown_connections 2023-10-25T16:19:48.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9664066470 0x7f9664068930 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9678140cf0 0x7f967813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f967806f570 0x7f96781f6d00 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 --2- 172.21.15.177:0/2460942849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f967806bf90 0x7f967813a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 >> 172.21.15.177:0/2460942849 conn(0x7f96780b2450 msgr2=0x7f9678157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:48.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 shutdown_connections 2023-10-25T16:19:48.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.336+0000 7f967d63f640 1 -- 172.21.15.177:0/2460942849 wait complete. 2023-10-25T16:19:48.355 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:19:48.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 -- 172.21.15.177:0/3910263435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59415eba0 msgr2=0x7fc5940b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 --2- 172.21.15.177:0/3910263435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59415eba0 0x7fc5940b4100 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fc59409f200 tx=0x7fc58401c750 comp rx=0 tx=0).stop 2023-10-25T16:19:48.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 -- 172.21.15.177:0/3910263435 shutdown_connections 2023-10-25T16:19:48.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 --2- 172.21.15.177:0/3910263435 >> v2:172.21.15.184:3300/0 conn(0x7fc5940b2120 0x7fc5940d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 --2- 172.21.15.177:0/3910263435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59415eba0 0x7fc5940b4100 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 -- 172.21.15.177:0/3910263435 >> 172.21.15.177:0/3910263435 conn(0x7fc59409a5c0 msgr2=0x7fc5940d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:48.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 -- 172.21.15.177:0/3910263435 shutdown_connections 2023-10-25T16:19:48.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.480+0000 7fc599cb3640 1 -- 172.21.15.177:0/3910263435 wait complete. 2023-10-25T16:19:48.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 Processor -- start 2023-10-25T16:19:48.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- start start 2023-10-25T16:19:48.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 0x7fc594153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5940cdb10 0x7fc594138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59415eba0 0x7fc594139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc594158220 con 0x7fc5940b2120 2023-10-25T16:19:48.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59414ed00 con 0x7fc59415eba0 2023-10-25T16:19:48.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59414efe0 con 0x7fc5940cdb10 2023-10-25T16:19:48.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 0x7fc594153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 0x7fc594153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33796/0 (socket says 172.21.15.177:33796) 2023-10-25T16:19:48.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 -- 172.21.15.177:0/1392022700 learned_addr learned my addr 172.21.15.177:0/1392022700 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:48.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc592ffd640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5940cdb10 0x7fc594138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc593fff640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59415eba0 0x7fc594139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 -- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5940cdb10 msgr2=0x7fc594138ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5940cdb10 0x7fc594138ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 -- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59415eba0 msgr2=0x7fc594139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59415eba0 0x7fc594139220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 -- 172.21.15.177:0/1392022700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840094a0 con 0x7fc5940b2120 2023-10-25T16:19:48.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc592ffd640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5940cdb10 0x7fc594138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:48.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc5937fe640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 0x7fc594153560 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fc584000c10 tx=0x7fc5840a6620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:48.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840b5070 con 0x7fc5940b2120 2023-10-25T16:19:48.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc584004030 con 0x7fc5940b2120 2023-10-25T16:19:48.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59414f2c0 con 0x7fc5940b2120 2023-10-25T16:19:48.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584004440 con 0x7fc5940b2120 2023-10-25T16:19:48.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc594158500 con 0x7fc5940b2120 2023-10-25T16:19:48.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.484+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59404daf0 con 0x7fc5940b2120 2023-10-25T16:19:48.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.488+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc584005140 con 0x7fc5940b2120 2023-10-25T16:19:48.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.488+0000 7fc57bfff640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc580066470 0x7fc580068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.488+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc58411dd60 con 0x7fc5940b2120 2023-10-25T16:19:48.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.488+0000 7fc592ffd640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc580066470 0x7fc580068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.488+0000 7fc592ffd640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc580066470 0x7fc580068930 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc588005fd0 tx=0x7fc588005da0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:48.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.492+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5840eb4f0 con 0x7fc5940b2120 2023-10-25T16:19:48.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.644+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fc5940ce930 con 0x7fc5940b2120 2023-10-25T16:19:48.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc57bfff640 1 -- 172.21.15.177:0/1392022700 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+1116 (secure 0 0 0) 0x7fc5840eeb10 con 0x7fc5940b2120 2023-10-25T16:19:48.646 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:19:48.646 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:19:48.646 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:19:48.647 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:19:48.647 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:19:48.647 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:19:48.647 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:19:48.647 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:19:48.648 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:19:48.648 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:19:48.648 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:19:48.648 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:19:48.648 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:19:48.648 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:19:48.649 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:19:48.649 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:19:48.649 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:19:48.649 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:19:48.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc580066470 msgr2=0x7fc580068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc580066470 0x7fc580068930 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc588005fd0 tx=0x7fc588005da0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 msgr2=0x7fc594153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 0x7fc594153560 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fc584000c10 tx=0x7fc5840a6620 comp rx=0 tx=0).stop 2023-10-25T16:19:48.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 shutdown_connections 2023-10-25T16:19:48.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc580066470 0x7fc580068930 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59415eba0 0x7fc594139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5940cdb10 0x7fc594138ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 --2- 172.21.15.177:0/1392022700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940b2120 0x7fc594153560 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 >> 172.21.15.177:0/1392022700 conn(0x7fc59409a5c0 msgr2=0x7fc5940cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:48.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 shutdown_connections 2023-10-25T16:19:48.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.648+0000 7fc599cb3640 1 -- 172.21.15.177:0/1392022700 wait complete. 2023-10-25T16:19:48.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:19:48.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- 172.21.15.177:0/770456312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b0005190 msgr2=0x7f78b000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 --2- 172.21.15.177:0/770456312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b0005190 0x7f78b000b990 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009e00 tx=0x7f78c001d150 comp rx=0 tx=0).stop 2023-10-25T16:19:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- 172.21.15.177:0/770456312 shutdown_connections 2023-10-25T16:19:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 --2- 172.21.15.177:0/770456312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b0005190 0x7f78b000b990 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- 172.21.15.177:0/770456312 >> 172.21.15.177:0/770456312 conn(0x7f78c80b2450 msgr2=0x7f78c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- 172.21.15.177:0/770456312 shutdown_connections 2023-10-25T16:19:48.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- 172.21.15.177:0/770456312 wait complete. 2023-10-25T16:19:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 Processor -- start 2023-10-25T16:19:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- start start 2023-10-25T16:19:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b0005190 0x7f78c81417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 0x7f78c8156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78c8143c50 0x7f78c813fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8141330 con 0x7f78c81554d0 2023-10-25T16:19:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8140a00 con 0x7f78b0005190 2023-10-25T16:19:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78cd689640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c8140ce0 con 0x7f78c8143c50 2023-10-25T16:19:48.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 0x7f78c8156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 0x7f78c8156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33814/0 (socket says 172.21.15.177:33814) 2023-10-25T16:19:48.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 -- 172.21.15.177:0/2384462169 learned_addr learned my addr 172.21.15.177:0/2384462169 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:48.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c6ffd640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b0005190 0x7f78c81417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c77fe640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78c8143c50 0x7f78c813fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 -- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78c8143c50 msgr2=0x7f78c813fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78c8143c50 0x7f78c813fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 -- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b0005190 msgr2=0x7f78c81417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b0005190 0x7f78c81417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 -- 172.21.15.177:0/2384462169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8140fc0 con 0x7f78c81554d0 2023-10-25T16:19:48.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c6ffd640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b0005190 0x7f78c81417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:19:48.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.784+0000 7f78c67fc640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 0x7f78c8156930 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f78bc006fd0 tx=0x7f78bc00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:48.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0062e0 con 0x7f78c81554d0 2023-10-25T16:19:48.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78bc006530 con 0x7f78c81554d0 2023-10-25T16:19:48.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0038d0 con 0x7f78c81554d0 2023-10-25T16:19:48.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c8156e70 con 0x7f78c81554d0 2023-10-25T16:19:48.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c81442d0 con 0x7f78c81554d0 2023-10-25T16:19:48.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c81414a0 con 0x7f78c81554d0 2023-10-25T16:19:48.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f78bc003a30 con 0x7f78c81554d0 2023-10-25T16:19:48.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78af7fe640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78b4066470 0x7f78b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:48.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f78bc084420 con 0x7f78c81554d0 2023-10-25T16:19:48.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78c6ffd640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78b4066470 0x7f78b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:48.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.788+0000 7f78c6ffd640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78b4066470 0x7f78b4068930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f78c815b290 tx=0x7f78b8001590 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:48.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.792+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78bc051b20 con 0x7f78c81554d0 2023-10-25T16:19:48.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.940+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f78c8157060 con 0x7f78c81554d0 2023-10-25T16:19:48.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.944+0000 7f78af7fe640 1 -- 172.21.15.177:0/2384462169 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f78c8157060 con 0x7f78c81554d0 2023-10-25T16:19:48.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78b4066470 msgr2=0x7f78b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78b4066470 0x7f78b4068930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f78c815b290 tx=0x7f78b8001590 comp rx=0 tx=0).stop 2023-10-25T16:19:48.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 msgr2=0x7f78c8156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:48.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 0x7f78c8156930 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f78bc006fd0 tx=0x7f78bc00da80 comp rx=0 tx=0).stop 2023-10-25T16:19:48.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 shutdown_connections 2023-10-25T16:19:48.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f78b4066470 0x7f78b4068930 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78c8143c50 0x7f78c813fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c81554d0 0x7f78c8156930 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 --2- 172.21.15.177:0/2384462169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78b0005190 0x7f78c81417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:48.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 >> 172.21.15.177:0/2384462169 conn(0x7f78c80b2450 msgr2=0x7f78c80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:48.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 shutdown_connections 2023-10-25T16:19:48.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:48.948+0000 7f78cd689640 1 -- 172.21.15.177:0/2384462169 wait complete. 2023-10-25T16:19:48.961 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:19:48.962 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:19:49.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:19:49.051 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:19:49.052 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:19:49.052 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:49.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:19:49.059 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:19:49.060 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:49.098 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:19:49.099 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:19:49.099 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:49.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:19:49.106 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:19:49.106 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:19:49.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:19:49.147 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:19:49.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:49.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 -- 172.21.15.177:0/172973653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac406b980 msgr2=0x7f8ac406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/172973653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac406b980 0x7f8ac406be10 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009cb0 tx=0x7f8abc01cd10 comp rx=0 tx=0).stop 2023-10-25T16:19:49.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 -- 172.21.15.177:0/172973653 shutdown_connections 2023-10-25T16:19:49.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/172973653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac406b980 0x7f8ac406be10 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/172973653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac4159230 0x7f8ac4071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 -- 172.21.15.177:0/172973653 >> 172.21.15.177:0/172973653 conn(0x7f8ac40b2450 msgr2=0x7f8ac40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:49.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 -- 172.21.15.177:0/172973653 shutdown_connections 2023-10-25T16:19:49.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 -- 172.21.15.177:0/172973653 wait complete. 2023-10-25T16:19:49.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 Processor -- start 2023-10-25T16:19:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.272+0000 7f8acbb1e640 1 -- start start 2023-10-25T16:19:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac406b980 0x7f8ac40abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 0x7f8ac414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac4159230 0x7f8ac414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b0fb0 con 0x7f8ac4070510 2023-10-25T16:19:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b1290 con 0x7f8ac4159230 2023-10-25T16:19:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b1570 con 0x7f8ac406b980 2023-10-25T16:19:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 0x7f8ac414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 0x7f8ac414de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33836/0 (socket says 172.21.15.177:33836) 2023-10-25T16:19:49.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 -- 172.21.15.177:0/2684920767 learned_addr learned my addr 172.21.15.177:0/2684920767 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aca0bb640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac4159230 0x7f8ac414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 -- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac406b980 msgr2=0x7f8ac40abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac406b980 0x7f8ac40abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 -- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac4159230 msgr2=0x7f8ac414a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac4159230 0x7f8ac414a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 -- 172.21.15.177:0/2684920767 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0098e0 con 0x7f8ac4070510 2023-10-25T16:19:49.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac90b9640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 0x7f8ac414de20 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c410 tx=0x7f8ab400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:49.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40054e0 con 0x7f8ac4070510 2023-10-25T16:19:49.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8ab4003650 con 0x7f8ac4070510 2023-10-25T16:19:49.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac40b1850 con 0x7f8ac4070510 2023-10-25T16:19:49.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4003ac0 con 0x7f8ac4070510 2023-10-25T16:19:49.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac40ac0e0 con 0x7f8ac4070510 2023-10-25T16:19:49.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac41543a0 con 0x7f8ac4070510 2023-10-25T16:19:49.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ab4003c20 con 0x7f8ac4070510 2023-10-25T16:19:49.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aba7fc640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa8066470 0x7f8aa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8ab4083080 con 0x7f8ac4070510 2023-10-25T16:19:49.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.276+0000 7f8ac98ba640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa8066470 0x7f8aa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.280+0000 7f8ac98ba640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa8066470 0x7f8aa8068930 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009690 tx=0x7f8ac0006c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:49.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.280+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ab4050780 con 0x7f8ac4070510 2023-10-25T16:19:49.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.456+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ac404daf0 con 0x7f8ac4070510 2023-10-25T16:19:49.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.456+0000 7f8aba7fc640 1 -- 172.21.15.177:0/2684920767 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f8ab4017e90 con 0x7f8ac4070510 2023-10-25T16:19:49.457 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:49.457 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6217,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1237395743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1237395743},{"type":"v1","addr":"172.21.15.184:6835","nonce":1237395743}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3442332766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3442332766},{"type":"v1","addr":"172.21.15.184:6837","nonce":3442332766}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7680,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2080291973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2080291973},{"type":"v1","addr":"172.21.15.177:6833","nonce":2080291973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1519967591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1519967591},{"type":"v1","addr":"172.21.15.177:6835","nonce":1519967591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46}],"filesystems":[]} 2023-10-25T16:19:49.459 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 46 2023-10-25T16:19:49.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa8066470 msgr2=0x7f8aa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa8066470 0x7f8aa8068930 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009690 tx=0x7f8ac0006c00 comp rx=0 tx=0).stop 2023-10-25T16:19:49.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 msgr2=0x7f8ac414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 0x7f8ac414de20 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c410 tx=0x7f8ab400c8d0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 shutdown_connections 2023-10-25T16:19:49.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8aa8066470 0x7f8aa8068930 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ac4159230 0x7f8ac414a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ac4070510 0x7f8ac414de20 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 --2- 172.21.15.177:0/2684920767 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8ac406b980 0x7f8ac40abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 >> 172.21.15.177:0/2684920767 conn(0x7f8ac40b2450 msgr2=0x7f8ac414f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:49.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 shutdown_connections 2023-10-25T16:19:49.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.460+0000 7f8acbb1e640 1 -- 172.21.15.177:0/2684920767 wait complete. 2023-10-25T16:19:49.474 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:19:49.474 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:19:49.475 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:19:49.475 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:49.476 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:19:49.476 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:19:49.477 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:19:49.477 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:49.478 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:19:49.478 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:19:49.479 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:19:49.479 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:49.480 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:19:49.480 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:19:49.480 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:19:49.481 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:19:49.490 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:19:49.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:19:49.493 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:19:49.493 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:19:49.495 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:19:49.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:19:49.497 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:19:49.498 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:19:49.534 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:19:49.535 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:49.536 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:19:49.537 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:49.540 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:19:49.541 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:19:49.541 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:49.542 DEBUG:teuthology.parallel:result is None 2023-10-25T16:19:49.543 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:19:49.596 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:19:49.599 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:19:49.612 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:19:49.613 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:19:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 -- 172.21.15.177:0/3505859132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 msgr2=0x7fc52c071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 --2- 172.21.15.177:0/3505859132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c071430 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009bc0 tx=0x7fc51c01cb80 comp rx=0 tx=0).stop 2023-10-25T16:19:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 -- 172.21.15.177:0/3505859132 shutdown_connections 2023-10-25T16:19:49.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 --2- 172.21.15.177:0/3505859132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c071430 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 --2- 172.21.15.177:0/3505859132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc52c0cea30 0x7fc52c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 -- 172.21.15.177:0/3505859132 >> 172.21.15.177:0/3505859132 conn(0x7fc52c0cdf10 msgr2=0x7fc52c0ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:49.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 -- 172.21.15.177:0/3505859132 shutdown_connections 2023-10-25T16:19:49.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.656+0000 7fc531351640 1 -- 172.21.15.177:0/3505859132 wait complete. 2023-10-25T16:19:49.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 Processor -- start 2023-10-25T16:19:49.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- start start 2023-10-25T16:19:49.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc52c0cea30 0x7fc52c13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc52c142c90 0x7fc52c1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c15bfc0 con 0x7fc52c070fa0 2023-10-25T16:19:49.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c15a9e0 con 0x7fc52c142c90 2023-10-25T16:19:49.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c15acc0 con 0x7fc52c0cea30 2023-10-25T16:19:49.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c15ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:33882/0 (socket says 172.21.15.177:33882) 2023-10-25T16:19:49.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 -- 172.21.15.177:0/2261566979 learned_addr learned my addr 172.21.15.177:0/2261566979 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:49.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52b7fe640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc52c142c90 0x7fc52c1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52a7fc640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc52c0cea30 0x7fc52c13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 -- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc52c0cea30 msgr2=0x7fc52c13dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc52c0cea30 0x7fc52c13dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 -- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc52c142c90 msgr2=0x7fc52c1404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:49.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc52c142c90 0x7fc52c1404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:49.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 -- 172.21.15.177:0/2261566979 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009820 con 0x7fc52c070fa0 2023-10-25T16:19:49.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc52affd640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c15ba80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c390 tx=0x7fc52400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:49.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524004230 con 0x7fc52c070fa0 2023-10-25T16:19:49.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c15afa0 con 0x7fc52c070fa0 2023-10-25T16:19:49.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc5240044a0 con 0x7fc52c070fa0 2023-10-25T16:19:49.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524003840 con 0x7fc52c070fa0 2023-10-25T16:19:49.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c15b560 con 0x7fc52c070fa0 2023-10-25T16:19:49.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.660+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52c15b780 con 0x7fc52c070fa0 2023-10-25T16:19:49.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.664+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc5240039a0 con 0x7fc52c070fa0 2023-10-25T16:19:49.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.664+0000 7fc5137fe640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc518066470 0x7fc518068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:49.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.664+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc524083400 con 0x7fc52c070fa0 2023-10-25T16:19:49.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.664+0000 7fc52a7fc640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc518066470 0x7fc518068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:49.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.664+0000 7fc52a7fc640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc518066470 0x7fc518068930 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc520005fd0 tx=0x7fc52000a4e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:49.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.668+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc524050b00 con 0x7fc52c070fa0 2023-10-25T16:19:49.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:49.824+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc52c04daf0 con 0x7fc52c070fa0 2023-10-25T16:19:50.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.364+0000 7fc5137fe640 1 -- 172.21.15.177:0/2261566979 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc524054120 con 0x7fc52c070fa0 2023-10-25T16:19:50.365 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:19:50.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc518066470 msgr2=0x7fc518068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc518066470 0x7fc518068930 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc520005fd0 tx=0x7fc52000a4e0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 msgr2=0x7fc52c15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c15ba80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c390 tx=0x7fc52400c850 comp rx=0 tx=0).stop 2023-10-25T16:19:50.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 shutdown_connections 2023-10-25T16:19:50.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc518066470 0x7fc518068930 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc52c142c90 0x7fc52c1404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc52c0cea30 0x7fc52c13dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 --2- 172.21.15.177:0/2261566979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc52c070fa0 0x7fc52c15ba80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 >> 172.21.15.177:0/2261566979 conn(0x7fc52c0cdf10 msgr2=0x7fc52c13b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:50.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 shutdown_connections 2023-10-25T16:19:50.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.368+0000 7fc531351640 1 -- 172.21.15.177:0/2261566979 wait complete. 2023-10-25T16:19:50.390 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:19:50.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- 172.21.15.177:0/1287755280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 msgr2=0x7f8d600b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 --2- 172.21.15.177:0/1287755280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600b4100 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f8d600cb890 tx=0x7f8d5001c810 comp rx=0 tx=0).stop 2023-10-25T16:19:50.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- 172.21.15.177:0/1287755280 shutdown_connections 2023-10-25T16:19:50.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 --2- 172.21.15.177:0/1287755280 >> v2:172.21.15.184:3300/0 conn(0x7f8d600cdb10 0x7f8d600cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 --2- 172.21.15.177:0/1287755280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600b4100 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- 172.21.15.177:0/1287755280 >> 172.21.15.177:0/1287755280 conn(0x7f8d6009a5c0 msgr2=0x7f8d600d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:50.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- 172.21.15.177:0/1287755280 shutdown_connections 2023-10-25T16:19:50.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- 172.21.15.177:0/1287755280 wait complete. 2023-10-25T16:19:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 Processor -- start 2023-10-25T16:19:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- start start 2023-10-25T16:19:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d600b2120 0x7f8d600c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d600cdb10 0x7f8d6015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600c6e40 con 0x7f8d6015eba0 2023-10-25T16:19:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600c61c0 con 0x7f8d600cdb10 2023-10-25T16:19:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d64871640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d600c64a0 con 0x7f8d600b2120 2023-10-25T16:19:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44026/0 (socket says 172.21.15.177:44026) 2023-10-25T16:19:50.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 -- 172.21.15.177:0/3739938524 learned_addr learned my addr 172.21.15.177:0/3739938524 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:50.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5e59c640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d600b2120 0x7f8d600c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 -- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d600b2120 msgr2=0x7f8d600c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d600b2120 0x7f8d600c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 -- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d600cdb10 msgr2=0x7f8d6015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d57fff640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d600cdb10 0x7f8d6015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d600cdb10 0x7f8d6015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 -- 172.21.15.177:0/3739938524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50009560 con 0x7f8d6015eba0 2023-10-25T16:19:50.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d5ed9d640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600cadd0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800ea20 tx=0x7f8d5800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:50.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.516+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800cde0 con 0x7f8d6015eba0 2023-10-25T16:19:50.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8d58004c40 con 0x7f8d6015eba0 2023-10-25T16:19:50.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d600c6780 con 0x7f8d6015eba0 2023-10-25T16:19:50.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58005020 con 0x7f8d6015eba0 2023-10-25T16:19:50.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d600cb310 con 0x7f8d6015eba0 2023-10-25T16:19:50.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d600c6f80 con 0x7f8d6015eba0 2023-10-25T16:19:50.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d58005180 con 0x7f8d6015eba0 2023-10-25T16:19:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d56ffd640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d40066470 0x7f8d40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8d58084490 con 0x7f8d6015eba0 2023-10-25T16:19:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d5e59c640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d40066470 0x7f8d40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.520+0000 7f8d5e59c640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d40066470 0x7f8d40068930 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8d500af000 tx=0x7f8d5001b050 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:50.524 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.524+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d600c6f80 con 0x7f8d6015eba0 2023-10-25T16:19:50.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.732+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8d600c6f80 con 0x7f8d6015eba0 2023-10-25T16:19:50.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.732+0000 7f8d56ffd640 1 -- 172.21.15.177:0/3739938524 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8d600c6f80 con 0x7f8d6015eba0 2023-10-25T16:19:50.733 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:50.733 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:19:50.733 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:19:50.734 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.734 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:19:50.734 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:19:50.734 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.734 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.735 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:50.735 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:50.735 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.735 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.735 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.736 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.736 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:19:50.736 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:19:50.736 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.736 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.737 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:50.737 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:50.737 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.737 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.737 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.738 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:19:50.738 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:19:50.738 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.738 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.739 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:50.739 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:50.739 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.739 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.740 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:19:50.740 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:19:50.740 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.740 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.740 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:50.741 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:50.741 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.741 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.742 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:19:50.742 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:19:50.742 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.742 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.742 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.743 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.743 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.743 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.743 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.743 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:19:50.744 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:19:50.744 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.744 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.744 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.744 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.745 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.745 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.745 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:19:50.745 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:19:50.745 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.746 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.746 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.746 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.746 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.747 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:19:50.747 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:19:50.747 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.747 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.748 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.748 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.748 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.748 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.749 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:19:50.749 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:19:50.749 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.749 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.749 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.750 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.750 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.750 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.750 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:19:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:19:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.751 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.752 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:19:50.752 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:19:50.752 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.753 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.753 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.753 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.753 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.754 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:19:50.754 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:19:50.754 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.754 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:19:50.755 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:19:50.755 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.755 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.755 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.756 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:19:50.756 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:19:50.756 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.756 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.756 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:19:50.756 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:19:50.757 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.757 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.757 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:19:50.757 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:19:50.758 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.758 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.758 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:19:50.758 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:19:50.758 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:19:50.759 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.759 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:19:50.759 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:19:50.759 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.760 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.760 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:19:50.760 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:19:50.760 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:19:50.760 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.761 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.761 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.761 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:19:50.761 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:19:50.761 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.762 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:19:50.762 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:19:50.762 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:19:50.762 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:19:50.762 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.763 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.763 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:19:50.763 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:19:50.763 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.763 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:19:50.764 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:19:50.764 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:19:50.764 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.764 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.765 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.765 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:19:50.765 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:19:50.765 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.765 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:19:50.766 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:19:50.766 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.766 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.766 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:19:50.766 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:50.766 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:19:50.767 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:19:50.767 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:19:50.767 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:19:50.767 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:19:50.767 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:19:50.768 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.768 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:50.768 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:19:50.768 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:19:50.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d40066470 msgr2=0x7f8d40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d40066470 0x7f8d40068930 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8d500af000 tx=0x7f8d5001b050 comp rx=0 tx=0).stop 2023-10-25T16:19:50.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 msgr2=0x7f8d600cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600cadd0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800ea20 tx=0x7f8d5800eee0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 shutdown_connections 2023-10-25T16:19:50.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d40066470 0x7f8d40068930 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d6015eba0 0x7f8d600cadd0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d600cdb10 0x7f8d6015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 --2- 172.21.15.177:0/3739938524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d600b2120 0x7f8d600c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 >> 172.21.15.177:0/3739938524 conn(0x7f8d6009a5c0 msgr2=0x7f8d600b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:50.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 shutdown_connections 2023-10-25T16:19:50.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.736+0000 7f8d64871640 1 -- 172.21.15.177:0/3739938524 wait complete. 2023-10-25T16:19:50.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:50.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 -- 172.21.15.177:0/377692131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc159230 msgr2=0x7f87fc071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 --2- 172.21.15.177:0/377692131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc159230 0x7f87fc071500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009900 tx=0x7f87ec01c890 comp rx=0 tx=0).stop 2023-10-25T16:19:50.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 -- 172.21.15.177:0/377692131 shutdown_connections 2023-10-25T16:19:50.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 --2- 172.21.15.177:0/377692131 >> v2:172.21.15.184:3300/0 conn(0x7f87fc06b980 0x7f87fc06be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 --2- 172.21.15.177:0/377692131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc159230 0x7f87fc071500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 -- 172.21.15.177:0/377692131 >> 172.21.15.177:0/377692131 conn(0x7f87fc0b2450 msgr2=0x7f87fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:50.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 -- 172.21.15.177:0/377692131 shutdown_connections 2023-10-25T16:19:50.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.896+0000 7f8802391640 1 -- 172.21.15.177:0/377692131 wait complete. 2023-10-25T16:19:50.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 Processor -- start 2023-10-25T16:19:50.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- start start 2023-10-25T16:19:50.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 0x7f87fc147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc070510 0x7f87fc0aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87fc159230 0x7f87fc0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0af0b0 con 0x7f87fc06b980 2023-10-25T16:19:50.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0ad6d0 con 0x7f87fc159230 2023-10-25T16:19:50.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0af2e0 con 0x7f87fc070510 2023-10-25T16:19:50.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 0x7f87fc147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 0x7f87fc147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44038/0 (socket says 172.21.15.177:44038) 2023-10-25T16:19:50.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 -- 172.21.15.177:0/2197144537 learned_addr learned my addr 172.21.15.177:0/2197144537 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:50.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fb7fe640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc070510 0x7f87fc0aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f880092e640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87fc159230 0x7f87fc0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 -- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc070510 msgr2=0x7f87fc0aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc070510 0x7f87fc0aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 -- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87fc159230 msgr2=0x7f87fc0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87fc159230 0x7f87fc0ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 -- 172.21.15.177:0/2197144537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009560 con 0x7f87fc06b980 2023-10-25T16:19:50.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87fbfff640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 0x7f87fc147c20 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0b0040 tx=0x7f87ec005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec005030 con 0x7f87fc06b980 2023-10-25T16:19:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f87ec005280 con 0x7f87fc06b980 2023-10-25T16:19:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0046d0 con 0x7f87fc06b980 2023-10-25T16:19:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc0af5c0 con 0x7f87fc06b980 2023-10-25T16:19:50.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc1f5a00 con 0x7f87fc06b980 2023-10-25T16:19:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.900+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc04daf0 con 0x7f87fc06b980 2023-10-25T16:19:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.904+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f87ec0b4070 con 0x7f87fc06b980 2023-10-25T16:19:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.904+0000 7f87f8ff9640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f87e8066470 0x7f87e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.904+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f87ec11deb0 con 0x7f87fc06b980 2023-10-25T16:19:50.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.904+0000 7f87fb7fe640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f87e8066470 0x7f87e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:50.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.904+0000 7f87fb7fe640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f87e8066470 0x7f87e8068930 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f87fc1f5960 tx=0x7f87f0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:50.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:50.908+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87ec0eb710 con 0x7f87fc06b980 2023-10-25T16:19:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.064+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87fc14d6f0 con 0x7f87fc06b980 2023-10-25T16:19:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.064+0000 7f87f8ff9640 1 -- 172.21.15.177:0/2197144537 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+12892 (secure 0 0 0) 0x7f87ec0eed30 con 0x7f87fc06b980 2023-10-25T16:19:51.063 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:51.064 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":139,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:50.383451+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f87e8066470 msgr2=0x7f87e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f87e8066470 0x7f87e8068930 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f87fc1f5960 tx=0x7f87f0009040 comp rx=0 tx=0).stop 2023-10-25T16:19:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 msgr2=0x7f87fc147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 0x7f87fc147c20 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0b0040 tx=0x7f87ec005de0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 shutdown_connections 2023-10-25T16:19:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f87e8066470 0x7f87e8068930 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87fc159230 0x7f87fc0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87fc070510 0x7f87fc0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 --2- 172.21.15.177:0/2197144537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87fc06b980 0x7f87fc147c20 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 >> 172.21.15.177:0/2197144537 conn(0x7f87fc0b2450 msgr2=0x7f87fc157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 shutdown_connections 2023-10-25T16:19:51.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.068+0000 7f8802391640 1 -- 172.21.15.177:0/2197144537 wait complete. 2023-10-25T16:19:51.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:19:51.083 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:19:51.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- 172.21.15.177:0/450171969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ce980 msgr2=0x7fbf480cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 --2- 172.21.15.177:0/450171969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ce980 0x7fbf480cb390 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009840 tx=0x7fbf3801c800 comp rx=0 tx=0).stop 2023-10-25T16:19:51.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- 172.21.15.177:0/450171969 shutdown_connections 2023-10-25T16:19:51.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 --2- 172.21.15.177:0/450171969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf481592c0 0x7fbf480c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 --2- 172.21.15.177:0/450171969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ce980 0x7fbf480cb390 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- 172.21.15.177:0/450171969 >> 172.21.15.177:0/450171969 conn(0x7fbf48069d20 msgr2=0x7fbf4806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:51.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- 172.21.15.177:0/450171969 shutdown_connections 2023-10-25T16:19:51.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- 172.21.15.177:0/450171969 wait complete. 2023-10-25T16:19:51.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 Processor -- start 2023-10-25T16:19:51.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- start start 2023-10-25T16:19:51.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 0x7fbf4814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ced60 0x7fbf480c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf481592c0 0x7fbf4813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c7280 con 0x7fbf480ce980 2023-10-25T16:19:51.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.212+0000 7fbf4c992640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c7560 con 0x7fbf480ced60 2023-10-25T16:19:51.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4c992640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480c7840 con 0x7fbf481592c0 2023-10-25T16:19:51.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 0x7fbf4814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 0x7fbf4814cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44046/0 (socket says 172.21.15.177:44046) 2023-10-25T16:19:51.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 -- 172.21.15.177:0/3761874773 learned_addr learned my addr 172.21.15.177:0/3761874773 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:51.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf46d9d640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf481592c0 0x7fbf4813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf45d9b640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ced60 0x7fbf480c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 -- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf481592c0 msgr2=0x7fbf4813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf481592c0 0x7fbf4813fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 -- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ced60 msgr2=0x7fbf480c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ced60 0x7fbf480c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 -- 172.21.15.177:0/3761874773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380094a0 con 0x7fbf480ce980 2023-10-25T16:19:51.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4659c640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 0x7fbf4814cb80 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fbf3801d0a0 tx=0x7fbf380a6580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:51.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004240 con 0x7fbf480ce980 2023-10-25T16:19:51.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf38004490 con 0x7fbf480ce980 2023-10-25T16:19:51.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480c7b20 con 0x7fbf480ce980 2023-10-25T16:19:51.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38005280 con 0x7fbf480ce980 2023-10-25T16:19:51.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4814d0c0 con 0x7fbf480ce980 2023-10-25T16:19:51.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4804daf0 con 0x7fbf480ce980 2023-10-25T16:19:51.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf380053e0 con 0x7fbf480ce980 2023-10-25T16:19:51.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf36ffd640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf28066470 0x7fbf28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbf380aa070 con 0x7fbf480ce980 2023-10-25T16:19:51.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf45d9b640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf28066470 0x7fbf28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.216+0000 7fbf45d9b640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf28066470 0x7fbf28068930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c007fd0 tx=0x7fbf3c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:51.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.220+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf380ebc20 con 0x7fbf480ce980 2023-10-25T16:19:51.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf480c7980 con 0x7fbf480ce980 2023-10-25T16:19:51.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf36ffd640 1 -- 172.21.15.177:0/3761874773 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf480c7980 con 0x7fbf480ce980 2023-10-25T16:19:51.367 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:19:51.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf28066470 msgr2=0x7fbf28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf28066470 0x7fbf28068930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c007fd0 tx=0x7fbf3c009040 comp rx=0 tx=0).stop 2023-10-25T16:19:51.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 msgr2=0x7fbf4814cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 0x7fbf4814cb80 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fbf3801d0a0 tx=0x7fbf380a6580 comp rx=0 tx=0).stop 2023-10-25T16:19:51.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 shutdown_connections 2023-10-25T16:19:51.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbf28066470 0x7fbf28068930 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbf481592c0 0x7fbf4813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf480ced60 0x7fbf480c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 --2- 172.21.15.177:0/3761874773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf480ce980 0x7fbf4814cb80 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 >> 172.21.15.177:0/3761874773 conn(0x7fbf48069d20 msgr2=0x7fbf480cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:51.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 shutdown_connections 2023-10-25T16:19:51.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.368+0000 7fbf4c992640 1 -- 172.21.15.177:0/3761874773 wait complete. 2023-10-25T16:19:51.386 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:19:51.501 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3297273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c81500f0 msgr2=0x7fa1c80c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3297273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c81500f0 0x7fa1c80c9910 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009840 tx=0x7fa1c401c700 comp rx=0 tx=0).stop 2023-10-25T16:19:51.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3297273631 shutdown_connections 2023-10-25T16:19:51.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3297273631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c81500f0 0x7fa1c80c9910 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.502 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3297273631 >> 172.21.15.177:0/3297273631 conn(0x7fa1c80b2450 msgr2=0x7fa1c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:51.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3297273631 shutdown_connections 2023-10-25T16:19:51.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3297273631 wait complete. 2023-10-25T16:19:51.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 Processor -- start 2023-10-25T16:19:51.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- start start 2023-10-25T16:19:51.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c806c0f0 0x7fa1c8145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 0x7fa1c80cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c81500f0 0x7fa1c80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8145e40 con 0x7fa1c80c9e50 2023-10-25T16:19:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80b0c50 con 0x7fa1c806c0f0 2023-10-25T16:19:51.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c814ab80 con 0x7fa1c81500f0 2023-10-25T16:19:51.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 0x7fa1c80cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1ce6d8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c81500f0 0x7fa1c80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 0x7fa1c80cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44056/0 (socket says 172.21.15.177:44056) 2023-10-25T16:19:51.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 -- 172.21.15.177:0/3825872131 learned_addr learned my addr 172.21.15.177:0/3825872131 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:51.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cded7640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c806c0f0 0x7fa1c8145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 -- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c81500f0 msgr2=0x7fa1c80cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c81500f0 0x7fa1c80cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 -- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c806c0f0 msgr2=0x7fa1c8145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c806c0f0 0x7fa1c8145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 -- 172.21.15.177:0/3825872131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c40094a0 con 0x7fa1c80c9e50 2023-10-25T16:19:51.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1cd6d6640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 0x7fa1c80cb760 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c3e0 tx=0x7fa1b800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:51.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8011790 con 0x7fa1c80c9e50 2023-10-25T16:19:51.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa1b80119e0 con 0x7fa1c80c9e50 2023-10-25T16:19:51.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c814ae60 con 0x7fa1c80c9e50 2023-10-25T16:19:51.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8011e30 con 0x7fa1c80c9e50 2023-10-25T16:19:51.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.504+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c814b420 con 0x7fa1c80c9e50 2023-10-25T16:19:51.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.508+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c80c9780 con 0x7fa1c80c9e50 2023-10-25T16:19:51.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.508+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa1b801c460 con 0x7fa1c80c9e50 2023-10-25T16:19:51.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.508+0000 7fa1be7fc640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1ac066470 0x7fa1ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.508+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1b8083a60 con 0x7fa1c80c9e50 2023-10-25T16:19:51.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.508+0000 7fa1cded7640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1ac066470 0x7fa1ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.508+0000 7fa1cded7640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1ac066470 0x7fa1ac068930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40af000 tx=0x7fa1c401af40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:51.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.512+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1b8051370 con 0x7fa1c80c9e50 2023-10-25T16:19:51.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.664+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa1c8071820 con 0x7fa1c80c9e50 2023-10-25T16:19:51.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.664+0000 7fa1be7fc640 1 -- 172.21.15.177:0/3825872131 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa1b8054990 con 0x7fa1c80c9e50 2023-10-25T16:19:51.665 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:51.666 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:19:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:19:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:19:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:19:51.666 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:19:51.667 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:19:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1ac066470 msgr2=0x7fa1ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1ac066470 0x7fa1ac068930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40af000 tx=0x7fa1c401af40 comp rx=0 tx=0).stop 2023-10-25T16:19:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 msgr2=0x7fa1c80cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 0x7fa1c80cb760 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c3e0 tx=0x7fa1b800c8a0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 shutdown_connections 2023-10-25T16:19:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1ac066470 0x7fa1ac068930 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c81500f0 0x7fa1c80cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1c80c9e50 0x7fa1c80cb760 secure :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c3e0 tx=0x7fa1b800c8a0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 --2- 172.21.15.177:0/3825872131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c806c0f0 0x7fa1c8145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 >> 172.21.15.177:0/3825872131 conn(0x7fa1c80b2450 msgr2=0x7fa1c80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:51.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 shutdown_connections 2023-10-25T16:19:51.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.668+0000 7fa1d013b640 1 -- 172.21.15.177:0/3825872131 wait complete. 2023-10-25T16:19:51.684 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:19:51.684 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:19:51.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- 172.21.15.177:0/999741204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5880c9680 msgr2=0x7fd588071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- 172.21.15.177:0/999741204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5880c9680 0x7fd588071110 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd5880ca720 tx=0x7fd57801dba0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- 172.21.15.177:0/999741204 shutdown_connections 2023-10-25T16:19:51.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- 172.21.15.177:0/999741204 >> v2:172.21.15.184:3300/0 conn(0x7fd5880cad40 0x7fd5880cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- 172.21.15.177:0/999741204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd58806c3d0 0x7fd5880c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- 172.21.15.177:0/999741204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5880c9680 0x7fd588071110 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- 172.21.15.177:0/999741204 >> 172.21.15.177:0/999741204 conn(0x7fd588069920 msgr2=0x7fd588069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:51.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- 172.21.15.177:0/999741204 shutdown_connections 2023-10-25T16:19:51.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- 172.21.15.177:0/999741204 wait complete. 2023-10-25T16:19:51.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 Processor -- start 2023-10-25T16:19:51.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- start start 2023-10-25T16:19:51.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 0x7fd588149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5880c9680 0x7fd588159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5880cad40 0x7fd58813c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58814fbf0 con 0x7fd58806c3d0 2023-10-25T16:19:51.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58814fed0 con 0x7fd5880cad40 2023-10-25T16:19:51.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd58d347640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5881501b0 con 0x7fd5880c9680 2023-10-25T16:19:51.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 0x7fd588149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 0x7fd588149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44064/0 (socket says 172.21.15.177:44064) 2023-10-25T16:19:51.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd586ffd640 1 -- 172.21.15.177:0/1727575694 learned_addr learned my addr 172.21.15.177:0/1727575694 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:51.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.816+0000 7fd5877fe640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5880cad40 0x7fd58813c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd5867fc640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5880c9680 0x7fd588159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd586ffd640 1 -- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5880c9680 msgr2=0x7fd588159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.822 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd586ffd640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5880c9680 0x7fd588159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd586ffd640 1 -- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5880cad40 msgr2=0x7fd58813c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:51.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd586ffd640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5880cad40 0x7fd58813c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:51.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd586ffd640 1 -- 172.21.15.177:0/1727575694 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57800a670 con 0x7fd58806c3d0 2023-10-25T16:19:51.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd5867fc640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5880c9680 0x7fd588159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:51.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd586ffd640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 0x7fd588149e10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd5780b1040 tx=0x7fd5780a6b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:51.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578005440 con 0x7fd58806c3d0 2023-10-25T16:19:51.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5780046d0 con 0x7fd58806c3d0 2023-10-25T16:19:51.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd588150490 con 0x7fd58806c3d0 2023-10-25T16:19:51.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578004ae0 con 0x7fd58806c3d0 2023-10-25T16:19:51.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58813cae0 con 0x7fd58806c3d0 2023-10-25T16:19:51.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd588073360 con 0x7fd58806c3d0 2023-10-25T16:19:51.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd578004c40 con 0x7fd58806c3d0 2023-10-25T16:19:51.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd56f7fe640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd574066470 0x7fd574068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:51.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd57811e560 con 0x7fd58806c3d0 2023-10-25T16:19:51.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd5867fc640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd574066470 0x7fd574068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:51.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.820+0000 7fd5867fc640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd574066470 0x7fd574068930 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005950 tx=0x7fd57c005ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:51.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.824+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd5780ebd40 con 0x7fd58806c3d0 2023-10-25T16:19:51.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:51.980+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd5880ca050 con 0x7fd58806c3d0 2023-10-25T16:19:52.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.392+0000 7fd56f7fe640 1 -- 172.21.15.177:0/1727575694 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd5780ef360 con 0x7fd58806c3d0 2023-10-25T16:19:52.391 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:19:52.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd574066470 msgr2=0x7fd574068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:52.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd574066470 0x7fd574068930 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005950 tx=0x7fd57c005ca0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 msgr2=0x7fd588149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:52.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 0x7fd588149e10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd5780b1040 tx=0x7fd5780a6b80 comp rx=0 tx=0).stop 2023-10-25T16:19:52.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 shutdown_connections 2023-10-25T16:19:52.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd574066470 0x7fd574068930 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5880cad40 0x7fd58813c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd5880c9680 0x7fd588159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 --2- 172.21.15.177:0/1727575694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd58806c3d0 0x7fd588149e10 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 >> 172.21.15.177:0/1727575694 conn(0x7fd588069920 msgr2=0x7fd588151f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:52.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 shutdown_connections 2023-10-25T16:19:52.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.396+0000 7fd58d347640 1 -- 172.21.15.177:0/1727575694 wait complete. 2023-10-25T16:19:52.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:19:52.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2019881754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb00af630 msgr2=0x7fcbb0159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:52.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2019881754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb00af630 0x7fcbb0159df0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00cabd0 tx=0x7fcba801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2019881754 shutdown_connections 2023-10-25T16:19:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2019881754 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb00af630 0x7fcbb0159df0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2019881754 >> v2:172.21.15.184:3300/0 conn(0x7fcbb0142d30 0x7fcbb015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2019881754 >> 172.21.15.177:0/2019881754 conn(0x7fcbb00698f0 msgr2=0x7fcbb0069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2019881754 shutdown_connections 2023-10-25T16:19:52.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2019881754 wait complete. 2023-10-25T16:19:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 Processor -- start 2023-10-25T16:19:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.552+0000 7fcbb4ba3640 1 -- start start 2023-10-25T16:19:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbb00af630 0x7fcbb0157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbb00cad80 0x7fcbb01418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:52.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 0x7fcbb0141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb0070bd0 con 0x7fcbb0142d30 2023-10-25T16:19:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb013e610 con 0x7fcbb00cad80 2023-10-25T16:19:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb013e8f0 con 0x7fcbb00af630 2023-10-25T16:19:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 0x7fcbb0141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:52.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 0x7fcbb0141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44082/0 (socket says 172.21.15.177:44082) 2023-10-25T16:19:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 -- 172.21.15.177:0/2133325101 learned_addr learned my addr 172.21.15.177:0/2133325101 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbae59c640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbb00af630 0x7fcbb0157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcba5d9b640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbb00cad80 0x7fcbb01418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 -- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbb00af630 msgr2=0x7fcbb0157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:52.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbb00af630 0x7fcbb0157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 -- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbb00cad80 msgr2=0x7fcbb01418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:52.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbb00cad80 0x7fcbb01418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:52.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 -- 172.21.15.177:0/2133325101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba80098e0 con 0x7fcbb0142d30 2023-10-25T16:19:52.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbaed9d640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 0x7fcbb0141df0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fcba801a920 tx=0x7fcba80a5c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:52.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8004e60 con 0x7fcbb0142d30 2023-10-25T16:19:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcba80ad6a0 con 0x7fcbb0142d30 2023-10-25T16:19:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb013ebd0 con 0x7fcbb0142d30 2023-10-25T16:19:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba80ada70 con 0x7fcbb0142d30 2023-10-25T16:19:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb0162420 con 0x7fcbb0142d30 2023-10-25T16:19:52.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb0162640 con 0x7fcbb0142d30 2023-10-25T16:19:52.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.556+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcba80b4040 con 0x7fcbb0142d30 2023-10-25T16:19:52.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.560+0000 7fcba77fe640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb90066470 0x7fcb90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.560+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fcba811e160 con 0x7fcbb0142d30 2023-10-25T16:19:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.560+0000 7fcbae59c640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb90066470 0x7fcb90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.560+0000 7fcbae59c640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb90066470 0x7fcb90068930 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcba0005fd0 tx=0x7fcba0005d10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:52.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.564+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcba80eb930 con 0x7fcbb0142d30 2023-10-25T16:19:52.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:52.720+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcbb004db20 con 0x7fcbb0142d30 2023-10-25T16:19:53.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.396+0000 7fcba77fe640 1 -- 172.21.15.177:0/2133325101 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcba80bc0d0 con 0x7fcbb0142d30 2023-10-25T16:19:53.395 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:19:53.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb90066470 msgr2=0x7fcb90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:53.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb90066470 0x7fcb90068930 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcba0005fd0 tx=0x7fcba0005d10 comp rx=0 tx=0).stop 2023-10-25T16:19:53.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 msgr2=0x7fcbb0141df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:53.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 0x7fcbb0141df0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fcba801a920 tx=0x7fcba80a5c30 comp rx=0 tx=0).stop 2023-10-25T16:19:53.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 shutdown_connections 2023-10-25T16:19:53.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb90066470 0x7fcb90068930 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbb0142d30 0x7fcbb0141df0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbb00cad80 0x7fcbb01418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 --2- 172.21.15.177:0/2133325101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcbb00af630 0x7fcbb0157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 >> 172.21.15.177:0/2133325101 conn(0x7fcbb00698f0 msgr2=0x7fcbb0139400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:53.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 shutdown_connections 2023-10-25T16:19:53.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.400+0000 7fcbb4ba3640 1 -- 172.21.15.177:0/2133325101 wait complete. 2023-10-25T16:19:53.423 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:19:53.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 -- 172.21.15.177:0/2084232055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 msgr2=0x7f033415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:53.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 --2- 172.21.15.177:0/2084232055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f033415bcf0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f03340b3810 tx=0x7f033001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 -- 172.21.15.177:0/2084232055 shutdown_connections 2023-10-25T16:19:53.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 --2- 172.21.15.177:0/2084232055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f033415bcf0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 --2- 172.21.15.177:0/2084232055 >> v2:172.21.15.184:3300/0 conn(0x7f033413b0d0 0x7f033406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 -- 172.21.15.177:0/2084232055 >> 172.21.15.177:0/2084232055 conn(0x7f03340afe20 msgr2=0x7f03340b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:53.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 -- 172.21.15.177:0/2084232055 shutdown_connections 2023-10-25T16:19:53.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 -- 172.21.15.177:0/2084232055 wait complete. 2023-10-25T16:19:53.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 Processor -- start 2023-10-25T16:19:53.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.548+0000 7f033b4fd640 1 -- start start 2023-10-25T16:19:53.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f0334155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:53.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f033413b0d0 0x7f033413e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:53.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f033415c230 0x7f03340aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:53.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340b0cd0 con 0x7f033406cc60 2023-10-25T16:19:53.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334155f70 con 0x7f033415c230 2023-10-25T16:19:53.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033413e530 con 0x7f033413b0d0 2023-10-25T16:19:53.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f0334155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:53.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f0334155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44100/0 (socket says 172.21.15.177:44100) 2023-10-25T16:19:53.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 -- 172.21.15.177:0/4061832168 learned_addr learned my addr 172.21.15.177:0/4061832168 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:53.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0338a98640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f033413b0d0 0x7f033413e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:53.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339a9a640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f033415c230 0x7f03340aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:53.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 -- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f033413b0d0 msgr2=0x7f033413e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:53.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f033413b0d0 0x7f033413e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 -- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f033415c230 msgr2=0x7f03340aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:53.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f033415c230 0x7f03340aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:53.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 -- 172.21.15.177:0/4061832168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300094a0 con 0x7f033406cc60 2023-10-25T16:19:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0339299640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f0334155a30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f032800c970 tx=0x7f032800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328007c70 con 0x7f033406cc60 2023-10-25T16:19:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f032800f450 con 0x7f033406cc60 2023-10-25T16:19:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03340b0f20 con 0x7f033406cc60 2023-10-25T16:19:53.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800f860 con 0x7f033406cc60 2023-10-25T16:19:53.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03340b14e0 con 0x7f033406cc60 2023-10-25T16:19:53.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03340b16d0 con 0x7f033406cc60 2023-10-25T16:19:53.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f032800f9c0 con 0x7f033406cc60 2023-10-25T16:19:53.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0325ffb640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0318066470 0x7f0318068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:53.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0328084640 con 0x7f033406cc60 2023-10-25T16:19:53.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.552+0000 7f0338a98640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0318066470 0x7f0318068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:53.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.556+0000 7f0338a98640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0318066470 0x7f0318068930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f03300af000 tx=0x7f033001aff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:53.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.560+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0328051bb0 con 0x7f033406cc60 2023-10-25T16:19:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:53.744+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f033404daf0 con 0x7f033406cc60 2023-10-25T16:19:54.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.688+0000 7f0325ffb640 1 -- 172.21.15.177:0/4061832168 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v49) v1 ==== 174+0+0 (secure 0 0 0) 0x7f03280551d0 con 0x7f033406cc60 2023-10-25T16:19:54.688 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 16 and data pool 17 2023-10-25T16:19:54.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0318066470 msgr2=0x7f0318068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:54.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0318066470 0x7f0318068930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f03300af000 tx=0x7f033001aff0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 msgr2=0x7f0334155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f0334155a30 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f032800c970 tx=0x7f032800ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 shutdown_connections 2023-10-25T16:19:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0318066470 0x7f0318068930 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f033415c230 0x7f03340aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f033413b0d0 0x7f033413e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 --2- 172.21.15.177:0/4061832168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f033406cc60 0x7f0334155a30 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 >> 172.21.15.177:0/4061832168 conn(0x7f03340afe20 msgr2=0x7f0334069720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:54.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 shutdown_connections 2023-10-25T16:19:54.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.692+0000 7f033b4fd640 1 -- 172.21.15.177:0/4061832168 wait complete. 2023-10-25T16:19:54.715 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:54.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 -- 172.21.15.177:0/2105168520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9698005e20 msgr2=0x7f96980062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:54.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 --2- 172.21.15.177:0/2105168520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9698005e20 0x7f96980062a0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009ee0 tx=0x7f96a801d5d0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b4daa640 1 -- 172.21.15.177:0/2105168520 reap_dead start 2023-10-25T16:19:54.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 -- 172.21.15.177:0/2105168520 shutdown_connections 2023-10-25T16:19:54.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 -- 172.21.15.177:0/2105168520 >> 172.21.15.177:0/2105168520 conn(0x7f96b00af3f0 msgr2=0x7f96b00af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:54.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 -- 172.21.15.177:0/2105168520 shutdown_connections 2023-10-25T16:19:54.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 -- 172.21.15.177:0/2105168520 wait complete. 2023-10-25T16:19:54.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 Processor -- start 2023-10-25T16:19:54.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.840+0000 7f96b680d640 1 -- start start 2023-10-25T16:19:54.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 0x7f96b00b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:54.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b00c8840 0x7f96b00b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:54.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b014bc70 0x7f96b014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:54.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00aef30 con 0x7f96b00c8460 2023-10-25T16:19:54.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01e1000 con 0x7f96b014bc70 2023-10-25T16:19:54.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01e1b80 con 0x7f96b00c8840 2023-10-25T16:19:54.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 0x7f96b00b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:54.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 0x7f96b00b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44120/0 (socket says 172.21.15.177:44120) 2023-10-25T16:19:54.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 -- 172.21.15.177:0/4286653379 learned_addr learned my addr 172.21.15.177:0/4286653379 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:54.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96af7fe640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b00c8840 0x7f96b00b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:54.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b4daa640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b014bc70 0x7f96b014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:54.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 -- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b00c8840 msgr2=0x7f96b00b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:54.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b00c8840 0x7f96b00b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 -- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b014bc70 msgr2=0x7f96b014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:54.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b014bc70 0x7f96b014c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:54.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 -- 172.21.15.177:0/4286653379 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b006c3c0 con 0x7f96b00c8460 2023-10-25T16:19:54.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96affff640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 0x7f96b00b28c0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f96a0004e20 tx=0x7f96a0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:54.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011870 con 0x7f96b00c8460 2023-10-25T16:19:54.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96a0011ac0 con 0x7f96b00c8460 2023-10-25T16:19:54.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b01e1250 con 0x7f96b00c8460 2023-10-25T16:19:54.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00103c0 con 0x7f96b00c8460 2023-10-25T16:19:54.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b01e1810 con 0x7f96b00c8460 2023-10-25T16:19:54.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b004daf0 con 0x7f96b00c8460 2023-10-25T16:19:54.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96a0010520 con 0x7f96b00c8460 2023-10-25T16:19:54.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96acff9640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f969c066470 0x7f969c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:54.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96a0084bd0 con 0x7f96b00c8460 2023-10-25T16:19:54.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.844+0000 7f96af7fe640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f969c066470 0x7f969c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:54.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.848+0000 7f96af7fe640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f969c066470 0x7f969c068930 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f96a40017b0 tx=0x7f96a4001da0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:54.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:54.848+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96a0052050 con 0x7f96b00c8460 2023-10-25T16:19:55.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.008+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96b006dc20 con 0x7f96b00c8460 2023-10-25T16:19:55.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96acff9640 1 -- 172.21.15.177:0/4286653379 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f96a0055670 con 0x7f96b00c8460 2023-10-25T16:19:55.009 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:55.010 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":142,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:53.749429+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:55.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f969c066470 msgr2=0x7f969c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f969c066470 0x7f969c068930 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f96a40017b0 tx=0x7f96a4001da0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 msgr2=0x7f96b00b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 0x7f96b00b28c0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f96a0004e20 tx=0x7f96a0001640 comp rx=0 tx=0).stop 2023-10-25T16:19:55.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 shutdown_connections 2023-10-25T16:19:55.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f969c066470 0x7f969c068930 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96b014bc70 0x7f96b014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96b00c8840 0x7f96b00b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 --2- 172.21.15.177:0/4286653379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96b00c8460 0x7f96b00b28c0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 >> 172.21.15.177:0/4286653379 conn(0x7f96b00af3f0 msgr2=0x7f96b006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:55.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 shutdown_connections 2023-10-25T16:19:55.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.012+0000 7f96b680d640 1 -- 172.21.15.177:0/4286653379 wait complete. 2023-10-25T16:19:55.029 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:55.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/1682049747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba80c9e50 msgr2=0x7f5ba806b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 --2- 172.21.15.177:0/1682049747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba80c9e50 0x7f5ba806b980 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80ccde0 tx=0x7f5b9c01c780 comp rx=0 tx=0).stop 2023-10-25T16:19:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/1682049747 shutdown_connections 2023-10-25T16:19:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 --2- 172.21.15.177:0/1682049747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba80c9e50 0x7f5ba806b980 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 --2- 172.21.15.177:0/1682049747 >> v2:172.21.15.184:3300/0 conn(0x7f5ba81500f0 0x7f5ba80c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/1682049747 >> 172.21.15.177:0/1682049747 conn(0x7f5ba80b2450 msgr2=0x7f5ba80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:55.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/1682049747 shutdown_connections 2023-10-25T16:19:55.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/1682049747 wait complete. 2023-10-25T16:19:55.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 Processor -- start 2023-10-25T16:19:55.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- start start 2023-10-25T16:19:55.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 0x7f5ba80b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba80c9e50 0x7f5ba81488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba81500f0 0x7f5ba814b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81493a0 con 0x7f5ba806bec0 2023-10-25T16:19:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80b01b0 con 0x7f5ba81500f0 2023-10-25T16:19:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80b0490 con 0x7f5ba80c9e50 2023-10-25T16:19:55.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 0x7f5ba80b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 0x7f5ba80b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44140/0 (socket says 172.21.15.177:44140) 2023-10-25T16:19:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 -- 172.21.15.177:0/3117146857 learned_addr learned my addr 172.21.15.177:0/3117146857 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba7fff640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba81500f0 0x7f5ba814b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 -- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba80c9e50 msgr2=0x7f5ba81488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba80c9e50 0x7f5ba81488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 -- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba81500f0 msgr2=0x7f5ba814b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba81500f0 0x7f5ba814b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 -- 172.21.15.177:0/3117146857 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c009500 con 0x7f5ba806bec0 2023-10-25T16:19:55.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5ba77fe640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 0x7f5ba80b0f70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800d950 tx=0x7f5b9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:55.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98009c30 con 0x7f5ba806bec0 2023-10-25T16:19:55.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b98009e80 con 0x7f5ba806bec0 2023-10-25T16:19:55.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980106c0 con 0x7f5ba806bec0 2023-10-25T16:19:55.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba80b0770 con 0x7f5ba806bec0 2023-10-25T16:19:55.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.152+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba8163820 con 0x7f5ba806bec0 2023-10-25T16:19:55.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.156+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba804daf0 con 0x7f5ba806bec0 2023-10-25T16:19:55.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.156+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b98010820 con 0x7f5ba806bec0 2023-10-25T16:19:55.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.156+0000 7f5b8ffff640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b94066470 0x7f5b94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.156+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b98084340 con 0x7f5ba806bec0 2023-10-25T16:19:55.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.156+0000 7f5ba6ffd640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b94066470 0x7f5b94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.156+0000 7f5ba6ffd640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b94066470 0x7f5b94068930 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0af000 tx=0x7f5b9c019520 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:55.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.160+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b980517c0 con 0x7f5ba806bec0 2023-10-25T16:19:55.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.312+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ba80cd970 con 0x7f5ba806bec0 2023-10-25T16:19:55.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5b8ffff640 1 -- 172.21.15.177:0/3117146857 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16565 (secure 0 0 0) 0x7f5b98054de0 con 0x7f5ba806bec0 2023-10-25T16:19:55.314 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:55.315 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":142,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:53.749429+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:55.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b94066470 msgr2=0x7f5b94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b94066470 0x7f5b94068930 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0af000 tx=0x7f5b9c019520 comp rx=0 tx=0).stop 2023-10-25T16:19:55.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 msgr2=0x7f5ba80b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 0x7f5ba80b0f70 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800d950 tx=0x7f5b9800de10 comp rx=0 tx=0).stop 2023-10-25T16:19:55.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 shutdown_connections 2023-10-25T16:19:55.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b94066470 0x7f5b94068930 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ba81500f0 0x7f5ba814b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ba80c9e50 0x7f5ba81488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 --2- 172.21.15.177:0/3117146857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ba806bec0 0x7f5ba80b0f70 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 >> 172.21.15.177:0/3117146857 conn(0x7f5ba80b2450 msgr2=0x7f5ba815c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:55.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 shutdown_connections 2023-10-25T16:19:55.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.316+0000 7f5bade52640 1 -- 172.21.15.177:0/3117146857 wait complete. 2023-10-25T16:19:55.333 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:19:55.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/2976626064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 msgr2=0x7fa1ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/2976626064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1ac00b990 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000c590 tx=0x7fa1b001d340 comp rx=0 tx=0).stop 2023-10-25T16:19:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/2976626064 shutdown_connections 2023-10-25T16:19:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/2976626064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1ac00b990 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/2976626064 >> 172.21.15.177:0/2976626064 conn(0x7fa1c00ce000 msgr2=0x7fa1c00ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:55.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/2976626064 shutdown_connections 2023-10-25T16:19:55.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/2976626064 wait complete. 2023-10-25T16:19:55.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 Processor -- start 2023-10-25T16:19:55.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.464+0000 7fa1c6a4b640 1 -- start start 2023-10-25T16:19:55.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1c01403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c01e0920 0x7fa1c01e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c01f5320 0x7fa1c01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01535a0 con 0x7fa1ac005190 2023-10-25T16:19:55.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01e3a00 con 0x7fa1c01f5320 2023-10-25T16:19:55.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c01e3440 con 0x7fa1c01e0920 2023-10-25T16:19:55.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1c01403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1c01403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44144/0 (socket says 172.21.15.177:44144) 2023-10-25T16:19:55.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 -- 172.21.15.177:0/1285626392 learned_addr learned my addr 172.21.15.177:0/1285626392 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:55.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 -- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c01e0920 msgr2=0x7fa1c01e0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c01e0920 0x7fa1c01e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c4fe8640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c01f5320 0x7fa1c01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 -- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c01f5320 msgr2=0x7fa1c01f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c01f5320 0x7fa1c01f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 -- 172.21.15.177:0/1285626392 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c01e3720 con 0x7fa1ac005190 2023-10-25T16:19:55.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bffff640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1c01403c0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800e960 tx=0x7fa1b800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:55.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b800cc60 con 0x7fa1ac005190 2023-10-25T16:19:55.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa1b8005020 con 0x7fa1ac005190 2023-10-25T16:19:55.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c01531c0 con 0x7fa1ac005190 2023-10-25T16:19:55.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b80053f0 con 0x7fa1ac005190 2023-10-25T16:19:55.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c0140db0 con 0x7fa1ac005190 2023-10-25T16:19:55.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c006fe60 con 0x7fa1ac005190 2023-10-25T16:19:55.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa1b8005550 con 0x7fa1ac005190 2023-10-25T16:19:55.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bcff9640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1a00664a0 0x7fa1a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1b8084770 con 0x7fa1ac005190 2023-10-25T16:19:55.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.468+0000 7fa1bf7fe640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1a00664a0 0x7fa1a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.472+0000 7fa1bf7fe640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1a00664a0 0x7fa1a0068960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8006fd0 tx=0x7fa1a8006910 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:55.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.472+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1b8051c80 con 0x7fa1ac005190 2023-10-25T16:19:55.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.664+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa1c004daf0 con 0x7fa1ac005190 2023-10-25T16:19:55.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.700+0000 7fa1bcff9640 1 -- 172.21.15.177:0/1285626392 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa1b801f020 con 0x7fa1ac005190 2023-10-25T16:19:55.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1a00664a0 msgr2=0x7fa1a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1a00664a0 0x7fa1a0068960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8006fd0 tx=0x7fa1a8006910 comp rx=0 tx=0).stop 2023-10-25T16:19:55.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 msgr2=0x7fa1c01403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1c01403c0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800e960 tx=0x7fa1b800ee20 comp rx=0 tx=0).stop 2023-10-25T16:19:55.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 shutdown_connections 2023-10-25T16:19:55.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa1a00664a0 0x7fa1a0068960 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c01f5320 0x7fa1c01f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa1c01e0920 0x7fa1c01e0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 --2- 172.21.15.177:0/1285626392 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1ac005190 0x7fa1c01403c0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 >> 172.21.15.177:0/1285626392 conn(0x7fa1c00ce000 msgr2=0x7fa1c00c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:55.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 shutdown_connections 2023-10-25T16:19:55.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.704+0000 7fa1c6a4b640 1 -- 172.21.15.177:0/1285626392 wait complete. 2023-10-25T16:19:55.719 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:19:55.719 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:19:55.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/1888289727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d80140e90 msgr2=0x7f4d800af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 --2- 172.21.15.177:0/1888289727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d80140e90 0x7f4d800af580 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009900 tx=0x7f4d7001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/1888289727 shutdown_connections 2023-10-25T16:19:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 --2- 172.21.15.177:0/1888289727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 0x7f4d8006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 --2- 172.21.15.177:0/1888289727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d80140e90 0x7f4d800af580 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/1888289727 >> 172.21.15.177:0/1888289727 conn(0x7f4d800b2450 msgr2=0x7f4d800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:55.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/1888289727 shutdown_connections 2023-10-25T16:19:55.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/1888289727 wait complete. 2023-10-25T16:19:55.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 Processor -- start 2023-10-25T16:19:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- start start 2023-10-25T16:19:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 0x7f4d8015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 0x7f4d800ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d80140e90 0x7f4d8013c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801556b0 con 0x7f4d8006bec0 2023-10-25T16:19:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8013dea0 con 0x7f4d80140e90 2023-10-25T16:19:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80154b30 con 0x7f4d8006f570 2023-10-25T16:19:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 0x7f4d8015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 0x7f4d8015ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44164/0 (socket says 172.21.15.177:44164) 2023-10-25T16:19:55.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 -- 172.21.15.177:0/549214200 learned_addr learned my addr 172.21.15.177:0/549214200 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:55.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7ed9d640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d80140e90 0x7f4d8013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d75d9b640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 0x7f4d800ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 -- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 msgr2=0x7f4d800ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 0x7f4d800ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 -- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d80140e90 msgr2=0x7f4d8013c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:55.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d80140e90 0x7f4d8013c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:55.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 -- 172.21.15.177:0/549214200 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009560 con 0x7f4d8006bec0 2023-10-25T16:19:55.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d75d9b640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 0x7f4d800ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:55.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d7e59c640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 0x7f4d8015ad00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4d7001aea0 tx=0x7f4d700b09c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700b0e70 con 0x7f4d8006bec0 2023-10-25T16:19:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d70004130 con 0x7f4d8006bec0 2023-10-25T16:19:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70005020 con 0x7f4d8006bec0 2023-10-25T16:19:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d80154e10 con 0x7f4d8006bec0 2023-10-25T16:19:55.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.848+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d801553d0 con 0x7f4d8006bec0 2023-10-25T16:19:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.852+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8013e060 con 0x7f4d8006bec0 2023-10-25T16:19:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.852+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d70005180 con 0x7f4d8006bec0 2023-10-25T16:19:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.852+0000 7f4d777fe640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d60066470 0x7f4d60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:55.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.852+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d7011e1d0 con 0x7f4d8006bec0 2023-10-25T16:19:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.852+0000 7f4d75d9b640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d60066470 0x7f4d60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.852+0000 7f4d75d9b640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d60066470 0x7f4d60068930 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4d68005870 tx=0x7f4d68005e50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:55.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:55.856+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d700eb650 con 0x7f4d8006bec0 2023-10-25T16:19:56.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.044+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4d8015bed0 con 0x7f4d8006bec0 2023-10-25T16:19:56.378 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-10-25T16:19:56.378+0000 7f8cc4671640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:19:56.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.704+0000 7f4d777fe640 1 -- 172.21.15.177:0/549214200 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4d700eec70 con 0x7f4d8006bec0 2023-10-25T16:19:56.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d60066470 msgr2=0x7f4d60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:56.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d60066470 0x7f4d60068930 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4d68005870 tx=0x7f4d68005e50 comp rx=0 tx=0).stop 2023-10-25T16:19:56.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 msgr2=0x7f4d8015ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:56.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 0x7f4d8015ad00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4d7001aea0 tx=0x7f4d700b09c0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 shutdown_connections 2023-10-25T16:19:56.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d60066470 0x7f4d60068930 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d80140e90 0x7f4d8013c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d8006f570 0x7f4d800ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 --2- 172.21.15.177:0/549214200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d8006bec0 0x7f4d8015ad00 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 >> 172.21.15.177:0/549214200 conn(0x7f4d800b2450 msgr2=0x7f4d800b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:56.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 shutdown_connections 2023-10-25T16:19:56.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.708+0000 7f4d84b15640 1 -- 172.21.15.177:0/549214200 wait complete. 2023-10-25T16:19:56.725 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:19:56.725 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:19:56.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/2403425390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 msgr2=0x7f320400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:56.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 --2- 172.21.15.177:0/2403425390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f320400b990 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f32180c8330 tx=0x7f321001d110 comp rx=0 tx=0).stop 2023-10-25T16:19:56.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/2403425390 shutdown_connections 2023-10-25T16:19:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 --2- 172.21.15.177:0/2403425390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f320400b990 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/2403425390 >> 172.21.15.177:0/2403425390 conn(0x7f321809a5c0 msgr2=0x7f32180d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/2403425390 shutdown_connections 2023-10-25T16:19:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/2403425390 wait complete. 2023-10-25T16:19:56.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 Processor -- start 2023-10-25T16:19:56.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- start start 2023-10-25T16:19:56.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f321815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:56.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32180c6de0 0x7f32181e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:56.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32180c7260 0x7f32181e5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:56.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180c5590 con 0x7f32040052b0 2023-10-25T16:19:56.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32180c49a0 con 0x7f32180c7260 2023-10-25T16:19:56.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32180c4bf0 con 0x7f32180c6de0 2023-10-25T16:19:56.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f321815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:56.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f321815bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44174/0 (socket says 172.21.15.177:44174) 2023-10-25T16:19:56.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 -- 172.21.15.177:0/1345656569 learned_addr learned my addr 172.21.15.177:0/1345656569 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:56.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e90e640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32180c7260 0x7f32181e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:56.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321d90c640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32180c6de0 0x7f32181e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:56.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 -- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32180c6de0 msgr2=0x7f32181e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:56.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32180c6de0 0x7f32181e4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 -- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32180c7260 msgr2=0x7f32181e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:56.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32180c7260 0x7f32181e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:56.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 -- 172.21.15.177:0/1345656569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180c4ed0 con 0x7f32040052b0 2023-10-25T16:19:56.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321d90c640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32180c6de0 0x7f32181e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:56.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f321e10d640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f321815bed0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f321400f5a0 tx=0x7f321400fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:56.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140118a0 con 0x7f32040052b0 2023-10-25T16:19:56.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3214011af0 con 0x7f32040052b0 2023-10-25T16:19:56.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32180c51b0 con 0x7f32040052b0 2023-10-25T16:19:56.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321401b480 con 0x7f32040052b0 2023-10-25T16:19:56.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.856+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32180c59b0 con 0x7f32040052b0 2023-10-25T16:19:56.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.860+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321804daf0 con 0x7f32040052b0 2023-10-25T16:19:56.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.860+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f321401b5e0 con 0x7f32040052b0 2023-10-25T16:19:56.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.860+0000 7f320effd640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31fc066470 0x7f31fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:56.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.860+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3214016070 con 0x7f32040052b0 2023-10-25T16:19:56.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.860+0000 7f321d90c640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31fc066470 0x7f31fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:56.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.860+0000 7f321d90c640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31fc066470 0x7f31fc068930 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3208001100 tx=0x7f32080060d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:56.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:56.864+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3214054b30 con 0x7f32040052b0 2023-10-25T16:19:57.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.052+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f321808b370 con 0x7f32040052b0 2023-10-25T16:19:57.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f320effd640 1 -- 172.21.15.177:0/1345656569 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f3214058150 con 0x7f32040052b0 2023-10-25T16:19:57.054 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:57.054 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:19:57.055 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:19:57.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31fc066470 msgr2=0x7f31fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31fc066470 0x7f31fc068930 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3208001100 tx=0x7f32080060d0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 msgr2=0x7f321815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f321815bed0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f321400f5a0 tx=0x7f321400fa60 comp rx=0 tx=0).stop 2023-10-25T16:19:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 shutdown_connections 2023-10-25T16:19:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31fc066470 0x7f31fc068930 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32180c7260 0x7f32181e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32180c6de0 0x7f32181e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 --2- 172.21.15.177:0/1345656569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32040052b0 0x7f321815bed0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 >> 172.21.15.177:0/1345656569 conn(0x7f321809a5c0 msgr2=0x7f32180b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 shutdown_connections 2023-10-25T16:19:57.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.056+0000 7f3220371640 1 -- 172.21.15.177:0/1345656569 wait complete. 2023-10-25T16:19:57.073 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:19:57.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/4087426063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ecc0047d0 msgr2=0x7f1ecc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 --2- 172.21.15.177:0/4087426063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ecc0047d0 0x7f1ecc004c50 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8005fd0 tx=0x7f1ed801cd60 comp rx=0 tx=0).stop 2023-10-25T16:19:57.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/4087426063 shutdown_connections 2023-10-25T16:19:57.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 --2- 172.21.15.177:0/4087426063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ecc0047d0 0x7f1ecc004c50 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/4087426063 >> 172.21.15.177:0/4087426063 conn(0x7f1ee40cefe0 msgr2=0x7f1ee40cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:57.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/4087426063 shutdown_connections 2023-10-25T16:19:57.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/4087426063 wait complete. 2023-10-25T16:19:57.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 Processor -- start 2023-10-25T16:19:57.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- start start 2023-10-25T16:19:57.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ecc0047d0 0x7f1ee415c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 0x7f1ee4150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee40b39a0 0x7f1ee40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4151230 con 0x7f1ee4150870 2023-10-25T16:19:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40b4360 con 0x7f1ecc0047d0 2023-10-25T16:19:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee414e6c0 con 0x7f1ee40b39a0 2023-10-25T16:19:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 0x7f1ee4150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 0x7f1ee4150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44188/0 (socket says 172.21.15.177:44188) 2023-10-25T16:19:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 -- 172.21.15.177:0/2178998439 learned_addr learned my addr 172.21.15.177:0/2178998439 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eea025640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ecc0047d0 0x7f1ee415c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eea826640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee40b39a0 0x7f1ee40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 -- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee40b39a0 msgr2=0x7f1ee40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee40b39a0 0x7f1ee40b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 -- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ecc0047d0 msgr2=0x7f1ee415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ecc0047d0 0x7f1ee415c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 -- 172.21.15.177:0/2178998439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee406ef20 con 0x7f1ee4150870 2023-10-25T16:19:57.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee9824640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 0x7f1ee4150cf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800ba60 tx=0x7f1ed8005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:57.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed80a6da0 con 0x7f1ee4150870 2023-10-25T16:19:57.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ed8005040 con 0x7f1ee4150870 2023-10-25T16:19:57.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee414e960 con 0x7f1ee4150870 2023-10-25T16:19:57.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8005430 con 0x7f1ee4150870 2023-10-25T16:19:57.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.200+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee414ef20 con 0x7f1ee4150870 2023-10-25T16:19:57.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.204+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee404daf0 con 0x7f1ee4150870 2023-10-25T16:19:57.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.204+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1ed80046d0 con 0x7f1ee4150870 2023-10-25T16:19:57.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.204+0000 7f1ee2ffd640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ed00664a0 0x7f1ed0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.204+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed811ec90 con 0x7f1ee4150870 2023-10-25T16:19:57.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.204+0000 7f1eea025640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ed00664a0 0x7f1ed0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.204+0000 7f1eea025640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ed00664a0 0x7f1ed0068960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1edc001b30 tx=0x7f1edc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:57.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.208+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1ed80ec0f0 con 0x7f1ee4150870 2023-10-25T16:19:57.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.364+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ee40aeaa0 con 0x7f1ee4150870 2023-10-25T16:19:57.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.364+0000 7f1ee2ffd640 1 -- 172.21.15.177:0/2178998439 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16552 (secure 0 0 0) 0x7f1ed80ef710 con 0x7f1ee4150870 2023-10-25T16:19:57.364 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:57.365 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":143,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:19:55.429388+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:19:57.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ed00664a0 msgr2=0x7f1ed0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ed00664a0 0x7f1ed0068960 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1edc001b30 tx=0x7f1edc009040 comp rx=0 tx=0).stop 2023-10-25T16:19:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 msgr2=0x7f1ee4150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 0x7f1ee4150cf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800ba60 tx=0x7f1ed8005900 comp rx=0 tx=0).stop 2023-10-25T16:19:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 shutdown_connections 2023-10-25T16:19:57.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ed00664a0 0x7f1ed0068960 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1ee40b39a0 0x7f1ee40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1ee4150870 0x7f1ee4150cf0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 --2- 172.21.15.177:0/2178998439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ecc0047d0 0x7f1ee415c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 >> 172.21.15.177:0/2178998439 conn(0x7f1ee40cefe0 msgr2=0x7f1ee40afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:57.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 shutdown_connections 2023-10-25T16:19:57.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.368+0000 7f1eec289640 1 -- 172.21.15.177:0/2178998439 wait complete. 2023-10-25T16:19:57.383 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:19:57.384 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:57.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3549619034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 msgr2=0x7f3fc40cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3549619034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc40cb5c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009c80 tx=0x7f3fbc01ccb0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3549619034 shutdown_connections 2023-10-25T16:19:57.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3549619034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc40cb5c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3549619034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3fc406c090 0x7f3fc40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3549619034 >> 172.21.15.177:0/3549619034 conn(0x7f3fc40b2450 msgr2=0x7f3fc40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:57.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3549619034 shutdown_connections 2023-10-25T16:19:57.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3549619034 wait complete. 2023-10-25T16:19:57.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 Processor -- start 2023-10-25T16:19:57.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- start start 2023-10-25T16:19:57.511 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc406c090 0x7f3fc415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3fc4140e90 0x7f3fc413f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc415adf0 con 0x7f3fc406f570 2023-10-25T16:19:57.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4157210 con 0x7f3fc406c090 2023-10-25T16:19:57.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc413e980 con 0x7f3fc4140e90 2023-10-25T16:19:57.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc413bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44204/0 (socket says 172.21.15.177:44204) 2023-10-25T16:19:57.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 -- 172.21.15.177:0/3362863513 learned_addr learned my addr 172.21.15.177:0/3362863513 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:57.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc37fe640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc406c090 0x7f3fc415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc3fff640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3fc4140e90 0x7f3fc413f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 -- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3fc4140e90 msgr2=0x7f3fc413f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3fc4140e90 0x7f3fc413f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 -- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc406c090 msgr2=0x7f3fc415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc406c090 0x7f3fc415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 -- 172.21.15.177:0/3362863513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0098e0 con 0x7f3fc406f570 2023-10-25T16:19:57.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc2ffd640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc413bf60 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c970 tx=0x7f3fb800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:57.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8007bb0 con 0x7f3fc406f570 2023-10-25T16:19:57.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3fb8007e00 con 0x7f3fc406f570 2023-10-25T16:19:57.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc413c4a0 con 0x7f3fc406f570 2023-10-25T16:19:57.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8005290 con 0x7f3fc406f570 2023-10-25T16:19:57.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc413e3c0 con 0x7f3fc406f570 2023-10-25T16:19:57.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.508+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc404daf0 con 0x7f3fc406f570 2023-10-25T16:19:57.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.512+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3fb80053f0 con 0x7f3fc406f570 2023-10-25T16:19:57.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.512+0000 7f3fabfff640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3fb00664a0 0x7f3fb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.512+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fb8084360 con 0x7f3fc406f570 2023-10-25T16:19:57.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.512+0000 7f3fc37fe640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3fb00664a0 0x7f3fb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.512+0000 7f3fc37fe640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3fb00664a0 0x7f3fb0068960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400a790 tx=0x7f3fb4008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:57.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.516+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3fb8051870 con 0x7f3fc406f570 2023-10-25T16:19:57.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.656+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fc40ca670 con 0x7f3fb00664a0 2023-10-25T16:19:57.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.680+0000 7f3fabfff640 1 -- 172.21.15.177:0/3362863513 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282699 (secure 0 0 0) 0x7f3fc40ca670 con 0x7f3fb00664a0 2023-10-25T16:19:57.678 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:57.683 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:57.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3fb00664a0 msgr2=0x7f3fb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3fb00664a0 0x7f3fb0068960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400a790 tx=0x7f3fb4008040 comp rx=0 tx=0).stop 2023-10-25T16:19:57.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 msgr2=0x7f3fc413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc413bf60 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c970 tx=0x7f3fb800ce30 comp rx=0 tx=0).stop 2023-10-25T16:19:57.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 shutdown_connections 2023-10-25T16:19:57.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3fb00664a0 0x7f3fb0068960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3fc4140e90 0x7f3fc413f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3fc406f570 0x7f3fc413bf60 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 --2- 172.21.15.177:0/3362863513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc406c090 0x7f3fc415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 >> 172.21.15.177:0/3362863513 conn(0x7f3fc40b2450 msgr2=0x7f3fc4070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:57.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 shutdown_connections 2023-10-25T16:19:57.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.684+0000 7f3fc9a62640 1 -- 172.21.15.177:0/3362863513 wait complete. 2023-10-25T16:19:57.699 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-10-25T16:19:56.750418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555205,"statfs":{"total":1600000000,"available":1592530609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.353666"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461879+0000","last_change":"2023-10-25T16:19:54.461727+0000","last_active":"2023-10-25T16:19:54.461879+0000","last_peered":"2023-10-25T16:19:54.461879+0000","last_clean":"2023-10-25T16:19:54.461879+0000","last_became_active":"2023-10-25T16:19:54.460940+0000","last_became_peered":"2023-10-25T16:19:54.460940+0000","last_unstale":"2023-10-25T16:19:54.461879+0000","last_undegraded":"2023-10-25T16:19:54.461879+0000","last_fullsized":"2023-10-25T16:19:54.461879+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.469115+0000","last_change":"2023-10-25T16:19:54.469017+0000","last_active":"2023-10-25T16:19:54.469115+0000","last_peered":"2023-10-25T16:19:54.469115+0000","last_clean":"2023-10-25T16:19:54.469115+0000","last_became_active":"2023-10-25T16:19:54.468147+0000","last_became_peered":"2023-10-25T16:19:54.468147+0000","last_unstale":"2023-10-25T16:19:54.469115+0000","last_undegraded":"2023-10-25T16:19:54.469115+0000","last_fullsized":"2023-10-25T16:19:54.469115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:19:00.692763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.454300+0000","last_change":"2023-10-25T16:19:54.453147+0000","last_active":"2023-10-25T16:19:54.454300+0000","last_peered":"2023-10-25T16:19:54.454300+0000","last_clean":"2023-10-25T16:19:54.454300+0000","last_became_active":"2023-10-25T16:19:54.450106+0000","last_became_peered":"2023-10-25T16:19:54.450106+0000","last_unstale":"2023-10-25T16:19:54.454300+0000","last_undegraded":"2023-10-25T16:19:54.454300+0000","last_fullsized":"2023-10-25T16:19:54.454300+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463967+0000","last_change":"2023-10-25T16:19:54.463763+0000","last_active":"2023-10-25T16:19:54.463967+0000","last_peered":"2023-10-25T16:19:54.463967+0000","last_clean":"2023-10-25T16:19:54.463967+0000","last_became_active":"2023-10-25T16:19:54.452773+0000","last_became_peered":"2023-10-25T16:19:54.452773+0000","last_unstale":"2023-10-25T16:19:54.463967+0000","last_undegraded":"2023-10-25T16:19:54.463967+0000","last_fullsized":"2023-10-25T16:19:54.463967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:54:04.307190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:53.394237+0000","last_change":"2023-10-25T16:19:53.394237+0000","last_active":"2023-10-25T16:19:53.394237+0000","last_peered":"2023-10-25T16:19:53.394237+0000","last_clean":"2023-10-25T16:19:53.394237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:53.394237+0000","last_undegraded":"2023-10-25T16:19:53.394237+0000","last_fullsized":"2023-10-25T16:19:53.394237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473461+0000","last_change":"2023-10-25T16:19:54.473119+0000","last_active":"2023-10-25T16:19:54.473461+0000","last_peered":"2023-10-25T16:19:54.473461+0000","last_clean":"2023-10-25T16:19:54.473461+0000","last_became_active":"2023-10-25T16:19:54.470943+0000","last_became_peered":"2023-10-25T16:19:54.470943+0000","last_unstale":"2023-10-25T16:19:54.473461+0000","last_undegraded":"2023-10-25T16:19:54.473461+0000","last_fullsized":"2023-10-25T16:19:54.473461+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:00.125788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459374+0000","last_change":"2023-10-25T16:19:54.458805+0000","last_active":"2023-10-25T16:19:54.459374+0000","last_peered":"2023-10-25T16:19:54.459374+0000","last_clean":"2023-10-25T16:19:54.459374+0000","last_became_active":"2023-10-25T16:19:54.457779+0000","last_became_peered":"2023-10-25T16:19:54.457779+0000","last_unstale":"2023-10-25T16:19:54.459374+0000","last_undegraded":"2023-10-25T16:19:54.459374+0000","last_fullsized":"2023-10-25T16:19:54.459374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:59.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466235+0000","last_change":"2023-10-25T16:19:54.466068+0000","last_active":"2023-10-25T16:19:54.466235+0000","last_peered":"2023-10-25T16:19:54.466235+0000","last_clean":"2023-10-25T16:19:54.466235+0000","last_became_active":"2023-10-25T16:19:54.464713+0000","last_became_peered":"2023-10-25T16:19:54.464713+0000","last_unstale":"2023-10-25T16:19:54.466235+0000","last_undegraded":"2023-10-25T16:19:54.466235+0000","last_fullsized":"2023-10-25T16:19:54.466235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:09.855686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464284+0000","last_change":"2023-10-25T16:19:54.464139+0000","last_active":"2023-10-25T16:19:54.464284+0000","last_peered":"2023-10-25T16:19:54.464284+0000","last_clean":"2023-10-25T16:19:54.464284+0000","last_became_active":"2023-10-25T16:19:54.453425+0000","last_became_peered":"2023-10-25T16:19:54.453425+0000","last_unstale":"2023-10-25T16:19:54.464284+0000","last_undegraded":"2023-10-25T16:19:54.464284+0000","last_fullsized":"2023-10-25T16:19:54.464284+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:59.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.474708+0000","last_change":"2023-10-25T16:19:54.474546+0000","last_active":"2023-10-25T16:19:54.474708+0000","last_peered":"2023-10-25T16:19:54.474708+0000","last_clean":"2023-10-25T16:19:54.474708+0000","last_became_active":"2023-10-25T16:19:54.469302+0000","last_became_peered":"2023-10-25T16:19:54.469302+0000","last_unstale":"2023-10-25T16:19:54.474708+0000","last_undegraded":"2023-10-25T16:19:54.474708+0000","last_fullsized":"2023-10-25T16:19:54.474708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463484+0000","last_change":"2023-10-25T16:19:54.463337+0000","last_active":"2023-10-25T16:19:54.463484+0000","last_peered":"2023-10-25T16:19:54.463484+0000","last_clean":"2023-10-25T16:19:54.463484+0000","last_became_active":"2023-10-25T16:19:54.462731+0000","last_became_peered":"2023-10-25T16:19:54.462731+0000","last_unstale":"2023-10-25T16:19:54.463484+0000","last_undegraded":"2023-10-25T16:19:54.463484+0000","last_fullsized":"2023-10-25T16:19:54.463484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:36:29.886246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463916+0000","last_change":"2023-10-25T16:19:54.463581+0000","last_active":"2023-10-25T16:19:54.463916+0000","last_peered":"2023-10-25T16:19:54.463916+0000","last_clean":"2023-10-25T16:19:54.463916+0000","last_became_active":"2023-10-25T16:19:54.462904+0000","last_became_peered":"2023-10-25T16:19:54.462904+0000","last_unstale":"2023-10-25T16:19:54.463916+0000","last_undegraded":"2023-10-25T16:19:54.463916+0000","last_fullsized":"2023-10-25T16:19:54.463916+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:11:08.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465865+0000","last_change":"2023-10-25T16:19:54.465565+0000","last_active":"2023-10-25T16:19:54.465865+0000","last_peered":"2023-10-25T16:19:54.465865+0000","last_clean":"2023-10-25T16:19:54.465865+0000","last_became_active":"2023-10-25T16:19:54.462990+0000","last_became_peered":"2023-10-25T16:19:54.462990+0000","last_unstale":"2023-10-25T16:19:54.465865+0000","last_undegraded":"2023-10-25T16:19:54.465865+0000","last_fullsized":"2023-10-25T16:19:54.465865+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:24.299112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466831+0000","last_change":"2023-10-25T16:19:54.466678+0000","last_active":"2023-10-25T16:19:54.466831+0000","last_peered":"2023-10-25T16:19:54.466831+0000","last_clean":"2023-10-25T16:19:54.466831+0000","last_became_active":"2023-10-25T16:19:54.461209+0000","last_became_peered":"2023-10-25T16:19:54.461209+0000","last_unstale":"2023-10-25T16:19:54.466831+0000","last_undegraded":"2023-10-25T16:19:54.466831+0000","last_fullsized":"2023-10-25T16:19:54.466831+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:51.803048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472670+0000","last_change":"2023-10-25T16:19:54.469012+0000","last_active":"2023-10-25T16:19:54.472670+0000","last_peered":"2023-10-25T16:19:54.472670+0000","last_clean":"2023-10-25T16:19:54.472670+0000","last_became_active":"2023-10-25T16:19:54.468016+0000","last_became_peered":"2023-10-25T16:19:54.468016+0000","last_unstale":"2023-10-25T16:19:54.472670+0000","last_undegraded":"2023-10-25T16:19:54.472670+0000","last_fullsized":"2023-10-25T16:19:54.472670+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:43.001368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450772+0000","last_change":"2023-10-25T16:19:54.448406+0000","last_active":"2023-10-25T16:19:54.450772+0000","last_peered":"2023-10-25T16:19:54.450772+0000","last_clean":"2023-10-25T16:19:54.450772+0000","last_became_active":"2023-10-25T16:19:54.446860+0000","last_became_peered":"2023-10-25T16:19:54.446860+0000","last_unstale":"2023-10-25T16:19:54.450772+0000","last_undegraded":"2023-10-25T16:19:54.450772+0000","last_fullsized":"2023-10-25T16:19:54.450772+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:28.086832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468918+0000","last_change":"2023-10-25T16:19:54.468783+0000","last_active":"2023-10-25T16:19:54.468918+0000","last_peered":"2023-10-25T16:19:54.468918+0000","last_clean":"2023-10-25T16:19:54.468918+0000","last_became_active":"2023-10-25T16:19:54.466677+0000","last_became_peered":"2023-10-25T16:19:54.466677+0000","last_unstale":"2023-10-25T16:19:54.468918+0000","last_undegraded":"2023-10-25T16:19:54.468918+0000","last_fullsized":"2023-10-25T16:19:54.468918+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:09.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461773+0000","last_change":"2023-10-25T16:19:54.461443+0000","last_active":"2023-10-25T16:19:54.461773+0000","last_peered":"2023-10-25T16:19:54.461773+0000","last_clean":"2023-10-25T16:19:54.461773+0000","last_became_active":"2023-10-25T16:19:54.460838+0000","last_became_peered":"2023-10-25T16:19:54.460838+0000","last_unstale":"2023-10-25T16:19:54.461773+0000","last_undegraded":"2023-10-25T16:19:54.461773+0000","last_fullsized":"2023-10-25T16:19:54.461773+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467213+0000","last_change":"2023-10-25T16:19:54.467062+0000","last_active":"2023-10-25T16:19:54.467213+0000","last_peered":"2023-10-25T16:19:54.467213+0000","last_clean":"2023-10-25T16:19:54.467213+0000","last_became_active":"2023-10-25T16:19:54.464502+0000","last_became_peered":"2023-10-25T16:19:54.464502+0000","last_unstale":"2023-10-25T16:19:54.467213+0000","last_undegraded":"2023-10-25T16:19:54.467213+0000","last_fullsized":"2023-10-25T16:19:54.467213+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456701+0000","last_change":"2023-10-25T16:19:54.451503+0000","last_active":"2023-10-25T16:19:54.456701+0000","last_peered":"2023-10-25T16:19:54.456701+0000","last_clean":"2023-10-25T16:19:54.456701+0000","last_became_active":"2023-10-25T16:19:54.450896+0000","last_became_peered":"2023-10-25T16:19:54.450896+0000","last_unstale":"2023-10-25T16:19:54.456701+0000","last_undegraded":"2023-10-25T16:19:54.456701+0000","last_fullsized":"2023-10-25T16:19:54.456701+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:43:37.602014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456649+0000","last_change":"2023-10-25T16:19:54.450150+0000","last_active":"2023-10-25T16:19:54.456649+0000","last_peered":"2023-10-25T16:19:54.456649+0000","last_clean":"2023-10-25T16:19:54.456649+0000","last_became_active":"2023-10-25T16:19:54.449509+0000","last_became_peered":"2023-10-25T16:19:54.449509+0000","last_unstale":"2023-10-25T16:19:54.456649+0000","last_undegraded":"2023-10-25T16:19:54.456649+0000","last_fullsized":"2023-10-25T16:19:54.456649+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:16:43.655185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459145+0000","last_change":"2023-10-25T16:19:54.458648+0000","last_active":"2023-10-25T16:19:54.459145+0000","last_peered":"2023-10-25T16:19:54.459145+0000","last_clean":"2023-10-25T16:19:54.459145+0000","last_became_active":"2023-10-25T16:19:54.457941+0000","last_became_peered":"2023-10-25T16:19:54.457941+0000","last_unstale":"2023-10-25T16:19:54.459145+0000","last_undegraded":"2023-10-25T16:19:54.459145+0000","last_fullsized":"2023-10-25T16:19:54.459145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:29:59.455072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457978+0000","last_change":"2023-10-25T16:19:54.457827+0000","last_active":"2023-10-25T16:19:54.457978+0000","last_peered":"2023-10-25T16:19:54.457978+0000","last_clean":"2023-10-25T16:19:54.457978+0000","last_became_active":"2023-10-25T16:19:54.456641+0000","last_became_peered":"2023-10-25T16:19:54.456641+0000","last_unstale":"2023-10-25T16:19:54.457978+0000","last_undegraded":"2023-10-25T16:19:54.457978+0000","last_fullsized":"2023-10-25T16:19:54.457978+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:52.812391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468333+0000","last_change":"2023-10-25T16:19:54.468145+0000","last_active":"2023-10-25T16:19:54.468333+0000","last_peered":"2023-10-25T16:19:54.468333+0000","last_clean":"2023-10-25T16:19:54.468333+0000","last_became_active":"2023-10-25T16:19:54.464664+0000","last_became_peered":"2023-10-25T16:19:54.464664+0000","last_unstale":"2023-10-25T16:19:54.468333+0000","last_undegraded":"2023-10-25T16:19:54.468333+0000","last_fullsized":"2023-10-25T16:19:54.468333+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:23.996474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456802+0000","last_change":"2023-10-25T16:19:54.454986+0000","last_active":"2023-10-25T16:19:54.456802+0000","last_peered":"2023-10-25T16:19:54.456802+0000","last_clean":"2023-10-25T16:19:54.456802+0000","last_became_active":"2023-10-25T16:19:54.454308+0000","last_became_peered":"2023-10-25T16:19:54.454308+0000","last_unstale":"2023-10-25T16:19:54.456802+0000","last_undegraded":"2023-10-25T16:19:54.456802+0000","last_fullsized":"2023-10-25T16:19:54.456802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:45:22.751967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450823+0000","last_change":"2023-10-25T16:19:54.448801+0000","last_active":"2023-10-25T16:19:54.450823+0000","last_peered":"2023-10-25T16:19:54.450823+0000","last_clean":"2023-10-25T16:19:54.450823+0000","last_became_active":"2023-10-25T16:19:54.447799+0000","last_became_peered":"2023-10-25T16:19:54.447799+0000","last_unstale":"2023-10-25T16:19:54.450823+0000","last_undegraded":"2023-10-25T16:19:54.450823+0000","last_fullsized":"2023-10-25T16:19:54.450823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:56.732275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466858+0000","last_change":"2023-10-25T16:19:54.466672+0000","last_active":"2023-10-25T16:19:54.466858+0000","last_peered":"2023-10-25T16:19:54.466858+0000","last_clean":"2023-10-25T16:19:54.466858+0000","last_became_active":"2023-10-25T16:19:54.465394+0000","last_became_peered":"2023-10-25T16:19:54.465394+0000","last_unstale":"2023-10-25T16:19:54.466858+0000","last_undegraded":"2023-10-25T16:19:54.466858+0000","last_fullsized":"2023-10-25T16:19:54.466858+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:55.228229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455819+0000","last_change":"2023-10-25T16:19:54.454070+0000","last_active":"2023-10-25T16:19:54.455819+0000","last_peered":"2023-10-25T16:19:54.455819+0000","last_clean":"2023-10-25T16:19:54.455819+0000","last_became_active":"2023-10-25T16:19:54.453409+0000","last_became_peered":"2023-10-25T16:19:54.453409+0000","last_unstale":"2023-10-25T16:19:54.455819+0000","last_undegraded":"2023-10-25T16:19:54.455819+0000","last_fullsized":"2023-10-25T16:19:54.455819+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456849+0000","last_change":"2023-10-25T16:19:54.455923+0000","last_active":"2023-10-25T16:19:54.456849+0000","last_peered":"2023-10-25T16:19:54.456849+0000","last_clean":"2023-10-25T16:19:54.456849+0000","last_became_active":"2023-10-25T16:19:54.455216+0000","last_became_peered":"2023-10-25T16:19:54.455216+0000","last_unstale":"2023-10-25T16:19:54.456849+0000","last_undegraded":"2023-10-25T16:19:54.456849+0000","last_fullsized":"2023-10-25T16:19:54.456849+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:36.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.447574+0000","last_change":"2023-10-25T16:19:54.447434+0000","last_active":"2023-10-25T16:19:54.447574+0000","last_peered":"2023-10-25T16:19:54.447574+0000","last_clean":"2023-10-25T16:19:54.447574+0000","last_became_active":"2023-10-25T16:19:54.446808+0000","last_became_peered":"2023-10-25T16:19:54.446808+0000","last_unstale":"2023-10-25T16:19:54.447574+0000","last_undegraded":"2023-10-25T16:19:54.447574+0000","last_fullsized":"2023-10-25T16:19:54.447574+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:25.646957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458359+0000","last_change":"2023-10-25T16:19:54.458170+0000","last_active":"2023-10-25T16:19:54.458359+0000","last_peered":"2023-10-25T16:19:54.458359+0000","last_clean":"2023-10-25T16:19:54.458359+0000","last_became_active":"2023-10-25T16:19:54.449443+0000","last_became_peered":"2023-10-25T16:19:54.449443+0000","last_unstale":"2023-10-25T16:19:54.458359+0000","last_undegraded":"2023-10-25T16:19:54.458359+0000","last_fullsized":"2023-10-25T16:19:54.458359+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:44.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466299+0000","last_change":"2023-10-25T16:19:54.466137+0000","last_active":"2023-10-25T16:19:54.466299+0000","last_peered":"2023-10-25T16:19:54.466299+0000","last_clean":"2023-10-25T16:19:54.466299+0000","last_became_active":"2023-10-25T16:19:54.464568+0000","last_became_peered":"2023-10-25T16:19:54.464568+0000","last_unstale":"2023-10-25T16:19:54.466299+0000","last_undegraded":"2023-10-25T16:19:54.466299+0000","last_fullsized":"2023-10-25T16:19:54.466299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:25.698386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461169+0000","last_change":"2023-10-25T16:19:54.460492+0000","last_active":"2023-10-25T16:19:54.461169+0000","last_peered":"2023-10-25T16:19:54.461169+0000","last_clean":"2023-10-25T16:19:54.461169+0000","last_became_active":"2023-10-25T16:19:54.459828+0000","last_became_peered":"2023-10-25T16:19:54.459828+0000","last_unstale":"2023-10-25T16:19:54.461169+0000","last_undegraded":"2023-10-25T16:19:54.461169+0000","last_fullsized":"2023-10-25T16:19:54.461169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:56:23.557613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705568+0000","last_change":"2023-10-25T16:19:53.408435+0000","last_active":"2023-10-25T16:19:54.705568+0000","last_peered":"2023-10-25T16:19:54.705568+0000","last_clean":"2023-10-25T16:19:54.705568+0000","last_became_active":"2023-10-25T16:19:53.407353+0000","last_became_peered":"2023-10-25T16:19:53.407353+0000","last_unstale":"2023-10-25T16:19:54.705568+0000","last_undegraded":"2023-10-25T16:19:54.705568+0000","last_fullsized":"2023-10-25T16:19:54.705568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:48:13.615155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457968+0000","last_change":"2023-10-25T16:19:54.457803+0000","last_active":"2023-10-25T16:19:54.457968+0000","last_peered":"2023-10-25T16:19:54.457968+0000","last_clean":"2023-10-25T16:19:54.457968+0000","last_became_active":"2023-10-25T16:19:54.457190+0000","last_became_peered":"2023-10-25T16:19:54.457190+0000","last_unstale":"2023-10-25T16:19:54.457968+0000","last_undegraded":"2023-10-25T16:19:54.457968+0000","last_fullsized":"2023-10-25T16:19:54.457968+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703698+0000","last_change":"2023-10-25T16:19:53.407966+0000","last_active":"2023-10-25T16:19:54.703698+0000","last_peered":"2023-10-25T16:19:54.703698+0000","last_clean":"2023-10-25T16:19:54.703698+0000","last_became_active":"2023-10-25T16:19:53.407333+0000","last_became_peered":"2023-10-25T16:19:53.407333+0000","last_unstale":"2023-10-25T16:19:54.703698+0000","last_undegraded":"2023-10-25T16:19:54.703698+0000","last_fullsized":"2023-10-25T16:19:54.703698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:01.501634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473363+0000","last_change":"2023-10-25T16:19:54.471618+0000","last_active":"2023-10-25T16:19:54.473363+0000","last_peered":"2023-10-25T16:19:54.473363+0000","last_clean":"2023-10-25T16:19:54.473363+0000","last_became_active":"2023-10-25T16:19:54.470001+0000","last_became_peered":"2023-10-25T16:19:54.470001+0000","last_unstale":"2023-10-25T16:19:54.473363+0000","last_undegraded":"2023-10-25T16:19:54.473363+0000","last_fullsized":"2023-10-25T16:19:54.473363+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:32.794532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464451+0000","last_change":"2023-10-25T16:19:54.464303+0000","last_active":"2023-10-25T16:19:54.464451+0000","last_peered":"2023-10-25T16:19:54.464451+0000","last_clean":"2023-10-25T16:19:54.464451+0000","last_became_active":"2023-10-25T16:19:54.463645+0000","last_became_peered":"2023-10-25T16:19:54.463645+0000","last_unstale":"2023-10-25T16:19:54.464451+0000","last_undegraded":"2023-10-25T16:19:54.464451+0000","last_fullsized":"2023-10-25T16:19:54.464451+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:52.561033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450869+0000","last_change":"2023-10-25T16:19:54.450631+0000","last_active":"2023-10-25T16:19:54.450869+0000","last_peered":"2023-10-25T16:19:54.450869+0000","last_clean":"2023-10-25T16:19:54.450869+0000","last_became_active":"2023-10-25T16:19:54.449923+0000","last_became_peered":"2023-10-25T16:19:54.449923+0000","last_unstale":"2023-10-25T16:19:54.450869+0000","last_undegraded":"2023-10-25T16:19:54.450869+0000","last_fullsized":"2023-10-25T16:19:54.450869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:59.058809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705246+0000","last_change":"2023-10-25T16:19:53.423223+0000","last_active":"2023-10-25T16:19:54.705246+0000","last_peered":"2023-10-25T16:19:54.705246+0000","last_clean":"2023-10-25T16:19:54.705246+0000","last_became_active":"2023-10-25T16:19:53.421712+0000","last_became_peered":"2023-10-25T16:19:53.421712+0000","last_unstale":"2023-10-25T16:19:54.705246+0000","last_undegraded":"2023-10-25T16:19:54.705246+0000","last_fullsized":"2023-10-25T16:19:54.705246+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:08.239214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468631+0000","last_change":"2023-10-25T16:19:54.468481+0000","last_active":"2023-10-25T16:19:54.468631+0000","last_peered":"2023-10-25T16:19:54.468631+0000","last_clean":"2023-10-25T16:19:54.468631+0000","last_became_active":"2023-10-25T16:19:54.465812+0000","last_became_peered":"2023-10-25T16:19:54.465812+0000","last_unstale":"2023-10-25T16:19:54.468631+0000","last_undegraded":"2023-10-25T16:19:54.468631+0000","last_fullsized":"2023-10-25T16:19:54.468631+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:10.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705601+0000","last_change":"2023-10-25T16:19:53.431077+0000","last_active":"2023-10-25T16:19:54.705601+0000","last_peered":"2023-10-25T16:19:54.705601+0000","last_clean":"2023-10-25T16:19:54.705601+0000","last_became_active":"2023-10-25T16:19:53.430825+0000","last_became_peered":"2023-10-25T16:19:53.430825+0000","last_unstale":"2023-10-25T16:19:54.705601+0000","last_undegraded":"2023-10-25T16:19:54.705601+0000","last_fullsized":"2023-10-25T16:19:54.705601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:17.573720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465347+0000","last_change":"2023-10-25T16:19:54.464983+0000","last_active":"2023-10-25T16:19:54.465347+0000","last_peered":"2023-10-25T16:19:54.465347+0000","last_clean":"2023-10-25T16:19:54.465347+0000","last_became_active":"2023-10-25T16:19:54.461758+0000","last_became_peered":"2023-10-25T16:19:54.461758+0000","last_unstale":"2023-10-25T16:19:54.465347+0000","last_undegraded":"2023-10-25T16:19:54.465347+0000","last_fullsized":"2023-10-25T16:19:54.465347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442024+0000","last_change":"2023-10-25T16:19:53.419217+0000","last_active":"2023-10-25T16:19:54.442024+0000","last_peered":"2023-10-25T16:19:54.442024+0000","last_clean":"2023-10-25T16:19:54.442024+0000","last_became_active":"2023-10-25T16:19:53.418429+0000","last_became_peered":"2023-10-25T16:19:53.418429+0000","last_unstale":"2023-10-25T16:19:54.442024+0000","last_undegraded":"2023-10-25T16:19:54.442024+0000","last_fullsized":"2023-10-25T16:19:54.442024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:53:13.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456035+0000","last_change":"2023-10-25T16:19:54.455866+0000","last_active":"2023-10-25T16:19:54.456035+0000","last_peered":"2023-10-25T16:19:54.456035+0000","last_clean":"2023-10-25T16:19:54.456035+0000","last_became_active":"2023-10-25T16:19:54.455162+0000","last_became_peered":"2023-10-25T16:19:54.455162+0000","last_unstale":"2023-10-25T16:19:54.456035+0000","last_undegraded":"2023-10-25T16:19:54.456035+0000","last_fullsized":"2023-10-25T16:19:54.456035+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:51.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446981+0000","last_change":"2023-10-25T16:19:53.419508+0000","last_active":"2023-10-25T16:19:54.446981+0000","last_peered":"2023-10-25T16:19:54.446981+0000","last_clean":"2023-10-25T16:19:54.446981+0000","last_became_active":"2023-10-25T16:19:53.418740+0000","last_became_peered":"2023-10-25T16:19:53.418740+0000","last_unstale":"2023-10-25T16:19:54.446981+0000","last_undegraded":"2023-10-25T16:19:54.446981+0000","last_fullsized":"2023-10-25T16:19:54.446981+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:45.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463926+0000","last_change":"2023-10-25T16:19:54.463626+0000","last_active":"2023-10-25T16:19:54.463926+0000","last_peered":"2023-10-25T16:19:54.463926+0000","last_clean":"2023-10-25T16:19:54.463926+0000","last_became_active":"2023-10-25T16:19:54.462999+0000","last_became_peered":"2023-10-25T16:19:54.462999+0000","last_unstale":"2023-10-25T16:19:54.463926+0000","last_undegraded":"2023-10-25T16:19:54.463926+0000","last_fullsized":"2023-10-25T16:19:54.463926+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:35.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465155+0000","last_change":"2023-10-25T16:19:54.465003+0000","last_active":"2023-10-25T16:19:54.465155+0000","last_peered":"2023-10-25T16:19:54.465155+0000","last_clean":"2023-10-25T16:19:54.465155+0000","last_became_active":"2023-10-25T16:19:54.463043+0000","last_became_peered":"2023-10-25T16:19:54.463043+0000","last_unstale":"2023-10-25T16:19:54.465155+0000","last_undegraded":"2023-10-25T16:19:54.465155+0000","last_fullsized":"2023-10-25T16:19:54.465155+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440427+0000","last_change":"2023-10-25T16:19:53.417480+0000","last_active":"2023-10-25T16:19:54.440427+0000","last_peered":"2023-10-25T16:19:54.440427+0000","last_clean":"2023-10-25T16:19:54.440427+0000","last_became_active":"2023-10-25T16:19:53.417160+0000","last_became_peered":"2023-10-25T16:19:53.417160+0000","last_unstale":"2023-10-25T16:19:54.440427+0000","last_undegraded":"2023-10-25T16:19:54.440427+0000","last_fullsized":"2023-10-25T16:19:54.440427+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:44.282469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449332+0000","last_change":"2023-10-25T16:19:54.448364+0000","last_active":"2023-10-25T16:19:54.449332+0000","last_peered":"2023-10-25T16:19:54.449332+0000","last_clean":"2023-10-25T16:19:54.449332+0000","last_became_active":"2023-10-25T16:19:54.447523+0000","last_became_peered":"2023-10-25T16:19:54.447523+0000","last_unstale":"2023-10-25T16:19:54.449332+0000","last_undegraded":"2023-10-25T16:19:54.449332+0000","last_fullsized":"2023-10-25T16:19:54.449332+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:07.214049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.709914+0000","last_change":"2023-10-25T16:19:53.427731+0000","last_active":"2023-10-25T16:19:54.709914+0000","last_peered":"2023-10-25T16:19:54.709914+0000","last_clean":"2023-10-25T16:19:54.709914+0000","last_became_active":"2023-10-25T16:19:53.424487+0000","last_became_peered":"2023-10-25T16:19:53.424487+0000","last_unstale":"2023-10-25T16:19:54.709914+0000","last_undegraded":"2023-10-25T16:19:54.709914+0000","last_fullsized":"2023-10-25T16:19:54.709914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:28.745280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445611+0000","last_change":"2023-10-25T16:19:54.445458+0000","last_active":"2023-10-25T16:19:54.445611+0000","last_peered":"2023-10-25T16:19:54.445611+0000","last_clean":"2023-10-25T16:19:54.445611+0000","last_became_active":"2023-10-25T16:19:54.444854+0000","last_became_peered":"2023-10-25T16:19:54.444854+0000","last_unstale":"2023-10-25T16:19:54.445611+0000","last_undegraded":"2023-10-25T16:19:54.445611+0000","last_fullsized":"2023-10-25T16:19:54.445611+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:54.145259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.714771+0000","last_change":"2023-10-25T16:19:53.422257+0000","last_active":"2023-10-25T16:19:54.714771+0000","last_peered":"2023-10-25T16:19:54.714771+0000","last_clean":"2023-10-25T16:19:54.714771+0000","last_became_active":"2023-10-25T16:19:53.419641+0000","last_became_peered":"2023-10-25T16:19:53.419641+0000","last_unstale":"2023-10-25T16:19:54.714771+0000","last_undegraded":"2023-10-25T16:19:54.714771+0000","last_fullsized":"2023-10-25T16:19:54.714771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:12:20.637482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449144+0000","last_change":"2023-10-25T16:19:54.447812+0000","last_active":"2023-10-25T16:19:54.449144+0000","last_peered":"2023-10-25T16:19:54.449144+0000","last_clean":"2023-10-25T16:19:54.449144+0000","last_became_active":"2023-10-25T16:19:54.447047+0000","last_became_peered":"2023-10-25T16:19:54.447047+0000","last_unstale":"2023-10-25T16:19:54.449144+0000","last_undegraded":"2023-10-25T16:19:54.449144+0000","last_fullsized":"2023-10-25T16:19:54.449144+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:14.600765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.706452+0000","last_change":"2023-10-25T16:19:53.427358+0000","last_active":"2023-10-25T16:19:54.706452+0000","last_peered":"2023-10-25T16:19:54.706452+0000","last_clean":"2023-10-25T16:19:54.706452+0000","last_became_active":"2023-10-25T16:19:53.427148+0000","last_became_peered":"2023-10-25T16:19:53.427148+0000","last_unstale":"2023-10-25T16:19:54.706452+0000","last_undegraded":"2023-10-25T16:19:54.706452+0000","last_fullsized":"2023-10-25T16:19:54.706452+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:10.163492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.465106+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.461605+0000","last_became_peered":"2023-10-25T16:19:54.461605+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.453850+0000","last_change":"2023-10-25T16:19:53.428746+0000","last_active":"2023-10-25T16:19:54.453850+0000","last_peered":"2023-10-25T16:19:54.453850+0000","last_clean":"2023-10-25T16:19:54.453850+0000","last_became_active":"2023-10-25T16:19:53.427276+0000","last_became_peered":"2023-10-25T16:19:53.427276+0000","last_unstale":"2023-10-25T16:19:54.453850+0000","last_undegraded":"2023-10-25T16:19:54.453850+0000","last_fullsized":"2023-10-25T16:19:54.453850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:55.728285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466705+0000","last_change":"2023-10-25T16:19:54.466527+0000","last_active":"2023-10-25T16:19:54.466705+0000","last_peered":"2023-10-25T16:19:54.466705+0000","last_clean":"2023-10-25T16:19:54.466705+0000","last_became_active":"2023-10-25T16:19:54.465742+0000","last_became_peered":"2023-10-25T16:19:54.465742+0000","last_unstale":"2023-10-25T16:19:54.466705+0000","last_undegraded":"2023-10-25T16:19:54.466705+0000","last_fullsized":"2023-10-25T16:19:54.466705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:45:47.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:53.394237+0000","last_change":"2023-10-25T16:19:53.394237+0000","last_active":"2023-10-25T16:19:53.394237+0000","last_peered":"2023-10-25T16:19:53.394237+0000","last_clean":"2023-10-25T16:19:53.394237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:53.394237+0000","last_undegraded":"2023-10-25T16:19:53.394237+0000","last_fullsized":"2023-10-25T16:19:53.394237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.712152+0000","last_change":"2023-10-25T16:19:53.422733+0000","last_active":"2023-10-25T16:19:54.712152+0000","last_peered":"2023-10-25T16:19:54.712152+0000","last_clean":"2023-10-25T16:19:54.712152+0000","last_became_active":"2023-10-25T16:19:53.420621+0000","last_became_peered":"2023-10-25T16:19:53.420621+0000","last_unstale":"2023-10-25T16:19:54.712152+0000","last_undegraded":"2023-10-25T16:19:54.712152+0000","last_fullsized":"2023-10-25T16:19:54.712152+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:01.712031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473418+0000","last_change":"2023-10-25T16:19:54.472785+0000","last_active":"2023-10-25T16:19:54.473418+0000","last_peered":"2023-10-25T16:19:54.473418+0000","last_clean":"2023-10-25T16:19:54.473418+0000","last_became_active":"2023-10-25T16:19:54.472181+0000","last_became_peered":"2023-10-25T16:19:54.472181+0000","last_unstale":"2023-10-25T16:19:54.473418+0000","last_undegraded":"2023-10-25T16:19:54.473418+0000","last_fullsized":"2023-10-25T16:19:54.473418+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:12:28.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457983+0000","last_change":"2023-10-25T16:19:54.456776+0000","last_active":"2023-10-25T16:19:54.457983+0000","last_peered":"2023-10-25T16:19:54.457983+0000","last_clean":"2023-10-25T16:19:54.457983+0000","last_became_active":"2023-10-25T16:19:54.456154+0000","last_became_peered":"2023-10-25T16:19:54.456154+0000","last_unstale":"2023-10-25T16:19:54.457983+0000","last_undegraded":"2023-10-25T16:19:54.457983+0000","last_fullsized":"2023-10-25T16:19:54.457983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703611+0000","last_change":"2023-10-25T16:19:53.428321+0000","last_active":"2023-10-25T16:19:54.703611+0000","last_peered":"2023-10-25T16:19:54.703611+0000","last_clean":"2023-10-25T16:19:54.703611+0000","last_became_active":"2023-10-25T16:19:53.426214+0000","last_became_peered":"2023-10-25T16:19:53.426214+0000","last_unstale":"2023-10-25T16:19:54.703611+0000","last_undegraded":"2023-10-25T16:19:54.703611+0000","last_fullsized":"2023-10-25T16:19:54.703611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:58.054818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440049+0000","last_change":"2023-10-25T16:19:54.439642+0000","last_active":"2023-10-25T16:19:54.440049+0000","last_peered":"2023-10-25T16:19:54.440049+0000","last_clean":"2023-10-25T16:19:54.440049+0000","last_became_active":"2023-10-25T16:19:54.439034+0000","last_became_peered":"2023-10-25T16:19:54.439034+0000","last_unstale":"2023-10-25T16:19:54.440049+0000","last_undegraded":"2023-10-25T16:19:54.440049+0000","last_fullsized":"2023-10-25T16:19:54.440049+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.444323+0000","last_change":"2023-10-25T16:19:53.420424+0000","last_active":"2023-10-25T16:19:54.444323+0000","last_peered":"2023-10-25T16:19:54.444323+0000","last_clean":"2023-10-25T16:19:54.444323+0000","last_became_active":"2023-10-25T16:19:53.418421+0000","last_became_peered":"2023-10-25T16:19:53.418421+0000","last_unstale":"2023-10-25T16:19:54.444323+0000","last_undegraded":"2023-10-25T16:19:54.444323+0000","last_fullsized":"2023-10-25T16:19:54.444323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:09.427824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452795+0000","last_change":"2023-10-25T16:19:54.452630+0000","last_active":"2023-10-25T16:19:54.452795+0000","last_peered":"2023-10-25T16:19:54.452795+0000","last_clean":"2023-10-25T16:19:54.452795+0000","last_became_active":"2023-10-25T16:19:54.448173+0000","last_became_peered":"2023-10-25T16:19:54.448173+0000","last_unstale":"2023-10-25T16:19:54.452795+0000","last_undegraded":"2023-10-25T16:19:54.452795+0000","last_fullsized":"2023-10-25T16:19:54.452795+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:52.905840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.708198+0000","last_change":"2023-10-25T16:19:53.426370+0000","last_active":"2023-10-25T16:19:54.708198+0000","last_peered":"2023-10-25T16:19:54.708198+0000","last_clean":"2023-10-25T16:19:54.708198+0000","last_became_active":"2023-10-25T16:19:53.425764+0000","last_became_peered":"2023-10-25T16:19:53.425764+0000","last_unstale":"2023-10-25T16:19:54.708198+0000","last_undegraded":"2023-10-25T16:19:54.708198+0000","last_fullsized":"2023-10-25T16:19:54.708198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:45.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472116+0000","last_change":"2023-10-25T16:19:54.470877+0000","last_active":"2023-10-25T16:19:54.472116+0000","last_peered":"2023-10-25T16:19:54.472116+0000","last_clean":"2023-10-25T16:19:54.472116+0000","last_became_active":"2023-10-25T16:19:54.466660+0000","last_became_peered":"2023-10-25T16:19:54.466660+0000","last_unstale":"2023-10-25T16:19:54.472116+0000","last_undegraded":"2023-10-25T16:19:54.472116+0000","last_fullsized":"2023-10-25T16:19:54.472116+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:10.091615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458790+0000","last_change":"2023-10-25T16:19:54.458538+0000","last_active":"2023-10-25T16:19:54.458790+0000","last_peered":"2023-10-25T16:19:54.458790+0000","last_clean":"2023-10-25T16:19:54.458790+0000","last_became_active":"2023-10-25T16:19:54.457929+0000","last_became_peered":"2023-10-25T16:19:54.457929+0000","last_unstale":"2023-10-25T16:19:54.458790+0000","last_undegraded":"2023-10-25T16:19:54.458790+0000","last_fullsized":"2023-10-25T16:19:54.458790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:18.577710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458365+0000","last_change":"2023-10-25T16:19:53.431122+0000","last_active":"2023-10-25T16:19:54.458365+0000","last_peered":"2023-10-25T16:19:54.458365+0000","last_clean":"2023-10-25T16:19:54.458365+0000","last_became_active":"2023-10-25T16:19:53.430508+0000","last_became_peered":"2023-10-25T16:19:53.430508+0000","last_unstale":"2023-10-25T16:19:54.458365+0000","last_undegraded":"2023-10-25T16:19:54.458365+0000","last_fullsized":"2023-10-25T16:19:54.458365+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:53.141269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455869+0000","last_change":"2023-10-25T16:19:54.454215+0000","last_active":"2023-10-25T16:19:54.455869+0000","last_peered":"2023-10-25T16:19:54.455869+0000","last_clean":"2023-10-25T16:19:54.455869+0000","last_became_active":"2023-10-25T16:19:54.452463+0000","last_became_peered":"2023-10-25T16:19:54.452463+0000","last_unstale":"2023-10-25T16:19:54.455869+0000","last_undegraded":"2023-10-25T16:19:54.455869+0000","last_fullsized":"2023-10-25T16:19:54.455869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442423+0000","last_change":"2023-10-25T16:19:53.431258+0000","last_active":"2023-10-25T16:19:54.442423+0000","last_peered":"2023-10-25T16:19:54.442423+0000","last_clean":"2023-10-25T16:19:54.442423+0000","last_became_active":"2023-10-25T16:19:53.430185+0000","last_became_peered":"2023-10-25T16:19:53.430185+0000","last_unstale":"2023-10-25T16:19:54.442423+0000","last_undegraded":"2023-10-25T16:19:54.442423+0000","last_fullsized":"2023-10-25T16:19:54.442423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:54:14.517117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.475198+0000","last_change":"2023-10-25T16:19:54.475021+0000","last_active":"2023-10-25T16:19:54.475198+0000","last_peered":"2023-10-25T16:19:54.475198+0000","last_clean":"2023-10-25T16:19:54.475198+0000","last_became_active":"2023-10-25T16:19:54.474608+0000","last_became_peered":"2023-10-25T16:19:54.474608+0000","last_unstale":"2023-10-25T16:19:54.475198+0000","last_undegraded":"2023-10-25T16:19:54.475198+0000","last_fullsized":"2023-10-25T16:19:54.475198+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:58:22.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.710156+0000","last_change":"2023-10-25T16:19:53.414277+0000","last_active":"2023-10-25T16:19:54.710156+0000","last_peered":"2023-10-25T16:19:54.710156+0000","last_clean":"2023-10-25T16:19:54.710156+0000","last_became_active":"2023-10-25T16:19:53.413965+0000","last_became_peered":"2023-10-25T16:19:53.413965+0000","last_unstale":"2023-10-25T16:19:54.710156+0000","last_undegraded":"2023-10-25T16:19:54.710156+0000","last_fullsized":"2023-10-25T16:19:54.710156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:50.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467776+0000","last_change":"2023-10-25T16:19:54.467618+0000","last_active":"2023-10-25T16:19:54.467776+0000","last_peered":"2023-10-25T16:19:54.467776+0000","last_clean":"2023-10-25T16:19:54.467776+0000","last_became_active":"2023-10-25T16:19:54.466936+0000","last_became_peered":"2023-10-25T16:19:54.466936+0000","last_unstale":"2023-10-25T16:19:54.467776+0000","last_undegraded":"2023-10-25T16:19:54.467776+0000","last_fullsized":"2023-10-25T16:19:54.467776+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:46.123344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452904+0000","last_change":"2023-10-25T16:19:53.416392+0000","last_active":"2023-10-25T16:19:54.452904+0000","last_peered":"2023-10-25T16:19:54.452904+0000","last_clean":"2023-10-25T16:19:54.452904+0000","last_became_active":"2023-10-25T16:19:53.415622+0000","last_became_peered":"2023-10-25T16:19:53.415622+0000","last_unstale":"2023-10-25T16:19:54.452904+0000","last_undegraded":"2023-10-25T16:19:54.452904+0000","last_fullsized":"2023-10-25T16:19:54.452904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:27.082841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464607+0000","last_change":"2023-10-25T16:19:54.464430+0000","last_active":"2023-10-25T16:19:54.464607+0000","last_peered":"2023-10-25T16:19:54.464607+0000","last_clean":"2023-10-25T16:19:54.464607+0000","last_became_active":"2023-10-25T16:19:54.460534+0000","last_became_peered":"2023-10-25T16:19:54.460534+0000","last_unstale":"2023-10-25T16:19:54.464607+0000","last_undegraded":"2023-10-25T16:19:54.464607+0000","last_fullsized":"2023-10-25T16:19:54.464607+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446604+0000","last_change":"2023-10-25T16:19:53.424091+0000","last_active":"2023-10-25T16:19:54.446604+0000","last_peered":"2023-10-25T16:19:54.446604+0000","last_clean":"2023-10-25T16:19:54.446604+0000","last_became_active":"2023-10-25T16:19:53.423484+0000","last_became_peered":"2023-10-25T16:19:53.423484+0000","last_unstale":"2023-10-25T16:19:54.446604+0000","last_undegraded":"2023-10-25T16:19:54.446604+0000","last_fullsized":"2023-10-25T16:19:54.446604+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:44.149035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472323+0000","last_change":"2023-10-25T16:19:54.472192+0000","last_active":"2023-10-25T16:19:54.472323+0000","last_peered":"2023-10-25T16:19:54.472323+0000","last_clean":"2023-10-25T16:19:54.472323+0000","last_became_active":"2023-10-25T16:19:54.471674+0000","last_became_peered":"2023-10-25T16:19:54.471674+0000","last_unstale":"2023-10-25T16:19:54.472323+0000","last_undegraded":"2023-10-25T16:19:54.472323+0000","last_fullsized":"2023-10-25T16:19:54.472323+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445917+0000","last_change":"2023-10-25T16:19:53.424477+0000","last_active":"2023-10-25T16:19:54.445917+0000","last_peered":"2023-10-25T16:19:54.445917+0000","last_clean":"2023-10-25T16:19:54.445917+0000","last_became_active":"2023-10-25T16:19:53.424258+0000","last_became_peered":"2023-10-25T16:19:53.424258+0000","last_unstale":"2023-10-25T16:19:54.445917+0000","last_undegraded":"2023-10-25T16:19:54.445917+0000","last_fullsized":"2023-10-25T16:19:54.445917+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:51.557043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467542+0000","last_change":"2023-10-25T16:19:54.467301+0000","last_active":"2023-10-25T16:19:54.467542+0000","last_peered":"2023-10-25T16:19:54.467542+0000","last_clean":"2023-10-25T16:19:54.467542+0000","last_became_active":"2023-10-25T16:19:54.461393+0000","last_became_peered":"2023-10-25T16:19:54.461393+0000","last_unstale":"2023-10-25T16:19:54.467542+0000","last_undegraded":"2023-10-25T16:19:54.467542+0000","last_fullsized":"2023-10-25T16:19:54.467542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:03:18.162726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.437580+0000","last_change":"2023-10-25T16:19:53.418461+0000","last_active":"2023-10-25T16:19:54.437580+0000","last_peered":"2023-10-25T16:19:54.437580+0000","last_clean":"2023-10-25T16:19:54.437580+0000","last_became_active":"2023-10-25T16:19:53.417773+0000","last_became_peered":"2023-10-25T16:19:53.417773+0000","last_unstale":"2023-10-25T16:19:54.437580+0000","last_undegraded":"2023-10-25T16:19:54.437580+0000","last_fullsized":"2023-10-25T16:19:54.437580+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:07.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459135+0000","last_change":"2023-10-25T16:19:54.458996+0000","last_active":"2023-10-25T16:19:54.459135+0000","last_peered":"2023-10-25T16:19:54.459135+0000","last_clean":"2023-10-25T16:19:54.459135+0000","last_became_active":"2023-10-25T16:19:54.458371+0000","last_became_peered":"2023-10-25T16:19:54.458371+0000","last_unstale":"2023-10-25T16:19:54.459135+0000","last_undegraded":"2023-10-25T16:19:54.459135+0000","last_fullsized":"2023-10-25T16:19:54.459135+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:03.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459380+0000","last_change":"2023-10-25T16:19:53.431861+0000","last_active":"2023-10-25T16:19:54.459380+0000","last_peered":"2023-10-25T16:19:54.459380+0000","last_clean":"2023-10-25T16:19:54.459380+0000","last_became_active":"2023-10-25T16:19:53.430078+0000","last_became_peered":"2023-10-25T16:19:53.430078+0000","last_unstale":"2023-10-25T16:19:54.459380+0000","last_undegraded":"2023-10-25T16:19:54.459380+0000","last_fullsized":"2023-10-25T16:19:54.459380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:16.139714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.466000+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.459488+0000","last_became_peered":"2023-10-25T16:19:54.459488+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:08:01.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473964+0000","last_change":"2023-10-25T16:19:54.473782+0000","last_active":"2023-10-25T16:19:54.473964+0000","last_peered":"2023-10-25T16:19:54.473964+0000","last_clean":"2023-10-25T16:19:54.473964+0000","last_became_active":"2023-10-25T16:19:54.470232+0000","last_became_peered":"2023-10-25T16:19:54.470232+0000","last_unstale":"2023-10-25T16:19:54.473964+0000","last_undegraded":"2023-10-25T16:19:54.473964+0000","last_fullsized":"2023-10-25T16:19:54.473964+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:04.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446978+0000","last_change":"2023-10-25T16:19:53.429389+0000","last_active":"2023-10-25T16:19:54.446978+0000","last_peered":"2023-10-25T16:19:54.446978+0000","last_clean":"2023-10-25T16:19:54.446978+0000","last_became_active":"2023-10-25T16:19:53.428712+0000","last_became_peered":"2023-10-25T16:19:53.428712+0000","last_unstale":"2023-10-25T16:19:54.446978+0000","last_undegraded":"2023-10-25T16:19:54.446978+0000","last_fullsized":"2023-10-25T16:19:54.446978+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:56:09.475192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459095+0000","last_change":"2023-10-25T16:19:54.458038+0000","last_active":"2023-10-25T16:19:54.459095+0000","last_peered":"2023-10-25T16:19:54.459095+0000","last_clean":"2023-10-25T16:19:54.459095+0000","last_became_active":"2023-10-25T16:19:54.456866+0000","last_became_peered":"2023-10-25T16:19:54.456866+0000","last_unstale":"2023-10-25T16:19:54.459095+0000","last_undegraded":"2023-10-25T16:19:54.459095+0000","last_fullsized":"2023-10-25T16:19:54.459095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.441904+0000","last_change":"2023-10-25T16:19:53.420809+0000","last_active":"2023-10-25T16:19:54.441904+0000","last_peered":"2023-10-25T16:19:54.441904+0000","last_clean":"2023-10-25T16:19:54.441904+0000","last_became_active":"2023-10-25T16:19:53.419238+0000","last_became_peered":"2023-10-25T16:19:53.419238+0000","last_unstale":"2023-10-25T16:19:54.441904+0000","last_undegraded":"2023-10-25T16:19:54.441904+0000","last_fullsized":"2023-10-25T16:19:54.441904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:44.328241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":280,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-25T16:19:53.402414+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:53.402414+0000","last_peered":"2023-10-25T16:19:53.402414+0000","last_clean":"2023-10-25T16:19:53.402414+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:53.402414+0000","last_undegraded":"2023-10-25T16:19:53.402414+0000","last_fullsized":"2023-10-25T16:19:53.402414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":124,"acting":124,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":50,"acting":50,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":754,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194557,"statfs":{"total":200000000,"available":199227265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":0.435},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.496},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":0.98499999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.874},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.034}]}]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193962,"statfs":{"total":200000000,"available":198618030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":1.004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.875},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":1.0840000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.048},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.179}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":1.02}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.089},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.181},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":1.2170000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.054}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":0.97799999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.93200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":1.046},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.89500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.5},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":1.091}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.083}]},{"osd":2,"last update":"Wed Oct 25 16:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88800000000000001,"15min":0.84199999999999997},"min":{"1min":0.57299999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.341,"5min":1.397,"15min":1.419},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94199999999999995,"15min":0.88400000000000001},"min":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.226}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.624},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1779999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2649999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.206}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194537,"statfs":{"total":200000000,"available":199206716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":0.97499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.84799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":0.872},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.083}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.05},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":0.95399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":1.127}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193969,"statfs":{"total":200000000,"available":198624805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":1.9610000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":2.5880000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":4.1920000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":3.3919999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":4.431},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":2.2970000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":4.5860000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":5.2880000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":3.5649999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":3.8340000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":0.622},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":0.70699999999999996}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:57.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:57.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- 172.21.15.177:0/4167460326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4444003980 msgr2=0x7f4444003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 --2- 172.21.15.177:0/4167460326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4444003980 0x7f4444003da0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f444800bbe0 tx=0x7f444801ce60 comp rx=0 tx=0).stop 2023-10-25T16:19:57.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445934d640 1 -- 172.21.15.177:0/4167460326 reap_dead start 2023-10-25T16:19:57.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- 172.21.15.177:0/4167460326 shutdown_connections 2023-10-25T16:19:57.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- 172.21.15.177:0/4167460326 >> 172.21.15.177:0/4167460326 conn(0x7f445409a5c0 msgr2=0x7f44540d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:57.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- 172.21.15.177:0/4167460326 shutdown_connections 2023-10-25T16:19:57.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- 172.21.15.177:0/4167460326 wait complete. 2023-10-25T16:19:57.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 Processor -- start 2023-10-25T16:19:57.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- start start 2023-10-25T16:19:57.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4444003980 0x7f44540c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 0x7f4454159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445415a350 0x7f44540ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540c8380 con 0x7f4454158bd0 2023-10-25T16:19:57.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445415a860 con 0x7f4444003980 2023-10-25T16:19:57.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445adb0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540c85d0 con 0x7f445415a350 2023-10-25T16:19:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 0x7f4454159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 0x7f4454159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44222/0 (socket says 172.21.15.177:44222) 2023-10-25T16:19:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 -- 172.21.15.177:0/2256124138 learned_addr learned my addr 172.21.15.177:0/2256124138 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f445934d640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445415a350 0x7f44540ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4458b4c640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4444003980 0x7f44540c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 -- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445415a350 msgr2=0x7f44540ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445415a350 0x7f44540ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 -- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4444003980 msgr2=0x7f44540c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4444003980 0x7f44540c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:57.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 -- 172.21.15.177:0/2256124138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540c88b0 con 0x7f4454158bd0 2023-10-25T16:19:57.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.868+0000 7f4453fff640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 0x7f4454159e10 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f444000f9d0 tx=0x7f444000fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:57.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000bcb0 con 0x7f4454158bd0 2023-10-25T16:19:57.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4440011440 con 0x7f4454158bd0 2023-10-25T16:19:57.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44540c8b90 con 0x7f4454158bd0 2023-10-25T16:19:57.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011810 con 0x7f4454158bd0 2023-10-25T16:19:57.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4454159a80 con 0x7f4454158bd0 2023-10-25T16:19:57.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445404daf0 con 0x7f4454158bd0 2023-10-25T16:19:57.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4440011970 con 0x7f4454158bd0 2023-10-25T16:19:57.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f44517fa640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4438066470 0x7f4438068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:57.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4440084bc0 con 0x7f4454158bd0 2023-10-25T16:19:57.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f4458b4c640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4438066470 0x7f4438068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:57.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.872+0000 7f4458b4c640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4438066470 0x7f4438068930 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f44480b0000 tx=0x7f4448019c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:57.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:57.876+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4440051fa0 con 0x7f4454158bd0 2023-10-25T16:19:58.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.028+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44540ce930 con 0x7f4438066470 2023-10-25T16:19:58.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.048+0000 7f44517fa640 1 -- 172.21.15.177:0/2256124138 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282699 (secure 0 0 0) 0x7f44540ce930 con 0x7f4438066470 2023-10-25T16:19:58.049 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:58.052 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4438066470 msgr2=0x7f4438068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4438066470 0x7f4438068930 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f44480b0000 tx=0x7f4448019c00 comp rx=0 tx=0).stop 2023-10-25T16:19:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 msgr2=0x7f4454159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 0x7f4454159e10 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f444000f9d0 tx=0x7f444000fe90 comp rx=0 tx=0).stop 2023-10-25T16:19:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 shutdown_connections 2023-10-25T16:19:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4438066470 0x7f4438068930 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445415a350 0x7f44540ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454158bd0 0x7f4454159e10 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 --2- 172.21.15.177:0/2256124138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4444003980 0x7f44540c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 >> 172.21.15.177:0/2256124138 conn(0x7f445409a5c0 msgr2=0x7f44540b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 shutdown_connections 2023-10-25T16:19:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.052+0000 7f445adb0640 1 -- 172.21.15.177:0/2256124138 wait complete. 2023-10-25T16:19:58.069 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-10-25T16:19:56.750418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555205,"statfs":{"total":1600000000,"available":1592530609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.353666"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461879+0000","last_change":"2023-10-25T16:19:54.461727+0000","last_active":"2023-10-25T16:19:54.461879+0000","last_peered":"2023-10-25T16:19:54.461879+0000","last_clean":"2023-10-25T16:19:54.461879+0000","last_became_active":"2023-10-25T16:19:54.460940+0000","last_became_peered":"2023-10-25T16:19:54.460940+0000","last_unstale":"2023-10-25T16:19:54.461879+0000","last_undegraded":"2023-10-25T16:19:54.461879+0000","last_fullsized":"2023-10-25T16:19:54.461879+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.469115+0000","last_change":"2023-10-25T16:19:54.469017+0000","last_active":"2023-10-25T16:19:54.469115+0000","last_peered":"2023-10-25T16:19:54.469115+0000","last_clean":"2023-10-25T16:19:54.469115+0000","last_became_active":"2023-10-25T16:19:54.468147+0000","last_became_peered":"2023-10-25T16:19:54.468147+0000","last_unstale":"2023-10-25T16:19:54.469115+0000","last_undegraded":"2023-10-25T16:19:54.469115+0000","last_fullsized":"2023-10-25T16:19:54.469115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:19:00.692763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.454300+0000","last_change":"2023-10-25T16:19:54.453147+0000","last_active":"2023-10-25T16:19:54.454300+0000","last_peered":"2023-10-25T16:19:54.454300+0000","last_clean":"2023-10-25T16:19:54.454300+0000","last_became_active":"2023-10-25T16:19:54.450106+0000","last_became_peered":"2023-10-25T16:19:54.450106+0000","last_unstale":"2023-10-25T16:19:54.454300+0000","last_undegraded":"2023-10-25T16:19:54.454300+0000","last_fullsized":"2023-10-25T16:19:54.454300+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463967+0000","last_change":"2023-10-25T16:19:54.463763+0000","last_active":"2023-10-25T16:19:54.463967+0000","last_peered":"2023-10-25T16:19:54.463967+0000","last_clean":"2023-10-25T16:19:54.463967+0000","last_became_active":"2023-10-25T16:19:54.452773+0000","last_became_peered":"2023-10-25T16:19:54.452773+0000","last_unstale":"2023-10-25T16:19:54.463967+0000","last_undegraded":"2023-10-25T16:19:54.463967+0000","last_fullsized":"2023-10-25T16:19:54.463967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:54:04.307190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:53.394237+0000","last_change":"2023-10-25T16:19:53.394237+0000","last_active":"2023-10-25T16:19:53.394237+0000","last_peered":"2023-10-25T16:19:53.394237+0000","last_clean":"2023-10-25T16:19:53.394237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:53.394237+0000","last_undegraded":"2023-10-25T16:19:53.394237+0000","last_fullsized":"2023-10-25T16:19:53.394237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473461+0000","last_change":"2023-10-25T16:19:54.473119+0000","last_active":"2023-10-25T16:19:54.473461+0000","last_peered":"2023-10-25T16:19:54.473461+0000","last_clean":"2023-10-25T16:19:54.473461+0000","last_became_active":"2023-10-25T16:19:54.470943+0000","last_became_peered":"2023-10-25T16:19:54.470943+0000","last_unstale":"2023-10-25T16:19:54.473461+0000","last_undegraded":"2023-10-25T16:19:54.473461+0000","last_fullsized":"2023-10-25T16:19:54.473461+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:00.125788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459374+0000","last_change":"2023-10-25T16:19:54.458805+0000","last_active":"2023-10-25T16:19:54.459374+0000","last_peered":"2023-10-25T16:19:54.459374+0000","last_clean":"2023-10-25T16:19:54.459374+0000","last_became_active":"2023-10-25T16:19:54.457779+0000","last_became_peered":"2023-10-25T16:19:54.457779+0000","last_unstale":"2023-10-25T16:19:54.459374+0000","last_undegraded":"2023-10-25T16:19:54.459374+0000","last_fullsized":"2023-10-25T16:19:54.459374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:59.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466235+0000","last_change":"2023-10-25T16:19:54.466068+0000","last_active":"2023-10-25T16:19:54.466235+0000","last_peered":"2023-10-25T16:19:54.466235+0000","last_clean":"2023-10-25T16:19:54.466235+0000","last_became_active":"2023-10-25T16:19:54.464713+0000","last_became_peered":"2023-10-25T16:19:54.464713+0000","last_unstale":"2023-10-25T16:19:54.466235+0000","last_undegraded":"2023-10-25T16:19:54.466235+0000","last_fullsized":"2023-10-25T16:19:54.466235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:09.855686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464284+0000","last_change":"2023-10-25T16:19:54.464139+0000","last_active":"2023-10-25T16:19:54.464284+0000","last_peered":"2023-10-25T16:19:54.464284+0000","last_clean":"2023-10-25T16:19:54.464284+0000","last_became_active":"2023-10-25T16:19:54.453425+0000","last_became_peered":"2023-10-25T16:19:54.453425+0000","last_unstale":"2023-10-25T16:19:54.464284+0000","last_undegraded":"2023-10-25T16:19:54.464284+0000","last_fullsized":"2023-10-25T16:19:54.464284+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:59.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.474708+0000","last_change":"2023-10-25T16:19:54.474546+0000","last_active":"2023-10-25T16:19:54.474708+0000","last_peered":"2023-10-25T16:19:54.474708+0000","last_clean":"2023-10-25T16:19:54.474708+0000","last_became_active":"2023-10-25T16:19:54.469302+0000","last_became_peered":"2023-10-25T16:19:54.469302+0000","last_unstale":"2023-10-25T16:19:54.474708+0000","last_undegraded":"2023-10-25T16:19:54.474708+0000","last_fullsized":"2023-10-25T16:19:54.474708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463484+0000","last_change":"2023-10-25T16:19:54.463337+0000","last_active":"2023-10-25T16:19:54.463484+0000","last_peered":"2023-10-25T16:19:54.463484+0000","last_clean":"2023-10-25T16:19:54.463484+0000","last_became_active":"2023-10-25T16:19:54.462731+0000","last_became_peered":"2023-10-25T16:19:54.462731+0000","last_unstale":"2023-10-25T16:19:54.463484+0000","last_undegraded":"2023-10-25T16:19:54.463484+0000","last_fullsized":"2023-10-25T16:19:54.463484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:36:29.886246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463916+0000","last_change":"2023-10-25T16:19:54.463581+0000","last_active":"2023-10-25T16:19:54.463916+0000","last_peered":"2023-10-25T16:19:54.463916+0000","last_clean":"2023-10-25T16:19:54.463916+0000","last_became_active":"2023-10-25T16:19:54.462904+0000","last_became_peered":"2023-10-25T16:19:54.462904+0000","last_unstale":"2023-10-25T16:19:54.463916+0000","last_undegraded":"2023-10-25T16:19:54.463916+0000","last_fullsized":"2023-10-25T16:19:54.463916+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:11:08.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465865+0000","last_change":"2023-10-25T16:19:54.465565+0000","last_active":"2023-10-25T16:19:54.465865+0000","last_peered":"2023-10-25T16:19:54.465865+0000","last_clean":"2023-10-25T16:19:54.465865+0000","last_became_active":"2023-10-25T16:19:54.462990+0000","last_became_peered":"2023-10-25T16:19:54.462990+0000","last_unstale":"2023-10-25T16:19:54.465865+0000","last_undegraded":"2023-10-25T16:19:54.465865+0000","last_fullsized":"2023-10-25T16:19:54.465865+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:24.299112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466831+0000","last_change":"2023-10-25T16:19:54.466678+0000","last_active":"2023-10-25T16:19:54.466831+0000","last_peered":"2023-10-25T16:19:54.466831+0000","last_clean":"2023-10-25T16:19:54.466831+0000","last_became_active":"2023-10-25T16:19:54.461209+0000","last_became_peered":"2023-10-25T16:19:54.461209+0000","last_unstale":"2023-10-25T16:19:54.466831+0000","last_undegraded":"2023-10-25T16:19:54.466831+0000","last_fullsized":"2023-10-25T16:19:54.466831+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:51.803048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472670+0000","last_change":"2023-10-25T16:19:54.469012+0000","last_active":"2023-10-25T16:19:54.472670+0000","last_peered":"2023-10-25T16:19:54.472670+0000","last_clean":"2023-10-25T16:19:54.472670+0000","last_became_active":"2023-10-25T16:19:54.468016+0000","last_became_peered":"2023-10-25T16:19:54.468016+0000","last_unstale":"2023-10-25T16:19:54.472670+0000","last_undegraded":"2023-10-25T16:19:54.472670+0000","last_fullsized":"2023-10-25T16:19:54.472670+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:43.001368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450772+0000","last_change":"2023-10-25T16:19:54.448406+0000","last_active":"2023-10-25T16:19:54.450772+0000","last_peered":"2023-10-25T16:19:54.450772+0000","last_clean":"2023-10-25T16:19:54.450772+0000","last_became_active":"2023-10-25T16:19:54.446860+0000","last_became_peered":"2023-10-25T16:19:54.446860+0000","last_unstale":"2023-10-25T16:19:54.450772+0000","last_undegraded":"2023-10-25T16:19:54.450772+0000","last_fullsized":"2023-10-25T16:19:54.450772+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:28.086832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468918+0000","last_change":"2023-10-25T16:19:54.468783+0000","last_active":"2023-10-25T16:19:54.468918+0000","last_peered":"2023-10-25T16:19:54.468918+0000","last_clean":"2023-10-25T16:19:54.468918+0000","last_became_active":"2023-10-25T16:19:54.466677+0000","last_became_peered":"2023-10-25T16:19:54.466677+0000","last_unstale":"2023-10-25T16:19:54.468918+0000","last_undegraded":"2023-10-25T16:19:54.468918+0000","last_fullsized":"2023-10-25T16:19:54.468918+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:09.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461773+0000","last_change":"2023-10-25T16:19:54.461443+0000","last_active":"2023-10-25T16:19:54.461773+0000","last_peered":"2023-10-25T16:19:54.461773+0000","last_clean":"2023-10-25T16:19:54.461773+0000","last_became_active":"2023-10-25T16:19:54.460838+0000","last_became_peered":"2023-10-25T16:19:54.460838+0000","last_unstale":"2023-10-25T16:19:54.461773+0000","last_undegraded":"2023-10-25T16:19:54.461773+0000","last_fullsized":"2023-10-25T16:19:54.461773+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467213+0000","last_change":"2023-10-25T16:19:54.467062+0000","last_active":"2023-10-25T16:19:54.467213+0000","last_peered":"2023-10-25T16:19:54.467213+0000","last_clean":"2023-10-25T16:19:54.467213+0000","last_became_active":"2023-10-25T16:19:54.464502+0000","last_became_peered":"2023-10-25T16:19:54.464502+0000","last_unstale":"2023-10-25T16:19:54.467213+0000","last_undegraded":"2023-10-25T16:19:54.467213+0000","last_fullsized":"2023-10-25T16:19:54.467213+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456701+0000","last_change":"2023-10-25T16:19:54.451503+0000","last_active":"2023-10-25T16:19:54.456701+0000","last_peered":"2023-10-25T16:19:54.456701+0000","last_clean":"2023-10-25T16:19:54.456701+0000","last_became_active":"2023-10-25T16:19:54.450896+0000","last_became_peered":"2023-10-25T16:19:54.450896+0000","last_unstale":"2023-10-25T16:19:54.456701+0000","last_undegraded":"2023-10-25T16:19:54.456701+0000","last_fullsized":"2023-10-25T16:19:54.456701+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:43:37.602014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456649+0000","last_change":"2023-10-25T16:19:54.450150+0000","last_active":"2023-10-25T16:19:54.456649+0000","last_peered":"2023-10-25T16:19:54.456649+0000","last_clean":"2023-10-25T16:19:54.456649+0000","last_became_active":"2023-10-25T16:19:54.449509+0000","last_became_peered":"2023-10-25T16:19:54.449509+0000","last_unstale":"2023-10-25T16:19:54.456649+0000","last_undegraded":"2023-10-25T16:19:54.456649+0000","last_fullsized":"2023-10-25T16:19:54.456649+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:16:43.655185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459145+0000","last_change":"2023-10-25T16:19:54.458648+0000","last_active":"2023-10-25T16:19:54.459145+0000","last_peered":"2023-10-25T16:19:54.459145+0000","last_clean":"2023-10-25T16:19:54.459145+0000","last_became_active":"2023-10-25T16:19:54.457941+0000","last_became_peered":"2023-10-25T16:19:54.457941+0000","last_unstale":"2023-10-25T16:19:54.459145+0000","last_undegraded":"2023-10-25T16:19:54.459145+0000","last_fullsized":"2023-10-25T16:19:54.459145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:29:59.455072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457978+0000","last_change":"2023-10-25T16:19:54.457827+0000","last_active":"2023-10-25T16:19:54.457978+0000","last_peered":"2023-10-25T16:19:54.457978+0000","last_clean":"2023-10-25T16:19:54.457978+0000","last_became_active":"2023-10-25T16:19:54.456641+0000","last_became_peered":"2023-10-25T16:19:54.456641+0000","last_unstale":"2023-10-25T16:19:54.457978+0000","last_undegraded":"2023-10-25T16:19:54.457978+0000","last_fullsized":"2023-10-25T16:19:54.457978+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:52.812391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468333+0000","last_change":"2023-10-25T16:19:54.468145+0000","last_active":"2023-10-25T16:19:54.468333+0000","last_peered":"2023-10-25T16:19:54.468333+0000","last_clean":"2023-10-25T16:19:54.468333+0000","last_became_active":"2023-10-25T16:19:54.464664+0000","last_became_peered":"2023-10-25T16:19:54.464664+0000","last_unstale":"2023-10-25T16:19:54.468333+0000","last_undegraded":"2023-10-25T16:19:54.468333+0000","last_fullsized":"2023-10-25T16:19:54.468333+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:23.996474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456802+0000","last_change":"2023-10-25T16:19:54.454986+0000","last_active":"2023-10-25T16:19:54.456802+0000","last_peered":"2023-10-25T16:19:54.456802+0000","last_clean":"2023-10-25T16:19:54.456802+0000","last_became_active":"2023-10-25T16:19:54.454308+0000","last_became_peered":"2023-10-25T16:19:54.454308+0000","last_unstale":"2023-10-25T16:19:54.456802+0000","last_undegraded":"2023-10-25T16:19:54.456802+0000","last_fullsized":"2023-10-25T16:19:54.456802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:45:22.751967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450823+0000","last_change":"2023-10-25T16:19:54.448801+0000","last_active":"2023-10-25T16:19:54.450823+0000","last_peered":"2023-10-25T16:19:54.450823+0000","last_clean":"2023-10-25T16:19:54.450823+0000","last_became_active":"2023-10-25T16:19:54.447799+0000","last_became_peered":"2023-10-25T16:19:54.447799+0000","last_unstale":"2023-10-25T16:19:54.450823+0000","last_undegraded":"2023-10-25T16:19:54.450823+0000","last_fullsized":"2023-10-25T16:19:54.450823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:56.732275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466858+0000","last_change":"2023-10-25T16:19:54.466672+0000","last_active":"2023-10-25T16:19:54.466858+0000","last_peered":"2023-10-25T16:19:54.466858+0000","last_clean":"2023-10-25T16:19:54.466858+0000","last_became_active":"2023-10-25T16:19:54.465394+0000","last_became_peered":"2023-10-25T16:19:54.465394+0000","last_unstale":"2023-10-25T16:19:54.466858+0000","last_undegraded":"2023-10-25T16:19:54.466858+0000","last_fullsized":"2023-10-25T16:19:54.466858+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:55.228229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455819+0000","last_change":"2023-10-25T16:19:54.454070+0000","last_active":"2023-10-25T16:19:54.455819+0000","last_peered":"2023-10-25T16:19:54.455819+0000","last_clean":"2023-10-25T16:19:54.455819+0000","last_became_active":"2023-10-25T16:19:54.453409+0000","last_became_peered":"2023-10-25T16:19:54.453409+0000","last_unstale":"2023-10-25T16:19:54.455819+0000","last_undegraded":"2023-10-25T16:19:54.455819+0000","last_fullsized":"2023-10-25T16:19:54.455819+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456849+0000","last_change":"2023-10-25T16:19:54.455923+0000","last_active":"2023-10-25T16:19:54.456849+0000","last_peered":"2023-10-25T16:19:54.456849+0000","last_clean":"2023-10-25T16:19:54.456849+0000","last_became_active":"2023-10-25T16:19:54.455216+0000","last_became_peered":"2023-10-25T16:19:54.455216+0000","last_unstale":"2023-10-25T16:19:54.456849+0000","last_undegraded":"2023-10-25T16:19:54.456849+0000","last_fullsized":"2023-10-25T16:19:54.456849+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:36.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.447574+0000","last_change":"2023-10-25T16:19:54.447434+0000","last_active":"2023-10-25T16:19:54.447574+0000","last_peered":"2023-10-25T16:19:54.447574+0000","last_clean":"2023-10-25T16:19:54.447574+0000","last_became_active":"2023-10-25T16:19:54.446808+0000","last_became_peered":"2023-10-25T16:19:54.446808+0000","last_unstale":"2023-10-25T16:19:54.447574+0000","last_undegraded":"2023-10-25T16:19:54.447574+0000","last_fullsized":"2023-10-25T16:19:54.447574+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:25.646957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458359+0000","last_change":"2023-10-25T16:19:54.458170+0000","last_active":"2023-10-25T16:19:54.458359+0000","last_peered":"2023-10-25T16:19:54.458359+0000","last_clean":"2023-10-25T16:19:54.458359+0000","last_became_active":"2023-10-25T16:19:54.449443+0000","last_became_peered":"2023-10-25T16:19:54.449443+0000","last_unstale":"2023-10-25T16:19:54.458359+0000","last_undegraded":"2023-10-25T16:19:54.458359+0000","last_fullsized":"2023-10-25T16:19:54.458359+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:44.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466299+0000","last_change":"2023-10-25T16:19:54.466137+0000","last_active":"2023-10-25T16:19:54.466299+0000","last_peered":"2023-10-25T16:19:54.466299+0000","last_clean":"2023-10-25T16:19:54.466299+0000","last_became_active":"2023-10-25T16:19:54.464568+0000","last_became_peered":"2023-10-25T16:19:54.464568+0000","last_unstale":"2023-10-25T16:19:54.466299+0000","last_undegraded":"2023-10-25T16:19:54.466299+0000","last_fullsized":"2023-10-25T16:19:54.466299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:25.698386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461169+0000","last_change":"2023-10-25T16:19:54.460492+0000","last_active":"2023-10-25T16:19:54.461169+0000","last_peered":"2023-10-25T16:19:54.461169+0000","last_clean":"2023-10-25T16:19:54.461169+0000","last_became_active":"2023-10-25T16:19:54.459828+0000","last_became_peered":"2023-10-25T16:19:54.459828+0000","last_unstale":"2023-10-25T16:19:54.461169+0000","last_undegraded":"2023-10-25T16:19:54.461169+0000","last_fullsized":"2023-10-25T16:19:54.461169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:56:23.557613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705568+0000","last_change":"2023-10-25T16:19:53.408435+0000","last_active":"2023-10-25T16:19:54.705568+0000","last_peered":"2023-10-25T16:19:54.705568+0000","last_clean":"2023-10-25T16:19:54.705568+0000","last_became_active":"2023-10-25T16:19:53.407353+0000","last_became_peered":"2023-10-25T16:19:53.407353+0000","last_unstale":"2023-10-25T16:19:54.705568+0000","last_undegraded":"2023-10-25T16:19:54.705568+0000","last_fullsized":"2023-10-25T16:19:54.705568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:48:13.615155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457968+0000","last_change":"2023-10-25T16:19:54.457803+0000","last_active":"2023-10-25T16:19:54.457968+0000","last_peered":"2023-10-25T16:19:54.457968+0000","last_clean":"2023-10-25T16:19:54.457968+0000","last_became_active":"2023-10-25T16:19:54.457190+0000","last_became_peered":"2023-10-25T16:19:54.457190+0000","last_unstale":"2023-10-25T16:19:54.457968+0000","last_undegraded":"2023-10-25T16:19:54.457968+0000","last_fullsized":"2023-10-25T16:19:54.457968+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703698+0000","last_change":"2023-10-25T16:19:53.407966+0000","last_active":"2023-10-25T16:19:54.703698+0000","last_peered":"2023-10-25T16:19:54.703698+0000","last_clean":"2023-10-25T16:19:54.703698+0000","last_became_active":"2023-10-25T16:19:53.407333+0000","last_became_peered":"2023-10-25T16:19:53.407333+0000","last_unstale":"2023-10-25T16:19:54.703698+0000","last_undegraded":"2023-10-25T16:19:54.703698+0000","last_fullsized":"2023-10-25T16:19:54.703698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:01.501634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473363+0000","last_change":"2023-10-25T16:19:54.471618+0000","last_active":"2023-10-25T16:19:54.473363+0000","last_peered":"2023-10-25T16:19:54.473363+0000","last_clean":"2023-10-25T16:19:54.473363+0000","last_became_active":"2023-10-25T16:19:54.470001+0000","last_became_peered":"2023-10-25T16:19:54.470001+0000","last_unstale":"2023-10-25T16:19:54.473363+0000","last_undegraded":"2023-10-25T16:19:54.473363+0000","last_fullsized":"2023-10-25T16:19:54.473363+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:32.794532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464451+0000","last_change":"2023-10-25T16:19:54.464303+0000","last_active":"2023-10-25T16:19:54.464451+0000","last_peered":"2023-10-25T16:19:54.464451+0000","last_clean":"2023-10-25T16:19:54.464451+0000","last_became_active":"2023-10-25T16:19:54.463645+0000","last_became_peered":"2023-10-25T16:19:54.463645+0000","last_unstale":"2023-10-25T16:19:54.464451+0000","last_undegraded":"2023-10-25T16:19:54.464451+0000","last_fullsized":"2023-10-25T16:19:54.464451+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:52.561033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450869+0000","last_change":"2023-10-25T16:19:54.450631+0000","last_active":"2023-10-25T16:19:54.450869+0000","last_peered":"2023-10-25T16:19:54.450869+0000","last_clean":"2023-10-25T16:19:54.450869+0000","last_became_active":"2023-10-25T16:19:54.449923+0000","last_became_peered":"2023-10-25T16:19:54.449923+0000","last_unstale":"2023-10-25T16:19:54.450869+0000","last_undegraded":"2023-10-25T16:19:54.450869+0000","last_fullsized":"2023-10-25T16:19:54.450869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:59.058809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705246+0000","last_change":"2023-10-25T16:19:53.423223+0000","last_active":"2023-10-25T16:19:54.705246+0000","last_peered":"2023-10-25T16:19:54.705246+0000","last_clean":"2023-10-25T16:19:54.705246+0000","last_became_active":"2023-10-25T16:19:53.421712+0000","last_became_peered":"2023-10-25T16:19:53.421712+0000","last_unstale":"2023-10-25T16:19:54.705246+0000","last_undegraded":"2023-10-25T16:19:54.705246+0000","last_fullsized":"2023-10-25T16:19:54.705246+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:08.239214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468631+0000","last_change":"2023-10-25T16:19:54.468481+0000","last_active":"2023-10-25T16:19:54.468631+0000","last_peered":"2023-10-25T16:19:54.468631+0000","last_clean":"2023-10-25T16:19:54.468631+0000","last_became_active":"2023-10-25T16:19:54.465812+0000","last_became_peered":"2023-10-25T16:19:54.465812+0000","last_unstale":"2023-10-25T16:19:54.468631+0000","last_undegraded":"2023-10-25T16:19:54.468631+0000","last_fullsized":"2023-10-25T16:19:54.468631+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:10.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705601+0000","last_change":"2023-10-25T16:19:53.431077+0000","last_active":"2023-10-25T16:19:54.705601+0000","last_peered":"2023-10-25T16:19:54.705601+0000","last_clean":"2023-10-25T16:19:54.705601+0000","last_became_active":"2023-10-25T16:19:53.430825+0000","last_became_peered":"2023-10-25T16:19:53.430825+0000","last_unstale":"2023-10-25T16:19:54.705601+0000","last_undegraded":"2023-10-25T16:19:54.705601+0000","last_fullsized":"2023-10-25T16:19:54.705601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:17.573720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465347+0000","last_change":"2023-10-25T16:19:54.464983+0000","last_active":"2023-10-25T16:19:54.465347+0000","last_peered":"2023-10-25T16:19:54.465347+0000","last_clean":"2023-10-25T16:19:54.465347+0000","last_became_active":"2023-10-25T16:19:54.461758+0000","last_became_peered":"2023-10-25T16:19:54.461758+0000","last_unstale":"2023-10-25T16:19:54.465347+0000","last_undegraded":"2023-10-25T16:19:54.465347+0000","last_fullsized":"2023-10-25T16:19:54.465347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442024+0000","last_change":"2023-10-25T16:19:53.419217+0000","last_active":"2023-10-25T16:19:54.442024+0000","last_peered":"2023-10-25T16:19:54.442024+0000","last_clean":"2023-10-25T16:19:54.442024+0000","last_became_active":"2023-10-25T16:19:53.418429+0000","last_became_peered":"2023-10-25T16:19:53.418429+0000","last_unstale":"2023-10-25T16:19:54.442024+0000","last_undegraded":"2023-10-25T16:19:54.442024+0000","last_fullsized":"2023-10-25T16:19:54.442024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:53:13.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456035+0000","last_change":"2023-10-25T16:19:54.455866+0000","last_active":"2023-10-25T16:19:54.456035+0000","last_peered":"2023-10-25T16:19:54.456035+0000","last_clean":"2023-10-25T16:19:54.456035+0000","last_became_active":"2023-10-25T16:19:54.455162+0000","last_became_peered":"2023-10-25T16:19:54.455162+0000","last_unstale":"2023-10-25T16:19:54.456035+0000","last_undegraded":"2023-10-25T16:19:54.456035+0000","last_fullsized":"2023-10-25T16:19:54.456035+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:51.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446981+0000","last_change":"2023-10-25T16:19:53.419508+0000","last_active":"2023-10-25T16:19:54.446981+0000","last_peered":"2023-10-25T16:19:54.446981+0000","last_clean":"2023-10-25T16:19:54.446981+0000","last_became_active":"2023-10-25T16:19:53.418740+0000","last_became_peered":"2023-10-25T16:19:53.418740+0000","last_unstale":"2023-10-25T16:19:54.446981+0000","last_undegraded":"2023-10-25T16:19:54.446981+0000","last_fullsized":"2023-10-25T16:19:54.446981+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:45.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463926+0000","last_change":"2023-10-25T16:19:54.463626+0000","last_active":"2023-10-25T16:19:54.463926+0000","last_peered":"2023-10-25T16:19:54.463926+0000","last_clean":"2023-10-25T16:19:54.463926+0000","last_became_active":"2023-10-25T16:19:54.462999+0000","last_became_peered":"2023-10-25T16:19:54.462999+0000","last_unstale":"2023-10-25T16:19:54.463926+0000","last_undegraded":"2023-10-25T16:19:54.463926+0000","last_fullsized":"2023-10-25T16:19:54.463926+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:35.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465155+0000","last_change":"2023-10-25T16:19:54.465003+0000","last_active":"2023-10-25T16:19:54.465155+0000","last_peered":"2023-10-25T16:19:54.465155+0000","last_clean":"2023-10-25T16:19:54.465155+0000","last_became_active":"2023-10-25T16:19:54.463043+0000","last_became_peered":"2023-10-25T16:19:54.463043+0000","last_unstale":"2023-10-25T16:19:54.465155+0000","last_undegraded":"2023-10-25T16:19:54.465155+0000","last_fullsized":"2023-10-25T16:19:54.465155+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440427+0000","last_change":"2023-10-25T16:19:53.417480+0000","last_active":"2023-10-25T16:19:54.440427+0000","last_peered":"2023-10-25T16:19:54.440427+0000","last_clean":"2023-10-25T16:19:54.440427+0000","last_became_active":"2023-10-25T16:19:53.417160+0000","last_became_peered":"2023-10-25T16:19:53.417160+0000","last_unstale":"2023-10-25T16:19:54.440427+0000","last_undegraded":"2023-10-25T16:19:54.440427+0000","last_fullsized":"2023-10-25T16:19:54.440427+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:44.282469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449332+0000","last_change":"2023-10-25T16:19:54.448364+0000","last_active":"2023-10-25T16:19:54.449332+0000","last_peered":"2023-10-25T16:19:54.449332+0000","last_clean":"2023-10-25T16:19:54.449332+0000","last_became_active":"2023-10-25T16:19:54.447523+0000","last_became_peered":"2023-10-25T16:19:54.447523+0000","last_unstale":"2023-10-25T16:19:54.449332+0000","last_undegraded":"2023-10-25T16:19:54.449332+0000","last_fullsized":"2023-10-25T16:19:54.449332+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:07.214049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.709914+0000","last_change":"2023-10-25T16:19:53.427731+0000","last_active":"2023-10-25T16:19:54.709914+0000","last_peered":"2023-10-25T16:19:54.709914+0000","last_clean":"2023-10-25T16:19:54.709914+0000","last_became_active":"2023-10-25T16:19:53.424487+0000","last_became_peered":"2023-10-25T16:19:53.424487+0000","last_unstale":"2023-10-25T16:19:54.709914+0000","last_undegraded":"2023-10-25T16:19:54.709914+0000","last_fullsized":"2023-10-25T16:19:54.709914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:28.745280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445611+0000","last_change":"2023-10-25T16:19:54.445458+0000","last_active":"2023-10-25T16:19:54.445611+0000","last_peered":"2023-10-25T16:19:54.445611+0000","last_clean":"2023-10-25T16:19:54.445611+0000","last_became_active":"2023-10-25T16:19:54.444854+0000","last_became_peered":"2023-10-25T16:19:54.444854+0000","last_unstale":"2023-10-25T16:19:54.445611+0000","last_undegraded":"2023-10-25T16:19:54.445611+0000","last_fullsized":"2023-10-25T16:19:54.445611+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:54.145259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.714771+0000","last_change":"2023-10-25T16:19:53.422257+0000","last_active":"2023-10-25T16:19:54.714771+0000","last_peered":"2023-10-25T16:19:54.714771+0000","last_clean":"2023-10-25T16:19:54.714771+0000","last_became_active":"2023-10-25T16:19:53.419641+0000","last_became_peered":"2023-10-25T16:19:53.419641+0000","last_unstale":"2023-10-25T16:19:54.714771+0000","last_undegraded":"2023-10-25T16:19:54.714771+0000","last_fullsized":"2023-10-25T16:19:54.714771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:12:20.637482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449144+0000","last_change":"2023-10-25T16:19:54.447812+0000","last_active":"2023-10-25T16:19:54.449144+0000","last_peered":"2023-10-25T16:19:54.449144+0000","last_clean":"2023-10-25T16:19:54.449144+0000","last_became_active":"2023-10-25T16:19:54.447047+0000","last_became_peered":"2023-10-25T16:19:54.447047+0000","last_unstale":"2023-10-25T16:19:54.449144+0000","last_undegraded":"2023-10-25T16:19:54.449144+0000","last_fullsized":"2023-10-25T16:19:54.449144+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:14.600765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.706452+0000","last_change":"2023-10-25T16:19:53.427358+0000","last_active":"2023-10-25T16:19:54.706452+0000","last_peered":"2023-10-25T16:19:54.706452+0000","last_clean":"2023-10-25T16:19:54.706452+0000","last_became_active":"2023-10-25T16:19:53.427148+0000","last_became_peered":"2023-10-25T16:19:53.427148+0000","last_unstale":"2023-10-25T16:19:54.706452+0000","last_undegraded":"2023-10-25T16:19:54.706452+0000","last_fullsized":"2023-10-25T16:19:54.706452+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:10.163492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.465106+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.461605+0000","last_became_peered":"2023-10-25T16:19:54.461605+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.453850+0000","last_change":"2023-10-25T16:19:53.428746+0000","last_active":"2023-10-25T16:19:54.453850+0000","last_peered":"2023-10-25T16:19:54.453850+0000","last_clean":"2023-10-25T16:19:54.453850+0000","last_became_active":"2023-10-25T16:19:53.427276+0000","last_became_peered":"2023-10-25T16:19:53.427276+0000","last_unstale":"2023-10-25T16:19:54.453850+0000","last_undegraded":"2023-10-25T16:19:54.453850+0000","last_fullsized":"2023-10-25T16:19:54.453850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:55.728285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466705+0000","last_change":"2023-10-25T16:19:54.466527+0000","last_active":"2023-10-25T16:19:54.466705+0000","last_peered":"2023-10-25T16:19:54.466705+0000","last_clean":"2023-10-25T16:19:54.466705+0000","last_became_active":"2023-10-25T16:19:54.465742+0000","last_became_peered":"2023-10-25T16:19:54.465742+0000","last_unstale":"2023-10-25T16:19:54.466705+0000","last_undegraded":"2023-10-25T16:19:54.466705+0000","last_fullsized":"2023-10-25T16:19:54.466705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:45:47.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:53.394237+0000","last_change":"2023-10-25T16:19:53.394237+0000","last_active":"2023-10-25T16:19:53.394237+0000","last_peered":"2023-10-25T16:19:53.394237+0000","last_clean":"2023-10-25T16:19:53.394237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:53.394237+0000","last_undegraded":"2023-10-25T16:19:53.394237+0000","last_fullsized":"2023-10-25T16:19:53.394237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.712152+0000","last_change":"2023-10-25T16:19:53.422733+0000","last_active":"2023-10-25T16:19:54.712152+0000","last_peered":"2023-10-25T16:19:54.712152+0000","last_clean":"2023-10-25T16:19:54.712152+0000","last_became_active":"2023-10-25T16:19:53.420621+0000","last_became_peered":"2023-10-25T16:19:53.420621+0000","last_unstale":"2023-10-25T16:19:54.712152+0000","last_undegraded":"2023-10-25T16:19:54.712152+0000","last_fullsized":"2023-10-25T16:19:54.712152+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:01.712031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473418+0000","last_change":"2023-10-25T16:19:54.472785+0000","last_active":"2023-10-25T16:19:54.473418+0000","last_peered":"2023-10-25T16:19:54.473418+0000","last_clean":"2023-10-25T16:19:54.473418+0000","last_became_active":"2023-10-25T16:19:54.472181+0000","last_became_peered":"2023-10-25T16:19:54.472181+0000","last_unstale":"2023-10-25T16:19:54.473418+0000","last_undegraded":"2023-10-25T16:19:54.473418+0000","last_fullsized":"2023-10-25T16:19:54.473418+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:12:28.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457983+0000","last_change":"2023-10-25T16:19:54.456776+0000","last_active":"2023-10-25T16:19:54.457983+0000","last_peered":"2023-10-25T16:19:54.457983+0000","last_clean":"2023-10-25T16:19:54.457983+0000","last_became_active":"2023-10-25T16:19:54.456154+0000","last_became_peered":"2023-10-25T16:19:54.456154+0000","last_unstale":"2023-10-25T16:19:54.457983+0000","last_undegraded":"2023-10-25T16:19:54.457983+0000","last_fullsized":"2023-10-25T16:19:54.457983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703611+0000","last_change":"2023-10-25T16:19:53.428321+0000","last_active":"2023-10-25T16:19:54.703611+0000","last_peered":"2023-10-25T16:19:54.703611+0000","last_clean":"2023-10-25T16:19:54.703611+0000","last_became_active":"2023-10-25T16:19:53.426214+0000","last_became_peered":"2023-10-25T16:19:53.426214+0000","last_unstale":"2023-10-25T16:19:54.703611+0000","last_undegraded":"2023-10-25T16:19:54.703611+0000","last_fullsized":"2023-10-25T16:19:54.703611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:58.054818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440049+0000","last_change":"2023-10-25T16:19:54.439642+0000","last_active":"2023-10-25T16:19:54.440049+0000","last_peered":"2023-10-25T16:19:54.440049+0000","last_clean":"2023-10-25T16:19:54.440049+0000","last_became_active":"2023-10-25T16:19:54.439034+0000","last_became_peered":"2023-10-25T16:19:54.439034+0000","last_unstale":"2023-10-25T16:19:54.440049+0000","last_undegraded":"2023-10-25T16:19:54.440049+0000","last_fullsized":"2023-10-25T16:19:54.440049+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.444323+0000","last_change":"2023-10-25T16:19:53.420424+0000","last_active":"2023-10-25T16:19:54.444323+0000","last_peered":"2023-10-25T16:19:54.444323+0000","last_clean":"2023-10-25T16:19:54.444323+0000","last_became_active":"2023-10-25T16:19:53.418421+0000","last_became_peered":"2023-10-25T16:19:53.418421+0000","last_unstale":"2023-10-25T16:19:54.444323+0000","last_undegraded":"2023-10-25T16:19:54.444323+0000","last_fullsized":"2023-10-25T16:19:54.444323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:09.427824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452795+0000","last_change":"2023-10-25T16:19:54.452630+0000","last_active":"2023-10-25T16:19:54.452795+0000","last_peered":"2023-10-25T16:19:54.452795+0000","last_clean":"2023-10-25T16:19:54.452795+0000","last_became_active":"2023-10-25T16:19:54.448173+0000","last_became_peered":"2023-10-25T16:19:54.448173+0000","last_unstale":"2023-10-25T16:19:54.452795+0000","last_undegraded":"2023-10-25T16:19:54.452795+0000","last_fullsized":"2023-10-25T16:19:54.452795+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:52.905840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.708198+0000","last_change":"2023-10-25T16:19:53.426370+0000","last_active":"2023-10-25T16:19:54.708198+0000","last_peered":"2023-10-25T16:19:54.708198+0000","last_clean":"2023-10-25T16:19:54.708198+0000","last_became_active":"2023-10-25T16:19:53.425764+0000","last_became_peered":"2023-10-25T16:19:53.425764+0000","last_unstale":"2023-10-25T16:19:54.708198+0000","last_undegraded":"2023-10-25T16:19:54.708198+0000","last_fullsized":"2023-10-25T16:19:54.708198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:45.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472116+0000","last_change":"2023-10-25T16:19:54.470877+0000","last_active":"2023-10-25T16:19:54.472116+0000","last_peered":"2023-10-25T16:19:54.472116+0000","last_clean":"2023-10-25T16:19:54.472116+0000","last_became_active":"2023-10-25T16:19:54.466660+0000","last_became_peered":"2023-10-25T16:19:54.466660+0000","last_unstale":"2023-10-25T16:19:54.472116+0000","last_undegraded":"2023-10-25T16:19:54.472116+0000","last_fullsized":"2023-10-25T16:19:54.472116+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:10.091615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458790+0000","last_change":"2023-10-25T16:19:54.458538+0000","last_active":"2023-10-25T16:19:54.458790+0000","last_peered":"2023-10-25T16:19:54.458790+0000","last_clean":"2023-10-25T16:19:54.458790+0000","last_became_active":"2023-10-25T16:19:54.457929+0000","last_became_peered":"2023-10-25T16:19:54.457929+0000","last_unstale":"2023-10-25T16:19:54.458790+0000","last_undegraded":"2023-10-25T16:19:54.458790+0000","last_fullsized":"2023-10-25T16:19:54.458790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:18.577710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458365+0000","last_change":"2023-10-25T16:19:53.431122+0000","last_active":"2023-10-25T16:19:54.458365+0000","last_peered":"2023-10-25T16:19:54.458365+0000","last_clean":"2023-10-25T16:19:54.458365+0000","last_became_active":"2023-10-25T16:19:53.430508+0000","last_became_peered":"2023-10-25T16:19:53.430508+0000","last_unstale":"2023-10-25T16:19:54.458365+0000","last_undegraded":"2023-10-25T16:19:54.458365+0000","last_fullsized":"2023-10-25T16:19:54.458365+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:53.141269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455869+0000","last_change":"2023-10-25T16:19:54.454215+0000","last_active":"2023-10-25T16:19:54.455869+0000","last_peered":"2023-10-25T16:19:54.455869+0000","last_clean":"2023-10-25T16:19:54.455869+0000","last_became_active":"2023-10-25T16:19:54.452463+0000","last_became_peered":"2023-10-25T16:19:54.452463+0000","last_unstale":"2023-10-25T16:19:54.455869+0000","last_undegraded":"2023-10-25T16:19:54.455869+0000","last_fullsized":"2023-10-25T16:19:54.455869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442423+0000","last_change":"2023-10-25T16:19:53.431258+0000","last_active":"2023-10-25T16:19:54.442423+0000","last_peered":"2023-10-25T16:19:54.442423+0000","last_clean":"2023-10-25T16:19:54.442423+0000","last_became_active":"2023-10-25T16:19:53.430185+0000","last_became_peered":"2023-10-25T16:19:53.430185+0000","last_unstale":"2023-10-25T16:19:54.442423+0000","last_undegraded":"2023-10-25T16:19:54.442423+0000","last_fullsized":"2023-10-25T16:19:54.442423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:54:14.517117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.475198+0000","last_change":"2023-10-25T16:19:54.475021+0000","last_active":"2023-10-25T16:19:54.475198+0000","last_peered":"2023-10-25T16:19:54.475198+0000","last_clean":"2023-10-25T16:19:54.475198+0000","last_became_active":"2023-10-25T16:19:54.474608+0000","last_became_peered":"2023-10-25T16:19:54.474608+0000","last_unstale":"2023-10-25T16:19:54.475198+0000","last_undegraded":"2023-10-25T16:19:54.475198+0000","last_fullsized":"2023-10-25T16:19:54.475198+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:58:22.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.710156+0000","last_change":"2023-10-25T16:19:53.414277+0000","last_active":"2023-10-25T16:19:54.710156+0000","last_peered":"2023-10-25T16:19:54.710156+0000","last_clean":"2023-10-25T16:19:54.710156+0000","last_became_active":"2023-10-25T16:19:53.413965+0000","last_became_peered":"2023-10-25T16:19:53.413965+0000","last_unstale":"2023-10-25T16:19:54.710156+0000","last_undegraded":"2023-10-25T16:19:54.710156+0000","last_fullsized":"2023-10-25T16:19:54.710156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:50.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467776+0000","last_change":"2023-10-25T16:19:54.467618+0000","last_active":"2023-10-25T16:19:54.467776+0000","last_peered":"2023-10-25T16:19:54.467776+0000","last_clean":"2023-10-25T16:19:54.467776+0000","last_became_active":"2023-10-25T16:19:54.466936+0000","last_became_peered":"2023-10-25T16:19:54.466936+0000","last_unstale":"2023-10-25T16:19:54.467776+0000","last_undegraded":"2023-10-25T16:19:54.467776+0000","last_fullsized":"2023-10-25T16:19:54.467776+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:46.123344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452904+0000","last_change":"2023-10-25T16:19:53.416392+0000","last_active":"2023-10-25T16:19:54.452904+0000","last_peered":"2023-10-25T16:19:54.452904+0000","last_clean":"2023-10-25T16:19:54.452904+0000","last_became_active":"2023-10-25T16:19:53.415622+0000","last_became_peered":"2023-10-25T16:19:53.415622+0000","last_unstale":"2023-10-25T16:19:54.452904+0000","last_undegraded":"2023-10-25T16:19:54.452904+0000","last_fullsized":"2023-10-25T16:19:54.452904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:27.082841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464607+0000","last_change":"2023-10-25T16:19:54.464430+0000","last_active":"2023-10-25T16:19:54.464607+0000","last_peered":"2023-10-25T16:19:54.464607+0000","last_clean":"2023-10-25T16:19:54.464607+0000","last_became_active":"2023-10-25T16:19:54.460534+0000","last_became_peered":"2023-10-25T16:19:54.460534+0000","last_unstale":"2023-10-25T16:19:54.464607+0000","last_undegraded":"2023-10-25T16:19:54.464607+0000","last_fullsized":"2023-10-25T16:19:54.464607+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446604+0000","last_change":"2023-10-25T16:19:53.424091+0000","last_active":"2023-10-25T16:19:54.446604+0000","last_peered":"2023-10-25T16:19:54.446604+0000","last_clean":"2023-10-25T16:19:54.446604+0000","last_became_active":"2023-10-25T16:19:53.423484+0000","last_became_peered":"2023-10-25T16:19:53.423484+0000","last_unstale":"2023-10-25T16:19:54.446604+0000","last_undegraded":"2023-10-25T16:19:54.446604+0000","last_fullsized":"2023-10-25T16:19:54.446604+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:44.149035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472323+0000","last_change":"2023-10-25T16:19:54.472192+0000","last_active":"2023-10-25T16:19:54.472323+0000","last_peered":"2023-10-25T16:19:54.472323+0000","last_clean":"2023-10-25T16:19:54.472323+0000","last_became_active":"2023-10-25T16:19:54.471674+0000","last_became_peered":"2023-10-25T16:19:54.471674+0000","last_unstale":"2023-10-25T16:19:54.472323+0000","last_undegraded":"2023-10-25T16:19:54.472323+0000","last_fullsized":"2023-10-25T16:19:54.472323+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445917+0000","last_change":"2023-10-25T16:19:53.424477+0000","last_active":"2023-10-25T16:19:54.445917+0000","last_peered":"2023-10-25T16:19:54.445917+0000","last_clean":"2023-10-25T16:19:54.445917+0000","last_became_active":"2023-10-25T16:19:53.424258+0000","last_became_peered":"2023-10-25T16:19:53.424258+0000","last_unstale":"2023-10-25T16:19:54.445917+0000","last_undegraded":"2023-10-25T16:19:54.445917+0000","last_fullsized":"2023-10-25T16:19:54.445917+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:51.557043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467542+0000","last_change":"2023-10-25T16:19:54.467301+0000","last_active":"2023-10-25T16:19:54.467542+0000","last_peered":"2023-10-25T16:19:54.467542+0000","last_clean":"2023-10-25T16:19:54.467542+0000","last_became_active":"2023-10-25T16:19:54.461393+0000","last_became_peered":"2023-10-25T16:19:54.461393+0000","last_unstale":"2023-10-25T16:19:54.467542+0000","last_undegraded":"2023-10-25T16:19:54.467542+0000","last_fullsized":"2023-10-25T16:19:54.467542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:03:18.162726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.437580+0000","last_change":"2023-10-25T16:19:53.418461+0000","last_active":"2023-10-25T16:19:54.437580+0000","last_peered":"2023-10-25T16:19:54.437580+0000","last_clean":"2023-10-25T16:19:54.437580+0000","last_became_active":"2023-10-25T16:19:53.417773+0000","last_became_peered":"2023-10-25T16:19:53.417773+0000","last_unstale":"2023-10-25T16:19:54.437580+0000","last_undegraded":"2023-10-25T16:19:54.437580+0000","last_fullsized":"2023-10-25T16:19:54.437580+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:07.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459135+0000","last_change":"2023-10-25T16:19:54.458996+0000","last_active":"2023-10-25T16:19:54.459135+0000","last_peered":"2023-10-25T16:19:54.459135+0000","last_clean":"2023-10-25T16:19:54.459135+0000","last_became_active":"2023-10-25T16:19:54.458371+0000","last_became_peered":"2023-10-25T16:19:54.458371+0000","last_unstale":"2023-10-25T16:19:54.459135+0000","last_undegraded":"2023-10-25T16:19:54.459135+0000","last_fullsized":"2023-10-25T16:19:54.459135+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:03.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459380+0000","last_change":"2023-10-25T16:19:53.431861+0000","last_active":"2023-10-25T16:19:54.459380+0000","last_peered":"2023-10-25T16:19:54.459380+0000","last_clean":"2023-10-25T16:19:54.459380+0000","last_became_active":"2023-10-25T16:19:53.430078+0000","last_became_peered":"2023-10-25T16:19:53.430078+0000","last_unstale":"2023-10-25T16:19:54.459380+0000","last_undegraded":"2023-10-25T16:19:54.459380+0000","last_fullsized":"2023-10-25T16:19:54.459380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:16.139714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.466000+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.459488+0000","last_became_peered":"2023-10-25T16:19:54.459488+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:08:01.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473964+0000","last_change":"2023-10-25T16:19:54.473782+0000","last_active":"2023-10-25T16:19:54.473964+0000","last_peered":"2023-10-25T16:19:54.473964+0000","last_clean":"2023-10-25T16:19:54.473964+0000","last_became_active":"2023-10-25T16:19:54.470232+0000","last_became_peered":"2023-10-25T16:19:54.470232+0000","last_unstale":"2023-10-25T16:19:54.473964+0000","last_undegraded":"2023-10-25T16:19:54.473964+0000","last_fullsized":"2023-10-25T16:19:54.473964+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:04.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446978+0000","last_change":"2023-10-25T16:19:53.429389+0000","last_active":"2023-10-25T16:19:54.446978+0000","last_peered":"2023-10-25T16:19:54.446978+0000","last_clean":"2023-10-25T16:19:54.446978+0000","last_became_active":"2023-10-25T16:19:53.428712+0000","last_became_peered":"2023-10-25T16:19:53.428712+0000","last_unstale":"2023-10-25T16:19:54.446978+0000","last_undegraded":"2023-10-25T16:19:54.446978+0000","last_fullsized":"2023-10-25T16:19:54.446978+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:56:09.475192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459095+0000","last_change":"2023-10-25T16:19:54.458038+0000","last_active":"2023-10-25T16:19:54.459095+0000","last_peered":"2023-10-25T16:19:54.459095+0000","last_clean":"2023-10-25T16:19:54.459095+0000","last_became_active":"2023-10-25T16:19:54.456866+0000","last_became_peered":"2023-10-25T16:19:54.456866+0000","last_unstale":"2023-10-25T16:19:54.459095+0000","last_undegraded":"2023-10-25T16:19:54.459095+0000","last_fullsized":"2023-10-25T16:19:54.459095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.441904+0000","last_change":"2023-10-25T16:19:53.420809+0000","last_active":"2023-10-25T16:19:54.441904+0000","last_peered":"2023-10-25T16:19:54.441904+0000","last_clean":"2023-10-25T16:19:54.441904+0000","last_became_active":"2023-10-25T16:19:53.419238+0000","last_became_peered":"2023-10-25T16:19:53.419238+0000","last_unstale":"2023-10-25T16:19:54.441904+0000","last_undegraded":"2023-10-25T16:19:54.441904+0000","last_fullsized":"2023-10-25T16:19:54.441904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:44.328241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":280,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-25T16:19:53.402414+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:53.402414+0000","last_peered":"2023-10-25T16:19:53.402414+0000","last_clean":"2023-10-25T16:19:53.402414+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:53.402414+0000","last_undegraded":"2023-10-25T16:19:53.402414+0000","last_fullsized":"2023-10-25T16:19:53.402414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":124,"acting":124,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":50,"acting":50,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":754,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194557,"statfs":{"total":200000000,"available":199227265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":0.435},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.496},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":0.98499999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.874},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.034}]}]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193962,"statfs":{"total":200000000,"available":198618030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":1.004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.875},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":1.0840000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.048},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.179}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":1.02}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.089},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.181},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":1.2170000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.054}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":0.97799999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.93200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":1.046},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.89500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.5},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":1.091}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.083}]},{"osd":2,"last update":"Wed Oct 25 16:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88800000000000001,"15min":0.84199999999999997},"min":{"1min":0.57299999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.341,"5min":1.397,"15min":1.419},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94199999999999995,"15min":0.88400000000000001},"min":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.226}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.624},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1779999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2649999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.206}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194537,"statfs":{"total":200000000,"available":199206716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":0.97499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.84799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":0.872},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.083}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.05},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":0.95399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":1.127}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193969,"statfs":{"total":200000000,"available":198624805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":1.9610000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":2.5880000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":4.1920000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":3.3919999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":4.431},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":2.2970000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":4.5860000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":5.2880000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":3.5649999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":3.8340000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":0.622},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":0.70699999999999996}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:58.075 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:58.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/642721160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00cbfa0 msgr2=0x7f81d00aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/642721160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00cbfa0 0x7f81d00aebc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f81d006c7b0 tx=0x7f81c001c840 comp rx=0 tx=0).stop 2023-10-25T16:19:58.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/642721160 shutdown_connections 2023-10-25T16:19:58.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/642721160 >> v2:172.21.15.184:3300/0 conn(0x7f81d00af100 0x7f81d0158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/642721160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00cbfa0 0x7f81d00aebc0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/642721160 >> 172.21.15.177:0/642721160 conn(0x7f81d00b2450 msgr2=0x7f81d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:58.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/642721160 shutdown_connections 2023-10-25T16:19:58.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/642721160 wait complete. 2023-10-25T16:19:58.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 Processor -- start 2023-10-25T16:19:58.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- start start 2023-10-25T16:19:58.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 0x7f81d0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d00cbfa0 0x7f81d0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81d014e810 0x7f81d014b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00aa8b0 con 0x7f81d00af100 2023-10-25T16:19:58.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0151150 con 0x7f81d00cbfa0 2023-10-25T16:19:58.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0151430 con 0x7f81d014e810 2023-10-25T16:19:58.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 0x7f81d0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 0x7f81d0150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44246/0 (socket says 172.21.15.177:44246) 2023-10-25T16:19:58.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 -- 172.21.15.177:0/3494626521 learned_addr learned my addr 172.21.15.177:0/3494626521 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:58.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81c6ffd640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d00cbfa0 0x7f81d0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cffff640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81d014e810 0x7f81d014b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 -- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81d014e810 msgr2=0x7f81d014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81d014e810 0x7f81d014b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 -- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d00cbfa0 msgr2=0x7f81d0149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d00cbfa0 0x7f81d0149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 -- 172.21.15.177:0/3494626521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0009500 con 0x7f81d00af100 2023-10-25T16:19:58.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81c6ffd640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d00cbfa0 0x7f81d0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:58.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cffff640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81d014e810 0x7f81d014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:58.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81cf7fe640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 0x7f81d0150920 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f81b800b3e0 tx=0x7f81b800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:58.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8011830 con 0x7f81d00af100 2023-10-25T16:19:58.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f81b8011aa0 con 0x7f81d00af100 2023-10-25T16:19:58.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8010380 con 0x7f81d00af100 2023-10-25T16:19:58.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d0151710 con 0x7f81d00af100 2023-10-25T16:19:58.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.236+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d0150e60 con 0x7f81d00af100 2023-10-25T16:19:58.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.240+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d004daf0 con 0x7f81d00af100 2023-10-25T16:19:58.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.240+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f81b80104e0 con 0x7f81d00af100 2023-10-25T16:19:58.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.240+0000 7f81ccff9640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f81b40664a0 0x7f81b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.240+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81b8084290 con 0x7f81d00af100 2023-10-25T16:19:58.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.240+0000 7f81c6ffd640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f81b40664a0 0x7f81b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.240+0000 7f81c6ffd640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f81b40664a0 0x7f81b4068960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81c00ae000 tx=0x7f81c001b080 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:58.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.244+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81b8051710 con 0x7f81d00af100 2023-10-25T16:19:58.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.388+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81d0151bc0 con 0x7f81b40664a0 2023-10-25T16:19:58.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.412+0000 7f81ccff9640 1 -- 172.21.15.177:0/3494626521 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282699 (secure 0 0 0) 0x7f81c00a6490 con 0x7f81b40664a0 2023-10-25T16:19:58.412 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:58.414 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:58.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f81b40664a0 msgr2=0x7f81b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f81b40664a0 0x7f81b4068960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f81c00ae000 tx=0x7f81c001b080 comp rx=0 tx=0).stop 2023-10-25T16:19:58.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 msgr2=0x7f81d0150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 0x7f81d0150920 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f81b800b3e0 tx=0x7f81b800b8a0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 shutdown_connections 2023-10-25T16:19:58.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f81b40664a0 0x7f81b4068960 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f81d014e810 0x7f81d014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81d00cbfa0 0x7f81d0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 --2- 172.21.15.177:0/3494626521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81d00af100 0x7f81d0150920 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 >> 172.21.15.177:0/3494626521 conn(0x7f81d00b2450 msgr2=0x7f81d006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:58.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 shutdown_connections 2023-10-25T16:19:58.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.416+0000 7f81d5e3a640 1 -- 172.21.15.177:0/3494626521 wait complete. 2023-10-25T16:19:58.430 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2023-10-25T16:19:56.750418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555205,"statfs":{"total":1600000000,"available":1592530609,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.353666"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461879+0000","last_change":"2023-10-25T16:19:54.461727+0000","last_active":"2023-10-25T16:19:54.461879+0000","last_peered":"2023-10-25T16:19:54.461879+0000","last_clean":"2023-10-25T16:19:54.461879+0000","last_became_active":"2023-10-25T16:19:54.460940+0000","last_became_peered":"2023-10-25T16:19:54.460940+0000","last_unstale":"2023-10-25T16:19:54.461879+0000","last_undegraded":"2023-10-25T16:19:54.461879+0000","last_fullsized":"2023-10-25T16:19:54.461879+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.469115+0000","last_change":"2023-10-25T16:19:54.469017+0000","last_active":"2023-10-25T16:19:54.469115+0000","last_peered":"2023-10-25T16:19:54.469115+0000","last_clean":"2023-10-25T16:19:54.469115+0000","last_became_active":"2023-10-25T16:19:54.468147+0000","last_became_peered":"2023-10-25T16:19:54.468147+0000","last_unstale":"2023-10-25T16:19:54.469115+0000","last_undegraded":"2023-10-25T16:19:54.469115+0000","last_fullsized":"2023-10-25T16:19:54.469115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:19:00.692763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.454300+0000","last_change":"2023-10-25T16:19:54.453147+0000","last_active":"2023-10-25T16:19:54.454300+0000","last_peered":"2023-10-25T16:19:54.454300+0000","last_clean":"2023-10-25T16:19:54.454300+0000","last_became_active":"2023-10-25T16:19:54.450106+0000","last_became_peered":"2023-10-25T16:19:54.450106+0000","last_unstale":"2023-10-25T16:19:54.454300+0000","last_undegraded":"2023-10-25T16:19:54.454300+0000","last_fullsized":"2023-10-25T16:19:54.454300+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463967+0000","last_change":"2023-10-25T16:19:54.463763+0000","last_active":"2023-10-25T16:19:54.463967+0000","last_peered":"2023-10-25T16:19:54.463967+0000","last_clean":"2023-10-25T16:19:54.463967+0000","last_became_active":"2023-10-25T16:19:54.452773+0000","last_became_peered":"2023-10-25T16:19:54.452773+0000","last_unstale":"2023-10-25T16:19:54.463967+0000","last_undegraded":"2023-10-25T16:19:54.463967+0000","last_fullsized":"2023-10-25T16:19:54.463967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:54:04.307190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:53.394237+0000","last_change":"2023-10-25T16:19:53.394237+0000","last_active":"2023-10-25T16:19:53.394237+0000","last_peered":"2023-10-25T16:19:53.394237+0000","last_clean":"2023-10-25T16:19:53.394237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:53.394237+0000","last_undegraded":"2023-10-25T16:19:53.394237+0000","last_fullsized":"2023-10-25T16:19:53.394237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473461+0000","last_change":"2023-10-25T16:19:54.473119+0000","last_active":"2023-10-25T16:19:54.473461+0000","last_peered":"2023-10-25T16:19:54.473461+0000","last_clean":"2023-10-25T16:19:54.473461+0000","last_became_active":"2023-10-25T16:19:54.470943+0000","last_became_peered":"2023-10-25T16:19:54.470943+0000","last_unstale":"2023-10-25T16:19:54.473461+0000","last_undegraded":"2023-10-25T16:19:54.473461+0000","last_fullsized":"2023-10-25T16:19:54.473461+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:00.125788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459374+0000","last_change":"2023-10-25T16:19:54.458805+0000","last_active":"2023-10-25T16:19:54.459374+0000","last_peered":"2023-10-25T16:19:54.459374+0000","last_clean":"2023-10-25T16:19:54.459374+0000","last_became_active":"2023-10-25T16:19:54.457779+0000","last_became_peered":"2023-10-25T16:19:54.457779+0000","last_unstale":"2023-10-25T16:19:54.459374+0000","last_undegraded":"2023-10-25T16:19:54.459374+0000","last_fullsized":"2023-10-25T16:19:54.459374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:59.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466235+0000","last_change":"2023-10-25T16:19:54.466068+0000","last_active":"2023-10-25T16:19:54.466235+0000","last_peered":"2023-10-25T16:19:54.466235+0000","last_clean":"2023-10-25T16:19:54.466235+0000","last_became_active":"2023-10-25T16:19:54.464713+0000","last_became_peered":"2023-10-25T16:19:54.464713+0000","last_unstale":"2023-10-25T16:19:54.466235+0000","last_undegraded":"2023-10-25T16:19:54.466235+0000","last_fullsized":"2023-10-25T16:19:54.466235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:09.855686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464284+0000","last_change":"2023-10-25T16:19:54.464139+0000","last_active":"2023-10-25T16:19:54.464284+0000","last_peered":"2023-10-25T16:19:54.464284+0000","last_clean":"2023-10-25T16:19:54.464284+0000","last_became_active":"2023-10-25T16:19:54.453425+0000","last_became_peered":"2023-10-25T16:19:54.453425+0000","last_unstale":"2023-10-25T16:19:54.464284+0000","last_undegraded":"2023-10-25T16:19:54.464284+0000","last_fullsized":"2023-10-25T16:19:54.464284+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:59.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.474708+0000","last_change":"2023-10-25T16:19:54.474546+0000","last_active":"2023-10-25T16:19:54.474708+0000","last_peered":"2023-10-25T16:19:54.474708+0000","last_clean":"2023-10-25T16:19:54.474708+0000","last_became_active":"2023-10-25T16:19:54.469302+0000","last_became_peered":"2023-10-25T16:19:54.469302+0000","last_unstale":"2023-10-25T16:19:54.474708+0000","last_undegraded":"2023-10-25T16:19:54.474708+0000","last_fullsized":"2023-10-25T16:19:54.474708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463484+0000","last_change":"2023-10-25T16:19:54.463337+0000","last_active":"2023-10-25T16:19:54.463484+0000","last_peered":"2023-10-25T16:19:54.463484+0000","last_clean":"2023-10-25T16:19:54.463484+0000","last_became_active":"2023-10-25T16:19:54.462731+0000","last_became_peered":"2023-10-25T16:19:54.462731+0000","last_unstale":"2023-10-25T16:19:54.463484+0000","last_undegraded":"2023-10-25T16:19:54.463484+0000","last_fullsized":"2023-10-25T16:19:54.463484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:36:29.886246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463916+0000","last_change":"2023-10-25T16:19:54.463581+0000","last_active":"2023-10-25T16:19:54.463916+0000","last_peered":"2023-10-25T16:19:54.463916+0000","last_clean":"2023-10-25T16:19:54.463916+0000","last_became_active":"2023-10-25T16:19:54.462904+0000","last_became_peered":"2023-10-25T16:19:54.462904+0000","last_unstale":"2023-10-25T16:19:54.463916+0000","last_undegraded":"2023-10-25T16:19:54.463916+0000","last_fullsized":"2023-10-25T16:19:54.463916+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:11:08.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465865+0000","last_change":"2023-10-25T16:19:54.465565+0000","last_active":"2023-10-25T16:19:54.465865+0000","last_peered":"2023-10-25T16:19:54.465865+0000","last_clean":"2023-10-25T16:19:54.465865+0000","last_became_active":"2023-10-25T16:19:54.462990+0000","last_became_peered":"2023-10-25T16:19:54.462990+0000","last_unstale":"2023-10-25T16:19:54.465865+0000","last_undegraded":"2023-10-25T16:19:54.465865+0000","last_fullsized":"2023-10-25T16:19:54.465865+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:24.299112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466831+0000","last_change":"2023-10-25T16:19:54.466678+0000","last_active":"2023-10-25T16:19:54.466831+0000","last_peered":"2023-10-25T16:19:54.466831+0000","last_clean":"2023-10-25T16:19:54.466831+0000","last_became_active":"2023-10-25T16:19:54.461209+0000","last_became_peered":"2023-10-25T16:19:54.461209+0000","last_unstale":"2023-10-25T16:19:54.466831+0000","last_undegraded":"2023-10-25T16:19:54.466831+0000","last_fullsized":"2023-10-25T16:19:54.466831+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:51.803048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472670+0000","last_change":"2023-10-25T16:19:54.469012+0000","last_active":"2023-10-25T16:19:54.472670+0000","last_peered":"2023-10-25T16:19:54.472670+0000","last_clean":"2023-10-25T16:19:54.472670+0000","last_became_active":"2023-10-25T16:19:54.468016+0000","last_became_peered":"2023-10-25T16:19:54.468016+0000","last_unstale":"2023-10-25T16:19:54.472670+0000","last_undegraded":"2023-10-25T16:19:54.472670+0000","last_fullsized":"2023-10-25T16:19:54.472670+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:43.001368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450772+0000","last_change":"2023-10-25T16:19:54.448406+0000","last_active":"2023-10-25T16:19:54.450772+0000","last_peered":"2023-10-25T16:19:54.450772+0000","last_clean":"2023-10-25T16:19:54.450772+0000","last_became_active":"2023-10-25T16:19:54.446860+0000","last_became_peered":"2023-10-25T16:19:54.446860+0000","last_unstale":"2023-10-25T16:19:54.450772+0000","last_undegraded":"2023-10-25T16:19:54.450772+0000","last_fullsized":"2023-10-25T16:19:54.450772+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:28.086832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468918+0000","last_change":"2023-10-25T16:19:54.468783+0000","last_active":"2023-10-25T16:19:54.468918+0000","last_peered":"2023-10-25T16:19:54.468918+0000","last_clean":"2023-10-25T16:19:54.468918+0000","last_became_active":"2023-10-25T16:19:54.466677+0000","last_became_peered":"2023-10-25T16:19:54.466677+0000","last_unstale":"2023-10-25T16:19:54.468918+0000","last_undegraded":"2023-10-25T16:19:54.468918+0000","last_fullsized":"2023-10-25T16:19:54.468918+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:09.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461773+0000","last_change":"2023-10-25T16:19:54.461443+0000","last_active":"2023-10-25T16:19:54.461773+0000","last_peered":"2023-10-25T16:19:54.461773+0000","last_clean":"2023-10-25T16:19:54.461773+0000","last_became_active":"2023-10-25T16:19:54.460838+0000","last_became_peered":"2023-10-25T16:19:54.460838+0000","last_unstale":"2023-10-25T16:19:54.461773+0000","last_undegraded":"2023-10-25T16:19:54.461773+0000","last_fullsized":"2023-10-25T16:19:54.461773+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467213+0000","last_change":"2023-10-25T16:19:54.467062+0000","last_active":"2023-10-25T16:19:54.467213+0000","last_peered":"2023-10-25T16:19:54.467213+0000","last_clean":"2023-10-25T16:19:54.467213+0000","last_became_active":"2023-10-25T16:19:54.464502+0000","last_became_peered":"2023-10-25T16:19:54.464502+0000","last_unstale":"2023-10-25T16:19:54.467213+0000","last_undegraded":"2023-10-25T16:19:54.467213+0000","last_fullsized":"2023-10-25T16:19:54.467213+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456701+0000","last_change":"2023-10-25T16:19:54.451503+0000","last_active":"2023-10-25T16:19:54.456701+0000","last_peered":"2023-10-25T16:19:54.456701+0000","last_clean":"2023-10-25T16:19:54.456701+0000","last_became_active":"2023-10-25T16:19:54.450896+0000","last_became_peered":"2023-10-25T16:19:54.450896+0000","last_unstale":"2023-10-25T16:19:54.456701+0000","last_undegraded":"2023-10-25T16:19:54.456701+0000","last_fullsized":"2023-10-25T16:19:54.456701+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:43:37.602014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456649+0000","last_change":"2023-10-25T16:19:54.450150+0000","last_active":"2023-10-25T16:19:54.456649+0000","last_peered":"2023-10-25T16:19:54.456649+0000","last_clean":"2023-10-25T16:19:54.456649+0000","last_became_active":"2023-10-25T16:19:54.449509+0000","last_became_peered":"2023-10-25T16:19:54.449509+0000","last_unstale":"2023-10-25T16:19:54.456649+0000","last_undegraded":"2023-10-25T16:19:54.456649+0000","last_fullsized":"2023-10-25T16:19:54.456649+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:16:43.655185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459145+0000","last_change":"2023-10-25T16:19:54.458648+0000","last_active":"2023-10-25T16:19:54.459145+0000","last_peered":"2023-10-25T16:19:54.459145+0000","last_clean":"2023-10-25T16:19:54.459145+0000","last_became_active":"2023-10-25T16:19:54.457941+0000","last_became_peered":"2023-10-25T16:19:54.457941+0000","last_unstale":"2023-10-25T16:19:54.459145+0000","last_undegraded":"2023-10-25T16:19:54.459145+0000","last_fullsized":"2023-10-25T16:19:54.459145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:29:59.455072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457978+0000","last_change":"2023-10-25T16:19:54.457827+0000","last_active":"2023-10-25T16:19:54.457978+0000","last_peered":"2023-10-25T16:19:54.457978+0000","last_clean":"2023-10-25T16:19:54.457978+0000","last_became_active":"2023-10-25T16:19:54.456641+0000","last_became_peered":"2023-10-25T16:19:54.456641+0000","last_unstale":"2023-10-25T16:19:54.457978+0000","last_undegraded":"2023-10-25T16:19:54.457978+0000","last_fullsized":"2023-10-25T16:19:54.457978+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:52.812391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468333+0000","last_change":"2023-10-25T16:19:54.468145+0000","last_active":"2023-10-25T16:19:54.468333+0000","last_peered":"2023-10-25T16:19:54.468333+0000","last_clean":"2023-10-25T16:19:54.468333+0000","last_became_active":"2023-10-25T16:19:54.464664+0000","last_became_peered":"2023-10-25T16:19:54.464664+0000","last_unstale":"2023-10-25T16:19:54.468333+0000","last_undegraded":"2023-10-25T16:19:54.468333+0000","last_fullsized":"2023-10-25T16:19:54.468333+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:23.996474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456802+0000","last_change":"2023-10-25T16:19:54.454986+0000","last_active":"2023-10-25T16:19:54.456802+0000","last_peered":"2023-10-25T16:19:54.456802+0000","last_clean":"2023-10-25T16:19:54.456802+0000","last_became_active":"2023-10-25T16:19:54.454308+0000","last_became_peered":"2023-10-25T16:19:54.454308+0000","last_unstale":"2023-10-25T16:19:54.456802+0000","last_undegraded":"2023-10-25T16:19:54.456802+0000","last_fullsized":"2023-10-25T16:19:54.456802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:45:22.751967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450823+0000","last_change":"2023-10-25T16:19:54.448801+0000","last_active":"2023-10-25T16:19:54.450823+0000","last_peered":"2023-10-25T16:19:54.450823+0000","last_clean":"2023-10-25T16:19:54.450823+0000","last_became_active":"2023-10-25T16:19:54.447799+0000","last_became_peered":"2023-10-25T16:19:54.447799+0000","last_unstale":"2023-10-25T16:19:54.450823+0000","last_undegraded":"2023-10-25T16:19:54.450823+0000","last_fullsized":"2023-10-25T16:19:54.450823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:56.732275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466858+0000","last_change":"2023-10-25T16:19:54.466672+0000","last_active":"2023-10-25T16:19:54.466858+0000","last_peered":"2023-10-25T16:19:54.466858+0000","last_clean":"2023-10-25T16:19:54.466858+0000","last_became_active":"2023-10-25T16:19:54.465394+0000","last_became_peered":"2023-10-25T16:19:54.465394+0000","last_unstale":"2023-10-25T16:19:54.466858+0000","last_undegraded":"2023-10-25T16:19:54.466858+0000","last_fullsized":"2023-10-25T16:19:54.466858+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:55.228229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455819+0000","last_change":"2023-10-25T16:19:54.454070+0000","last_active":"2023-10-25T16:19:54.455819+0000","last_peered":"2023-10-25T16:19:54.455819+0000","last_clean":"2023-10-25T16:19:54.455819+0000","last_became_active":"2023-10-25T16:19:54.453409+0000","last_became_peered":"2023-10-25T16:19:54.453409+0000","last_unstale":"2023-10-25T16:19:54.455819+0000","last_undegraded":"2023-10-25T16:19:54.455819+0000","last_fullsized":"2023-10-25T16:19:54.455819+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456849+0000","last_change":"2023-10-25T16:19:54.455923+0000","last_active":"2023-10-25T16:19:54.456849+0000","last_peered":"2023-10-25T16:19:54.456849+0000","last_clean":"2023-10-25T16:19:54.456849+0000","last_became_active":"2023-10-25T16:19:54.455216+0000","last_became_peered":"2023-10-25T16:19:54.455216+0000","last_unstale":"2023-10-25T16:19:54.456849+0000","last_undegraded":"2023-10-25T16:19:54.456849+0000","last_fullsized":"2023-10-25T16:19:54.456849+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:36.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.447574+0000","last_change":"2023-10-25T16:19:54.447434+0000","last_active":"2023-10-25T16:19:54.447574+0000","last_peered":"2023-10-25T16:19:54.447574+0000","last_clean":"2023-10-25T16:19:54.447574+0000","last_became_active":"2023-10-25T16:19:54.446808+0000","last_became_peered":"2023-10-25T16:19:54.446808+0000","last_unstale":"2023-10-25T16:19:54.447574+0000","last_undegraded":"2023-10-25T16:19:54.447574+0000","last_fullsized":"2023-10-25T16:19:54.447574+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:25.646957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458359+0000","last_change":"2023-10-25T16:19:54.458170+0000","last_active":"2023-10-25T16:19:54.458359+0000","last_peered":"2023-10-25T16:19:54.458359+0000","last_clean":"2023-10-25T16:19:54.458359+0000","last_became_active":"2023-10-25T16:19:54.449443+0000","last_became_peered":"2023-10-25T16:19:54.449443+0000","last_unstale":"2023-10-25T16:19:54.458359+0000","last_undegraded":"2023-10-25T16:19:54.458359+0000","last_fullsized":"2023-10-25T16:19:54.458359+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:44.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466299+0000","last_change":"2023-10-25T16:19:54.466137+0000","last_active":"2023-10-25T16:19:54.466299+0000","last_peered":"2023-10-25T16:19:54.466299+0000","last_clean":"2023-10-25T16:19:54.466299+0000","last_became_active":"2023-10-25T16:19:54.464568+0000","last_became_peered":"2023-10-25T16:19:54.464568+0000","last_unstale":"2023-10-25T16:19:54.466299+0000","last_undegraded":"2023-10-25T16:19:54.466299+0000","last_fullsized":"2023-10-25T16:19:54.466299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:25.698386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461169+0000","last_change":"2023-10-25T16:19:54.460492+0000","last_active":"2023-10-25T16:19:54.461169+0000","last_peered":"2023-10-25T16:19:54.461169+0000","last_clean":"2023-10-25T16:19:54.461169+0000","last_became_active":"2023-10-25T16:19:54.459828+0000","last_became_peered":"2023-10-25T16:19:54.459828+0000","last_unstale":"2023-10-25T16:19:54.461169+0000","last_undegraded":"2023-10-25T16:19:54.461169+0000","last_fullsized":"2023-10-25T16:19:54.461169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:56:23.557613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705568+0000","last_change":"2023-10-25T16:19:53.408435+0000","last_active":"2023-10-25T16:19:54.705568+0000","last_peered":"2023-10-25T16:19:54.705568+0000","last_clean":"2023-10-25T16:19:54.705568+0000","last_became_active":"2023-10-25T16:19:53.407353+0000","last_became_peered":"2023-10-25T16:19:53.407353+0000","last_unstale":"2023-10-25T16:19:54.705568+0000","last_undegraded":"2023-10-25T16:19:54.705568+0000","last_fullsized":"2023-10-25T16:19:54.705568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:48:13.615155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457968+0000","last_change":"2023-10-25T16:19:54.457803+0000","last_active":"2023-10-25T16:19:54.457968+0000","last_peered":"2023-10-25T16:19:54.457968+0000","last_clean":"2023-10-25T16:19:54.457968+0000","last_became_active":"2023-10-25T16:19:54.457190+0000","last_became_peered":"2023-10-25T16:19:54.457190+0000","last_unstale":"2023-10-25T16:19:54.457968+0000","last_undegraded":"2023-10-25T16:19:54.457968+0000","last_fullsized":"2023-10-25T16:19:54.457968+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703698+0000","last_change":"2023-10-25T16:19:53.407966+0000","last_active":"2023-10-25T16:19:54.703698+0000","last_peered":"2023-10-25T16:19:54.703698+0000","last_clean":"2023-10-25T16:19:54.703698+0000","last_became_active":"2023-10-25T16:19:53.407333+0000","last_became_peered":"2023-10-25T16:19:53.407333+0000","last_unstale":"2023-10-25T16:19:54.703698+0000","last_undegraded":"2023-10-25T16:19:54.703698+0000","last_fullsized":"2023-10-25T16:19:54.703698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:01.501634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473363+0000","last_change":"2023-10-25T16:19:54.471618+0000","last_active":"2023-10-25T16:19:54.473363+0000","last_peered":"2023-10-25T16:19:54.473363+0000","last_clean":"2023-10-25T16:19:54.473363+0000","last_became_active":"2023-10-25T16:19:54.470001+0000","last_became_peered":"2023-10-25T16:19:54.470001+0000","last_unstale":"2023-10-25T16:19:54.473363+0000","last_undegraded":"2023-10-25T16:19:54.473363+0000","last_fullsized":"2023-10-25T16:19:54.473363+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:32.794532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464451+0000","last_change":"2023-10-25T16:19:54.464303+0000","last_active":"2023-10-25T16:19:54.464451+0000","last_peered":"2023-10-25T16:19:54.464451+0000","last_clean":"2023-10-25T16:19:54.464451+0000","last_became_active":"2023-10-25T16:19:54.463645+0000","last_became_peered":"2023-10-25T16:19:54.463645+0000","last_unstale":"2023-10-25T16:19:54.464451+0000","last_undegraded":"2023-10-25T16:19:54.464451+0000","last_fullsized":"2023-10-25T16:19:54.464451+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:52.561033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450869+0000","last_change":"2023-10-25T16:19:54.450631+0000","last_active":"2023-10-25T16:19:54.450869+0000","last_peered":"2023-10-25T16:19:54.450869+0000","last_clean":"2023-10-25T16:19:54.450869+0000","last_became_active":"2023-10-25T16:19:54.449923+0000","last_became_peered":"2023-10-25T16:19:54.449923+0000","last_unstale":"2023-10-25T16:19:54.450869+0000","last_undegraded":"2023-10-25T16:19:54.450869+0000","last_fullsized":"2023-10-25T16:19:54.450869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:59.058809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705246+0000","last_change":"2023-10-25T16:19:53.423223+0000","last_active":"2023-10-25T16:19:54.705246+0000","last_peered":"2023-10-25T16:19:54.705246+0000","last_clean":"2023-10-25T16:19:54.705246+0000","last_became_active":"2023-10-25T16:19:53.421712+0000","last_became_peered":"2023-10-25T16:19:53.421712+0000","last_unstale":"2023-10-25T16:19:54.705246+0000","last_undegraded":"2023-10-25T16:19:54.705246+0000","last_fullsized":"2023-10-25T16:19:54.705246+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:08.239214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468631+0000","last_change":"2023-10-25T16:19:54.468481+0000","last_active":"2023-10-25T16:19:54.468631+0000","last_peered":"2023-10-25T16:19:54.468631+0000","last_clean":"2023-10-25T16:19:54.468631+0000","last_became_active":"2023-10-25T16:19:54.465812+0000","last_became_peered":"2023-10-25T16:19:54.465812+0000","last_unstale":"2023-10-25T16:19:54.468631+0000","last_undegraded":"2023-10-25T16:19:54.468631+0000","last_fullsized":"2023-10-25T16:19:54.468631+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:10.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705601+0000","last_change":"2023-10-25T16:19:53.431077+0000","last_active":"2023-10-25T16:19:54.705601+0000","last_peered":"2023-10-25T16:19:54.705601+0000","last_clean":"2023-10-25T16:19:54.705601+0000","last_became_active":"2023-10-25T16:19:53.430825+0000","last_became_peered":"2023-10-25T16:19:53.430825+0000","last_unstale":"2023-10-25T16:19:54.705601+0000","last_undegraded":"2023-10-25T16:19:54.705601+0000","last_fullsized":"2023-10-25T16:19:54.705601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:17.573720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465347+0000","last_change":"2023-10-25T16:19:54.464983+0000","last_active":"2023-10-25T16:19:54.465347+0000","last_peered":"2023-10-25T16:19:54.465347+0000","last_clean":"2023-10-25T16:19:54.465347+0000","last_became_active":"2023-10-25T16:19:54.461758+0000","last_became_peered":"2023-10-25T16:19:54.461758+0000","last_unstale":"2023-10-25T16:19:54.465347+0000","last_undegraded":"2023-10-25T16:19:54.465347+0000","last_fullsized":"2023-10-25T16:19:54.465347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442024+0000","last_change":"2023-10-25T16:19:53.419217+0000","last_active":"2023-10-25T16:19:54.442024+0000","last_peered":"2023-10-25T16:19:54.442024+0000","last_clean":"2023-10-25T16:19:54.442024+0000","last_became_active":"2023-10-25T16:19:53.418429+0000","last_became_peered":"2023-10-25T16:19:53.418429+0000","last_unstale":"2023-10-25T16:19:54.442024+0000","last_undegraded":"2023-10-25T16:19:54.442024+0000","last_fullsized":"2023-10-25T16:19:54.442024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:53:13.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456035+0000","last_change":"2023-10-25T16:19:54.455866+0000","last_active":"2023-10-25T16:19:54.456035+0000","last_peered":"2023-10-25T16:19:54.456035+0000","last_clean":"2023-10-25T16:19:54.456035+0000","last_became_active":"2023-10-25T16:19:54.455162+0000","last_became_peered":"2023-10-25T16:19:54.455162+0000","last_unstale":"2023-10-25T16:19:54.456035+0000","last_undegraded":"2023-10-25T16:19:54.456035+0000","last_fullsized":"2023-10-25T16:19:54.456035+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:51.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446981+0000","last_change":"2023-10-25T16:19:53.419508+0000","last_active":"2023-10-25T16:19:54.446981+0000","last_peered":"2023-10-25T16:19:54.446981+0000","last_clean":"2023-10-25T16:19:54.446981+0000","last_became_active":"2023-10-25T16:19:53.418740+0000","last_became_peered":"2023-10-25T16:19:53.418740+0000","last_unstale":"2023-10-25T16:19:54.446981+0000","last_undegraded":"2023-10-25T16:19:54.446981+0000","last_fullsized":"2023-10-25T16:19:54.446981+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:45.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463926+0000","last_change":"2023-10-25T16:19:54.463626+0000","last_active":"2023-10-25T16:19:54.463926+0000","last_peered":"2023-10-25T16:19:54.463926+0000","last_clean":"2023-10-25T16:19:54.463926+0000","last_became_active":"2023-10-25T16:19:54.462999+0000","last_became_peered":"2023-10-25T16:19:54.462999+0000","last_unstale":"2023-10-25T16:19:54.463926+0000","last_undegraded":"2023-10-25T16:19:54.463926+0000","last_fullsized":"2023-10-25T16:19:54.463926+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:35.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465155+0000","last_change":"2023-10-25T16:19:54.465003+0000","last_active":"2023-10-25T16:19:54.465155+0000","last_peered":"2023-10-25T16:19:54.465155+0000","last_clean":"2023-10-25T16:19:54.465155+0000","last_became_active":"2023-10-25T16:19:54.463043+0000","last_became_peered":"2023-10-25T16:19:54.463043+0000","last_unstale":"2023-10-25T16:19:54.465155+0000","last_undegraded":"2023-10-25T16:19:54.465155+0000","last_fullsized":"2023-10-25T16:19:54.465155+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440427+0000","last_change":"2023-10-25T16:19:53.417480+0000","last_active":"2023-10-25T16:19:54.440427+0000","last_peered":"2023-10-25T16:19:54.440427+0000","last_clean":"2023-10-25T16:19:54.440427+0000","last_became_active":"2023-10-25T16:19:53.417160+0000","last_became_peered":"2023-10-25T16:19:53.417160+0000","last_unstale":"2023-10-25T16:19:54.440427+0000","last_undegraded":"2023-10-25T16:19:54.440427+0000","last_fullsized":"2023-10-25T16:19:54.440427+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:44.282469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449332+0000","last_change":"2023-10-25T16:19:54.448364+0000","last_active":"2023-10-25T16:19:54.449332+0000","last_peered":"2023-10-25T16:19:54.449332+0000","last_clean":"2023-10-25T16:19:54.449332+0000","last_became_active":"2023-10-25T16:19:54.447523+0000","last_became_peered":"2023-10-25T16:19:54.447523+0000","last_unstale":"2023-10-25T16:19:54.449332+0000","last_undegraded":"2023-10-25T16:19:54.449332+0000","last_fullsized":"2023-10-25T16:19:54.449332+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:07.214049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.709914+0000","last_change":"2023-10-25T16:19:53.427731+0000","last_active":"2023-10-25T16:19:54.709914+0000","last_peered":"2023-10-25T16:19:54.709914+0000","last_clean":"2023-10-25T16:19:54.709914+0000","last_became_active":"2023-10-25T16:19:53.424487+0000","last_became_peered":"2023-10-25T16:19:53.424487+0000","last_unstale":"2023-10-25T16:19:54.709914+0000","last_undegraded":"2023-10-25T16:19:54.709914+0000","last_fullsized":"2023-10-25T16:19:54.709914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:28.745280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445611+0000","last_change":"2023-10-25T16:19:54.445458+0000","last_active":"2023-10-25T16:19:54.445611+0000","last_peered":"2023-10-25T16:19:54.445611+0000","last_clean":"2023-10-25T16:19:54.445611+0000","last_became_active":"2023-10-25T16:19:54.444854+0000","last_became_peered":"2023-10-25T16:19:54.444854+0000","last_unstale":"2023-10-25T16:19:54.445611+0000","last_undegraded":"2023-10-25T16:19:54.445611+0000","last_fullsized":"2023-10-25T16:19:54.445611+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:54.145259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.714771+0000","last_change":"2023-10-25T16:19:53.422257+0000","last_active":"2023-10-25T16:19:54.714771+0000","last_peered":"2023-10-25T16:19:54.714771+0000","last_clean":"2023-10-25T16:19:54.714771+0000","last_became_active":"2023-10-25T16:19:53.419641+0000","last_became_peered":"2023-10-25T16:19:53.419641+0000","last_unstale":"2023-10-25T16:19:54.714771+0000","last_undegraded":"2023-10-25T16:19:54.714771+0000","last_fullsized":"2023-10-25T16:19:54.714771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:12:20.637482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449144+0000","last_change":"2023-10-25T16:19:54.447812+0000","last_active":"2023-10-25T16:19:54.449144+0000","last_peered":"2023-10-25T16:19:54.449144+0000","last_clean":"2023-10-25T16:19:54.449144+0000","last_became_active":"2023-10-25T16:19:54.447047+0000","last_became_peered":"2023-10-25T16:19:54.447047+0000","last_unstale":"2023-10-25T16:19:54.449144+0000","last_undegraded":"2023-10-25T16:19:54.449144+0000","last_fullsized":"2023-10-25T16:19:54.449144+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:14.600765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.706452+0000","last_change":"2023-10-25T16:19:53.427358+0000","last_active":"2023-10-25T16:19:54.706452+0000","last_peered":"2023-10-25T16:19:54.706452+0000","last_clean":"2023-10-25T16:19:54.706452+0000","last_became_active":"2023-10-25T16:19:53.427148+0000","last_became_peered":"2023-10-25T16:19:53.427148+0000","last_unstale":"2023-10-25T16:19:54.706452+0000","last_undegraded":"2023-10-25T16:19:54.706452+0000","last_fullsized":"2023-10-25T16:19:54.706452+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:10.163492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.465106+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.461605+0000","last_became_peered":"2023-10-25T16:19:54.461605+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.453850+0000","last_change":"2023-10-25T16:19:53.428746+0000","last_active":"2023-10-25T16:19:54.453850+0000","last_peered":"2023-10-25T16:19:54.453850+0000","last_clean":"2023-10-25T16:19:54.453850+0000","last_became_active":"2023-10-25T16:19:53.427276+0000","last_became_peered":"2023-10-25T16:19:53.427276+0000","last_unstale":"2023-10-25T16:19:54.453850+0000","last_undegraded":"2023-10-25T16:19:54.453850+0000","last_fullsized":"2023-10-25T16:19:54.453850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:55.728285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466705+0000","last_change":"2023-10-25T16:19:54.466527+0000","last_active":"2023-10-25T16:19:54.466705+0000","last_peered":"2023-10-25T16:19:54.466705+0000","last_clean":"2023-10-25T16:19:54.466705+0000","last_became_active":"2023-10-25T16:19:54.465742+0000","last_became_peered":"2023-10-25T16:19:54.465742+0000","last_unstale":"2023-10-25T16:19:54.466705+0000","last_undegraded":"2023-10-25T16:19:54.466705+0000","last_fullsized":"2023-10-25T16:19:54.466705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:45:47.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:53.394237+0000","last_change":"2023-10-25T16:19:53.394237+0000","last_active":"2023-10-25T16:19:53.394237+0000","last_peered":"2023-10-25T16:19:53.394237+0000","last_clean":"2023-10-25T16:19:53.394237+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:53.394237+0000","last_undegraded":"2023-10-25T16:19:53.394237+0000","last_fullsized":"2023-10-25T16:19:53.394237+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.712152+0000","last_change":"2023-10-25T16:19:53.422733+0000","last_active":"2023-10-25T16:19:54.712152+0000","last_peered":"2023-10-25T16:19:54.712152+0000","last_clean":"2023-10-25T16:19:54.712152+0000","last_became_active":"2023-10-25T16:19:53.420621+0000","last_became_peered":"2023-10-25T16:19:53.420621+0000","last_unstale":"2023-10-25T16:19:54.712152+0000","last_undegraded":"2023-10-25T16:19:54.712152+0000","last_fullsized":"2023-10-25T16:19:54.712152+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:01.712031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473418+0000","last_change":"2023-10-25T16:19:54.472785+0000","last_active":"2023-10-25T16:19:54.473418+0000","last_peered":"2023-10-25T16:19:54.473418+0000","last_clean":"2023-10-25T16:19:54.473418+0000","last_became_active":"2023-10-25T16:19:54.472181+0000","last_became_peered":"2023-10-25T16:19:54.472181+0000","last_unstale":"2023-10-25T16:19:54.473418+0000","last_undegraded":"2023-10-25T16:19:54.473418+0000","last_fullsized":"2023-10-25T16:19:54.473418+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:12:28.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457983+0000","last_change":"2023-10-25T16:19:54.456776+0000","last_active":"2023-10-25T16:19:54.457983+0000","last_peered":"2023-10-25T16:19:54.457983+0000","last_clean":"2023-10-25T16:19:54.457983+0000","last_became_active":"2023-10-25T16:19:54.456154+0000","last_became_peered":"2023-10-25T16:19:54.456154+0000","last_unstale":"2023-10-25T16:19:54.457983+0000","last_undegraded":"2023-10-25T16:19:54.457983+0000","last_fullsized":"2023-10-25T16:19:54.457983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703611+0000","last_change":"2023-10-25T16:19:53.428321+0000","last_active":"2023-10-25T16:19:54.703611+0000","last_peered":"2023-10-25T16:19:54.703611+0000","last_clean":"2023-10-25T16:19:54.703611+0000","last_became_active":"2023-10-25T16:19:53.426214+0000","last_became_peered":"2023-10-25T16:19:53.426214+0000","last_unstale":"2023-10-25T16:19:54.703611+0000","last_undegraded":"2023-10-25T16:19:54.703611+0000","last_fullsized":"2023-10-25T16:19:54.703611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:58.054818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440049+0000","last_change":"2023-10-25T16:19:54.439642+0000","last_active":"2023-10-25T16:19:54.440049+0000","last_peered":"2023-10-25T16:19:54.440049+0000","last_clean":"2023-10-25T16:19:54.440049+0000","last_became_active":"2023-10-25T16:19:54.439034+0000","last_became_peered":"2023-10-25T16:19:54.439034+0000","last_unstale":"2023-10-25T16:19:54.440049+0000","last_undegraded":"2023-10-25T16:19:54.440049+0000","last_fullsized":"2023-10-25T16:19:54.440049+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.444323+0000","last_change":"2023-10-25T16:19:53.420424+0000","last_active":"2023-10-25T16:19:54.444323+0000","last_peered":"2023-10-25T16:19:54.444323+0000","last_clean":"2023-10-25T16:19:54.444323+0000","last_became_active":"2023-10-25T16:19:53.418421+0000","last_became_peered":"2023-10-25T16:19:53.418421+0000","last_unstale":"2023-10-25T16:19:54.444323+0000","last_undegraded":"2023-10-25T16:19:54.444323+0000","last_fullsized":"2023-10-25T16:19:54.444323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:09.427824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452795+0000","last_change":"2023-10-25T16:19:54.452630+0000","last_active":"2023-10-25T16:19:54.452795+0000","last_peered":"2023-10-25T16:19:54.452795+0000","last_clean":"2023-10-25T16:19:54.452795+0000","last_became_active":"2023-10-25T16:19:54.448173+0000","last_became_peered":"2023-10-25T16:19:54.448173+0000","last_unstale":"2023-10-25T16:19:54.452795+0000","last_undegraded":"2023-10-25T16:19:54.452795+0000","last_fullsized":"2023-10-25T16:19:54.452795+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:52.905840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.708198+0000","last_change":"2023-10-25T16:19:53.426370+0000","last_active":"2023-10-25T16:19:54.708198+0000","last_peered":"2023-10-25T16:19:54.708198+0000","last_clean":"2023-10-25T16:19:54.708198+0000","last_became_active":"2023-10-25T16:19:53.425764+0000","last_became_peered":"2023-10-25T16:19:53.425764+0000","last_unstale":"2023-10-25T16:19:54.708198+0000","last_undegraded":"2023-10-25T16:19:54.708198+0000","last_fullsized":"2023-10-25T16:19:54.708198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:45.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472116+0000","last_change":"2023-10-25T16:19:54.470877+0000","last_active":"2023-10-25T16:19:54.472116+0000","last_peered":"2023-10-25T16:19:54.472116+0000","last_clean":"2023-10-25T16:19:54.472116+0000","last_became_active":"2023-10-25T16:19:54.466660+0000","last_became_peered":"2023-10-25T16:19:54.466660+0000","last_unstale":"2023-10-25T16:19:54.472116+0000","last_undegraded":"2023-10-25T16:19:54.472116+0000","last_fullsized":"2023-10-25T16:19:54.472116+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:10.091615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458790+0000","last_change":"2023-10-25T16:19:54.458538+0000","last_active":"2023-10-25T16:19:54.458790+0000","last_peered":"2023-10-25T16:19:54.458790+0000","last_clean":"2023-10-25T16:19:54.458790+0000","last_became_active":"2023-10-25T16:19:54.457929+0000","last_became_peered":"2023-10-25T16:19:54.457929+0000","last_unstale":"2023-10-25T16:19:54.458790+0000","last_undegraded":"2023-10-25T16:19:54.458790+0000","last_fullsized":"2023-10-25T16:19:54.458790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:18.577710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458365+0000","last_change":"2023-10-25T16:19:53.431122+0000","last_active":"2023-10-25T16:19:54.458365+0000","last_peered":"2023-10-25T16:19:54.458365+0000","last_clean":"2023-10-25T16:19:54.458365+0000","last_became_active":"2023-10-25T16:19:53.430508+0000","last_became_peered":"2023-10-25T16:19:53.430508+0000","last_unstale":"2023-10-25T16:19:54.458365+0000","last_undegraded":"2023-10-25T16:19:54.458365+0000","last_fullsized":"2023-10-25T16:19:54.458365+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:53.141269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455869+0000","last_change":"2023-10-25T16:19:54.454215+0000","last_active":"2023-10-25T16:19:54.455869+0000","last_peered":"2023-10-25T16:19:54.455869+0000","last_clean":"2023-10-25T16:19:54.455869+0000","last_became_active":"2023-10-25T16:19:54.452463+0000","last_became_peered":"2023-10-25T16:19:54.452463+0000","last_unstale":"2023-10-25T16:19:54.455869+0000","last_undegraded":"2023-10-25T16:19:54.455869+0000","last_fullsized":"2023-10-25T16:19:54.455869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442423+0000","last_change":"2023-10-25T16:19:53.431258+0000","last_active":"2023-10-25T16:19:54.442423+0000","last_peered":"2023-10-25T16:19:54.442423+0000","last_clean":"2023-10-25T16:19:54.442423+0000","last_became_active":"2023-10-25T16:19:53.430185+0000","last_became_peered":"2023-10-25T16:19:53.430185+0000","last_unstale":"2023-10-25T16:19:54.442423+0000","last_undegraded":"2023-10-25T16:19:54.442423+0000","last_fullsized":"2023-10-25T16:19:54.442423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:54:14.517117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.475198+0000","last_change":"2023-10-25T16:19:54.475021+0000","last_active":"2023-10-25T16:19:54.475198+0000","last_peered":"2023-10-25T16:19:54.475198+0000","last_clean":"2023-10-25T16:19:54.475198+0000","last_became_active":"2023-10-25T16:19:54.474608+0000","last_became_peered":"2023-10-25T16:19:54.474608+0000","last_unstale":"2023-10-25T16:19:54.475198+0000","last_undegraded":"2023-10-25T16:19:54.475198+0000","last_fullsized":"2023-10-25T16:19:54.475198+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:58:22.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.710156+0000","last_change":"2023-10-25T16:19:53.414277+0000","last_active":"2023-10-25T16:19:54.710156+0000","last_peered":"2023-10-25T16:19:54.710156+0000","last_clean":"2023-10-25T16:19:54.710156+0000","last_became_active":"2023-10-25T16:19:53.413965+0000","last_became_peered":"2023-10-25T16:19:53.413965+0000","last_unstale":"2023-10-25T16:19:54.710156+0000","last_undegraded":"2023-10-25T16:19:54.710156+0000","last_fullsized":"2023-10-25T16:19:54.710156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:50.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467776+0000","last_change":"2023-10-25T16:19:54.467618+0000","last_active":"2023-10-25T16:19:54.467776+0000","last_peered":"2023-10-25T16:19:54.467776+0000","last_clean":"2023-10-25T16:19:54.467776+0000","last_became_active":"2023-10-25T16:19:54.466936+0000","last_became_peered":"2023-10-25T16:19:54.466936+0000","last_unstale":"2023-10-25T16:19:54.467776+0000","last_undegraded":"2023-10-25T16:19:54.467776+0000","last_fullsized":"2023-10-25T16:19:54.467776+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:46.123344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452904+0000","last_change":"2023-10-25T16:19:53.416392+0000","last_active":"2023-10-25T16:19:54.452904+0000","last_peered":"2023-10-25T16:19:54.452904+0000","last_clean":"2023-10-25T16:19:54.452904+0000","last_became_active":"2023-10-25T16:19:53.415622+0000","last_became_peered":"2023-10-25T16:19:53.415622+0000","last_unstale":"2023-10-25T16:19:54.452904+0000","last_undegraded":"2023-10-25T16:19:54.452904+0000","last_fullsized":"2023-10-25T16:19:54.452904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:27.082841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464607+0000","last_change":"2023-10-25T16:19:54.464430+0000","last_active":"2023-10-25T16:19:54.464607+0000","last_peered":"2023-10-25T16:19:54.464607+0000","last_clean":"2023-10-25T16:19:54.464607+0000","last_became_active":"2023-10-25T16:19:54.460534+0000","last_became_peered":"2023-10-25T16:19:54.460534+0000","last_unstale":"2023-10-25T16:19:54.464607+0000","last_undegraded":"2023-10-25T16:19:54.464607+0000","last_fullsized":"2023-10-25T16:19:54.464607+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446604+0000","last_change":"2023-10-25T16:19:53.424091+0000","last_active":"2023-10-25T16:19:54.446604+0000","last_peered":"2023-10-25T16:19:54.446604+0000","last_clean":"2023-10-25T16:19:54.446604+0000","last_became_active":"2023-10-25T16:19:53.423484+0000","last_became_peered":"2023-10-25T16:19:53.423484+0000","last_unstale":"2023-10-25T16:19:54.446604+0000","last_undegraded":"2023-10-25T16:19:54.446604+0000","last_fullsized":"2023-10-25T16:19:54.446604+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:44.149035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472323+0000","last_change":"2023-10-25T16:19:54.472192+0000","last_active":"2023-10-25T16:19:54.472323+0000","last_peered":"2023-10-25T16:19:54.472323+0000","last_clean":"2023-10-25T16:19:54.472323+0000","last_became_active":"2023-10-25T16:19:54.471674+0000","last_became_peered":"2023-10-25T16:19:54.471674+0000","last_unstale":"2023-10-25T16:19:54.472323+0000","last_undegraded":"2023-10-25T16:19:54.472323+0000","last_fullsized":"2023-10-25T16:19:54.472323+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445917+0000","last_change":"2023-10-25T16:19:53.424477+0000","last_active":"2023-10-25T16:19:54.445917+0000","last_peered":"2023-10-25T16:19:54.445917+0000","last_clean":"2023-10-25T16:19:54.445917+0000","last_became_active":"2023-10-25T16:19:53.424258+0000","last_became_peered":"2023-10-25T16:19:53.424258+0000","last_unstale":"2023-10-25T16:19:54.445917+0000","last_undegraded":"2023-10-25T16:19:54.445917+0000","last_fullsized":"2023-10-25T16:19:54.445917+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:51.557043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467542+0000","last_change":"2023-10-25T16:19:54.467301+0000","last_active":"2023-10-25T16:19:54.467542+0000","last_peered":"2023-10-25T16:19:54.467542+0000","last_clean":"2023-10-25T16:19:54.467542+0000","last_became_active":"2023-10-25T16:19:54.461393+0000","last_became_peered":"2023-10-25T16:19:54.461393+0000","last_unstale":"2023-10-25T16:19:54.467542+0000","last_undegraded":"2023-10-25T16:19:54.467542+0000","last_fullsized":"2023-10-25T16:19:54.467542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:03:18.162726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.437580+0000","last_change":"2023-10-25T16:19:53.418461+0000","last_active":"2023-10-25T16:19:54.437580+0000","last_peered":"2023-10-25T16:19:54.437580+0000","last_clean":"2023-10-25T16:19:54.437580+0000","last_became_active":"2023-10-25T16:19:53.417773+0000","last_became_peered":"2023-10-25T16:19:53.417773+0000","last_unstale":"2023-10-25T16:19:54.437580+0000","last_undegraded":"2023-10-25T16:19:54.437580+0000","last_fullsized":"2023-10-25T16:19:54.437580+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:07.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459135+0000","last_change":"2023-10-25T16:19:54.458996+0000","last_active":"2023-10-25T16:19:54.459135+0000","last_peered":"2023-10-25T16:19:54.459135+0000","last_clean":"2023-10-25T16:19:54.459135+0000","last_became_active":"2023-10-25T16:19:54.458371+0000","last_became_peered":"2023-10-25T16:19:54.458371+0000","last_unstale":"2023-10-25T16:19:54.459135+0000","last_undegraded":"2023-10-25T16:19:54.459135+0000","last_fullsized":"2023-10-25T16:19:54.459135+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:03.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459380+0000","last_change":"2023-10-25T16:19:53.431861+0000","last_active":"2023-10-25T16:19:54.459380+0000","last_peered":"2023-10-25T16:19:54.459380+0000","last_clean":"2023-10-25T16:19:54.459380+0000","last_became_active":"2023-10-25T16:19:53.430078+0000","last_became_peered":"2023-10-25T16:19:53.430078+0000","last_unstale":"2023-10-25T16:19:54.459380+0000","last_undegraded":"2023-10-25T16:19:54.459380+0000","last_fullsized":"2023-10-25T16:19:54.459380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:16.139714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.466000+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.459488+0000","last_became_peered":"2023-10-25T16:19:54.459488+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:08:01.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:19:52.390247+0000","last_change":"2023-10-25T16:19:52.390247+0000","last_active":"2023-10-25T16:19:52.390247+0000","last_peered":"2023-10-25T16:19:52.390247+0000","last_clean":"2023-10-25T16:19:52.390247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:19:52.390247+0000","last_undegraded":"2023-10-25T16:19:52.390247+0000","last_fullsized":"2023-10-25T16:19:52.390247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473964+0000","last_change":"2023-10-25T16:19:54.473782+0000","last_active":"2023-10-25T16:19:54.473964+0000","last_peered":"2023-10-25T16:19:54.473964+0000","last_clean":"2023-10-25T16:19:54.473964+0000","last_became_active":"2023-10-25T16:19:54.470232+0000","last_became_peered":"2023-10-25T16:19:54.470232+0000","last_unstale":"2023-10-25T16:19:54.473964+0000","last_undegraded":"2023-10-25T16:19:54.473964+0000","last_fullsized":"2023-10-25T16:19:54.473964+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:04.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446978+0000","last_change":"2023-10-25T16:19:53.429389+0000","last_active":"2023-10-25T16:19:54.446978+0000","last_peered":"2023-10-25T16:19:54.446978+0000","last_clean":"2023-10-25T16:19:54.446978+0000","last_became_active":"2023-10-25T16:19:53.428712+0000","last_became_peered":"2023-10-25T16:19:53.428712+0000","last_unstale":"2023-10-25T16:19:54.446978+0000","last_undegraded":"2023-10-25T16:19:54.446978+0000","last_fullsized":"2023-10-25T16:19:54.446978+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:56:09.475192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459095+0000","last_change":"2023-10-25T16:19:54.458038+0000","last_active":"2023-10-25T16:19:54.459095+0000","last_peered":"2023-10-25T16:19:54.459095+0000","last_clean":"2023-10-25T16:19:54.459095+0000","last_became_active":"2023-10-25T16:19:54.456866+0000","last_became_peered":"2023-10-25T16:19:54.456866+0000","last_unstale":"2023-10-25T16:19:54.459095+0000","last_undegraded":"2023-10-25T16:19:54.459095+0000","last_fullsized":"2023-10-25T16:19:54.459095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.441904+0000","last_change":"2023-10-25T16:19:53.420809+0000","last_active":"2023-10-25T16:19:54.441904+0000","last_peered":"2023-10-25T16:19:54.441904+0000","last_clean":"2023-10-25T16:19:54.441904+0000","last_became_active":"2023-10-25T16:19:53.419238+0000","last_became_peered":"2023-10-25T16:19:53.419238+0000","last_unstale":"2023-10-25T16:19:54.441904+0000","last_undegraded":"2023-10-25T16:19:54.441904+0000","last_fullsized":"2023-10-25T16:19:54.441904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:44.328241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":280,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-25T16:19:53.402414+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:53.402414+0000","last_peered":"2023-10-25T16:19:53.402414+0000","last_clean":"2023-10-25T16:19:53.402414+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:53.402414+0000","last_undegraded":"2023-10-25T16:19:53.402414+0000","last_fullsized":"2023-10-25T16:19:53.402414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":124,"acting":124,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":50,"acting":50,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":754,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194557,"statfs":{"total":200000000,"available":199227265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":0.435},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.496},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.74099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.1599999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":0.98499999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.874},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.034}]}]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193962,"statfs":{"total":200000000,"available":198618030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":1.004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.875},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":1.0840000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.048},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.179}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":1.02}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.089},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.181},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":1.2170000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.054}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":0.97799999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.93200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":1.046},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.89500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.5},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":1.091}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.083}]},{"osd":2,"last update":"Wed Oct 25 16:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88800000000000001,"15min":0.84199999999999997},"min":{"1min":0.57299999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.341,"5min":1.397,"15min":1.419},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94199999999999995,"15min":0.88400000000000001},"min":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.226}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.624},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1779999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2649999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.206}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194537,"statfs":{"total":200000000,"available":199206716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":0.97499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.84799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":0.872},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.083}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.05},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":0.95399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":1.127}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193969,"statfs":{"total":200000000,"available":198624805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":1.9610000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":2.5880000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":4.1920000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":3.3919999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":4.431},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":2.2970000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":4.5860000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":5.2880000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":3.5649999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":3.8340000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":0.622},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":0.70699999999999996}]}]}],"pool_statfs":[]}} 2023-10-25T16:19:58.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-10-25T16:19:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:53.394237+0000', 'last_change': '2023-10-25T16:19:53.394237+0000', 'last_active': '2023-10-25T16:19:53.394237+0000', 'last_peered': '2023-10-25T16:19:53.394237+0000', 'last_clean': '2023-10-25T16:19:53.394237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:53.394237+0000', 'last_undegraded': '2023-10-25T16:19:53.394237+0000', 'last_fullsized': '2023-10-25T16:19:53.394237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:53.394237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:53.394237+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:53.394237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-10-25T16:19:58.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-10-25T16:19:58.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-10-25T16:19:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-10-25T16:19:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-10-25T16:19:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:53.394237+0000', 'last_change': '2023-10-25T16:19:53.394237+0000', 'last_active': '2023-10-25T16:19:53.394237+0000', 'last_peered': '2023-10-25T16:19:53.394237+0000', 'last_clean': '2023-10-25T16:19:53.394237+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:53.394237+0000', 'last_undegraded': '2023-10-25T16:19:53.394237+0000', 'last_fullsized': '2023-10-25T16:19:53.394237+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:53.394237+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:53.394237+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:53.394237+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-10-25T16:19:58.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-10-25T16:19:58.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-10-25T16:19:58.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:19:52.390247+0000', 'last_change': '2023-10-25T16:19:52.390247+0000', 'last_active': '2023-10-25T16:19:52.390247+0000', 'last_peered': '2023-10-25T16:19:52.390247+0000', 'last_clean': '2023-10-25T16:19:52.390247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:19:52.390247+0000', 'last_undegraded': '2023-10-25T16:19:52.390247+0000', 'last_fullsized': '2023-10-25T16:19:52.390247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'last_clean_scrub_stamp': '2023-10-25T16:19:52.390247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:19:58.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:19:58.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 -- 172.21.15.177:0/64161865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 msgr2=0x7f82600d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 --2- 172.21.15.177:0/64161865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600d1bd0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f82600b3ea0 tx=0x7f825001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 -- 172.21.15.177:0/64161865 shutdown_connections 2023-10-25T16:19:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 --2- 172.21.15.177:0/64161865 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600d1bd0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 --2- 172.21.15.177:0/64161865 >> v2:172.21.15.184:3300/0 conn(0x7f826015eba0 0x7f82600b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 -- 172.21.15.177:0/64161865 >> 172.21.15.177:0/64161865 conn(0x7f826009a5c0 msgr2=0x7f82600d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:58.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 -- 172.21.15.177:0/64161865 shutdown_connections 2023-10-25T16:19:58.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.596+0000 7f826722e640 1 -- 172.21.15.177:0/64161865 wait complete. 2023-10-25T16:19:58.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 Processor -- start 2023-10-25T16:19:58.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- start start 2023-10-25T16:19:58.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82600cdb10 0x7f82600ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f826015eba0 0x7f82600ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c50a0 con 0x7f82600b2120 2023-10-25T16:19:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c4d00 con 0x7f82600cdb10 2023-10-25T16:19:58.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826015a7c0 con 0x7f826015eba0 2023-10-25T16:19:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44268/0 (socket says 172.21.15.177:44268) 2023-10-25T16:19:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 -- 172.21.15.177:0/4027629913 learned_addr learned my addr 172.21.15.177:0/4027629913 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f825ffff640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82600cdb10 0x7f82600ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f82657cb640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f826015eba0 0x7f82600ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 -- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f826015eba0 msgr2=0x7f82600ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f826015eba0 0x7f82600ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 -- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82600cdb10 msgr2=0x7f82600ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82600cdb10 0x7f82600ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 -- 172.21.15.177:0/4027629913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009560 con 0x7f82600b2120 2023-10-25T16:19:58.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f82657cb640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f826015eba0 0x7f82600ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:19:58.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f8264fca640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600c83f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f824800b410 tx=0x7f824800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:58.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248011830 con 0x7f82600b2120 2023-10-25T16:19:58.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8248011a80 con 0x7f82600b2120 2023-10-25T16:19:58.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248011e90 con 0x7f82600b2120 2023-10-25T16:19:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826015aaa0 con 0x7f82600b2120 2023-10-25T16:19:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8260151dc0 con 0x7f82600b2120 2023-10-25T16:19:58.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82600c51e0 con 0x7f82600b2120 2023-10-25T16:19:58.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.600+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f824801a400 con 0x7f82600b2120 2023-10-25T16:19:58.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.604+0000 7f825d7fa640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8240066470 0x7f8240068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.604+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82480841c0 con 0x7f82600b2120 2023-10-25T16:19:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.604+0000 7f825ffff640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8240066470 0x7f8240068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.604+0000 7f825ffff640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8240066470 0x7f8240068930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f82500ae000 tx=0x7f82500b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:58.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.608+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82600c51e0 con 0x7f82600b2120 2023-10-25T16:19:58.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.808+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f82600c51e0 con 0x7f82600b2120 2023-10-25T16:19:58.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f825d7fa640 1 -- 172.21.15.177:0/4027629913 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1505 (secure 0 0 0) 0x7f82600c51e0 con 0x7f82600b2120 2023-10-25T16:19:58.809 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:58.809 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":429,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"unknown","count":9}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":592778,"bytes_used":7469391,"bytes_avail":1592530609,"bytes_total":1600000000,"unknown_pgs_ratio":0.092783503234386444,"write_bytes_sec":3292,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":51,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":155741}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-10-25T16:19:42.746702+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:19:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8240066470 msgr2=0x7f8240068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8240066470 0x7f8240068930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f82500ae000 tx=0x7f82500b3040 comp rx=0 tx=0).stop 2023-10-25T16:19:58.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 msgr2=0x7f82600c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600c83f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f824800b410 tx=0x7f824800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 shutdown_connections 2023-10-25T16:19:58.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8240066470 0x7f8240068930 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f826015eba0 0x7f82600ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82600cdb10 0x7f82600ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 --2- 172.21.15.177:0/4027629913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f82600b2120 0x7f82600c83f0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 >> 172.21.15.177:0/4027629913 conn(0x7f826009a5c0 msgr2=0x7f826015d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:58.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 shutdown_connections 2023-10-25T16:19:58.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.812+0000 7f826722e640 1 -- 172.21.15.177:0/4027629913 wait complete. 2023-10-25T16:19:58.827 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:19:58.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:19:58.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/1804959915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c06b9e0 msgr2=0x7f339c06be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 --2- 172.21.15.177:0/1804959915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c06b9e0 0x7f339c06be30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3394009bc0 tx=0x7f339401cb50 comp rx=0 tx=0).stop 2023-10-25T16:19:58.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/1804959915 shutdown_connections 2023-10-25T16:19:58.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 --2- 172.21.15.177:0/1804959915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c06b9e0 0x7f339c06be30 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 --2- 172.21.15.177:0/1804959915 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f339c1537d0 0x7f339c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/1804959915 >> 172.21.15.177:0/1804959915 conn(0x7f339c0b2450 msgr2=0x7f339c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:58.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/1804959915 shutdown_connections 2023-10-25T16:19:58.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/1804959915 wait complete. 2023-10-25T16:19:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 Processor -- start 2023-10-25T16:19:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- start start 2023-10-25T16:19:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f339c06b9e0 0x7f339c1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 0x7f339c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339c15cdd0 0x7f339c152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c148180 con 0x7f339c1537d0 2023-10-25T16:19:58.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c148420 con 0x7f339c15cdd0 2023-10-25T16:19:58.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c148700 con 0x7f339c06b9e0 2023-10-25T16:19:58.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 0x7f339c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 0x7f339c14d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44286/0 (socket says 172.21.15.177:44286) 2023-10-25T16:19:58.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 -- 172.21.15.177:0/788318624 learned_addr learned my addr 172.21.15.177:0/788318624 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:19:58.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 -- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f339c06b9e0 msgr2=0x7f339c1494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f339c06b9e0 0x7f339c1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 -- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339c15cdd0 msgr2=0x7f339c152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339c15cdd0 0x7f339c152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 -- 172.21.15.177:0/788318624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394009820 con 0x7f339c1537d0 2023-10-25T16:19:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a0ead640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 0x7f339c14d6c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f338c00c3c0 tx=0x7f338c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0054e0 con 0x7f339c1537d0 2023-10-25T16:19:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f338c003600 con 0x7f339c1537d0 2023-10-25T16:19:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c003a30 con 0x7f339c1537d0 2023-10-25T16:19:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c0718c0 con 0x7f339c1537d0 2023-10-25T16:19:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c148cc0 con 0x7f339c1537d0 2023-10-25T16:19:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.948+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c04daf0 con 0x7f339c1537d0 2023-10-25T16:19:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.952+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f338c003b90 con 0x7f339c1537d0 2023-10-25T16:19:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.952+0000 7f3391ffb640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33800664a0 0x7f3380068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:19:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.952+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f338c083560 con 0x7f339c1537d0 2023-10-25T16:19:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.952+0000 7f33a16ae640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33800664a0 0x7f3380068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:19:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.952+0000 7f33a16ae640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33800664a0 0x7f3380068960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f339c147e00 tx=0x7f3398006ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:19:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:58.956+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f338c054470 con 0x7f339c1537d0 2023-10-25T16:19:59.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.096+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f339c071740 con 0x7f33800664a0 2023-10-25T16:19:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.116+0000 7f3391ffb640 1 -- 172.21.15.177:0/788318624 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283805 (secure 0 0 0) 0x7f339800b480 con 0x7f33800664a0 2023-10-25T16:19:59.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:19:59.119 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:19:59.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33800664a0 msgr2=0x7f3380068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:59.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33800664a0 0x7f3380068960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f339c147e00 tx=0x7f3398006ca0 comp rx=0 tx=0).stop 2023-10-25T16:19:59.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 msgr2=0x7f339c14d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:19:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 0x7f339c14d6c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f338c00c3c0 tx=0x7f338c00c880 comp rx=0 tx=0).stop 2023-10-25T16:19:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 shutdown_connections 2023-10-25T16:19:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33800664a0 0x7f3380068960 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f339c15cdd0 0x7f339c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f339c1537d0 0x7f339c14d6c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:59.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 --2- 172.21.15.177:0/788318624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f339c06b9e0 0x7f339c1494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:19:59.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 >> 172.21.15.177:0/788318624 conn(0x7f339c0b2450 msgr2=0x7f339c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:19:59.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 shutdown_connections 2023-10-25T16:19:59.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:19:59.120+0000 7f33a3912640 1 -- 172.21.15.177:0/788318624 wait complete. 2023-10-25T16:19:59.134 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2023-10-25T16:19:58.751082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7318,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555181,"statfs":{"total":1600000000,"available":1592505442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001786"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461879+0000","last_change":"2023-10-25T16:19:54.461727+0000","last_active":"2023-10-25T16:19:54.461879+0000","last_peered":"2023-10-25T16:19:54.461879+0000","last_clean":"2023-10-25T16:19:54.461879+0000","last_became_active":"2023-10-25T16:19:54.460940+0000","last_became_peered":"2023-10-25T16:19:54.460940+0000","last_unstale":"2023-10-25T16:19:54.461879+0000","last_undegraded":"2023-10-25T16:19:54.461879+0000","last_fullsized":"2023-10-25T16:19:54.461879+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.469115+0000","last_change":"2023-10-25T16:19:54.469017+0000","last_active":"2023-10-25T16:19:54.469115+0000","last_peered":"2023-10-25T16:19:54.469115+0000","last_clean":"2023-10-25T16:19:54.469115+0000","last_became_active":"2023-10-25T16:19:54.468147+0000","last_became_peered":"2023-10-25T16:19:54.468147+0000","last_unstale":"2023-10-25T16:19:54.469115+0000","last_undegraded":"2023-10-25T16:19:54.469115+0000","last_fullsized":"2023-10-25T16:19:54.469115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:19:00.692763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.454300+0000","last_change":"2023-10-25T16:19:54.453147+0000","last_active":"2023-10-25T16:19:54.454300+0000","last_peered":"2023-10-25T16:19:54.454300+0000","last_clean":"2023-10-25T16:19:54.454300+0000","last_became_active":"2023-10-25T16:19:54.450106+0000","last_became_peered":"2023-10-25T16:19:54.450106+0000","last_unstale":"2023-10-25T16:19:54.454300+0000","last_undegraded":"2023-10-25T16:19:54.454300+0000","last_fullsized":"2023-10-25T16:19:54.454300+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463967+0000","last_change":"2023-10-25T16:19:54.463763+0000","last_active":"2023-10-25T16:19:54.463967+0000","last_peered":"2023-10-25T16:19:54.463967+0000","last_clean":"2023-10-25T16:19:54.463967+0000","last_became_active":"2023-10-25T16:19:54.452773+0000","last_became_peered":"2023-10-25T16:19:54.452773+0000","last_unstale":"2023-10-25T16:19:54.463967+0000","last_undegraded":"2023-10-25T16:19:54.463967+0000","last_fullsized":"2023-10-25T16:19:54.463967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:54:04.307190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553448+0000","last_change":"2023-10-25T16:19:54.474691+0000","last_active":"2023-10-25T16:19:55.553448+0000","last_peered":"2023-10-25T16:19:55.553448+0000","last_clean":"2023-10-25T16:19:55.553448+0000","last_became_active":"2023-10-25T16:19:54.473381+0000","last_became_peered":"2023-10-25T16:19:54.473381+0000","last_unstale":"2023-10-25T16:19:55.553448+0000","last_undegraded":"2023-10-25T16:19:55.553448+0000","last_fullsized":"2023-10-25T16:19:55.553448+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:21:03.421421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473461+0000","last_change":"2023-10-25T16:19:54.473119+0000","last_active":"2023-10-25T16:19:54.473461+0000","last_peered":"2023-10-25T16:19:54.473461+0000","last_clean":"2023-10-25T16:19:54.473461+0000","last_became_active":"2023-10-25T16:19:54.470943+0000","last_became_peered":"2023-10-25T16:19:54.470943+0000","last_unstale":"2023-10-25T16:19:54.473461+0000","last_undegraded":"2023-10-25T16:19:54.473461+0000","last_fullsized":"2023-10-25T16:19:54.473461+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:00.125788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459374+0000","last_change":"2023-10-25T16:19:54.458805+0000","last_active":"2023-10-25T16:19:54.459374+0000","last_peered":"2023-10-25T16:19:54.459374+0000","last_clean":"2023-10-25T16:19:54.459374+0000","last_became_active":"2023-10-25T16:19:54.457779+0000","last_became_peered":"2023-10-25T16:19:54.457779+0000","last_unstale":"2023-10-25T16:19:54.459374+0000","last_undegraded":"2023-10-25T16:19:54.459374+0000","last_fullsized":"2023-10-25T16:19:54.459374+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:59.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466235+0000","last_change":"2023-10-25T16:19:54.466068+0000","last_active":"2023-10-25T16:19:54.466235+0000","last_peered":"2023-10-25T16:19:54.466235+0000","last_clean":"2023-10-25T16:19:54.466235+0000","last_became_active":"2023-10-25T16:19:54.464713+0000","last_became_peered":"2023-10-25T16:19:54.464713+0000","last_unstale":"2023-10-25T16:19:54.466235+0000","last_undegraded":"2023-10-25T16:19:54.466235+0000","last_fullsized":"2023-10-25T16:19:54.466235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:09.855686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464284+0000","last_change":"2023-10-25T16:19:54.464139+0000","last_active":"2023-10-25T16:19:54.464284+0000","last_peered":"2023-10-25T16:19:54.464284+0000","last_clean":"2023-10-25T16:19:54.464284+0000","last_became_active":"2023-10-25T16:19:54.453425+0000","last_became_peered":"2023-10-25T16:19:54.453425+0000","last_unstale":"2023-10-25T16:19:54.464284+0000","last_undegraded":"2023-10-25T16:19:54.464284+0000","last_fullsized":"2023-10-25T16:19:54.464284+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:59.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.474708+0000","last_change":"2023-10-25T16:19:54.474546+0000","last_active":"2023-10-25T16:19:54.474708+0000","last_peered":"2023-10-25T16:19:54.474708+0000","last_clean":"2023-10-25T16:19:54.474708+0000","last_became_active":"2023-10-25T16:19:54.469302+0000","last_became_peered":"2023-10-25T16:19:54.469302+0000","last_unstale":"2023-10-25T16:19:54.474708+0000","last_undegraded":"2023-10-25T16:19:54.474708+0000","last_fullsized":"2023-10-25T16:19:54.474708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463484+0000","last_change":"2023-10-25T16:19:54.463337+0000","last_active":"2023-10-25T16:19:54.463484+0000","last_peered":"2023-10-25T16:19:54.463484+0000","last_clean":"2023-10-25T16:19:54.463484+0000","last_became_active":"2023-10-25T16:19:54.462731+0000","last_became_peered":"2023-10-25T16:19:54.462731+0000","last_unstale":"2023-10-25T16:19:54.463484+0000","last_undegraded":"2023-10-25T16:19:54.463484+0000","last_fullsized":"2023-10-25T16:19:54.463484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:36:29.886246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463916+0000","last_change":"2023-10-25T16:19:54.463581+0000","last_active":"2023-10-25T16:19:54.463916+0000","last_peered":"2023-10-25T16:19:54.463916+0000","last_clean":"2023-10-25T16:19:54.463916+0000","last_became_active":"2023-10-25T16:19:54.462904+0000","last_became_peered":"2023-10-25T16:19:54.462904+0000","last_unstale":"2023-10-25T16:19:54.463916+0000","last_undegraded":"2023-10-25T16:19:54.463916+0000","last_fullsized":"2023-10-25T16:19:54.463916+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:11:08.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465865+0000","last_change":"2023-10-25T16:19:54.465565+0000","last_active":"2023-10-25T16:19:54.465865+0000","last_peered":"2023-10-25T16:19:54.465865+0000","last_clean":"2023-10-25T16:19:54.465865+0000","last_became_active":"2023-10-25T16:19:54.462990+0000","last_became_peered":"2023-10-25T16:19:54.462990+0000","last_unstale":"2023-10-25T16:19:54.465865+0000","last_undegraded":"2023-10-25T16:19:54.465865+0000","last_fullsized":"2023-10-25T16:19:54.465865+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:24.299112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466831+0000","last_change":"2023-10-25T16:19:54.466678+0000","last_active":"2023-10-25T16:19:54.466831+0000","last_peered":"2023-10-25T16:19:54.466831+0000","last_clean":"2023-10-25T16:19:54.466831+0000","last_became_active":"2023-10-25T16:19:54.461209+0000","last_became_peered":"2023-10-25T16:19:54.461209+0000","last_unstale":"2023-10-25T16:19:54.466831+0000","last_undegraded":"2023-10-25T16:19:54.466831+0000","last_fullsized":"2023-10-25T16:19:54.466831+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:51.803048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472670+0000","last_change":"2023-10-25T16:19:54.469012+0000","last_active":"2023-10-25T16:19:54.472670+0000","last_peered":"2023-10-25T16:19:54.472670+0000","last_clean":"2023-10-25T16:19:54.472670+0000","last_became_active":"2023-10-25T16:19:54.468016+0000","last_became_peered":"2023-10-25T16:19:54.468016+0000","last_unstale":"2023-10-25T16:19:54.472670+0000","last_undegraded":"2023-10-25T16:19:54.472670+0000","last_fullsized":"2023-10-25T16:19:54.472670+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:43.001368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450772+0000","last_change":"2023-10-25T16:19:54.448406+0000","last_active":"2023-10-25T16:19:54.450772+0000","last_peered":"2023-10-25T16:19:54.450772+0000","last_clean":"2023-10-25T16:19:54.450772+0000","last_became_active":"2023-10-25T16:19:54.446860+0000","last_became_peered":"2023-10-25T16:19:54.446860+0000","last_unstale":"2023-10-25T16:19:54.450772+0000","last_undegraded":"2023-10-25T16:19:54.450772+0000","last_fullsized":"2023-10-25T16:19:54.450772+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:28.086832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468918+0000","last_change":"2023-10-25T16:19:54.468783+0000","last_active":"2023-10-25T16:19:54.468918+0000","last_peered":"2023-10-25T16:19:54.468918+0000","last_clean":"2023-10-25T16:19:54.468918+0000","last_became_active":"2023-10-25T16:19:54.466677+0000","last_became_peered":"2023-10-25T16:19:54.466677+0000","last_unstale":"2023-10-25T16:19:54.468918+0000","last_undegraded":"2023-10-25T16:19:54.468918+0000","last_fullsized":"2023-10-25T16:19:54.468918+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:09.856536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461773+0000","last_change":"2023-10-25T16:19:54.461443+0000","last_active":"2023-10-25T16:19:54.461773+0000","last_peered":"2023-10-25T16:19:54.461773+0000","last_clean":"2023-10-25T16:19:54.461773+0000","last_became_active":"2023-10-25T16:19:54.460838+0000","last_became_peered":"2023-10-25T16:19:54.460838+0000","last_unstale":"2023-10-25T16:19:54.461773+0000","last_undegraded":"2023-10-25T16:19:54.461773+0000","last_fullsized":"2023-10-25T16:19:54.461773+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467213+0000","last_change":"2023-10-25T16:19:54.467062+0000","last_active":"2023-10-25T16:19:54.467213+0000","last_peered":"2023-10-25T16:19:54.467213+0000","last_clean":"2023-10-25T16:19:54.467213+0000","last_became_active":"2023-10-25T16:19:54.464502+0000","last_became_peered":"2023-10-25T16:19:54.464502+0000","last_unstale":"2023-10-25T16:19:54.467213+0000","last_undegraded":"2023-10-25T16:19:54.467213+0000","last_fullsized":"2023-10-25T16:19:54.467213+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456701+0000","last_change":"2023-10-25T16:19:54.451503+0000","last_active":"2023-10-25T16:19:54.456701+0000","last_peered":"2023-10-25T16:19:54.456701+0000","last_clean":"2023-10-25T16:19:54.456701+0000","last_became_active":"2023-10-25T16:19:54.450896+0000","last_became_peered":"2023-10-25T16:19:54.450896+0000","last_unstale":"2023-10-25T16:19:54.456701+0000","last_undegraded":"2023-10-25T16:19:54.456701+0000","last_fullsized":"2023-10-25T16:19:54.456701+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:43:37.602014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456649+0000","last_change":"2023-10-25T16:19:54.450150+0000","last_active":"2023-10-25T16:19:54.456649+0000","last_peered":"2023-10-25T16:19:54.456649+0000","last_clean":"2023-10-25T16:19:54.456649+0000","last_became_active":"2023-10-25T16:19:54.449509+0000","last_became_peered":"2023-10-25T16:19:54.449509+0000","last_unstale":"2023-10-25T16:19:54.456649+0000","last_undegraded":"2023-10-25T16:19:54.456649+0000","last_fullsized":"2023-10-25T16:19:54.456649+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:16:43.655185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459145+0000","last_change":"2023-10-25T16:19:54.458648+0000","last_active":"2023-10-25T16:19:54.459145+0000","last_peered":"2023-10-25T16:19:54.459145+0000","last_clean":"2023-10-25T16:19:54.459145+0000","last_became_active":"2023-10-25T16:19:54.457941+0000","last_became_peered":"2023-10-25T16:19:54.457941+0000","last_unstale":"2023-10-25T16:19:54.459145+0000","last_undegraded":"2023-10-25T16:19:54.459145+0000","last_fullsized":"2023-10-25T16:19:54.459145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:29:59.455072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457978+0000","last_change":"2023-10-25T16:19:54.457827+0000","last_active":"2023-10-25T16:19:54.457978+0000","last_peered":"2023-10-25T16:19:54.457978+0000","last_clean":"2023-10-25T16:19:54.457978+0000","last_became_active":"2023-10-25T16:19:54.456641+0000","last_became_peered":"2023-10-25T16:19:54.456641+0000","last_unstale":"2023-10-25T16:19:54.457978+0000","last_undegraded":"2023-10-25T16:19:54.457978+0000","last_fullsized":"2023-10-25T16:19:54.457978+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:24:52.812391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468333+0000","last_change":"2023-10-25T16:19:54.468145+0000","last_active":"2023-10-25T16:19:54.468333+0000","last_peered":"2023-10-25T16:19:54.468333+0000","last_clean":"2023-10-25T16:19:54.468333+0000","last_became_active":"2023-10-25T16:19:54.464664+0000","last_became_peered":"2023-10-25T16:19:54.464664+0000","last_unstale":"2023-10-25T16:19:54.468333+0000","last_undegraded":"2023-10-25T16:19:54.468333+0000","last_fullsized":"2023-10-25T16:19:54.468333+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:23.996474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456802+0000","last_change":"2023-10-25T16:19:54.454986+0000","last_active":"2023-10-25T16:19:54.456802+0000","last_peered":"2023-10-25T16:19:54.456802+0000","last_clean":"2023-10-25T16:19:54.456802+0000","last_became_active":"2023-10-25T16:19:54.454308+0000","last_became_peered":"2023-10-25T16:19:54.454308+0000","last_unstale":"2023-10-25T16:19:54.456802+0000","last_undegraded":"2023-10-25T16:19:54.456802+0000","last_fullsized":"2023-10-25T16:19:54.456802+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:45:22.751967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450823+0000","last_change":"2023-10-25T16:19:54.448801+0000","last_active":"2023-10-25T16:19:54.450823+0000","last_peered":"2023-10-25T16:19:54.450823+0000","last_clean":"2023-10-25T16:19:54.450823+0000","last_became_active":"2023-10-25T16:19:54.447799+0000","last_became_peered":"2023-10-25T16:19:54.447799+0000","last_unstale":"2023-10-25T16:19:54.450823+0000","last_undegraded":"2023-10-25T16:19:54.450823+0000","last_fullsized":"2023-10-25T16:19:54.450823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:56.732275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466858+0000","last_change":"2023-10-25T16:19:54.466672+0000","last_active":"2023-10-25T16:19:54.466858+0000","last_peered":"2023-10-25T16:19:54.466858+0000","last_clean":"2023-10-25T16:19:54.466858+0000","last_became_active":"2023-10-25T16:19:54.465394+0000","last_became_peered":"2023-10-25T16:19:54.465394+0000","last_unstale":"2023-10-25T16:19:54.466858+0000","last_undegraded":"2023-10-25T16:19:54.466858+0000","last_fullsized":"2023-10-25T16:19:54.466858+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:55.228229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455819+0000","last_change":"2023-10-25T16:19:54.454070+0000","last_active":"2023-10-25T16:19:54.455819+0000","last_peered":"2023-10-25T16:19:54.455819+0000","last_clean":"2023-10-25T16:19:54.455819+0000","last_became_active":"2023-10-25T16:19:54.453409+0000","last_became_peered":"2023-10-25T16:19:54.453409+0000","last_unstale":"2023-10-25T16:19:54.455819+0000","last_undegraded":"2023-10-25T16:19:54.455819+0000","last_fullsized":"2023-10-25T16:19:54.455819+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456849+0000","last_change":"2023-10-25T16:19:54.455923+0000","last_active":"2023-10-25T16:19:54.456849+0000","last_peered":"2023-10-25T16:19:54.456849+0000","last_clean":"2023-10-25T16:19:54.456849+0000","last_became_active":"2023-10-25T16:19:54.455216+0000","last_became_peered":"2023-10-25T16:19:54.455216+0000","last_unstale":"2023-10-25T16:19:54.456849+0000","last_undegraded":"2023-10-25T16:19:54.456849+0000","last_fullsized":"2023-10-25T16:19:54.456849+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:36.251915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.447574+0000","last_change":"2023-10-25T16:19:54.447434+0000","last_active":"2023-10-25T16:19:54.447574+0000","last_peered":"2023-10-25T16:19:54.447574+0000","last_clean":"2023-10-25T16:19:54.447574+0000","last_became_active":"2023-10-25T16:19:54.446808+0000","last_became_peered":"2023-10-25T16:19:54.446808+0000","last_unstale":"2023-10-25T16:19:54.447574+0000","last_undegraded":"2023-10-25T16:19:54.447574+0000","last_fullsized":"2023-10-25T16:19:54.447574+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:25.646957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458359+0000","last_change":"2023-10-25T16:19:54.458170+0000","last_active":"2023-10-25T16:19:54.458359+0000","last_peered":"2023-10-25T16:19:54.458359+0000","last_clean":"2023-10-25T16:19:54.458359+0000","last_became_active":"2023-10-25T16:19:54.449443+0000","last_became_peered":"2023-10-25T16:19:54.449443+0000","last_unstale":"2023-10-25T16:19:54.458359+0000","last_undegraded":"2023-10-25T16:19:54.458359+0000","last_fullsized":"2023-10-25T16:19:54.458359+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:44.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466299+0000","last_change":"2023-10-25T16:19:54.466137+0000","last_active":"2023-10-25T16:19:54.466299+0000","last_peered":"2023-10-25T16:19:54.466299+0000","last_clean":"2023-10-25T16:19:54.466299+0000","last_became_active":"2023-10-25T16:19:54.464568+0000","last_became_peered":"2023-10-25T16:19:54.464568+0000","last_unstale":"2023-10-25T16:19:54.466299+0000","last_undegraded":"2023-10-25T16:19:54.466299+0000","last_fullsized":"2023-10-25T16:19:54.466299+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:25.698386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.461169+0000","last_change":"2023-10-25T16:19:54.460492+0000","last_active":"2023-10-25T16:19:54.461169+0000","last_peered":"2023-10-25T16:19:54.461169+0000","last_clean":"2023-10-25T16:19:54.461169+0000","last_became_active":"2023-10-25T16:19:54.459828+0000","last_became_peered":"2023-10-25T16:19:54.459828+0000","last_unstale":"2023-10-25T16:19:54.461169+0000","last_undegraded":"2023-10-25T16:19:54.461169+0000","last_fullsized":"2023-10-25T16:19:54.461169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:56:23.557613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705568+0000","last_change":"2023-10-25T16:19:53.408435+0000","last_active":"2023-10-25T16:19:54.705568+0000","last_peered":"2023-10-25T16:19:54.705568+0000","last_clean":"2023-10-25T16:19:54.705568+0000","last_became_active":"2023-10-25T16:19:53.407353+0000","last_became_peered":"2023-10-25T16:19:53.407353+0000","last_unstale":"2023-10-25T16:19:54.705568+0000","last_undegraded":"2023-10-25T16:19:54.705568+0000","last_fullsized":"2023-10-25T16:19:54.705568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:48:13.615155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457968+0000","last_change":"2023-10-25T16:19:54.457803+0000","last_active":"2023-10-25T16:19:54.457968+0000","last_peered":"2023-10-25T16:19:54.457968+0000","last_clean":"2023-10-25T16:19:54.457968+0000","last_became_active":"2023-10-25T16:19:54.457190+0000","last_became_peered":"2023-10-25T16:19:54.457190+0000","last_unstale":"2023-10-25T16:19:54.457968+0000","last_undegraded":"2023-10-25T16:19:54.457968+0000","last_fullsized":"2023-10-25T16:19:54.457968+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703698+0000","last_change":"2023-10-25T16:19:53.407966+0000","last_active":"2023-10-25T16:19:54.703698+0000","last_peered":"2023-10-25T16:19:54.703698+0000","last_clean":"2023-10-25T16:19:54.703698+0000","last_became_active":"2023-10-25T16:19:53.407333+0000","last_became_peered":"2023-10-25T16:19:53.407333+0000","last_unstale":"2023-10-25T16:19:54.703698+0000","last_undegraded":"2023-10-25T16:19:54.703698+0000","last_fullsized":"2023-10-25T16:19:54.703698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:01.501634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473363+0000","last_change":"2023-10-25T16:19:54.471618+0000","last_active":"2023-10-25T16:19:54.473363+0000","last_peered":"2023-10-25T16:19:54.473363+0000","last_clean":"2023-10-25T16:19:54.473363+0000","last_became_active":"2023-10-25T16:19:54.470001+0000","last_became_peered":"2023-10-25T16:19:54.470001+0000","last_unstale":"2023-10-25T16:19:54.473363+0000","last_undegraded":"2023-10-25T16:19:54.473363+0000","last_fullsized":"2023-10-25T16:19:54.473363+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:27:32.794532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"142'2","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554210+0000","last_change":"2023-10-25T16:19:53.426629+0000","last_active":"2023-10-25T16:19:55.554210+0000","last_peered":"2023-10-25T16:19:55.554210+0000","last_clean":"2023-10-25T16:19:55.554210+0000","last_became_active":"2023-10-25T16:19:53.426403+0000","last_became_peered":"2023-10-25T16:19:53.426403+0000","last_unstale":"2023-10-25T16:19:55.554210+0000","last_undegraded":"2023-10-25T16:19:55.554210+0000","last_fullsized":"2023-10-25T16:19:55.554210+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:43.593371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464451+0000","last_change":"2023-10-25T16:19:54.464303+0000","last_active":"2023-10-25T16:19:54.464451+0000","last_peered":"2023-10-25T16:19:54.464451+0000","last_clean":"2023-10-25T16:19:54.464451+0000","last_became_active":"2023-10-25T16:19:54.463645+0000","last_became_peered":"2023-10-25T16:19:54.463645+0000","last_unstale":"2023-10-25T16:19:54.464451+0000","last_undegraded":"2023-10-25T16:19:54.464451+0000","last_fullsized":"2023-10-25T16:19:54.464451+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:52.561033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"142'2","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554601+0000","last_change":"2023-10-25T16:19:53.427454+0000","last_active":"2023-10-25T16:19:55.554601+0000","last_peered":"2023-10-25T16:19:55.554601+0000","last_clean":"2023-10-25T16:19:55.554601+0000","last_became_active":"2023-10-25T16:19:53.426405+0000","last_became_peered":"2023-10-25T16:19:53.426405+0000","last_unstale":"2023-10-25T16:19:55.554601+0000","last_undegraded":"2023-10-25T16:19:55.554601+0000","last_fullsized":"2023-10-25T16:19:55.554601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:46:43.866540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.450869+0000","last_change":"2023-10-25T16:19:54.450631+0000","last_active":"2023-10-25T16:19:54.450869+0000","last_peered":"2023-10-25T16:19:54.450869+0000","last_clean":"2023-10-25T16:19:54.450869+0000","last_became_active":"2023-10-25T16:19:54.449923+0000","last_became_peered":"2023-10-25T16:19:54.449923+0000","last_unstale":"2023-10-25T16:19:54.450869+0000","last_undegraded":"2023-10-25T16:19:54.450869+0000","last_fullsized":"2023-10-25T16:19:54.450869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:59.058809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705246+0000","last_change":"2023-10-25T16:19:53.423223+0000","last_active":"2023-10-25T16:19:54.705246+0000","last_peered":"2023-10-25T16:19:54.705246+0000","last_clean":"2023-10-25T16:19:54.705246+0000","last_became_active":"2023-10-25T16:19:53.421712+0000","last_became_peered":"2023-10-25T16:19:53.421712+0000","last_unstale":"2023-10-25T16:19:54.705246+0000","last_undegraded":"2023-10-25T16:19:54.705246+0000","last_fullsized":"2023-10-25T16:19:54.705246+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:08.239214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.468631+0000","last_change":"2023-10-25T16:19:54.468481+0000","last_active":"2023-10-25T16:19:54.468631+0000","last_peered":"2023-10-25T16:19:54.468631+0000","last_clean":"2023-10-25T16:19:54.468631+0000","last_became_active":"2023-10-25T16:19:54.465812+0000","last_became_peered":"2023-10-25T16:19:54.465812+0000","last_unstale":"2023-10-25T16:19:54.468631+0000","last_undegraded":"2023-10-25T16:19:54.468631+0000","last_fullsized":"2023-10-25T16:19:54.468631+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:10.100720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.705601+0000","last_change":"2023-10-25T16:19:53.431077+0000","last_active":"2023-10-25T16:19:54.705601+0000","last_peered":"2023-10-25T16:19:54.705601+0000","last_clean":"2023-10-25T16:19:54.705601+0000","last_became_active":"2023-10-25T16:19:53.430825+0000","last_became_peered":"2023-10-25T16:19:53.430825+0000","last_unstale":"2023-10-25T16:19:54.705601+0000","last_undegraded":"2023-10-25T16:19:54.705601+0000","last_fullsized":"2023-10-25T16:19:54.705601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:17.573720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465347+0000","last_change":"2023-10-25T16:19:54.464983+0000","last_active":"2023-10-25T16:19:54.465347+0000","last_peered":"2023-10-25T16:19:54.465347+0000","last_clean":"2023-10-25T16:19:54.465347+0000","last_became_active":"2023-10-25T16:19:54.461758+0000","last_became_peered":"2023-10-25T16:19:54.461758+0000","last_unstale":"2023-10-25T16:19:54.465347+0000","last_undegraded":"2023-10-25T16:19:54.465347+0000","last_fullsized":"2023-10-25T16:19:54.465347+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442024+0000","last_change":"2023-10-25T16:19:53.419217+0000","last_active":"2023-10-25T16:19:54.442024+0000","last_peered":"2023-10-25T16:19:54.442024+0000","last_clean":"2023-10-25T16:19:54.442024+0000","last_became_active":"2023-10-25T16:19:53.418429+0000","last_became_peered":"2023-10-25T16:19:53.418429+0000","last_unstale":"2023-10-25T16:19:54.442024+0000","last_undegraded":"2023-10-25T16:19:54.442024+0000","last_fullsized":"2023-10-25T16:19:54.442024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:53:13.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.456035+0000","last_change":"2023-10-25T16:19:54.455866+0000","last_active":"2023-10-25T16:19:54.456035+0000","last_peered":"2023-10-25T16:19:54.456035+0000","last_clean":"2023-10-25T16:19:54.456035+0000","last_became_active":"2023-10-25T16:19:54.455162+0000","last_became_peered":"2023-10-25T16:19:54.455162+0000","last_unstale":"2023-10-25T16:19:54.456035+0000","last_undegraded":"2023-10-25T16:19:54.456035+0000","last_fullsized":"2023-10-25T16:19:54.456035+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:45:51.961812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446981+0000","last_change":"2023-10-25T16:19:53.419508+0000","last_active":"2023-10-25T16:19:54.446981+0000","last_peered":"2023-10-25T16:19:54.446981+0000","last_clean":"2023-10-25T16:19:54.446981+0000","last_became_active":"2023-10-25T16:19:53.418740+0000","last_became_peered":"2023-10-25T16:19:53.418740+0000","last_unstale":"2023-10-25T16:19:54.446981+0000","last_undegraded":"2023-10-25T16:19:54.446981+0000","last_fullsized":"2023-10-25T16:19:54.446981+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:45.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.463926+0000","last_change":"2023-10-25T16:19:54.463626+0000","last_active":"2023-10-25T16:19:54.463926+0000","last_peered":"2023-10-25T16:19:54.463926+0000","last_clean":"2023-10-25T16:19:54.463926+0000","last_became_active":"2023-10-25T16:19:54.462999+0000","last_became_peered":"2023-10-25T16:19:54.462999+0000","last_unstale":"2023-10-25T16:19:54.463926+0000","last_undegraded":"2023-10-25T16:19:54.463926+0000","last_fullsized":"2023-10-25T16:19:54.463926+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:35.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554708+0000","last_change":"2023-10-25T16:19:53.427105+0000","last_active":"2023-10-25T16:19:55.554708+0000","last_peered":"2023-10-25T16:19:55.554708+0000","last_clean":"2023-10-25T16:19:55.554708+0000","last_became_active":"2023-10-25T16:19:53.425534+0000","last_became_peered":"2023-10-25T16:19:53.425534+0000","last_unstale":"2023-10-25T16:19:55.554708+0000","last_undegraded":"2023-10-25T16:19:55.554708+0000","last_fullsized":"2023-10-25T16:19:55.554708+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:36:03.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.465155+0000","last_change":"2023-10-25T16:19:54.465003+0000","last_active":"2023-10-25T16:19:54.465155+0000","last_peered":"2023-10-25T16:19:54.465155+0000","last_clean":"2023-10-25T16:19:54.465155+0000","last_became_active":"2023-10-25T16:19:54.463043+0000","last_became_peered":"2023-10-25T16:19:54.463043+0000","last_unstale":"2023-10-25T16:19:54.465155+0000","last_undegraded":"2023-10-25T16:19:54.465155+0000","last_fullsized":"2023-10-25T16:19:54.465155+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440427+0000","last_change":"2023-10-25T16:19:53.417480+0000","last_active":"2023-10-25T16:19:54.440427+0000","last_peered":"2023-10-25T16:19:54.440427+0000","last_clean":"2023-10-25T16:19:54.440427+0000","last_became_active":"2023-10-25T16:19:53.417160+0000","last_became_peered":"2023-10-25T16:19:53.417160+0000","last_unstale":"2023-10-25T16:19:54.440427+0000","last_undegraded":"2023-10-25T16:19:54.440427+0000","last_fullsized":"2023-10-25T16:19:54.440427+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:44.282469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449332+0000","last_change":"2023-10-25T16:19:54.448364+0000","last_active":"2023-10-25T16:19:54.449332+0000","last_peered":"2023-10-25T16:19:54.449332+0000","last_clean":"2023-10-25T16:19:54.449332+0000","last_became_active":"2023-10-25T16:19:54.447523+0000","last_became_peered":"2023-10-25T16:19:54.447523+0000","last_unstale":"2023-10-25T16:19:54.449332+0000","last_undegraded":"2023-10-25T16:19:54.449332+0000","last_fullsized":"2023-10-25T16:19:54.449332+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:07.214049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.709914+0000","last_change":"2023-10-25T16:19:53.427731+0000","last_active":"2023-10-25T16:19:54.709914+0000","last_peered":"2023-10-25T16:19:54.709914+0000","last_clean":"2023-10-25T16:19:54.709914+0000","last_became_active":"2023-10-25T16:19:53.424487+0000","last_became_peered":"2023-10-25T16:19:53.424487+0000","last_unstale":"2023-10-25T16:19:54.709914+0000","last_undegraded":"2023-10-25T16:19:54.709914+0000","last_fullsized":"2023-10-25T16:19:54.709914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:28.745280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445611+0000","last_change":"2023-10-25T16:19:54.445458+0000","last_active":"2023-10-25T16:19:54.445611+0000","last_peered":"2023-10-25T16:19:54.445611+0000","last_clean":"2023-10-25T16:19:54.445611+0000","last_became_active":"2023-10-25T16:19:54.444854+0000","last_became_peered":"2023-10-25T16:19:54.444854+0000","last_unstale":"2023-10-25T16:19:54.445611+0000","last_undegraded":"2023-10-25T16:19:54.445611+0000","last_fullsized":"2023-10-25T16:19:54.445611+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:54.145259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.714771+0000","last_change":"2023-10-25T16:19:53.422257+0000","last_active":"2023-10-25T16:19:54.714771+0000","last_peered":"2023-10-25T16:19:54.714771+0000","last_clean":"2023-10-25T16:19:54.714771+0000","last_became_active":"2023-10-25T16:19:53.419641+0000","last_became_peered":"2023-10-25T16:19:53.419641+0000","last_unstale":"2023-10-25T16:19:54.714771+0000","last_undegraded":"2023-10-25T16:19:54.714771+0000","last_fullsized":"2023-10-25T16:19:54.714771+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:12:20.637482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.449144+0000","last_change":"2023-10-25T16:19:54.447812+0000","last_active":"2023-10-25T16:19:54.449144+0000","last_peered":"2023-10-25T16:19:54.449144+0000","last_clean":"2023-10-25T16:19:54.449144+0000","last_became_active":"2023-10-25T16:19:54.447047+0000","last_became_peered":"2023-10-25T16:19:54.447047+0000","last_unstale":"2023-10-25T16:19:54.449144+0000","last_undegraded":"2023-10-25T16:19:54.449144+0000","last_fullsized":"2023-10-25T16:19:54.449144+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:14.600765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.706452+0000","last_change":"2023-10-25T16:19:53.427358+0000","last_active":"2023-10-25T16:19:54.706452+0000","last_peered":"2023-10-25T16:19:54.706452+0000","last_clean":"2023-10-25T16:19:54.706452+0000","last_became_active":"2023-10-25T16:19:53.427148+0000","last_became_peered":"2023-10-25T16:19:53.427148+0000","last_unstale":"2023-10-25T16:19:54.706452+0000","last_undegraded":"2023-10-25T16:19:54.706452+0000","last_fullsized":"2023-10-25T16:19:54.706452+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:10.163492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.465106+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.461605+0000","last_became_peered":"2023-10-25T16:19:54.461605+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.453850+0000","last_change":"2023-10-25T16:19:53.428746+0000","last_active":"2023-10-25T16:19:54.453850+0000","last_peered":"2023-10-25T16:19:54.453850+0000","last_clean":"2023-10-25T16:19:54.453850+0000","last_became_active":"2023-10-25T16:19:53.427276+0000","last_became_peered":"2023-10-25T16:19:53.427276+0000","last_unstale":"2023-10-25T16:19:54.453850+0000","last_undegraded":"2023-10-25T16:19:54.453850+0000","last_fullsized":"2023-10-25T16:19:54.453850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:55.728285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466705+0000","last_change":"2023-10-25T16:19:54.466527+0000","last_active":"2023-10-25T16:19:54.466705+0000","last_peered":"2023-10-25T16:19:54.466705+0000","last_clean":"2023-10-25T16:19:54.466705+0000","last_became_active":"2023-10-25T16:19:54.465742+0000","last_became_peered":"2023-10-25T16:19:54.465742+0000","last_unstale":"2023-10-25T16:19:54.466705+0000","last_undegraded":"2023-10-25T16:19:54.466705+0000","last_fullsized":"2023-10-25T16:19:54.466705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:45:47.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"142'8","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551914+0000","last_change":"2023-10-25T16:19:53.418871+0000","last_active":"2023-10-25T16:19:55.551914+0000","last_peered":"2023-10-25T16:19:55.551914+0000","last_clean":"2023-10-25T16:19:55.551914+0000","last_became_active":"2023-10-25T16:19:53.418623+0000","last_became_peered":"2023-10-25T16:19:53.418623+0000","last_unstale":"2023-10-25T16:19:55.551914+0000","last_undegraded":"2023-10-25T16:19:55.551914+0000","last_fullsized":"2023-10-25T16:19:55.551914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:53:33.184556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553778+0000","last_change":"2023-10-25T16:19:54.474228+0000","last_active":"2023-10-25T16:19:55.553778+0000","last_peered":"2023-10-25T16:19:55.553778+0000","last_clean":"2023-10-25T16:19:55.553778+0000","last_became_active":"2023-10-25T16:19:54.470789+0000","last_became_peered":"2023-10-25T16:19:54.470789+0000","last_unstale":"2023-10-25T16:19:55.553778+0000","last_undegraded":"2023-10-25T16:19:55.553778+0000","last_fullsized":"2023-10-25T16:19:55.553778+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:49:04.378644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.712152+0000","last_change":"2023-10-25T16:19:53.422733+0000","last_active":"2023-10-25T16:19:54.712152+0000","last_peered":"2023-10-25T16:19:54.712152+0000","last_clean":"2023-10-25T16:19:54.712152+0000","last_became_active":"2023-10-25T16:19:53.420621+0000","last_became_peered":"2023-10-25T16:19:53.420621+0000","last_unstale":"2023-10-25T16:19:54.712152+0000","last_undegraded":"2023-10-25T16:19:54.712152+0000","last_fullsized":"2023-10-25T16:19:54.712152+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:01.712031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473418+0000","last_change":"2023-10-25T16:19:54.472785+0000","last_active":"2023-10-25T16:19:54.473418+0000","last_peered":"2023-10-25T16:19:54.473418+0000","last_clean":"2023-10-25T16:19:54.473418+0000","last_became_active":"2023-10-25T16:19:54.472181+0000","last_became_peered":"2023-10-25T16:19:54.472181+0000","last_unstale":"2023-10-25T16:19:54.473418+0000","last_undegraded":"2023-10-25T16:19:54.473418+0000","last_fullsized":"2023-10-25T16:19:54.473418+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:12:28.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"142'2","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554434+0000","last_change":"2023-10-25T16:19:53.413568+0000","last_active":"2023-10-25T16:19:55.554434+0000","last_peered":"2023-10-25T16:19:55.554434+0000","last_clean":"2023-10-25T16:19:55.554434+0000","last_became_active":"2023-10-25T16:19:53.413342+0000","last_became_peered":"2023-10-25T16:19:53.413342+0000","last_unstale":"2023-10-25T16:19:55.554434+0000","last_undegraded":"2023-10-25T16:19:55.554434+0000","last_fullsized":"2023-10-25T16:19:55.554434+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:47.014326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.457983+0000","last_change":"2023-10-25T16:19:54.456776+0000","last_active":"2023-10-25T16:19:54.457983+0000","last_peered":"2023-10-25T16:19:54.457983+0000","last_clean":"2023-10-25T16:19:54.457983+0000","last_became_active":"2023-10-25T16:19:54.456154+0000","last_became_peered":"2023-10-25T16:19:54.456154+0000","last_unstale":"2023-10-25T16:19:54.457983+0000","last_undegraded":"2023-10-25T16:19:54.457983+0000","last_fullsized":"2023-10-25T16:19:54.457983+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.703611+0000","last_change":"2023-10-25T16:19:53.428321+0000","last_active":"2023-10-25T16:19:54.703611+0000","last_peered":"2023-10-25T16:19:54.703611+0000","last_clean":"2023-10-25T16:19:54.703611+0000","last_became_active":"2023-10-25T16:19:53.426214+0000","last_became_peered":"2023-10-25T16:19:53.426214+0000","last_unstale":"2023-10-25T16:19:54.703611+0000","last_undegraded":"2023-10-25T16:19:54.703611+0000","last_fullsized":"2023-10-25T16:19:54.703611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:58.054818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.440049+0000","last_change":"2023-10-25T16:19:54.439642+0000","last_active":"2023-10-25T16:19:54.440049+0000","last_peered":"2023-10-25T16:19:54.440049+0000","last_clean":"2023-10-25T16:19:54.440049+0000","last_became_active":"2023-10-25T16:19:54.439034+0000","last_became_peered":"2023-10-25T16:19:54.439034+0000","last_unstale":"2023-10-25T16:19:54.440049+0000","last_undegraded":"2023-10-25T16:19:54.440049+0000","last_fullsized":"2023-10-25T16:19:54.440049+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.444323+0000","last_change":"2023-10-25T16:19:53.420424+0000","last_active":"2023-10-25T16:19:54.444323+0000","last_peered":"2023-10-25T16:19:54.444323+0000","last_clean":"2023-10-25T16:19:54.444323+0000","last_became_active":"2023-10-25T16:19:53.418421+0000","last_became_peered":"2023-10-25T16:19:53.418421+0000","last_unstale":"2023-10-25T16:19:54.444323+0000","last_undegraded":"2023-10-25T16:19:54.444323+0000","last_fullsized":"2023-10-25T16:19:54.444323+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:09.427824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452795+0000","last_change":"2023-10-25T16:19:54.452630+0000","last_active":"2023-10-25T16:19:54.452795+0000","last_peered":"2023-10-25T16:19:54.452795+0000","last_clean":"2023-10-25T16:19:54.452795+0000","last_became_active":"2023-10-25T16:19:54.448173+0000","last_became_peered":"2023-10-25T16:19:54.448173+0000","last_unstale":"2023-10-25T16:19:54.452795+0000","last_undegraded":"2023-10-25T16:19:54.452795+0000","last_fullsized":"2023-10-25T16:19:54.452795+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:52.905840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.708198+0000","last_change":"2023-10-25T16:19:53.426370+0000","last_active":"2023-10-25T16:19:54.708198+0000","last_peered":"2023-10-25T16:19:54.708198+0000","last_clean":"2023-10-25T16:19:54.708198+0000","last_became_active":"2023-10-25T16:19:53.425764+0000","last_became_peered":"2023-10-25T16:19:53.425764+0000","last_unstale":"2023-10-25T16:19:54.708198+0000","last_undegraded":"2023-10-25T16:19:54.708198+0000","last_fullsized":"2023-10-25T16:19:54.708198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:45.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472116+0000","last_change":"2023-10-25T16:19:54.470877+0000","last_active":"2023-10-25T16:19:54.472116+0000","last_peered":"2023-10-25T16:19:54.472116+0000","last_clean":"2023-10-25T16:19:54.472116+0000","last_became_active":"2023-10-25T16:19:54.466660+0000","last_became_peered":"2023-10-25T16:19:54.466660+0000","last_unstale":"2023-10-25T16:19:54.472116+0000","last_undegraded":"2023-10-25T16:19:54.472116+0000","last_fullsized":"2023-10-25T16:19:54.472116+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:10.091615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551645+0000","last_change":"2023-10-25T16:19:53.421607+0000","last_active":"2023-10-25T16:19:55.551645+0000","last_peered":"2023-10-25T16:19:55.551645+0000","last_clean":"2023-10-25T16:19:55.551645+0000","last_became_active":"2023-10-25T16:19:53.421374+0000","last_became_peered":"2023-10-25T16:19:53.421374+0000","last_unstale":"2023-10-25T16:19:55.551645+0000","last_undegraded":"2023-10-25T16:19:55.551645+0000","last_fullsized":"2023-10-25T16:19:55.551645+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:22:15.047600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458790+0000","last_change":"2023-10-25T16:19:54.458538+0000","last_active":"2023-10-25T16:19:54.458790+0000","last_peered":"2023-10-25T16:19:54.458790+0000","last_clean":"2023-10-25T16:19:54.458790+0000","last_became_active":"2023-10-25T16:19:54.457929+0000","last_became_peered":"2023-10-25T16:19:54.457929+0000","last_unstale":"2023-10-25T16:19:54.458790+0000","last_undegraded":"2023-10-25T16:19:54.458790+0000","last_fullsized":"2023-10-25T16:19:54.458790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:18.577710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.458365+0000","last_change":"2023-10-25T16:19:53.431122+0000","last_active":"2023-10-25T16:19:54.458365+0000","last_peered":"2023-10-25T16:19:54.458365+0000","last_clean":"2023-10-25T16:19:54.458365+0000","last_became_active":"2023-10-25T16:19:53.430508+0000","last_became_peered":"2023-10-25T16:19:53.430508+0000","last_unstale":"2023-10-25T16:19:54.458365+0000","last_undegraded":"2023-10-25T16:19:54.458365+0000","last_fullsized":"2023-10-25T16:19:54.458365+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:53.141269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.455869+0000","last_change":"2023-10-25T16:19:54.454215+0000","last_active":"2023-10-25T16:19:54.455869+0000","last_peered":"2023-10-25T16:19:54.455869+0000","last_clean":"2023-10-25T16:19:54.455869+0000","last_became_active":"2023-10-25T16:19:54.452463+0000","last_became_peered":"2023-10-25T16:19:54.452463+0000","last_unstale":"2023-10-25T16:19:54.455869+0000","last_undegraded":"2023-10-25T16:19:54.455869+0000","last_fullsized":"2023-10-25T16:19:54.455869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.442423+0000","last_change":"2023-10-25T16:19:53.431258+0000","last_active":"2023-10-25T16:19:54.442423+0000","last_peered":"2023-10-25T16:19:54.442423+0000","last_clean":"2023-10-25T16:19:54.442423+0000","last_became_active":"2023-10-25T16:19:53.430185+0000","last_became_peered":"2023-10-25T16:19:53.430185+0000","last_unstale":"2023-10-25T16:19:54.442423+0000","last_undegraded":"2023-10-25T16:19:54.442423+0000","last_fullsized":"2023-10-25T16:19:54.442423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:54:14.517117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.475198+0000","last_change":"2023-10-25T16:19:54.475021+0000","last_active":"2023-10-25T16:19:54.475198+0000","last_peered":"2023-10-25T16:19:54.475198+0000","last_clean":"2023-10-25T16:19:54.475198+0000","last_became_active":"2023-10-25T16:19:54.474608+0000","last_became_peered":"2023-10-25T16:19:54.474608+0000","last_unstale":"2023-10-25T16:19:54.475198+0000","last_undegraded":"2023-10-25T16:19:54.475198+0000","last_fullsized":"2023-10-25T16:19:54.475198+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:58:22.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.710156+0000","last_change":"2023-10-25T16:19:53.414277+0000","last_active":"2023-10-25T16:19:54.710156+0000","last_peered":"2023-10-25T16:19:54.710156+0000","last_clean":"2023-10-25T16:19:54.710156+0000","last_became_active":"2023-10-25T16:19:53.413965+0000","last_became_peered":"2023-10-25T16:19:53.413965+0000","last_unstale":"2023-10-25T16:19:54.710156+0000","last_undegraded":"2023-10-25T16:19:54.710156+0000","last_fullsized":"2023-10-25T16:19:54.710156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:50.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467776+0000","last_change":"2023-10-25T16:19:54.467618+0000","last_active":"2023-10-25T16:19:54.467776+0000","last_peered":"2023-10-25T16:19:54.467776+0000","last_clean":"2023-10-25T16:19:54.467776+0000","last_became_active":"2023-10-25T16:19:54.466936+0000","last_became_peered":"2023-10-25T16:19:54.466936+0000","last_unstale":"2023-10-25T16:19:54.467776+0000","last_undegraded":"2023-10-25T16:19:54.467776+0000","last_fullsized":"2023-10-25T16:19:54.467776+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:26:46.123344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.452904+0000","last_change":"2023-10-25T16:19:53.416392+0000","last_active":"2023-10-25T16:19:54.452904+0000","last_peered":"2023-10-25T16:19:54.452904+0000","last_clean":"2023-10-25T16:19:54.452904+0000","last_became_active":"2023-10-25T16:19:53.415622+0000","last_became_peered":"2023-10-25T16:19:53.415622+0000","last_unstale":"2023-10-25T16:19:54.452904+0000","last_undegraded":"2023-10-25T16:19:54.452904+0000","last_fullsized":"2023-10-25T16:19:54.452904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:27.082841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.464607+0000","last_change":"2023-10-25T16:19:54.464430+0000","last_active":"2023-10-25T16:19:54.464607+0000","last_peered":"2023-10-25T16:19:54.464607+0000","last_clean":"2023-10-25T16:19:54.464607+0000","last_became_active":"2023-10-25T16:19:54.460534+0000","last_became_peered":"2023-10-25T16:19:54.460534+0000","last_unstale":"2023-10-25T16:19:54.464607+0000","last_undegraded":"2023-10-25T16:19:54.464607+0000","last_fullsized":"2023-10-25T16:19:54.464607+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446604+0000","last_change":"2023-10-25T16:19:53.424091+0000","last_active":"2023-10-25T16:19:54.446604+0000","last_peered":"2023-10-25T16:19:54.446604+0000","last_clean":"2023-10-25T16:19:54.446604+0000","last_became_active":"2023-10-25T16:19:53.423484+0000","last_became_peered":"2023-10-25T16:19:53.423484+0000","last_unstale":"2023-10-25T16:19:54.446604+0000","last_undegraded":"2023-10-25T16:19:54.446604+0000","last_fullsized":"2023-10-25T16:19:54.446604+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:44.149035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.472323+0000","last_change":"2023-10-25T16:19:54.472192+0000","last_active":"2023-10-25T16:19:54.472323+0000","last_peered":"2023-10-25T16:19:54.472323+0000","last_clean":"2023-10-25T16:19:54.472323+0000","last_became_active":"2023-10-25T16:19:54.471674+0000","last_became_peered":"2023-10-25T16:19:54.471674+0000","last_unstale":"2023-10-25T16:19:54.472323+0000","last_undegraded":"2023-10-25T16:19:54.472323+0000","last_fullsized":"2023-10-25T16:19:54.472323+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.445917+0000","last_change":"2023-10-25T16:19:53.424477+0000","last_active":"2023-10-25T16:19:54.445917+0000","last_peered":"2023-10-25T16:19:54.445917+0000","last_clean":"2023-10-25T16:19:54.445917+0000","last_became_active":"2023-10-25T16:19:53.424258+0000","last_became_peered":"2023-10-25T16:19:53.424258+0000","last_unstale":"2023-10-25T16:19:54.445917+0000","last_undegraded":"2023-10-25T16:19:54.445917+0000","last_fullsized":"2023-10-25T16:19:54.445917+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:51.557043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.467542+0000","last_change":"2023-10-25T16:19:54.467301+0000","last_active":"2023-10-25T16:19:54.467542+0000","last_peered":"2023-10-25T16:19:54.467542+0000","last_clean":"2023-10-25T16:19:54.467542+0000","last_became_active":"2023-10-25T16:19:54.461393+0000","last_became_peered":"2023-10-25T16:19:54.461393+0000","last_unstale":"2023-10-25T16:19:54.467542+0000","last_undegraded":"2023-10-25T16:19:54.467542+0000","last_fullsized":"2023-10-25T16:19:54.467542+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:03:18.162726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.437580+0000","last_change":"2023-10-25T16:19:53.418461+0000","last_active":"2023-10-25T16:19:54.437580+0000","last_peered":"2023-10-25T16:19:54.437580+0000","last_clean":"2023-10-25T16:19:54.437580+0000","last_became_active":"2023-10-25T16:19:53.417773+0000","last_became_peered":"2023-10-25T16:19:53.417773+0000","last_unstale":"2023-10-25T16:19:54.437580+0000","last_undegraded":"2023-10-25T16:19:54.437580+0000","last_fullsized":"2023-10-25T16:19:54.437580+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:07.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459135+0000","last_change":"2023-10-25T16:19:54.458996+0000","last_active":"2023-10-25T16:19:54.459135+0000","last_peered":"2023-10-25T16:19:54.459135+0000","last_clean":"2023-10-25T16:19:54.459135+0000","last_became_active":"2023-10-25T16:19:54.458371+0000","last_became_peered":"2023-10-25T16:19:54.458371+0000","last_unstale":"2023-10-25T16:19:54.459135+0000","last_undegraded":"2023-10-25T16:19:54.459135+0000","last_fullsized":"2023-10-25T16:19:54.459135+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:03.999216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459380+0000","last_change":"2023-10-25T16:19:53.431861+0000","last_active":"2023-10-25T16:19:54.459380+0000","last_peered":"2023-10-25T16:19:54.459380+0000","last_clean":"2023-10-25T16:19:54.459380+0000","last_became_active":"2023-10-25T16:19:53.430078+0000","last_became_peered":"2023-10-25T16:19:53.430078+0000","last_unstale":"2023-10-25T16:19:54.459380+0000","last_undegraded":"2023-10-25T16:19:54.459380+0000","last_fullsized":"2023-10-25T16:19:54.459380+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:16.139714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.466185+0000","last_change":"2023-10-25T16:19:54.466000+0000","last_active":"2023-10-25T16:19:54.466185+0000","last_peered":"2023-10-25T16:19:54.466185+0000","last_clean":"2023-10-25T16:19:54.466185+0000","last_became_active":"2023-10-25T16:19:54.459488+0000","last_became_peered":"2023-10-25T16:19:54.459488+0000","last_unstale":"2023-10-25T16:19:54.466185+0000","last_undegraded":"2023-10-25T16:19:54.466185+0000","last_fullsized":"2023-10-25T16:19:54.466185+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:08:01.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552163+0000","last_change":"2023-10-25T16:19:53.423939+0000","last_active":"2023-10-25T16:19:55.552163+0000","last_peered":"2023-10-25T16:19:55.552163+0000","last_clean":"2023-10-25T16:19:55.552163+0000","last_became_active":"2023-10-25T16:19:53.423125+0000","last_became_peered":"2023-10-25T16:19:53.423125+0000","last_unstale":"2023-10-25T16:19:55.552163+0000","last_undegraded":"2023-10-25T16:19:55.552163+0000","last_fullsized":"2023-10-25T16:19:55.552163+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:23:31.332681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.473964+0000","last_change":"2023-10-25T16:19:54.473782+0000","last_active":"2023-10-25T16:19:54.473964+0000","last_peered":"2023-10-25T16:19:54.473964+0000","last_clean":"2023-10-25T16:19:54.473964+0000","last_became_active":"2023-10-25T16:19:54.470232+0000","last_became_peered":"2023-10-25T16:19:54.470232+0000","last_unstale":"2023-10-25T16:19:54.473964+0000","last_undegraded":"2023-10-25T16:19:54.473964+0000","last_fullsized":"2023-10-25T16:19:54.473964+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:04.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.446978+0000","last_change":"2023-10-25T16:19:53.429389+0000","last_active":"2023-10-25T16:19:54.446978+0000","last_peered":"2023-10-25T16:19:54.446978+0000","last_clean":"2023-10-25T16:19:54.446978+0000","last_became_active":"2023-10-25T16:19:53.428712+0000","last_became_peered":"2023-10-25T16:19:53.428712+0000","last_unstale":"2023-10-25T16:19:54.446978+0000","last_undegraded":"2023-10-25T16:19:54.446978+0000","last_fullsized":"2023-10-25T16:19:54.446978+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:56:09.475192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.459095+0000","last_change":"2023-10-25T16:19:54.458038+0000","last_active":"2023-10-25T16:19:54.459095+0000","last_peered":"2023-10-25T16:19:54.459095+0000","last_clean":"2023-10-25T16:19:54.459095+0000","last_became_active":"2023-10-25T16:19:54.456866+0000","last_became_peered":"2023-10-25T16:19:54.456866+0000","last_unstale":"2023-10-25T16:19:54.459095+0000","last_undegraded":"2023-10-25T16:19:54.459095+0000","last_fullsized":"2023-10-25T16:19:54.459095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.441904+0000","last_change":"2023-10-25T16:19:53.420809+0000","last_active":"2023-10-25T16:19:54.441904+0000","last_peered":"2023-10-25T16:19:54.441904+0000","last_clean":"2023-10-25T16:19:54.441904+0000","last_became_active":"2023-10-25T16:19:53.419238+0000","last_became_peered":"2023-10-25T16:19:53.419238+0000","last_unstale":"2023-10-25T16:19:54.441904+0000","last_undegraded":"2023-10-25T16:19:54.441904+0000","last_fullsized":"2023-10-25T16:19:54.441904+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:44.328241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":280,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-10-25T16:19:53.402414+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:53.402414+0000","last_peered":"2023-10-25T16:19:53.402414+0000","last_clean":"2023-10-25T16:19:53.402414+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:53.402414+0000","last_undegraded":"2023-10-25T16:19:53.402414+0000","last_fullsized":"2023-10-25T16:19:53.402414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542231,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202098,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":1.008},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.95299999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.97699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.874},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":1.1539999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":1.034}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.1200000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1349,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193962,"statfs":{"total":200000000,"available":198618030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":1.004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.69099999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.875},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":1.0840000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.048},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.179}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":1.02}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":1.089},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.1399999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.181},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":1.2170000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.054}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":0.97799999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.93200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":1.046},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.89500000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.5},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":1.091}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.141}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":766,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194546,"statfs":{"total":200000000,"available":199215173,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.083}]},{"osd":2,"last update":"Wed Oct 25 16:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88800000000000001,"15min":0.84199999999999997},"min":{"1min":0.57299999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.341,"5min":1.397,"15min":1.419},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94199999999999995,"15min":0.88400000000000001},"min":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.226}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.624},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1779999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.2649999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.004},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.206}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":774,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194537,"statfs":{"total":200000000,"available":199206716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.73999999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.71299999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":0.97499999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.84799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":0.872},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":1.083}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.05},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":0.95399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":773,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.755}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.89800000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":1.127}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":1.1040000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1342,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193969,"statfs":{"total":200000000,"available":198624805,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":1.9610000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":2.5880000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":4.1920000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":3.3919999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":4.431},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":2.2970000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":4.5860000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":2.2629999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":5.2880000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":3.5649999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":3.8340000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":0.622},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":0.70699999999999996}]}]}],"pool_statfs":[]}} 2023-10-25T16:20:01.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:20:01.498 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:20:02.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:20:02.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/537641526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac0c9e50 msgr2=0x7ff5ac06b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 --2- 172.21.15.177:0/537641526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac0c9e50 0x7ff5ac06b980 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098f0 tx=0x7ff59401c850 comp rx=0 tx=0).stop 2023-10-25T16:20:02.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/537641526 shutdown_connections 2023-10-25T16:20:02.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 --2- 172.21.15.177:0/537641526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac0c9e50 0x7ff5ac06b980 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 --2- 172.21.15.177:0/537641526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5ac1500f0 0x7ff5ac0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/537641526 >> 172.21.15.177:0/537641526 conn(0x7ff5ac0b2450 msgr2=0x7ff5ac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:02.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/537641526 shutdown_connections 2023-10-25T16:20:02.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/537641526 wait complete. 2023-10-25T16:20:02.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 Processor -- start 2023-10-25T16:20:02.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- start start 2023-10-25T16:20:02.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 0x7ff5ac14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5ac0c9e50 0x7ff5ac148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5ac1500f0 0x7ff5ac0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac13d1e0 con 0x7ff5ac06bec0 2023-10-25T16:20:02.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac151f60 con 0x7ff5ac1500f0 2023-10-25T16:20:02.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac14e370 con 0x7ff5ac0c9e50 2023-10-25T16:20:02.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 0x7ff5ac14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 0x7ff5ac14d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51572/0 (socket says 172.21.15.177:51572) 2023-10-25T16:20:02.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 -- 172.21.15.177:0/1981281544 learned_addr learned my addr 172.21.15.177:0/1981281544 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:02.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aad9d640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5ac1500f0 0x7ff5ac0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 -- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5ac0c9e50 msgr2=0x7ff5ac148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5a1d9b640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5ac0c9e50 0x7ff5ac148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5ac0c9e50 0x7ff5ac148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 -- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5ac1500f0 msgr2=0x7ff5ac0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5ac1500f0 0x7ff5ac0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 -- 172.21.15.177:0/1981281544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009500 con 0x7ff5ac06bec0 2023-10-25T16:20:02.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aad9d640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5ac1500f0 0x7ff5ac0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5aa59c640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 0x7ff5ac14d720 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00d980 tx=0x7ff59c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c009c30 con 0x7ff5ac06bec0 2023-10-25T16:20:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff59c009e80 con 0x7ff5ac06bec0 2023-10-25T16:20:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac14ddb0 con 0x7ff5ac06bec0 2023-10-25T16:20:02.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0106a0 con 0x7ff5ac06bec0 2023-10-25T16:20:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac152190 con 0x7ff5ac06bec0 2023-10-25T16:20:02.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.280+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac04daf0 con 0x7ff5ac06bec0 2023-10-25T16:20:02.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.284+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff59c010800 con 0x7ff5ac06bec0 2023-10-25T16:20:02.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.284+0000 7ff5a37fe640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff58c066470 0x7ff58c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.284+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff59c084780 con 0x7ff5ac06bec0 2023-10-25T16:20:02.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.284+0000 7ff5a1d9b640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff58c066470 0x7ff58c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.284+0000 7ff5a1d9b640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff58c066470 0x7ff58c068930 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff5940af000 tx=0x7ff59401b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:02.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.288+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff59c051be0 con 0x7ff5ac06bec0 2023-10-25T16:20:02.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.428+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5ac141e60 con 0x7ff58c066470 2023-10-25T16:20:02.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.452+0000 7ff5a37fe640 1 -- 172.21.15.177:0/1981281544 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284010 (secure 0 0 0) 0x7ff5ac141e60 con 0x7ff58c066470 2023-10-25T16:20:02.452 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:02.454 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:20:02.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff58c066470 msgr2=0x7ff58c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff58c066470 0x7ff58c068930 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff5940af000 tx=0x7ff59401b090 comp rx=0 tx=0).stop 2023-10-25T16:20:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 msgr2=0x7ff5ac14d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 0x7ff5ac14d720 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00d980 tx=0x7ff59c00de40 comp rx=0 tx=0).stop 2023-10-25T16:20:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 shutdown_connections 2023-10-25T16:20:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff58c066470 0x7ff58c068930 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5ac1500f0 0x7ff5ac0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5ac0c9e50 0x7ff5ac148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 --2- 172.21.15.177:0/1981281544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5ac06bec0 0x7ff5ac14d720 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 >> 172.21.15.177:0/1981281544 conn(0x7ff5ac0b2450 msgr2=0x7ff5ac069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 shutdown_connections 2023-10-25T16:20:02.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.456+0000 7ff5b0818640 1 -- 172.21.15.177:0/1981281544 wait complete. 2023-10-25T16:20:02.472 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2023-10-25T16:20:00.751737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7391,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555108,"statfs":{"total":1600000000,"available":1592431228,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.349871"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436568+0000","last_change":"2023-10-25T16:19:54.461727+0000","last_active":"2023-10-25T16:19:55.436568+0000","last_peered":"2023-10-25T16:19:55.436568+0000","last_clean":"2023-10-25T16:19:55.436568+0000","last_became_active":"2023-10-25T16:19:54.460940+0000","last_became_peered":"2023-10-25T16:19:54.460940+0000","last_unstale":"2023-10-25T16:19:55.436568+0000","last_undegraded":"2023-10-25T16:19:55.436568+0000","last_fullsized":"2023-10-25T16:19:55.436568+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:37.058323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552816+0000","last_change":"2023-10-25T16:19:54.469017+0000","last_active":"2023-10-25T16:19:55.552816+0000","last_peered":"2023-10-25T16:19:55.552816+0000","last_clean":"2023-10-25T16:19:55.552816+0000","last_became_active":"2023-10-25T16:19:54.468147+0000","last_became_peered":"2023-10-25T16:19:54.468147+0000","last_unstale":"2023-10-25T16:19:55.552816+0000","last_undegraded":"2023-10-25T16:19:55.552816+0000","last_fullsized":"2023-10-25T16:19:55.552816+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:07.214049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552932+0000","last_change":"2023-10-25T16:19:54.453147+0000","last_active":"2023-10-25T16:19:55.552932+0000","last_peered":"2023-10-25T16:19:55.552932+0000","last_clean":"2023-10-25T16:19:55.552932+0000","last_became_active":"2023-10-25T16:19:54.450106+0000","last_became_peered":"2023-10-25T16:19:54.450106+0000","last_unstale":"2023-10-25T16:19:55.552932+0000","last_undegraded":"2023-10-25T16:19:55.552932+0000","last_fullsized":"2023-10-25T16:19:55.552932+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:56.732275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436427+0000","last_change":"2023-10-25T16:19:54.463763+0000","last_active":"2023-10-25T16:19:55.436427+0000","last_peered":"2023-10-25T16:19:55.436427+0000","last_clean":"2023-10-25T16:19:55.436427+0000","last_became_active":"2023-10-25T16:19:54.452773+0000","last_became_peered":"2023-10-25T16:19:54.452773+0000","last_unstale":"2023-10-25T16:19:55.436427+0000","last_undegraded":"2023-10-25T16:19:55.436427+0000","last_fullsized":"2023-10-25T16:19:55.436427+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:57:35.662635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553448+0000","last_change":"2023-10-25T16:19:54.474691+0000","last_active":"2023-10-25T16:19:55.553448+0000","last_peered":"2023-10-25T16:19:55.553448+0000","last_clean":"2023-10-25T16:19:55.553448+0000","last_became_active":"2023-10-25T16:19:54.473381+0000","last_became_peered":"2023-10-25T16:19:54.473381+0000","last_unstale":"2023-10-25T16:19:55.553448+0000","last_undegraded":"2023-10-25T16:19:55.553448+0000","last_fullsized":"2023-10-25T16:19:55.553448+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:21:03.421421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551792+0000","last_change":"2023-10-25T16:19:54.473119+0000","last_active":"2023-10-25T16:19:55.551792+0000","last_peered":"2023-10-25T16:19:55.551792+0000","last_clean":"2023-10-25T16:19:55.551792+0000","last_became_active":"2023-10-25T16:19:54.470943+0000","last_became_peered":"2023-10-25T16:19:54.470943+0000","last_unstale":"2023-10-25T16:19:55.551792+0000","last_undegraded":"2023-10-25T16:19:55.551792+0000","last_fullsized":"2023-10-25T16:19:55.551792+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:07:25.646957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.438113+0000","last_change":"2023-10-25T16:19:54.458805+0000","last_active":"2023-10-25T16:19:55.438113+0000","last_peered":"2023-10-25T16:19:55.438113+0000","last_clean":"2023-10-25T16:19:55.438113+0000","last_became_active":"2023-10-25T16:19:54.457779+0000","last_became_peered":"2023-10-25T16:19:54.457779+0000","last_unstale":"2023-10-25T16:19:55.438113+0000","last_undegraded":"2023-10-25T16:19:55.438113+0000","last_fullsized":"2023-10-25T16:19:55.438113+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:14:50.851318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553290+0000","last_change":"2023-10-25T16:19:54.466068+0000","last_active":"2023-10-25T16:19:55.553290+0000","last_peered":"2023-10-25T16:19:55.553290+0000","last_clean":"2023-10-25T16:19:55.553290+0000","last_became_active":"2023-10-25T16:19:54.464713+0000","last_became_peered":"2023-10-25T16:19:54.464713+0000","last_unstale":"2023-10-25T16:19:55.553290+0000","last_undegraded":"2023-10-25T16:19:55.553290+0000","last_fullsized":"2023-10-25T16:19:55.553290+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:04.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436978+0000","last_change":"2023-10-25T16:19:54.464139+0000","last_active":"2023-10-25T16:19:55.436978+0000","last_peered":"2023-10-25T16:19:55.436978+0000","last_clean":"2023-10-25T16:19:55.436978+0000","last_became_active":"2023-10-25T16:19:54.453425+0000","last_became_peered":"2023-10-25T16:19:54.453425+0000","last_unstale":"2023-10-25T16:19:55.436978+0000","last_undegraded":"2023-10-25T16:19:55.436978+0000","last_fullsized":"2023-10-25T16:19:55.436978+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:12:53.034829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.438004+0000","last_change":"2023-10-25T16:19:54.474546+0000","last_active":"2023-10-25T16:19:55.438004+0000","last_peered":"2023-10-25T16:19:55.438004+0000","last_clean":"2023-10-25T16:19:55.438004+0000","last_became_active":"2023-10-25T16:19:54.469302+0000","last_became_peered":"2023-10-25T16:19:54.469302+0000","last_unstale":"2023-10-25T16:19:55.438004+0000","last_undegraded":"2023-10-25T16:19:55.438004+0000","last_fullsized":"2023-10-25T16:19:55.438004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:06:39.040856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552543+0000","last_change":"2023-10-25T16:19:54.463337+0000","last_active":"2023-10-25T16:19:55.552543+0000","last_peered":"2023-10-25T16:19:55.552543+0000","last_clean":"2023-10-25T16:19:55.552543+0000","last_became_active":"2023-10-25T16:19:54.462731+0000","last_became_peered":"2023-10-25T16:19:54.462731+0000","last_unstale":"2023-10-25T16:19:55.552543+0000","last_undegraded":"2023-10-25T16:19:55.552543+0000","last_fullsized":"2023-10-25T16:19:55.552543+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:29:59.455072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436781+0000","last_change":"2023-10-25T16:19:54.463581+0000","last_active":"2023-10-25T16:19:55.436781+0000","last_peered":"2023-10-25T16:19:55.436781+0000","last_clean":"2023-10-25T16:19:55.436781+0000","last_became_active":"2023-10-25T16:19:54.462904+0000","last_became_peered":"2023-10-25T16:19:54.462904+0000","last_unstale":"2023-10-25T16:19:55.436781+0000","last_undegraded":"2023-10-25T16:19:55.436781+0000","last_fullsized":"2023-10-25T16:19:55.436781+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:45:43.923443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553124+0000","last_change":"2023-10-25T16:19:54.465565+0000","last_active":"2023-10-25T16:19:55.553124+0000","last_peered":"2023-10-25T16:19:55.553124+0000","last_clean":"2023-10-25T16:19:55.553124+0000","last_became_active":"2023-10-25T16:19:54.462990+0000","last_became_peered":"2023-10-25T16:19:54.462990+0000","last_unstale":"2023-10-25T16:19:55.553124+0000","last_undegraded":"2023-10-25T16:19:55.553124+0000","last_fullsized":"2023-10-25T16:19:55.553124+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:59.058809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551411+0000","last_change":"2023-10-25T16:19:54.466678+0000","last_active":"2023-10-25T16:19:55.551411+0000","last_peered":"2023-10-25T16:19:55.551411+0000","last_clean":"2023-10-25T16:19:55.551411+0000","last_became_active":"2023-10-25T16:19:54.461209+0000","last_became_peered":"2023-10-25T16:19:54.461209+0000","last_unstale":"2023-10-25T16:19:55.551411+0000","last_undegraded":"2023-10-25T16:19:55.551411+0000","last_fullsized":"2023-10-25T16:19:55.551411+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:27:20.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551928+0000","last_change":"2023-10-25T16:19:54.469012+0000","last_active":"2023-10-25T16:19:55.551928+0000","last_peered":"2023-10-25T16:19:55.551928+0000","last_clean":"2023-10-25T16:19:55.551928+0000","last_became_active":"2023-10-25T16:19:54.468016+0000","last_became_peered":"2023-10-25T16:19:54.468016+0000","last_unstale":"2023-10-25T16:19:55.551928+0000","last_undegraded":"2023-10-25T16:19:55.551928+0000","last_fullsized":"2023-10-25T16:19:55.551928+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:08.244284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436719+0000","last_change":"2023-10-25T16:19:54.448406+0000","last_active":"2023-10-25T16:19:55.436719+0000","last_peered":"2023-10-25T16:19:55.436719+0000","last_clean":"2023-10-25T16:19:55.436719+0000","last_became_active":"2023-10-25T16:19:54.446860+0000","last_became_peered":"2023-10-25T16:19:54.446860+0000","last_unstale":"2023-10-25T16:19:55.436719+0000","last_undegraded":"2023-10-25T16:19:55.436719+0000","last_fullsized":"2023-10-25T16:19:55.436719+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:45.588913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553159+0000","last_change":"2023-10-25T16:19:54.468783+0000","last_active":"2023-10-25T16:19:55.553159+0000","last_peered":"2023-10-25T16:19:55.553159+0000","last_clean":"2023-10-25T16:19:55.553159+0000","last_became_active":"2023-10-25T16:19:54.466677+0000","last_became_peered":"2023-10-25T16:19:54.466677+0000","last_unstale":"2023-10-25T16:19:55.553159+0000","last_undegraded":"2023-10-25T16:19:55.553159+0000","last_fullsized":"2023-10-25T16:19:55.553159+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:37:38.604127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551014+0000","last_change":"2023-10-25T16:19:54.461443+0000","last_active":"2023-10-25T16:19:55.551014+0000","last_peered":"2023-10-25T16:19:55.551014+0000","last_clean":"2023-10-25T16:19:55.551014+0000","last_became_active":"2023-10-25T16:19:54.460838+0000","last_became_peered":"2023-10-25T16:19:54.460838+0000","last_unstale":"2023-10-25T16:19:55.551014+0000","last_undegraded":"2023-10-25T16:19:55.551014+0000","last_fullsized":"2023-10-25T16:19:55.551014+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:44.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551753+0000","last_change":"2023-10-25T16:19:54.467062+0000","last_active":"2023-10-25T16:19:55.551753+0000","last_peered":"2023-10-25T16:19:55.551753+0000","last_clean":"2023-10-25T16:19:55.551753+0000","last_became_active":"2023-10-25T16:19:54.464502+0000","last_became_peered":"2023-10-25T16:19:54.464502+0000","last_unstale":"2023-10-25T16:19:55.551753+0000","last_undegraded":"2023-10-25T16:19:55.551753+0000","last_fullsized":"2023-10-25T16:19:55.551753+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552733+0000","last_change":"2023-10-25T16:19:54.451503+0000","last_active":"2023-10-25T16:19:55.552733+0000","last_peered":"2023-10-25T16:19:55.552733+0000","last_clean":"2023-10-25T16:19:55.552733+0000","last_became_active":"2023-10-25T16:19:54.450896+0000","last_became_peered":"2023-10-25T16:19:54.450896+0000","last_unstale":"2023-10-25T16:19:55.552733+0000","last_undegraded":"2023-10-25T16:19:55.552733+0000","last_fullsized":"2023-10-25T16:19:55.552733+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:14.600765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553220+0000","last_change":"2023-10-25T16:19:54.450150+0000","last_active":"2023-10-25T16:19:55.553220+0000","last_peered":"2023-10-25T16:19:55.553220+0000","last_clean":"2023-10-25T16:19:55.553220+0000","last_became_active":"2023-10-25T16:19:54.449509+0000","last_became_peered":"2023-10-25T16:19:54.449509+0000","last_unstale":"2023-10-25T16:19:55.553220+0000","last_undegraded":"2023-10-25T16:19:55.553220+0000","last_fullsized":"2023-10-25T16:19:55.553220+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:03:42.231948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553197+0000","last_change":"2023-10-25T16:19:54.458648+0000","last_active":"2023-10-25T16:19:55.553197+0000","last_peered":"2023-10-25T16:19:55.553197+0000","last_clean":"2023-10-25T16:19:55.553197+0000","last_became_active":"2023-10-25T16:19:54.457941+0000","last_became_peered":"2023-10-25T16:19:54.457941+0000","last_unstale":"2023-10-25T16:19:55.553197+0000","last_undegraded":"2023-10-25T16:19:55.553197+0000","last_fullsized":"2023-10-25T16:19:55.553197+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:02.505624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552716+0000","last_change":"2023-10-25T16:19:54.457827+0000","last_active":"2023-10-25T16:19:55.552716+0000","last_peered":"2023-10-25T16:19:55.552716+0000","last_clean":"2023-10-25T16:19:55.552716+0000","last_became_active":"2023-10-25T16:19:54.456641+0000","last_became_peered":"2023-10-25T16:19:54.456641+0000","last_unstale":"2023-10-25T16:19:55.552716+0000","last_undegraded":"2023-10-25T16:19:55.552716+0000","last_fullsized":"2023-10-25T16:19:55.552716+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:23.996474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552016+0000","last_change":"2023-10-25T16:19:54.468145+0000","last_active":"2023-10-25T16:19:55.552016+0000","last_peered":"2023-10-25T16:19:55.552016+0000","last_clean":"2023-10-25T16:19:55.552016+0000","last_became_active":"2023-10-25T16:19:54.464664+0000","last_became_peered":"2023-10-25T16:19:54.464664+0000","last_unstale":"2023-10-25T16:19:55.552016+0000","last_undegraded":"2023-10-25T16:19:55.552016+0000","last_fullsized":"2023-10-25T16:19:55.552016+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:24.299112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553091+0000","last_change":"2023-10-25T16:19:54.454986+0000","last_active":"2023-10-25T16:19:55.553091+0000","last_peered":"2023-10-25T16:19:55.553091+0000","last_clean":"2023-10-25T16:19:55.553091+0000","last_became_active":"2023-10-25T16:19:54.454308+0000","last_became_peered":"2023-10-25T16:19:54.454308+0000","last_unstale":"2023-10-25T16:19:55.553091+0000","last_undegraded":"2023-10-25T16:19:55.553091+0000","last_fullsized":"2023-10-25T16:19:55.553091+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:51.803048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436860+0000","last_change":"2023-10-25T16:19:54.448801+0000","last_active":"2023-10-25T16:19:55.436860+0000","last_peered":"2023-10-25T16:19:55.436860+0000","last_clean":"2023-10-25T16:19:55.436860+0000","last_became_active":"2023-10-25T16:19:54.447799+0000","last_became_peered":"2023-10-25T16:19:54.447799+0000","last_unstale":"2023-10-25T16:19:55.436860+0000","last_undegraded":"2023-10-25T16:19:55.436860+0000","last_fullsized":"2023-10-25T16:19:55.436860+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:23:02.050342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553015+0000","last_change":"2023-10-25T16:19:54.466672+0000","last_active":"2023-10-25T16:19:55.553015+0000","last_peered":"2023-10-25T16:19:55.553015+0000","last_clean":"2023-10-25T16:19:55.553015+0000","last_became_active":"2023-10-25T16:19:54.465394+0000","last_became_peered":"2023-10-25T16:19:54.465394+0000","last_unstale":"2023-10-25T16:19:55.553015+0000","last_undegraded":"2023-10-25T16:19:55.553015+0000","last_fullsized":"2023-10-25T16:19:55.553015+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:59.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552146+0000","last_change":"2023-10-25T16:19:54.454070+0000","last_active":"2023-10-25T16:19:55.552146+0000","last_peered":"2023-10-25T16:19:55.552146+0000","last_clean":"2023-10-25T16:19:55.552146+0000","last_became_active":"2023-10-25T16:19:54.453409+0000","last_became_peered":"2023-10-25T16:19:54.453409+0000","last_unstale":"2023-10-25T16:19:55.552146+0000","last_undegraded":"2023-10-25T16:19:55.552146+0000","last_fullsized":"2023-10-25T16:19:55.552146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:08:01.655044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552768+0000","last_change":"2023-10-25T16:19:54.455923+0000","last_active":"2023-10-25T16:19:55.552768+0000","last_peered":"2023-10-25T16:19:55.552768+0000","last_clean":"2023-10-25T16:19:55.552768+0000","last_became_active":"2023-10-25T16:19:54.455216+0000","last_became_peered":"2023-10-25T16:19:54.455216+0000","last_unstale":"2023-10-25T16:19:55.552768+0000","last_undegraded":"2023-10-25T16:19:55.552768+0000","last_fullsized":"2023-10-25T16:19:55.552768+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:45:47.609832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437625+0000","last_change":"2023-10-25T16:19:54.447434+0000","last_active":"2023-10-25T16:19:55.437625+0000","last_peered":"2023-10-25T16:19:55.437625+0000","last_clean":"2023-10-25T16:19:55.437625+0000","last_became_active":"2023-10-25T16:19:54.446808+0000","last_became_peered":"2023-10-25T16:19:54.446808+0000","last_unstale":"2023-10-25T16:19:55.437625+0000","last_undegraded":"2023-10-25T16:19:55.437625+0000","last_fullsized":"2023-10-25T16:19:55.437625+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:40:07.534175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437001+0000","last_change":"2023-10-25T16:19:54.458170+0000","last_active":"2023-10-25T16:19:55.437001+0000","last_peered":"2023-10-25T16:19:55.437001+0000","last_clean":"2023-10-25T16:19:55.437001+0000","last_became_active":"2023-10-25T16:19:54.449443+0000","last_became_peered":"2023-10-25T16:19:54.449443+0000","last_unstale":"2023-10-25T16:19:55.437001+0000","last_undegraded":"2023-10-25T16:19:55.437001+0000","last_fullsized":"2023-10-25T16:19:55.437001+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:07.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553509+0000","last_change":"2023-10-25T16:19:54.466137+0000","last_active":"2023-10-25T16:19:55.553509+0000","last_peered":"2023-10-25T16:19:55.553509+0000","last_clean":"2023-10-25T16:19:55.553509+0000","last_became_active":"2023-10-25T16:19:54.464568+0000","last_became_peered":"2023-10-25T16:19:54.464568+0000","last_unstale":"2023-10-25T16:19:55.553509+0000","last_undegraded":"2023-10-25T16:19:55.553509+0000","last_fullsized":"2023-10-25T16:19:55.553509+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:45.332231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552726+0000","last_change":"2023-10-25T16:19:54.460492+0000","last_active":"2023-10-25T16:19:55.552726+0000","last_peered":"2023-10-25T16:19:55.552726+0000","last_clean":"2023-10-25T16:19:55.552726+0000","last_became_active":"2023-10-25T16:19:54.459828+0000","last_became_peered":"2023-10-25T16:19:54.459828+0000","last_unstale":"2023-10-25T16:19:55.552726+0000","last_undegraded":"2023-10-25T16:19:55.552726+0000","last_fullsized":"2023-10-25T16:19:55.552726+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:35.305048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"142'4","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.838500+0000","last_change":"2023-10-25T16:19:53.408435+0000","last_active":"2023-10-25T16:19:54.838500+0000","last_peered":"2023-10-25T16:19:54.838500+0000","last_clean":"2023-10-25T16:19:54.838500+0000","last_became_active":"2023-10-25T16:19:53.407353+0000","last_became_peered":"2023-10-25T16:19:53.407353+0000","last_unstale":"2023-10-25T16:19:54.838500+0000","last_undegraded":"2023-10-25T16:19:54.838500+0000","last_fullsized":"2023-10-25T16:19:54.838500+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:48:13.615155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551337+0000","last_change":"2023-10-25T16:19:54.457803+0000","last_active":"2023-10-25T16:19:55.551337+0000","last_peered":"2023-10-25T16:19:55.551337+0000","last_clean":"2023-10-25T16:19:55.551337+0000","last_became_active":"2023-10-25T16:19:54.457190+0000","last_became_peered":"2023-10-25T16:19:54.457190+0000","last_unstale":"2023-10-25T16:19:55.551337+0000","last_undegraded":"2023-10-25T16:19:55.551337+0000","last_fullsized":"2023-10-25T16:19:55.551337+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:18:04.030780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.829467+0000","last_change":"2023-10-25T16:19:53.407966+0000","last_active":"2023-10-25T16:19:54.829467+0000","last_peered":"2023-10-25T16:19:54.829467+0000","last_clean":"2023-10-25T16:19:54.829467+0000","last_became_active":"2023-10-25T16:19:53.407333+0000","last_became_peered":"2023-10-25T16:19:53.407333+0000","last_unstale":"2023-10-25T16:19:54.829467+0000","last_undegraded":"2023-10-25T16:19:54.829467+0000","last_fullsized":"2023-10-25T16:19:54.829467+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:01.501634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552145+0000","last_change":"2023-10-25T16:19:54.471618+0000","last_active":"2023-10-25T16:19:55.552145+0000","last_peered":"2023-10-25T16:19:55.552145+0000","last_clean":"2023-10-25T16:19:55.552145+0000","last_became_active":"2023-10-25T16:19:54.470001+0000","last_became_peered":"2023-10-25T16:19:54.470001+0000","last_unstale":"2023-10-25T16:19:55.552145+0000","last_undegraded":"2023-10-25T16:19:55.552145+0000","last_fullsized":"2023-10-25T16:19:55.552145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:48:14.619145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"142'2","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554210+0000","last_change":"2023-10-25T16:19:53.426629+0000","last_active":"2023-10-25T16:19:55.554210+0000","last_peered":"2023-10-25T16:19:55.554210+0000","last_clean":"2023-10-25T16:19:55.554210+0000","last_became_active":"2023-10-25T16:19:53.426403+0000","last_became_peered":"2023-10-25T16:19:53.426403+0000","last_unstale":"2023-10-25T16:19:55.554210+0000","last_undegraded":"2023-10-25T16:19:55.554210+0000","last_fullsized":"2023-10-25T16:19:55.554210+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:54:43.593371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552432+0000","last_change":"2023-10-25T16:19:54.464303+0000","last_active":"2023-10-25T16:19:55.552432+0000","last_peered":"2023-10-25T16:19:55.552432+0000","last_clean":"2023-10-25T16:19:55.552432+0000","last_became_active":"2023-10-25T16:19:54.463645+0000","last_became_peered":"2023-10-25T16:19:54.463645+0000","last_unstale":"2023-10-25T16:19:55.552432+0000","last_undegraded":"2023-10-25T16:19:55.552432+0000","last_fullsized":"2023-10-25T16:19:55.552432+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:28.086832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"142'2","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554601+0000","last_change":"2023-10-25T16:19:53.427454+0000","last_active":"2023-10-25T16:19:55.554601+0000","last_peered":"2023-10-25T16:19:55.554601+0000","last_clean":"2023-10-25T16:19:55.554601+0000","last_became_active":"2023-10-25T16:19:53.426405+0000","last_became_peered":"2023-10-25T16:19:53.426405+0000","last_unstale":"2023-10-25T16:19:55.554601+0000","last_undegraded":"2023-10-25T16:19:55.554601+0000","last_fullsized":"2023-10-25T16:19:55.554601+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:46:43.866540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.436728+0000","last_change":"2023-10-25T16:19:54.450631+0000","last_active":"2023-10-25T16:19:55.436728+0000","last_peered":"2023-10-25T16:19:55.436728+0000","last_clean":"2023-10-25T16:19:55.436728+0000","last_became_active":"2023-10-25T16:19:54.449923+0000","last_became_peered":"2023-10-25T16:19:54.449923+0000","last_unstale":"2023-10-25T16:19:55.436728+0000","last_undegraded":"2023-10-25T16:19:55.436728+0000","last_fullsized":"2023-10-25T16:19:55.436728+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:15:07.963218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.838559+0000","last_change":"2023-10-25T16:19:53.423223+0000","last_active":"2023-10-25T16:19:54.838559+0000","last_peered":"2023-10-25T16:19:54.838559+0000","last_clean":"2023-10-25T16:19:54.838559+0000","last_became_active":"2023-10-25T16:19:53.421712+0000","last_became_peered":"2023-10-25T16:19:53.421712+0000","last_unstale":"2023-10-25T16:19:54.838559+0000","last_undegraded":"2023-10-25T16:19:54.838559+0000","last_fullsized":"2023-10-25T16:19:54.838559+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:08.239214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553466+0000","last_change":"2023-10-25T16:19:54.468481+0000","last_active":"2023-10-25T16:19:55.553466+0000","last_peered":"2023-10-25T16:19:55.553466+0000","last_clean":"2023-10-25T16:19:55.553466+0000","last_became_active":"2023-10-25T16:19:54.465812+0000","last_became_peered":"2023-10-25T16:19:54.465812+0000","last_unstale":"2023-10-25T16:19:55.553466+0000","last_undegraded":"2023-10-25T16:19:55.553466+0000","last_fullsized":"2023-10-25T16:19:55.553466+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:37.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.820838+0000","last_change":"2023-10-25T16:19:53.431077+0000","last_active":"2023-10-25T16:19:54.820838+0000","last_peered":"2023-10-25T16:19:54.820838+0000","last_clean":"2023-10-25T16:19:54.820838+0000","last_became_active":"2023-10-25T16:19:53.430825+0000","last_became_peered":"2023-10-25T16:19:53.430825+0000","last_unstale":"2023-10-25T16:19:54.820838+0000","last_undegraded":"2023-10-25T16:19:54.820838+0000","last_fullsized":"2023-10-25T16:19:54.820838+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:21:17.573720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.438312+0000","last_change":"2023-10-25T16:19:54.464983+0000","last_active":"2023-10-25T16:19:55.438312+0000","last_peered":"2023-10-25T16:19:55.438312+0000","last_clean":"2023-10-25T16:19:55.438312+0000","last_became_active":"2023-10-25T16:19:54.461758+0000","last_became_peered":"2023-10-25T16:19:54.461758+0000","last_unstale":"2023-10-25T16:19:55.438312+0000","last_undegraded":"2023-10-25T16:19:55.438312+0000","last_fullsized":"2023-10-25T16:19:55.438312+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:08:49.421182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.827912+0000","last_change":"2023-10-25T16:19:53.419217+0000","last_active":"2023-10-25T16:19:54.827912+0000","last_peered":"2023-10-25T16:19:54.827912+0000","last_clean":"2023-10-25T16:19:54.827912+0000","last_became_active":"2023-10-25T16:19:53.418429+0000","last_became_peered":"2023-10-25T16:19:53.418429+0000","last_unstale":"2023-10-25T16:19:54.827912+0000","last_undegraded":"2023-10-25T16:19:54.827912+0000","last_fullsized":"2023-10-25T16:19:54.827912+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:53:13.033289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437399+0000","last_change":"2023-10-25T16:19:54.455866+0000","last_active":"2023-10-25T16:19:55.437399+0000","last_peered":"2023-10-25T16:19:55.437399+0000","last_clean":"2023-10-25T16:19:55.437399+0000","last_became_active":"2023-10-25T16:19:54.455162+0000","last_became_peered":"2023-10-25T16:19:54.455162+0000","last_unstale":"2023-10-25T16:19:55.437399+0000","last_undegraded":"2023-10-25T16:19:55.437399+0000","last_fullsized":"2023-10-25T16:19:55.437399+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:15:33.364547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.823154+0000","last_change":"2023-10-25T16:19:53.419508+0000","last_active":"2023-10-25T16:19:54.823154+0000","last_peered":"2023-10-25T16:19:54.823154+0000","last_clean":"2023-10-25T16:19:54.823154+0000","last_became_active":"2023-10-25T16:19:53.418740+0000","last_became_peered":"2023-10-25T16:19:53.418740+0000","last_unstale":"2023-10-25T16:19:54.823154+0000","last_undegraded":"2023-10-25T16:19:54.823154+0000","last_fullsized":"2023-10-25T16:19:54.823154+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:27:45.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437512+0000","last_change":"2023-10-25T16:19:54.463626+0000","last_active":"2023-10-25T16:19:55.437512+0000","last_peered":"2023-10-25T16:19:55.437512+0000","last_clean":"2023-10-25T16:19:55.437512+0000","last_became_active":"2023-10-25T16:19:54.462999+0000","last_became_peered":"2023-10-25T16:19:54.462999+0000","last_unstale":"2023-10-25T16:19:55.437512+0000","last_undegraded":"2023-10-25T16:19:55.437512+0000","last_fullsized":"2023-10-25T16:19:55.437512+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:52.156546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554708+0000","last_change":"2023-10-25T16:19:53.427105+0000","last_active":"2023-10-25T16:19:55.554708+0000","last_peered":"2023-10-25T16:19:55.554708+0000","last_clean":"2023-10-25T16:19:55.554708+0000","last_became_active":"2023-10-25T16:19:53.425534+0000","last_became_peered":"2023-10-25T16:19:53.425534+0000","last_unstale":"2023-10-25T16:19:55.554708+0000","last_undegraded":"2023-10-25T16:19:55.554708+0000","last_fullsized":"2023-10-25T16:19:55.554708+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:36:03.534138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554258+0000","last_change":"2023-10-25T16:19:54.465003+0000","last_active":"2023-10-25T16:19:55.554258+0000","last_peered":"2023-10-25T16:19:55.554258+0000","last_clean":"2023-10-25T16:19:55.554258+0000","last_became_active":"2023-10-25T16:19:54.463043+0000","last_became_peered":"2023-10-25T16:19:54.463043+0000","last_unstale":"2023-10-25T16:19:55.554258+0000","last_undegraded":"2023-10-25T16:19:55.554258+0000","last_fullsized":"2023-10-25T16:19:55.554258+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:10.091615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.820878+0000","last_change":"2023-10-25T16:19:53.417480+0000","last_active":"2023-10-25T16:19:54.820878+0000","last_peered":"2023-10-25T16:19:54.820878+0000","last_clean":"2023-10-25T16:19:54.820878+0000","last_became_active":"2023-10-25T16:19:53.417160+0000","last_became_peered":"2023-10-25T16:19:53.417160+0000","last_unstale":"2023-10-25T16:19:54.820878+0000","last_undegraded":"2023-10-25T16:19:54.820878+0000","last_fullsized":"2023-10-25T16:19:54.820878+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:44.282469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552341+0000","last_change":"2023-10-25T16:19:54.448364+0000","last_active":"2023-10-25T16:19:55.552341+0000","last_peered":"2023-10-25T16:19:55.552341+0000","last_clean":"2023-10-25T16:19:55.552341+0000","last_became_active":"2023-10-25T16:19:54.447523+0000","last_became_peered":"2023-10-25T16:19:54.447523+0000","last_unstale":"2023-10-25T16:19:55.552341+0000","last_undegraded":"2023-10-25T16:19:55.552341+0000","last_fullsized":"2023-10-25T16:19:55.552341+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:09.855686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"142'3","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.823012+0000","last_change":"2023-10-25T16:19:53.427731+0000","last_active":"2023-10-25T16:19:54.823012+0000","last_peered":"2023-10-25T16:19:54.823012+0000","last_clean":"2023-10-25T16:19:54.823012+0000","last_became_active":"2023-10-25T16:19:53.424487+0000","last_became_peered":"2023-10-25T16:19:53.424487+0000","last_unstale":"2023-10-25T16:19:54.823012+0000","last_undegraded":"2023-10-25T16:19:54.823012+0000","last_fullsized":"2023-10-25T16:19:54.823012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:28.745280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437452+0000","last_change":"2023-10-25T16:19:54.445458+0000","last_active":"2023-10-25T16:19:55.437452+0000","last_peered":"2023-10-25T16:19:55.437452+0000","last_clean":"2023-10-25T16:19:55.437452+0000","last_became_active":"2023-10-25T16:19:54.444854+0000","last_became_peered":"2023-10-25T16:19:54.444854+0000","last_unstale":"2023-10-25T16:19:55.437452+0000","last_undegraded":"2023-10-25T16:19:55.437452+0000","last_fullsized":"2023-10-25T16:19:55.437452+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:53:00.437242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"142'6","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.822788+0000","last_change":"2023-10-25T16:19:53.422257+0000","last_active":"2023-10-25T16:19:54.822788+0000","last_peered":"2023-10-25T16:19:54.822788+0000","last_clean":"2023-10-25T16:19:54.822788+0000","last_became_active":"2023-10-25T16:19:53.419641+0000","last_became_peered":"2023-10-25T16:19:53.419641+0000","last_unstale":"2023-10-25T16:19:54.822788+0000","last_undegraded":"2023-10-25T16:19:54.822788+0000","last_fullsized":"2023-10-25T16:19:54.822788+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:12:20.637482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554220+0000","last_change":"2023-10-25T16:19:54.447812+0000","last_active":"2023-10-25T16:19:55.554220+0000","last_peered":"2023-10-25T16:19:55.554220+0000","last_clean":"2023-10-25T16:19:55.554220+0000","last_became_active":"2023-10-25T16:19:54.447047+0000","last_became_peered":"2023-10-25T16:19:54.447047+0000","last_unstale":"2023-10-25T16:19:55.554220+0000","last_undegraded":"2023-10-25T16:19:55.554220+0000","last_fullsized":"2023-10-25T16:19:55.554220+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:58:22.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.824282+0000","last_change":"2023-10-25T16:19:53.427358+0000","last_active":"2023-10-25T16:19:54.824282+0000","last_peered":"2023-10-25T16:19:54.824282+0000","last_clean":"2023-10-25T16:19:54.824282+0000","last_became_active":"2023-10-25T16:19:53.427148+0000","last_became_peered":"2023-10-25T16:19:53.427148+0000","last_unstale":"2023-10-25T16:19:54.824282+0000","last_undegraded":"2023-10-25T16:19:54.824282+0000","last_fullsized":"2023-10-25T16:19:54.824282+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:10.163492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554084+0000","last_change":"2023-10-25T16:19:54.465106+0000","last_active":"2023-10-25T16:19:55.554084+0000","last_peered":"2023-10-25T16:19:55.554084+0000","last_clean":"2023-10-25T16:19:55.554084+0000","last_became_active":"2023-10-25T16:19:54.461605+0000","last_became_peered":"2023-10-25T16:19:54.461605+0000","last_unstale":"2023-10-25T16:19:55.554084+0000","last_undegraded":"2023-10-25T16:19:55.554084+0000","last_fullsized":"2023-10-25T16:19:55.554084+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:27:20.460645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.830185+0000","last_change":"2023-10-25T16:19:53.428746+0000","last_active":"2023-10-25T16:19:54.830185+0000","last_peered":"2023-10-25T16:19:54.830185+0000","last_clean":"2023-10-25T16:19:54.830185+0000","last_became_active":"2023-10-25T16:19:53.427276+0000","last_became_peered":"2023-10-25T16:19:53.427276+0000","last_unstale":"2023-10-25T16:19:54.830185+0000","last_undegraded":"2023-10-25T16:19:54.830185+0000","last_fullsized":"2023-10-25T16:19:54.830185+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:18:55.728285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554228+0000","last_change":"2023-10-25T16:19:54.466527+0000","last_active":"2023-10-25T16:19:55.554228+0000","last_peered":"2023-10-25T16:19:55.554228+0000","last_clean":"2023-10-25T16:19:55.554228+0000","last_became_active":"2023-10-25T16:19:54.465742+0000","last_became_peered":"2023-10-25T16:19:54.465742+0000","last_unstale":"2023-10-25T16:19:55.554228+0000","last_undegraded":"2023-10-25T16:19:55.554228+0000","last_fullsized":"2023-10-25T16:19:55.554228+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:52:01.923758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"142'8","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551914+0000","last_change":"2023-10-25T16:19:53.418871+0000","last_active":"2023-10-25T16:19:55.551914+0000","last_peered":"2023-10-25T16:19:55.551914+0000","last_clean":"2023-10-25T16:19:55.551914+0000","last_became_active":"2023-10-25T16:19:53.418623+0000","last_became_peered":"2023-10-25T16:19:53.418623+0000","last_unstale":"2023-10-25T16:19:55.551914+0000","last_undegraded":"2023-10-25T16:19:55.551914+0000","last_fullsized":"2023-10-25T16:19:55.551914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:53:33.184556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553778+0000","last_change":"2023-10-25T16:19:54.474228+0000","last_active":"2023-10-25T16:19:55.553778+0000","last_peered":"2023-10-25T16:19:55.553778+0000","last_clean":"2023-10-25T16:19:55.553778+0000","last_became_active":"2023-10-25T16:19:54.470789+0000","last_became_peered":"2023-10-25T16:19:54.470789+0000","last_unstale":"2023-10-25T16:19:55.553778+0000","last_undegraded":"2023-10-25T16:19:55.553778+0000","last_fullsized":"2023-10-25T16:19:55.553778+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:49:04.378644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.822819+0000","last_change":"2023-10-25T16:19:53.422733+0000","last_active":"2023-10-25T16:19:54.822819+0000","last_peered":"2023-10-25T16:19:54.822819+0000","last_clean":"2023-10-25T16:19:54.822819+0000","last_became_active":"2023-10-25T16:19:53.420621+0000","last_became_peered":"2023-10-25T16:19:53.420621+0000","last_unstale":"2023-10-25T16:19:54.822819+0000","last_undegraded":"2023-10-25T16:19:54.822819+0000","last_fullsized":"2023-10-25T16:19:54.822819+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:01.712031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553070+0000","last_change":"2023-10-25T16:19:54.472785+0000","last_active":"2023-10-25T16:19:55.553070+0000","last_peered":"2023-10-25T16:19:55.553070+0000","last_clean":"2023-10-25T16:19:55.553070+0000","last_became_active":"2023-10-25T16:19:54.472181+0000","last_became_peered":"2023-10-25T16:19:54.472181+0000","last_unstale":"2023-10-25T16:19:55.553070+0000","last_undegraded":"2023-10-25T16:19:55.553070+0000","last_fullsized":"2023-10-25T16:19:55.553070+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:09.243204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"142'2","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554434+0000","last_change":"2023-10-25T16:19:53.413568+0000","last_active":"2023-10-25T16:19:55.554434+0000","last_peered":"2023-10-25T16:19:55.554434+0000","last_clean":"2023-10-25T16:19:55.554434+0000","last_became_active":"2023-10-25T16:19:53.413342+0000","last_became_peered":"2023-10-25T16:19:53.413342+0000","last_unstale":"2023-10-25T16:19:55.554434+0000","last_undegraded":"2023-10-25T16:19:55.554434+0000","last_fullsized":"2023-10-25T16:19:55.554434+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:47.014326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553231+0000","last_change":"2023-10-25T16:19:54.456776+0000","last_active":"2023-10-25T16:19:55.553231+0000","last_peered":"2023-10-25T16:19:55.553231+0000","last_clean":"2023-10-25T16:19:55.553231+0000","last_became_active":"2023-10-25T16:19:54.456154+0000","last_became_peered":"2023-10-25T16:19:54.456154+0000","last_unstale":"2023-10-25T16:19:55.553231+0000","last_undegraded":"2023-10-25T16:19:55.553231+0000","last_fullsized":"2023-10-25T16:19:55.553231+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:44.793294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.830234+0000","last_change":"2023-10-25T16:19:53.428321+0000","last_active":"2023-10-25T16:19:54.830234+0000","last_peered":"2023-10-25T16:19:54.830234+0000","last_clean":"2023-10-25T16:19:54.830234+0000","last_became_active":"2023-10-25T16:19:53.426214+0000","last_became_peered":"2023-10-25T16:19:53.426214+0000","last_unstale":"2023-10-25T16:19:54.830234+0000","last_undegraded":"2023-10-25T16:19:54.830234+0000","last_fullsized":"2023-10-25T16:19:54.830234+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:58.054818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551470+0000","last_change":"2023-10-25T16:19:54.439642+0000","last_active":"2023-10-25T16:19:55.551470+0000","last_peered":"2023-10-25T16:19:55.551470+0000","last_clean":"2023-10-25T16:19:55.551470+0000","last_became_active":"2023-10-25T16:19:54.439034+0000","last_became_peered":"2023-10-25T16:19:54.439034+0000","last_unstale":"2023-10-25T16:19:55.551470+0000","last_undegraded":"2023-10-25T16:19:55.551470+0000","last_fullsized":"2023-10-25T16:19:55.551470+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:58:22.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.838638+0000","last_change":"2023-10-25T16:19:53.420424+0000","last_active":"2023-10-25T16:19:54.838638+0000","last_peered":"2023-10-25T16:19:54.838638+0000","last_clean":"2023-10-25T16:19:54.838638+0000","last_became_active":"2023-10-25T16:19:53.418421+0000","last_became_peered":"2023-10-25T16:19:53.418421+0000","last_unstale":"2023-10-25T16:19:54.838638+0000","last_undegraded":"2023-10-25T16:19:54.838638+0000","last_fullsized":"2023-10-25T16:19:54.838638+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:22:09.427824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552422+0000","last_change":"2023-10-25T16:19:54.452630+0000","last_active":"2023-10-25T16:19:55.552422+0000","last_peered":"2023-10-25T16:19:55.552422+0000","last_clean":"2023-10-25T16:19:55.552422+0000","last_became_active":"2023-10-25T16:19:54.448173+0000","last_became_peered":"2023-10-25T16:19:54.448173+0000","last_unstale":"2023-10-25T16:19:55.552422+0000","last_undegraded":"2023-10-25T16:19:55.552422+0000","last_fullsized":"2023-10-25T16:19:55.552422+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:22.566800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.824206+0000","last_change":"2023-10-25T16:19:53.426370+0000","last_active":"2023-10-25T16:19:54.824206+0000","last_peered":"2023-10-25T16:19:54.824206+0000","last_clean":"2023-10-25T16:19:54.824206+0000","last_became_active":"2023-10-25T16:19:53.425764+0000","last_became_peered":"2023-10-25T16:19:53.425764+0000","last_unstale":"2023-10-25T16:19:54.824206+0000","last_undegraded":"2023-10-25T16:19:54.824206+0000","last_fullsized":"2023-10-25T16:19:54.824206+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:03:45.700532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437397+0000","last_change":"2023-10-25T16:19:54.470877+0000","last_active":"2023-10-25T16:19:55.437397+0000","last_peered":"2023-10-25T16:19:55.437397+0000","last_clean":"2023-10-25T16:19:55.437397+0000","last_became_active":"2023-10-25T16:19:54.466660+0000","last_became_peered":"2023-10-25T16:19:54.466660+0000","last_unstale":"2023-10-25T16:19:55.437397+0000","last_undegraded":"2023-10-25T16:19:55.437397+0000","last_fullsized":"2023-10-25T16:19:55.437397+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:45:01.564350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551645+0000","last_change":"2023-10-25T16:19:53.421607+0000","last_active":"2023-10-25T16:19:55.551645+0000","last_peered":"2023-10-25T16:19:55.551645+0000","last_clean":"2023-10-25T16:19:55.551645+0000","last_became_active":"2023-10-25T16:19:53.421374+0000","last_became_peered":"2023-10-25T16:19:53.421374+0000","last_unstale":"2023-10-25T16:19:55.551645+0000","last_undegraded":"2023-10-25T16:19:55.551645+0000","last_fullsized":"2023-10-25T16:19:55.551645+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:22:15.047600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551775+0000","last_change":"2023-10-25T16:19:54.458538+0000","last_active":"2023-10-25T16:19:55.551775+0000","last_peered":"2023-10-25T16:19:55.551775+0000","last_clean":"2023-10-25T16:19:55.551775+0000","last_became_active":"2023-10-25T16:19:54.457929+0000","last_became_peered":"2023-10-25T16:19:54.457929+0000","last_unstale":"2023-10-25T16:19:55.551775+0000","last_undegraded":"2023-10-25T16:19:55.551775+0000","last_fullsized":"2023-10-25T16:19:55.551775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.824294+0000","last_change":"2023-10-25T16:19:53.431122+0000","last_active":"2023-10-25T16:19:54.824294+0000","last_peered":"2023-10-25T16:19:54.824294+0000","last_clean":"2023-10-25T16:19:54.824294+0000","last_became_active":"2023-10-25T16:19:53.430508+0000","last_became_peered":"2023-10-25T16:19:53.430508+0000","last_unstale":"2023-10-25T16:19:54.824294+0000","last_undegraded":"2023-10-25T16:19:54.824294+0000","last_fullsized":"2023-10-25T16:19:54.824294+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:34:53.141269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.554412+0000","last_change":"2023-10-25T16:19:54.454215+0000","last_active":"2023-10-25T16:19:55.554412+0000","last_peered":"2023-10-25T16:19:55.554412+0000","last_clean":"2023-10-25T16:19:55.554412+0000","last_became_active":"2023-10-25T16:19:54.452463+0000","last_became_peered":"2023-10-25T16:19:54.452463+0000","last_unstale":"2023-10-25T16:19:55.554412+0000","last_undegraded":"2023-10-25T16:19:55.554412+0000","last_fullsized":"2023-10-25T16:19:55.554412+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:03.318343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.823116+0000","last_change":"2023-10-25T16:19:53.431258+0000","last_active":"2023-10-25T16:19:54.823116+0000","last_peered":"2023-10-25T16:19:54.823116+0000","last_clean":"2023-10-25T16:19:54.823116+0000","last_became_active":"2023-10-25T16:19:53.430185+0000","last_became_peered":"2023-10-25T16:19:53.430185+0000","last_unstale":"2023-10-25T16:19:54.823116+0000","last_undegraded":"2023-10-25T16:19:54.823116+0000","last_fullsized":"2023-10-25T16:19:54.823116+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:54:14.517117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551640+0000","last_change":"2023-10-25T16:19:54.475021+0000","last_active":"2023-10-25T16:19:55.551640+0000","last_peered":"2023-10-25T16:19:55.551640+0000","last_clean":"2023-10-25T16:19:55.551640+0000","last_became_active":"2023-10-25T16:19:54.474608+0000","last_became_peered":"2023-10-25T16:19:54.474608+0000","last_unstale":"2023-10-25T16:19:55.551640+0000","last_undegraded":"2023-10-25T16:19:55.551640+0000","last_fullsized":"2023-10-25T16:19:55.551640+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:11:08.542742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.820891+0000","last_change":"2023-10-25T16:19:53.414277+0000","last_active":"2023-10-25T16:19:54.820891+0000","last_peered":"2023-10-25T16:19:54.820891+0000","last_clean":"2023-10-25T16:19:54.820891+0000","last_became_active":"2023-10-25T16:19:53.413965+0000","last_became_peered":"2023-10-25T16:19:53.413965+0000","last_unstale":"2023-10-25T16:19:54.820891+0000","last_undegraded":"2023-10-25T16:19:54.820891+0000","last_fullsized":"2023-10-25T16:19:54.820891+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:04:50.799058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437114+0000","last_change":"2023-10-25T16:19:54.467618+0000","last_active":"2023-10-25T16:19:55.437114+0000","last_peered":"2023-10-25T16:19:55.437114+0000","last_clean":"2023-10-25T16:19:55.437114+0000","last_became_active":"2023-10-25T16:19:54.466936+0000","last_became_peered":"2023-10-25T16:19:54.466936+0000","last_unstale":"2023-10-25T16:19:55.437114+0000","last_undegraded":"2023-10-25T16:19:55.437114+0000","last_fullsized":"2023-10-25T16:19:55.437114+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:06:36.344113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"143'1","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551801+0000","last_change":"2023-10-25T16:19:53.416392+0000","last_active":"2023-10-25T16:19:55.551801+0000","last_peered":"2023-10-25T16:19:55.551801+0000","last_clean":"2023-10-25T16:19:55.551801+0000","last_became_active":"2023-10-25T16:19:53.415622+0000","last_became_peered":"2023-10-25T16:19:53.415622+0000","last_unstale":"2023-10-25T16:19:55.551801+0000","last_undegraded":"2023-10-25T16:19:55.551801+0000","last_fullsized":"2023-10-25T16:19:55.551801+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:39:27.082841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.438578+0000","last_change":"2023-10-25T16:19:54.464430+0000","last_active":"2023-10-25T16:19:55.438578+0000","last_peered":"2023-10-25T16:19:55.438578+0000","last_clean":"2023-10-25T16:19:55.438578+0000","last_became_active":"2023-10-25T16:19:54.460534+0000","last_became_peered":"2023-10-25T16:19:54.460534+0000","last_unstale":"2023-10-25T16:19:55.438578+0000","last_undegraded":"2023-10-25T16:19:55.438578+0000","last_fullsized":"2023-10-25T16:19:55.438578+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:30.736912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.822861+0000","last_change":"2023-10-25T16:19:53.424091+0000","last_active":"2023-10-25T16:19:54.822861+0000","last_peered":"2023-10-25T16:19:54.822861+0000","last_clean":"2023-10-25T16:19:54.822861+0000","last_became_active":"2023-10-25T16:19:53.423484+0000","last_became_peered":"2023-10-25T16:19:53.423484+0000","last_unstale":"2023-10-25T16:19:54.822861+0000","last_undegraded":"2023-10-25T16:19:54.822861+0000","last_fullsized":"2023-10-25T16:19:54.822861+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:21:44.149035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.551393+0000","last_change":"2023-10-25T16:19:54.472192+0000","last_active":"2023-10-25T16:19:55.551393+0000","last_peered":"2023-10-25T16:19:55.551393+0000","last_clean":"2023-10-25T16:19:55.551393+0000","last_became_active":"2023-10-25T16:19:54.471674+0000","last_became_peered":"2023-10-25T16:19:54.471674+0000","last_unstale":"2023-10-25T16:19:55.551393+0000","last_undegraded":"2023-10-25T16:19:55.551393+0000","last_fullsized":"2023-10-25T16:19:55.551393+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:54:15.521107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.820984+0000","last_change":"2023-10-25T16:19:53.424477+0000","last_active":"2023-10-25T16:19:54.820984+0000","last_peered":"2023-10-25T16:19:54.820984+0000","last_clean":"2023-10-25T16:19:54.820984+0000","last_became_active":"2023-10-25T16:19:53.424258+0000","last_became_peered":"2023-10-25T16:19:53.424258+0000","last_unstale":"2023-10-25T16:19:54.820984+0000","last_undegraded":"2023-10-25T16:19:54.820984+0000","last_fullsized":"2023-10-25T16:19:54.820984+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:48:51.557043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.553808+0000","last_change":"2023-10-25T16:19:54.467301+0000","last_active":"2023-10-25T16:19:55.553808+0000","last_peered":"2023-10-25T16:19:55.553808+0000","last_clean":"2023-10-25T16:19:55.553808+0000","last_became_active":"2023-10-25T16:19:54.461393+0000","last_became_peered":"2023-10-25T16:19:54.461393+0000","last_unstale":"2023-10-25T16:19:55.553808+0000","last_undegraded":"2023-10-25T16:19:55.553808+0000","last_fullsized":"2023-10-25T16:19:55.553808+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:45.299555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.838665+0000","last_change":"2023-10-25T16:19:53.418461+0000","last_active":"2023-10-25T16:19:54.838665+0000","last_peered":"2023-10-25T16:19:54.838665+0000","last_clean":"2023-10-25T16:19:54.838665+0000","last_became_active":"2023-10-25T16:19:53.417773+0000","last_became_peered":"2023-10-25T16:19:53.417773+0000","last_unstale":"2023-10-25T16:19:54.838665+0000","last_undegraded":"2023-10-25T16:19:54.838665+0000","last_fullsized":"2023-10-25T16:19:54.838665+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:18:07.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552909+0000","last_change":"2023-10-25T16:19:54.458996+0000","last_active":"2023-10-25T16:19:55.552909+0000","last_peered":"2023-10-25T16:19:55.552909+0000","last_clean":"2023-10-25T16:19:55.552909+0000","last_became_active":"2023-10-25T16:19:54.458371+0000","last_became_peered":"2023-10-25T16:19:54.458371+0000","last_unstale":"2023-10-25T16:19:55.552909+0000","last_undegraded":"2023-10-25T16:19:55.552909+0000","last_fullsized":"2023-10-25T16:19:55.552909+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:53:45.286459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.828087+0000","last_change":"2023-10-25T16:19:53.431861+0000","last_active":"2023-10-25T16:19:54.828087+0000","last_peered":"2023-10-25T16:19:54.828087+0000","last_clean":"2023-10-25T16:19:54.828087+0000","last_became_active":"2023-10-25T16:19:53.430078+0000","last_became_peered":"2023-10-25T16:19:53.430078+0000","last_unstale":"2023-10-25T16:19:54.828087+0000","last_undegraded":"2023-10-25T16:19:54.828087+0000","last_fullsized":"2023-10-25T16:19:54.828087+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:52:16.139714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552089+0000","last_change":"2023-10-25T16:19:54.466000+0000","last_active":"2023-10-25T16:19:55.552089+0000","last_peered":"2023-10-25T16:19:55.552089+0000","last_clean":"2023-10-25T16:19:55.552089+0000","last_became_active":"2023-10-25T16:19:54.459488+0000","last_became_peered":"2023-10-25T16:19:54.459488+0000","last_unstale":"2023-10-25T16:19:55.552089+0000","last_undegraded":"2023-10-25T16:19:55.552089+0000","last_fullsized":"2023-10-25T16:19:55.552089+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:22:06.471307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552163+0000","last_change":"2023-10-25T16:19:53.423939+0000","last_active":"2023-10-25T16:19:55.552163+0000","last_peered":"2023-10-25T16:19:55.552163+0000","last_clean":"2023-10-25T16:19:55.552163+0000","last_became_active":"2023-10-25T16:19:53.423125+0000","last_became_peered":"2023-10-25T16:19:53.423125+0000","last_unstale":"2023-10-25T16:19:55.552163+0000","last_undegraded":"2023-10-25T16:19:55.552163+0000","last_fullsized":"2023-10-25T16:19:55.552163+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:23:31.332681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.437078+0000","last_change":"2023-10-25T16:19:54.473782+0000","last_active":"2023-10-25T16:19:55.437078+0000","last_peered":"2023-10-25T16:19:55.437078+0000","last_clean":"2023-10-25T16:19:55.437078+0000","last_became_active":"2023-10-25T16:19:54.470232+0000","last_became_peered":"2023-10-25T16:19:54.470232+0000","last_unstale":"2023-10-25T16:19:55.437078+0000","last_undegraded":"2023-10-25T16:19:55.437078+0000","last_fullsized":"2023-10-25T16:19:55.437078+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:30:29.116770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.822905+0000","last_change":"2023-10-25T16:19:53.429389+0000","last_active":"2023-10-25T16:19:54.822905+0000","last_peered":"2023-10-25T16:19:54.822905+0000","last_clean":"2023-10-25T16:19:54.822905+0000","last_became_active":"2023-10-25T16:19:53.428712+0000","last_became_peered":"2023-10-25T16:19:53.428712+0000","last_unstale":"2023-10-25T16:19:54.822905+0000","last_undegraded":"2023-10-25T16:19:54.822905+0000","last_fullsized":"2023-10-25T16:19:54.822905+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:56:09.475192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-25T16:19:55.552470+0000","last_change":"2023-10-25T16:19:54.458038+0000","last_active":"2023-10-25T16:19:55.552470+0000","last_peered":"2023-10-25T16:19:55.552470+0000","last_clean":"2023-10-25T16:19:55.552470+0000","last_became_active":"2023-10-25T16:19:54.456866+0000","last_became_peered":"2023-10-25T16:19:54.456866+0000","last_unstale":"2023-10-25T16:19:55.552470+0000","last_undegraded":"2023-10-25T16:19:55.552470+0000","last_fullsized":"2023-10-25T16:19:55.552470+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:53.394237+0000","last_clean_scrub_stamp":"2023-10-25T16:19:53.394237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:32:52.905840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.838610+0000","last_change":"2023-10-25T16:19:53.420809+0000","last_active":"2023-10-25T16:19:54.838610+0000","last_peered":"2023-10-25T16:19:54.838610+0000","last_clean":"2023-10-25T16:19:54.838610+0000","last_became_active":"2023-10-25T16:19:53.419238+0000","last_became_peered":"2023-10-25T16:19:53.419238+0000","last_unstale":"2023-10-25T16:19:54.838610+0000","last_undegraded":"2023-10-25T16:19:54.838610+0000","last_fullsized":"2023-10-25T16:19:54.838610+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:19:52.390247+0000","last_clean_scrub_stamp":"2023-10-25T16:19:52.390247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:35:44.328241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":281,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-10-25T16:19:54.441278+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:19:54.441278+0000","last_peered":"2023-10-25T16:19:54.441278+0000","last_clean":"2023-10-25T16:19:54.441278+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:19:54.441278+0000","last_undegraded":"2023-10-25T16:19:54.441278+0000","last_fullsized":"2023-10-25T16:19:54.441278+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542231,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202098,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.51600000000000001},"min":{"1min":0.36099999999999999,"5min":0.25600000000000001,"15min":0.23100000000000001},"max":{"1min":0.98399999999999999,"5min":1.093,"15min":1.093},"last":1.008},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.63200000000000001,"15min":0.57599999999999996},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.94999999999999996,"5min":1.077,"15min":1.077},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":0.83599999999999997,"5min":1.1220000000000001,"15min":1.1759999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":0.96599999999999997,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.60599999999999998},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.1020000000000001,"5min":1.246,"15min":1.246},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.747,"15min":0.63200000000000001},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.28199999999999997},"max":{"1min":1.1910000000000001,"5min":1.345,"15min":1.345},"last":0.95299999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91200000000000003,"15min":0.82599999999999996},"min":{"1min":0.63500000000000001,"5min":0.47199999999999998,"15min":0.438},"max":{"1min":1.2190000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.92900000000000005,"15min":0.85999999999999999},"min":{"1min":0.48099999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1699999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.97699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.345,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.874},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.69399999999999995,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.171,"5min":1.671,"15min":1.671},"last":1.1539999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.89800000000000002},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3440000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.92000000000000004,"15min":0.93200000000000005},"min":{"1min":0.66700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2230000000000001,"5min":1.5409999999999999,"15min":1.8400000000000001},"last":1.034}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.97799999999999998,"15min":0.93000000000000005},"min":{"1min":0.55100000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99299999999999999,"15min":0.96599999999999997},"min":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3069999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.1200000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1356,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193956,"statfs":{"total":200000000,"available":198611114,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.75900000000000001},"min":{"1min":0.54500000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1399999999999999,"5min":1.256,"15min":1.256},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86599999999999999,"15min":0.83199999999999996},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2709999999999999,"5min":1.534,"15min":1.534},"last":0.879}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.91800000000000004,"15min":0.88700000000000001},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.94799999999999995,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.48799999999999999},"max":{"1min":1.3120000000000001,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.83599999999999997},"min":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1259999999999999,"5min":1.27,"15min":1.27},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.873,"15min":0.83499999999999996},"min":{"1min":0.59599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.131,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.97599999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.67500000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.296,"5min":1.446,"15min":1.446},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0069999999999999,"15min":0.95199999999999996},"min":{"1min":0.88400000000000001,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.3340000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.032}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.871,"15min":0.86299999999999999},"min":{"1min":0.63400000000000001,"5min":0.58399999999999996,"15min":0.56999999999999995},"max":{"1min":1.125,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.93500000000000005,"15min":0.999},"min":{"1min":0.64600000000000002,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.3939999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.78500000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.97899999999999998,"15min":1.0409999999999999},"min":{"1min":0.64200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4670000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.628},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0109999999999999,"15min":1.0329999999999999},"min":{"1min":0.65900000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.4159999999999999,"5min":1.637,"15min":1.637},"last":1.0569999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.107,"15min":1.141},"min":{"1min":0.70499999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5780000000000001,"5min":1.669,"15min":1.669},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.123},"min":{"1min":0.83999999999999997,"5min":0.72399999999999998,"15min":0.65700000000000003},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.94599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202028,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88800000000000001,"15min":0.86699999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.327,"5min":1.397,"15min":1.397},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.89700000000000002,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.6419999999999999},"last":0.873}]},{"osd":1,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.88200000000000001},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.129,"5min":1.302,"15min":1.302},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.92700000000000005,"15min":0.90500000000000003},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3200000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94299999999999995,"15min":0.88300000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.476},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.96199999999999997,"15min":0.89700000000000002},"min":{"1min":0.66900000000000004,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.629}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92900000000000005,"15min":0.92000000000000004},"min":{"1min":0.64800000000000002,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.052,"15min":1.046},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.587,"5min":1.587,"15min":1.7110000000000001},"last":1.206}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.383,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.94099999999999995,"15min":0.98499999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.319,"5min":1.444,"15min":1.444},"last":1.163}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.99299999999999999,"15min":0.97499999999999998},"min":{"1min":0.67300000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3520000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.0680000000000001,"15min":1.0580000000000001},"min":{"1min":0.71899999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3500000000000001,"5min":1.5720000000000001,"15min":1.895},"last":1.2949999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.107,"15min":1.087},"min":{"1min":0.71599999999999997,"5min":0.68000000000000005,"15min":0.46700000000000003},"max":{"1min":1.54,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.1000000000000001,"15min":1.0489999999999999},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.48899999999999999},"max":{"1min":1.329,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.246}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194532,"statfs":{"total":200000000,"available":199201494,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":1.2829999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3080000000000001,"5min":1.661,"15min":14.843},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.82399999999999995,"15min":1.3979999999999999},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.238,"5min":1.2410000000000001,"15min":16.439},"last":0.83099999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":1.351},"min":{"1min":0.443,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.423,"5min":1.423,"15min":14.630000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.91200000000000003,"15min":0.876},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.496},"max":{"1min":1.2270000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0309999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":0.95899999999999996,"15min":0.94899999999999995},"min":{"1min":0.64100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.96199999999999997,"15min":0.96399999999999997},"min":{"1min":0.58199999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2050000000000001,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97999999999999998,"15min":0.98999999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.56799999999999995},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.145},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0820000000000001,"15min":1.458},"min":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.2809999999999999,"5min":2.194,"15min":14.954000000000001},"last":0.998}]},{"osd":4,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.004,"15min":1.522},"min":{"1min":0.66400000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":15.904},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.94099999999999995,"15min":1.534},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.101,"5min":1.879,"15min":17.219999999999999},"last":1.0900000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.4510000000000001},"min":{"1min":0.81100000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.6439999999999999,"5min":1.748,"15min":14.567},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.6419999999999999},"min":{"1min":0.83799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.657,"5min":1.657,"15min":15.089},"last":1.1759999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:19:11 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.012,"15min":1.6439999999999999},"min":{"1min":0.77500000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3380000000000001,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1519999999999999,"15min":1.2569999999999999},"min":{"1min":0.99399999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.7350000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.2010000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199202098,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.80800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.3,"5min":1.327,"15min":1.47},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.86299999999999999,"15min":0.81699999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1870000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.875,"15min":0.82299999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.119,"5min":1.288,"15min":1.288},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99399999999999999,"15min":0.94999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.47,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.95299999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.88800000000000001,"15min":0.84199999999999997},"min":{"1min":0.57299999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.341,"5min":1.397,"15min":1.419},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.94199999999999995,"15min":0.88400000000000001},"min":{"1min":0.65400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.79900000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95699999999999996,"15min":0.90900000000000003},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.85699999999999998,"15min":0.79600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.095,"5min":1.518,"15min":1.518},"last":1.0640000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":0.95299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.599,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.119,"15min":1.121},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0329999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.94699999999999995,"15min":0.97499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.274,"5min":2.085,"15min":2.085},"last":1.212},{"interface":"front","average":{"1min":1.008,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.5429999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.097}]},{"osd":7,"last update":"Wed Oct 25 16:19:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94599999999999995,"15min":0.94199999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2290000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.1240000000000001,"15min":1.113},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.431,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.256}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":780,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194531,"statfs":{"total":200000000,"available":199200416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.55600000000000005},"min":{"1min":0.27200000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65500000000000003,"15min":0.63900000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.86599999999999999,"5min":1.077,"15min":1.083},"last":0.52700000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.247,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.97999999999999998,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.70299999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0980000000000001,"5min":1.254,"15min":1.2809999999999999},"last":0.88700000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68400000000000005,"15min":0.66900000000000004},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.087,"5min":1.087,"15min":1.3560000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.137,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.86599999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.90100000000000002,"15min":0.873},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.96799999999999997,"15min":0.97799999999999998},"min":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.228,"5min":1.2390000000000001,"15min":1.427},"last":0.98199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88200000000000001,"15min":0.92200000000000004},"min":{"1min":0.50900000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.218,"5min":1.2769999999999999,"15min":1.5269999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96999999999999997,"15min":0.94199999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2090000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89600000000000002,"15min":0.90000000000000002},"min":{"1min":0.56799999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.294,"5min":1.306,"15min":1.456},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.54700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.663},"last":0.755}]},{"osd":7,"last update":"Wed Oct 25 16:19:09 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.63300000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.294,"5min":1.4890000000000001,"15min":1.5660000000000001},"last":1.008},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98199999999999998,"15min":0.94999999999999996},"min":{"1min":0.64300000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.389},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194533,"statfs":{"total":200000000,"available":199201974,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.253,"5min":0.249,"15min":0.249},"max":{"1min":0.75700000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.075,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.58199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.60799999999999998,"15min":0.55700000000000005},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73099999999999998,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.107,"5min":1.2,"15min":1.2},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97899999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.34799999999999998,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0269999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.022,"15min":0.96799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.0660000000000001,"5min":12.698,"15min":12.698},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.23,"5min":12.721,"15min":12.721},"last":0.79700000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1970000000000001,"5min":1.546,"15min":1.546},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90600000000000003,"15min":0.88800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2549999999999999,"5min":2.206,"15min":2.206},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.95399999999999996,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.2569999999999999,"5min":1.379,"15min":1.4610000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.0209999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.3240000000000001,"5min":1.581,"15min":1.5980000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:10 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.097,"15min":0.98199999999999998},"min":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.206,"5min":14.776,"15min":14.776},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.1040000000000001,"15min":1.02},"min":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2829999999999999,"5min":10.509,"15min":10.509},"last":0.65000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1357,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193955,"statfs":{"total":200000000,"available":198610006,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.57799999999999996,"15min":0.68799999999999994},"min":{"1min":0.27500000000000002,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.208,"5min":1.208,"15min":5.1029999999999998},"last":0.31},{"interface":"front","average":{"1min":0.745,"5min":0.65400000000000003,"15min":0.73899999999999999},"min":{"1min":0.33100000000000002,"5min":0.311,"15min":0.25700000000000001},"max":{"1min":1.3140000000000001,"5min":1.3560000000000001,"15min":4.9980000000000002},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.67700000000000005},"min":{"1min":0.311,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":4.2320000000000002},"last":0.376},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.71699999999999997},"min":{"1min":0.436,"5min":0.30099999999999999,"15min":0.29599999999999999},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":3.2909999999999999},"last":0.32900000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.78200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":4.1219999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84699999999999998,"15min":0.82199999999999995},"min":{"1min":0.47799999999999998,"5min":0.378,"15min":0.28599999999999998},"max":{"1min":1.155,"5min":1.407,"15min":3.6579999999999999},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.84399999999999997},"min":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.54300000000000004},"max":{"1min":1.2310000000000001,"5min":1.3120000000000001,"15min":1.6599999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89500000000000002,"15min":0.92900000000000005},"min":{"1min":0.60499999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2050000000000001,"5min":1.6719999999999999,"15min":3.4510000000000001},"last":0.50800000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.92700000000000005,"15min":0.86799999999999999},"min":{"1min":0.746,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.27,"5min":1.27,"15min":1.5589999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.92100000000000004,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":3.5430000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96499999999999997,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.667,"5min":1.667,"15min":3.1349999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97099999999999997,"15min":0.93000000000000005},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3680000000000001,"5min":1.387,"15min":1.8180000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:19:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.006,"15min":1.2749999999999999},"min":{"1min":0.76700000000000002,"5min":0.58599999999999997,"15min":0.55900000000000005},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.0209999999999999,"15min":1.292},"min":{"1min":0.64900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4159999999999999,"5min":1.4410000000000001,"15min":11.622},"last":0.77600000000000002}]}]}],"pool_statfs":[]}} 2023-10-25T16:20:02.478 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:20:02.479 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:20:02.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- 172.21.15.177:0/4192126690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0141d20 msgr2=0x7fbbc00aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4192126690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0141d20 0x7fbbc00aef70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fbbc006f650 tx=0x7fbbb401c7f0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- 172.21.15.177:0/4192126690 shutdown_connections 2023-10-25T16:20:02.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4192126690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc0141d20 0x7fbbc00aef70 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4192126690 >> v2:172.21.15.184:3300/0 conn(0x7fbbc0141940 0x7fbbc00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- 172.21.15.177:0/4192126690 >> 172.21.15.177:0/4192126690 conn(0x7fbbc00698f0 msgr2=0x7fbbc0069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:02.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- 172.21.15.177:0/4192126690 shutdown_connections 2023-10-25T16:20:02.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- 172.21.15.177:0/4192126690 wait complete. 2023-10-25T16:20:02.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 Processor -- start 2023-10-25T16:20:02.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- start start 2023-10-25T16:20:02.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 0x7fbbc01f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbc0141940 0x7fbbc015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbbc0141d20 0x7fbbc015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc013b2d0 con 0x7fbbc00af4b0 2023-10-25T16:20:02.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc013a470 con 0x7fbbc0141940 2023-10-25T16:20:02.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbc576d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc013a750 con 0x7fbbc0141d20 2023-10-25T16:20:02.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbbeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 0x7fbbc01f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbbeffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 0x7fbbc01f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51578/0 (socket says 172.21.15.177:51578) 2023-10-25T16:20:02.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.648+0000 7fbbbeffd640 1 -- 172.21.15.177:0/4226655063 learned_addr learned my addr 172.21.15.177:0/4226655063 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:02.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbe7fc640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbc0141940 0x7fbbc015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbf7fe640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbbc0141d20 0x7fbbc015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbeffd640 1 -- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbbc0141d20 msgr2=0x7fbbc015b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbeffd640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbbc0141d20 0x7fbbc015b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbeffd640 1 -- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbc0141940 msgr2=0x7fbbc015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbeffd640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbc0141940 0x7fbbc015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbeffd640 1 -- 172.21.15.177:0/4226655063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4009560 con 0x7fbbc00af4b0 2023-10-25T16:20:02.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbeffd640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 0x7fbbc01f7f40 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c970 tx=0x7fbbb000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:02.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0007c70 con 0x7fbbc00af4b0 2023-10-25T16:20:02.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbbb000f450 con 0x7fbbc00af4b0 2023-10-25T16:20:02.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc013aa30 con 0x7fbbc00af4b0 2023-10-25T16:20:02.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb000f860 con 0x7fbbc00af4b0 2023-10-25T16:20:02.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc013aff0 con 0x7fbbc00af4b0 2023-10-25T16:20:02.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc004db20 con 0x7fbbc00af4b0 2023-10-25T16:20:02.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbbb000f9c0 con 0x7fbbc00af4b0 2023-10-25T16:20:02.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbba77fe640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbac066470 0x7fbbac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:02.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbb0084730 con 0x7fbbc00af4b0 2023-10-25T16:20:02.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbe7fc640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbac066470 0x7fbbac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:02.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.652+0000 7fbbbe7fc640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbac066470 0x7fbbac068930 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40af000 tx=0x7fbbb401b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:02.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.656+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbb0051bc0 con 0x7fbbc00af4b0 2023-10-25T16:20:02.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.872+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbbc00cdc20 con 0x7fbbc00af4b0 2023-10-25T16:20:02.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbba77fe640 1 -- 172.21.15.177:0/4226655063 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbbb001d0b0 con 0x7fbbc00af4b0 2023-10-25T16:20:02.874 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:20:02.875 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:20:02.875 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:20:02.875 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:20:02.875 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:20:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:20:02.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbac066470 msgr2=0x7fbbac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbac066470 0x7fbbac068930 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fbbb40af000 tx=0x7fbbb401b030 comp rx=0 tx=0).stop 2023-10-25T16:20:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 msgr2=0x7fbbc01f7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 0x7fbbc01f7f40 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c970 tx=0x7fbbb000ce30 comp rx=0 tx=0).stop 2023-10-25T16:20:02.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 shutdown_connections 2023-10-25T16:20:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbbac066470 0x7fbbac068930 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbbc0141d20 0x7fbbc015b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbc0141940 0x7fbbc015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 --2- 172.21.15.177:0/4226655063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbc00af4b0 0x7fbbc01f7f40 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:02.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 >> 172.21.15.177:0/4226655063 conn(0x7fbbc00698f0 msgr2=0x7fbbc00ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 shutdown_connections 2023-10-25T16:20:02.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:02.876+0000 7fbbc576d640 1 -- 172.21.15.177:0/4226655063 wait complete. 2023-10-25T16:20:02.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:03.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- 172.21.15.177:0/537784393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc158030 msgr2=0x7fc5dc15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/537784393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc158030 0x7fc5dc15c810 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009900 tx=0x7fc5cc01c7c0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- 172.21.15.177:0/537784393 shutdown_connections 2023-10-25T16:20:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/537784393 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc0cde10 0x7fc5dc0ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/537784393 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc158030 0x7fc5dc15c810 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- 172.21.15.177:0/537784393 >> 172.21.15.177:0/537784393 conn(0x7fc5dc06a830 msgr2=0x7fc5dc06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- 172.21.15.177:0/537784393 shutdown_connections 2023-10-25T16:20:03.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- 172.21.15.177:0/537784393 wait complete. 2023-10-25T16:20:03.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 Processor -- start 2023-10-25T16:20:03.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- start start 2023-10-25T16:20:03.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 0x7fc5dc13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc0cde10 0x7fc5dc15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc158030 0x7fc5dc15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc14b690 con 0x7fc5dc0712a0 2023-10-25T16:20:03.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc14c4f0 con 0x7fc5dc0cde10 2023-10-25T16:20:03.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5e0a59640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc14b8e0 con 0x7fc5dc158030 2023-10-25T16:20:03.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 0x7fc5dc13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 0x7fc5dc13fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51594/0 (socket says 172.21.15.177:51594) 2023-10-25T16:20:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 -- 172.21.15.177:0/1693548670 learned_addr learned my addr 172.21.15.177:0/1693548670 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5dad9d640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc158030 0x7fc5dc15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 -- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc158030 msgr2=0x7fc5dc15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5d9d9b640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc0cde10 0x7fc5dc15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc158030 0x7fc5dc15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 -- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc0cde10 msgr2=0x7fc5dc15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc0cde10 0x7fc5dc15bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 -- 172.21.15.177:0/1693548670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009560 con 0x7fc5dc0712a0 2023-10-25T16:20:03.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5dad9d640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc158030 0x7fc5dc15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.020+0000 7fc5da59c640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 0x7fc5dc13fd20 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009850 tx=0x7fc5cc0a56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc003800 con 0x7fc5dc0712a0 2023-10-25T16:20:03.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc5cc003960 con 0x7fc5dc0712a0 2023-10-25T16:20:03.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc14bbc0 con 0x7fc5dc0712a0 2023-10-25T16:20:03.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc003d30 con 0x7fc5dc0712a0 2023-10-25T16:20:03.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc14c180 con 0x7fc5dc0712a0 2023-10-25T16:20:03.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc04daf0 con 0x7fc5dc0712a0 2023-10-25T16:20:03.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc5cc0b4070 con 0x7fc5dc0712a0 2023-10-25T16:20:03.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5caffd640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5bc0664c0 0x7fc5bc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5cc11e800 con 0x7fc5dc0712a0 2023-10-25T16:20:03.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5d9d9b640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5bc0664c0 0x7fc5bc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.024+0000 7fc5d9d9b640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5bc0664c0 0x7fc5bc068980 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc162e30 tx=0x7fc5d0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.028+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5cc0ebe20 con 0x7fc5dc0712a0 2023-10-25T16:20:03.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5dc04daf0 con 0x7fc5dc0712a0 2023-10-25T16:20:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5caffd640 1 -- 172.21.15.177:0/1693548670 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fc5cc0ef440 con 0x7fc5dc0712a0 2023-10-25T16:20:03.203 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:03.203 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:03.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5bc0664c0 msgr2=0x7fc5bc068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5bc0664c0 0x7fc5bc068980 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc162e30 tx=0x7fc5d0009040 comp rx=0 tx=0).stop 2023-10-25T16:20:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 msgr2=0x7fc5dc13fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 0x7fc5dc13fd20 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009850 tx=0x7fc5cc0a56c0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 shutdown_connections 2023-10-25T16:20:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5bc0664c0 0x7fc5bc068980 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc5dc158030 0x7fc5dc15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5dc0cde10 0x7fc5dc15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 --2- 172.21.15.177:0/1693548670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5dc0712a0 0x7fc5dc13fd20 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 >> 172.21.15.177:0/1693548670 conn(0x7fc5dc06a830 msgr2=0x7fc5dc158680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 shutdown_connections 2023-10-25T16:20:03.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.204+0000 7fc5e0a59640 1 -- 172.21.15.177:0/1693548670 wait complete. 2023-10-25T16:20:03.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:19:53.749743+0000', 'modified': '2023-10-25T16:19:56.046743+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 155741}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_155741': {'gid': 155741, 'name': 'b', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/3822415207', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6835', 'nonce': 3822415207}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 3822415207}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:20:03.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:20:03.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-25T16:20:03.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.764+0000 7f7ac1900640 1 -- 172.21.15.177:0/4243869461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 msgr2=0x7f7abc06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.764+0000 7f7ac1900640 1 --2- 172.21.15.177:0/4243869461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc06be10 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f7abc06c6a0 tx=0x7f7ab401c7b0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- 172.21.15.177:0/4243869461 shutdown_connections 2023-10-25T16:20:03.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 --2- 172.21.15.177:0/4243869461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc06be10 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 --2- 172.21.15.177:0/4243869461 >> v2:172.21.15.184:3300/0 conn(0x7f7abc071500 0x7f7abc070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- 172.21.15.177:0/4243869461 >> 172.21.15.177:0/4243869461 conn(0x7f7abc0b2450 msgr2=0x7f7abc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- 172.21.15.177:0/4243869461 shutdown_connections 2023-10-25T16:20:03.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- 172.21.15.177:0/4243869461 wait complete. 2023-10-25T16:20:03.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 Processor -- start 2023-10-25T16:20:03.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- start start 2023-10-25T16:20:03.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7abc071500 0x7f7abc147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7abc159230 0x7f7abc155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0c9740 con 0x7f7abc06b980 2023-10-25T16:20:03.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc148210 con 0x7f7abc159230 2023-10-25T16:20:03.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1484f0 con 0x7f7abc071500 2023-10-25T16:20:03.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51600/0 (socket says 172.21.15.177:51600) 2023-10-25T16:20:03.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 -- 172.21.15.177:0/784482506 learned_addr learned my addr 172.21.15.177:0/784482506 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7abc159230 0x7f7abc155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 -- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7abc071500 msgr2=0x7f7abc147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7abc071500 0x7f7abc147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7abc071500 0x7f7abc147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 -- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7abc159230 msgr2=0x7f7abc155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7abc159230 0x7f7abc155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 -- 172.21.15.177:0/784482506 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40094a0 con 0x7f7abc06b980 2023-10-25T16:20:03.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7abc159230 0x7f7abc155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7abaffd640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc148fd0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c7a0 tx=0x7f7aac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ab3fff640 1 -- 172.21.15.177:0/784482506 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac003db0 con 0x7f7abc06b980 2023-10-25T16:20:03.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ab3fff640 1 -- 172.21.15.177:0/784482506 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7aac005070 con 0x7f7abc06b980 2023-10-25T16:20:03.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc1487d0 con 0x7f7abc06b980 2023-10-25T16:20:03.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ab3fff640 1 -- 172.21.15.177:0/784482506 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac005480 con 0x7f7abc06b980 2023-10-25T16:20:03.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.768+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc147d50 con 0x7f7abc06b980 2023-10-25T16:20:03.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ab3fff640 1 -- 172.21.15.177:0/784482506 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7aac0055e0 con 0x7f7abc06b980 2023-10-25T16:20:03.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ab3fff640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a9c066470 0x7f7a9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ab3fff640 1 -- 172.21.15.177:0/784482506 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aac083940 con 0x7f7abc06b980 2023-10-25T16:20:03.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a9c066470 0x7f7a9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 Processor -- start 2023-10-25T16:20:03.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- start start 2023-10-25T16:20:03.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a9c066470 0x7f7a9c068930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0adbe0 tx=0x7f7aa4005c60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d20e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d209ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d209c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1e90cc0 con 0x5634d20e59c0 2023-10-25T16:20:03.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1ef3920 con 0x5634d209bf80 2023-10-25T16:20:03.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d1ef0e50 con 0x5634d20e62e0 2023-10-25T16:20:03.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d20e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d20e5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51602/0 (socket says 172.21.15.177:51602) 2023-10-25T16:20:03.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 -- 172.21.15.177:0/3294168042 learned_addr learned my addr 172.21.15.177:0/3294168042 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d209ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d209c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 -- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 msgr2=0x5634d209ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d209ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 -- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 msgr2=0x5634d209c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d209c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 -- 172.21.15.177:0/3294168042 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634d1be5890 con 0x5634d20e59c0 2023-10-25T16:20:03.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d209c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7abaffd640 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d20e5da0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001340 tx=0x7f7aac0552d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23170666eceef46b server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ab17fa640 1 -- 172.21.15.177:0/3294168042 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac06c070 con 0x5634d20e59c0 2023-10-25T16:20:03.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ab17fa640 1 -- 172.21.15.177:0/3294168042 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7aac05ce10 con 0x5634d20e59c0 2023-10-25T16:20:03.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ab17fa640 1 -- 172.21.15.177:0/3294168042 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac051220 con 0x5634d20e59c0 2023-10-25T16:20:03.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/3294168042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 msgr2=0x5634d20e5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d20e5da0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f7aac001340 tx=0x7f7aac0552d0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/3294168042 shutdown_connections 2023-10-25T16:20:03.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d209c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d209ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/3294168042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d20e5da0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.772+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/3294168042 >> 172.21.15.177:0/3294168042 conn(0x5634d20932f0 msgr2=0x5634d209a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/3294168042 shutdown_connections 2023-10-25T16:20:03.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/3294168042 wait complete. 2023-10-25T16:20:03.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- start start 2023-10-25T16:20:03.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 Processor -- start 2023-10-25T16:20:03.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 0x5634d20a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d20e59c0 0x5634d20a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d20a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1eec740 con 0x5634d209bf80 2023-10-25T16:20:03.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1eabd10 con 0x5634d20e59c0 2023-10-25T16:20:03.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d1eab9b0 con 0x5634d20e62e0 2023-10-25T16:20:03.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 10 client.0 _ll_register_callbacks cb 0x5634d20876c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:20:03.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 0x5634d20a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 0x5634d20a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51604/0 (socket says 172.21.15.177:51604) 2023-10-25T16:20:03.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 -- 172.21.15.177:0/1964062303 learned_addr learned my addr 172.21.15.177:0/1964062303 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d20e59c0 0x5634d20a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d20a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 -- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 msgr2=0x5634d20a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d20a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 -- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d20e59c0 msgr2=0x5634d20a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d20e59c0 0x5634d20a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 -- 172.21.15.177:0/1964062303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc147d50 con 0x5634d209bf80 2023-10-25T16:20:03.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d20a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d20e59c0 0x5634d20a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7abaffd640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 0x5634d20a6b90 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f7aac054aa0 tx=0x7f7aac058d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458d0e4ec9199c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:20:03.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/1964062303 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac06c040 con 0x5634d209bf80 2023-10-25T16:20:03.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/1964062303 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aac055e40 con 0x5634d209bf80 2023-10-25T16:20:03.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634d1ea0370 con 0x5634d209bf80 2023-10-25T16:20:03.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/1964062303 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aac054210 con 0x5634d209bf80 2023-10-25T16:20:03.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 10 client.8319 fetch_fsmap learned FSMap version 51 2023-10-25T16:20:03.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5634d1eae460 con 0x5634d209bf80 2023-10-25T16:20:03.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/1964062303 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5634d1ea0370 con 0x5634d209bf80 2023-10-25T16:20:03.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/1964062303 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7aac06c290 con 0x5634d209bf80 2023-10-25T16:20:03.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 10 client.8319 fetch_fsmap finished waiting for FSMap version 51 2023-10-25T16:20:03.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 10 client.8319 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:20:03.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 20 client.8319 populate_metadata read hostname 'smithi177' 2023-10-25T16:20:03.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20f4a50 0x5634d20f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 4 client.8319 mds_command: new command op to 155741 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:20:03.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 --> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634d1e862d0 con 0x5634d20f4a50 2023-10-25T16:20:03.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20f4a50 0x5634d20f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20f4a50 0x5634d20f6e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add20d6bbb98a30f server_cookie=a2966aac7813cf54 in_seq=0 out_seq=0 2023-10-25T16:20:03.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.776+0000 7f7a9a7fc640 10 client.8319 ms_handle_connect on v2:172.21.15.184:6835/3822415207 2023-10-25T16:20:03.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/1964062303 <== mds.0 v2:172.21.15.184:6835/3822415207 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5634d1e862d0 con 0x5634d20f4a50 2023-10-25T16:20:03.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7a9a7fc640 10 client.8319 handle_command_reply: tid=0 2023-10-25T16:20:03.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 client.8319 shutdown 2023-10-25T16:20:03.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 msgr2=0x5634d20a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 0x5634d20a6b90 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f7aac054aa0 tx=0x7f7aac058d20 comp rx=0 tx=0).stop 2023-10-25T16:20:03.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 shutdown_connections 2023-10-25T16:20:03.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20f4a50 0x5634d20f6e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20e62e0 0x5634d20a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7a9a7fc640 0 client.8319 ms_handle_reset on v2:172.21.15.184:6835/3822415207 2023-10-25T16:20:03.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d20e59c0 0x5634d20a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/1964062303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d209bf80 0x5634d20a6b90 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 >> 172.21.15.177:0/1964062303 conn(0x5634d20932f0 msgr2=0x5634d209aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 shutdown_connections 2023-10-25T16:20:03.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/1964062303 wait complete. 2023-10-25T16:20:03.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.780+0000 7f7ac4a4a000 20 client.8319 trim_cache size 0 max 16384 2023-10-25T16:20:03.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 Processor -- start 2023-10-25T16:20:03.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- start start 2023-10-25T16:20:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d2144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2145210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1ba6940 con 0x5634d20e59c0 2023-10-25T16:20:03.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1ee6a40 con 0x5634d209bf80 2023-10-25T16:20:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d20a0d00 con 0x5634d20932f0 2023-10-25T16:20:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51608/0 (socket says 172.21.15.177:51608) 2023-10-25T16:20:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 -- 172.21.15.177:0/5622132 learned_addr learned my addr 172.21.15.177:0/5622132 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abaffd640 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d2144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 -- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 msgr2=0x5634d2144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d2144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 -- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 msgr2=0x5634d2144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 -- 172.21.15.177:0/5622132 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634d1e94760 con 0x5634d20e59c0 2023-10-25T16:20:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2145210 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4005950 tx=0x7f7ab401aff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5a12a6c9974532 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ab1ffb640 1 -- 172.21.15.177:0/5622132 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40bd070 con 0x5634d20e59c0 2023-10-25T16:20:03.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ab1ffb640 1 -- 172.21.15.177:0/5622132 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ab40a5b40 con 0x5634d20e59c0 2023-10-25T16:20:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ab1ffb640 1 -- 172.21.15.177:0/5622132 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4004030 con 0x5634d20e59c0 2023-10-25T16:20:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/5622132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 msgr2=0x5634d2145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2145210 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4005950 tx=0x7f7ab401aff0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/5622132 shutdown_connections 2023-10-25T16:20:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2145210 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/5622132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d2144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/5622132 >> 172.21.15.177:0/5622132 conn(0x5634d20a1860 msgr2=0x5634d20e4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/5622132 shutdown_connections 2023-10-25T16:20:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/5622132 wait complete. 2023-10-25T16:20:03.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- start start 2023-10-25T16:20:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 Processor -- start 2023-10-25T16:20:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d21487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2148d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2103430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1ef0740 con 0x5634d20e59c0 2023-10-25T16:20:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d1eb5720 con 0x5634d209bf80 2023-10-25T16:20:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d209ed90 con 0x5634d20932f0 2023-10-25T16:20:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.796+0000 7f7ac4a4a000 10 client.0 _ll_register_callbacks cb 0x5634d1eeaea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:20:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2103430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2103430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51622/0 (socket says 172.21.15.177:51622) 2023-10-25T16:20:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 -- 172.21.15.177:0/2374424752 learned_addr learned my addr 172.21.15.177:0/2374424752 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abaffd640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d21487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 -- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 msgr2=0x5634d21487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d21487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 -- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 msgr2=0x5634d2148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:20:03.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 -- 172.21.15.177:0/2374424752 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc0cb310 con 0x5634d20e59c0 2023-10-25T16:20:03.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abaffd640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d21487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7aba7fc640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:03.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abb7fe640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2103430 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4005e10 tx=0x7f7ab40a58d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faf4d8efd5d4c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:20:03.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/2374424752 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40bd070 con 0x5634d20e59c0 2023-10-25T16:20:03.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/2374424752 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ab4004330 con 0x5634d20e59c0 2023-10-25T16:20:03.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634d209f950 con 0x5634d20e59c0 2023-10-25T16:20:03.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/2374424752 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab40044f0 con 0x5634d20e59c0 2023-10-25T16:20:03.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 10 client.8325 fetch_fsmap learned FSMap version 51 2023-10-25T16:20:03.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5634d1be5cc0 con 0x5634d20e59c0 2023-10-25T16:20:03.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/2374424752 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5634d209f950 con 0x5634d20e59c0 2023-10-25T16:20:03.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/2374424752 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7ab40b4070 con 0x5634d20e59c0 2023-10-25T16:20:03.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 10 client.8325 fetch_fsmap finished waiting for FSMap version 51 2023-10-25T16:20:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 10 client.8325 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:20:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 20 client.8325 populate_metadata read hostname 'smithi177' 2023-10-25T16:20:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20e62e0 0x5634d2103df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 4 client.8325 mds_command: new command op to 155741 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:20:03.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 --> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5634d1e846f0 con 0x5634d20e62e0 2023-10-25T16:20:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abaffd640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20e62e0 0x5634d2103df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 10 client.8325 ms_handle_connect on v2:172.21.15.184:6835/3822415207 2023-10-25T16:20:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7abaffd640 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20e62e0 0x5634d2103df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b5343b0a1b59242 server_cookie=d034a4359f423e05 in_seq=0 out_seq=0 2023-10-25T16:20:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 1 -- 172.21.15.177:0/2374424752 <== mds.0 v2:172.21.15.184:6835/3822415207 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x5634d1e846f0 con 0x5634d20e62e0 2023-10-25T16:20:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 10 client.8325 handle_command_reply: tid=0 2023-10-25T16:20:03.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 client.8325 shutdown 2023-10-25T16:20:03.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 msgr2=0x5634d2103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2103430 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4005e10 tx=0x7f7ab40a58d0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 shutdown_connections 2023-10-25T16:20:03.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:6835/3822415207,v1:172.21.15.184:6837/3822415207] conn(0x5634d20e62e0 0x5634d2103df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5634d20e59c0 0x5634d2103430 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7a9a7fc640 0 client.8325 ms_handle_reset on v2:172.21.15.184:6835/3822415207 2023-10-25T16:20:03.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634d209bf80 0x5634d2148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 --2- 172.21.15.177:0/2374424752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5634d20932f0 0x5634d21487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 >> 172.21.15.177:0/2374424752 conn(0x5634d20a1860 msgr2=0x5634d20f7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 shutdown_connections 2023-10-25T16:20:03.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 1 -- 172.21.15.177:0/2374424752 wait complete. 2023-10-25T16:20:03.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac4a4a000 20 client.8325 trim_cache size 0 max 16384 2023-10-25T16:20:03.819 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:03.819 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:03.820 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:20:03.820 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 155741, 2023-10-25T16:20:03.820 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:20:03.820 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:20:03.820 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:20:03.821 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1097054400000008, 2023-10-25T16:20:03.821 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 51, 2023-10-25T16:20:03.821 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 143, 2023-10-25T16:20:03.821 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 143, 2023-10-25T16:20:03.821 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 14.185030448999999 2023-10-25T16:20:03.822 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:03.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a9c066470 msgr2=0x7f7a9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a9c066470 0x7f7a9c068930 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0adbe0 tx=0x7f7aa4005c60 comp rx=0 tx=0).stop 2023-10-25T16:20:03.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 msgr2=0x7f7abc148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc148fd0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c7a0 tx=0x7f7aac00cc60 comp rx=0 tx=0).stop 2023-10-25T16:20:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 shutdown_connections 2023-10-25T16:20:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7a9c066470 0x7f7a9c068930 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7abc159230 0x7f7abc155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7abc071500 0x7f7abc147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 --2- 172.21.15.177:0/784482506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7abc06b980 0x7f7abc148fd0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 >> 172.21.15.177:0/784482506 conn(0x7f7abc0b2450 msgr2=0x7f7abc0cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 shutdown_connections 2023-10-25T16:20:03.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.800+0000 7f7ac1900640 1 -- 172.21.15.177:0/784482506 wait complete. 2023-10-25T16:20:03.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:20:03.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.944+0000 7f4e745fc640 1 -- 172.21.15.177:0/2305291317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 msgr2=0x7f4e6c06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.944+0000 7f4e745fc640 1 --2- 172.21.15.177:0/2305291317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c06be10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0ccde0 tx=0x7f4e6401cb10 comp rx=0 tx=0).stop 2023-10-25T16:20:03.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/2305291317 shutdown_connections 2023-10-25T16:20:03.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 --2- 172.21.15.177:0/2305291317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c06be10 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 --2- 172.21.15.177:0/2305291317 >> v2:172.21.15.184:3300/0 conn(0x7f4e6c159230 0x7f4e6c071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/2305291317 >> 172.21.15.177:0/2305291317 conn(0x7f4e6c0b2450 msgr2=0x7f4e6c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:03.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/2305291317 shutdown_connections 2023-10-25T16:20:03.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/2305291317 wait complete. 2023-10-25T16:20:03.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 Processor -- start 2023-10-25T16:20:03.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- start start 2023-10-25T16:20:03.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e6c070510 0x7f4e6c147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e6c159230 0x7f4e6c149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c147b60 con 0x7f4e6c06b980 2023-10-25T16:20:03.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c147e40 con 0x7f4e6c159230 2023-10-25T16:20:03.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c148120 con 0x7f4e6c070510 2023-10-25T16:20:03.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c0add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51636/0 (socket says 172.21.15.177:51636) 2023-10-25T16:20:03.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 -- 172.21.15.177:0/3868832552 learned_addr learned my addr 172.21.15.177:0/3868832552 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:03.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e71b97640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e6c070510 0x7f4e6c147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72b99640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e6c159230 0x7f4e6c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 -- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e6c070510 msgr2=0x7f4e6c147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e6c070510 0x7f4e6c147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 -- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e6c159230 msgr2=0x7f4e6c149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:03.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e6c159230 0x7f4e6c149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:03.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 -- 172.21.15.177:0/3868832552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009820 con 0x7f4e6c06b980 2023-10-25T16:20:03.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e72398640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c0add40 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f4e680058d0 tx=0x7f4e6800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68009c30 con 0x7f4e6c06b980 2023-10-25T16:20:03.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e68009e80 con 0x7f4e6c06b980 2023-10-25T16:20:03.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680106a0 con 0x7f4e6c06b980 2023-10-25T16:20:03.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c148400 con 0x7f4e6c06b980 2023-10-25T16:20:03.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c1498b0 con 0x7f4e6c06b980 2023-10-25T16:20:03.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.948+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c15c100 con 0x7f4e6c06b980 2023-10-25T16:20:03.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.952+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e68010800 con 0x7f4e6c06b980 2023-10-25T16:20:03.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.952+0000 7f4e62ffd640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e50066470 0x7f4e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:03.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.952+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e68084320 con 0x7f4e6c06b980 2023-10-25T16:20:03.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.952+0000 7f4e71b97640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e50066470 0x7f4e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:03.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.952+0000 7f4e71b97640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e50066470 0x7f4e50068930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c149e40 tx=0x7f4e5c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:03.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:03.956+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e680517a0 con 0x7f4e6c06b980 2023-10-25T16:20:04.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.144+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e6c158350 con 0x7f4e6c06b980 2023-10-25T16:20:04.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.144+0000 7f4e62ffd640 1 -- 172.21.15.177:0/3868832552 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e68054dc0 con 0x7f4e6c06b980 2023-10-25T16:20:04.144 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:20:04.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e50066470 msgr2=0x7f4e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:04.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e50066470 0x7f4e50068930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c149e40 tx=0x7f4e5c009040 comp rx=0 tx=0).stop 2023-10-25T16:20:04.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 msgr2=0x7f4e6c0add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:04.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c0add40 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f4e680058d0 tx=0x7f4e6800dde0 comp rx=0 tx=0).stop 2023-10-25T16:20:04.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 shutdown_connections 2023-10-25T16:20:04.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4e50066470 0x7f4e50068930 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:04.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e6c159230 0x7f4e6c149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:04.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e6c070510 0x7f4e6c147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:04.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 --2- 172.21.15.177:0/3868832552 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e6c06b980 0x7f4e6c0add40 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:04.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 >> 172.21.15.177:0/3868832552 conn(0x7f4e6c0b2450 msgr2=0x7f4e6c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:04.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 shutdown_connections 2023-10-25T16:20:04.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:04.148+0000 7f4e745fc640 1 -- 172.21.15.177:0/3868832552 wait complete. 2023-10-25T16:20:04.162 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:20:04.162 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:20:04.163 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:20:04.163 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:20:04.163 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:04.164 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:20:04.164 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:20:04.164 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:20:04.165 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:20:04.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.165 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:20:04.172 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:20:04.172 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:20:04.172 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:20:04.172 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.173 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:20:04.173 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.173 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:20:04.173 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:04.173 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:20:04.174 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:20:04.174 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:04.174 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:20:04.174 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:20:04.174 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:04.175 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:20:04.175 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:04.175 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:20:04.175 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42114sec preferred_lft 42114sec 2023-10-25T16:20:04.175 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:20:04.175 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.176 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:20:04.176 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:04.176 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:20:04.176 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.176 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:20:04.177 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:04.177 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:20:04.177 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.177 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:20:04.177 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.177 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:20:04.178 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:04.178 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:20:04.178 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.178 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:20:04.178 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:04.179 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:20:04.179 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:04.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.180 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:20:04.221 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:20:04.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.222 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:20:04.272 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:20:04.272 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:20:04.273 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:20:04.273 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:20:04.273 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:20:04.273 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:20:04.274 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:20:04.274 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:20:04.274 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:20:04.274 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:20:04.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.275 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:20:04.275 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:20:04.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:20:04.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:20:04.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:20:04.277 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:20:04.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.350 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:20:04.398 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:20:04.398 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:20:04.398 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:20:04.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:20:04.453 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:20:04.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:20:04.454 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:04.501 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:20:04.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:20:04.502 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:04.550 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:20:04.602 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:20:04.603 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:20:04.603 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:20:04.603 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:20:04.603 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:20:04.603 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:20:04.604 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:20:04.604 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:20:04.604 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:20:04.604 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:20:04.604 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:20:04.605 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:20:04.605 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:20:04.605 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:20:04.605 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:20:04.605 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:20:04.605 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:20:04.606 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:20:04.606 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:20:04.606 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:20:04.606 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:20:04.606 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:20:04.607 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:20:04.607 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:20:04.607 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:20:04.608 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:20:04.608 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:20:04.608 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:20:04.608 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:20:04.608 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:04.608 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:04.609 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:04.609 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:04.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.611 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:20:04.657 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:20:04.658 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:20:04.702 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:20:04.709 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:20:04.709 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:20:04.709 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:20:04.710 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:20:04.710 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:20:04.710 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:20:04.710 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:20:04.710 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:20:04.711 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:20:04.711 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:20:04.711 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:20:04.711 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:20:04.712 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:20:04.712 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:20:04.712 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:20:04.712 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:20:04.712 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:20:04.713 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:20:04.713 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:20:04.713 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:20:04.713 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:20:04.713 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:20:04.714 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:20:04.714 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:20:04.714 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:20:04.714 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:20:04.714 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:20:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:20:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:20:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:04.715 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:04.716 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:04.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:04.717 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:20:04.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:20:04.788+0000 7f14400b7580 -1 init, newargv = 0x55fce27ce330 newargc=15 2023-10-25T16:20:04.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[50067]: starting ceph client 2023-10-25T16:20:04.793 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[50067]: starting fuse 2023-10-25T16:20:05.865 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:20:05.874 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:20:05.874 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:20:05.874 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:20:05.874 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:20:05.875 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:20:05.875 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:20:05.875 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:20:05.875 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:20:05.875 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:20:05.875 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:20:05.876 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:20:05.876 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:20:05.876 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:20:05.876 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:20:05.876 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:20:05.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:20:05.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:20:05.877 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:20:05.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:20:05.877 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:20:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:20:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:20:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:20:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:20:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:20:05.878 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:20:05.879 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:20:05.879 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:20:05.879 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:20:05.879 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:05.879 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:20:05.880 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:05.880 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:20:05.880 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:05.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:05.882 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:20:05.929 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:20:05.930 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:20:05.930 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:20:05.931 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:20:05.931 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:20:05.932 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:20:05.932 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:20:05.933 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:20:05.933 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:20:05.933 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:20:05.934 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:20:05.934 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:20:05.935 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:20:05.935 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:20:05.935 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:20:05.936 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:20:05.936 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:20:05.936 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:20:05.937 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:20:05.937 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:20:05.938 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:20:05.938 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:20:05.938 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:20:05.939 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:20:05.939 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:20:05.939 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:20:05.940 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:20:05.940 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:20:05.941 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:20:06.054 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.50067.asok 2023-10-25T16:20:06.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:06.067 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50067.asok 2023-10-25T16:20:06.068 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:06.069 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.50067.asok status 2023-10-25T16:20:06.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:06.255 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:06.256 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:20:06.256 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:20:06.256 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:20:06.256 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:20:06.257 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:20:06.257 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:20:06.257 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "50067", 2023-10-25T16:20:06.257 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:20:06.257 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:06.257 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:20:06.258 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:20:06.258 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 8340, 2023-10-25T16:20:06.258 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:20:06.258 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:20:06.258 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:20:06.259 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 8340 2023-10-25T16:20:06.259 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:06.259 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:20:06.259 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:06.259 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:20:06.260 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3636905109 2023-10-25T16:20:06.260 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:06.260 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:06.260 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:20:06.260 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:06.260 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:20:06.261 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3636905109 2023-10-25T16:20:06.261 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:06.261 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.8340 192.168.0.1:0/3636905109", 2023-10-25T16:20:06.261 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/3636905109", 2023-10-25T16:20:06.261 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:20:06.262 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 51, 2023-10-25T16:20:06.262 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 143, 2023-10-25T16:20:06.262 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:20:06.262 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:20:06.262 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:20:06.263 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:06.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:06.275 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:06.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:20:06.276 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:06.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:06.321 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:20:06.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:06.328 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:06.328 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:06.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:06.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:06.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:06.424 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:20:06.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/2071721590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56a0003f30 msgr2=0x7f56a00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:06.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 --2- 172.21.15.177:0/2071721590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56a0003f30 0x7f56a00047d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009b50 tx=0x7f56ac01d270 comp rx=0 tx=0).stop 2023-10-25T16:20:06.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bdb07640 1 -- 172.21.15.177:0/2071721590 reap_dead start 2023-10-25T16:20:06.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/2071721590 shutdown_connections 2023-10-25T16:20:06.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/2071721590 >> 172.21.15.177:0/2071721590 conn(0x7f56b80b2450 msgr2=0x7f56b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:06.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/2071721590 shutdown_connections 2023-10-25T16:20:06.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/2071721590 wait complete. 2023-10-25T16:20:06.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 Processor -- start 2023-10-25T16:20:06.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- start start 2023-10-25T16:20:06.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56a0003f30 0x7f56b8153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:06.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 0x7f56b81468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:06.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56b8158260 0x7f56b81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:06.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80a9940 con 0x7f56b80a9d60 2023-10-25T16:20:06.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8158c20 con 0x7f56a0003f30 2023-10-25T16:20:06.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80a8cc0 con 0x7f56b8158260 2023-10-25T16:20:06.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 0x7f56b81468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:06.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 0x7f56b81468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51656/0 (socket says 172.21.15.177:51656) 2023-10-25T16:20:06.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 -- 172.21.15.177:0/522999381 learned_addr learned my addr 172.21.15.177:0/522999381 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:06.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bd306640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56a0003f30 0x7f56b8153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:06.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bdb07640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56b8158260 0x7f56b81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:06.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 -- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56b8158260 msgr2=0x7f56b81586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56b8158260 0x7f56b81586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 -- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56a0003f30 msgr2=0x7f56b8153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:06.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56a0003f30 0x7f56b8153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 -- 172.21.15.177:0/522999381 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80a8fa0 con 0x7f56b80a9d60 2023-10-25T16:20:06.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bcb05640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 0x7f56b81468c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f56ac000c10 tx=0x7f56ac0049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac004c50 con 0x7f56b80a9d60 2023-10-25T16:20:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56ac004db0 con 0x7f56b80a9d60 2023-10-25T16:20:06.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b80a9280 con 0x7f56b80a9d60 2023-10-25T16:20:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac005250 con 0x7f56b80a9d60 2023-10-25T16:20:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.552+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b8146e00 con 0x7f56b80a9d60 2023-10-25T16:20:06.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.556+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b804daf0 con 0x7f56b80a9d60 2023-10-25T16:20:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.556+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56ac0aa030 con 0x7f56b80a9d60 2023-10-25T16:20:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.556+0000 7f56b5ffb640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56a4066470 0x7f56a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:06.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.556+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56ac11e600 con 0x7f56b80a9d60 2023-10-25T16:20:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.556+0000 7f56bd306640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56a4066470 0x7f56a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:06.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.556+0000 7f56bd306640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56a4066470 0x7f56a4068930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f56a8001dc0 tx=0x7f56a8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:06.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.560+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56ac0ebc30 con 0x7f56b80a9d60 2023-10-25T16:20:06.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.748+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56b8159740 con 0x7f56b80a9d60 2023-10-25T16:20:06.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.748+0000 7f56b5ffb640 1 -- 172.21.15.177:0/522999381 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f56ac0ef250 con 0x7f56b80a9d60 2023-10-25T16:20:06.748 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:20:06.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56a4066470 msgr2=0x7f56a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:06.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56a4066470 0x7f56a4068930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f56a8001dc0 tx=0x7f56a8009040 comp rx=0 tx=0).stop 2023-10-25T16:20:06.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 msgr2=0x7f56b81468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:06.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 0x7f56b81468c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f56ac000c10 tx=0x7f56ac0049a0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 shutdown_connections 2023-10-25T16:20:06.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56a4066470 0x7f56a4068930 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56b8158260 0x7f56b81586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56b80a9d60 0x7f56b81468c0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 --2- 172.21.15.177:0/522999381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56a0003f30 0x7f56b8153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:06.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 >> 172.21.15.177:0/522999381 conn(0x7f56b80b2450 msgr2=0x7f56b8155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:06.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 shutdown_connections 2023-10-25T16:20:06.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:06.752+0000 7f56bf56a640 1 -- 172.21.15.177:0/522999381 wait complete. 2023-10-25T16:20:06.765 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:20:06.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:20:06.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:20:06.768 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:20:06.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:06.768 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:20:06.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:20:06.769 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:20:06.770 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:20:06.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:06.771 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:20:06.778 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:20:06.779 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:20:06.779 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:20:06.779 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.779 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:20:06.780 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.780 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:20:06.780 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:06.780 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:20:06.780 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:20:06.781 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:06.781 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:20:06.781 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:20:06.781 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:06.781 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:20:06.782 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:06.782 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:20:06.782 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42092sec preferred_lft 42092sec 2023-10-25T16:20:06.782 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:20:06.782 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.783 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:20:06.783 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:06.783 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:20:06.783 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.783 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:20:06.783 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:20:06.784 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:20:06.784 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.784 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:20:06.784 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.785 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:20:06.785 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:06.785 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:20:06.785 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.785 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:20:06.786 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:06.786 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:20:06.786 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:20:06.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:06.787 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:20:06.839 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:20:06.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:06.841 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:20:06.891 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:20:06.891 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:20:06.891 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:20:06.892 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:20:06.892 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:20:06.892 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:20:06.892 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:20:06.893 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:20:06.893 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:20:06.893 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:20:06.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:06.894 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:20:06.895 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:20:06.895 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:20:06.895 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:20:06.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:20:06.898 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:20:06.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:06.969 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:20:07.015 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:20:07.015 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:20:07.015 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:20:07.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:07.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:20:07.075 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:20:07.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:20:07.076 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:07.122 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:20:07.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:20:07.123 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:07.170 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:20:07.220 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:20:07.221 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:20:07.221 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:20:07.221 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:20:07.221 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:20:07.221 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:20:07.222 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:20:07.222 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:20:07.222 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:20:07.222 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:20:07.222 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:20:07.223 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:20:07.223 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:20:07.223 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:20:07.223 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:20:07.223 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:20:07.223 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:20:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:20:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:20:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:20:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:20:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:20:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:20:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:20:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:20:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:20:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:20:07.225 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:20:07.226 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:20:07.226 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:07.226 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:07.226 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:07.226 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:07.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:07.228 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:20:07.274 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:20:07.275 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:20:07.319 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:20:07.326 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:20:07.326 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:20:07.327 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:20:07.327 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:20:07.327 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:20:07.327 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:20:07.327 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:20:07.328 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:20:07.328 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:20:07.328 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:20:07.328 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:20:07.328 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:20:07.329 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:20:07.329 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:20:07.329 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:20:07.329 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:20:07.329 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:20:07.330 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:20:07.330 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:20:07.330 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:20:07.330 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:20:07.330 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:20:07.331 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:20:07.331 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:20:07.331 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:20:07.331 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:20:07.331 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:20:07.331 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:20:07.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:20:07.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:07.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:07.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:07.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:07.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:07.334 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:20:07.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:20:07.401+0000 7f0004b35580 -1 init, newargv = 0x5653d4e075d0 newargc=15 2023-10-25T16:20:07.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35136]: starting ceph client 2023-10-25T16:20:07.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35136]: starting fuse 2023-10-25T16:20:08.486 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:20:08.495 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:20:08.495 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:20:08.495 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:20:08.495 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:20:08.496 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:20:08.496 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:20:08.496 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:20:08.496 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:20:08.496 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:20:08.496 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:20:08.497 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:20:08.497 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:20:08.497 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:20:08.497 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:20:08.497 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:20:08.498 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:20:08.498 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:20:08.498 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:20:08.498 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:20:08.498 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:20:08.499 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:20:08.499 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:20:08.499 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:20:08.499 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:20:08.499 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:20:08.500 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:20:08.500 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:20:08.500 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:20:08.500 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:20:08.500 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:08.500 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:20:08.501 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:08.501 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:20:08.501 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:08.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:08.503 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:20:08.551 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:20:08.551 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:20:08.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:20:08.552 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:20:08.553 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:20:08.553 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:20:08.554 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:20:08.554 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:20:08.555 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:20:08.555 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:20:08.555 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:20:08.556 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:20:08.556 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:20:08.556 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:20:08.557 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:20:08.558 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:20:08.559 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:20:08.559 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:20:08.560 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:20:08.560 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:20:08.560 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:20:08.561 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:20:08.561 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:20:08.561 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:20:08.562 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:20:08.562 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:20:08.563 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:20:08.563 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:20:08.563 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:20:08.675 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.35136.asok 2023-10-25T16:20:08.679 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:08.688 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35136.asok 2023-10-25T16:20:08.688 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:08.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.35136.asok status 2023-10-25T16:20:08.781 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:08.885 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:20:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:20:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:20:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:20:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:20:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:20:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:20:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "35136", 2023-10-25T16:20:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:20:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:20:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:20:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:20:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 155807, 2023-10-25T16:20:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:20:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:20:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:20:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 155807 2023-10-25T16:20:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:20:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:20:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:20:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:20:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1845398739 2023-10-25T16:20:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:20:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:20:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:20:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:20:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:20:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1845398739 2023-10-25T16:20:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:20:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.155807 192.168.0.1:0/1845398739", 2023-10-25T16:20:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/1845398739", 2023-10-25T16:20:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:20:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 51, 2023-10-25T16:20:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 143, 2023-10-25T16:20:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:20:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:20:08.892 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:20:08.892 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:20:08.897 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:08.904 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:08.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:20:08.905 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:08.955 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:08.956 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:20:08.957 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:08.963 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:08.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:08.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:09.009 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:09.010 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:09.016 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/1763151621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b0004d10 msgr2=0x7ff6b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/1763151621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b0004d10 0x7ff6b0005190 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009e30 tx=0x7ff6c001d150 comp rx=0 tx=0).stop 2023-10-25T16:20:09.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 -- 172.21.15.177:0/1763151621 reap_dead start 2023-10-25T16:20:09.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/1763151621 shutdown_connections 2023-10-25T16:20:09.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/1763151621 >> 172.21.15.177:0/1763151621 conn(0x7ff6c80af3f0 msgr2=0x7ff6c80af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:09.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/1763151621 shutdown_connections 2023-10-25T16:20:09.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/1763151621 wait complete. 2023-10-25T16:20:09.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 Processor -- start 2023-10-25T16:20:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- start start 2023-10-25T16:20:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b0004d10 0x7ff6c80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6c80b2450 0x7ff6c8145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 0x7ff6c80c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80b2030 con 0x7ff6c814fe60 2023-10-25T16:20:09.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c8145780 con 0x7ff6c80b2450 2023-10-25T16:20:09.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80b3410 con 0x7ff6b0004d10 2023-10-25T16:20:09.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 0x7ff6c80c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 0x7ff6c80c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51670/0 (socket says 172.21.15.177:51670) 2023-10-25T16:20:09.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 -- 172.21.15.177:0/2428306185 learned_addr learned my addr 172.21.15.177:0/2428306185 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c67fc640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6c80b2450 0x7ff6c8145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c6ffd640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b0004d10 0x7ff6c80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 -- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b0004d10 msgr2=0x7ff6c80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b0004d10 0x7ff6c80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 -- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6c80b2450 msgr2=0x7ff6c8145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6c80b2450 0x7ff6c8145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 -- 172.21.15.177:0/2428306185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80b1690 con 0x7ff6c814fe60 2023-10-25T16:20:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6c77fe640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 0x7ff6c80c6a70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00af040 tx=0x7ff6c00ada10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00adc90 con 0x7ff6c814fe60 2023-10-25T16:20:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff6c0004a50 con 0x7ff6c814fe60 2023-10-25T16:20:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c80b1970 con 0x7ff6c814fe60 2023-10-25T16:20:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0004e20 con 0x7ff6c814fe60 2023-10-25T16:20:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c814e7b0 con 0x7ff6c814fe60 2023-10-25T16:20:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.160+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c80b2170 con 0x7ff6c814fe60 2023-10-25T16:20:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.164+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff6c00b3070 con 0x7ff6c814fe60 2023-10-25T16:20:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.164+0000 7ff6af7fe640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff6b4066470 0x7ff6b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.164+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c00a5e40 con 0x7ff6c814fe60 2023-10-25T16:20:09.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.164+0000 7ff6c6ffd640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff6b4066470 0x7ff6b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.164+0000 7ff6c6ffd640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff6b4066470 0x7ff6b4068930 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8001ce0 tx=0x7ff6b8000f20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:09.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.168+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff6c00ecc50 con 0x7ff6c814fe60 2023-10-25T16:20:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.356+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6c80b2170 con 0x7ff6c814fe60 2023-10-25T16:20:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6af7fe640 1 -- 172.21.15.177:0/2428306185 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7ff6c80b2170 con 0x7ff6c814fe60 2023-10-25T16:20:09.358 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:09.358 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:09.360 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:09.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff6b4066470 msgr2=0x7ff6b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff6b4066470 0x7ff6b4068930 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8001ce0 tx=0x7ff6b8000f20 comp rx=0 tx=0).stop 2023-10-25T16:20:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 msgr2=0x7ff6c80c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 0x7ff6c80c6a70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00af040 tx=0x7ff6c00ada10 comp rx=0 tx=0).stop 2023-10-25T16:20:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 shutdown_connections 2023-10-25T16:20:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff6b4066470 0x7ff6b4068930 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c814fe60 0x7ff6c80c6a70 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6c80b2450 0x7ff6c8145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 --2- 172.21.15.177:0/2428306185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6b0004d10 0x7ff6c80b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 >> 172.21.15.177:0/2428306185 conn(0x7ff6c80af3f0 msgr2=0x7ff6c80ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:09.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 shutdown_connections 2023-10-25T16:20:09.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.360+0000 7ff6cd60c640 1 -- 172.21.15.177:0/2428306185 wait complete. 2023-10-25T16:20:09.378 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:20:09.526 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155741,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.820915399,"mdsmap_epoch":51,"osdmap_epoch":143,"osdmap_epoch_barrier":143,"uptime":19.896239925} 2023-10-25T16:20:09.527 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155741, "mdsmap_epoch": 51, "osdmap_epoch": 143, "osdmap_epoch_barrier": 143, "rank_uptime": 14.820915399, "state": "up:active", "uptime": 19.896239925, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:20:09.527 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-25T16:20:09.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 -- 172.21.15.177:0/30495926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 msgr2=0x7f6730004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 --2- 172.21.15.177:0/30495926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f6730004c50 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f673c009b10 tx=0x7f673c01d210 comp rx=0 tx=0).stop 2023-10-25T16:20:09.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 -- 172.21.15.177:0/30495926 shutdown_connections 2023-10-25T16:20:09.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 --2- 172.21.15.177:0/30495926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f6730004c50 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 -- 172.21.15.177:0/30495926 >> 172.21.15.177:0/30495926 conn(0x7f6748069920 msgr2=0x7f6748069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 -- 172.21.15.177:0/30495926 shutdown_connections 2023-10-25T16:20:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.664+0000 7f674cab0640 1 -- 172.21.15.177:0/30495926 wait complete. 2023-10-25T16:20:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 Processor -- start 2023-10-25T16:20:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- start start 2023-10-25T16:20:09.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f67481f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67480aca00 0x7f67480ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f674815bec0 0x7f674815c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481511c0 con 0x7f67300047d0 2023-10-25T16:20:09.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6748150330 con 0x7f67480aca00 2023-10-25T16:20:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480ad3c0 con 0x7f674815bec0 2023-10-25T16:20:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f67481f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f67481f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51688/0 (socket says 172.21.15.177:51688) 2023-10-25T16:20:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 -- 172.21.15.177:0/3033087406 learned_addr learned my addr 172.21.15.177:0/3033087406 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f6746d9d640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f674815bec0 0x7f674815c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f6745d9b640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67480aca00 0x7f67480ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 -- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f674815bec0 msgr2=0x7f674815c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f674815bec0 0x7f674815c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 -- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67480aca00 msgr2=0x7f67480ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67480aca00 0x7f67480ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 -- 172.21.15.177:0/3033087406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674815c880 con 0x7f67300047d0 2023-10-25T16:20:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674659c640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f67481f2740 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f673800d8c0 tx=0x7f673800dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800b8d0 con 0x7f67300047d0 2023-10-25T16:20:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f673800ba30 con 0x7f67300047d0 2023-10-25T16:20:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6748150540 con 0x7f67300047d0 2023-10-25T16:20:09.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800bda0 con 0x7f67300047d0 2023-10-25T16:20:09.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6748150b00 con 0x7f67300047d0 2023-10-25T16:20:09.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.668+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6748073360 con 0x7f67300047d0 2023-10-25T16:20:09.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.672+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f673801a3b0 con 0x7f67300047d0 2023-10-25T16:20:09.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.672+0000 7f6736ffd640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:09.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.672+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6738083f20 con 0x7f67300047d0 2023-10-25T16:20:09.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.672+0000 7f6745d9b640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:09.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.672+0000 7f6745d9b640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f673c0ad000 tx=0x7f673c019fb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:09.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.676+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6738051430 con 0x7f67300047d0 2023-10-25T16:20:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:09.832+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f674815c880 con 0x7f67300047d0 2023-10-25T16:20:10.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.832+0000 7f6736ffd640 1 -- 172.21.15.177:0/3033087406 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v144) v1 ==== 181+0+0 (secure 0 0 0) 0x7f674815c880 con 0x7f67300047d0 2023-10-25T16:20:10.832 INFO:teuthology.orchestra.run.smithi177.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-25T16:20:10.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 msgr2=0x7f6728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:10.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f673c0ad000 tx=0x7f673c019fb0 comp rx=0 tx=0).stop 2023-10-25T16:20:10.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 msgr2=0x7f67481f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:10.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f67481f2740 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f673800d8c0 tx=0x7f673800dd80 comp rx=0 tx=0).stop 2023-10-25T16:20:10.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 shutdown_connections 2023-10-25T16:20:10.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f67280664a0 0x7f6728068960 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:10.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f674815bec0 0x7f674815c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:10.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67480aca00 0x7f67480ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:10.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 --2- 172.21.15.177:0/3033087406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67300047d0 0x7f67481f2740 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:10.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 >> 172.21.15.177:0/3033087406 conn(0x7f6748069920 msgr2=0x7f674814fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:10.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 shutdown_connections 2023-10-25T16:20:10.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:10.836+0000 7f674cab0640 1 -- 172.21.15.177:0/3033087406 wait complete. 2023-10-25T16:20:10.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:20:10.997 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:20:10.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:20:10.998 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-25T16:20:10.998 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:10.998 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:11.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:11.004 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-25T16:20:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:16+0 records in 2023-10-25T16:20:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:16+0 records out 2023-10-25T16:20:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.172575 s, 97.2 MB/s 2023-10-25T16:20:11.235 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:11.236 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:11.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:11.243 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-25T16:20:11.462 INFO:teuthology.orchestra.run.smithi177.stderr:17+0 records in 2023-10-25T16:20:11.463 INFO:teuthology.orchestra.run.smithi177.stderr:17+0 records out 2023-10-25T16:20:11.463 INFO:teuthology.orchestra.run.smithi177.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.16553 s, 108 MB/s 2023-10-25T16:20:11.464 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-25T16:20:11.464 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/641955910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 msgr2=0x7f9acc15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- 172.21.15.177:0/641955910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc15b600 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0b0020 tx=0x7f9ac401cd60 comp rx=0 tx=0).stop 2023-10-25T16:20:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/641955910 shutdown_connections 2023-10-25T16:20:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- 172.21.15.177:0/641955910 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc15b600 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- 172.21.15.177:0/641955910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9acc06f4c0 0x7f9acc06fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- 172.21.15.177:0/641955910 >> v2:172.21.15.184:3300/0 conn(0x7f9acc157a70 0x7f9acc0ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/641955910 >> 172.21.15.177:0/641955910 conn(0x7f9acc0aeb00 msgr2=0x7f9acc0aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/641955910 shutdown_connections 2023-10-25T16:20:11.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/641955910 wait complete. 2023-10-25T16:20:11.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 Processor -- start 2023-10-25T16:20:11.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- start start 2023-10-25T16:20:11.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9acc06f4c0 0x7f9acc0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:11.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:11.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9acc157a70 0x7f9acc1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:11.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc14bc50 con 0x7f9acc070370 2023-10-25T16:20:11.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0cb770 con 0x7f9acc157a70 2023-10-25T16:20:11.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0caea0 con 0x7f9acc06f4c0 2023-10-25T16:20:11.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:11.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52170/0 (socket says 172.21.15.177:52170) 2023-10-25T16:20:11.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 -- 172.21.15.177:0/3504867792 learned_addr learned my addr 172.21.15.177:0/3504867792 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:11.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acbfff640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9acc06f4c0 0x7f9acc0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:11.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad08db640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9acc157a70 0x7f9acc1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:11.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 -- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9acc06f4c0 msgr2=0x7f9acc0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:11.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9acc06f4c0 0x7f9acc0cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 -- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9acc157a70 msgr2=0x7f9acc1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:11.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9acc157a70 0x7f9acc1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 -- 172.21.15.177:0/3504867792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40098e0 con 0x7f9acc070370 2023-10-25T16:20:11.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9acb7fe640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc152170 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c970 tx=0x7f9abc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:11.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc007c70 con 0x7f9acc070370 2023-10-25T16:20:11.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9abc00f450 con 0x7f9acc070370 2023-10-25T16:20:11.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc0c9a20 con 0x7f9acc070370 2023-10-25T16:20:11.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00f860 con 0x7f9acc070370 2023-10-25T16:20:11.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.596+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc0c9740 con 0x7f9acc070370 2023-10-25T16:20:11.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.600+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc0cb900 con 0x7f9acc070370 2023-10-25T16:20:11.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.600+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9abc00f9c0 con 0x7f9acc070370 2023-10-25T16:20:11.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.600+0000 7f9ac8ff9640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9aac0664a0 0x7f9aac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:11.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.600+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9abc084680 con 0x7f9acc070370 2023-10-25T16:20:11.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.600+0000 7f9acbfff640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9aac0664a0 0x7f9aac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:11.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.600+0000 7f9acbfff640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9aac0664a0 0x7f9aac068960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4005fd0 tx=0x7f9ab4005d10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:11.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.604+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9abc051a80 con 0x7f9acc070370 2023-10-25T16:20:11.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.760+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9acc09b160 con 0x7f9acc070370 2023-10-25T16:20:11.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.760+0000 7f9ac8ff9640 1 -- 172.21.15.177:0/3504867792 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+33994 (secure 0 0 0) 0x7f9abc0550a0 con 0x7f9acc070370 2023-10-25T16:20:11.761 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:11.761 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:11.762 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 144, 2023-10-25T16:20:11.762 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:11.762 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:11.762 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:10.824097+0000", 2023-10-25T16:20:11.762 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:11.763 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:11.763 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:11.763 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:11.763 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:11.763 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:11.764 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:11.764 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:11.764 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:11.764 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:11.764 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:11.765 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:11.765 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:11.765 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:11.765 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:11.765 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:11.766 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:11.766 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:11.766 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:11.767 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:11.767 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:11.767 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:11.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.767 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:11.768 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:11.768 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:11.768 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:11.768 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:11.768 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:11.770 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:11.770 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:11.770 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:11.770 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:11.770 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:11.771 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:11.771 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:11.771 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:11.771 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:11.773 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:11.773 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:11.773 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:11.773 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:11.774 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:11.774 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:11.774 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:11.774 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.774 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:11.775 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:11.775 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:11.775 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:11.775 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:11.775 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:11.775 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:11.777 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:11.778 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:11.778 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:11.778 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:11.778 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:11.778 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:11.779 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:11.779 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:11.779 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:11.779 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:11.779 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:11.780 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:11.780 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:11.780 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:11.780 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:11.780 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:11.781 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:11.781 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:11.781 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:11.781 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:11.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.781 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:11.782 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:11.782 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:11.782 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:11.783 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:11.783 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:11.783 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:11.783 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:11.783 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:11.784 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:11.784 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:11.784 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:11.784 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:11.784 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:11.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.785 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:11.785 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:11.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.785 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:11.786 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:11.786 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:11.786 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:11.786 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:11.786 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:11.787 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:11.787 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:11.787 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:11.788 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.788 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.788 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.788 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:11.788 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:11.789 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:11.789 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:11.789 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:11.789 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:11.789 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:11.790 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:11.790 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:11.790 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:11.790 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:11.790 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:11.791 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:11.791 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:11.791 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:11.791 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:11.791 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:11.793 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:11.793 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:11.794 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:11.794 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:11.794 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:11.794 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:11.794 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:11.795 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:11.795 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:11.795 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:11.795 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.795 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:11.796 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:11.796 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:11.796 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:11.796 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:11.797 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:11.797 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:11.797 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:11.797 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:11.798 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:11.798 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:11.798 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:11.799 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:11.799 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:11.800 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:11.800 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:11.800 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:11.801 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:11.801 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:11.801 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:11.801 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:11.801 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:11.802 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:11.802 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:11.802 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:11.802 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:11.803 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:11.803 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.803 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:11.803 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:11.803 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:11.804 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:11.804 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:11.804 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:11.804 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:11.804 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:11.805 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:11.805 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:11.805 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:11.805 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:11.805 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:11.805 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:11.806 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:11.806 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.806 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:11.806 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:11.806 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:11.807 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.807 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.807 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:11.807 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:11.809 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:11.809 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:11.809 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:11.809 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:11.809 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:11.810 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:11.810 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:11.810 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.810 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.811 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.811 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:11.811 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:11.811 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:11.811 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:11.812 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:11.812 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:11.812 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:11.812 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:11.812 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:11.812 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:11.813 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:11.813 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:11.813 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:11.813 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:11.813 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:11.814 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:11.814 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:11.814 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:11.814 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:11.814 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:11.814 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:11.815 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:11.815 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:11.815 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:11.815 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:11.815 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:11.816 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:11.816 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.816 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "144", 2023-10-25T16:20:11.816 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:11.816 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:11.817 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:11.817 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:11.817 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:11.817 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:11.817 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:11.818 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:11.818 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:11.818 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:11.818 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:11.818 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:11.818 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:11.819 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:11.819 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:11.819 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:11.819 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:11.819 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:11.820 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:11.820 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:11.820 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:11.820 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:11.820 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:11.821 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:11.821 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:11.821 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:11.821 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.821 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:11.821 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:11.822 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:11.822 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:11.822 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:11.822 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:11.822 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:11.823 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:11.823 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:11.823 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:11.823 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:11.823 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:11.824 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:11.824 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:11.824 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.824 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:11.824 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:11.824 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:11.825 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.825 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.825 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:11.825 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:11.825 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:11.826 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:11.826 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:11.826 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:11.826 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:11.826 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:11.826 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:11.827 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.827 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.827 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:11.827 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:11.827 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.828 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.829 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.829 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.829 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.829 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.829 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.830 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.830 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.830 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.830 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.830 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.830 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:11.831 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.831 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.831 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.831 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.831 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.832 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.833 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.833 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.833 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:11.833 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.833 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.834 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.834 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:11.834 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.834 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.835 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.835 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.835 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.835 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.835 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.835 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.836 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:11.836 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.836 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.836 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.837 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.837 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:11.837 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.837 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.837 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.838 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.838 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.838 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.838 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.838 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.838 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:11.839 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.839 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.839 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.839 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:11.840 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:11.840 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.840 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.840 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.840 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:11.841 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:11.841 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:11.841 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:11.841 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.841 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.842 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.842 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.842 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.842 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.842 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:11.842 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.843 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.843 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.843 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.843 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.843 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.844 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.844 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.844 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.844 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.844 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.845 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.845 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.845 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.845 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.845 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:11.846 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.846 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.846 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.846 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:11.846 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.847 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.847 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.847 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.847 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.847 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.848 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.848 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.848 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:11.848 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.848 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.849 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.849 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:11.849 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.849 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.850 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.850 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.850 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.851 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.851 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.851 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:11.851 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.852 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.852 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.852 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:11.852 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.852 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.853 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.853 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.853 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.853 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.853 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.853 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.854 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:11.854 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.854 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.854 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.855 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:11.855 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:11.855 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.855 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.856 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:11.856 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:11.856 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:11.856 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:11.856 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.857 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.857 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.857 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.857 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.857 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.857 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:11.858 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.858 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.858 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.858 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.858 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.859 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.859 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.859 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:11.859 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.859 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.860 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.860 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.860 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.860 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.860 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.861 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:11.861 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.861 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.861 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.861 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.861 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:11.862 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.862 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.862 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.862 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.863 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.863 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.863 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.863 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:11.863 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.864 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.864 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.864 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:11.864 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.865 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.865 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.865 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.865 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.865 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.865 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.866 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.866 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:11.866 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.866 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.866 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.867 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.867 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:11.867 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.867 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.867 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.868 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.868 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.868 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.868 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.868 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.869 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:11.869 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.869 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.869 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.869 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.869 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:11.870 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:11.870 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.870 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.870 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:11.871 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:11.871 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:11.871 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:11.871 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.871 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.872 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.872 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.872 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.872 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:11.872 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.873 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.873 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.873 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.873 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.873 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.874 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.874 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.874 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.874 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.874 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.875 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.875 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.875 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.875 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.875 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:11.876 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.876 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.876 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.876 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:11.876 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.877 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.877 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.877 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.877 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.877 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.878 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.878 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:11.878 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.879 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.879 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.879 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:11.879 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.879 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.879 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.880 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.880 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.880 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.880 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.881 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:11.882 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.882 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.882 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.882 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.882 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.883 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.883 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.883 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.883 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:11.883 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.884 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.884 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.884 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:11.884 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:11.885 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.885 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.885 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.885 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:11.885 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:11.885 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:11.886 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:11.886 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.886 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.886 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.886 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.887 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.887 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:11.887 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.887 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.888 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.888 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.888 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.888 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.888 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.888 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.889 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.889 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.889 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.889 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.889 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.890 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.890 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.890 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:11.890 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.890 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.890 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.891 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.891 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:11.891 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.891 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.891 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.892 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.892 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.892 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.892 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.892 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:11.893 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.893 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.893 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.893 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:11.894 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.894 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.894 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.894 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.895 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.895 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.895 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.895 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:11.895 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.896 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.896 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.896 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.896 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:11.896 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.896 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.897 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.897 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.897 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.897 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.898 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.898 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:11.898 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.898 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.898 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.899 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:11.899 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:11.899 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.899 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.899 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.900 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:11.900 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:11.900 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:11.900 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:11.900 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.901 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.901 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.901 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.901 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:11.902 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.902 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.902 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.902 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.902 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.903 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.903 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.903 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.903 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.903 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.903 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.904 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.904 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.904 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.904 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:11.905 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.905 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.905 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:11.905 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.906 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.906 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.906 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.906 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.907 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.907 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:11.907 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.908 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.908 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:11.908 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.908 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.909 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.909 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.909 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.909 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.910 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:11.910 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.910 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.911 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:11.911 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.911 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.911 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.911 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.912 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.912 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.912 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:11.912 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.913 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.913 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:11.913 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:11.913 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.914 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.914 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:11.914 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:11.914 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:11.915 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:11.915 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.915 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.915 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.915 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.916 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:11.916 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.916 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.916 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.917 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.918 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.918 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.918 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.918 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.919 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.919 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:11.919 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.920 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:11.920 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.920 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.920 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.921 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.921 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:11.922 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.922 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.922 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:11.923 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.923 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.923 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.923 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.924 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:11.924 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.925 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.925 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:11.925 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.925 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.926 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.926 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.926 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.927 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.927 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:11.927 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.927 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.928 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:11.928 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:11.928 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.928 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.928 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.929 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:11.929 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:11.929 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:11.929 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:11.929 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.929 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.930 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.930 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.930 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.930 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:11.931 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:11.931 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:11.931 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:11.931 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:11.931 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:11.931 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:11.932 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:11.932 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:11.932 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:11.932 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:11.932 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:11.933 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:11.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:11.934 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.934 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.934 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.936 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.936 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:11.936 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.937 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:11.937 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.937 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.937 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.938 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:11.938 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:11.939 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.939 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.939 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.939 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:11.940 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.940 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.940 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.940 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.940 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:11.941 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:11.941 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.941 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:11.941 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:11.941 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.941 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.942 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.942 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:11.942 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:11.942 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:11.942 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.943 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.943 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.943 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:11.943 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:11.943 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:11.944 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:11.944 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:11.944 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:11.944 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:11.944 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:11.944 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.945 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:11.945 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:11.945 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.945 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:11.945 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.946 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.946 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.946 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.946 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.946 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:11.946 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.947 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.947 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:11.947 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.947 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.948 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.948 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.948 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.948 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:11.948 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.949 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.949 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.949 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:11.949 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.949 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.949 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.950 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.950 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.950 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:11.950 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.950 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.951 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.951 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:11.951 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.951 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.951 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.951 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.952 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.953 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:11.953 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.953 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.953 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.953 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.953 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.954 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:11.954 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.954 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.954 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.954 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:11.955 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.955 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.955 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.955 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.955 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.956 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:11.956 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.956 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.956 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:11.956 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.957 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.957 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.957 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.957 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.957 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:11.958 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.958 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.958 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:11.958 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:11.958 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:11.958 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:11.959 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:11.959 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:11.959 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:11.959 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:11.959 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:11.960 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.960 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:11.960 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:11.960 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:11.960 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:11.960 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:11.961 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:11.961 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:11.961 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:11.961 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:11.961 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:11.961 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:11.962 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:11.963 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:11.963 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:11.963 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:11.963 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:11.964 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:11.964 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:11.964 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:11.964 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:11.964 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:11.964 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:11.965 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:11.965 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:11.965 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9aac0664a0 msgr2=0x7f9aac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9aac0664a0 0x7f9aac068960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4005fd0 tx=0x7f9ab4005d10 comp rx=0 tx=0).stop 2023-10-25T16:20:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 msgr2=0x7f9acc152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc152170 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00c970 tx=0x7f9abc00ce30 comp rx=0 tx=0).stop 2023-10-25T16:20:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 shutdown_connections 2023-10-25T16:20:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9aac0664a0 0x7f9aac068960 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9acc157a70 0x7f9acc1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9acc070370 0x7f9acc152170 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 --2- 172.21.15.177:0/3504867792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9acc06f4c0 0x7f9acc0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 >> 172.21.15.177:0/3504867792 conn(0x7f9acc0aeb00 msgr2=0x7f9acc0acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 shutdown_connections 2023-10-25T16:20:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:11.764+0000 7f9ad233e640 1 -- 172.21.15.177:0/3504867792 wait complete. 2023-10-25T16:20:11.970 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:20:16.971 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:17.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- 172.21.15.177:0/853409059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 msgr2=0x7feacc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:17.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 --2- 172.21.15.177:0/853409059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feacc00b990 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fead8009eb0 tx=0x7fead801d1f0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- 172.21.15.177:0/853409059 shutdown_connections 2023-10-25T16:20:17.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 --2- 172.21.15.177:0/853409059 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feacc00b990 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- 172.21.15.177:0/853409059 >> 172.21.15.177:0/853409059 conn(0x7feae00b0de0 msgr2=0x7feae00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:17.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- 172.21.15.177:0/853409059 shutdown_connections 2023-10-25T16:20:17.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- 172.21.15.177:0/853409059 wait complete. 2023-10-25T16:20:17.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 Processor -- start 2023-10-25T16:20:17.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- start start 2023-10-25T16:20:17.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feae00c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:17.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feae00c7ed0 0x7feae00b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:17.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feae01557e0 0x7feae00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:17.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00c91b0 con 0x7feacc0051e0 2023-10-25T16:20:17.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00c8ed0 con 0x7feae01557e0 2023-10-25T16:20:17.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae7af0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae00c6eb0 con 0x7feae00c7ed0 2023-10-25T16:20:17.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feae00c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:17.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feae00c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52194/0 (socket says 172.21.15.177:52194) 2023-10-25T16:20:17.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae508b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feae00c7ed0 0x7feae00b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:17.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 -- 172.21.15.177:0/2764257291 learned_addr learned my addr 172.21.15.177:0/2764257291 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:17.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae608d640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feae01557e0 0x7feae00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:17.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 -- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feae00c7ed0 msgr2=0x7feae00b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:17.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feae00c7ed0 0x7feae00b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 -- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feae01557e0 msgr2=0x7feae00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:17.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feae01557e0 0x7feae00b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 -- 172.21.15.177:0/2764257291 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00c7190 con 0x7feacc0051e0 2023-10-25T16:20:17.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae508b640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feae00c7ed0 0x7feae00b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:20:17.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7feae588c640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feae00c7990 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7feadc00d4e0 tx=0x7feadc00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:17.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.112+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc012630 con 0x7feacc0051e0 2023-10-25T16:20:17.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feadc0127d0 con 0x7feacc0051e0 2023-10-25T16:20:17.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae00c7470 con 0x7feacc0051e0 2023-10-25T16:20:17.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc012be0 con 0x7feacc0051e0 2023-10-25T16:20:17.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae00c8c30 con 0x7feacc0051e0 2023-10-25T16:20:17.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae00c6d10 con 0x7feacc0051e0 2023-10-25T16:20:17.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feadc01a3b0 con 0x7feacc0051e0 2023-10-25T16:20:17.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7fead67fc640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feac4066470 0x7feac4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:17.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feadc083d10 con 0x7feacc0051e0 2023-10-25T16:20:17.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7feae508b640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feac4066470 0x7feac4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:17.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.116+0000 7feae508b640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feac4066470 0x7feac4068930 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fead00017b0 tx=0x7fead0001020 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:17.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.120+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feae00c6d10 con 0x7feacc0051e0 2023-10-25T16:20:17.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.272+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7feae00c6d10 con 0x7feacc0051e0 2023-10-25T16:20:17.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.272+0000 7fead67fc640 1 -- 172.21.15.177:0/2764257291 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v144) v1 ==== 81+0+33994 (secure 0 0 0) 0x7feae00c6d10 con 0x7feacc0051e0 2023-10-25T16:20:17.273 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:17.273 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:17.273 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 144, 2023-10-25T16:20:17.273 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:17.274 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:17.274 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:10.824097+0000", 2023-10-25T16:20:17.274 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:17.274 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:17.274 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:17.275 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:17.275 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:17.275 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:17.275 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:17.275 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:17.275 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:17.276 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:17.276 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:17.276 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:17.276 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:17.276 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:17.277 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:17.277 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:17.277 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:17.277 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:17.277 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:17.278 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:17.278 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:17.278 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:17.278 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.278 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:17.279 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:17.279 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:17.279 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:17.279 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:17.279 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:17.280 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:17.280 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:17.280 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:17.280 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:17.280 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:17.281 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:17.281 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:17.281 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:17.281 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:17.281 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:17.282 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:17.282 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:17.282 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:17.282 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:17.282 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:17.283 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:17.283 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:17.283 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:17.283 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:17.283 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:17.284 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:17.284 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.284 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:17.284 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:17.284 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:17.285 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:17.285 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:17.285 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:17.285 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:17.285 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:17.285 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:17.286 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:17.286 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:17.286 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:17.286 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:17.286 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:17.287 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:17.287 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:17.287 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:17.287 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:17.287 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:17.288 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:17.288 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:17.288 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:17.288 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:17.288 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:17.289 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:17.289 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:17.289 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:17.289 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.289 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:17.289 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:17.290 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:17.290 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:17.290 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:17.290 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:17.291 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:17.291 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:17.291 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:17.291 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:17.291 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.292 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:17.293 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:17.293 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.293 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:17.293 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:17.293 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:17.294 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:17.294 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:17.294 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:17.294 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:17.294 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:17.295 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:17.295 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.295 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.295 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.295 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:17.295 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:17.296 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:17.296 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:17.296 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:17.296 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:17.296 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:17.297 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:17.299 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:17.300 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:17.300 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:17.300 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:17.301 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:17.301 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:17.301 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:17.301 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:17.302 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:17.302 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:17.302 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:17.302 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:17.303 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:17.303 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.303 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:17.303 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:17.303 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:17.304 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:17.304 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:17.304 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:17.304 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:17.305 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:17.305 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:17.305 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:17.306 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:17.306 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:17.306 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:17.306 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:17.307 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:17.307 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:17.307 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:17.307 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:17.308 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:17.308 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:17.308 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:17.308 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:17.309 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:17.309 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:17.309 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:17.309 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:17.310 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:17.310 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.310 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:17.311 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:17.311 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:17.311 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:17.311 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:17.312 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:17.312 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:17.312 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:17.312 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:17.313 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:17.314 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:17.314 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.314 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:17.314 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:17.315 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:17.315 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.315 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:17.316 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:17.316 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:17.316 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:17.316 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:17.316 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:17.317 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:17.317 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:17.317 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:17.317 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.317 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.318 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.318 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:17.318 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:17.319 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:17.319 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:17.320 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:17.320 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:17.320 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:17.320 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:17.321 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:17.321 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:17.321 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:17.321 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:17.322 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:17.322 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:17.322 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:17.323 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:17.323 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:17.323 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:17.323 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:17.323 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:17.324 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:17.324 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:17.324 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:17.325 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:17.325 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:17.325 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:17.325 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:17.326 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.326 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "144", 2023-10-25T16:20:17.326 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:17.327 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:17.327 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:17.327 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:17.327 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:17.328 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:17.328 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:17.328 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:17.329 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:17.329 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:17.329 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:17.330 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:17.330 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:17.330 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:17.331 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:17.331 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:17.331 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:17.332 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:17.332 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:17.332 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:17.332 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:17.333 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:17.334 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.335 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:17.335 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:17.335 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:17.335 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:17.336 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:17.336 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:17.336 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:17.336 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:17.337 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:17.337 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:17.337 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:17.337 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:17.338 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:17.338 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:17.338 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.338 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.339 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.340 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:17.340 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:17.340 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:17.340 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:17.341 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:17.341 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:17.341 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:17.341 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:17.342 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:17.342 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.342 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.342 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:17.343 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:17.343 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.343 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:17.343 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.344 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.344 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.344 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.344 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.344 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.345 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.345 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.345 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.345 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.346 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.346 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.346 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.346 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.347 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.347 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:17.347 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.347 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.348 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.349 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.349 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.349 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.349 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.349 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.350 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:17.350 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.350 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.350 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.350 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.351 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:17.351 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.351 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.351 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.351 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.352 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.352 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.352 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.352 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.353 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:17.353 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.353 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.354 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.355 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.355 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.355 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.356 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.356 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.356 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.356 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:17.357 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.357 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.357 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.358 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.358 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:17.358 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:17.358 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.359 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.359 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:17.360 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:17.360 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:17.360 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:17.361 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.361 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.361 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.361 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.362 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.362 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:17.363 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.363 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.363 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.363 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.364 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.364 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.364 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.365 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.365 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.365 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.366 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.366 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.366 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.367 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.367 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.367 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:17.368 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.368 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.368 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.368 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.368 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:17.369 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.369 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.369 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.370 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.370 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.370 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.371 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.371 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:17.371 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.371 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.372 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.372 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.372 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:17.372 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.373 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.373 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.373 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.373 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.373 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.374 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.374 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.374 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:17.374 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.374 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.375 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.376 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.376 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.376 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.376 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.377 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.377 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:17.377 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.377 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.377 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.378 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.378 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:17.378 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:17.378 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.378 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.379 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:17.379 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:17.379 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:17.380 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:17.380 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.380 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.380 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.381 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.381 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.381 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.382 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:17.382 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.382 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.382 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.383 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.383 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.383 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.384 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:17.384 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.384 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.384 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.384 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.385 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.385 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.385 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.385 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:17.386 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.386 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.386 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.387 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.387 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:17.387 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.387 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.388 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.388 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.388 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.388 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.389 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.389 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:17.390 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.390 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.391 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:17.391 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.392 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.392 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.392 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.392 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.393 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.393 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.394 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:17.394 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.394 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:17.395 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.396 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.397 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.397 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.398 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.398 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:17.398 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.399 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.399 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.400 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:17.400 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:17.400 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.400 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.401 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.401 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:17.401 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:17.401 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:17.401 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:17.402 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.402 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.402 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.402 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.403 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.403 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:17.403 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.403 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.404 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.404 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.404 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.404 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.404 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.405 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.405 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.405 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.405 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.405 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.406 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.406 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.406 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:17.407 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.407 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.407 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:17.408 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.408 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.408 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.408 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.409 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.409 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.409 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:17.410 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.410 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.411 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:17.411 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.411 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.411 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.412 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.412 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.412 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.412 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.413 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:17.413 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.414 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.414 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:17.414 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.414 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.415 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.415 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.415 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.415 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:17.416 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.417 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:17.418 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:17.418 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.418 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.419 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:17.419 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:17.419 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:17.419 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:17.420 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.420 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.420 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.420 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.421 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.421 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:17.421 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.422 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.422 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.422 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.423 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.423 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.423 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.423 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.424 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.424 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.424 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.425 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.425 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.425 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.426 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:17.426 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.426 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.427 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.427 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.427 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:17.428 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.428 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.428 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.429 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.429 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.430 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.430 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:17.430 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.430 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.430 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.431 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.431 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:17.431 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.432 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.432 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.433 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.433 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.433 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.434 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.434 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:17.434 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.435 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.435 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:17.435 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.435 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.436 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.438 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.438 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:17.438 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:17.438 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.438 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.439 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:17.439 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:17.439 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:17.440 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:17.440 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.440 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.440 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.441 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.441 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.441 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.441 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:17.442 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.442 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.442 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.442 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.443 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.443 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.443 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.443 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.444 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.444 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.444 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.444 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.445 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.445 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.445 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.445 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:17.446 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.446 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.446 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.447 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:17.447 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.447 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.447 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.448 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.448 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.448 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.448 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.449 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.449 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:17.449 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.450 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:17.450 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.451 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.451 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.451 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.452 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:17.453 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.454 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:17.454 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.454 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.455 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.455 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.455 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.456 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.456 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.456 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.457 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.458 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.459 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.459 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:17.459 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:17.459 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:17.460 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:17.460 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.460 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.460 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.461 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.461 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.461 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:17.462 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.462 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.462 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.463 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.463 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.463 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.463 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.464 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.464 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.464 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.464 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.465 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.465 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.466 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.466 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:17.466 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.467 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.467 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:17.468 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.468 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.468 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.468 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.469 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.469 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.469 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:17.470 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.470 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.471 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:17.471 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.471 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.472 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.472 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.472 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.473 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.473 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:17.473 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.474 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.474 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.474 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:17.474 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.475 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.475 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.475 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.476 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.476 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.477 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:17.477 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:17.478 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.479 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.479 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:17.479 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:17.480 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:17.480 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:17.480 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.480 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.480 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.481 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.482 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:17.482 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:17.482 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:17.483 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:17.483 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:17.483 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:17.483 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:17.484 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:17.484 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:17.484 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:17.484 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:17.484 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:17.485 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:17.485 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.485 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.485 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:17.486 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.486 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.487 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.487 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:17.487 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.487 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.488 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.488 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:17.488 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.489 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.489 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:17.489 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.489 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.490 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.490 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.490 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:17.490 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.491 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.491 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.491 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:17.491 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.492 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:17.492 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.493 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.493 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:17.493 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.494 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.494 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.494 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:17.494 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:17.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.495 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:17.495 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:17.495 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:17.496 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:17.497 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:17.497 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.497 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:17.498 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:17.499 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:17.499 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:17.499 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:17.500 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:17.500 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.500 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:17.500 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:17.501 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.501 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:17.501 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.502 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.502 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.502 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.503 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.503 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:17.503 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.504 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:17.504 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.504 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.504 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.505 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.505 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.505 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:17.505 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.506 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.506 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.506 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:17.506 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.507 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.507 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.507 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.507 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.508 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:17.508 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.508 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.509 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:17.509 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.509 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.509 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.510 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.510 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.510 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:17.510 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.511 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.511 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:17.511 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.512 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.513 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.513 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.514 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.514 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:17.514 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.515 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.515 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:17.515 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.515 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.516 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.516 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.516 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.516 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:17.516 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.517 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.517 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.517 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:17.517 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.517 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:17.518 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:17.519 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:17.520 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:17.520 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:17.520 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:17.520 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:17.520 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:17.521 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:17.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.521 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:17.521 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:17.521 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:17.522 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:17.522 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:17.522 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:17.522 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:17.522 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:17.524 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:17.524 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:17.524 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:17.525 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:17.525 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:17.525 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:17.525 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:17.526 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:17.526 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:17.526 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:17.527 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:17.527 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:17.527 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:17.527 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:17.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:17.528 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feac4066470 msgr2=0x7feac4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feac4066470 0x7feac4068930 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fead00017b0 tx=0x7fead0001020 comp rx=0 tx=0).stop 2023-10-25T16:20:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 msgr2=0x7feae00c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feae00c7990 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7feadc00d4e0 tx=0x7feadc00d9a0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 shutdown_connections 2023-10-25T16:20:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feac4066470 0x7feac4068930 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feae01557e0 0x7feae00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feae00c7ed0 0x7feae00b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 --2- 172.21.15.177:0/2764257291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feacc0051e0 0x7feae00c7990 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 >> 172.21.15.177:0/2764257291 conn(0x7feae00b0de0 msgr2=0x7feae015d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 shutdown_connections 2023-10-25T16:20:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:17.276+0000 7feae7af0640 1 -- 172.21.15.177:0/2764257291 wait complete. 2023-10-25T16:20:17.534 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:20:22.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:22.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/114525382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79a4003a00 msgr2=0x7f79a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:22.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 --2- 172.21.15.177:0/114525382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79a4003a00 0x7f79a4003e20 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f79ac006f10 tx=0x7f79ac01ce10 comp rx=0 tx=0).stop 2023-10-25T16:20:22.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/114525382 shutdown_connections 2023-10-25T16:20:22.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 --2- 172.21.15.177:0/114525382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79a4003a00 0x7f79a4003e20 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:22.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/114525382 >> 172.21.15.177:0/114525382 conn(0x7f79bc0b2450 msgr2=0x7f79bc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:22.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/114525382 shutdown_connections 2023-10-25T16:20:22.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/114525382 wait complete. 2023-10-25T16:20:22.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 Processor -- start 2023-10-25T16:20:22.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- start start 2023-10-25T16:20:22.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a4003a00 0x7f79bc1456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:22.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79bc14a880 0x7f79bc14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:22.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 0x7f79bc14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:22.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc145c30 con 0x7f79bc1472c0 2023-10-25T16:20:22.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc14f370 con 0x7f79a4003a00 2023-10-25T16:20:22.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc14f650 con 0x7f79bc14a880 2023-10-25T16:20:22.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 0x7f79bc14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:22.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 0x7f79bc14ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41676/0 (socket says 172.21.15.177:41676) 2023-10-25T16:20:22.682 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 -- 172.21.15.177:0/2931683176 learned_addr learned my addr 172.21.15.177:0/2931683176 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:22.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bb7fe640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a4003a00 0x7f79bc1456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:22.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79baffd640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79bc14a880 0x7f79bc14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:22.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 -- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79bc14a880 msgr2=0x7f79bc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:22.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79bc14a880 0x7f79bc14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:22.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 -- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a4003a00 msgr2=0x7f79bc1456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:22.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a4003a00 0x7f79bc1456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:22.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 -- 172.21.15.177:0/2931683176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc14f930 con 0x7f79bc1472c0 2023-10-25T16:20:22.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79bbfff640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 0x7f79bc14ce10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f79bc06f5a0 tx=0x7f79b400fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:22.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b4003d90 con 0x7f79bc1472c0 2023-10-25T16:20:22.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f79b400d8b0 con 0x7f79bc1472c0 2023-10-25T16:20:22.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc14fc10 con 0x7f79bc1472c0 2023-10-25T16:20:22.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b400dcc0 con 0x7f79bc1472c0 2023-10-25T16:20:22.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.680+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc14c0f0 con 0x7f79bc1472c0 2023-10-25T16:20:22.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc04daf0 con 0x7f79bc1472c0 2023-10-25T16:20:22.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f79b4004030 con 0x7f79bc1472c0 2023-10-25T16:20:22.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79a3fff640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f79a8066470 0x7f79a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:22.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b40847e0 con 0x7f79bc1472c0 2023-10-25T16:20:22.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f79a806dfa0 con 0x7f79bc1472c0 2023-10-25T16:20:22.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79bb7fe640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f79a8066470 0x7f79a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:22.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.684+0000 7f79bb7fe640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f79a8066470 0x7f79a8068930 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0ac000 tx=0x7f79ac0b0040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:22.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.688+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f79b4051c90 con 0x7f79bc1472c0 2023-10-25T16:20:22.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.848+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f79bc0c9220 con 0x7f79bc1472c0 2023-10-25T16:20:22.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79a3fff640 1 -- 172.21.15.177:0/2931683176 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+34013 (secure 0 0 0) 0x7f79b4021030 con 0x7f79bc1472c0 2023-10-25T16:20:22.851 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:22.851 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:22.851 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 145, 2023-10-25T16:20:22.852 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:22.852 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:22.852 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:17.690015+0000", 2023-10-25T16:20:22.852 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:22.853 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:22.853 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:22.853 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:22.853 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:22.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:22.854 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:22.854 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:22.854 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:22.854 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:22.855 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:22.855 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:22.855 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:22.855 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:22.856 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:22.856 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:22.856 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:22.856 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:22.857 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:22.857 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:22.857 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:22.857 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:22.857 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.858 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:22.858 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:22.858 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:22.858 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:22.859 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:22.859 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:22.859 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:22.859 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:22.859 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:22.860 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:22.860 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:22.860 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:22.860 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:22.861 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:22.861 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:22.861 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:22.862 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:22.862 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:22.862 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:22.862 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:22.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:22.863 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:22.863 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:22.863 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:22.863 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:22.864 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:22.864 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:22.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.864 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:22.864 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:22.865 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:22.865 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:22.865 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:22.865 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:22.866 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:22.866 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:22.866 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:22.866 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:22.866 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:22.867 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:22.867 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:22.867 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:22.867 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:22.867 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:22.868 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:22.868 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:22.868 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:22.868 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:22.868 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:22.869 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:22.869 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:22.869 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:22.869 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:22.869 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:22.870 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:22.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.870 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:22.870 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:22.871 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:22.871 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:22.871 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:22.871 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:22.871 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:22.871 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:22.872 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:22.872 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:22.872 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:22.872 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:22.873 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:22.873 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:22.873 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.875 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:22.876 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:22.877 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.878 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:22.879 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:22.880 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:22.881 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:22.882 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:22.883 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:22.884 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:22.885 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:22.886 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:22.887 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:22.888 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:22.889 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:22.891 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:22.892 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:22.893 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:22.894 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.895 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:20:22.896 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:20:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:22.897 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:22.898 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:22.899 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:22.900 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "145", 2023-10-25T16:20:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:22.901 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:22.902 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:22.903 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:22.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:22.905 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:22.906 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:22.907 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:22.908 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:22.909 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:22.910 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:22.911 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:22.912 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:22.913 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:22.914 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.915 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.916 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.917 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:22.918 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:22.919 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:22.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.922 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.923 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:22.925 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:22.925 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.925 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.925 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.925 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:22.926 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:22.926 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:22.926 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:22.926 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:22.926 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:22.927 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:22.927 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.927 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:22.927 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:22.928 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:22.928 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:22.928 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:22.928 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:22.928 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:22.929 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:22.929 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:22.929 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:22.929 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:22.929 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:22.930 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:22.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.930 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:22.931 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.931 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.931 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:22.931 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.932 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.932 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.932 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:22.932 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:22.933 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.933 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.934 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.934 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:22.934 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.934 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.934 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.935 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:22.935 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.935 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.935 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.936 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:22.936 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.936 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.936 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:22.937 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.937 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.937 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.937 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:22.938 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.938 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:22.938 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.939 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.939 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.939 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:22.939 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:22.940 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.940 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.940 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.940 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:22.940 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:22.941 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:22.941 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:22.941 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:22.941 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:22.941 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:22.941 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.942 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.942 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.942 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:22.942 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:22.942 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:22.943 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:22.943 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:22.943 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:22.943 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:22.943 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:22.944 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:22.944 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:22.944 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:22.944 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:22.944 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:22.944 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.945 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.945 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.945 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:22.945 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.945 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.946 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.946 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.946 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:22.946 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.946 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.946 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.947 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:22.947 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.947 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.947 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.948 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:22.948 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.948 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.948 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:22.949 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.949 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.949 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.949 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.950 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:22.950 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.950 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.950 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.950 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:22.951 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.952 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.952 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.952 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:22.952 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.953 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.953 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.953 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:22.953 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.953 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.953 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.954 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:22.954 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:22.954 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.954 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.955 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.955 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:22.955 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:22.955 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:22.955 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:22.956 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:22.956 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:22.956 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:22.956 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.956 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.957 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:22.957 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:22.957 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:22.957 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:22.957 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:22.958 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:22.958 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:22.958 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:22.958 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:22.958 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:22.958 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:22.959 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:22.959 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:22.959 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.959 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.959 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.960 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:22.960 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.960 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.960 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.960 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.960 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:22.961 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.961 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.961 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.961 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:22.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:22.962 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.963 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.964 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.964 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:22.964 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.965 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.965 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:22.965 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.965 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.966 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:22.966 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.966 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.966 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.967 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:22.967 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.967 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.967 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:22.968 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.968 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:22.968 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:22.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.969 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.969 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:22.969 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:22.970 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:22.970 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:22.970 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:22.970 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:22.970 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:22.970 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.971 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:22.971 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:22.971 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:22.972 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:22.972 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:22.972 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:22.972 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:22.972 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:22.972 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:22.973 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:22.973 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:22.973 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:22.973 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:22.973 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.974 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:22.974 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.975 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.975 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:22.975 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.975 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.975 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.976 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:22.976 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.976 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:22.977 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.977 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:22.978 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.978 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.978 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.978 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:22.979 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.979 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.979 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:22.979 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.980 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.980 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:22.980 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.980 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.981 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.981 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.981 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:22.981 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.981 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.982 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.982 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:22.982 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.983 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.983 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:22.983 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:22.983 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.983 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.984 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:22.984 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:22.984 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:22.984 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:22.984 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:22.985 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:22.985 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:22.985 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.985 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:22.986 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:22.986 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:22.986 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:22.986 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:22.986 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:22.987 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:22.987 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:22.987 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:22.987 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:22.987 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:22.987 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:22.988 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:22.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.988 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:22.989 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:22.989 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.990 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.990 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:22.990 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.991 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:22.991 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.992 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:22.992 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.992 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.992 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.993 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:22.993 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.993 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.993 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:22.994 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.994 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.994 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:22.995 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.995 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:22.996 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:22.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:22.996 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:22.996 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:22.997 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:22.997 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:22.997 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:22.997 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:22.998 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:22.998 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:22.998 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:22.998 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:22.999 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:22.999 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:22.999 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:22.999 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:22.999 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:22.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.000 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:23.000 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.000 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.000 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.001 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.001 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.001 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.001 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.001 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.001 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.002 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.002 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.002 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.002 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.003 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.003 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:23.003 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:23.004 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.004 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.004 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.005 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.005 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:23.006 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.006 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.006 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:23.007 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.007 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.007 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.008 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.008 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.008 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:23.008 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.008 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.009 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.009 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:23.009 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.009 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.010 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.010 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.010 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.010 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.010 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.011 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:23.011 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.011 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:23.013 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:23.013 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:23.013 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:23.013 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.013 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.014 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.014 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.014 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.014 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:23.015 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.015 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.015 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.015 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.015 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.015 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.016 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.016 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.016 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.016 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.016 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.017 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.017 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.017 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.017 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:23.017 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.018 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.018 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:23.018 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.019 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.019 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.019 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.020 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.020 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:23.020 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.020 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.021 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.021 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:23.021 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.021 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.022 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.022 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.022 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.022 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.022 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.023 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:23.023 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.023 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.023 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.023 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.023 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:23.024 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.024 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.024 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.024 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.024 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.025 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.025 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.025 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.025 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:23.025 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.025 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.026 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.026 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.026 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:23.026 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.027 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.027 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.027 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:23.027 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:23.027 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:23.028 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:23.028 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.028 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.028 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.028 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.028 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.029 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:23.029 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:23.029 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.029 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:23.029 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.030 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.030 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.030 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.030 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.030 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:23.030 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.031 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.031 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.031 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:23.031 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.031 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.032 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.032 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.032 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.032 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:23.032 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.033 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.033 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.033 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:23.033 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.033 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.033 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.034 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.034 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.034 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:23.034 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.034 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.035 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.035 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:23.035 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.035 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.035 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.035 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.036 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.036 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:23.036 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.036 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.036 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.037 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:23.037 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.037 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.037 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.037 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.038 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.038 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:23.038 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.038 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.038 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.039 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:23.039 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.039 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.039 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.039 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.039 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.040 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:23.040 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.040 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.040 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.040 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:23.041 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.041 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.041 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.041 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.041 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.041 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:23.042 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.042 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.042 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.042 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:23.042 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.043 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.043 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.043 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.043 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.043 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:23.045 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.045 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.045 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:23.045 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:23.046 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:23.046 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:23.046 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:23.046 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:23.046 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:23.047 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:23.047 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:23.047 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:23.047 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:23.047 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:23.047 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:23.048 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:23.048 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:23.048 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.048 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.048 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:23.049 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:23.049 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:23.049 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:23.049 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:23.049 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:23.049 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:23.050 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:23.050 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:23.050 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:23.050 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:23.050 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.051 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:23.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f79a8066470 msgr2=0x7f79a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f79a8066470 0x7f79a8068930 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0ac000 tx=0x7f79ac0b0040 comp rx=0 tx=0).stop 2023-10-25T16:20:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 msgr2=0x7f79bc14ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 0x7f79bc14ce10 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f79bc06f5a0 tx=0x7f79b400fed0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 shutdown_connections 2023-10-25T16:20:23.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f79a8066470 0x7f79a8068930 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79bc1472c0 0x7f79bc14ce10 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79bc14a880 0x7f79bc14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 --2- 172.21.15.177:0/2931683176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79a4003a00 0x7f79bc1456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.852+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 >> 172.21.15.177:0/2931683176 conn(0x7f79bc0b2450 msgr2=0x7f79bc15cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:23.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.856+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 shutdown_connections 2023-10-25T16:20:23.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:22.856+0000 7f79c1d17640 1 -- 172.21.15.177:0/2931683176 wait complete. 2023-10-25T16:20:23.055 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-25T16:20:23.056 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:23.056 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:23.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:23.063 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-25T16:20:23.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:20:23.177 INFO:teuthology.orchestra.run.smithi177.stderr:dd: error writing 'large_file_b': No space left on device 2023-10-25T16:20:23.177 INFO:teuthology.orchestra.run.smithi177.stderr:dd: closing output file 'large_file_b': No space left on device 2023-10-25T16:20:23.178 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:23.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/3606656195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa480047d0 msgr2=0x7ffa48004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 --2- 172.21.15.177:0/3606656195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa480047d0 0x7ffa48004c50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c290 tx=0x7ffa4c01f760 comp rx=0 tx=0).stop 2023-10-25T16:20:23.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa62c20640 1 -- 172.21.15.177:0/3606656195 reap_dead start 2023-10-25T16:20:23.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/3606656195 shutdown_connections 2023-10-25T16:20:23.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/3606656195 >> 172.21.15.177:0/3606656195 conn(0x7ffa5c0af5b0 msgr2=0x7ffa5c0af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/3606656195 shutdown_connections 2023-10-25T16:20:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/3606656195 wait complete. 2023-10-25T16:20:23.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 Processor -- start 2023-10-25T16:20:23.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- start start 2023-10-25T16:20:23.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480047d0 0x7ffa5c0c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 0x7ffa5c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa5c1494d0 0x7ffa5c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c15a720 con 0x7ffa5c1f2460 2023-10-25T16:20:23.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c15aa00 con 0x7ffa480047d0 2023-10-25T16:20:23.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c148cd0 con 0x7ffa5c1494d0 2023-10-25T16:20:23.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 0x7ffa5c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 0x7ffa5c159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41694/0 (socket says 172.21.15.177:41694) 2023-10-25T16:20:23.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 -- 172.21.15.177:0/2381629090 learned_addr learned my addr 172.21.15.177:0/2381629090 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa6241f640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480047d0 0x7ffa5c0c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa62c20640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa5c1494d0 0x7ffa5c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 -- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa5c1494d0 msgr2=0x7ffa5c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa5c1494d0 0x7ffa5c06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 -- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480047d0 msgr2=0x7ffa5c0c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480047d0 0x7ffa5c0c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 -- 172.21.15.177:0/2381629090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c148fb0 con 0x7ffa5c1f2460 2023-10-25T16:20:23.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa62c20640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa5c1494d0 0x7ffa5c06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa61c1e640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 0x7ffa5c159ed0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0262d0 tx=0x7ffa4c006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0b5070 con 0x7ffa5c1f2460 2023-10-25T16:20:23.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffa4c001440 con 0x7ffa5c1f2460 2023-10-25T16:20:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c15a410 con 0x7ffa5c1f2460 2023-10-25T16:20:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c001810 con 0x7ffa5c1f2460 2023-10-25T16:20:23.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.308+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c149950 con 0x7ffa5c1f2460 2023-10-25T16:20:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c149140 con 0x7ffa5c1f2460 2023-10-25T16:20:23.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa4c003600 con 0x7ffa5c1f2460 2023-10-25T16:20:23.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa52ffd640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa40066470 0x7ffa40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa4c0b8040 con 0x7ffa5c1f2460 2023-10-25T16:20:23.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7ffa4006dfa0 con 0x7ffa5c1f2460 2023-10-25T16:20:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa6241f640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa40066470 0x7ffa40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.312+0000 7ffa6241f640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa40066470 0x7ffa40068930 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009ab0 tx=0x7ffa580091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:23.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.316+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa4c0ee7f0 con 0x7ffa5c1f2460 2023-10-25T16:20:23.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.456+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffa5c04daf0 con 0x7ffa5c1f2460 2023-10-25T16:20:23.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa52ffd640 1 -- 172.21.15.177:0/2381629090 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+34013 (secure 0 0 0) 0x7ffa4c0f1e10 con 0x7ffa5c1f2460 2023-10-25T16:20:23.459 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:23.459 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:23.459 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 145, 2023-10-25T16:20:23.459 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:23.459 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:23.460 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:17.690015+0000", 2023-10-25T16:20:23.460 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:23.460 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:23.460 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:23.460 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:23.461 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:23.461 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:23.461 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:23.461 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:23.461 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:23.462 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:23.462 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:23.462 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:23.462 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:23.462 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:23.462 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:23.463 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:23.463 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:23.463 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:23.463 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:23.463 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:23.464 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:23.464 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:23.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.464 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:23.464 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:23.465 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:23.465 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:23.465 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:23.465 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:23.465 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:23.465 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:23.466 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:23.466 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:23.466 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:23.466 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:23.466 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:23.467 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:23.467 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:23.467 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:23.467 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:23.467 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:23.468 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:23.468 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:23.468 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:23.468 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:23.468 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:23.469 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:23.469 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:23.469 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:23.469 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:23.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.470 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:23.470 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:23.470 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:23.470 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:23.470 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:23.470 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:23.471 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:23.471 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:23.471 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:23.471 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:23.471 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:23.472 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:23.472 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:23.472 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:23.472 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:23.472 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:23.473 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:23.473 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:23.473 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:23.473 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:23.473 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:23.473 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:23.474 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:23.474 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:23.474 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:23.474 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:23.474 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:23.475 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.475 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:23.475 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:23.475 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:23.475 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:23.475 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:23.476 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:23.476 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:23.476 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:23.476 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:23.476 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:23.477 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:23.477 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:23.477 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:23.477 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:23.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.477 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:23.478 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:23.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.478 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:23.478 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:23.478 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:23.479 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:23.479 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:23.479 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:23.479 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:23.479 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:23.480 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:23.480 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.480 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.480 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:23.481 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:23.481 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:23.481 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:23.481 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:23.481 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:23.481 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:23.482 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:23.482 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:23.482 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:23.482 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:23.482 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:23.483 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:23.483 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:23.483 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:23.483 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:23.483 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:23.484 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:23.484 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:23.484 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:23.484 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:23.484 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:23.484 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:23.485 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:23.485 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:23.485 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:23.485 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:23.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.486 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:23.486 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:23.486 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:23.486 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:23.486 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:23.487 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:23.487 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:23.487 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:23.487 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:23.487 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:23.487 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:23.488 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:23.488 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:23.488 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:23.488 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:23.488 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:23.489 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:23.489 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:23.489 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:23.489 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:23.489 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:23.490 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:23.490 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:23.490 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:23.490 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:23.490 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:23.491 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:23.491 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.491 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:23.491 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:23.491 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:23.491 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:23.492 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:23.492 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:23.492 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:23.492 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:23.492 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:23.493 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:23.493 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:23.493 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:23.493 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:23.493 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:23.493 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:23.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.494 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:23.494 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:23.494 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:23.494 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.495 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.495 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:23.495 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:23.495 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:23.495 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:23.496 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:23.496 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:23.496 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:23.496 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:23.496 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:23.496 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.497 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:23.497 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:23.497 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:23.498 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:20:23.498 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:20:23.498 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:23.498 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:23.498 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:23.499 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:23.499 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:23.499 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:23.499 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:23.499 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:23.499 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:23.500 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:23.500 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:23.500 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:23.500 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:23.500 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:23.500 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:23.501 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:23.501 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:23.501 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:23.501 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:23.501 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:23.502 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:23.502 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:23.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.502 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "145", 2023-10-25T16:20:23.502 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:23.503 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:23.503 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:23.503 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:23.503 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:23.503 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:23.504 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:23.504 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:23.504 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:23.504 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:23.504 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:23.504 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:23.505 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:23.505 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:23.505 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:23.505 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:23.506 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:23.506 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:23.506 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:23.506 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:23.506 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:23.507 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:23.507 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:23.507 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:23.507 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:23.507 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:23.509 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.509 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:23.509 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:23.509 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:23.510 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:23.510 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:23.510 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:23.510 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:23.510 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:23.511 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:23.511 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:23.511 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:23.511 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:23.511 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:23.512 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:23.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.512 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:23.512 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:23.513 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:23.514 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:23.514 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:23.514 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:23.514 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:23.514 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:23.515 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:23.515 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:23.515 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.515 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.515 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:23.515 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:23.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.516 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:23.516 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.516 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.516 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.517 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.517 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.517 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.517 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.517 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.518 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.518 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.518 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.518 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.518 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.519 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.519 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.519 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:23.519 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.520 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.520 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:23.520 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.520 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.521 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.521 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.521 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.521 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.521 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.522 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:23.522 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.522 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.522 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:23.524 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:23.525 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.526 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:23.528 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:23.529 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.530 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.531 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.532 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.533 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.536 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.537 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.538 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:23.539 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.540 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:23.544 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.545 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.546 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.547 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.548 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.549 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:23.550 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.551 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.552 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.553 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.554 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.555 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:23.558 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:23.559 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.561 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.562 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.563 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.565 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.566 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.567 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.568 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.569 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.570 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.571 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:23.572 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:23.573 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:23.574 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.575 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:23.576 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.577 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.578 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:23.579 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:23.580 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.581 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.584 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.585 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.586 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:23.587 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:23.588 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:23.589 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.590 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.591 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.592 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.593 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.595 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.596 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.597 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:23.599 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:23.600 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.601 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:23.602 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:23.603 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:23.604 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.606 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.607 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.610 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.611 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.612 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:23.614 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:23.615 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.616 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.618 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:23.619 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:23.621 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:23.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.623 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.625 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.627 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:23.628 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.631 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.632 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.633 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:23.634 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:23.635 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:23.636 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.636 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:23.636 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.636 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.636 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.637 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.637 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.637 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:23.637 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.638 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.638 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:23.638 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.638 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.638 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.638 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.639 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.639 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:23.639 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.640 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:23.640 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.640 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.640 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.640 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.641 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.641 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:23.641 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.642 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:23.642 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.642 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.642 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.642 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.643 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.643 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:23.643 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.643 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.644 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:23.644 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.644 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.644 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.644 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.645 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.645 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:23.645 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.646 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:23.646 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.646 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.646 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.646 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.646 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.647 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:23.647 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.647 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.647 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.647 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:23.648 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.648 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.648 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.648 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.648 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.649 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:23.649 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:23.649 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:23.650 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:23.650 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:23.650 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:23.650 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:23.650 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:23.651 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:23.651 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:23.651 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.651 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:23.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:23.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:23.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:23.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:23.652 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:23.653 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:23.653 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:23.653 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:23.653 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:23.654 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:23.654 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:23.654 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:23.654 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:23.654 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:23.655 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:23.655 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:23.655 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:23.656 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:23.657 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:23.658 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:23.658 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:23.658 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:23.659 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:23.659 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:23.659 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:23.659 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:23.660 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:23.660 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa40066470 msgr2=0x7ffa40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa40066470 0x7ffa40068930 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009ab0 tx=0x7ffa580091e0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 msgr2=0x7ffa5c159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 0x7ffa5c159ed0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0262d0 tx=0x7ffa4c006650 comp rx=0 tx=0).stop 2023-10-25T16:20:23.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 shutdown_connections 2023-10-25T16:20:23.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa40066470 0x7ffa40068930 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa5c1494d0 0x7ffa5c06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c1f2460 0x7ffa5c159ed0 secure :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0262d0 tx=0x7ffa4c006650 comp rx=0 tx=0).stop 2023-10-25T16:20:23.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 --2- 172.21.15.177:0/2381629090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480047d0 0x7ffa5c0c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 >> 172.21.15.177:0/2381629090 conn(0x7ffa5c0af5b0 msgr2=0x7ffa5c072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:23.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 shutdown_connections 2023-10-25T16:20:23.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.460+0000 7ffa64683640 1 -- 172.21.15.177:0/2381629090 wait complete. 2023-10-25T16:20:23.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/3346990711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f445406b980 msgr2=0x7f445406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 --2- 172.21.15.177:0/3346990711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f445406b980 0x7f445406be10 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f44540ccde0 tx=0x7f444c01ccd0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/3346990711 shutdown_connections 2023-10-25T16:20:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 --2- 172.21.15.177:0/3346990711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f445406b980 0x7f445406be10 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 --2- 172.21.15.177:0/3346990711 >> v2:172.21.15.184:3300/0 conn(0x7f4454159230 0x7f4454071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/3346990711 >> 172.21.15.177:0/3346990711 conn(0x7f44540b2450 msgr2=0x7f44540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/3346990711 shutdown_connections 2023-10-25T16:20:23.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/3346990711 wait complete. 2023-10-25T16:20:23.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 Processor -- start 2023-10-25T16:20:23.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- start start 2023-10-25T16:20:23.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445406b980 0x7f44540af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 0x7f445415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4454159230 0x7f445415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540ae620 con 0x7f4454070510 2023-10-25T16:20:23.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44541564c0 con 0x7f4454159230 2023-10-25T16:20:23.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44540aeea0 con 0x7f445406b980 2023-10-25T16:20:23.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 0x7f445415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 0x7f445415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41716/0 (socket says 172.21.15.177:41716) 2023-10-25T16:20:23.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 -- 172.21.15.177:0/648802862 learned_addr learned my addr 172.21.15.177:0/648802862 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:23.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f4453fff640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445406b980 0x7f44540af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 -- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445406b980 msgr2=0x7f44540af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445406b980 0x7f44540af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 -- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4454159230 msgr2=0x7f445415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4454159230 0x7f445415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 -- 172.21.15.177:0/648802862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0098e0 con 0x7f4454070510 2023-10-25T16:20:23.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f4453fff640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445406b980 0x7f44540af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:23.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f44537fe640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 0x7f445415ade0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f444800c4b0 tx=0x7f444800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:23.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448012830 con 0x7f4454070510 2023-10-25T16:20:23.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4448012aa0 con 0x7f4454070510 2023-10-25T16:20:23.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44541561e0 con 0x7f4454070510 2023-10-25T16:20:23.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4448011380 con 0x7f4454070510 2023-10-25T16:20:23.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.800+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540aeb30 con 0x7f4454070510 2023-10-25T16:20:23.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445406c000 con 0x7f4454070510 2023-10-25T16:20:23.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f44480114e0 con 0x7f4454070510 2023-10-25T16:20:23.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f4450ff9640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44400664a0 0x7f4440068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:23.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4448083ec0 con 0x7f4454070510 2023-10-25T16:20:23.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f444006dfd0 con 0x7f4454070510 2023-10-25T16:20:23.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f4453fff640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44400664a0 0x7f4440068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:23.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.804+0000 7f4453fff640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44400664a0 0x7f4440068960 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f44440058d0 tx=0x7f4444005ca0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:23.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.808+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4448051340 con 0x7f4454070510 2023-10-25T16:20:23.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.992+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f445404daf0 con 0x7f4454070510 2023-10-25T16:20:23.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f4450ff9640 1 -- 172.21.15.177:0/648802862 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f4448054960 con 0x7f4454070510 2023-10-25T16:20:23.993 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:23.994 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:23.994 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44400664a0 msgr2=0x7f4440068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44400664a0 0x7f4440068960 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f44440058d0 tx=0x7f4444005ca0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 msgr2=0x7f445415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 0x7f445415ade0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f444800c4b0 tx=0x7f444800c970 comp rx=0 tx=0).stop 2023-10-25T16:20:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 shutdown_connections 2023-10-25T16:20:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f44400664a0 0x7f4440068960 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4454159230 0x7f445415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4454070510 0x7f445415ade0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 --2- 172.21.15.177:0/648802862 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f445406b980 0x7f44540af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 >> 172.21.15.177:0/648802862 conn(0x7f44540b2450 msgr2=0x7f44540b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 shutdown_connections 2023-10-25T16:20:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:23.996+0000 7f445a929640 1 -- 172.21.15.177:0/648802862 wait complete. 2023-10-25T16:20:24.011 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:20:24.156 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155741,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.451361443,"mdsmap_epoch":51,"osdmap_epoch":145,"osdmap_epoch_barrier":143,"uptime":34.526686353000002} 2023-10-25T16:20:24.156 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155741, "mdsmap_epoch": 51, "osdmap_epoch": 145, "osdmap_epoch_barrier": 143, "rank_uptime": 29.451361443, "state": "up:active", "uptime": 34.526686353, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:20:24.157 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:20:24.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:24.157 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-25T16:20:24.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:24.169 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-25T16:20:24.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:24.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 -- 172.21.15.177:0/459521757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72281537d0 msgr2=0x7f7228159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:24.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 --2- 172.21.15.177:0/459521757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72281537d0 0x7f7228159780 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f7218009900 tx=0x7f721801c850 comp rx=0 tx=0).stop 2023-10-25T16:20:24.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 -- 172.21.15.177:0/459521757 shutdown_connections 2023-10-25T16:20:24.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 --2- 172.21.15.177:0/459521757 >> v2:172.21.15.184:3300/0 conn(0x7f72280705b0 0x7f722806bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 --2- 172.21.15.177:0/459521757 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72280c9f00 0x7f722806ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 --2- 172.21.15.177:0/459521757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72281537d0 0x7f7228159780 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 -- 172.21.15.177:0/459521757 >> 172.21.15.177:0/459521757 conn(0x7f72280b2450 msgr2=0x7f72280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:24.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 -- 172.21.15.177:0/459521757 shutdown_connections 2023-10-25T16:20:24.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.408+0000 7f722d99e640 1 -- 172.21.15.177:0/459521757 wait complete. 2023-10-25T16:20:24.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 Processor -- start 2023-10-25T16:20:24.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- start start 2023-10-25T16:20:24.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 0x7f7228141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:24.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72280c9f00 0x7f72280b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:24.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72280b0c80 0x7f722814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:24.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722814def0 con 0x7f72280705b0 2023-10-25T16:20:24.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228142240 con 0x7f72280b0c80 2023-10-25T16:20:24.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722814a360 con 0x7f72280c9f00 2023-10-25T16:20:24.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 0x7f7228141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:24.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 0x7f7228141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41736/0 (socket says 172.21.15.177:41736) 2023-10-25T16:20:24.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 -- 172.21.15.177:0/3645481375 learned_addr learned my addr 172.21.15.177:0/3645481375 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:24.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f72267fc640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72280c9f00 0x7f72280b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:24.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f72277fe640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72280b0c80 0x7f722814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:24.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 -- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72280c9f00 msgr2=0x7f72280b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:24.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72280c9f00 0x7f72280b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 -- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72280b0c80 msgr2=0x7f722814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72280b0c80 0x7f722814a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 -- 172.21.15.177:0/3645481375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7218009560 con 0x7f72280705b0 2023-10-25T16:20:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f7226ffd640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 0x7f7228141d00 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f721801cd30 tx=0x7f72180a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218005230 con 0x7f72280705b0 2023-10-25T16:20:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f72180a5860 con 0x7f72280705b0 2023-10-25T16:20:24.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7228149a70 con 0x7f72280705b0 2023-10-25T16:20:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180046d0 con 0x7f72280705b0 2023-10-25T16:20:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7228149d10 con 0x7f72280705b0 2023-10-25T16:20:24.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722804daf0 con 0x7f72280705b0 2023-10-25T16:20:24.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.412+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f72180b4040 con 0x7f72280705b0 2023-10-25T16:20:24.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.416+0000 7f720ffff640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7214066470 0x7f7214068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:24.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.416+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f721811e040 con 0x7f72280705b0 2023-10-25T16:20:24.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.416+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7f721406dfa0 con 0x7f72280705b0 2023-10-25T16:20:24.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.416+0000 7f72267fc640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7214066470 0x7f7214068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:24.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.416+0000 7f72267fc640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7214066470 0x7f7214068930 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7228152a00 tx=0x7f721c005e30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:24.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.420+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f72180bc060 con 0x7f72280705b0 2023-10-25T16:20:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.572+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f722815c060 con 0x7f72280705b0 2023-10-25T16:20:24.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f720ffff640 1 -- 172.21.15.177:0/3645481375 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+34013 (secure 0 0 0) 0x7f72180b2020 con 0x7f72280705b0 2023-10-25T16:20:24.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:24.574 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:24.574 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 145, 2023-10-25T16:20:24.574 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:24.575 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:24.575 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:17.690015+0000", 2023-10-25T16:20:24.575 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:24.575 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:24.575 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:24.576 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:24.576 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:24.576 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:24.576 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:24.576 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:24.577 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:24.577 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:24.577 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:24.577 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:24.577 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:24.578 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:24.578 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:24.578 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:24.578 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:24.579 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:24.579 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:24.579 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:24.579 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:24.579 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:24.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.580 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:24.580 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:24.580 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:24.580 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:24.580 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:24.581 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:24.581 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:24.581 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:24.581 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:24.581 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:24.582 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:24.582 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:24.582 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:24.582 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:24.582 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:24.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:24.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:24.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:24.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:24.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:24.584 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:24.584 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:24.584 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:24.584 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:24.584 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:24.586 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:24.586 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:24.586 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:24.586 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:24.586 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:24.587 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:24.587 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:24.587 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:24.587 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:24.587 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:24.588 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:24.588 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:24.588 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:24.588 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:24.588 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:24.589 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:24.589 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:24.589 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:24.589 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:24.589 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:24.589 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:24.590 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:24.590 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:24.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:24.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.590 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:24.591 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:24.591 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:24.591 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:24.591 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:24.591 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:24.592 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:24.592 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:24.592 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:24.592 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:24.592 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:24.593 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:24.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:24.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:24.593 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.594 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:24.594 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:24.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.594 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:24.594 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:24.595 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:24.595 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:24.595 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:24.595 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:24.595 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:24.596 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:24.596 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:24.596 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.597 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:24.597 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:24.597 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:24.597 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:24.597 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:24.597 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:24.598 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:24.598 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:24.598 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:24.598 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:24.598 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:24.599 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:24.599 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:24.599 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:24.599 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:24.599 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:24.600 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:24.600 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:24.600 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:24.600 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:24.600 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:24.600 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:24.601 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:24.601 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:24.601 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:24.601 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:24.601 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:24.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.602 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:24.602 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:24.602 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:24.602 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:24.603 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:24.603 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:24.603 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:24.603 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:24.603 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:24.604 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:24.604 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:24.604 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:24.604 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:24.604 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:24.604 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:24.605 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:24.605 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:24.605 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:24.605 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:24.605 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:24.606 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:24.606 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:24.606 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:24.606 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:24.606 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:24.607 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:24.607 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:24.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.607 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:24.607 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:24.607 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:24.608 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:24.608 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:24.608 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:24.608 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:24.608 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:24.609 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:24.609 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:24.609 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:24.609 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:24.609 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:24.609 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:24.610 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:24.610 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.610 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:24.610 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:24.610 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:24.611 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.611 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:24.611 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:24.611 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:24.612 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:24.612 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:24.612 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:24.612 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:24.612 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:24.613 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:24.613 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.613 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:24.613 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:24.614 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:24.614 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:20:24.614 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:20:24.614 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:24.614 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:24.615 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:24.616 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:24.617 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:24.618 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "145", 2023-10-25T16:20:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:24.619 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:24.620 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:24.621 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:24.622 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:24.623 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:24.624 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:24.625 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:24.626 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:24.627 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:24.628 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:24.629 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:24.630 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.631 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.632 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.636 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.637 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.638 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:24.639 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:24.640 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.643 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:24.644 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.646 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.647 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.648 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.650 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.651 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.652 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:24.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:24.658 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:24.659 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.661 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:24.662 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.665 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.666 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:24.667 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.668 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:24.669 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:24.670 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.671 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.673 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:24.674 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.675 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.676 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.677 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.680 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.681 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.682 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.683 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:24.683 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.683 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.683 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.683 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.684 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.684 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:24.685 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.685 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.685 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.685 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.685 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:24.686 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.686 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.686 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.686 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.688 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.688 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:24.688 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:24.688 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.689 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.689 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:24.689 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:24.689 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:24.690 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:24.690 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.690 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.690 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.690 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.691 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:24.691 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.691 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.691 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.692 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.692 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.692 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.692 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.692 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.693 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.693 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.693 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.693 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.694 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.694 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.694 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.694 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:24.694 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.695 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.696 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.696 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.696 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.696 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.698 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:24.698 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.698 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.698 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.699 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.699 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.699 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:24.700 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.700 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.700 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:24.701 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.701 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.701 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.701 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.701 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.702 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.702 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:24.702 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.703 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.703 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.703 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:24.703 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:24.703 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:24.705 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.705 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.705 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.705 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.706 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:24.706 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.706 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.706 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.707 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.707 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.707 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.707 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.707 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.707 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.708 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.708 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.708 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.708 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.708 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.709 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:24.709 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.709 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.710 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:24.710 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.710 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.710 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.711 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.711 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.711 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.711 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.711 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:24.712 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.712 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.712 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:24.713 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.713 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.713 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.713 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.713 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.714 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.714 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:24.714 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.715 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.715 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.715 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:24.715 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.715 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.716 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.716 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.716 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.716 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.717 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:24.717 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.717 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:24.718 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:24.718 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.718 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.718 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.719 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.720 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.720 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.720 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.720 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.720 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:24.721 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.721 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.721 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.721 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.721 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.722 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.722 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.722 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.722 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.722 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.723 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.723 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.723 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.723 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.723 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.723 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:24.724 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.724 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.724 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.724 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.724 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:24.725 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.725 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.725 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.725 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.725 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.726 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.726 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.726 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.726 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:24.726 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.727 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.727 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.727 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.727 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:24.727 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.727 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.728 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.728 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.728 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.728 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.729 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.729 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:24.729 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.729 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.729 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.730 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.730 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:24.730 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.730 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.730 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.731 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.731 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.731 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.731 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.731 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.731 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:24.732 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.732 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.732 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.732 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.732 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:24.733 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:24.733 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.733 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.733 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.733 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:24.734 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:24.734 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:24.734 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:24.734 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.734 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.735 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.735 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.735 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.735 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.735 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:24.736 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:24.736 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:24.736 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:24.736 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:24.736 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:24.737 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:24.737 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:24.737 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:24.737 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:24.737 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:24.737 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:24.738 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:24.738 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.738 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.738 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:24.739 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.739 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.739 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.739 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:24.740 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.740 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.740 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.740 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:24.740 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.741 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.741 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:24.741 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.742 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.742 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.742 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:24.742 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.742 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.743 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.743 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.743 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:24.743 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.743 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.744 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.744 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:24.744 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.744 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.744 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.744 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.745 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:24.745 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.745 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.745 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.745 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.745 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:24.746 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:24.746 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.746 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:24.746 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:24.746 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.747 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.747 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:24.747 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:24.747 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:24.748 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.748 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.748 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:24.748 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:24.748 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:24.749 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:24.749 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:24.749 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:24.749 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:24.749 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:24.749 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.750 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:24.750 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:24.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.750 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:24.750 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.751 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.751 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.751 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.751 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.751 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:24.752 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.752 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:24.752 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.753 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.753 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.753 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.753 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.753 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:24.754 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.754 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.754 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.754 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:24.754 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.754 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.755 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.755 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.755 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.755 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:24.755 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.756 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.756 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:24.756 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.756 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.756 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.757 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.757 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.757 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:24.757 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.758 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.758 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:24.758 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.758 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.758 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.759 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.759 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.759 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:24.759 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.760 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:24.760 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.760 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.760 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.760 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.761 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.761 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:24.761 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.761 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.761 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.761 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:24.762 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.762 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.762 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.762 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.762 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.763 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:24.763 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.763 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:24.763 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:24.764 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:24.764 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:24.764 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:24.764 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:24.764 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:24.765 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:24.765 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:24.765 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.765 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:24.765 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:24.765 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:24.766 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:24.766 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:24.766 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:24.766 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:24.766 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:24.767 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:24.767 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:24.767 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:24.767 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:24.767 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:24.768 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:24.768 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:24.768 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.768 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:24.768 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:24.768 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:24.769 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:24.769 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:24.769 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:24.769 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:24.769 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:24.770 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:24.770 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:24.770 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:24.770 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:24.770 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:24.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7214066470 msgr2=0x7f7214068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:24.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7214066470 0x7f7214068930 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7228152a00 tx=0x7f721c005e30 comp rx=0 tx=0).stop 2023-10-25T16:20:24.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 msgr2=0x7f7228141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:24.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 0x7f7228141d00 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f721801cd30 tx=0x7f72180a5670 comp rx=0 tx=0).stop 2023-10-25T16:20:24.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 shutdown_connections 2023-10-25T16:20:24.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7214066470 0x7f7214068930 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72280b0c80 0x7f722814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72280c9f00 0x7f72280b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 --2- 172.21.15.177:0/3645481375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72280705b0 0x7f7228141d00 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:24.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 >> 172.21.15.177:0/3645481375 conn(0x7f72280b2450 msgr2=0x7f722815af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:24.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 shutdown_connections 2023-10-25T16:20:24.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:24.576+0000 7f722d99e640 1 -- 172.21.15.177:0/3645481375 wait complete. 2023-10-25T16:20:24.775 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:20:29.777 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:29.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/3082964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a006c0f0 msgr2=0x7fc4a00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:29.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/3082964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a006c0f0 0x7fc4a00706f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc498009bc0 tx=0x7fc49801cb50 comp rx=0 tx=0).stop 2023-10-25T16:20:29.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/3082964596 shutdown_connections 2023-10-25T16:20:29.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/3082964596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a006c0f0 0x7fc4a00706f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:29.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/3082964596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4a01500f0 0x7fc4a00c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:29.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/3082964596 >> 172.21.15.177:0/3082964596 conn(0x7fc4a00b2450 msgr2=0x7fc4a00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:29.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/3082964596 shutdown_connections 2023-10-25T16:20:29.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/3082964596 wait complete. 2023-10-25T16:20:29.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 Processor -- start 2023-10-25T16:20:29.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.915+0000 7fc4a6dd6640 1 -- start start 2023-10-25T16:20:29.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4a006c0f0 0x7fc4a014a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:29.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a00c9e50 0x7fc4a01480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:29.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 0x7fc4a01485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:29.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0147c90 con 0x7fc4a01500f0 2023-10-25T16:20:29.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a013d1e0 con 0x7fc4a00c9e50 2023-10-25T16:20:29.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0152d40 con 0x7fc4a006c0f0 2023-10-25T16:20:29.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 0x7fc4a01485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:29.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 0x7fc4a01485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:41746/0 (socket says 172.21.15.177:41746) 2023-10-25T16:20:29.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 -- 172.21.15.177:0/1164753509 learned_addr learned my addr 172.21.15.177:0/1164753509 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:29.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a4b72640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4a006c0f0 0x7fc4a014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:29.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49ffff640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a00c9e50 0x7fc4a01480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:29.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 -- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4a006c0f0 msgr2=0x7fc4a014a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:29.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4a006c0f0 0x7fc4a014a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:29.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 -- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a00c9e50 msgr2=0x7fc4a01480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:29.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a00c9e50 0x7fc4a01480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:29.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 -- 172.21.15.177:0/1164753509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009560 con 0x7fc4a01500f0 2023-10-25T16:20:29.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a5373640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 0x7fc4a01485f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fc49801a780 tx=0x7fc498009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:29.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498004c50 con 0x7fc4a01500f0 2023-10-25T16:20:29.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc4980a5be0 con 0x7fc4a01500f0 2023-10-25T16:20:29.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc498009820 con 0x7fc4a01500f0 2023-10-25T16:20:29.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498004ea0 con 0x7fc4a01500f0 2023-10-25T16:20:29.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a01475d0 con 0x7fc4a01500f0 2023-10-25T16:20:29.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0147dd0 con 0x7fc4a01500f0 2023-10-25T16:20:29.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc4980b4040 con 0x7fc4a01500f0 2023-10-25T16:20:29.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc48c066470 0x7fc48c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:29.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc49811e050 con 0x7fc4a01500f0 2023-10-25T16:20:29.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=146}) v3 -- 0x7fc48c06dfa0 con 0x7fc4a01500f0 2023-10-25T16:20:29.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.919+0000 7fc4a4b72640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc48c066470 0x7fc48c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:29.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.923+0000 7fc4a4b72640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc48c066470 0x7fc48c068930 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc494009d70 tx=0x7fc494009260 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:29.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:29.923+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4980b2020 con 0x7fc4a01500f0 2023-10-25T16:20:30.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.075+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc4a004daf0 con 0x7fc4a01500f0 2023-10-25T16:20:30.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.079+0000 7fc49d7fa640 1 -- 172.21.15.177:0/1164753509 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v145) v1 ==== 81+0+34013 (secure 0 0 0) 0x7fc4980bc070 con 0x7fc4a01500f0 2023-10-25T16:20:30.080 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:30.080 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:30.080 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 145, 2023-10-25T16:20:30.080 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:30.080 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:30.081 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:17.690015+0000", 2023-10-25T16:20:30.081 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:30.081 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:30.081 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:30.081 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:30.082 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:30.082 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:30.082 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:30.082 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:30.082 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:30.083 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:30.083 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:30.083 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:30.083 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:30.083 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:30.084 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:30.084 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:30.084 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:30.084 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:30.084 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:30.085 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:30.085 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:30.085 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:30.085 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.085 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:30.085 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:30.086 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:30.086 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:30.086 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:30.086 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:30.086 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:30.087 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:30.087 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:30.087 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:30.087 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:30.087 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:30.088 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:30.088 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:30.088 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:30.088 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:30.088 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:30.089 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:30.090 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:30.090 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:30.090 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:30.090 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:30.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.091 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:30.091 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:30.091 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:30.091 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:30.091 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:30.092 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:30.093 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:30.093 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:30.093 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:30.093 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:30.093 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:30.094 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:30.094 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:30.094 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:30.094 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:30.094 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:30.095 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:30.095 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:30.095 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:30.095 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:30.095 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:30.095 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:30.096 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.096 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:30.096 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:30.096 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:30.096 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:30.097 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:30.097 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:30.097 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:30.097 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:30.097 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:30.098 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:30.098 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:30.098 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:30.098 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:30.098 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:30.099 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.099 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:30.099 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:30.099 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.099 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:30.100 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:30.100 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:30.100 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:30.100 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:30.100 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:30.101 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:30.101 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:30.101 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:30.101 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.101 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.102 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.102 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:30.102 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:30.102 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:30.102 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:30.103 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:30.103 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:30.103 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:30.103 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:30.103 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:30.103 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:30.104 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:30.104 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:30.104 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:30.104 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:30.104 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:30.105 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:30.105 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:30.105 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:30.105 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:30.105 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:30.106 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:30.106 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:30.106 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:30.106 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:30.106 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:30.106 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:30.107 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:30.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.107 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:30.107 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:30.107 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:30.108 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:30.108 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:30.108 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:30.108 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:30.108 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:30.109 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:30.109 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:30.109 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:30.109 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:30.109 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:30.109 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:30.110 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:30.110 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:30.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:30.110 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:30.110 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:30.111 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:30.111 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:30.111 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:30.111 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:30.111 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:30.112 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:30.112 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:30.112 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:30.112 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.112 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:30.113 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:30.113 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:30.113 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:30.113 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:30.113 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:20:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:20:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "145", 2023-10-25T16:20:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:30.126 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:30.126 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:30.126 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:30.126 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:30.127 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:30.127 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:30.127 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:30.127 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:30.127 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:30.128 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:30.128 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:30.128 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:30.128 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:30.128 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:30.128 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:30.129 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:30.129 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:30.129 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:30.129 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:30.129 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.130 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:30.130 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:30.130 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:30.130 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:30.130 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:30.131 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:30.131 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:30.131 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:30.131 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:30.131 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:30.132 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:30.132 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:30.132 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:30.132 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:30.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.133 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:30.133 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:30.133 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:30.133 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.133 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.133 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:30.134 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:30.134 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:30.134 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:30.134 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:30.134 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:30.135 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:30.135 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:30.135 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:30.135 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.135 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.136 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:30.136 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:30.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.136 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:30.136 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.137 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.137 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.137 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.137 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.137 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.137 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.138 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.138 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.138 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.138 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.138 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.139 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.139 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.139 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.139 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:30.139 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.140 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.140 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.140 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:30.140 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.140 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.141 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.141 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.141 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.141 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.141 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.142 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.142 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:30.142 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.142 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.143 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.143 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:30.143 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.143 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.143 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.144 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.144 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.144 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.144 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.144 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.145 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:30.145 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.145 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.145 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.145 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:30.146 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.146 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.146 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.146 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.146 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.147 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.147 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.147 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.147 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:30.147 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.148 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.148 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:30.148 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:30.148 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.149 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.149 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:30.149 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:30.149 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:30.150 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:30.150 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.150 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.150 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.150 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.151 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.151 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.151 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:30.151 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.151 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.151 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.152 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.152 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.152 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.152 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.152 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.153 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.153 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.153 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.153 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.153 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.153 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.154 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.154 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:30.154 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.154 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.155 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.155 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:30.155 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.155 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.155 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.156 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.156 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.156 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.156 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.157 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:30.157 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.157 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.157 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.158 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:30.158 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.158 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.158 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.158 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.159 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.159 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.159 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.159 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.159 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:30.159 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.160 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.160 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:30.160 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.161 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.161 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.161 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.161 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.161 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.161 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.162 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.162 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:30.162 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.162 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.162 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.163 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:30.163 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:30.163 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.163 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.164 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.164 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:30.164 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:30.164 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:30.164 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:30.164 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.165 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.165 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.165 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.165 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.165 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.166 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:30.166 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.166 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.166 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.166 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.167 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.167 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.167 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.167 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:30.167 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.167 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.168 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.168 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.168 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.168 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.168 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.169 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:30.169 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.169 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.169 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.169 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.169 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.171 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.171 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.171 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.171 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:30.171 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.172 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.172 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.172 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.172 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:30.172 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.173 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.173 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.173 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.173 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.173 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.174 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.174 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.174 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:30.174 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.175 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.175 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.175 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:30.175 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.176 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.176 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.176 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.176 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.176 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.176 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.177 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.177 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:30.177 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.177 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.177 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.178 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.178 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:30.178 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:30.178 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.178 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.179 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.179 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:30.179 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:30.179 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:30.179 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:30.179 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.180 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.180 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.180 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.180 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.181 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:30.181 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.181 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.181 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.181 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.181 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.182 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.182 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.182 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.182 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.182 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.183 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.183 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.183 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.183 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.183 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.184 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:30.184 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.184 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.184 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.184 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.185 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:30.185 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.185 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.185 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.185 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.186 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.186 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.186 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.186 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:30.186 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.187 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.187 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.187 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.187 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:30.187 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.188 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.188 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.188 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.188 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.188 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.189 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.189 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:30.189 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.190 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.190 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:30.190 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.190 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.190 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.191 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.191 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.191 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.192 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:30.192 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.192 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.192 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:30.193 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:30.193 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.193 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.193 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.193 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:30.194 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:30.194 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:30.194 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:30.194 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.194 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.195 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.195 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.195 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:30.195 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.196 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.196 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.196 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.196 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.196 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.197 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.197 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.197 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.197 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.197 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.198 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.198 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.198 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.198 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.198 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:30.198 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.199 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.199 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.199 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.199 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:30.199 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.200 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.200 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.200 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.200 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.200 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.201 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:30.201 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.201 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.202 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.202 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:30.202 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.202 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.202 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.203 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.205 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:30.206 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.206 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.206 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:30.207 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.207 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.207 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.207 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.208 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:30.208 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.209 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:30.210 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:30.210 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.210 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.210 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:30.211 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:30.211 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:30.211 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:30.211 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.211 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.211 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.212 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.212 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:30.212 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.213 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.213 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.213 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.213 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.213 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.214 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.214 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.214 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.214 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.214 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.215 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.215 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.215 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.215 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:30.215 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.216 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.216 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.216 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:30.216 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.217 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.217 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.217 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.217 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.218 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.218 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:30.218 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.218 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.219 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.219 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.219 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:30.219 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.219 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.219 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.220 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.220 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:30.221 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.221 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:30.222 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.222 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.222 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.222 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.223 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:30.223 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.224 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.224 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.224 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:30.224 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:30.225 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.225 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.225 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:30.225 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:30.226 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:30.226 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:30.226 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.226 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.226 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.227 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.227 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.227 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:30.227 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.227 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.228 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.228 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.228 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.228 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.228 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.229 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.229 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.229 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.229 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.229 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.230 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.230 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.230 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.230 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:30.230 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.231 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.231 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:30.231 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.231 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.232 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.232 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.232 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.233 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.234 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:30.234 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.234 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.234 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.235 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.235 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:30.236 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.237 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.237 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.237 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.237 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.238 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.238 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:30.238 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.239 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.239 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:30.239 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:30.239 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.240 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.240 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:30.240 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:30.240 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:30.241 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:30.241 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.241 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.241 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.241 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.242 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:30.242 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:30.242 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:30.242 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:30.243 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:30.243 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:30.243 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:30.243 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:30.243 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:30.244 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:30.244 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:30.244 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:30.244 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:30.244 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.245 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.245 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:30.245 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.246 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.246 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.246 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:30.246 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.246 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.247 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.247 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.247 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:30.247 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.248 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.248 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:30.248 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.249 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.249 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:30.249 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.249 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.249 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.250 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:30.250 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.250 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.250 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:30.251 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.251 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.251 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:30.252 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.252 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.252 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.252 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:30.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:30.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.253 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:30.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:30.253 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.254 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.254 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:30.254 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:30.254 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:30.254 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:30.255 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:30.256 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.257 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.258 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:30.259 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.260 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:30.261 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:30.262 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.263 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.263 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.263 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:30.263 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.263 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.264 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.264 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.264 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.264 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:30.264 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.265 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.265 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.265 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:30.265 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.265 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.265 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.266 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.266 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.266 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:30.266 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.267 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.267 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:30.267 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.267 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.267 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.268 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.268 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.268 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:30.268 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.268 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.269 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.269 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:30.269 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.269 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.269 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.270 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.270 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.270 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:30.270 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.270 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.271 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:30.271 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:30.271 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:30.271 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:30.271 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:30.272 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:30.272 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:30.272 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:30.272 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:30.272 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.273 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:30.273 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:30.273 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:30.273 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:30.273 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:30.273 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:30.274 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:30.274 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:30.274 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:30.274 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:30.274 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:30.275 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:30.275 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:30.275 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:30.275 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:30.275 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.276 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:30.276 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:30.276 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:30.276 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:30.276 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:30.277 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:30.277 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:30.277 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:30.277 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:30.277 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:30.278 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:30.278 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:30.278 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:30.278 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:30.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc48c066470 msgr2=0x7fc48c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:30.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc48c066470 0x7fc48c068930 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc494009d70 tx=0x7fc494009260 comp rx=0 tx=0).stop 2023-10-25T16:20:30.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 msgr2=0x7fc4a01485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:30.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 0x7fc4a01485f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fc49801a780 tx=0x7fc498009240 comp rx=0 tx=0).stop 2023-10-25T16:20:30.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 shutdown_connections 2023-10-25T16:20:30.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc48c066470 0x7fc48c068930 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:30.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4a01500f0 0x7fc4a01485f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:30.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4a00c9e50 0x7fc4a01480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:30.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 --2- 172.21.15.177:0/1164753509 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4a006c0f0 0x7fc4a014a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:30.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 >> 172.21.15.177:0/1164753509 conn(0x7fc4a00b2450 msgr2=0x7fc4a014d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:30.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 shutdown_connections 2023-10-25T16:20:30.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:30.083+0000 7fc4a6dd6640 1 -- 172.21.15.177:0/1164753509 wait complete. 2023-10-25T16:20:30.283 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:20:31.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:20:31.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:20:35.284 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:35.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- 172.21.15.177:0/1628767029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17280c9df0 msgr2=0x7f172815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 --2- 172.21.15.177:0/1628767029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17280c9df0 0x7f172815afb0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f172000acd0 tx=0x7f172001ddd0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- 172.21.15.177:0/1628767029 shutdown_connections 2023-10-25T16:20:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 --2- 172.21.15.177:0/1628767029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17280c9df0 0x7f172815afb0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- 172.21.15.177:0/1628767029 >> 172.21.15.177:0/1628767029 conn(0x7f17280b2450 msgr2=0x7f17280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- 172.21.15.177:0/1628767029 shutdown_connections 2023-10-25T16:20:35.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- 172.21.15.177:0/1628767029 wait complete. 2023-10-25T16:20:35.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 Processor -- start 2023-10-25T16:20:35.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- start start 2023-10-25T16:20:35.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f172806c180 0x7f1728153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17280c9df0 0x7f1728139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 0x7f1728150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728150750 con 0x7f172815bbe0 2023-10-25T16:20:35.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172814ff40 con 0x7f17280c9df0 2023-10-25T16:20:35.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f172df35640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1728151030 con 0x7f172806c180 2023-10-25T16:20:35.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 0x7f1728150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 0x7f1728150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48388/0 (socket says 172.21.15.177:48388) 2023-10-25T16:20:35.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 -- 172.21.15.177:0/3090131846 learned_addr learned my addr 172.21.15.177:0/3090131846 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:35.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f17277fe640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f172806c180 0x7f1728153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1726ffd640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17280c9df0 0x7f1728139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 -- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f172806c180 msgr2=0x7f1728153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f172806c180 0x7f1728153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 -- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17280c9df0 msgr2=0x7f1728139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17280c9df0 0x7f1728139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 -- 172.21.15.177:0/3090131846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172000a930 con 0x7f172815bbe0 2023-10-25T16:20:35.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1726ffd640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17280c9df0 0x7f1728139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:35.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.423+0000 7f1727fff640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 0x7f1728150af0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f172000ac20 tx=0x7f172000a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:35.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200afaa0 con 0x7f172815bbe0 2023-10-25T16:20:35.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17200afcf0 con 0x7f172815bbe0 2023-10-25T16:20:35.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1728150190 con 0x7f172815bbe0 2023-10-25T16:20:35.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720004c90 con 0x7f172815bbe0 2023-10-25T16:20:35.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1728139ce0 con 0x7f172815bbe0 2023-10-25T16:20:35.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728139b40 con 0x7f172815bbe0 2023-10-25T16:20:35.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17200b5070 con 0x7f172815bbe0 2023-10-25T16:20:35.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f170ffff640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17140664a0 0x7f1714068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f172011f480 con 0x7f172815bbe0 2023-10-25T16:20:35.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f17277fe640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17140664a0 0x7f1714068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.427+0000 7f17277fe640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17140664a0 0x7f1714068960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f171c0011f0 tx=0x7f171c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:35.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.431+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1728139b40 con 0x7f172815bbe0 2023-10-25T16:20:35.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.587+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1728139b40 con 0x7f172815bbe0 2023-10-25T16:20:35.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.587+0000 7f170ffff640 1 -- 172.21.15.177:0/3090131846 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+33994 (secure 0 0 0) 0x7f1728139b40 con 0x7f172815bbe0 2023-10-25T16:20:35.589 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:35.589 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:35.590 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 146, 2023-10-25T16:20:35.590 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:35.591 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:35.591 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:32.695867+0000", 2023-10-25T16:20:35.591 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:35.591 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:35.592 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:35.592 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:35.592 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:35.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:35.593 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:35.593 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:35.593 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:35.593 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:35.594 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:35.594 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:35.594 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:35.594 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:35.595 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:35.595 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:35.595 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:35.596 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:35.596 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:35.596 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:35.597 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:35.597 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:35.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.597 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:35.598 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:35.598 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:35.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:35.598 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:35.599 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:35.599 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:35.599 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:35.599 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:35.600 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:35.600 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:35.600 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:35.601 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:35.601 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:35.601 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:35.601 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:35.601 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:35.602 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:35.602 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:35.602 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:35.602 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:35.602 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:35.603 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:35.603 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:35.603 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:35.603 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:35.603 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:35.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.604 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:35.604 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:35.604 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:35.605 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:35.605 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:35.605 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:35.605 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:35.605 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:35.606 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:35.606 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:35.606 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:35.607 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:35.607 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:35.607 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:35.607 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:35.608 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:35.608 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:35.609 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:35.609 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:35.609 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:35.610 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:35.611 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:35.611 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:35.611 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:35.612 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:35.612 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:35.612 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:35.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.613 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:35.614 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:35.614 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:35.614 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:35.615 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:35.615 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:35.615 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:35.616 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:35.616 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:35.616 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:35.617 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:35.617 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:35.617 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:35.617 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:35.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.618 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:35.618 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:35.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.619 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:35.619 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:35.619 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:35.620 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:35.620 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:35.620 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:35.621 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:35.621 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:35.622 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:35.622 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.623 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:35.623 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:35.624 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:35.624 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:35.624 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:35.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:35.625 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:35.625 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:35.625 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:35.625 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:35.626 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:35.626 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:35.626 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:35.626 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:35.627 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:35.627 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:35.627 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:35.627 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:35.628 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:35.628 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:35.628 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:35.628 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:35.629 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:35.629 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:35.629 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:35.629 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:35.629 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:35.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.630 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:35.630 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:35.630 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:35.631 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:35.631 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:35.631 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:35.631 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:35.632 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:35.632 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:35.632 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:35.632 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:35.632 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:35.633 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:35.633 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:35.633 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:35.633 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:35.633 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:35.634 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:35.634 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:35.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:35.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:35.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:35.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:35.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:35.635 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:35.635 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:35.635 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:35.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.636 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:35.636 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:35.636 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:35.637 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:35.637 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:35.637 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:35.637 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:35.637 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:35.638 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:35.638 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:35.638 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:35.638 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:35.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:35.639 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:35.639 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:35.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.640 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:35.640 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:35.640 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:35.640 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.641 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:35.642 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:35.642 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:35.642 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:35.642 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:35.643 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:35.643 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:35.644 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:35.644 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:35.644 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.645 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:35.645 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:35.646 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:35.646 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:35.646 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:35.646 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:35.647 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:35.647 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:35.648 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:35.648 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:35.648 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:35.649 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:35.649 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:35.649 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:35.649 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:35.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:35.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:35.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:35.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:35.651 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:35.651 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:35.651 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:35.652 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:35.652 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:35.652 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:35.653 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:35.653 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:35.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.653 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "146", 2023-10-25T16:20:35.654 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:35.654 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:35.654 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:35.655 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:35.655 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:35.655 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:35.655 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:35.656 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:35.656 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:35.656 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:35.656 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:35.657 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:35.657 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:35.657 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:35.657 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:35.657 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:35.658 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:35.658 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:35.658 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:35.658 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:35.658 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:35.659 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:35.659 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:35.659 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:35.659 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:35.659 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:35.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.660 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:35.660 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:35.660 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:35.661 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:35.661 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:35.661 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:35.661 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:35.661 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:35.661 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:35.662 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:35.662 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:35.662 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:35.663 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:35.663 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:35.663 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.663 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:35.663 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:35.664 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:35.664 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.664 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:35.664 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:35.665 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:35.666 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:35.666 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.666 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.666 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:35.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:35.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.667 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:35.667 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.667 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.667 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.668 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.668 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.668 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.668 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.668 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.668 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.669 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.669 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.669 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.670 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.670 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:35.670 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.671 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.671 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:35.671 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.671 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.671 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.671 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.672 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.672 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:35.673 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.673 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.673 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.673 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:35.674 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.674 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.674 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.674 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:35.675 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.676 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.677 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.677 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:35.677 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.677 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.678 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.678 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.678 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.678 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.679 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.679 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:35.679 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.679 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.681 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:35.681 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:35.681 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:35.681 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:35.681 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.682 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.682 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.682 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.682 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.682 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.683 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:35.683 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.683 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.683 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.683 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.684 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.684 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.684 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.684 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.684 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.684 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.685 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.686 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:35.686 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.686 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:35.687 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.687 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.687 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.688 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.688 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.688 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:35.688 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.689 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:35.689 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.690 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.690 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.690 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.690 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.691 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.691 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:35.691 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.691 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.692 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.692 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:35.692 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.692 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.692 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.693 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.693 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.693 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.693 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.693 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:35.694 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.694 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.694 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.694 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:35.695 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:35.695 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.695 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.695 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:35.696 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:35.696 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:35.696 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:35.696 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.696 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.696 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.697 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.697 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:35.697 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.698 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.698 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.698 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.698 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.698 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.699 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.699 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:35.699 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.699 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.699 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.699 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.700 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.701 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.701 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:35.701 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.701 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.702 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.702 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.702 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.702 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.703 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:35.703 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.703 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.703 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.703 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:35.704 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.704 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.704 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.705 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.705 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:35.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.706 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.706 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:35.706 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.707 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.707 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.707 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.707 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.708 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.708 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.708 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.708 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:35.708 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.709 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:35.709 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:35.709 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.710 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.710 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:35.710 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:35.710 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:35.711 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:35.711 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.711 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.711 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.711 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.712 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:35.712 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.712 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.713 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.713 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.713 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.713 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.713 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.714 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.714 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.714 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.714 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.714 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.715 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.715 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.715 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.715 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:35.715 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.716 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.716 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:35.716 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.716 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.717 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.717 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.717 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.717 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:35.718 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.718 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.718 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.718 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.719 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:35.719 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.719 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.719 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.720 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.720 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.720 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.720 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.720 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:35.721 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.721 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.721 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.721 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.721 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:35.722 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.722 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.722 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.722 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.722 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.723 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.723 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.723 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.723 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:35.723 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.723 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.724 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.724 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.724 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:35.724 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:35.724 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:35.725 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:35.726 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.726 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.726 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.726 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.727 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.727 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.727 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:35.727 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.727 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.728 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.728 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.728 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.728 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.728 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.729 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.729 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.729 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.729 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.729 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.729 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.730 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.730 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.730 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:35.730 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.730 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.731 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.731 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.731 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:35.731 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.731 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.731 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.732 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.732 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.732 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.732 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.732 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.733 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:35.733 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.733 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.733 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.733 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.734 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:35.734 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.734 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.734 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.737 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.737 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.738 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.738 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.738 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.738 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:35.738 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.738 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.739 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.739 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.739 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:35.739 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.739 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.740 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.740 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.740 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.740 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.740 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.741 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.741 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:35.741 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.741 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.741 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.741 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.742 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:35.742 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:35.742 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.742 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.742 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.743 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:35.743 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:35.743 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:35.743 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:35.743 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.744 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.744 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.744 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.744 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.744 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.744 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:35.745 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.745 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.745 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.745 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.745 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.746 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.746 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.746 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.746 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.746 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.747 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.747 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.747 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.747 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.747 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.747 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:35.748 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.748 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.748 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.748 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.748 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:35.749 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.749 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.749 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.749 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.749 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.749 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.750 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.750 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.750 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:35.750 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.750 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.751 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.751 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.751 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:35.751 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.751 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.752 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.752 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.752 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.752 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.752 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.752 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.753 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:35.753 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.753 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.753 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.753 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.754 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:35.754 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.754 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.754 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.754 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.755 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.755 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.755 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.755 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.755 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:35.755 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.756 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.756 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.756 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.756 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:35.756 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:35.757 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.757 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.757 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.757 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:35.757 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:35.757 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:35.758 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:35.758 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.758 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.758 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.758 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.759 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.759 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.759 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:35.759 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.759 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.760 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.760 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.760 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.760 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.760 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.760 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.761 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.761 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.761 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.761 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.761 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.762 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.762 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.762 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:35.762 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.763 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.763 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.763 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:35.763 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.763 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.764 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.764 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.764 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.764 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.765 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:35.765 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.765 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.765 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.765 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.765 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:35.766 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.766 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.766 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.766 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.766 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.767 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.767 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.767 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.767 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:35.767 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.768 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.768 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.768 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.768 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:35.768 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.769 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.769 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.769 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.769 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.769 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.770 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.770 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.770 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:35.770 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.770 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.771 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.771 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.771 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:35.771 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:35.771 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.771 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.772 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.772 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:35.772 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:35.772 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:35.772 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:35.773 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.773 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.773 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.773 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.773 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.774 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.774 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:35.774 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:35.774 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:35.774 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:35.774 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:35.775 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:35.775 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:35.775 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:35.775 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:35.775 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:35.776 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:35.776 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:35.776 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:35.776 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.776 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.776 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.777 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:35.777 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.777 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.777 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.777 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.778 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:35.778 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.778 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.778 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.778 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.779 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:35.779 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.779 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.779 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.779 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:35.779 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.780 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.780 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.780 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.780 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:35.780 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.781 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.781 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.781 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.781 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:35.781 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.782 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.782 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.782 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:35.782 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.782 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.782 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.783 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.783 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:35.783 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.783 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.783 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.784 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.784 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:35.784 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:35.784 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.784 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:35.785 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:35.785 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.785 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.785 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.785 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:35.786 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:35.786 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:35.786 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.786 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.786 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.787 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:35.787 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:35.787 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:35.787 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:35.787 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:35.787 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:35.788 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:35.788 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:35.788 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.788 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:35.788 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:35.789 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.789 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:35.789 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.789 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.789 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.790 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.790 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.790 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:35.790 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.790 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.790 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.791 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:35.791 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.791 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.791 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.791 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.792 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.792 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:35.792 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.792 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.792 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.793 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:35.793 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.793 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.793 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.793 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.793 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.794 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:35.794 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.794 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.794 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.794 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:35.795 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.795 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.795 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.795 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.795 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.796 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:35.796 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.796 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.796 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.796 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:35.796 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.797 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.797 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.797 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.797 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.797 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:35.798 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.798 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.798 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.798 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:35.798 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.799 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.799 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.799 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.799 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.799 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:35.799 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.800 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.800 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.800 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:35.800 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.800 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.801 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.801 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.801 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.801 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:35.801 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.801 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.802 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:35.802 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:35.802 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:35.802 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:35.802 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:35.803 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:35.803 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:35.803 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:35.803 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:35.803 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.804 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:35.804 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:35.804 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:35.804 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:35.804 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:35.804 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:35.805 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:35.806 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:35.806 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:35.806 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:35.806 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.806 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:35.807 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:35.807 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:35.807 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:35.807 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:35.808 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:35.808 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:35.808 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:35.808 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:35.808 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:35.808 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:35.809 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:35.809 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:35.809 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:35.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17140664a0 msgr2=0x7f1714068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17140664a0 0x7f1714068960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f171c0011f0 tx=0x7f171c009040 comp rx=0 tx=0).stop 2023-10-25T16:20:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 msgr2=0x7f1728150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 0x7f1728150af0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f172000ac20 tx=0x7f172000a310 comp rx=0 tx=0).stop 2023-10-25T16:20:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 shutdown_connections 2023-10-25T16:20:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f17140664a0 0x7f1714068960 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815bbe0 0x7f1728150af0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17280c9df0 0x7f1728139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 --2- 172.21.15.177:0/3090131846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f172806c180 0x7f1728153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 >> 172.21.15.177:0/3090131846 conn(0x7f17280b2450 msgr2=0x7f17280cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 shutdown_connections 2023-10-25T16:20:35.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.591+0000 7f172df35640 1 -- 172.21.15.177:0/3090131846 wait complete. 2023-10-25T16:20:35.813 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-25T16:20:35.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:20:35.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/975236940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d800c9e50 msgr2=0x7f2d8006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 --2- 172.21.15.177:0/975236940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d800c9e50 0x7f2d8006b980 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f2d740098f0 tx=0x7f2d7401c850 comp rx=0 tx=0).stop 2023-10-25T16:20:35.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/975236940 shutdown_connections 2023-10-25T16:20:35.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 --2- 172.21.15.177:0/975236940 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d800c9e50 0x7f2d8006b980 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 --2- 172.21.15.177:0/975236940 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d801500f0 0x7f2d800c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/975236940 >> 172.21.15.177:0/975236940 conn(0x7f2d800b2450 msgr2=0x7f2d800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:35.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/975236940 shutdown_connections 2023-10-25T16:20:35.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/975236940 wait complete. 2023-10-25T16:20:35.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 Processor -- start 2023-10-25T16:20:35.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- start start 2023-10-25T16:20:35.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d8006bec0 0x7f2d800ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d800c9e50 0x7f2d800acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 0x7f2d800abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800aef20 con 0x7f2d801500f0 2023-10-25T16:20:35.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800b03f0 con 0x7f2d800c9e50 2023-10-25T16:20:35.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800b06d0 con 0x7f2d8006bec0 2023-10-25T16:20:35.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 0x7f2d800abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 0x7f2d800abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48412/0 (socket says 172.21.15.177:48412) 2023-10-25T16:20:35.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 -- 172.21.15.177:0/3766659793 learned_addr learned my addr 172.21.15.177:0/3766659793 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:35.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d7ffff640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d8006bec0 0x7f2d800ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d7f7fe640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d800c9e50 0x7f2d800acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 -- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d8006bec0 msgr2=0x7f2d800ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d8006bec0 0x7f2d800ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 -- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d800c9e50 msgr2=0x7f2d800acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:35.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d800c9e50 0x7f2d800acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:35.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 -- 172.21.15.177:0/3766659793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74009500 con 0x7f2d801500f0 2023-10-25T16:20:35.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d84bee640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 0x7f2d800abba0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800b970 tx=0x7f2d7800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:35.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800cb40 con 0x7f2d801500f0 2023-10-25T16:20:35.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2d7800cd90 con 0x7f2d801500f0 2023-10-25T16:20:35.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d800b09b0 con 0x7f2d801500f0 2023-10-25T16:20:35.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d780146a0 con 0x7f2d801500f0 2023-10-25T16:20:35.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.959+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d800b0f70 con 0x7f2d801500f0 2023-10-25T16:20:35.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.963+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d800b1160 con 0x7f2d801500f0 2023-10-25T16:20:35.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.963+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d7801d3b0 con 0x7f2d801500f0 2023-10-25T16:20:35.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.963+0000 7f2d7cff9640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d6c0664a0 0x7f2d6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:35.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.963+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d78084050 con 0x7f2d801500f0 2023-10-25T16:20:35.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.963+0000 7f2d7ffff640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d6c0664a0 0x7f2d6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:35.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.963+0000 7f2d7ffff640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d6c0664a0 0x7f2d6c068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2d700058d0 tx=0x7f2d70005e30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:35.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:35.967+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d780514d0 con 0x7f2d801500f0 2023-10-25T16:20:36.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.119+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2d8004daf0 con 0x7f2d801500f0 2023-10-25T16:20:36.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.119+0000 7f2d7cff9640 1 -- 172.21.15.177:0/3766659793 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+33994 (secure 0 0 0) 0x7f2d78054af0 con 0x7f2d801500f0 2023-10-25T16:20:36.121 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:36.121 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:36.121 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 146, 2023-10-25T16:20:36.121 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:20:36.122 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:20:36.122 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:20:32.695867+0000", 2023-10-25T16:20:36.122 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:20:36.122 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:20:36.122 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:20:36.123 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:20:36.123 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:20:36.123 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:20:36.123 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:20:36.123 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:20:36.124 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:20:36.124 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:36.124 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:20:36.124 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:20:36.124 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:20:36.125 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:20:36.125 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:20:36.125 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 17, 2023-10-25T16:20:36.125 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:20:36.125 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:20:36.125 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:20:36.126 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:20:36.126 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:20:36.126 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:20:36.126 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.126 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:20:36.127 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:20:36.127 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:20:36.127 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:36.127 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:36.127 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:36.128 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:36.128 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:36.128 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:36.128 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:36.128 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:36.129 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:36.129 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:36.129 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:36.129 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:36.129 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:20:36.130 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:20:36.130 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:20:36.130 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:20:36.130 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:20:36.130 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:36.131 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:36.131 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:36.131 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:36.131 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:36.131 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:36.132 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:36.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.132 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:20:36.132 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:36.132 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:36.132 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:36.133 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:36.133 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:36.133 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:36.133 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:36.133 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:36.134 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:36.134 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:36.134 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:36.134 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:36.134 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:36.134 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:36.135 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:36.135 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:36.135 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:36.135 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:36.135 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:36.136 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:36.136 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:36.136 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:36.136 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:36.136 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:36.136 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:36.137 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:36.137 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.137 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:36.137 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:36.137 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:36.137 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:36.138 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:36.138 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:36.138 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:36.138 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:36.138 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:36.139 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:36.139 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:36.139 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:36.139 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:20:36.139 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:20:36.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.140 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:36.140 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:20:36.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.140 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:36.141 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:20:36.141 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:20:36.141 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:20:36.141 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:20:36.141 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:20:36.141 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:36.142 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:36.142 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:36.142 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.142 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.143 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 16, 2023-10-25T16:20:36.143 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:20:36.143 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.021145+0000", 2023-10-25T16:20:36.143 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:36.143 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:36.144 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:36.144 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:36.144 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:36.144 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:36.144 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:36.146 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:36.146 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:36.146 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:36.146 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:36.147 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:36.147 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:20:36.147 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:20:36.147 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:20:36.147 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:20:36.148 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:20:36.148 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:36.148 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:36.148 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:36.148 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:36.149 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:36.149 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:36.149 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:36.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.149 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "142", 2023-10-25T16:20:36.149 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:36.150 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:36.150 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:36.150 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:36.150 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:36.150 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:36.151 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:36.151 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:36.151 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:36.151 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:20:36.151 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:36.152 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:36.152 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:36.152 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:36.152 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:36.152 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:36.153 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:36.153 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:36.153 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:36.153 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:36.153 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:36.154 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:36.154 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:36.154 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:36.154 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:36.154 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:36.155 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.155 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:36.155 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:36.155 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:36.155 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:36.155 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:36.156 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:36.156 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:36.156 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:36.156 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:36.156 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:36.157 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:36.157 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:36.157 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:20:36.157 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:20:36.157 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:20:36.157 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.158 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:36.158 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:36.158 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:20:36.158 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.158 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.159 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:36.159 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:36.159 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:36.159 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:36.159 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:36.160 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:36.160 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:36.160 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:36.160 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:36.160 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.161 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.161 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.161 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 17, 2023-10-25T16:20:36.161 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:20:36.161 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:19:52.759535+0000", 2023-10-25T16:20:36.161 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:20:36.162 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:20:36.162 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:20:36.162 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:20:36.162 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:20:36.162 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:20:36.163 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:20:36.163 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:20:36.163 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:20:36.163 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:20:36.163 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:20:36.164 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:20:36.164 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:20:36.164 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:20:36.164 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:20:36.164 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:20:36.165 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:20:36.165 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:20:36.165 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:20:36.165 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:20:36.165 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:20:36.165 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:20:36.166 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:20:36.166 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:20:36.166 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.166 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "146", 2023-10-25T16:20:36.166 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:20:36.167 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:20:36.167 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:20:36.167 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:20:36.167 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:20:36.167 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:20:36.167 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:20:36.168 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:20:36.168 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:20:36.168 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:20:36.168 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:20:36.168 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:20:36.168 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:20:36.169 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:20:36.169 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:20:36.169 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:20:36.169 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:20:36.169 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:20:36.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:20:36.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:20:36.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:20:36.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:20:36.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:20:36.171 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:20:36.171 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:20:36.171 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:20:36.171 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.171 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:20:36.171 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:20:36.172 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:20:36.172 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:20:36.172 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:20:36.172 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:20:36.172 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:20:36.173 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:20:36.173 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:20:36.173 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:20:36.173 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:20:36.173 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:20:36.174 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:20:36.174 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:20:36.174 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.174 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:20:36.174 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:20:36.174 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:20:36.175 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.176 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:20:36.177 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.75, 2023-10-25T16:20:36.177 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.75, 2023-10-25T16:20:36.177 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:20:36.177 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.75, 2023-10-25T16:20:36.177 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.75, 2023-10-25T16:20:36.178 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:20:36.178 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:20:36.178 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:20:36.178 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.178 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.179 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:36.179 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:20:36.179 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.179 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:36.179 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.180 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.180 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.180 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.180 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.180 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.180 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.181 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.181 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.181 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.181 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.181 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.182 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.182 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.182 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.182 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:20:36.182 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.183 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.183 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.183 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.183 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:20:36.183 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.184 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.185 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.185 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.185 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.185 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.185 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.186 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.186 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:20:36.186 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.186 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.187 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.187 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:20:36.187 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.187 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.187 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.188 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.188 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.188 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.188 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.188 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.188 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:20:36.189 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.189 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.189 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:20:36.190 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.190 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.190 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.190 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.191 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.191 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.191 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.192 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:20:36.192 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.193 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.194 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.194 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:20:36.194 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:20:36.194 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.195 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.195 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.195 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:20:36.195 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:20:36.195 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:20:36.196 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:20:36.196 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.196 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.196 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.196 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.197 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.197 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:36.197 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.197 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.197 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.198 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.198 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.198 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.198 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.199 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.199 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.199 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.199 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.199 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.200 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.200 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.200 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.200 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:20:36.200 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.201 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.201 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.201 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.201 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:20:36.201 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.201 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.202 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.202 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.202 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.202 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.202 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.203 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:20:36.203 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.203 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.204 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.204 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:20:36.204 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.204 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.204 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.205 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.205 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.205 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.205 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.205 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:20:36.206 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.206 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.207 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:20:36.207 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.207 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.207 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.207 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.208 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:20:36.208 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:20:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:20:36.209 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.210 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.210 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:20:36.210 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:20:36.210 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:20:36.211 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:20:36.211 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.211 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.211 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.211 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.212 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:36.212 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.212 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.213 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.213 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.213 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.213 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.213 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.213 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:20:36.214 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.214 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.214 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.214 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.215 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.215 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.215 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.215 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:20:36.215 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.216 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.216 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.216 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:20:36.216 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.216 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.217 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.217 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.217 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.218 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.218 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.218 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:20:36.218 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.219 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:20:36.220 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.220 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.221 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.222 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:20:36.222 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.222 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.222 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:20:36.223 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.223 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.223 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.223 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.224 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.224 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.224 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:20:36.225 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.225 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.225 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:20:36.226 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:20:36.226 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.226 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.226 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:20:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:20:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:20:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:20:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.227 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.228 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.228 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.228 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:36.228 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.229 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.229 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.229 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.229 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.229 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.230 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.230 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.230 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.230 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.230 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.231 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.231 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.231 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.231 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.231 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:20:36.231 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.232 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.232 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.232 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:20:36.232 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.233 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.233 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.233 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.233 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.233 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.234 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.234 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:20:36.234 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.235 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.235 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.235 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:20:36.235 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.235 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.235 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.236 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.236 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.236 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.237 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:20:36.237 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.237 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.237 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.237 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.237 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:20:36.238 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.238 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.238 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.238 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.239 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.239 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.239 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.239 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:20:36.239 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.240 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.240 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:20:36.240 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:20:36.241 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.241 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.241 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:20:36.241 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:20:36.241 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:20:36.242 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:20:36.242 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.242 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.242 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.242 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.243 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:36.243 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.243 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.244 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.244 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.244 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.244 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.244 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.244 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.245 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.245 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.245 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.245 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.245 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.246 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.246 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.246 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:20:36.246 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.246 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.247 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.247 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.247 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:20:36.247 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.247 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.247 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.248 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.248 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.248 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.248 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.248 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.249 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:20:36.249 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.249 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.249 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.249 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.249 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:20:36.250 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.250 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.250 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.250 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.251 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.251 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.251 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:20:36.251 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.252 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.252 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.252 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.252 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:20:36.252 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.252 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.253 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.253 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.253 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.253 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.253 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.254 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.254 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:20:36.254 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.254 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.254 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.255 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.255 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:20:36.255 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:20:36.255 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.255 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.255 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.256 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:20:36.256 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:20:36.256 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:20:36.256 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:20:36.256 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.257 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.257 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.257 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.257 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.257 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.258 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:36.258 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.258 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.258 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.258 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.258 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.259 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.259 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.259 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.259 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.259 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.260 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.260 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.260 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.260 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.260 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.261 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:20:36.261 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.261 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.261 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.261 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.261 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:20:36.262 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.262 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.262 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.262 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.262 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.263 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.263 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.263 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.263 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:20:36.263 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.264 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.264 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.264 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.264 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:20:36.264 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.265 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.265 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.265 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.265 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.265 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.265 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.266 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.266 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:20:36.266 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.266 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.266 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.267 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.267 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:20:36.267 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.267 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.267 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.267 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.268 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.268 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.268 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.268 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.268 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:20:36.269 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.269 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.269 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.269 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.269 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:20:36.269 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:20:36.270 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.270 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.270 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.270 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:20:36.270 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:20:36.271 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:20:36.271 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:20:36.271 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.271 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.271 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.272 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.272 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.272 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.272 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:36.272 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.272 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.273 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.273 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.273 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.273 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.273 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.274 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.274 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.274 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.274 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.274 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.274 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.275 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.275 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.275 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:20:36.275 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.275 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.276 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.276 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.276 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:20:36.276 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.276 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.277 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.277 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.277 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.277 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.277 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.277 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.278 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:20:36.278 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.278 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.278 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.278 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.279 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:20:36.279 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.279 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.279 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.279 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:20:36.280 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.281 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.281 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.281 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.281 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:20:36.281 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.282 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.282 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.282 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.282 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.282 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.283 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.283 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.283 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:20:36.283 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.283 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.284 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.284 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.284 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:20:36.284 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:20:36.284 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.284 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.285 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.285 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:20:36.285 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:20:36.285 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:20:36.285 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:20:36.286 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.286 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.286 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.286 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.286 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.286 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.287 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:36.287 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:20:36.287 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:20:36.287 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:20:36.287 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:20:36.288 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:20:36.288 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:20:36.288 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:20:36.288 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:20:36.288 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 141, 2023-10-25T16:20:36.289 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:20:36.289 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:20:36.289 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:20:36.289 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.289 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.289 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.290 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:20:36.290 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.290 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.290 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.290 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.291 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:20:36.291 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.291 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.291 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.291 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.292 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:20:36.292 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.292 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.292 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.292 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:20:36.293 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.293 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.293 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.293 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.293 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:20:36.293 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.294 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.294 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.294 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.294 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:20:36.294 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.295 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.295 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.295 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:20:36.295 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.295 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.296 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.296 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.296 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:20:36.296 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.296 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.296 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.297 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.297 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:20:36.297 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:20:36.297 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.297 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:20:36.297 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:20:36.298 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.298 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.298 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.298 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:20:36.298 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:20:36.299 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:20:36.299 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.299 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.299 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.299 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:20:36.300 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:20:36.300 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:20:36.300 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:20:36.300 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:20:36.300 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:20:36.300 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:20:36.301 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:36.301 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.301 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:36.301 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:20:36.301 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.302 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:20:36.302 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.302 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.302 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.302 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.303 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.303 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:20:36.303 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.303 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.303 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.304 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:20:36.304 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.304 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.304 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.304 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.304 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.305 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:20:36.305 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.305 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.305 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.305 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:20:36.306 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.306 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.306 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.306 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.306 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.306 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:20:36.307 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.307 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.307 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.307 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:20:36.307 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.308 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.308 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.308 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.308 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.308 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:20:36.309 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.309 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.309 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.309 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:20:36.310 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.310 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.310 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.310 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.310 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.311 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:20:36.311 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.311 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.311 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.311 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:20:36.312 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.312 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.312 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.312 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.312 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.312 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:20:36.313 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.313 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.313 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.313 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:20:36.313 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.314 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.314 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.314 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.314 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.314 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:20:36.315 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.315 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.315 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:36.315 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:20:36.315 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:20:36.316 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:20:36.316 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:20:36.316 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:20:36.316 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:20:36.316 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:20:36.316 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:20:36.317 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.317 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:20:36.317 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:20:36.317 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:20:36.317 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:20:36.318 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:20:36.318 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:20:36.318 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:20:36.318 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:20:36.318 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:20:36.319 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:20:36.319 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:20:36.319 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:20:36.319 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:20:36.319 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:20:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:20:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:20:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:20:36.320 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:20:36.321 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:20:36.321 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:20:36.321 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:20:36.321 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:20:36.321 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:20:36.322 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:20:36.322 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:20:36.322 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:20:36.322 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:36.322 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:36.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d6c0664a0 msgr2=0x7f2d6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d6c0664a0 0x7f2d6c068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2d700058d0 tx=0x7f2d70005e30 comp rx=0 tx=0).stop 2023-10-25T16:20:36.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 msgr2=0x7f2d800abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 0x7f2d800abba0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800b970 tx=0x7f2d7800be30 comp rx=0 tx=0).stop 2023-10-25T16:20:36.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 shutdown_connections 2023-10-25T16:20:36.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d6c0664a0 0x7f2d6c068960 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d801500f0 0x7f2d800abba0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d800c9e50 0x7f2d800acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 --2- 172.21.15.177:0/3766659793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d8006bec0 0x7f2d800ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 >> 172.21.15.177:0/3766659793 conn(0x7f2d800b2450 msgr2=0x7f2d800b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:36.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 shutdown_connections 2023-10-25T16:20:36.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.123+0000 7f2d86651640 1 -- 172.21.15.177:0/3766659793 wait complete. 2023-10-25T16:20:36.327 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 -- 172.21.15.177:0/1572377639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c15eba0 msgr2=0x7fa71c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 --2- 172.21.15.177:0/1572377639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c15eba0 0x7fa71c0b4100 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa718009c80 tx=0x7fa71801ccb0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 -- 172.21.15.177:0/1572377639 shutdown_connections 2023-10-25T16:20:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 --2- 172.21.15.177:0/1572377639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa71c0b2120 0x7fa71c0d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 --2- 172.21.15.177:0/1572377639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c15eba0 0x7fa71c0b4100 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 -- 172.21.15.177:0/1572377639 >> 172.21.15.177:0/1572377639 conn(0x7fa71c09a5c0 msgr2=0x7fa71c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:36.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 -- 172.21.15.177:0/1572377639 shutdown_connections 2023-10-25T16:20:36.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.455+0000 7fa724228640 1 -- 172.21.15.177:0/1572377639 wait complete. 2023-10-25T16:20:36.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 Processor -- start 2023-10-25T16:20:36.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- start start 2023-10-25T16:20:36.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71c0b2120 0x7fa71c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:36.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 0x7fa71c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:36.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa71c15eba0 0x7fa71c0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:36.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c61e0 con 0x7fa71c0cdb10 2023-10-25T16:20:36.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c64c0 con 0x7fa71c0b2120 2023-10-25T16:20:36.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c67a0 con 0x7fa71c15eba0 2023-10-25T16:20:36.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 0x7fa71c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:36.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 0x7fa71c153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48432/0 (socket says 172.21.15.177:48432) 2023-10-25T16:20:36.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 -- 172.21.15.177:0/82161651 learned_addr learned my addr 172.21.15.177:0/82161651 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:36.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa721fc4640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71c0b2120 0x7fa71c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:36.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7227c5640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa71c15eba0 0x7fa71c0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:36.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 -- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa71c15eba0 msgr2=0x7fa71c0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa71c15eba0 0x7fa71c0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 -- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71c0b2120 msgr2=0x7fa71c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71c0b2120 0x7fa71c15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 -- 172.21.15.177:0/82161651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7180098e0 con 0x7fa71c0cdb10 2023-10-25T16:20:36.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa721fc4640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71c0b2120 0x7fa71c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:20:36.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7217c3640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 0x7fa71c153760 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00d980 tx=0x7fa70c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:36.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c009c30 con 0x7fa71c0cdb10 2023-10-25T16:20:36.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa70c005020 con 0x7fa71c0cdb10 2023-10-25T16:20:36.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c0c6a80 con 0x7fa71c0cdb10 2023-10-25T16:20:36.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c005430 con 0x7fa71c0cdb10 2023-10-25T16:20:36.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c0c5ed0 con 0x7fa71c0cdb10 2023-10-25T16:20:36.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c04daf0 con 0x7fa71c0cdb10 2023-10-25T16:20:36.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa70c0047b0 con 0x7fa71c0cdb10 2023-10-25T16:20:36.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.459+0000 7fa7127fc640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa700066470 0x7fa700068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:36.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.463+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa70c0840d0 con 0x7fa71c0cdb10 2023-10-25T16:20:36.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.463+0000 7fa721fc4640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa700066470 0x7fa700068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:36.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.463+0000 7fa721fc4640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa700066470 0x7fa700068930 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa7180af000 tx=0x7fa71801b4f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:36.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.467+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa70c051550 con 0x7fa71c0cdb10 2023-10-25T16:20:36.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.639+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa71c0c6f30 con 0x7fa71c0cdb10 2023-10-25T16:20:36.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.639+0000 7fa7127fc640 1 -- 172.21.15.177:0/82161651 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fa70c020090 con 0x7fa71c0cdb10 2023-10-25T16:20:36.640 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:36.640 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:36.640 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:36.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa700066470 msgr2=0x7fa700068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa700066470 0x7fa700068930 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa7180af000 tx=0x7fa71801b4f0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 msgr2=0x7fa71c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 0x7fa71c153760 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00d980 tx=0x7fa70c00de40 comp rx=0 tx=0).stop 2023-10-25T16:20:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 shutdown_connections 2023-10-25T16:20:36.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa700066470 0x7fa700068930 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa71c15eba0 0x7fa71c0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa71c0cdb10 0x7fa71c153760 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 --2- 172.21.15.177:0/82161651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa71c0b2120 0x7fa71c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 >> 172.21.15.177:0/82161651 conn(0x7fa71c09a5c0 msgr2=0x7fa71c0b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:36.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 shutdown_connections 2023-10-25T16:20:36.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:36.643+0000 7fa724228640 1 -- 172.21.15.177:0/82161651 wait complete. 2023-10-25T16:20:36.657 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:20:36.804 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155741,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":42.100198542999998,"mdsmap_epoch":51,"osdmap_epoch":146,"osdmap_epoch_barrier":145,"uptime":47.175530408999997} 2023-10-25T16:20:36.804 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155741, "mdsmap_epoch": 51, "osdmap_epoch": 146, "osdmap_epoch_barrier": 145, "rank_uptime": 42.100198543, "state": "up:active", "uptime": 47.175530409, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:20:36.805 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:20:36.805 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:36.805 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:36.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:36.812 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-25T16:20:37.389 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records in 2023-10-25T16:20:37.390 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records out 2023-10-25T16:20:37.390 INFO:teuthology.orchestra.run.smithi177.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.519557 s, 101 MB/s 2023-10-25T16:20:37.391 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:20:37.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:20:37.454 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:20:37.519 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:20:37.520 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:37.520 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:37.527 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:37.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/3423786656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00cdb10 msgr2=0x7f3aa00cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:37.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/3423786656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00cdb10 0x7f3aa00cdfc0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f3a98009900 tx=0x7f3a9801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/3423786656 shutdown_connections 2023-10-25T16:20:37.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/3423786656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00cdb10 0x7f3aa00cdfc0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/3423786656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa00b2120 0x7f3aa00b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/3423786656 >> 172.21.15.177:0/3423786656 conn(0x7f3aa009a5c0 msgr2=0x7f3aa00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:37.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/3423786656 shutdown_connections 2023-10-25T16:20:37.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/3423786656 wait complete. 2023-10-25T16:20:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 Processor -- start 2023-10-25T16:20:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- start start 2023-10-25T16:20:37.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 0x7f3aa0150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa00cdb10 0x7f3aa00c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa015eba0 0x7f3aa006a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0156930 con 0x7f3aa00b2120 2023-10-25T16:20:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0157700 con 0x7f3aa00cdb10 2023-10-25T16:20:37.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3aa4a6b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0156b80 con 0x7f3aa015eba0 2023-10-25T16:20:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3a9e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 0x7f3aa0150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3a9e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 0x7f3aa0150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48440/0 (socket says 172.21.15.177:48440) 2023-10-25T16:20:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.703+0000 7f3a9e59c640 1 -- 172.21.15.177:0/460120682 learned_addr learned my addr 172.21.15.177:0/460120682 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9ed9d640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa015eba0 0x7f3aa006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:37.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9dd9b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa00cdb10 0x7f3aa00c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9e59c640 1 -- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa015eba0 msgr2=0x7f3aa006a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9e59c640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa015eba0 0x7f3aa006a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9e59c640 1 -- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa00cdb10 msgr2=0x7f3aa00c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:37.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9e59c640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa00cdb10 0x7f3aa00c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9e59c640 1 -- 172.21.15.177:0/460120682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009560 con 0x7f3aa00b2120 2023-10-25T16:20:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9e59c640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 0x7f3aa0150230 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000ba80 tx=0x7f3a9000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000cc00 con 0x7f3aa00b2120 2023-10-25T16:20:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3a9000ce50 con 0x7f3aa00b2120 2023-10-25T16:20:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0156e60 con 0x7f3aa00b2120 2023-10-25T16:20:37.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90003be0 con 0x7f3aa00b2120 2023-10-25T16:20:37.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa0157420 con 0x7f3aa00b2120 2023-10-25T16:20:37.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa004daf0 con 0x7f3aa00b2120 2023-10-25T16:20:37.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a90014440 con 0x7f3aa00b2120 2023-10-25T16:20:37.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a8effd640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a80066470 0x7f3a80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:37.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a90083e80 con 0x7f3aa00b2120 2023-10-25T16:20:37.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9dd9b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a80066470 0x7f3a80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:37.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.707+0000 7f3a9dd9b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a80066470 0x7f3a80068930 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3a94005fd0 tx=0x7f3a9400a4e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:37.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.711+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a90051390 con 0x7f3aa00b2120 2023-10-25T16:20:37.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.871+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aa0153820 con 0x7f3aa00b2120 2023-10-25T16:20:37.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.871+0000 7f3a8effd640 1 -- 172.21.15.177:0/460120682 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16559 (secure 0 0 0) 0x7f3a900549b0 con 0x7f3aa00b2120 2023-10-25T16:20:37.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:37.872 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":146,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:32.695867+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:37.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a80066470 msgr2=0x7f3a80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:37.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a80066470 0x7f3a80068930 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3a94005fd0 tx=0x7f3a9400a4e0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 msgr2=0x7f3aa0150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:37.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 0x7f3aa0150230 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000ba80 tx=0x7f3a9000bf40 comp rx=0 tx=0).stop 2023-10-25T16:20:37.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 shutdown_connections 2023-10-25T16:20:37.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a80066470 0x7f3a80068930 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3aa015eba0 0x7f3aa006a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3aa00cdb10 0x7f3aa00c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 --2- 172.21.15.177:0/460120682 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aa00b2120 0x7f3aa0150230 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 >> 172.21.15.177:0/460120682 conn(0x7f3aa009a5c0 msgr2=0x7f3aa015c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 shutdown_connections 2023-10-25T16:20:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:37.875+0000 7f3aa4a6b640 1 -- 172.21.15.177:0/460120682 wait complete. 2023-10-25T16:20:37.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:19:52.021145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:19:52.759535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:20:37.891 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:20:38.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/1847242807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4181500f0 msgr2=0x7fd4180c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 --2- 172.21.15.177:0/1847242807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4181500f0 0x7fd4180c9910 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd4180cd940 tx=0x7fd40801c7c0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/1847242807 shutdown_connections 2023-10-25T16:20:38.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 --2- 172.21.15.177:0/1847242807 >> v2:172.21.15.184:3300/0 conn(0x7fd4180c9e50 0x7fd41806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 --2- 172.21.15.177:0/1847242807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4181500f0 0x7fd4180c9910 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/1847242807 >> 172.21.15.177:0/1847242807 conn(0x7fd4180b2450 msgr2=0x7fd4180b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/1847242807 shutdown_connections 2023-10-25T16:20:38.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/1847242807 wait complete. 2023-10-25T16:20:38.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 Processor -- start 2023-10-25T16:20:38.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- start start 2023-10-25T16:20:38.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd41806bf40 0x7fd4180b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 0x7fd4181552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4181500f0 0x7fd4180abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180b2090 con 0x7fd4180c9e50 2023-10-25T16:20:38.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4181557e0 con 0x7fd4181500f0 2023-10-25T16:20:38.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd418154200 con 0x7fd41806bf40 2023-10-25T16:20:38.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 0x7fd4181552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 0x7fd4181552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48452/0 (socket says 172.21.15.177:48452) 2023-10-25T16:20:38.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 -- 172.21.15.177:0/142711729 learned_addr learned my addr 172.21.15.177:0/142711729 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:38.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41cc09640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4181500f0 0x7fd4180abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd417fff640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd41806bf40 0x7fd4180b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 -- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd41806bf40 msgr2=0x7fd4180b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd41806bf40 0x7fd4180b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 -- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4181500f0 msgr2=0x7fd4180abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4181500f0 0x7fd4180abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 -- 172.21.15.177:0/142711729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd408009560 con 0x7fd4180c9e50 2023-10-25T16:20:38.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41cc09640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4181500f0 0x7fd4180abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:38.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd40ffff640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 0x7fd4181552a0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c970 tx=0x7fd40000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400007bb0 con 0x7fd4180c9e50 2023-10-25T16:20:38.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd400007e00 con 0x7fd4180c9e50 2023-10-25T16:20:38.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4181544e0 con 0x7fd4180c9e50 2023-10-25T16:20:38.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400004a50 con 0x7fd4180c9e50 2023-10-25T16:20:38.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.023+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd418154aa0 con 0x7fd4180c9e50 2023-10-25T16:20:38.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.027+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41804daf0 con 0x7fd4180c9e50 2023-10-25T16:20:38.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.027+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd400004bb0 con 0x7fd4180c9e50 2023-10-25T16:20:38.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.027+0000 7fd4157fa640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3f8066470 0x7fd3f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.027+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd400084220 con 0x7fd4180c9e50 2023-10-25T16:20:38.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.027+0000 7fd417fff640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3f8066470 0x7fd3f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.027+0000 7fd417fff640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3f8066470 0x7fd3f8068930 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd4080af000 tx=0x7fd40801b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.031+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd400051580 con 0x7fd4180c9e50 2023-10-25T16:20:38.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.183+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd418156d70 con 0x7fd4180c9e50 2023-10-25T16:20:38.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd4157fa640 1 -- 172.21.15.177:0/142711729 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd400004e60 con 0x7fd4180c9e50 2023-10-25T16:20:38.184 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:20:38.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3f8066470 msgr2=0x7fd3f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3f8066470 0x7fd3f8068930 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd4080af000 tx=0x7fd40801b000 comp rx=0 tx=0).stop 2023-10-25T16:20:38.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 msgr2=0x7fd4181552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 0x7fd4181552a0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c970 tx=0x7fd40000ce30 comp rx=0 tx=0).stop 2023-10-25T16:20:38.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 shutdown_connections 2023-10-25T16:20:38.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd3f8066470 0x7fd3f8068930 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4181500f0 0x7fd4180abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4180c9e50 0x7fd4181552a0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 --2- 172.21.15.177:0/142711729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd41806bf40 0x7fd4180b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 >> 172.21.15.177:0/142711729 conn(0x7fd4180b2450 msgr2=0x7fd4180aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 shutdown_connections 2023-10-25T16:20:38.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.187+0000 7fd41e66c640 1 -- 172.21.15.177:0/142711729 wait complete. 2023-10-25T16:20:38.203 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:20:38.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.331+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/2214653573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa480b02c0 msgr2=0x7ffa480cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.331+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/2214653573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa480b02c0 0x7ffa480cf600 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009900 tx=0x7ffa3c01f070 comp rx=0 tx=0).stop 2023-10-25T16:20:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/2214653573 shutdown_connections 2023-10-25T16:20:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/2214653573 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa480cfb40 0x7ffa480cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/2214653573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa480b02c0 0x7ffa480cf600 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/2214653573 >> 172.21.15.177:0/2214653573 conn(0x7ffa4809a640 msgr2=0x7ffa480d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/2214653573 shutdown_connections 2023-10-25T16:20:38.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/2214653573 wait complete. 2023-10-25T16:20:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 Processor -- start 2023-10-25T16:20:38.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- start start 2023-10-25T16:20:38.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa480b02c0 0x7ffa4815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480cfb40 0x7ffa480c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 0x7ffa480c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480ca850 con 0x7ffa4815edf0 2023-10-25T16:20:38.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480c59b0 con 0x7ffa480cfb40 2023-10-25T16:20:38.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480caaf0 con 0x7ffa480b02c0 2023-10-25T16:20:38.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 0x7ffa480c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 0x7ffa480c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48478/0 (socket says 172.21.15.177:48478) 2023-10-25T16:20:38.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 -- 172.21.15.177:0/521767034 learned_addr learned my addr 172.21.15.177:0/521767034 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:38.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa477fe640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa480b02c0 0x7ffa4815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 -- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa480b02c0 msgr2=0x7ffa4815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa480b02c0 0x7ffa4815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 -- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480cfb40 msgr2=0x7ffa480c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480cfb40 0x7ffa480c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 -- 172.21.15.177:0/521767034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c009560 con 0x7ffa4815edf0 2023-10-25T16:20:38.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa47fff640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 0x7ffa480c6f10 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000ea20 tx=0x7ffa4000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4000cde0 con 0x7ffa4815edf0 2023-10-25T16:20:38.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffa40004c20 con 0x7ffa4815edf0 2023-10-25T16:20:38.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa480cadd0 con 0x7ffa4815edf0 2023-10-25T16:20:38.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40005020 con 0x7ffa4815edf0 2023-10-25T16:20:38.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa480c83a0 con 0x7ffa4815edf0 2023-10-25T16:20:38.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.335+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4804daf0 con 0x7ffa4815edf0 2023-10-25T16:20:38.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.339+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa40005180 con 0x7ffa4815edf0 2023-10-25T16:20:38.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.339+0000 7ffa2ffff640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa34066470 0x7ffa34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.339+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa400848e0 con 0x7ffa4815edf0 2023-10-25T16:20:38.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.339+0000 7ffa477fe640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa34066470 0x7ffa34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.339+0000 7ffa477fe640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa34066470 0x7ffa34068930 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800a750 tx=0x7ffa38008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.343+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa40051d70 con 0x7ffa4815edf0 2023-10-25T16:20:38.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.491+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa4809ab20 con 0x7ffa4815edf0 2023-10-25T16:20:38.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.491+0000 7ffa2ffff640 1 -- 172.21.15.177:0/521767034 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa4001f0a0 con 0x7ffa4815edf0 2023-10-25T16:20:38.491 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:20:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa34066470 msgr2=0x7ffa34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa34066470 0x7ffa34068930 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800a750 tx=0x7ffa38008040 comp rx=0 tx=0).stop 2023-10-25T16:20:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 msgr2=0x7ffa480c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 0x7ffa480c6f10 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000ea20 tx=0x7ffa4000eee0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 shutdown_connections 2023-10-25T16:20:38.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffa34066470 0x7ffa34068930 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa4815edf0 0x7ffa480c6f10 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffa480cfb40 0x7ffa480c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 --2- 172.21.15.177:0/521767034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffa480b02c0 0x7ffa4815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 >> 172.21.15.177:0/521767034 conn(0x7ffa4809a640 msgr2=0x7ffa48151790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 shutdown_connections 2023-10-25T16:20:38.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.495+0000 7ffa4dbb8640 1 -- 172.21.15.177:0/521767034 wait complete. 2023-10-25T16:20:38.508 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:20:38.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3905752465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3940047d0 msgr2=0x7fe394004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3905752465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3940047d0 0x7fe394004c50 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8158a20 tx=0x7fe39001f6e0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3905752465 shutdown_connections 2023-10-25T16:20:38.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3905752465 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3940047d0 0x7fe394004c50 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3905752465 >> 172.21.15.177:0/3905752465 conn(0x7fe3a80aee60 msgr2=0x7fe3a80af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3905752465 shutdown_connections 2023-10-25T16:20:38.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3905752465 wait complete. 2023-10-25T16:20:38.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 Processor -- start 2023-10-25T16:20:38.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- start start 2023-10-25T16:20:38.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3940047d0 0x7fe3a814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a815b1f0 0x7fe3a8148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 0x7fe3a8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81568d0 con 0x7fe3a8155f00 2023-10-25T16:20:38.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a814eb80 con 0x7fe3940047d0 2023-10-25T16:20:38.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a814ee60 con 0x7fe3a815b1f0 2023-10-25T16:20:38.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 0x7fe3a8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 0x7fe3a8156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48490/0 (socket says 172.21.15.177:48490) 2023-10-25T16:20:38.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 -- 172.21.15.177:0/3667792442 learned_addr learned my addr 172.21.15.177:0/3667792442 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:38.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe39ffff640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a815b1f0 0x7fe3a8148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a77fe640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3940047d0 0x7fe3a814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 -- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a815b1f0 msgr2=0x7fe3a8148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a815b1f0 0x7fe3a8148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 -- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3940047d0 msgr2=0x7fe3a814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3940047d0 0x7fe3a814e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.644 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 -- 172.21.15.177:0/3667792442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a814f140 con 0x7fe3a8155f00 2023-10-25T16:20:38.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a7fff640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 0x7fe3a8156390 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe3a806cbe0 tx=0x7fe3a000da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0003d90 con 0x7fe3a8155f00 2023-10-25T16:20:38.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe3a0006110 con 0x7fe3a8155f00 2023-10-25T16:20:38.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a814f420 con 0x7fe3a8155f00 2023-10-25T16:20:38.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00064e0 con 0x7fe3a8155f00 2023-10-25T16:20:38.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.639+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a814e7c0 con 0x7fe3a8155f00 2023-10-25T16:20:38.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.643+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a814f8d0 con 0x7fe3a8155f00 2023-10-25T16:20:38.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.643+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3a0006640 con 0x7fe3a8155f00 2023-10-25T16:20:38.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.643+0000 7fe3a4ff9640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe388066470 0x7fe388068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.643+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3a0084100 con 0x7fe3a8155f00 2023-10-25T16:20:38.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.643+0000 7fe3a77fe640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe388066470 0x7fe388068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.643+0000 7fe3a77fe640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe388066470 0x7fe388068930 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80ca8d0 tx=0x7fe3980091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.647+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3a814f8d0 con 0x7fe3a8155f00 2023-10-25T16:20:38.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.799+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3a814f8d0 con 0x7fe3a8155f00 2023-10-25T16:20:38.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3a4ff9640 1 -- 172.21.15.177:0/3667792442 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3a814f8d0 con 0x7fe3a8155f00 2023-10-25T16:20:38.801 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:20:38.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe388066470 msgr2=0x7fe388068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe388066470 0x7fe388068930 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80ca8d0 tx=0x7fe3980091e0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 msgr2=0x7fe3a8156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 0x7fe3a8156390 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe3a806cbe0 tx=0x7fe3a000da10 comp rx=0 tx=0).stop 2023-10-25T16:20:38.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 shutdown_connections 2023-10-25T16:20:38.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe388066470 0x7fe388068930 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3a8155f00 0x7fe3a8156390 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3a815b1f0 0x7fe3a8148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 --2- 172.21.15.177:0/3667792442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3940047d0 0x7fe3a814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 >> 172.21.15.177:0/3667792442 conn(0x7fe3a80aee60 msgr2=0x7fe3a80ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 shutdown_connections 2023-10-25T16:20:38.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.803+0000 7fe3adc72640 1 -- 172.21.15.177:0/3667792442 wait complete. 2023-10-25T16:20:38.820 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:20:38.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.951+0000 7fb358b09640 1 -- 172.21.15.177:0/1996375832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb354140db0 msgr2=0x7fb3540af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.951+0000 7fb358b09640 1 --2- 172.21.15.177:0/1996375832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb354140db0 0x7fb3540af5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009900 tx=0x7fb34c01c890 comp rx=0 tx=0).stop 2023-10-25T16:20:38.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- 172.21.15.177:0/1996375832 shutdown_connections 2023-10-25T16:20:38.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 --2- 172.21.15.177:0/1996375832 >> v2:172.21.15.184:3300/0 conn(0x7fb35406be60 0x7fb3540b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 --2- 172.21.15.177:0/1996375832 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb354140db0 0x7fb3540af5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- 172.21.15.177:0/1996375832 >> 172.21.15.177:0/1996375832 conn(0x7fb3540b2450 msgr2=0x7fb3540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:38.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- 172.21.15.177:0/1996375832 shutdown_connections 2023-10-25T16:20:38.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- 172.21.15.177:0/1996375832 wait complete. 2023-10-25T16:20:38.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 Processor -- start 2023-10-25T16:20:38.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- start start 2023-10-25T16:20:38.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb35406ba00 0x7fb3541569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 0x7fb3541345f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb354140db0 0x7fb354134b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354130fc0 con 0x7fb35406be60 2023-10-25T16:20:38.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb354131680 con 0x7fb354140db0 2023-10-25T16:20:38.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35413a160 con 0x7fb35406ba00 2023-10-25T16:20:38.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 0x7fb3541345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 0x7fb3541345f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48492/0 (socket says 172.21.15.177:48492) 2023-10-25T16:20:38.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 -- 172.21.15.177:0/4274826582 learned_addr learned my addr 172.21.15.177:0/4274826582 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:38.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb35259c640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb35406ba00 0x7fb3541569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb352d9d640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb354140db0 0x7fb354134b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 -- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb35406ba00 msgr2=0x7fb3541569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb35406ba00 0x7fb3541569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 -- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb354140db0 msgr2=0x7fb354134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:38.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb354140db0 0x7fb354134b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:38.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 -- 172.21.15.177:0/4274826582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009560 con 0x7fb35406be60 2023-10-25T16:20:38.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb35259c640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb35406ba00 0x7fb3541569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:20:38.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb351d9b640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 0x7fb3541345f0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb33c001ec0 tx=0x7fb33c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0052d0 con 0x7fb35406be60 2023-10-25T16:20:38.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb33c007020 con 0x7fb35406be60 2023-10-25T16:20:38.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3541318d0 con 0x7fb35406be60 2023-10-25T16:20:38.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c007470 con 0x7fb35406be60 2023-10-25T16:20:38.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.955+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35413a6e0 con 0x7fb35406be60 2023-10-25T16:20:38.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.959+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35404daf0 con 0x7fb35406be60 2023-10-25T16:20:38.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.959+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb33c0067e0 con 0x7fb35406be60 2023-10-25T16:20:38.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.959+0000 7fb34affd640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb334066470 0x7fb334068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:38.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.959+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb33c083510 con 0x7fb35406be60 2023-10-25T16:20:38.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.959+0000 7fb35259c640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb334066470 0x7fb334068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:38.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.959+0000 7fb35259c640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb334066470 0x7fb334068930 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0af000 tx=0x7fb34c01b0d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:38.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:38.963+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb33c0508f0 con 0x7fb35406be60 2023-10-25T16:20:39.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.127+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb3540ca670 con 0x7fb35406be60 2023-10-25T16:20:39.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.127+0000 7fb34affd640 1 -- 172.21.15.177:0/4274826582 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v146) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb33c053f10 con 0x7fb35406be60 2023-10-25T16:20:39.127 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:20:39.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb334066470 msgr2=0x7fb334068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb334066470 0x7fb334068930 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0af000 tx=0x7fb34c01b0d0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 msgr2=0x7fb3541345f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 0x7fb3541345f0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fb33c001ec0 tx=0x7fb33c00c820 comp rx=0 tx=0).stop 2023-10-25T16:20:39.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 shutdown_connections 2023-10-25T16:20:39.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb334066470 0x7fb334068930 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb354140db0 0x7fb354134b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb35406be60 0x7fb3541345f0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 --2- 172.21.15.177:0/4274826582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb35406ba00 0x7fb3541569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 >> 172.21.15.177:0/4274826582 conn(0x7fb3540b2450 msgr2=0x7fb3540b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:39.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 shutdown_connections 2023-10-25T16:20:39.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.131+0000 7fb358b09640 1 -- 172.21.15.177:0/4274826582 wait complete. 2023-10-25T16:20:39.146 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:20:39.147 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:39.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:20:39.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:39.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[50067]: fuse finished with error 0 and tester_r 0 2023-10-25T16:20:39.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:39.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:20:39.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:39.211 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:20:39.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:39.271 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:20:39.271 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:39.282 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:39.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3320332784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c40047d0 msgr2=0x7f14c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3320332784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c40047d0 0x7f14c4004c50 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f14d40016b0 tx=0x7f14d401c720 comp rx=0 tx=0).stop 2023-10-25T16:20:39.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3320332784 shutdown_connections 2023-10-25T16:20:39.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3320332784 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c40047d0 0x7f14c4004c50 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3320332784 >> 172.21.15.177:0/3320332784 conn(0x7f14d80b2450 msgr2=0x7f14d80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:39.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3320332784 shutdown_connections 2023-10-25T16:20:39.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3320332784 wait complete. 2023-10-25T16:20:39.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 Processor -- start 2023-10-25T16:20:39.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- start start 2023-10-25T16:20:39.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c40047d0 0x7f14d81368f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d815adf0 0x7f14d8138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 0x7f14d80cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d814f950 con 0x7f14d8138640 2023-10-25T16:20:39.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8136e30 con 0x7f14d815adf0 2023-10-25T16:20:39.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8137060 con 0x7f14c40047d0 2023-10-25T16:20:39.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 0x7f14d80cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 0x7f14d80cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48502/0 (socket says 172.21.15.177:48502) 2023-10-25T16:20:39.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 -- 172.21.15.177:0/3682873970 learned_addr learned my addr 172.21.15.177:0/3682873970 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:39.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dd190640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d815adf0 0x7f14d8138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dd991640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c40047d0 0x7f14d81368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 -- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c40047d0 msgr2=0x7f14d81368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c40047d0 0x7f14d81368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 -- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d815adf0 msgr2=0x7f14d8138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d815adf0 0x7f14d8138100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 -- 172.21.15.177:0/3682873970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8137340 con 0x7f14d8138640 2023-10-25T16:20:39.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14de192640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 0x7f14d80cce80 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b1b10 tx=0x7f14d000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:39.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0018070 con 0x7f14d8138640 2023-10-25T16:20:39.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f14d0004b30 con 0x7f14d8138640 2023-10-25T16:20:39.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000ba20 con 0x7f14d8138640 2023-10-25T16:20:39.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d8137620 con 0x7f14d8138640 2023-10-25T16:20:39.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.403+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d8137be0 con 0x7f14d8138640 2023-10-25T16:20:39.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.407+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d80c9780 con 0x7f14d8138640 2023-10-25T16:20:39.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.407+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14d000bb80 con 0x7f14d8138640 2023-10-25T16:20:39.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.407+0000 7f14ce7fc640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14bc066470 0x7f14bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.407+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14d0083c70 con 0x7f14d8138640 2023-10-25T16:20:39.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.407+0000 7f14dd991640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14bc066470 0x7f14bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.407+0000 7f14dd991640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14bc066470 0x7f14bc068930 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f14c8001ec0 tx=0x7f14c8001db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:39.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.411+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14d00510f0 con 0x7f14d8138640 2023-10-25T16:20:39.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.567+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14d804daf0 con 0x7f14d8138640 2023-10-25T16:20:39.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.567+0000 7f14ce7fc640 1 -- 172.21.15.177:0/3682873970 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16559 (secure 0 0 0) 0x7f14d0054710 con 0x7f14d8138640 2023-10-25T16:20:39.573 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:39.573 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":146,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:32.695867+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:39.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14bc066470 msgr2=0x7f14bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14bc066470 0x7f14bc068930 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f14c8001ec0 tx=0x7f14c8001db0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 msgr2=0x7f14d80cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 0x7f14d80cce80 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f14d80b1b10 tx=0x7f14d000dd90 comp rx=0 tx=0).stop 2023-10-25T16:20:39.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 shutdown_connections 2023-10-25T16:20:39.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f14bc066470 0x7f14bc068930 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14d8138640 0x7f14d80cce80 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d815adf0 0x7f14d8138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 --2- 172.21.15.177:0/3682873970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14c40047d0 0x7f14d81368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 >> 172.21.15.177:0/3682873970 conn(0x7f14d80b2450 msgr2=0x7f14d8069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:39.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 shutdown_connections 2023-10-25T16:20:39.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.571+0000 7f14dfbf5640 1 -- 172.21.15.177:0/3682873970 wait complete. 2023-10-25T16:20:39.588 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:19:52.021145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:19:52.759535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:20:39.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:20:39.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- 172.21.15.177:0/980926964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 msgr2=0x7fd974003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/980926964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd974003dd0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fd984009b60 tx=0x7fd98401d290 comp rx=0 tx=0).stop 2023-10-25T16:20:39.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98e41a640 1 -- 172.21.15.177:0/980926964 reap_dead start 2023-10-25T16:20:39.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- 172.21.15.177:0/980926964 shutdown_connections 2023-10-25T16:20:39.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- 172.21.15.177:0/980926964 >> 172.21.15.177:0/980926964 conn(0x7fd98809a5c0 msgr2=0x7fd9880d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:39.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- 172.21.15.177:0/980926964 shutdown_connections 2023-10-25T16:20:39.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- 172.21.15.177:0/980926964 wait complete. 2023-10-25T16:20:39.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 Processor -- start 2023-10-25T16:20:39.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- start start 2023-10-25T16:20:39.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd988154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880c77e0 0x7fd98814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9880c4ca0 0x7fd988158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9880c5f30 con 0x7fd9740039b0 2023-10-25T16:20:39.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd988153d10 con 0x7fd9880c77e0 2023-10-25T16:20:39.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.731+0000 7fd98fe7d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd988154980 con 0x7fd9880c4ca0 2023-10-25T16:20:39.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd988154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd988154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48522/0 (socket says 172.21.15.177:48522) 2023-10-25T16:20:39.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 -- 172.21.15.177:0/1972423435 learned_addr learned my addr 172.21.15.177:0/1972423435 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:39.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98e41a640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9880c4ca0 0x7fd988158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98d418640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880c77e0 0x7fd98814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 -- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9880c4ca0 msgr2=0x7fd988158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9880c4ca0 0x7fd988158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 -- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880c77e0 msgr2=0x7fd98814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880c77e0 0x7fd98814e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 -- 172.21.15.177:0/1972423435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98814eb20 con 0x7fd9740039b0 2023-10-25T16:20:39.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98dc19640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd988154440 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fd98401d0c0 tx=0x7fd984005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:39.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840bb070 con 0x7fd9740039b0 2023-10-25T16:20:39.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd984004120 con 0x7fd9740039b0 2023-10-25T16:20:39.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984004510 con 0x7fd9740039b0 2023-10-25T16:20:39.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9880c56b0 con 0x7fd9740039b0 2023-10-25T16:20:39.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9880c5c50 con 0x7fd9740039b0 2023-10-25T16:20:39.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98804daf0 con 0x7fd9740039b0 2023-10-25T16:20:39.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd9840b3070 con 0x7fd9740039b0 2023-10-25T16:20:39.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd97e7fc640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd96c066470 0x7fd96c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:39.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd98411e430 con 0x7fd9740039b0 2023-10-25T16:20:39.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.735+0000 7fd98d418640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd96c066470 0x7fd96c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:39.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.739+0000 7fd98d418640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd96c066470 0x7fd96c068930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd98809f200 tx=0x7fd978006b60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:39.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.739+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9840ebab0 con 0x7fd9740039b0 2023-10-25T16:20:39.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd988073140 con 0x7fd9740039b0 2023-10-25T16:20:39.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd97e7fc640 1 -- 172.21.15.177:0/1972423435 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9840b1020 con 0x7fd9740039b0 2023-10-25T16:20:39.897 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:20:39.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd96c066470 msgr2=0x7fd96c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd96c066470 0x7fd96c068930 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd98809f200 tx=0x7fd978006b60 comp rx=0 tx=0).stop 2023-10-25T16:20:39.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 msgr2=0x7fd988154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:39.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd988154440 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fd98401d0c0 tx=0x7fd984005540 comp rx=0 tx=0).stop 2023-10-25T16:20:39.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 shutdown_connections 2023-10-25T16:20:39.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd96c066470 0x7fd96c068930 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd9880c4ca0 0x7fd988158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9880c77e0 0x7fd98814e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 --2- 172.21.15.177:0/1972423435 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9740039b0 0x7fd988154440 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:39.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 >> 172.21.15.177:0/1972423435 conn(0x7fd98809a5c0 msgr2=0x7fd98815a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:39.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 shutdown_connections 2023-10-25T16:20:39.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:39.899+0000 7fd98fe7d640 1 -- 172.21.15.177:0/1972423435 wait complete. 2023-10-25T16:20:39.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:20:40.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3201414021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 msgr2=0x7fc7f4155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3201414021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f4155880 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009900 tx=0x7fc7e001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3201414021 shutdown_connections 2023-10-25T16:20:40.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3201414021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f4155880 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3201414021 >> 172.21.15.177:0/3201414021 conn(0x7fc7f40b2450 msgr2=0x7fc7f40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:40.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3201414021 shutdown_connections 2023-10-25T16:20:40.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3201414021 wait complete. 2023-10-25T16:20:40.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 Processor -- start 2023-10-25T16:20:40.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- start start 2023-10-25T16:20:40.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f406c130 0x7fc7f414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4159180 0x7fc7f4145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f414d1f0 con 0x7fc7f406bd50 2023-10-25T16:20:40.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f414d4d0 con 0x7fc7f4159180 2023-10-25T16:20:40.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f414d7b0 con 0x7fc7f406c130 2023-10-25T16:20:40.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f414e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48542/0 (socket says 172.21.15.177:48542) 2023-10-25T16:20:40.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 -- 172.21.15.177:0/3854691460 learned_addr learned my addr 172.21.15.177:0/3854691460 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:40.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f3fff640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f406c130 0x7fc7f414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f9517640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4159180 0x7fc7f4145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 -- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f406c130 msgr2=0x7fc7f414c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f406c130 0x7fc7f414c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 -- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4159180 msgr2=0x7fc7f4145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4159180 0x7fc7f4145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 -- 172.21.15.177:0/3854691460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0009560 con 0x7fc7f406bd50 2023-10-25T16:20:40.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f9517640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4159180 0x7fc7f4145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:40.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f8d16640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f414e290 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009850 tx=0x7fc7e00a66a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:40.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00be070 con 0x7fc7f406bd50 2023-10-25T16:20:40.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7e00041b0 con 0x7fc7f406bd50 2023-10-25T16:20:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f414da90 con 0x7fc7f406bd50 2023-10-25T16:20:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00043a0 con 0x7fc7f406bd50 2023-10-25T16:20:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.043+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f414cf00 con 0x7fc7f406bd50 2023-10-25T16:20:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.047+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f414dfb0 con 0x7fc7f406bd50 2023-10-25T16:20:40.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.047+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7e0003600 con 0x7fc7f406bd50 2023-10-25T16:20:40.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.047+0000 7fc7f17fa640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7d8066470 0x7fc7d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.047+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7e00aa070 con 0x7fc7f406bd50 2023-10-25T16:20:40.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.047+0000 7fc7f3fff640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7d8066470 0x7fc7d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.047+0000 7fc7f3fff640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7d8066470 0x7fc7d8068930 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc7f41f5080 tx=0x7fc7e8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:40.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.051+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7f414dfb0 con 0x7fc7f406bd50 2023-10-25T16:20:40.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.203+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7f404daf0 con 0x7fc7f406bd50 2023-10-25T16:20:40.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.203+0000 7fc7f17fa640 1 -- 172.21.15.177:0/3854691460 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc7e00ec2b0 con 0x7fc7f406bd50 2023-10-25T16:20:40.204 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:20:40.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7d8066470 msgr2=0x7fc7d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7d8066470 0x7fc7d8068930 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc7f41f5080 tx=0x7fc7e8009040 comp rx=0 tx=0).stop 2023-10-25T16:20:40.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 msgr2=0x7fc7f414e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f414e290 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009850 tx=0x7fc7e00a66a0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 shutdown_connections 2023-10-25T16:20:40.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7d8066470 0x7fc7d8068930 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f4159180 0x7fc7f4145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7f406c130 0x7fc7f414c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 --2- 172.21.15.177:0/3854691460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406bd50 0x7fc7f414e290 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 >> 172.21.15.177:0/3854691460 conn(0x7fc7f40b2450 msgr2=0x7fc7f40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:40.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 shutdown_connections 2023-10-25T16:20:40.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.207+0000 7fc7faf7a640 1 -- 172.21.15.177:0/3854691460 wait complete. 2023-10-25T16:20:40.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:20:40.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 -- 172.21.15.177:0/77458565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 msgr2=0x7f27e806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/77458565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e806be10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009930 tx=0x7f27e001c890 comp rx=0 tx=0).stop 2023-10-25T16:20:40.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 -- 172.21.15.177:0/77458565 shutdown_connections 2023-10-25T16:20:40.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/77458565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e806be10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/77458565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27e8159230 0x7f27e8071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 -- 172.21.15.177:0/77458565 >> 172.21.15.177:0/77458565 conn(0x7f27e80b2450 msgr2=0x7f27e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:40.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 -- 172.21.15.177:0/77458565 shutdown_connections 2023-10-25T16:20:40.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.351+0000 7f27ef5ab640 1 -- 172.21.15.177:0/77458565 wait complete. 2023-10-25T16:20:40.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 Processor -- start 2023-10-25T16:20:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- start start 2023-10-25T16:20:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e814e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e8070510 0x7f27e80abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27e8159230 0x7f27e8149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e814dfe0 con 0x7f27e806b980 2023-10-25T16:20:40.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e814aed0 con 0x7f27e8070510 2023-10-25T16:20:40.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80ac420 con 0x7f27e8159230 2023-10-25T16:20:40.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e814e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e814e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:48560/0 (socket says 172.21.15.177:48560) 2023-10-25T16:20:40.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 -- 172.21.15.177:0/2497828486 learned_addr learned my addr 172.21.15.177:0/2497828486 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:40.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 -- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27e8159230 msgr2=0x7f27e8149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27edb48640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27e8159230 0x7f27e8149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ecb46640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e8070510 0x7f27e80abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27e8159230 0x7f27e8149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 -- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e8070510 msgr2=0x7f27e80abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e8070510 0x7f27e80abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 -- 172.21.15.177:0/2497828486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009560 con 0x7f27e806b980 2023-10-25T16:20:40.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ed347640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e814e400 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f27e400ea20 tx=0x7f27e400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:40.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400cde0 con 0x7f27e806b980 2023-10-25T16:20:40.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27e4004c20 con 0x7f27e806b980 2023-10-25T16:20:40.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e814d640 con 0x7f27e806b980 2023-10-25T16:20:40.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4005020 con 0x7f27e806b980 2023-10-25T16:20:40.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e814dc00 con 0x7f27e806b980 2023-10-25T16:20:40.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e814e120 con 0x7f27e806b980 2023-10-25T16:20:40.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.355+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27e4005180 con 0x7f27e806b980 2023-10-25T16:20:40.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.359+0000 7f27ddffb640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27cc066470 0x7f27cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.359+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27e40847d0 con 0x7f27e806b980 2023-10-25T16:20:40.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.359+0000 7f27ecb46640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27cc066470 0x7f27cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.359+0000 7f27ecb46640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27cc066470 0x7f27cc068930 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f27e814b080 tx=0x7f27d8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:40.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.363+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27e814e120 con 0x7f27e806b980 2023-10-25T16:20:40.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27e814e120 con 0x7f27e806b980 2023-10-25T16:20:40.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ddffb640 1 -- 172.21.15.177:0/2497828486 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27e814e120 con 0x7f27e806b980 2023-10-25T16:20:40.510 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:20:40.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27cc066470 msgr2=0x7f27cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27cc066470 0x7f27cc068930 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f27e814b080 tx=0x7f27d8009040 comp rx=0 tx=0).stop 2023-10-25T16:20:40.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 msgr2=0x7f27e814e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.521 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e814e400 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f27e400ea20 tx=0x7f27e400eee0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 shutdown_connections 2023-10-25T16:20:40.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27cc066470 0x7f27cc068930 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27e8159230 0x7f27e8149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.522 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e8070510 0x7f27e80abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 --2- 172.21.15.177:0/2497828486 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e806b980 0x7f27e814e400 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 >> 172.21.15.177:0/2497828486 conn(0x7f27e80b2450 msgr2=0x7f27e80b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:40.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 shutdown_connections 2023-10-25T16:20:40.523 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.511+0000 7f27ef5ab640 1 -- 172.21.15.177:0/2497828486 wait complete. 2023-10-25T16:20:40.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:20:40.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/3111194717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 msgr2=0x7f3c940cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 --2- 172.21.15.177:0/3111194717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c940cbc40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009cb0 tx=0x7f3c8c01cd10 comp rx=0 tx=0).stop 2023-10-25T16:20:40.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/3111194717 shutdown_connections 2023-10-25T16:20:40.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 --2- 172.21.15.177:0/3111194717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c940cbc40 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/3111194717 >> 172.21.15.177:0/3111194717 conn(0x7f3c940b2450 msgr2=0x7f3c940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:40.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/3111194717 shutdown_connections 2023-10-25T16:20:40.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/3111194717 wait complete. 2023-10-25T16:20:40.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 Processor -- start 2023-10-25T16:20:40.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- start start 2023-10-25T16:20:40.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9406c110 0x7f3c9413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c9413d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c94140db0 0x7f3c940cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9413f1b0 con 0x7f3c940af5a0 2023-10-25T16:20:40.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9413f490 con 0x7f3c94140db0 2023-10-25T16:20:40.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9413f770 con 0x7f3c9406c110 2023-10-25T16:20:40.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c9413d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c9413d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51348/0 (socket says 172.21.15.177:51348) 2023-10-25T16:20:40.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 -- 172.21.15.177:0/1037248257 learned_addr learned my addr 172.21.15.177:0/1037248257 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:40.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 -- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9406c110 msgr2=0x7f3c9413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9406c110 0x7f3c9413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 -- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c94140db0 msgr2=0x7f3c940cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c94140db0 0x7f3c940cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 -- 172.21.15.177:0/1037248257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0098e0 con 0x7f3c940af5a0 2023-10-25T16:20:40.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c927fc640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c9413d260 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c430 tx=0x7f3c8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:40.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88011790 con 0x7f3c940af5a0 2023-10-25T16:20:40.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c880119e0 con 0x7f3c940af5a0 2023-10-25T16:20:40.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9413fa50 con 0x7f3c940af5a0 2023-10-25T16:20:40.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88011e30 con 0x7f3c940af5a0 2023-10-25T16:20:40.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.663+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9413ee60 con 0x7f3c940af5a0 2023-10-25T16:20:40.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.667+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9413fc90 con 0x7f3c940af5a0 2023-10-25T16:20:40.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.667+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3c88012420 con 0x7f3c940af5a0 2023-10-25T16:20:40.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.667+0000 7f3c7bfff640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3c800664a0 0x7f3c80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:40.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.667+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c88083c40 con 0x7f3c940af5a0 2023-10-25T16:20:40.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.667+0000 7f3c92ffd640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3c800664a0 0x7f3c80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:40.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.667+0000 7f3c92ffd640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3c800664a0 0x7f3c80068960 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c84007fd0 tx=0x7f3c84007940 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:40.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.671+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c9413fc90 con 0x7f3c940af5a0 2023-10-25T16:20:40.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c9413fc40 con 0x7f3c940af5a0 2023-10-25T16:20:40.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c7bfff640 1 -- 172.21.15.177:0/1037248257 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v146) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c880510b0 con 0x7f3c940af5a0 2023-10-25T16:20:40.833 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:20:40.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3c800664a0 msgr2=0x7f3c80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3c800664a0 0x7f3c80068960 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3c84007fd0 tx=0x7f3c84007940 comp rx=0 tx=0).stop 2023-10-25T16:20:40.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 msgr2=0x7f3c9413d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:40.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c9413d260 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c430 tx=0x7f3c8800c8f0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 shutdown_connections 2023-10-25T16:20:40.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3c800664a0 0x7f3c80068960 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c94140db0 0x7f3c940cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c940af5a0 0x7f3c9413d260 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 --2- 172.21.15.177:0/1037248257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3c9406c110 0x7f3c9413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:40.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 >> 172.21.15.177:0/1037248257 conn(0x7f3c940b2450 msgr2=0x7f3c940b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:40.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 shutdown_connections 2023-10-25T16:20:40.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:40.835+0000 7f3c9990e640 1 -- 172.21.15.177:0/1037248257 wait complete. 2023-10-25T16:20:40.850 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:20:40.851 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:20:40.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:20:40.918 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:20:40.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35136]: fuse finished with error 0 and tester_r 0 2023-10-25T16:20:40.920 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:40.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:20:40.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:20:40.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:40.929 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:20:40.940 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:40.940 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:40.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:20:40.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:20:40.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:40.956 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:20:41.004 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:20:41.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:20:41.006 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:20:41.006 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:41.017 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:20:41.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:20:41.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:20:41.018 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:20:41.070 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:20:41.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:20:41.072 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:41.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- 172.21.15.177:0/2001764595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64180cca70 msgr2=0x7f64180ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 --2- 172.21.15.177:0/2001764595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64180cca70 0x7f64180ad3f0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f64180702e0 tx=0x7f640801c8a0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- 172.21.15.177:0/2001764595 shutdown_connections 2023-10-25T16:20:41.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 --2- 172.21.15.177:0/2001764595 >> v2:172.21.15.184:3300/0 conn(0x7f64180cbb80 0x7f64180cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 --2- 172.21.15.177:0/2001764595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64180cca70 0x7f64180ad3f0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- 172.21.15.177:0/2001764595 >> 172.21.15.177:0/2001764595 conn(0x7f64180caa30 msgr2=0x7f64180cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:41.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- 172.21.15.177:0/2001764595 shutdown_connections 2023-10-25T16:20:41.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- 172.21.15.177:0/2001764595 wait complete. 2023-10-25T16:20:41.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 Processor -- start 2023-10-25T16:20:41.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- start start 2023-10-25T16:20:41.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64180cbb80 0x7f6418154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64180cca70 0x7f641814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 0x7f641814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180ac540 con 0x7f64181592e0 2023-10-25T16:20:41.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180ab930 con 0x7f64180cca70 2023-10-25T16:20:41.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641eeac640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64180abc10 con 0x7f64180cbb80 2023-10-25T16:20:41.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 0x7f641814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 0x7f641814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51372/0 (socket says 172.21.15.177:51372) 2023-10-25T16:20:41.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 -- 172.21.15.177:0/445671538 learned_addr learned my addr 172.21.15.177:0/445671538 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:41.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641cc48640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64180cbb80 0x7f6418154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f6417fff640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64180cca70 0x7f641814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 -- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64180cbb80 msgr2=0x7f6418154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64180cbb80 0x7f6418154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 -- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64180cca70 msgr2=0x7f641814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64180cca70 0x7f641814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 -- 172.21.15.177:0/445671538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009560 con 0x7f64181592e0 2023-10-25T16:20:41.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f641d449640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 0x7f641814f8b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f641000c730 tx=0x7f641000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:41.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.199+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6410006d60 con 0x7f64181592e0 2023-10-25T16:20:41.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6410003980 con 0x7f64181592e0 2023-10-25T16:20:41.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64180abef0 con 0x7f64181592e0 2023-10-25T16:20:41.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6410003d90 con 0x7f64181592e0 2023-10-25T16:20:41.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6418154850 con 0x7f64181592e0 2023-10-25T16:20:41.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641804daf0 con 0x7f64181592e0 2023-10-25T16:20:41.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64100050d0 con 0x7f64181592e0 2023-10-25T16:20:41.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f64157fa640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6410083c40 con 0x7f64181592e0 2023-10-25T16:20:41.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f641cc48640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.203+0000 7f641cc48640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f64080af000 tx=0x7f640801b0e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:41.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.207+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64100510d0 con 0x7f64181592e0 2023-10-25T16:20:41.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.387+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f641815b4b0 con 0x7f64181592e0 2023-10-25T16:20:41.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.387+0000 7f64157fa640 1 -- 172.21.15.177:0/445671538 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7f64100546f0 con 0x7f64181592e0 2023-10-25T16:20:41.386 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:41.386 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:41.387 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:41.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 msgr2=0x7f6404068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f64080af000 tx=0x7f640801b0e0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 msgr2=0x7f641814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 0x7f641814f8b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f641000c730 tx=0x7f641000cb30 comp rx=0 tx=0).stop 2023-10-25T16:20:41.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 shutdown_connections 2023-10-25T16:20:41.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6404066470 0x7f6404068930 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64181592e0 0x7f641814f8b0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64180cca70 0x7f641814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 --2- 172.21.15.177:0/445671538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64180cbb80 0x7f6418154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 >> 172.21.15.177:0/445671538 conn(0x7f64180caa30 msgr2=0x7f641815a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:41.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 shutdown_connections 2023-10-25T16:20:41.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.391+0000 7f641eeac640 1 -- 172.21.15.177:0/445671538 wait complete. 2023-10-25T16:20:41.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:41.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f4551ed5640 1 -- 172.21.15.177:0/1390611628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4534005190 msgr2=0x7f453400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f4551ed5640 1 --2- 172.21.15.177:0/1390611628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4534005190 0x7f453400b990 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f454400ac60 tx=0x7f454401cc90 comp rx=0 tx=0).stop 2023-10-25T16:20:41.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f454bfff640 1 -- 172.21.15.177:0/1390611628 reap_dead start 2023-10-25T16:20:41.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f4551ed5640 1 -- 172.21.15.177:0/1390611628 shutdown_connections 2023-10-25T16:20:41.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f4551ed5640 1 -- 172.21.15.177:0/1390611628 >> 172.21.15.177:0/1390611628 conn(0x7f454c0983a0 msgr2=0x7f454c0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:41.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f4551ed5640 1 -- 172.21.15.177:0/1390611628 shutdown_connections 2023-10-25T16:20:41.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.531+0000 7f4551ed5640 1 -- 172.21.15.177:0/1390611628 wait complete. 2023-10-25T16:20:41.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 Processor -- start 2023-10-25T16:20:41.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- start start 2023-10-25T16:20:41.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4534005190 0x7f454c14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 0x7f454c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f454c1ef830 0x7f454c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c150090 con 0x7f454c151df0 2023-10-25T16:20:41.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c7cc0 con 0x7f4534005190 2023-10-25T16:20:41.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1f01a0 con 0x7f454c1ef830 2023-10-25T16:20:41.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 0x7f454c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 0x7f454c0c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51400/0 (socket says 172.21.15.177:51400) 2023-10-25T16:20:41.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 -- 172.21.15.177:0/2504386258 learned_addr learned my addr 172.21.15.177:0/2504386258 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:41.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454bfff640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f454c1ef830 0x7f454c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 -- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f454c1ef830 msgr2=0x7f454c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f454c1ef830 0x7f454c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454b7fe640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4534005190 0x7f454c14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 -- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4534005190 msgr2=0x7f454c14e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4534005190 0x7f454c14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 -- 172.21.15.177:0/2504386258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0cd770 con 0x7f454c151df0 2023-10-25T16:20:41.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454bfff640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f454c1ef830 0x7f454c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:41.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f454affd640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 0x7f454c0c7780 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f454000c700 tx=0x7f454000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:41.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540005480 con 0x7f454c151df0 2023-10-25T16:20:41.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4540003600 con 0x7f454c151df0 2023-10-25T16:20:41.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c1f0480 con 0x7f454c151df0 2023-10-25T16:20:41.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540003a10 con 0x7f454c151df0 2023-10-25T16:20:41.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c14fd20 con 0x7f454c151df0 2023-10-25T16:20:41.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.535+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c04daf0 con 0x7f454c151df0 2023-10-25T16:20:41.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.539+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4540003b70 con 0x7f454c151df0 2023-10-25T16:20:41.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.539+0000 7f4533fff640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45380664a0 0x7f4538068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.539+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4540083ac0 con 0x7f454c151df0 2023-10-25T16:20:41.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.539+0000 7f454b7fe640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45380664a0 0x7f4538068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.539+0000 7f454b7fe640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45380664a0 0x7f4538068960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f453c005fd0 tx=0x7f453c005e60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:41.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.539+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4540051020 con 0x7f454c151df0 2023-10-25T16:20:41.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.683+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f454c0ce1c0 con 0x7f454c151df0 2023-10-25T16:20:41.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4533fff640 1 -- 172.21.15.177:0/2504386258 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16559 (secure 0 0 0) 0x7f454c0ce1c0 con 0x7f454c151df0 2023-10-25T16:20:41.686 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:41.687 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":146,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:32.695867+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:41.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45380664a0 msgr2=0x7f4538068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45380664a0 0x7f4538068960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f453c005fd0 tx=0x7f453c005e60 comp rx=0 tx=0).stop 2023-10-25T16:20:41.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 msgr2=0x7f454c0c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 0x7f454c0c7780 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f454000c700 tx=0x7f454000cbc0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 shutdown_connections 2023-10-25T16:20:41.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45380664a0 0x7f4538068960 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f454c1ef830 0x7f454c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c151df0 0x7f454c0c7780 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 --2- 172.21.15.177:0/2504386258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4534005190 0x7f454c14e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 >> 172.21.15.177:0/2504386258 conn(0x7f454c0983a0 msgr2=0x7f454c0ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:41.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 shutdown_connections 2023-10-25T16:20:41.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.687+0000 7f4551ed5640 1 -- 172.21.15.177:0/2504386258 wait complete. 2023-10-25T16:20:41.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:19:52.021145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:19:52.759535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:20:41.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:20:41.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- 172.21.15.177:0/3276533873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fc8003980 msgr2=0x7f2fc8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3276533873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fc8003980 0x7f2fc8003da0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8005fd0 tx=0x7f2fd801cd10 comp rx=0 tx=0).stop 2023-10-25T16:20:41.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe181a640 1 -- 172.21.15.177:0/3276533873 reap_dead start 2023-10-25T16:20:41.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- 172.21.15.177:0/3276533873 shutdown_connections 2023-10-25T16:20:41.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- 172.21.15.177:0/3276533873 >> 172.21.15.177:0/3276533873 conn(0x7f2fdc0b2450 msgr2=0x7f2fdc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:41.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- 172.21.15.177:0/3276533873 shutdown_connections 2023-10-25T16:20:41.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- 172.21.15.177:0/3276533873 wait complete. 2023-10-25T16:20:41.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 Processor -- start 2023-10-25T16:20:41.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- start start 2023-10-25T16:20:41.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc8003980 0x7f2fdc141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 0x7f2fdc157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fdc158ea0 0x7f2fdc159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc1583d0 con 0x7f2fdc157a10 2023-10-25T16:20:41.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0aac20 con 0x7f2fc8003980 2023-10-25T16:20:41.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe327d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc159c70 con 0x7f2fdc158ea0 2023-10-25T16:20:41.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe0818640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 0x7f2fdc157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe0818640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 0x7f2fdc157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51426/0 (socket says 172.21.15.177:51426) 2023-10-25T16:20:41.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe0818640 1 -- 172.21.15.177:0/3177087252 learned_addr learned my addr 172.21.15.177:0/3177087252 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:41.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.843+0000 7f2fe1019640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc8003980 0x7f2fdc141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe0818640 1 -- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fdc158ea0 msgr2=0x7f2fdc159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe181a640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fdc158ea0 0x7f2fdc159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe0818640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fdc158ea0 0x7f2fdc159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe0818640 1 -- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc8003980 msgr2=0x7f2fdc141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:41.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe0818640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc8003980 0x7f2fdc141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:41.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe0818640 1 -- 172.21.15.177:0/3177087252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc159f50 con 0x7f2fdc157a10 2023-10-25T16:20:41.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe1019640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc8003980 0x7f2fdc141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:41.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe0818640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 0x7f2fdc157e90 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00d920 tx=0x7f2fcc00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:41.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0063a0 con 0x7f2fdc157a10 2023-10-25T16:20:41.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2fcc00b890 con 0x7f2fdc157a10 2023-10-25T16:20:41.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc15a230 con 0x7f2fdc157a10 2023-10-25T16:20:41.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00bca0 con 0x7f2fdc157a10 2023-10-25T16:20:41.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc141cd0 con 0x7f2fdc157a10 2023-10-25T16:20:41.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc0aadb0 con 0x7f2fdc157a10 2023-10-25T16:20:41.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2fcc003600 con 0x7f2fdc157a10 2023-10-25T16:20:41.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fd1ffb640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fc0066470 0x7f2fc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:41.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fcc084fe0 con 0x7f2fdc157a10 2023-10-25T16:20:41.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.847+0000 7f2fe1019640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fc0066470 0x7f2fc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:41.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.851+0000 7f2fe1019640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fc0066470 0x7f2fc0068930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80b0000 tx=0x7f2fd8019ab0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:41.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:41.851+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fcc052480 con 0x7f2fdc157a10 2023-10-25T16:20:42.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.007+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fdc04daf0 con 0x7f2fdc157a10 2023-10-25T16:20:42.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.007+0000 7f2fd1ffb640 1 -- 172.21.15.177:0/3177087252 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v146) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fcc0140a0 con 0x7f2fdc157a10 2023-10-25T16:20:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:20:42.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fc0066470 msgr2=0x7f2fc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fc0066470 0x7f2fc0068930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80b0000 tx=0x7f2fd8019ab0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 msgr2=0x7f2fdc157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 0x7f2fdc157e90 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00d920 tx=0x7f2fcc00dde0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 shutdown_connections 2023-10-25T16:20:42.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2fc0066470 0x7f2fc0068930 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fdc158ea0 0x7f2fdc159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fdc157a10 0x7f2fdc157e90 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 --2- 172.21.15.177:0/3177087252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc8003980 0x7f2fdc141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 >> 172.21.15.177:0/3177087252 conn(0x7f2fdc0b2450 msgr2=0x7f2fdc0cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 shutdown_connections 2023-10-25T16:20:42.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.011+0000 7f2fe327d640 1 -- 172.21.15.177:0/3177087252 wait complete. 2023-10-25T16:20:42.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:20:42.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- 172.21.15.177:0/1789869142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0cdb10 msgr2=0x7fa99c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 --2- 172.21.15.177:0/1789869142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0cdb10 0x7fa99c0cdfc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa994009c80 tx=0x7fa99401ccf0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- 172.21.15.177:0/1789869142 shutdown_connections 2023-10-25T16:20:42.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 --2- 172.21.15.177:0/1789869142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0cdb10 0x7fa99c0cdfc0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 --2- 172.21.15.177:0/1789869142 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99c0b2120 0x7fa99c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- 172.21.15.177:0/1789869142 >> 172.21.15.177:0/1789869142 conn(0x7fa99c09a5c0 msgr2=0x7fa99c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- 172.21.15.177:0/1789869142 shutdown_connections 2023-10-25T16:20:42.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- 172.21.15.177:0/1789869142 wait complete. 2023-10-25T16:20:42.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 Processor -- start 2023-10-25T16:20:42.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- start start 2023-10-25T16:20:42.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0b2120 0x7fa99c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99c0cdb10 0x7fa99c150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 0x7fa99c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c150550 con 0x7fa99c15eba0 2023-10-25T16:20:42.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c9500 con 0x7fa99c0b2120 2023-10-25T16:20:42.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a4641640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c88f0 con 0x7fa99c0cdb10 2023-10-25T16:20:42.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 0x7fa99c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 0x7fa99c1564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51430/0 (socket says 172.21.15.177:51430) 2023-10-25T16:20:42.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 -- 172.21.15.177:0/465245970 learned_addr learned my addr 172.21.15.177:0/465245970 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:42.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a23dd640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0b2120 0x7fa99c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a1bdc640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99c0cdb10 0x7fa99c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 -- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99c0cdb10 msgr2=0x7fa99c150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99c0cdb10 0x7fa99c150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 -- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0b2120 msgr2=0x7fa99c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.163+0000 7fa9a2bde640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0b2120 0x7fa99c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a2bde640 1 -- 172.21.15.177:0/465245970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9940098e0 con 0x7fa99c15eba0 2023-10-25T16:20:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a2bde640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 0x7fa99c1564e0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa99401a920 tx=0x7fa9940093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:42.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9940a5b40 con 0x7fa99c15eba0 2023-10-25T16:20:42.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa994003c80 con 0x7fa99c15eba0 2023-10-25T16:20:42.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c0c8bd0 con 0x7fa99c15eba0 2023-10-25T16:20:42.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994004290 con 0x7fa99c15eba0 2023-10-25T16:20:42.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c0c9190 con 0x7fa99c15eba0 2023-10-25T16:20:42.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c1506e0 con 0x7fa99c15eba0 2023-10-25T16:20:42.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9940b4040 con 0x7fa99c15eba0 2023-10-25T16:20:42.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa992ffd640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa980066470 0x7fa980068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa99411e4b0 con 0x7fa99c15eba0 2023-10-25T16:20:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a23dd640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa980066470 0x7fa980068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.167+0000 7fa9a23dd640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa980066470 0x7fa980068930 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa99c153150 tx=0x7fa998009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:42.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.171+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa99c1506e0 con 0x7fa99c15eba0 2023-10-25T16:20:42.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.327+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa99c1506e0 con 0x7fa99c15eba0 2023-10-25T16:20:42.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.327+0000 7fa992ffd640 1 -- 172.21.15.177:0/465245970 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa99c1506e0 con 0x7fa99c15eba0 2023-10-25T16:20:42.327 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:20:42.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa980066470 msgr2=0x7fa980068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa980066470 0x7fa980068930 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa99c153150 tx=0x7fa998009040 comp rx=0 tx=0).stop 2023-10-25T16:20:42.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 msgr2=0x7fa99c1564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 0x7fa99c1564e0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fa99401a920 tx=0x7fa9940093b0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 shutdown_connections 2023-10-25T16:20:42.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa980066470 0x7fa980068930 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa99c15eba0 0x7fa99c1564e0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99c0cdb10 0x7fa99c150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 --2- 172.21.15.177:0/465245970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa99c0b2120 0x7fa99c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 >> 172.21.15.177:0/465245970 conn(0x7fa99c09a5c0 msgr2=0x7fa99c0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 shutdown_connections 2023-10-25T16:20:42.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.331+0000 7fa9a4641640 1 -- 172.21.15.177:0/465245970 wait complete. 2023-10-25T16:20:42.345 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:20:42.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 -- 172.21.15.177:0/1083921944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 msgr2=0x7f27f0165f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 --2- 172.21.15.177:0/1083921944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f0165f80 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009840 tx=0x7f27e801c790 comp rx=0 tx=0).stop 2023-10-25T16:20:42.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 -- 172.21.15.177:0/1083921944 shutdown_connections 2023-10-25T16:20:42.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 --2- 172.21.15.177:0/1083921944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f0165f80 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 -- 172.21.15.177:0/1083921944 >> 172.21.15.177:0/1083921944 conn(0x7f27f009a570 msgr2=0x7f27f00d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 -- 172.21.15.177:0/1083921944 shutdown_connections 2023-10-25T16:20:42.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 -- 172.21.15.177:0/1083921944 wait complete. 2023-10-25T16:20:42.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.475+0000 7f27f4f97640 1 Processor -- start 2023-10-25T16:20:42.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- start start 2023-10-25T16:20:42.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27f00cff00 0x7f27f0154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f015b3a0 0x7f27f0154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00ca590 con 0x7f27f00ce1a0 2023-10-25T16:20:42.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00c9910 con 0x7f27f015b3a0 2023-10-25T16:20:42.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00c9bf0 con 0x7f27f00cff00 2023-10-25T16:20:42.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f00ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51442/0 (socket says 172.21.15.177:51442) 2023-10-25T16:20:42.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 -- 172.21.15.177:0/2473712727 learned_addr learned my addr 172.21.15.177:0/2473712727 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:42.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 -- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27f00cff00 msgr2=0x7f27f0154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27f00cff00 0x7f27f0154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 -- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f015b3a0 msgr2=0x7f27f0154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27eed9d640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f015b3a0 0x7f27f0154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f015b3a0 0x7f27f0154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 -- 172.21.15.177:0/2473712727 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80094a0 con 0x7f27f00ce1a0 2023-10-25T16:20:42.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27ee59c640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f00ca9b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f27e000cb50 tx=0x7f27e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:42.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000aa50 con 0x7f27f00ce1a0 2023-10-25T16:20:42.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27e000ce90 con 0x7f27f00ce1a0 2023-10-25T16:20:42.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00c9ed0 con 0x7f27f00ce1a0 2023-10-25T16:20:42.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0012420 con 0x7f27f00ce1a0 2023-10-25T16:20:42.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00c9480 con 0x7f27f00ce1a0 2023-10-25T16:20:42.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f00c96d0 con 0x7f27f00ce1a0 2023-10-25T16:20:42.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27e0012580 con 0x7f27f00ce1a0 2023-10-25T16:20:42.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27e6ffd640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27d0066470 0x7f27d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27e0084220 con 0x7f27f00ce1a0 2023-10-25T16:20:42.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.479+0000 7f27edd9b640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27d0066470 0x7f27d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.483+0000 7f27edd9b640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27d0066470 0x7f27d0068930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f27f00c79c0 tx=0x7f27d80079c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:42.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.483+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27f00c96d0 con 0x7f27f00ce1a0 2023-10-25T16:20:42.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.635+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27f00c96d0 con 0x7f27f00ce1a0 2023-10-25T16:20:42.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27e6ffd640 1 -- 172.21.15.177:0/2473712727 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27f00c96d0 con 0x7f27f00ce1a0 2023-10-25T16:20:42.637 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:20:42.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27d0066470 msgr2=0x7f27d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27d0066470 0x7f27d0068930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f27f00c79c0 tx=0x7f27d80079c0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 msgr2=0x7f27f00ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f00ca9b0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f27e000cb50 tx=0x7f27e000cc40 comp rx=0 tx=0).stop 2023-10-25T16:20:42.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 shutdown_connections 2023-10-25T16:20:42.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f27d0066470 0x7f27d0068930 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27f015b3a0 0x7f27f0154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27f00cff00 0x7f27f0154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 --2- 172.21.15.177:0/2473712727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27f00ce1a0 0x7f27f00ca9b0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 >> 172.21.15.177:0/2473712727 conn(0x7f27f009a570 msgr2=0x7f27f00b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 shutdown_connections 2023-10-25T16:20:42.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.639+0000 7f27f4f97640 1 -- 172.21.15.177:0/2473712727 wait complete. 2023-10-25T16:20:42.656 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:42.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- 172.21.15.177:0/4223125132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3600039b0 msgr2=0x7fe360003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 --2- 172.21.15.177:0/4223125132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3600039b0 0x7fe360003dd0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe370009e30 tx=0x7fe37001d150 comp rx=0 tx=0).stop 2023-10-25T16:20:42.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e881640 1 -- 172.21.15.177:0/4223125132 reap_dead start 2023-10-25T16:20:42.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- 172.21.15.177:0/4223125132 shutdown_connections 2023-10-25T16:20:42.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- 172.21.15.177:0/4223125132 >> 172.21.15.177:0/4223125132 conn(0x7fe37809a5c0 msgr2=0x7fe3780d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- 172.21.15.177:0/4223125132 shutdown_connections 2023-10-25T16:20:42.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- 172.21.15.177:0/4223125132 wait complete. 2023-10-25T16:20:42.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 Processor -- start 2023-10-25T16:20:42.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- start start 2023-10-25T16:20:42.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 0x7fe37815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3780cb190 0x7fe37806a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37806a880 0x7fe37815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37806ad30 con 0x7fe378147710 2023-10-25T16:20:42.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37815d0c0 con 0x7fe37806a880 2023-10-25T16:20:42.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe3802e4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37815d3a0 con 0x7fe3780cb190 2023-10-25T16:20:42.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 0x7fe37815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 0x7fe37815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51452/0 (socket says 172.21.15.177:51452) 2023-10-25T16:20:42.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 -- 172.21.15.177:0/1552939236 learned_addr learned my addr 172.21.15.177:0/1552939236 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:42.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e881640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37806a880 0x7fe37815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37d87f640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3780cb190 0x7fe37806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 -- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3780cb190 msgr2=0x7fe37806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3780cb190 0x7fe37806a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 -- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37806a880 msgr2=0x7fe37815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37806a880 0x7fe37815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 -- 172.21.15.177:0/1552939236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780d0330 con 0x7fe378147710 2023-10-25T16:20:42.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.795+0000 7fe37e080640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 0x7fe37815c770 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe370009e30 tx=0x7fe370005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:42.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370003b80 con 0x7fe378147710 2023-10-25T16:20:42.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe370003dd0 con 0x7fe378147710 2023-10-25T16:20:42.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37815d680 con 0x7fe378147710 2023-10-25T16:20:42.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370005550 con 0x7fe378147710 2023-10-25T16:20:42.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37815dc40 con 0x7fe378147710 2023-10-25T16:20:42.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37804daf0 con 0x7fe378147710 2023-10-25T16:20:42.807 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3700b3070 con 0x7fe378147710 2023-10-25T16:20:42.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe3640664a0 0x7fe364068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:42.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe37011e590 con 0x7fe378147710 2023-10-25T16:20:42.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fe36406dfd0 con 0x7fe378147710 2023-10-25T16:20:42.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe37d87f640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe3640664a0 0x7fe364068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:42.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.799+0000 7fe37d87f640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe3640664a0 0x7fe364068960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe3780cb5d0 tx=0x7fe36c0013c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:42.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.803+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3700b1060 con 0x7fe378147710 2023-10-25T16:20:42.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.991+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3780ce930 con 0x7fe378147710 2023-10-25T16:20:42.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.991+0000 7fe376ffd640 1 -- 172.21.15.177:0/1552939236 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fe3700b1070 con 0x7fe378147710 2023-10-25T16:20:42.992 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:42.992 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:42.993 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe3640664a0 msgr2=0x7fe364068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe3640664a0 0x7fe364068960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe3780cb5d0 tx=0x7fe36c0013c0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 msgr2=0x7fe37815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 0x7fe37815c770 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe370009e30 tx=0x7fe370005040 comp rx=0 tx=0).stop 2023-10-25T16:20:42.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 shutdown_connections 2023-10-25T16:20:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe3640664a0 0x7fe364068960 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe37806a880 0x7fe37815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3780cb190 0x7fe37806a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 --2- 172.21.15.177:0/1552939236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe378147710 0x7fe37815c770 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:42.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 >> 172.21.15.177:0/1552939236 conn(0x7fe37809a5c0 msgr2=0x7fe37815f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:42.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 shutdown_connections 2023-10-25T16:20:42.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:42.995+0000 7fe3802e4640 1 -- 172.21.15.177:0/1552939236 wait complete. 2023-10-25T16:20:43.011 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:43.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- 172.21.15.177:0/577679636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c069e30 msgr2=0x7efc0c142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 --2- 172.21.15.177:0/577679636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c069e30 0x7efc0c142510 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7efc00009840 tx=0x7efc0001c7c0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- 172.21.15.177:0/577679636 shutdown_connections 2023-10-25T16:20:43.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 --2- 172.21.15.177:0/577679636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c069e30 0x7efc0c142510 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- 172.21.15.177:0/577679636 >> 172.21.15.177:0/577679636 conn(0x7efc0c0ce000 msgr2=0x7efc0c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:43.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- 172.21.15.177:0/577679636 shutdown_connections 2023-10-25T16:20:43.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- 172.21.15.177:0/577679636 wait complete. 2023-10-25T16:20:43.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 Processor -- start 2023-10-25T16:20:43.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- start start 2023-10-25T16:20:43.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc0c069e30 0x7efc0c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 0x7efc0c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc0c142ba0 0x7efc0c15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c135890 con 0x7efc0c142130 2023-10-25T16:20:43.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c15ac00 con 0x7efc0c142ba0 2023-10-25T16:20:43.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc1116c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0c1355b0 con 0x7efc0c069e30 2023-10-25T16:20:43.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 0x7efc0c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 0x7efc0c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51466/0 (socket says 172.21.15.177:51466) 2023-10-25T16:20:43.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 -- 172.21.15.177:0/1422536821 learned_addr learned my addr 172.21.15.177:0/1422536821 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:43.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 -- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc0c069e30 msgr2=0x7efc0c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc0c069e30 0x7efc0c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 -- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc0c142ba0 msgr2=0x7efc0c15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0b59e640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc0c142ba0 0x7efc0c15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc0c142ba0 0x7efc0c15cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 -- 172.21.15.177:0/1422536821 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000094a0 con 0x7efc0c142130 2023-10-25T16:20:43.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.131+0000 7efc0a59c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 0x7efc0c15b6a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7efc0001cca0 tx=0x7efc000a5850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:43.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000053c0 con 0x7efc0c142130 2023-10-25T16:20:43.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efc00005610 con 0x7efc0c142130 2023-10-25T16:20:43.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0c15aea0 con 0x7efc0c142130 2023-10-25T16:20:43.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00004930 con 0x7efc0c142130 2023-10-25T16:20:43.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0c15bbe0 con 0x7efc0c142130 2023-10-25T16:20:43.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0c15aa60 con 0x7efc0c142130 2023-10-25T16:20:43.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc00004a90 con 0x7efc0c142130 2023-10-25T16:20:43.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efbf8066470 0x7efbf8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc0011ebd0 con 0x7efc0c142130 2023-10-25T16:20:43.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7efbf806dfa0 con 0x7efc0c142130 2023-10-25T16:20:43.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efc0ad9d640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efbf8066470 0x7efbf8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.135+0000 7efc0ad9d640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efbf8066470 0x7efbf8068930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efbfc007fd0 tx=0x7efbfc007920 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:43.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.139+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc000bb060 con 0x7efc0c142130 2023-10-25T16:20:43.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.291+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc0c04daf0 con 0x7efc0c142130 2023-10-25T16:20:43.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efbf37fe640 1 -- 172.21.15.177:0/1422536821 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+16578 (secure 0 0 0) 0x7efc000b2020 con 0x7efc0c142130 2023-10-25T16:20:43.293 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:43.293 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":147,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:42.699213+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:43.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efbf8066470 msgr2=0x7efbf8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efbf8066470 0x7efbf8068930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efbfc007fd0 tx=0x7efbfc007920 comp rx=0 tx=0).stop 2023-10-25T16:20:43.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 msgr2=0x7efc0c15b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 0x7efc0c15b6a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7efc0001cca0 tx=0x7efc000a5850 comp rx=0 tx=0).stop 2023-10-25T16:20:43.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 shutdown_connections 2023-10-25T16:20:43.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7efbf8066470 0x7efbf8068930 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc0c142ba0 0x7efc0c15cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc0c142130 0x7efc0c15b6a0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 --2- 172.21.15.177:0/1422536821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc0c069e30 0x7efc0c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 >> 172.21.15.177:0/1422536821 conn(0x7efc0c0ce000 msgr2=0x7efc0c069720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:43.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 shutdown_connections 2023-10-25T16:20:43.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.295+0000 7efc1116c640 1 -- 172.21.15.177:0/1422536821 wait complete. 2023-10-25T16:20:43.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:20:43.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:43.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/3838695660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a40cdb10 msgr2=0x7ff2a40cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/3838695660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a40cdb10 0x7ff2a40cdfc0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009c80 tx=0x7ff29c01ccb0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/3838695660 shutdown_connections 2023-10-25T16:20:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/3838695660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a40cdb10 0x7ff2a40cdfc0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/3838695660 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2a415eba0 0x7ff2a40b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/3838695660 >> 172.21.15.177:0/3838695660 conn(0x7ff2a409a5c0 msgr2=0x7ff2a40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:43.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/3838695660 shutdown_connections 2023-10-25T16:20:43.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/3838695660 wait complete. 2023-10-25T16:20:43.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 Processor -- start 2023-10-25T16:20:43.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- start start 2023-10-25T16:20:43.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2a40b2120 0x7ff2a414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2a40cdb10 0x7ff2a40b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 0x7ff2a4150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40b5fe0 con 0x7ff2a415eba0 2023-10-25T16:20:43.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4158a00 con 0x7ff2a40cdb10 2023-10-25T16:20:43.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4158ce0 con 0x7ff2a40b2120 2023-10-25T16:20:43.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 0x7ff2a4150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 0x7ff2a4150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51486/0 (socket says 172.21.15.177:51486) 2023-10-25T16:20:43.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 -- 172.21.15.177:0/4065810541 learned_addr learned my addr 172.21.15.177:0/4065810541 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:43.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a3fff640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2a40b2120 0x7ff2a414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff29b7fe640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2a40cdb10 0x7ff2a40b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 -- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2a40b2120 msgr2=0x7ff2a414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2a40b2120 0x7ff2a414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.431 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 -- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2a40cdb10 msgr2=0x7ff2a40b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2a40cdb10 0x7ff2a40b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 -- 172.21.15.177:0/4065810541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0098e0 con 0x7ff2a415eba0 2023-10-25T16:20:43.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a8975640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 0x7ff2a4150f80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009bd0 tx=0x7ff29c0a5960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:43.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004e60 con 0x7ff2a415eba0 2023-10-25T16:20:43.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff29c004000 con 0x7ff2a415eba0 2023-10-25T16:20:43.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a4158fc0 con 0x7ff2a415eba0 2023-10-25T16:20:43.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004410 con 0x7ff2a415eba0 2023-10-25T16:20:43.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.427+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a40b6560 con 0x7ff2a415eba0 2023-10-25T16:20:43.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a41591b0 con 0x7ff2a415eba0 2023-10-25T16:20:43.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff29c0b4040 con 0x7ff2a415eba0 2023-10-25T16:20:43.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2a17fa640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff284066470 0x7ff284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff29c11e300 con 0x7ff2a415eba0 2023-10-25T16:20:43.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7ff28406dfa0 con 0x7ff2a415eba0 2023-10-25T16:20:43.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2a3fff640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff284066470 0x7ff284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.431+0000 7ff2a3fff640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff284066470 0x7ff284068930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff2940058d0 tx=0x7ff294005d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:43.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.435+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff29c0b2060 con 0x7ff2a415eba0 2023-10-25T16:20:43.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.607+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2a40b6750 con 0x7ff2a415eba0 2023-10-25T16:20:43.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2a17fa640 1 -- 172.21.15.177:0/4065810541 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7ff29c0bc020 con 0x7ff2a415eba0 2023-10-25T16:20:43.609 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:43.609 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:43.609 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:43.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff284066470 msgr2=0x7ff284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff284066470 0x7ff284068930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff2940058d0 tx=0x7ff294005d90 comp rx=0 tx=0).stop 2023-10-25T16:20:43.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 msgr2=0x7ff2a4150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 0x7ff2a4150f80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009bd0 tx=0x7ff29c0a5960 comp rx=0 tx=0).stop 2023-10-25T16:20:43.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 shutdown_connections 2023-10-25T16:20:43.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff284066470 0x7ff284068930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2a415eba0 0x7ff2a4150f80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2a40cdb10 0x7ff2a40b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 --2- 172.21.15.177:0/4065810541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2a40b2120 0x7ff2a414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 >> 172.21.15.177:0/4065810541 conn(0x7ff2a409a5c0 msgr2=0x7ff2a40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:43.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 shutdown_connections 2023-10-25T16:20:43.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.611+0000 7ff2aa3d8640 1 -- 172.21.15.177:0/4065810541 wait complete. 2023-10-25T16:20:43.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:43.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 -- 172.21.15.177:0/1594981771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 msgr2=0x7fc7a80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/1594981771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80b4100 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fc798009900 tx=0x7fc79801c7f0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 -- 172.21.15.177:0/1594981771 shutdown_connections 2023-10-25T16:20:43.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/1594981771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80b2120 0x7fc7a80d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/1594981771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80b4100 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 -- 172.21.15.177:0/1594981771 >> 172.21.15.177:0/1594981771 conn(0x7fc7a809a5c0 msgr2=0x7fc7a80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:43.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 -- 172.21.15.177:0/1594981771 shutdown_connections 2023-10-25T16:20:43.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.739+0000 7fc7ad10e640 1 -- 172.21.15.177:0/1594981771 wait complete. 2023-10-25T16:20:43.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 Processor -- start 2023-10-25T16:20:43.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- start start 2023-10-25T16:20:43.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80b2120 0x7fc7a81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80cdb10 0x7fc7a8153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8151bf0 con 0x7fc7a815eba0 2023-10-25T16:20:43.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c4c60 con 0x7fc7a80b2120 2023-10-25T16:20:43.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80c5ac0 con 0x7fc7a80cdb10 2023-10-25T16:20:43.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51516/0 (socket says 172.21.15.177:51516) 2023-10-25T16:20:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 -- 172.21.15.177:0/2991842423 learned_addr learned my addr 172.21.15.177:0/2991842423 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a659c640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80cdb10 0x7fc7a8153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a6d9d640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80b2120 0x7fc7a81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 -- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80cdb10 msgr2=0x7fc7a8153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80cdb10 0x7fc7a8153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 -- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80b2120 msgr2=0x7fc7a81516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80b2120 0x7fc7a81516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 -- 172.21.15.177:0/2991842423 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798009560 con 0x7fc7a815eba0 2023-10-25T16:20:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a659c640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80cdb10 0x7fc7a8153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a6d9d640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80b2120 0x7fc7a81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:43.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7a759e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80ca550 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c7b0 tx=0x7fc7a000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0003d90 con 0x7fc7a815eba0 2023-10-25T16:20:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc7a0005070 con 0x7fc7a815eba0 2023-10-25T16:20:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a80c4eb0 con 0x7fc7a815eba0 2023-10-25T16:20:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0005480 con 0x7fc7a815eba0 2023-10-25T16:20:43.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a80c5470 con 0x7fc7a815eba0 2023-10-25T16:20:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a804daf0 con 0x7fc7a815eba0 2023-10-25T16:20:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.743+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7a00055e0 con 0x7fc7a815eba0 2023-10-25T16:20:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.747+0000 7fc78f7fe640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7940664a0 0x7fc794068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:43.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.747+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7a0083ca0 con 0x7fc7a815eba0 2023-10-25T16:20:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.747+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fc79406dfd0 con 0x7fc7a815eba0 2023-10-25T16:20:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.747+0000 7fc7a6d9d640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7940664a0 0x7fc794068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.747+0000 7fc7a6d9d640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7940664a0 0x7fc794068960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc7980ae000 tx=0x7fc79801b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:43.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.747+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7a0017020 con 0x7fc7a815eba0 2023-10-25T16:20:43.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.919+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7a80c5c00 con 0x7fc7a815eba0 2023-10-25T16:20:43.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc78f7fe640 1 -- 172.21.15.177:0/2991842423 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4933 (secure 0 0 0) 0x7fc7a0051200 con 0x7fc7a815eba0 2023-10-25T16:20:43.922 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:43.923 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:19:53.749743+0000","modified":"2023-10-25T16:19:56.046743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155741},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155741":{"gid":155741,"name":"b","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/3822415207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3822415207},{"type":"v1","addr":"172.21.15.184:6837","nonce":3822415207}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-10-25T16:20:43.924 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 51 2023-10-25T16:20:43.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7940664a0 msgr2=0x7fc794068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7940664a0 0x7fc794068960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc7980ae000 tx=0x7fc79801b030 comp rx=0 tx=0).stop 2023-10-25T16:20:43.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 msgr2=0x7fc7a80ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:43.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80ca550 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c7b0 tx=0x7fc7a000cc70 comp rx=0 tx=0).stop 2023-10-25T16:20:43.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 shutdown_connections 2023-10-25T16:20:43.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc7940664a0 0x7fc794068960 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a815eba0 0x7fc7a80ca550 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7a80cdb10 0x7fc7a8153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 --2- 172.21.15.177:0/2991842423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7a80b2120 0x7fc7a81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:43.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 >> 172.21.15.177:0/2991842423 conn(0x7fc7a809a5c0 msgr2=0x7fc7a80b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:43.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 shutdown_connections 2023-10-25T16:20:43.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:43.923+0000 7fc7ad10e640 1 -- 172.21.15.177:0/2991842423 wait complete. 2023-10-25T16:20:43.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:44.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e8246640 1 -- 172.21.15.177:0/636752007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 msgr2=0x7fb7cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e8246640 1 --2- 172.21.15.177:0/636752007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7cc005190 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c260 tx=0x7fb7d801cfc0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e67e3640 1 -- 172.21.15.177:0/636752007 reap_dead start 2023-10-25T16:20:44.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e8246640 1 -- 172.21.15.177:0/636752007 shutdown_connections 2023-10-25T16:20:44.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e8246640 1 -- 172.21.15.177:0/636752007 >> 172.21.15.177:0/636752007 conn(0x7fb7e00af5b0 msgr2=0x7fb7e00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:44.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e8246640 1 -- 172.21.15.177:0/636752007 shutdown_connections 2023-10-25T16:20:44.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.063+0000 7fb7e8246640 1 -- 172.21.15.177:0/636752007 wait complete. 2023-10-25T16:20:44.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 Processor -- start 2023-10-25T16:20:44.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- start start 2023-10-25T16:20:44.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7e0158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e014a550 0x7fb7e00a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e01e1d00 0x7fb7e01499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00a8830 con 0x7fb7cc004d10 2023-10-25T16:20:44.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00a8990 con 0x7fb7e01e1d00 2023-10-25T16:20:44.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00a8be0 con 0x7fb7e014a550 2023-10-25T16:20:44.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7e0158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7e0158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51532/0 (socket says 172.21.15.177:51532) 2023-10-25T16:20:44.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 -- 172.21.15.177:0/205966263 learned_addr learned my addr 172.21.15.177:0/205966263 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:44.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e57e1640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e014a550 0x7fb7e00a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e67e3640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e01e1d00 0x7fb7e01499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 -- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e014a550 msgr2=0x7fb7e00a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e014a550 0x7fb7e00a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 -- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e01e1d00 msgr2=0x7fb7e01499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e01e1d00 0x7fb7e01499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 -- 172.21.15.177:0/205966263 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e00a8ec0 con 0x7fb7cc004d10 2023-10-25T16:20:44.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e67e3640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e01e1d00 0x7fb7e01499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:44.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e5fe2640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7e0158380 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0018b0 tx=0x7fb7dc001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:44.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc00e970 con 0x7fb7cc004d10 2023-10-25T16:20:44.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb7dc00ebc0 con 0x7fb7cc004d10 2023-10-25T16:20:44.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00a91a0 con 0x7fb7cc004d10 2023-10-25T16:20:44.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc011460 con 0x7fb7cc004d10 2023-10-25T16:20:44.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00a9760 con 0x7fb7cc004d10 2023-10-25T16:20:44.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e004daf0 con 0x7fb7cc004d10 2023-10-25T16:20:44.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.067+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7dc0115c0 con 0x7fb7cc004d10 2023-10-25T16:20:44.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.071+0000 7fb7d67fc640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7c4066470 0x7fb7c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.071+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7dc084b30 con 0x7fb7cc004d10 2023-10-25T16:20:44.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.071+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7fb7c406dfa0 con 0x7fb7cc004d10 2023-10-25T16:20:44.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.071+0000 7fb7e57e1640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7c4066470 0x7fb7c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.071+0000 7fb7e57e1640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7c4066470 0x7fb7c4068930 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0157e60 tx=0x7fb7d00091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:44.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.075+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7dc015060 con 0x7fb7cc004d10 2023-10-25T16:20:44.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.231+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7e00acac0 con 0x7fb7cc004d10 2023-10-25T16:20:44.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.231+0000 7fb7d67fc640 1 -- 172.21.15.177:0/205966263 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+16578 (secure 0 0 0) 0x7fb7dc01f030 con 0x7fb7cc004d10 2023-10-25T16:20:44.231 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:44.231 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":147,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:42.699213+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:19:52.021145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-25T16:19:52.759535+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:44.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7c4066470 msgr2=0x7fb7c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7c4066470 0x7fb7c4068930 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0157e60 tx=0x7fb7d00091e0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 msgr2=0x7fb7e0158380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7e0158380 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0018b0 tx=0x7fb7dc001cb0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 shutdown_connections 2023-10-25T16:20:44.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7c4066470 0x7fb7c4068930 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7e01e1d00 0x7fb7e01499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7e014a550 0x7fb7e00a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 --2- 172.21.15.177:0/205966263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7cc004d10 0x7fb7e0158380 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 >> 172.21.15.177:0/205966263 conn(0x7fb7e00af5b0 msgr2=0x7fb7e0070580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:44.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 shutdown_connections 2023-10-25T16:20:44.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.235+0000 7fb7e8246640 1 -- 172.21.15.177:0/205966263 wait complete. 2023-10-25T16:20:44.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:20:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 -- 172.21.15.177:0/664424204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 msgr2=0x7f3de4071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 --2- 172.21.15.177:0/664424204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de4071500 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009930 tx=0x7f3ddc01c850 comp rx=0 tx=0).stop 2023-10-25T16:20:44.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 -- 172.21.15.177:0/664424204 shutdown_connections 2023-10-25T16:20:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 --2- 172.21.15.177:0/664424204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3de4070510 0x7f3de40cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 --2- 172.21.15.177:0/664424204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de4071500 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 -- 172.21.15.177:0/664424204 >> 172.21.15.177:0/664424204 conn(0x7f3de40b2450 msgr2=0x7f3de40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:44.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 -- 172.21.15.177:0/664424204 shutdown_connections 2023-10-25T16:20:44.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.363+0000 7f3dec726640 1 -- 172.21.15.177:0/664424204 wait complete. 2023-10-25T16:20:44.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 Processor -- start 2023-10-25T16:20:44.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- start start 2023-10-25T16:20:44.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3de4070510 0x7f3de414ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3de40cc610 0x7f3de41f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de41f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.370 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de41537d0 con 0x7f3de4159230 2023-10-25T16:20:44.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40af8f0 con 0x7f3de4070510 2023-10-25T16:20:44.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4153a20 con 0x7f3de40cc610 2023-10-25T16:20:44.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de41f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de41f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51554/0 (socket says 172.21.15.177:51554) 2023-10-25T16:20:44.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 -- 172.21.15.177:0/3014033363 learned_addr learned my addr 172.21.15.177:0/3014033363 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:44.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3de9cc1640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3de40cc610 0x7f3de41f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dea4c2640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3de4070510 0x7f3de414ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 -- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3de40cc610 msgr2=0x7f3de41f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3de40cc610 0x7f3de41f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 -- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3de4070510 msgr2=0x7f3de414ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3de4070510 0x7f3de414ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009560 con 0x7f3de4159230 2023-10-25T16:20:44.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dea4c2640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3de4070510 0x7f3de414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:44.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3deacc3640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de41f5e20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c780 tx=0x7f3de000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:44.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004b70 con 0x7f3de4159230 2023-10-25T16:20:44.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3de000ce90 con 0x7f3de4159230 2023-10-25T16:20:44.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de4153d00 con 0x7f3de4159230 2023-10-25T16:20:44.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000aab0 con 0x7f3de4159230 2023-10-25T16:20:44.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de414f120 con 0x7f3de4159230 2023-10-25T16:20:44.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4153f40 con 0x7f3de4159230 2023-10-25T16:20:44.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.367+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3de000ac10 con 0x7f3de4159230 2023-10-25T16:20:44.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.371+0000 7f3ddaffd640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dc8066470 0x7f3dc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.371+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de00842e0 con 0x7f3de4159230 2023-10-25T16:20:44.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.371+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=148}) v3 -- 0x7f3dc806dfa0 con 0x7f3de4159230 2023-10-25T16:20:44.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.371+0000 7f3dea4c2640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dc8066470 0x7f3dc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.371+0000 7f3dea4c2640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dc8066470 0x7f3dc8068930 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0af000 tx=0x7f3ddc01b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:44.377 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.375+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3de4153f40 con 0x7f3de4159230 2023-10-25T16:20:44.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.543+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3de4153f40 con 0x7f3de4159230 2023-10-25T16:20:44.543 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:20:44.543+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:20:44.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.547+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3de4153f40 con 0x7f3de4159230 2023-10-25T16:20:44.547 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:20:44.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(148..148 src has 1..148) v4 ==== 374+0+0 (secure 0 0 0) 0x7f3de0055b20 con 0x7f3de4159230 2023-10-25T16:20:44.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3ddaffd640 1 -- 172.21.15.177:0/3014033363 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f3dc806e9a0 con 0x7f3de4159230 2023-10-25T16:20:44.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dc8066470 msgr2=0x7f3dc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dc8066470 0x7f3dc8068930 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0af000 tx=0x7f3ddc01b090 comp rx=0 tx=0).stop 2023-10-25T16:20:44.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 msgr2=0x7f3de41f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de41f5e20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c780 tx=0x7f3de000cc40 comp rx=0 tx=0).stop 2023-10-25T16:20:44.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 shutdown_connections 2023-10-25T16:20:44.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3dc8066470 0x7f3dc8068930 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de4159230 0x7f3de41f5e20 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3de40cc610 0x7f3de41f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 --2- 172.21.15.177:0/3014033363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3de4070510 0x7f3de414ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 >> 172.21.15.177:0/3014033363 conn(0x7f3de40b2450 msgr2=0x7f3de41571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:44.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 shutdown_connections 2023-10-25T16:20:44.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.551+0000 7f3dec726640 1 -- 172.21.15.177:0/3014033363 wait complete. 2023-10-25T16:20:44.567 INFO:tasks.ceph.mds.b.smithi184.stderr: -8157> 2023-10-25T16:19:56.378+0000 7f8cc4671640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:20:44.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:20:44.637 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:20:44.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 -- 172.21.15.177:0/2041244297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0071500 msgr2=0x7f77b0070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 --2- 172.21.15.177:0/2041244297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0071500 0x7f77b0070510 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f77a4005fd0 tx=0x7f77a401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 -- 172.21.15.177:0/2041244297 shutdown_connections 2023-10-25T16:20:44.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 --2- 172.21.15.177:0/2041244297 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77b006b980 0x7f77b006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 --2- 172.21.15.177:0/2041244297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0071500 0x7f77b0070510 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 -- 172.21.15.177:0/2041244297 >> 172.21.15.177:0/2041244297 conn(0x7f77b00b2450 msgr2=0x7f77b00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:44.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 -- 172.21.15.177:0/2041244297 shutdown_connections 2023-10-25T16:20:44.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.695+0000 7f77b58b4640 1 -- 172.21.15.177:0/2041244297 wait complete. 2023-10-25T16:20:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 Processor -- start 2023-10-25T16:20:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- start start 2023-10-25T16:20:44.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77b006b980 0x7f77b0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77b0071500 0x7f77b00c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 0x7f77b0148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01495b0 con 0x7f77b0159230 2023-10-25T16:20:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0151560 con 0x7f77b0071500 2023-10-25T16:20:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0151800 con 0x7f77b006b980 2023-10-25T16:20:44.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 0x7f77b0148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 0x7f77b0148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51580/0 (socket says 172.21.15.177:51580) 2023-10-25T16:20:44.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 -- 172.21.15.177:0/3106642471 learned_addr learned my addr 172.21.15.177:0/3106642471 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:44.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77aeffd640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77b006b980 0x7f77b0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77ae7fc640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77b0071500 0x7f77b00c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 -- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77b006b980 msgr2=0x7f77b0157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77b006b980 0x7f77b0157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 -- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77b0071500 msgr2=0x7f77b00c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:44.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77b0071500 0x7f77b00c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:44.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 -- 172.21.15.177:0/3106642471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009450 con 0x7f77b0159230 2023-10-25T16:20:44.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77af7fe640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 0x7f77b0148270 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f77a800eb20 tx=0x7f77a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8004b30 con 0x7f77b0159230 2023-10-25T16:20:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77a8004cb0 con 0x7f77b0159230 2023-10-25T16:20:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b0151ae0 con 0x7f77b0159230 2023-10-25T16:20:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8005280 con 0x7f77b0159230 2023-10-25T16:20:44.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b0158070 con 0x7f77b0159230 2023-10-25T16:20:44.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.699+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b0152000 con 0x7f77b0159230 2023-10-25T16:20:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.703+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77a80053e0 con 0x7f77b0159230 2023-10-25T16:20:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.703+0000 7f7797fff640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f779c0664a0 0x7f779c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.703+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f77a8014070 con 0x7f77b0159230 2023-10-25T16:20:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.703+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7f779c06e0e0 con 0x7f77b0159230 2023-10-25T16:20:44.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.703+0000 7f77aeffd640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f779c0664a0 0x7f779c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:44.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.703+0000 7f77aeffd640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f779c0664a0 0x7f779c068960 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f77a00015e0 tx=0x7f77a0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:44.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.707+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77b0152000 con 0x7f77b0159230 2023-10-25T16:20:44.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:44.895+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77b0152000 con 0x7f77b0159230 2023-10-25T16:20:45.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.559+0000 7f7797fff640 1 -- 172.21.15.177:0/3106642471 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77b0152000 con 0x7f77b0159230 2023-10-25T16:20:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f779c0664a0 msgr2=0x7f779c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f779c0664a0 0x7f779c068960 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f77a00015e0 tx=0x7f77a0009040 comp rx=0 tx=0).stop 2023-10-25T16:20:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 msgr2=0x7f77b0148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 0x7f77b0148270 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f77a800eb20 tx=0x7f77a800c2d0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 shutdown_connections 2023-10-25T16:20:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f779c0664a0 0x7f779c068960 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77b0159230 0x7f77b0148270 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77b0071500 0x7f77b00c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 --2- 172.21.15.177:0/3106642471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77b006b980 0x7f77b0157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 >> 172.21.15.177:0/3106642471 conn(0x7f77b00b2450 msgr2=0x7f77b0152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:45.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 shutdown_connections 2023-10-25T16:20:45.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.563+0000 7f77b58b4640 1 -- 172.21.15.177:0/3106642471 wait complete. 2023-10-25T16:20:45.587 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:20:45.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.719+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/2134200951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8070c80 msgr2=0x7fc6d80cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:45.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.719+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/2134200951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8070c80 0x7fc6d80cb860 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8071320 tx=0x7fc6d001ccf0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.719+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/2134200951 shutdown_connections 2023-10-25T16:20:45.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.719+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/2134200951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d8070c80 0x7fc6d80cb860 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.719+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/2134200951 >> v2:172.21.15.184:3300/0 conn(0x7fc6d8141a40 0x7fc6d815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.719+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/2134200951 >> 172.21.15.177:0/2134200951 conn(0x7fc6d80cdf80 msgr2=0x7fc6d80ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:45.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/2134200951 shutdown_connections 2023-10-25T16:20:45.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/2134200951 wait complete. 2023-10-25T16:20:45.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 Processor -- start 2023-10-25T16:20:45.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- start start 2023-10-25T16:20:45.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 0x7fc6d813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:45.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070c80 0x7fc6d813e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:45.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8141a40 0x7fc6d80aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:45.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d8154da0 con 0x7fc6d806dce0 2023-10-25T16:20:45.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d81547e0 con 0x7fc6d8141a40 2023-10-25T16:20:45.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d8154ac0 con 0x7fc6d8070c80 2023-10-25T16:20:45.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 0x7fc6d813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:45.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 0x7fc6d813acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51606/0 (socket says 172.21.15.177:51606) 2023-10-25T16:20:45.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 -- 172.21.15.177:0/1975822541 learned_addr learned my addr 172.21.15.177:0/1975822541 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:45.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6cffff640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070c80 0x7fc6d813e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:45.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d6d9d640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8141a40 0x7fc6d80aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:45.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 -- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070c80 msgr2=0x7fc6d813e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:45.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070c80 0x7fc6d813e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 -- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8141a40 msgr2=0x7fc6d80aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:45.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8141a40 0x7fc6d80aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:45.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d00098e0 con 0x7fc6d806dce0 2023-10-25T16:20:45.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6d659c640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 0x7fc6d813acf0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b410 tx=0x7fc6c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:45.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8011830 con 0x7fc6d806dce0 2023-10-25T16:20:45.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc6c8011a80 con 0x7fc6d806dce0 2023-10-25T16:20:45.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d80ae5c0 con 0x7fc6d806dce0 2023-10-25T16:20:45.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8011e90 con 0x7fc6d806dce0 2023-10-25T16:20:45.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.723+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d813b230 con 0x7fc6d806dce0 2023-10-25T16:20:45.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80ae7b0 con 0x7fc6d806dce0 2023-10-25T16:20:45.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6c801a400 con 0x7fc6d806dce0 2023-10-25T16:20:45.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6ceffd640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b8066470 0x7fc6b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:45.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc6c8084290 con 0x7fc6d806dce0 2023-10-25T16:20:45.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=149}) v3 -- 0x7fc6b806e0b0 con 0x7fc6d806dce0 2023-10-25T16:20:45.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6cffff640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b8066470 0x7fc6b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:45.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.727+0000 7fc6cffff640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b8066470 0x7fc6b8068930 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8140f80 tx=0x7fc6c0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:45.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.731+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6c8015060 con 0x7fc6d806dce0 2023-10-25T16:20:45.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:45.887+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6d8073360 con 0x7fc6d806dce0 2023-10-25T16:20:46.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.563+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v149) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc6c80551f0 con 0x7fc6d806dce0 2023-10-25T16:20:46.562 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:20:46.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.563+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(149..149 src has 1..149) v4 ==== 296+0+0 (secure 0 0 0) 0x7fc6c80840c0 con 0x7fc6d806dce0 2023-10-25T16:20:46.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.563+0000 7fc6ceffd640 1 -- 172.21.15.177:0/1975822541 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7fc6b806c4e0 con 0x7fc6d806dce0 2023-10-25T16:20:46.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b8066470 msgr2=0x7fc6b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:46.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b8066470 0x7fc6b8068930 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8140f80 tx=0x7fc6c0009040 comp rx=0 tx=0).stop 2023-10-25T16:20:46.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 msgr2=0x7fc6d813acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 0x7fc6d813acf0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b410 tx=0x7fc6c800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 shutdown_connections 2023-10-25T16:20:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc6b8066470 0x7fc6b8068930 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d8141a40 0x7fc6d80aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc6d8070c80 0x7fc6d813e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 --2- 172.21.15.177:0/1975822541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc6d806dce0 0x7fc6d813acf0 secure :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b410 tx=0x7fc6c800b8d0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 >> 172.21.15.177:0/1975822541 conn(0x7fc6d80cdf80 msgr2=0x7fc6d8157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:46.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 shutdown_connections 2023-10-25T16:20:46.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.575+0000 7fc6dcfa0640 1 -- 172.21.15.177:0/1975822541 wait complete. 2023-10-25T16:20:46.596 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:20:46.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- 172.21.15.177:0/2254364759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 msgr2=0x7f63dc1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:46.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 --2- 172.21.15.177:0/2254364759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc1589a0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009870 tx=0x7f63cc01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- 172.21.15.177:0/2254364759 shutdown_connections 2023-10-25T16:20:46.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 --2- 172.21.15.177:0/2254364759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63dc0cd1c0 0x7f63dc0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 --2- 172.21.15.177:0/2254364759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc1589a0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- 172.21.15.177:0/2254364759 >> 172.21.15.177:0/2254364759 conn(0x7f63dc069920 msgr2=0x7f63dc069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:46.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- 172.21.15.177:0/2254364759 shutdown_connections 2023-10-25T16:20:46.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- 172.21.15.177:0/2254364759 wait complete. 2023-10-25T16:20:46.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 Processor -- start 2023-10-25T16:20:46.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- start start 2023-10-25T16:20:46.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63dc0cd1c0 0x7f63dc06d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:46.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc0ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:46.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc14bd50 0x7f63dc06bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:46.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0aba80 con 0x7f63dc14f2f0 2023-10-25T16:20:46.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0ac270 con 0x7f63dc14bd50 2023-10-25T16:20:46.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63e0c33640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc0b03d0 con 0x7f63dc0cd1c0 2023-10-25T16:20:46.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc0ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:46.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc0ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51624/0 (socket says 172.21.15.177:51624) 2023-10-25T16:20:46.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 -- 172.21.15.177:0/1102239386 learned_addr learned my addr 172.21.15.177:0/1102239386 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:46.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63da59c640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63dc0cd1c0 0x7f63dc06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:46.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 -- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63dc0cd1c0 msgr2=0x7f63dc06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:46.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63dc0cd1c0 0x7f63dc06d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63dad9d640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc14bd50 0x7f63dc06bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:46.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 -- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc14bd50 msgr2=0x7f63dc06bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:46.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc14bd50 0x7f63dc06bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:46.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0094a0 con 0x7f63dc14f2f0 2023-10-25T16:20:46.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63dad9d640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc14bd50 0x7f63dc06bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:46.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.731+0000 7f63d9d9b640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc0ab540 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f63d000c3d0 tx=0x7f63d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:46.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011790 con 0x7f63dc14f2f0 2023-10-25T16:20:46.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc0abcb0 con 0x7f63dc14f2f0 2023-10-25T16:20:46.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f63d0011a00 con 0x7f63dc14f2f0 2023-10-25T16:20:46.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0011e10 con 0x7f63dc14f2f0 2023-10-25T16:20:46.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc0b0060 con 0x7f63dc14f2f0 2023-10-25T16:20:46.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc073360 con 0x7f63dc14f2f0 2023-10-25T16:20:46.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f63d001c460 con 0x7f63dc14f2f0 2023-10-25T16:20:46.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f63bc0664a0 0x7f63bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:46.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f63d0083da0 con 0x7f63dc14f2f0 2023-10-25T16:20:46.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=150}) v3 -- 0x7f63bc06d270 con 0x7f63dc14f2f0 2023-10-25T16:20:46.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63da59c640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f63bc0664a0 0x7f63bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:46.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.735+0000 7f63da59c640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f63bc0664a0 0x7f63bc068960 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0af000 tx=0x7f63cc01b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:46.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.739+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63d0051390 con 0x7f63dc14f2f0 2023-10-25T16:20:46.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:46.895+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f63dc0b0510 con 0x7f63dc14f2f0 2023-10-25T16:20:47.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.575+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v150) v1 ==== 169+0+0 (secure 0 0 0) 0x7f63d00549b0 con 0x7f63dc14f2f0 2023-10-25T16:20:47.573 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:20:47.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.575+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(150..150 src has 1..150) v4 ==== 296+0+0 (secure 0 0 0) 0x7f63d000e280 con 0x7f63dc14f2f0 2023-10-25T16:20:47.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.575+0000 7f63caffd640 1 -- 172.21.15.177:0/1102239386 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=151}) v3 -- 0x7f63bc06c000 con 0x7f63dc14f2f0 2023-10-25T16:20:47.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.583+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f63bc0664a0 msgr2=0x7f63bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.583+0000 7f63e0c33640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f63bc0664a0 0x7f63bc068960 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0af000 tx=0x7f63cc01b010 comp rx=0 tx=0).stop 2023-10-25T16:20:47.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.583+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 msgr2=0x7f63dc0ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.583+0000 7f63e0c33640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc0ab540 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f63d000c3d0 tx=0x7f63d000c890 comp rx=0 tx=0).stop 2023-10-25T16:20:47.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 shutdown_connections 2023-10-25T16:20:47.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f63bc0664a0 0x7f63bc068960 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc14bd50 0x7f63dc06bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63dc14f2f0 0x7f63dc0ab540 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 --2- 172.21.15.177:0/1102239386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63dc0cd1c0 0x7f63dc06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 >> 172.21.15.177:0/1102239386 conn(0x7f63dc069920 msgr2=0x7f63dc156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:47.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 shutdown_connections 2023-10-25T16:20:47.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.587+0000 7f63e0c33640 1 -- 172.21.15.177:0/1102239386 wait complete. 2023-10-25T16:20:47.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:20:47.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 -- 172.21.15.177:0/3444364404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3100039b0 msgr2=0x7fc310003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 --2- 172.21.15.177:0/3444364404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3100039b0 0x7fc310003dd0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc328070ac0 tx=0x7fc31801cc10 comp rx=0 tx=0).stop 2023-10-25T16:20:47.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32d70d640 1 -- 172.21.15.177:0/3444364404 reap_dead start 2023-10-25T16:20:47.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 -- 172.21.15.177:0/3444364404 shutdown_connections 2023-10-25T16:20:47.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 -- 172.21.15.177:0/3444364404 >> 172.21.15.177:0/3444364404 conn(0x7fc3280b0b30 msgr2=0x7fc3280b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:47.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 -- 172.21.15.177:0/3444364404 shutdown_connections 2023-10-25T16:20:47.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 -- 172.21.15.177:0/3444364404 wait complete. 2023-10-25T16:20:47.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.735+0000 7fc32f170640 1 Processor -- start 2023-10-25T16:20:47.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- start start 2023-10-25T16:20:47.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100039b0 0x7fc3281494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:47.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 0x7fc3280cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:47.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc328154000 0x7fc328154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:47.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328154d30 con 0x7fc3280cbc10 2023-10-25T16:20:47.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280cc5d0 con 0x7fc328154000 2023-10-25T16:20:47.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281525b0 con 0x7fc3100039b0 2023-10-25T16:20:47.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 0x7fc3280cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:47.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 0x7fc3280cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51638/0 (socket says 172.21.15.177:51638) 2023-10-25T16:20:47.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 -- 172.21.15.177:0/1996869988 learned_addr learned my addr 172.21.15.177:0/1996869988 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:47.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32cf0c640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100039b0 0x7fc3281494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:47.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32d70d640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc328154000 0x7fc328154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:47.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 -- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100039b0 msgr2=0x7fc3281494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100039b0 0x7fc3281494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 -- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc328154000 msgr2=0x7fc328154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc328154000 0x7fc328154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 -- 172.21.15.177:0/1996869988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328151c80 con 0x7fc3280cbc10 2023-10-25T16:20:47.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc327fff640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 0x7fc3280cc090 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006fd0 tx=0x7fc31c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:47.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c011870 con 0x7fc3280cbc10 2023-10-25T16:20:47.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc31c011ac0 con 0x7fc3280cbc10 2023-10-25T16:20:47.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc328151f60 con 0x7fc3280cbc10 2023-10-25T16:20:47.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c001d50 con 0x7fc3280cbc10 2023-10-25T16:20:47.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328152a40 con 0x7fc3280cbc10 2023-10-25T16:20:47.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc328152760 con 0x7fc3280cbc10 2023-10-25T16:20:47.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc31c01a400 con 0x7fc3280cbc10 2023-10-25T16:20:47.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc3257fa640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3140664a0 0x7fc314068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:47.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc31c084810 con 0x7fc3280cbc10 2023-10-25T16:20:47.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.739+0000 7fc32cf0c640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3140664a0 0x7fc314068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:47.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.743+0000 7fc32cf0c640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3140664a0 0x7fc314068960 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc3180b0000 tx=0x7fc3180a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:47.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.743+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc328152760 con 0x7fc3280cbc10 2023-10-25T16:20:47.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.899+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7fc328152720 con 0x7fc3280cbc10 2023-10-25T16:20:47.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc3257fa640 1 -- 172.21.15.177:0/1996869988 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v32) v1 ==== 71+0+0 (secure 0 0 0) 0x7fc31c052020 con 0x7fc3280cbc10 2023-10-25T16:20:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3140664a0 msgr2=0x7fc314068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3140664a0 0x7fc314068960 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc3180b0000 tx=0x7fc3180a7040 comp rx=0 tx=0).stop 2023-10-25T16:20:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 msgr2=0x7fc3280cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:47.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 0x7fc3280cc090 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fc31c006fd0 tx=0x7fc31c001640 comp rx=0 tx=0).stop 2023-10-25T16:20:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 shutdown_connections 2023-10-25T16:20:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc3140664a0 0x7fc314068960 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc328154000 0x7fc328154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3280cbc10 0x7fc3280cc090 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 --2- 172.21.15.177:0/1996869988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3100039b0 0x7fc3281494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 >> 172.21.15.177:0/1996869988 conn(0x7fc3280b0b30 msgr2=0x7fc32806d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 shutdown_connections 2023-10-25T16:20:47.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:47.907+0000 7fc32f170640 1 -- 172.21.15.177:0/1996869988 wait complete. 2023-10-25T16:20:47.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-10-25T16:20:48.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/4030637104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6494003980 msgr2=0x7f6494003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 --2- 172.21.15.177:0/4030637104 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6494003980 0x7f6494003da0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f649c00c260 tx=0x7f649c01cfb0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 -- 172.21.15.177:0/4030637104 reap_dead start 2023-10-25T16:20:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/4030637104 shutdown_connections 2023-10-25T16:20:48.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/4030637104 >> 172.21.15.177:0/4030637104 conn(0x7f64ac0b2450 msgr2=0x7f64ac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:48.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/4030637104 shutdown_connections 2023-10-25T16:20:48.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/4030637104 wait complete. 2023-10-25T16:20:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 Processor -- start 2023-10-25T16:20:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- start start 2023-10-25T16:20:48.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6494003980 0x7f64ac13d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64ac0afcf0 0x7f64ac1642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 0x7f64ac164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac15d500 con 0x7f64ac0b0170 2023-10-25T16:20:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac15ccf0 con 0x7f64ac0afcf0 2023-10-25T16:20:48.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac13d760 con 0x7f6494003980 2023-10-25T16:20:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 0x7f64ac164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 0x7f64ac164830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51664/0 (socket says 172.21.15.177:51664) 2023-10-25T16:20:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 -- 172.21.15.177:0/2759722266 learned_addr learned my addr 172.21.15.177:0/2759722266 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:48.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b0dce640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6494003980 0x7f64ac13d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64abfff640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64ac0afcf0 0x7f64ac1642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 -- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6494003980 msgr2=0x7f64ac13d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6494003980 0x7f64ac13d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 -- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64ac0afcf0 msgr2=0x7f64ac1642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64ac0afcf0 0x7f64ac1642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 -- 172.21.15.177:0/2759722266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac15fbf0 con 0x7f64ac0b0170 2023-10-25T16:20:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64abfff640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64ac0afcf0 0x7f64ac1642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:20:48.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b15cf640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 0x7f64ac164830 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b2400 tx=0x7f64a400fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4004d30 con 0x7f64ac0b0170 2023-10-25T16:20:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64a400daa0 con 0x7f64ac0b0170 2023-10-25T16:20:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac15cf40 con 0x7f64ac0b0170 2023-10-25T16:20:48.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400de90 con 0x7f64ac0b0170 2023-10-25T16:20:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.047+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac13dc00 con 0x7f64ac0b0170 2023-10-25T16:20:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.051+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac13da60 con 0x7f64ac0b0170 2023-10-25T16:20:48.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.051+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64a4011440 con 0x7f64ac0b0170 2023-10-25T16:20:48.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.051+0000 7f64a97fa640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6498066470 0x7f6498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.051+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f64a40838b0 con 0x7f64ac0b0170 2023-10-25T16:20:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.051+0000 7f64b0dce640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6498066470 0x7f6498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.051+0000 7f64b0dce640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6498066470 0x7f6498068930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f649c0ab000 tx=0x7f649c019d50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:48.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.055+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64ac13da60 con 0x7f64ac0b0170 2023-10-25T16:20:48.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.263+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f64ac13da60 con 0x7f64ac0b0170 2023-10-25T16:20:48.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64a97fa640 1 -- 172.21.15.177:0/2759722266 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v402) v1 ==== 140+0+0 (secure 0 0 0) 0x7f64ac13da60 con 0x7f64ac0b0170 2023-10-25T16:20:48.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6498066470 msgr2=0x7f6498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6498066470 0x7f6498068930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f649c0ab000 tx=0x7f649c019d50 comp rx=0 tx=0).stop 2023-10-25T16:20:48.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 msgr2=0x7f64ac164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 0x7f64ac164830 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b2400 tx=0x7f64a400fd90 comp rx=0 tx=0).stop 2023-10-25T16:20:48.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 shutdown_connections 2023-10-25T16:20:48.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6498066470 0x7f6498068930 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64ac0b0170 0x7f64ac164830 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64ac0afcf0 0x7f64ac1642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 --2- 172.21.15.177:0/2759722266 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6494003980 0x7f64ac13d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 >> 172.21.15.177:0/2759722266 conn(0x7f64ac0b2450 msgr2=0x7f64ac153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:48.581 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 shutdown_connections 2023-10-25T16:20:48.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.579+0000 7f64b3032640 1 -- 172.21.15.177:0/2759722266 wait complete. 2023-10-25T16:20:48.599 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-25T16:20:48.599 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-10-25T16:20:48.600 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:48.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/1508584981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b0003980 msgr2=0x7ff7b0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/1508584981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b0003980 0x7ff7b0003da0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc001ec0 tx=0x7ff7bc01cf80 comp rx=0 tx=0).stop 2023-10-25T16:20:48.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/1508584981 shutdown_connections 2023-10-25T16:20:48.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/1508584981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7b0003980 0x7ff7b0003da0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/1508584981 >> 172.21.15.177:0/1508584981 conn(0x7ff7c809a5c0 msgr2=0x7ff7c80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:48.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/1508584981 shutdown_connections 2023-10-25T16:20:48.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/1508584981 wait complete. 2023-10-25T16:20:48.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 Processor -- start 2023-10-25T16:20:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- start start 2023-10-25T16:20:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b0003980 0x7ff7c80c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c80c9b20 0x7ff7c81f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 0x7ff7c80ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c8151f80 con 0x7ff7c8151810 2023-10-25T16:20:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80c8a80 con 0x7ff7b0003980 2023-10-25T16:20:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80c8d60 con 0x7ff7c80c9b20 2023-10-25T16:20:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 0x7ff7c80ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 0x7ff7c80ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51692/0 (socket says 172.21.15.177:51692) 2023-10-25T16:20:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 -- 172.21.15.177:0/2396339296 learned_addr learned my addr 172.21.15.177:0/2396339296 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c77fe640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b0003980 0x7ff7c80c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c6ffd640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c80c9b20 0x7ff7c81f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 -- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c80c9b20 msgr2=0x7ff7c81f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c80c9b20 0x7ff7c81f85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 -- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b0003980 msgr2=0x7ff7c80c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b0003980 0x7ff7c80c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 -- 172.21.15.177:0/2396339296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80c9040 con 0x7ff7c8151810 2023-10-25T16:20:48.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7c7fff640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 0x7ff7c80ca500 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff7c806a0b0 tx=0x7ff7c000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:48.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0003980 con 0x7ff7c8151810 2023-10-25T16:20:48.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff7c0003ae0 con 0x7ff7c8151810 2023-10-25T16:20:48.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80c9320 con 0x7ff7c8151810 2023-10-25T16:20:48.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0005030 con 0x7ff7c8151810 2023-10-25T16:20:48.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.719+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c81f8ae0 con 0x7ff7c8151810 2023-10-25T16:20:48.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.723+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c804daf0 con 0x7ff7c8151810 2023-10-25T16:20:48.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.723+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff7c0005190 con 0x7ff7c8151810 2023-10-25T16:20:48.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.723+0000 7ff7affff640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7b4066470 0x7ff7b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:48.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.723+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff7c0083520 con 0x7ff7c8151810 2023-10-25T16:20:48.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.723+0000 7ff7c77fe640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7b4066470 0x7ff7b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.723+0000 7ff7c77fe640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7b4066470 0x7ff7b4068930 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0ac000 tx=0x7ff7bc019d20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:48.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.727+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7c0050ca0 con 0x7ff7c8151810 2023-10-25T16:20:48.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.879+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7c80d02a0 con 0x7ff7c8151810 2023-10-25T16:20:48.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.879+0000 7ff7affff640 1 -- 172.21.15.177:0/2396339296 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+13023 (secure 0 0 0) 0x7ff7c0018020 con 0x7ff7c8151810 2023-10-25T16:20:48.879 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:48.879 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":150,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:47.566877+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6837/3822415207":"2023-10-26T16:20:44.548386+0000","172.21.15.184:6835/3822415207":"2023-10-26T16:20:44.548386+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:48.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7b4066470 msgr2=0x7ff7b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7b4066470 0x7ff7b4068930 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0ac000 tx=0x7ff7bc019d20 comp rx=0 tx=0).stop 2023-10-25T16:20:48.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 msgr2=0x7ff7c80ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:48.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 0x7ff7c80ca500 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7ff7c806a0b0 tx=0x7ff7c000dc10 comp rx=0 tx=0).stop 2023-10-25T16:20:48.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 shutdown_connections 2023-10-25T16:20:48.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff7b4066470 0x7ff7b4068930 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7c8151810 0x7ff7c80ca500 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7c80c9b20 0x7ff7c81f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 --2- 172.21.15.177:0/2396339296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7b0003980 0x7ff7c80c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:48.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 >> 172.21.15.177:0/2396339296 conn(0x7ff7c809a5c0 msgr2=0x7ff7c815c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:48.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 shutdown_connections 2023-10-25T16:20:48.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:48.883+0000 7ff7ce1cb640 1 -- 172.21.15.177:0/2396339296 wait complete. 2023-10-25T16:20:48.896 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:20:48.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:20:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.019+0000 7f29de43e640 1 -- 172.21.15.177:0/3745597264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d80c9e50 msgr2=0x7f29d806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.019+0000 7f29de43e640 1 --2- 172.21.15.177:0/3745597264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d80c9e50 0x7f29d806b9e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f29d80ccde0 tx=0x7f29c001c7c0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.019+0000 7f29de43e640 1 -- 172.21.15.177:0/3745597264 shutdown_connections 2023-10-25T16:20:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.019+0000 7f29de43e640 1 --2- 172.21.15.177:0/3745597264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d80c9e50 0x7f29d806b9e0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.019+0000 7f29de43e640 1 --2- 172.21.15.177:0/3745597264 >> v2:172.21.15.184:3300/0 conn(0x7f29d81500f0 0x7f29d80c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- 172.21.15.177:0/3745597264 >> 172.21.15.177:0/3745597264 conn(0x7f29d80b2450 msgr2=0x7f29d80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- 172.21.15.177:0/3745597264 shutdown_connections 2023-10-25T16:20:49.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- 172.21.15.177:0/3745597264 wait complete. 2023-10-25T16:20:49.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 Processor -- start 2023-10-25T16:20:49.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- start start 2023-10-25T16:20:49.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d806bf20 0x7f29d80ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d80c9e50 0x7f29d80cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 0x7f29d8149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80ade80 con 0x7f29d81500f0 2023-10-25T16:20:49.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8155d90 con 0x7f29d806bf20 2023-10-25T16:20:49.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8156070 con 0x7f29d80c9e50 2023-10-25T16:20:49.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 0x7f29d8149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 0x7f29d8149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51710/0 (socket says 172.21.15.177:51710) 2023-10-25T16:20:49.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 -- 172.21.15.177:0/977392063 learned_addr learned my addr 172.21.15.177:0/977392063 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:49.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29d7fff640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d806bf20 0x7f29d80ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29cf7fe640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d80c9e50 0x7f29d80cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 -- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d80c9e50 msgr2=0x7f29d80cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d80c9e50 0x7f29d80cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 -- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d806bf20 msgr2=0x7f29d80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d806bf20 0x7f29d80ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 -- 172.21.15.177:0/977392063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0009500 con 0x7f29d81500f0 2023-10-25T16:20:49.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29dc9db640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 0x7f29d8149ac0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c730 tx=0x7f29d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:49.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0003b80 con 0x7f29d81500f0 2023-10-25T16:20:49.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29d0003ce0 con 0x7f29d81500f0 2023-10-25T16:20:49.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8156350 con 0x7f29d81500f0 2023-10-25T16:20:49.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000aa50 con 0x7f29d81500f0 2023-10-25T16:20:49.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d8156910 con 0x7f29d81500f0 2023-10-25T16:20:49.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.023+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8156b00 con 0x7f29d81500f0 2023-10-25T16:20:49.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.027+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f29d000abb0 con 0x7f29d81500f0 2023-10-25T16:20:49.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.027+0000 7f29d57fa640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29b8066470 0x7f29b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.027+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f29d0083aa0 con 0x7f29d81500f0 2023-10-25T16:20:49.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.027+0000 7f29d7fff640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29b8066470 0x7f29b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.027+0000 7f29d7fff640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29b8066470 0x7f29b8068930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29c8005fd0 tx=0x7f29c800a4e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:49.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.031+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29d0051220 con 0x7f29d81500f0 2023-10-25T16:20:49.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29d804daf0 con 0x7f29d81500f0 2023-10-25T16:20:49.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29d57fa640 1 -- 172.21.15.177:0/977392063 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v150) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29d000ae60 con 0x7f29d81500f0 2023-10-25T16:20:49.173 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:20:49.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29b8066470 msgr2=0x7f29b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29b8066470 0x7f29b8068930 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f29c8005fd0 tx=0x7f29c800a4e0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 msgr2=0x7f29d8149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 0x7f29d8149ac0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c730 tx=0x7f29d000cbf0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 shutdown_connections 2023-10-25T16:20:49.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f29b8066470 0x7f29b8068930 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29d81500f0 0x7f29d8149ac0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f29d80c9e50 0x7f29d80cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 --2- 172.21.15.177:0/977392063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f29d806bf20 0x7f29d80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 >> 172.21.15.177:0/977392063 conn(0x7f29d80b2450 msgr2=0x7f29d815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:49.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 shutdown_connections 2023-10-25T16:20:49.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.175+0000 7f29de43e640 1 -- 172.21.15.177:0/977392063 wait complete. 2023-10-25T16:20:49.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-25T16:20:49.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 -- 172.21.15.177:0/259984635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f4159230 msgr2=0x7f39f4071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/259984635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f4159230 0x7f39f4071500 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f39f40ca900 tx=0x7f39e401cd10 comp rx=0 tx=0).stop 2023-10-25T16:20:49.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 -- 172.21.15.177:0/259984635 shutdown_connections 2023-10-25T16:20:49.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/259984635 >> v2:172.21.15.184:3300/0 conn(0x7f39f406b980 0x7f39f406be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/259984635 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f4159230 0x7f39f4071500 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 -- 172.21.15.177:0/259984635 >> 172.21.15.177:0/259984635 conn(0x7f39f40b2450 msgr2=0x7f39f40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:49.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 -- 172.21.15.177:0/259984635 shutdown_connections 2023-10-25T16:20:49.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.315+0000 7f39f8a0e640 1 -- 172.21.15.177:0/259984635 wait complete. 2023-10-25T16:20:49.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 Processor -- start 2023-10-25T16:20:49.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- start start 2023-10-25T16:20:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 0x7f39f40af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39f4070510 0x7f39f40ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39f4159230 0x7f39f41382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4138820 con 0x7f39f406b980 2023-10-25T16:20:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40ae780 con 0x7f39f4070510 2023-10-25T16:20:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40aea20 con 0x7f39f4159230 2023-10-25T16:20:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 0x7f39f40af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 0x7f39f40af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51728/0 (socket says 172.21.15.177:51728) 2023-10-25T16:20:49.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 -- 172.21.15.177:0/2302239760 learned_addr learned my addr 172.21.15.177:0/2302239760 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:49.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 -- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39f4159230 msgr2=0x7f39f41382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39f4159230 0x7f39f41382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 -- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39f4070510 msgr2=0x7f39f40ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39f4070510 0x7f39f40ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 -- 172.21.15.177:0/2302239760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40098e0 con 0x7f39f406b980 2023-10-25T16:20:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f259c640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 0x7f39f40af500 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f39e401c780 tx=0x7f39e4009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40aec80 con 0x7f39f406b980 2023-10-25T16:20:49.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f39e4005040 con 0x7f39f406b980 2023-10-25T16:20:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f40aed00 con 0x7f39f406b980 2023-10-25T16:20:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4005410 con 0x7f39f406b980 2023-10-25T16:20:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f40ad040 con 0x7f39f406b980 2023-10-25T16:20:49.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f404daf0 con 0x7f39f406b980 2023-10-25T16:20:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39e400a040 con 0x7f39f406b980 2023-10-25T16:20:49.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39e2ffd640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39d40664a0 0x7f39d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.319+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f39e411f620 con 0x7f39f406b980 2023-10-25T16:20:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.323+0000 7f39f1d9b640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39d40664a0 0x7f39d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.323+0000 7f39f1d9b640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39d40664a0 0x7f39d4068960 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f39f40cd640 tx=0x7f39e8007850 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:49.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.327+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39e40ece30 con 0x7f39f406b980 2023-10-25T16:20:49.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.531+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f39f40af1b0 con 0x7f39f406b980 2023-10-25T16:20:49.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.587+0000 7f39e2ffd640 1 -- 172.21.15.177:0/2302239760 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v403) v1 ==== 135+0+0 (secure 0 0 0) 0x7f39e40b2070 con 0x7f39f406b980 2023-10-25T16:20:49.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39d40664a0 msgr2=0x7f39d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39d40664a0 0x7f39d4068960 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f39f40cd640 tx=0x7f39e8007850 comp rx=0 tx=0).stop 2023-10-25T16:20:49.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 msgr2=0x7f39f40af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 0x7f39f40af500 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f39e401c780 tx=0x7f39e4009350 comp rx=0 tx=0).stop 2023-10-25T16:20:49.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 shutdown_connections 2023-10-25T16:20:49.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f39d40664a0 0x7f39d4068960 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39f4159230 0x7f39f41382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39f4070510 0x7f39f40ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 --2- 172.21.15.177:0/2302239760 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39f406b980 0x7f39f40af500 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 >> 172.21.15.177:0/2302239760 conn(0x7f39f40b2450 msgr2=0x7f39f4071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:49.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 shutdown_connections 2023-10-25T16:20:49.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.591+0000 7f39f8a0e640 1 -- 172.21.15.177:0/2302239760 wait complete. 2023-10-25T16:20:49.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:20:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/2399481248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 msgr2=0x7f6fe40b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 --2- 172.21.15.177:0/2399481248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40b4100 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009840 tx=0x7f6fd401c730 comp rx=0 tx=0).stop 2023-10-25T16:20:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/2399481248 shutdown_connections 2023-10-25T16:20:49.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 --2- 172.21.15.177:0/2399481248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40b4100 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/2399481248 >> 172.21.15.177:0/2399481248 conn(0x7f6fe409a5c0 msgr2=0x7f6fe40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/2399481248 shutdown_connections 2023-10-25T16:20:49.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/2399481248 wait complete. 2023-10-25T16:20:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 Processor -- start 2023-10-25T16:20:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- start start 2023-10-25T16:20:49.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe40cdb10 0x7f6fe4149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415eba0 0x7f6fe4149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe406bb80 con 0x7f6fe40b2120 2023-10-25T16:20:49.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe41554b0 con 0x7f6fe40cdb10 2023-10-25T16:20:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe4155790 con 0x7f6fe415eba0 2023-10-25T16:20:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51752/0 (socket says 172.21.15.177:51752) 2023-10-25T16:20:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 -- 172.21.15.177:0/872512459 learned_addr learned my addr 172.21.15.177:0/872512459 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:49.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 -- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415eba0 msgr2=0x7f6fe4149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415eba0 0x7f6fe4149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9729640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe40cdb10 0x7f6fe4149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 -- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe40cdb10 msgr2=0x7f6fe4149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe40cdb10 0x7f6fe4149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 -- 172.21.15.177:0/872512459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40094a0 con 0x7f6fe40b2120 2023-10-25T16:20:49.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fe9f2a640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40c9da0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b410 tx=0x7f6fe000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004020 con 0x7f6fe40b2120 2023-10-25T16:20:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6fe0004270 con 0x7f6fe40b2120 2023-10-25T16:20:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe4155a70 con 0x7f6fe40b2120 2023-10-25T16:20:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0011890 con 0x7f6fe40b2120 2023-10-25T16:20:49.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.727+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe406be60 con 0x7f6fe40b2120 2023-10-25T16:20:49.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.731+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe404daf0 con 0x7f6fe40b2120 2023-10-25T16:20:49.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.731+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6fe0003600 con 0x7f6fe40b2120 2023-10-25T16:20:49.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.731+0000 7f6fda7fc640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fc8066470 0x7f6fc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:49.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.731+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6fe0083b40 con 0x7f6fe40b2120 2023-10-25T16:20:49.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.731+0000 7f6fe9729640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fc8066470 0x7f6fc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:49.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.731+0000 7f6fe9729640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fc8066470 0x7f6fc8068930 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40af000 tx=0x7f6fd401af70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:49.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.735+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fe0051350 con 0x7f6fe40b2120 2023-10-25T16:20:49.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.879+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f6fe40ce930 con 0x7f6fe40b2120 2023-10-25T16:20:49.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.879+0000 7f6fda7fc640 1 -- 172.21.15.177:0/872512459 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v32) v1 ==== 59+0+1116 (secure 0 0 0) 0x7f6fe0054970 con 0x7f6fe40b2120 2023-10-25T16:20:49.878 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:20:49.878 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:20:49.879 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:20:49.879 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:20:49.879 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:20:49.879 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:20:49.880 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:20:49.880 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:20:49.880 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:20:49.881 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:20:49.881 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:20:49.881 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:20:49.881 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:20:49.881 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:20:49.882 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:20:49.882 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:20:49.882 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:20:49.882 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:20:49.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.879+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fc8066470 msgr2=0x7f6fc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.879+0000 7f6fec18e640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fc8066470 0x7f6fc8068930 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40af000 tx=0x7f6fd401af70 comp rx=0 tx=0).stop 2023-10-25T16:20:49.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.879+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 msgr2=0x7f6fe40c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:49.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.879+0000 7f6fec18e640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40c9da0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000b410 tx=0x7f6fe000b8d0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 shutdown_connections 2023-10-25T16:20:49.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6fc8066470 0x7f6fc8068930 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6fe415eba0 0x7f6fe4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fe40cdb10 0x7f6fe4149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 --2- 172.21.15.177:0/872512459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fe40b2120 0x7f6fe40c9da0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:49.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 >> 172.21.15.177:0/872512459 conn(0x7f6fe409a5c0 msgr2=0x7f6fe40d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:49.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 shutdown_connections 2023-10-25T16:20:49.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:49.883+0000 7f6fec18e640 1 -- 172.21.15.177:0/872512459 wait complete. 2023-10-25T16:20:49.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:20:50.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/479875972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8d0005190 msgr2=0x7ff8d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/479875972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8d0005190 0x7ff8d000b990 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009ee0 tx=0x7ff8d801d610 comp rx=0 tx=0).stop 2023-10-25T16:20:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/479875972 shutdown_connections 2023-10-25T16:20:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/479875972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8d0005190 0x7ff8d000b990 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/479875972 >> 172.21.15.177:0/479875972 conn(0x7ff8e80af5b0 msgr2=0x7ff8e80af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/479875972 shutdown_connections 2023-10-25T16:20:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/479875972 wait complete. 2023-10-25T16:20:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 Processor -- start 2023-10-25T16:20:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- start start 2023-10-25T16:20:50.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8d0005190 0x7ff8e80abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 0x7ff8e8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8e814fd80 0x7ff8e80a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80ac210 con 0x7ff8e814f930 2023-10-25T16:20:50.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e8151c60 con 0x7ff8e814fd80 2023-10-25T16:20:50.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e8150680 con 0x7ff8d0005190 2023-10-25T16:20:50.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 0x7ff8e8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 0x7ff8e8151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:51770/0 (socket says 172.21.15.177:51770) 2023-10-25T16:20:50.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 -- 172.21.15.177:0/1939355578 learned_addr learned my addr 172.21.15.177:0/1939355578 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:50.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e77fe640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8d0005190 0x7ff8e80abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e7fff640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8e814fd80 0x7ff8e80a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 -- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8d0005190 msgr2=0x7ff8e80abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8d0005190 0x7ff8e80abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 -- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8e814fd80 msgr2=0x7ff8e80a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8e814fd80 0x7ff8e80a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 -- 172.21.15.177:0/1939355578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8150960 con 0x7ff8e814f930 2023-10-25T16:20:50.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e7fff640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8e814fd80 0x7ff8e80a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:20:50.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8e6ffd640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 0x7ff8e8151720 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00d410 tx=0x7ff8dc00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:50.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc011590 con 0x7ff8e814f930 2023-10-25T16:20:50.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff8dc0116f0 con 0x7ff8e814f930 2023-10-25T16:20:50.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e8150c40 con 0x7ff8e814f930 2023-10-25T16:20:50.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc011ae0 con 0x7ff8e814f930 2023-10-25T16:20:50.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.027+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e8151200 con 0x7ff8e814f930 2023-10-25T16:20:50.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.031+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e81513c0 con 0x7ff8e814f930 2023-10-25T16:20:50.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.031+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff8dc011c40 con 0x7ff8e814f930 2023-10-25T16:20:50.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.031+0000 7ff8cffff640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff8d4066470 0x7ff8d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.031+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff8dc0839f0 con 0x7ff8e814f930 2023-10-25T16:20:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.031+0000 7ff8e77fe640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff8d4066470 0x7ff8d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.031+0000 7ff8e77fe640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff8d4066470 0x7ff8d4068930 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00018f0 tx=0x7ff8e00013c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:50.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.035+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8dc051180 con 0x7ff8e814f930 2023-10-25T16:20:50.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.179+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff8e804daf0 con 0x7ff8e814f930 2023-10-25T16:20:50.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.183+0000 7ff8cffff640 1 -- 172.21.15.177:0/1939355578 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v33)=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8dc0547a0 con 0x7ff8e814f930 2023-10-25T16:20:50.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff8d4066470 msgr2=0x7ff8d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff8d4066470 0x7ff8d4068930 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00018f0 tx=0x7ff8e00013c0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 msgr2=0x7ff8e8151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 0x7ff8e8151720 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00d410 tx=0x7ff8dc00d8d0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 shutdown_connections 2023-10-25T16:20:50.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff8d4066470 0x7ff8d4068930 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8e814fd80 0x7ff8e80a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8e814f930 0x7ff8e8151720 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 --2- 172.21.15.177:0/1939355578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8d0005190 0x7ff8e80abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 >> 172.21.15.177:0/1939355578 conn(0x7ff8e80af5b0 msgr2=0x7ff8e814e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:50.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 shutdown_connections 2023-10-25T16:20:50.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.187+0000 7ff8eda9d640 1 -- 172.21.15.177:0/1939355578 wait complete. 2023-10-25T16:20:50.201 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:20:50.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:20:50.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:20:50.304 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:20:50.304 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:50.305 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:50.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:20:50.310 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:20:50.311 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:50.317 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:20:50.317 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:20:50.318 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:50.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:20:50.359 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:20:50.359 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:20:50.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:20:50.368 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:20:50.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:50.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 -- 172.21.15.177:0/1363449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4980715f0 msgr2=0x7fd498070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 --2- 172.21.15.177:0/1363449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4980715f0 0x7fd498070620 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fd498071a80 tx=0x7fd48801c720 comp rx=0 tx=0).stop 2023-10-25T16:20:50.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 -- 172.21.15.177:0/1363449283 shutdown_connections 2023-10-25T16:20:50.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 --2- 172.21.15.177:0/1363449283 >> v2:172.21.15.184:3300/0 conn(0x7fd498070b60 0x7fd4980b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 --2- 172.21.15.177:0/1363449283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4980715f0 0x7fd498070620 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 -- 172.21.15.177:0/1363449283 >> 172.21.15.177:0/1363449283 conn(0x7fd4980cdf10 msgr2=0x7fd4980ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:50.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 -- 172.21.15.177:0/1363449283 shutdown_connections 2023-10-25T16:20:50.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.527+0000 7fd49f62e640 1 -- 172.21.15.177:0/1363449283 wait complete. 2023-10-25T16:20:50.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 Processor -- start 2023-10-25T16:20:50.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- start start 2023-10-25T16:20:50.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 0x7fd498154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4980715f0 0x7fd49813e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4981581a0 0x7fd49814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49813ed70 con 0x7fd498070b60 2023-10-25T16:20:50.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814fa40 con 0x7fd4981581a0 2023-10-25T16:20:50.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814fd20 con 0x7fd4980715f0 2023-10-25T16:20:50.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 0x7fd498154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 0x7fd498154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37738/0 (socket says 172.21.15.177:37738) 2023-10-25T16:20:50.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 -- 172.21.15.177:0/2671834968 learned_addr learned my addr 172.21.15.177:0/2671834968 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:50.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 -- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4980715f0 msgr2=0x7fd49813e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4980715f0 0x7fd49813e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 -- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4981581a0 msgr2=0x7fd49814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4981581a0 0x7fd49814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 -- 172.21.15.177:0/2671834968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880094a0 con 0x7fd498070b60 2023-10-25T16:20:50.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49d3ca640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 0x7fd498154c90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fd494001ec0 tx=0x7fd49400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:50.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940054e0 con 0x7fd498070b60 2023-10-25T16:20:50.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd494003600 con 0x7fd498070b60 2023-10-25T16:20:50.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd498154490 con 0x7fd498070b60 2023-10-25T16:20:50.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494003a30 con 0x7fd498070b60 2023-10-25T16:20:50.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49814f730 con 0x7fd498070b60 2023-10-25T16:20:50.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49814fee0 con 0x7fd498070b60 2023-10-25T16:20:50.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd494003b90 con 0x7fd498070b60 2023-10-25T16:20:50.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.531+0000 7fd48dffb640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd47c066470 0x7fd47c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.535+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd494083310 con 0x7fd498070b60 2023-10-25T16:20:50.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.535+0000 7fd49cbc9640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd47c066470 0x7fd47c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.535+0000 7fd49cbc9640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd47c066470 0x7fd47c068930 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd4880af000 tx=0x7fd4880194c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:50.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.539+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd494050a90 con 0x7fd498070b60 2023-10-25T16:20:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.723+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd49804daf0 con 0x7fd498070b60 2023-10-25T16:20:50.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd48dffb640 1 -- 172.21.15.177:0/2671834968 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fd4940540b0 con 0x7fd498070b60 2023-10-25T16:20:50.725 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:50.725 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/2413213209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":2413213209},{"type":"v1","addr":"172.21.15.184:6836","nonce":2413213209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3225869391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":3225869391},{"type":"v1","addr":"172.21.15.184:6837","nonce":3225869391}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":8145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/4009380614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4009380614},{"type":"v1","addr":"172.21.15.177:6833","nonce":4009380614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":48},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1283905519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1283905519},{"type":"v1","addr":"172.21.15.177:6835","nonce":1283905519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":47}],"filesystems":[]} 2023-10-25T16:20:50.725 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 53 2023-10-25T16:20:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd47c066470 msgr2=0x7fd47c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd47c066470 0x7fd47c068930 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd4880af000 tx=0x7fd4880194c0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 msgr2=0x7fd498154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 0x7fd498154c90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fd494001ec0 tx=0x7fd49400c8e0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 shutdown_connections 2023-10-25T16:20:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd47c066470 0x7fd47c068930 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4981581a0 0x7fd49814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4980715f0 0x7fd49813e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 --2- 172.21.15.177:0/2671834968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd498070b60 0x7fd498154c90 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 >> 172.21.15.177:0/2671834968 conn(0x7fd4980cdf10 msgr2=0x7fd4980ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:50.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 shutdown_connections 2023-10-25T16:20:50.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.727+0000 7fd49f62e640 1 -- 172.21.15.177:0/2671834968 wait complete. 2023-10-25T16:20:50.744 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:20:50.744 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:20:50.745 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:20:50.745 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:20:50.745 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:20:50.746 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:20:50.746 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:20:50.746 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:20:50.747 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:20:50.747 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:20:50.747 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:20:50.748 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:20:50.748 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:20:50.748 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:20:50.749 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:20:50.749 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:20:50.756 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:20:50.756 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:20:50.757 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:20:50.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:20:50.760 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:20:50.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:20:50.765 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:20:50.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:20:50.801 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:20:50.802 DEBUG:teuthology.parallel:result is None 2023-10-25T16:20:50.803 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:20:50.803 DEBUG:teuthology.parallel:result is None 2023-10-25T16:20:50.810 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:20:50.811 DEBUG:teuthology.parallel:result is None 2023-10-25T16:20:50.812 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:20:50.812 DEBUG:teuthology.parallel:result is None 2023-10-25T16:20:50.813 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:20:50.866 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:20:50.867 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:20:50.880 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:20:50.884 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:20:50.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.927+0000 7fcd39ba3640 1 -- 172.21.15.177:0/3216154116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 msgr2=0x7fcd3406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.927+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/3216154116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd3406be90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fcd24005fd0 tx=0x7fcd2401c780 comp rx=0 tx=0).stop 2023-10-25T16:20:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/3216154116 shutdown_connections 2023-10-25T16:20:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/3216154116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd3406be90 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/3216154116 >> 172.21.15.177:0/3216154116 conn(0x7fcd340b2450 msgr2=0x7fcd340b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/3216154116 shutdown_connections 2023-10-25T16:20:50.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/3216154116 wait complete. 2023-10-25T16:20:50.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 Processor -- start 2023-10-25T16:20:50.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- start start 2023-10-25T16:20:50.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd340abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd340706f0 0x7fcd34148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd341500f0 0x7fcd34147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd341468f0 con 0x7fcd3406b9e0 2023-10-25T16:20:50.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34146bd0 con 0x7fcd341500f0 2023-10-25T16:20:50.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34146eb0 con 0x7fcd340706f0 2023-10-25T16:20:50.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd340abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd340abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37788/0 (socket says 172.21.15.177:37788) 2023-10-25T16:20:50.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 -- 172.21.15.177:0/1315672213 learned_addr learned my addr 172.21.15.177:0/1315672213 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:50.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd33fff640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd341500f0 0x7fcd34147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd32ffd640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd340706f0 0x7fcd34148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 -- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd340706f0 msgr2=0x7fcd34148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd340706f0 0x7fcd34148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 -- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd341500f0 msgr2=0x7fcd34147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:50.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd341500f0 0x7fcd34147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:50.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 -- 172.21.15.177:0/1315672213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24009450 con 0x7fcd3406b9e0 2023-10-25T16:20:50.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd32ffd640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd340706f0 0x7fcd34148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:20:50.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd337fe640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd340abd70 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c4d0 tx=0x7fcd1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:50.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c005480 con 0x7fcd3406b9e0 2023-10-25T16:20:50.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcd1c0036f0 con 0x7fcd3406b9e0 2023-10-25T16:20:50.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3415a6b0 con 0x7fcd3406b9e0 2023-10-25T16:20:50.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c003b00 con 0x7fcd3406b9e0 2023-10-25T16:20:50.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd34147470 con 0x7fcd3406b9e0 2023-10-25T16:20:50.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.931+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3404daf0 con 0x7fcd3406b9e0 2023-10-25T16:20:50.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.935+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd1c003c60 con 0x7fcd3406b9e0 2023-10-25T16:20:50.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.935+0000 7fcd2bfff640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd140664a0 0x7fcd14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:50.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.935+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcd1c083310 con 0x7fcd3406b9e0 2023-10-25T16:20:50.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.935+0000 7fcd32ffd640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd140664a0 0x7fcd14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:50.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.935+0000 7fcd32ffd640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd140664a0 0x7fcd14068960 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcd240ae000 tx=0x7fcd2401afc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:50.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:50.939+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd1c050c00 con 0x7fcd3406b9e0 2023-10-25T16:20:51.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.091+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd34157080 con 0x7fcd3406b9e0 2023-10-25T16:20:51.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.619+0000 7fcd2bfff640 1 -- 172.21.15.177:0/1315672213 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcd1c054220 con 0x7fcd3406b9e0 2023-10-25T16:20:51.619 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:20:51.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd140664a0 msgr2=0x7fcd14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:51.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd140664a0 0x7fcd14068960 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcd240ae000 tx=0x7fcd2401afc0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 msgr2=0x7fcd340abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:51.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd340abd70 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c4d0 tx=0x7fcd1c00c990 comp rx=0 tx=0).stop 2023-10-25T16:20:51.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 shutdown_connections 2023-10-25T16:20:51.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd140664a0 0x7fcd14068960 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd341500f0 0x7fcd34147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd340706f0 0x7fcd34148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 --2- 172.21.15.177:0/1315672213 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd3406b9e0 0x7fcd340abd70 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 >> 172.21.15.177:0/1315672213 conn(0x7fcd340b2450 msgr2=0x7fcd340c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:51.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 shutdown_connections 2023-10-25T16:20:51.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.623+0000 7fcd39ba3640 1 -- 172.21.15.177:0/1315672213 wait complete. 2023-10-25T16:20:51.646 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:20:51.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/1467007284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 msgr2=0x7f4e100cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:51.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 --2- 172.21.15.177:0/1467007284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e100cdf80 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b3ea0 tx=0x7f4e0801cc90 comp rx=0 tx=0).stop 2023-10-25T16:20:51.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/1467007284 shutdown_connections 2023-10-25T16:20:51.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 --2- 172.21.15.177:0/1467007284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e100cdf80 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 --2- 172.21.15.177:0/1467007284 >> v2:172.21.15.184:3300/0 conn(0x7f4e1015eba0 0x7f4e100b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/1467007284 >> 172.21.15.177:0/1467007284 conn(0x7f4e1009a5c0 msgr2=0x7f4e100d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:51.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/1467007284 shutdown_connections 2023-10-25T16:20:51.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/1467007284 wait complete. 2023-10-25T16:20:51.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 Processor -- start 2023-10-25T16:20:51.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- start start 2023-10-25T16:20:51.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100b2120 0x7f4e1014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:51.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e10140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:51.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1015eba0 0x7f4e10151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:51.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1014fb20 con 0x7f4e100cdb10 2023-10-25T16:20:51.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1014f630 con 0x7f4e100b2120 2023-10-25T16:20:51.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015cc80 con 0x7f4e1015eba0 2023-10-25T16:20:51.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e10140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:51.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e10140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37800/0 (socket says 172.21.15.177:37800) 2023-10-25T16:20:51.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 -- 172.21.15.177:0/2480774792 learned_addr learned my addr 172.21.15.177:0/2480774792 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:51.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e16b74640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1015eba0 0x7f4e10151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:51.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e16373640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100b2120 0x7f4e1014f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:51.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 -- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1015eba0 msgr2=0x7f4e10151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:51.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1015eba0 0x7f4e10151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 -- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100b2120 msgr2=0x7f4e1014f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:51.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100b2120 0x7f4e1014f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:51.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 -- 172.21.15.177:0/2480774792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e080098e0 con 0x7f4e100cdb10 2023-10-25T16:20:51.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e15b72640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e10140540 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c490 tx=0x7f4e00001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:51.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00003600 con 0x7f4e100cdb10 2023-10-25T16:20:51.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e00003780 con 0x7f4e100cdb10 2023-10-25T16:20:51.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e10140a80 con 0x7f4e100cdb10 2023-10-25T16:20:51.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00003bd0 con 0x7f4e100cdb10 2023-10-25T16:20:51.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.779+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100b48e0 con 0x7f4e100cdb10 2023-10-25T16:20:51.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.783+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1004daf0 con 0x7f4e100cdb10 2023-10-25T16:20:51.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.783+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e00003d30 con 0x7f4e100cdb10 2023-10-25T16:20:51.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.783+0000 7f4e06ffd640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4df4066470 0x7f4df4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.783+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e00082dc0 con 0x7f4e100cdb10 2023-10-25T16:20:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.783+0000 7f4e16373640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4df4066470 0x7f4df4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:51.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.783+0000 7f4e16373640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4df4066470 0x7f4df4068930 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0058d0 tx=0x7f4e0c005d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:51.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.787+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e00050590 con 0x7f4e100cdb10 2023-10-25T16:20:51.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.979+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4e100d02d0 con 0x7f4e100cdb10 2023-10-25T16:20:51.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.979+0000 7f4e06ffd640 1 -- 172.21.15.177:0/2480774792 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4e00053bb0 con 0x7f4e100cdb10 2023-10-25T16:20:51.980 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:51.980 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:20:51.980 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:20:51.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.981 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:20:51.981 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:20:51.981 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.981 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:51.982 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:20:51.982 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:20:51.982 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.982 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.983 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:20:51.983 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:20:51.983 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.984 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:51.984 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:20:51.984 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:20:51.984 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.984 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.985 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:20:51.985 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:20:51.985 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.986 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:51.986 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:20:51.986 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:20:51.986 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.986 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.987 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.987 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:20:51.987 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:20:51.987 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.988 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:51.988 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:20:51.988 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:20:51.989 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.989 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.990 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:20:51.990 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:20:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.992 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:20:51.992 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:20:51.992 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.992 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:51.992 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:51.993 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.993 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.993 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:20:51.994 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:20:51.994 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.994 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:51.994 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:51.994 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.995 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.995 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:20:51.995 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:20:51.996 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.996 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:51.996 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:51.996 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.996 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.996 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.997 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:20:51.997 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:20:51.997 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.997 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:51.998 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:51.998 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:51.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:51.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:51.998 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:51.999 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:20:51.999 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:20:51.999 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:51.999 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:51.999 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:52.000 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:52.000 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.001 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:20:52.001 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:20:52.002 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.002 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:52.002 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:52.002 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:52.002 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:20:52.003 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:20:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.004 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:20:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:20:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:52.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:20:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:20:52.006 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.007 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:52.007 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:20:52.007 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:20:52.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.008 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:20:52.008 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:20:52.008 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.008 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:52.009 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:20:52.009 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:20:52.009 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:20:52.009 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.010 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:20:52.010 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:20:52.010 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.010 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:52.011 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:20:52.011 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:20:52.011 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:20:52.011 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.013 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:20:52.014 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:20:52.014 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.014 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:20:52.015 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:20:52.015 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:20:52.015 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:20:52.015 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.016 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.016 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:20:52.016 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:20:52.016 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.016 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:20:52.017 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:20:52.017 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:20:52.017 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:52.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.018 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.018 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:20:52.018 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:20:52.018 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.019 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:20:52.019 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:20:52.019 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:52.019 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:20:52.020 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.020 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:20:52.020 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:20:52.020 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:20:52.020 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:20:52.021 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:20:52.021 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:20:52.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.021 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.021 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:20:52.022 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:20:52.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4df4066470 msgr2=0x7f4df4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4df4066470 0x7f4df4068930 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0058d0 tx=0x7f4e0c005d90 comp rx=0 tx=0).stop 2023-10-25T16:20:52.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 msgr2=0x7f4e10140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e10140540 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c490 tx=0x7f4e00001e80 comp rx=0 tx=0).stop 2023-10-25T16:20:52.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 shutdown_connections 2023-10-25T16:20:52.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4df4066470 0x7f4df4068930 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1015eba0 0x7f4e10151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e100cdb10 0x7f4e10140540 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 --2- 172.21.15.177:0/2480774792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100b2120 0x7f4e1014f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 >> 172.21.15.177:0/2480774792 conn(0x7f4e1009a5c0 msgr2=0x7f4e100d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 shutdown_connections 2023-10-25T16:20:52.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:51.983+0000 7f4e185d7640 1 -- 172.21.15.177:0/2480774792 wait complete. 2023-10-25T16:20:52.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:52.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- 172.21.15.177:0/3146584639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040aff30 msgr2=0x7f2c040b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/3146584639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040aff30 0x7f2c040b0380 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c9d10 tx=0x7f2bfc01cd30 comp rx=0 tx=0).stop 2023-10-25T16:20:52.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- 172.21.15.177:0/3146584639 shutdown_connections 2023-10-25T16:20:52.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/3146584639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040aff30 0x7f2c040b0380 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/3146584639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c0406ba00 0x7f2c0406be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/3146584639 >> v2:172.21.15.184:3300/0 conn(0x7f2c04140db0 0x7f2c040af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- 172.21.15.177:0/3146584639 >> 172.21.15.177:0/3146584639 conn(0x7f2c040b2450 msgr2=0x7f2c040b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- 172.21.15.177:0/3146584639 shutdown_connections 2023-10-25T16:20:52.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- 172.21.15.177:0/3146584639 wait complete. 2023-10-25T16:20:52.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 Processor -- start 2023-10-25T16:20:52.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- start start 2023-10-25T16:20:52.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c0406ba00 0x7f2c04154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c040aff30 0x7f2c04164a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 0x7f2c04139250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415b810 con 0x7f2c04140db0 2023-10-25T16:20:52.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415ad20 con 0x7f2c040aff30 2023-10-25T16:20:52.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c08fe3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c04154cb0 con 0x7f2c0406ba00 2023-10-25T16:20:52.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c02d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 0x7f2c04139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c02d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 0x7f2c04139250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37806/0 (socket says 172.21.15.177:37806) 2023-10-25T16:20:52.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c02d9d640 1 -- 172.21.15.177:0/4076511191 learned_addr learned my addr 172.21.15.177:0/4076511191 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:52.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2c0259c640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c0406ba00 0x7f2c04154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.151+0000 7f2bfbfff640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c040aff30 0x7f2c04164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c02d9d640 1 -- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c0406ba00 msgr2=0x7f2c04154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c02d9d640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c0406ba00 0x7f2c04154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c02d9d640 1 -- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c040aff30 msgr2=0x7f2c04164a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c02d9d640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c040aff30 0x7f2c04164a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c02d9d640 1 -- 172.21.15.177:0/4076511191 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0098e0 con 0x7f2c04140db0 2023-10-25T16:20:52.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c02d9d640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 0x7f2c04139250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc01b3e0 tx=0x7f2bfc0a5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:52.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc003b90 con 0x7f2c04140db0 2023-10-25T16:20:52.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2bfc003cf0 con 0x7f2c04140db0 2023-10-25T16:20:52.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc004290 con 0x7f2c04140db0 2023-10-25T16:20:52.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c040aaa50 con 0x7f2c04140db0 2023-10-25T16:20:52.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0415af70 con 0x7f2c04140db0 2023-10-25T16:20:52.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c040aa8b0 con 0x7f2c04140db0 2023-10-25T16:20:52.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2bfc0b4040 con 0x7f2c04140db0 2023-10-25T16:20:52.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2bfaffd640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2be4066470 0x7f2be4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2bfc11e3f0 con 0x7f2c04140db0 2023-10-25T16:20:52.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c0259c640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2be4066470 0x7f2be4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.155+0000 7f2c0259c640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2be4066470 0x7f2be4068930 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0058d0 tx=0x7f2bec005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:52.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.159+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c040aa8b0 con 0x7f2c04140db0 2023-10-25T16:20:52.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.315+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c040aa8b0 con 0x7f2c04140db0 2023-10-25T16:20:52.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.315+0000 7f2bfaffd640 1 -- 172.21.15.177:0/4076511191 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+12892 (secure 0 0 0) 0x7f2c040aa8b0 con 0x7f2c04140db0 2023-10-25T16:20:52.314 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:52.315 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":154,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:51.640308+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:52.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.315+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2be4066470 msgr2=0x7f2be4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.315+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2be4066470 0x7f2be4068930 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2bec0058d0 tx=0x7f2bec005860 comp rx=0 tx=0).stop 2023-10-25T16:20:52.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 msgr2=0x7f2c04139250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 0x7f2c04139250 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc01b3e0 tx=0x7f2bfc0a5b40 comp rx=0 tx=0).stop 2023-10-25T16:20:52.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 shutdown_connections 2023-10-25T16:20:52.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2be4066470 0x7f2be4068930 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c04140db0 0x7f2c04139250 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c040aff30 0x7f2c04164a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 --2- 172.21.15.177:0/4076511191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c0406ba00 0x7f2c04154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 >> 172.21.15.177:0/4076511191 conn(0x7f2c040b2450 msgr2=0x7f2c040712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 shutdown_connections 2023-10-25T16:20:52.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.319+0000 7f2c08fe3640 1 -- 172.21.15.177:0/4076511191 wait complete. 2023-10-25T16:20:52.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:20:52.334 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:20:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/512634095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 msgr2=0x7fb8780cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 --2- 172.21.15.177:0/512634095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb8780cbc40 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fb870009bf0 tx=0x7fb87001cb10 comp rx=0 tx=0).stop 2023-10-25T16:20:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/512634095 shutdown_connections 2023-10-25T16:20:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 --2- 172.21.15.177:0/512634095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb8780cbc40 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/512634095 >> 172.21.15.177:0/512634095 conn(0x7fb8780b2450 msgr2=0x7fb8780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/512634095 shutdown_connections 2023-10-25T16:20:52.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/512634095 wait complete. 2023-10-25T16:20:52.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 Processor -- start 2023-10-25T16:20:52.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- start start 2023-10-25T16:20:52.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb87806c110 0x7fb8781400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb87813dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb878140db0 0x7fb87813f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87813f0b0 con 0x7fb8780af5a0 2023-10-25T16:20:52.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87813fee0 con 0x7fb87806c110 2023-10-25T16:20:52.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87813e430 con 0x7fb878140db0 2023-10-25T16:20:52.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb87813dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb87813dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37818/0 (socket says 172.21.15.177:37818) 2023-10-25T16:20:52.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 -- 172.21.15.177:0/20237096 learned_addr learned my addr 172.21.15.177:0/20237096 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:52.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb8777fe640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb87806c110 0x7fb8781400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb877fff640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb878140db0 0x7fb87813f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 -- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb878140db0 msgr2=0x7fb87813f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb878140db0 0x7fb87813f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 -- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb87806c110 msgr2=0x7fb8781400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb87806c110 0x7fb8781400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 -- 172.21.15.177:0/20237096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870009820 con 0x7fb8780af5a0 2023-10-25T16:20:52.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb86effd640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb87813dda0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c550 tx=0x7fb86000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:52.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860005480 con 0x7fb8780af5a0 2023-10-25T16:20:52.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb860003600 con 0x7fb8780af5a0 2023-10-25T16:20:52.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87813e710 con 0x7fb8780af5a0 2023-10-25T16:20:52.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860003a10 con 0x7fb8780af5a0 2023-10-25T16:20:52.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87813ecd0 con 0x7fb8780af5a0 2023-10-25T16:20:52.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.463+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87813f1f0 con 0x7fb8780af5a0 2023-10-25T16:20:52.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.467+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb860003b70 con 0x7fb8780af5a0 2023-10-25T16:20:52.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.467+0000 7fb874ff9640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb858066470 0x7fb858068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.467+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb860083900 con 0x7fb8780af5a0 2023-10-25T16:20:52.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.467+0000 7fb8777fe640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb858066470 0x7fb858068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.467+0000 7fb8777fe640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb858066470 0x7fb858068930 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb86800a750 tx=0x7fb868008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:52.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.471+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb87813f1f0 con 0x7fb8780af5a0 2023-10-25T16:20:52.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.627+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb87813f1f0 con 0x7fb8780af5a0 2023-10-25T16:20:52.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.627+0000 7fb874ff9640 1 -- 172.21.15.177:0/20237096 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb87813f1f0 con 0x7fb8780af5a0 2023-10-25T16:20:52.627 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:20:52.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb858066470 msgr2=0x7fb858068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb858066470 0x7fb858068930 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb86800a750 tx=0x7fb868008040 comp rx=0 tx=0).stop 2023-10-25T16:20:52.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 msgr2=0x7fb87813dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb87813dda0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb86000c550 tx=0x7fb86000ca10 comp rx=0 tx=0).stop 2023-10-25T16:20:52.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 shutdown_connections 2023-10-25T16:20:52.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb858066470 0x7fb858068930 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb878140db0 0x7fb87813f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8780af5a0 0x7fb87813dda0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 --2- 172.21.15.177:0/20237096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb87806c110 0x7fb8781400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 >> 172.21.15.177:0/20237096 conn(0x7fb8780b2450 msgr2=0x7fb8780aa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 shutdown_connections 2023-10-25T16:20:52.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.631+0000 7fb87db52640 1 -- 172.21.15.177:0/20237096 wait complete. 2023-10-25T16:20:52.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:20:52.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.767+0000 7ffb3014c640 1 -- 172.21.15.177:0/4016276756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 msgr2=0x7ffb280af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.767+0000 7ffb3014c640 1 --2- 172.21.15.177:0/4016276756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb280af5a0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ffb2806c670 tx=0x7ffb2401c850 comp rx=0 tx=0).stop 2023-10-25T16:20:52.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/4016276756 shutdown_connections 2023-10-25T16:20:52.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 --2- 172.21.15.177:0/4016276756 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb280aff30 0x7ffb280b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 --2- 172.21.15.177:0/4016276756 >> v2:172.21.15.184:3300/0 conn(0x7ffb2806ba00 0x7ffb2806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 --2- 172.21.15.177:0/4016276756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb280af5a0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/4016276756 >> 172.21.15.177:0/4016276756 conn(0x7ffb280b2450 msgr2=0x7ffb280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/4016276756 shutdown_connections 2023-10-25T16:20:52.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/4016276756 wait complete. 2023-10-25T16:20:52.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 Processor -- start 2023-10-25T16:20:52.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- start start 2023-10-25T16:20:52.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2806ba00 0x7ffb281578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb280aff30 0x7ffb2813e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb28158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2813fbc0 con 0x7ffb28140db0 2023-10-25T16:20:52.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2813efb0 con 0x7ffb280aff30 2023-10-25T16:20:52.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2813f290 con 0x7ffb2806ba00 2023-10-25T16:20:52.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb28158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb28158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37836/0 (socket says 172.21.15.177:37836) 2023-10-25T16:20:52.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 -- 172.21.15.177:0/2522303261 learned_addr learned my addr 172.21.15.177:0/2522303261 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:52.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2d6e7640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb280aff30 0x7ffb2813e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2dee8640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2806ba00 0x7ffb281578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 -- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2806ba00 msgr2=0x7ffb281578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2806ba00 0x7ffb281578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 -- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb280aff30 msgr2=0x7ffb2813e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb280aff30 0x7ffb2813e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 -- 172.21.15.177:0/2522303261 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009560 con 0x7ffb28140db0 2023-10-25T16:20:52.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2d6e7640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb280aff30 0x7ffb2813e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:52.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2dee8640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2806ba00 0x7ffb281578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:52.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb2e6e9640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb28158860 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000ccb0 tx=0x7ffb2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:52.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20004b30 con 0x7ffb28140db0 2023-10-25T16:20:52.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb20004da0 con 0x7ffb28140db0 2023-10-25T16:20:52.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2813f570 con 0x7ffb28140db0 2023-10-25T16:20:52.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20005280 con 0x7ffb28140db0 2023-10-25T16:20:52.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb28157e30 con 0x7ffb28140db0 2023-10-25T16:20:52.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.771+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2813fd70 con 0x7ffb28140db0 2023-10-25T16:20:52.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.775+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb200053e0 con 0x7ffb28140db0 2023-10-25T16:20:52.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.775+0000 7ffb1e7fc640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb0c066470 0x7ffb0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:52.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.775+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffb20084700 con 0x7ffb28140db0 2023-10-25T16:20:52.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.775+0000 7ffb2dee8640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb0c066470 0x7ffb0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:52.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.775+0000 7ffb2dee8640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb0c066470 0x7ffb0c068930 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ffb240af000 tx=0x7ffb2401b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:52.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.779+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb20051fb0 con 0x7ffb28140db0 2023-10-25T16:20:52.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.931+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffb2804daf0 con 0x7ffb28140db0 2023-10-25T16:20:52.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb1e7fc640 1 -- 172.21.15.177:0/2522303261 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffb2001d090 con 0x7ffb28140db0 2023-10-25T16:20:52.932 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:52.933 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:20:52.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:20:52.933 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:20:52.933 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:20:52.934 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:20:52.934 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:20:52.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb0c066470 msgr2=0x7ffb0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb0c066470 0x7ffb0c068930 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ffb240af000 tx=0x7ffb2401b090 comp rx=0 tx=0).stop 2023-10-25T16:20:52.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 msgr2=0x7ffb28158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:52.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb28158860 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000ccb0 tx=0x7ffb2000a620 comp rx=0 tx=0).stop 2023-10-25T16:20:52.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 shutdown_connections 2023-10-25T16:20:52.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb0c066470 0x7ffb0c068930 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb28140db0 0x7ffb28158860 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb280aff30 0x7ffb2813e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 --2- 172.21.15.177:0/2522303261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb2806ba00 0x7ffb281578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:52.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 >> 172.21.15.177:0/2522303261 conn(0x7ffb280b2450 msgr2=0x7ffb2813cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:52.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 shutdown_connections 2023-10-25T16:20:52.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:52.935+0000 7ffb3014c640 1 -- 172.21.15.177:0/2522303261 wait complete. 2023-10-25T16:20:52.951 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:20:52.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:20:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 -- 172.21.15.177:0/1480317185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66a00047d0 msgr2=0x7f66a0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 --2- 172.21.15.177:0/1480317185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66a00047d0 0x7f66a0004c50 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009b90 tx=0x7f66ac01d260 comp rx=0 tx=0).stop 2023-10-25T16:20:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66b7fff640 1 -- 172.21.15.177:0/1480317185 reap_dead start 2023-10-25T16:20:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 -- 172.21.15.177:0/1480317185 shutdown_connections 2023-10-25T16:20:53.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 -- 172.21.15.177:0/1480317185 >> 172.21.15.177:0/1480317185 conn(0x7f66b809a5c0 msgr2=0x7f66b80d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:53.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 -- 172.21.15.177:0/1480317185 shutdown_connections 2023-10-25T16:20:53.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 -- 172.21.15.177:0/1480317185 wait complete. 2023-10-25T16:20:53.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 Processor -- start 2023-10-25T16:20:53.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.079+0000 7f66be0a0640 1 -- start start 2023-10-25T16:20:53.083 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 0x7f66b80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66b815a3e0 0x7f66b815a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b8157e30 0x7f66b81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b81587f0 con 0x7f66b815a000 2023-10-25T16:20:53.084 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b8152b90 con 0x7f66b8157e30 2023-10-25T16:20:53.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b80c8a50 con 0x7f66b815a3e0 2023-10-25T16:20:53.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 0x7f66b80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 0x7f66b80c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37842/0 (socket says 172.21.15.177:37842) 2023-10-25T16:20:53.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 -- 172.21.15.177:0/2320730932 learned_addr learned my addr 172.21.15.177:0/2320730932 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:53.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b7fff640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b8157e30 0x7f66b81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b6ffd640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66b815a3e0 0x7f66b815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 -- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66b815a3e0 msgr2=0x7f66b815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66b815a3e0 0x7f66b815a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 -- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b8157e30 msgr2=0x7f66b81582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b8157e30 0x7f66b81582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 -- 172.21.15.177:0/2320730932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80c8d30 con 0x7f66b815a000 2023-10-25T16:20:53.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b7fff640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b8157e30 0x7f66b81582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:53.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b77fe640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 0x7f66b80c8350 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f66a8011a50 tx=0x7f66a8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:53.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a800fd90 con 0x7f66b815a000 2023-10-25T16:20:53.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f66a8012450 con 0x7f66b815a000 2023-10-25T16:20:53.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b80c9010 con 0x7f66b815a000 2023-10-25T16:20:53.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8012860 con 0x7f66b815a000 2023-10-25T16:20:53.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b80c95d0 con 0x7f66b815a000 2023-10-25T16:20:53.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b8073360 con 0x7f66b815a000 2023-10-25T16:20:53.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f66a80129c0 con 0x7f66b815a000 2023-10-25T16:20:53.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f669ffff640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66a4066470 0x7f66a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66a8084a80 con 0x7f66b815a000 2023-10-25T16:20:53.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.083+0000 7f66b6ffd640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66a4066470 0x7f66a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.087+0000 7f66b6ffd640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66a4066470 0x7f66a4068930 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0ae000 tx=0x7f66ac01a000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:53.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.087+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66a8052300 con 0x7f66b815a000 2023-10-25T16:20:53.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.231+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f66b815bc50 con 0x7f66b815a000 2023-10-25T16:20:53.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.719+0000 7f669ffff640 1 -- 172.21.15.177:0/2320730932 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) v1 ==== 138+0+0 (secure 0 0 0) 0x7f66a801f0b0 con 0x7f66b815a000 2023-10-25T16:20:53.719 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:20:53.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66a4066470 msgr2=0x7f66a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66a4066470 0x7f66a4068930 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0ae000 tx=0x7f66ac01a000 comp rx=0 tx=0).stop 2023-10-25T16:20:53.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 msgr2=0x7f66b80c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 0x7f66b80c8350 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f66a8011a50 tx=0x7f66a8011f10 comp rx=0 tx=0).stop 2023-10-25T16:20:53.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 shutdown_connections 2023-10-25T16:20:53.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66a4066470 0x7f66a4068930 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b8157e30 0x7f66b81582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66b815a3e0 0x7f66b815a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 --2- 172.21.15.177:0/2320730932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66b815a000 0x7f66b80c8350 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 >> 172.21.15.177:0/2320730932 conn(0x7f66b809a5c0 msgr2=0x7f66b80cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:53.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 shutdown_connections 2023-10-25T16:20:53.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.723+0000 7f66be0a0640 1 -- 172.21.15.177:0/2320730932 wait complete. 2023-10-25T16:20:53.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:20:53.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 -- 172.21.15.177:0/313316610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 msgr2=0x7fdf080aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 --2- 172.21.15.177:0/313316610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf080aef70 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009840 tx=0x7fdefc01c730 comp rx=0 tx=0).stop 2023-10-25T16:20:53.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 -- 172.21.15.177:0/313316610 shutdown_connections 2023-10-25T16:20:53.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 --2- 172.21.15.177:0/313316610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf080aef70 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 -- 172.21.15.177:0/313316610 >> 172.21.15.177:0/313316610 conn(0x7fdf080698f0 msgr2=0x7fdf08069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:53.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 -- 172.21.15.177:0/313316610 shutdown_connections 2023-10-25T16:20:53.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.879+0000 7fdf0df34640 1 -- 172.21.15.177:0/313316610 wait complete. 2023-10-25T16:20:53.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 Processor -- start 2023-10-25T16:20:53.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- start start 2023-10-25T16:20:53.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080af4b0 0x7fdf08136360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf08141940 0x7fdf08157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf08157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f3dd0 con 0x7fdf08141d20 2023-10-25T16:20:53.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081368a0 con 0x7fdf080af4b0 2023-10-25T16:20:53.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f3150 con 0x7fdf08141940 2023-10-25T16:20:53.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf08157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf08157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37858/0 (socket says 172.21.15.177:37858) 2023-10-25T16:20:53.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 -- 172.21.15.177:0/3156008681 learned_addr learned my addr 172.21.15.177:0/3156008681 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:53.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf077fe640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080af4b0 0x7fdf08136360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf06ffd640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf08141940 0x7fdf08157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 -- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf08141940 msgr2=0x7fdf08157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf08141940 0x7fdf08157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 -- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080af4b0 msgr2=0x7fdf08136360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:53.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080af4b0 0x7fdf08136360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:53.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 -- 172.21.15.177:0/3156008681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0094a0 con 0x7fdf08141d20 2023-10-25T16:20:53.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf06ffd640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf08141940 0x7fdf08157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:53.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf07fff640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf08157b50 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000cb40 tx=0x7fdf0000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:53.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000aa50 con 0x7fdf08141d20 2023-10-25T16:20:53.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf0000aca0 con 0x7fdf08141d20 2023-10-25T16:20:53.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf081f3430 con 0x7fdf08141d20 2023-10-25T16:20:53.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00012680 con 0x7fdf08141d20 2023-10-25T16:20:53.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf081f39f0 con 0x7fdf08141d20 2023-10-25T16:20:53.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.883+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf081f3f10 con 0x7fdf08141d20 2023-10-25T16:20:53.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.887+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf0001a3b0 con 0x7fdf08141d20 2023-10-25T16:20:53.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.887+0000 7fdeeffff640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdef4066470 0x7fdef4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:53.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.887+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fdf00084020 con 0x7fdf08141d20 2023-10-25T16:20:53.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.887+0000 7fdf077fe640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdef4066470 0x7fdef4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:53.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.887+0000 7fdf077fe640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdef4066470 0x7fdef4068930 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdef8004e30 tx=0x7fdef8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:53.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:53.891+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf081f3f10 con 0x7fdf08141d20 2023-10-25T16:20:54.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.043+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf081f3f10 con 0x7fdf08141d20 2023-10-25T16:20:54.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.735+0000 7fdeeffff640 1 -- 172.21.15.177:0/3156008681 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf081f3f10 con 0x7fdf08141d20 2023-10-25T16:20:54.733 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:20:54.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdef4066470 msgr2=0x7fdef4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:54.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdef4066470 0x7fdef4068930 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdef8004e30 tx=0x7fdef8009040 comp rx=0 tx=0).stop 2023-10-25T16:20:54.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 msgr2=0x7fdf08157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:54.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf08157b50 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000cb40 tx=0x7fdf0000cc30 comp rx=0 tx=0).stop 2023-10-25T16:20:54.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 shutdown_connections 2023-10-25T16:20:54.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdef4066470 0x7fdef4068930 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf08141d20 0x7fdf08157b50 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf08141940 0x7fdf08157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 --2- 172.21.15.177:0/3156008681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080af4b0 0x7fdf08136360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 >> 172.21.15.177:0/3156008681 conn(0x7fdf080698f0 msgr2=0x7fdf0806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:54.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 shutdown_connections 2023-10-25T16:20:54.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.739+0000 7fdf0df34640 1 -- 172.21.15.177:0/3156008681 wait complete. 2023-10-25T16:20:54.769 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:20:54.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 -- 172.21.15.177:0/3906245542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa54c003980 msgr2=0x7fa54c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:54.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 --2- 172.21.15.177:0/3906245542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa54c003980 0x7fa54c003d80 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c700 tx=0x7fa55001c650 comp rx=0 tx=0).stop 2023-10-25T16:20:54.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 -- 172.21.15.177:0/3906245542 shutdown_connections 2023-10-25T16:20:54.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 --2- 172.21.15.177:0/3906245542 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa54c003980 0x7fa54c003d80 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 -- 172.21.15.177:0/3906245542 >> 172.21.15.177:0/3906245542 conn(0x7fa5600b2450 msgr2=0x7fa5600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:54.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 -- 172.21.15.177:0/3906245542 shutdown_connections 2023-10-25T16:20:54.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.899+0000 7fa565f42640 1 -- 172.21.15.177:0/3906245542 wait complete. 2023-10-25T16:20:54.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 Processor -- start 2023-10-25T16:20:54.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- start start 2023-10-25T16:20:54.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa54c003980 0x7fa5601f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:54.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 0x7fa56015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:54.903 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56015a940 0x7fa560153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:54.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600acba0 con 0x7fa5601f5a50 2023-10-25T16:20:54.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600ad990 con 0x7fa56015a940 2023-10-25T16:20:54.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600acd80 con 0x7fa54c003980 2023-10-25T16:20:54.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 0x7fa56015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:54.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 0x7fa56015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37876/0 (socket says 172.21.15.177:37876) 2023-10-25T16:20:54.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 -- 172.21.15.177:0/2586648399 learned_addr learned my addr 172.21.15.177:0/2586648399 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:54.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55f7fe640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa54c003980 0x7fa5601f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:54.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55ffff640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56015a940 0x7fa560153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:54.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 -- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa54c003980 msgr2=0x7fa5601f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:54.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa54c003980 0x7fa5601f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 -- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56015a940 msgr2=0x7fa560153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:54.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56015a940 0x7fa560153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:54.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 -- 172.21.15.177:0/2586648399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600ad060 con 0x7fa5601f5a50 2023-10-25T16:20:54.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55f7fe640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa54c003980 0x7fa5601f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:54.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55ffff640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56015a940 0x7fa560153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:54.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa557fff640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 0x7fa56015a400 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fa54800e960 tx=0x7fa54800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:54.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800cc60 con 0x7fa5601f5a50 2023-10-25T16:20:54.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa54800ceb0 con 0x7fa5601f5a50 2023-10-25T16:20:54.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600ad340 con 0x7fa5601f5a50 2023-10-25T16:20:54.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480116d0 con 0x7fa5601f5a50 2023-10-25T16:20:54.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560153e80 con 0x7fa5601f5a50 2023-10-25T16:20:54.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56004daf0 con 0x7fa5601f5a50 2023-10-25T16:20:54.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.903+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa548011830 con 0x7fa5601f5a50 2023-10-25T16:20:54.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.907+0000 7fa55cff9640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5400664a0 0x7fa540068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:54.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.907+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa548084e00 con 0x7fa5601f5a50 2023-10-25T16:20:54.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.907+0000 7fa55f7fe640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5400664a0 0x7fa540068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:54.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.907+0000 7fa55f7fe640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5400664a0 0x7fa540068960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0057b0 tx=0x7fa5500193f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:54.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:54.911+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa548052370 con 0x7fa5601f5a50 2023-10-25T16:20:55.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.095+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa5600cd970 con 0x7fa5601f5a50 2023-10-25T16:20:55.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.771+0000 7fa55cff9640 1 -- 172.21.15.177:0/2586648399 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa548055990 con 0x7fa5601f5a50 2023-10-25T16:20:55.773 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 18 and data pool 19 2023-10-25T16:20:55.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5400664a0 msgr2=0x7fa540068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:55.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5400664a0 0x7fa540068960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0057b0 tx=0x7fa5500193f0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 msgr2=0x7fa56015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:55.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 0x7fa56015a400 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fa54800e960 tx=0x7fa54800ee20 comp rx=0 tx=0).stop 2023-10-25T16:20:55.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 shutdown_connections 2023-10-25T16:20:55.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5400664a0 0x7fa540068960 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56015a940 0x7fa560153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5601f5a50 0x7fa56015a400 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 --2- 172.21.15.177:0/2586648399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa54c003980 0x7fa5601f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 >> 172.21.15.177:0/2586648399 conn(0x7fa5600b2450 msgr2=0x7fa560154cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:55.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 shutdown_connections 2023-10-25T16:20:55.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.779+0000 7fa565f42640 1 -- 172.21.15.177:0/2586648399 wait complete. 2023-10-25T16:20:55.801 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:55.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- 172.21.15.177:0/246051087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 msgr2=0x7f7578003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:55.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 --2- 172.21.15.177:0/246051087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f7578003dd0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f758800bb10 tx=0x7f758801cd80 comp rx=0 tx=0).stop 2023-10-25T16:20:55.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f7591b8c640 1 -- 172.21.15.177:0/246051087 reap_dead start 2023-10-25T16:20:55.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- 172.21.15.177:0/246051087 shutdown_connections 2023-10-25T16:20:55.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- 172.21.15.177:0/246051087 >> 172.21.15.177:0/246051087 conn(0x7f758c065f40 msgr2=0x7f758c09a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:55.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- 172.21.15.177:0/246051087 shutdown_connections 2023-10-25T16:20:55.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- 172.21.15.177:0/246051087 wait complete. 2023-10-25T16:20:55.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 Processor -- start 2023-10-25T16:20:55.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- start start 2023-10-25T16:20:55.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f758c1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:55.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758c166590 0x7f758c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:55.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758c15a960 0x7f758c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:55.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c15adc0 con 0x7f75780039b0 2023-10-25T16:20:55.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c1f5bd0 con 0x7f758c15a960 2023-10-25T16:20:55.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f75935ef640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c0c52e0 con 0x7f758c166590 2023-10-25T16:20:55.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f759138b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f758c1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:55.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f759138b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f758c1f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37890/0 (socket says 172.21.15.177:37890) 2023-10-25T16:20:55.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.927+0000 7f759138b640 1 -- 172.21.15.177:0/2176264983 learned_addr learned my addr 172.21.15.177:0/2176264983 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:55.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7590b8a640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758c166590 0x7f758c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:55.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7591b8c640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758c15a960 0x7f758c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:55.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f759138b640 1 -- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758c166590 msgr2=0x7f758c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:55.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f759138b640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758c166590 0x7f758c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f759138b640 1 -- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758c15a960 msgr2=0x7f758c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:55.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f759138b640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758c15a960 0x7f758c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:55.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f759138b640 1 -- 172.21.15.177:0/2176264983 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0c65c0 con 0x7f75780039b0 2023-10-25T16:20:55.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7590b8a640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758c166590 0x7f758c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:55.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7591b8c640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758c15a960 0x7f758c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:55.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f759138b640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f758c1f5690 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f758801cbb0 tx=0x7f75880a5f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:55.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588004220 con 0x7f75780039b0 2023-10-25T16:20:55.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7588004470 con 0x7f75780039b0 2023-10-25T16:20:55.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c0c5a40 con 0x7f75780039b0 2023-10-25T16:20:55.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75880053e0 con 0x7f75780039b0 2023-10-25T16:20:55.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c0c6000 con 0x7f75780039b0 2023-10-25T16:20:55.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c04daf0 con 0x7f75780039b0 2023-10-25T16:20:55.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75880046d0 con 0x7f75780039b0 2023-10-25T16:20:55.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7581ffb640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7570066470 0x7f7570068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:55.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f758811e240 con 0x7f75780039b0 2023-10-25T16:20:55.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7590b8a640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7570066470 0x7f7570068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:55.938 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.931+0000 7f7590b8a640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7570066470 0x7f7570068930 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f757c001ec0 tx=0x7f757c001cb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:55.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:55.935+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75880eb640 con 0x7f75780039b0 2023-10-25T16:20:56.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.091+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758c0d1550 con 0x7f75780039b0 2023-10-25T16:20:56.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.091+0000 7f7581ffb640 1 -- 172.21.15.177:0/2176264983 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f75880eec60 con 0x7f75780039b0 2023-10-25T16:20:56.091 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:56.091 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":157,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:55.099121+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:56.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7570066470 msgr2=0x7f7570068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7570066470 0x7f7570068930 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f757c001ec0 tx=0x7f757c001cb0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 msgr2=0x7f758c1f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f758c1f5690 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f758801cbb0 tx=0x7f75880a5f00 comp rx=0 tx=0).stop 2023-10-25T16:20:56.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 shutdown_connections 2023-10-25T16:20:56.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7570066470 0x7f7570068930 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f758c15a960 0x7f758c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f758c166590 0x7f758c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 --2- 172.21.15.177:0/2176264983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75780039b0 0x7f758c1f5690 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 >> 172.21.15.177:0/2176264983 conn(0x7f758c065f40 msgr2=0x7f758c09a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:56.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 shutdown_connections 2023-10-25T16:20:56.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.095+0000 7f75935ef640 1 -- 172.21.15.177:0/2176264983 wait complete. 2023-10-25T16:20:56.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:56.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 -- 172.21.15.177:0/89004472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015eba0 msgr2=0x7f46e00b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 --2- 172.21.15.177:0/89004472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015eba0 0x7f46e00b4100 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009840 tx=0x7f46d001c5c0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 -- 172.21.15.177:0/89004472 shutdown_connections 2023-10-25T16:20:56.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 --2- 172.21.15.177:0/89004472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015eba0 0x7f46e00b4100 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 -- 172.21.15.177:0/89004472 >> 172.21.15.177:0/89004472 conn(0x7f46e009a5c0 msgr2=0x7f46e00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:56.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 -- 172.21.15.177:0/89004472 shutdown_connections 2023-10-25T16:20:56.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.227+0000 7f46e6314640 1 -- 172.21.15.177:0/89004472 wait complete. 2023-10-25T16:20:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 Processor -- start 2023-10-25T16:20:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- start start 2023-10-25T16:20:56.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00b2120 0x7f46e0159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 0x7f46e00c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e015eba0 0x7f46e00c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e015a6e0 con 0x7f46e00cdb10 2023-10-25T16:20:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e015bb40 con 0x7f46e015eba0 2023-10-25T16:20:56.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e015a410 con 0x7f46e00b2120 2023-10-25T16:20:56.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 0x7f46e00c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 0x7f46e00c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37906/0 (socket says 172.21.15.177:37906) 2023-10-25T16:20:56.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 -- 172.21.15.177:0/1974588944 learned_addr learned my addr 172.21.15.177:0/1974588944 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:56.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 -- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00b2120 msgr2=0x7f46e0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46dffff640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00b2120 0x7f46e0159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e48b1640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e015eba0 0x7f46e00c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00b2120 0x7f46e0159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 -- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e015eba0 msgr2=0x7f46e00c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e015eba0 0x7f46e00c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 -- 172.21.15.177:0/1974588944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00094a0 con 0x7f46e00cdb10 2023-10-25T16:20:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46df7fe640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 0x7f46e00c6e30 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c780 tx=0x7f46d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:56.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4005480 con 0x7f46e00cdb10 2023-10-25T16:20:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f46d400ce30 con 0x7f46e00cdb10 2023-10-25T16:20:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e015b210 con 0x7f46e00cdb10 2023-10-25T16:20:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400a8a0 con 0x7f46e00cdb10 2023-10-25T16:20:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e015b7d0 con 0x7f46e00cdb10 2023-10-25T16:20:56.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.231+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e015bcd0 con 0x7f46e00cdb10 2023-10-25T16:20:56.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.235+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46d400aa00 con 0x7f46e00cdb10 2023-10-25T16:20:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.235+0000 7f46dcff9640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46cc0664a0 0x7f46cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.235+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46d40838b0 con 0x7f46e00cdb10 2023-10-25T16:20:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.235+0000 7f46dffff640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46cc0664a0 0x7f46cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.235+0000 7f46dffff640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46cc0664a0 0x7f46cc068960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f46d00ae000 tx=0x7f46d001ae00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:56.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.239+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46d4050cb0 con 0x7f46e00cdb10 2023-10-25T16:20:56.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.391+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46e004daf0 con 0x7f46e00cdb10 2023-10-25T16:20:56.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46dcff9640 1 -- 172.21.15.177:0/1974588944 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f46d4017020 con 0x7f46e00cdb10 2023-10-25T16:20:56.393 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:56.393 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":157,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:55.099121+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:56.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46cc0664a0 msgr2=0x7f46cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46cc0664a0 0x7f46cc068960 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f46d00ae000 tx=0x7f46d001ae00 comp rx=0 tx=0).stop 2023-10-25T16:20:56.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 msgr2=0x7f46e00c6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 0x7f46e00c6e30 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f46d400c780 tx=0x7f46d400cc40 comp rx=0 tx=0).stop 2023-10-25T16:20:56.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 shutdown_connections 2023-10-25T16:20:56.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46cc0664a0 0x7f46cc068960 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e015eba0 0x7f46e00c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cdb10 0x7f46e00c6e30 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 --2- 172.21.15.177:0/1974588944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00b2120 0x7f46e0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 >> 172.21.15.177:0/1974588944 conn(0x7f46e009a5c0 msgr2=0x7f46e00b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:56.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 shutdown_connections 2023-10-25T16:20:56.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.395+0000 7f46e6314640 1 -- 172.21.15.177:0/1974588944 wait complete. 2023-10-25T16:20:56.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:20:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/3992907666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c1c0039b0 msgr2=0x7f7c1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/3992907666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c1c0039b0 0x7f7c1c003dd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f7c24006fb0 tx=0x7f7c2401cf50 comp rx=0 tx=0).stop 2023-10-25T16:20:56.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c38a3d640 1 -- 172.21.15.177:0/3992907666 reap_dead start 2023-10-25T16:20:56.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/3992907666 shutdown_connections 2023-10-25T16:20:56.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/3992907666 >> 172.21.15.177:0/3992907666 conn(0x7f7c340b2450 msgr2=0x7f7c340b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:56.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/3992907666 shutdown_connections 2023-10-25T16:20:56.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/3992907666 wait complete. 2023-10-25T16:20:56.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 Processor -- start 2023-10-25T16:20:56.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.547+0000 7f7c3a4a0640 1 -- start start 2023-10-25T16:20:56.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c1c0039b0 0x7f7c34156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 0x7f7c340c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c340c9070 0x7f7c340c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34159840 con 0x7f7c341f5160 2023-10-25T16:20:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34159b20 con 0x7f7c340c9070 2023-10-25T16:20:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34159e00 con 0x7f7c1c0039b0 2023-10-25T16:20:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 0x7f7c340c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 0x7f7c340c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37924/0 (socket says 172.21.15.177:37924) 2023-10-25T16:20:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 -- 172.21.15.177:0/897874825 learned_addr learned my addr 172.21.15.177:0/897874825 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c38a3d640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c340c9070 0x7f7c340c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 -- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c1c0039b0 msgr2=0x7f7c34156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c33fff640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c1c0039b0 0x7f7c34156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c1c0039b0 0x7f7c34156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 -- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c340c9070 msgr2=0x7f7c340c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c340c9070 0x7f7c340c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 -- 172.21.15.177:0/897874825 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3415a0e0 con 0x7f7c341f5160 2023-10-25T16:20:56.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c38a3d640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c340c9070 0x7f7c340c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:56.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c337fe640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 0x7f7c340c8b30 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f7c28011a50 tx=0x7f7c28011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:56.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800fd90 con 0x7f7c341f5160 2023-10-25T16:20:56.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7c28012450 con 0x7f7c341f5160 2023-10-25T16:20:56.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3415a3c0 con 0x7f7c341f5160 2023-10-25T16:20:56.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28012860 con 0x7f7c341f5160 2023-10-25T16:20:56.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c341574d0 con 0x7f7c341f5160 2023-10-25T16:20:56.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3404daf0 con 0x7f7c341f5160 2023-10-25T16:20:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c280129c0 con 0x7f7c341f5160 2023-10-25T16:20:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c30ff9640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c20066470 0x7f7c20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c28084d40 con 0x7f7c341f5160 2023-10-25T16:20:56.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.551+0000 7f7c33fff640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c20066470 0x7f7c20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.555+0000 7f7c33fff640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c20066470 0x7f7c20068930 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7c240ac000 tx=0x7f7c240a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:56.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.555+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c28052260 con 0x7f7c341f5160 2023-10-25T16:20:56.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.751+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7c341404c0 con 0x7f7c341f5160 2023-10-25T16:20:56.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.771+0000 7f7c30ff9640 1 -- 172.21.15.177:0/897874825 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c2801f0b0 con 0x7f7c341f5160 2023-10-25T16:20:56.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c20066470 msgr2=0x7f7c20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c20066470 0x7f7c20068930 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7c240ac000 tx=0x7f7c240a7040 comp rx=0 tx=0).stop 2023-10-25T16:20:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 msgr2=0x7f7c340c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 0x7f7c340c8b30 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f7c28011a50 tx=0x7f7c28011f10 comp rx=0 tx=0).stop 2023-10-25T16:20:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 shutdown_connections 2023-10-25T16:20:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7c20066470 0x7f7c20068930 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c340c9070 0x7f7c340c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c341f5160 0x7f7c340c8b30 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 --2- 172.21.15.177:0/897874825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c1c0039b0 0x7f7c34156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 >> 172.21.15.177:0/897874825 conn(0x7f7c340b2450 msgr2=0x7f7c340afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 shutdown_connections 2023-10-25T16:20:56.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.775+0000 7f7c3a4a0640 1 -- 172.21.15.177:0/897874825 wait complete. 2023-10-25T16:20:56.791 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:20:56.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:20:56.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- 172.21.15.177:0/2610422596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 msgr2=0x7ff53c0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 --2- 172.21.15.177:0/2610422596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c9d10 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0cfd10 tx=0x7ff53001c7e0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- 172.21.15.177:0/2610422596 shutdown_connections 2023-10-25T16:20:56.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 --2- 172.21.15.177:0/2610422596 >> v2:172.21.15.184:3300/0 conn(0x7ff53c15b1f0 0x7ff53c15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 --2- 172.21.15.177:0/2610422596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c9d10 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- 172.21.15.177:0/2610422596 >> 172.21.15.177:0/2610422596 conn(0x7ff53c0b0de0 msgr2=0x7ff53c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:56.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- 172.21.15.177:0/2610422596 shutdown_connections 2023-10-25T16:20:56.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- 172.21.15.177:0/2610422596 wait complete. 2023-10-25T16:20:56.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 Processor -- start 2023-10-25T16:20:56.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- start start 2023-10-25T16:20:56.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c156e60 0x7ff53c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff53c15b1f0 0x7ff53c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c14ee70 con 0x7ff53c0c9880 2023-10-25T16:20:56.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0c2320 con 0x7ff53c156e60 2023-10-25T16:20:56.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff542bdf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c14f610 con 0x7ff53c15b1f0 2023-10-25T16:20:56.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37944/0 (socket says 172.21.15.177:37944) 2023-10-25T16:20:56.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 -- 172.21.15.177:0/294850679 learned_addr learned my addr 172.21.15.177:0/294850679 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:56.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff53bfff640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c156e60 0x7ff53c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54117c640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff53c15b1f0 0x7ff53c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 -- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff53c15b1f0 msgr2=0x7ff53c155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff53c15b1f0 0x7ff53c155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 -- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c156e60 msgr2=0x7ff53c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:56.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c156e60 0x7ff53c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:56.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 -- 172.21.15.177:0/294850679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300094a0 con 0x7ff53c0c9880 2023-10-25T16:20:56.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54117c640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff53c15b1f0 0x7ff53c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:56.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff54097b640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c1de0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c450 tx=0x7ff52c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:56.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.907+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c004230 con 0x7ff53c0c9880 2023-10-25T16:20:56.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff52c0044a0 con 0x7ff53c0c9880 2023-10-25T16:20:56.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c14f8f0 con 0x7ff53c0c9880 2023-10-25T16:20:56.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c005260 con 0x7ff53c0c9880 2023-10-25T16:20:56.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c14eb00 con 0x7ff53c0c9880 2023-10-25T16:20:56.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04daf0 con 0x7ff53c0c9880 2023-10-25T16:20:56.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff52c0053c0 con 0x7ff53c0c9880 2023-10-25T16:20:56.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff5397fa640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5280664a0 0x7ff528068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:56.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52c083da0 con 0x7ff53c0c9880 2023-10-25T16:20:56.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff53bfff640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5280664a0 0x7ff528068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:56.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.911+0000 7ff53bfff640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5280664a0 0x7ff528068960 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff5300af000 tx=0x7ff53001b020 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:56.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:56.915+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff52c0510f0 con 0x7ff53c0c9880 2023-10-25T16:20:57.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.103+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff53c065cf0 con 0x7ff53c0c9880 2023-10-25T16:20:57.637 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-10-25T16:20:57.636+0000 7fbdb8a92640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:20:57.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.799+0000 7ff5397fa640 1 -- 172.21.15.177:0/294850679 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff52c016070 con 0x7ff53c0c9880 2023-10-25T16:20:57.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5280664a0 msgr2=0x7ff528068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:57.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5280664a0 0x7ff528068960 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff5300af000 tx=0x7ff53001b020 comp rx=0 tx=0).stop 2023-10-25T16:20:57.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 msgr2=0x7ff53c0c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:57.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c1de0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c450 tx=0x7ff52c00c910 comp rx=0 tx=0).stop 2023-10-25T16:20:57.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 shutdown_connections 2023-10-25T16:20:57.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff5280664a0 0x7ff528068960 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff53c15b1f0 0x7ff53c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff53c156e60 0x7ff53c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 --2- 172.21.15.177:0/294850679 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff53c0c9880 0x7ff53c0c1de0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 >> 172.21.15.177:0/294850679 conn(0x7ff53c0b0de0 msgr2=0x7ff53c0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:57.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 shutdown_connections 2023-10-25T16:20:57.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.803+0000 7ff542bdf640 1 -- 172.21.15.177:0/294850679 wait complete. 2023-10-25T16:20:57.819 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:20:57.820 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:20:57.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/1135443596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd5006b980 msgr2=0x7fcd5006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:57.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 --2- 172.21.15.177:0/1135443596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd5006b980 0x7fcd5006be10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009bc0 tx=0x7fcd4801cb50 comp rx=0 tx=0).stop 2023-10-25T16:20:57.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/1135443596 shutdown_connections 2023-10-25T16:20:57.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 --2- 172.21.15.177:0/1135443596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd5006b980 0x7fcd5006be10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 --2- 172.21.15.177:0/1135443596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd50071500 0x7fcd50070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/1135443596 >> 172.21.15.177:0/1135443596 conn(0x7fcd500b2450 msgr2=0x7fcd500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:57.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/1135443596 shutdown_connections 2023-10-25T16:20:57.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/1135443596 wait complete. 2023-10-25T16:20:57.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 Processor -- start 2023-10-25T16:20:57.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- start start 2023-10-25T16:20:57.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 0x7fcd501402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:57.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd50071500 0x7fcd501553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:57.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd50159230 0x7fcd501447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:57.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5013fe20 con 0x7fcd5006b980 2023-10-25T16:20:57.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd50140c80 con 0x7fcd50071500 2023-10-25T16:20:57.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5013f4f0 con 0x7fcd50159230 2023-10-25T16:20:57.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 0x7fcd501402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:57.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 0x7fcd501402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37950/0 (socket says 172.21.15.177:37950) 2023-10-25T16:20:57.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 -- 172.21.15.177:0/3031904456 learned_addr learned my addr 172.21.15.177:0/3031904456 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:57.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd56353640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd50159230 0x7fcd501447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:57.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55351640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd50071500 0x7fcd501553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:57.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 -- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd50159230 msgr2=0x7fcd501447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:57.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd50159230 0x7fcd501447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 -- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd50071500 msgr2=0x7fcd501553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:57.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd50071500 0x7fcd501553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:57.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 -- 172.21.15.177:0/3031904456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009450 con 0x7fcd5006b980 2023-10-25T16:20:57.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd55b52640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 0x7fcd501402b0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c450 tx=0x7fcd4c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:57.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c005480 con 0x7fcd5006b980 2023-10-25T16:20:57.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcd4c0036f0 con 0x7fcd5006b980 2023-10-25T16:20:57.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c003b00 con 0x7fcd5006b980 2023-10-25T16:20:57.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd48009820 con 0x7fcd5006b980 2023-10-25T16:20:57.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.951+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5013fab0 con 0x7fcd5006b980 2023-10-25T16:20:57.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.955+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5004daf0 con 0x7fcd5006b980 2023-10-25T16:20:57.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.955+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd4c003c60 con 0x7fcd5006b980 2023-10-25T16:20:57.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.955+0000 7fcd467fc640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd340664a0 0x7fcd34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:57.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.955+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd4c083620 con 0x7fcd5006b980 2023-10-25T16:20:57.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.955+0000 7fcd55351640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd340664a0 0x7fcd34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:57.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.955+0000 7fcd55351640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd340664a0 0x7fcd34068960 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcd500b2980 tx=0x7fcd40005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:57.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:57.959+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd4c050aa0 con 0x7fcd5006b980 2023-10-25T16:20:58.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.139+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd500c99e0 con 0x7fcd5006b980 2023-10-25T16:20:58.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.139+0000 7fcd467fc640 1 -- 172.21.15.177:0/3031904456 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fcd4c017090 con 0x7fcd5006b980 2023-10-25T16:20:58.140 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:58.140 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:20:58.141 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:20:58.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd340664a0 msgr2=0x7fcd34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd340664a0 0x7fcd34068960 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcd500b2980 tx=0x7fcd40005f40 comp rx=0 tx=0).stop 2023-10-25T16:20:58.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 msgr2=0x7fcd501402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 0x7fcd501402b0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c450 tx=0x7fcd4c00c910 comp rx=0 tx=0).stop 2023-10-25T16:20:58.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 shutdown_connections 2023-10-25T16:20:58.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcd340664a0 0x7fcd34068960 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd50159230 0x7fcd501447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd50071500 0x7fcd501553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 --2- 172.21.15.177:0/3031904456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd5006b980 0x7fcd501402b0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 >> 172.21.15.177:0/3031904456 conn(0x7fcd500b2450 msgr2=0x7fcd500cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:58.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 shutdown_connections 2023-10-25T16:20:58.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.143+0000 7fcd57db6640 1 -- 172.21.15.177:0/3031904456 wait complete. 2023-10-25T16:20:58.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:20:58.279 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 -- 172.21.15.177:0/3038513066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac815bdb0 msgr2=0x7fdac80aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 --2- 172.21.15.177:0/3038513066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac815bdb0 0x7fdac80aebc0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fdac80cdef0 tx=0x7fdab801db10 comp rx=0 tx=0).stop 2023-10-25T16:20:58.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 -- 172.21.15.177:0/3038513066 shutdown_connections 2023-10-25T16:20:58.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 --2- 172.21.15.177:0/3038513066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac815bdb0 0x7fdac80aebc0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 --2- 172.21.15.177:0/3038513066 >> v2:172.21.15.184:3300/0 conn(0x7fdac814e810 0x7fdac80cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 -- 172.21.15.177:0/3038513066 >> 172.21.15.177:0/3038513066 conn(0x7fdac80b2450 msgr2=0x7fdac80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:58.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 -- 172.21.15.177:0/3038513066 shutdown_connections 2023-10-25T16:20:58.281 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.279+0000 7fdacf37a640 1 -- 172.21.15.177:0/3038513066 wait complete. 2023-10-25T16:20:58.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 Processor -- start 2023-10-25T16:20:58.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- start start 2023-10-25T16:20:58.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 0x7fdac8150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac814e810 0x7fdac8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac815bdb0 0x7fdac813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac814fe50 con 0x7fdac80af100 2023-10-25T16:20:58.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac81507b0 con 0x7fdac815bdb0 2023-10-25T16:20:58.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac81552a0 con 0x7fdac814e810 2023-10-25T16:20:58.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 0x7fdac8150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 0x7fdac8150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37962/0 (socket says 172.21.15.177:37962) 2023-10-25T16:20:58.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 -- 172.21.15.177:0/1921285830 learned_addr learned my addr 172.21.15.177:0/1921285830 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:58.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 -- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac814e810 msgr2=0x7fdac8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac814e810 0x7fdac8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 -- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac815bdb0 msgr2=0x7fdac813f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd917640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac815bdb0 0x7fdac813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac815bdb0 0x7fdac813f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 -- 172.21.15.177:0/1921285830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab800a560 con 0x7fdac80af100 2023-10-25T16:20:58.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacd116640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 0x7fdac8150270 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c9a0 tx=0x7fdac400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:58.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4007bb0 con 0x7fdac80af100 2023-10-25T16:20:58.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdac4007e20 con 0x7fdac80af100 2023-10-25T16:20:58.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac814f1d0 con 0x7fdac80af100 2023-10-25T16:20:58.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4005280 con 0x7fdac80af100 2023-10-25T16:20:58.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac814f790 con 0x7fdac80af100 2023-10-25T16:20:58.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac814ff90 con 0x7fdac80af100 2023-10-25T16:20:58.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.283+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdac40053e0 con 0x7fdac80af100 2023-10-25T16:20:58.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.287+0000 7fdabdffb640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdaac066470 0x7fdaac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.287+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdac4084780 con 0x7fdac80af100 2023-10-25T16:20:58.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.287+0000 7fdacc915640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdaac066470 0x7fdaac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.287+0000 7fdacc915640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdaac066470 0x7fdaac068930 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdab80af000 tx=0x7fdab801a8b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:58.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.291+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdac814ff90 con 0x7fdac80af100 2023-10-25T16:20:58.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.439+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdac8158d20 con 0x7fdac80af100 2023-10-25T16:20:58.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.439+0000 7fdabdffb640 1 -- 172.21.15.177:0/1921285830 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16604 (secure 0 0 0) 0x7fdac401d020 con 0x7fdac80af100 2023-10-25T16:20:58.440 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:58.440 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":158,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:20:56.741475+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:20:58.441 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdaac066470 msgr2=0x7fdaac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdaac066470 0x7fdaac068930 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdab80af000 tx=0x7fdab801a8b0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 msgr2=0x7fdac8150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 0x7fdac8150270 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c9a0 tx=0x7fdac400ce60 comp rx=0 tx=0).stop 2023-10-25T16:20:58.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 shutdown_connections 2023-10-25T16:20:58.442 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdaac066470 0x7fdaac068930 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdac815bdb0 0x7fdac813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdac814e810 0x7fdac8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 --2- 172.21.15.177:0/1921285830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac80af100 0x7fdac8150270 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 >> 172.21.15.177:0/1921285830 conn(0x7fdac80b2450 msgr2=0x7fdac80afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:58.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 shutdown_connections 2023-10-25T16:20:58.444 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.443+0000 7fdacf37a640 1 -- 172.21.15.177:0/1921285830 wait complete. 2023-10-25T16:20:58.458 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:20:58.459 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:20:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 -- 172.21.15.177:0/3199423174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3424004d10 msgr2=0x7f3424005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 --2- 172.21.15.177:0/3199423174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3424004d10 0x7f3424005190 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f343400c610 tx=0x7f343401fac0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f343ad9d640 1 -- 172.21.15.177:0/3199423174 reap_dead start 2023-10-25T16:20:58.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 -- 172.21.15.177:0/3199423174 shutdown_connections 2023-10-25T16:20:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 -- 172.21.15.177:0/3199423174 >> 172.21.15.177:0/3199423174 conn(0x7f343c09a5c0 msgr2=0x7f343c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 -- 172.21.15.177:0/3199423174 shutdown_connections 2023-10-25T16:20:58.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 -- 172.21.15.177:0/3199423174 wait complete. 2023-10-25T16:20:58.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.579+0000 7f3440a4f640 1 Processor -- start 2023-10-25T16:20:58.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- start start 2023-10-25T16:20:58.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 0x7f343c15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f343c0c5640 0x7f343c0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f343c0c5ac0 0x7f343c0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0b1e60 con 0x7f343c14f2d0 2023-10-25T16:20:58.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c15c0d0 con 0x7f343c0c5ac0 2023-10-25T16:20:58.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c14f6b0 con 0x7f343c0c5640 2023-10-25T16:20:58.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 0x7f343c15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 0x7f343c15c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37972/0 (socket says 172.21.15.177:37972) 2023-10-25T16:20:58.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 -- 172.21.15.177:0/1968957566 learned_addr learned my addr 172.21.15.177:0/1968957566 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:58.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343ad9d640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f343c0c5ac0 0x7f343c0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3439d9b640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f343c0c5640 0x7f343c0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 -- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f343c0c5640 msgr2=0x7f343c0c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f343c0c5640 0x7f343c0c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 -- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f343c0c5ac0 msgr2=0x7f343c0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f343c0c5ac0 0x7f343c0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 -- 172.21.15.177:0/1968957566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c14fb70 con 0x7f343c14f2d0 2023-10-25T16:20:58.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3439d9b640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f343c0c5640 0x7f343c0c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:58.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f343a59c640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 0x7f343c15c4f0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f342c00fa00 tx=0x7f342c00fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:58.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00bcb0 con 0x7f343c14f2d0 2023-10-25T16:20:58.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f342c004030 con 0x7f343c14f2d0 2023-10-25T16:20:58.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c15b450 con 0x7f343c14f2d0 2023-10-25T16:20:58.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c004420 con 0x7f343c14f2d0 2023-10-25T16:20:58.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c15ba10 con 0x7f343c14f2d0 2023-10-25T16:20:58.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c15c340 con 0x7f343c14f2d0 2023-10-25T16:20:58.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f342c003600 con 0x7f343c14f2d0 2023-10-25T16:20:58.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f342affd640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f341c066470 0x7f341c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f342c0848f0 con 0x7f343c14f2d0 2023-10-25T16:20:58.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.583+0000 7f3439d9b640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f341c066470 0x7f341c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.587+0000 7f3439d9b640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f341c066470 0x7f341c068930 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f343c066f60 tx=0x7f34300091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:58.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.587+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f342c051e20 con 0x7f343c14f2d0 2023-10-25T16:20:58.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.739+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f343c0cfd00 con 0x7f341c066470 2023-10-25T16:20:58.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f342affd640 1 -- 172.21.15.177:0/1968957566 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277754 (secure 0 0 0) 0x7f3430016070 con 0x7f341c066470 2023-10-25T16:20:58.762 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:58.763 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:20:58.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f341c066470 msgr2=0x7f341c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f341c066470 0x7f341c068930 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f343c066f60 tx=0x7f34300091e0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 msgr2=0x7f343c15c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 0x7f343c15c4f0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f342c00fa00 tx=0x7f342c00fec0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 shutdown_connections 2023-10-25T16:20:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f341c066470 0x7f341c068930 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f343c0c5ac0 0x7f343c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f343c0c5640 0x7f343c0c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 --2- 172.21.15.177:0/1968957566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f343c14f2d0 0x7f343c15c4f0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 >> 172.21.15.177:0/1968957566 conn(0x7f343c09a5c0 msgr2=0x7f343c0b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 shutdown_connections 2023-10-25T16:20:58.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.763+0000 7f3440a4f640 1 -- 172.21.15.177:0/1968957566 wait complete. 2023-10-25T16:20:58.780 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2023-10-25T16:20:56.771544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7911,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554588,"statfs":{"total":1600000000,"available":1591898431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001289"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751716+0000","last_change":"2023-10-25T16:20:54.751716+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751716+0000","last_undegraded":"2023-10-25T16:20:54.751716+0000","last_fullsized":"2023-10-25T16:20:54.751716+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754600+0000","last_change":"2023-10-25T16:20:54.754600+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754600+0000","last_undegraded":"2023-10-25T16:20:54.754600+0000","last_fullsized":"2023-10-25T16:20:54.754600+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755873+0000","last_change":"2023-10-25T16:20:54.755873+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755873+0000","last_undegraded":"2023-10-25T16:20:54.755873+0000","last_fullsized":"2023-10-25T16:20:54.755873+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752156+0000","last_change":"2023-10-25T16:20:54.752156+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752156+0000","last_undegraded":"2023-10-25T16:20:54.752156+0000","last_fullsized":"2023-10-25T16:20:54.752156+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751457+0000","last_change":"2023-10-25T16:20:54.751457+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751457+0000","last_undegraded":"2023-10-25T16:20:54.751457+0000","last_fullsized":"2023-10-25T16:20:54.751457+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753766+0000","last_change":"2023-10-25T16:20:54.753766+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753766+0000","last_undegraded":"2023-10-25T16:20:54.753766+0000","last_fullsized":"2023-10-25T16:20:54.753766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755962+0000","last_change":"2023-10-25T16:20:54.755962+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755962+0000","last_undegraded":"2023-10-25T16:20:54.755962+0000","last_fullsized":"2023-10-25T16:20:54.755962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752774+0000","last_change":"2023-10-25T16:20:54.752774+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752774+0000","last_undegraded":"2023-10-25T16:20:54.752774+0000","last_fullsized":"2023-10-25T16:20:54.752774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750691+0000","last_change":"2023-10-25T16:20:54.750691+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750691+0000","last_undegraded":"2023-10-25T16:20:54.750691+0000","last_fullsized":"2023-10-25T16:20:54.750691+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750855+0000","last_change":"2023-10-25T16:20:54.750855+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750855+0000","last_undegraded":"2023-10-25T16:20:54.750855+0000","last_fullsized":"2023-10-25T16:20:54.750855+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751538+0000","last_change":"2023-10-25T16:20:54.751538+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751538+0000","last_undegraded":"2023-10-25T16:20:54.751538+0000","last_fullsized":"2023-10-25T16:20:54.751538+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748570+0000","last_change":"2023-10-25T16:20:54.748570+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748570+0000","last_undegraded":"2023-10-25T16:20:54.748570+0000","last_fullsized":"2023-10-25T16:20:54.748570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749669+0000","last_change":"2023-10-25T16:20:54.749669+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749669+0000","last_undegraded":"2023-10-25T16:20:54.749669+0000","last_fullsized":"2023-10-25T16:20:54.749669+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748618+0000","last_change":"2023-10-25T16:20:54.748618+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748618+0000","last_undegraded":"2023-10-25T16:20:54.748618+0000","last_fullsized":"2023-10-25T16:20:54.748618+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753051+0000","last_change":"2023-10-25T16:20:54.753051+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753051+0000","last_undegraded":"2023-10-25T16:20:54.753051+0000","last_fullsized":"2023-10-25T16:20:54.753051+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748660+0000","last_change":"2023-10-25T16:20:54.748660+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748660+0000","last_undegraded":"2023-10-25T16:20:54.748660+0000","last_fullsized":"2023-10-25T16:20:54.748660+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757935+0000","last_change":"2023-10-25T16:20:54.757935+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757935+0000","last_undegraded":"2023-10-25T16:20:54.757935+0000","last_fullsized":"2023-10-25T16:20:54.757935+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749462+0000","last_change":"2023-10-25T16:20:54.749462+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749462+0000","last_undegraded":"2023-10-25T16:20:54.749462+0000","last_fullsized":"2023-10-25T16:20:54.749462+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752341+0000","last_change":"2023-10-25T16:20:54.752341+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752341+0000","last_undegraded":"2023-10-25T16:20:54.752341+0000","last_fullsized":"2023-10-25T16:20:54.752341+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752700+0000","last_change":"2023-10-25T16:20:54.752700+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752700+0000","last_undegraded":"2023-10-25T16:20:54.752700+0000","last_fullsized":"2023-10-25T16:20:54.752700+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752357+0000","last_change":"2023-10-25T16:20:54.752357+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752357+0000","last_undegraded":"2023-10-25T16:20:54.752357+0000","last_fullsized":"2023-10-25T16:20:54.752357+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747818+0000","last_change":"2023-10-25T16:20:54.747818+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747818+0000","last_undegraded":"2023-10-25T16:20:54.747818+0000","last_fullsized":"2023-10-25T16:20:54.747818+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746049+0000","last_change":"2023-10-25T16:20:54.746049+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746049+0000","last_undegraded":"2023-10-25T16:20:54.746049+0000","last_fullsized":"2023-10-25T16:20:54.746049+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757166+0000","last_change":"2023-10-25T16:20:54.757166+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757166+0000","last_undegraded":"2023-10-25T16:20:54.757166+0000","last_fullsized":"2023-10-25T16:20:54.757166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750554+0000","last_change":"2023-10-25T16:20:54.750554+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750554+0000","last_undegraded":"2023-10-25T16:20:54.750554+0000","last_fullsized":"2023-10-25T16:20:54.750554+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748228+0000","last_change":"2023-10-25T16:20:54.748228+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748228+0000","last_undegraded":"2023-10-25T16:20:54.748228+0000","last_fullsized":"2023-10-25T16:20:54.748228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.751054+0000","last_change":"2023-10-25T16:20:54.750779+0000","last_active":"2023-10-25T16:20:54.751054+0000","last_peered":"2023-10-25T16:20:54.751054+0000","last_clean":"2023-10-25T16:20:54.751054+0000","last_became_active":"2023-10-25T16:20:54.750091+0000","last_became_peered":"2023-10-25T16:20:54.750091+0000","last_unstale":"2023-10-25T16:20:54.751054+0000","last_undegraded":"2023-10-25T16:20:54.751054+0000","last_fullsized":"2023-10-25T16:20:54.751054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:25:27.972269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753123+0000","last_change":"2023-10-25T16:20:54.753123+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753123+0000","last_undegraded":"2023-10-25T16:20:54.753123+0000","last_fullsized":"2023-10-25T16:20:54.753123+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759359+0000","last_change":"2023-10-25T16:20:54.759191+0000","last_active":"2023-10-25T16:20:54.759359+0000","last_peered":"2023-10-25T16:20:54.759359+0000","last_clean":"2023-10-25T16:20:54.759359+0000","last_became_active":"2023-10-25T16:20:54.758654+0000","last_became_peered":"2023-10-25T16:20:54.758654+0000","last_unstale":"2023-10-25T16:20:54.759359+0000","last_undegraded":"2023-10-25T16:20:54.759359+0000","last_fullsized":"2023-10-25T16:20:54.759359+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748190+0000","last_change":"2023-10-25T16:20:54.748190+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748190+0000","last_undegraded":"2023-10-25T16:20:54.748190+0000","last_fullsized":"2023-10-25T16:20:54.748190+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758560+0000","last_change":"2023-10-25T16:20:54.758266+0000","last_active":"2023-10-25T16:20:54.758560+0000","last_peered":"2023-10-25T16:20:54.758560+0000","last_clean":"2023-10-25T16:20:54.758560+0000","last_became_active":"2023-10-25T16:20:54.757497+0000","last_became_peered":"2023-10-25T16:20:54.757497+0000","last_unstale":"2023-10-25T16:20:54.758560+0000","last_undegraded":"2023-10-25T16:20:54.758560+0000","last_fullsized":"2023-10-25T16:20:54.758560+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:29:33.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755084+0000","last_change":"2023-10-25T16:20:54.755084+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755084+0000","last_undegraded":"2023-10-25T16:20:54.755084+0000","last_fullsized":"2023-10-25T16:20:54.755084+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756647+0000","last_change":"2023-10-25T16:20:54.756559+0000","last_active":"2023-10-25T16:20:54.756647+0000","last_peered":"2023-10-25T16:20:54.756647+0000","last_clean":"2023-10-25T16:20:54.756647+0000","last_became_active":"2023-10-25T16:20:54.756240+0000","last_became_peered":"2023-10-25T16:20:54.756240+0000","last_unstale":"2023-10-25T16:20:54.756647+0000","last_undegraded":"2023-10-25T16:20:54.756647+0000","last_fullsized":"2023-10-25T16:20:54.756647+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748171+0000","last_change":"2023-10-25T16:20:54.748171+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748171+0000","last_undegraded":"2023-10-25T16:20:54.748171+0000","last_fullsized":"2023-10-25T16:20:54.748171+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.754257+0000","last_change":"2023-10-25T16:20:54.753168+0000","last_active":"2023-10-25T16:20:54.754257+0000","last_peered":"2023-10-25T16:20:54.754257+0000","last_clean":"2023-10-25T16:20:54.754257+0000","last_became_active":"2023-10-25T16:20:54.752919+0000","last_became_peered":"2023-10-25T16:20:54.752919+0000","last_unstale":"2023-10-25T16:20:54.754257+0000","last_undegraded":"2023-10-25T16:20:54.754257+0000","last_fullsized":"2023-10-25T16:20:54.754257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:18.896946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748577+0000","last_change":"2023-10-25T16:20:54.748577+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748577+0000","last_undegraded":"2023-10-25T16:20:54.748577+0000","last_fullsized":"2023-10-25T16:20:54.748577+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.755685+0000","last_change":"2023-10-25T16:20:54.755598+0000","last_active":"2023-10-25T16:20:54.755685+0000","last_peered":"2023-10-25T16:20:54.755685+0000","last_clean":"2023-10-25T16:20:54.755685+0000","last_became_active":"2023-10-25T16:20:54.755185+0000","last_became_peered":"2023-10-25T16:20:54.755185+0000","last_unstale":"2023-10-25T16:20:54.755685+0000","last_undegraded":"2023-10-25T16:20:54.755685+0000","last_fullsized":"2023-10-25T16:20:54.755685+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:17:00.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751297+0000","last_change":"2023-10-25T16:20:54.751297+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751297+0000","last_undegraded":"2023-10-25T16:20:54.751297+0000","last_fullsized":"2023-10-25T16:20:54.751297+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.765707+0000","last_change":"2023-10-25T16:20:54.765552+0000","last_active":"2023-10-25T16:20:54.765707+0000","last_peered":"2023-10-25T16:20:54.765707+0000","last_clean":"2023-10-25T16:20:54.765707+0000","last_became_active":"2023-10-25T16:20:54.764892+0000","last_became_peered":"2023-10-25T16:20:54.764892+0000","last_unstale":"2023-10-25T16:20:54.765707+0000","last_undegraded":"2023-10-25T16:20:54.765707+0000","last_fullsized":"2023-10-25T16:20:54.765707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:24.555799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750998+0000","last_change":"2023-10-25T16:20:54.750998+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750998+0000","last_undegraded":"2023-10-25T16:20:54.750998+0000","last_fullsized":"2023-10-25T16:20:54.750998+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763711+0000","last_change":"2023-10-25T16:20:54.763630+0000","last_active":"2023-10-25T16:20:54.763711+0000","last_peered":"2023-10-25T16:20:54.763711+0000","last_clean":"2023-10-25T16:20:54.763711+0000","last_became_active":"2023-10-25T16:20:54.763250+0000","last_became_peered":"2023-10-25T16:20:54.763250+0000","last_unstale":"2023-10-25T16:20:54.763711+0000","last_undegraded":"2023-10-25T16:20:54.763711+0000","last_fullsized":"2023-10-25T16:20:54.763711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763639+0000","last_change":"2023-10-25T16:20:54.763382+0000","last_active":"2023-10-25T16:20:54.763639+0000","last_peered":"2023-10-25T16:20:54.763639+0000","last_clean":"2023-10-25T16:20:54.763639+0000","last_became_active":"2023-10-25T16:20:54.762654+0000","last_became_peered":"2023-10-25T16:20:54.762654+0000","last_unstale":"2023-10-25T16:20:54.763639+0000","last_undegraded":"2023-10-25T16:20:54.763639+0000","last_fullsized":"2023-10-25T16:20:54.763639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:02.824860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747244+0000","last_change":"2023-10-25T16:20:54.747244+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747244+0000","last_undegraded":"2023-10-25T16:20:54.747244+0000","last_fullsized":"2023-10-25T16:20:54.747244+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763595+0000","last_change":"2023-10-25T16:20:54.763506+0000","last_active":"2023-10-25T16:20:54.763595+0000","last_peered":"2023-10-25T16:20:54.763595+0000","last_clean":"2023-10-25T16:20:54.763595+0000","last_became_active":"2023-10-25T16:20:54.763202+0000","last_became_peered":"2023-10-25T16:20:54.763202+0000","last_unstale":"2023-10-25T16:20:54.763595+0000","last_undegraded":"2023-10-25T16:20:54.763595+0000","last_fullsized":"2023-10-25T16:20:54.763595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:41.174773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755828+0000","last_change":"2023-10-25T16:20:54.755828+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755828+0000","last_undegraded":"2023-10-25T16:20:54.755828+0000","last_fullsized":"2023-10-25T16:20:54.755828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768121+0000","last_change":"2023-10-25T16:20:54.767309+0000","last_active":"2023-10-25T16:20:54.768121+0000","last_peered":"2023-10-25T16:20:54.768121+0000","last_clean":"2023-10-25T16:20:54.768121+0000","last_became_active":"2023-10-25T16:20:54.765724+0000","last_became_peered":"2023-10-25T16:20:54.765724+0000","last_unstale":"2023-10-25T16:20:54.768121+0000","last_undegraded":"2023-10-25T16:20:54.768121+0000","last_fullsized":"2023-10-25T16:20:54.768121+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747603+0000","last_change":"2023-10-25T16:20:54.747603+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747603+0000","last_undegraded":"2023-10-25T16:20:54.747603+0000","last_fullsized":"2023-10-25T16:20:54.747603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771758+0000","last_change":"2023-10-25T16:20:54.771635+0000","last_active":"2023-10-25T16:20:54.771758+0000","last_peered":"2023-10-25T16:20:54.771758+0000","last_clean":"2023-10-25T16:20:54.771758+0000","last_became_active":"2023-10-25T16:20:54.771107+0000","last_became_peered":"2023-10-25T16:20:54.771107+0000","last_unstale":"2023-10-25T16:20:54.771758+0000","last_undegraded":"2023-10-25T16:20:54.771758+0000","last_fullsized":"2023-10-25T16:20:54.771758+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:37:02.197973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:53.713473+0000","last_change":"2023-10-25T16:20:53.713473+0000","last_active":"2023-10-25T16:20:53.713473+0000","last_peered":"2023-10-25T16:20:53.713473+0000","last_clean":"2023-10-25T16:20:53.713473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:53.713473+0000","last_undegraded":"2023-10-25T16:20:53.713473+0000","last_fullsized":"2023-10-25T16:20:53.713473+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754480+0000","last_change":"2023-10-25T16:20:54.754480+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754480+0000","last_undegraded":"2023-10-25T16:20:54.754480+0000","last_fullsized":"2023-10-25T16:20:54.754480+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768377+0000","last_change":"2023-10-25T16:20:54.768310+0000","last_active":"2023-10-25T16:20:54.768377+0000","last_peered":"2023-10-25T16:20:54.768377+0000","last_clean":"2023-10-25T16:20:54.768377+0000","last_became_active":"2023-10-25T16:20:54.768064+0000","last_became_peered":"2023-10-25T16:20:54.768064+0000","last_unstale":"2023-10-25T16:20:54.768377+0000","last_undegraded":"2023-10-25T16:20:54.768377+0000","last_fullsized":"2023-10-25T16:20:54.768377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:37.419589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750032+0000","last_change":"2023-10-25T16:20:54.750032+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750032+0000","last_undegraded":"2023-10-25T16:20:54.750032+0000","last_fullsized":"2023-10-25T16:20:54.750032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771237+0000","last_change":"2023-10-25T16:20:54.771088+0000","last_active":"2023-10-25T16:20:54.771237+0000","last_peered":"2023-10-25T16:20:54.771237+0000","last_clean":"2023-10-25T16:20:54.771237+0000","last_became_active":"2023-10-25T16:20:54.768618+0000","last_became_peered":"2023-10-25T16:20:54.768618+0000","last_unstale":"2023-10-25T16:20:54.771237+0000","last_undegraded":"2023-10-25T16:20:54.771237+0000","last_fullsized":"2023-10-25T16:20:54.771237+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:34.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749605+0000","last_change":"2023-10-25T16:20:54.749605+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749605+0000","last_undegraded":"2023-10-25T16:20:54.749605+0000","last_fullsized":"2023-10-25T16:20:54.749605+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756007+0000","last_change":"2023-10-25T16:20:54.753340+0000","last_active":"2023-10-25T16:20:54.756007+0000","last_peered":"2023-10-25T16:20:54.756007+0000","last_clean":"2023-10-25T16:20:54.756007+0000","last_became_active":"2023-10-25T16:20:54.752315+0000","last_became_peered":"2023-10-25T16:20:54.752315+0000","last_unstale":"2023-10-25T16:20:54.756007+0000","last_undegraded":"2023-10-25T16:20:54.756007+0000","last_fullsized":"2023-10-25T16:20:54.756007+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:53.225075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.745977+0000","last_change":"2023-10-25T16:20:54.745977+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.745977+0000","last_undegraded":"2023-10-25T16:20:54.745977+0000","last_fullsized":"2023-10-25T16:20:54.745977+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764932+0000","last_change":"2023-10-25T16:20:54.764861+0000","last_active":"2023-10-25T16:20:54.764932+0000","last_peered":"2023-10-25T16:20:54.764932+0000","last_clean":"2023-10-25T16:20:54.764932+0000","last_became_active":"2023-10-25T16:20:54.764490+0000","last_became_peered":"2023-10-25T16:20:54.764490+0000","last_unstale":"2023-10-25T16:20:54.764932+0000","last_undegraded":"2023-10-25T16:20:54.764932+0000","last_fullsized":"2023-10-25T16:20:54.764932+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:56.070146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747834+0000","last_change":"2023-10-25T16:20:54.747834+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747834+0000","last_undegraded":"2023-10-25T16:20:54.747834+0000","last_fullsized":"2023-10-25T16:20:54.747834+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758935+0000","last_change":"2023-10-25T16:20:54.758776+0000","last_active":"2023-10-25T16:20:54.758935+0000","last_peered":"2023-10-25T16:20:54.758935+0000","last_clean":"2023-10-25T16:20:54.758935+0000","last_became_active":"2023-10-25T16:20:54.757905+0000","last_became_peered":"2023-10-25T16:20:54.757905+0000","last_unstale":"2023-10-25T16:20:54.758935+0000","last_undegraded":"2023-10-25T16:20:54.758935+0000","last_fullsized":"2023-10-25T16:20:54.758935+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:33.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751602+0000","last_change":"2023-10-25T16:20:54.751602+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751602+0000","last_undegraded":"2023-10-25T16:20:54.751602+0000","last_fullsized":"2023-10-25T16:20:54.751602+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759275+0000","last_change":"2023-10-25T16:20:54.759150+0000","last_active":"2023-10-25T16:20:54.759275+0000","last_peered":"2023-10-25T16:20:54.759275+0000","last_clean":"2023-10-25T16:20:54.759275+0000","last_became_active":"2023-10-25T16:20:54.758491+0000","last_became_peered":"2023-10-25T16:20:54.758491+0000","last_unstale":"2023-10-25T16:20:54.759275+0000","last_undegraded":"2023-10-25T16:20:54.759275+0000","last_fullsized":"2023-10-25T16:20:54.759275+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.769009+0000","last_change":"2023-10-25T16:20:54.768780+0000","last_active":"2023-10-25T16:20:54.769009+0000","last_peered":"2023-10-25T16:20:54.769009+0000","last_clean":"2023-10-25T16:20:54.769009+0000","last_became_active":"2023-10-25T16:20:54.766581+0000","last_became_peered":"2023-10-25T16:20:54.766581+0000","last_unstale":"2023-10-25T16:20:54.769009+0000","last_undegraded":"2023-10-25T16:20:54.769009+0000","last_fullsized":"2023-10-25T16:20:54.769009+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:10.174922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750878+0000","last_change":"2023-10-25T16:20:54.750878+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750878+0000","last_undegraded":"2023-10-25T16:20:54.750878+0000","last_fullsized":"2023-10-25T16:20:54.750878+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763950+0000","last_change":"2023-10-25T16:20:54.763860+0000","last_active":"2023-10-25T16:20:54.763950+0000","last_peered":"2023-10-25T16:20:54.763950+0000","last_clean":"2023-10-25T16:20:54.763950+0000","last_became_active":"2023-10-25T16:20:54.763501+0000","last_became_peered":"2023-10-25T16:20:54.763501+0000","last_unstale":"2023-10-25T16:20:54.763950+0000","last_undegraded":"2023-10-25T16:20:54.763950+0000","last_fullsized":"2023-10-25T16:20:54.763950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:22.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752193+0000","last_change":"2023-10-25T16:20:54.752193+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752193+0000","last_undegraded":"2023-10-25T16:20:54.752193+0000","last_fullsized":"2023-10-25T16:20:54.752193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758910+0000","last_change":"2023-10-25T16:20:54.758838+0000","last_active":"2023-10-25T16:20:54.758910+0000","last_peered":"2023-10-25T16:20:54.758910+0000","last_clean":"2023-10-25T16:20:54.758910+0000","last_became_active":"2023-10-25T16:20:54.758498+0000","last_became_peered":"2023-10-25T16:20:54.758498+0000","last_unstale":"2023-10-25T16:20:54.758910+0000","last_undegraded":"2023-10-25T16:20:54.758910+0000","last_fullsized":"2023-10-25T16:20:54.758910+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:53:55.894845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748055+0000","last_change":"2023-10-25T16:20:54.748055+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748055+0000","last_undegraded":"2023-10-25T16:20:54.748055+0000","last_fullsized":"2023-10-25T16:20:54.748055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763285+0000","last_change":"2023-10-25T16:20:54.763224+0000","last_active":"2023-10-25T16:20:54.763285+0000","last_peered":"2023-10-25T16:20:54.763285+0000","last_clean":"2023-10-25T16:20:54.763285+0000","last_became_active":"2023-10-25T16:20:54.762999+0000","last_became_peered":"2023-10-25T16:20:54.762999+0000","last_unstale":"2023-10-25T16:20:54.763285+0000","last_undegraded":"2023-10-25T16:20:54.763285+0000","last_fullsized":"2023-10-25T16:20:54.763285+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:04.836130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750042+0000","last_change":"2023-10-25T16:20:54.750042+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750042+0000","last_undegraded":"2023-10-25T16:20:54.750042+0000","last_fullsized":"2023-10-25T16:20:54.750042+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:53.713473+0000","last_change":"2023-10-25T16:20:53.713473+0000","last_active":"2023-10-25T16:20:53.713473+0000","last_peered":"2023-10-25T16:20:53.713473+0000","last_clean":"2023-10-25T16:20:53.713473+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:53.713473+0000","last_undegraded":"2023-10-25T16:20:53.713473+0000","last_fullsized":"2023-10-25T16:20:53.713473+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:20:54.724505+0000","last_change":"2023-10-25T16:20:54.724505+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.724505+0000","last_undegraded":"2023-10-25T16:20:54.724505+0000","last_fullsized":"2023-10-25T16:20:54.724505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.762505+0000","last_change":"2023-10-25T16:20:54.762316+0000","last_active":"2023-10-25T16:20:54.762505+0000","last_peered":"2023-10-25T16:20:54.762505+0000","last_clean":"2023-10-25T16:20:54.762505+0000","last_became_active":"2023-10-25T16:20:54.761646+0000","last_became_peered":"2023-10-25T16:20:54.761646+0000","last_unstale":"2023-10-25T16:20:54.762505+0000","last_undegraded":"2023-10-25T16:20:54.762505+0000","last_fullsized":"2023-10-25T16:20:54.762505+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:41:54.859004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751346+0000","last_change":"2023-10-25T16:20:54.751346+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751346+0000","last_undegraded":"2023-10-25T16:20:54.751346+0000","last_fullsized":"2023-10-25T16:20:54.751346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764433+0000","last_change":"2023-10-25T16:20:54.764346+0000","last_active":"2023-10-25T16:20:54.764433+0000","last_peered":"2023-10-25T16:20:54.764433+0000","last_clean":"2023-10-25T16:20:54.764433+0000","last_became_active":"2023-10-25T16:20:54.764007+0000","last_became_peered":"2023-10-25T16:20:54.764007+0000","last_unstale":"2023-10-25T16:20:54.764433+0000","last_undegraded":"2023-10-25T16:20:54.764433+0000","last_fullsized":"2023-10-25T16:20:54.764433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:11:45.618791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750803+0000","last_change":"2023-10-25T16:20:54.750803+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750803+0000","last_undegraded":"2023-10-25T16:20:54.750803+0000","last_fullsized":"2023-10-25T16:20:54.750803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758587+0000","last_change":"2023-10-25T16:20:54.758458+0000","last_active":"2023-10-25T16:20:54.758587+0000","last_peered":"2023-10-25T16:20:54.758587+0000","last_clean":"2023-10-25T16:20:54.758587+0000","last_became_active":"2023-10-25T16:20:54.757860+0000","last_became_peered":"2023-10-25T16:20:54.757860+0000","last_unstale":"2023-10-25T16:20:54.758587+0000","last_undegraded":"2023-10-25T16:20:54.758587+0000","last_fullsized":"2023-10-25T16:20:54.758587+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:44:32.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757000+0000","last_change":"2023-10-25T16:20:54.757000+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757000+0000","last_undegraded":"2023-10-25T16:20:54.757000+0000","last_fullsized":"2023-10-25T16:20:54.757000+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768298+0000","last_change":"2023-10-25T16:20:54.768211+0000","last_active":"2023-10-25T16:20:54.768298+0000","last_peered":"2023-10-25T16:20:54.768298+0000","last_clean":"2023-10-25T16:20:54.768298+0000","last_became_active":"2023-10-25T16:20:54.767978+0000","last_became_peered":"2023-10-25T16:20:54.767978+0000","last_unstale":"2023-10-25T16:20:54.768298+0000","last_undegraded":"2023-10-25T16:20:54.768298+0000","last_fullsized":"2023-10-25T16:20:54.768298+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746378+0000","last_change":"2023-10-25T16:20:54.746378+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746378+0000","last_undegraded":"2023-10-25T16:20:54.746378+0000","last_fullsized":"2023-10-25T16:20:54.746378+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.760066+0000","last_change":"2023-10-25T16:20:54.759883+0000","last_active":"2023-10-25T16:20:54.760066+0000","last_peered":"2023-10-25T16:20:54.760066+0000","last_clean":"2023-10-25T16:20:54.760066+0000","last_became_active":"2023-10-25T16:20:54.758688+0000","last_became_peered":"2023-10-25T16:20:54.758688+0000","last_unstale":"2023-10-25T16:20:54.760066+0000","last_undegraded":"2023-10-25T16:20:54.760066+0000","last_fullsized":"2023-10-25T16:20:54.760066+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:50.541261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747856+0000","last_change":"2023-10-25T16:20:54.747856+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747856+0000","last_undegraded":"2023-10-25T16:20:54.747856+0000","last_fullsized":"2023-10-25T16:20:54.747856+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771883+0000","last_change":"2023-10-25T16:20:54.771822+0000","last_active":"2023-10-25T16:20:54.771883+0000","last_peered":"2023-10-25T16:20:54.771883+0000","last_clean":"2023-10-25T16:20:54.771883+0000","last_became_active":"2023-10-25T16:20:54.771600+0000","last_became_peered":"2023-10-25T16:20:54.771600+0000","last_unstale":"2023-10-25T16:20:54.771883+0000","last_undegraded":"2023-10-25T16:20:54.771883+0000","last_fullsized":"2023-10-25T16:20:54.771883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:16.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754088+0000","last_change":"2023-10-25T16:20:54.754088+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754088+0000","last_undegraded":"2023-10-25T16:20:54.754088+0000","last_fullsized":"2023-10-25T16:20:54.754088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.761233+0000","last_change":"2023-10-25T16:20:54.761148+0000","last_active":"2023-10-25T16:20:54.761233+0000","last_peered":"2023-10-25T16:20:54.761233+0000","last_clean":"2023-10-25T16:20:54.761233+0000","last_became_active":"2023-10-25T16:20:54.760911+0000","last_became_peered":"2023-10-25T16:20:54.760911+0000","last_unstale":"2023-10-25T16:20:54.761233+0000","last_undegraded":"2023-10-25T16:20:54.761233+0000","last_fullsized":"2023-10-25T16:20:54.761233+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:45:31.619997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747278+0000","last_change":"2023-10-25T16:20:54.747278+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747278+0000","last_undegraded":"2023-10-25T16:20:54.747278+0000","last_fullsized":"2023-10-25T16:20:54.747278+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.767060+0000","last_change":"2023-10-25T16:20:54.766906+0000","last_active":"2023-10-25T16:20:54.767060+0000","last_peered":"2023-10-25T16:20:54.767060+0000","last_clean":"2023-10-25T16:20:54.767060+0000","last_became_active":"2023-10-25T16:20:54.753701+0000","last_became_peered":"2023-10-25T16:20:54.753701+0000","last_unstale":"2023-10-25T16:20:54.767060+0000","last_undegraded":"2023-10-25T16:20:54.767060+0000","last_fullsized":"2023-10-25T16:20:54.767060+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:48.379708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-25T16:20:53.724985+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:20:53.724985+0000","last_peered":"2023-10-25T16:20:53.724985+0000","last_clean":"2023-10-25T16:20:53.724985+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:20:53.724985+0000","last_undegraded":"2023-10-25T16:20:53.724985+0000","last_fullsized":"2023-10-25T16:20:53.724985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542242,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154106,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.52900000000000003},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.88200000000000001,"5min":0.94999999999999996,"15min":1.077},"last":0.42999999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66400000000000003,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.1759999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70699999999999996,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":1.159,"5min":1.246,"15min":1.246},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.2729999999999999,"5min":1.345,"15min":1.345},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.94799999999999995,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.45,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.87},"min":{"1min":0.68400000000000005,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.3160000000000001,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.85499999999999998},"min":{"1min":0.74399999999999999,"5min":0.56599999999999995,"15min":0.504},"max":{"1min":1.298,"5min":1.345,"15min":1.4930000000000001},"last":0.499},{"interface":"front","average":{"1min":1.002,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.747,"5min":0.58599999999999997,"15min":0.47899999999999998},"max":{"1min":1.518,"5min":1.671,"15min":1.671},"last":0.57299999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.90700000000000003},"min":{"1min":0.79300000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.95299999999999996,"15min":0.93700000000000006},"min":{"1min":0.73099999999999998,"5min":0.56699999999999995,"15min":0.53000000000000003},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.995,"15min":0.93600000000000005},"min":{"1min":0.71099999999999997,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.226,"5min":1.474,"15min":1.677},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.016,"15min":0.97099999999999997},"min":{"1min":0.69699999999999995,"5min":0.61699999999999999,"15min":0.57999999999999996},"max":{"1min":1.4139999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.61599999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193883,"statfs":{"total":200000000,"available":198536405,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.256,"15min":1.256},"last":1.204},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.534,"15min":1.534},"last":0.73699999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.92700000000000005,"15min":0.89100000000000001},"min":{"1min":0.52800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.647,"15min":1.647},"last":1.129},{"interface":"front","average":{"1min":0.87,"5min":0.95099999999999996,"15min":0.90900000000000003},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":1.2549999999999999,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.877,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.018,"5min":1.27,"15min":1.27},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.86899999999999999,"15min":0.83899999999999997},"min":{"1min":0.60499999999999998,"5min":0.54700000000000004,"15min":0.51800000000000002},"max":{"1min":1.284,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.117,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":0.95099999999999996},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.1950000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0029999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86599999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.177,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93500000000000005,"15min":0.99399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0029999999999999,"15min":1.028},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.323,"5min":1.637,"15min":1.637},"last":0.91400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1000000000000001,"15min":1.1359999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2789999999999999,"5min":1.669,"15min":1.669},"last":1.165},{"interface":"front","average":{"1min":1.038,"5min":1.0980000000000001,"15min":1.117},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.371,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.28}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.353,"5min":1.395,"15min":1.397},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2230000000000001,"5min":1.224,"15min":1.6419999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89500000000000002,"15min":0.88400000000000001},"min":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.2569999999999999,"5min":1.302,"15min":1.302},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2609999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.84999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.88400000000000001},"min":{"1min":0.57599999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.446,"5min":1.4570000000000001,"15min":1.476},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.149}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.046,"15min":1.044},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.367,"5min":1.587,"15min":1.7110000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.411,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.236,"5min":1.444,"15min":1.444},"last":1.048}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.98999999999999999,"15min":0.97299999999999998},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.29,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.054},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.895},"last":1.234}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.105,"15min":1.0860000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.095,"15min":1.05},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.339,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1830000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86699999999999999,"15min":1.242},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":14.843},"last":1.014},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80900000000000005,"15min":1.3380000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1639999999999999,"5min":1.238,"15min":16.439},"last":2.8450000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.88900000000000001,"15min":1.3},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.111,"5min":1.423,"15min":14.630000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.90800000000000003,"15min":0.877},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.399,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.3520000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95399999999999996,"15min":0.94099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.133,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.601},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94199999999999995,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.129,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.234,"5min":1.482,"15min":1.482},"last":1.4950000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0700000000000001,"15min":1.4139999999999999},"min":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.268,"5min":2.194,"15min":14.954000000000001},"last":1.1319999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.006,"15min":1.472},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3129999999999999,"5min":1.5489999999999999,"15min":15.904},"last":1.4399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.4650000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0900000000000001,"5min":1.879,"15min":17.219999999999999},"last":7.9610000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.0289999999999999,"15min":1.401},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2470000000000001,"5min":1.748,"15min":14.567},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.1479999999999999,"15min":1.5880000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.431,"5min":1.657,"15min":15.089},"last":2.4079999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.5720000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2709999999999999,"5min":1.7090000000000001,"15min":17.492000000000001},"last":7.8730000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.121,"15min":1.234},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2410000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":8.6920000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.216,"5min":1.327,"15min":1.47},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1180000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1659999999999999,"15min":1.288},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98099999999999998,"15min":0.95499999999999996},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.208}]},{"osd":2,"last update":"Wed Oct 25 16:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.288,"5min":1.397,"15min":1.419},"last":1.022},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.226,"5min":1.411,"15min":1.411},"last":1.0629999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.91200000000000003},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2849999999999999,"5min":1.5,"15min":1.5},"last":1.133},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84999999999999998,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1339999999999999,"5min":1.518,"15min":1.518},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.48799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.302,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.49,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.97799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.69199999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":2.085,"15min":2.085},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.212,"5min":1.107,"15min":1.0780000000000001},"min":{"1min":0.92500000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.625,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94799999999999995,"15min":0.94599999999999995},"min":{"1min":0.59299999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":1.474,"15min":1.5029999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.135,"15min":1.1180000000000001},"min":{"1min":0.96099999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.0980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.79000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.44500000000000001,"5min":0.25700000000000001,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.077,"15min":1.083},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":1.052,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.109,"5min":1.254,"15min":1.2809999999999999},"last":1.012}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70099999999999996,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.25,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.63900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89900000000000002,"15min":0.92200000000000004},"min":{"1min":0.68100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.5269999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.998,"5min":0.98299999999999998,"15min":0.94699999999999995},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2410000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.64600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.28,"5min":1.306,"15min":1.456},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97799999999999998,"15min":0.997},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.395,"5min":1.395,"15min":1.663},"last":0.88600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.018,"15min":0.98099999999999998},"min":{"1min":0.82399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.5660000000000001},"last":1.123},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.51500000000000001},"max":{"1min":1.212,"5min":1.3480000000000001,"15min":1.389},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.0800000000000001,"5min":1.1539999999999999,"15min":1.4610000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.29499999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":1.129,"15min":1.1990000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98599999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.35399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90100000000000002,"5min":1.2,"15min":1.2},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.749},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0129999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.96199999999999997},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.242,"5min":1.702,"15min":12.698},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95799999999999996,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.2090000000000001,"5min":1.4279999999999999,"15min":12.721},"last":0.998}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.345,"15min":1.546},"last":1.018},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1779999999999999,"5min":2.206,"15min":2.206},"last":1.0509999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95899999999999996,"15min":0.93999999999999995},"min":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.379,"15min":1.4610000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.397,"15min":1.5980000000000001},"last":1.1619999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.60999999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2849999999999999,"5min":1.9410000000000001,"15min":14.776},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.254,"5min":1.476,"15min":10.509},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193889,"statfs":{"total":200000000,"available":198542680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.67800000000000005},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.64300000000000002,"15min":0.68200000000000005},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.3919999999999999,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85499999999999998,"15min":0.81799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.181,"5min":1.407,"15min":3.6579999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.621},{"interface":"front","average":{"1min":1.054,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.77800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94199999999999995,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.97499999999999998,"15min":0.96099999999999997},"min":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.01,"15min":0.98499999999999999},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0109999999999999,"15min":0.94099999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.024,"15min":1.246},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4450000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.2629999999999999},"min":{"1min":0.70699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.282,"5min":1.4410000000000001,"15min":11.622},"last":0.75800000000000001}]}]}],"pool_statfs":[]}} 2023-10-25T16:20:58.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:20:58.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 -- 172.21.15.177:0/147327356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc23014e810 msgr2=0x7fc2300cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 --2- 172.21.15.177:0/147327356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc23014e810 0x7fc2300cbfa0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc2300c9b20 tx=0x7fc22001c7e0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 -- 172.21.15.177:0/147327356 shutdown_connections 2023-10-25T16:20:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 --2- 172.21.15.177:0/147327356 >> v2:172.21.15.184:3300/0 conn(0x7fc23015bdb0 0x7fc2300aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 --2- 172.21.15.177:0/147327356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc23014e810 0x7fc2300cbfa0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 -- 172.21.15.177:0/147327356 >> 172.21.15.177:0/147327356 conn(0x7fc2300b2450 msgr2=0x7fc2300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:58.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 -- 172.21.15.177:0/147327356 shutdown_connections 2023-10-25T16:20:58.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.947+0000 7fc23496c640 1 -- 172.21.15.177:0/147327356 wait complete. 2023-10-25T16:20:58.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 Processor -- start 2023-10-25T16:20:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- start start 2023-10-25T16:20:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 0x7fc230135f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc23014e810 0x7fc2300ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23015bdb0 0x7fc230156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23014ade0 con 0x7fc2300af100 2023-10-25T16:20:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23014b0c0 con 0x7fc23015bdb0 2023-10-25T16:20:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23014b3a0 con 0x7fc23014e810 2023-10-25T16:20:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 0x7fc230135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 0x7fc230135f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37990/0 (socket says 172.21.15.177:37990) 2023-10-25T16:20:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 -- 172.21.15.177:0/1546290999 learned_addr learned my addr 172.21.15.177:0/1546290999 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc227fff640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc23014e810 0x7fc2300ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22ed9d640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23015bdb0 0x7fc230156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 -- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc23014e810 msgr2=0x7fc2300ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc23014e810 0x7fc2300ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 -- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23015bdb0 msgr2=0x7fc230156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23015bdb0 0x7fc230156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 -- 172.21.15.177:0/1546290999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2200094a0 con 0x7fc2300af100 2023-10-25T16:20:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc22e59c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 0x7fc230135f50 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fc22001ae90 tx=0x7fc2200aaa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:58.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200b8070 con 0x7fc2300af100 2023-10-25T16:20:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2200aac70 con 0x7fc2300af100 2023-10-25T16:20:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23014b680 con 0x7fc2300af100 2023-10-25T16:20:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220004020 con 0x7fc2300af100 2023-10-25T16:20:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23014aa00 con 0x7fc2300af100 2023-10-25T16:20:58.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.951+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23004daf0 con 0x7fc2300af100 2023-10-25T16:20:58.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.955+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc220004180 con 0x7fc2300af100 2023-10-25T16:20:58.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.955+0000 7fc226ffd640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc210066470 0x7fc210068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:58.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.955+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc22011ea50 con 0x7fc2300af100 2023-10-25T16:20:58.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.955+0000 7fc227fff640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc210066470 0x7fc210068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:58.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.955+0000 7fc227fff640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc210066470 0x7fc210068930 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc23014c1f0 tx=0x7fc218008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:58.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:58.959+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2200ec160 con 0x7fc2300af100 2023-10-25T16:20:59.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.095+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc230158d70 con 0x7fc210066470 2023-10-25T16:20:59.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc226ffd640 1 -- 172.21.15.177:0/1546290999 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279288 (secure 0 0 0) 0x7fc230158d70 con 0x7fc210066470 2023-10-25T16:20:59.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:59.119 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:20:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc210066470 msgr2=0x7fc210068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc210066470 0x7fc210068930 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc23014c1f0 tx=0x7fc218008040 comp rx=0 tx=0).stop 2023-10-25T16:20:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 msgr2=0x7fc230135f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 0x7fc230135f50 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fc22001ae90 tx=0x7fc2200aaa80 comp rx=0 tx=0).stop 2023-10-25T16:20:59.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 shutdown_connections 2023-10-25T16:20:59.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc210066470 0x7fc210068930 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23015bdb0 0x7fc230156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc23014e810 0x7fc2300ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 --2- 172.21.15.177:0/1546290999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2300af100 0x7fc230135f50 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.119+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 >> 172.21.15.177:0/1546290999 conn(0x7fc2300b2450 msgr2=0x7fc2300cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:59.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.123+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 shutdown_connections 2023-10-25T16:20:59.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.123+0000 7fc23496c640 1 -- 172.21.15.177:0/1546290999 wait complete. 2023-10-25T16:20:59.135 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-25T16:20:58.772102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554554,"statfs":{"total":1600000000,"available":1591863707,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.047330"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.780088+0000","last_change":"2023-10-25T16:20:55.780004+0000","last_active":"2023-10-25T16:20:55.780088+0000","last_peered":"2023-10-25T16:20:55.780088+0000","last_clean":"2023-10-25T16:20:55.780088+0000","last_became_active":"2023-10-25T16:20:55.779374+0000","last_became_peered":"2023-10-25T16:20:55.779374+0000","last_unstale":"2023-10-25T16:20:55.780088+0000","last_undegraded":"2023-10-25T16:20:55.780088+0000","last_fullsized":"2023-10-25T16:20:55.780088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:16:34.694815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751716+0000","last_change":"2023-10-25T16:20:54.751716+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751716+0000","last_undegraded":"2023-10-25T16:20:54.751716+0000","last_fullsized":"2023-10-25T16:20:54.751716+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754600+0000","last_change":"2023-10-25T16:20:54.754600+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754600+0000","last_undegraded":"2023-10-25T16:20:54.754600+0000","last_fullsized":"2023-10-25T16:20:54.754600+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.776968+0000","last_change":"2023-10-25T16:20:55.776769+0000","last_active":"2023-10-25T16:20:55.776968+0000","last_peered":"2023-10-25T16:20:55.776968+0000","last_clean":"2023-10-25T16:20:55.776968+0000","last_became_active":"2023-10-25T16:20:55.774636+0000","last_became_peered":"2023-10-25T16:20:55.774636+0000","last_unstale":"2023-10-25T16:20:55.776968+0000","last_undegraded":"2023-10-25T16:20:55.776968+0000","last_fullsized":"2023-10-25T16:20:55.776968+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:39:58.917721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755873+0000","last_change":"2023-10-25T16:20:54.755873+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755873+0000","last_undegraded":"2023-10-25T16:20:54.755873+0000","last_fullsized":"2023-10-25T16:20:54.755873+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752156+0000","last_change":"2023-10-25T16:20:54.752156+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752156+0000","last_undegraded":"2023-10-25T16:20:54.752156+0000","last_fullsized":"2023-10-25T16:20:54.752156+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751457+0000","last_change":"2023-10-25T16:20:54.751457+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751457+0000","last_undegraded":"2023-10-25T16:20:54.751457+0000","last_fullsized":"2023-10-25T16:20:54.751457+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753766+0000","last_change":"2023-10-25T16:20:54.753766+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753766+0000","last_undegraded":"2023-10-25T16:20:54.753766+0000","last_fullsized":"2023-10-25T16:20:54.753766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755962+0000","last_change":"2023-10-25T16:20:54.755962+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755962+0000","last_undegraded":"2023-10-25T16:20:54.755962+0000","last_fullsized":"2023-10-25T16:20:54.755962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752774+0000","last_change":"2023-10-25T16:20:54.752774+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752774+0000","last_undegraded":"2023-10-25T16:20:54.752774+0000","last_fullsized":"2023-10-25T16:20:54.752774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750691+0000","last_change":"2023-10-25T16:20:54.750691+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750691+0000","last_undegraded":"2023-10-25T16:20:54.750691+0000","last_fullsized":"2023-10-25T16:20:54.750691+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750855+0000","last_change":"2023-10-25T16:20:54.750855+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750855+0000","last_undegraded":"2023-10-25T16:20:54.750855+0000","last_fullsized":"2023-10-25T16:20:54.750855+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772630+0000","last_change":"2023-10-25T16:20:55.772466+0000","last_active":"2023-10-25T16:20:55.772630+0000","last_peered":"2023-10-25T16:20:55.772630+0000","last_clean":"2023-10-25T16:20:55.772630+0000","last_became_active":"2023-10-25T16:20:55.771742+0000","last_became_peered":"2023-10-25T16:20:55.771742+0000","last_unstale":"2023-10-25T16:20:55.772630+0000","last_undegraded":"2023-10-25T16:20:55.772630+0000","last_fullsized":"2023-10-25T16:20:55.772630+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:23:11.762083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751538+0000","last_change":"2023-10-25T16:20:54.751538+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751538+0000","last_undegraded":"2023-10-25T16:20:54.751538+0000","last_fullsized":"2023-10-25T16:20:54.751538+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.783023+0000","last_change":"2023-10-25T16:20:55.782883+0000","last_active":"2023-10-25T16:20:55.783023+0000","last_peered":"2023-10-25T16:20:55.783023+0000","last_clean":"2023-10-25T16:20:55.783023+0000","last_became_active":"2023-10-25T16:20:55.782144+0000","last_became_peered":"2023-10-25T16:20:55.782144+0000","last_unstale":"2023-10-25T16:20:55.783023+0000","last_undegraded":"2023-10-25T16:20:55.783023+0000","last_fullsized":"2023-10-25T16:20:55.783023+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:30:51.670014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748570+0000","last_change":"2023-10-25T16:20:54.748570+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748570+0000","last_undegraded":"2023-10-25T16:20:54.748570+0000","last_fullsized":"2023-10-25T16:20:54.748570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749669+0000","last_change":"2023-10-25T16:20:54.749669+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749669+0000","last_undegraded":"2023-10-25T16:20:54.749669+0000","last_fullsized":"2023-10-25T16:20:54.749669+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748618+0000","last_change":"2023-10-25T16:20:54.748618+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748618+0000","last_undegraded":"2023-10-25T16:20:54.748618+0000","last_fullsized":"2023-10-25T16:20:54.748618+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753051+0000","last_change":"2023-10-25T16:20:54.753051+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753051+0000","last_undegraded":"2023-10-25T16:20:54.753051+0000","last_fullsized":"2023-10-25T16:20:54.753051+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748660+0000","last_change":"2023-10-25T16:20:54.748660+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748660+0000","last_undegraded":"2023-10-25T16:20:54.748660+0000","last_fullsized":"2023-10-25T16:20:54.748660+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757935+0000","last_change":"2023-10-25T16:20:54.757935+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757935+0000","last_undegraded":"2023-10-25T16:20:54.757935+0000","last_fullsized":"2023-10-25T16:20:54.757935+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749462+0000","last_change":"2023-10-25T16:20:54.749462+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749462+0000","last_undegraded":"2023-10-25T16:20:54.749462+0000","last_fullsized":"2023-10-25T16:20:54.749462+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752341+0000","last_change":"2023-10-25T16:20:54.752341+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752341+0000","last_undegraded":"2023-10-25T16:20:54.752341+0000","last_fullsized":"2023-10-25T16:20:54.752341+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752700+0000","last_change":"2023-10-25T16:20:54.752700+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752700+0000","last_undegraded":"2023-10-25T16:20:54.752700+0000","last_fullsized":"2023-10-25T16:20:54.752700+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752357+0000","last_change":"2023-10-25T16:20:54.752357+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752357+0000","last_undegraded":"2023-10-25T16:20:54.752357+0000","last_fullsized":"2023-10-25T16:20:54.752357+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747818+0000","last_change":"2023-10-25T16:20:54.747818+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747818+0000","last_undegraded":"2023-10-25T16:20:54.747818+0000","last_fullsized":"2023-10-25T16:20:54.747818+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.787336+0000","last_change":"2023-10-25T16:20:55.787260+0000","last_active":"2023-10-25T16:20:55.787336+0000","last_peered":"2023-10-25T16:20:55.787336+0000","last_clean":"2023-10-25T16:20:55.787336+0000","last_became_active":"2023-10-25T16:20:55.786974+0000","last_became_peered":"2023-10-25T16:20:55.786974+0000","last_unstale":"2023-10-25T16:20:55.787336+0000","last_undegraded":"2023-10-25T16:20:55.787336+0000","last_fullsized":"2023-10-25T16:20:55.787336+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:08.864443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746049+0000","last_change":"2023-10-25T16:20:54.746049+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746049+0000","last_undegraded":"2023-10-25T16:20:54.746049+0000","last_fullsized":"2023-10-25T16:20:54.746049+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.783735+0000","last_change":"2023-10-25T16:20:55.783671+0000","last_active":"2023-10-25T16:20:55.783735+0000","last_peered":"2023-10-25T16:20:55.783735+0000","last_clean":"2023-10-25T16:20:55.783735+0000","last_became_active":"2023-10-25T16:20:55.783323+0000","last_became_peered":"2023-10-25T16:20:55.783323+0000","last_unstale":"2023-10-25T16:20:55.783735+0000","last_undegraded":"2023-10-25T16:20:55.783735+0000","last_fullsized":"2023-10-25T16:20:55.783735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:42.879285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.778841+0000","last_change":"2023-10-25T16:20:55.778429+0000","last_active":"2023-10-25T16:20:55.778841+0000","last_peered":"2023-10-25T16:20:55.778841+0000","last_clean":"2023-10-25T16:20:55.778841+0000","last_became_active":"2023-10-25T16:20:55.777725+0000","last_became_peered":"2023-10-25T16:20:55.777725+0000","last_unstale":"2023-10-25T16:20:55.778841+0000","last_undegraded":"2023-10-25T16:20:55.778841+0000","last_fullsized":"2023-10-25T16:20:55.778841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:01:26.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757166+0000","last_change":"2023-10-25T16:20:54.757166+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757166+0000","last_undegraded":"2023-10-25T16:20:54.757166+0000","last_fullsized":"2023-10-25T16:20:54.757166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750554+0000","last_change":"2023-10-25T16:20:54.750554+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750554+0000","last_undegraded":"2023-10-25T16:20:54.750554+0000","last_fullsized":"2023-10-25T16:20:54.750554+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748228+0000","last_change":"2023-10-25T16:20:54.748228+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748228+0000","last_undegraded":"2023-10-25T16:20:54.748228+0000","last_fullsized":"2023-10-25T16:20:54.748228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.751054+0000","last_change":"2023-10-25T16:20:54.750779+0000","last_active":"2023-10-25T16:20:54.751054+0000","last_peered":"2023-10-25T16:20:54.751054+0000","last_clean":"2023-10-25T16:20:54.751054+0000","last_became_active":"2023-10-25T16:20:54.750091+0000","last_became_peered":"2023-10-25T16:20:54.750091+0000","last_unstale":"2023-10-25T16:20:54.751054+0000","last_undegraded":"2023-10-25T16:20:54.751054+0000","last_fullsized":"2023-10-25T16:20:54.751054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:25:27.972269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753123+0000","last_change":"2023-10-25T16:20:54.753123+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753123+0000","last_undegraded":"2023-10-25T16:20:54.753123+0000","last_fullsized":"2023-10-25T16:20:54.753123+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759359+0000","last_change":"2023-10-25T16:20:54.759191+0000","last_active":"2023-10-25T16:20:54.759359+0000","last_peered":"2023-10-25T16:20:54.759359+0000","last_clean":"2023-10-25T16:20:54.759359+0000","last_became_active":"2023-10-25T16:20:54.758654+0000","last_became_peered":"2023-10-25T16:20:54.758654+0000","last_unstale":"2023-10-25T16:20:54.759359+0000","last_undegraded":"2023-10-25T16:20:54.759359+0000","last_fullsized":"2023-10-25T16:20:54.759359+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748190+0000","last_change":"2023-10-25T16:20:54.748190+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748190+0000","last_undegraded":"2023-10-25T16:20:54.748190+0000","last_fullsized":"2023-10-25T16:20:54.748190+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758560+0000","last_change":"2023-10-25T16:20:54.758266+0000","last_active":"2023-10-25T16:20:54.758560+0000","last_peered":"2023-10-25T16:20:54.758560+0000","last_clean":"2023-10-25T16:20:54.758560+0000","last_became_active":"2023-10-25T16:20:54.757497+0000","last_became_peered":"2023-10-25T16:20:54.757497+0000","last_unstale":"2023-10-25T16:20:54.758560+0000","last_undegraded":"2023-10-25T16:20:54.758560+0000","last_fullsized":"2023-10-25T16:20:54.758560+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:29:33.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755084+0000","last_change":"2023-10-25T16:20:54.755084+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755084+0000","last_undegraded":"2023-10-25T16:20:54.755084+0000","last_fullsized":"2023-10-25T16:20:54.755084+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756647+0000","last_change":"2023-10-25T16:20:54.756559+0000","last_active":"2023-10-25T16:20:54.756647+0000","last_peered":"2023-10-25T16:20:54.756647+0000","last_clean":"2023-10-25T16:20:54.756647+0000","last_became_active":"2023-10-25T16:20:54.756240+0000","last_became_peered":"2023-10-25T16:20:54.756240+0000","last_unstale":"2023-10-25T16:20:54.756647+0000","last_undegraded":"2023-10-25T16:20:54.756647+0000","last_fullsized":"2023-10-25T16:20:54.756647+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748171+0000","last_change":"2023-10-25T16:20:54.748171+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748171+0000","last_undegraded":"2023-10-25T16:20:54.748171+0000","last_fullsized":"2023-10-25T16:20:54.748171+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.754257+0000","last_change":"2023-10-25T16:20:54.753168+0000","last_active":"2023-10-25T16:20:54.754257+0000","last_peered":"2023-10-25T16:20:54.754257+0000","last_clean":"2023-10-25T16:20:54.754257+0000","last_became_active":"2023-10-25T16:20:54.752919+0000","last_became_peered":"2023-10-25T16:20:54.752919+0000","last_unstale":"2023-10-25T16:20:54.754257+0000","last_undegraded":"2023-10-25T16:20:54.754257+0000","last_fullsized":"2023-10-25T16:20:54.754257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:18.896946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748577+0000","last_change":"2023-10-25T16:20:54.748577+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748577+0000","last_undegraded":"2023-10-25T16:20:54.748577+0000","last_fullsized":"2023-10-25T16:20:54.748577+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.755685+0000","last_change":"2023-10-25T16:20:54.755598+0000","last_active":"2023-10-25T16:20:54.755685+0000","last_peered":"2023-10-25T16:20:54.755685+0000","last_clean":"2023-10-25T16:20:54.755685+0000","last_became_active":"2023-10-25T16:20:54.755185+0000","last_became_peered":"2023-10-25T16:20:54.755185+0000","last_unstale":"2023-10-25T16:20:54.755685+0000","last_undegraded":"2023-10-25T16:20:54.755685+0000","last_fullsized":"2023-10-25T16:20:54.755685+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:17:00.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751297+0000","last_change":"2023-10-25T16:20:54.751297+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751297+0000","last_undegraded":"2023-10-25T16:20:54.751297+0000","last_fullsized":"2023-10-25T16:20:54.751297+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.765707+0000","last_change":"2023-10-25T16:20:54.765552+0000","last_active":"2023-10-25T16:20:54.765707+0000","last_peered":"2023-10-25T16:20:54.765707+0000","last_clean":"2023-10-25T16:20:54.765707+0000","last_became_active":"2023-10-25T16:20:54.764892+0000","last_became_peered":"2023-10-25T16:20:54.764892+0000","last_unstale":"2023-10-25T16:20:54.765707+0000","last_undegraded":"2023-10-25T16:20:54.765707+0000","last_fullsized":"2023-10-25T16:20:54.765707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:24.555799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750998+0000","last_change":"2023-10-25T16:20:54.750998+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750998+0000","last_undegraded":"2023-10-25T16:20:54.750998+0000","last_fullsized":"2023-10-25T16:20:54.750998+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763711+0000","last_change":"2023-10-25T16:20:54.763630+0000","last_active":"2023-10-25T16:20:54.763711+0000","last_peered":"2023-10-25T16:20:54.763711+0000","last_clean":"2023-10-25T16:20:54.763711+0000","last_became_active":"2023-10-25T16:20:54.763250+0000","last_became_peered":"2023-10-25T16:20:54.763250+0000","last_unstale":"2023-10-25T16:20:54.763711+0000","last_undegraded":"2023-10-25T16:20:54.763711+0000","last_fullsized":"2023-10-25T16:20:54.763711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.773342+0000","last_change":"2023-10-25T16:20:55.773192+0000","last_active":"2023-10-25T16:20:55.773342+0000","last_peered":"2023-10-25T16:20:55.773342+0000","last_clean":"2023-10-25T16:20:55.773342+0000","last_became_active":"2023-10-25T16:20:55.771716+0000","last_became_peered":"2023-10-25T16:20:55.771716+0000","last_unstale":"2023-10-25T16:20:55.773342+0000","last_undegraded":"2023-10-25T16:20:55.773342+0000","last_fullsized":"2023-10-25T16:20:55.773342+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:54:01.767510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763639+0000","last_change":"2023-10-25T16:20:54.763382+0000","last_active":"2023-10-25T16:20:54.763639+0000","last_peered":"2023-10-25T16:20:54.763639+0000","last_clean":"2023-10-25T16:20:54.763639+0000","last_became_active":"2023-10-25T16:20:54.762654+0000","last_became_peered":"2023-10-25T16:20:54.762654+0000","last_unstale":"2023-10-25T16:20:54.763639+0000","last_undegraded":"2023-10-25T16:20:54.763639+0000","last_fullsized":"2023-10-25T16:20:54.763639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:02.824860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747244+0000","last_change":"2023-10-25T16:20:54.747244+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747244+0000","last_undegraded":"2023-10-25T16:20:54.747244+0000","last_fullsized":"2023-10-25T16:20:54.747244+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763595+0000","last_change":"2023-10-25T16:20:54.763506+0000","last_active":"2023-10-25T16:20:54.763595+0000","last_peered":"2023-10-25T16:20:54.763595+0000","last_clean":"2023-10-25T16:20:54.763595+0000","last_became_active":"2023-10-25T16:20:54.763202+0000","last_became_peered":"2023-10-25T16:20:54.763202+0000","last_unstale":"2023-10-25T16:20:54.763595+0000","last_undegraded":"2023-10-25T16:20:54.763595+0000","last_fullsized":"2023-10-25T16:20:54.763595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:41.174773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755828+0000","last_change":"2023-10-25T16:20:54.755828+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755828+0000","last_undegraded":"2023-10-25T16:20:54.755828+0000","last_fullsized":"2023-10-25T16:20:54.755828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768121+0000","last_change":"2023-10-25T16:20:54.767309+0000","last_active":"2023-10-25T16:20:54.768121+0000","last_peered":"2023-10-25T16:20:54.768121+0000","last_clean":"2023-10-25T16:20:54.768121+0000","last_became_active":"2023-10-25T16:20:54.765724+0000","last_became_peered":"2023-10-25T16:20:54.765724+0000","last_unstale":"2023-10-25T16:20:54.768121+0000","last_undegraded":"2023-10-25T16:20:54.768121+0000","last_fullsized":"2023-10-25T16:20:54.768121+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747603+0000","last_change":"2023-10-25T16:20:54.747603+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747603+0000","last_undegraded":"2023-10-25T16:20:54.747603+0000","last_fullsized":"2023-10-25T16:20:54.747603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771758+0000","last_change":"2023-10-25T16:20:54.771635+0000","last_active":"2023-10-25T16:20:54.771758+0000","last_peered":"2023-10-25T16:20:54.771758+0000","last_clean":"2023-10-25T16:20:54.771758+0000","last_became_active":"2023-10-25T16:20:54.771107+0000","last_became_peered":"2023-10-25T16:20:54.771107+0000","last_unstale":"2023-10-25T16:20:54.771758+0000","last_undegraded":"2023-10-25T16:20:54.771758+0000","last_fullsized":"2023-10-25T16:20:54.771758+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:37:02.197973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772582+0000","last_change":"2023-10-25T16:20:55.772121+0000","last_active":"2023-10-25T16:20:55.772582+0000","last_peered":"2023-10-25T16:20:55.772582+0000","last_clean":"2023-10-25T16:20:55.772582+0000","last_became_active":"2023-10-25T16:20:55.771504+0000","last_became_peered":"2023-10-25T16:20:55.771504+0000","last_unstale":"2023-10-25T16:20:55.772582+0000","last_undegraded":"2023-10-25T16:20:55.772582+0000","last_fullsized":"2023-10-25T16:20:55.772582+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:25.410199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772708+0000","last_change":"2023-10-25T16:20:54.759691+0000","last_active":"2023-10-25T16:20:55.772708+0000","last_peered":"2023-10-25T16:20:55.772708+0000","last_clean":"2023-10-25T16:20:55.772708+0000","last_became_active":"2023-10-25T16:20:54.759459+0000","last_became_peered":"2023-10-25T16:20:54.759459+0000","last_unstale":"2023-10-25T16:20:55.772708+0000","last_undegraded":"2023-10-25T16:20:55.772708+0000","last_fullsized":"2023-10-25T16:20:55.772708+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:24:39.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754480+0000","last_change":"2023-10-25T16:20:54.754480+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754480+0000","last_undegraded":"2023-10-25T16:20:54.754480+0000","last_fullsized":"2023-10-25T16:20:54.754480+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768377+0000","last_change":"2023-10-25T16:20:54.768310+0000","last_active":"2023-10-25T16:20:54.768377+0000","last_peered":"2023-10-25T16:20:54.768377+0000","last_clean":"2023-10-25T16:20:54.768377+0000","last_became_active":"2023-10-25T16:20:54.768064+0000","last_became_peered":"2023-10-25T16:20:54.768064+0000","last_unstale":"2023-10-25T16:20:54.768377+0000","last_undegraded":"2023-10-25T16:20:54.768377+0000","last_fullsized":"2023-10-25T16:20:54.768377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:37.419589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750032+0000","last_change":"2023-10-25T16:20:54.750032+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750032+0000","last_undegraded":"2023-10-25T16:20:54.750032+0000","last_fullsized":"2023-10-25T16:20:54.750032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771237+0000","last_change":"2023-10-25T16:20:54.771088+0000","last_active":"2023-10-25T16:20:54.771237+0000","last_peered":"2023-10-25T16:20:54.771237+0000","last_clean":"2023-10-25T16:20:54.771237+0000","last_became_active":"2023-10-25T16:20:54.768618+0000","last_became_peered":"2023-10-25T16:20:54.768618+0000","last_unstale":"2023-10-25T16:20:54.771237+0000","last_undegraded":"2023-10-25T16:20:54.771237+0000","last_fullsized":"2023-10-25T16:20:54.771237+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:34.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749605+0000","last_change":"2023-10-25T16:20:54.749605+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749605+0000","last_undegraded":"2023-10-25T16:20:54.749605+0000","last_fullsized":"2023-10-25T16:20:54.749605+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756007+0000","last_change":"2023-10-25T16:20:54.753340+0000","last_active":"2023-10-25T16:20:54.756007+0000","last_peered":"2023-10-25T16:20:54.756007+0000","last_clean":"2023-10-25T16:20:54.756007+0000","last_became_active":"2023-10-25T16:20:54.752315+0000","last_became_peered":"2023-10-25T16:20:54.752315+0000","last_unstale":"2023-10-25T16:20:54.756007+0000","last_undegraded":"2023-10-25T16:20:54.756007+0000","last_fullsized":"2023-10-25T16:20:54.756007+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:53.225075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.745977+0000","last_change":"2023-10-25T16:20:54.745977+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.745977+0000","last_undegraded":"2023-10-25T16:20:54.745977+0000","last_fullsized":"2023-10-25T16:20:54.745977+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764932+0000","last_change":"2023-10-25T16:20:54.764861+0000","last_active":"2023-10-25T16:20:54.764932+0000","last_peered":"2023-10-25T16:20:54.764932+0000","last_clean":"2023-10-25T16:20:54.764932+0000","last_became_active":"2023-10-25T16:20:54.764490+0000","last_became_peered":"2023-10-25T16:20:54.764490+0000","last_unstale":"2023-10-25T16:20:54.764932+0000","last_undegraded":"2023-10-25T16:20:54.764932+0000","last_fullsized":"2023-10-25T16:20:54.764932+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:56.070146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747834+0000","last_change":"2023-10-25T16:20:54.747834+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747834+0000","last_undegraded":"2023-10-25T16:20:54.747834+0000","last_fullsized":"2023-10-25T16:20:54.747834+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758935+0000","last_change":"2023-10-25T16:20:54.758776+0000","last_active":"2023-10-25T16:20:54.758935+0000","last_peered":"2023-10-25T16:20:54.758935+0000","last_clean":"2023-10-25T16:20:54.758935+0000","last_became_active":"2023-10-25T16:20:54.757905+0000","last_became_peered":"2023-10-25T16:20:54.757905+0000","last_unstale":"2023-10-25T16:20:54.758935+0000","last_undegraded":"2023-10-25T16:20:54.758935+0000","last_fullsized":"2023-10-25T16:20:54.758935+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:33.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751602+0000","last_change":"2023-10-25T16:20:54.751602+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751602+0000","last_undegraded":"2023-10-25T16:20:54.751602+0000","last_fullsized":"2023-10-25T16:20:54.751602+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759275+0000","last_change":"2023-10-25T16:20:54.759150+0000","last_active":"2023-10-25T16:20:54.759275+0000","last_peered":"2023-10-25T16:20:54.759275+0000","last_clean":"2023-10-25T16:20:54.759275+0000","last_became_active":"2023-10-25T16:20:54.758491+0000","last_became_peered":"2023-10-25T16:20:54.758491+0000","last_unstale":"2023-10-25T16:20:54.759275+0000","last_undegraded":"2023-10-25T16:20:54.759275+0000","last_fullsized":"2023-10-25T16:20:54.759275+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.778146+0000","last_change":"2023-10-25T16:20:55.777794+0000","last_active":"2023-10-25T16:20:55.778146+0000","last_peered":"2023-10-25T16:20:55.778146+0000","last_clean":"2023-10-25T16:20:55.778146+0000","last_became_active":"2023-10-25T16:20:55.776081+0000","last_became_peered":"2023-10-25T16:20:55.776081+0000","last_unstale":"2023-10-25T16:20:55.778146+0000","last_undegraded":"2023-10-25T16:20:55.778146+0000","last_fullsized":"2023-10-25T16:20:55.778146+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:25:37.942080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.769009+0000","last_change":"2023-10-25T16:20:54.768780+0000","last_active":"2023-10-25T16:20:54.769009+0000","last_peered":"2023-10-25T16:20:54.769009+0000","last_clean":"2023-10-25T16:20:54.769009+0000","last_became_active":"2023-10-25T16:20:54.766581+0000","last_became_peered":"2023-10-25T16:20:54.766581+0000","last_unstale":"2023-10-25T16:20:54.769009+0000","last_undegraded":"2023-10-25T16:20:54.769009+0000","last_fullsized":"2023-10-25T16:20:54.769009+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:10.174922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750878+0000","last_change":"2023-10-25T16:20:54.750878+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750878+0000","last_undegraded":"2023-10-25T16:20:54.750878+0000","last_fullsized":"2023-10-25T16:20:54.750878+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763950+0000","last_change":"2023-10-25T16:20:54.763860+0000","last_active":"2023-10-25T16:20:54.763950+0000","last_peered":"2023-10-25T16:20:54.763950+0000","last_clean":"2023-10-25T16:20:54.763950+0000","last_became_active":"2023-10-25T16:20:54.763501+0000","last_became_peered":"2023-10-25T16:20:54.763501+0000","last_unstale":"2023-10-25T16:20:54.763950+0000","last_undegraded":"2023-10-25T16:20:54.763950+0000","last_fullsized":"2023-10-25T16:20:54.763950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:22.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752193+0000","last_change":"2023-10-25T16:20:54.752193+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752193+0000","last_undegraded":"2023-10-25T16:20:54.752193+0000","last_fullsized":"2023-10-25T16:20:54.752193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758910+0000","last_change":"2023-10-25T16:20:54.758838+0000","last_active":"2023-10-25T16:20:54.758910+0000","last_peered":"2023-10-25T16:20:54.758910+0000","last_clean":"2023-10-25T16:20:54.758910+0000","last_became_active":"2023-10-25T16:20:54.758498+0000","last_became_peered":"2023-10-25T16:20:54.758498+0000","last_unstale":"2023-10-25T16:20:54.758910+0000","last_undegraded":"2023-10-25T16:20:54.758910+0000","last_fullsized":"2023-10-25T16:20:54.758910+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:53:55.894845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748055+0000","last_change":"2023-10-25T16:20:54.748055+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748055+0000","last_undegraded":"2023-10-25T16:20:54.748055+0000","last_fullsized":"2023-10-25T16:20:54.748055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763285+0000","last_change":"2023-10-25T16:20:54.763224+0000","last_active":"2023-10-25T16:20:54.763285+0000","last_peered":"2023-10-25T16:20:54.763285+0000","last_clean":"2023-10-25T16:20:54.763285+0000","last_became_active":"2023-10-25T16:20:54.762999+0000","last_became_peered":"2023-10-25T16:20:54.762999+0000","last_unstale":"2023-10-25T16:20:54.763285+0000","last_undegraded":"2023-10-25T16:20:54.763285+0000","last_fullsized":"2023-10-25T16:20:54.763285+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:04.836130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750042+0000","last_change":"2023-10-25T16:20:54.750042+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750042+0000","last_undegraded":"2023-10-25T16:20:54.750042+0000","last_fullsized":"2023-10-25T16:20:54.750042+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.797974+0000","last_change":"2023-10-25T16:20:54.769664+0000","last_active":"2023-10-25T16:20:55.797974+0000","last_peered":"2023-10-25T16:20:55.797974+0000","last_clean":"2023-10-25T16:20:55.797974+0000","last_became_active":"2023-10-25T16:20:54.769387+0000","last_became_peered":"2023-10-25T16:20:54.769387+0000","last_unstale":"2023-10-25T16:20:55.797974+0000","last_undegraded":"2023-10-25T16:20:55.797974+0000","last_fullsized":"2023-10-25T16:20:55.797974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:51.170554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.776948+0000","last_change":"2023-10-25T16:20:55.773589+0000","last_active":"2023-10-25T16:20:55.776948+0000","last_peered":"2023-10-25T16:20:55.776948+0000","last_clean":"2023-10-25T16:20:55.776948+0000","last_became_active":"2023-10-25T16:20:55.772463+0000","last_became_peered":"2023-10-25T16:20:55.772463+0000","last_unstale":"2023-10-25T16:20:55.776948+0000","last_undegraded":"2023-10-25T16:20:55.776948+0000","last_fullsized":"2023-10-25T16:20:55.776948+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:31:53.486815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.762505+0000","last_change":"2023-10-25T16:20:54.762316+0000","last_active":"2023-10-25T16:20:54.762505+0000","last_peered":"2023-10-25T16:20:54.762505+0000","last_clean":"2023-10-25T16:20:54.762505+0000","last_became_active":"2023-10-25T16:20:54.761646+0000","last_became_peered":"2023-10-25T16:20:54.761646+0000","last_unstale":"2023-10-25T16:20:54.762505+0000","last_undegraded":"2023-10-25T16:20:54.762505+0000","last_fullsized":"2023-10-25T16:20:54.762505+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:41:54.859004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751346+0000","last_change":"2023-10-25T16:20:54.751346+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751346+0000","last_undegraded":"2023-10-25T16:20:54.751346+0000","last_fullsized":"2023-10-25T16:20:54.751346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764433+0000","last_change":"2023-10-25T16:20:54.764346+0000","last_active":"2023-10-25T16:20:54.764433+0000","last_peered":"2023-10-25T16:20:54.764433+0000","last_clean":"2023-10-25T16:20:54.764433+0000","last_became_active":"2023-10-25T16:20:54.764007+0000","last_became_peered":"2023-10-25T16:20:54.764007+0000","last_unstale":"2023-10-25T16:20:54.764433+0000","last_undegraded":"2023-10-25T16:20:54.764433+0000","last_fullsized":"2023-10-25T16:20:54.764433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:11:45.618791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750803+0000","last_change":"2023-10-25T16:20:54.750803+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750803+0000","last_undegraded":"2023-10-25T16:20:54.750803+0000","last_fullsized":"2023-10-25T16:20:54.750803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758587+0000","last_change":"2023-10-25T16:20:54.758458+0000","last_active":"2023-10-25T16:20:54.758587+0000","last_peered":"2023-10-25T16:20:54.758587+0000","last_clean":"2023-10-25T16:20:54.758587+0000","last_became_active":"2023-10-25T16:20:54.757860+0000","last_became_peered":"2023-10-25T16:20:54.757860+0000","last_unstale":"2023-10-25T16:20:54.758587+0000","last_undegraded":"2023-10-25T16:20:54.758587+0000","last_fullsized":"2023-10-25T16:20:54.758587+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:44:32.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757000+0000","last_change":"2023-10-25T16:20:54.757000+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757000+0000","last_undegraded":"2023-10-25T16:20:54.757000+0000","last_fullsized":"2023-10-25T16:20:54.757000+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768298+0000","last_change":"2023-10-25T16:20:54.768211+0000","last_active":"2023-10-25T16:20:54.768298+0000","last_peered":"2023-10-25T16:20:54.768298+0000","last_clean":"2023-10-25T16:20:54.768298+0000","last_became_active":"2023-10-25T16:20:54.767978+0000","last_became_peered":"2023-10-25T16:20:54.767978+0000","last_unstale":"2023-10-25T16:20:54.768298+0000","last_undegraded":"2023-10-25T16:20:54.768298+0000","last_fullsized":"2023-10-25T16:20:54.768298+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746378+0000","last_change":"2023-10-25T16:20:54.746378+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746378+0000","last_undegraded":"2023-10-25T16:20:54.746378+0000","last_fullsized":"2023-10-25T16:20:54.746378+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.760066+0000","last_change":"2023-10-25T16:20:54.759883+0000","last_active":"2023-10-25T16:20:54.760066+0000","last_peered":"2023-10-25T16:20:54.760066+0000","last_clean":"2023-10-25T16:20:54.760066+0000","last_became_active":"2023-10-25T16:20:54.758688+0000","last_became_peered":"2023-10-25T16:20:54.758688+0000","last_unstale":"2023-10-25T16:20:54.760066+0000","last_undegraded":"2023-10-25T16:20:54.760066+0000","last_fullsized":"2023-10-25T16:20:54.760066+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:50.541261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747856+0000","last_change":"2023-10-25T16:20:54.747856+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747856+0000","last_undegraded":"2023-10-25T16:20:54.747856+0000","last_fullsized":"2023-10-25T16:20:54.747856+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771883+0000","last_change":"2023-10-25T16:20:54.771822+0000","last_active":"2023-10-25T16:20:54.771883+0000","last_peered":"2023-10-25T16:20:54.771883+0000","last_clean":"2023-10-25T16:20:54.771883+0000","last_became_active":"2023-10-25T16:20:54.771600+0000","last_became_peered":"2023-10-25T16:20:54.771600+0000","last_unstale":"2023-10-25T16:20:54.771883+0000","last_undegraded":"2023-10-25T16:20:54.771883+0000","last_fullsized":"2023-10-25T16:20:54.771883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:16.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754088+0000","last_change":"2023-10-25T16:20:54.754088+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754088+0000","last_undegraded":"2023-10-25T16:20:54.754088+0000","last_fullsized":"2023-10-25T16:20:54.754088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.761233+0000","last_change":"2023-10-25T16:20:54.761148+0000","last_active":"2023-10-25T16:20:54.761233+0000","last_peered":"2023-10-25T16:20:54.761233+0000","last_clean":"2023-10-25T16:20:54.761233+0000","last_became_active":"2023-10-25T16:20:54.760911+0000","last_became_peered":"2023-10-25T16:20:54.760911+0000","last_unstale":"2023-10-25T16:20:54.761233+0000","last_undegraded":"2023-10-25T16:20:54.761233+0000","last_fullsized":"2023-10-25T16:20:54.761233+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:45:31.619997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747278+0000","last_change":"2023-10-25T16:20:54.747278+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747278+0000","last_undegraded":"2023-10-25T16:20:54.747278+0000","last_fullsized":"2023-10-25T16:20:54.747278+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.767060+0000","last_change":"2023-10-25T16:20:54.766906+0000","last_active":"2023-10-25T16:20:54.767060+0000","last_peered":"2023-10-25T16:20:54.767060+0000","last_clean":"2023-10-25T16:20:54.767060+0000","last_became_active":"2023-10-25T16:20:54.753701+0000","last_became_peered":"2023-10-25T16:20:54.753701+0000","last_unstale":"2023-10-25T16:20:54.767060+0000","last_undegraded":"2023-10-25T16:20:54.767060+0000","last_fullsized":"2023-10-25T16:20:54.767060+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:48.379708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-25T16:20:53.724985+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:20:53.724985+0000","last_peered":"2023-10-25T16:20:53.724985+0000","last_clean":"2023-10-25T16:20:53.724985+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:20:53.724985+0000","last_undegraded":"2023-10-25T16:20:53.724985+0000","last_fullsized":"2023-10-25T16:20:53.724985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542243,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":859,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194452,"statfs":{"total":200000000,"available":199119382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.52900000000000003},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.88200000000000001,"5min":0.94999999999999996,"15min":1.077},"last":1.0489999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66400000000000003,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.1759999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70699999999999996,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":1.159,"5min":1.246,"15min":1.246},"last":0.495},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.2729999999999999,"5min":1.345,"15min":1.345},"last":0.46200000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.94799999999999995,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.45,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.87},"min":{"1min":0.68400000000000005,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.3160000000000001,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.85499999999999998},"min":{"1min":0.74399999999999999,"5min":0.56599999999999995,"15min":0.504},"max":{"1min":1.298,"5min":1.345,"15min":1.4930000000000001},"last":0.749},{"interface":"front","average":{"1min":1.002,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.747,"5min":0.58599999999999997,"15min":0.47899999999999998},"max":{"1min":1.518,"5min":1.671,"15min":1.671},"last":0.93700000000000006}]},{"osd":6,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.90700000000000003},"min":{"1min":0.79300000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.02,"5min":0.95299999999999996,"15min":0.93700000000000006},"min":{"1min":0.73099999999999998,"5min":0.56699999999999995,"15min":0.53000000000000003},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.995,"15min":0.93600000000000005},"min":{"1min":0.71099999999999997,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.226,"5min":1.474,"15min":1.677},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.016,"15min":0.97099999999999997},"min":{"1min":0.69699999999999995,"5min":0.61699999999999999,"15min":0.57999999999999996},"max":{"1min":1.4139999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.0049999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193883,"statfs":{"total":200000000,"available":198536405,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.256,"15min":1.256},"last":1.204},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.534,"15min":1.534},"last":0.73699999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.92700000000000005,"15min":0.89100000000000001},"min":{"1min":0.52800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.647,"15min":1.647},"last":1.129},{"interface":"front","average":{"1min":0.87,"5min":0.95099999999999996,"15min":0.90900000000000003},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":1.2549999999999999,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.877,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.018,"5min":1.27,"15min":1.27},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.86899999999999999,"15min":0.83899999999999997},"min":{"1min":0.60499999999999998,"5min":0.54700000000000004,"15min":0.51800000000000002},"max":{"1min":1.284,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.117,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":0.95099999999999996},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.1950000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0029999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86599999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.177,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93500000000000005,"15min":0.99399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0029999999999999,"15min":1.028},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.323,"5min":1.637,"15min":1.637},"last":0.91400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1000000000000001,"15min":1.1359999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2789999999999999,"5min":1.669,"15min":1.669},"last":1.165},{"interface":"front","average":{"1min":1.038,"5min":1.0980000000000001,"15min":1.117},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.371,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.28}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.353,"5min":1.395,"15min":1.397},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2230000000000001,"5min":1.224,"15min":1.6419999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89500000000000002,"15min":0.88400000000000001},"min":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.2569999999999999,"5min":1.302,"15min":1.302},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2609999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.84999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.88400000000000001},"min":{"1min":0.57599999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.446,"5min":1.4570000000000001,"15min":1.476},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.149}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.046,"15min":1.044},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.367,"5min":1.587,"15min":1.7110000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.411,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.236,"5min":1.444,"15min":1.444},"last":1.048}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.98999999999999999,"15min":0.97299999999999998},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.29,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.054},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.895},"last":1.234}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.105,"15min":1.0860000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.095,"15min":1.05},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.339,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1830000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86699999999999999,"15min":1.242},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":14.843},"last":1.014},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80900000000000005,"15min":1.3380000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1639999999999999,"5min":1.238,"15min":16.439},"last":2.8450000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.88900000000000001,"15min":1.3},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.111,"5min":1.423,"15min":14.630000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.90800000000000003,"15min":0.877},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.399,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.3520000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95399999999999996,"15min":0.94099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.133,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.601},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94199999999999995,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.129,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.234,"5min":1.482,"15min":1.482},"last":1.4950000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0700000000000001,"15min":1.4139999999999999},"min":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.268,"5min":2.194,"15min":14.954000000000001},"last":1.1319999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.006,"15min":1.472},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3129999999999999,"5min":1.5489999999999999,"15min":15.904},"last":1.4399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.4650000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0900000000000001,"5min":1.879,"15min":17.219999999999999},"last":7.9610000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.0289999999999999,"15min":1.401},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2470000000000001,"5min":1.748,"15min":14.567},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.1479999999999999,"15min":1.5880000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.431,"5min":1.657,"15min":15.089},"last":2.4079999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.5720000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2709999999999999,"5min":1.7090000000000001,"15min":17.492000000000001},"last":7.8730000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.121,"15min":1.234},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2410000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":8.6920000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.216,"5min":1.327,"15min":1.47},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1180000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1659999999999999,"15min":1.288},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98099999999999998,"15min":0.95499999999999996},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.208}]},{"osd":2,"last update":"Wed Oct 25 16:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.288,"5min":1.397,"15min":1.419},"last":1.022},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.226,"5min":1.411,"15min":1.411},"last":1.0629999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.91200000000000003},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2849999999999999,"5min":1.5,"15min":1.5},"last":1.133},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84999999999999998,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1339999999999999,"5min":1.518,"15min":1.518},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.48799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.302,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.49,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.97799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.69199999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":2.085,"15min":2.085},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.212,"5min":1.107,"15min":1.0780000000000001},"min":{"1min":0.92500000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.625,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94799999999999995,"15min":0.94599999999999995},"min":{"1min":0.59299999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":1.474,"15min":1.5029999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.135,"15min":1.1180000000000001},"min":{"1min":0.96099999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.0980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.79000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.44500000000000001,"5min":0.25700000000000001,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.077,"15min":1.083},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":1.052,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.109,"5min":1.254,"15min":1.2809999999999999},"last":1.012}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70099999999999996,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.25,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.63900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89900000000000002,"15min":0.92200000000000004},"min":{"1min":0.68100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.5269999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.998,"5min":0.98299999999999998,"15min":0.94699999999999995},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2410000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.64600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.28,"5min":1.306,"15min":1.456},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97799999999999998,"15min":0.997},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.395,"5min":1.395,"15min":1.663},"last":0.88600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.018,"15min":0.98099999999999998},"min":{"1min":0.82399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.5660000000000001},"last":1.123},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.51500000000000001},"max":{"1min":1.212,"5min":1.3480000000000001,"15min":1.389},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.0800000000000001,"5min":1.1539999999999999,"15min":1.4610000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.29499999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":1.129,"15min":1.1990000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98599999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.35399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90100000000000002,"5min":1.2,"15min":1.2},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.749},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0129999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.96199999999999997},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.242,"5min":1.702,"15min":12.698},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95799999999999996,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.2090000000000001,"5min":1.4279999999999999,"15min":12.721},"last":0.998}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.345,"15min":1.546},"last":1.018},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1779999999999999,"5min":2.206,"15min":2.206},"last":1.0509999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95899999999999996,"15min":0.93999999999999995},"min":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.379,"15min":1.4610000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.397,"15min":1.5980000000000001},"last":1.1619999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.60999999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2849999999999999,"5min":1.9410000000000001,"15min":14.776},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.254,"5min":1.476,"15min":10.509},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193889,"statfs":{"total":200000000,"available":198542680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.67800000000000005},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.64300000000000002,"15min":0.68200000000000005},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.3919999999999999,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85499999999999998,"15min":0.81799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.181,"5min":1.407,"15min":3.6579999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.621},{"interface":"front","average":{"1min":1.054,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.77800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94199999999999995,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.97499999999999998,"15min":0.96099999999999997},"min":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.01,"15min":0.98499999999999999},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0109999999999999,"15min":0.94099999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.024,"15min":1.246},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4450000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.2629999999999999},"min":{"1min":0.70699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.282,"5min":1.4410000000000001,"15min":11.622},"last":0.75800000000000001}]}]}],"pool_statfs":[]}} 2023-10-25T16:20:59.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:20:59.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- 172.21.15.177:0/1525050360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 msgr2=0x7f1cb806c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/1525050360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb806c8e0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f1cb806f070 tx=0x7f1ca801caa0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- 172.21.15.177:0/1525050360 shutdown_connections 2023-10-25T16:20:59.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/1525050360 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb806c8e0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/1525050360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cb8142ba0 0x7f1cb8069720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/1525050360 >> v2:172.21.15.184:3300/0 conn(0x7f1cb8142130 0x7f1cb8142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- 172.21.15.177:0/1525050360 >> 172.21.15.177:0/1525050360 conn(0x7f1cb80ce000 msgr2=0x7f1cb80ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:59.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- 172.21.15.177:0/1525050360 shutdown_connections 2023-10-25T16:20:59.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- 172.21.15.177:0/1525050360 wait complete. 2023-10-25T16:20:59.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 Processor -- start 2023-10-25T16:20:59.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- start start 2023-10-25T16:20:59.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb8137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cb8142130 0x7f1cb8153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cb8142ba0 0x7f1cb8154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8137f60 con 0x7f1cb8069c60 2023-10-25T16:20:59.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8139d20 con 0x7f1cb8142ba0 2023-10-25T16:20:59.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cbe71e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb813a000 con 0x7f1cb8142130 2023-10-25T16:20:59.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cb7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb8137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cb7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb8137a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38018/0 (socket says 172.21.15.177:38018) 2023-10-25T16:20:59.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.291+0000 7f1cb7fff640 1 -- 172.21.15.177:0/2786084268 learned_addr learned my addr 172.21.15.177:0/2786084268 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:59.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cbccbb640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cb8142ba0 0x7f1cb8154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb77fe640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cb8142130 0x7f1cb8153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb7fff640 1 -- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cb8142130 msgr2=0x7f1cb8153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb7fff640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cb8142130 0x7f1cb8153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb7fff640 1 -- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cb8142ba0 msgr2=0x7f1cb8154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb7fff640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cb8142ba0 0x7f1cb8154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb7fff640 1 -- 172.21.15.177:0/2786084268 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80098e0 con 0x7f1cb8069c60 2023-10-25T16:20:59.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cbccbb640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cb8142ba0 0x7f1cb8154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:59.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb7fff640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb8137a20 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000d770 tx=0x7f1cb000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:59.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0009c30 con 0x7f1cb8069c60 2023-10-25T16:20:59.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb813a2e0 con 0x7f1cb8069c60 2023-10-25T16:20:59.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1cb0009e80 con 0x7f1cb8069c60 2023-10-25T16:20:59.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00106a0 con 0x7f1cb8069c60 2023-10-25T16:20:59.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb813a8a0 con 0x7f1cb8069c60 2023-10-25T16:20:59.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb813aa30 con 0x7f1cb8069c60 2023-10-25T16:20:59.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1cb0010800 con 0x7f1cb8069c60 2023-10-25T16:20:59.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb4ff9640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c98066470 0x7f1c98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cb0084430 con 0x7f1cb8069c60 2023-10-25T16:20:59.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb77fe640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c98066470 0x7f1c98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.295+0000 7f1cb77fe640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c98066470 0x7f1c98068930 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00058d0 tx=0x7f1ca0005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:59.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.299+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1cb00552c0 con 0x7f1cb8069c60 2023-10-25T16:20:59.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.451+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cb804daf0 con 0x7f1c98066470 2023-10-25T16:20:59.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.471+0000 7f1cb4ff9640 1 -- 172.21.15.177:0/2786084268 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279288 (secure 0 0 0) 0x7f1cb804daf0 con 0x7f1c98066470 2023-10-25T16:20:59.473 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:59.475 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:20:59.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c98066470 msgr2=0x7f1c98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c98066470 0x7f1c98068930 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00058d0 tx=0x7f1ca0005860 comp rx=0 tx=0).stop 2023-10-25T16:20:59.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 msgr2=0x7f1cb8137a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb8137a20 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000d770 tx=0x7f1cb000dc30 comp rx=0 tx=0).stop 2023-10-25T16:20:59.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 shutdown_connections 2023-10-25T16:20:59.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1c98066470 0x7f1c98068930 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1cb8142ba0 0x7f1cb8154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1cb8142130 0x7f1cb8153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 --2- 172.21.15.177:0/2786084268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1cb8069c60 0x7f1cb8137a20 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 >> 172.21.15.177:0/2786084268 conn(0x7f1cb80ce000 msgr2=0x7f1cb8159270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:59.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 shutdown_connections 2023-10-25T16:20:59.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.475+0000 7f1cbe71e640 1 -- 172.21.15.177:0/2786084268 wait complete. 2023-10-25T16:20:59.490 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-25T16:20:58.772102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554554,"statfs":{"total":1600000000,"available":1591863707,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.047330"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.780088+0000","last_change":"2023-10-25T16:20:55.780004+0000","last_active":"2023-10-25T16:20:55.780088+0000","last_peered":"2023-10-25T16:20:55.780088+0000","last_clean":"2023-10-25T16:20:55.780088+0000","last_became_active":"2023-10-25T16:20:55.779374+0000","last_became_peered":"2023-10-25T16:20:55.779374+0000","last_unstale":"2023-10-25T16:20:55.780088+0000","last_undegraded":"2023-10-25T16:20:55.780088+0000","last_fullsized":"2023-10-25T16:20:55.780088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:16:34.694815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751716+0000","last_change":"2023-10-25T16:20:54.751716+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751716+0000","last_undegraded":"2023-10-25T16:20:54.751716+0000","last_fullsized":"2023-10-25T16:20:54.751716+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754600+0000","last_change":"2023-10-25T16:20:54.754600+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754600+0000","last_undegraded":"2023-10-25T16:20:54.754600+0000","last_fullsized":"2023-10-25T16:20:54.754600+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.776968+0000","last_change":"2023-10-25T16:20:55.776769+0000","last_active":"2023-10-25T16:20:55.776968+0000","last_peered":"2023-10-25T16:20:55.776968+0000","last_clean":"2023-10-25T16:20:55.776968+0000","last_became_active":"2023-10-25T16:20:55.774636+0000","last_became_peered":"2023-10-25T16:20:55.774636+0000","last_unstale":"2023-10-25T16:20:55.776968+0000","last_undegraded":"2023-10-25T16:20:55.776968+0000","last_fullsized":"2023-10-25T16:20:55.776968+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:39:58.917721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755873+0000","last_change":"2023-10-25T16:20:54.755873+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755873+0000","last_undegraded":"2023-10-25T16:20:54.755873+0000","last_fullsized":"2023-10-25T16:20:54.755873+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752156+0000","last_change":"2023-10-25T16:20:54.752156+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752156+0000","last_undegraded":"2023-10-25T16:20:54.752156+0000","last_fullsized":"2023-10-25T16:20:54.752156+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751457+0000","last_change":"2023-10-25T16:20:54.751457+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751457+0000","last_undegraded":"2023-10-25T16:20:54.751457+0000","last_fullsized":"2023-10-25T16:20:54.751457+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753766+0000","last_change":"2023-10-25T16:20:54.753766+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753766+0000","last_undegraded":"2023-10-25T16:20:54.753766+0000","last_fullsized":"2023-10-25T16:20:54.753766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755962+0000","last_change":"2023-10-25T16:20:54.755962+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755962+0000","last_undegraded":"2023-10-25T16:20:54.755962+0000","last_fullsized":"2023-10-25T16:20:54.755962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752774+0000","last_change":"2023-10-25T16:20:54.752774+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752774+0000","last_undegraded":"2023-10-25T16:20:54.752774+0000","last_fullsized":"2023-10-25T16:20:54.752774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750691+0000","last_change":"2023-10-25T16:20:54.750691+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750691+0000","last_undegraded":"2023-10-25T16:20:54.750691+0000","last_fullsized":"2023-10-25T16:20:54.750691+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750855+0000","last_change":"2023-10-25T16:20:54.750855+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750855+0000","last_undegraded":"2023-10-25T16:20:54.750855+0000","last_fullsized":"2023-10-25T16:20:54.750855+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772630+0000","last_change":"2023-10-25T16:20:55.772466+0000","last_active":"2023-10-25T16:20:55.772630+0000","last_peered":"2023-10-25T16:20:55.772630+0000","last_clean":"2023-10-25T16:20:55.772630+0000","last_became_active":"2023-10-25T16:20:55.771742+0000","last_became_peered":"2023-10-25T16:20:55.771742+0000","last_unstale":"2023-10-25T16:20:55.772630+0000","last_undegraded":"2023-10-25T16:20:55.772630+0000","last_fullsized":"2023-10-25T16:20:55.772630+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:23:11.762083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751538+0000","last_change":"2023-10-25T16:20:54.751538+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751538+0000","last_undegraded":"2023-10-25T16:20:54.751538+0000","last_fullsized":"2023-10-25T16:20:54.751538+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.783023+0000","last_change":"2023-10-25T16:20:55.782883+0000","last_active":"2023-10-25T16:20:55.783023+0000","last_peered":"2023-10-25T16:20:55.783023+0000","last_clean":"2023-10-25T16:20:55.783023+0000","last_became_active":"2023-10-25T16:20:55.782144+0000","last_became_peered":"2023-10-25T16:20:55.782144+0000","last_unstale":"2023-10-25T16:20:55.783023+0000","last_undegraded":"2023-10-25T16:20:55.783023+0000","last_fullsized":"2023-10-25T16:20:55.783023+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:30:51.670014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748570+0000","last_change":"2023-10-25T16:20:54.748570+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748570+0000","last_undegraded":"2023-10-25T16:20:54.748570+0000","last_fullsized":"2023-10-25T16:20:54.748570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749669+0000","last_change":"2023-10-25T16:20:54.749669+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749669+0000","last_undegraded":"2023-10-25T16:20:54.749669+0000","last_fullsized":"2023-10-25T16:20:54.749669+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748618+0000","last_change":"2023-10-25T16:20:54.748618+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748618+0000","last_undegraded":"2023-10-25T16:20:54.748618+0000","last_fullsized":"2023-10-25T16:20:54.748618+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753051+0000","last_change":"2023-10-25T16:20:54.753051+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753051+0000","last_undegraded":"2023-10-25T16:20:54.753051+0000","last_fullsized":"2023-10-25T16:20:54.753051+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748660+0000","last_change":"2023-10-25T16:20:54.748660+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748660+0000","last_undegraded":"2023-10-25T16:20:54.748660+0000","last_fullsized":"2023-10-25T16:20:54.748660+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757935+0000","last_change":"2023-10-25T16:20:54.757935+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757935+0000","last_undegraded":"2023-10-25T16:20:54.757935+0000","last_fullsized":"2023-10-25T16:20:54.757935+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749462+0000","last_change":"2023-10-25T16:20:54.749462+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749462+0000","last_undegraded":"2023-10-25T16:20:54.749462+0000","last_fullsized":"2023-10-25T16:20:54.749462+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752341+0000","last_change":"2023-10-25T16:20:54.752341+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752341+0000","last_undegraded":"2023-10-25T16:20:54.752341+0000","last_fullsized":"2023-10-25T16:20:54.752341+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752700+0000","last_change":"2023-10-25T16:20:54.752700+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752700+0000","last_undegraded":"2023-10-25T16:20:54.752700+0000","last_fullsized":"2023-10-25T16:20:54.752700+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752357+0000","last_change":"2023-10-25T16:20:54.752357+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752357+0000","last_undegraded":"2023-10-25T16:20:54.752357+0000","last_fullsized":"2023-10-25T16:20:54.752357+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747818+0000","last_change":"2023-10-25T16:20:54.747818+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747818+0000","last_undegraded":"2023-10-25T16:20:54.747818+0000","last_fullsized":"2023-10-25T16:20:54.747818+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.787336+0000","last_change":"2023-10-25T16:20:55.787260+0000","last_active":"2023-10-25T16:20:55.787336+0000","last_peered":"2023-10-25T16:20:55.787336+0000","last_clean":"2023-10-25T16:20:55.787336+0000","last_became_active":"2023-10-25T16:20:55.786974+0000","last_became_peered":"2023-10-25T16:20:55.786974+0000","last_unstale":"2023-10-25T16:20:55.787336+0000","last_undegraded":"2023-10-25T16:20:55.787336+0000","last_fullsized":"2023-10-25T16:20:55.787336+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:08.864443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746049+0000","last_change":"2023-10-25T16:20:54.746049+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746049+0000","last_undegraded":"2023-10-25T16:20:54.746049+0000","last_fullsized":"2023-10-25T16:20:54.746049+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.783735+0000","last_change":"2023-10-25T16:20:55.783671+0000","last_active":"2023-10-25T16:20:55.783735+0000","last_peered":"2023-10-25T16:20:55.783735+0000","last_clean":"2023-10-25T16:20:55.783735+0000","last_became_active":"2023-10-25T16:20:55.783323+0000","last_became_peered":"2023-10-25T16:20:55.783323+0000","last_unstale":"2023-10-25T16:20:55.783735+0000","last_undegraded":"2023-10-25T16:20:55.783735+0000","last_fullsized":"2023-10-25T16:20:55.783735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:42.879285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.778841+0000","last_change":"2023-10-25T16:20:55.778429+0000","last_active":"2023-10-25T16:20:55.778841+0000","last_peered":"2023-10-25T16:20:55.778841+0000","last_clean":"2023-10-25T16:20:55.778841+0000","last_became_active":"2023-10-25T16:20:55.777725+0000","last_became_peered":"2023-10-25T16:20:55.777725+0000","last_unstale":"2023-10-25T16:20:55.778841+0000","last_undegraded":"2023-10-25T16:20:55.778841+0000","last_fullsized":"2023-10-25T16:20:55.778841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:01:26.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757166+0000","last_change":"2023-10-25T16:20:54.757166+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757166+0000","last_undegraded":"2023-10-25T16:20:54.757166+0000","last_fullsized":"2023-10-25T16:20:54.757166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750554+0000","last_change":"2023-10-25T16:20:54.750554+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750554+0000","last_undegraded":"2023-10-25T16:20:54.750554+0000","last_fullsized":"2023-10-25T16:20:54.750554+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748228+0000","last_change":"2023-10-25T16:20:54.748228+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748228+0000","last_undegraded":"2023-10-25T16:20:54.748228+0000","last_fullsized":"2023-10-25T16:20:54.748228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.751054+0000","last_change":"2023-10-25T16:20:54.750779+0000","last_active":"2023-10-25T16:20:54.751054+0000","last_peered":"2023-10-25T16:20:54.751054+0000","last_clean":"2023-10-25T16:20:54.751054+0000","last_became_active":"2023-10-25T16:20:54.750091+0000","last_became_peered":"2023-10-25T16:20:54.750091+0000","last_unstale":"2023-10-25T16:20:54.751054+0000","last_undegraded":"2023-10-25T16:20:54.751054+0000","last_fullsized":"2023-10-25T16:20:54.751054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:25:27.972269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753123+0000","last_change":"2023-10-25T16:20:54.753123+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753123+0000","last_undegraded":"2023-10-25T16:20:54.753123+0000","last_fullsized":"2023-10-25T16:20:54.753123+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759359+0000","last_change":"2023-10-25T16:20:54.759191+0000","last_active":"2023-10-25T16:20:54.759359+0000","last_peered":"2023-10-25T16:20:54.759359+0000","last_clean":"2023-10-25T16:20:54.759359+0000","last_became_active":"2023-10-25T16:20:54.758654+0000","last_became_peered":"2023-10-25T16:20:54.758654+0000","last_unstale":"2023-10-25T16:20:54.759359+0000","last_undegraded":"2023-10-25T16:20:54.759359+0000","last_fullsized":"2023-10-25T16:20:54.759359+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748190+0000","last_change":"2023-10-25T16:20:54.748190+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748190+0000","last_undegraded":"2023-10-25T16:20:54.748190+0000","last_fullsized":"2023-10-25T16:20:54.748190+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758560+0000","last_change":"2023-10-25T16:20:54.758266+0000","last_active":"2023-10-25T16:20:54.758560+0000","last_peered":"2023-10-25T16:20:54.758560+0000","last_clean":"2023-10-25T16:20:54.758560+0000","last_became_active":"2023-10-25T16:20:54.757497+0000","last_became_peered":"2023-10-25T16:20:54.757497+0000","last_unstale":"2023-10-25T16:20:54.758560+0000","last_undegraded":"2023-10-25T16:20:54.758560+0000","last_fullsized":"2023-10-25T16:20:54.758560+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:29:33.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755084+0000","last_change":"2023-10-25T16:20:54.755084+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755084+0000","last_undegraded":"2023-10-25T16:20:54.755084+0000","last_fullsized":"2023-10-25T16:20:54.755084+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756647+0000","last_change":"2023-10-25T16:20:54.756559+0000","last_active":"2023-10-25T16:20:54.756647+0000","last_peered":"2023-10-25T16:20:54.756647+0000","last_clean":"2023-10-25T16:20:54.756647+0000","last_became_active":"2023-10-25T16:20:54.756240+0000","last_became_peered":"2023-10-25T16:20:54.756240+0000","last_unstale":"2023-10-25T16:20:54.756647+0000","last_undegraded":"2023-10-25T16:20:54.756647+0000","last_fullsized":"2023-10-25T16:20:54.756647+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748171+0000","last_change":"2023-10-25T16:20:54.748171+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748171+0000","last_undegraded":"2023-10-25T16:20:54.748171+0000","last_fullsized":"2023-10-25T16:20:54.748171+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.754257+0000","last_change":"2023-10-25T16:20:54.753168+0000","last_active":"2023-10-25T16:20:54.754257+0000","last_peered":"2023-10-25T16:20:54.754257+0000","last_clean":"2023-10-25T16:20:54.754257+0000","last_became_active":"2023-10-25T16:20:54.752919+0000","last_became_peered":"2023-10-25T16:20:54.752919+0000","last_unstale":"2023-10-25T16:20:54.754257+0000","last_undegraded":"2023-10-25T16:20:54.754257+0000","last_fullsized":"2023-10-25T16:20:54.754257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:18.896946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748577+0000","last_change":"2023-10-25T16:20:54.748577+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748577+0000","last_undegraded":"2023-10-25T16:20:54.748577+0000","last_fullsized":"2023-10-25T16:20:54.748577+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.755685+0000","last_change":"2023-10-25T16:20:54.755598+0000","last_active":"2023-10-25T16:20:54.755685+0000","last_peered":"2023-10-25T16:20:54.755685+0000","last_clean":"2023-10-25T16:20:54.755685+0000","last_became_active":"2023-10-25T16:20:54.755185+0000","last_became_peered":"2023-10-25T16:20:54.755185+0000","last_unstale":"2023-10-25T16:20:54.755685+0000","last_undegraded":"2023-10-25T16:20:54.755685+0000","last_fullsized":"2023-10-25T16:20:54.755685+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:17:00.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751297+0000","last_change":"2023-10-25T16:20:54.751297+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751297+0000","last_undegraded":"2023-10-25T16:20:54.751297+0000","last_fullsized":"2023-10-25T16:20:54.751297+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.765707+0000","last_change":"2023-10-25T16:20:54.765552+0000","last_active":"2023-10-25T16:20:54.765707+0000","last_peered":"2023-10-25T16:20:54.765707+0000","last_clean":"2023-10-25T16:20:54.765707+0000","last_became_active":"2023-10-25T16:20:54.764892+0000","last_became_peered":"2023-10-25T16:20:54.764892+0000","last_unstale":"2023-10-25T16:20:54.765707+0000","last_undegraded":"2023-10-25T16:20:54.765707+0000","last_fullsized":"2023-10-25T16:20:54.765707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:24.555799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750998+0000","last_change":"2023-10-25T16:20:54.750998+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750998+0000","last_undegraded":"2023-10-25T16:20:54.750998+0000","last_fullsized":"2023-10-25T16:20:54.750998+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763711+0000","last_change":"2023-10-25T16:20:54.763630+0000","last_active":"2023-10-25T16:20:54.763711+0000","last_peered":"2023-10-25T16:20:54.763711+0000","last_clean":"2023-10-25T16:20:54.763711+0000","last_became_active":"2023-10-25T16:20:54.763250+0000","last_became_peered":"2023-10-25T16:20:54.763250+0000","last_unstale":"2023-10-25T16:20:54.763711+0000","last_undegraded":"2023-10-25T16:20:54.763711+0000","last_fullsized":"2023-10-25T16:20:54.763711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.773342+0000","last_change":"2023-10-25T16:20:55.773192+0000","last_active":"2023-10-25T16:20:55.773342+0000","last_peered":"2023-10-25T16:20:55.773342+0000","last_clean":"2023-10-25T16:20:55.773342+0000","last_became_active":"2023-10-25T16:20:55.771716+0000","last_became_peered":"2023-10-25T16:20:55.771716+0000","last_unstale":"2023-10-25T16:20:55.773342+0000","last_undegraded":"2023-10-25T16:20:55.773342+0000","last_fullsized":"2023-10-25T16:20:55.773342+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:54:01.767510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763639+0000","last_change":"2023-10-25T16:20:54.763382+0000","last_active":"2023-10-25T16:20:54.763639+0000","last_peered":"2023-10-25T16:20:54.763639+0000","last_clean":"2023-10-25T16:20:54.763639+0000","last_became_active":"2023-10-25T16:20:54.762654+0000","last_became_peered":"2023-10-25T16:20:54.762654+0000","last_unstale":"2023-10-25T16:20:54.763639+0000","last_undegraded":"2023-10-25T16:20:54.763639+0000","last_fullsized":"2023-10-25T16:20:54.763639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:02.824860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747244+0000","last_change":"2023-10-25T16:20:54.747244+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747244+0000","last_undegraded":"2023-10-25T16:20:54.747244+0000","last_fullsized":"2023-10-25T16:20:54.747244+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763595+0000","last_change":"2023-10-25T16:20:54.763506+0000","last_active":"2023-10-25T16:20:54.763595+0000","last_peered":"2023-10-25T16:20:54.763595+0000","last_clean":"2023-10-25T16:20:54.763595+0000","last_became_active":"2023-10-25T16:20:54.763202+0000","last_became_peered":"2023-10-25T16:20:54.763202+0000","last_unstale":"2023-10-25T16:20:54.763595+0000","last_undegraded":"2023-10-25T16:20:54.763595+0000","last_fullsized":"2023-10-25T16:20:54.763595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:41.174773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755828+0000","last_change":"2023-10-25T16:20:54.755828+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755828+0000","last_undegraded":"2023-10-25T16:20:54.755828+0000","last_fullsized":"2023-10-25T16:20:54.755828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768121+0000","last_change":"2023-10-25T16:20:54.767309+0000","last_active":"2023-10-25T16:20:54.768121+0000","last_peered":"2023-10-25T16:20:54.768121+0000","last_clean":"2023-10-25T16:20:54.768121+0000","last_became_active":"2023-10-25T16:20:54.765724+0000","last_became_peered":"2023-10-25T16:20:54.765724+0000","last_unstale":"2023-10-25T16:20:54.768121+0000","last_undegraded":"2023-10-25T16:20:54.768121+0000","last_fullsized":"2023-10-25T16:20:54.768121+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747603+0000","last_change":"2023-10-25T16:20:54.747603+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747603+0000","last_undegraded":"2023-10-25T16:20:54.747603+0000","last_fullsized":"2023-10-25T16:20:54.747603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771758+0000","last_change":"2023-10-25T16:20:54.771635+0000","last_active":"2023-10-25T16:20:54.771758+0000","last_peered":"2023-10-25T16:20:54.771758+0000","last_clean":"2023-10-25T16:20:54.771758+0000","last_became_active":"2023-10-25T16:20:54.771107+0000","last_became_peered":"2023-10-25T16:20:54.771107+0000","last_unstale":"2023-10-25T16:20:54.771758+0000","last_undegraded":"2023-10-25T16:20:54.771758+0000","last_fullsized":"2023-10-25T16:20:54.771758+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:37:02.197973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772582+0000","last_change":"2023-10-25T16:20:55.772121+0000","last_active":"2023-10-25T16:20:55.772582+0000","last_peered":"2023-10-25T16:20:55.772582+0000","last_clean":"2023-10-25T16:20:55.772582+0000","last_became_active":"2023-10-25T16:20:55.771504+0000","last_became_peered":"2023-10-25T16:20:55.771504+0000","last_unstale":"2023-10-25T16:20:55.772582+0000","last_undegraded":"2023-10-25T16:20:55.772582+0000","last_fullsized":"2023-10-25T16:20:55.772582+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:25.410199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772708+0000","last_change":"2023-10-25T16:20:54.759691+0000","last_active":"2023-10-25T16:20:55.772708+0000","last_peered":"2023-10-25T16:20:55.772708+0000","last_clean":"2023-10-25T16:20:55.772708+0000","last_became_active":"2023-10-25T16:20:54.759459+0000","last_became_peered":"2023-10-25T16:20:54.759459+0000","last_unstale":"2023-10-25T16:20:55.772708+0000","last_undegraded":"2023-10-25T16:20:55.772708+0000","last_fullsized":"2023-10-25T16:20:55.772708+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:24:39.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754480+0000","last_change":"2023-10-25T16:20:54.754480+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754480+0000","last_undegraded":"2023-10-25T16:20:54.754480+0000","last_fullsized":"2023-10-25T16:20:54.754480+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768377+0000","last_change":"2023-10-25T16:20:54.768310+0000","last_active":"2023-10-25T16:20:54.768377+0000","last_peered":"2023-10-25T16:20:54.768377+0000","last_clean":"2023-10-25T16:20:54.768377+0000","last_became_active":"2023-10-25T16:20:54.768064+0000","last_became_peered":"2023-10-25T16:20:54.768064+0000","last_unstale":"2023-10-25T16:20:54.768377+0000","last_undegraded":"2023-10-25T16:20:54.768377+0000","last_fullsized":"2023-10-25T16:20:54.768377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:37.419589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750032+0000","last_change":"2023-10-25T16:20:54.750032+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750032+0000","last_undegraded":"2023-10-25T16:20:54.750032+0000","last_fullsized":"2023-10-25T16:20:54.750032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771237+0000","last_change":"2023-10-25T16:20:54.771088+0000","last_active":"2023-10-25T16:20:54.771237+0000","last_peered":"2023-10-25T16:20:54.771237+0000","last_clean":"2023-10-25T16:20:54.771237+0000","last_became_active":"2023-10-25T16:20:54.768618+0000","last_became_peered":"2023-10-25T16:20:54.768618+0000","last_unstale":"2023-10-25T16:20:54.771237+0000","last_undegraded":"2023-10-25T16:20:54.771237+0000","last_fullsized":"2023-10-25T16:20:54.771237+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:34.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749605+0000","last_change":"2023-10-25T16:20:54.749605+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749605+0000","last_undegraded":"2023-10-25T16:20:54.749605+0000","last_fullsized":"2023-10-25T16:20:54.749605+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756007+0000","last_change":"2023-10-25T16:20:54.753340+0000","last_active":"2023-10-25T16:20:54.756007+0000","last_peered":"2023-10-25T16:20:54.756007+0000","last_clean":"2023-10-25T16:20:54.756007+0000","last_became_active":"2023-10-25T16:20:54.752315+0000","last_became_peered":"2023-10-25T16:20:54.752315+0000","last_unstale":"2023-10-25T16:20:54.756007+0000","last_undegraded":"2023-10-25T16:20:54.756007+0000","last_fullsized":"2023-10-25T16:20:54.756007+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:53.225075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.745977+0000","last_change":"2023-10-25T16:20:54.745977+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.745977+0000","last_undegraded":"2023-10-25T16:20:54.745977+0000","last_fullsized":"2023-10-25T16:20:54.745977+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764932+0000","last_change":"2023-10-25T16:20:54.764861+0000","last_active":"2023-10-25T16:20:54.764932+0000","last_peered":"2023-10-25T16:20:54.764932+0000","last_clean":"2023-10-25T16:20:54.764932+0000","last_became_active":"2023-10-25T16:20:54.764490+0000","last_became_peered":"2023-10-25T16:20:54.764490+0000","last_unstale":"2023-10-25T16:20:54.764932+0000","last_undegraded":"2023-10-25T16:20:54.764932+0000","last_fullsized":"2023-10-25T16:20:54.764932+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:56.070146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747834+0000","last_change":"2023-10-25T16:20:54.747834+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747834+0000","last_undegraded":"2023-10-25T16:20:54.747834+0000","last_fullsized":"2023-10-25T16:20:54.747834+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758935+0000","last_change":"2023-10-25T16:20:54.758776+0000","last_active":"2023-10-25T16:20:54.758935+0000","last_peered":"2023-10-25T16:20:54.758935+0000","last_clean":"2023-10-25T16:20:54.758935+0000","last_became_active":"2023-10-25T16:20:54.757905+0000","last_became_peered":"2023-10-25T16:20:54.757905+0000","last_unstale":"2023-10-25T16:20:54.758935+0000","last_undegraded":"2023-10-25T16:20:54.758935+0000","last_fullsized":"2023-10-25T16:20:54.758935+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:33.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751602+0000","last_change":"2023-10-25T16:20:54.751602+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751602+0000","last_undegraded":"2023-10-25T16:20:54.751602+0000","last_fullsized":"2023-10-25T16:20:54.751602+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759275+0000","last_change":"2023-10-25T16:20:54.759150+0000","last_active":"2023-10-25T16:20:54.759275+0000","last_peered":"2023-10-25T16:20:54.759275+0000","last_clean":"2023-10-25T16:20:54.759275+0000","last_became_active":"2023-10-25T16:20:54.758491+0000","last_became_peered":"2023-10-25T16:20:54.758491+0000","last_unstale":"2023-10-25T16:20:54.759275+0000","last_undegraded":"2023-10-25T16:20:54.759275+0000","last_fullsized":"2023-10-25T16:20:54.759275+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.778146+0000","last_change":"2023-10-25T16:20:55.777794+0000","last_active":"2023-10-25T16:20:55.778146+0000","last_peered":"2023-10-25T16:20:55.778146+0000","last_clean":"2023-10-25T16:20:55.778146+0000","last_became_active":"2023-10-25T16:20:55.776081+0000","last_became_peered":"2023-10-25T16:20:55.776081+0000","last_unstale":"2023-10-25T16:20:55.778146+0000","last_undegraded":"2023-10-25T16:20:55.778146+0000","last_fullsized":"2023-10-25T16:20:55.778146+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:25:37.942080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.769009+0000","last_change":"2023-10-25T16:20:54.768780+0000","last_active":"2023-10-25T16:20:54.769009+0000","last_peered":"2023-10-25T16:20:54.769009+0000","last_clean":"2023-10-25T16:20:54.769009+0000","last_became_active":"2023-10-25T16:20:54.766581+0000","last_became_peered":"2023-10-25T16:20:54.766581+0000","last_unstale":"2023-10-25T16:20:54.769009+0000","last_undegraded":"2023-10-25T16:20:54.769009+0000","last_fullsized":"2023-10-25T16:20:54.769009+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:10.174922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750878+0000","last_change":"2023-10-25T16:20:54.750878+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750878+0000","last_undegraded":"2023-10-25T16:20:54.750878+0000","last_fullsized":"2023-10-25T16:20:54.750878+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763950+0000","last_change":"2023-10-25T16:20:54.763860+0000","last_active":"2023-10-25T16:20:54.763950+0000","last_peered":"2023-10-25T16:20:54.763950+0000","last_clean":"2023-10-25T16:20:54.763950+0000","last_became_active":"2023-10-25T16:20:54.763501+0000","last_became_peered":"2023-10-25T16:20:54.763501+0000","last_unstale":"2023-10-25T16:20:54.763950+0000","last_undegraded":"2023-10-25T16:20:54.763950+0000","last_fullsized":"2023-10-25T16:20:54.763950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:22.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752193+0000","last_change":"2023-10-25T16:20:54.752193+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752193+0000","last_undegraded":"2023-10-25T16:20:54.752193+0000","last_fullsized":"2023-10-25T16:20:54.752193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758910+0000","last_change":"2023-10-25T16:20:54.758838+0000","last_active":"2023-10-25T16:20:54.758910+0000","last_peered":"2023-10-25T16:20:54.758910+0000","last_clean":"2023-10-25T16:20:54.758910+0000","last_became_active":"2023-10-25T16:20:54.758498+0000","last_became_peered":"2023-10-25T16:20:54.758498+0000","last_unstale":"2023-10-25T16:20:54.758910+0000","last_undegraded":"2023-10-25T16:20:54.758910+0000","last_fullsized":"2023-10-25T16:20:54.758910+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:53:55.894845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748055+0000","last_change":"2023-10-25T16:20:54.748055+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748055+0000","last_undegraded":"2023-10-25T16:20:54.748055+0000","last_fullsized":"2023-10-25T16:20:54.748055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763285+0000","last_change":"2023-10-25T16:20:54.763224+0000","last_active":"2023-10-25T16:20:54.763285+0000","last_peered":"2023-10-25T16:20:54.763285+0000","last_clean":"2023-10-25T16:20:54.763285+0000","last_became_active":"2023-10-25T16:20:54.762999+0000","last_became_peered":"2023-10-25T16:20:54.762999+0000","last_unstale":"2023-10-25T16:20:54.763285+0000","last_undegraded":"2023-10-25T16:20:54.763285+0000","last_fullsized":"2023-10-25T16:20:54.763285+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:04.836130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750042+0000","last_change":"2023-10-25T16:20:54.750042+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750042+0000","last_undegraded":"2023-10-25T16:20:54.750042+0000","last_fullsized":"2023-10-25T16:20:54.750042+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.797974+0000","last_change":"2023-10-25T16:20:54.769664+0000","last_active":"2023-10-25T16:20:55.797974+0000","last_peered":"2023-10-25T16:20:55.797974+0000","last_clean":"2023-10-25T16:20:55.797974+0000","last_became_active":"2023-10-25T16:20:54.769387+0000","last_became_peered":"2023-10-25T16:20:54.769387+0000","last_unstale":"2023-10-25T16:20:55.797974+0000","last_undegraded":"2023-10-25T16:20:55.797974+0000","last_fullsized":"2023-10-25T16:20:55.797974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:51.170554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.776948+0000","last_change":"2023-10-25T16:20:55.773589+0000","last_active":"2023-10-25T16:20:55.776948+0000","last_peered":"2023-10-25T16:20:55.776948+0000","last_clean":"2023-10-25T16:20:55.776948+0000","last_became_active":"2023-10-25T16:20:55.772463+0000","last_became_peered":"2023-10-25T16:20:55.772463+0000","last_unstale":"2023-10-25T16:20:55.776948+0000","last_undegraded":"2023-10-25T16:20:55.776948+0000","last_fullsized":"2023-10-25T16:20:55.776948+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:31:53.486815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.762505+0000","last_change":"2023-10-25T16:20:54.762316+0000","last_active":"2023-10-25T16:20:54.762505+0000","last_peered":"2023-10-25T16:20:54.762505+0000","last_clean":"2023-10-25T16:20:54.762505+0000","last_became_active":"2023-10-25T16:20:54.761646+0000","last_became_peered":"2023-10-25T16:20:54.761646+0000","last_unstale":"2023-10-25T16:20:54.762505+0000","last_undegraded":"2023-10-25T16:20:54.762505+0000","last_fullsized":"2023-10-25T16:20:54.762505+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:41:54.859004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751346+0000","last_change":"2023-10-25T16:20:54.751346+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751346+0000","last_undegraded":"2023-10-25T16:20:54.751346+0000","last_fullsized":"2023-10-25T16:20:54.751346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764433+0000","last_change":"2023-10-25T16:20:54.764346+0000","last_active":"2023-10-25T16:20:54.764433+0000","last_peered":"2023-10-25T16:20:54.764433+0000","last_clean":"2023-10-25T16:20:54.764433+0000","last_became_active":"2023-10-25T16:20:54.764007+0000","last_became_peered":"2023-10-25T16:20:54.764007+0000","last_unstale":"2023-10-25T16:20:54.764433+0000","last_undegraded":"2023-10-25T16:20:54.764433+0000","last_fullsized":"2023-10-25T16:20:54.764433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:11:45.618791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750803+0000","last_change":"2023-10-25T16:20:54.750803+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750803+0000","last_undegraded":"2023-10-25T16:20:54.750803+0000","last_fullsized":"2023-10-25T16:20:54.750803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758587+0000","last_change":"2023-10-25T16:20:54.758458+0000","last_active":"2023-10-25T16:20:54.758587+0000","last_peered":"2023-10-25T16:20:54.758587+0000","last_clean":"2023-10-25T16:20:54.758587+0000","last_became_active":"2023-10-25T16:20:54.757860+0000","last_became_peered":"2023-10-25T16:20:54.757860+0000","last_unstale":"2023-10-25T16:20:54.758587+0000","last_undegraded":"2023-10-25T16:20:54.758587+0000","last_fullsized":"2023-10-25T16:20:54.758587+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:44:32.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757000+0000","last_change":"2023-10-25T16:20:54.757000+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757000+0000","last_undegraded":"2023-10-25T16:20:54.757000+0000","last_fullsized":"2023-10-25T16:20:54.757000+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768298+0000","last_change":"2023-10-25T16:20:54.768211+0000","last_active":"2023-10-25T16:20:54.768298+0000","last_peered":"2023-10-25T16:20:54.768298+0000","last_clean":"2023-10-25T16:20:54.768298+0000","last_became_active":"2023-10-25T16:20:54.767978+0000","last_became_peered":"2023-10-25T16:20:54.767978+0000","last_unstale":"2023-10-25T16:20:54.768298+0000","last_undegraded":"2023-10-25T16:20:54.768298+0000","last_fullsized":"2023-10-25T16:20:54.768298+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746378+0000","last_change":"2023-10-25T16:20:54.746378+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746378+0000","last_undegraded":"2023-10-25T16:20:54.746378+0000","last_fullsized":"2023-10-25T16:20:54.746378+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.760066+0000","last_change":"2023-10-25T16:20:54.759883+0000","last_active":"2023-10-25T16:20:54.760066+0000","last_peered":"2023-10-25T16:20:54.760066+0000","last_clean":"2023-10-25T16:20:54.760066+0000","last_became_active":"2023-10-25T16:20:54.758688+0000","last_became_peered":"2023-10-25T16:20:54.758688+0000","last_unstale":"2023-10-25T16:20:54.760066+0000","last_undegraded":"2023-10-25T16:20:54.760066+0000","last_fullsized":"2023-10-25T16:20:54.760066+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:50.541261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747856+0000","last_change":"2023-10-25T16:20:54.747856+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747856+0000","last_undegraded":"2023-10-25T16:20:54.747856+0000","last_fullsized":"2023-10-25T16:20:54.747856+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771883+0000","last_change":"2023-10-25T16:20:54.771822+0000","last_active":"2023-10-25T16:20:54.771883+0000","last_peered":"2023-10-25T16:20:54.771883+0000","last_clean":"2023-10-25T16:20:54.771883+0000","last_became_active":"2023-10-25T16:20:54.771600+0000","last_became_peered":"2023-10-25T16:20:54.771600+0000","last_unstale":"2023-10-25T16:20:54.771883+0000","last_undegraded":"2023-10-25T16:20:54.771883+0000","last_fullsized":"2023-10-25T16:20:54.771883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:16.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754088+0000","last_change":"2023-10-25T16:20:54.754088+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754088+0000","last_undegraded":"2023-10-25T16:20:54.754088+0000","last_fullsized":"2023-10-25T16:20:54.754088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.761233+0000","last_change":"2023-10-25T16:20:54.761148+0000","last_active":"2023-10-25T16:20:54.761233+0000","last_peered":"2023-10-25T16:20:54.761233+0000","last_clean":"2023-10-25T16:20:54.761233+0000","last_became_active":"2023-10-25T16:20:54.760911+0000","last_became_peered":"2023-10-25T16:20:54.760911+0000","last_unstale":"2023-10-25T16:20:54.761233+0000","last_undegraded":"2023-10-25T16:20:54.761233+0000","last_fullsized":"2023-10-25T16:20:54.761233+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:45:31.619997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747278+0000","last_change":"2023-10-25T16:20:54.747278+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747278+0000","last_undegraded":"2023-10-25T16:20:54.747278+0000","last_fullsized":"2023-10-25T16:20:54.747278+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.767060+0000","last_change":"2023-10-25T16:20:54.766906+0000","last_active":"2023-10-25T16:20:54.767060+0000","last_peered":"2023-10-25T16:20:54.767060+0000","last_clean":"2023-10-25T16:20:54.767060+0000","last_became_active":"2023-10-25T16:20:54.753701+0000","last_became_peered":"2023-10-25T16:20:54.753701+0000","last_unstale":"2023-10-25T16:20:54.767060+0000","last_undegraded":"2023-10-25T16:20:54.767060+0000","last_fullsized":"2023-10-25T16:20:54.767060+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:48.379708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-25T16:20:53.724985+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:20:53.724985+0000","last_peered":"2023-10-25T16:20:53.724985+0000","last_clean":"2023-10-25T16:20:53.724985+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:20:53.724985+0000","last_undegraded":"2023-10-25T16:20:53.724985+0000","last_fullsized":"2023-10-25T16:20:53.724985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542243,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":859,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194452,"statfs":{"total":200000000,"available":199119382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.52900000000000003},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.88200000000000001,"5min":0.94999999999999996,"15min":1.077},"last":1.0489999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66400000000000003,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.1759999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70699999999999996,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":1.159,"5min":1.246,"15min":1.246},"last":0.495},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.2729999999999999,"5min":1.345,"15min":1.345},"last":0.46200000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.94799999999999995,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.45,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.87},"min":{"1min":0.68400000000000005,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.3160000000000001,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.85499999999999998},"min":{"1min":0.74399999999999999,"5min":0.56599999999999995,"15min":0.504},"max":{"1min":1.298,"5min":1.345,"15min":1.4930000000000001},"last":0.749},{"interface":"front","average":{"1min":1.002,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.747,"5min":0.58599999999999997,"15min":0.47899999999999998},"max":{"1min":1.518,"5min":1.671,"15min":1.671},"last":0.93700000000000006}]},{"osd":6,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.90700000000000003},"min":{"1min":0.79300000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.02,"5min":0.95299999999999996,"15min":0.93700000000000006},"min":{"1min":0.73099999999999998,"5min":0.56699999999999995,"15min":0.53000000000000003},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.995,"15min":0.93600000000000005},"min":{"1min":0.71099999999999997,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.226,"5min":1.474,"15min":1.677},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.016,"15min":0.97099999999999997},"min":{"1min":0.69699999999999995,"5min":0.61699999999999999,"15min":0.57999999999999996},"max":{"1min":1.4139999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.0049999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193883,"statfs":{"total":200000000,"available":198536405,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.256,"15min":1.256},"last":1.204},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.534,"15min":1.534},"last":0.73699999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.92700000000000005,"15min":0.89100000000000001},"min":{"1min":0.52800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.647,"15min":1.647},"last":1.129},{"interface":"front","average":{"1min":0.87,"5min":0.95099999999999996,"15min":0.90900000000000003},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":1.2549999999999999,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.877,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.018,"5min":1.27,"15min":1.27},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.86899999999999999,"15min":0.83899999999999997},"min":{"1min":0.60499999999999998,"5min":0.54700000000000004,"15min":0.51800000000000002},"max":{"1min":1.284,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.117,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":0.95099999999999996},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.1950000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0029999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86599999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.177,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93500000000000005,"15min":0.99399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0029999999999999,"15min":1.028},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.323,"5min":1.637,"15min":1.637},"last":0.91400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1000000000000001,"15min":1.1359999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2789999999999999,"5min":1.669,"15min":1.669},"last":1.165},{"interface":"front","average":{"1min":1.038,"5min":1.0980000000000001,"15min":1.117},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.371,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.28}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.353,"5min":1.395,"15min":1.397},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2230000000000001,"5min":1.224,"15min":1.6419999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89500000000000002,"15min":0.88400000000000001},"min":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.2569999999999999,"5min":1.302,"15min":1.302},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2609999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.84999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.88400000000000001},"min":{"1min":0.57599999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.446,"5min":1.4570000000000001,"15min":1.476},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.149}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.046,"15min":1.044},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.367,"5min":1.587,"15min":1.7110000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.411,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.236,"5min":1.444,"15min":1.444},"last":1.048}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.98999999999999999,"15min":0.97299999999999998},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.29,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.054},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.895},"last":1.234}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.105,"15min":1.0860000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.095,"15min":1.05},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.339,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1830000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86699999999999999,"15min":1.242},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":14.843},"last":1.014},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80900000000000005,"15min":1.3380000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1639999999999999,"5min":1.238,"15min":16.439},"last":2.8450000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.88900000000000001,"15min":1.3},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.111,"5min":1.423,"15min":14.630000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.90800000000000003,"15min":0.877},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.399,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.3520000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95399999999999996,"15min":0.94099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.133,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.601},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94199999999999995,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.129,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.234,"5min":1.482,"15min":1.482},"last":1.4950000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0700000000000001,"15min":1.4139999999999999},"min":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.268,"5min":2.194,"15min":14.954000000000001},"last":1.1319999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.006,"15min":1.472},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3129999999999999,"5min":1.5489999999999999,"15min":15.904},"last":1.4399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.4650000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0900000000000001,"5min":1.879,"15min":17.219999999999999},"last":7.9610000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.0289999999999999,"15min":1.401},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2470000000000001,"5min":1.748,"15min":14.567},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.1479999999999999,"15min":1.5880000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.431,"5min":1.657,"15min":15.089},"last":2.4079999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.5720000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2709999999999999,"5min":1.7090000000000001,"15min":17.492000000000001},"last":7.8730000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.121,"15min":1.234},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2410000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":8.6920000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.216,"5min":1.327,"15min":1.47},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1180000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1659999999999999,"15min":1.288},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98099999999999998,"15min":0.95499999999999996},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.208}]},{"osd":2,"last update":"Wed Oct 25 16:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.288,"5min":1.397,"15min":1.419},"last":1.022},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.226,"5min":1.411,"15min":1.411},"last":1.0629999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.91200000000000003},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2849999999999999,"5min":1.5,"15min":1.5},"last":1.133},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84999999999999998,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1339999999999999,"5min":1.518,"15min":1.518},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.48799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.302,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.49,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.97799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.69199999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":2.085,"15min":2.085},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.212,"5min":1.107,"15min":1.0780000000000001},"min":{"1min":0.92500000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.625,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94799999999999995,"15min":0.94599999999999995},"min":{"1min":0.59299999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":1.474,"15min":1.5029999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.135,"15min":1.1180000000000001},"min":{"1min":0.96099999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.0980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.79000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.44500000000000001,"5min":0.25700000000000001,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.077,"15min":1.083},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":1.052,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.109,"5min":1.254,"15min":1.2809999999999999},"last":1.012}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70099999999999996,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.25,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.63900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89900000000000002,"15min":0.92200000000000004},"min":{"1min":0.68100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.5269999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.998,"5min":0.98299999999999998,"15min":0.94699999999999995},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2410000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.64600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.28,"5min":1.306,"15min":1.456},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97799999999999998,"15min":0.997},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.395,"5min":1.395,"15min":1.663},"last":0.88600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.018,"15min":0.98099999999999998},"min":{"1min":0.82399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.5660000000000001},"last":1.123},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.51500000000000001},"max":{"1min":1.212,"5min":1.3480000000000001,"15min":1.389},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.0800000000000001,"5min":1.1539999999999999,"15min":1.4610000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.29499999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":1.129,"15min":1.1990000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98599999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.35399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90100000000000002,"5min":1.2,"15min":1.2},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.749},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0129999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.96199999999999997},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.242,"5min":1.702,"15min":12.698},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95799999999999996,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.2090000000000001,"5min":1.4279999999999999,"15min":12.721},"last":0.998}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.345,"15min":1.546},"last":1.018},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1779999999999999,"5min":2.206,"15min":2.206},"last":1.0509999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95899999999999996,"15min":0.93999999999999995},"min":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.379,"15min":1.4610000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.397,"15min":1.5980000000000001},"last":1.1619999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.60999999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2849999999999999,"5min":1.9410000000000001,"15min":14.776},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.254,"5min":1.476,"15min":10.509},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193889,"statfs":{"total":200000000,"available":198542680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.67800000000000005},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.64300000000000002,"15min":0.68200000000000005},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.3919999999999999,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85499999999999998,"15min":0.81799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.181,"5min":1.407,"15min":3.6579999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.621},{"interface":"front","average":{"1min":1.054,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.77800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94199999999999995,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.97499999999999998,"15min":0.96099999999999997},"min":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.01,"15min":0.98499999999999999},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0109999999999999,"15min":0.94099999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.024,"15min":1.246},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4450000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.2629999999999999},"min":{"1min":0.70699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.282,"5min":1.4410000000000001,"15min":11.622},"last":0.75800000000000001}]}]}],"pool_statfs":[]}} 2023-10-25T16:20:59.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2023-10-25T16:20:59.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.751716+0000', 'last_change': '2023-10-25T16:20:54.751716+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.751716+0000', 'last_undegraded': '2023-10-25T16:20:54.751716+0000', 'last_fullsized': '2023-10-25T16:20:54.751716+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-10-25T16:20:59.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.754600+0000', 'last_change': '2023-10-25T16:20:54.754600+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.754600+0000', 'last_undegraded': '2023-10-25T16:20:54.754600+0000', 'last_fullsized': '2023-10-25T16:20:54.754600+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-10-25T16:20:59.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.755873+0000', 'last_change': '2023-10-25T16:20:54.755873+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.755873+0000', 'last_undegraded': '2023-10-25T16:20:54.755873+0000', 'last_fullsized': '2023-10-25T16:20:54.755873+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-10-25T16:20:59.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.752156+0000', 'last_change': '2023-10-25T16:20:54.752156+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.752156+0000', 'last_undegraded': '2023-10-25T16:20:54.752156+0000', 'last_fullsized': '2023-10-25T16:20:54.752156+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-10-25T16:20:59.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.751457+0000', 'last_change': '2023-10-25T16:20:54.751457+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.751457+0000', 'last_undegraded': '2023-10-25T16:20:54.751457+0000', 'last_fullsized': '2023-10-25T16:20:54.751457+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-10-25T16:20:59.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.753766+0000', 'last_change': '2023-10-25T16:20:54.753766+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.753766+0000', 'last_undegraded': '2023-10-25T16:20:54.753766+0000', 'last_fullsized': '2023-10-25T16:20:54.753766+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-10-25T16:20:59.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.755962+0000', 'last_change': '2023-10-25T16:20:54.755962+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.755962+0000', 'last_undegraded': '2023-10-25T16:20:54.755962+0000', 'last_fullsized': '2023-10-25T16:20:54.755962+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2023-10-25T16:20:59.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.752774+0000', 'last_change': '2023-10-25T16:20:54.752774+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.752774+0000', 'last_undegraded': '2023-10-25T16:20:54.752774+0000', 'last_fullsized': '2023-10-25T16:20:54.752774+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-10-25T16:20:59.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750691+0000', 'last_change': '2023-10-25T16:20:54.750691+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750691+0000', 'last_undegraded': '2023-10-25T16:20:54.750691+0000', 'last_fullsized': '2023-10-25T16:20:54.750691+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:20:59.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-10-25T16:20:59.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750855+0000', 'last_change': '2023-10-25T16:20:54.750855+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750855+0000', 'last_undegraded': '2023-10-25T16:20:54.750855+0000', 'last_fullsized': '2023-10-25T16:20:54.750855+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-10-25T16:20:59.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.751538+0000', 'last_change': '2023-10-25T16:20:54.751538+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.751538+0000', 'last_undegraded': '2023-10-25T16:20:54.751538+0000', 'last_fullsized': '2023-10-25T16:20:54.751538+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2023-10-25T16:20:59.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748570+0000', 'last_change': '2023-10-25T16:20:54.748570+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748570+0000', 'last_undegraded': '2023-10-25T16:20:54.748570+0000', 'last_fullsized': '2023-10-25T16:20:54.748570+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-10-25T16:20:59.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.749669+0000', 'last_change': '2023-10-25T16:20:54.749669+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.749669+0000', 'last_undegraded': '2023-10-25T16:20:54.749669+0000', 'last_fullsized': '2023-10-25T16:20:54.749669+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2023-10-25T16:20:59.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748618+0000', 'last_change': '2023-10-25T16:20:54.748618+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748618+0000', 'last_undegraded': '2023-10-25T16:20:54.748618+0000', 'last_fullsized': '2023-10-25T16:20:54.748618+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2023-10-25T16:20:59.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.753051+0000', 'last_change': '2023-10-25T16:20:54.753051+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.753051+0000', 'last_undegraded': '2023-10-25T16:20:54.753051+0000', 'last_fullsized': '2023-10-25T16:20:54.753051+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:20:59.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2023-10-25T16:20:59.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748660+0000', 'last_change': '2023-10-25T16:20:54.748660+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748660+0000', 'last_undegraded': '2023-10-25T16:20:54.748660+0000', 'last_fullsized': '2023-10-25T16:20:54.748660+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-10-25T16:20:59.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.757935+0000', 'last_change': '2023-10-25T16:20:54.757935+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.757935+0000', 'last_undegraded': '2023-10-25T16:20:54.757935+0000', 'last_fullsized': '2023-10-25T16:20:54.757935+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2023-10-25T16:20:59.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.749462+0000', 'last_change': '2023-10-25T16:20:54.749462+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.749462+0000', 'last_undegraded': '2023-10-25T16:20:54.749462+0000', 'last_fullsized': '2023-10-25T16:20:54.749462+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:20:59.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-10-25T16:20:59.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.752341+0000', 'last_change': '2023-10-25T16:20:54.752341+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.752341+0000', 'last_undegraded': '2023-10-25T16:20:54.752341+0000', 'last_fullsized': '2023-10-25T16:20:54.752341+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-10-25T16:20:59.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.752700+0000', 'last_change': '2023-10-25T16:20:54.752700+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.752700+0000', 'last_undegraded': '2023-10-25T16:20:54.752700+0000', 'last_fullsized': '2023-10-25T16:20:54.752700+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-25T16:20:59.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-10-25T16:20:59.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.752357+0000', 'last_change': '2023-10-25T16:20:54.752357+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.752357+0000', 'last_undegraded': '2023-10-25T16:20:54.752357+0000', 'last_fullsized': '2023-10-25T16:20:54.752357+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.26 is not active+clean 2023-10-25T16:20:59.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.747818+0000', 'last_change': '2023-10-25T16:20:54.747818+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.747818+0000', 'last_undegraded': '2023-10-25T16:20:54.747818+0000', 'last_fullsized': '2023-10-25T16:20:54.747818+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-10-25T16:20:59.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.746049+0000', 'last_change': '2023-10-25T16:20:54.746049+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.746049+0000', 'last_undegraded': '2023-10-25T16:20:54.746049+0000', 'last_fullsized': '2023-10-25T16:20:54.746049+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:20:59.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-10-25T16:20:59.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.757166+0000', 'last_change': '2023-10-25T16:20:54.757166+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.757166+0000', 'last_undegraded': '2023-10-25T16:20:54.757166+0000', 'last_fullsized': '2023-10-25T16:20:54.757166+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-10-25T16:20:59.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750554+0000', 'last_change': '2023-10-25T16:20:54.750554+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750554+0000', 'last_undegraded': '2023-10-25T16:20:54.750554+0000', 'last_fullsized': '2023-10-25T16:20:54.750554+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-10-25T16:20:59.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748228+0000', 'last_change': '2023-10-25T16:20:54.748228+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748228+0000', 'last_undegraded': '2023-10-25T16:20:54.748228+0000', 'last_fullsized': '2023-10-25T16:20:54.748228+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-10-25T16:20:59.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.753123+0000', 'last_change': '2023-10-25T16:20:54.753123+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.753123+0000', 'last_undegraded': '2023-10-25T16:20:54.753123+0000', 'last_fullsized': '2023-10-25T16:20:54.753123+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-10-25T16:20:59.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748190+0000', 'last_change': '2023-10-25T16:20:54.748190+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748190+0000', 'last_undegraded': '2023-10-25T16:20:54.748190+0000', 'last_fullsized': '2023-10-25T16:20:54.748190+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-10-25T16:20:59.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.755084+0000', 'last_change': '2023-10-25T16:20:54.755084+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.755084+0000', 'last_undegraded': '2023-10-25T16:20:54.755084+0000', 'last_fullsized': '2023-10-25T16:20:54.755084+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-10-25T16:20:59.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748171+0000', 'last_change': '2023-10-25T16:20:54.748171+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748171+0000', 'last_undegraded': '2023-10-25T16:20:54.748171+0000', 'last_fullsized': '2023-10-25T16:20:54.748171+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-10-25T16:20:59.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748577+0000', 'last_change': '2023-10-25T16:20:54.748577+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748577+0000', 'last_undegraded': '2023-10-25T16:20:54.748577+0000', 'last_fullsized': '2023-10-25T16:20:54.748577+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-10-25T16:20:59.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.751297+0000', 'last_change': '2023-10-25T16:20:54.751297+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.751297+0000', 'last_undegraded': '2023-10-25T16:20:54.751297+0000', 'last_fullsized': '2023-10-25T16:20:54.751297+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-10-25T16:20:59.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750998+0000', 'last_change': '2023-10-25T16:20:54.750998+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750998+0000', 'last_undegraded': '2023-10-25T16:20:54.750998+0000', 'last_fullsized': '2023-10-25T16:20:54.750998+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-10-25T16:20:59.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.747244+0000', 'last_change': '2023-10-25T16:20:54.747244+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.747244+0000', 'last_undegraded': '2023-10-25T16:20:54.747244+0000', 'last_fullsized': '2023-10-25T16:20:54.747244+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:20:59.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-10-25T16:20:59.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.755828+0000', 'last_change': '2023-10-25T16:20:54.755828+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.755828+0000', 'last_undegraded': '2023-10-25T16:20:54.755828+0000', 'last_fullsized': '2023-10-25T16:20:54.755828+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-10-25T16:20:59.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.747603+0000', 'last_change': '2023-10-25T16:20:54.747603+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.747603+0000', 'last_undegraded': '2023-10-25T16:20:54.747603+0000', 'last_fullsized': '2023-10-25T16:20:54.747603+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-10-25T16:20:59.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.754480+0000', 'last_change': '2023-10-25T16:20:54.754480+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.754480+0000', 'last_undegraded': '2023-10-25T16:20:54.754480+0000', 'last_fullsized': '2023-10-25T16:20:54.754480+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-10-25T16:20:59.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750032+0000', 'last_change': '2023-10-25T16:20:54.750032+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750032+0000', 'last_undegraded': '2023-10-25T16:20:54.750032+0000', 'last_fullsized': '2023-10-25T16:20:54.750032+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-10-25T16:20:59.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.749605+0000', 'last_change': '2023-10-25T16:20:54.749605+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.749605+0000', 'last_undegraded': '2023-10-25T16:20:54.749605+0000', 'last_fullsized': '2023-10-25T16:20:54.749605+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-25T16:20:59.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-10-25T16:20:59.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.745977+0000', 'last_change': '2023-10-25T16:20:54.745977+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.745977+0000', 'last_undegraded': '2023-10-25T16:20:54.745977+0000', 'last_fullsized': '2023-10-25T16:20:54.745977+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:20:59.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2023-10-25T16:20:59.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.747834+0000', 'last_change': '2023-10-25T16:20:54.747834+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.747834+0000', 'last_undegraded': '2023-10-25T16:20:54.747834+0000', 'last_fullsized': '2023-10-25T16:20:54.747834+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-10-25T16:20:59.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.751602+0000', 'last_change': '2023-10-25T16:20:54.751602+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.751602+0000', 'last_undegraded': '2023-10-25T16:20:54.751602+0000', 'last_fullsized': '2023-10-25T16:20:54.751602+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-10-25T16:20:59.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750878+0000', 'last_change': '2023-10-25T16:20:54.750878+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750878+0000', 'last_undegraded': '2023-10-25T16:20:54.750878+0000', 'last_fullsized': '2023-10-25T16:20:54.750878+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-10-25T16:20:59.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.752193+0000', 'last_change': '2023-10-25T16:20:54.752193+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.752193+0000', 'last_undegraded': '2023-10-25T16:20:54.752193+0000', 'last_fullsized': '2023-10-25T16:20:54.752193+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-10-25T16:20:59.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.748055+0000', 'last_change': '2023-10-25T16:20:54.748055+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.748055+0000', 'last_undegraded': '2023-10-25T16:20:54.748055+0000', 'last_fullsized': '2023-10-25T16:20:54.748055+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-10-25T16:20:59.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750042+0000', 'last_change': '2023-10-25T16:20:54.750042+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750042+0000', 'last_undegraded': '2023-10-25T16:20:54.750042+0000', 'last_fullsized': '2023-10-25T16:20:54.750042+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-10-25T16:20:59.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.751346+0000', 'last_change': '2023-10-25T16:20:54.751346+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.751346+0000', 'last_undegraded': '2023-10-25T16:20:54.751346+0000', 'last_fullsized': '2023-10-25T16:20:54.751346+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-10-25T16:20:59.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.750803+0000', 'last_change': '2023-10-25T16:20:54.750803+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.750803+0000', 'last_undegraded': '2023-10-25T16:20:54.750803+0000', 'last_fullsized': '2023-10-25T16:20:54.750803+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-25T16:20:59.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-10-25T16:20:59.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.757000+0000', 'last_change': '2023-10-25T16:20:54.757000+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.757000+0000', 'last_undegraded': '2023-10-25T16:20:54.757000+0000', 'last_fullsized': '2023-10-25T16:20:54.757000+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-10-25T16:20:59.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.746378+0000', 'last_change': '2023-10-25T16:20:54.746378+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.746378+0000', 'last_undegraded': '2023-10-25T16:20:54.746378+0000', 'last_fullsized': '2023-10-25T16:20:54.746378+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-25T16:20:59.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-10-25T16:20:59.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.747856+0000', 'last_change': '2023-10-25T16:20:54.747856+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.747856+0000', 'last_undegraded': '2023-10-25T16:20:54.747856+0000', 'last_fullsized': '2023-10-25T16:20:54.747856+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-25T16:20:59.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-10-25T16:20:59.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.754088+0000', 'last_change': '2023-10-25T16:20:54.754088+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.754088+0000', 'last_undegraded': '2023-10-25T16:20:54.754088+0000', 'last_fullsized': '2023-10-25T16:20:54.754088+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-25T16:20:59.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-10-25T16:20:59.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:20:54.747278+0000', 'last_change': '2023-10-25T16:20:54.747278+0000', 'last_active': '2023-10-25T16:20:54.724505+0000', 'last_peered': '2023-10-25T16:20:54.724505+0000', 'last_clean': '2023-10-25T16:20:54.724505+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:20:54.747278+0000', 'last_undegraded': '2023-10-25T16:20:54.747278+0000', 'last_fullsized': '2023-10-25T16:20:54.747278+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'last_clean_scrub_stamp': '2023-10-25T16:20:54.724505+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-25T16:20:59.540 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:20:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/3774812458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0140e90 msgr2=0x7fd2e00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/3774812458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0140e90 0x7fd2e00af580 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00afca0 tx=0x7fd2d001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/3774812458 shutdown_connections 2023-10-25T16:20:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/3774812458 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2e006c090 0x7fd2e00cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/3774812458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0140e90 0x7fd2e00af580 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/3774812458 >> 172.21.15.177:0/3774812458 conn(0x7fd2e00b2450 msgr2=0x7fd2e00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/3774812458 shutdown_connections 2023-10-25T16:20:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/3774812458 wait complete. 2023-10-25T16:20:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 Processor -- start 2023-10-25T16:20:59.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- start start 2023-10-25T16:20:59.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2e006c090 0x7fd2e0156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 0x7fd2e013b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2e0140e90 0x7fd2e00a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00a69d0 con 0x7fd2e006f570 2023-10-25T16:20:59.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00a6cb0 con 0x7fd2e0140e90 2023-10-25T16:20:59.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00a6f90 con 0x7fd2e006c090 2023-10-25T16:20:59.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 0x7fd2e013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 0x7fd2e013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38026/0 (socket says 172.21.15.177:38026) 2023-10-25T16:20:59.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 -- 172.21.15.177:0/2736284572 learned_addr learned my addr 172.21.15.177:0/2736284572 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:20:59.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2de59c640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2e006c090 0x7fd2e0156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2ded9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2e0140e90 0x7fd2e00a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 -- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2e006c090 msgr2=0x7fd2e0156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2e006c090 0x7fd2e0156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 -- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2e0140e90 msgr2=0x7fd2e00a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2e0140e90 0x7fd2e00a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 -- 172.21.15.177:0/2736284572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009560 con 0x7fd2e006f570 2023-10-25T16:20:59.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2ded9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2e0140e90 0x7fd2e00a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:20:59.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d7fff640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 0x7fd2e013b630 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c410 tx=0x7fd2c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:59.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8011790 con 0x7fd2e006f570 2023-10-25T16:20:59.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd2c80119e0 con 0x7fd2e006f570 2023-10-25T16:20:59.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e00a7270 con 0x7fd2e006f570 2023-10-25T16:20:59.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8011e30 con 0x7fd2e006f570 2023-10-25T16:20:59.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.667+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e0157420 con 0x7fd2e006f570 2023-10-25T16:20:59.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.671+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e004daf0 con 0x7fd2e006f570 2023-10-25T16:20:59.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.671+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd2c8007020 con 0x7fd2e006f570 2023-10-25T16:20:59.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.671+0000 7fd2d6ffd640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2c0066470 0x7fd2c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:20:59.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.671+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2c8083ef0 con 0x7fd2e006f570 2023-10-25T16:20:59.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.671+0000 7fd2de59c640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2c0066470 0x7fd2c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:20:59.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.671+0000 7fd2de59c640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2c0066470 0x7fd2c0068930 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00af000 tx=0x7fd2d001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:20:59.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.675+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd2c80512d0 con 0x7fd2e006f570 2023-10-25T16:20:59.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.871+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd2e00ca670 con 0x7fd2e006f570 2023-10-25T16:20:59.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.871+0000 7fd2d6ffd640 1 -- 172.21.15.177:0/2736284572 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1511 (secure 0 0 0) 0x7fd2c80548f0 con 0x7fd2e006f570 2023-10-25T16:20:59.870 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:20:59.870 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":491,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":158,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":53},{"state_name":"active+clean","count":44}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":8136293,"bytes_avail":1591863707,"bytes_total":1600000000,"inactive_pgs_ratio":0.54639172554016113,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":58,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":155948}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-25T16:20:50.769861+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-25T16:20:59.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2c0066470 msgr2=0x7fd2c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2c0066470 0x7fd2c0068930 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00af000 tx=0x7fd2d001b010 comp rx=0 tx=0).stop 2023-10-25T16:20:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 msgr2=0x7fd2e013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:20:59.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 0x7fd2e013b630 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c410 tx=0x7fd2c800c8d0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 shutdown_connections 2023-10-25T16:20:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd2c0066470 0x7fd2c0068930 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2e0140e90 0x7fd2e00a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e006f570 0x7fd2e013b630 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 --2- 172.21.15.177:0/2736284572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2e006c090 0x7fd2e0156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:20:59.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 >> 172.21.15.177:0/2736284572 conn(0x7fd2e00b2450 msgr2=0x7fd2e00cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:20:59.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 shutdown_connections 2023-10-25T16:20:59.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.875+0000 7fd2e4e9d640 1 -- 172.21.15.177:0/2736284572 wait complete. 2023-10-25T16:20:59.888 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:20:59.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:20:59.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 -- 172.21.15.177:0/3654998000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc15eba0 msgr2=0x7fdbcc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:00.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/3654998000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc15eba0 0x7fdbcc0b4100 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc09f200 tx=0x7fdbc801c750 comp rx=0 tx=0).stop 2023-10-25T16:21:00.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 -- 172.21.15.177:0/3654998000 shutdown_connections 2023-10-25T16:21:00.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/3654998000 >> v2:172.21.15.184:3300/0 conn(0x7fdbcc0b2120 0x7fdbcc0d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/3654998000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc15eba0 0x7fdbcc0b4100 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 -- 172.21.15.177:0/3654998000 >> 172.21.15.177:0/3654998000 conn(0x7fdbcc09a5c0 msgr2=0x7fdbcc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:00.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 -- 172.21.15.177:0/3654998000 shutdown_connections 2023-10-25T16:21:00.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:20:59.999+0000 7fdbd46a2640 1 -- 172.21.15.177:0/3654998000 wait complete. 2023-10-25T16:21:00.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 Processor -- start 2023-10-25T16:21:00.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- start start 2023-10-25T16:21:00.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 0x7fdbcc0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:00.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbcc0cdb10 0x7fdbcc0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:00.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbcc15eba0 0x7fdbcc15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:00.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0cb120 con 0x7fdbcc0b2120 2023-10-25T16:21:00.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0c57a0 con 0x7fdbcc0cdb10 2023-10-25T16:21:00.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15b5b0 con 0x7fdbcc15eba0 2023-10-25T16:21:00.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 0x7fdbcc0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:00.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 0x7fdbcc0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:38044/0 (socket says 172.21.15.177:38044) 2023-10-25T16:21:00.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 -- 172.21.15.177:0/462772243 learned_addr learned my addr 172.21.15.177:0/462772243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:00.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd1c3d640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbcc0cdb10 0x7fdbcc0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:00.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 -- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbcc15eba0 msgr2=0x7fdbcc15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:00.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd2c3f640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbcc15eba0 0x7fdbcc15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:00.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbcc15eba0 0x7fdbcc15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 -- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbcc0cdb10 msgr2=0x7fdbcc0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:00.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbcc0cdb10 0x7fdbcc0c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 -- 172.21.15.177:0/462772243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80094a0 con 0x7fdbcc0b2120 2023-10-25T16:21:00.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd1c3d640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbcc0cdb10 0x7fdbcc0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:21:00.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd243e640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 0x7fdbcc0cabe0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8098130 tx=0x7fdbc80a64b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:00.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8005240 con 0x7fdbcc0b2120 2023-10-25T16:21:00.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbc80b5040 con 0x7fdbcc0b2120 2023-10-25T16:21:00.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc0c59d0 con 0x7fdbcc0b2120 2023-10-25T16:21:00.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8005600 con 0x7fdbcc0b2120 2023-10-25T16:21:00.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc0c5f90 con 0x7fdbcc0b2120 2023-10-25T16:21:00.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc04daf0 con 0x7fdbcc0b2120 2023-10-25T16:21:00.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.003+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdbc80046d0 con 0x7fdbcc0b2120 2023-10-25T16:21:00.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.007+0000 7fdbc2ffd640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbb0066470 0x7fdbb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:00.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.007+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbc811e1c0 con 0x7fdbcc0b2120 2023-10-25T16:21:00.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.007+0000 7fdbd1c3d640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbb0066470 0x7fdbb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:00.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.007+0000 7fdbd1c3d640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbb0066470 0x7fdbb0068930 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005fd0 tx=0x7fdbbc005d40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:00.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.007+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbc80eb720 con 0x7fdbcc0b2120 2023-10-25T16:21:00.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.159+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbcc0ce930 con 0x7fdbb0066470 2023-10-25T16:21:00.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.183+0000 7fdbc2ffd640 1 -- 172.21.15.177:0/462772243 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279288 (secure 0 0 0) 0x7fdbcc0ce930 con 0x7fdbb0066470 2023-10-25T16:21:00.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:21:00.184 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:21:00.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbb0066470 msgr2=0x7fdbb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:00.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbb0066470 0x7fdbb0068930 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005fd0 tx=0x7fdbbc005d40 comp rx=0 tx=0).stop 2023-10-25T16:21:00.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 msgr2=0x7fdbcc0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:00.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 0x7fdbcc0cabe0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8098130 tx=0x7fdbc80a64b0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 shutdown_connections 2023-10-25T16:21:00.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdbb0066470 0x7fdbb0068930 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbcc15eba0 0x7fdbcc15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbcc0cdb10 0x7fdbcc0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 --2- 172.21.15.177:0/462772243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbcc0b2120 0x7fdbcc0cabe0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:00.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 >> 172.21.15.177:0/462772243 conn(0x7fdbcc09a5c0 msgr2=0x7fdbcc0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:00.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 shutdown_connections 2023-10-25T16:21:00.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:00.187+0000 7fdbd46a2640 1 -- 172.21.15.177:0/462772243 wait complete. 2023-10-25T16:21:00.201 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-25T16:20:58.772102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554554,"statfs":{"total":1600000000,"available":1591863707,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.047330"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.780088+0000","last_change":"2023-10-25T16:20:55.780004+0000","last_active":"2023-10-25T16:20:55.780088+0000","last_peered":"2023-10-25T16:20:55.780088+0000","last_clean":"2023-10-25T16:20:55.780088+0000","last_became_active":"2023-10-25T16:20:55.779374+0000","last_became_peered":"2023-10-25T16:20:55.779374+0000","last_unstale":"2023-10-25T16:20:55.780088+0000","last_undegraded":"2023-10-25T16:20:55.780088+0000","last_fullsized":"2023-10-25T16:20:55.780088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:16:34.694815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751716+0000","last_change":"2023-10-25T16:20:54.751716+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751716+0000","last_undegraded":"2023-10-25T16:20:54.751716+0000","last_fullsized":"2023-10-25T16:20:54.751716+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754600+0000","last_change":"2023-10-25T16:20:54.754600+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754600+0000","last_undegraded":"2023-10-25T16:20:54.754600+0000","last_fullsized":"2023-10-25T16:20:54.754600+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.776968+0000","last_change":"2023-10-25T16:20:55.776769+0000","last_active":"2023-10-25T16:20:55.776968+0000","last_peered":"2023-10-25T16:20:55.776968+0000","last_clean":"2023-10-25T16:20:55.776968+0000","last_became_active":"2023-10-25T16:20:55.774636+0000","last_became_peered":"2023-10-25T16:20:55.774636+0000","last_unstale":"2023-10-25T16:20:55.776968+0000","last_undegraded":"2023-10-25T16:20:55.776968+0000","last_fullsized":"2023-10-25T16:20:55.776968+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:39:58.917721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755873+0000","last_change":"2023-10-25T16:20:54.755873+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755873+0000","last_undegraded":"2023-10-25T16:20:54.755873+0000","last_fullsized":"2023-10-25T16:20:54.755873+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752156+0000","last_change":"2023-10-25T16:20:54.752156+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752156+0000","last_undegraded":"2023-10-25T16:20:54.752156+0000","last_fullsized":"2023-10-25T16:20:54.752156+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751457+0000","last_change":"2023-10-25T16:20:54.751457+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751457+0000","last_undegraded":"2023-10-25T16:20:54.751457+0000","last_fullsized":"2023-10-25T16:20:54.751457+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753766+0000","last_change":"2023-10-25T16:20:54.753766+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753766+0000","last_undegraded":"2023-10-25T16:20:54.753766+0000","last_fullsized":"2023-10-25T16:20:54.753766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755962+0000","last_change":"2023-10-25T16:20:54.755962+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755962+0000","last_undegraded":"2023-10-25T16:20:54.755962+0000","last_fullsized":"2023-10-25T16:20:54.755962+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752774+0000","last_change":"2023-10-25T16:20:54.752774+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752774+0000","last_undegraded":"2023-10-25T16:20:54.752774+0000","last_fullsized":"2023-10-25T16:20:54.752774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750691+0000","last_change":"2023-10-25T16:20:54.750691+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750691+0000","last_undegraded":"2023-10-25T16:20:54.750691+0000","last_fullsized":"2023-10-25T16:20:54.750691+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750855+0000","last_change":"2023-10-25T16:20:54.750855+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750855+0000","last_undegraded":"2023-10-25T16:20:54.750855+0000","last_fullsized":"2023-10-25T16:20:54.750855+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772630+0000","last_change":"2023-10-25T16:20:55.772466+0000","last_active":"2023-10-25T16:20:55.772630+0000","last_peered":"2023-10-25T16:20:55.772630+0000","last_clean":"2023-10-25T16:20:55.772630+0000","last_became_active":"2023-10-25T16:20:55.771742+0000","last_became_peered":"2023-10-25T16:20:55.771742+0000","last_unstale":"2023-10-25T16:20:55.772630+0000","last_undegraded":"2023-10-25T16:20:55.772630+0000","last_fullsized":"2023-10-25T16:20:55.772630+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:23:11.762083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751538+0000","last_change":"2023-10-25T16:20:54.751538+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751538+0000","last_undegraded":"2023-10-25T16:20:54.751538+0000","last_fullsized":"2023-10-25T16:20:54.751538+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.783023+0000","last_change":"2023-10-25T16:20:55.782883+0000","last_active":"2023-10-25T16:20:55.783023+0000","last_peered":"2023-10-25T16:20:55.783023+0000","last_clean":"2023-10-25T16:20:55.783023+0000","last_became_active":"2023-10-25T16:20:55.782144+0000","last_became_peered":"2023-10-25T16:20:55.782144+0000","last_unstale":"2023-10-25T16:20:55.783023+0000","last_undegraded":"2023-10-25T16:20:55.783023+0000","last_fullsized":"2023-10-25T16:20:55.783023+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:30:51.670014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748570+0000","last_change":"2023-10-25T16:20:54.748570+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748570+0000","last_undegraded":"2023-10-25T16:20:54.748570+0000","last_fullsized":"2023-10-25T16:20:54.748570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749669+0000","last_change":"2023-10-25T16:20:54.749669+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749669+0000","last_undegraded":"2023-10-25T16:20:54.749669+0000","last_fullsized":"2023-10-25T16:20:54.749669+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748618+0000","last_change":"2023-10-25T16:20:54.748618+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748618+0000","last_undegraded":"2023-10-25T16:20:54.748618+0000","last_fullsized":"2023-10-25T16:20:54.748618+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753051+0000","last_change":"2023-10-25T16:20:54.753051+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753051+0000","last_undegraded":"2023-10-25T16:20:54.753051+0000","last_fullsized":"2023-10-25T16:20:54.753051+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748660+0000","last_change":"2023-10-25T16:20:54.748660+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748660+0000","last_undegraded":"2023-10-25T16:20:54.748660+0000","last_fullsized":"2023-10-25T16:20:54.748660+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757935+0000","last_change":"2023-10-25T16:20:54.757935+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757935+0000","last_undegraded":"2023-10-25T16:20:54.757935+0000","last_fullsized":"2023-10-25T16:20:54.757935+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749462+0000","last_change":"2023-10-25T16:20:54.749462+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749462+0000","last_undegraded":"2023-10-25T16:20:54.749462+0000","last_fullsized":"2023-10-25T16:20:54.749462+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752341+0000","last_change":"2023-10-25T16:20:54.752341+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752341+0000","last_undegraded":"2023-10-25T16:20:54.752341+0000","last_fullsized":"2023-10-25T16:20:54.752341+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752700+0000","last_change":"2023-10-25T16:20:54.752700+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752700+0000","last_undegraded":"2023-10-25T16:20:54.752700+0000","last_fullsized":"2023-10-25T16:20:54.752700+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752357+0000","last_change":"2023-10-25T16:20:54.752357+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752357+0000","last_undegraded":"2023-10-25T16:20:54.752357+0000","last_fullsized":"2023-10-25T16:20:54.752357+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747818+0000","last_change":"2023-10-25T16:20:54.747818+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747818+0000","last_undegraded":"2023-10-25T16:20:54.747818+0000","last_fullsized":"2023-10-25T16:20:54.747818+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.787336+0000","last_change":"2023-10-25T16:20:55.787260+0000","last_active":"2023-10-25T16:20:55.787336+0000","last_peered":"2023-10-25T16:20:55.787336+0000","last_clean":"2023-10-25T16:20:55.787336+0000","last_became_active":"2023-10-25T16:20:55.786974+0000","last_became_peered":"2023-10-25T16:20:55.786974+0000","last_unstale":"2023-10-25T16:20:55.787336+0000","last_undegraded":"2023-10-25T16:20:55.787336+0000","last_fullsized":"2023-10-25T16:20:55.787336+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:08.864443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746049+0000","last_change":"2023-10-25T16:20:54.746049+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746049+0000","last_undegraded":"2023-10-25T16:20:54.746049+0000","last_fullsized":"2023-10-25T16:20:54.746049+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.783735+0000","last_change":"2023-10-25T16:20:55.783671+0000","last_active":"2023-10-25T16:20:55.783735+0000","last_peered":"2023-10-25T16:20:55.783735+0000","last_clean":"2023-10-25T16:20:55.783735+0000","last_became_active":"2023-10-25T16:20:55.783323+0000","last_became_peered":"2023-10-25T16:20:55.783323+0000","last_unstale":"2023-10-25T16:20:55.783735+0000","last_undegraded":"2023-10-25T16:20:55.783735+0000","last_fullsized":"2023-10-25T16:20:55.783735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:42.879285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.778841+0000","last_change":"2023-10-25T16:20:55.778429+0000","last_active":"2023-10-25T16:20:55.778841+0000","last_peered":"2023-10-25T16:20:55.778841+0000","last_clean":"2023-10-25T16:20:55.778841+0000","last_became_active":"2023-10-25T16:20:55.777725+0000","last_became_peered":"2023-10-25T16:20:55.777725+0000","last_unstale":"2023-10-25T16:20:55.778841+0000","last_undegraded":"2023-10-25T16:20:55.778841+0000","last_fullsized":"2023-10-25T16:20:55.778841+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:01:26.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757166+0000","last_change":"2023-10-25T16:20:54.757166+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757166+0000","last_undegraded":"2023-10-25T16:20:54.757166+0000","last_fullsized":"2023-10-25T16:20:54.757166+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750554+0000","last_change":"2023-10-25T16:20:54.750554+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750554+0000","last_undegraded":"2023-10-25T16:20:54.750554+0000","last_fullsized":"2023-10-25T16:20:54.750554+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748228+0000","last_change":"2023-10-25T16:20:54.748228+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748228+0000","last_undegraded":"2023-10-25T16:20:54.748228+0000","last_fullsized":"2023-10-25T16:20:54.748228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.751054+0000","last_change":"2023-10-25T16:20:54.750779+0000","last_active":"2023-10-25T16:20:54.751054+0000","last_peered":"2023-10-25T16:20:54.751054+0000","last_clean":"2023-10-25T16:20:54.751054+0000","last_became_active":"2023-10-25T16:20:54.750091+0000","last_became_peered":"2023-10-25T16:20:54.750091+0000","last_unstale":"2023-10-25T16:20:54.751054+0000","last_undegraded":"2023-10-25T16:20:54.751054+0000","last_fullsized":"2023-10-25T16:20:54.751054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:25:27.972269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.753123+0000","last_change":"2023-10-25T16:20:54.753123+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.753123+0000","last_undegraded":"2023-10-25T16:20:54.753123+0000","last_fullsized":"2023-10-25T16:20:54.753123+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759359+0000","last_change":"2023-10-25T16:20:54.759191+0000","last_active":"2023-10-25T16:20:54.759359+0000","last_peered":"2023-10-25T16:20:54.759359+0000","last_clean":"2023-10-25T16:20:54.759359+0000","last_became_active":"2023-10-25T16:20:54.758654+0000","last_became_peered":"2023-10-25T16:20:54.758654+0000","last_unstale":"2023-10-25T16:20:54.759359+0000","last_undegraded":"2023-10-25T16:20:54.759359+0000","last_fullsized":"2023-10-25T16:20:54.759359+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748190+0000","last_change":"2023-10-25T16:20:54.748190+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748190+0000","last_undegraded":"2023-10-25T16:20:54.748190+0000","last_fullsized":"2023-10-25T16:20:54.748190+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758560+0000","last_change":"2023-10-25T16:20:54.758266+0000","last_active":"2023-10-25T16:20:54.758560+0000","last_peered":"2023-10-25T16:20:54.758560+0000","last_clean":"2023-10-25T16:20:54.758560+0000","last_became_active":"2023-10-25T16:20:54.757497+0000","last_became_peered":"2023-10-25T16:20:54.757497+0000","last_unstale":"2023-10-25T16:20:54.758560+0000","last_undegraded":"2023-10-25T16:20:54.758560+0000","last_fullsized":"2023-10-25T16:20:54.758560+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:29:33.878390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755084+0000","last_change":"2023-10-25T16:20:54.755084+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755084+0000","last_undegraded":"2023-10-25T16:20:54.755084+0000","last_fullsized":"2023-10-25T16:20:54.755084+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756647+0000","last_change":"2023-10-25T16:20:54.756559+0000","last_active":"2023-10-25T16:20:54.756647+0000","last_peered":"2023-10-25T16:20:54.756647+0000","last_clean":"2023-10-25T16:20:54.756647+0000","last_became_active":"2023-10-25T16:20:54.756240+0000","last_became_peered":"2023-10-25T16:20:54.756240+0000","last_unstale":"2023-10-25T16:20:54.756647+0000","last_undegraded":"2023-10-25T16:20:54.756647+0000","last_fullsized":"2023-10-25T16:20:54.756647+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748171+0000","last_change":"2023-10-25T16:20:54.748171+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748171+0000","last_undegraded":"2023-10-25T16:20:54.748171+0000","last_fullsized":"2023-10-25T16:20:54.748171+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.754257+0000","last_change":"2023-10-25T16:20:54.753168+0000","last_active":"2023-10-25T16:20:54.754257+0000","last_peered":"2023-10-25T16:20:54.754257+0000","last_clean":"2023-10-25T16:20:54.754257+0000","last_became_active":"2023-10-25T16:20:54.752919+0000","last_became_peered":"2023-10-25T16:20:54.752919+0000","last_unstale":"2023-10-25T16:20:54.754257+0000","last_undegraded":"2023-10-25T16:20:54.754257+0000","last_fullsized":"2023-10-25T16:20:54.754257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:22:18.896946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748577+0000","last_change":"2023-10-25T16:20:54.748577+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748577+0000","last_undegraded":"2023-10-25T16:20:54.748577+0000","last_fullsized":"2023-10-25T16:20:54.748577+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.755685+0000","last_change":"2023-10-25T16:20:54.755598+0000","last_active":"2023-10-25T16:20:54.755685+0000","last_peered":"2023-10-25T16:20:54.755685+0000","last_clean":"2023-10-25T16:20:54.755685+0000","last_became_active":"2023-10-25T16:20:54.755185+0000","last_became_peered":"2023-10-25T16:20:54.755185+0000","last_unstale":"2023-10-25T16:20:54.755685+0000","last_undegraded":"2023-10-25T16:20:54.755685+0000","last_fullsized":"2023-10-25T16:20:54.755685+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:17:00.238365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751297+0000","last_change":"2023-10-25T16:20:54.751297+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751297+0000","last_undegraded":"2023-10-25T16:20:54.751297+0000","last_fullsized":"2023-10-25T16:20:54.751297+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.765707+0000","last_change":"2023-10-25T16:20:54.765552+0000","last_active":"2023-10-25T16:20:54.765707+0000","last_peered":"2023-10-25T16:20:54.765707+0000","last_clean":"2023-10-25T16:20:54.765707+0000","last_became_active":"2023-10-25T16:20:54.764892+0000","last_became_peered":"2023-10-25T16:20:54.764892+0000","last_unstale":"2023-10-25T16:20:54.765707+0000","last_undegraded":"2023-10-25T16:20:54.765707+0000","last_fullsized":"2023-10-25T16:20:54.765707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:24.555799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750998+0000","last_change":"2023-10-25T16:20:54.750998+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750998+0000","last_undegraded":"2023-10-25T16:20:54.750998+0000","last_fullsized":"2023-10-25T16:20:54.750998+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763711+0000","last_change":"2023-10-25T16:20:54.763630+0000","last_active":"2023-10-25T16:20:54.763711+0000","last_peered":"2023-10-25T16:20:54.763711+0000","last_clean":"2023-10-25T16:20:54.763711+0000","last_became_active":"2023-10-25T16:20:54.763250+0000","last_became_peered":"2023-10-25T16:20:54.763250+0000","last_unstale":"2023-10-25T16:20:54.763711+0000","last_undegraded":"2023-10-25T16:20:54.763711+0000","last_fullsized":"2023-10-25T16:20:54.763711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:49:52.880269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.773342+0000","last_change":"2023-10-25T16:20:55.773192+0000","last_active":"2023-10-25T16:20:55.773342+0000","last_peered":"2023-10-25T16:20:55.773342+0000","last_clean":"2023-10-25T16:20:55.773342+0000","last_became_active":"2023-10-25T16:20:55.771716+0000","last_became_peered":"2023-10-25T16:20:55.771716+0000","last_unstale":"2023-10-25T16:20:55.773342+0000","last_undegraded":"2023-10-25T16:20:55.773342+0000","last_fullsized":"2023-10-25T16:20:55.773342+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:54:01.767510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763639+0000","last_change":"2023-10-25T16:20:54.763382+0000","last_active":"2023-10-25T16:20:54.763639+0000","last_peered":"2023-10-25T16:20:54.763639+0000","last_clean":"2023-10-25T16:20:54.763639+0000","last_became_active":"2023-10-25T16:20:54.762654+0000","last_became_peered":"2023-10-25T16:20:54.762654+0000","last_unstale":"2023-10-25T16:20:54.763639+0000","last_undegraded":"2023-10-25T16:20:54.763639+0000","last_fullsized":"2023-10-25T16:20:54.763639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:02.824860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747244+0000","last_change":"2023-10-25T16:20:54.747244+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747244+0000","last_undegraded":"2023-10-25T16:20:54.747244+0000","last_fullsized":"2023-10-25T16:20:54.747244+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763595+0000","last_change":"2023-10-25T16:20:54.763506+0000","last_active":"2023-10-25T16:20:54.763595+0000","last_peered":"2023-10-25T16:20:54.763595+0000","last_clean":"2023-10-25T16:20:54.763595+0000","last_became_active":"2023-10-25T16:20:54.763202+0000","last_became_peered":"2023-10-25T16:20:54.763202+0000","last_unstale":"2023-10-25T16:20:54.763595+0000","last_undegraded":"2023-10-25T16:20:54.763595+0000","last_fullsized":"2023-10-25T16:20:54.763595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:41.174773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.755828+0000","last_change":"2023-10-25T16:20:54.755828+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.755828+0000","last_undegraded":"2023-10-25T16:20:54.755828+0000","last_fullsized":"2023-10-25T16:20:54.755828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768121+0000","last_change":"2023-10-25T16:20:54.767309+0000","last_active":"2023-10-25T16:20:54.768121+0000","last_peered":"2023-10-25T16:20:54.768121+0000","last_clean":"2023-10-25T16:20:54.768121+0000","last_became_active":"2023-10-25T16:20:54.765724+0000","last_became_peered":"2023-10-25T16:20:54.765724+0000","last_unstale":"2023-10-25T16:20:54.768121+0000","last_undegraded":"2023-10-25T16:20:54.768121+0000","last_fullsized":"2023-10-25T16:20:54.768121+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747603+0000","last_change":"2023-10-25T16:20:54.747603+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747603+0000","last_undegraded":"2023-10-25T16:20:54.747603+0000","last_fullsized":"2023-10-25T16:20:54.747603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771758+0000","last_change":"2023-10-25T16:20:54.771635+0000","last_active":"2023-10-25T16:20:54.771758+0000","last_peered":"2023-10-25T16:20:54.771758+0000","last_clean":"2023-10-25T16:20:54.771758+0000","last_became_active":"2023-10-25T16:20:54.771107+0000","last_became_peered":"2023-10-25T16:20:54.771107+0000","last_unstale":"2023-10-25T16:20:54.771758+0000","last_undegraded":"2023-10-25T16:20:54.771758+0000","last_fullsized":"2023-10-25T16:20:54.771758+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:37:02.197973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772582+0000","last_change":"2023-10-25T16:20:55.772121+0000","last_active":"2023-10-25T16:20:55.772582+0000","last_peered":"2023-10-25T16:20:55.772582+0000","last_clean":"2023-10-25T16:20:55.772582+0000","last_became_active":"2023-10-25T16:20:55.771504+0000","last_became_peered":"2023-10-25T16:20:55.771504+0000","last_unstale":"2023-10-25T16:20:55.772582+0000","last_undegraded":"2023-10-25T16:20:55.772582+0000","last_fullsized":"2023-10-25T16:20:55.772582+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:25.410199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.772708+0000","last_change":"2023-10-25T16:20:54.759691+0000","last_active":"2023-10-25T16:20:55.772708+0000","last_peered":"2023-10-25T16:20:55.772708+0000","last_clean":"2023-10-25T16:20:55.772708+0000","last_became_active":"2023-10-25T16:20:54.759459+0000","last_became_peered":"2023-10-25T16:20:54.759459+0000","last_unstale":"2023-10-25T16:20:55.772708+0000","last_undegraded":"2023-10-25T16:20:55.772708+0000","last_fullsized":"2023-10-25T16:20:55.772708+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:24:39.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754480+0000","last_change":"2023-10-25T16:20:54.754480+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754480+0000","last_undegraded":"2023-10-25T16:20:54.754480+0000","last_fullsized":"2023-10-25T16:20:54.754480+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768377+0000","last_change":"2023-10-25T16:20:54.768310+0000","last_active":"2023-10-25T16:20:54.768377+0000","last_peered":"2023-10-25T16:20:54.768377+0000","last_clean":"2023-10-25T16:20:54.768377+0000","last_became_active":"2023-10-25T16:20:54.768064+0000","last_became_peered":"2023-10-25T16:20:54.768064+0000","last_unstale":"2023-10-25T16:20:54.768377+0000","last_undegraded":"2023-10-25T16:20:54.768377+0000","last_fullsized":"2023-10-25T16:20:54.768377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:37.419589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750032+0000","last_change":"2023-10-25T16:20:54.750032+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750032+0000","last_undegraded":"2023-10-25T16:20:54.750032+0000","last_fullsized":"2023-10-25T16:20:54.750032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771237+0000","last_change":"2023-10-25T16:20:54.771088+0000","last_active":"2023-10-25T16:20:54.771237+0000","last_peered":"2023-10-25T16:20:54.771237+0000","last_clean":"2023-10-25T16:20:54.771237+0000","last_became_active":"2023-10-25T16:20:54.768618+0000","last_became_peered":"2023-10-25T16:20:54.768618+0000","last_unstale":"2023-10-25T16:20:54.771237+0000","last_undegraded":"2023-10-25T16:20:54.771237+0000","last_fullsized":"2023-10-25T16:20:54.771237+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:34.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.749605+0000","last_change":"2023-10-25T16:20:54.749605+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.749605+0000","last_undegraded":"2023-10-25T16:20:54.749605+0000","last_fullsized":"2023-10-25T16:20:54.749605+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.756007+0000","last_change":"2023-10-25T16:20:54.753340+0000","last_active":"2023-10-25T16:20:54.756007+0000","last_peered":"2023-10-25T16:20:54.756007+0000","last_clean":"2023-10-25T16:20:54.756007+0000","last_became_active":"2023-10-25T16:20:54.752315+0000","last_became_peered":"2023-10-25T16:20:54.752315+0000","last_unstale":"2023-10-25T16:20:54.756007+0000","last_undegraded":"2023-10-25T16:20:54.756007+0000","last_fullsized":"2023-10-25T16:20:54.756007+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:33:53.225075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.745977+0000","last_change":"2023-10-25T16:20:54.745977+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.745977+0000","last_undegraded":"2023-10-25T16:20:54.745977+0000","last_fullsized":"2023-10-25T16:20:54.745977+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764932+0000","last_change":"2023-10-25T16:20:54.764861+0000","last_active":"2023-10-25T16:20:54.764932+0000","last_peered":"2023-10-25T16:20:54.764932+0000","last_clean":"2023-10-25T16:20:54.764932+0000","last_became_active":"2023-10-25T16:20:54.764490+0000","last_became_peered":"2023-10-25T16:20:54.764490+0000","last_unstale":"2023-10-25T16:20:54.764932+0000","last_undegraded":"2023-10-25T16:20:54.764932+0000","last_fullsized":"2023-10-25T16:20:54.764932+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:56.070146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747834+0000","last_change":"2023-10-25T16:20:54.747834+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747834+0000","last_undegraded":"2023-10-25T16:20:54.747834+0000","last_fullsized":"2023-10-25T16:20:54.747834+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758935+0000","last_change":"2023-10-25T16:20:54.758776+0000","last_active":"2023-10-25T16:20:54.758935+0000","last_peered":"2023-10-25T16:20:54.758935+0000","last_clean":"2023-10-25T16:20:54.758935+0000","last_became_active":"2023-10-25T16:20:54.757905+0000","last_became_peered":"2023-10-25T16:20:54.757905+0000","last_unstale":"2023-10-25T16:20:54.758935+0000","last_undegraded":"2023-10-25T16:20:54.758935+0000","last_fullsized":"2023-10-25T16:20:54.758935+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:33:33.548429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751602+0000","last_change":"2023-10-25T16:20:54.751602+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751602+0000","last_undegraded":"2023-10-25T16:20:54.751602+0000","last_fullsized":"2023-10-25T16:20:54.751602+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.759275+0000","last_change":"2023-10-25T16:20:54.759150+0000","last_active":"2023-10-25T16:20:54.759275+0000","last_peered":"2023-10-25T16:20:54.759275+0000","last_clean":"2023-10-25T16:20:54.759275+0000","last_became_active":"2023-10-25T16:20:54.758491+0000","last_became_peered":"2023-10-25T16:20:54.758491+0000","last_unstale":"2023-10-25T16:20:54.759275+0000","last_undegraded":"2023-10-25T16:20:54.759275+0000","last_fullsized":"2023-10-25T16:20:54.759275+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:01.974280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.778146+0000","last_change":"2023-10-25T16:20:55.777794+0000","last_active":"2023-10-25T16:20:55.778146+0000","last_peered":"2023-10-25T16:20:55.778146+0000","last_clean":"2023-10-25T16:20:55.778146+0000","last_became_active":"2023-10-25T16:20:55.776081+0000","last_became_peered":"2023-10-25T16:20:55.776081+0000","last_unstale":"2023-10-25T16:20:55.778146+0000","last_undegraded":"2023-10-25T16:20:55.778146+0000","last_fullsized":"2023-10-25T16:20:55.778146+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:25:37.942080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.769009+0000","last_change":"2023-10-25T16:20:54.768780+0000","last_active":"2023-10-25T16:20:54.769009+0000","last_peered":"2023-10-25T16:20:54.769009+0000","last_clean":"2023-10-25T16:20:54.769009+0000","last_became_active":"2023-10-25T16:20:54.766581+0000","last_became_peered":"2023-10-25T16:20:54.766581+0000","last_unstale":"2023-10-25T16:20:54.769009+0000","last_undegraded":"2023-10-25T16:20:54.769009+0000","last_fullsized":"2023-10-25T16:20:54.769009+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:10.174922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750878+0000","last_change":"2023-10-25T16:20:54.750878+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750878+0000","last_undegraded":"2023-10-25T16:20:54.750878+0000","last_fullsized":"2023-10-25T16:20:54.750878+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763950+0000","last_change":"2023-10-25T16:20:54.763860+0000","last_active":"2023-10-25T16:20:54.763950+0000","last_peered":"2023-10-25T16:20:54.763950+0000","last_clean":"2023-10-25T16:20:54.763950+0000","last_became_active":"2023-10-25T16:20:54.763501+0000","last_became_peered":"2023-10-25T16:20:54.763501+0000","last_unstale":"2023-10-25T16:20:54.763950+0000","last_undegraded":"2023-10-25T16:20:54.763950+0000","last_fullsized":"2023-10-25T16:20:54.763950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:46:22.895709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.752193+0000","last_change":"2023-10-25T16:20:54.752193+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.752193+0000","last_undegraded":"2023-10-25T16:20:54.752193+0000","last_fullsized":"2023-10-25T16:20:54.752193+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758910+0000","last_change":"2023-10-25T16:20:54.758838+0000","last_active":"2023-10-25T16:20:54.758910+0000","last_peered":"2023-10-25T16:20:54.758910+0000","last_clean":"2023-10-25T16:20:54.758910+0000","last_became_active":"2023-10-25T16:20:54.758498+0000","last_became_peered":"2023-10-25T16:20:54.758498+0000","last_unstale":"2023-10-25T16:20:54.758910+0000","last_undegraded":"2023-10-25T16:20:54.758910+0000","last_fullsized":"2023-10-25T16:20:54.758910+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:53:55.894845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.748055+0000","last_change":"2023-10-25T16:20:54.748055+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.748055+0000","last_undegraded":"2023-10-25T16:20:54.748055+0000","last_fullsized":"2023-10-25T16:20:54.748055+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.763285+0000","last_change":"2023-10-25T16:20:54.763224+0000","last_active":"2023-10-25T16:20:54.763285+0000","last_peered":"2023-10-25T16:20:54.763285+0000","last_clean":"2023-10-25T16:20:54.763285+0000","last_became_active":"2023-10-25T16:20:54.762999+0000","last_became_peered":"2023-10-25T16:20:54.762999+0000","last_unstale":"2023-10-25T16:20:54.763285+0000","last_undegraded":"2023-10-25T16:20:54.763285+0000","last_fullsized":"2023-10-25T16:20:54.763285+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:04.836130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750042+0000","last_change":"2023-10-25T16:20:54.750042+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750042+0000","last_undegraded":"2023-10-25T16:20:54.750042+0000","last_fullsized":"2023-10-25T16:20:54.750042+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"157'2","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.797974+0000","last_change":"2023-10-25T16:20:54.769664+0000","last_active":"2023-10-25T16:20:55.797974+0000","last_peered":"2023-10-25T16:20:55.797974+0000","last_clean":"2023-10-25T16:20:55.797974+0000","last_became_active":"2023-10-25T16:20:54.769387+0000","last_became_peered":"2023-10-25T16:20:54.769387+0000","last_unstale":"2023-10-25T16:20:55.797974+0000","last_undegraded":"2023-10-25T16:20:55.797974+0000","last_fullsized":"2023-10-25T16:20:55.797974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:51.170554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.776948+0000","last_change":"2023-10-25T16:20:55.773589+0000","last_active":"2023-10-25T16:20:55.776948+0000","last_peered":"2023-10-25T16:20:55.776948+0000","last_clean":"2023-10-25T16:20:55.776948+0000","last_became_active":"2023-10-25T16:20:55.772463+0000","last_became_peered":"2023-10-25T16:20:55.772463+0000","last_unstale":"2023-10-25T16:20:55.776948+0000","last_undegraded":"2023-10-25T16:20:55.776948+0000","last_fullsized":"2023-10-25T16:20:55.776948+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:31:53.486815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.762505+0000","last_change":"2023-10-25T16:20:54.762316+0000","last_active":"2023-10-25T16:20:54.762505+0000","last_peered":"2023-10-25T16:20:54.762505+0000","last_clean":"2023-10-25T16:20:54.762505+0000","last_became_active":"2023-10-25T16:20:54.761646+0000","last_became_peered":"2023-10-25T16:20:54.761646+0000","last_unstale":"2023-10-25T16:20:54.762505+0000","last_undegraded":"2023-10-25T16:20:54.762505+0000","last_fullsized":"2023-10-25T16:20:54.762505+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:41:54.859004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.751346+0000","last_change":"2023-10-25T16:20:54.751346+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.751346+0000","last_undegraded":"2023-10-25T16:20:54.751346+0000","last_fullsized":"2023-10-25T16:20:54.751346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.764433+0000","last_change":"2023-10-25T16:20:54.764346+0000","last_active":"2023-10-25T16:20:54.764433+0000","last_peered":"2023-10-25T16:20:54.764433+0000","last_clean":"2023-10-25T16:20:54.764433+0000","last_became_active":"2023-10-25T16:20:54.764007+0000","last_became_peered":"2023-10-25T16:20:54.764007+0000","last_unstale":"2023-10-25T16:20:54.764433+0000","last_undegraded":"2023-10-25T16:20:54.764433+0000","last_fullsized":"2023-10-25T16:20:54.764433+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:11:45.618791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.750803+0000","last_change":"2023-10-25T16:20:54.750803+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.750803+0000","last_undegraded":"2023-10-25T16:20:54.750803+0000","last_fullsized":"2023-10-25T16:20:54.750803+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.758587+0000","last_change":"2023-10-25T16:20:54.758458+0000","last_active":"2023-10-25T16:20:54.758587+0000","last_peered":"2023-10-25T16:20:54.758587+0000","last_clean":"2023-10-25T16:20:54.758587+0000","last_became_active":"2023-10-25T16:20:54.757860+0000","last_became_peered":"2023-10-25T16:20:54.757860+0000","last_unstale":"2023-10-25T16:20:54.758587+0000","last_undegraded":"2023-10-25T16:20:54.758587+0000","last_fullsized":"2023-10-25T16:20:54.758587+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:44:32.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.757000+0000","last_change":"2023-10-25T16:20:54.757000+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.757000+0000","last_undegraded":"2023-10-25T16:20:54.757000+0000","last_fullsized":"2023-10-25T16:20:54.757000+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.768298+0000","last_change":"2023-10-25T16:20:54.768211+0000","last_active":"2023-10-25T16:20:54.768298+0000","last_peered":"2023-10-25T16:20:54.768298+0000","last_clean":"2023-10-25T16:20:54.768298+0000","last_became_active":"2023-10-25T16:20:54.767978+0000","last_became_peered":"2023-10-25T16:20:54.767978+0000","last_unstale":"2023-10-25T16:20:54.768298+0000","last_undegraded":"2023-10-25T16:20:54.768298+0000","last_fullsized":"2023-10-25T16:20:54.768298+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:23:24.618348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.746378+0000","last_change":"2023-10-25T16:20:54.746378+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.746378+0000","last_undegraded":"2023-10-25T16:20:54.746378+0000","last_fullsized":"2023-10-25T16:20:54.746378+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.760066+0000","last_change":"2023-10-25T16:20:54.759883+0000","last_active":"2023-10-25T16:20:54.760066+0000","last_peered":"2023-10-25T16:20:54.760066+0000","last_clean":"2023-10-25T16:20:54.760066+0000","last_became_active":"2023-10-25T16:20:54.758688+0000","last_became_peered":"2023-10-25T16:20:54.758688+0000","last_unstale":"2023-10-25T16:20:54.760066+0000","last_undegraded":"2023-10-25T16:20:54.760066+0000","last_fullsized":"2023-10-25T16:20:54.760066+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:50.541261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747856+0000","last_change":"2023-10-25T16:20:54.747856+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747856+0000","last_undegraded":"2023-10-25T16:20:54.747856+0000","last_fullsized":"2023-10-25T16:20:54.747856+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.771883+0000","last_change":"2023-10-25T16:20:54.771822+0000","last_active":"2023-10-25T16:20:54.771883+0000","last_peered":"2023-10-25T16:20:54.771883+0000","last_clean":"2023-10-25T16:20:54.771883+0000","last_became_active":"2023-10-25T16:20:54.771600+0000","last_became_peered":"2023-10-25T16:20:54.771600+0000","last_unstale":"2023-10-25T16:20:54.771883+0000","last_undegraded":"2023-10-25T16:20:54.771883+0000","last_fullsized":"2023-10-25T16:20:54.771883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:16.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.754088+0000","last_change":"2023-10-25T16:20:54.754088+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.754088+0000","last_undegraded":"2023-10-25T16:20:54.754088+0000","last_fullsized":"2023-10-25T16:20:54.754088+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.761233+0000","last_change":"2023-10-25T16:20:54.761148+0000","last_active":"2023-10-25T16:20:54.761233+0000","last_peered":"2023-10-25T16:20:54.761233+0000","last_clean":"2023-10-25T16:20:54.761233+0000","last_became_active":"2023-10-25T16:20:54.760911+0000","last_became_peered":"2023-10-25T16:20:54.760911+0000","last_unstale":"2023-10-25T16:20:54.761233+0000","last_undegraded":"2023-10-25T16:20:54.761233+0000","last_fullsized":"2023-10-25T16:20:54.761233+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:45:31.619997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-10-25T16:20:54.747278+0000","last_change":"2023-10-25T16:20:54.747278+0000","last_active":"2023-10-25T16:20:54.724505+0000","last_peered":"2023-10-25T16:20:54.724505+0000","last_clean":"2023-10-25T16:20:54.724505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:20:54.747278+0000","last_undegraded":"2023-10-25T16:20:54.747278+0000","last_fullsized":"2023-10-25T16:20:54.747278+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-25T16:20:54.767060+0000","last_change":"2023-10-25T16:20:54.766906+0000","last_active":"2023-10-25T16:20:54.767060+0000","last_peered":"2023-10-25T16:20:54.767060+0000","last_clean":"2023-10-25T16:20:54.767060+0000","last_became_active":"2023-10-25T16:20:54.753701+0000","last_became_peered":"2023-10-25T16:20:54.753701+0000","last_unstale":"2023-10-25T16:20:54.767060+0000","last_undegraded":"2023-10-25T16:20:54.767060+0000","last_fullsized":"2023-10-25T16:20:54.767060+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:48.379708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":293,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-25T16:20:53.724985+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:20:53.724985+0000","last_peered":"2023-10-25T16:20:53.724985+0000","last_clean":"2023-10-25T16:20:53.724985+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:20:53.724985+0000","last_undegraded":"2023-10-25T16:20:53.724985+0000","last_fullsized":"2023-10-25T16:20:53.724985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542243,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":859,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194452,"statfs":{"total":200000000,"available":199119382,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.52900000000000003},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.88200000000000001,"5min":0.94999999999999996,"15min":1.077},"last":1.0489999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66400000000000003,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.1759999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70699999999999996,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":1.159,"5min":1.246,"15min":1.246},"last":0.495},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.2729999999999999,"5min":1.345,"15min":1.345},"last":0.46200000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.94799999999999995,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.45,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.87},"min":{"1min":0.68400000000000005,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.3160000000000001,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":1.1220000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.85499999999999998},"min":{"1min":0.74399999999999999,"5min":0.56599999999999995,"15min":0.504},"max":{"1min":1.298,"5min":1.345,"15min":1.4930000000000001},"last":0.749},{"interface":"front","average":{"1min":1.002,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.747,"5min":0.58599999999999997,"15min":0.47899999999999998},"max":{"1min":1.518,"5min":1.671,"15min":1.671},"last":0.93700000000000006}]},{"osd":6,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.90700000000000003},"min":{"1min":0.79300000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.02,"5min":0.95299999999999996,"15min":0.93700000000000006},"min":{"1min":0.73099999999999998,"5min":0.56699999999999995,"15min":0.53000000000000003},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.995,"15min":0.93600000000000005},"min":{"1min":0.71099999999999997,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.226,"5min":1.474,"15min":1.677},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.026,"5min":1.016,"15min":0.97099999999999997},"min":{"1min":0.69699999999999995,"5min":0.61699999999999999,"15min":0.57999999999999996},"max":{"1min":1.4139999999999999,"5min":1.454,"15min":1.7569999999999999},"last":1.0049999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193883,"statfs":{"total":200000000,"available":198536405,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.256,"15min":1.256},"last":1.204},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.534,"15min":1.534},"last":0.73699999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.92700000000000005,"15min":0.89100000000000001},"min":{"1min":0.52800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.647,"15min":1.647},"last":1.129},{"interface":"front","average":{"1min":0.87,"5min":0.95099999999999996,"15min":0.90900000000000003},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":1.2549999999999999,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.877,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.018,"5min":1.27,"15min":1.27},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.86899999999999999,"15min":0.83899999999999997},"min":{"1min":0.60499999999999998,"5min":0.54700000000000004,"15min":0.51800000000000002},"max":{"1min":1.284,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.117,"5min":1.446,"15min":1.446},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":0.95099999999999996},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.1950000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0029999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86599999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.177,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93500000000000005,"15min":0.99399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.095}]},{"osd":5,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0029999999999999,"15min":1.028},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.323,"5min":1.637,"15min":1.637},"last":0.91400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1000000000000001,"15min":1.1359999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2789999999999999,"5min":1.669,"15min":1.669},"last":1.165},{"interface":"front","average":{"1min":1.038,"5min":1.0980000000000001,"15min":1.117},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.371,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.28}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.353,"5min":1.395,"15min":1.397},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2230000000000001,"5min":1.224,"15min":1.6419999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89500000000000002,"15min":0.88400000000000001},"min":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.2569999999999999,"5min":1.302,"15min":1.302},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2609999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.84999999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.88400000000000001},"min":{"1min":0.57599999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.446,"5min":1.4570000000000001,"15min":1.476},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.149}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.046,"15min":1.044},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.367,"5min":1.587,"15min":1.7110000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.411,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.002},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.236,"5min":1.444,"15min":1.444},"last":1.048}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.98999999999999999,"15min":0.97299999999999998},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.29,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.054},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.895},"last":1.234}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.105,"15min":1.0860000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.095,"15min":1.05},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.339,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.1830000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86699999999999999,"15min":1.242},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":14.843},"last":1.014},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80900000000000005,"15min":1.3380000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1639999999999999,"5min":1.238,"15min":16.439},"last":2.8450000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.88900000000000001,"15min":1.3},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.111,"5min":1.423,"15min":14.630000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.90800000000000003,"15min":0.877},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.399,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.3520000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95399999999999996,"15min":0.94099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.133,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.601},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94199999999999995,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.129,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":1.0740000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.234,"5min":1.482,"15min":1.482},"last":1.4950000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0700000000000001,"15min":1.4139999999999999},"min":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.268,"5min":2.194,"15min":14.954000000000001},"last":1.1319999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.006,"15min":1.472},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3129999999999999,"5min":1.5489999999999999,"15min":15.904},"last":1.4399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.4650000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0900000000000001,"5min":1.879,"15min":17.219999999999999},"last":7.9610000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.0289999999999999,"15min":1.401},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2470000000000001,"5min":1.748,"15min":14.567},"last":4.5970000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.1479999999999999,"15min":1.5880000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.431,"5min":1.657,"15min":15.089},"last":2.4079999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.5720000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2709999999999999,"5min":1.7090000000000001,"15min":17.492000000000001},"last":7.8730000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.121,"15min":1.234},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2410000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":8.6920000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.216,"5min":1.327,"15min":1.47},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1180000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1659999999999999,"15min":1.288},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98099999999999998,"15min":0.95499999999999996},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.208}]},{"osd":2,"last update":"Wed Oct 25 16:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.288,"5min":1.397,"15min":1.419},"last":1.022},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.226,"5min":1.411,"15min":1.411},"last":1.0629999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.91200000000000003},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2849999999999999,"5min":1.5,"15min":1.5},"last":1.133},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84999999999999998,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1339999999999999,"5min":1.518,"15min":1.518},"last":0.74199999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.48799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.302,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.49,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.97799999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.69199999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":2.085,"15min":2.085},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.212,"5min":1.107,"15min":1.0780000000000001},"min":{"1min":0.92500000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.625,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94799999999999995,"15min":0.94599999999999995},"min":{"1min":0.59299999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":1.474,"15min":1.5029999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.135,"15min":1.1180000000000001},"min":{"1min":0.96099999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.0980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.79000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.44500000000000001,"5min":0.25700000000000001,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.077,"15min":1.083},"last":0.66900000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":1.052,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.109,"5min":1.254,"15min":1.2809999999999999},"last":1.012}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70099999999999996,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.25,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.80300000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.63900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1919999999999999,"15min":1.23},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.042}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89900000000000002,"15min":0.92200000000000004},"min":{"1min":0.68100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.5269999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.998,"5min":0.98299999999999998,"15min":0.94699999999999995},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2410000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.64600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.28,"5min":1.306,"15min":1.456},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97799999999999998,"15min":0.997},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.395,"5min":1.395,"15min":1.663},"last":0.88600000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.018,"15min":0.98099999999999998},"min":{"1min":0.82399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.5660000000000001},"last":1.123},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.51500000000000001},"max":{"1min":1.212,"5min":1.3480000000000001,"15min":1.389},"last":0.85399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":846,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194465,"statfs":{"total":200000000,"available":199133048,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.0800000000000001,"5min":1.1539999999999999,"15min":1.4610000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.29499999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":1.129,"15min":1.1990000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98599999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.35399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90100000000000002,"5min":1.2,"15min":1.2},"last":0.90300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.749},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0129999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.96199999999999997},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.242,"5min":1.702,"15min":12.698},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95799999999999996,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.2090000000000001,"5min":1.4279999999999999,"15min":12.721},"last":0.998}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.345,"15min":1.546},"last":1.018},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1779999999999999,"5min":2.206,"15min":2.206},"last":1.0509999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95899999999999996,"15min":0.93999999999999995},"min":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.379,"15min":1.4610000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.397,"15min":1.5980000000000001},"last":1.1619999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.60999999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2849999999999999,"5min":1.9410000000000001,"15min":14.776},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.254,"5min":1.476,"15min":10.509},"last":1.133}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193889,"statfs":{"total":200000000,"available":198542680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.67800000000000005},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.73399999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.64300000000000002,"15min":0.68200000000000005},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.3919999999999999,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85499999999999998,"15min":0.81799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.181,"5min":1.407,"15min":3.6579999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.621},{"interface":"front","average":{"1min":1.054,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.77800000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94199999999999995,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.97499999999999998,"15min":0.96099999999999997},"min":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.82599999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.01,"15min":0.98499999999999999},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0109999999999999,"15min":0.94099999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.024,"15min":1.246},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4450000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.2629999999999999},"min":{"1min":0.70699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.282,"5min":1.4410000000000001,"15min":11.622},"last":0.75800000000000001}]}]}],"pool_statfs":[]}} 2023-10-25T16:21:01.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:21:01.953 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:21:03.209 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:21:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 -- 172.21.15.177:0/4169790216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 msgr2=0x7f10b40b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 --2- 172.21.15.177:0/4169790216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b40b1df0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009900 tx=0x7f10a401c7f0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 -- 172.21.15.177:0/4169790216 shutdown_connections 2023-10-25T16:21:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 --2- 172.21.15.177:0/4169790216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10b40b2330 0x7f10b40d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 --2- 172.21.15.177:0/4169790216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b40b1df0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 -- 172.21.15.177:0/4169790216 >> 172.21.15.177:0/4169790216 conn(0x7f10b4065f40 msgr2=0x7f10b409a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 -- 172.21.15.177:0/4169790216 shutdown_connections 2023-10-25T16:21:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 -- 172.21.15.177:0/4169790216 wait complete. 2023-10-25T16:21:03.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 Processor -- start 2023-10-25T16:21:03.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.347+0000 7f10b962a640 1 -- start start 2023-10-25T16:21:03.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10b40b2330 0x7f10b4151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10b40d1960 0x7f10b40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b406af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4152130 con 0x7f10b415b590 2023-10-25T16:21:03.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40b4470 con 0x7f10b40d1960 2023-10-25T16:21:03.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40b4750 con 0x7f10b40b2330 2023-10-25T16:21:03.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b406af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b406af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52200/0 (socket says 172.21.15.177:52200) 2023-10-25T16:21:03.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 -- 172.21.15.177:0/2818137138 learned_addr learned my addr 172.21.15.177:0/2818137138 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:03.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b27fc640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10b40d1960 0x7f10b40b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b2ffd640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10b40b2330 0x7f10b4151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 -- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10b40b2330 msgr2=0x7f10b4151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10b40b2330 0x7f10b4151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 -- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10b40d1960 msgr2=0x7f10b40b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10b40d1960 0x7f10b40b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 -- 172.21.15.177:0/2818137138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4009560 con 0x7f10b415b590 2023-10-25T16:21:03.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b37fe640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b406af20 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00c780 tx=0x7f10ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:03.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac004b70 con 0x7f10b415b590 2023-10-25T16:21:03.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f10ac00ce90 con 0x7f10b415b590 2023-10-25T16:21:03.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b40b4a30 con 0x7f10b415b590 2023-10-25T16:21:03.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00aab0 con 0x7f10b415b590 2023-10-25T16:21:03.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b40c58c0 con 0x7f10b415b590 2023-10-25T16:21:03.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b404daf0 con 0x7f10b415b590 2023-10-25T16:21:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f10ac00ac10 con 0x7f10b415b590 2023-10-25T16:21:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f109b7fe640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f10a0066470 0x7f10a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.351+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10ac0844b0 con 0x7f10b415b590 2023-10-25T16:21:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.355+0000 7f10b2ffd640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f10a0066470 0x7f10a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.355+0000 7f10b2ffd640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f10a0066470 0x7f10a0068930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f10a40af000 tx=0x7f10a401b030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.359+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10ac0519c0 con 0x7f10b415b590 2023-10-25T16:21:03.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.515+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10b40c5ae0 con 0x7f10a0066470 2023-10-25T16:21:03.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.535+0000 7f109b7fe640 1 -- 172.21.15.177:0/2818137138 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283837 (secure 0 0 0) 0x7f10b40c5ae0 con 0x7f10a0066470 2023-10-25T16:21:03.536 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:21:03.538 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:21:03.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f10a0066470 msgr2=0x7f10a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f10a0066470 0x7f10a0068930 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f10a40af000 tx=0x7f10a401b030 comp rx=0 tx=0).stop 2023-10-25T16:21:03.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 msgr2=0x7f10b406af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b406af20 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00c780 tx=0x7f10ac00cc40 comp rx=0 tx=0).stop 2023-10-25T16:21:03.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 shutdown_connections 2023-10-25T16:21:03.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f10a0066470 0x7f10a0068930 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b415b590 0x7f10b406af20 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10b40d1960 0x7f10b40b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 --2- 172.21.15.177:0/2818137138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10b40b2330 0x7f10b4151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 >> 172.21.15.177:0/2818137138 conn(0x7f10b4065f40 msgr2=0x7f10b40b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:03.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 shutdown_connections 2023-10-25T16:21:03.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.539+0000 7f10b962a640 1 -- 172.21.15.177:0/2818137138 wait complete. 2023-10-25T16:21:03.556 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2023-10-25T16:21:02.773578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8082,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554417,"statfs":{"total":1600000000,"available":1591724028,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002851"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665864+0000","last_change":"2023-10-25T16:20:55.780004+0000","last_active":"2023-10-25T16:20:57.665864+0000","last_peered":"2023-10-25T16:20:57.665864+0000","last_clean":"2023-10-25T16:20:57.665864+0000","last_became_active":"2023-10-25T16:20:55.779374+0000","last_became_peered":"2023-10-25T16:20:55.779374+0000","last_unstale":"2023-10-25T16:20:57.665864+0000","last_undegraded":"2023-10-25T16:20:57.665864+0000","last_fullsized":"2023-10-25T16:20:57.665864+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:25:54.142659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663741+0000","last_change":"2023-10-25T16:20:55.786259+0000","last_active":"2023-10-25T16:20:57.663741+0000","last_peered":"2023-10-25T16:20:57.663741+0000","last_clean":"2023-10-25T16:20:57.663741+0000","last_became_active":"2023-10-25T16:20:55.785881+0000","last_became_peered":"2023-10-25T16:20:55.785881+0000","last_unstale":"2023-10-25T16:20:57.663741+0000","last_undegraded":"2023-10-25T16:20:57.663741+0000","last_fullsized":"2023-10-25T16:20:57.663741+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:55:05.637458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.662859+0000","last_change":"2023-10-25T16:20:55.783495+0000","last_active":"2023-10-25T16:20:57.662859+0000","last_peered":"2023-10-25T16:20:57.662859+0000","last_clean":"2023-10-25T16:20:57.662859+0000","last_became_active":"2023-10-25T16:20:55.771225+0000","last_became_peered":"2023-10-25T16:20:55.771225+0000","last_unstale":"2023-10-25T16:20:57.662859+0000","last_undegraded":"2023-10-25T16:20:57.662859+0000","last_fullsized":"2023-10-25T16:20:57.662859+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:51.552293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663699+0000","last_change":"2023-10-25T16:20:55.776769+0000","last_active":"2023-10-25T16:20:57.663699+0000","last_peered":"2023-10-25T16:20:57.663699+0000","last_clean":"2023-10-25T16:20:57.663699+0000","last_became_active":"2023-10-25T16:20:55.774636+0000","last_became_peered":"2023-10-25T16:20:55.774636+0000","last_unstale":"2023-10-25T16:20:57.663699+0000","last_undegraded":"2023-10-25T16:20:57.663699+0000","last_fullsized":"2023-10-25T16:20:57.663699+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:38:31.070288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746274+0000","last_change":"2023-10-25T16:20:55.768741+0000","last_active":"2023-10-25T16:20:56.746274+0000","last_peered":"2023-10-25T16:20:56.746274+0000","last_clean":"2023-10-25T16:20:56.746274+0000","last_became_active":"2023-10-25T16:20:55.768116+0000","last_became_peered":"2023-10-25T16:20:55.768116+0000","last_unstale":"2023-10-25T16:20:56.746274+0000","last_undegraded":"2023-10-25T16:20:56.746274+0000","last_fullsized":"2023-10-25T16:20:56.746274+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:20:54.442578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663831+0000","last_change":"2023-10-25T16:20:55.779371+0000","last_active":"2023-10-25T16:20:57.663831+0000","last_peered":"2023-10-25T16:20:57.663831+0000","last_clean":"2023-10-25T16:20:57.663831+0000","last_became_active":"2023-10-25T16:20:55.778666+0000","last_became_peered":"2023-10-25T16:20:55.778666+0000","last_unstale":"2023-10-25T16:20:57.663831+0000","last_undegraded":"2023-10-25T16:20:57.663831+0000","last_fullsized":"2023-10-25T16:20:57.663831+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:41.550788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664343+0000","last_change":"2023-10-25T16:20:55.784301+0000","last_active":"2023-10-25T16:20:57.664343+0000","last_peered":"2023-10-25T16:20:57.664343+0000","last_clean":"2023-10-25T16:20:57.664343+0000","last_became_active":"2023-10-25T16:20:55.776099+0000","last_became_peered":"2023-10-25T16:20:55.776099+0000","last_unstale":"2023-10-25T16:20:57.664343+0000","last_undegraded":"2023-10-25T16:20:57.664343+0000","last_fullsized":"2023-10-25T16:20:57.664343+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:09:44.256644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663321+0000","last_change":"2023-10-25T16:20:55.784066+0000","last_active":"2023-10-25T16:20:57.663321+0000","last_peered":"2023-10-25T16:20:57.663321+0000","last_clean":"2023-10-25T16:20:57.663321+0000","last_became_active":"2023-10-25T16:20:55.783115+0000","last_became_peered":"2023-10-25T16:20:55.783115+0000","last_unstale":"2023-10-25T16:20:57.663321+0000","last_undegraded":"2023-10-25T16:20:57.663321+0000","last_fullsized":"2023-10-25T16:20:57.663321+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:41:55.870036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.662988+0000","last_change":"2023-10-25T16:20:55.773608+0000","last_active":"2023-10-25T16:20:57.662988+0000","last_peered":"2023-10-25T16:20:57.662988+0000","last_clean":"2023-10-25T16:20:57.662988+0000","last_became_active":"2023-10-25T16:20:55.772990+0000","last_became_peered":"2023-10-25T16:20:55.772990+0000","last_unstale":"2023-10-25T16:20:57.662988+0000","last_undegraded":"2023-10-25T16:20:57.662988+0000","last_fullsized":"2023-10-25T16:20:57.662988+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:49.390740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665052+0000","last_change":"2023-10-25T16:20:55.775636+0000","last_active":"2023-10-25T16:20:57.665052+0000","last_peered":"2023-10-25T16:20:57.665052+0000","last_clean":"2023-10-25T16:20:57.665052+0000","last_became_active":"2023-10-25T16:20:55.774539+0000","last_became_peered":"2023-10-25T16:20:55.774539+0000","last_unstale":"2023-10-25T16:20:57.665052+0000","last_undegraded":"2023-10-25T16:20:57.665052+0000","last_fullsized":"2023-10-25T16:20:57.665052+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:22:46.483294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.928954+0000","last_change":"2023-10-25T16:20:55.769529+0000","last_active":"2023-10-25T16:20:56.928954+0000","last_peered":"2023-10-25T16:20:56.928954+0000","last_clean":"2023-10-25T16:20:56.928954+0000","last_became_active":"2023-10-25T16:20:55.765970+0000","last_became_peered":"2023-10-25T16:20:55.765970+0000","last_unstale":"2023-10-25T16:20:56.928954+0000","last_undegraded":"2023-10-25T16:20:56.928954+0000","last_fullsized":"2023-10-25T16:20:56.928954+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:12.327080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663607+0000","last_change":"2023-10-25T16:20:55.764558+0000","last_active":"2023-10-25T16:20:57.663607+0000","last_peered":"2023-10-25T16:20:57.663607+0000","last_clean":"2023-10-25T16:20:57.663607+0000","last_became_active":"2023-10-25T16:20:55.763563+0000","last_became_peered":"2023-10-25T16:20:55.763563+0000","last_unstale":"2023-10-25T16:20:57.663607+0000","last_undegraded":"2023-10-25T16:20:57.663607+0000","last_fullsized":"2023-10-25T16:20:57.663607+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:41:18.251178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663699+0000","last_change":"2023-10-25T16:20:55.772466+0000","last_active":"2023-10-25T16:20:57.663699+0000","last_peered":"2023-10-25T16:20:57.663699+0000","last_clean":"2023-10-25T16:20:57.663699+0000","last_became_active":"2023-10-25T16:20:55.771742+0000","last_became_peered":"2023-10-25T16:20:55.771742+0000","last_unstale":"2023-10-25T16:20:57.663699+0000","last_undegraded":"2023-10-25T16:20:57.663699+0000","last_fullsized":"2023-10-25T16:20:57.663699+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:54:01.419933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663576+0000","last_change":"2023-10-25T16:20:55.771836+0000","last_active":"2023-10-25T16:20:57.663576+0000","last_peered":"2023-10-25T16:20:57.663576+0000","last_clean":"2023-10-25T16:20:57.663576+0000","last_became_active":"2023-10-25T16:20:55.771247+0000","last_became_peered":"2023-10-25T16:20:55.771247+0000","last_unstale":"2023-10-25T16:20:57.663576+0000","last_undegraded":"2023-10-25T16:20:57.663576+0000","last_fullsized":"2023-10-25T16:20:57.663576+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:39:31.079538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665127+0000","last_change":"2023-10-25T16:20:55.782883+0000","last_active":"2023-10-25T16:20:57.665127+0000","last_peered":"2023-10-25T16:20:57.665127+0000","last_clean":"2023-10-25T16:20:57.665127+0000","last_became_active":"2023-10-25T16:20:55.782144+0000","last_became_peered":"2023-10-25T16:20:55.782144+0000","last_unstale":"2023-10-25T16:20:57.665127+0000","last_undegraded":"2023-10-25T16:20:57.665127+0000","last_fullsized":"2023-10-25T16:20:57.665127+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:31:23.331213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.567887+0000","last_change":"2023-10-25T16:20:55.778831+0000","last_active":"2023-10-25T16:20:57.567887+0000","last_peered":"2023-10-25T16:20:57.567887+0000","last_clean":"2023-10-25T16:20:57.567887+0000","last_became_active":"2023-10-25T16:20:55.778501+0000","last_became_peered":"2023-10-25T16:20:55.778501+0000","last_unstale":"2023-10-25T16:20:57.567887+0000","last_undegraded":"2023-10-25T16:20:57.567887+0000","last_fullsized":"2023-10-25T16:20:57.567887+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:37:11.388532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664701+0000","last_change":"2023-10-25T16:20:55.784726+0000","last_active":"2023-10-25T16:20:57.664701+0000","last_peered":"2023-10-25T16:20:57.664701+0000","last_clean":"2023-10-25T16:20:57.664701+0000","last_became_active":"2023-10-25T16:20:55.779785+0000","last_became_peered":"2023-10-25T16:20:55.779785+0000","last_unstale":"2023-10-25T16:20:57.664701+0000","last_undegraded":"2023-10-25T16:20:57.664701+0000","last_fullsized":"2023-10-25T16:20:57.664701+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:51.552293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.567828+0000","last_change":"2023-10-25T16:20:55.764785+0000","last_active":"2023-10-25T16:20:57.567828+0000","last_peered":"2023-10-25T16:20:57.567828+0000","last_clean":"2023-10-25T16:20:57.567828+0000","last_became_active":"2023-10-25T16:20:55.763826+0000","last_became_peered":"2023-10-25T16:20:55.763826+0000","last_unstale":"2023-10-25T16:20:57.567828+0000","last_undegraded":"2023-10-25T16:20:57.567828+0000","last_fullsized":"2023-10-25T16:20:57.567828+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:09:22.075726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.928900+0000","last_change":"2023-10-25T16:20:55.760101+0000","last_active":"2023-10-25T16:20:56.928900+0000","last_peered":"2023-10-25T16:20:56.928900+0000","last_clean":"2023-10-25T16:20:56.928900+0000","last_became_active":"2023-10-25T16:20:55.758710+0000","last_became_peered":"2023-10-25T16:20:55.758710+0000","last_unstale":"2023-10-25T16:20:56.928900+0000","last_undegraded":"2023-10-25T16:20:56.928900+0000","last_fullsized":"2023-10-25T16:20:56.928900+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:53.572197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.567379+0000","last_change":"2023-10-25T16:20:55.777123+0000","last_active":"2023-10-25T16:20:57.567379+0000","last_peered":"2023-10-25T16:20:57.567379+0000","last_clean":"2023-10-25T16:20:57.567379+0000","last_became_active":"2023-10-25T16:20:55.776657+0000","last_became_peered":"2023-10-25T16:20:55.776657+0000","last_unstale":"2023-10-25T16:20:57.567379+0000","last_undegraded":"2023-10-25T16:20:57.567379+0000","last_fullsized":"2023-10-25T16:20:57.567379+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:53:22.758056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.745652+0000","last_change":"2023-10-25T16:20:55.768670+0000","last_active":"2023-10-25T16:20:56.745652+0000","last_peered":"2023-10-25T16:20:56.745652+0000","last_clean":"2023-10-25T16:20:56.745652+0000","last_became_active":"2023-10-25T16:20:55.767746+0000","last_became_peered":"2023-10-25T16:20:55.767746+0000","last_unstale":"2023-10-25T16:20:56.745652+0000","last_undegraded":"2023-10-25T16:20:56.745652+0000","last_fullsized":"2023-10-25T16:20:56.745652+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:47:52.261206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.929077+0000","last_change":"2023-10-25T16:20:55.759026+0000","last_active":"2023-10-25T16:20:56.929077+0000","last_peered":"2023-10-25T16:20:56.929077+0000","last_clean":"2023-10-25T16:20:56.929077+0000","last_became_active":"2023-10-25T16:20:55.758387+0000","last_became_peered":"2023-10-25T16:20:55.758387+0000","last_unstale":"2023-10-25T16:20:56.929077+0000","last_undegraded":"2023-10-25T16:20:56.929077+0000","last_fullsized":"2023-10-25T16:20:56.929077+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:15:06.955475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664432+0000","last_change":"2023-10-25T16:20:55.769917+0000","last_active":"2023-10-25T16:20:57.664432+0000","last_peered":"2023-10-25T16:20:57.664432+0000","last_clean":"2023-10-25T16:20:57.664432+0000","last_became_active":"2023-10-25T16:20:55.767189+0000","last_became_peered":"2023-10-25T16:20:55.767189+0000","last_unstale":"2023-10-25T16:20:57.664432+0000","last_undegraded":"2023-10-25T16:20:57.664432+0000","last_fullsized":"2023-10-25T16:20:57.664432+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:44:30.600766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.928986+0000","last_change":"2023-10-25T16:20:55.766552+0000","last_active":"2023-10-25T16:20:56.928986+0000","last_peered":"2023-10-25T16:20:56.928986+0000","last_clean":"2023-10-25T16:20:56.928986+0000","last_became_active":"2023-10-25T16:20:55.765720+0000","last_became_peered":"2023-10-25T16:20:55.765720+0000","last_unstale":"2023-10-25T16:20:56.928986+0000","last_undegraded":"2023-10-25T16:20:56.928986+0000","last_fullsized":"2023-10-25T16:20:56.928986+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:09:53.025055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665397+0000","last_change":"2023-10-25T16:20:55.775142+0000","last_active":"2023-10-25T16:20:57.665397+0000","last_peered":"2023-10-25T16:20:57.665397+0000","last_clean":"2023-10-25T16:20:57.665397+0000","last_became_active":"2023-10-25T16:20:55.769796+0000","last_became_peered":"2023-10-25T16:20:55.769796+0000","last_unstale":"2023-10-25T16:20:57.665397+0000","last_undegraded":"2023-10-25T16:20:57.665397+0000","last_fullsized":"2023-10-25T16:20:57.665397+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:28:47.752385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.568245+0000","last_change":"2023-10-25T16:20:55.777978+0000","last_active":"2023-10-25T16:20:57.568245+0000","last_peered":"2023-10-25T16:20:57.568245+0000","last_clean":"2023-10-25T16:20:57.568245+0000","last_became_active":"2023-10-25T16:20:55.777668+0000","last_became_peered":"2023-10-25T16:20:55.777668+0000","last_unstale":"2023-10-25T16:20:57.568245+0000","last_undegraded":"2023-10-25T16:20:57.568245+0000","last_fullsized":"2023-10-25T16:20:57.568245+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:25:30.560205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664570+0000","last_change":"2023-10-25T16:20:55.787260+0000","last_active":"2023-10-25T16:20:57.664570+0000","last_peered":"2023-10-25T16:20:57.664570+0000","last_clean":"2023-10-25T16:20:57.664570+0000","last_became_active":"2023-10-25T16:20:55.786974+0000","last_became_peered":"2023-10-25T16:20:55.786974+0000","last_unstale":"2023-10-25T16:20:57.664570+0000","last_undegraded":"2023-10-25T16:20:57.664570+0000","last_fullsized":"2023-10-25T16:20:57.664570+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:07:37.801819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.748412+0000","last_change":"2023-10-25T16:20:55.749890+0000","last_active":"2023-10-25T16:20:56.748412+0000","last_peered":"2023-10-25T16:20:56.748412+0000","last_clean":"2023-10-25T16:20:56.748412+0000","last_became_active":"2023-10-25T16:20:55.749259+0000","last_became_peered":"2023-10-25T16:20:55.749259+0000","last_unstale":"2023-10-25T16:20:56.748412+0000","last_undegraded":"2023-10-25T16:20:56.748412+0000","last_fullsized":"2023-10-25T16:20:56.748412+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:09.873010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664388+0000","last_change":"2023-10-25T16:20:55.783671+0000","last_active":"2023-10-25T16:20:57.664388+0000","last_peered":"2023-10-25T16:20:57.664388+0000","last_clean":"2023-10-25T16:20:57.664388+0000","last_became_active":"2023-10-25T16:20:55.783323+0000","last_became_peered":"2023-10-25T16:20:55.783323+0000","last_unstale":"2023-10-25T16:20:57.664388+0000","last_undegraded":"2023-10-25T16:20:57.664388+0000","last_fullsized":"2023-10-25T16:20:57.664388+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:33.724082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665451+0000","last_change":"2023-10-25T16:20:55.778429+0000","last_active":"2023-10-25T16:20:57.665451+0000","last_peered":"2023-10-25T16:20:57.665451+0000","last_clean":"2023-10-25T16:20:57.665451+0000","last_became_active":"2023-10-25T16:20:55.777725+0000","last_became_peered":"2023-10-25T16:20:55.777725+0000","last_unstale":"2023-10-25T16:20:57.665451+0000","last_undegraded":"2023-10-25T16:20:57.665451+0000","last_fullsized":"2023-10-25T16:20:57.665451+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:02:05.329484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746032+0000","last_change":"2023-10-25T16:20:55.778947+0000","last_active":"2023-10-25T16:20:56.746032+0000","last_peered":"2023-10-25T16:20:56.746032+0000","last_clean":"2023-10-25T16:20:56.746032+0000","last_became_active":"2023-10-25T16:20:55.778688+0000","last_became_peered":"2023-10-25T16:20:55.778688+0000","last_unstale":"2023-10-25T16:20:56.746032+0000","last_undegraded":"2023-10-25T16:20:56.746032+0000","last_fullsized":"2023-10-25T16:20:56.746032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:03:01.582872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664545+0000","last_change":"2023-10-25T16:20:55.783810+0000","last_active":"2023-10-25T16:20:57.664545+0000","last_peered":"2023-10-25T16:20:57.664545+0000","last_clean":"2023-10-25T16:20:57.664545+0000","last_became_active":"2023-10-25T16:20:55.774850+0000","last_became_peered":"2023-10-25T16:20:55.774850+0000","last_unstale":"2023-10-25T16:20:57.664545+0000","last_undegraded":"2023-10-25T16:20:57.664545+0000","last_fullsized":"2023-10-25T16:20:57.664545+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:25:28.983301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.567462+0000","last_change":"2023-10-25T16:20:55.750452+0000","last_active":"2023-10-25T16:20:57.567462+0000","last_peered":"2023-10-25T16:20:57.567462+0000","last_clean":"2023-10-25T16:20:57.567462+0000","last_became_active":"2023-10-25T16:20:55.749816+0000","last_became_peered":"2023-10-25T16:20:55.749816+0000","last_unstale":"2023-10-25T16:20:57.567462+0000","last_undegraded":"2023-10-25T16:20:57.567462+0000","last_fullsized":"2023-10-25T16:20:57.567462+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:27.671809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"157'4","reported_seq":16,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.795086+0000","last_change":"2023-10-25T16:20:54.750779+0000","last_active":"2023-10-25T16:20:55.795086+0000","last_peered":"2023-10-25T16:20:55.795086+0000","last_clean":"2023-10-25T16:20:55.795086+0000","last_became_active":"2023-10-25T16:20:54.750091+0000","last_became_peered":"2023-10-25T16:20:54.750091+0000","last_unstale":"2023-10-25T16:20:55.795086+0000","last_undegraded":"2023-10-25T16:20:55.795086+0000","last_fullsized":"2023-10-25T16:20:55.795086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:16:58.100751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663712+0000","last_change":"2023-10-25T16:20:55.784208+0000","last_active":"2023-10-25T16:20:57.663712+0000","last_peered":"2023-10-25T16:20:57.663712+0000","last_clean":"2023-10-25T16:20:57.663712+0000","last_became_active":"2023-10-25T16:20:55.783828+0000","last_became_peered":"2023-10-25T16:20:55.783828+0000","last_unstale":"2023-10-25T16:20:57.663712+0000","last_undegraded":"2023-10-25T16:20:57.663712+0000","last_fullsized":"2023-10-25T16:20:57.663712+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:47.253943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"157'1","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.796120+0000","last_change":"2023-10-25T16:20:54.759191+0000","last_active":"2023-10-25T16:20:55.796120+0000","last_peered":"2023-10-25T16:20:55.796120+0000","last_clean":"2023-10-25T16:20:55.796120+0000","last_became_active":"2023-10-25T16:20:54.758654+0000","last_became_peered":"2023-10-25T16:20:54.758654+0000","last_unstale":"2023-10-25T16:20:55.796120+0000","last_undegraded":"2023-10-25T16:20:55.796120+0000","last_fullsized":"2023-10-25T16:20:55.796120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:39:45.112530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746386+0000","last_change":"2023-10-25T16:20:55.775078+0000","last_active":"2023-10-25T16:20:56.746386+0000","last_peered":"2023-10-25T16:20:56.746386+0000","last_clean":"2023-10-25T16:20:56.746386+0000","last_became_active":"2023-10-25T16:20:55.772617+0000","last_became_peered":"2023-10-25T16:20:55.772617+0000","last_unstale":"2023-10-25T16:20:56.746386+0000","last_undegraded":"2023-10-25T16:20:56.746386+0000","last_fullsized":"2023-10-25T16:20:56.746386+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:20:09.455860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"157'2","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.798579+0000","last_change":"2023-10-25T16:20:54.758266+0000","last_active":"2023-10-25T16:20:55.798579+0000","last_peered":"2023-10-25T16:20:55.798579+0000","last_clean":"2023-10-25T16:20:55.798579+0000","last_became_active":"2023-10-25T16:20:54.757497+0000","last_became_peered":"2023-10-25T16:20:54.757497+0000","last_unstale":"2023-10-25T16:20:55.798579+0000","last_undegraded":"2023-10-25T16:20:55.798579+0000","last_fullsized":"2023-10-25T16:20:55.798579+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:49:33.059367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746537+0000","last_change":"2023-10-25T16:20:55.776907+0000","last_active":"2023-10-25T16:20:56.746537+0000","last_peered":"2023-10-25T16:20:56.746537+0000","last_clean":"2023-10-25T16:20:56.746537+0000","last_became_active":"2023-10-25T16:20:55.776161+0000","last_became_peered":"2023-10-25T16:20:55.776161+0000","last_unstale":"2023-10-25T16:20:56.746537+0000","last_undegraded":"2023-10-25T16:20:56.746537+0000","last_fullsized":"2023-10-25T16:20:56.746537+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:59:08.107784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"157'2","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.798766+0000","last_change":"2023-10-25T16:20:54.756559+0000","last_active":"2023-10-25T16:20:55.798766+0000","last_peered":"2023-10-25T16:20:55.798766+0000","last_clean":"2023-10-25T16:20:55.798766+0000","last_became_active":"2023-10-25T16:20:54.756240+0000","last_became_peered":"2023-10-25T16:20:54.756240+0000","last_unstale":"2023-10-25T16:20:55.798766+0000","last_undegraded":"2023-10-25T16:20:55.798766+0000","last_fullsized":"2023-10-25T16:20:55.798766+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:55:15.840343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.568153+0000","last_change":"2023-10-25T16:20:55.764415+0000","last_active":"2023-10-25T16:20:57.568153+0000","last_peered":"2023-10-25T16:20:57.568153+0000","last_clean":"2023-10-25T16:20:57.568153+0000","last_became_active":"2023-10-25T16:20:55.763033+0000","last_became_peered":"2023-10-25T16:20:55.763033+0000","last_unstale":"2023-10-25T16:20:57.568153+0000","last_undegraded":"2023-10-25T16:20:57.568153+0000","last_fullsized":"2023-10-25T16:20:57.568153+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:01:35.726433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"157'1","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.798489+0000","last_change":"2023-10-25T16:20:54.753168+0000","last_active":"2023-10-25T16:20:55.798489+0000","last_peered":"2023-10-25T16:20:55.798489+0000","last_clean":"2023-10-25T16:20:55.798489+0000","last_became_active":"2023-10-25T16:20:54.752919+0000","last_became_peered":"2023-10-25T16:20:54.752919+0000","last_unstale":"2023-10-25T16:20:55.798489+0000","last_undegraded":"2023-10-25T16:20:55.798489+0000","last_fullsized":"2023-10-25T16:20:55.798489+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:28.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664857+0000","last_change":"2023-10-25T16:20:55.785170+0000","last_active":"2023-10-25T16:20:57.664857+0000","last_peered":"2023-10-25T16:20:57.664857+0000","last_clean":"2023-10-25T16:20:57.664857+0000","last_became_active":"2023-10-25T16:20:55.783078+0000","last_became_peered":"2023-10-25T16:20:55.783078+0000","last_unstale":"2023-10-25T16:20:57.664857+0000","last_undegraded":"2023-10-25T16:20:57.664857+0000","last_fullsized":"2023-10-25T16:20:57.664857+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:36:49.390740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"157'1","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.799070+0000","last_change":"2023-10-25T16:20:54.755598+0000","last_active":"2023-10-25T16:20:55.799070+0000","last_peered":"2023-10-25T16:20:55.799070+0000","last_clean":"2023-10-25T16:20:55.799070+0000","last_became_active":"2023-10-25T16:20:54.755185+0000","last_became_peered":"2023-10-25T16:20:54.755185+0000","last_unstale":"2023-10-25T16:20:55.799070+0000","last_undegraded":"2023-10-25T16:20:55.799070+0000","last_fullsized":"2023-10-25T16:20:55.799070+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:54.851962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664228+0000","last_change":"2023-10-25T16:20:55.779385+0000","last_active":"2023-10-25T16:20:57.664228+0000","last_peered":"2023-10-25T16:20:57.664228+0000","last_clean":"2023-10-25T16:20:57.664228+0000","last_became_active":"2023-10-25T16:20:55.774646+0000","last_became_peered":"2023-10-25T16:20:55.774646+0000","last_unstale":"2023-10-25T16:20:57.664228+0000","last_undegraded":"2023-10-25T16:20:57.664228+0000","last_fullsized":"2023-10-25T16:20:57.664228+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:09:55.862994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.751398+0000","last_change":"2023-10-25T16:20:54.765552+0000","last_active":"2023-10-25T16:20:55.751398+0000","last_peered":"2023-10-25T16:20:55.751398+0000","last_clean":"2023-10-25T16:20:55.751398+0000","last_became_active":"2023-10-25T16:20:54.764892+0000","last_became_peered":"2023-10-25T16:20:54.764892+0000","last_unstale":"2023-10-25T16:20:55.751398+0000","last_undegraded":"2023-10-25T16:20:55.751398+0000","last_fullsized":"2023-10-25T16:20:55.751398+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:48.117410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663947+0000","last_change":"2023-10-25T16:20:55.764950+0000","last_active":"2023-10-25T16:20:57.663947+0000","last_peered":"2023-10-25T16:20:57.663947+0000","last_clean":"2023-10-25T16:20:57.663947+0000","last_became_active":"2023-10-25T16:20:55.764342+0000","last_became_peered":"2023-10-25T16:20:55.764342+0000","last_unstale":"2023-10-25T16:20:57.663947+0000","last_undegraded":"2023-10-25T16:20:57.663947+0000","last_fullsized":"2023-10-25T16:20:57.663947+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:40:04.046289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.766434+0000","last_change":"2023-10-25T16:20:54.763630+0000","last_active":"2023-10-25T16:20:55.766434+0000","last_peered":"2023-10-25T16:20:55.766434+0000","last_clean":"2023-10-25T16:20:55.766434+0000","last_became_active":"2023-10-25T16:20:54.763250+0000","last_became_peered":"2023-10-25T16:20:54.763250+0000","last_unstale":"2023-10-25T16:20:55.766434+0000","last_undegraded":"2023-10-25T16:20:55.766434+0000","last_fullsized":"2023-10-25T16:20:55.766434+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:29:10.410851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665175+0000","last_change":"2023-10-25T16:20:55.773192+0000","last_active":"2023-10-25T16:20:57.665175+0000","last_peered":"2023-10-25T16:20:57.665175+0000","last_clean":"2023-10-25T16:20:57.665175+0000","last_became_active":"2023-10-25T16:20:55.771716+0000","last_became_peered":"2023-10-25T16:20:55.771716+0000","last_unstale":"2023-10-25T16:20:57.665175+0000","last_undegraded":"2023-10-25T16:20:57.665175+0000","last_fullsized":"2023-10-25T16:20:57.665175+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:59:55.575085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.746297+0000","last_change":"2023-10-25T16:20:54.763382+0000","last_active":"2023-10-25T16:20:55.746297+0000","last_peered":"2023-10-25T16:20:55.746297+0000","last_clean":"2023-10-25T16:20:55.746297+0000","last_became_active":"2023-10-25T16:20:54.762654+0000","last_became_peered":"2023-10-25T16:20:54.762654+0000","last_unstale":"2023-10-25T16:20:55.746297+0000","last_undegraded":"2023-10-25T16:20:55.746297+0000","last_fullsized":"2023-10-25T16:20:55.746297+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:28.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.748383+0000","last_change":"2023-10-25T16:20:55.749761+0000","last_active":"2023-10-25T16:20:56.748383+0000","last_peered":"2023-10-25T16:20:56.748383+0000","last_clean":"2023-10-25T16:20:56.748383+0000","last_became_active":"2023-10-25T16:20:55.749061+0000","last_became_peered":"2023-10-25T16:20:55.749061+0000","last_unstale":"2023-10-25T16:20:56.748383+0000","last_undegraded":"2023-10-25T16:20:56.748383+0000","last_fullsized":"2023-10-25T16:20:56.748383+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:55:16.851375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.746406+0000","last_change":"2023-10-25T16:20:54.763506+0000","last_active":"2023-10-25T16:20:55.746406+0000","last_peered":"2023-10-25T16:20:55.746406+0000","last_clean":"2023-10-25T16:20:55.746406+0000","last_became_active":"2023-10-25T16:20:54.763202+0000","last_became_peered":"2023-10-25T16:20:54.763202+0000","last_unstale":"2023-10-25T16:20:55.746406+0000","last_undegraded":"2023-10-25T16:20:55.746406+0000","last_fullsized":"2023-10-25T16:20:55.746406+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:10:46.242911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.745634+0000","last_change":"2023-10-25T16:20:55.761545+0000","last_active":"2023-10-25T16:20:56.745634+0000","last_peered":"2023-10-25T16:20:56.745634+0000","last_clean":"2023-10-25T16:20:56.745634+0000","last_became_active":"2023-10-25T16:20:55.760912+0000","last_became_peered":"2023-10-25T16:20:55.760912+0000","last_unstale":"2023-10-25T16:20:56.745634+0000","last_undegraded":"2023-10-25T16:20:56.745634+0000","last_fullsized":"2023-10-25T16:20:56.745634+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:37:32.400636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"157'3","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.795077+0000","last_change":"2023-10-25T16:20:54.767309+0000","last_active":"2023-10-25T16:20:55.795077+0000","last_peered":"2023-10-25T16:20:55.795077+0000","last_clean":"2023-10-25T16:20:55.795077+0000","last_became_active":"2023-10-25T16:20:54.765724+0000","last_became_peered":"2023-10-25T16:20:54.765724+0000","last_unstale":"2023-10-25T16:20:55.795077+0000","last_undegraded":"2023-10-25T16:20:55.795077+0000","last_fullsized":"2023-10-25T16:20:55.795077+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:57:03.637579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.745458+0000","last_change":"2023-10-25T16:20:55.769235+0000","last_active":"2023-10-25T16:20:56.745458+0000","last_peered":"2023-10-25T16:20:56.745458+0000","last_clean":"2023-10-25T16:20:56.745458+0000","last_became_active":"2023-10-25T16:20:55.768575+0000","last_became_peered":"2023-10-25T16:20:55.768575+0000","last_unstale":"2023-10-25T16:20:56.745458+0000","last_undegraded":"2023-10-25T16:20:56.745458+0000","last_fullsized":"2023-10-25T16:20:56.745458+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:25:30.560205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"157'6","reported_seq":18,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.798271+0000","last_change":"2023-10-25T16:20:54.771635+0000","last_active":"2023-10-25T16:20:55.798271+0000","last_peered":"2023-10-25T16:20:55.798271+0000","last_clean":"2023-10-25T16:20:55.798271+0000","last_became_active":"2023-10-25T16:20:54.771107+0000","last_became_peered":"2023-10-25T16:20:54.771107+0000","last_unstale":"2023-10-25T16:20:55.798271+0000","last_undegraded":"2023-10-25T16:20:55.798271+0000","last_fullsized":"2023-10-25T16:20:55.798271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:25:27.972269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665774+0000","last_change":"2023-10-25T16:20:55.772121+0000","last_active":"2023-10-25T16:20:57.665774+0000","last_peered":"2023-10-25T16:20:57.665774+0000","last_clean":"2023-10-25T16:20:57.665774+0000","last_became_active":"2023-10-25T16:20:55.771504+0000","last_became_peered":"2023-10-25T16:20:55.771504+0000","last_unstale":"2023-10-25T16:20:57.665774+0000","last_undegraded":"2023-10-25T16:20:57.665774+0000","last_fullsized":"2023-10-25T16:20:57.665774+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:46:24.082235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.817363+0000","last_change":"2023-10-25T16:20:54.759691+0000","last_active":"2023-10-25T16:20:56.817363+0000","last_peered":"2023-10-25T16:20:56.817363+0000","last_clean":"2023-10-25T16:20:56.817363+0000","last_became_active":"2023-10-25T16:20:54.759459+0000","last_became_peered":"2023-10-25T16:20:54.759459+0000","last_unstale":"2023-10-25T16:20:56.817363+0000","last_undegraded":"2023-10-25T16:20:56.817363+0000","last_fullsized":"2023-10-25T16:20:56.817363+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:24:39.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663491+0000","last_change":"2023-10-25T16:20:55.772529+0000","last_active":"2023-10-25T16:20:57.663491+0000","last_peered":"2023-10-25T16:20:57.663491+0000","last_clean":"2023-10-25T16:20:57.663491+0000","last_became_active":"2023-10-25T16:20:55.771890+0000","last_became_peered":"2023-10-25T16:20:55.771890+0000","last_unstale":"2023-10-25T16:20:57.663491+0000","last_undegraded":"2023-10-25T16:20:57.663491+0000","last_fullsized":"2023-10-25T16:20:57.663491+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:47.453612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.757122+0000","last_change":"2023-10-25T16:20:54.768310+0000","last_active":"2023-10-25T16:20:55.757122+0000","last_peered":"2023-10-25T16:20:55.757122+0000","last_clean":"2023-10-25T16:20:55.757122+0000","last_became_active":"2023-10-25T16:20:54.768064+0000","last_became_peered":"2023-10-25T16:20:54.768064+0000","last_unstale":"2023-10-25T16:20:55.757122+0000","last_undegraded":"2023-10-25T16:20:55.757122+0000","last_fullsized":"2023-10-25T16:20:55.757122+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:59.378044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663944+0000","last_change":"2023-10-25T16:20:55.764190+0000","last_active":"2023-10-25T16:20:57.663944+0000","last_peered":"2023-10-25T16:20:57.663944+0000","last_clean":"2023-10-25T16:20:57.663944+0000","last_became_active":"2023-10-25T16:20:55.762701+0000","last_became_peered":"2023-10-25T16:20:55.762701+0000","last_unstale":"2023-10-25T16:20:57.663944+0000","last_undegraded":"2023-10-25T16:20:57.663944+0000","last_fullsized":"2023-10-25T16:20:57.663944+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:16:59.111784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"157'8","reported_seq":20,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.798049+0000","last_change":"2023-10-25T16:20:54.771088+0000","last_active":"2023-10-25T16:20:55.798049+0000","last_peered":"2023-10-25T16:20:55.798049+0000","last_clean":"2023-10-25T16:20:55.798049+0000","last_became_active":"2023-10-25T16:20:54.768618+0000","last_became_peered":"2023-10-25T16:20:54.768618+0000","last_unstale":"2023-10-25T16:20:55.798049+0000","last_undegraded":"2023-10-25T16:20:55.798049+0000","last_fullsized":"2023-10-25T16:20:55.798049+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:00:40.539755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664421+0000","last_change":"2023-10-25T16:20:55.780306+0000","last_active":"2023-10-25T16:20:57.664421+0000","last_peered":"2023-10-25T16:20:57.664421+0000","last_clean":"2023-10-25T16:20:57.664421+0000","last_became_active":"2023-10-25T16:20:55.778778+0000","last_became_peered":"2023-10-25T16:20:55.778778+0000","last_unstale":"2023-10-25T16:20:57.664421+0000","last_undegraded":"2023-10-25T16:20:57.664421+0000","last_fullsized":"2023-10-25T16:20:57.664421+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:28:51.666004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"157'1","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.791417+0000","last_change":"2023-10-25T16:20:54.753340+0000","last_active":"2023-10-25T16:20:55.791417+0000","last_peered":"2023-10-25T16:20:55.791417+0000","last_clean":"2023-10-25T16:20:55.791417+0000","last_became_active":"2023-10-25T16:20:54.752315+0000","last_became_peered":"2023-10-25T16:20:54.752315+0000","last_unstale":"2023-10-25T16:20:55.791417+0000","last_undegraded":"2023-10-25T16:20:55.791417+0000","last_fullsized":"2023-10-25T16:20:55.791417+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:19:04.350016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.748553+0000","last_change":"2023-10-25T16:20:55.759971+0000","last_active":"2023-10-25T16:20:56.748553+0000","last_peered":"2023-10-25T16:20:56.748553+0000","last_clean":"2023-10-25T16:20:56.748553+0000","last_became_active":"2023-10-25T16:20:55.759004+0000","last_became_peered":"2023-10-25T16:20:55.759004+0000","last_unstale":"2023-10-25T16:20:56.748553+0000","last_undegraded":"2023-10-25T16:20:56.748553+0000","last_fullsized":"2023-10-25T16:20:56.748553+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:29:11.421883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"157'2","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.798345+0000","last_change":"2023-10-25T16:20:54.764861+0000","last_active":"2023-10-25T16:20:55.798345+0000","last_peered":"2023-10-25T16:20:55.798345+0000","last_clean":"2023-10-25T16:20:55.798345+0000","last_became_active":"2023-10-25T16:20:54.764490+0000","last_became_peered":"2023-10-25T16:20:54.764490+0000","last_unstale":"2023-10-25T16:20:55.798345+0000","last_undegraded":"2023-10-25T16:20:55.798345+0000","last_fullsized":"2023-10-25T16:20:55.798345+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:38:08.026667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.567545+0000","last_change":"2023-10-25T16:20:55.775081+0000","last_active":"2023-10-25T16:20:57.567545+0000","last_peered":"2023-10-25T16:20:57.567545+0000","last_clean":"2023-10-25T16:20:57.567545+0000","last_became_active":"2023-10-25T16:20:55.774436+0000","last_became_peered":"2023-10-25T16:20:55.774436+0000","last_unstale":"2023-10-25T16:20:57.567545+0000","last_undegraded":"2023-10-25T16:20:57.567545+0000","last_fullsized":"2023-10-25T16:20:57.567545+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:29:50.017000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"157'1","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.792850+0000","last_change":"2023-10-25T16:20:54.758776+0000","last_active":"2023-10-25T16:20:55.792850+0000","last_peered":"2023-10-25T16:20:55.792850+0000","last_clean":"2023-10-25T16:20:55.792850+0000","last_became_active":"2023-10-25T16:20:54.757905+0000","last_became_peered":"2023-10-25T16:20:54.757905+0000","last_unstale":"2023-10-25T16:20:55.792850+0000","last_undegraded":"2023-10-25T16:20:55.792850+0000","last_fullsized":"2023-10-25T16:20:55.792850+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:34.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665114+0000","last_change":"2023-10-25T16:20:55.771678+0000","last_active":"2023-10-25T16:20:57.665114+0000","last_peered":"2023-10-25T16:20:57.665114+0000","last_clean":"2023-10-25T16:20:57.665114+0000","last_became_active":"2023-10-25T16:20:55.770627+0000","last_became_peered":"2023-10-25T16:20:55.770627+0000","last_unstale":"2023-10-25T16:20:57.665114+0000","last_undegraded":"2023-10-25T16:20:57.665114+0000","last_fullsized":"2023-10-25T16:20:57.665114+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:57:11.809450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.747041+0000","last_change":"2023-10-25T16:20:54.759150+0000","last_active":"2023-10-25T16:20:55.747041+0000","last_peered":"2023-10-25T16:20:55.747041+0000","last_clean":"2023-10-25T16:20:55.747041+0000","last_became_active":"2023-10-25T16:20:54.758491+0000","last_became_peered":"2023-10-25T16:20:54.758491+0000","last_unstale":"2023-10-25T16:20:55.747041+0000","last_undegraded":"2023-10-25T16:20:55.747041+0000","last_fullsized":"2023-10-25T16:20:55.747041+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:59.378044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664061+0000","last_change":"2023-10-25T16:20:55.777794+0000","last_active":"2023-10-25T16:20:57.664061+0000","last_peered":"2023-10-25T16:20:57.664061+0000","last_clean":"2023-10-25T16:20:57.664061+0000","last_became_active":"2023-10-25T16:20:55.776081+0000","last_became_peered":"2023-10-25T16:20:55.776081+0000","last_unstale":"2023-10-25T16:20:57.664061+0000","last_undegraded":"2023-10-25T16:20:57.664061+0000","last_fullsized":"2023-10-25T16:20:57.664061+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:01:10.185186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"157'2","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.795880+0000","last_change":"2023-10-25T16:20:54.768780+0000","last_active":"2023-10-25T16:20:55.795880+0000","last_peered":"2023-10-25T16:20:55.795880+0000","last_clean":"2023-10-25T16:20:55.795880+0000","last_became_active":"2023-10-25T16:20:54.766581+0000","last_became_peered":"2023-10-25T16:20:54.766581+0000","last_unstale":"2023-10-25T16:20:55.795880+0000","last_undegraded":"2023-10-25T16:20:55.795880+0000","last_fullsized":"2023-10-25T16:20:55.795880+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:26:22.886036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663084+0000","last_change":"2023-10-25T16:20:55.770606+0000","last_active":"2023-10-25T16:20:57.663084+0000","last_peered":"2023-10-25T16:20:57.663084+0000","last_clean":"2023-10-25T16:20:57.663084+0000","last_became_active":"2023-10-25T16:20:55.769827+0000","last_became_peered":"2023-10-25T16:20:55.769827+0000","last_unstale":"2023-10-25T16:20:57.663084+0000","last_undegraded":"2023-10-25T16:20:57.663084+0000","last_fullsized":"2023-10-25T16:20:57.663084+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:17:01.249397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.746968+0000","last_change":"2023-10-25T16:20:54.763860+0000","last_active":"2023-10-25T16:20:55.746968+0000","last_peered":"2023-10-25T16:20:55.746968+0000","last_clean":"2023-10-25T16:20:55.746968+0000","last_became_active":"2023-10-25T16:20:54.763501+0000","last_became_peered":"2023-10-25T16:20:54.763501+0000","last_unstale":"2023-10-25T16:20:55.746968+0000","last_undegraded":"2023-10-25T16:20:55.746968+0000","last_fullsized":"2023-10-25T16:20:55.746968+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:44:29.589734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663905+0000","last_change":"2023-10-25T16:20:55.765520+0000","last_active":"2023-10-25T16:20:57.663905+0000","last_peered":"2023-10-25T16:20:57.663905+0000","last_clean":"2023-10-25T16:20:57.663905+0000","last_became_active":"2023-10-25T16:20:55.764837+0000","last_became_peered":"2023-10-25T16:20:55.764837+0000","last_unstale":"2023-10-25T16:20:57.663905+0000","last_undegraded":"2023-10-25T16:20:57.663905+0000","last_fullsized":"2023-10-25T16:20:57.663905+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:13:22.971740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.746587+0000","last_change":"2023-10-25T16:20:54.758838+0000","last_active":"2023-10-25T16:20:55.746587+0000","last_peered":"2023-10-25T16:20:55.746587+0000","last_clean":"2023-10-25T16:20:55.746587+0000","last_became_active":"2023-10-25T16:20:54.758498+0000","last_became_peered":"2023-10-25T16:20:54.758498+0000","last_unstale":"2023-10-25T16:20:55.746587+0000","last_undegraded":"2023-10-25T16:20:55.746587+0000","last_fullsized":"2023-10-25T16:20:55.746587+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:16:58.100751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746051+0000","last_change":"2023-10-25T16:20:55.771445+0000","last_active":"2023-10-25T16:20:56.746051+0000","last_peered":"2023-10-25T16:20:56.746051+0000","last_clean":"2023-10-25T16:20:56.746051+0000","last_became_active":"2023-10-25T16:20:55.770324+0000","last_became_peered":"2023-10-25T16:20:55.770324+0000","last_unstale":"2023-10-25T16:20:56.746051+0000","last_undegraded":"2023-10-25T16:20:56.746051+0000","last_fullsized":"2023-10-25T16:20:56.746051+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:28:21.994560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.753585+0000","last_change":"2023-10-25T16:20:54.763224+0000","last_active":"2023-10-25T16:20:55.753585+0000","last_peered":"2023-10-25T16:20:55.753585+0000","last_clean":"2023-10-25T16:20:55.753585+0000","last_became_active":"2023-10-25T16:20:54.762999+0000","last_became_peered":"2023-10-25T16:20:54.762999+0000","last_unstale":"2023-10-25T16:20:55.753585+0000","last_undegraded":"2023-10-25T16:20:55.753585+0000","last_fullsized":"2023-10-25T16:20:55.753585+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:03:10.012614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663416+0000","last_change":"2023-10-25T16:20:55.765781+0000","last_active":"2023-10-25T16:20:57.663416+0000","last_peered":"2023-10-25T16:20:57.663416+0000","last_clean":"2023-10-25T16:20:57.663416+0000","last_became_active":"2023-10-25T16:20:55.765097+0000","last_became_peered":"2023-10-25T16:20:55.765097+0000","last_unstale":"2023-10-25T16:20:57.663416+0000","last_undegraded":"2023-10-25T16:20:57.663416+0000","last_fullsized":"2023-10-25T16:20:57.663416+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:17.245071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"157'2","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.817306+0000","last_change":"2023-10-25T16:20:54.769664+0000","last_active":"2023-10-25T16:20:56.817306+0000","last_peered":"2023-10-25T16:20:56.817306+0000","last_clean":"2023-10-25T16:20:56.817306+0000","last_became_active":"2023-10-25T16:20:54.769387+0000","last_became_peered":"2023-10-25T16:20:54.769387+0000","last_unstale":"2023-10-25T16:20:56.817306+0000","last_undegraded":"2023-10-25T16:20:56.817306+0000","last_fullsized":"2023-10-25T16:20:56.817306+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:15:51.170554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.664856+0000","last_change":"2023-10-25T16:20:55.773589+0000","last_active":"2023-10-25T16:20:57.664856+0000","last_peered":"2023-10-25T16:20:57.664856+0000","last_clean":"2023-10-25T16:20:57.664856+0000","last_became_active":"2023-10-25T16:20:55.772463+0000","last_became_peered":"2023-10-25T16:20:55.772463+0000","last_unstale":"2023-10-25T16:20:57.664856+0000","last_undegraded":"2023-10-25T16:20:57.664856+0000","last_fullsized":"2023-10-25T16:20:57.664856+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:18:12.019178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.752924+0000","last_change":"2023-10-25T16:20:54.762316+0000","last_active":"2023-10-25T16:20:55.752924+0000","last_peered":"2023-10-25T16:20:55.752924+0000","last_clean":"2023-10-25T16:20:55.752924+0000","last_became_active":"2023-10-25T16:20:54.761646+0000","last_became_peered":"2023-10-25T16:20:54.761646+0000","last_unstale":"2023-10-25T16:20:55.752924+0000","last_undegraded":"2023-10-25T16:20:55.752924+0000","last_fullsized":"2023-10-25T16:20:55.752924+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:28:50.654972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.665949+0000","last_change":"2023-10-25T16:20:55.773906+0000","last_active":"2023-10-25T16:20:57.665949+0000","last_peered":"2023-10-25T16:20:57.665949+0000","last_clean":"2023-10-25T16:20:57.665949+0000","last_became_active":"2023-10-25T16:20:55.768994+0000","last_became_peered":"2023-10-25T16:20:55.768994+0000","last_unstale":"2023-10-25T16:20:57.665949+0000","last_undegraded":"2023-10-25T16:20:57.665949+0000","last_fullsized":"2023-10-25T16:20:57.665949+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:13:38.388591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.756950+0000","last_change":"2023-10-25T16:20:54.764346+0000","last_active":"2023-10-25T16:20:55.756950+0000","last_peered":"2023-10-25T16:20:55.756950+0000","last_clean":"2023-10-25T16:20:55.756950+0000","last_became_active":"2023-10-25T16:20:54.764007+0000","last_became_peered":"2023-10-25T16:20:54.764007+0000","last_unstale":"2023-10-25T16:20:55.756950+0000","last_undegraded":"2023-10-25T16:20:55.756950+0000","last_fullsized":"2023-10-25T16:20:55.756950+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:57.051511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.662854+0000","last_change":"2023-10-25T16:20:55.773778+0000","last_active":"2023-10-25T16:20:57.662854+0000","last_peered":"2023-10-25T16:20:57.662854+0000","last_clean":"2023-10-25T16:20:57.662854+0000","last_became_active":"2023-10-25T16:20:55.773159+0000","last_became_peered":"2023-10-25T16:20:55.773159+0000","last_unstale":"2023-10-25T16:20:57.662854+0000","last_undegraded":"2023-10-25T16:20:57.662854+0000","last_fullsized":"2023-10-25T16:20:57.662854+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:12:42.185805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.753447+0000","last_change":"2023-10-25T16:20:54.758458+0000","last_active":"2023-10-25T16:20:55.753447+0000","last_peered":"2023-10-25T16:20:55.753447+0000","last_clean":"2023-10-25T16:20:55.753447+0000","last_became_active":"2023-10-25T16:20:54.757860+0000","last_became_peered":"2023-10-25T16:20:54.757860+0000","last_unstale":"2023-10-25T16:20:55.753447+0000","last_undegraded":"2023-10-25T16:20:55.753447+0000","last_fullsized":"2023-10-25T16:20:55.753447+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:14.061274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.745427+0000","last_change":"2023-10-25T16:20:55.784255+0000","last_active":"2023-10-25T16:20:56.745427+0000","last_peered":"2023-10-25T16:20:56.745427+0000","last_clean":"2023-10-25T16:20:56.745427+0000","last_became_active":"2023-10-25T16:20:55.783984+0000","last_became_peered":"2023-10-25T16:20:55.783984+0000","last_unstale":"2023-10-25T16:20:56.745427+0000","last_undegraded":"2023-10-25T16:20:56.745427+0000","last_fullsized":"2023-10-25T16:20:56.745427+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:01:35.726433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.764148+0000","last_change":"2023-10-25T16:20:54.768211+0000","last_active":"2023-10-25T16:20:55.764148+0000","last_peered":"2023-10-25T16:20:55.764148+0000","last_clean":"2023-10-25T16:20:55.764148+0000","last_became_active":"2023-10-25T16:20:54.767978+0000","last_became_peered":"2023-10-25T16:20:54.767978+0000","last_unstale":"2023-10-25T16:20:55.764148+0000","last_undegraded":"2023-10-25T16:20:55.764148+0000","last_fullsized":"2023-10-25T16:20:55.764148+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:08.861978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.748740+0000","last_change":"2023-10-25T16:20:55.779757+0000","last_active":"2023-10-25T16:20:56.748740+0000","last_peered":"2023-10-25T16:20:56.748740+0000","last_clean":"2023-10-25T16:20:56.748740+0000","last_became_active":"2023-10-25T16:20:55.779145+0000","last_became_peered":"2023-10-25T16:20:55.779145+0000","last_unstale":"2023-10-25T16:20:56.748740+0000","last_undegraded":"2023-10-25T16:20:56.748740+0000","last_fullsized":"2023-10-25T16:20:56.748740+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:47.453612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.754041+0000","last_change":"2023-10-25T16:20:54.759883+0000","last_active":"2023-10-25T16:20:55.754041+0000","last_peered":"2023-10-25T16:20:55.754041+0000","last_clean":"2023-10-25T16:20:55.754041+0000","last_became_active":"2023-10-25T16:20:54.758688+0000","last_became_peered":"2023-10-25T16:20:54.758688+0000","last_unstale":"2023-10-25T16:20:55.754041+0000","last_undegraded":"2023-10-25T16:20:55.754041+0000","last_fullsized":"2023-10-25T16:20:55.754041+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:41.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.567809+0000","last_change":"2023-10-25T16:20:55.777614+0000","last_active":"2023-10-25T16:20:57.567809+0000","last_peered":"2023-10-25T16:20:57.567809+0000","last_clean":"2023-10-25T16:20:57.567809+0000","last_became_active":"2023-10-25T16:20:55.776988+0000","last_became_peered":"2023-10-25T16:20:55.776988+0000","last_unstale":"2023-10-25T16:20:57.567809+0000","last_undegraded":"2023-10-25T16:20:57.567809+0000","last_fullsized":"2023-10-25T16:20:57.567809+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:25:54.914192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.747213+0000","last_change":"2023-10-25T16:20:54.771822+0000","last_active":"2023-10-25T16:20:55.747213+0000","last_peered":"2023-10-25T16:20:55.747213+0000","last_clean":"2023-10-25T16:20:55.747213+0000","last_became_active":"2023-10-25T16:20:54.771600+0000","last_became_peered":"2023-10-25T16:20:54.771600+0000","last_unstale":"2023-10-25T16:20:55.747213+0000","last_undegraded":"2023-10-25T16:20:55.747213+0000","last_fullsized":"2023-10-25T16:20:55.747213+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:41.785563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:57.663856+0000","last_change":"2023-10-25T16:20:55.768463+0000","last_active":"2023-10-25T16:20:57.663856+0000","last_peered":"2023-10-25T16:20:57.663856+0000","last_clean":"2023-10-25T16:20:57.663856+0000","last_became_active":"2023-10-25T16:20:55.767851+0000","last_became_peered":"2023-10-25T16:20:55.767851+0000","last_unstale":"2023-10-25T16:20:57.663856+0000","last_undegraded":"2023-10-25T16:20:57.663856+0000","last_fullsized":"2023-10-25T16:20:57.663856+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:05:01.273403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.755383+0000","last_change":"2023-10-25T16:20:54.761148+0000","last_active":"2023-10-25T16:20:55.755383+0000","last_peered":"2023-10-25T16:20:55.755383+0000","last_clean":"2023-10-25T16:20:55.755383+0000","last_became_active":"2023-10-25T16:20:54.760911+0000","last_became_peered":"2023-10-25T16:20:54.760911+0000","last_unstale":"2023-10-25T16:20:55.755383+0000","last_undegraded":"2023-10-25T16:20:55.755383+0000","last_fullsized":"2023-10-25T16:20:55.755383+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:11.597975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746721+0000","last_change":"2023-10-25T16:20:55.782080+0000","last_active":"2023-10-25T16:20:56.746721+0000","last_peered":"2023-10-25T16:20:56.746721+0000","last_clean":"2023-10-25T16:20:56.746721+0000","last_became_active":"2023-10-25T16:20:55.781797+0000","last_became_peered":"2023-10-25T16:20:55.781797+0000","last_unstale":"2023-10-25T16:20:56.746721+0000","last_undegraded":"2023-10-25T16:20:56.746721+0000","last_fullsized":"2023-10-25T16:20:56.746721+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:54.724505+0000","last_clean_scrub_stamp":"2023-10-25T16:20:54.724505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:00:16.963164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"157'2","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-25T16:20:55.795684+0000","last_change":"2023-10-25T16:20:54.766906+0000","last_active":"2023-10-25T16:20:55.795684+0000","last_peered":"2023-10-25T16:20:55.795684+0000","last_clean":"2023-10-25T16:20:55.795684+0000","last_became_active":"2023-10-25T16:20:54.753701+0000","last_became_peered":"2023-10-25T16:20:54.753701+0000","last_unstale":"2023-10-25T16:20:55.795684+0000","last_undegraded":"2023-10-25T16:20:55.795684+0000","last_fullsized":"2023-10-25T16:20:55.795684+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:20:53.713473+0000","last_clean_scrub_stamp":"2023-10-25T16:20:53.713473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:26.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":296,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-25T16:20:56.746108+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:20:56.746108+0000","last_peered":"2023-10-25T16:20:56.746108+0000","last_clean":"2023-10-25T16:20:56.746108+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:20:56.746108+0000","last_undegraded":"2023-10-25T16:20:56.746108+0000","last_fullsized":"2023-10-25T16:20:56.746108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542244,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":866,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113082,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.52900000000000003},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.377},{"interface":"front","average":{"1min":0.628,"5min":0.64000000000000001,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.27400000000000002,"15min":0.27000000000000002},"max":{"1min":0.88200000000000001,"5min":0.94999999999999996,"15min":1.077},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66400000000000003,"15min":0.58699999999999997},"min":{"1min":0.41199999999999998,"5min":0.307,"15min":0.27000000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.1759999999999999},"last":0.438},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46200000000000002,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.34599999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.70699999999999996,"15min":0.61199999999999999},"min":{"1min":0.374,"5min":0.315,"15min":0.29599999999999999},"max":{"1min":1.159,"5min":1.246,"15min":1.246},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.64800000000000002},"min":{"1min":0.46200000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.2729999999999999,"5min":1.345,"15min":1.345},"last":0.40699999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.94799999999999995,"15min":0.83999999999999997},"min":{"1min":0.70199999999999996,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.45,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.94999999999999996,"15min":0.87},"min":{"1min":0.68400000000000005,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.3160000000000001,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91100000000000003,"15min":0.85499999999999998},"min":{"1min":0.74399999999999999,"5min":0.56599999999999995,"15min":0.504},"max":{"1min":1.298,"5min":1.345,"15min":1.4930000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.002,"5min":0.96899999999999997,"15min":0.93300000000000005},"min":{"1min":0.747,"5min":0.58599999999999997,"15min":0.47899999999999998},"max":{"1min":1.518,"5min":1.671,"15min":1.671},"last":0.60199999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98499999999999999,"15min":0.90700000000000003},"min":{"1min":0.79300000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.95299999999999996,"15min":0.93700000000000006},"min":{"1min":0.73099999999999998,"5min":0.56699999999999995,"15min":0.53000000000000003},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.995,"15min":0.93600000000000005},"min":{"1min":0.71099999999999997,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.226,"5min":1.474,"15min":1.677},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.026,"5min":1.016,"15min":0.97099999999999997},"min":{"1min":0.69699999999999995,"5min":0.61699999999999999,"15min":0.57999999999999996},"max":{"1min":1.4139999999999999,"5min":1.454,"15min":1.7569999999999999},"last":0.79100000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1444,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193868,"statfs":{"total":200000000,"available":198521080,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.76000000000000001},"min":{"1min":0.51800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0580000000000001,"5min":1.256,"15min":1.256},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.86499999999999999,"15min":0.83299999999999996},"min":{"1min":0.46800000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.534,"15min":1.534},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.92700000000000005,"15min":0.89100000000000001},"min":{"1min":0.52800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.242,"5min":1.647,"15min":1.647},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.95099999999999996,"15min":0.90900000000000003},"min":{"1min":0.59099999999999997,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":1.2549999999999999,"5min":1.3540000000000001,"15min":1.3759999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.877,"15min":0.83399999999999996},"min":{"1min":0.55200000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.018,"5min":1.27,"15min":1.27},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.86899999999999999,"15min":0.83899999999999997},"min":{"1min":0.60499999999999998,"5min":0.54700000000000004,"15min":0.51800000000000002},"max":{"1min":1.284,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.58999999999999997,"5min":0.505,"15min":0.505},"max":{"1min":1.117,"5min":1.446,"15min":1.446},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":0.95099999999999996},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.51500000000000001},"max":{"1min":1.1950000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.86599999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.177,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.085},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.93500000000000005,"15min":0.99399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1779999999999999,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.82399999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.95999999999999996,"15min":1.032},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.216,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.96699999999999997,"5min":1.0029999999999999,"15min":1.028},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.323,"5min":1.637,"15min":1.637},"last":1.1559999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1000000000000001,"15min":1.1359999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2789999999999999,"5min":1.669,"15min":1.669},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.0980000000000001,"15min":1.117},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.371,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.228}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":867,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194445,"statfs":{"total":200000000,"available":199112086,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.878,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.353,"5min":1.395,"15min":1.397},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.88500000000000001,"15min":0.88900000000000001},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2230000000000001,"5min":1.224,"15min":1.6419999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89500000000000002,"15min":0.88400000000000001},"min":{"1min":0.56699999999999995,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.2569999999999999,"5min":1.302,"15min":1.302},"last":1.1699999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93300000000000005,"15min":0.90800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.2609999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.625}]},{"osd":2,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.92700000000000005,"15min":0.88400000000000001},"min":{"1min":0.57599999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.446,"5min":1.4570000000000001,"15min":1.476},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":0.90400000000000003},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.91100000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":0.91800000000000004},"min":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.046,"15min":1.044},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.367,"5min":1.587,"15min":1.7110000000000001},"last":1.228}]},{"osd":4,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.95499999999999996,"15min":0.95399999999999996},"min":{"1min":0.48699999999999999,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.411,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.97699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.236,"5min":1.444,"15min":1.444},"last":0.877}]},{"osd":5,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.98999999999999999,"15min":0.97299999999999998},"min":{"1min":0.54600000000000004,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.29,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.054},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3859999999999999,"5min":1.5720000000000001,"15min":1.895},"last":1.2829999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:20:13 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.105,"15min":1.0860000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.29,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.095,"15min":1.05},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.339,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.081}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86699999999999999,"15min":1.242},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":14.843},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.80900000000000005,"15min":1.3380000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.1639999999999999,"5min":1.238,"15min":16.439},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.88900000000000001,"15min":1.3},"min":{"1min":0.54000000000000004,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.111,"5min":1.423,"15min":14.630000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.90800000000000003,"15min":0.877},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.399,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.91200000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95399999999999996,"15min":0.94099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.133,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.94199999999999995,"15min":0.95499999999999996},"min":{"1min":0.58599999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.129,"5min":1.4399999999999999,"15min":1.4810000000000001},"last":0.876}]},{"osd":3,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.97899999999999998,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.234,"5min":1.482,"15min":1.482},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.0700000000000001,"15min":1.4139999999999999},"min":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.52900000000000003},"max":{"1min":1.268,"5min":2.194,"15min":14.954000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.006,"15min":1.472},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3129999999999999,"5min":1.5489999999999999,"15min":15.904},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.92200000000000004,"15min":1.4650000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.0900000000000001,"5min":1.879,"15min":17.219999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.0289999999999999,"15min":1.401},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2470000000000001,"5min":1.748,"15min":14.567},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.1479999999999999,"15min":1.5880000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.431,"5min":1.657,"15min":15.089},"last":1.075}]},{"osd":7,"last update":"Wed Oct 25 16:20:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.99399999999999999,"15min":1.5720000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2709999999999999,"5min":1.7090000000000001,"15min":17.492000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.121,"15min":1.234},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2410000000000001,"5min":1.9530000000000001,"15min":3.7930000000000001},"last":1.1080000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113628,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.85799999999999998,"15min":0.81100000000000005},"min":{"1min":0.627,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.216,"5min":1.327,"15min":1.47},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.85499999999999998,"15min":0.81599999999999995},"min":{"1min":0.56100000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1180000000000001,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.84399999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.82799999999999996},"min":{"1min":0.49199999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1459999999999999,"5min":1.1659999999999999,"15min":1.288},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.98099999999999998,"15min":0.95499999999999996},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4059999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:20:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.58699999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.288,"5min":1.397,"15min":1.419},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.95999999999999996,"15min":0.89000000000000001},"min":{"1min":0.69899999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.226,"5min":1.411,"15min":1.411},"last":0.996}]},{"osd":3,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.91200000000000003},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2849999999999999,"5min":1.5,"15min":1.5},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.84999999999999998,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1339999999999999,"5min":1.518,"15min":1.518},"last":0.74299999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94399999999999995,"15min":0.94899999999999995},"min":{"1min":0.48799999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.302,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.66000000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.49,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.153}]},{"osd":6,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.96399999999999997,"15min":0.97799999999999998},"min":{"1min":0.69199999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2749999999999999,"5min":2.085,"15min":2.085},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.107,"15min":1.0780000000000001},"min":{"1min":0.92500000000000004,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.625,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.0660000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:20:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.94799999999999995,"15min":0.94599999999999995},"min":{"1min":0.59299999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4490000000000001,"5min":1.474,"15min":1.5029999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.135,"15min":1.1180000000000001},"min":{"1min":0.96099999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1890000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113538,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63,"15min":0.56499999999999995},"min":{"1min":0.40500000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.79000000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.093},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.44500000000000001,"5min":0.25700000000000001,"15min":0.222},"max":{"1min":1.0529999999999999,"5min":1.077,"15min":1.083},"last":1.0109999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.64400000000000002},"min":{"1min":0.42499999999999999,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":1.052,"5min":1.1779999999999999,"15min":1.3360000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.47399999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.109,"5min":1.254,"15min":1.2809999999999999},"last":0.97599999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.70099999999999996,"15min":0.67600000000000005},"min":{"1min":0.36099999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69899999999999995,"15min":0.69399999999999995},"min":{"1min":0.38400000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.25,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.63900000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1919999999999999,"15min":1.23},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.996,"15min":0.98399999999999999},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.89900000000000002,"15min":0.92200000000000004},"min":{"1min":0.68100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.5269999999999999},"last":1.052},{"interface":"front","average":{"1min":0.998,"5min":0.98299999999999998,"15min":0.94699999999999995},"min":{"1min":0.58899999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2410000000000001,"5min":1.4059999999999999,"15min":1.4830000000000001},"last":0.88500000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91300000000000003,"15min":0.90500000000000003},"min":{"1min":0.64600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.28,"5min":1.306,"15min":1.456},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.97799999999999998,"15min":0.997},"min":{"1min":0.626,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.395,"5min":1.395,"15min":1.663},"last":0.92900000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.018,"15min":0.98099999999999998},"min":{"1min":0.82399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.508,"5min":1.508,"15min":1.5660000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.98699999999999999,"15min":0.95299999999999996},"min":{"1min":0.60199999999999998,"5min":0.54700000000000004,"15min":0.51500000000000001},"max":{"1min":1.212,"5min":1.3480000000000001,"15min":1.389},"last":1.29}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":865,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194446,"statfs":{"total":200000000,"available":199113698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.0800000000000001,"5min":1.1539999999999999,"15min":1.4610000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.29499999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.92600000000000005,"5min":1.129,"15min":1.1990000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.98599999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.35399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90100000000000002,"5min":1.2,"15min":1.2},"last":0.503}]},{"osd":3,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65200000000000002,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80500000000000005,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.749},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.28000000000000003},"max":{"1min":1.0129999999999999,"5min":1.2110000000000001,"15min":1.423},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.88900000000000001,"15min":0.96199999999999997},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.242,"5min":1.702,"15min":12.698},"last":1.04},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.95799999999999996,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.61799999999999999,"15min":0.54800000000000004},"max":{"1min":1.2090000000000001,"5min":1.4279999999999999,"15min":12.721},"last":0.95999999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.90900000000000003,"15min":0.91200000000000003},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.115,"5min":1.345,"15min":1.546},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.89400000000000002,"15min":0.88700000000000001},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1779999999999999,"5min":2.206,"15min":2.206},"last":0.99299999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.95899999999999996,"15min":0.93999999999999995},"min":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.379,"15min":1.4610000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.006,"15min":1.0169999999999999},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.25,"5min":1.397,"15min":1.5980000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:20:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.60999999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2849999999999999,"5min":1.9410000000000001,"15min":14.776},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99199999999999999,"15min":1.016},"min":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.254,"5min":1.476,"15min":10.509},"last":1.0229999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1442,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193870,"statfs":{"total":200000000,"available":198523330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.67800000000000005},"min":{"1min":0.31,"5min":0.22500000000000001,"15min":0.217},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.64300000000000002,"15min":0.68200000000000005},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.3919999999999999,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.58699999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.431,"5min":4.431,"15min":4.431},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.85499999999999998,"15min":0.81799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.181,"5min":1.407,"15min":3.6579999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88500000000000001,"15min":0.84899999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.054,"5min":0.93700000000000006,"15min":0.93600000000000005},"min":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.85899999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94199999999999995,"15min":0.875},"min":{"1min":0.58699999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.97499999999999998,"15min":0.96099999999999997},"min":{"1min":0.63300000000000001,"5min":0.57799999999999996,"15min":0.53300000000000003},"max":{"1min":5.2880000000000003,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.74299999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.01,"15min":0.98499999999999999},"min":{"1min":0.60199999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.0109999999999999,"15min":0.94099999999999995},"min":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.63}]},{"osd":7,"last update":"Wed Oct 25 16:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.024,"15min":1.246},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.4450000000000001,"5min":1.6060000000000001,"15min":11.891999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.038,"15min":1.2629999999999999},"min":{"1min":0.70699999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.282,"5min":1.4410000000000001,"15min":11.622},"last":0.92200000000000004}]}]}],"pool_statfs":[]}} 2023-10-25T16:21:03.562 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:21:03.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:21:03.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1819028615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 msgr2=0x7f5df815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 --2- 172.21.15.177:0/1819028615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df815bea0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5df80acb50 tx=0x7f5df401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1819028615 shutdown_connections 2023-10-25T16:21:03.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 --2- 172.21.15.177:0/1819028615 >> v2:172.21.15.184:3300/0 conn(0x7f5df80c9f50 0x7f5df8071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 --2- 172.21.15.177:0/1819028615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df815bea0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1819028615 >> 172.21.15.177:0/1819028615 conn(0x7f5df80698f0 msgr2=0x7f5df8069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:03.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1819028615 shutdown_connections 2023-10-25T16:21:03.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1819028615 wait complete. 2023-10-25T16:21:03.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 Processor -- start 2023-10-25T16:21:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- start start 2023-10-25T16:21:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df8071560 0x7f5df8147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df8145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df80c9f50 0x7f5df80ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8148310 con 0x7f5df80c9b70 2023-10-25T16:21:03.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81485f0 con 0x7f5df80c9f50 2023-10-25T16:21:03.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81488d0 con 0x7f5df8071560 2023-10-25T16:21:03.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df8145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df8145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52214/0 (socket says 172.21.15.177:52214) 2023-10-25T16:21:03.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 -- 172.21.15.177:0/1697867014 learned_addr learned my addr 172.21.15.177:0/1697867014 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:03.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfd09d640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df8071560 0x7f5df8147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfd89e640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df80c9f50 0x7f5df80ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 -- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df8071560 msgr2=0x7f5df8147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df8071560 0x7f5df8147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 -- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df80c9f50 msgr2=0x7f5df80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df80c9f50 0x7f5df80ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 -- 172.21.15.177:0/1697867014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009560 con 0x7f5df80c9b70 2023-10-25T16:21:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dfc89c640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df8145df0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c970 tx=0x7f5de800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8007bb0 con 0x7f5df80c9b70 2023-10-25T16:21:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5de8007e20 con 0x7f5df80c9b70 2023-10-25T16:21:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df8148bb0 con 0x7f5df80c9b70 2023-10-25T16:21:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8005280 con 0x7f5df80c9b70 2023-10-25T16:21:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.743+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df8146e00 con 0x7f5df80c9b70 2023-10-25T16:21:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.747+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df804db20 con 0x7f5df80c9b70 2023-10-25T16:21:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.747+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5de80053e0 con 0x7f5df80c9b70 2023-10-25T16:21:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.747+0000 7f5dedffb640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ddc066470 0x7f5ddc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.747+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5de8084710 con 0x7f5df80c9b70 2023-10-25T16:21:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.747+0000 7f5dfd09d640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ddc066470 0x7f5ddc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.747+0000 7f5dfd09d640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ddc066470 0x7f5ddc068930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5df40af000 tx=0x7f5df401b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.751+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5de8051c20 con 0x7f5df80c9b70 2023-10-25T16:21:03.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.967+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5df8149060 con 0x7f5df80c9b70 2023-10-25T16:21:03.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.971+0000 7f5dedffb640 1 -- 172.21.15.177:0/1697867014 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5de801d020 con 0x7f5df80c9b70 2023-10-25T16:21:03.970 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:21:03.971 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:21:03.971 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:21:03.971 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:21:03.972 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:21:03.973 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:21:03.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ddc066470 msgr2=0x7f5ddc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ddc066470 0x7f5ddc068930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5df40af000 tx=0x7f5df401b010 comp rx=0 tx=0).stop 2023-10-25T16:21:03.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 msgr2=0x7f5df8145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:03.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df8145df0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5de800c970 tx=0x7f5de800ce30 comp rx=0 tx=0).stop 2023-10-25T16:21:03.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 shutdown_connections 2023-10-25T16:21:03.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ddc066470 0x7f5ddc068930 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5df80c9f50 0x7f5df80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df80c9b70 0x7f5df8145df0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 --2- 172.21.15.177:0/1697867014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5df8071560 0x7f5df8147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:03.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 >> 172.21.15.177:0/1697867014 conn(0x7f5df80698f0 msgr2=0x7f5df8154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:03.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 shutdown_connections 2023-10-25T16:21:03.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:03.975+0000 7f5dff301640 1 -- 172.21.15.177:0/1697867014 wait complete. 2023-10-25T16:21:03.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:21:04.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 -- 172.21.15.177:0/2150824253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 msgr2=0x7fa62006ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2150824253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 0x7fa62006ba50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa6080098f0 tx=0x7fa60801c830 comp rx=0 tx=0).stop 2023-10-25T16:21:04.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 -- 172.21.15.177:0/2150824253 shutdown_connections 2023-10-25T16:21:04.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2150824253 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 0x7fa62006ba50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2150824253 >> v2:172.21.15.184:3300/0 conn(0x7fa620140cf0 0x7fa6200af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 -- 172.21.15.177:0/2150824253 >> 172.21.15.177:0/2150824253 conn(0x7fa6200b2450 msgr2=0x7fa6200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 -- 172.21.15.177:0/2150824253 shutdown_connections 2023-10-25T16:21:04.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 -- 172.21.15.177:0/2150824253 wait complete. 2023-10-25T16:21:04.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 Processor -- start 2023-10-25T16:21:04.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.115+0000 7fa6251ac640 1 -- start start 2023-10-25T16:21:04.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 0x7fa6201f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 0x7fa620154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa620140cf0 0x7fa620157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620136580 con 0x7fa62006bf90 2023-10-25T16:21:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620155c40 con 0x7fa620140cf0 2023-10-25T16:21:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201f3740 con 0x7fa62006f570 2023-10-25T16:21:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 0x7fa6201f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 0x7fa6201f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52226/0 (socket says 172.21.15.177:52226) 2023-10-25T16:21:04.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 -- 172.21.15.177:0/2398531882 learned_addr learned my addr 172.21.15.177:0/2398531882 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61e59c640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 0x7fa620154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61f59e640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa620140cf0 0x7fa620157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 -- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 msgr2=0x7fa620154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 0x7fa620154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 -- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa620140cf0 msgr2=0x7fa620157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa620140cf0 0x7fa620157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 -- 172.21.15.177:0/2398531882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608009500 con 0x7fa62006bf90 2023-10-25T16:21:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61ed9d640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 0x7fa6201f30b0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa61000e7a0 tx=0x7fa61000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610009590 con 0x7fa62006bf90 2023-10-25T16:21:04.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa61000cdb0 con 0x7fa62006bf90 2023-10-25T16:21:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6201f3a20 con 0x7fa62006bf90 2023-10-25T16:21:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610010690 con 0x7fa62006bf90 2023-10-25T16:21:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6201f3fe0 con 0x7fa62006bf90 2023-10-25T16:21:04.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62004daf0 con 0x7fa62006bf90 2023-10-25T16:21:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa6100107f0 con 0x7fa62006bf90 2023-10-25T16:21:04.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6177fe640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa600066470 0x7fa600068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa610014070 con 0x7fa62006bf90 2023-10-25T16:21:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61e59c640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa600066470 0x7fa600068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.119+0000 7fa61e59c640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa600066470 0x7fa600068930 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa6080af000 tx=0x7fa60801b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.123+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa610050090 con 0x7fa62006bf90 2023-10-25T16:21:04.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.307+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6200ca670 con 0x7fa62006bf90 2023-10-25T16:21:04.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6177fe640 1 -- 172.21.15.177:0/2398531882 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fa610051d60 con 0x7fa62006bf90 2023-10-25T16:21:04.309 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:21:04.309 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:21:04.309 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:21:04.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa600066470 msgr2=0x7fa600068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa600066470 0x7fa600068930 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa6080af000 tx=0x7fa60801b070 comp rx=0 tx=0).stop 2023-10-25T16:21:04.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 msgr2=0x7fa6201f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 0x7fa6201f30b0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa61000e7a0 tx=0x7fa61000ec60 comp rx=0 tx=0).stop 2023-10-25T16:21:04.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 shutdown_connections 2023-10-25T16:21:04.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa600066470 0x7fa600068930 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa620140cf0 0x7fa620157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa62006f570 0x7fa620154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 --2- 172.21.15.177:0/2398531882 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62006bf90 0x7fa6201f30b0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 >> 172.21.15.177:0/2398531882 conn(0x7fa6200b2450 msgr2=0x7fa620159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 shutdown_connections 2023-10-25T16:21:04.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.311+0000 7fa6251ac640 1 -- 172.21.15.177:0/2398531882 wait complete. 2023-10-25T16:21:04.729 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:20:55.099845+0000', 'modified': '2023-10-25T16:20:57.107431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 155948}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_155948': {'gid': 155948, 'name': 'b', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6835/1729696523', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 1729696523}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 1729696523}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:21:04.729 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:21:04.730 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-25T16:21:04.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- 172.21.15.177:0/1637524048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c0047d0 msgr2=0x7f170c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 --2- 172.21.15.177:0/1637524048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c0047d0 0x7f170c004c50 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f1710001ec0 tx=0x7f171001cf10 comp rx=0 tx=0).stop 2023-10-25T16:21:04.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- 172.21.15.177:0/1637524048 shutdown_connections 2023-10-25T16:21:04.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 --2- 172.21.15.177:0/1637524048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170c0047d0 0x7f170c004c50 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- 172.21.15.177:0/1637524048 >> 172.21.15.177:0/1637524048 conn(0x7f17200b2450 msgr2=0x7f17200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- 172.21.15.177:0/1637524048 shutdown_connections 2023-10-25T16:21:04.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- 172.21.15.177:0/1637524048 wait complete. 2023-10-25T16:21:04.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 Processor -- start 2023-10-25T16:21:04.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- start start 2023-10-25T16:21:04.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170c0047d0 0x7f17201f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17201578d0 0x7f17201fd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 0x7f1720071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17201582c0 con 0x7f1720070de0 2023-10-25T16:21:04.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200717a0 con 0x7f17201578d0 2023-10-25T16:21:04.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1727a56640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17201fa9d0 con 0x7f170c0047d0 2023-10-25T16:21:04.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1725ff3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 0x7f1720071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1725ff3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 0x7f1720071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52234/0 (socket says 172.21.15.177:52234) 2023-10-25T16:21:04.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.871+0000 7f1725ff3640 1 -- 172.21.15.177:0/719625718 learned_addr learned my addr 172.21.15.177:0/719625718 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:04.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1724ff1640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17201578d0 0x7f17201fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f17257f2640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170c0047d0 0x7f17201f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1725ff3640 1 -- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170c0047d0 msgr2=0x7f17201f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1725ff3640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170c0047d0 0x7f17201f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1725ff3640 1 -- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17201578d0 msgr2=0x7f17201fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1725ff3640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17201578d0 0x7f17201fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1725ff3640 1 -- 172.21.15.177:0/719625718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720157d50 con 0x7f1720070de0 2023-10-25T16:21:04.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f17257f2640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170c0047d0 0x7f17201f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:21:04.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1724ff1640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17201578d0 0x7f17201fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:21:04.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1725ff3640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 0x7f1720071260 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f17200acb50 tx=0x7f171800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1715ffb640 1 -- 172.21.15.177:0/719625718 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718003b80 con 0x7f1720070de0 2023-10-25T16:21:04.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1715ffb640 1 -- 172.21.15.177:0/719625718 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1718003dd0 con 0x7f1720070de0 2023-10-25T16:21:04.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17201fdca0 con 0x7f1720070de0 2023-10-25T16:21:04.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1715ffb640 1 -- 172.21.15.177:0/719625718 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718005330 con 0x7f1720070de0 2023-10-25T16:21:04.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17201fa0a0 con 0x7f1720070de0 2023-10-25T16:21:04.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f172aba0000 1 Processor -- start 2023-10-25T16:21:04.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f172aba0000 1 -- start start 2023-10-25T16:21:04.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f172aba0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e614861da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614817a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.875+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614818360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61460ccc0 con 0x55e6148619c0 2023-10-25T16:21:04.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e61466f920 con 0x55e6148622e0 2023-10-25T16:21:04.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e61466ce50 con 0x55e614817f80 2023-10-25T16:21:04.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e614861da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e614861da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52244/0 (socket says 172.21.15.177:52244) 2023-10-25T16:21:04.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 -- 172.21.15.177:0/2504748403 learned_addr learned my addr 172.21.15.177:0/2504748403 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:04.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f17257f2640 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614817a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 -- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 msgr2=0x55e614818360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614818360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 -- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 msgr2=0x55e614817a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614817a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 -- 172.21.15.177:0/2504748403 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e614361890 con 0x55e6148619c0 2023-10-25T16:21:04.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e614861da0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f171001b790 tx=0x7f170c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0487ba14c4bf5d server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1715ffb640 1 -- 172.21.15.177:0/719625718 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1718005490 con 0x7f1720070de0 2023-10-25T16:21:04.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f170affd640 1 -- 172.21.15.177:0/2504748403 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100a5de0 con 0x55e6148619c0 2023-10-25T16:21:04.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f170affd640 1 -- 172.21.15.177:0/2504748403 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17100b4070 con 0x55e6148619c0 2023-10-25T16:21:04.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f170affd640 1 -- 172.21.15.177:0/2504748403 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710001710 con 0x55e6148619c0 2023-10-25T16:21:04.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1715ffb640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1704066470 0x7f1704068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1715ffb640 1 -- 172.21.15.177:0/719625718 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17180834f0 con 0x7f1720070de0 2023-10-25T16:21:04.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/2504748403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 msgr2=0x55e614861da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e614861da0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f171001b790 tx=0x7f170c005800 comp rx=0 tx=0).stop 2023-10-25T16:21:04.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/2504748403 shutdown_connections 2023-10-25T16:21:04.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614818360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.889 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614817a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- 172.21.15.177:0/2504748403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e614861da0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/2504748403 >> 172.21.15.177:0/2504748403 conn(0x55e61480f2f0 msgr2=0x55e614816320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/2504748403 shutdown_connections 2023-10-25T16:21:04.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f17257f2640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1704066470 0x7f1704068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.890 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/2504748403 wait complete. 2023-10-25T16:21:04.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- start start 2023-10-25T16:21:04.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 Processor -- start 2023-10-25T16:21:04.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f17257f2640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1704066470 0x7f1704068930 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f171c0058d0 tx=0x7f171c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614861410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e61481d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e61481d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e614668740 con 0x55e6148622e0 2023-10-25T16:21:04.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e614627d10 con 0x55e6148619c0 2023-10-25T16:21:04.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6146279b0 con 0x55e614817f80 2023-10-25T16:21:04.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 10 client.0 _ll_register_callbacks cb 0x55e6148036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:21:04.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e61481d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e61481d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52252/0 (socket says 172.21.15.177:52252) 2023-10-25T16:21:04.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 -- 172.21.15.177:0/3719935814 learned_addr learned my addr 172.21.15.177:0/3719935814 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:04.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f17257f2640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614861410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1724ff1640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e61481d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 -- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 msgr2=0x55e614861410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614861410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 -- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 msgr2=0x55e61481d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e61481d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 -- 172.21.15.177:0/3719935814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c003530 con 0x55e6148622e0 2023-10-25T16:21:04.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f1725ff3640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e61481d800 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f1718081a20 tx=0x7f1718054f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544115a6a8e5d2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f16fffff640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:21:04.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f16fffff640 1 -- 172.21.15.177:0/3719935814 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171806c020 con 0x55e6148622e0 2023-10-25T16:21:04.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f16fffff640 1 -- 172.21.15.177:0/3719935814 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1718081e40 con 0x55e6148622e0 2023-10-25T16:21:04.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e61461c370 con 0x55e6148622e0 2023-10-25T16:21:04.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f16fffff640 1 -- 172.21.15.177:0/3719935814 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1718050dd0 con 0x55e6148622e0 2023-10-25T16:21:04.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 10 client.8838 fetch_fsmap learned FSMap version 58 2023-10-25T16:21:04.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.879+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55e61462a460 con 0x55e6148622e0 2023-10-25T16:21:04.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f16fffff640 1 -- 172.21.15.177:0/3719935814 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55e61461c370 con 0x55e6148622e0 2023-10-25T16:21:04.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f16fffff640 1 -- 172.21.15.177:0/3719935814 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f171805c530 con 0x55e6148622e0 2023-10-25T16:21:04.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 10 client.8838 fetch_fsmap finished waiting for FSMap version 58 2023-10-25T16:21:04.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 10 client.8838 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:21:04.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 20 client.8838 populate_metadata read hostname 'smithi177' 2023-10-25T16:21:04.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614824410 0x55e614873a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 4 client.8838 mds_command: new command op to 155948 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:21:04.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 --> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6146022d0 con 0x55e614824410 2023-10-25T16:21:04.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f17257f2640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614824410 0x55e614873a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f17257f2640 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614824410 0x55e614873a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ec1fb5a87bb83d server_cookie=46d42a860b182bfc in_seq=0 out_seq=0 2023-10-25T16:21:04.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f16fffff640 10 client.8838 ms_handle_connect on v2:172.21.15.184:6834/1729696523 2023-10-25T16:21:04.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f16fffff640 1 -- 172.21.15.177:0/3719935814 <== mds.0 v2:172.21.15.184:6834/1729696523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e6146022d0 con 0x55e614824410 2023-10-25T16:21:04.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f16fffff640 10 client.8838 handle_command_reply: tid=0 2023-10-25T16:21:04.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 client.8838 shutdown 2023-10-25T16:21:04.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 msgr2=0x55e61481d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e61481d800 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f1718081a20 tx=0x7f1718054f00 comp rx=0 tx=0).stop 2023-10-25T16:21:04.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 shutdown_connections 2023-10-25T16:21:04.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e61481d800 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614824410 0x55e614873a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e61481d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 --2- 172.21.15.177:0/3719935814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e614861410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 >> 172.21.15.177:0/3719935814 conn(0x55e61480f2f0 msgr2=0x55e614816a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f16fffff640 0 client.8838 ms_handle_reset on v2:172.21.15.184:6834/1729696523 2023-10-25T16:21:04.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 shutdown_connections 2023-10-25T16:21:04.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 1 -- 172.21.15.177:0/3719935814 wait complete. 2023-10-25T16:21:04.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.883+0000 7f172aba0000 20 client.8838 trim_cache size 0 max 16384 2023-10-25T16:21:04.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 Processor -- start 2023-10-25T16:21:04.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 -- start start 2023-10-25T16:21:04.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e61485f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e61485ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614871a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e614322940 con 0x55e6148619c0 2023-10-25T16:21:04.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6146166c0 con 0x55e6148622e0 2023-10-25T16:21:04.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6146274d0 con 0x55e614817f80 2023-10-25T16:21:04.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e61485ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e61485ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52260/0 (socket says 172.21.15.177:52260) 2023-10-25T16:21:04.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 -- 172.21.15.177:0/2132614350 learned_addr learned my addr 172.21.15.177:0/2132614350 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:04.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 -- 172.21.15.177:0/2132614350 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 msgr2=0x55e61485f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e61485f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 -- 172.21.15.177:0/2132614350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 msgr2=0x55e614871a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614871a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 -- 172.21.15.177:0/2132614350 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e614610760 con 0x55e6148619c0 2023-10-25T16:21:04.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e61485ff10 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f1710001990 tx=0x7f17100067b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6654064c93bb89a server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f170b7fe640 1 -- 172.21.15.177:0/2132614350 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100a5de0 con 0x55e6148619c0 2023-10-25T16:21:04.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f170b7fe640 1 -- 172.21.15.177:0/2132614350 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17100b4040 con 0x55e6148619c0 2023-10-25T16:21:04.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.899+0000 7f170b7fe640 1 -- 172.21.15.177:0/2132614350 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100061e0 con 0x55e6148619c0 2023-10-25T16:21:04.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2132614350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 msgr2=0x55e61485ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e61485ff10 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f1710001990 tx=0x7f17100067b0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2132614350 shutdown_connections 2023-10-25T16:21:04.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148622e0 0x55e614871a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148619c0 0x55e61485ff10 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- 172.21.15.177:0/2132614350 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e61485f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2132614350 >> 172.21.15.177:0/2132614350 conn(0x55e61480f2f0 msgr2=0x55e614822b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2132614350 shutdown_connections 2023-10-25T16:21:04.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2132614350 wait complete. 2023-10-25T16:21:04.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- start start 2023-10-25T16:21:04.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 Processor -- start 2023-10-25T16:21:04.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e6148bf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e614873f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e6148744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6146640b0 con 0x55e6148622e0 2023-10-25T16:21:04.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e614662a40 con 0x55e6148619c0 2023-10-25T16:21:04.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e6143621b0 con 0x55e614817f80 2023-10-25T16:21:04.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 10 client.0 _ll_register_callbacks cb 0x55e614666ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:21:04.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e6148744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e6148744a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52272/0 (socket says 172.21.15.177:52272) 2023-10-25T16:21:04.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 -- 172.21.15.177:0/2488524733 learned_addr learned my addr 172.21.15.177:0/2488524733 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:04.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 -- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 msgr2=0x55e6148bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1724ff1640 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e614873f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e6148bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 -- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 msgr2=0x55e614873f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:21:04.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e614873f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 -- 172.21.15.177:0/2488524733 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e614361890 con 0x55e6148622e0 2023-10-25T16:21:04.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f1725ff3640 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e6148744a0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f171805c490 tx=0x7f1718054810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5643673e6d5232a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:04.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:21:04.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 1 -- 172.21.15.177:0/2488524733 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718054490 con 0x55e6148622e0 2023-10-25T16:21:04.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 1 -- 172.21.15.177:0/2488524733 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1718081e40 con 0x55e6148622e0 2023-10-25T16:21:04.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e61481a6e0 con 0x55e6148622e0 2023-10-25T16:21:04.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 1 -- 172.21.15.177:0/2488524733 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17180830c0 con 0x55e6148622e0 2023-10-25T16:21:04.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 10 client.8844 fetch_fsmap learned FSMap version 58 2023-10-25T16:21:04.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55e614361cc0 con 0x55e6148622e0 2023-10-25T16:21:04.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 1 -- 172.21.15.177:0/2488524733 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1718078020 con 0x55e6148622e0 2023-10-25T16:21:04.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 1 -- 172.21.15.177:0/2488524733 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f171805c530 con 0x55e6148622e0 2023-10-25T16:21:04.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 10 client.8844 fetch_fsmap finished waiting for FSMap version 58 2023-10-25T16:21:04.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 10 client.8844 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-25T16:21:04.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 20 client.8844 populate_metadata read hostname 'smithi177' 2023-10-25T16:21:04.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614874e60 0x55e614875240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:04.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 4 client.8844 mds_command: new command op to 155948 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:21:04.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 --> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e6146006f0 con 0x55e614874e60 2023-10-25T16:21:04.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f17257f2640 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614874e60 0x55e614875240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:04.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f17257f2640 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614874e60 0x55e614875240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44f660fc03076c5 server_cookie=73283024da429810 in_seq=0 out_seq=0 2023-10-25T16:21:04.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.903+0000 7f16fffff640 10 client.8844 ms_handle_connect on v2:172.21.15.184:6834/1729696523 2023-10-25T16:21:04.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f16fffff640 1 -- 172.21.15.177:0/2488524733 <== mds.0 v2:172.21.15.184:6834/1729696523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55e6146006f0 con 0x55e614874e60 2023-10-25T16:21:04.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f16fffff640 10 client.8844 handle_command_reply: tid=0 2023-10-25T16:21:04.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 client.8844 shutdown 2023-10-25T16:21:04.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 msgr2=0x55e6148744a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e6148744a0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f171805c490 tx=0x7f1718054810 comp rx=0 tx=0).stop 2023-10-25T16:21:04.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 shutdown_connections 2023-10-25T16:21:04.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e6148622e0 0x55e6148744a0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:6834/1729696523,v1:172.21.15.184:6835/1729696523] conn(0x55e614874e60 0x55e614875240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e6148619c0 0x55e614873f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 --2- 172.21.15.177:0/2488524733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55e614817f80 0x55e6148bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f16fffff640 0 client.8844 ms_handle_reset on v2:172.21.15.184:6834/1729696523 2023-10-25T16:21:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 >> 172.21.15.177:0/2488524733 conn(0x55e61480f2f0 msgr2=0x55e614823420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 shutdown_connections 2023-10-25T16:21:04.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 1 -- 172.21.15.177:0/2488524733 wait complete. 2023-10-25T16:21:04.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f172aba0000 20 client.8844 trim_cache size 0 max 16384 2023-10-25T16:21:04.923 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:21:04.923 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:21:04.923 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:21:04.924 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 155948, 2023-10-25T16:21:04.924 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:21:04.924 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:21:04.924 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:21:04.924 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1308379810000009, 2023-10-25T16:21:04.925 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 58, 2023-10-25T16:21:04.925 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 158, 2023-10-25T16:21:04.925 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 158, 2023-10-25T16:21:04.925 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 14.022171065 2023-10-25T16:21:04.925 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:21:04.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1704066470 msgr2=0x7f1704068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1704066470 0x7f1704068930 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f171c0058d0 tx=0x7f171c005860 comp rx=0 tx=0).stop 2023-10-25T16:21:04.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 msgr2=0x7f1720071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:04.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 0x7f1720071260 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f17200acb50 tx=0x7f171800cb90 comp rx=0 tx=0).stop 2023-10-25T16:21:04.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 shutdown_connections 2023-10-25T16:21:04.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1704066470 0x7f1704068930 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1720070de0 0x7f1720071260 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17201578d0 0x7f17201fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 --2- 172.21.15.177:0/719625718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f170c0047d0 0x7f17201f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 >> 172.21.15.177:0/719625718 conn(0x7f17200b2450 msgr2=0x7f17200aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 shutdown_connections 2023-10-25T16:21:04.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:04.907+0000 7f1727a56640 1 -- 172.21.15.177:0/719625718 wait complete. 2023-10-25T16:21:04.930 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:21:05.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3133283365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 msgr2=0x7f5b10005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:05.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3133283365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b10005190 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009b40 tx=0x7f5b1c01d230 comp rx=0 tx=0).stop 2023-10-25T16:21:05.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b22d9d640 1 -- 172.21.15.177:0/3133283365 reap_dead start 2023-10-25T16:21:05.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3133283365 shutdown_connections 2023-10-25T16:21:05.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3133283365 >> 172.21.15.177:0/3133283365 conn(0x7f5b240b2450 msgr2=0x7f5b240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:05.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3133283365 shutdown_connections 2023-10-25T16:21:05.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3133283365 wait complete. 2023-10-25T16:21:05.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 Processor -- start 2023-10-25T16:21:05.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- start start 2023-10-25T16:21:05.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b240adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:05.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b241ef4c0 0x7f5b24156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b24157d50 0x7f5b241581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240ae190 con 0x7f5b10004d10 2023-10-25T16:21:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24158710 con 0x7f5b24157d50 2023-10-25T16:21:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24145260 con 0x7f5b241ef4c0 2023-10-25T16:21:05.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b240adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b240adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52286/0 (socket says 172.21.15.177:52286) 2023-10-25T16:21:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 -- 172.21.15.177:0/3025905201 learned_addr learned my addr 172.21.15.177:0/3025905201 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b21d9b640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b241ef4c0 0x7f5b24156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b22d9d640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b24157d50 0x7f5b241581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:05.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 -- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b241ef4c0 msgr2=0x7f5b24156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:05.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b241ef4c0 0x7f5b24156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:05.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 -- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b24157d50 msgr2=0x7f5b241581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:05.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b24157d50 0x7f5b241581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:05.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 -- 172.21.15.177:0/3025905201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24156b60 con 0x7f5b10004d10 2023-10-25T16:21:05.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b2259c640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b240adc50 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5b140015b0 tx=0x7f5b1400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:05.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400ccb0 con 0x7f5b10004d10 2023-10-25T16:21:05.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b14011460 con 0x7f5b10004d10 2023-10-25T16:21:05.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b240ae370 con 0x7f5b10004d10 2023-10-25T16:21:05.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14011870 con 0x7f5b10004d10 2023-10-25T16:21:05.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.047+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b240ae930 con 0x7f5b10004d10 2023-10-25T16:21:05.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.051+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2404daf0 con 0x7f5b10004d10 2023-10-25T16:21:05.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.051+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b140119d0 con 0x7f5b10004d10 2023-10-25T16:21:05.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.051+0000 7f5b1affd640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b040664a0 0x7f5b04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:05.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.051+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b14084a50 con 0x7f5b10004d10 2023-10-25T16:21:05.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.051+0000 7f5b21d9b640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b040664a0 0x7f5b04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:05.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.051+0000 7f5b21d9b640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b040664a0 0x7f5b04068960 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5b24153770 tx=0x7f5b0c005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:05.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.055+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b14051ed0 con 0x7f5b10004d10 2023-10-25T16:21:05.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.235+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b240cd970 con 0x7f5b10004d10 2023-10-25T16:21:05.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.235+0000 7f5b1affd640 1 -- 172.21.15.177:0/3025905201 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b1401f020 con 0x7f5b10004d10 2023-10-25T16:21:05.234 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:21:05.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b040664a0 msgr2=0x7f5b04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:05.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b040664a0 0x7f5b04068960 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5b24153770 tx=0x7f5b0c005f40 comp rx=0 tx=0).stop 2023-10-25T16:21:05.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 msgr2=0x7f5b240adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:05.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b240adc50 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f5b140015b0 tx=0x7f5b1400ee00 comp rx=0 tx=0).stop 2023-10-25T16:21:05.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 shutdown_connections 2023-10-25T16:21:05.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b040664a0 0x7f5b04068960 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:05.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b24157d50 0x7f5b241581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:05.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b241ef4c0 0x7f5b24156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:05.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 --2- 172.21.15.177:0/3025905201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b10004d10 0x7f5b240adc50 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:05.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 >> 172.21.15.177:0/3025905201 conn(0x7f5b240b2450 msgr2=0x7f5b2414e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:05.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 shutdown_connections 2023-10-25T16:21:05.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:05.239+0000 7f5b28ec2640 1 -- 172.21.15.177:0/3025905201 wait complete. 2023-10-25T16:21:05.253 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:21:05.253 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:21:05.254 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:21:05.254 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:21:05.255 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:05.255 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:21:05.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:21:05.256 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:21:05.256 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:21:05.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.257 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:21:05.263 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:21:05.264 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:21:05.264 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:21:05.264 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.264 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:21:05.264 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.265 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:21:05.265 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:05.265 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:21:05.265 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:21:05.266 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:05.266 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:21:05.266 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:21:05.266 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:05.266 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:21:05.267 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:05.267 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:21:05.267 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42052sec preferred_lft 42052sec 2023-10-25T16:21:05.267 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:21:05.268 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.268 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:21:05.268 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:05.268 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:21:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.269 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:21:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:05.269 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:21:05.270 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.270 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:21:05.270 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.270 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:21:05.270 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:05.271 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:21:05.271 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.271 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:21:05.271 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:05.271 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:21:05.272 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:05.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.272 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:21:05.320 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:21:05.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.322 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:21:05.372 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:21:05.372 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:21:05.372 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:21:05.373 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:21:05.373 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:21:05.374 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:21:05.374 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:21:05.374 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:21:05.374 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:21:05.375 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:21:05.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.375 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:21:05.376 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:21:05.376 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:21:05.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:21:05.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:21:05.377 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:21:05.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.450 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:21:05.496 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:21:05.497 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:21:05.497 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:21:05.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:21:05.551 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:21:05.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:21:05.552 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:05.601 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:21:05.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:21:05.602 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:05.648 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:21:05.697 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:21:05.698 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:21:05.698 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:21:05.698 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:21:05.698 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:21:05.699 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:21:05.699 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:21:05.699 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:21:05.699 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:21:05.699 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:21:05.700 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:21:05.700 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:21:05.700 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:21:05.700 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:21:05.700 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:21:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:21:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:21:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:21:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:21:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:21:05.702 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:21:05.702 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:21:05.702 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:21:05.702 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:21:05.702 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:21:05.703 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:21:05.703 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:21:05.703 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:21:05.703 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:21:05.703 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:05.704 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:05.704 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:05.704 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:05.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.706 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:21:05.753 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:21:05.754 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:21:05.797 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:21:05.804 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:21:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:21:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:21:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:21:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:21:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:21:05.806 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:21:05.806 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:21:05.806 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:21:05.806 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:21:05.806 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:21:05.807 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:21:05.807 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:21:05.807 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:21:05.807 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:21:05.807 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:21:05.808 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:21:05.808 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:21:05.808 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:21:05.808 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:21:05.808 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:21:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:21:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:21:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:21:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:21:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:21:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:21:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:21:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:21:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:05.811 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:05.811 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:05.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:05.812 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:21:05.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:21:05.887+0000 7f95614a3580 -1 init, newargv = 0x564ed419bfb0 newargc=15 2023-10-25T16:21:05.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52065]: starting ceph client 2023-10-25T16:21:05.891 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52065]: starting fuse 2023-10-25T16:21:06.962 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:21:06.971 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:21:06.972 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:21:06.972 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:21:06.972 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:21:06.972 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:21:06.972 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:21:06.973 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:21:06.973 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:21:06.973 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:21:06.973 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:21:06.973 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:21:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:21:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:21:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:21:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:21:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:21:06.974 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:21:06.975 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:21:06.975 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:21:06.975 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:21:06.975 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:21:06.975 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:21:06.976 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:21:06.976 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:21:06.976 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:21:06.976 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:21:06.976 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:21:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:21:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:21:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:21:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:21:06.978 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:06.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:06.979 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:21:07.024 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:21:07.025 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:21:07.025 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:21:07.026 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:21:07.026 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:21:07.027 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:21:07.027 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:21:07.028 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:07.028 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:21:07.028 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:21:07.029 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:21:07.029 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:21:07.029 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:07.030 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:21:07.030 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:21:07.031 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:21:07.031 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:21:07.031 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:07.032 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:21:07.032 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:21:07.032 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:21:07.033 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:21:07.033 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:21:07.034 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:21:07.034 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:21:07.034 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:21:07.035 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:07.035 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:21:07.035 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:21:07.153 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.52065.asok 2023-10-25T16:21:07.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:07.164 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52065.asok 2023-10-25T16:21:07.165 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:21:07.165 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.52065.asok status 2023-10-25T16:21:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:21:07.357 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:21:07.357 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:21:07.357 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:21:07.358 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:21:07.358 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:21:07.358 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:21:07.358 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:21:07.359 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "52065", 2023-10-25T16:21:07.359 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:21:07.359 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:21:07.359 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:21:07.359 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:21:07.360 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 8856, 2023-10-25T16:21:07.360 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:21:07.360 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:21:07.360 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:21:07.361 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 8856 2023-10-25T16:21:07.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:21:07.361 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:21:07.361 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:21:07.361 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:21:07.362 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1749160690 2023-10-25T16:21:07.362 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:21:07.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:21:07.362 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:21:07.363 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:21:07.363 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:21:07.363 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1749160690 2023-10-25T16:21:07.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:21:07.364 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.8856 192.168.0.1:0/1749160690", 2023-10-25T16:21:07.364 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1749160690", 2023-10-25T16:21:07.364 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:21:07.364 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 58, 2023-10-25T16:21:07.365 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 158, 2023-10-25T16:21:07.365 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:21:07.365 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:21:07.365 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:21:07.365 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:21:07.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:07.377 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:21:07.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:21:07.378 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:07.427 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:21:07.428 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:21:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:07.435 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:07.436 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:21:07.436 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:21:07.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:21:07.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:07.488 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:21:07.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 -- 172.21.15.177:0/2822477062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 msgr2=0x7f56bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:07.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 --2- 172.21.15.177:0/2822477062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56bc003da0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f56c400bb10 tx=0x7f56c401cd80 comp rx=0 tx=0).stop 2023-10-25T16:21:07.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 -- 172.21.15.177:0/2822477062 shutdown_connections 2023-10-25T16:21:07.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 --2- 172.21.15.177:0/2822477062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56bc003da0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 -- 172.21.15.177:0/2822477062 >> 172.21.15.177:0/2822477062 conn(0x7f56d40b2450 msgr2=0x7f56d40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:07.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 -- 172.21.15.177:0/2822477062 shutdown_connections 2023-10-25T16:21:07.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 -- 172.21.15.177:0/2822477062 wait complete. 2023-10-25T16:21:07.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 Processor -- start 2023-10-25T16:21:07.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.663+0000 7f56d897f640 1 -- start start 2023-10-25T16:21:07.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56d4152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:07.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56d415b5a0 0x7f56d4144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:07.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56d4155a80 0x7f56d4155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:07.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4153470 con 0x7f56bc003980 2023-10-25T16:21:07.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d4156440 con 0x7f56d415b5a0 2023-10-25T16:21:07.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d415ba20 con 0x7f56d4155a80 2023-10-25T16:21:07.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56d4152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:07.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56d4152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52302/0 (socket says 172.21.15.177:52302) 2023-10-25T16:21:07.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 -- 172.21.15.177:0/2280393848 learned_addr learned my addr 172.21.15.177:0/2280393848 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:07.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d1d9b640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56d415b5a0 0x7f56d4144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:07.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d2d9d640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56d4155a80 0x7f56d4155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:07.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 -- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56d4155a80 msgr2=0x7f56d4155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:07.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56d4155a80 0x7f56d4155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 -- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56d415b5a0 msgr2=0x7f56d4144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:07.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56d415b5a0 0x7f56d4144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 -- 172.21.15.177:0/2280393848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4154700 con 0x7f56bc003980 2023-10-25T16:21:07.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d259c640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56d4152f30 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f56c401cbb0 tx=0x7f56c40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:07.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4005040 con 0x7f56bc003980 2023-10-25T16:21:07.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56c4005290 con 0x7f56bc003980 2023-10-25T16:21:07.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d4153660 con 0x7f56bc003980 2023-10-25T16:21:07.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c40046d0 con 0x7f56bc003980 2023-10-25T16:21:07.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4153c20 con 0x7f56bc003980 2023-10-25T16:21:07.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d404daf0 con 0x7f56bc003980 2023-10-25T16:21:07.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f56c4004830 con 0x7f56bc003980 2023-10-25T16:21:07.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56c2ffd640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56b4066470 0x7f56b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:07.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c411ede0 con 0x7f56bc003980 2023-10-25T16:21:07.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d1d9b640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56b4066470 0x7f56b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:07.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.667+0000 7f56d1d9b640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56b4066470 0x7f56b4068930 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000fc0 tx=0x7f56c8006b50 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:07.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.671+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f56c40ec250 con 0x7f56bc003980 2023-10-25T16:21:07.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.859+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f56d4144e50 con 0x7f56bc003980 2023-10-25T16:21:07.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.859+0000 7f56c2ffd640 1 -- 172.21.15.177:0/2280393848 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f56c40ab060 con 0x7f56bc003980 2023-10-25T16:21:07.858 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:21:07.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56b4066470 msgr2=0x7f56b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56b4066470 0x7f56b4068930 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000fc0 tx=0x7f56c8006b50 comp rx=0 tx=0).stop 2023-10-25T16:21:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 msgr2=0x7f56d4152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56d4152f30 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f56c401cbb0 tx=0x7f56c40040c0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 shutdown_connections 2023-10-25T16:21:07.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f56b4066470 0x7f56b4068930 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56d4155a80 0x7f56d4155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56d415b5a0 0x7f56d4144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 --2- 172.21.15.177:0/2280393848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f56bc003980 0x7f56d4152f30 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:07.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 >> 172.21.15.177:0/2280393848 conn(0x7f56d40b2450 msgr2=0x7f56d4156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 shutdown_connections 2023-10-25T16:21:07.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:07.863+0000 7f56d897f640 1 -- 172.21.15.177:0/2280393848 wait complete. 2023-10-25T16:21:07.875 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:21:07.876 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:21:07.876 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:21:07.876 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:21:07.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:07.877 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:21:07.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:21:07.878 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:21:07.878 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:21:07.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:07.879 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:21:07.886 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:21:07.886 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:21:07.887 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:21:07.887 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.887 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:21:07.887 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.888 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:21:07.889 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:07.889 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:21:07.889 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:21:07.889 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:07.889 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:21:07.890 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:21:07.890 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:07.890 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:21:07.890 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:07.890 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:21:07.891 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42031sec preferred_lft 42031sec 2023-10-25T16:21:07.891 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:21:07.891 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.891 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:21:07.891 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:07.892 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:21:07.892 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.892 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:21:07.892 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:21:07.892 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:21:07.893 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.893 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:21:07.893 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.893 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:21:07.893 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:07.894 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:21:07.894 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.894 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:21:07.894 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:07.894 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:21:07.895 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:21:07.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:07.895 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:21:07.942 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:21:07.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:07.944 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:21:07.994 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:21:07.995 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:21:07.995 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:21:07.995 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:21:07.995 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:21:07.995 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:21:07.996 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:21:07.996 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:21:07.996 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:21:07.996 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:21:07.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:07.997 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:21:07.997 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:21:07.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:21:07.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:21:07.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:21:07.999 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:21:08.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:08.074 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:21:08.126 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:21:08.127 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:21:08.127 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:21:08.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:08.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:21:08.183 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:21:08.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:21:08.184 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:08.230 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:21:08.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:21:08.231 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:08.278 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:21:08.327 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:21:08.328 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:21:08.328 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:21:08.328 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:21:08.328 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:21:08.329 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:21:08.329 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:21:08.329 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:21:08.329 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:21:08.329 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:21:08.330 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:21:08.330 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:21:08.330 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:21:08.330 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:21:08.330 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:21:08.331 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:21:08.331 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:21:08.331 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:21:08.331 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:21:08.331 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:21:08.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:21:08.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:21:08.332 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:21:08.332 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:21:08.332 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:21:08.333 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:21:08.333 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:21:08.333 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:21:08.333 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:21:08.333 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:08.334 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:08.334 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:08.334 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:08.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:08.336 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:21:08.383 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:21:08.383 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:21:08.428 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:21:08.434 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:21:08.435 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:21:08.435 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:21:08.435 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:21:08.435 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:21:08.436 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:21:08.436 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:21:08.436 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:21:08.436 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:21:08.436 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:21:08.436 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:21:08.437 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:21:08.437 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:21:08.437 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:21:08.437 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:21:08.437 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:21:08.438 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:21:08.438 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:21:08.438 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:21:08.438 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:21:08.438 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:21:08.439 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:21:08.439 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:21:08.439 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:21:08.439 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:21:08.439 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:21:08.440 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:21:08.440 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:21:08.440 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:21:08.440 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:08.440 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:08.440 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:08.441 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:08.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:08.442 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:21:08.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:21:08.512+0000 7eff30f97580 -1 init, newargv = 0x55f0afa965a0 newargc=15 2023-10-25T16:21:08.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35332]: starting ceph client 2023-10-25T16:21:08.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35332]: starting fuse 2023-10-25T16:21:09.590 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:21:09.599 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:21:09.599 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:21:09.599 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:21:09.599 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:21:09.600 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:21:09.600 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:21:09.600 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:21:09.600 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:21:09.600 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:21:09.601 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:21:09.601 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:21:09.601 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:21:09.601 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:21:09.601 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:21:09.601 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:21:09.602 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:21:09.602 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:21:09.602 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:21:09.602 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:21:09.602 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:21:09.603 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:21:09.603 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:21:09.603 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:21:09.603 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:21:09.604 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:21:09.604 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:21:09.604 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:21:09.604 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:21:09.604 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:21:09.605 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:09.605 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:21:09.605 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:09.605 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:21:09.606 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:09.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:21:09.607 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:21:09.654 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:21:09.655 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:21:09.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:21:09.656 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:21:09.656 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:21:09.657 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:21:09.657 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:21:09.657 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:21:09.658 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:21:09.658 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:21:09.659 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:21:09.659 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:21:09.659 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:21:09.660 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:21:09.660 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:21:09.660 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:21:09.661 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:21:09.661 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:21:09.661 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:21:09.662 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:21:09.662 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:21:09.663 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:21:09.663 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:21:09.663 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:21:09.664 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:21:09.664 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:21:09.664 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:21:09.665 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:21:09.665 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:21:09.780 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.35332.asok 2023-10-25T16:21:09.783 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:09.791 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35332.asok 2023-10-25T16:21:09.792 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:21:09.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.35332.asok status 2023-10-25T16:21:09.882 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:21:09.983 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:21:09.983 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:21:09.984 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:21:09.984 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:21:09.984 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:21:09.984 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:21:09.985 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:21:09.985 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "35332", 2023-10-25T16:21:09.985 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:21:09.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:21:09.985 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:21:09.985 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:21:09.986 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 6817, 2023-10-25T16:21:09.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:21:09.986 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:21:09.986 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:21:09.986 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 6817 2023-10-25T16:21:09.987 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:21:09.987 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:21:09.987 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:21:09.987 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:21:09.987 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1943295314 2023-10-25T16:21:09.988 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:21:09.988 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:21:09.988 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:21:09.988 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:21:09.988 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:21:09.989 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1943295314 2023-10-25T16:21:09.989 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:21:09.989 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.6817 192.168.0.1:0/1943295314", 2023-10-25T16:21:09.989 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/1943295314", 2023-10-25T16:21:09.989 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:21:09.990 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 58, 2023-10-25T16:21:09.990 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 158, 2023-10-25T16:21:09.990 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:21:09.990 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:21:09.990 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:21:09.990 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:21:09.995 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:10.003 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:21:10.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:21:10.004 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:10.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:21:10.048 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:21:10.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:10.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:10.055 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:21:10.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:21:10.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:21:10.145 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:21:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:21:10.152 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:21:10.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2208334503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd050003980 msgr2=0x7fd050003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:10.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2208334503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd050003980 0x7fd050003d80 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fd058006fd0 tx=0x7fd05801cf90 comp rx=0 tx=0).stop 2023-10-25T16:21:10.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2208334503 shutdown_connections 2023-10-25T16:21:10.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2208334503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd050003980 0x7fd050003d80 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2208334503 >> 172.21.15.177:0/2208334503 conn(0x7fd0680b2450 msgr2=0x7fd0680b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2208334503 shutdown_connections 2023-10-25T16:21:10.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2208334503 wait complete. 2023-10-25T16:21:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 Processor -- start 2023-10-25T16:21:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- start start 2023-10-25T16:21:10.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd050003980 0x7fd0681f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd068151bb0 0x7fd068152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 0x7fd0681502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0681507f0 con 0x7fd06814fe30 2023-10-25T16:21:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0681531f0 con 0x7fd068151bb0 2023-10-25T16:21:10.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd068152670 con 0x7fd050003980 2023-10-25T16:21:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 0x7fd0681502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 0x7fd0681502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:52310/0 (socket says 172.21.15.177:52310) 2023-10-25T16:21:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 -- 172.21.15.177:0/2978361416 learned_addr learned my addr 172.21.15.177:0/2978361416 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd067fff640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd050003980 0x7fd0681f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:10.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd0677fe640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd068151bb0 0x7fd068152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 -- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd050003980 msgr2=0x7fd0681f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd050003980 0x7fd0681f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 -- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd068151bb0 msgr2=0x7fd068152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:10.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd068151bb0 0x7fd068152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 -- 172.21.15.177:0/2978361416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068152950 con 0x7fd06814fe30 2023-10-25T16:21:10.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd067fff640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd050003980 0x7fd0681f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:21:10.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06cdda640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 0x7fd0681502b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fd06806ffa0 tx=0x7fd06000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:10.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060011790 con 0x7fd06814fe30 2023-10-25T16:21:10.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd060011a00 con 0x7fd06814fe30 2023-10-25T16:21:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060011e10 con 0x7fd06814fe30 2023-10-25T16:21:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd068152c30 con 0x7fd06814fe30 2023-10-25T16:21:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.291+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0680ae870 con 0x7fd06814fe30 2023-10-25T16:21:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.295+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06804daf0 con 0x7fd06814fe30 2023-10-25T16:21:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.295+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd06001c460 con 0x7fd06814fe30 2023-10-25T16:21:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.295+0000 7fd064ff9640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0540664a0 0x7fd054068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.295+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd060083e70 con 0x7fd06814fe30 2023-10-25T16:21:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.295+0000 7fd067fff640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0540664a0 0x7fd054068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.295+0000 7fd067fff640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0540664a0 0x7fd054068960 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ac000 tx=0x7fd058019d30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.299+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0600512f0 con 0x7fd06814fe30 2023-10-25T16:21:10.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.487+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd068155310 con 0x7fd06814fe30 2023-10-25T16:21:10.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.487+0000 7fd064ff9640 1 -- 172.21.15.177:0/2978361416 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7fd060054910 con 0x7fd06814fe30 2023-10-25T16:21:10.487 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:21:10.487 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:21:10.490 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:21:10.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0540664a0 msgr2=0x7fd054068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:10.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0540664a0 0x7fd054068960 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd0580ac000 tx=0x7fd058019d30 comp rx=0 tx=0).stop 2023-10-25T16:21:10.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 msgr2=0x7fd0681502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:10.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 0x7fd0681502b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fd06806ffa0 tx=0x7fd06000c800 comp rx=0 tx=0).stop 2023-10-25T16:21:10.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 shutdown_connections 2023-10-25T16:21:10.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0540664a0 0x7fd054068960 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd06814fe30 0x7fd0681502b0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd068151bb0 0x7fd068152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 --2- 172.21.15.177:0/2978361416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd050003980 0x7fd0681f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:10.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 >> 172.21.15.177:0/2978361416 conn(0x7fd0680b2450 msgr2=0x7fd068154760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:10.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 shutdown_connections 2023-10-25T16:21:10.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.491+0000 7fd06e83d640 1 -- 172.21.15.177:0/2978361416 wait complete. 2023-10-25T16:21:10.504 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-10-25T16:21:10.652 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":155948,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.864447655999999,"mdsmap_epoch":58,"osdmap_epoch":158,"osdmap_epoch_barrier":158,"uptime":19.755789028999999} 2023-10-25T16:21:10.652 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 155948, "mdsmap_epoch": 58, "osdmap_epoch": 158, "osdmap_epoch_barrier": 158, "rank_uptime": 14.864447656, "state": "up:active", "uptime": 19.755789029, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:21:10.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-25T16:21:10.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/3463675996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe300003fe0 msgr2=0x7fe3000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 --2- 172.21.15.177:0/3463675996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe300003fe0 0x7fe3000047d0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe30400aea0 tx=0x7fe30401d080 comp rx=0 tx=0).stop 2023-10-25T16:21:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3137fe640 1 -- 172.21.15.177:0/3463675996 reap_dead start 2023-10-25T16:21:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/3463675996 shutdown_connections 2023-10-25T16:21:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/3463675996 >> 172.21.15.177:0/3463675996 conn(0x7fe314069920 msgr2=0x7fe314069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:11.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/3463675996 shutdown_connections 2023-10-25T16:21:11.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/3463675996 wait complete. 2023-10-25T16:21:11.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 Processor -- start 2023-10-25T16:21:11.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- start start 2023-10-25T16:21:11.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe300003fe0 0x7fe3140ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:11.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 0x7fe314148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3141563a0 0x7fe314148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140c6480 con 0x7fe314155f40 2023-10-25T16:21:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140aef50 con 0x7fe300003fe0 2023-10-25T16:21:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140af230 con 0x7fe3141563a0 2023-10-25T16:21:11.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 0x7fe314148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:11.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 0x7fe314148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58664/0 (socket says 172.21.15.177:58664) 2023-10-25T16:21:11.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 -- 172.21.15.177:0/4062910312 learned_addr learned my addr 172.21.15.177:0/4062910312 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:21:11.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe312ffd640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe300003fe0 0x7fe3140ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:11.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3137fe640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3141563a0 0x7fe314148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:11.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 -- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3141563a0 msgr2=0x7fe314148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:11.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3141563a0 0x7fe314148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:11.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 -- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe300003fe0 msgr2=0x7fe3140ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe300003fe0 0x7fe3140ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 -- 172.21.15.177:0/4062910312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140af510 con 0x7fe314155f40 2023-10-25T16:21:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe3127fc640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 0x7fe314148610 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe30400adc0 tx=0x7fe3040aca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040bc070 con 0x7fe314155f40 2023-10-25T16:21:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe3040b6700 con 0x7fe314155f40 2023-10-25T16:21:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3140af7f0 con 0x7fe314155f40 2023-10-25T16:21:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040b6b10 con 0x7fe314155f40 2023-10-25T16:21:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.791+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3140acf00 con 0x7fe314155f40 2023-10-25T16:21:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.795+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3140cc460 con 0x7fe314155f40 2023-10-25T16:21:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.795+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3040b6c70 con 0x7fe314155f40 2023-10-25T16:21:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.795+0000 7fe30b7fe640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:21:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.795+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe30411ed30 con 0x7fe314155f40 2023-10-25T16:21:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.795+0000 7fe312ffd640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:21:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.795+0000 7fe312ffd640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0017b0 tx=0x7fe30c000f00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:21:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.799+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3040ec1b0 con 0x7fe314155f40 2023-10-25T16:21:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:10.955+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fe314073360 con 0x7fe314155f40 2023-10-25T16:21:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.871+0000 7fe30b7fe640 1 -- 172.21.15.177:0/4062910312 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v159) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe3040b1020 con 0x7fe314155f40 2023-10-25T16:21:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-25T16:21:11.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 msgr2=0x7fe2f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:11.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0017b0 tx=0x7fe30c000f00 comp rx=0 tx=0).stop 2023-10-25T16:21:11.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 msgr2=0x7fe314148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:21:11.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 0x7fe314148610 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe30400adc0 tx=0x7fe3040aca20 comp rx=0 tx=0).stop 2023-10-25T16:21:11.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 shutdown_connections 2023-10-25T16:21:11.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:11.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3141563a0 0x7fe314148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:11.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314155f40 0x7fe314148610 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:11.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 --2- 172.21.15.177:0/4062910312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe300003fe0 0x7fe3140ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:21:11.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 >> 172.21.15.177:0/4062910312 conn(0x7fe314069920 msgr2=0x7fe3140b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:21:11.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 shutdown_connections 2023-10-25T16:21:11.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:21:11.875+0000 7fe31958a640 1 -- 172.21.15.177:0/4062910312 wait complete. 2023-10-25T16:21:11.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:21:12.034 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:21:12.034 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:21:12.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-25T16:21:12.162 INFO:teuthology.orchestra.run.smithi177.stdout:{"mon_tick_interval":"5"} 2023-10-25T16:21:12.163 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-25T16:21:12.163 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-25T16:21:12.163 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:21:12.164 DEBUG:teuthology.orchestra.run.smithi177:> import time 2023-10-25T16:21:12.164 DEBUG:teuthology.orchestra.run.smithi177:> import datetime 2023-10-25T16:21:12.164 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:21:12.165 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:21:12.165 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.165 DEBUG:teuthology.orchestra.run.smithi177:> # Write some buffered data through before going full, all should be well 2023-10-25T16:21:12.166 DEBUG:teuthology.orchestra.run.smithi177:> print("writing some data through which we expect to succeed") 2023-10-25T16:21:12.166 DEBUG:teuthology.orchestra.run.smithi177:> bytes = 0 2023-10-25T16:21:12.166 DEBUG:teuthology.orchestra.run.smithi177:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-25T16:21:12.167 DEBUG:teuthology.orchestra.run.smithi177:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-25T16:21:12.167 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-10-25T16:21:12.167 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:21:12.168 DEBUG:teuthology.orchestra.run.smithi177:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-25T16:21:12.168 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.168 DEBUG:teuthology.orchestra.run.smithi177:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-25T16:21:12.169 DEBUG:teuthology.orchestra.run.smithi177:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-25T16:21:12.169 DEBUG:teuthology.orchestra.run.smithi177:> # buffered IO, the error should always only appear from fsync and not 2023-10-25T16:21:12.170 DEBUG:teuthology.orchestra.run.smithi177:> # from write 2023-10-25T16:21:12.170 DEBUG:teuthology.orchestra.run.smithi177:> full = False 2023-10-25T16:21:12.170 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.171 DEBUG:teuthology.orchestra.run.smithi177:> for n in range(0, int(32 * 0.9)): 2023-10-25T16:21:12.171 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-25T16:21:12.171 DEBUG:teuthology.orchestra.run.smithi177:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-10-25T16:21:12.172 DEBUG:teuthology.orchestra.run.smithi177:> print("done writing {0} bytes".format(bytes)) 2023-10-25T16:21:12.172 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.172 DEBUG:teuthology.orchestra.run.smithi177:> # OK, now we should sneak in under the full condition 2023-10-25T16:21:12.173 DEBUG:teuthology.orchestra.run.smithi177:> # due to the time it takes the OSDs to report to the 2023-10-25T16:21:12.173 DEBUG:teuthology.orchestra.run.smithi177:> # mons, and get a successful fsync on our full-making data 2023-10-25T16:21:12.173 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:21:12.174 DEBUG:teuthology.orchestra.run.smithi177:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-10-25T16:21:12.174 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.174 DEBUG:teuthology.orchestra.run.smithi177:> # buffered write, add more dirty data to the buffer 2023-10-25T16:21:12.175 DEBUG:teuthology.orchestra.run.smithi177:> print("starting buffered write") 2023-10-25T16:21:12.175 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:21:12.175 DEBUG:teuthology.orchestra.run.smithi177:> for n in range(0, int(32 * 0.2)): 2023-10-25T16:21:12.176 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-25T16:21:12.176 DEBUG:teuthology.orchestra.run.smithi177:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-25T16:21:12.176 DEBUG:teuthology.orchestra.run.smithi177:> time.sleep(15.0) 2023-10-25T16:21:12.177 DEBUG:teuthology.orchestra.run.smithi177:> except OSError: 2023-10-25T16:21:12.177 DEBUG:teuthology.orchestra.run.smithi177:> pass; 2023-10-25T16:21:12.177 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.178 DEBUG:teuthology.orchestra.run.smithi177:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-10-25T16:21:12.178 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.178 DEBUG:teuthology.orchestra.run.smithi177:> # Wait long enough for a background flush that should fail 2023-10-25T16:21:12.179 DEBUG:teuthology.orchestra.run.smithi177:> time.sleep(30) 2023-10-25T16:21:12.179 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.179 DEBUG:teuthology.orchestra.run.smithi177:> if True: 2023-10-25T16:21:12.180 DEBUG:teuthology.orchestra.run.smithi177:> # ...and check that the failed background flush is reflected in fclose 2023-10-25T16:21:12.180 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:21:12.180 DEBUG:teuthology.orchestra.run.smithi177:> os.close(f) 2023-10-25T16:21:12.181 DEBUG:teuthology.orchestra.run.smithi177:> except OSError: 2023-10-25T16:21:12.181 DEBUG:teuthology.orchestra.run.smithi177:> print("close() returned an error as expected") 2023-10-25T16:21:12.181 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:21:12.182 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("close() failed to raise error") 2023-10-25T16:21:12.182 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:21:12.182 DEBUG:teuthology.orchestra.run.smithi177:> # The kernel cephfs client does not raise errors on fclose 2023-10-25T16:21:12.183 DEBUG:teuthology.orchestra.run.smithi177:> os.close(f) 2023-10-25T16:21:12.183 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:21:12.183 DEBUG:teuthology.orchestra.run.smithi177:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-25T16:21:12.184 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:21:31.999 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:21:32.002 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:22:02.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:22:02.132 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:22:32.236 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:22:32.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:23:01.175 INFO:teuthology.orchestra.run.smithi177.stdout:writing some data through which we expect to succeed 2023-10-25T16:23:01.175 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-25T16:23:01.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-10-25T16:23:01.175 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-10-25T16:23:01.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-10-25T16:23:01.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-10-25T16:23:01.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-10-25T16:23:01.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-10-25T16:23:01.176 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-10-25T16:23:01.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-10-25T16:23:01.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-10-25T16:23:01.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-10-25T16:23:01.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-10-25T16:23:01.177 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-10-25T16:23:01.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-10-25T16:23:01.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-10-25T16:23:01.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-10-25T16:23:01.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-10-25T16:23:01.178 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-10-25T16:23:01.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-10-25T16:23:01.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-10-25T16:23:01.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-10-25T16:23:01.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-10-25T16:23:01.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-10-25T16:23:01.179 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-10-25T16:23:01.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-10-25T16:23:01.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-10-25T16:23:01.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-10-25T16:23:01.180 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-10-25T16:23:01.181 INFO:teuthology.orchestra.run.smithi177.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-10-25T16:23:01.181 INFO:teuthology.orchestra.run.smithi177.stdout:done writing 29884416 bytes 2023-10-25T16:23:01.181 INFO:teuthology.orchestra.run.smithi177.stdout:successfully fsync'ed prior to getting full state reported 2023-10-25T16:23:01.181 INFO:teuthology.orchestra.run.smithi177.stdout:starting buffered write 2023-10-25T16:23:01.181 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:23:01.181 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:23:01.182 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:23:01.182 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:23:01.182 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:23:01.182 INFO:teuthology.orchestra.run.smithi177.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-10-25T16:23:01.182 INFO:teuthology.orchestra.run.smithi177.stdout:close() returned an error as expected 2023-10-25T16:23:01.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:01.197 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:23:01.198 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:23:01.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:23:01.284 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:23:01.284 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:23:01.285 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:01.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:01.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.464+0000 7f3179225640 1 -- 172.21.15.177:0/539633432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 msgr2=0x7f317406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.464+0000 7f3179225640 1 --2- 172.21.15.177:0/539633432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f317406b9e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f31680098f0 tx=0x7f316801c730 comp rx=0 tx=0).stop 2023-10-25T16:23:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- 172.21.15.177:0/539633432 shutdown_connections 2023-10-25T16:23:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 --2- 172.21.15.177:0/539633432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f317406b9e0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- 172.21.15.177:0/539633432 >> 172.21.15.177:0/539633432 conn(0x7f31740b2450 msgr2=0x7f31740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:01.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- 172.21.15.177:0/539633432 shutdown_connections 2023-10-25T16:23:01.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- 172.21.15.177:0/539633432 wait complete. 2023-10-25T16:23:01.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 Processor -- start 2023-10-25T16:23:01.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- start start 2023-10-25T16:23:01.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31740c9910 0x7f31741488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f3174155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317415b480 0x7f31741f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317415d4d0 con 0x7f31740cb5f0 2023-10-25T16:23:01.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3174151400 con 0x7f317415b480 2023-10-25T16:23:01.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31741f6240 con 0x7f31740c9910 2023-10-25T16:23:01.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f3174155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f3174155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35444/0 (socket says 172.21.15.177:35444) 2023-10-25T16:23:01.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 -- 172.21.15.177:0/3216857993 learned_addr learned my addr 172.21.15.177:0/3216857993 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:01.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317359e640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317415b480 0x7f31741f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 -- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31740c9910 msgr2=0x7f31741488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3172d9d640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31740c9910 0x7f31741488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31740c9910 0x7f31741488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 -- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317415b480 msgr2=0x7f31741f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317415b480 0x7f31741f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 -- 172.21.15.177:0/3216857993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168009500 con 0x7f31740cb5f0 2023-10-25T16:23:01.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317359e640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317415b480 0x7f31741f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:01.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f317259c640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f3174155b30 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f3168000c10 tx=0x7f31680a6780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:01.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168004340 con 0x7f31740cb5f0 2023-10-25T16:23:01.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3168003600 con 0x7f31740cb5f0 2023-10-25T16:23:01.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168003a10 con 0x7f31740cb5f0 2023-10-25T16:23:01.471 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3174150e40 con 0x7f31740cb5f0 2023-10-25T16:23:01.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.468+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317415d700 con 0x7f31740cb5f0 2023-10-25T16:23:01.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317415d8f0 con 0x7f31740cb5f0 2023-10-25T16:23:01.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3168003b70 con 0x7f31740cb5f0 2023-10-25T16:23:01.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f315b7fe640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3160066470 0x7f3160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f31680aa070 con 0x7f31740cb5f0 2023-10-25T16:23:01.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f316006e060 con 0x7f31740cb5f0 2023-10-25T16:23:01.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f3172d9d640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3160066470 0x7f3160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.472+0000 7f3172d9d640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3160066470 0x7f3160068930 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f31640012f0 tx=0x7f3164009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:01.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.476+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31680be070 con 0x7f31740cb5f0 2023-10-25T16:23:01.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.632+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f317404daf0 con 0x7f31740cb5f0 2023-10-25T16:23:01.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.636+0000 7f315b7fe640 1 -- 172.21.15.177:0/3216857993 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16726 (secure 0 0 0) 0x7f316811f030 con 0x7f31740cb5f0 2023-10-25T16:23:01.633 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:01.634 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":162,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:22:12.760090+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:01.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3160066470 msgr2=0x7f3160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3160066470 0x7f3160068930 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f31640012f0 tx=0x7f3164009040 comp rx=0 tx=0).stop 2023-10-25T16:23:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 msgr2=0x7f3174155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f3174155b30 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f3168000c10 tx=0x7f31680a6780 comp rx=0 tx=0).stop 2023-10-25T16:23:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 shutdown_connections 2023-10-25T16:23:01.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3160066470 0x7f3160068930 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317415b480 0x7f31741f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31740cb5f0 0x7f3174155b30 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 --2- 172.21.15.177:0/3216857993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31740c9910 0x7f31741488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 >> 172.21.15.177:0/3216857993 conn(0x7f31740b2450 msgr2=0x7f3174070400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:01.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 shutdown_connections 2023-10-25T16:23:01.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.640+0000 7f3179225640 1 -- 172.21.15.177:0/3216857993 wait complete. 2023-10-25T16:23:01.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:20:53.275247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:20:54.087392+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:23:01.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:23:01.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/3286871998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c1537d0 msgr2=0x7f313c0caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 --2- 172.21.15.177:0/3286871998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c1537d0 0x7f313c0caf90 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f312c009900 tx=0x7f312c01c850 comp rx=0 tx=0).stop 2023-10-25T16:23:01.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/3286871998 shutdown_connections 2023-10-25T16:23:01.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 --2- 172.21.15.177:0/3286871998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c06b9e0 0x7f313c06be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 --2- 172.21.15.177:0/3286871998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c1537d0 0x7f313c0caf90 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/3286871998 >> 172.21.15.177:0/3286871998 conn(0x7f313c0b2450 msgr2=0x7f313c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:01.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/3286871998 shutdown_connections 2023-10-25T16:23:01.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/3286871998 wait complete. 2023-10-25T16:23:01.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 Processor -- start 2023-10-25T16:23:01.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- start start 2023-10-25T16:23:01.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 0x7f313c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f313c1537d0 0x7f313c15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c15cdd0 0x7f313c15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c12e7a0 con 0x7f313c06b9e0 2023-10-25T16:23:01.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0ae940 con 0x7f313c1537d0 2023-10-25T16:23:01.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0aebc0 con 0x7f313c15cdd0 2023-10-25T16:23:01.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 0x7f313c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 0x7f313c0ace70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35466/0 (socket says 172.21.15.177:35466) 2023-10-25T16:23:01.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 -- 172.21.15.177:0/2947434922 learned_addr learned my addr 172.21.15.177:0/2947434922 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:01.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313b7fe640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f313c1537d0 0x7f313c15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3140ee4640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c15cdd0 0x7f313c15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 -- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c15cdd0 msgr2=0x7f313c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c15cdd0 0x7f313c15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 -- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f313c1537d0 msgr2=0x7f313c15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f313c1537d0 0x7f313c15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 -- 172.21.15.177:0/2947434922 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c009560 con 0x7f313c06b9e0 2023-10-25T16:23:01.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3140ee4640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c15cdd0 0x7f313c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:01.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313b7fe640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f313c1537d0 0x7f313c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:01.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f313bfff640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 0x7f313c0ace70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f312c009850 tx=0x7f312c0a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:01.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c005230 con 0x7f313c06b9e0 2023-10-25T16:23:01.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f312c005480 con 0x7f313c06b9e0 2023-10-25T16:23:01.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c0aeea0 con 0x7f313c06b9e0 2023-10-25T16:23:01.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c004930 con 0x7f313c06b9e0 2023-10-25T16:23:01.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.784+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c0af460 con 0x7f313c06b9e0 2023-10-25T16:23:01.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c04daf0 con 0x7f313c06b9e0 2023-10-25T16:23:01.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f312c0b4070 con 0x7f313c06b9e0 2023-10-25T16:23:01.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f3138ff9640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3128066470 0x7f3128068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:01.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f312c11e3d0 con 0x7f313c06b9e0 2023-10-25T16:23:01.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f312806e060 con 0x7f313c06b9e0 2023-10-25T16:23:01.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f313b7fe640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3128066470 0x7f3128068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:01.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.788+0000 7f313b7fe640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3128066470 0x7f3128068930 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f313c12b610 tx=0x7f3130009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:01.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.792+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f312c0eb8a0 con 0x7f313c06b9e0 2023-10-25T16:23:01.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.944+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f313c04daf0 con 0x7f313c06b9e0 2023-10-25T16:23:01.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3138ff9640 1 -- 172.21.15.177:0/2947434922 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f312c0b2020 con 0x7f313c06b9e0 2023-10-25T16:23:01.944 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:23:01.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3128066470 msgr2=0x7f3128068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3128066470 0x7f3128068930 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f313c12b610 tx=0x7f3130009040 comp rx=0 tx=0).stop 2023-10-25T16:23:01.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 msgr2=0x7f313c0ace70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:01.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 0x7f313c0ace70 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f312c009850 tx=0x7f312c0a56d0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 shutdown_connections 2023-10-25T16:23:01.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3128066470 0x7f3128068930 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f313c15cdd0 0x7f313c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f313c1537d0 0x7f313c15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 --2- 172.21.15.177:0/2947434922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f313c06b9e0 0x7f313c0ace70 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:01.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 >> 172.21.15.177:0/2947434922 conn(0x7f313c0b2450 msgr2=0x7f313c15b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:01.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 shutdown_connections 2023-10-25T16:23:01.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:01.948+0000 7f3142947640 1 -- 172.21.15.177:0/2947434922 wait complete. 2023-10-25T16:23:01.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:23:02.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- 172.21.15.177:0/3375906154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f463806fd80 msgr2=0x7f46380cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 --2- 172.21.15.177:0/3375906154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f463806fd80 0x7f46380cc830 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f4630009930 tx=0x7f463001c880 comp rx=0 tx=0).stop 2023-10-25T16:23:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- 172.21.15.177:0/3375906154 shutdown_connections 2023-10-25T16:23:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 --2- 172.21.15.177:0/3375906154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f463806fd80 0x7f46380cc830 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- 172.21.15.177:0/3375906154 >> 172.21.15.177:0/3375906154 conn(0x7f46380af3f0 msgr2=0x7f46380af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- 172.21.15.177:0/3375906154 shutdown_connections 2023-10-25T16:23:02.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- 172.21.15.177:0/3375906154 wait complete. 2023-10-25T16:23:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 Processor -- start 2023-10-25T16:23:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- start start 2023-10-25T16:23:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f463806fd80 0x7f463814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 0x7f4638149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f463814eb40 0x7f4638142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380b16e0 con 0x7f46380accf0 2023-10-25T16:23:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463814fc80 con 0x7f463814eb40 2023-10-25T16:23:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f463d27e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463814ab50 con 0x7f463806fd80 2023-10-25T16:23:02.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 0x7f4638149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 0x7f4638149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35490/0 (socket says 172.21.15.177:35490) 2023-10-25T16:23:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 -- 172.21.15.177:0/3992785491 learned_addr learned my addr 172.21.15.177:0/3992785491 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46377fe640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f463814eb40 0x7f4638142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f4636ffd640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f463806fd80 0x7f463814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 -- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f463806fd80 msgr2=0x7f463814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f463806fd80 0x7f463814a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 -- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f463814eb40 msgr2=0x7f4638142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f463814eb40 0x7f4638142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.096+0000 7f46367fc640 1 -- 172.21.15.177:0/3992785491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009560 con 0x7f46380accf0 2023-10-25T16:23:02.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f46367fc640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 0x7f4638149580 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f462000c4d0 tx=0x7f462000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:02.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200052d0 con 0x7f46380accf0 2023-10-25T16:23:02.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4620005430 con 0x7f46380accf0 2023-10-25T16:23:02.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463814ae30 con 0x7f46380accf0 2023-10-25T16:23:02.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620012890 con 0x7f46380accf0 2023-10-25T16:23:02.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463814b3f0 con 0x7f46380accf0 2023-10-25T16:23:02.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4620003600 con 0x7f46380accf0 2023-10-25T16:23:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380b1440 con 0x7f46380accf0 2023-10-25T16:23:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4618066470 0x7f4618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4620083ae0 con 0x7f46380accf0 2023-10-25T16:23:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f461806e060 con 0x7f46380accf0 2023-10-25T16:23:02.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f4636ffd640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4618066470 0x7f4618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.100+0000 7f4636ffd640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4618066470 0x7f4618068930 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f46300af000 tx=0x7f463001b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:02.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.104+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46380b1440 con 0x7f46380accf0 2023-10-25T16:23:02.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.244+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46380b1820 con 0x7f46380accf0 2023-10-25T16:23:02.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.244+0000 7f462f7fe640 1 -- 172.21.15.177:0/3992785491 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46380b1820 con 0x7f46380accf0 2023-10-25T16:23:02.242 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:23:02.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4618066470 msgr2=0x7f4618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4618066470 0x7f4618068930 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f46300af000 tx=0x7f463001b0c0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 msgr2=0x7f4638149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 0x7f4638149580 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f462000c4d0 tx=0x7f462000c990 comp rx=0 tx=0).stop 2023-10-25T16:23:02.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 shutdown_connections 2023-10-25T16:23:02.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4618066470 0x7f4618068930 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f463814eb40 0x7f4638142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46380accf0 0x7f4638149580 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 --2- 172.21.15.177:0/3992785491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f463806fd80 0x7f463814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 >> 172.21.15.177:0/3992785491 conn(0x7f46380af3f0 msgr2=0x7f463814d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 shutdown_connections 2023-10-25T16:23:02.246 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.248+0000 7f463d27e640 1 -- 172.21.15.177:0/3992785491 wait complete. 2023-10-25T16:23:02.260 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:23:02.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/94171312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0aebc0 msgr2=0x7f44ac0af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/94171312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0aebc0 0x7f44ac0af010 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0c9b20 tx=0x7f44a401c8a0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/94171312 shutdown_connections 2023-10-25T16:23:02.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/94171312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0aebc0 0x7f44ac0af010 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/94171312 >> v2:172.21.15.184:3300/0 conn(0x7f44ac0cbfa0 0x7f44ac06b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/94171312 >> 172.21.15.177:0/94171312 conn(0x7f44ac0b2450 msgr2=0x7f44ac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:02.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/94171312 shutdown_connections 2023-10-25T16:23:02.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/94171312 wait complete. 2023-10-25T16:23:02.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 Processor -- start 2023-10-25T16:23:02.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- start start 2023-10-25T16:23:02.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44ac0aebc0 0x7f44ac152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 0x7f44ac14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44ac14e810 0x7f44ac146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac149c30 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac14cb10 con 0x7f44ac14e810 2023-10-25T16:23:02.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac14f410 con 0x7f44ac0aebc0 2023-10-25T16:23:02.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 0x7f44ac14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 0x7f44ac14eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35514/0 (socket says 172.21.15.177:35514) 2023-10-25T16:23:02.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 -- 172.21.15.177:0/440131549 learned_addr learned my addr 172.21.15.177:0/440131549 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:02.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 -- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44ac0aebc0 msgr2=0x7f44ac152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44ac0aebc0 0x7f44ac152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 -- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44ac14e810 msgr2=0x7f44ac146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44ac14e810 0x7f44ac146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 -- 172.21.15.177:0/440131549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009560 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44aaffd640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 0x7f44ac14eed0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f449400d980 tx=0x7f449400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:02.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494009c30 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4494009e80 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac14f640 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940106a0 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.392+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac14a100 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac04daf0 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4494010800 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44a3fff640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f448c066470 0x7f448c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4494084450 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f448c06e060 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44ab7fe640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f448c066470 0x7f448c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.396+0000 7f44ab7fe640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f448c066470 0x7f448c068930 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f449c007fd0 tx=0x7f449c007d40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:02.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.400+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4494017060 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44ac147350 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44a3fff640 1 -- 172.21.15.177:0/440131549 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4494021070 con 0x7f44ac0cbfa0 2023-10-25T16:23:02.548 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:23:02.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f448c066470 msgr2=0x7f448c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f448c066470 0x7f448c068930 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f449c007fd0 tx=0x7f449c007d40 comp rx=0 tx=0).stop 2023-10-25T16:23:02.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 msgr2=0x7f44ac14eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 0x7f44ac14eed0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f449400d980 tx=0x7f449400de40 comp rx=0 tx=0).stop 2023-10-25T16:23:02.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 shutdown_connections 2023-10-25T16:23:02.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f448c066470 0x7f448c068930 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44ac14e810 0x7f44ac146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44ac0cbfa0 0x7f44ac14eed0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 --2- 172.21.15.177:0/440131549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f44ac0aebc0 0x7f44ac152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 >> 172.21.15.177:0/440131549 conn(0x7f44ac0b2450 msgr2=0x7f44ac0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:02.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 shutdown_connections 2023-10-25T16:23:02.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.552+0000 7f44b1e0f640 1 -- 172.21.15.177:0/440131549 wait complete. 2023-10-25T16:23:02.566 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:23:02.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:23:02.617 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:23:02.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.680+0000 7f1691a01640 1 -- 172.21.15.177:0/741808745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c15eba0 msgr2=0x7f168c0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.680+0000 7f1691a01640 1 --2- 172.21.15.177:0/741808745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c15eba0 0x7f168c0b4100 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f167c009900 tx=0x7f167c01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.680+0000 7f1691a01640 1 -- 172.21.15.177:0/741808745 shutdown_connections 2023-10-25T16:23:02.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.680+0000 7f1691a01640 1 --2- 172.21.15.177:0/741808745 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c15eba0 0x7f168c0b4100 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.680+0000 7f1691a01640 1 -- 172.21.15.177:0/741808745 >> 172.21.15.177:0/741808745 conn(0x7f168c09a5c0 msgr2=0x7f168c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:02.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- 172.21.15.177:0/741808745 shutdown_connections 2023-10-25T16:23:02.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- 172.21.15.177:0/741808745 wait complete. 2023-10-25T16:23:02.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 Processor -- start 2023-10-25T16:23:02.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- start start 2023-10-25T16:23:02.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c0b2120 0x7f168c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 0x7f168c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c15eba0 0x7f168c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c56b0 con 0x7f168c0cdb10 2023-10-25T16:23:02.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c5990 con 0x7f168c15eba0 2023-10-25T16:23:02.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c5c70 con 0x7f168c0b2120 2023-10-25T16:23:02.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 0x7f168c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 0x7f168c0c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35534/0 (socket says 172.21.15.177:35534) 2023-10-25T16:23:02.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 -- 172.21.15.177:0/2709281703 learned_addr learned my addr 172.21.15.177:0/2709281703 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:02.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168b7fe640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c15eba0 0x7f168c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 -- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c0b2120 msgr2=0x7f168c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c0b2120 0x7f168c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 -- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c15eba0 msgr2=0x7f168c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c15eba0 0x7f168c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 -- 172.21.15.177:0/2709281703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c009560 con 0x7f168c0cdb10 2023-10-25T16:23:02.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f168a7fc640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 0x7f168c0c4c60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f167400c4d0 tx=0x7f167400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:02.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674005480 con 0x7f168c0cdb10 2023-10-25T16:23:02.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f16740036f0 con 0x7f168c0cdb10 2023-10-25T16:23:02.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674003b00 con 0x7f168c0cdb10 2023-10-25T16:23:02.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c0c5f50 con 0x7f168c0cdb10 2023-10-25T16:23:02.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.684+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c151450 con 0x7f168c0cdb10 2023-10-25T16:23:02.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c04daf0 con 0x7f168c0cdb10 2023-10-25T16:23:02.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1674003c60 con 0x7f168c0cdb10 2023-10-25T16:23:02.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f1683fff640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f166c066470 0x7f166c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:02.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1674083760 con 0x7f168c0cdb10 2023-10-25T16:23:02.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f166c06e060 con 0x7f168c0cdb10 2023-10-25T16:23:02.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f168affd640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f166c066470 0x7f166c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:02.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.688+0000 7f168affd640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f166c066470 0x7f166c068930 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f167c0af000 tx=0x7f167c019590 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:02.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.692+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1674017070 con 0x7f168c0cdb10 2023-10-25T16:23:02.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f168c0c6400 con 0x7f168c0cdb10 2023-10-25T16:23:02.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1683fff640 1 -- 172.21.15.177:0/2709281703 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v162) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1674050c60 con 0x7f168c0cdb10 2023-10-25T16:23:02.849 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:23:02.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f166c066470 msgr2=0x7f166c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f166c066470 0x7f166c068930 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f167c0af000 tx=0x7f167c019590 comp rx=0 tx=0).stop 2023-10-25T16:23:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 msgr2=0x7f168c0c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 0x7f168c0c4c60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f167400c4d0 tx=0x7f167400c990 comp rx=0 tx=0).stop 2023-10-25T16:23:02.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 shutdown_connections 2023-10-25T16:23:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f166c066470 0x7f166c068930 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c15eba0 0x7f168c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f168c0cdb10 0x7f168c0c4c60 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 --2- 172.21.15.177:0/2709281703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c0b2120 0x7f168c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:02.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 >> 172.21.15.177:0/2709281703 conn(0x7f168c09a5c0 msgr2=0x7f168c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:02.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 shutdown_connections 2023-10-25T16:23:02.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02.852+0000 7f1691a01640 1 -- 172.21.15.177:0/2709281703 wait complete. 2023-10-25T16:23:02.866 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:23:02.866 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:02.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:02.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:02.948 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[52065]: fuse finished with error 0 and tester_r 0 2023-10-25T16:23:02.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:02.955 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:23:02.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:02.956 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:23:02.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:23:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:02.974 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:23:02.974 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:02.981 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:03.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 -- 172.21.15.177:0/3532466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 msgr2=0x7f22f806e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 --2- 172.21.15.177:0/3532466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f806e030 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009c80 tx=0x7f22f001cd80 comp rx=0 tx=0).stop 2023-10-25T16:23:03.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 -- 172.21.15.177:0/3532466622 shutdown_connections 2023-10-25T16:23:03.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 --2- 172.21.15.177:0/3532466622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f806e030 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 --2- 172.21.15.177:0/3532466622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f813b0d0 0x7f22f806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 -- 172.21.15.177:0/3532466622 >> 172.21.15.177:0/3532466622 conn(0x7f22f80afe20 msgr2=0x7f22f80b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:03.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 -- 172.21.15.177:0/3532466622 shutdown_connections 2023-10-25T16:23:03.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.132+0000 7f22ffa13640 1 -- 172.21.15.177:0/3532466622 wait complete. 2023-10-25T16:23:03.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 Processor -- start 2023-10-25T16:23:03.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- start start 2023-10-25T16:23:03.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f806cc60 0x7f22f81571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f813b0d0 0x7f22f8133c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f8134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8131f20 con 0x7f22f815c400 2023-10-25T16:23:03.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8132200 con 0x7f22f813b0d0 2023-10-25T16:23:03.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f81324e0 con 0x7f22f806cc60 2023-10-25T16:23:03.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f8134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f8134140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35548/0 (socket says 172.21.15.177:35548) 2023-10-25T16:23:03.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 -- 172.21.15.177:0/1033017243 learned_addr learned my addr 172.21.15.177:0/1033017243 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:03.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fcfae640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f813b0d0 0x7f22f8133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fd7af640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f806cc60 0x7f22f81571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 -- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f806cc60 msgr2=0x7f22f81571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f806cc60 0x7f22f81571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 -- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f813b0d0 msgr2=0x7f22f8133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f813b0d0 0x7f22f8133c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 -- 172.21.15.177:0/1033017243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f00098e0 con 0x7f22f815c400 2023-10-25T16:23:03.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22fdfb0640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f8134140 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009bd0 tx=0x7f22f00093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:03.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00ba070 con 0x7f22f815c400 2023-10-25T16:23:03.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f22f00ad7c0 con 0x7f22f815c400 2023-10-25T16:23:03.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f81327c0 con 0x7f22f815c400 2023-10-25T16:23:03.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f00adbd0 con 0x7f22f815c400 2023-10-25T16:23:03.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f8131bd0 con 0x7f22f815c400 2023-10-25T16:23:03.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.136+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f804daf0 con 0x7f22f815c400 2023-10-25T16:23:03.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.140+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f22f00b4040 con 0x7f22f815c400 2023-10-25T16:23:03.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.140+0000 7f22edffb640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22dc066470 0x7f22dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.140+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f22f011e580 con 0x7f22f815c400 2023-10-25T16:23:03.143 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.140+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f22dc06e060 con 0x7f22f815c400 2023-10-25T16:23:03.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.140+0000 7f22fd7af640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22dc066470 0x7f22dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.140+0000 7f22fd7af640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22dc066470 0x7f22dc068930 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f22f400a830 tx=0x7f22f4008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:03.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.144+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22f00b2020 con 0x7f22f815c400 2023-10-25T16:23:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.300+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22f80cde80 con 0x7f22f815c400 2023-10-25T16:23:03.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.300+0000 7f22edffb640 1 -- 172.21.15.177:0/1033017243 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16726 (secure 0 0 0) 0x7f22f00eb9c0 con 0x7f22f815c400 2023-10-25T16:23:03.298 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:03.298 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":162,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:22:12.760090+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:03.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22dc066470 msgr2=0x7f22dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22dc066470 0x7f22dc068930 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f22f400a830 tx=0x7f22f4008040 comp rx=0 tx=0).stop 2023-10-25T16:23:03.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 msgr2=0x7f22f8134140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f8134140 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009bd0 tx=0x7f22f00093b0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 shutdown_connections 2023-10-25T16:23:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f22dc066470 0x7f22dc068930 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22f815c400 0x7f22f8134140 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f813b0d0 0x7f22f8133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 --2- 172.21.15.177:0/1033017243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f806cc60 0x7f22f81571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 >> 172.21.15.177:0/1033017243 conn(0x7f22f80afe20 msgr2=0x7f22f80b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 shutdown_connections 2023-10-25T16:23:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.304+0000 7f22ffa13640 1 -- 172.21.15.177:0/1033017243 wait complete. 2023-10-25T16:23:03.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:20:53.275247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:20:54.087392+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:23:03.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:23:03.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- 172.21.15.177:0/3312819256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c069e30 msgr2=0x7f007c06dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 --2- 172.21.15.177:0/3312819256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c069e30 0x7f007c06dc60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0074009bc0 tx=0x7f007401cb10 comp rx=0 tx=0).stop 2023-10-25T16:23:03.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- 172.21.15.177:0/3312819256 shutdown_connections 2023-10-25T16:23:03.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 --2- 172.21.15.177:0/3312819256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c069e30 0x7f007c06dc60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 --2- 172.21.15.177:0/3312819256 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 0x7f007c15a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- 172.21.15.177:0/3312819256 >> 172.21.15.177:0/3312819256 conn(0x7f007c0afe20 msgr2=0x7f007c0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:03.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- 172.21.15.177:0/3312819256 shutdown_connections 2023-10-25T16:23:03.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- 172.21.15.177:0/3312819256 wait complete. 2023-10-25T16:23:03.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 Processor -- start 2023-10-25T16:23:03.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- start start 2023-10-25T16:23:03.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 0x7f007c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c15a9b0 0x7f007c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 0x7f007c070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c148850 con 0x7f007c069e30 2023-10-25T16:23:03.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c163c60 con 0x7f007c15a9b0 2023-10-25T16:23:03.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f008129f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c147bd0 con 0x7f007c15c650 2023-10-25T16:23:03.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 0x7f007c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 0x7f007c155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35560/0 (socket says 172.21.15.177:35560) 2023-10-25T16:23:03.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 -- 172.21.15.177:0/1702051783 learned_addr learned my addr 172.21.15.177:0/1702051783 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:03.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007b7fe640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 0x7f007c070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 -- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 msgr2=0x7f007c070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007a7fc640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c15a9b0 0x7f007c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 0x7f007c070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 -- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c15a9b0 msgr2=0x7f007c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c15a9b0 0x7f007c0b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 -- 172.21.15.177:0/1702051783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009560 con 0x7f007c069e30 2023-10-25T16:23:03.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007b7fe640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 0x7f007c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:03.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007a7fc640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c15a9b0 0x7f007c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:03.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f007affd640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 0x7f007c155500 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f006c00e9f0 tx=0x7f006c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:03.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.448+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00cd80 con 0x7f007c069e30 2023-10-25T16:23:03.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f006c004020 con 0x7f007c069e30 2023-10-25T16:23:03.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0074009820 con 0x7f007c069e30 2023-10-25T16:23:03.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c004430 con 0x7f007c069e30 2023-10-25T16:23:03.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c148190 con 0x7f007c069e30 2023-10-25T16:23:03.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c04daf0 con 0x7f007c069e30 2023-10-25T16:23:03.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f006c003600 con 0x7f007c069e30 2023-10-25T16:23:03.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f00637fe640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f006c014070 con 0x7f007c069e30 2023-10-25T16:23:03.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f006806e060 con 0x7f007c069e30 2023-10-25T16:23:03.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f007a7fc640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.452+0000 7f007a7fc640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0068066470 0x7f0068068930 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f007c153710 tx=0x7f0070009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:03.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.456+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f006c051ea0 con 0x7f007c069e30 2023-10-25T16:23:03.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.608+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f007c150260 con 0x7f007c069e30 2023-10-25T16:23:03.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.608+0000 7f00637fe640 1 -- 172.21.15.177:0/1702051783 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f006c0554c0 con 0x7f007c069e30 2023-10-25T16:23:03.606 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:23:03.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0068066470 msgr2=0x7f0068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0068066470 0x7f0068068930 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f007c153710 tx=0x7f0070009040 comp rx=0 tx=0).stop 2023-10-25T16:23:03.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 msgr2=0x7f007c155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 0x7f007c155500 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f006c00e9f0 tx=0x7f006c00edf0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 shutdown_connections 2023-10-25T16:23:03.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0068066470 0x7f0068068930 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f007c15c650 0x7f007c070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c15a9b0 0x7f007c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 --2- 172.21.15.177:0/1702051783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c069e30 0x7f007c155500 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 >> 172.21.15.177:0/1702051783 conn(0x7f007c0afe20 msgr2=0x7f007c157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:03.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 shutdown_connections 2023-10-25T16:23:03.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.612+0000 7f008129f640 1 -- 172.21.15.177:0/1702051783 wait complete. 2023-10-25T16:23:03.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:23:03.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98a5ffb640 1 -- 172.21.15.177:0/1779773126 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900a5e10 con 0x7f98a80cc440 2023-10-25T16:23:03.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1779773126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80cc440 msgr2=0x7f98a80cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1779773126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80cc440 0x7f98a80cca30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9890009840 tx=0x7f989001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1779773126 shutdown_connections 2023-10-25T16:23:03.747 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1779773126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80cc440 0x7f98a80cca30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1779773126 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a8155db0 0x7f98a80cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1779773126 >> 172.21.15.177:0/1779773126 conn(0x7f98a80ce000 msgr2=0x7f98a80ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1779773126 shutdown_connections 2023-10-25T16:23:03.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.748+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1779773126 wait complete. 2023-10-25T16:23:03.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 Processor -- start 2023-10-25T16:23:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- start start 2023-10-25T16:23:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 0x7f98a814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80ccf70 0x7f98a8150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a8155db0 0x7f98a814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8148af0 con 0x7f98a80cc440 2023-10-25T16:23:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a814ab60 con 0x7f98a80ccf70 2023-10-25T16:23:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a814a550 con 0x7f98a8155db0 2023-10-25T16:23:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 0x7f98a814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 0x7f98a814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35566/0 (socket says 172.21.15.177:35566) 2023-10-25T16:23:03.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 -- 172.21.15.177:0/1657126239 learned_addr learned my addr 172.21.15.177:0/1657126239 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a67fc640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80ccf70 0x7f98a8150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a77fe640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a8155db0 0x7f98a814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 -- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a8155db0 msgr2=0x7f98a814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a8155db0 0x7f98a814aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 -- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80ccf70 msgr2=0x7f98a8150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80ccf70 0x7f98a8150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 -- 172.21.15.177:0/1657126239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900094a0 con 0x7f98a80cc440 2023-10-25T16:23:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98a6ffd640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 0x7f98a814c940 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f989800ebc0 tx=0x7f989800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898010630 con 0x7f98a80cc440 2023-10-25T16:23:03.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9898010880 con 0x7f98a80cc440 2023-10-25T16:23:03.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a80ca610 con 0x7f98a80cc440 2023-10-25T16:23:03.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898010c70 con 0x7f98a80cc440 2023-10-25T16:23:03.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a8158250 con 0x7f98a80cc440 2023-10-25T16:23:03.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a806fe60 con 0x7f98a80cc440 2023-10-25T16:23:03.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9898018420 con 0x7f98a80cc440 2023-10-25T16:23:03.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.752+0000 7f989f7fe640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9888066470 0x7f9888068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:03.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.756+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9898014070 con 0x7f98a80cc440 2023-10-25T16:23:03.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.756+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f988806e060 con 0x7f98a80cc440 2023-10-25T16:23:03.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.756+0000 7f98a67fc640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9888066470 0x7f9888068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:03.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.756+0000 7f98a67fc640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9888066470 0x7f9888068930 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f98900af000 tx=0x7f989001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:03.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.756+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9898050090 con 0x7f98a80cc440 2023-10-25T16:23:03.901 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.904+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98a804daf0 con 0x7f98a80cc440 2023-10-25T16:23:03.902 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.904+0000 7f989f7fe640 1 -- 172.21.15.177:0/1657126239 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9898052130 con 0x7f98a80cc440 2023-10-25T16:23:03.902 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:23:03.904 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9888066470 msgr2=0x7f9888068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9888066470 0x7f9888068930 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f98900af000 tx=0x7f989001b010 comp rx=0 tx=0).stop 2023-10-25T16:23:03.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 msgr2=0x7f98a814c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:03.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 0x7f98a814c940 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f989800ebc0 tx=0x7f989800c6a0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.905 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 shutdown_connections 2023-10-25T16:23:03.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9888066470 0x7f9888068930 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98a8155db0 0x7f98a814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98a80ccf70 0x7f98a8150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 --2- 172.21.15.177:0/1657126239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98a80cc440 0x7f98a814c940 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:03.906 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 >> 172.21.15.177:0/1657126239 conn(0x7f98a80ce000 msgr2=0x7f98a806d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:03.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 shutdown_connections 2023-10-25T16:23:03.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:03.908+0000 7f98ad5c1640 1 -- 172.21.15.177:0/1657126239 wait complete. 2023-10-25T16:23:03.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:23:04.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/2219264038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2b00039b0 msgr2=0x7fa2b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/2219264038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2b00039b0 0x7fa2b0003dd0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80016b0 tx=0x7fa2b801c770 comp rx=0 tx=0).stop 2023-10-25T16:23:04.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2c77fe640 1 -- 172.21.15.177:0/2219264038 reap_dead start 2023-10-25T16:23:04.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/2219264038 shutdown_connections 2023-10-25T16:23:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/2219264038 >> 172.21.15.177:0/2219264038 conn(0x7fa2c80b2450 msgr2=0x7fa2c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/2219264038 shutdown_connections 2023-10-25T16:23:04.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/2219264038 wait complete. 2023-10-25T16:23:04.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 Processor -- start 2023-10-25T16:23:04.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.040+0000 7fa2cd6e6640 1 -- start start 2023-10-25T16:23:04.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b00039b0 0x7fa2c80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c80af600 0x7fa2c813c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 0x7fa2c815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80af170 con 0x7fa2c814d470 2023-10-25T16:23:04.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c80afa80 con 0x7fa2c80af600 2023-10-25T16:23:04.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c813c6c0 con 0x7fa2b00039b0 2023-10-25T16:23:04.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 0x7fa2c815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 0x7fa2c815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35574/0 (socket says 172.21.15.177:35574) 2023-10-25T16:23:04.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 -- 172.21.15.177:0/32499212 learned_addr learned my addr 172.21.15.177:0/32499212 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:04.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c6ffd640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b00039b0 0x7fa2c80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 -- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b00039b0 msgr2=0x7fa2c80acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b00039b0 0x7fa2c80acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c67fc640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c80af600 0x7fa2c813c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 -- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c80af600 msgr2=0x7fa2c813c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c80af600 0x7fa2c813c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 -- 172.21.15.177:0/32499212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c815a6b0 con 0x7fa2c814d470 2023-10-25T16:23:04.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c77fe640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 0x7fa2c815b9c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0001340 tx=0x7fa2c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:04.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000a9c0 con 0x7fa2c814d470 2023-10-25T16:23:04.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2c000ac10 con 0x7fa2c814d470 2023-10-25T16:23:04.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c80ae840 con 0x7fa2c814d470 2023-10-25T16:23:04.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0007070 con 0x7fa2c814d470 2023-10-25T16:23:04.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c80aee00 con 0x7fa2c814d470 2023-10-25T16:23:04.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c80af2e0 con 0x7fa2c814d470 2023-10-25T16:23:04.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa2c00071d0 con 0x7fa2c814d470 2023-10-25T16:23:04.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2b4066470 0x7fa2b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa2c0083b00 con 0x7fa2c814d470 2023-10-25T16:23:04.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7fa2b406e060 con 0x7fa2c814d470 2023-10-25T16:23:04.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c6ffd640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2b4066470 0x7fa2b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.044+0000 7fa2c6ffd640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2b4066470 0x7fa2b4068930 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8001680 tx=0x7fa2b80a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:04.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.048+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa2c0017030 con 0x7fa2c814d470 2023-10-25T16:23:04.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.188+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2c804daf0 con 0x7fa2c814d470 2023-10-25T16:23:04.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2af7fe640 1 -- 172.21.15.177:0/32499212 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2c0017030 con 0x7fa2c814d470 2023-10-25T16:23:04.190 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:23:04.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2b4066470 msgr2=0x7fa2b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2b4066470 0x7fa2b4068930 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8001680 tx=0x7fa2b80a7040 comp rx=0 tx=0).stop 2023-10-25T16:23:04.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 msgr2=0x7fa2c815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 0x7fa2c815b9c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0001340 tx=0x7fa2c000cce0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 shutdown_connections 2023-10-25T16:23:04.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa2b4066470 0x7fa2b4068930 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2c814d470 0x7fa2c815b9c0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2c80af600 0x7fa2c813c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 --2- 172.21.15.177:0/32499212 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2b00039b0 0x7fa2c80acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 >> 172.21.15.177:0/32499212 conn(0x7fa2c80b2450 msgr2=0x7fa2c80cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:04.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 shutdown_connections 2023-10-25T16:23:04.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.192+0000 7fa2cd6e6640 1 -- 172.21.15.177:0/32499212 wait complete. 2023-10-25T16:23:04.206 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:23:04.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 -- 172.21.15.177:0/4229269351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94159230 msgr2=0x7faa94071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/4229269351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94159230 0x7faa94071500 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7faa9406c6a0 tx=0x7faa9001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 -- 172.21.15.177:0/4229269351 shutdown_connections 2023-10-25T16:23:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/4229269351 >> v2:172.21.15.184:3300/0 conn(0x7faa94070510 0x7faa940cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/4229269351 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94159230 0x7faa94071500 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 -- 172.21.15.177:0/4229269351 >> 172.21.15.177:0/4229269351 conn(0x7faa940b2450 msgr2=0x7faa940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 -- 172.21.15.177:0/4229269351 shutdown_connections 2023-10-25T16:23:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 -- 172.21.15.177:0/4229269351 wait complete. 2023-10-25T16:23:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 Processor -- start 2023-10-25T16:23:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 -- start start 2023-10-25T16:23:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.332+0000 7faa9b9bc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 0x7faa94149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa940cc610 0x7faa940ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa94159230 0x7faa940aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9414a2a0 con 0x7faa94070510 2023-10-25T16:23:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa94152370 con 0x7faa940cc610 2023-10-25T16:23:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa940adba0 con 0x7faa94159230 2023-10-25T16:23:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 0x7faa94149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 0x7faa94149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35606/0 (socket says 172.21.15.177:35606) 2023-10-25T16:23:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 -- 172.21.15.177:0/3413452720 learned_addr learned my addr 172.21.15.177:0/3413452720 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:04.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 -- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa94159230 msgr2=0x7faa940aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa94159230 0x7faa940aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 -- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa940cc610 msgr2=0x7faa940ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa940cc610 0x7faa940ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 -- 172.21.15.177:0/3413452720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa900094a0 con 0x7faa94070510 2023-10-25T16:23:04.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa99758640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 0x7faa94149d60 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7faa90009790 tx=0x7faa900a57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:04.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90005230 con 0x7faa94070510 2023-10-25T16:23:04.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faa90005480 con 0x7faa94070510 2023-10-25T16:23:04.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa900046d0 con 0x7faa94070510 2023-10-25T16:23:04.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa941515b0 con 0x7faa94070510 2023-10-25T16:23:04.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa94151b70 con 0x7faa94070510 2023-10-25T16:23:04.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9404daf0 con 0x7faa94070510 2023-10-25T16:23:04.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa900b4040 con 0x7faa94070510 2023-10-25T16:23:04.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa780664a0 0x7faa78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faa9011de00 con 0x7faa94070510 2023-10-25T16:23:04.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7faa7806e090 con 0x7faa94070510 2023-10-25T16:23:04.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa98f57640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa780664a0 0x7faa78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.336+0000 7faa98f57640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa780664a0 0x7faa78068960 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faa941f58b0 tx=0x7faa84005bf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:04.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.340+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa900b2060 con 0x7faa94070510 2023-10-25T16:23:04.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.504+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faa9415aa90 con 0x7faa94070510 2023-10-25T16:23:04.503 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa89ffb640 1 -- 172.21.15.177:0/3413452720 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v162) v1 ==== 80+0+0 (secure 0 0 0) 0x7faa900bc030 con 0x7faa94070510 2023-10-25T16:23:04.504 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:23:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa780664a0 msgr2=0x7faa78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa780664a0 0x7faa78068960 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7faa941f58b0 tx=0x7faa84005bf0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 msgr2=0x7faa94149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 0x7faa94149d60 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7faa90009790 tx=0x7faa900a57e0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 shutdown_connections 2023-10-25T16:23:04.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa780664a0 0x7faa78068960 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa94159230 0x7faa940aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa940cc610 0x7faa940ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.507 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 --2- 172.21.15.177:0/3413452720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa94070510 0x7faa94149d60 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 >> 172.21.15.177:0/3413452720 conn(0x7faa940b2450 msgr2=0x7faa9415a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:04.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 shutdown_connections 2023-10-25T16:23:04.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.508+0000 7faa9b9bc640 1 -- 172.21.15.177:0/3413452720 wait complete. 2023-10-25T16:23:04.521 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:23:04.522 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:04.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:04.578 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:04.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35332]: fuse finished with error 0 and tester_r 0 2023-10-25T16:23:04.579 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:04.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:04.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:23:04.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:04.588 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:23:04.596 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:23:04.597 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:04.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:23:04.603 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:23:04.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:04.604 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:23:04.647 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:23:04.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:23:04.649 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:23:04.649 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:04.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:23:04.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:23:04.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:04.657 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:23:04.701 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:23:04.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:23:04.703 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:04.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/4194998040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 msgr2=0x7f75b00c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- 172.21.15.177:0/4194998040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b00c9910 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f75b015dd70 tx=0x7f75a001c5d0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/4194998040 shutdown_connections 2023-10-25T16:23:04.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- 172.21.15.177:0/4194998040 >> v2:172.21.15.184:3300/0 conn(0x7f75b006bf20 0x7f75b00aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- 172.21.15.177:0/4194998040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b00c9e50 0x7f75b006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- 172.21.15.177:0/4194998040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b00c9910 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/4194998040 >> 172.21.15.177:0/4194998040 conn(0x7f75b00b2450 msgr2=0x7f75b00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:04.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/4194998040 shutdown_connections 2023-10-25T16:23:04.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/4194998040 wait complete. 2023-10-25T16:23:04.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 Processor -- start 2023-10-25T16:23:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- start start 2023-10-25T16:23:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b006bf20 0x7f75b0145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b00c9e50 0x7f75b0146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b01507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b014d9e0 con 0x7f75b01500f0 2023-10-25T16:23:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b01457c0 con 0x7f75b006bf20 2023-10-25T16:23:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0145c30 con 0x7f75b00c9e50 2023-10-25T16:23:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b01507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b01507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35616/0 (socket says 172.21.15.177:35616) 2023-10-25T16:23:04.837 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 -- 172.21.15.177:0/1190713165 learned_addr learned my addr 172.21.15.177:0/1190713165 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:04.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75af7fe640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b006bf20 0x7f75b0145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75aeffd640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b00c9e50 0x7f75b0146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 -- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b00c9e50 msgr2=0x7f75b0146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b00c9e50 0x7f75b0146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 -- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b006bf20 msgr2=0x7f75b0145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b006bf20 0x7f75b0145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 -- 172.21.15.177:0/1190713165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a0009560 con 0x7f75b01500f0 2023-10-25T16:23:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75affff640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b01507a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f75a800b9a0 tx=0x7f75a800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800caa0 con 0x7f75b01500f0 2023-10-25T16:23:04.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75a800cd10 con 0x7f75b01500f0 2023-10-25T16:23:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b014a6e0 con 0x7f75b01500f0 2023-10-25T16:23:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80146a0 con 0x7f75b01500f0 2023-10-25T16:23:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.836+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b014dea0 con 0x7f75b01500f0 2023-10-25T16:23:04.840 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b004daf0 con 0x7f75b01500f0 2023-10-25T16:23:04.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75a801d3b0 con 0x7f75b01500f0 2023-10-25T16:23:04.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75a7fff640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7590066470 0x7f7590068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f75a8083e50 con 0x7f75b01500f0 2023-10-25T16:23:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f759006e060 con 0x7f75b01500f0 2023-10-25T16:23:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75af7fe640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7590066470 0x7f7590068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.840+0000 7f75af7fe640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7590066470 0x7f7590068930 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f75a00ae000 tx=0x7f75a00b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:04.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:04.844+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75a8019060 con 0x7f75b01500f0 2023-10-25T16:23:05.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.020+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75b00b2c50 con 0x7f75b01500f0 2023-10-25T16:23:05.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75a7fff640 1 -- 172.21.15.177:0/1190713165 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f75a80513d0 con 0x7f75b01500f0 2023-10-25T16:23:05.020 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:05.020 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:23:05.021 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:23:05.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7590066470 msgr2=0x7f7590068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7590066470 0x7f7590068930 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f75a00ae000 tx=0x7f75a00b3040 comp rx=0 tx=0).stop 2023-10-25T16:23:05.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 msgr2=0x7f75b01507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b01507a0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f75a800b9a0 tx=0x7f75a800bda0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 shutdown_connections 2023-10-25T16:23:05.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7590066470 0x7f7590068930 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75b01500f0 0x7f75b01507a0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75b00c9e50 0x7f75b0146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 --2- 172.21.15.177:0/1190713165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75b006bf20 0x7f75b0145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 >> 172.21.15.177:0/1190713165 conn(0x7f75b00b2450 msgr2=0x7f75b00cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 shutdown_connections 2023-10-25T16:23:05.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.024+0000 7f75b6231640 1 -- 172.21.15.177:0/1190713165 wait complete. 2023-10-25T16:23:05.038 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:05.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/485559124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5100cdb10 msgr2=0x7fa5100cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 --2- 172.21.15.177:0/485559124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5100cdb10 0x7fa5100cdf80 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa5100b3ea0 tx=0x7fa50801ccd0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/485559124 shutdown_connections 2023-10-25T16:23:05.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 --2- 172.21.15.177:0/485559124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5100cdb10 0x7fa5100cdf80 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 --2- 172.21.15.177:0/485559124 >> v2:172.21.15.184:3300/0 conn(0x7fa51015eba0 0x7fa5100b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/485559124 >> 172.21.15.177:0/485559124 conn(0x7fa51009a5c0 msgr2=0x7fa5100d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/485559124 shutdown_connections 2023-10-25T16:23:05.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/485559124 wait complete. 2023-10-25T16:23:05.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 Processor -- start 2023-10-25T16:23:05.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- start start 2023-10-25T16:23:05.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5100b2120 0x7fa51015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5100cdb10 0x7fa51015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 0x7fa510158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100cb2c0 con 0x7fa51015eba0 2023-10-25T16:23:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51014ea30 con 0x7fa5100b2120 2023-10-25T16:23:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100ca640 con 0x7fa5100cdb10 2023-10-25T16:23:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 0x7fa510158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 0x7fa510158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35626/0 (socket says 172.21.15.177:35626) 2023-10-25T16:23:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 -- 172.21.15.177:0/2245238904 learned_addr learned my addr 172.21.15.177:0/2245238904 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50effd640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5100cdb10 0x7fa51015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50f7fe640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5100b2120 0x7fa51015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 -- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5100cdb10 msgr2=0x7fa51015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5100cdb10 0x7fa51015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 -- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5100b2120 msgr2=0x7fa51015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5100b2120 0x7fa51015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 -- 172.21.15.177:0/2245238904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080098e0 con 0x7fa51015eba0 2023-10-25T16:23:05.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa50ffff640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 0x7fa510158ca0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fa5080198e0 tx=0x7fa5080a5b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:05.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508004e60 con 0x7fa51015eba0 2023-10-25T16:23:05.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa508004050 con 0x7fa51015eba0 2023-10-25T16:23:05.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100ca920 con 0x7fa51015eba0 2023-10-25T16:23:05.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508004420 con 0x7fa51015eba0 2023-10-25T16:23:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.164+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5100caee0 con 0x7fa51015eba0 2023-10-25T16:23:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5100cb400 con 0x7fa51015eba0 2023-10-25T16:23:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5080b4040 con 0x7fa51015eba0 2023-10-25T16:23:05.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa4f7fff640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4fc066470 0x7fa4fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa50811e280 con 0x7fa51015eba0 2023-10-25T16:23:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7fa4fc06e060 con 0x7fa51015eba0 2023-10-25T16:23:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa50f7fe640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4fc066470 0x7fa4fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.168+0000 7fa50f7fe640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4fc066470 0x7fa4fc068930 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa500005fd0 tx=0x7fa500005d10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.172+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5080b2060 con 0x7fa51015eba0 2023-10-25T16:23:05.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.332+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5100d02d0 con 0x7fa51015eba0 2023-10-25T16:23:05.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.332+0000 7fa4f7fff640 1 -- 172.21.15.177:0/2245238904 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16726 (secure 0 0 0) 0x7fa5080bc020 con 0x7fa51015eba0 2023-10-25T16:23:05.331 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:05.331 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":162,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:22:12.760090+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:05.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4fc066470 msgr2=0x7fa4fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4fc066470 0x7fa4fc068930 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa500005fd0 tx=0x7fa500005d10 comp rx=0 tx=0).stop 2023-10-25T16:23:05.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 msgr2=0x7fa510158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 0x7fa510158ca0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fa5080198e0 tx=0x7fa5080a5b00 comp rx=0 tx=0).stop 2023-10-25T16:23:05.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 shutdown_connections 2023-10-25T16:23:05.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa4fc066470 0x7fa4fc068930 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa51015eba0 0x7fa510158ca0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5100cdb10 0x7fa51015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 --2- 172.21.15.177:0/2245238904 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5100b2120 0x7fa51015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 >> 172.21.15.177:0/2245238904 conn(0x7fa51009a5c0 msgr2=0x7fa51015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 shutdown_connections 2023-10-25T16:23:05.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.336+0000 7fa515fee640 1 -- 172.21.15.177:0/2245238904 wait complete. 2023-10-25T16:23:05.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:20:53.275247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:20:54.087392+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:23:05.351 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:23:05.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 -- 172.21.15.177:0/1491843290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd14806b980 msgr2=0x7fd14806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 --2- 172.21.15.177:0/1491843290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd14806b980 0x7fd14806be10 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd140009bf0 tx=0x7fd14001ca70 comp rx=0 tx=0).stop 2023-10-25T16:23:05.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 -- 172.21.15.177:0/1491843290 shutdown_connections 2023-10-25T16:23:05.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 --2- 172.21.15.177:0/1491843290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd14806b980 0x7fd14806be10 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 --2- 172.21.15.177:0/1491843290 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd148159230 0x7fd148071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 -- 172.21.15.177:0/1491843290 >> 172.21.15.177:0/1491843290 conn(0x7fd1480b2450 msgr2=0x7fd1480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 -- 172.21.15.177:0/1491843290 shutdown_connections 2023-10-25T16:23:05.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.476+0000 7fd14e52a640 1 -- 172.21.15.177:0/1491843290 wait complete. 2023-10-25T16:23:05.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 Processor -- start 2023-10-25T16:23:05.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- start start 2023-10-25T16:23:05.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd14806b980 0x7fd148141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd148070510 0x7fd1480ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 0x7fd14814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481502b0 con 0x7fd148159230 2023-10-25T16:23:05.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14814ffd0 con 0x7fd148070510 2023-10-25T16:23:05.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481457c0 con 0x7fd14806b980 2023-10-25T16:23:05.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 0x7fd14814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 0x7fd14814d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35642/0 (socket says 172.21.15.177:35642) 2023-10-25T16:23:05.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 -- 172.21.15.177:0/2294754203 learned_addr learned my addr 172.21.15.177:0/2294754203 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:05.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd147fff640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd14806b980 0x7fd148141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd1477fe640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd148070510 0x7fd1480ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 -- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd14806b980 msgr2=0x7fd148141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd14806b980 0x7fd148141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 -- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd148070510 msgr2=0x7fd1480ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd148070510 0x7fd1480ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 -- 172.21.15.177:0/2294754203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009820 con 0x7fd148159230 2023-10-25T16:23:05.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14cac7640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 0x7fd14814d620 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fd14001b120 tx=0x7fd140003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:05.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400ba070 con 0x7fd148159230 2023-10-25T16:23:05.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd140004b40 con 0x7fd148159230 2023-10-25T16:23:05.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd148145aa0 con 0x7fd148159230 2023-10-25T16:23:05.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140005020 con 0x7fd148159230 2023-10-25T16:23:05.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1480af9a0 con 0x7fd148159230 2023-10-25T16:23:05.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14804daf0 con 0x7fd148159230 2023-10-25T16:23:05.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.480+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1400b4040 con 0x7fd148159230 2023-10-25T16:23:05.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.484+0000 7fd144ff9640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd134066470 0x7fd134068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.484+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd14011e380 con 0x7fd148159230 2023-10-25T16:23:05.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.484+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7fd13406e060 con 0x7fd148159230 2023-10-25T16:23:05.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.484+0000 7fd147fff640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd134066470 0x7fd134068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.484+0000 7fd147fff640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd134066470 0x7fd134068930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd1380058d0 tx=0x7fd138005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:05.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.488+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1400b2020 con 0x7fd148159230 2023-10-25T16:23:05.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd14815a0c0 con 0x7fd148159230 2023-10-25T16:23:05.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd144ff9640 1 -- 172.21.15.177:0/2294754203 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1400eb7c0 con 0x7fd148159230 2023-10-25T16:23:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:23:05.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd134066470 msgr2=0x7fd134068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd134066470 0x7fd134068930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd1380058d0 tx=0x7fd138005860 comp rx=0 tx=0).stop 2023-10-25T16:23:05.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 msgr2=0x7fd14814d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 0x7fd14814d620 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fd14001b120 tx=0x7fd140003ae0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 shutdown_connections 2023-10-25T16:23:05.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd134066470 0x7fd134068930 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd148159230 0x7fd14814d620 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd148070510 0x7fd1480ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 --2- 172.21.15.177:0/2294754203 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd14806b980 0x7fd148141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 >> 172.21.15.177:0/2294754203 conn(0x7fd1480b2450 msgr2=0x7fd148156710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 shutdown_connections 2023-10-25T16:23:05.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.628+0000 7fd14e52a640 1 -- 172.21.15.177:0/2294754203 wait complete. 2023-10-25T16:23:05.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:23:05.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 -- 172.21.15.177:0/2024747168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c0cdb10 msgr2=0x7fbb6c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 --2- 172.21.15.177:0/2024747168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c0cdb10 0x7fbb6c0cdf80 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c09f200 tx=0x7fbb6401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 -- 172.21.15.177:0/2024747168 shutdown_connections 2023-10-25T16:23:05.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 --2- 172.21.15.177:0/2024747168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c0cdb10 0x7fbb6c0cdf80 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 --2- 172.21.15.177:0/2024747168 >> v2:172.21.15.184:3300/0 conn(0x7fbb6c0b2120 0x7fbb6c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 -- 172.21.15.177:0/2024747168 >> 172.21.15.177:0/2024747168 conn(0x7fbb6c09a5c0 msgr2=0x7fbb6c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 -- 172.21.15.177:0/2024747168 shutdown_connections 2023-10-25T16:23:05.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 -- 172.21.15.177:0/2024747168 wait complete. 2023-10-25T16:23:05.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 Processor -- start 2023-10-25T16:23:05.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.760+0000 7fbb74426640 1 -- start start 2023-10-25T16:23:05.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6c0b2120 0x7fbb6c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb6c0cdb10 0x7fbb6c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 0x7fbb6c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0cb080 con 0x7fbb6c15eba0 2023-10-25T16:23:05.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c15a6e0 con 0x7fbb6c0b2120 2023-10-25T16:23:05.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c15a930 con 0x7fbb6c0cdb10 2023-10-25T16:23:05.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 0x7fbb6c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 0x7fbb6c154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35652/0 (socket says 172.21.15.177:35652) 2023-10-25T16:23:05.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 -- 172.21.15.177:0/1993858098 learned_addr learned my addr 172.21.15.177:0/1993858098 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:05.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 -- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb6c0cdb10 msgr2=0x7fbb6c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb6c0cdb10 0x7fbb6c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 -- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6c0b2120 msgr2=0x7fbb6c153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb721c2640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6c0b2120 0x7fbb6c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6c0b2120 0x7fbb6c153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 -- 172.21.15.177:0/1993858098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64009560 con 0x7fbb6c15eba0 2023-10-25T16:23:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb729c3640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 0x7fbb6c154f80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fbb6401d070 tx=0x7fbb640a6530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:05.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640b6070 con 0x7fbb6c15eba0 2023-10-25T16:23:05.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb64004050 con 0x7fbb6c15eba0 2023-10-25T16:23:05.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c15ac10 con 0x7fbb6c15eba0 2023-10-25T16:23:05.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64004440 con 0x7fbb6c15eba0 2023-10-25T16:23:05.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c154a60 con 0x7fbb6c15eba0 2023-10-25T16:23:05.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c1545e0 con 0x7fbb6c15eba0 2023-10-25T16:23:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbb64005040 con 0x7fbb6c15eba0 2023-10-25T16:23:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb58066470 0x7fbb58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb6411e6b0 con 0x7fbb6c15eba0 2023-10-25T16:23:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7fbb5806e060 con 0x7fbb6c15eba0 2023-10-25T16:23:05.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb721c2640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb58066470 0x7fbb58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.764+0000 7fbb721c2640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb58066470 0x7fbb58068930 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0b7290 tx=0x7fbb5c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:05.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.768+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb6c1545e0 con 0x7fbb6c15eba0 2023-10-25T16:23:05.907 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb6c1545e0 con 0x7fbb6c15eba0 2023-10-25T16:23:05.908 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb62ffd640 1 -- 172.21.15.177:0/1993858098 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb6c1545e0 con 0x7fbb6c15eba0 2023-10-25T16:23:05.908 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:23:05.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb58066470 msgr2=0x7fbb58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb58066470 0x7fbb58068930 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0b7290 tx=0x7fbb5c008040 comp rx=0 tx=0).stop 2023-10-25T16:23:05.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 msgr2=0x7fbb6c154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:05.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 0x7fbb6c154f80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fbb6401d070 tx=0x7fbb640a6530 comp rx=0 tx=0).stop 2023-10-25T16:23:05.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 shutdown_connections 2023-10-25T16:23:05.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb58066470 0x7fbb58068930 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb6c15eba0 0x7fbb6c154f80 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb6c0cdb10 0x7fbb6c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 --2- 172.21.15.177:0/1993858098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb6c0b2120 0x7fbb6c153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:05.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 >> 172.21.15.177:0/1993858098 conn(0x7fbb6c09a5c0 msgr2=0x7fbb6c15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:05.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 shutdown_connections 2023-10-25T16:23:05.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:05.912+0000 7fbb74426640 1 -- 172.21.15.177:0/1993858098 wait complete. 2023-10-25T16:23:05.927 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:23:06.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 -- 172.21.15.177:0/3585415171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 msgr2=0x7f78800c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 --2- 172.21.15.177:0/3585415171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f78800c9910 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7870009900 tx=0x7f787001c7c0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 -- 172.21.15.177:0/3585415171 shutdown_connections 2023-10-25T16:23:06.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 --2- 172.21.15.177:0/3585415171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f78800c9910 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 -- 172.21.15.177:0/3585415171 >> 172.21.15.177:0/3585415171 conn(0x7f78800b2450 msgr2=0x7f78800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 -- 172.21.15.177:0/3585415171 shutdown_connections 2023-10-25T16:23:06.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.044+0000 7f7886ae4640 1 -- 172.21.15.177:0/3585415171 wait complete. 2023-10-25T16:23:06.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 Processor -- start 2023-10-25T16:23:06.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- start start 2023-10-25T16:23:06.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f788006c0f0 0x7f78801452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78800c9e50 0x7f78800acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.049 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f788014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788014cd00 con 0x7f78801500f0 2023-10-25T16:23:06.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78800ad5d0 con 0x7f788006c0f0 2023-10-25T16:23:06.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788014cf50 con 0x7f78800c9e50 2023-10-25T16:23:06.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f788014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f788014a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35680/0 (socket says 172.21.15.177:35680) 2023-10-25T16:23:06.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 -- 172.21.15.177:0/2522770614 learned_addr learned my addr 172.21.15.177:0/2522770614 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:06.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f787ffff640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78800c9e50 0x7f78800acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7884880640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f788006c0f0 0x7f78801452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 -- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78800c9e50 msgr2=0x7f78800acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78800c9e50 0x7f78800acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 -- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f788006c0f0 msgr2=0x7f78801452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f788006c0f0 0x7f78801452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 -- 172.21.15.177:0/2522770614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870009560 con 0x7f78801500f0 2023-10-25T16:23:06.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7885081640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f788014a900 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f787800c700 tx=0x7f787800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878003db0 con 0x7f78801500f0 2023-10-25T16:23:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f787800ce10 con 0x7f78801500f0 2023-10-25T16:23:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788014d230 con 0x7f78801500f0 2023-10-25T16:23:06.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878005330 con 0x7f78801500f0 2023-10-25T16:23:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880145da0 con 0x7f78801500f0 2023-10-25T16:23:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788004daf0 con 0x7f78801500f0 2023-10-25T16:23:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.048+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7878005490 con 0x7f78801500f0 2023-10-25T16:23:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.052+0000 7f787d7fa640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f786c066470 0x7f786c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.052+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7878083970 con 0x7f78801500f0 2023-10-25T16:23:06.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.052+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f786c06e060 con 0x7f78801500f0 2023-10-25T16:23:06.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.052+0000 7f7884880640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f786c066470 0x7f786c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.052+0000 7f7884880640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f786c066470 0x7f786c068930 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f78700af000 tx=0x7f787001b000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.056+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7878017070 con 0x7f78801500f0 2023-10-25T16:23:06.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.196+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7880071820 con 0x7f78801500f0 2023-10-25T16:23:06.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.196+0000 7f787d7fa640 1 -- 172.21.15.177:0/2522770614 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78780548d0 con 0x7f78801500f0 2023-10-25T16:23:06.195 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:23:06.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f786c066470 msgr2=0x7f786c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f786c066470 0x7f786c068930 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f78700af000 tx=0x7f787001b000 comp rx=0 tx=0).stop 2023-10-25T16:23:06.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 msgr2=0x7f788014a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f788014a900 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f787800c700 tx=0x7f787800cbc0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 shutdown_connections 2023-10-25T16:23:06.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f786c066470 0x7f786c068930 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78801500f0 0x7f788014a900 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78800c9e50 0x7f78800acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 --2- 172.21.15.177:0/2522770614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f788006c0f0 0x7f78801452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 >> 172.21.15.177:0/2522770614 conn(0x7f78800b2450 msgr2=0x7f7880072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 shutdown_connections 2023-10-25T16:23:06.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.200+0000 7f7886ae4640 1 -- 172.21.15.177:0/2522770614 wait complete. 2023-10-25T16:23:06.212 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:06.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/1969674917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 msgr2=0x7f8314004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 --2- 172.21.15.177:0/1969674917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8314004c50 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f832806f520 tx=0x7f831801c6b0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/1969674917 shutdown_connections 2023-10-25T16:23:06.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 --2- 172.21.15.177:0/1969674917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8314004c50 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/1969674917 >> 172.21.15.177:0/1969674917 conn(0x7f83280b2450 msgr2=0x7f83280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/1969674917 shutdown_connections 2023-10-25T16:23:06.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/1969674917 wait complete. 2023-10-25T16:23:06.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 Processor -- start 2023-10-25T16:23:06.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- start start 2023-10-25T16:23:06.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8328147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83281e9190 0x7f83281e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83281528b0 0x7f8328152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281e9b50 con 0x7f83140047d0 2023-10-25T16:23:06.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8328147f80 con 0x7f83281528b0 2023-10-25T16:23:06.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83280b00d0 con 0x7f83281e9190 2023-10-25T16:23:06.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8328147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8328147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35704/0 (socket says 172.21.15.177:35704) 2023-10-25T16:23:06.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 -- 172.21.15.177:0/2126058376 learned_addr learned my addr 172.21.15.177:0/2126058376 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:06.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832cb84640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83281e9190 0x7f83281e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832db86640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83281528b0 0x7f8328152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 -- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83281e9190 msgr2=0x7f83281e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83281e9190 0x7f83281e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 -- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83281528b0 msgr2=0x7f8328152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83281528b0 0x7f8328152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 -- 172.21.15.177:0/2126058376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280b0370 con 0x7f83140047d0 2023-10-25T16:23:06.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832d385640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8328147a40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f8324011ae0 tx=0x7f8324009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400fcd0 con 0x7f83140047d0 2023-10-25T16:23:06.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f832400fe30 con 0x7f83140047d0 2023-10-25T16:23:06.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83280b0650 con 0x7f83140047d0 2023-10-25T16:23:06.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324004280 con 0x7f83140047d0 2023-10-25T16:23:06.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.328+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8328153590 con 0x7f83140047d0 2023-10-25T16:23:06.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832804daf0 con 0x7f83140047d0 2023-10-25T16:23:06.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8324003600 con 0x7f83140047d0 2023-10-25T16:23:06.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f831dffb640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f830c066470 0x7f830c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8324084a40 con 0x7f83140047d0 2023-10-25T16:23:06.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f830c06e060 con 0x7f83140047d0 2023-10-25T16:23:06.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f832cb84640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f830c066470 0x7f830c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.332+0000 7f832cb84640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f830c066470 0x7f830c068930 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f83180aa000 tx=0x7f8318019450 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.336+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8324086e60 con 0x7f83140047d0 2023-10-25T16:23:06.505 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.508+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83280cd1d0 con 0x7f83140047d0 2023-10-25T16:23:06.506 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.508+0000 7f831dffb640 1 -- 172.21.15.177:0/2126058376 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f8324051e80 con 0x7f83140047d0 2023-10-25T16:23:06.507 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:06.507 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:23:06.507 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:23:06.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f830c066470 msgr2=0x7f830c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f830c066470 0x7f830c068930 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f83180aa000 tx=0x7f8318019450 comp rx=0 tx=0).stop 2023-10-25T16:23:06.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 msgr2=0x7f8328147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8328147a40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f8324011ae0 tx=0x7f8324009f20 comp rx=0 tx=0).stop 2023-10-25T16:23:06.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 shutdown_connections 2023-10-25T16:23:06.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f830c066470 0x7f830c068930 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83281528b0 0x7f8328152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83281e9190 0x7f83281e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 --2- 172.21.15.177:0/2126058376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83140047d0 0x7f8328147a40 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 >> 172.21.15.177:0/2126058376 conn(0x7f83280b2450 msgr2=0x7f832815b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 shutdown_connections 2023-10-25T16:23:06.510 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.512+0000 7f832f5e9640 1 -- 172.21.15.177:0/2126058376 wait complete. 2023-10-25T16:23:06.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:06.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/3045115818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea00051e0 msgr2=0x7f8ea000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/3045115818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea00051e0 0x7f8ea000b990 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006f00 tx=0x7f8eac01cee0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/3045115818 shutdown_connections 2023-10-25T16:23:06.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/3045115818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ea00051e0 0x7f8ea000b990 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/3045115818 >> 172.21.15.177:0/3045115818 conn(0x7f8eb40b0de0 msgr2=0x7f8eb40b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/3045115818 shutdown_connections 2023-10-25T16:23:06.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/3045115818 wait complete. 2023-10-25T16:23:06.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 Processor -- start 2023-10-25T16:23:06.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- start start 2023-10-25T16:23:06.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00051e0 0x7f8eb40c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb40afdd0 0x7f8eb40b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 0x7f8eb414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40b0770 con 0x7f8eb414ec60 2023-10-25T16:23:06.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40c3e90 con 0x7f8ea00051e0 2023-10-25T16:23:06.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb414fd30 con 0x7f8eb40afdd0 2023-10-25T16:23:06.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 0x7f8eb414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 0x7f8eb414f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35720/0 (socket says 172.21.15.177:35720) 2023-10-25T16:23:06.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 -- 172.21.15.177:0/959930205 learned_addr learned my addr 172.21.15.177:0/959930205 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:06.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb37fe640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb40afdd0 0x7f8eb40b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb3fff640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00051e0 0x7f8eb40c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 -- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb40afdd0 msgr2=0x7f8eb40b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb40afdd0 0x7f8eb40b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 -- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00051e0 msgr2=0x7f8eb40c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00051e0 0x7f8eb40c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 -- 172.21.15.177:0/959930205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb415e620 con 0x7f8eb414ec60 2023-10-25T16:23:06.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb8f67640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 0x7f8eb414f0e0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f8eac000c10 tx=0x7f8eac0011b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0b2070 con 0x7f8eb414ec60 2023-10-25T16:23:06.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8eac001690 con 0x7f8eb414ec60 2023-10-25T16:23:06.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb414fa50 con 0x7f8eb414ec60 2023-10-25T16:23:06.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac003860 con 0x7f8eb414ec60 2023-10-25T16:23:06.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.636+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40c3b20 con 0x7f8eb414ec60 2023-10-25T16:23:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb40c4000 con 0x7f8eb414ec60 2023-10-25T16:23:06.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8eac0ab070 con 0x7f8eb414ec60 2023-10-25T16:23:06.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eb0ff9640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e940664a0 0x7f8e94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8eac11d860 con 0x7f8eb414ec60 2023-10-25T16:23:06.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f8e9406e090 con 0x7f8eb414ec60 2023-10-25T16:23:06.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eb3fff640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e940664a0 0x7f8e94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.640+0000 7f8eb3fff640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e940664a0 0x7f8e94068960 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004450 tx=0x7f8ea4006d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.644+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8eac11d070 con 0x7f8eb414ec60 2023-10-25T16:23:06.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.788+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb404daf0 con 0x7f8eb414ec60 2023-10-25T16:23:06.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.788+0000 7f8eb0ff9640 1 -- 172.21.15.177:0/959930205 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16726 (secure 0 0 0) 0x7f8eac0eacb0 con 0x7f8eb414ec60 2023-10-25T16:23:06.787 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:06.788 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":162,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:22:12.760090+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:06.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e940664a0 msgr2=0x7f8e94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e940664a0 0x7f8e94068960 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004450 tx=0x7f8ea4006d90 comp rx=0 tx=0).stop 2023-10-25T16:23:06.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 msgr2=0x7f8eb414f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 0x7f8eb414f0e0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f8eac000c10 tx=0x7f8eac0011b0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 shutdown_connections 2023-10-25T16:23:06.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e940664a0 0x7f8e94068960 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb414ec60 0x7f8eb414f0e0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb40afdd0 0x7f8eb40b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 --2- 172.21.15.177:0/959930205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ea00051e0 0x7f8eb40c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 >> 172.21.15.177:0/959930205 conn(0x7f8eb40b0de0 msgr2=0x7f8eb40cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 shutdown_connections 2023-10-25T16:23:06.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.792+0000 7f8eba9ca640 1 -- 172.21.15.177:0/959930205 wait complete. 2023-10-25T16:23:06.806 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:23:06.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:06.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- 172.21.15.177:0/1438063048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fe00039b0 msgr2=0x7f0fe0003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 --2- 172.21.15.177:0/1438063048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fe00039b0 0x7f0fe0003db0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800a9b0 tx=0x7f0fe801c810 comp rx=0 tx=0).stop 2023-10-25T16:23:06.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ff77fe640 1 -- 172.21.15.177:0/1438063048 reap_dead start 2023-10-25T16:23:06.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- 172.21.15.177:0/1438063048 shutdown_connections 2023-10-25T16:23:06.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- 172.21.15.177:0/1438063048 >> 172.21.15.177:0/1438063048 conn(0x7f0ff80caa30 msgr2=0x7f0ff80cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:06.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- 172.21.15.177:0/1438063048 shutdown_connections 2023-10-25T16:23:06.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- 172.21.15.177:0/1438063048 wait complete. 2023-10-25T16:23:06.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 Processor -- start 2023-10-25T16:23:06.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- start start 2023-10-25T16:23:06.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe00039b0 0x7f0ff814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 0x7f0ff815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff80ab270 0x7f0ff815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80ac3e0 con 0x7f0ff80aadf0 2023-10-25T16:23:06.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814ce90 con 0x7f0ff80ab270 2023-10-25T16:23:06.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ffd729640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80ab760 con 0x7f0fe00039b0 2023-10-25T16:23:06.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ff67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 0x7f0ff815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ff67fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 0x7f0ff815be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35734/0 (socket says 172.21.15.177:35734) 2023-10-25T16:23:06.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ff67fc640 1 -- 172.21.15.177:0/401965140 learned_addr learned my addr 172.21.15.177:0/401965140 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:06.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ff77fe640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff80ab270 0x7f0ff815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.924+0000 7f0ff6ffd640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe00039b0 0x7f0ff814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff67fc640 1 -- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe00039b0 msgr2=0x7f0ff814c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff67fc640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe00039b0 0x7f0ff814c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff67fc640 1 -- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff80ab270 msgr2=0x7f0ff815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:06.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff67fc640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff80ab270 0x7f0ff815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:06.928 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff67fc640 1 -- 172.21.15.177:0/401965140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80aba40 con 0x7f0ff80aadf0 2023-10-25T16:23:06.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff67fc640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 0x7f0ff815be50 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00d4e0 tx=0x7f0fec00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec012630 con 0x7f0ff80aadf0 2023-10-25T16:23:06.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fec0127d0 con 0x7f0ff80aadf0 2023-10-25T16:23:06.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80abd20 con 0x7f0ff80aadf0 2023-10-25T16:23:06.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec012be0 con 0x7f0ff80aadf0 2023-10-25T16:23:06.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8150770 con 0x7f0ff80aadf0 2023-10-25T16:23:06.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80ac520 con 0x7f0ff80aadf0 2023-10-25T16:23:06.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0fec012d40 con 0x7f0ff80aadf0 2023-10-25T16:23:06.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0fe40664a0 0x7f0fe4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:06.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0fec083df0 con 0x7f0ff80aadf0 2023-10-25T16:23:06.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f0fe406e090 con 0x7f0ff80aadf0 2023-10-25T16:23:06.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff6ffd640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0fe40664a0 0x7f0fe4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:06.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.928+0000 7f0ff6ffd640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0fe40664a0 0x7f0fe4068960 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80ad000 tx=0x7f0fe80b2040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:06.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:06.932+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ff80ac520 con 0x7f0ff80aadf0 2023-10-25T16:23:07.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.116+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ff80ac520 con 0x7f0ff80aadf0 2023-10-25T16:23:07.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.116+0000 7f0fdf7fe640 1 -- 172.21.15.177:0/401965140 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f0ff80ac520 con 0x7f0ff80aadf0 2023-10-25T16:23:07.113 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:07.114 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:23:07.114 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:23:07.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0fe40664a0 msgr2=0x7f0fe4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0fe40664a0 0x7f0fe4068960 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80ad000 tx=0x7f0fe80b2040 comp rx=0 tx=0).stop 2023-10-25T16:23:07.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 msgr2=0x7f0ff815be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 0x7f0ff815be50 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00d4e0 tx=0x7f0fec00d9a0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 shutdown_connections 2023-10-25T16:23:07.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0fe40664a0 0x7f0fe4068960 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff80ab270 0x7f0ff815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ff80aadf0 0x7f0ff815be50 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 --2- 172.21.15.177:0/401965140 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0fe00039b0 0x7f0ff814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 >> 172.21.15.177:0/401965140 conn(0x7f0ff80caa30 msgr2=0x7f0ff80cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:07.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 shutdown_connections 2023-10-25T16:23:07.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.120+0000 7f0ffd729640 1 -- 172.21.15.177:0/401965140 wait complete. 2023-10-25T16:23:07.131 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 -- 172.21.15.177:0/3624484619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 msgr2=0x7f2b98070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/3624484619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b98070b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009900 tx=0x7f2b8801c890 comp rx=0 tx=0).stop 2023-10-25T16:23:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 -- 172.21.15.177:0/3624484619 shutdown_connections 2023-10-25T16:23:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/3624484619 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b98070b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/3624484619 >> v2:172.21.15.184:3300/0 conn(0x7f2b9806b9e0 0x7f2b9806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 -- 172.21.15.177:0/3624484619 >> 172.21.15.177:0/3624484619 conn(0x7f2b980b2450 msgr2=0x7f2b980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 -- 172.21.15.177:0/3624484619 shutdown_connections 2023-10-25T16:23:07.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.244+0000 7f2b9eec5640 1 -- 172.21.15.177:0/3624484619 wait complete. 2023-10-25T16:23:07.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 Processor -- start 2023-10-25T16:23:07.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- start start 2023-10-25T16:23:07.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 0x7f2b98141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b981411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b981500f0 0x7f2b9815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98141d60 con 0x7f2b9806b9e0 2023-10-25T16:23:07.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98142040 con 0x7f2b981500f0 2023-10-25T16:23:07.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98142320 con 0x7f2b980706f0 2023-10-25T16:23:07.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 0x7f2b98141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 0x7f2b98141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35736/0 (socket says 172.21.15.177:35736) 2023-10-25T16:23:07.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 -- 172.21.15.177:0/565160539 learned_addr learned my addr 172.21.15.177:0/565160539 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:07.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b97fff640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b981411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9d462640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b981500f0 0x7f2b9815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 -- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 msgr2=0x7f2b981411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b981411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 -- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b981500f0 msgr2=0x7f2b9815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b981500f0 0x7f2b9815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 -- 172.21.15.177:0/565160539 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009560 con 0x7f2b9806b9e0 2023-10-25T16:23:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b97fff640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b981411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:23:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9cc61640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 0x7f2b98141770 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2b90007fd0 tx=0x7f2b9000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b900052d0 con 0x7f2b9806b9e0 2023-10-25T16:23:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b90003600 con 0x7f2b9806b9e0 2023-10-25T16:23:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98142600 con 0x7f2b9806b9e0 2023-10-25T16:23:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90003a10 con 0x7f2b9806b9e0 2023-10-25T16:23:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b98142e00 con 0x7f2b9806b9e0 2023-10-25T16:23:07.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.248+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98142b20 con 0x7f2b9806b9e0 2023-10-25T16:23:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.252+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b90003b70 con 0x7f2b9806b9e0 2023-10-25T16:23:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.252+0000 7f2b957fa640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b84066470 0x7f2b84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.252+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2b90083590 con 0x7f2b9806b9e0 2023-10-25T16:23:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.252+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7f2b8406e060 con 0x7f2b9806b9e0 2023-10-25T16:23:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.252+0000 7f2b97fff640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b84066470 0x7f2b84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.252+0000 7f2b97fff640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b84066470 0x7f2b84068930 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2b981472f0 tx=0x7f2b8c0094a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.256+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b98142b20 con 0x7f2b9806b9e0 2023-10-25T16:23:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b98142b20 con 0x7f2b9806b9e0 2023-10-25T16:23:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b957fa640 1 -- 172.21.15.177:0/565160539 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4930 (secure 0 0 0) 0x7f2b98142b20 con 0x7f2b9806b9e0 2023-10-25T16:23:07.425 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:07.425 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":58,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:20:55.099845+0000","modified":"2023-10-25T16:20:57.107431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":155948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_155948":{"gid":155948,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6835/1729696523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1729696523},{"type":"v1","addr":"172.21.15.184:6835","nonce":1729696523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-10-25T16:23:07.425 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 58 2023-10-25T16:23:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b84066470 msgr2=0x7f2b84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b84066470 0x7f2b84068930 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2b981472f0 tx=0x7f2b8c0094a0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 msgr2=0x7f2b98141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 0x7f2b98141770 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2b90007fd0 tx=0x7f2b9000c890 comp rx=0 tx=0).stop 2023-10-25T16:23:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 shutdown_connections 2023-10-25T16:23:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b84066470 0x7f2b84068930 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b981500f0 0x7f2b9815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b980706f0 0x7f2b981411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 --2- 172.21.15.177:0/565160539 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b9806b9e0 0x7f2b98141770 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 >> 172.21.15.177:0/565160539 conn(0x7f2b980b2450 msgr2=0x7f2b980c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 shutdown_connections 2023-10-25T16:23:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.428+0000 7f2b9eec5640 1 -- 172.21.15.177:0/565160539 wait complete. 2023-10-25T16:23:07.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:07.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/346707669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 msgr2=0x7fb7c80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/346707669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c80b4100 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fb7c809f200 tx=0x7fb7c401c750 comp rx=0 tx=0).stop 2023-10-25T16:23:07.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/346707669 shutdown_connections 2023-10-25T16:23:07.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/346707669 >> v2:172.21.15.184:3300/0 conn(0x7fb7c80b2120 0x7fb7c80d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/346707669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c80b4100 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/346707669 >> 172.21.15.177:0/346707669 conn(0x7fb7c809a5c0 msgr2=0x7fb7c80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:07.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/346707669 shutdown_connections 2023-10-25T16:23:07.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/346707669 wait complete. 2023-10-25T16:23:07.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 Processor -- start 2023-10-25T16:23:07.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- start start 2023-10-25T16:23:07.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80b2120 0x7fb7c81528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c80cdb10 0x7fb7c81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c8159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815b480 con 0x7fb7c815eba0 2023-10-25T16:23:07.558 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815a5c0 con 0x7fb7c80b2120 2023-10-25T16:23:07.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815a8a0 con 0x7fb7c80cdb10 2023-10-25T16:23:07.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c8159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c8159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35742/0 (socket says 172.21.15.177:35742) 2023-10-25T16:23:07.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 -- 172.21.15.177:0/781167413 learned_addr learned my addr 172.21.15.177:0/781167413 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:07.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 -- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c80cdb10 msgr2=0x7fb7c81530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c80cdb10 0x7fb7c81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 -- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80b2120 msgr2=0x7fb7c81528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80b2120 0x7fb7c81528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 -- 172.21.15.177:0/781167413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40094a0 con 0x7fb7c815eba0 2023-10-25T16:23:07.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7ce48c640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c8159be0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000cbc0 tx=0x7fb7c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:07.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0003b80 con 0x7fb7c815eba0 2023-10-25T16:23:07.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb7c0003df0 con 0x7fb7c815eba0 2023-10-25T16:23:07.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c815b110 con 0x7fb7c815eba0 2023-10-25T16:23:07.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000aa90 con 0x7fb7c815eba0 2023-10-25T16:23:07.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.556+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c815ab80 con 0x7fb7c815eba0 2023-10-25T16:23:07.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c81585f0 con 0x7fb7c815eba0 2023-10-25T16:23:07.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7c000abf0 con 0x7fb7c815eba0 2023-10-25T16:23:07.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7be7fc640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7ac0664a0 0x7fb7ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb7c00844f0 con 0x7fb7c815eba0 2023-10-25T16:23:07.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=163}) v3 -- 0x7fb7ac06e090 con 0x7fb7c815eba0 2023-10-25T16:23:07.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7cdc8b640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7ac0664a0 0x7fb7ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.560+0000 7fb7cdc8b640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7ac0664a0 0x7fb7ac068960 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40af000 tx=0x7fb7c40194f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:07.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.564+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7c00519c0 con 0x7fb7c815eba0 2023-10-25T16:23:07.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.720+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7c804daf0 con 0x7fb7c815eba0 2023-10-25T16:23:07.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7be7fc640 1 -- 172.21.15.177:0/781167413 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16726 (secure 0 0 0) 0x7fb7c0054fe0 con 0x7fb7c815eba0 2023-10-25T16:23:07.721 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:07.722 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":162,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:22:12.760090+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:20:53.275247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-25T16:20:54.087392+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:07.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7ac0664a0 msgr2=0x7fb7ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7ac0664a0 0x7fb7ac068960 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40af000 tx=0x7fb7c40194f0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 msgr2=0x7fb7c8159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c8159be0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000cbc0 tx=0x7fb7c000cbf0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 shutdown_connections 2023-10-25T16:23:07.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7ac0664a0 0x7fb7ac068960 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7c815eba0 0x7fb7c8159be0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7c80cdb10 0x7fb7c81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 --2- 172.21.15.177:0/781167413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80b2120 0x7fb7c81528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.724+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 >> 172.21.15.177:0/781167413 conn(0x7fb7c809a5c0 msgr2=0x7fb7c8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:07.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.728+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 shutdown_connections 2023-10-25T16:23:07.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.728+0000 7fb7cfeef640 1 -- 172.21.15.177:0/781167413 wait complete. 2023-10-25T16:23:07.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:23:07.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 -- 172.21.15.177:0/3591001279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 msgr2=0x7f6b440cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 --2- 172.21.15.177:0/3591001279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440cb7e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b1d60 tx=0x7f6b3401c8a0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 -- 172.21.15.177:0/3591001279 shutdown_connections 2023-10-25T16:23:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 --2- 172.21.15.177:0/3591001279 >> v2:172.21.15.184:3300/0 conn(0x7f6b440cbd20 0x7f6b440c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 --2- 172.21.15.177:0/3591001279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440cb7e0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 -- 172.21.15.177:0/3591001279 >> 172.21.15.177:0/3591001279 conn(0x7f6b440b0de0 msgr2=0x7f6b440b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 -- 172.21.15.177:0/3591001279 shutdown_connections 2023-10-25T16:23:07.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.868+0000 7f6b488d1640 1 -- 172.21.15.177:0/3591001279 wait complete. 2023-10-25T16:23:07.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 Processor -- start 2023-10-25T16:23:07.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- start start 2023-10-25T16:23:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b440c9dc0 0x7f6b441497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b440cbd20 0x7f6b440cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4406b510 con 0x7f6b44156e60 2023-10-25T16:23:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4406a8d0 con 0x7f6b440c9dc0 2023-10-25T16:23:07.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4406ab70 con 0x7f6b440cbd20 2023-10-25T16:23:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35768/0 (socket says 172.21.15.177:35768) 2023-10-25T16:23:07.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 -- 172.21.15.177:0/809019013 learned_addr learned my addr 172.21.15.177:0/809019013 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:07.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 -- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b440cbd20 msgr2=0x7f6b440cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b440cbd20 0x7f6b440cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 -- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b440c9dc0 msgr2=0x7f6b441497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:07.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b440c9dc0 0x7f6b441497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:07.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 -- 172.21.15.177:0/809019013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009560 con 0x7f6b44156e60 2023-10-25T16:23:07.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b42d9d640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440ce290 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c710 tx=0x7f6b3c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:07.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c006d60 con 0x7f6b44156e60 2023-10-25T16:23:07.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b3c00ce20 con 0x7f6b44156e60 2023-10-25T16:23:07.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4406ae50 con 0x7f6b44156e60 2023-10-25T16:23:07.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c003be0 con 0x7f6b44156e60 2023-10-25T16:23:07.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b44149d30 con 0x7f6b44156e60 2023-10-25T16:23:07.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.872+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4406b650 con 0x7f6b44156e60 2023-10-25T16:23:07.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.876+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b3c003d40 con 0x7f6b44156e60 2023-10-25T16:23:07.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.876+0000 7f6b32ffd640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b24066470 0x7f6b24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:07.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.876+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6b3c083c80 con 0x7f6b44156e60 2023-10-25T16:23:07.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.876+0000 7f6b4259c640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b24066470 0x7f6b24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:07.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.876+0000 7f6b4259c640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b24066470 0x7f6b24068930 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6b340af000 tx=0x7f6b34019640 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:07.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:07.880+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b4406b650 con 0x7f6b44156e60 2023-10-25T16:23:08.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.052+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6b4406b650 con 0x7f6b44156e60 2023-10-25T16:23:08.051 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:23:08.052+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:23:08.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.056+0000 7f6b32ffd640 1 -- 172.21.15.177:0/809019013 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6b4406b650 con 0x7f6b44156e60 2023-10-25T16:23:08.054 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:23:08.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b24066470 msgr2=0x7f6b24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:08.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b24066470 0x7f6b24068930 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6b340af000 tx=0x7f6b34019640 comp rx=0 tx=0).stop 2023-10-25T16:23:08.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 msgr2=0x7f6b440ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:08.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440ce290 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c710 tx=0x7f6b3c00cbd0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 shutdown_connections 2023-10-25T16:23:08.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6b24066470 0x7f6b24068930 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b44156e60 0x7f6b440ce290 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b440cbd20 0x7f6b440cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 --2- 172.21.15.177:0/809019013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b440c9dc0 0x7f6b441497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 >> 172.21.15.177:0/809019013 conn(0x7f6b440b0de0 msgr2=0x7f6b44158780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:08.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 shutdown_connections 2023-10-25T16:23:08.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.060+0000 7f6b488d1640 1 -- 172.21.15.177:0/809019013 wait complete. 2023-10-25T16:23:08.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:23:08.075 INFO:tasks.ceph.mds.b.smithi184.stderr: -9363> 2023-10-25T16:20:57.636+0000 7fbdb8a92640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:23:08.135 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:23:08.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 -- 172.21.15.177:0/3444879250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6834003b40 msgr2=0x7f6834003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:08.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 --2- 172.21.15.177:0/3444879250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6834003b40 0x7f6834003f40 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f684000c630 tx=0x7f684001d2e0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f6847fff640 1 -- 172.21.15.177:0/3444879250 reap_dead start 2023-10-25T16:23:08.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 -- 172.21.15.177:0/3444879250 shutdown_connections 2023-10-25T16:23:08.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 -- 172.21.15.177:0/3444879250 >> 172.21.15.177:0/3444879250 conn(0x7f684809a5c0 msgr2=0x7f68480d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:08.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 -- 172.21.15.177:0/3444879250 shutdown_connections 2023-10-25T16:23:08.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 -- 172.21.15.177:0/3444879250 wait complete. 2023-10-25T16:23:08.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 Processor -- start 2023-10-25T16:23:08.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.188+0000 7f684df95640 1 -- start start 2023-10-25T16:23:08.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6834003b40 0x7f6848159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:08.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68481f50c0 0x7f684806b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:08.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 0x7f684806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:08.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684815f090 con 0x7f68481f5540 2023-10-25T16:23:08.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684815fc10 con 0x7f68481f50c0 2023-10-25T16:23:08.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684815f2e0 con 0x7f6834003b40 2023-10-25T16:23:08.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 0x7f684806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:08.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 0x7f684806ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35794/0 (socket says 172.21.15.177:35794) 2023-10-25T16:23:08.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 -- 172.21.15.177:0/660514167 learned_addr learned my addr 172.21.15.177:0/660514167 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:08.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f68477fe640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6834003b40 0x7f6848159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:08.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6846ffd640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68481f50c0 0x7f684806b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:08.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 -- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6834003b40 msgr2=0x7f6848159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:08.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6834003b40 0x7f6848159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 -- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68481f50c0 msgr2=0x7f684806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:08.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68481f50c0 0x7f684806b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:08.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 -- 172.21.15.177:0/660514167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684815f5c0 con 0x7f68481f5540 2023-10-25T16:23:08.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6846ffd640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68481f50c0 0x7f684806b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:23:08.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f6847fff640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 0x7f684806ba00 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f684808ac30 tx=0x7f6838001780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:08.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011660 con 0x7f68481f5540 2023-10-25T16:23:08.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f68380118d0 con 0x7f68481f5540 2023-10-25T16:23:08.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684815f8a0 con 0x7f68481f5540 2023-10-25T16:23:08.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011ce0 con 0x7f68481f5540 2023-10-25T16:23:08.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68480c9fb0 con 0x7f68481f5540 2023-10-25T16:23:08.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684815fd80 con 0x7f68481f5540 2023-10-25T16:23:08.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f683801c460 con 0x7f68481f5540 2023-10-25T16:23:08.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f683ffff640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6828066470 0x7f6828068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:08.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f68380846a0 con 0x7f68481f5540 2023-10-25T16:23:08.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.192+0000 7f68477fe640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6828066470 0x7f6828068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:08.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.196+0000 7f68477fe640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6828066470 0x7f6828068930 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f68400ac000 tx=0x7f684001a080 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:08.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.196+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6838051a10 con 0x7f68481f5540 2023-10-25T16:23:08.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:08.372+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f684804daf0 con 0x7f68481f5540 2023-10-25T16:23:09.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.068+0000 7f683ffff640 1 -- 172.21.15.177:0/660514167 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6838055030 con 0x7f68481f5540 2023-10-25T16:23:09.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6828066470 msgr2=0x7f6828068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:09.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6828066470 0x7f6828068930 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f68400ac000 tx=0x7f684001a080 comp rx=0 tx=0).stop 2023-10-25T16:23:09.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 msgr2=0x7f684806ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:09.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 0x7f684806ba00 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f684808ac30 tx=0x7f6838001780 comp rx=0 tx=0).stop 2023-10-25T16:23:09.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 shutdown_connections 2023-10-25T16:23:09.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6828066470 0x7f6828068930 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68481f5540 0x7f684806ba00 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68481f50c0 0x7f684806b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 --2- 172.21.15.177:0/660514167 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6834003b40 0x7f6848159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 >> 172.21.15.177:0/660514167 conn(0x7f684809a5c0 msgr2=0x7f68480b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:09.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 shutdown_connections 2023-10-25T16:23:09.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.072+0000 7f684df95640 1 -- 172.21.15.177:0/660514167 wait complete. 2023-10-25T16:23:09.089 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:23:09.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- 172.21.15.177:0/3170244659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d40159360 msgr2=0x7f7d400ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:09.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/3170244659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d40159360 0x7f7d400ca260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009bf0 tx=0x7f7d3801ca60 comp rx=0 tx=0).stop 2023-10-25T16:23:09.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- 172.21.15.177:0/3170244659 shutdown_connections 2023-10-25T16:23:09.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/3170244659 >> v2:172.21.15.184:3300/0 conn(0x7f7d400b1430 0x7f7d4015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/3170244659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d40159360 0x7f7d400ca260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- 172.21.15.177:0/3170244659 >> 172.21.15.177:0/3170244659 conn(0x7f7d40069920 msgr2=0x7f7d40069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:09.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- 172.21.15.177:0/3170244659 shutdown_connections 2023-10-25T16:23:09.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- 172.21.15.177:0/3170244659 wait complete. 2023-10-25T16:23:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 Processor -- start 2023-10-25T16:23:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- start start 2023-10-25T16:23:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400b0fd0 0x7f7d4015f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b1430 0x7f7d401576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 0x7f7d40150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40155470 con 0x7f7d40159360 2023-10-25T16:23:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40160f10 con 0x7f7d400b1430 2023-10-25T16:23:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d44ec6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401548f0 con 0x7f7d400b0fd0 2023-10-25T16:23:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 0x7f7d40150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 0x7f7d40150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35802/0 (socket says 172.21.15.177:35802) 2023-10-25T16:23:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 -- 172.21.15.177:0/1576171992 learned_addr learned my addr 172.21.15.177:0/1576171992 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3e59c640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400b0fd0 0x7f7d4015f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3dd9b640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b1430 0x7f7d401576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 -- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400b0fd0 msgr2=0x7f7d4015f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:09.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400b0fd0 0x7f7d4015f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 -- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b1430 msgr2=0x7f7d401576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:09.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b1430 0x7f7d401576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:09.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 -- 172.21.15.177:0/1576171992 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009820 con 0x7f7d40159360 2023-10-25T16:23:09.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.228+0000 7f7d3ed9d640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 0x7f7d40150540 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000e970 tx=0x7f7d3000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:09.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300096d0 con 0x7f7d40159360 2023-10-25T16:23:09.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d3000ccc0 con 0x7f7d40159360 2023-10-25T16:23:09.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d40154bd0 con 0x7f7d40159360 2023-10-25T16:23:09.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30005280 con 0x7f7d40159360 2023-10-25T16:23:09.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d40155190 con 0x7f7d40159360 2023-10-25T16:23:09.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d40073360 con 0x7f7d40159360 2023-10-25T16:23:09.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d300053e0 con 0x7f7d40159360 2023-10-25T16:23:09.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d2effd640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d20066470 0x7f7d20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:09.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7d30014070 con 0x7f7d40159360 2023-10-25T16:23:09.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d3e59c640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d20066470 0x7f7d20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:09.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.232+0000 7f7d3e59c640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d20066470 0x7f7d20068930 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7d380af000 tx=0x7f7d3801b2a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:09.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.236+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d30055880 con 0x7f7d40159360 2023-10-25T16:23:09.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:09.388+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d400cda40 con 0x7f7d40159360 2023-10-25T16:23:10.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.072+0000 7f7d2effd640 1 -- 172.21.15.177:0/1576171992 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v165) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7d30055410 con 0x7f7d40159360 2023-10-25T16:23:10.069 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:23:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d20066470 msgr2=0x7f7d20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d20066470 0x7f7d20068930 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7d380af000 tx=0x7f7d3801b2a0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 msgr2=0x7f7d40150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 0x7f7d40150540 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000e970 tx=0x7f7d3000ee30 comp rx=0 tx=0).stop 2023-10-25T16:23:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 shutdown_connections 2023-10-25T16:23:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d20066470 0x7f7d20068930 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d40159360 0x7f7d40150540 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d400b1430 0x7f7d401576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 --2- 172.21.15.177:0/1576171992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d400b0fd0 0x7f7d4015f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 >> 172.21.15.177:0/1576171992 conn(0x7f7d40069920 msgr2=0x7f7d40159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 shutdown_connections 2023-10-25T16:23:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.076+0000 7f7d44ec6640 1 -- 172.21.15.177:0/1576171992 wait complete. 2023-10-25T16:23:10.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:23:10.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/3785206032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 msgr2=0x7f5ae415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:10.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/3785206032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415fc60 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009900 tx=0x7f5acc01c850 comp rx=0 tx=0).stop 2023-10-25T16:23:10.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/3785206032 shutdown_connections 2023-10-25T16:23:10.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/3785206032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae40ccf00 0x7f5ae40d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/3785206032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415fc60 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/3785206032 >> 172.21.15.177:0/3785206032 conn(0x7f5ae409a5b0 msgr2=0x7f5ae40d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/3785206032 shutdown_connections 2023-10-25T16:23:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/3785206032 wait complete. 2023-10-25T16:23:10.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 Processor -- start 2023-10-25T16:23:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- start start 2023-10-25T16:23:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae40ccf00 0x7f5ae40b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae415b6f0 0x7f5ae40b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40b1180 con 0x7f5ae40cff40 2023-10-25T16:23:10.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40b1fe0 con 0x7f5ae40ccf00 2023-10-25T16:23:10.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae9fdc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40b13d0 con 0x7f5ae415b6f0 2023-10-25T16:23:10.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:10.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:35822/0 (socket says 172.21.15.177:35822) 2023-10-25T16:23:10.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 -- 172.21.15.177:0/107080887 learned_addr learned my addr 172.21.15.177:0/107080887 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:10.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae3fff640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae415b6f0 0x7f5ae40b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:10.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae37fe640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae40ccf00 0x7f5ae40b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:10.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 -- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae415b6f0 msgr2=0x7f5ae40b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:10.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae415b6f0 0x7f5ae40b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 -- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae40ccf00 msgr2=0x7f5ae40b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:10.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae40ccf00 0x7f5ae40b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:10.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.236+0000 7f5ae2ffd640 1 -- 172.21.15.177:0/107080887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009560 con 0x7f5ae40cff40 2023-10-25T16:23:10.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5ae2ffd640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415d9e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0b0040 tx=0x7f5acc0a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:10.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0052f0 con 0x7f5ae40cff40 2023-10-25T16:23:10.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5acc005540 con 0x7f5ae40cff40 2023-10-25T16:23:10.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae40b16b0 con 0x7f5ae40cff40 2023-10-25T16:23:10.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc004930 con 0x7f5ae40cff40 2023-10-25T16:23:10.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae40b1c70 con 0x7f5ae40cff40 2023-10-25T16:23:10.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae4073360 con 0x7f5ae40cff40 2023-10-25T16:23:10.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5acc0b4070 con 0x7f5ae40cff40 2023-10-25T16:23:10.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5adbfff640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac4066470 0x7f5ac4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:10.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f5acc11e0d0 con 0x7f5ae40cff40 2023-10-25T16:23:10.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5ae37fe640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac4066470 0x7f5ac4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:10.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.240+0000 7f5ae37fe640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac4066470 0x7f5ac4068930 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009f20 tx=0x7f5adc0094d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:10.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.244+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5acc0eb700 con 0x7f5ae40cff40 2023-10-25T16:23:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:10.400+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ae40ce8d0 con 0x7f5ae40cff40 2023-10-25T16:23:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.076+0000 7f5adbfff640 1 -- 172.21.15.177:0/107080887 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v166) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5acc0eed20 con 0x7f5ae40cff40 2023-10-25T16:23:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:23:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac4066470 msgr2=0x7f5ac4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac4066470 0x7f5ac4068930 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009f20 tx=0x7f5adc0094d0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 msgr2=0x7f5ae415d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415d9e0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0b0040 tx=0x7f5acc0a5840 comp rx=0 tx=0).stop 2023-10-25T16:23:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 shutdown_connections 2023-10-25T16:23:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ac4066470 0x7f5ac4068930 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae415b6f0 0x7f5ae40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae40cff40 0x7f5ae415d9e0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 --2- 172.21.15.177:0/107080887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae40ccf00 0x7f5ae40b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 >> 172.21.15.177:0/107080887 conn(0x7f5ae409a5b0 msgr2=0x7f5ae40cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 shutdown_connections 2023-10-25T16:23:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.080+0000 7f5ae9fdc640 1 -- 172.21.15.177:0/107080887 wait complete. 2023-10-25T16:23:11.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:23:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 -- 172.21.15.177:0/201783634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d9406f570 msgr2=0x7f7d9406b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/201783634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d9406f570 0x7f7d9406b980 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f7d840098f0 tx=0x7f7d8401c830 comp rx=0 tx=0).stop 2023-10-25T16:23:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 -- 172.21.15.177:0/201783634 shutdown_connections 2023-10-25T16:23:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/201783634 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d9406f570 0x7f7d9406b980 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/201783634 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d94140e90 0x7f7d940af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 -- 172.21.15.177:0/201783634 >> 172.21.15.177:0/201783634 conn(0x7f7d940b2450 msgr2=0x7f7d940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 -- 172.21.15.177:0/201783634 shutdown_connections 2023-10-25T16:23:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.228+0000 7f7d9bf55640 1 -- 172.21.15.177:0/201783634 wait complete. 2023-10-25T16:23:11.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 Processor -- start 2023-10-25T16:23:11.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- start start 2023-10-25T16:23:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d9406bec0 0x7f7d9413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d9406f570 0x7f7d94070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 0x7f7d940adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9413fee0 con 0x7f7d94140e90 2023-10-25T16:23:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940aced0 con 0x7f7d9406f570 2023-10-25T16:23:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d940ad1b0 con 0x7f7d9406bec0 2023-10-25T16:23:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 0x7f7d940adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 0x7f7d940adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53292/0 (socket says 172.21.15.177:53292) 2023-10-25T16:23:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 -- 172.21.15.177:0/2468421154 learned_addr learned my addr 172.21.15.177:0/2468421154 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 -- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d9406bec0 msgr2=0x7f7d9413f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d9406bec0 0x7f7d9413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 -- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d9406f570 msgr2=0x7f7d94070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d9406f570 0x7f7d94070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 -- 172.21.15.177:0/2468421154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009500 con 0x7f7d94140e90 2023-10-25T16:23:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9a4f2640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 0x7f7d940adc90 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00c770 tx=0x7f7d8c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c003b80 con 0x7f7d94140e90 2023-10-25T16:23:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7d8c003ce0 con 0x7f7d94140e90 2023-10-25T16:23:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940ad490 con 0x7f7d94140e90 2023-10-25T16:23:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00aab0 con 0x7f7d94140e90 2023-10-25T16:23:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9413c650 con 0x7f7d94140e90 2023-10-25T16:23:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9413c840 con 0x7f7d94140e90 2023-10-25T16:23:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d8c00ac10 con 0x7f7d94140e90 2023-10-25T16:23:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d8a7fc640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d78066470 0x7f7d78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7d8c083ba0 con 0x7f7d94140e90 2023-10-25T16:23:11.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.232+0000 7f7d99cf1640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d78066470 0x7f7d78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:11.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.236+0000 7f7d99cf1640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d78066470 0x7f7d78068930 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000a860 tx=0x7f7d90005b60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:11.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.236+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d9413c840 con 0x7f7d94140e90 2023-10-25T16:23:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.392+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7f7d9413c840 con 0x7f7d94140e90 2023-10-25T16:23:11.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.400+0000 7f7d8a7fc640 1 -- 172.21.15.177:0/2468421154 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v34) v1 ==== 71+0+0 (secure 0 0 0) 0x7f7d9413c840 con 0x7f7d94140e90 2023-10-25T16:23:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d78066470 msgr2=0x7f7d78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d78066470 0x7f7d78068930 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000a860 tx=0x7f7d90005b60 comp rx=0 tx=0).stop 2023-10-25T16:23:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 msgr2=0x7f7d940adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 0x7f7d940adc90 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c00c770 tx=0x7f7d8c00cc30 comp rx=0 tx=0).stop 2023-10-25T16:23:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 shutdown_connections 2023-10-25T16:23:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7d78066470 0x7f7d78068930 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d94140e90 0x7f7d940adc90 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d9406f570 0x7f7d94070000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 --2- 172.21.15.177:0/2468421154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d9406bec0 0x7f7d9413f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 >> 172.21.15.177:0/2468421154 conn(0x7f7d940b2450 msgr2=0x7f7d94156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:11.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 shutdown_connections 2023-10-25T16:23:11.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.404+0000 7f7d9bf55640 1 -- 172.21.15.177:0/2468421154 wait complete. 2023-10-25T16:23:11.417 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-10-25T16:23:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/4292254423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec8140e90 msgr2=0x7f5ec80af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/4292254423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec8140e90 0x7f5ec80af580 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80ca640 tx=0x7f5ec001c7b0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/4292254423 shutdown_connections 2023-10-25T16:23:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/4292254423 >> v2:172.21.15.184:3300/0 conn(0x7f5ec806f570 0x7f5ec806b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/4292254423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec8140e90 0x7f5ec80af580 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/4292254423 >> 172.21.15.177:0/4292254423 conn(0x7f5ec80b2450 msgr2=0x7f5ec80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/4292254423 shutdown_connections 2023-10-25T16:23:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/4292254423 wait complete. 2023-10-25T16:23:11.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 Processor -- start 2023-10-25T16:23:11.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- start start 2023-10-25T16:23:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ec806bec0 0x7f5ec80a80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 0x7f5ec813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ec8140e90 0x7f5ec80a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80a72d0 con 0x7f5ec806f570 2023-10-25T16:23:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80a87d0 con 0x7f5ec8140e90 2023-10-25T16:23:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80a8ab0 con 0x7f5ec806bec0 2023-10-25T16:23:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 0x7f5ec813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 0x7f5ec813b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53312/0 (socket says 172.21.15.177:53312) 2023-10-25T16:23:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 -- 172.21.15.177:0/173528420 learned_addr learned my addr 172.21.15.177:0/173528420 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecdbd2640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ec806bec0 0x7f5ec80a80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ece3d3640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ec8140e90 0x7f5ec80a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 -- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ec806bec0 msgr2=0x7f5ec80a80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ec806bec0 0x7f5ec80a80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 -- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ec8140e90 msgr2=0x7f5ec80a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ec8140e90 0x7f5ec80a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 -- 172.21.15.177:0/173528420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009560 con 0x7f5ec806f570 2023-10-25T16:23:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ece3d3640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ec8140e90 0x7f5ec80a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecd3d1640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 0x7f5ec813b6c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000cce0 tx=0x7f5eb000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0004b30 con 0x7f5ec806f570 2023-10-25T16:23:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5eb0004d80 con 0x7f5ec806f570 2023-10-25T16:23:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec80a8d90 con 0x7f5ec806f570 2023-10-25T16:23:11.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0005290 con 0x7f5ec806f570 2023-10-25T16:23:11.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.544+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec813bc00 con 0x7f5ec806f570 2023-10-25T16:23:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.548+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec804daf0 con 0x7f5ec806f570 2023-10-25T16:23:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.548+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5eb00053f0 con 0x7f5ec806f570 2023-10-25T16:23:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.548+0000 7f5ec67fc640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ea8066470 0x7f5ea8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.548+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5eb0084480 con 0x7f5ec806f570 2023-10-25T16:23:11.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.548+0000 7f5ecdbd2640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ea8066470 0x7f5ea8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:11.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.548+0000 7f5ecdbd2640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ea8066470 0x7f5ea8068930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00ae000 tx=0x7f5ec001aff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:11.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.552+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5eb0051c00 con 0x7f5ec806f570 2023-10-25T16:23:11.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:11.756+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f5ec80aa940 con 0x7f5ec806f570 2023-10-25T16:23:12.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.088+0000 7f5ec67fc640 1 -- 172.21.15.177:0/173528420 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v491) v1 ==== 132+0+0 (secure 0 0 0) 0x7f5eb001d0c0 con 0x7f5ec806f570 2023-10-25T16:23:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ea8066470 msgr2=0x7f5ea8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ea8066470 0x7f5ea8068930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00ae000 tx=0x7f5ec001aff0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 msgr2=0x7f5ec813b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 0x7f5ec813b6c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000cce0 tx=0x7f5eb000a620 comp rx=0 tx=0).stop 2023-10-25T16:23:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 shutdown_connections 2023-10-25T16:23:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5ea8066470 0x7f5ea8068930 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ec8140e90 0x7f5ec80a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ec806f570 0x7f5ec813b6c0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 --2- 172.21.15.177:0/173528420 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ec806bec0 0x7f5ec80a80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 >> 172.21.15.177:0/173528420 conn(0x7f5ec80b2450 msgr2=0x7f5ec8070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 shutdown_connections 2023-10-25T16:23:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.092+0000 7f5ecfe36640 1 -- 172.21.15.177:0/173528420 wait complete. 2023-10-25T16:23:12.116 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-25T16:23:12.116 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-10-25T16:23:12.117 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-10-25T16:23:12.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:12.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 -- 172.21.15.177:0/3312844054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 msgr2=0x7f8dc00cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/3312844054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 0x7f8dc00cbb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009c80 tx=0x7f8db801cd80 comp rx=0 tx=0).stop 2023-10-25T16:23:12.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 -- 172.21.15.177:0/3312844054 shutdown_connections 2023-10-25T16:23:12.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/3312844054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 0x7f8dc00cbb10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/3312844054 >> v2:172.21.15.184:3300/0 conn(0x7f8dc006ba20 0x7f8dc015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 -- 172.21.15.177:0/3312844054 >> 172.21.15.177:0/3312844054 conn(0x7f8dc00b2450 msgr2=0x7f8dc00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:12.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 -- 172.21.15.177:0/3312844054 shutdown_connections 2023-10-25T16:23:12.249 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.248+0000 7f8dc78cc640 1 -- 172.21.15.177:0/3312844054 wait complete. 2023-10-25T16:23:12.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 Processor -- start 2023-10-25T16:23:12.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 -- start start 2023-10-25T16:23:12.251 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 0x7f8dc0149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dc006be00 0x7f8dc00abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 0x7f8dc013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00ac400 con 0x7f8dc006ba20 2023-10-25T16:23:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0153430 con 0x7f8dc006be00 2023-10-25T16:23:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc013ebb0 con 0x7f8dc0070e30 2023-10-25T16:23:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 0x7f8dc0149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 0x7f8dc0149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53318/0 (socket says 172.21.15.177:53318) 2023-10-25T16:23:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 -- 172.21.15.177:0/1364516678 learned_addr learned my addr 172.21.15.177:0/1364516678 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5e69640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 0x7f8dc013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc4e67640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dc006be00 0x7f8dc00abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 -- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 msgr2=0x7f8dc013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 0x7f8dc013c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 -- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dc006be00 msgr2=0x7f8dc00abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dc006be00 0x7f8dc00abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 -- 172.21.15.177:0/1364516678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80098e0 con 0x7f8dc006ba20 2023-10-25T16:23:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc5668640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 0x7f8dc0149d90 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00e9f0 tx=0x7f8dbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc009710 con 0x7f8dc006ba20 2023-10-25T16:23:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8dbc00ce70 con 0x7f8dc006ba20 2023-10-25T16:23:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc01536d0 con 0x7f8dc006ba20 2023-10-25T16:23:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc010690 con 0x7f8dc006ba20 2023-10-25T16:23:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.252+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc013cef0 con 0x7f8dc006ba20 2023-10-25T16:23:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.256+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc0153bd0 con 0x7f8dc006ba20 2023-10-25T16:23:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.256+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8dbc0107f0 con 0x7f8dc006ba20 2023-10-25T16:23:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.256+0000 7f8db5ffb640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.256+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8dbc014070 con 0x7f8dc006ba20 2023-10-25T16:23:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.256+0000 7f8dc4e67640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.256+0000 7f8dc4e67640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8dc01f8060 tx=0x7f8db0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.260+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8dbc050090 con 0x7f8dc006ba20 2023-10-25T16:23:12.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.404+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dc004daf0 con 0x7f8dc006ba20 2023-10-25T16:23:12.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.404+0000 7f8db5ffb640 1 -- 172.21.15.177:0/1364516678 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+13023 (secure 0 0 0) 0x7f8dbc055a50 con 0x7f8dc006ba20 2023-10-25T16:23:12.403 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:12.403 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":166,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:23:11.074764+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6835/1729696523":"2023-10-26T16:23:08.056719+0000","172.21.15.184:6834/1729696523":"2023-10-26T16:23:08.056719+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:12.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 msgr2=0x7f8da4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8dc01f8060 tx=0x7f8db0009040 comp rx=0 tx=0).stop 2023-10-25T16:23:12.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 msgr2=0x7f8dc0149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 0x7f8dc0149d90 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00e9f0 tx=0x7f8dbc00eeb0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 shutdown_connections 2023-10-25T16:23:12.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8da4066470 0x7f8da4068930 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8dc0070e30 0x7f8dc013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8dc006be00 0x7f8dc00abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 --2- 172.21.15.177:0/1364516678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8dc006ba20 0x7f8dc0149d90 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 >> 172.21.15.177:0/1364516678 conn(0x7f8dc00b2450 msgr2=0x7f8dc00b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:12.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 shutdown_connections 2023-10-25T16:23:12.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.408+0000 7f8dc78cc640 1 -- 172.21.15.177:0/1364516678 wait complete. 2023-10-25T16:23:12.421 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:23:12.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:23:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/4276530284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2600047d0 msgr2=0x7fb260004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/4276530284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2600047d0 0x7fb260004c50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb264005fd0 tx=0x7fb26401d230 comp rx=0 tx=0).stop 2023-10-25T16:23:12.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27a644640 1 -- 172.21.15.177:0/4276530284 reap_dead start 2023-10-25T16:23:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/4276530284 shutdown_connections 2023-10-25T16:23:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/4276530284 >> 172.21.15.177:0/4276530284 conn(0x7fb2740b2450 msgr2=0x7fb2740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/4276530284 shutdown_connections 2023-10-25T16:23:12.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/4276530284 wait complete. 2023-10-25T16:23:12.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 Processor -- start 2023-10-25T16:23:12.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- start start 2023-10-25T16:23:12.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2741f1640 0x7fb274159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 0x7fb27414d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb274137f10 0x7fb27414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27414e250 con 0x7fb274137a90 2023-10-25T16:23:12.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27413ad80 con 0x7fb274137f10 2023-10-25T16:23:12.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27413aaa0 con 0x7fb2741f1640 2023-10-25T16:23:12.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 0x7fb27414d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 0x7fb27414d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53332/0 (socket says 172.21.15.177:53332) 2023-10-25T16:23:12.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 -- 172.21.15.177:0/206621566 learned_addr learned my addr 172.21.15.177:0/206621566 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:12.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279e43640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2741f1640 0x7fb274159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27a644640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb274137f10 0x7fb27414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 -- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2741f1640 msgr2=0x7fb274159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2741f1640 0x7fb274159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 -- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb274137f10 msgr2=0x7fb27414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb274137f10 0x7fb27414d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 -- 172.21.15.177:0/206621566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274159380 con 0x7fb274137a90 2023-10-25T16:23:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb279642640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 0x7fb27414d390 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fb264000c10 tx=0x7fb2640ad4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:12.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640ad980 con 0x7fb274137a90 2023-10-25T16:23:12.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb2640adae0 con 0x7fb274137a90 2023-10-25T16:23:12.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640b8420 con 0x7fb274137a90 2023-10-25T16:23:12.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb274159660 con 0x7fb274137a90 2023-10-25T16:23:12.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.544+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2741f1a20 con 0x7fb274137a90 2023-10-25T16:23:12.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.548+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb2640aa030 con 0x7fb274137a90 2023-10-25T16:23:12.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.548+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27404daf0 con 0x7fb274137a90 2023-10-25T16:23:12.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.548+0000 7fb26a7fc640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2580664a0 0x7fb258068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.548+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb26411ecf0 con 0x7fb274137a90 2023-10-25T16:23:12.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.548+0000 7fb279e43640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2580664a0 0x7fb258068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.548+0000 7fb279e43640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2580664a0 0x7fb258068960 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb270000c10 tx=0x7fb2700011d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:12.551 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.552+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2640ec470 con 0x7fb274137a90 2023-10-25T16:23:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.704+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2740ca670 con 0x7fb274137a90 2023-10-25T16:23:12.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.704+0000 7fb26a7fc640 1 -- 172.21.15.177:0/206621566 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v166) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2640efa90 con 0x7fb274137a90 2023-10-25T16:23:12.703 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:23:12.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2580664a0 msgr2=0x7fb258068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2580664a0 0x7fb258068960 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb270000c10 tx=0x7fb2700011d0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 msgr2=0x7fb27414d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 0x7fb27414d390 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fb264000c10 tx=0x7fb2640ad4d0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 shutdown_connections 2023-10-25T16:23:12.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2580664a0 0x7fb258068960 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb274137f10 0x7fb27414d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb274137a90 0x7fb27414d390 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 --2- 172.21.15.177:0/206621566 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2741f1640 0x7fb274159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 >> 172.21.15.177:0/206621566 conn(0x7fb2740b2450 msgr2=0x7fb27415aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:12.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 shutdown_connections 2023-10-25T16:23:12.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.708+0000 7fb27c0a7640 1 -- 172.21.15.177:0/206621566 wait complete. 2023-10-25T16:23:12.722 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-25T16:23:12.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 -- 172.21.15.177:0/117775655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415bdb0 msgr2=0x7fd7640aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/117775655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415bdb0 0x7fd7640aebc0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fd7640cdef0 tx=0x7fd75801c880 comp rx=0 tx=0).stop 2023-10-25T16:23:12.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 -- 172.21.15.177:0/117775655 shutdown_connections 2023-10-25T16:23:12.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/117775655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd7640af100 0x7fd764158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/117775655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd76415bdb0 0x7fd7640aebc0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/117775655 >> v2:172.21.15.184:3300/0 conn(0x7fd76414e810 0x7fd7640cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 -- 172.21.15.177:0/117775655 >> 172.21.15.177:0/117775655 conn(0x7fd7640b2450 msgr2=0x7fd7640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:12.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 -- 172.21.15.177:0/117775655 shutdown_connections 2023-10-25T16:23:12.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.848+0000 7fd76c3cf640 1 -- 172.21.15.177:0/117775655 wait complete. 2023-10-25T16:23:12.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 Processor -- start 2023-10-25T16:23:12.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- start start 2023-10-25T16:23:12.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 0x7fd764070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76414e810 0x7fd764145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd76415bdb0 0x7fd7641450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641460e0 con 0x7fd7640af100 2023-10-25T16:23:12.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406fe80 con 0x7fd76415bdb0 2023-10-25T16:23:12.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406f570 con 0x7fd76414e810 2023-10-25T16:23:12.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 0x7fd764070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 0x7fd764070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53354/0 (socket says 172.21.15.177:53354) 2023-10-25T16:23:12.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 -- 172.21.15.177:0/39596520 learned_addr learned my addr 172.21.15.177:0/39596520 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:12.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76996a640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76414e810 0x7fd764145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 -- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76414e810 msgr2=0x7fd764145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76414e810 0x7fd764145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a96c640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd76415bdb0 0x7fd7641450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 -- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd76415bdb0 msgr2=0x7fd7641450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:12.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd76415bdb0 0x7fd7641450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:12.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 -- 172.21.15.177:0/39596520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758009500 con 0x7fd7640af100 2023-10-25T16:23:12.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76a16b640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 0x7fd764070fa0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd75400ccb0 tx=0x7fd75400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:12.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754004b30 con 0x7fd7640af100 2023-10-25T16:23:12.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd754004da0 con 0x7fd7640af100 2023-10-25T16:23:12.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7640716a0 con 0x7fd7640af100 2023-10-25T16:23:12.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754005280 con 0x7fd7640af100 2023-10-25T16:23:12.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76406fb10 con 0x7fd7640af100 2023-10-25T16:23:12.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.852+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76414a440 con 0x7fd7640af100 2023-10-25T16:23:12.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.856+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7540053e0 con 0x7fd7640af100 2023-10-25T16:23:12.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.856+0000 7fd762ffd640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7500664a0 0x7fd750068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:12.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.856+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd754084450 con 0x7fd7640af100 2023-10-25T16:23:12.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.856+0000 7fd76996a640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7500664a0 0x7fd750068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:12.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.856+0000 7fd76996a640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7500664a0 0x7fd750068960 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd7580ae000 tx=0x7fd75801b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:12.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:12.860+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd754051bd0 con 0x7fd7640af100 2023-10-25T16:23:13.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.056+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fd76404daf0 con 0x7fd7640af100 2023-10-25T16:23:13.090 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.092+0000 7fd762ffd640 1 -- 172.21.15.177:0/39596520 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v492) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd75401d020 con 0x7fd7640af100 2023-10-25T16:23:13.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7500664a0 msgr2=0x7fd750068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7500664a0 0x7fd750068960 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd7580ae000 tx=0x7fd75801b0c0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 msgr2=0x7fd764070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 0x7fd764070fa0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fd75400ccb0 tx=0x7fd75400a620 comp rx=0 tx=0).stop 2023-10-25T16:23:13.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 shutdown_connections 2023-10-25T16:23:13.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd7500664a0 0x7fd750068960 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd76415bdb0 0x7fd7641450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd76414e810 0x7fd764145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 --2- 172.21.15.177:0/39596520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7640af100 0x7fd764070fa0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 >> 172.21.15.177:0/39596520 conn(0x7fd7640b2450 msgr2=0x7fd7640b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:13.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 shutdown_connections 2023-10-25T16:23:13.095 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.096+0000 7fd76c3cf640 1 -- 172.21.15.177:0/39596520 wait complete. 2023-10-25T16:23:13.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:23:13.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 -- 172.21.15.177:0/3682463103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338806cc60 msgr2=0x7f338815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 --2- 172.21.15.177:0/3682463103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338806cc60 0x7f338815bcf0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f33880b3810 tx=0x7f337c01c830 comp rx=0 tx=0).stop 2023-10-25T16:23:13.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 -- 172.21.15.177:0/3682463103 shutdown_connections 2023-10-25T16:23:13.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 --2- 172.21.15.177:0/3682463103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338806cc60 0x7f338815bcf0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 --2- 172.21.15.177:0/3682463103 >> v2:172.21.15.184:3300/0 conn(0x7f338813b0d0 0x7f338806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 -- 172.21.15.177:0/3682463103 >> 172.21.15.177:0/3682463103 conn(0x7f33880afe20 msgr2=0x7f33880b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:13.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 -- 172.21.15.177:0/3682463103 shutdown_connections 2023-10-25T16:23:13.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.232+0000 7f338c8dd640 1 -- 172.21.15.177:0/3682463103 wait complete. 2023-10-25T16:23:13.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 Processor -- start 2023-10-25T16:23:13.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- start start 2023-10-25T16:23:13.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f338806cc60 0x7f3388135d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 0x7f338813b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f338815c230 0x7f3388154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338813d5f0 con 0x7f338813b0d0 2023-10-25T16:23:13.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338813d8d0 con 0x7f338806cc60 2023-10-25T16:23:13.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338813dbb0 con 0x7f338815c230 2023-10-25T16:23:13.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 0x7f338813b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 0x7f338813b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53364/0 (socket says 172.21.15.177:53364) 2023-10-25T16:23:13.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 -- 172.21.15.177:0/2318330998 learned_addr learned my addr 172.21.15.177:0/2318330998 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:13.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3386d9d640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f338815c230 0x7f3388154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 -- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f338815c230 msgr2=0x7f3388154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338659c640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f338806cc60 0x7f3388135d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f338815c230 0x7f3388154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 -- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f338806cc60 msgr2=0x7f3388135d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f338806cc60 0x7f3388135d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 -- 172.21.15.177:0/2318330998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c009560 con 0x7f338813b0d0 2023-10-25T16:23:13.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3386d9d640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f338815c230 0x7f3388154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:13.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3385d9b640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 0x7f338813b6a0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f337c0b0040 tx=0x7f337c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:13.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c0044b0 con 0x7f338813b0d0 2023-10-25T16:23:13.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f337c005140 con 0x7f338813b0d0 2023-10-25T16:23:13.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338813de90 con 0x7f338813b0d0 2023-10-25T16:23:13.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c005550 con 0x7f338813b0d0 2023-10-25T16:23:13.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338813d2a0 con 0x7f338813b0d0 2023-10-25T16:23:13.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.236+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338813e0b0 con 0x7f338813b0d0 2023-10-25T16:23:13.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.240+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f337c0b4070 con 0x7f338813b0d0 2023-10-25T16:23:13.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.240+0000 7f3376ffd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3368066470 0x7f3368068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.240+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f337c11d2c0 con 0x7f338813b0d0 2023-10-25T16:23:13.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.240+0000 7f338659c640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3368066470 0x7f3368068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.240+0000 7f338659c640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3368066470 0x7f3368068930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f337800a830 tx=0x7f3378008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:13.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.244+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f337c0eaa40 con 0x7f338813b0d0 2023-10-25T16:23:13.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.392+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f338813d730 con 0x7f338813b0d0 2023-10-25T16:23:13.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f3376ffd640 1 -- 172.21.15.177:0/2318330998 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v34) v1 ==== 59+0+1116 (secure 0 0 0) 0x7f338813d730 con 0x7f338813b0d0 2023-10-25T16:23:13.392 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:23:13.392 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:23:13.392 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:23:13.392 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:23:13.392 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:23:13.393 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:23:13.393 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:23:13.393 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:23:13.393 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:23:13.393 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:23:13.394 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:23:13.394 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:23:13.394 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:23:13.394 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:23:13.395 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:23:13.395 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:23:13.395 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:23:13.395 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:23:13.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3368066470 msgr2=0x7f3368068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3368066470 0x7f3368068930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f337800a830 tx=0x7f3378008040 comp rx=0 tx=0).stop 2023-10-25T16:23:13.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 msgr2=0x7f338813b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 0x7f338813b6a0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f337c0b0040 tx=0x7f337c0040c0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 shutdown_connections 2023-10-25T16:23:13.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3368066470 0x7f3368068930 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f338815c230 0x7f3388154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f338813b0d0 0x7f338813b6a0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 --2- 172.21.15.177:0/2318330998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f338806cc60 0x7f3388135d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 >> 172.21.15.177:0/2318330998 conn(0x7f33880afe20 msgr2=0x7f3388155730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:13.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 shutdown_connections 2023-10-25T16:23:13.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.396+0000 7f338c8dd640 1 -- 172.21.15.177:0/2318330998 wait complete. 2023-10-25T16:23:13.408 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:23:13.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- 172.21.15.177:0/496597925 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 msgr2=0x7f94b8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 --2- 172.21.15.177:0/496597925 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94b8004c50 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f94c806f520 tx=0x7f94b401ca00 comp rx=0 tx=0).stop 2023-10-25T16:23:13.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cd587640 1 -- 172.21.15.177:0/496597925 reap_dead start 2023-10-25T16:23:13.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- 172.21.15.177:0/496597925 shutdown_connections 2023-10-25T16:23:13.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- 172.21.15.177:0/496597925 >> 172.21.15.177:0/496597925 conn(0x7f94c80b2450 msgr2=0x7f94c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:13.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- 172.21.15.177:0/496597925 shutdown_connections 2023-10-25T16:23:13.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- 172.21.15.177:0/496597925 wait complete. 2023-10-25T16:23:13.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 Processor -- start 2023-10-25T16:23:13.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- start start 2023-10-25T16:23:13.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94c8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c814ce70 0x7f94c80b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c80b1270 0x7f94c80b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80b01d0 con 0x7f94b80047d0 2023-10-25T16:23:13.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80b04b0 con 0x7f94c814ce70 2023-10-25T16:23:13.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cefea640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80b0790 con 0x7f94c80b1270 2023-10-25T16:23:13.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94c8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94c8157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53388/0 (socket says 172.21.15.177:53388) 2023-10-25T16:23:13.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 -- 172.21.15.177:0/1261384691 learned_addr learned my addr 172.21.15.177:0/1261384691 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:13.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94c7fff640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c814ce70 0x7f94c80b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94cd587640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c80b1270 0x7f94c80b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 -- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c80b1270 msgr2=0x7f94c80b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c80b1270 0x7f94c80b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 -- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c814ce70 msgr2=0x7f94c80b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c814ce70 0x7f94c80b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 -- 172.21.15.177:0/1261384691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80b0a70 con 0x7f94b80047d0 2023-10-25T16:23:13.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94c7fff640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c814ce70 0x7f94c80b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:13.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94ccd86640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94c8157d50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00e990 tx=0x7f94bc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:13.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.540+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc00cbe0 con 0x7f94b80047d0 2023-10-25T16:23:13.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94bc00ce30 con 0x7f94b80047d0 2023-10-25T16:23:13.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc005280 con 0x7f94b80047d0 2023-10-25T16:23:13.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c80b0d50 con 0x7f94b80047d0 2023-10-25T16:23:13.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c8158460 con 0x7f94b80047d0 2023-10-25T16:23:13.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c804daf0 con 0x7f94b80047d0 2023-10-25T16:23:13.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94bc0053e0 con 0x7f94b80047d0 2023-10-25T16:23:13.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c57fa640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:13.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f94bc084660 con 0x7f94b80047d0 2023-10-25T16:23:13.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c7fff640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:13.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.544+0000 7f94c7fff640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f94b40b0000 tx=0x7f94b40a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:13.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.548+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94bc055760 con 0x7f94b80047d0 2023-10-25T16:23:13.694 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.696+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f94c8158dd0 con 0x7f94b80047d0 2023-10-25T16:23:13.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.704+0000 7f94c57fa640 1 -- 172.21.15.177:0/1261384691 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v35)=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f94bc01f020 con 0x7f94b80047d0 2023-10-25T16:23:13.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 msgr2=0x7f94ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f94b40b0000 tx=0x7f94b40a7040 comp rx=0 tx=0).stop 2023-10-25T16:23:13.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 msgr2=0x7f94c8157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:13.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94c8157d50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00e990 tx=0x7f94bc00ee50 comp rx=0 tx=0).stop 2023-10-25T16:23:13.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 shutdown_connections 2023-10-25T16:23:13.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f94ac066470 0x7f94ac068930 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94c80b1270 0x7f94c80b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94c814ce70 0x7f94c80b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 --2- 172.21.15.177:0/1261384691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94b80047d0 0x7f94c8157d50 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:13.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 >> 172.21.15.177:0/1261384691 conn(0x7f94c80b2450 msgr2=0x7f94c814f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:13.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 shutdown_connections 2023-10-25T16:23:13.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:13.708+0000 7f94cefea640 1 -- 172.21.15.177:0/1261384691 wait complete. 2023-10-25T16:23:13.720 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:23:13.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:23:13.769 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:23:13.808 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:23:13.808 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:23:13.809 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:13.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:23:13.819 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:23:13.819 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:13.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:23:13.855 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:23:13.855 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:13.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:23:13.865 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:23:13.865 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:23:13.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:23:13.903 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:23:13.903 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:14.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 -- 172.21.15.177:0/4157211990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50071500 msgr2=0x7f8b50070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 --2- 172.21.15.177:0/4157211990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50071500 0x7f8b50070510 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f8b500ca900 tx=0x7f8b4401c790 comp rx=0 tx=0).stop 2023-10-25T16:23:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 -- 172.21.15.177:0/4157211990 shutdown_connections 2023-10-25T16:23:14.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 --2- 172.21.15.177:0/4157211990 >> v2:172.21.15.184:3300/0 conn(0x7f8b5006b980 0x7f8b5006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 --2- 172.21.15.177:0/4157211990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50071500 0x7f8b50070510 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 -- 172.21.15.177:0/4157211990 >> 172.21.15.177:0/4157211990 conn(0x7f8b500b2450 msgr2=0x7f8b500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:14.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 -- 172.21.15.177:0/4157211990 shutdown_connections 2023-10-25T16:23:14.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.028+0000 7f8b552c8640 1 -- 172.21.15.177:0/4157211990 wait complete. 2023-10-25T16:23:14.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 Processor -- start 2023-10-25T16:23:14.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- start start 2023-10-25T16:23:14.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5006b980 0x7f8b50147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b50071500 0x7f8b50152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 0x7f8b50153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501470a0 con 0x7f8b50159230 2023-10-25T16:23:14.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50156110 con 0x7f8b5006b980 2023-10-25T16:23:14.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501563f0 con 0x7f8b50071500 2023-10-25T16:23:14.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 0x7f8b50153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 0x7f8b50153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53394/0 (socket says 172.21.15.177:53394) 2023-10-25T16:23:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 -- 172.21.15.177:0/2249102780 learned_addr learned my addr 172.21.15.177:0/2249102780 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4effd640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5006b980 0x7f8b50147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4e7fc640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b50071500 0x7f8b50152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 -- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b50071500 msgr2=0x7f8b50152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b50071500 0x7f8b50152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 -- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5006b980 msgr2=0x7f8b50147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5006b980 0x7f8b50147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 -- 172.21.15.177:0/2249102780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009450 con 0x7f8b50159230 2023-10-25T16:23:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4e7fc640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b50071500 0x7f8b50152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:14.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b4f7fe640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 0x7f8b50153070 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800b970 tx=0x7f8b4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800cb40 con 0x7f8b50159230 2023-10-25T16:23:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8b4800cdb0 con 0x7f8b50159230 2023-10-25T16:23:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b501469e0 con 0x7f8b50159230 2023-10-25T16:23:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480146a0 con 0x7f8b50159230 2023-10-25T16:23:14.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50156ac0 con 0x7f8b50159230 2023-10-25T16:23:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.032+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b501471e0 con 0x7f8b50159230 2023-10-25T16:23:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.036+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b4801d3b0 con 0x7f8b50159230 2023-10-25T16:23:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.036+0000 7f8b377fe640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b3c066470 0x7f8b3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.036+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b48083cd0 con 0x7f8b50159230 2023-10-25T16:23:14.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.036+0000 7f8b4effd640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b3c066470 0x7f8b3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.036+0000 7f8b4effd640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b3c066470 0x7f8b3c068930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007fd0 tx=0x7f8b40009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:14.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.040+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b501471e0 con 0x7f8b50159230 2023-10-25T16:23:14.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b501471e0 con 0x7f8b50159230 2023-10-25T16:23:14.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b377fe640 1 -- 172.21.15.177:0/2249102780 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f8b501471e0 con 0x7f8b50159230 2023-10-25T16:23:14.213 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:14.213 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4073463930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4073463930},{"type":"v1","addr":"172.21.15.184:6837","nonce":4073463930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3147336687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3147336687},{"type":"v1","addr":"172.21.15.184:6835","nonce":3147336687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":8655,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/717565267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":717565267},{"type":"v1","addr":"172.21.15.177:6833","nonce":717565267}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":8658,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2464847428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2464847428},{"type":"v1","addr":"172.21.15.177:6835","nonce":2464847428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[]} 2023-10-25T16:23:14.213 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 60 2023-10-25T16:23:14.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b3c066470 msgr2=0x7f8b3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b3c066470 0x7f8b3c068930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8b40007fd0 tx=0x7f8b40009040 comp rx=0 tx=0).stop 2023-10-25T16:23:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 msgr2=0x7f8b50153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 0x7f8b50153070 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800b970 tx=0x7f8b4800be30 comp rx=0 tx=0).stop 2023-10-25T16:23:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 shutdown_connections 2023-10-25T16:23:14.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8b3c066470 0x7f8b3c068930 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b50159230 0x7f8b50153070 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b50071500 0x7f8b50152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 --2- 172.21.15.177:0/2249102780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b5006b980 0x7f8b50147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 >> 172.21.15.177:0/2249102780 conn(0x7f8b500b2450 msgr2=0x7f8b500cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:14.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 shutdown_connections 2023-10-25T16:23:14.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.216+0000 7f8b552c8640 1 -- 172.21.15.177:0/2249102780 wait complete. 2023-10-25T16:23:14.230 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:23:14.230 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:23:14.231 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:23:14.231 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:23:14.231 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:23:14.232 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:23:14.232 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:23:14.232 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:23:14.232 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:23:14.233 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:23:14.233 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:23:14.233 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:23:14.234 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:23:14.234 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:23:14.234 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:23:14.234 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:23:14.241 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:23:14.241 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:23:14.243 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:23:14.243 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:23:14.247 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:23:14.247 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:23:14.248 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:23:14.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:23:14.284 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:23:14.285 DEBUG:teuthology.parallel:result is None 2023-10-25T16:23:14.286 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:23:14.286 DEBUG:teuthology.parallel:result is None 2023-10-25T16:23:14.291 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:23:14.292 DEBUG:teuthology.parallel:result is None 2023-10-25T16:23:14.292 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:23:14.293 DEBUG:teuthology.parallel:result is None 2023-10-25T16:23:14.293 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:23:14.342 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:23:14.342 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:23:14.362 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:23:14.362 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:23:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 -- 172.21.15.177:0/2532677987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 msgr2=0x7f9d74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 --2- 172.21.15.177:0/2532677987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d74005190 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009b60 tx=0x7f9d8401d250 comp rx=0 tx=0).stop 2023-10-25T16:23:14.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d90cd2640 1 -- 172.21.15.177:0/2532677987 reap_dead start 2023-10-25T16:23:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 -- 172.21.15.177:0/2532677987 shutdown_connections 2023-10-25T16:23:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 -- 172.21.15.177:0/2532677987 >> 172.21.15.177:0/2532677987 conn(0x7f9d8c09a5c0 msgr2=0x7f9d8c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 -- 172.21.15.177:0/2532677987 shutdown_connections 2023-10-25T16:23:14.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 -- 172.21.15.177:0/2532677987 wait complete. 2023-10-25T16:23:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 Processor -- start 2023-10-25T16:23:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.416+0000 7f9d92735640 1 -- start start 2023-10-25T16:23:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d8c1ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c1e5520 0x7f9d8c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c0c7370 0x7f9d8c1e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c7800 con 0x7f9d74004d10 2023-10-25T16:23:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1f2d80 con 0x7f9d8c1e5520 2023-10-25T16:23:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1f2200 con 0x7f9d8c0c7370 2023-10-25T16:23:14.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d8c1ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d8c1ef3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53470/0 (socket says 172.21.15.177:53470) 2023-10-25T16:23:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 -- 172.21.15.177:0/4020502860 learned_addr learned my addr 172.21.15.177:0/4020502860 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8b7fe640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c1e5520 0x7f9d8c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d90cd2640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c0c7370 0x7f9d8c1e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 -- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c0c7370 msgr2=0x7f9d8c1e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c0c7370 0x7f9d8c1e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 -- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c1e5520 msgr2=0x7f9d8c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c1e5520 0x7f9d8c0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 -- 172.21.15.177:0/4020502860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c1f24e0 con 0x7f9d74004d10 2023-10-25T16:23:14.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8bfff640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d8c1ef3b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001b30 tx=0x7f9d7c012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c010b40 con 0x7f9d74004d10 2023-10-25T16:23:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9d7c010ca0 con 0x7f9d74004d10 2023-10-25T16:23:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1f27c0 con 0x7f9d74004d10 2023-10-25T16:23:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c012e60 con 0x7f9d74004d10 2023-10-25T16:23:14.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c1e59a0 con 0x7f9d74004d10 2023-10-25T16:23:14.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c1f3040 con 0x7f9d74004d10 2023-10-25T16:23:14.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9d7c019020 con 0x7f9d74004d10 2023-10-25T16:23:14.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d88ff9640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9d78066470 0x7f9d78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:14.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d7c0877c0 con 0x7f9d74004d10 2023-10-25T16:23:14.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8b7fe640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9d78066470 0x7f9d78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:14.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.420+0000 7f9d8b7fe640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9d78066470 0x7f9d78068930 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009470 tx=0x7f9d800091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:14.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.424+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d8c1f3040 con 0x7f9d74004d10 2023-10-25T16:23:14.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-25T16:23:14.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-25T16:23:14.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-25T16:23:14.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-25T16:23:14.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:14.592+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9d8c1f3040 con 0x7f9d74004d10 2023-10-25T16:23:15.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.120+0000 7f9d88ff9640 1 -- 172.21.15.177:0/4020502860 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v168) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9d8c1f3040 con 0x7f9d74004d10 2023-10-25T16:23:15.117 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:23:15.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9d78066470 msgr2=0x7f9d78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9d78066470 0x7f9d78068930 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009470 tx=0x7f9d800091e0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 msgr2=0x7f9d8c1ef3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d8c1ef3b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001b30 tx=0x7f9d7c012b20 comp rx=0 tx=0).stop 2023-10-25T16:23:15.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 shutdown_connections 2023-10-25T16:23:15.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9d78066470 0x7f9d78068930 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d8c0c7370 0x7f9d8c1e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d8c1e5520 0x7f9d8c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 --2- 172.21.15.177:0/4020502860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d74004d10 0x7f9d8c1ef3b0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 >> 172.21.15.177:0/4020502860 conn(0x7f9d8c09a5c0 msgr2=0x7f9d8c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:15.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 shutdown_connections 2023-10-25T16:23:15.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.124+0000 7f9d92735640 1 -- 172.21.15.177:0/4020502860 wait complete. 2023-10-25T16:23:15.142 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:23:15.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3803993154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 msgr2=0x7ff1800cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3803993154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800cb7e0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7ff178009bc0 tx=0x7ff17801cb80 comp rx=0 tx=0).stop 2023-10-25T16:23:15.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3803993154 shutdown_connections 2023-10-25T16:23:15.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3803993154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1800c9f90 0x7ff18015b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3803993154 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800cb7e0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3803993154 >> 172.21.15.177:0/3803993154 conn(0x7ff1800b0de0 msgr2=0x7ff1800b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:15.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3803993154 shutdown_connections 2023-10-25T16:23:15.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3803993154 wait complete. 2023-10-25T16:23:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 Processor -- start 2023-10-25T16:23:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- start start 2023-10-25T16:23:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1800c9f90 0x7ff1800c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1800cbd20 0x7ff18014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800b3540 con 0x7ff180156e60 2023-10-25T16:23:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff180150600 con 0x7ff1800c9f90 2023-10-25T16:23:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800c4780 con 0x7ff1800cbd20 2023-10-25T16:23:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53490/0 (socket says 172.21.15.177:53490) 2023-10-25T16:23:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 -- 172.21.15.177:0/3674404814 learned_addr learned my addr 172.21.15.177:0/3674404814 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff17f7fe640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1800cbd20 0x7ff18014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff17ffff640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1800c9f90 0x7ff1800c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 -- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1800cbd20 msgr2=0x7ff18014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1800cbd20 0x7ff18014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 -- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1800c9f90 msgr2=0x7ff1800c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1800c9f90 0x7ff1800c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 -- 172.21.15.177:0/3674404814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178009820 con 0x7ff180156e60 2023-10-25T16:23:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff184881640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800b3f50 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c970 tx=0x7ff17000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:15.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170007bb0 con 0x7ff180156e60 2023-10-25T16:23:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff170007e20 con 0x7ff180156e60 2023-10-25T16:23:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1800c4a60 con 0x7ff180156e60 2023-10-25T16:23:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000f6b0 con 0x7ff180156e60 2023-10-25T16:23:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.312+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1800b3750 con 0x7ff180156e60 2023-10-25T16:23:15.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.316+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18004daf0 con 0x7ff180156e60 2023-10-25T16:23:15.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.316+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff17000f810 con 0x7ff180156e60 2023-10-25T16:23:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.316+0000 7ff17cff9640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff16c066470 0x7ff16c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.316+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff1700843f0 con 0x7ff180156e60 2023-10-25T16:23:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.316+0000 7ff17ffff640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff16c066470 0x7ff16c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.316+0000 7ff17ffff640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff16c066470 0x7ff16c068930 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff1780af000 tx=0x7ff17801b3c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:15.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.320+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff170051b20 con 0x7ff180156e60 2023-10-25T16:23:15.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.516+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff180065cf0 con 0x7ff180156e60 2023-10-25T16:23:15.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.516+0000 7ff17cff9640 1 -- 172.21.15.177:0/3674404814 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff170055140 con 0x7ff180156e60 2023-10-25T16:23:15.515 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:15.515 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:23:15.516 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:23:15.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.516 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:23:15.516 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:23:15.516 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.517 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.517 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:23:15.517 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:23:15.517 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.517 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.518 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.518 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:23:15.518 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:23:15.518 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:23:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:23:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.520 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.520 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:23:15.520 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:23:15.520 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.520 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.521 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:23:15.521 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:23:15.521 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:23:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:23:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.522 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:23:15.523 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:23:15.523 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.523 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.523 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.524 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:23:15.524 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:23:15.524 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.525 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.525 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.525 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.525 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.526 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.526 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:23:15.526 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:23:15.526 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.526 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.526 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.527 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.527 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.527 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.527 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:23:15.528 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:23:15.528 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.528 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.528 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.528 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.529 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.529 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:23:15.529 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:23:15.530 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.530 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.530 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.530 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.530 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.531 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.531 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.531 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:23:15.531 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:23:15.531 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.531 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.532 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.532 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.532 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.533 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:23:15.533 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:23:15.533 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.533 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.533 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.534 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.534 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.534 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.534 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:23:15.535 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:23:15.535 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.535 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.535 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.535 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.536 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.536 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:23:15.536 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:23:15.536 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.537 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:23:15.537 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:23:15.537 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.537 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.537 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.538 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.538 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:23:15.538 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:23:15.538 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.538 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.539 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:23:15.539 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:23:15.539 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.539 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:23:15.540 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:23:15.540 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.540 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.540 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:23:15.540 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:23:15.541 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:23:15.541 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.541 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:23:15.541 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:23:15.542 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.542 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.542 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:23:15.542 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:23:15.542 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:23:15.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.543 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:23:15.543 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:23:15.544 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.544 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:23:15.544 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:23:15.544 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:23:15.544 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:23:15.545 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.545 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:23:15.545 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:23:15.546 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.546 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:23:15.546 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:23:15.546 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:23:15.546 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.547 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.547 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:23:15.547 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:23:15.547 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.548 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:23:15.548 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:23:15.548 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.548 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:15.548 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:15.549 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:23:15.549 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:23:15.549 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:23:15.549 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:23:15.549 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:23:15.550 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:23:15.550 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.550 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:15.550 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:23:15.550 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:23:15.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff16c066470 msgr2=0x7ff16c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff16c066470 0x7ff16c068930 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff1780af000 tx=0x7ff17801b3c0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 msgr2=0x7ff1800b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800b3f50 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c970 tx=0x7ff17000ce30 comp rx=0 tx=0).stop 2023-10-25T16:23:15.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 shutdown_connections 2023-10-25T16:23:15.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff16c066470 0x7ff16c068930 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff180156e60 0x7ff1800b3f50 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1800cbd20 0x7ff18014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 --2- 172.21.15.177:0/3674404814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1800c9f90 0x7ff1800c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 >> 172.21.15.177:0/3674404814 conn(0x7ff1800b0de0 msgr2=0x7ff18015d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:15.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 shutdown_connections 2023-10-25T16:23:15.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.520+0000 7ff1862e4640 1 -- 172.21.15.177:0/3674404814 wait complete. 2023-10-25T16:23:15.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/3717444488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 msgr2=0x7fc0d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/3717444488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc001680 tx=0x7fc0dc01c760 comp rx=0 tx=0).stop 2023-10-25T16:23:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/3717444488 shutdown_connections 2023-10-25T16:23:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/3717444488 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0d0004c50 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/3717444488 >> 172.21.15.177:0/3717444488 conn(0x7fc0e809a5c0 msgr2=0x7fc0e80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/3717444488 shutdown_connections 2023-10-25T16:23:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/3717444488 wait complete. 2023-10-25T16:23:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 Processor -- start 2023-10-25T16:23:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- start start 2023-10-25T16:23:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0e806b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e80c93d0 0x7fc0e80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0e80c9d70 0x7fc0e80c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80c5110 con 0x7fc0d00047d0 2023-10-25T16:23:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8146450 con 0x7fc0e80c93d0 2023-10-25T16:23:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80ca1f0 con 0x7fc0e80c9d70 2023-10-25T16:23:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0e806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0e806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53502/0 (socket says 172.21.15.177:53502) 2023-10-25T16:23:15.685 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 -- 172.21.15.177:0/1847394175 learned_addr learned my addr 172.21.15.177:0/1847394175 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ecfd7640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e80c93d0 0x7fc0e80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0edfd9640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0e80c9d70 0x7fc0e80c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 -- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0e80c9d70 msgr2=0x7fc0e80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0e80c9d70 0x7fc0e80c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.686 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 -- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e80c93d0 msgr2=0x7fc0e80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e80c93d0 0x7fc0e80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 -- 172.21.15.177:0/1847394175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8146170 con 0x7fc0d00047d0 2023-10-25T16:23:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0ed7d8640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0e806b720 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000e9c0 tx=0x7fc0e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e000cc60 con 0x7fc0d00047d0 2023-10-25T16:23:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc0e000ceb0 con 0x7fc0d00047d0 2023-10-25T16:23:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e80c4a50 con 0x7fc0d00047d0 2023-10-25T16:23:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011690 con 0x7fc0d00047d0 2023-10-25T16:23:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.684+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e806bc60 con 0x7fc0d00047d0 2023-10-25T16:23:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.688+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e804daf0 con 0x7fc0d00047d0 2023-10-25T16:23:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.688+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0e00117f0 con 0x7fc0d00047d0 2023-10-25T16:23:15.689 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.688+0000 7fc0e5ffb640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d40664a0 0x7fc0d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.688+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc0e00846f0 con 0x7fc0d00047d0 2023-10-25T16:23:15.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.688+0000 7fc0ecfd7640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d40664a0 0x7fc0d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:15.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.688+0000 7fc0ecfd7640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d40664a0 0x7fc0d4068960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0004750 tx=0x7fc0dc019500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:15.690 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.692+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0e0055950 con 0x7fc0d00047d0 2023-10-25T16:23:15.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.848+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0e80ce930 con 0x7fc0d00047d0 2023-10-25T16:23:15.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.848+0000 7fc0e5ffb640 1 -- 172.21.15.177:0/1847394175 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+12892 (secure 0 0 0) 0x7fc0e00554e0 con 0x7fc0d00047d0 2023-10-25T16:23:15.847 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:15.847 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":170,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:23:15.144116+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:15.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d40664a0 msgr2=0x7fc0d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d40664a0 0x7fc0d4068960 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0004750 tx=0x7fc0dc019500 comp rx=0 tx=0).stop 2023-10-25T16:23:15.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 msgr2=0x7fc0e806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0e806b720 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000e9c0 tx=0x7fc0e000ee80 comp rx=0 tx=0).stop 2023-10-25T16:23:15.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 shutdown_connections 2023-10-25T16:23:15.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d40664a0 0x7fc0d4068960 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0e80c9d70 0x7fc0e80c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e80c93d0 0x7fc0e80c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 --2- 172.21.15.177:0/1847394175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0d00047d0 0x7fc0e806b720 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 >> 172.21.15.177:0/1847394175 conn(0x7fc0e809a5c0 msgr2=0x7fc0e815ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:15.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 shutdown_connections 2023-10-25T16:23:15.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.852+0000 7fc0efa3c640 1 -- 172.21.15.177:0/1847394175 wait complete. 2023-10-25T16:23:15.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:23:15.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:23:15.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/1973617663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 msgr2=0x7fc0f806be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:15.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/1973617663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f806be30 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0005fd0 tx=0x7fc0e001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/1973617663 shutdown_connections 2023-10-25T16:23:15.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/1973617663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0f80706f0 0x7fc0f8070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/1973617663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f806be30 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:15.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/1973617663 >> 172.21.15.177:0/1973617663 conn(0x7fc0f80b2450 msgr2=0x7fc0f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:15.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/1973617663 shutdown_connections 2023-10-25T16:23:15.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/1973617663 wait complete. 2023-10-25T16:23:15.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 Processor -- start 2023-10-25T16:23:15.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:15.996+0000 7fc0fc9f7640 1 -- start start 2023-10-25T16:23:15.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f8151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0f80706f0 0x7fc0f8143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0f81500f0 0x7fc0f81582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:15.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8143d50 con 0x7fc0f806b980 2023-10-25T16:23:15.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8145920 con 0x7fc0f80706f0 2023-10-25T16:23:15.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81522b0 con 0x7fc0f81500f0 2023-10-25T16:23:15.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f8151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f8151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53532/0 (socket says 172.21.15.177:53532) 2023-10-25T16:23:16.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 -- 172.21.15.177:0/70572815 learned_addr learned my addr 172.21.15.177:0/70572815 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:16.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f5d9b640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0f80706f0 0x7fc0f8143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 -- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0f81500f0 msgr2=0x7fc0f81582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0f81500f0 0x7fc0f81582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 -- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0f80706f0 msgr2=0x7fc0f8143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0f80706f0 0x7fc0f8143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 -- 172.21.15.177:0/70572815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0009450 con 0x7fc0f806b980 2023-10-25T16:23:16.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f659c640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f8151bd0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c430 tx=0x7fc0f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:16.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0011790 con 0x7fc0f806b980 2023-10-25T16:23:16.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc0f00119e0 con 0x7fc0f806b980 2023-10-25T16:23:16.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f8152590 con 0x7fc0f806b980 2023-10-25T16:23:16.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0011dd0 con 0x7fc0f806b980 2023-10-25T16:23:16.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f81455b0 con 0x7fc0f806b980 2023-10-25T16:23:16.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f804daf0 con 0x7fc0f806b980 2023-10-25T16:23:16.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0f001c460 con 0x7fc0f806b980 2023-10-25T16:23:16.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0eeffd640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d8066470 0x7fc0d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc0f0083d80 con 0x7fc0f806b980 2023-10-25T16:23:16.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.000+0000 7fc0f5d9b640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d8066470 0x7fc0d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.004+0000 7fc0f5d9b640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d8066470 0x7fc0d8068930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00ae000 tx=0x7fc0e001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:16.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.004+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0f00514c0 con 0x7fc0f806b980 2023-10-25T16:23:16.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.148+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0f81519b0 con 0x7fc0f806b980 2023-10-25T16:23:16.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.148+0000 7fc0eeffd640 1 -- 172.21.15.177:0/70572815 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0f0054ae0 con 0x7fc0f806b980 2023-10-25T16:23:16.147 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:23:16.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d8066470 msgr2=0x7fc0d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d8066470 0x7fc0d8068930 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00ae000 tx=0x7fc0e001b010 comp rx=0 tx=0).stop 2023-10-25T16:23:16.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 msgr2=0x7fc0f8151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f8151bd0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c430 tx=0x7fc0f000c8f0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 shutdown_connections 2023-10-25T16:23:16.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0d8066470 0x7fc0d8068930 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc0f81500f0 0x7fc0f81582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0f80706f0 0x7fc0f8143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 --2- 172.21.15.177:0/70572815 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f806b980 0x7fc0f8151bd0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 >> 172.21.15.177:0/70572815 conn(0x7fc0f80b2450 msgr2=0x7fc0f8148850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 shutdown_connections 2023-10-25T16:23:16.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.152+0000 7fc0fc9f7640 1 -- 172.21.15.177:0/70572815 wait complete. 2023-10-25T16:23:16.165 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:23:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 -- 172.21.15.177:0/3296101135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8281591e0 msgr2=0x7fb8280c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/3296101135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8281591e0 0x7fb8280c2b30 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fb818009bc0 tx=0x7fb81801cb80 comp rx=0 tx=0).stop 2023-10-25T16:23:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 -- 172.21.15.177:0/3296101135 shutdown_connections 2023-10-25T16:23:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/3296101135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8280b0a20 0x7fb8280b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/3296101135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8281591e0 0x7fb8280c2b30 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 -- 172.21.15.177:0/3296101135 >> 172.21.15.177:0/3296101135 conn(0x7fb8280cefe0 msgr2=0x7fb8280cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 -- 172.21.15.177:0/3296101135 shutdown_connections 2023-10-25T16:23:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 -- 172.21.15.177:0/3296101135 wait complete. 2023-10-25T16:23:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 Processor -- start 2023-10-25T16:23:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.284+0000 7fb82d9f8640 1 -- start start 2023-10-25T16:23:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 0x7fb82814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8280b0a20 0x7fb8281515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8281591e0 0x7fb828161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82814faa0 con 0x7fb8280af110 2023-10-25T16:23:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82814f6f0 con 0x7fb8281591e0 2023-10-25T16:23:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82806ae30 con 0x7fb8280b0a20 2023-10-25T16:23:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 0x7fb82814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 0x7fb82814f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53544/0 (socket says 172.21.15.177:53544) 2023-10-25T16:23:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 -- 172.21.15.177:0/1262460696 learned_addr learned my addr 172.21.15.177:0/1262460696 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 -- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8280b0a20 msgr2=0x7fb8281515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8280b0a20 0x7fb8281515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 -- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8281591e0 msgr2=0x7fb828161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8281591e0 0x7fb828161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 -- 172.21.15.177:0/1262460696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818009820 con 0x7fb8280af110 2023-10-25T16:23:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb826ffd640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 0x7fb82814f1b0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fb818009b10 tx=0x7fb8180a59e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818004c50 con 0x7fb8280af110 2023-10-25T16:23:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb818004000 con 0x7fb8280af110 2023-10-25T16:23:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82806b110 con 0x7fb8280af110 2023-10-25T16:23:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818004ea0 con 0x7fb8280af110 2023-10-25T16:23:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82806b6d0 con 0x7fb8280af110 2023-10-25T16:23:16.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82804daf0 con 0x7fb8280af110 2023-10-25T16:23:16.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8180b4040 con 0x7fb8280af110 2023-10-25T16:23:16.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb80ffff640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb814066470 0x7fb814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb81811dcb0 con 0x7fb8280af110 2023-10-25T16:23:16.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.288+0000 7fb8267fc640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb814066470 0x7fb814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.292+0000 7fb8267fc640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb814066470 0x7fb814068930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb828163150 tx=0x7fb81c005c80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:16.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.292+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8180eb490 con 0x7fb8280af110 2023-10-25T16:23:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.448+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb82806aae0 con 0x7fb8280af110 2023-10-25T16:23:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.448+0000 7fb80ffff640 1 -- 172.21.15.177:0/1262460696 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v170) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb8180eeab0 con 0x7fb8280af110 2023-10-25T16:23:16.446 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:16.447 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:23:16.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:23:16.447 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:23:16.447 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:23:16.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:16.448 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:23:16.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb814066470 msgr2=0x7fb814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb814066470 0x7fb814068930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb828163150 tx=0x7fb81c005c80 comp rx=0 tx=0).stop 2023-10-25T16:23:16.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 msgr2=0x7fb82814f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 0x7fb82814f1b0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fb818009b10 tx=0x7fb8180a59e0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 shutdown_connections 2023-10-25T16:23:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb814066470 0x7fb814068930 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8281591e0 0x7fb828161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8280b0a20 0x7fb8281515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 --2- 172.21.15.177:0/1262460696 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8280af110 0x7fb82814f1b0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 >> 172.21.15.177:0/1262460696 conn(0x7fb8280cefe0 msgr2=0x7fb82815c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 shutdown_connections 2023-10-25T16:23:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.452+0000 7fb82d9f8640 1 -- 172.21.15.177:0/1262460696 wait complete. 2023-10-25T16:23:16.466 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:23:16.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:23:16.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- 172.21.15.177:0/2204082944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 msgr2=0x7fbd3015d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 --2- 172.21.15.177:0/2204082944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd3015d0d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009840 tx=0x7fbd2001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- 172.21.15.177:0/2204082944 shutdown_connections 2023-10-25T16:23:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 --2- 172.21.15.177:0/2204082944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd300cdbb0 0x7fbd300ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 --2- 172.21.15.177:0/2204082944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd3015d0d0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- 172.21.15.177:0/2204082944 >> 172.21.15.177:0/2204082944 conn(0x7fbd3009a590 msgr2=0x7fbd300d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- 172.21.15.177:0/2204082944 shutdown_connections 2023-10-25T16:23:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- 172.21.15.177:0/2204082944 wait complete. 2023-10-25T16:23:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 Processor -- start 2023-10-25T16:23:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- start start 2023-10-25T16:23:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd300cbdf0 0x7fbd30151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd300cdbb0 0x7fbd30152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd30149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c54a0 con 0x7fbd3015c890 2023-10-25T16:23:16.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300cb380 con 0x7fbd300cbdf0 2023-10-25T16:23:16.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.604+0000 7fbd36a27640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c7ba0 con 0x7fbd300cdbb0 2023-10-25T16:23:16.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd30149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd30149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53562/0 (socket says 172.21.15.177:53562) 2023-10-25T16:23:16.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 -- 172.21.15.177:0/3198986476 learned_addr learned my addr 172.21.15.177:0/3198986476 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:16.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2ffff640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd300cbdf0 0x7fbd30151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2f7fe640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd300cdbb0 0x7fbd30152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 -- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd300cdbb0 msgr2=0x7fbd30152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd300cdbb0 0x7fbd30152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 -- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd300cbdf0 msgr2=0x7fbd30151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:16.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd300cbdf0 0x7fbd30151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:16.608 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 -- 172.21.15.177:0/3198986476 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200094a0 con 0x7fbd3015c890 2023-10-25T16:23:16.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd34fc4640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd30149210 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800cb70 tx=0x7fbd2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:16.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800aa50 con 0x7fbd3015c890 2023-10-25T16:23:16.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbd2800aca0 con 0x7fbd3015c890 2023-10-25T16:23:16.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd300c7900 con 0x7fbd3015c890 2023-10-25T16:23:16.609 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28012680 con 0x7fbd3015c890 2023-10-25T16:23:16.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd300c5130 con 0x7fbd3015c890 2023-10-25T16:23:16.610 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd300c5650 con 0x7fbd3015c890 2023-10-25T16:23:16.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd2801a3b0 con 0x7fbd3015c890 2023-10-25T16:23:16.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2cff9640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd1c066470 0x7fbd1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:16.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd28083f00 con 0x7fbd3015c890 2023-10-25T16:23:16.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2ffff640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd1c066470 0x7fbd1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:16.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.608+0000 7fbd2ffff640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd1c066470 0x7fbd1c068930 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbd200af000 tx=0x7fbd2001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:16.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.612+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd300c5650 con 0x7fbd3015c890 2023-10-25T16:23:16.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:16.768+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd300c5650 con 0x7fbd3015c890 2023-10-25T16:23:17.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.132+0000 7fbd2cff9640 1 -- 172.21.15.177:0/3198986476 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v171) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd300c5650 con 0x7fbd3015c890 2023-10-25T16:23:17.128 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:23:17.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd1c066470 msgr2=0x7fbd1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:17.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd1c066470 0x7fbd1c068930 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbd200af000 tx=0x7fbd2001b010 comp rx=0 tx=0).stop 2023-10-25T16:23:17.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 msgr2=0x7fbd30149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:17.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd30149210 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800cb70 tx=0x7fbd2800cc60 comp rx=0 tx=0).stop 2023-10-25T16:23:17.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 shutdown_connections 2023-10-25T16:23:17.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbd1c066470 0x7fbd1c068930 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd3015c890 0x7fbd30149210 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd300cdbb0 0x7fbd30152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 --2- 172.21.15.177:0/3198986476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd300cbdf0 0x7fbd30151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 >> 172.21.15.177:0/3198986476 conn(0x7fbd3009a590 msgr2=0x7fbd3015b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:17.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 shutdown_connections 2023-10-25T16:23:17.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.136+0000 7fbd36a27640 1 -- 172.21.15.177:0/3198986476 wait complete. 2023-10-25T16:23:17.156 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:23:17.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/1584064400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 msgr2=0x7fb8e0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:17.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/1584064400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8e0003da0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c260 tx=0x7fb8e801cfa0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8f6d9d640 1 -- 172.21.15.177:0/1584064400 reap_dead start 2023-10-25T16:23:17.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/1584064400 shutdown_connections 2023-10-25T16:23:17.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/1584064400 >> 172.21.15.177:0/1584064400 conn(0x7fb8f808ac90 msgr2=0x7fb8f809a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:17.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/1584064400 shutdown_connections 2023-10-25T16:23:17.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.288+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/1584064400 wait complete. 2023-10-25T16:23:17.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 Processor -- start 2023-10-25T16:23:17.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- start start 2023-10-25T16:23:17.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8f8145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:17.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f80b05a0 0x7fb8f8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:17.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f81f82c0 0x7fb8f81f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:17.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8153e50 con 0x7fb8e0003980 2023-10-25T16:23:17.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f81f8c90 con 0x7fb8f81f82c0 2023-10-25T16:23:17.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f8150400 con 0x7fb8f80b05a0 2023-10-25T16:23:17.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8f8145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:17.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8f8145b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53578/0 (socket says 172.21.15.177:53578) 2023-10-25T16:23:17.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 -- 172.21.15.177:0/12030547 learned_addr learned my addr 172.21.15.177:0/12030547 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:17.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f6d9d640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f81f82c0 0x7fb8f81f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:17.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f5d9b640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f80b05a0 0x7fb8f8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:17.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 -- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f80b05a0 msgr2=0x7fb8f8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:17.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f80b05a0 0x7fb8f8153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 -- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f81f82c0 msgr2=0x7fb8f81f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:17.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f81f82c0 0x7fb8f81f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:17.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 -- 172.21.15.177:0/12030547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80ae8b0 con 0x7fb8e0003980 2023-10-25T16:23:17.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f6d9d640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f81f82c0 0x7fb8f81f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:23:17.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8f659c640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8f8145b00 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801ca10 tx=0x7fb8e8001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:17.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80b1070 con 0x7fb8e0003980 2023-10-25T16:23:17.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb8e80063b0 con 0x7fb8e0003980 2023-10-25T16:23:17.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f8150120 con 0x7fb8e0003980 2023-10-25T16:23:17.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8003600 con 0x7fb8e0003980 2023-10-25T16:23:17.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f80aee30 con 0x7fb8e0003980 2023-10-25T16:23:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.292+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f80ae710 con 0x7fb8e0003980 2023-10-25T16:23:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.296+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8e8003760 con 0x7fb8e0003980 2023-10-25T16:23:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.296+0000 7fb8e6ffd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d8066470 0x7fb8d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.296+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb8e80b4040 con 0x7fb8e0003980 2023-10-25T16:23:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.296+0000 7fb8f5d9b640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d8066470 0x7fb8d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.296+0000 7fb8f5d9b640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d8066470 0x7fb8d8068930 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009470 tx=0x7fb8ec0093a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.300+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8e80ebab0 con 0x7fb8e0003980 2023-10-25T16:23:17.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:17.452+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb8f80ae710 con 0x7fb8e0003980 2023-10-25T16:23:18.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.136+0000 7fb8e6ffd640 1 -- 172.21.15.177:0/12030547 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v172) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb8f80ae710 con 0x7fb8e0003980 2023-10-25T16:23:18.133 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:23:18.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d8066470 msgr2=0x7fb8d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:18.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d8066470 0x7fb8d8068930 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009470 tx=0x7fb8ec0093a0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 msgr2=0x7fb8f8145b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:18.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8f8145b00 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb8e801ca10 tx=0x7fb8e8001ce0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 shutdown_connections 2023-10-25T16:23:18.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb8d8066470 0x7fb8d8068930 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8f81f82c0 0x7fb8f81f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8f80b05a0 0x7fb8f8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 --2- 172.21.15.177:0/12030547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e0003980 0x7fb8f8145b00 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 >> 172.21.15.177:0/12030547 conn(0x7fb8f808ac90 msgr2=0x7fb8f8154040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:18.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 shutdown_connections 2023-10-25T16:23:18.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.140+0000 7fb8fcbdd640 1 -- 172.21.15.177:0/12030547 wait complete. 2023-10-25T16:23:18.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:23:18.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 -- 172.21.15.177:0/1586945040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03480047d0 msgr2=0x7f0348004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:18.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 --2- 172.21.15.177:0/1586945040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03480047d0 0x7f0348004c50 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f0358009eb0 tx=0x7f035801d510 comp rx=0 tx=0).stop 2023-10-25T16:23:18.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0362832640 1 -- 172.21.15.177:0/1586945040 reap_dead start 2023-10-25T16:23:18.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 -- 172.21.15.177:0/1586945040 shutdown_connections 2023-10-25T16:23:18.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 -- 172.21.15.177:0/1586945040 >> 172.21.15.177:0/1586945040 conn(0x7f035c09a5c0 msgr2=0x7f035c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:18.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 -- 172.21.15.177:0/1586945040 shutdown_connections 2023-10-25T16:23:18.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 -- 172.21.15.177:0/1586945040 wait complete. 2023-10-25T16:23:18.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 Processor -- start 2023-10-25T16:23:18.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.292+0000 7f0364295640 1 -- start start 2023-10-25T16:23:18.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03480047d0 0x7f035c14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:18.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 0x7f035c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:18.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f035c0c63f0 0x7f035c0c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:18.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0c8480 con 0x7f035c0c98d0 2023-10-25T16:23:18.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c14b580 con 0x7f03480047d0 2023-10-25T16:23:18.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c0c6db0 con 0x7f035c0c63f0 2023-10-25T16:23:18.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 0x7f035c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:18.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 0x7f035c0c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53592/0 (socket says 172.21.15.177:53592) 2023-10-25T16:23:18.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 -- 172.21.15.177:0/1597296724 learned_addr learned my addr 172.21.15.177:0/1597296724 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:18.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0362031640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03480047d0 0x7f035c14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:18.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0362832640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f035c0c63f0 0x7f035c0c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:18.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 -- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f035c0c63f0 msgr2=0x7f035c0c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:18.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f035c0c63f0 0x7f035c0c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 -- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03480047d0 msgr2=0x7f035c14b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:18.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03480047d0 0x7f035c14b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:18.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 -- 172.21.15.177:0/1597296724 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0ca7d0 con 0x7f035c0c98d0 2023-10-25T16:23:18.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0362031640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03480047d0 0x7f035c14b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:23:18.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0361830640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 0x7f035c0c9d50 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f03580af040 tx=0x7f0358003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:18.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358004300 con 0x7f035c0c98d0 2023-10-25T16:23:18.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0358004550 con 0x7f035c0c98d0 2023-10-25T16:23:18.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c0c8690 con 0x7f035c0c98d0 2023-10-25T16:23:18.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03580b6410 con 0x7f035c0c98d0 2023-10-25T16:23:18.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c0c8c50 con 0x7f035c0c98d0 2023-10-25T16:23:18.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c04daf0 con 0x7f035c0c98d0 2023-10-25T16:23:18.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f03580b3070 con 0x7f035c0c98d0 2023-10-25T16:23:18.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f034effd640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03400664a0 0x7f0340068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:18.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f035811f9a0 con 0x7f035c0c98d0 2023-10-25T16:23:18.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.296+0000 7f0362031640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03400664a0 0x7f0340068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:18.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.300+0000 7f0362031640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03400664a0 0x7f0340068960 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0350001ec0 tx=0x7f0350009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:18.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.300+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03580eced0 con 0x7f035c0c98d0 2023-10-25T16:23:18.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:18.488+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f035c0cd6a0 con 0x7f035c0c98d0 2023-10-25T16:23:19.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.164+0000 7f034effd640 1 -- 172.21.15.177:0/1597296724 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7f03580b1030 con 0x7f035c0c98d0 2023-10-25T16:23:19.162 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 20 and data pool 21 2023-10-25T16:23:19.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03400664a0 msgr2=0x7f0340068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03400664a0 0x7f0340068960 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0350001ec0 tx=0x7f0350009040 comp rx=0 tx=0).stop 2023-10-25T16:23:19.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 msgr2=0x7f035c0c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 0x7f035c0c9d50 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f03580af040 tx=0x7f0358003f70 comp rx=0 tx=0).stop 2023-10-25T16:23:19.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 shutdown_connections 2023-10-25T16:23:19.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03400664a0 0x7f0340068960 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f035c0c63f0 0x7f035c0c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c0c98d0 0x7f035c0c9d50 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 --2- 172.21.15.177:0/1597296724 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03480047d0 0x7f035c14b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 >> 172.21.15.177:0/1597296724 conn(0x7f035c09a5c0 msgr2=0x7f035c0b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:19.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 shutdown_connections 2023-10-25T16:23:19.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.168+0000 7f0364295640 1 -- 172.21.15.177:0/1597296724 wait complete. 2023-10-25T16:23:19.200 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:19.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 -- 172.21.15.177:0/4232691639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4480b2070 msgr2=0x7fa4480c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 --2- 172.21.15.177:0/4232691639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4480b2070 0x7fa4480c8a20 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fa440009840 tx=0x7fa44001c770 comp rx=0 tx=0).stop 2023-10-25T16:23:19.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 -- 172.21.15.177:0/4232691639 shutdown_connections 2023-10-25T16:23:19.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 --2- 172.21.15.177:0/4232691639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4480b2070 0x7fa4480c8a20 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 -- 172.21.15.177:0/4232691639 >> 172.21.15.177:0/4232691639 conn(0x7fa44809a580 msgr2=0x7fa4480d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:19.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 -- 172.21.15.177:0/4232691639 shutdown_connections 2023-10-25T16:23:19.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.324+0000 7fa44e52b640 1 -- 172.21.15.177:0/4232691639 wait complete. 2023-10-25T16:23:19.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 Processor -- start 2023-10-25T16:23:19.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- start start 2023-10-25T16:23:19.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4480b2070 0x7fa4481481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4480cfe20 0x7fa4480c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 0x7fa448148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480c4fe0 con 0x7fa44815eba0 2023-10-25T16:23:19.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44814d930 con 0x7fa4480cfe20 2023-10-25T16:23:19.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44814d370 con 0x7fa4480b2070 2023-10-25T16:23:19.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 0x7fa448148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 0x7fa448148e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53606/0 (socket says 172.21.15.177:53606) 2023-10-25T16:23:19.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 -- 172.21.15.177:0/702570159 learned_addr learned my addr 172.21.15.177:0/702570159 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:19.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa447fff640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4480b2070 0x7fa4481481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa4477fe640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4480cfe20 0x7fa4480c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 -- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4480b2070 msgr2=0x7fa4481481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4480b2070 0x7fa4481481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 -- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4480cfe20 msgr2=0x7fa4480c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4480cfe20 0x7fa4480c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 -- 172.21.15.177:0/702570159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400094a0 con 0x7fa44815eba0 2023-10-25T16:23:19.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa4477fe640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4480cfe20 0x7fa4480c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:19.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44cac8640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 0x7fa448148e90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fa44001cc50 tx=0x7fa440005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:19.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa440004230 con 0x7fa44815eba0 2023-10-25T16:23:19.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa440004480 con 0x7fa44815eba0 2023-10-25T16:23:19.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4400048d0 con 0x7fa44815eba0 2023-10-25T16:23:19.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44814d650 con 0x7fa44815eba0 2023-10-25T16:23:19.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa448159fb0 con 0x7fa44815eba0 2023-10-25T16:23:19.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.328+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44804daf0 con 0x7fa44815eba0 2023-10-25T16:23:19.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.332+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa440004a30 con 0x7fa44815eba0 2023-10-25T16:23:19.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.332+0000 7fa444ff9640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa428066470 0x7fa428068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.332+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa44011f0a0 con 0x7fa44815eba0 2023-10-25T16:23:19.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.332+0000 7fa447fff640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa428066470 0x7fa428068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.332+0000 7fa447fff640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa428066470 0x7fa428068930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa438001cb0 tx=0x7fa438009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:19.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.336+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4400ec5b0 con 0x7fa44815eba0 2023-10-25T16:23:19.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.488+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44814f3e0 con 0x7fa44815eba0 2023-10-25T16:23:19.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa444ff9640 1 -- 172.21.15.177:0/702570159 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16617 (secure 0 0 0) 0x7fa4400b2090 con 0x7fa44815eba0 2023-10-25T16:23:19.488 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:19.489 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":173,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:23:18.493322+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:19.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa428066470 msgr2=0x7fa428068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa428066470 0x7fa428068930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa438001cb0 tx=0x7fa438009040 comp rx=0 tx=0).stop 2023-10-25T16:23:19.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 msgr2=0x7fa448148e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 0x7fa448148e90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fa44001cc50 tx=0x7fa440005730 comp rx=0 tx=0).stop 2023-10-25T16:23:19.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 shutdown_connections 2023-10-25T16:23:19.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa428066470 0x7fa428068930 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa44815eba0 0x7fa448148e90 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4480cfe20 0x7fa4480c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 --2- 172.21.15.177:0/702570159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4480b2070 0x7fa4481481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 >> 172.21.15.177:0/702570159 conn(0x7fa44809a580 msgr2=0x7fa4480c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:19.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 shutdown_connections 2023-10-25T16:23:19.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.492+0000 7fa44e52b640 1 -- 172.21.15.177:0/702570159 wait complete. 2023-10-25T16:23:19.508 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/2403534806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38004d10 msgr2=0x7f2e38005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/2403534806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e38004d10 0x7f2e38005190 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009e30 tx=0x7f2e5001d190 comp rx=0 tx=0).stop 2023-10-25T16:23:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5cc7f640 1 -- 172.21.15.177:0/2403534806 reap_dead start 2023-10-25T16:23:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/2403534806 shutdown_connections 2023-10-25T16:23:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/2403534806 >> 172.21.15.177:0/2403534806 conn(0x7f2e580b2450 msgr2=0x7f2e580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/2403534806 shutdown_connections 2023-10-25T16:23:19.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.632+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/2403534806 wait complete. 2023-10-25T16:23:19.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 Processor -- start 2023-10-25T16:23:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- start start 2023-10-25T16:23:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e581484e0 0x7f2e580ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 0x7f2e58158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e580b1540 0x7f2e58158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580ae7a0 con 0x7f2e580af840 2023-10-25T16:23:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580aea80 con 0x7f2e580b1540 2023-10-25T16:23:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580aed60 con 0x7f2e581484e0 2023-10-25T16:23:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 0x7f2e58158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 0x7f2e58158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53624/0 (socket says 172.21.15.177:53624) 2023-10-25T16:23:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 -- 172.21.15.177:0/392878147 learned_addr learned my addr 172.21.15.177:0/392878147 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e57fff640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e581484e0 0x7f2e580ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5cc7f640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e580b1540 0x7f2e58158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 -- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e581484e0 msgr2=0x7f2e580ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e581484e0 0x7f2e580ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 -- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e580b1540 msgr2=0x7f2e58158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e580b1540 0x7f2e58158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 -- 172.21.15.177:0/392878147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580af040 con 0x7f2e580af840 2023-10-25T16:23:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5cc7f640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e580b1540 0x7f2e58158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:23:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e4f7fe640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 0x7f2e58158420 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000e990 tx=0x7f2e4000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:19.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000cb80 con 0x7f2e580af840 2023-10-25T16:23:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e4000cdd0 con 0x7f2e580af840 2023-10-25T16:23:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e580af320 con 0x7f2e580af840 2023-10-25T16:23:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4001a6c0 con 0x7f2e580af840 2023-10-25T16:23:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e581488c0 con 0x7f2e580af840 2023-10-25T16:23:19.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.636+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5804daf0 con 0x7f2e580af840 2023-10-25T16:23:19.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.640+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e4001a820 con 0x7f2e580af840 2023-10-25T16:23:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.640+0000 7f2e557fa640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e3c0664a0 0x7f2e3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.640+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e40015070 con 0x7f2e580af840 2023-10-25T16:23:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.640+0000 7f2e57fff640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e3c0664a0 0x7f2e3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.640+0000 7f2e57fff640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e3c0664a0 0x7f2e3c068960 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001060 tx=0x7f2e48006040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:19.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.644+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e400525d0 con 0x7f2e580af840 2023-10-25T16:23:19.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.792+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e58148b40 con 0x7f2e580af840 2023-10-25T16:23:19.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e557fa640 1 -- 172.21.15.177:0/392878147 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16617 (secure 0 0 0) 0x7f2e40055bf0 con 0x7f2e580af840 2023-10-25T16:23:19.792 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:19.792 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":173,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:23:18.493322+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:19.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e3c0664a0 msgr2=0x7f2e3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e3c0664a0 0x7f2e3c068960 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001060 tx=0x7f2e48006040 comp rx=0 tx=0).stop 2023-10-25T16:23:19.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 msgr2=0x7f2e58158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 0x7f2e58158420 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000e990 tx=0x7f2e4000ee50 comp rx=0 tx=0).stop 2023-10-25T16:23:19.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 shutdown_connections 2023-10-25T16:23:19.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e3c0664a0 0x7f2e3c068960 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e580b1540 0x7f2e58158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e580af840 0x7f2e58158420 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 --2- 172.21.15.177:0/392878147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e581484e0 0x7f2e580ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 >> 172.21.15.177:0/392878147 conn(0x7f2e580b2450 msgr2=0x7f2e58151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:19.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 shutdown_connections 2023-10-25T16:23:19.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.796+0000 7f2e5e6e2640 1 -- 172.21.15.177:0/392878147 wait complete. 2023-10-25T16:23:19.809 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:23:19.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 -- 172.21.15.177:0/3778608848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb4159210 msgr2=0x7f7bb40ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 --2- 172.21.15.177:0/3778608848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb4159210 0x7f7bb40ae700 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009840 tx=0x7f7ba401c700 comp rx=0 tx=0).stop 2023-10-25T16:23:19.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 -- 172.21.15.177:0/3778608848 shutdown_connections 2023-10-25T16:23:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 --2- 172.21.15.177:0/3778608848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb4159210 0x7f7bb40ae700 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 -- 172.21.15.177:0/3778608848 >> 172.21.15.177:0/3778608848 conn(0x7f7bb4097a40 msgr2=0x7f7bb4097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 -- 172.21.15.177:0/3778608848 shutdown_connections 2023-10-25T16:23:19.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 -- 172.21.15.177:0/3778608848 wait complete. 2023-10-25T16:23:19.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 Processor -- start 2023-10-25T16:23:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.928+0000 7f7bb9161640 1 -- start start 2023-10-25T16:23:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 0x7f7bb415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bb40cdcf0 0x7f7bb4159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb4159210 0x7f7bb40acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb4152260 con 0x7f7bb40afd80 2023-10-25T16:23:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb415bc30 con 0x7f7bb4159210 2023-10-25T16:23:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb415bf10 con 0x7f7bb40cdcf0 2023-10-25T16:23:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 0x7f7bb415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.931 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 0x7f7bb415b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53652/0 (socket says 172.21.15.177:53652) 2023-10-25T16:23:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 -- 172.21.15.177:0/2141472331 learned_addr learned my addr 172.21.15.177:0/2141472331 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 -- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bb40cdcf0 msgr2=0x7f7bb4159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bb40cdcf0 0x7f7bb4159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 -- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb4159210 msgr2=0x7f7bb40acfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb4159210 0x7f7bb40acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:19.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 -- 172.21.15.177:0/2141472331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40094a0 con 0x7f7bb40afd80 2023-10-25T16:23:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb2d9d640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 0x7f7bb415b5c0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009790 tx=0x7f7ba40a6770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40041c0 con 0x7f7bb40afd80 2023-10-25T16:23:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ba4004410 con 0x7f7bb40afd80 2023-10-25T16:23:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb415c1f0 con 0x7f7bb40afd80 2023-10-25T16:23:19.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4005020 con 0x7f7bb40afd80 2023-10-25T16:23:19.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb4159fe0 con 0x7f7bb40afd80 2023-10-25T16:23:19.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb415c6a0 con 0x7f7bb40afd80 2023-10-25T16:23:19.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ba4005180 con 0x7f7bb40afd80 2023-10-25T16:23:19.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7b9b7fe640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ba0066470 0x7f7ba0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:19.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ba40aa070 con 0x7f7bb40afd80 2023-10-25T16:23:19.935 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.932+0000 7f7bb259c640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ba0066470 0x7f7ba0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:19.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.936+0000 7f7bb259c640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ba0066470 0x7f7ba0068930 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7bb415cc60 tx=0x7f7ba80079c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:19.936 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:19.936+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ba40ebfd0 con 0x7f7bb40afd80 2023-10-25T16:23:20.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.112+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7bb404daf0 con 0x7f7bb40afd80 2023-10-25T16:23:20.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.200+0000 7f7b9b7fe640 1 -- 172.21.15.177:0/2141472331 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7ba40bd020 con 0x7f7bb40afd80 2023-10-25T16:23:20.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ba0066470 msgr2=0x7f7ba0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:20.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ba0066470 0x7f7ba0068930 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7bb415cc60 tx=0x7f7ba80079c0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 msgr2=0x7f7bb415b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:20.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 0x7f7bb415b5c0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009790 tx=0x7f7ba40a6770 comp rx=0 tx=0).stop 2023-10-25T16:23:20.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 shutdown_connections 2023-10-25T16:23:20.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7ba0066470 0x7f7ba0068930 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb4159210 0x7f7bb40acfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7bb40cdcf0 0x7f7bb4159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 --2- 172.21.15.177:0/2141472331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bb40afd80 0x7f7bb415b5c0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 >> 172.21.15.177:0/2141472331 conn(0x7f7bb4097a40 msgr2=0x7f7bb406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:20.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 shutdown_connections 2023-10-25T16:23:20.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.204+0000 7f7bb9161640 1 -- 172.21.15.177:0/2141472331 wait complete. 2023-10-25T16:23:20.217 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:23:20.218 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:23:20.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/205923783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d00aebc0 msgr2=0x7f66d00af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:20.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 --2- 172.21.15.177:0/205923783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d00aebc0 0x7f66d00af010 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009900 tx=0x7f66c801c8c0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/205923783 shutdown_connections 2023-10-25T16:23:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 --2- 172.21.15.177:0/205923783 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d00aebc0 0x7f66d00af010 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/205923783 >> 172.21.15.177:0/205923783 conn(0x7f66d00b2450 msgr2=0x7f66d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/205923783 shutdown_connections 2023-10-25T16:23:20.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/205923783 wait complete. 2023-10-25T16:23:20.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 Processor -- start 2023-10-25T16:23:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- start start 2023-10-25T16:23:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66d00aebc0 0x7f66d00abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d00cbfa0 0x7f66d0071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:20.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 0x7f66d0145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:20.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00ac5e0 con 0x7f66d014e810 2023-10-25T16:23:20.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00ac300 con 0x7f66d00cbfa0 2023-10-25T16:23:20.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d0070660 con 0x7f66d00aebc0 2023-10-25T16:23:20.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 0x7f66d0145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:20.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 0x7f66d0145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:53666/0 (socket says 172.21.15.177:53666) 2023-10-25T16:23:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 -- 172.21.15.177:0/1767079681 learned_addr learned my addr 172.21.15.177:0/1767079681 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66ce7fc640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d00cbfa0 0x7f66d0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66ceffd640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66d00aebc0 0x7f66d00abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 -- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66d00aebc0 msgr2=0x7f66d00abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:20.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66d00aebc0 0x7f66d00abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 -- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d00cbfa0 msgr2=0x7f66d0071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d00cbfa0 0x7f66d0071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 -- 172.21.15.177:0/1767079681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8009560 con 0x7f66d014e810 2023-10-25T16:23:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66cf7fe640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 0x7f66d0145bd0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009850 tx=0x7f66c80a57f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:20.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c80bb070 con 0x7f66d014e810 2023-10-25T16:23:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f66c8004230 con 0x7f66d014e810 2023-10-25T16:23:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d0070940 con 0x7f66d014e810 2023-10-25T16:23:20.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8003600 con 0x7f66d014e810 2023-10-25T16:23:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.344+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d00ac010 con 0x7f66d014e810 2023-10-25T16:23:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.348+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0070e60 con 0x7f66d014e810 2023-10-25T16:23:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.348+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f66c80b4040 con 0x7f66d014e810 2023-10-25T16:23:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.348+0000 7f66b77fe640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66bc066470 0x7f66bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:20.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.348+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66c811dd50 con 0x7f66d014e810 2023-10-25T16:23:20.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.348+0000 7f66ceffd640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66bc066470 0x7f66bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:20.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.348+0000 7f66ceffd640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66bc066470 0x7f66bc068930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f66d00ca070 tx=0x7f66c0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:20.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.352+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66d0070e60 con 0x7f66d014e810 2023-10-25T16:23:20.520 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:20.524+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f66d0070e60 con 0x7f66d014e810 2023-10-25T16:23:21.124 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-25T16:23:21.125+0000 7fe52c926640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:23:21.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-25T16:23:21.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-25T16:23:21.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-25T16:23:21.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-25T16:23:21.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.212+0000 7f66b77fe640 1 -- 172.21.15.177:0/1767079681 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66d0070e60 con 0x7f66d014e810 2023-10-25T16:23:21.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66bc066470 msgr2=0x7f66bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66bc066470 0x7f66bc068930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f66d00ca070 tx=0x7f66c0009040 comp rx=0 tx=0).stop 2023-10-25T16:23:21.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 msgr2=0x7f66d0145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 0x7f66d0145bd0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009850 tx=0x7f66c80a57f0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 shutdown_connections 2023-10-25T16:23:21.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f66bc066470 0x7f66bc068930 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66d014e810 0x7f66d0145bd0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66d00cbfa0 0x7f66d0071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 --2- 172.21.15.177:0/1767079681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66d00aebc0 0x7f66d00abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 >> 172.21.15.177:0/1767079681 conn(0x7f66d00b2450 msgr2=0x7f66d00ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:21.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 shutdown_connections 2023-10-25T16:23:21.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.216+0000 7f66d5734640 1 -- 172.21.15.177:0/1767079681 wait complete. 2023-10-25T16:23:21.235 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:23:21.235 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:21.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 -- 172.21.15.177:0/454087316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 msgr2=0x7fa0b40cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/454087316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40cfd30 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac009c80 tx=0x7fa0ac01cd50 comp rx=0 tx=0).stop 2023-10-25T16:23:21.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 -- 172.21.15.177:0/454087316 shutdown_connections 2023-10-25T16:23:21.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/454087316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40cfd30 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/454087316 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0b415b3a0 0x7fa0b40cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 -- 172.21.15.177:0/454087316 >> 172.21.15.177:0/454087316 conn(0x7fa0b409a570 msgr2=0x7fa0b40d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:21.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 -- 172.21.15.177:0/454087316 shutdown_connections 2023-10-25T16:23:21.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.360+0000 7fa0b90d1640 1 -- 172.21.15.177:0/454087316 wait complete. 2023-10-25T16:23:21.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 Processor -- start 2023-10-25T16:23:21.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- start start 2023-10-25T16:23:21.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b40b6e10 0x7fa0b4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0b415b3a0 0x7fa0b40d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b41575b0 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4157890 con 0x7fa0b40b6e10 2023-10-25T16:23:21.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4157b70 con 0x7fa0b415b3a0 2023-10-25T16:23:21.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36946/0 (socket says 172.21.15.177:36946) 2023-10-25T16:23:21.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 -- 172.21.15.177:0/4054424823 learned_addr learned my addr 172.21.15.177:0/4054424823 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:21.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 -- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0b415b3a0 msgr2=0x7fa0b40d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0b415b3a0 0x7fa0b40d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 -- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b40b6e10 msgr2=0x7fa0b4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b2d9d640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b40b6e10 0x7fa0b4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b40b6e10 0x7fa0b4156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 -- 172.21.15.177:0/4054424823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0098e0 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b259c640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40c69f0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c4d0 tx=0x7fa0a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:21.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8005480 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa0a80036f0 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b4157e50 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8003b00 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b40c6f30 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b404daf0 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.367 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0a8003c60 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa09b7fe640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0a00664a0 0x7fa0a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.364+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0a80836b0 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.368+0000 7fa0b2d9d640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0a00664a0 0x7fa0a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.368+0000 7fa0b2d9d640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0a00664a0 0x7fa0a0068960 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40058d0 tx=0x7fa0a4005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:21.369 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.368+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0a8050c00 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.552+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0b4158300 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.552+0000 7fa09b7fe640 1 -- 172.21.15.177:0/4054424823 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fa0a8054220 con 0x7fa0b40ce1a0 2023-10-25T16:23:21.550 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:21.550 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:23:21.551 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:23:21.552 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0a00664a0 msgr2=0x7fa0a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0a00664a0 0x7fa0a0068960 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40058d0 tx=0x7fa0a4005860 comp rx=0 tx=0).stop 2023-10-25T16:23:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 msgr2=0x7fa0b40c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40c69f0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c4d0 tx=0x7fa0a800c990 comp rx=0 tx=0).stop 2023-10-25T16:23:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 shutdown_connections 2023-10-25T16:23:21.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa0a00664a0 0x7fa0a0068960 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa0b415b3a0 0x7fa0b40d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b40ce1a0 0x7fa0b40c69f0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 --2- 172.21.15.177:0/4054424823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0b40b6e10 0x7fa0b4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 >> 172.21.15.177:0/4054424823 conn(0x7fa0b409a570 msgr2=0x7fa0b40b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:21.554 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 shutdown_connections 2023-10-25T16:23:21.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.556+0000 7fa0b90d1640 1 -- 172.21.15.177:0/4054424823 wait complete. 2023-10-25T16:23:21.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:23:21.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/1847955587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 msgr2=0x7fea1c0d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 --2- 172.21.15.177:0/1847955587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0d1bd0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fea04009840 tx=0x7fea0401c770 comp rx=0 tx=0).stop 2023-10-25T16:23:21.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/1847955587 shutdown_connections 2023-10-25T16:23:21.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 --2- 172.21.15.177:0/1847955587 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0d1bd0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 --2- 172.21.15.177:0/1847955587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea1c15eba0 0x7fea1c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/1847955587 >> 172.21.15.177:0/1847955587 conn(0x7fea1c09a5c0 msgr2=0x7fea1c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:21.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/1847955587 shutdown_connections 2023-10-25T16:23:21.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/1847955587 wait complete. 2023-10-25T16:23:21.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 Processor -- start 2023-10-25T16:23:21.695 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- start start 2023-10-25T16:23:21.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea1c0cdb10 0x7fea1c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea1c15eba0 0x7fea1c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0b4ea0 con 0x7fea1c0b2120 2023-10-25T16:23:21.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0b5d00 con 0x7fea1c15eba0 2023-10-25T16:23:21.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0b50f0 con 0x7fea1c0cdb10 2023-10-25T16:23:21.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36962/0 (socket says 172.21.15.177:36962) 2023-10-25T16:23:21.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 -- 172.21.15.177:0/3476134271 learned_addr learned my addr 172.21.15.177:0/3476134271 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:21.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea19d9b640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea1c0cdb10 0x7fea1c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1ad9d640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea1c15eba0 0x7fea1c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 -- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea1c0cdb10 msgr2=0x7fea1c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea1c0cdb10 0x7fea1c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 -- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea1c15eba0 msgr2=0x7fea1c0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea1c15eba0 0x7fea1c0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 -- 172.21.15.177:0/3476134271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040094a0 con 0x7fea1c0b2120 2023-10-25T16:23:21.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea1a59c640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0b6190 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fea1400eaa0 tx=0x7fea1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:21.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400ce10 con 0x7fea1c0b2120 2023-10-25T16:23:21.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea14011470 con 0x7fea1c0b2120 2023-10-25T16:23:21.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0b53d0 con 0x7fea1c0b2120 2023-10-25T16:23:21.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011860 con 0x7fea1c0b2120 2023-10-25T16:23:21.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0b5990 con 0x7fea1c0b2120 2023-10-25T16:23:21.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.696+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c04daf0 con 0x7fea1c0b2120 2023-10-25T16:23:21.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.700+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea140119c0 con 0x7fea1c0b2120 2023-10-25T16:23:21.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.700+0000 7fea12ffd640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea000664a0 0x7fea00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:21.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.700+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea14084b30 con 0x7fea1c0b2120 2023-10-25T16:23:21.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.700+0000 7fea19d9b640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea000664a0 0x7fea00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:21.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.700+0000 7fea19d9b640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea000664a0 0x7fea00068960 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fea040ae000 tx=0x7fea040b3040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:21.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.704+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea14051fb0 con 0x7fea1c0b2120 2023-10-25T16:23:21.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.856+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea1c0ce930 con 0x7fea1c0b2120 2023-10-25T16:23:21.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea12ffd640 1 -- 172.21.15.177:0/3476134271 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+16604 (secure 0 0 0) 0x7fea140555d0 con 0x7fea1c0b2120 2023-10-25T16:23:21.856 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:21.856 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":174,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:23:20.167035+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:23:21.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea000664a0 msgr2=0x7fea00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea000664a0 0x7fea00068960 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fea040ae000 tx=0x7fea040b3040 comp rx=0 tx=0).stop 2023-10-25T16:23:21.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 msgr2=0x7fea1c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:21.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0b6190 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fea1400eaa0 tx=0x7fea1400ef60 comp rx=0 tx=0).stop 2023-10-25T16:23:21.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 shutdown_connections 2023-10-25T16:23:21.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea000664a0 0x7fea00068960 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea1c15eba0 0x7fea1c0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea1c0cdb10 0x7fea1c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 --2- 172.21.15.177:0/3476134271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea1c0b2120 0x7fea1c0b6190 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:21.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 >> 172.21.15.177:0/3476134271 conn(0x7fea1c09a5c0 msgr2=0x7fea1c158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:21.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 shutdown_connections 2023-10-25T16:23:21.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:21.860+0000 7fea20976640 1 -- 172.21.15.177:0/3476134271 wait complete. 2023-10-25T16:23:21.875 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:23:21.876 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:23:22.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/1666962400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 msgr2=0x7f2e3c0062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 --2- 172.21.15.177:0/1666962400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e3c0062a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f2e48001d70 tx=0x7f2e4801cae0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e560dd640 1 -- 172.21.15.177:0/1666962400 reap_dead start 2023-10-25T16:23:22.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/1666962400 shutdown_connections 2023-10-25T16:23:22.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/1666962400 >> 172.21.15.177:0/1666962400 conn(0x7f2e500b2450 msgr2=0x7f2e500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:22.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/1666962400 shutdown_connections 2023-10-25T16:23:22.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/1666962400 wait complete. 2023-10-25T16:23:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 Processor -- start 2023-10-25T16:23:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- start start 2023-10-25T16:23:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e50159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5013e6f0 0x7f2e5015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e501e2650 0x7f2e501e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e501e1ef0 con 0x7f2e3c005e20 2023-10-25T16:23:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50159350 con 0x7f2e5013e6f0 2023-10-25T16:23:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50158aa0 con 0x7f2e501e2650 2023-10-25T16:23:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e50159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e50159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:36974/0 (socket says 172.21.15.177:36974) 2023-10-25T16:23:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 -- 172.21.15.177:0/3828861638 learned_addr learned my addr 172.21.15.177:0/3828861638 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e550db640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5013e6f0 0x7f2e5015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e560dd640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e501e2650 0x7f2e501e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 -- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e501e2650 msgr2=0x7f2e501e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e501e2650 0x7f2e501e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 -- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5013e6f0 msgr2=0x7f2e5015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5013e6f0 0x7f2e5015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 -- 172.21.15.177:0/3828861638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e501e1c10 con 0x7f2e3c005e20 2023-10-25T16:23:22.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e560dd640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e501e2650 0x7f2e501e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:22.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e558dc640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e50159770 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006da0 tx=0x7f2e4c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:22.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c010890 con 0x7f2e3c005e20 2023-10-25T16:23:22.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e4c010ae0 con 0x7f2e3c005e20 2023-10-25T16:23:22.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e50158c90 con 0x7f2e3c005e20 2023-10-25T16:23:22.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c011460 con 0x7f2e3c005e20 2023-10-25T16:23:22.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e50159cb0 con 0x7f2e3c005e20 2023-10-25T16:23:22.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.008+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e50159490 con 0x7f2e3c005e20 2023-10-25T16:23:22.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.012+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e4c0193b0 con 0x7f2e3c005e20 2023-10-25T16:23:22.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.012+0000 7f2e467fc640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e340664a0 0x7f2e34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.012+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e4c084a50 con 0x7f2e3c005e20 2023-10-25T16:23:22.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.012+0000 7f2e550db640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e340664a0 0x7f2e34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.012+0000 7f2e550db640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e340664a0 0x7f2e34068960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2e50157560 tx=0x7f2e40005f40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:22.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.016+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e50159490 con 0x7f2e3c005e20 2023-10-25T16:23:22.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.168+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e501e3010 con 0x7f2e340664a0 2023-10-25T16:23:22.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.188+0000 7f2e467fc640 1 -- 172.21.15.177:0/3828861638 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282245 (secure 0 0 0) 0x7f2e501e3010 con 0x7f2e340664a0 2023-10-25T16:23:22.189 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:22.191 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:23:22.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e340664a0 msgr2=0x7f2e34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e340664a0 0x7f2e34068960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2e50157560 tx=0x7f2e40005f40 comp rx=0 tx=0).stop 2023-10-25T16:23:22.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 msgr2=0x7f2e50159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e50159770 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c006da0 tx=0x7f2e4c0049e0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 shutdown_connections 2023-10-25T16:23:22.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e340664a0 0x7f2e34068960 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e501e2650 0x7f2e501e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5013e6f0 0x7f2e5015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 --2- 172.21.15.177:0/3828861638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e3c005e20 0x7f2e50159770 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 >> 172.21.15.177:0/3828861638 conn(0x7f2e500b2450 msgr2=0x7f2e500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:22.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 shutdown_connections 2023-10-25T16:23:22.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.192+0000 7f2e57b40640 1 -- 172.21.15.177:0/3828861638 wait complete. 2023-10-25T16:23:22.208 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2023-10-25T16:23:20.823827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8731,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553768,"statfs":{"total":1600000000,"available":1591058732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001219"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179492+0000","last_change":"2023-10-25T16:23:19.179248+0000","last_active":"2023-10-25T16:23:19.179492+0000","last_peered":"2023-10-25T16:23:19.179492+0000","last_clean":"2023-10-25T16:23:19.179492+0000","last_became_active":"2023-10-25T16:23:19.179003+0000","last_became_peered":"2023-10-25T16:23:19.179003+0000","last_unstale":"2023-10-25T16:23:19.179492+0000","last_undegraded":"2023-10-25T16:23:19.179492+0000","last_fullsized":"2023-10-25T16:23:19.179492+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:58.596626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180343+0000","last_change":"2023-10-25T16:23:19.180275+0000","last_active":"2023-10-25T16:23:19.180343+0000","last_peered":"2023-10-25T16:23:19.180343+0000","last_clean":"2023-10-25T16:23:19.180343+0000","last_became_active":"2023-10-25T16:23:19.180044+0000","last_became_peered":"2023-10-25T16:23:19.180044+0000","last_unstale":"2023-10-25T16:23:19.180343+0000","last_undegraded":"2023-10-25T16:23:19.180343+0000","last_fullsized":"2023-10-25T16:23:19.180343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:34:40.100162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193667+0000","last_change":"2023-10-25T16:23:19.193592+0000","last_active":"2023-10-25T16:23:19.193667+0000","last_peered":"2023-10-25T16:23:19.193667+0000","last_clean":"2023-10-25T16:23:19.193667+0000","last_became_active":"2023-10-25T16:23:19.192339+0000","last_became_peered":"2023-10-25T16:23:19.192339+0000","last_unstale":"2023-10-25T16:23:19.193667+0000","last_undegraded":"2023-10-25T16:23:19.193667+0000","last_fullsized":"2023-10-25T16:23:19.193667+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:49.438562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185930+0000","last_change":"2023-10-25T16:23:19.185798+0000","last_active":"2023-10-25T16:23:19.185930+0000","last_peered":"2023-10-25T16:23:19.185930+0000","last_clean":"2023-10-25T16:23:19.185930+0000","last_became_active":"2023-10-25T16:23:19.184621+0000","last_became_peered":"2023-10-25T16:23:19.184621+0000","last_unstale":"2023-10-25T16:23:19.185930+0000","last_undegraded":"2023-10-25T16:23:19.185930+0000","last_fullsized":"2023-10-25T16:23:19.185930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:19:30.964216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191807+0000","last_change":"2023-10-25T16:23:19.191555+0000","last_active":"2023-10-25T16:23:19.191807+0000","last_peered":"2023-10-25T16:23:19.191807+0000","last_clean":"2023-10-25T16:23:19.191807+0000","last_became_active":"2023-10-25T16:23:19.191159+0000","last_became_peered":"2023-10-25T16:23:19.191159+0000","last_unstale":"2023-10-25T16:23:19.191807+0000","last_undegraded":"2023-10-25T16:23:19.191807+0000","last_fullsized":"2023-10-25T16:23:19.191807+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:19.271674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.205515+0000","last_change":"2023-10-25T16:23:19.205378+0000","last_active":"2023-10-25T16:23:19.205515+0000","last_peered":"2023-10-25T16:23:19.205515+0000","last_clean":"2023-10-25T16:23:19.205515+0000","last_became_active":"2023-10-25T16:23:19.202582+0000","last_became_peered":"2023-10-25T16:23:19.202582+0000","last_unstale":"2023-10-25T16:23:19.205515+0000","last_undegraded":"2023-10-25T16:23:19.205515+0000","last_fullsized":"2023-10-25T16:23:19.205515+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:57.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190227+0000","last_change":"2023-10-25T16:23:19.190157+0000","last_active":"2023-10-25T16:23:19.190227+0000","last_peered":"2023-10-25T16:23:19.190227+0000","last_clean":"2023-10-25T16:23:19.190227+0000","last_became_active":"2023-10-25T16:23:19.189923+0000","last_became_peered":"2023-10-25T16:23:19.189923+0000","last_unstale":"2023-10-25T16:23:19.190227+0000","last_undegraded":"2023-10-25T16:23:19.190227+0000","last_fullsized":"2023-10-25T16:23:19.190227+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195713+0000","last_change":"2023-10-25T16:23:19.195649+0000","last_active":"2023-10-25T16:23:19.195713+0000","last_peered":"2023-10-25T16:23:19.195713+0000","last_clean":"2023-10-25T16:23:19.195713+0000","last_became_active":"2023-10-25T16:23:19.195462+0000","last_became_peered":"2023-10-25T16:23:19.195462+0000","last_unstale":"2023-10-25T16:23:19.195713+0000","last_undegraded":"2023-10-25T16:23:19.195713+0000","last_fullsized":"2023-10-25T16:23:19.195713+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:04:05.185753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180467+0000","last_change":"2023-10-25T16:23:19.180227+0000","last_active":"2023-10-25T16:23:19.180467+0000","last_peered":"2023-10-25T16:23:19.180467+0000","last_clean":"2023-10-25T16:23:19.180467+0000","last_became_active":"2023-10-25T16:23:19.179523+0000","last_became_peered":"2023-10-25T16:23:19.179523+0000","last_unstale":"2023-10-25T16:23:19.180467+0000","last_undegraded":"2023-10-25T16:23:19.180467+0000","last_fullsized":"2023-10-25T16:23:19.180467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:09.212133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185765+0000","last_change":"2023-10-25T16:23:19.185690+0000","last_active":"2023-10-25T16:23:19.185765+0000","last_peered":"2023-10-25T16:23:19.185765+0000","last_clean":"2023-10-25T16:23:19.185765+0000","last_became_active":"2023-10-25T16:23:19.185461+0000","last_became_peered":"2023-10-25T16:23:19.185461+0000","last_unstale":"2023-10-25T16:23:19.185765+0000","last_undegraded":"2023-10-25T16:23:19.185765+0000","last_fullsized":"2023-10-25T16:23:19.185765+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:43.458260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204930+0000","last_change":"2023-10-25T16:23:19.204724+0000","last_active":"2023-10-25T16:23:19.204930+0000","last_peered":"2023-10-25T16:23:19.204930+0000","last_clean":"2023-10-25T16:23:19.204930+0000","last_became_active":"2023-10-25T16:23:19.201797+0000","last_became_peered":"2023-10-25T16:23:19.201797+0000","last_unstale":"2023-10-25T16:23:19.204930+0000","last_undegraded":"2023-10-25T16:23:19.204930+0000","last_fullsized":"2023-10-25T16:23:19.204930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:24:15.782352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193383+0000","last_change":"2023-10-25T16:23:19.193268+0000","last_active":"2023-10-25T16:23:19.193383+0000","last_peered":"2023-10-25T16:23:19.193383+0000","last_clean":"2023-10-25T16:23:19.193383+0000","last_became_active":"2023-10-25T16:23:19.193016+0000","last_became_peered":"2023-10-25T16:23:19.193016+0000","last_unstale":"2023-10-25T16:23:19.193383+0000","last_undegraded":"2023-10-25T16:23:19.193383+0000","last_fullsized":"2023-10-25T16:23:19.193383+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:33.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196025+0000","last_change":"2023-10-25T16:23:19.195794+0000","last_active":"2023-10-25T16:23:19.196025+0000","last_peered":"2023-10-25T16:23:19.196025+0000","last_clean":"2023-10-25T16:23:19.196025+0000","last_became_active":"2023-10-25T16:23:19.195408+0000","last_became_peered":"2023-10-25T16:23:19.195408+0000","last_unstale":"2023-10-25T16:23:19.196025+0000","last_undegraded":"2023-10-25T16:23:19.196025+0000","last_fullsized":"2023-10-25T16:23:19.196025+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:32:13.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183344+0000","last_change":"2023-10-25T16:23:19.180964+0000","last_active":"2023-10-25T16:23:19.183344+0000","last_peered":"2023-10-25T16:23:19.183344+0000","last_clean":"2023-10-25T16:23:19.183344+0000","last_became_active":"2023-10-25T16:23:19.180431+0000","last_became_peered":"2023-10-25T16:23:19.180431+0000","last_unstale":"2023-10-25T16:23:19.183344+0000","last_undegraded":"2023-10-25T16:23:19.183344+0000","last_fullsized":"2023-10-25T16:23:19.183344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:16:41.765358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190297+0000","last_change":"2023-10-25T16:23:19.190014+0000","last_active":"2023-10-25T16:23:19.190297+0000","last_peered":"2023-10-25T16:23:19.190297+0000","last_clean":"2023-10-25T16:23:19.190297+0000","last_became_active":"2023-10-25T16:23:19.189493+0000","last_became_peered":"2023-10-25T16:23:19.189493+0000","last_unstale":"2023-10-25T16:23:19.190297+0000","last_undegraded":"2023-10-25T16:23:19.190297+0000","last_fullsized":"2023-10-25T16:23:19.190297+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:02.385681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179509+0000","last_change":"2023-10-25T16:23:19.179324+0000","last_active":"2023-10-25T16:23:19.179509+0000","last_peered":"2023-10-25T16:23:19.179509+0000","last_clean":"2023-10-25T16:23:19.179509+0000","last_became_active":"2023-10-25T16:23:19.179112+0000","last_became_peered":"2023-10-25T16:23:19.179112+0000","last_unstale":"2023-10-25T16:23:19.179509+0000","last_undegraded":"2023-10-25T16:23:19.179509+0000","last_fullsized":"2023-10-25T16:23:19.179509+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193837+0000","last_change":"2023-10-25T16:23:19.193768+0000","last_active":"2023-10-25T16:23:19.193837+0000","last_peered":"2023-10-25T16:23:19.193837+0000","last_clean":"2023-10-25T16:23:19.193837+0000","last_became_active":"2023-10-25T16:23:19.192700+0000","last_became_peered":"2023-10-25T16:23:19.192700+0000","last_unstale":"2023-10-25T16:23:19.193837+0000","last_undegraded":"2023-10-25T16:23:19.193837+0000","last_fullsized":"2023-10-25T16:23:19.193837+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:39.792430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192238+0000","last_change":"2023-10-25T16:23:19.191525+0000","last_active":"2023-10-25T16:23:19.192238+0000","last_peered":"2023-10-25T16:23:19.192238+0000","last_clean":"2023-10-25T16:23:19.192238+0000","last_became_active":"2023-10-25T16:23:19.191250+0000","last_became_peered":"2023-10-25T16:23:19.191250+0000","last_unstale":"2023-10-25T16:23:19.192238+0000","last_undegraded":"2023-10-25T16:23:19.192238+0000","last_fullsized":"2023-10-25T16:23:19.192238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:37:41.183771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179216+0000","last_change":"2023-10-25T16:23:19.179127+0000","last_active":"2023-10-25T16:23:19.179216+0000","last_peered":"2023-10-25T16:23:19.179216+0000","last_clean":"2023-10-25T16:23:19.179216+0000","last_became_active":"2023-10-25T16:23:19.178779+0000","last_became_peered":"2023-10-25T16:23:19.178779+0000","last_unstale":"2023-10-25T16:23:19.179216+0000","last_undegraded":"2023-10-25T16:23:19.179216+0000","last_fullsized":"2023-10-25T16:23:19.179216+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183287+0000","last_change":"2023-10-25T16:23:19.178582+0000","last_active":"2023-10-25T16:23:19.183287+0000","last_peered":"2023-10-25T16:23:19.183287+0000","last_clean":"2023-10-25T16:23:19.183287+0000","last_became_active":"2023-10-25T16:23:19.178119+0000","last_became_peered":"2023-10-25T16:23:19.178119+0000","last_unstale":"2023-10-25T16:23:19.183287+0000","last_undegraded":"2023-10-25T16:23:19.183287+0000","last_fullsized":"2023-10-25T16:23:19.183287+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:09.196519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185634+0000","last_change":"2023-10-25T16:23:19.185562+0000","last_active":"2023-10-25T16:23:19.185634+0000","last_peered":"2023-10-25T16:23:19.185634+0000","last_clean":"2023-10-25T16:23:19.185634+0000","last_became_active":"2023-10-25T16:23:19.184794+0000","last_became_peered":"2023-10-25T16:23:19.184794+0000","last_unstale":"2023-10-25T16:23:19.185634+0000","last_undegraded":"2023-10-25T16:23:19.185634+0000","last_fullsized":"2023-10-25T16:23:19.185634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:51.312017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184140+0000","last_change":"2023-10-25T16:23:19.184065+0000","last_active":"2023-10-25T16:23:19.184140+0000","last_peered":"2023-10-25T16:23:19.184140+0000","last_clean":"2023-10-25T16:23:19.184140+0000","last_became_active":"2023-10-25T16:23:19.183837+0000","last_became_peered":"2023-10-25T16:23:19.183837+0000","last_unstale":"2023-10-25T16:23:19.184140+0000","last_undegraded":"2023-10-25T16:23:19.184140+0000","last_fullsized":"2023-10-25T16:23:19.184140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:25.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204289+0000","last_change":"2023-10-25T16:23:19.204123+0000","last_active":"2023-10-25T16:23:19.204289+0000","last_peered":"2023-10-25T16:23:19.204289+0000","last_clean":"2023-10-25T16:23:19.204289+0000","last_became_active":"2023-10-25T16:23:19.199324+0000","last_became_peered":"2023-10-25T16:23:19.199324+0000","last_unstale":"2023-10-25T16:23:19.204289+0000","last_undegraded":"2023-10-25T16:23:19.204289+0000","last_fullsized":"2023-10-25T16:23:19.204289+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:57.289392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.189186+0000","last_change":"2023-10-25T16:23:19.186729+0000","last_active":"2023-10-25T16:23:19.189186+0000","last_peered":"2023-10-25T16:23:19.189186+0000","last_clean":"2023-10-25T16:23:19.189186+0000","last_became_active":"2023-10-25T16:23:19.186354+0000","last_became_peered":"2023-10-25T16:23:19.186354+0000","last_unstale":"2023-10-25T16:23:19.189186+0000","last_undegraded":"2023-10-25T16:23:19.189186+0000","last_fullsized":"2023-10-25T16:23:19.189186+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190522+0000","last_change":"2023-10-25T16:23:19.190180+0000","last_active":"2023-10-25T16:23:19.190522+0000","last_peered":"2023-10-25T16:23:19.190522+0000","last_clean":"2023-10-25T16:23:19.190522+0000","last_became_active":"2023-10-25T16:23:19.189509+0000","last_became_peered":"2023-10-25T16:23:19.189509+0000","last_unstale":"2023-10-25T16:23:19.190522+0000","last_undegraded":"2023-10-25T16:23:19.190522+0000","last_fullsized":"2023-10-25T16:23:19.190522+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:56:08.244234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184942+0000","last_change":"2023-10-25T16:23:19.184422+0000","last_active":"2023-10-25T16:23:19.184942+0000","last_peered":"2023-10-25T16:23:19.184942+0000","last_clean":"2023-10-25T16:23:19.184942+0000","last_became_active":"2023-10-25T16:23:19.183889+0000","last_became_peered":"2023-10-25T16:23:19.183889+0000","last_unstale":"2023-10-25T16:23:19.184942+0000","last_undegraded":"2023-10-25T16:23:19.184942+0000","last_fullsized":"2023-10-25T16:23:19.184942+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:53:37.207613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196081+0000","last_change":"2023-10-25T16:23:19.195947+0000","last_active":"2023-10-25T16:23:19.196081+0000","last_peered":"2023-10-25T16:23:19.196081+0000","last_clean":"2023-10-25T16:23:19.196081+0000","last_became_active":"2023-10-25T16:23:19.195349+0000","last_became_peered":"2023-10-25T16:23:19.195349+0000","last_unstale":"2023-10-25T16:23:19.196081+0000","last_undegraded":"2023-10-25T16:23:19.196081+0000","last_fullsized":"2023-10-25T16:23:19.196081+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:22.043144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194059+0000","last_change":"2023-10-25T16:23:19.193900+0000","last_active":"2023-10-25T16:23:19.194059+0000","last_peered":"2023-10-25T16:23:19.194059+0000","last_clean":"2023-10-25T16:23:19.194059+0000","last_became_active":"2023-10-25T16:23:19.193551+0000","last_became_peered":"2023-10-25T16:23:19.193551+0000","last_unstale":"2023-10-25T16:23:19.194059+0000","last_undegraded":"2023-10-25T16:23:19.194059+0000","last_fullsized":"2023-10-25T16:23:19.194059+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:47:44.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"173'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185551+0000","last_change":"2023-10-25T16:23:18.159556+0000","last_active":"2023-10-25T16:23:19.185551+0000","last_peered":"2023-10-25T16:23:19.185551+0000","last_clean":"2023-10-25T16:23:19.185551+0000","last_became_active":"2023-10-25T16:23:18.158349+0000","last_became_peered":"2023-10-25T16:23:18.158349+0000","last_unstale":"2023-10-25T16:23:19.185551+0000","last_undegraded":"2023-10-25T16:23:19.185551+0000","last_fullsized":"2023-10-25T16:23:19.185551+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182590+0000","last_change":"2023-10-25T16:23:19.182477+0000","last_active":"2023-10-25T16:23:19.182590+0000","last_peered":"2023-10-25T16:23:19.182590+0000","last_clean":"2023-10-25T16:23:19.182590+0000","last_became_active":"2023-10-25T16:23:19.182166+0000","last_became_peered":"2023-10-25T16:23:19.182166+0000","last_unstale":"2023-10-25T16:23:19.182590+0000","last_undegraded":"2023-10-25T16:23:19.182590+0000","last_fullsized":"2023-10-25T16:23:19.182590+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:43:46.901069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186987+0000","last_change":"2023-10-25T16:23:18.167802+0000","last_active":"2023-10-25T16:23:19.186987+0000","last_peered":"2023-10-25T16:23:19.186987+0000","last_clean":"2023-10-25T16:23:19.186987+0000","last_became_active":"2023-10-25T16:23:18.167507+0000","last_became_peered":"2023-10-25T16:23:18.167507+0000","last_unstale":"2023-10-25T16:23:19.186987+0000","last_undegraded":"2023-10-25T16:23:19.186987+0000","last_fullsized":"2023-10-25T16:23:19.186987+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:24.539701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182953+0000","last_change":"2023-10-25T16:23:19.182770+0000","last_active":"2023-10-25T16:23:19.182953+0000","last_peered":"2023-10-25T16:23:19.182953+0000","last_clean":"2023-10-25T16:23:19.182953+0000","last_became_active":"2023-10-25T16:23:19.182217+0000","last_became_peered":"2023-10-25T16:23:19.182217+0000","last_unstale":"2023-10-25T16:23:19.182953+0000","last_undegraded":"2023-10-25T16:23:19.182953+0000","last_fullsized":"2023-10-25T16:23:19.182953+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:56.039708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191466+0000","last_change":"2023-10-25T16:23:18.169529+0000","last_active":"2023-10-25T16:23:19.191466+0000","last_peered":"2023-10-25T16:23:19.191466+0000","last_clean":"2023-10-25T16:23:19.191466+0000","last_became_active":"2023-10-25T16:23:18.162217+0000","last_became_peered":"2023-10-25T16:23:18.162217+0000","last_unstale":"2023-10-25T16:23:19.191466+0000","last_undegraded":"2023-10-25T16:23:19.191466+0000","last_fullsized":"2023-10-25T16:23:19.191466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:41:25.784664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193525+0000","last_change":"2023-10-25T16:23:19.193435+0000","last_active":"2023-10-25T16:23:19.193525+0000","last_peered":"2023-10-25T16:23:19.193525+0000","last_clean":"2023-10-25T16:23:19.193525+0000","last_became_active":"2023-10-25T16:23:19.193047+0000","last_became_peered":"2023-10-25T16:23:19.193047+0000","last_unstale":"2023-10-25T16:23:19.193525+0000","last_undegraded":"2023-10-25T16:23:19.193525+0000","last_fullsized":"2023-10-25T16:23:19.193525+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198646+0000","last_change":"2023-10-25T16:23:18.159481+0000","last_active":"2023-10-25T16:23:19.198646+0000","last_peered":"2023-10-25T16:23:19.198646+0000","last_clean":"2023-10-25T16:23:19.198646+0000","last_became_active":"2023-10-25T16:23:18.158375+0000","last_became_peered":"2023-10-25T16:23:18.158375+0000","last_unstale":"2023-10-25T16:23:19.198646+0000","last_undegraded":"2023-10-25T16:23:19.198646+0000","last_fullsized":"2023-10-25T16:23:19.198646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:37.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194416+0000","last_change":"2023-10-25T16:23:19.194347+0000","last_active":"2023-10-25T16:23:19.194416+0000","last_peered":"2023-10-25T16:23:19.194416+0000","last_clean":"2023-10-25T16:23:19.194416+0000","last_became_active":"2023-10-25T16:23:19.193313+0000","last_became_peered":"2023-10-25T16:23:19.193313+0000","last_unstale":"2023-10-25T16:23:19.194416+0000","last_undegraded":"2023-10-25T16:23:19.194416+0000","last_fullsized":"2023-10-25T16:23:19.194416+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185592+0000","last_change":"2023-10-25T16:23:19.185493+0000","last_active":"2023-10-25T16:23:19.185592+0000","last_peered":"2023-10-25T16:23:19.185592+0000","last_clean":"2023-10-25T16:23:19.185592+0000","last_became_active":"2023-10-25T16:23:19.184661+0000","last_became_peered":"2023-10-25T16:23:19.184661+0000","last_unstale":"2023-10-25T16:23:19.185592+0000","last_undegraded":"2023-10-25T16:23:19.185592+0000","last_fullsized":"2023-10-25T16:23:19.185592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:41.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195019+0000","last_change":"2023-10-25T16:23:18.158454+0000","last_active":"2023-10-25T16:23:19.195019+0000","last_peered":"2023-10-25T16:23:19.195019+0000","last_clean":"2023-10-25T16:23:19.195019+0000","last_became_active":"2023-10-25T16:23:18.157852+0000","last_became_peered":"2023-10-25T16:23:18.157852+0000","last_unstale":"2023-10-25T16:23:19.195019+0000","last_undegraded":"2023-10-25T16:23:19.195019+0000","last_fullsized":"2023-10-25T16:23:19.195019+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:17.308462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199538+0000","last_change":"2023-10-25T16:23:19.199453+0000","last_active":"2023-10-25T16:23:19.199538+0000","last_peered":"2023-10-25T16:23:19.199538+0000","last_clean":"2023-10-25T16:23:19.199538+0000","last_became_active":"2023-10-25T16:23:19.197416+0000","last_became_peered":"2023-10-25T16:23:19.197416+0000","last_unstale":"2023-10-25T16:23:19.199538+0000","last_undegraded":"2023-10-25T16:23:19.199538+0000","last_fullsized":"2023-10-25T16:23:19.199538+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:03:05.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193467+0000","last_change":"2023-10-25T16:23:19.193398+0000","last_active":"2023-10-25T16:23:19.193467+0000","last_peered":"2023-10-25T16:23:19.193467+0000","last_clean":"2023-10-25T16:23:19.193467+0000","last_became_active":"2023-10-25T16:23:19.193144+0000","last_became_peered":"2023-10-25T16:23:19.193144+0000","last_unstale":"2023-10-25T16:23:19.193467+0000","last_undegraded":"2023-10-25T16:23:19.193467+0000","last_fullsized":"2023-10-25T16:23:19.193467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:15.074684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176047+0000","last_change":"2023-10-25T16:23:18.170217+0000","last_active":"2023-10-25T16:23:19.176047+0000","last_peered":"2023-10-25T16:23:19.176047+0000","last_clean":"2023-10-25T16:23:19.176047+0000","last_became_active":"2023-10-25T16:23:18.164022+0000","last_became_peered":"2023-10-25T16:23:18.164022+0000","last_unstale":"2023-10-25T16:23:19.176047+0000","last_undegraded":"2023-10-25T16:23:19.176047+0000","last_fullsized":"2023-10-25T16:23:19.176047+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:38.919815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.202140+0000","last_change":"2023-10-25T16:23:19.202046+0000","last_active":"2023-10-25T16:23:19.202140+0000","last_peered":"2023-10-25T16:23:19.202140+0000","last_clean":"2023-10-25T16:23:19.202140+0000","last_became_active":"2023-10-25T16:23:19.201736+0000","last_became_peered":"2023-10-25T16:23:19.201736+0000","last_unstale":"2023-10-25T16:23:19.202140+0000","last_undegraded":"2023-10-25T16:23:19.202140+0000","last_fullsized":"2023-10-25T16:23:19.202140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:11.245553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175388+0000","last_change":"2023-10-25T16:23:18.152106+0000","last_active":"2023-10-25T16:23:19.175388+0000","last_peered":"2023-10-25T16:23:19.175388+0000","last_clean":"2023-10-25T16:23:19.175388+0000","last_became_active":"2023-10-25T16:23:18.151874+0000","last_became_peered":"2023-10-25T16:23:18.151874+0000","last_unstale":"2023-10-25T16:23:19.175388+0000","last_undegraded":"2023-10-25T16:23:19.175388+0000","last_fullsized":"2023-10-25T16:23:19.175388+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:25.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174870+0000","last_change":"2023-10-25T16:23:19.174784+0000","last_active":"2023-10-25T16:23:19.174870+0000","last_peered":"2023-10-25T16:23:19.174870+0000","last_clean":"2023-10-25T16:23:19.174870+0000","last_became_active":"2023-10-25T16:23:19.174430+0000","last_became_peered":"2023-10-25T16:23:19.174430+0000","last_unstale":"2023-10-25T16:23:19.174870+0000","last_undegraded":"2023-10-25T16:23:19.174870+0000","last_fullsized":"2023-10-25T16:23:19.174870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:54.951159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177883+0000","last_change":"2023-10-25T16:23:18.173400+0000","last_active":"2023-10-25T16:23:19.177883+0000","last_peered":"2023-10-25T16:23:19.177883+0000","last_clean":"2023-10-25T16:23:19.177883+0000","last_became_active":"2023-10-25T16:23:18.172310+0000","last_became_peered":"2023-10-25T16:23:18.172310+0000","last_unstale":"2023-10-25T16:23:19.177883+0000","last_undegraded":"2023-10-25T16:23:19.177883+0000","last_fullsized":"2023-10-25T16:23:19.177883+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:40.956111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"173'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.207997+0000","last_change":"2023-10-25T16:23:18.154423+0000","last_active":"2023-10-25T16:23:19.207997+0000","last_peered":"2023-10-25T16:23:19.207997+0000","last_clean":"2023-10-25T16:23:19.207997+0000","last_became_active":"2023-10-25T16:23:18.154185+0000","last_became_peered":"2023-10-25T16:23:18.154185+0000","last_unstale":"2023-10-25T16:23:19.207997+0000","last_undegraded":"2023-10-25T16:23:19.207997+0000","last_fullsized":"2023-10-25T16:23:19.207997+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:32.778729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190263+0000","last_change":"2023-10-25T16:23:19.188225+0000","last_active":"2023-10-25T16:23:19.190263+0000","last_peered":"2023-10-25T16:23:19.190263+0000","last_clean":"2023-10-25T16:23:19.190263+0000","last_became_active":"2023-10-25T16:23:19.187882+0000","last_became_peered":"2023-10-25T16:23:19.187882+0000","last_unstale":"2023-10-25T16:23:19.190263+0000","last_undegraded":"2023-10-25T16:23:19.190263+0000","last_fullsized":"2023-10-25T16:23:19.190263+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:16.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190158+0000","last_change":"2023-10-25T16:23:18.161583+0000","last_active":"2023-10-25T16:23:19.190158+0000","last_peered":"2023-10-25T16:23:19.190158+0000","last_clean":"2023-10-25T16:23:19.190158+0000","last_became_active":"2023-10-25T16:23:18.160916+0000","last_became_peered":"2023-10-25T16:23:18.160916+0000","last_unstale":"2023-10-25T16:23:19.190158+0000","last_undegraded":"2023-10-25T16:23:19.190158+0000","last_fullsized":"2023-10-25T16:23:19.190158+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:03.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178373+0000","last_change":"2023-10-25T16:23:19.178044+0000","last_active":"2023-10-25T16:23:19.178373+0000","last_peered":"2023-10-25T16:23:19.178373+0000","last_clean":"2023-10-25T16:23:19.178373+0000","last_became_active":"2023-10-25T16:23:19.177776+0000","last_became_peered":"2023-10-25T16:23:19.177776+0000","last_unstale":"2023-10-25T16:23:19.178373+0000","last_undegraded":"2023-10-25T16:23:19.178373+0000","last_fullsized":"2023-10-25T16:23:19.178373+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:23.165764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187417+0000","last_change":"2023-10-25T16:23:18.166804+0000","last_active":"2023-10-25T16:23:19.187417+0000","last_peered":"2023-10-25T16:23:19.187417+0000","last_clean":"2023-10-25T16:23:19.187417+0000","last_became_active":"2023-10-25T16:23:18.166187+0000","last_became_peered":"2023-10-25T16:23:18.166187+0000","last_unstale":"2023-10-25T16:23:19.187417+0000","last_undegraded":"2023-10-25T16:23:19.187417+0000","last_fullsized":"2023-10-25T16:23:19.187417+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:57.177360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196007+0000","last_change":"2023-10-25T16:23:19.195656+0000","last_active":"2023-10-25T16:23:19.196007+0000","last_peered":"2023-10-25T16:23:19.196007+0000","last_clean":"2023-10-25T16:23:19.196007+0000","last_became_active":"2023-10-25T16:23:19.195225+0000","last_became_peered":"2023-10-25T16:23:19.195225+0000","last_unstale":"2023-10-25T16:23:19.196007+0000","last_undegraded":"2023-10-25T16:23:19.196007+0000","last_fullsized":"2023-10-25T16:23:19.196007+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:51.080489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173863+0000","last_change":"2023-10-25T16:23:18.151003+0000","last_active":"2023-10-25T16:23:19.173863+0000","last_peered":"2023-10-25T16:23:19.173863+0000","last_clean":"2023-10-25T16:23:19.173863+0000","last_became_active":"2023-10-25T16:23:18.150677+0000","last_became_peered":"2023-10-25T16:23:18.150677+0000","last_unstale":"2023-10-25T16:23:19.173863+0000","last_undegraded":"2023-10-25T16:23:19.173863+0000","last_fullsized":"2023-10-25T16:23:19.173863+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:19.475448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.197147+0000","last_change":"2023-10-25T16:23:19.197069+0000","last_active":"2023-10-25T16:23:19.197147+0000","last_peered":"2023-10-25T16:23:19.197147+0000","last_clean":"2023-10-25T16:23:19.197147+0000","last_became_active":"2023-10-25T16:23:19.196772+0000","last_became_peered":"2023-10-25T16:23:19.196772+0000","last_unstale":"2023-10-25T16:23:19.197147+0000","last_undegraded":"2023-10-25T16:23:19.197147+0000","last_fullsized":"2023-10-25T16:23:19.197147+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:42.978913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178825+0000","last_change":"2023-10-25T16:23:19.178741+0000","last_active":"2023-10-25T16:23:19.178825+0000","last_peered":"2023-10-25T16:23:19.178825+0000","last_clean":"2023-10-25T16:23:19.178825+0000","last_became_active":"2023-10-25T16:23:19.178495+0000","last_became_peered":"2023-10-25T16:23:19.178495+0000","last_unstale":"2023-10-25T16:23:19.178825+0000","last_undegraded":"2023-10-25T16:23:19.178825+0000","last_fullsized":"2023-10-25T16:23:19.178825+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191193+0000","last_change":"2023-10-25T16:23:18.150704+0000","last_active":"2023-10-25T16:23:19.191193+0000","last_peered":"2023-10-25T16:23:19.191193+0000","last_clean":"2023-10-25T16:23:19.191193+0000","last_became_active":"2023-10-25T16:23:18.149026+0000","last_became_peered":"2023-10-25T16:23:18.149026+0000","last_unstale":"2023-10-25T16:23:19.191193+0000","last_undegraded":"2023-10-25T16:23:19.191193+0000","last_fullsized":"2023-10-25T16:23:19.191193+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:52.995037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199223+0000","last_change":"2023-10-25T16:23:18.160357+0000","last_active":"2023-10-25T16:23:19.199223+0000","last_peered":"2023-10-25T16:23:19.199223+0000","last_clean":"2023-10-25T16:23:19.199223+0000","last_became_active":"2023-10-25T16:23:18.160114+0000","last_became_peered":"2023-10-25T16:23:18.160114+0000","last_unstale":"2023-10-25T16:23:19.199223+0000","last_undegraded":"2023-10-25T16:23:19.199223+0000","last_fullsized":"2023-10-25T16:23:19.199223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:22:54.207547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190232+0000","last_change":"2023-10-25T16:23:19.186950+0000","last_active":"2023-10-25T16:23:19.190232+0000","last_peered":"2023-10-25T16:23:19.190232+0000","last_clean":"2023-10-25T16:23:19.190232+0000","last_became_active":"2023-10-25T16:23:19.186538+0000","last_became_peered":"2023-10-25T16:23:19.186538+0000","last_unstale":"2023-10-25T16:23:19.190232+0000","last_undegraded":"2023-10-25T16:23:19.190232+0000","last_fullsized":"2023-10-25T16:23:19.190232+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:06.640286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.206013+0000","last_change":"2023-10-25T16:23:19.205886+0000","last_active":"2023-10-25T16:23:19.206013+0000","last_peered":"2023-10-25T16:23:19.206013+0000","last_clean":"2023-10-25T16:23:19.206013+0000","last_became_active":"2023-10-25T16:23:19.203366+0000","last_became_peered":"2023-10-25T16:23:19.203366+0000","last_unstale":"2023-10-25T16:23:19.206013+0000","last_undegraded":"2023-10-25T16:23:19.206013+0000","last_fullsized":"2023-10-25T16:23:19.206013+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:24:20.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174344+0000","last_change":"2023-10-25T16:23:18.151835+0000","last_active":"2023-10-25T16:23:19.174344+0000","last_peered":"2023-10-25T16:23:19.174344+0000","last_clean":"2023-10-25T16:23:19.174344+0000","last_became_active":"2023-10-25T16:23:18.151576+0000","last_became_peered":"2023-10-25T16:23:18.151576+0000","last_unstale":"2023-10-25T16:23:19.174344+0000","last_undegraded":"2023-10-25T16:23:19.174344+0000","last_fullsized":"2023-10-25T16:23:19.174344+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:22.254506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183324+0000","last_change":"2023-10-25T16:23:19.180761+0000","last_active":"2023-10-25T16:23:19.183324+0000","last_peered":"2023-10-25T16:23:19.183324+0000","last_clean":"2023-10-25T16:23:19.183324+0000","last_became_active":"2023-10-25T16:23:19.179966+0000","last_became_peered":"2023-10-25T16:23:19.179966+0000","last_unstale":"2023-10-25T16:23:19.183324+0000","last_undegraded":"2023-10-25T16:23:19.183324+0000","last_fullsized":"2023-10-25T16:23:19.183324+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:46.370576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186103+0000","last_change":"2023-10-25T16:23:18.172840+0000","last_active":"2023-10-25T16:23:19.186103+0000","last_peered":"2023-10-25T16:23:19.186103+0000","last_clean":"2023-10-25T16:23:19.186103+0000","last_became_active":"2023-10-25T16:23:18.172410+0000","last_became_peered":"2023-10-25T16:23:18.172410+0000","last_unstale":"2023-10-25T16:23:19.186103+0000","last_undegraded":"2023-10-25T16:23:19.186103+0000","last_fullsized":"2023-10-25T16:23:19.186103+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181485+0000","last_change":"2023-10-25T16:23:19.181417+0000","last_active":"2023-10-25T16:23:19.181485+0000","last_peered":"2023-10-25T16:23:19.181485+0000","last_clean":"2023-10-25T16:23:19.181485+0000","last_became_active":"2023-10-25T16:23:19.181183+0000","last_became_peered":"2023-10-25T16:23:19.181183+0000","last_unstale":"2023-10-25T16:23:19.181485+0000","last_undegraded":"2023-10-25T16:23:19.181485+0000","last_fullsized":"2023-10-25T16:23:19.181485+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:33.754559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.172850+0000","last_change":"2023-10-25T16:23:18.168302+0000","last_active":"2023-10-25T16:23:19.172850+0000","last_peered":"2023-10-25T16:23:19.172850+0000","last_clean":"2023-10-25T16:23:19.172850+0000","last_became_active":"2023-10-25T16:23:18.167104+0000","last_became_peered":"2023-10-25T16:23:18.167104+0000","last_unstale":"2023-10-25T16:23:19.172850+0000","last_undegraded":"2023-10-25T16:23:19.172850+0000","last_fullsized":"2023-10-25T16:23:19.172850+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:14.919507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183360+0000","last_change":"2023-10-25T16:23:19.181928+0000","last_active":"2023-10-25T16:23:19.183360+0000","last_peered":"2023-10-25T16:23:19.183360+0000","last_clean":"2023-10-25T16:23:19.183360+0000","last_became_active":"2023-10-25T16:23:19.181522+0000","last_became_peered":"2023-10-25T16:23:19.181522+0000","last_unstale":"2023-10-25T16:23:19.183360+0000","last_undegraded":"2023-10-25T16:23:19.183360+0000","last_fullsized":"2023-10-25T16:23:19.183360+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:58:58.064499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175066+0000","last_change":"2023-10-25T16:23:18.166147+0000","last_active":"2023-10-25T16:23:19.175066+0000","last_peered":"2023-10-25T16:23:19.175066+0000","last_clean":"2023-10-25T16:23:19.175066+0000","last_became_active":"2023-10-25T16:23:18.165261+0000","last_became_peered":"2023-10-25T16:23:18.165261+0000","last_unstale":"2023-10-25T16:23:19.175066+0000","last_undegraded":"2023-10-25T16:23:19.175066+0000","last_fullsized":"2023-10-25T16:23:19.175066+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:00.551034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181129+0000","last_change":"2023-10-25T16:23:19.180843+0000","last_active":"2023-10-25T16:23:19.181129+0000","last_peered":"2023-10-25T16:23:19.181129+0000","last_clean":"2023-10-25T16:23:19.181129+0000","last_became_active":"2023-10-25T16:23:19.180642+0000","last_became_peered":"2023-10-25T16:23:19.180642+0000","last_unstale":"2023-10-25T16:23:19.181129+0000","last_undegraded":"2023-10-25T16:23:19.181129+0000","last_fullsized":"2023-10-25T16:23:19.181129+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187569+0000","last_change":"2023-10-25T16:23:18.155577+0000","last_active":"2023-10-25T16:23:19.187569+0000","last_peered":"2023-10-25T16:23:19.187569+0000","last_clean":"2023-10-25T16:23:19.187569+0000","last_became_active":"2023-10-25T16:23:18.154738+0000","last_became_peered":"2023-10-25T16:23:18.154738+0000","last_unstale":"2023-10-25T16:23:19.187569+0000","last_undegraded":"2023-10-25T16:23:19.187569+0000","last_fullsized":"2023-10-25T16:23:19.187569+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:19.137605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195579+0000","last_change":"2023-10-25T16:23:19.195535+0000","last_active":"2023-10-25T16:23:19.195579+0000","last_peered":"2023-10-25T16:23:19.195579+0000","last_clean":"2023-10-25T16:23:19.195579+0000","last_became_active":"2023-10-25T16:23:19.194875+0000","last_became_peered":"2023-10-25T16:23:19.194875+0000","last_unstale":"2023-10-25T16:23:19.195579+0000","last_undegraded":"2023-10-25T16:23:19.195579+0000","last_fullsized":"2023-10-25T16:23:19.195579+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:55:46.166735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182724+0000","last_change":"2023-10-25T16:23:18.172760+0000","last_active":"2023-10-25T16:23:19.182724+0000","last_peered":"2023-10-25T16:23:19.182724+0000","last_clean":"2023-10-25T16:23:19.182724+0000","last_became_active":"2023-10-25T16:23:18.170761+0000","last_became_peered":"2023-10-25T16:23:18.170761+0000","last_unstale":"2023-10-25T16:23:19.182724+0000","last_undegraded":"2023-10-25T16:23:19.182724+0000","last_fullsized":"2023-10-25T16:23:19.182724+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:32.740149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190210+0000","last_change":"2023-10-25T16:23:19.186788+0000","last_active":"2023-10-25T16:23:19.190210+0000","last_peered":"2023-10-25T16:23:19.190210+0000","last_clean":"2023-10-25T16:23:19.190210+0000","last_became_active":"2023-10-25T16:23:19.186225+0000","last_became_peered":"2023-10-25T16:23:19.186225+0000","last_unstale":"2023-10-25T16:23:19.190210+0000","last_undegraded":"2023-10-25T16:23:19.190210+0000","last_fullsized":"2023-10-25T16:23:19.190210+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:39.934224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174737+0000","last_change":"2023-10-25T16:23:18.160453+0000","last_active":"2023-10-25T16:23:19.174737+0000","last_peered":"2023-10-25T16:23:19.174737+0000","last_clean":"2023-10-25T16:23:19.174737+0000","last_became_active":"2023-10-25T16:23:18.160242+0000","last_became_peered":"2023-10-25T16:23:18.160242+0000","last_unstale":"2023-10-25T16:23:19.174737+0000","last_undegraded":"2023-10-25T16:23:19.174737+0000","last_fullsized":"2023-10-25T16:23:19.174737+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:30.230996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.188042+0000","last_change":"2023-10-25T16:23:19.187943+0000","last_active":"2023-10-25T16:23:19.188042+0000","last_peered":"2023-10-25T16:23:19.188042+0000","last_clean":"2023-10-25T16:23:19.188042+0000","last_became_active":"2023-10-25T16:23:19.187788+0000","last_became_peered":"2023-10-25T16:23:19.187788+0000","last_unstale":"2023-10-25T16:23:19.188042+0000","last_undegraded":"2023-10-25T16:23:19.188042+0000","last_fullsized":"2023-10-25T16:23:19.188042+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:22:37.089982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173774+0000","last_change":"2023-10-25T16:23:18.154831+0000","last_active":"2023-10-25T16:23:19.173774+0000","last_peered":"2023-10-25T16:23:19.173774+0000","last_clean":"2023-10-25T16:23:19.173774+0000","last_became_active":"2023-10-25T16:23:18.154491+0000","last_became_peered":"2023-10-25T16:23:18.154491+0000","last_unstale":"2023-10-25T16:23:19.173774+0000","last_undegraded":"2023-10-25T16:23:19.173774+0000","last_fullsized":"2023-10-25T16:23:19.173774+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:57.283692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190571+0000","last_change":"2023-10-25T16:23:19.190322+0000","last_active":"2023-10-25T16:23:19.190571+0000","last_peered":"2023-10-25T16:23:19.190571+0000","last_clean":"2023-10-25T16:23:19.190571+0000","last_became_active":"2023-10-25T16:23:19.189841+0000","last_became_peered":"2023-10-25T16:23:19.189841+0000","last_unstale":"2023-10-25T16:23:19.190571+0000","last_undegraded":"2023-10-25T16:23:19.190571+0000","last_fullsized":"2023-10-25T16:23:19.190571+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:40.045282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173739+0000","last_change":"2023-10-25T16:23:18.154686+0000","last_active":"2023-10-25T16:23:19.173739+0000","last_peered":"2023-10-25T16:23:19.173739+0000","last_clean":"2023-10-25T16:23:19.173739+0000","last_became_active":"2023-10-25T16:23:18.154437+0000","last_became_peered":"2023-10-25T16:23:18.154437+0000","last_unstale":"2023-10-25T16:23:19.173739+0000","last_undegraded":"2023-10-25T16:23:19.173739+0000","last_fullsized":"2023-10-25T16:23:19.173739+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:14:28.241432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.170440+0000","last_change":"2023-10-25T16:23:18.162041+0000","last_active":"2023-10-25T16:23:19.170440+0000","last_peered":"2023-10-25T16:23:19.170440+0000","last_clean":"2023-10-25T16:23:19.170440+0000","last_became_active":"2023-10-25T16:23:18.161793+0000","last_became_peered":"2023-10-25T16:23:18.161793+0000","last_unstale":"2023-10-25T16:23:19.170440+0000","last_undegraded":"2023-10-25T16:23:19.170440+0000","last_fullsized":"2023-10-25T16:23:19.170440+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:01.371271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192534+0000","last_change":"2023-10-25T16:23:19.192438+0000","last_active":"2023-10-25T16:23:19.192534+0000","last_peered":"2023-10-25T16:23:19.192534+0000","last_clean":"2023-10-25T16:23:19.192534+0000","last_became_active":"2023-10-25T16:23:19.192213+0000","last_became_peered":"2023-10-25T16:23:19.192213+0000","last_unstale":"2023-10-25T16:23:19.192534+0000","last_undegraded":"2023-10-25T16:23:19.192534+0000","last_fullsized":"2023-10-25T16:23:19.192534+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:06.205275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177449+0000","last_change":"2023-10-25T16:23:18.173060+0000","last_active":"2023-10-25T16:23:19.177449+0000","last_peered":"2023-10-25T16:23:19.177449+0000","last_clean":"2023-10-25T16:23:19.177449+0000","last_became_active":"2023-10-25T16:23:18.171579+0000","last_became_peered":"2023-10-25T16:23:18.171579+0000","last_unstale":"2023-10-25T16:23:19.177449+0000","last_undegraded":"2023-10-25T16:23:19.177449+0000","last_fullsized":"2023-10-25T16:23:19.177449+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192391+0000","last_change":"2023-10-25T16:23:19.192244+0000","last_active":"2023-10-25T16:23:19.192391+0000","last_peered":"2023-10-25T16:23:19.192391+0000","last_clean":"2023-10-25T16:23:19.192391+0000","last_became_active":"2023-10-25T16:23:19.191971+0000","last_became_peered":"2023-10-25T16:23:19.191971+0000","last_unstale":"2023-10-25T16:23:19.192391+0000","last_undegraded":"2023-10-25T16:23:19.192391+0000","last_fullsized":"2023-10-25T16:23:19.192391+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:59:12.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182401+0000","last_change":"2023-10-25T16:23:18.169800+0000","last_active":"2023-10-25T16:23:19.182401+0000","last_peered":"2023-10-25T16:23:19.182401+0000","last_clean":"2023-10-25T16:23:19.182401+0000","last_became_active":"2023-10-25T16:23:18.167411+0000","last_became_peered":"2023-10-25T16:23:18.167411+0000","last_unstale":"2023-10-25T16:23:19.182401+0000","last_undegraded":"2023-10-25T16:23:19.182401+0000","last_fullsized":"2023-10-25T16:23:19.182401+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:13:16.298558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198587+0000","last_change":"2023-10-25T16:23:19.198512+0000","last_active":"2023-10-25T16:23:19.198587+0000","last_peered":"2023-10-25T16:23:19.198587+0000","last_clean":"2023-10-25T16:23:19.198587+0000","last_became_active":"2023-10-25T16:23:19.198216+0000","last_became_peered":"2023-10-25T16:23:19.198216+0000","last_unstale":"2023-10-25T16:23:19.198587+0000","last_undegraded":"2023-10-25T16:23:19.198587+0000","last_fullsized":"2023-10-25T16:23:19.198587+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:50:42.583353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176315+0000","last_change":"2023-10-25T16:23:18.167697+0000","last_active":"2023-10-25T16:23:19.176315+0000","last_peered":"2023-10-25T16:23:19.176315+0000","last_clean":"2023-10-25T16:23:19.176315+0000","last_became_active":"2023-10-25T16:23:18.167237+0000","last_became_peered":"2023-10-25T16:23:18.167237+0000","last_unstale":"2023-10-25T16:23:19.176315+0000","last_undegraded":"2023-10-25T16:23:19.176315+0000","last_fullsized":"2023-10-25T16:23:19.176315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191073+0000","last_change":"2023-10-25T16:23:19.191002+0000","last_active":"2023-10-25T16:23:19.191073+0000","last_peered":"2023-10-25T16:23:19.191073+0000","last_clean":"2023-10-25T16:23:19.191073+0000","last_became_active":"2023-10-25T16:23:19.190626+0000","last_became_peered":"2023-10-25T16:23:19.190626+0000","last_unstale":"2023-10-25T16:23:19.191073+0000","last_undegraded":"2023-10-25T16:23:19.191073+0000","last_fullsized":"2023-10-25T16:23:19.191073+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:01.565443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"173'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193332+0000","last_change":"2023-10-25T16:23:18.170261+0000","last_active":"2023-10-25T16:23:19.193332+0000","last_peered":"2023-10-25T16:23:19.193332+0000","last_clean":"2023-10-25T16:23:19.193332+0000","last_became_active":"2023-10-25T16:23:18.168947+0000","last_became_peered":"2023-10-25T16:23:18.168947+0000","last_unstale":"2023-10-25T16:23:19.193332+0000","last_undegraded":"2023-10-25T16:23:19.193332+0000","last_fullsized":"2023-10-25T16:23:19.193332+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:38:37.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-25T16:23:18.162842+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:23:18.162842+0000","last_peered":"2023-10-25T16:23:18.162842+0000","last_clean":"2023-10-25T16:23:18.162842+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:23:18.162842+0000","last_undegraded":"2023-10-25T16:23:18.162842+0000","last_fullsized":"2023-10-25T16:23:18.162842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":56,"acting":56,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":933,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194379,"statfs":{"total":200000000,"available":199044201,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.54800000000000004},"min":{"1min":0.48999999999999999,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.0329999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67600000000000005,"15min":0.60299999999999998},"min":{"1min":0.51600000000000001,"5min":0.308,"15min":0.27000000000000002},"max":{"1min":0.97799999999999998,"5min":1.0489999999999999,"15min":1.077},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.67600000000000005,"15min":0.60699999999999998},"min":{"1min":0.59699999999999998,"5min":0.32300000000000001,"15min":0.27000000000000002},"max":{"1min":0.97899999999999998,"5min":1.145,"15min":1.1759999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.73199999999999998,"15min":0.61399999999999999},"min":{"1min":0.60799999999999998,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0389999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.625},"min":{"1min":0.53000000000000003,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":0.96899999999999997,"5min":1.246,"15min":1.246},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.81299999999999994,"15min":0.68000000000000005},"min":{"1min":0.77700000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.111,"5min":1.2729999999999999,"15min":1.345},"last":0.69899999999999995}]},{"osd":4,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.96799999999999997,"15min":0.86599999999999999},"min":{"1min":0.748,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.1990000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.88600000000000001},"min":{"1min":0.69999999999999996,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.216,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90400000000000003,"15min":0.86299999999999999},"min":{"1min":0.76500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.998,"5min":1.46,"15min":1.4930000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.101,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":1.004,"5min":0.57299999999999995,"15min":0.47899999999999998},"max":{"1min":1.2370000000000001,"5min":1.671,"15min":1.671},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0049999999999999,"15min":0.92400000000000004},"min":{"1min":0.83899999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2010000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.099},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.98499999999999999,"15min":0.94299999999999995},"min":{"1min":0.91600000000000004,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0349999999999999,"15min":0.95499999999999996},"min":{"1min":0.995,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.032,"15min":0.98099999999999998},"min":{"1min":0.97299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.177,"5min":1.454,"15min":1.7569999999999999},"last":0.92300000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193790,"statfs":{"total":200000000,"available":198441741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.35899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.256},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83999999999999997},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.534},"last":0.86899999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.42899999999999999},"max":{"1min":1.4259999999999999,"5min":1.647,"15min":1.647},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70899999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89200000000000002,"15min":0.85699999999999998},"min":{"1min":0.55100000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.234,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1879999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.996,"15min":0.98199999999999998},"min":{"1min":0.78900000000000003,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.3360000000000001,"5min":1.51,"15min":1.51},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0249999999999999,"15min":0.97699999999999998},"min":{"1min":0.69099999999999995,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.3600000000000001,"5min":1.548,"15min":1.548},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.262,"5min":1.478,"15min":1.4910000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.61799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.77400000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2909999999999999,"5min":1.696,"15min":1.7370000000000001},"last":0.63},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.0229999999999999},"min":{"1min":0.67700000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.0169999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.496,"5min":1.643,"15min":1.669},"last":1.099},{"interface":"front","average":{"1min":1.125,"5min":1.1060000000000001,"15min":1.117},"min":{"1min":0.77900000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.54,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.876},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.339,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.877},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.998,"15min":0.92400000000000004},"min":{"1min":0.67700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.2529999999999999,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.242}]},{"osd":1,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.624,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.3080000000000001,"5min":10.667,"15min":10.667},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.046,"15min":0.94499999999999995},"min":{"1min":0.65400000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96299999999999997,"15min":0.91200000000000003},"min":{"1min":0.68500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.242,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0600000000000001,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.609,"5min":10.948,"15min":10.948},"last":0.97299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.72499999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.996},{"interface":"front","average":{"1min":1.127,"5min":1.121,"15min":1.069},"min":{"1min":0.84399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4370000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.139}]},{"osd":4,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.052,"15min":0.98199999999999998},"min":{"1min":0.63,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.381,"5min":11.081,"15min":11.081},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.96999999999999997},"min":{"1min":0.64900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.165,"5min":1.444,"15min":1.444},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98299999999999998,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3069999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.087,"5min":1.1100000000000001,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.734,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.022}]},{"osd":7,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.244,"15min":1.1339999999999999},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.6140000000000001,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.179},{"interface":"front","average":{"1min":1.181,"5min":1.151,"15min":1.079},"min":{"1min":0.82399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.1970000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.052}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":1.1279999999999999},"min":{"1min":0.66700000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.224,"5min":2.1429999999999998,"15min":14.843},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":1.1819999999999999},"min":{"1min":0.58699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.111,"5min":2.8450000000000002,"15min":16.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":1.1739999999999999},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.423,"15min":14.630000000000001},"last":1.048},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92700000000000005,"15min":0.89700000000000002},"min":{"1min":0.69599999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2430000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0249999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.95099999999999996},"min":{"1min":0.627,"5min":0.5,"15min":0.5},"max":{"1min":1.22,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.76500000000000001,"5min":0.53800000000000003,"15min":0.48499999999999999},"max":{"1min":1.248,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.97199999999999998,"15min":0.98399999999999999},"min":{"1min":0.80400000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.179,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.302},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.1160000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.321},"min":{"1min":0.56999999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":15.904},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":1.298},"min":{"1min":0.63600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.0840000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.044,"15min":1.288},"min":{"1min":0.69499999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2689999999999999,"5min":4.5970000000000004,"15min":14.567},"last":0.746},{"interface":"front","average":{"1min":1.133,"5min":1.139,"15min":1.4419999999999999},"min":{"1min":0.81299999999999994,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.421,"5min":2.4079999999999999,"15min":15.089},"last":0.84699999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0209999999999999,"15min":1.395},"min":{"1min":0.748,"5min":0.436,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.171,"15min":1.2190000000000001},"min":{"1min":0.81599999999999995,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3220000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.86899999999999999,"15min":0.82699999999999996},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.252,"5min":1.3,"15min":1.47},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.874,"15min":0.83199999999999996},"min":{"1min":0.65800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.274,"5min":1.278,"15min":1.3029999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.873,"15min":0.84299999999999997},"min":{"1min":0.60599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.288},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98399999999999999,"15min":0.96399999999999997},"min":{"1min":0.65600000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.383,"5min":1.47,"15min":1.4990000000000001},"last":0.876}]},{"osd":2,"last update":"Wed Oct 25 16:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88500000000000001,"15min":0.85299999999999998},"min":{"1min":0.72899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1379999999999999,"5min":1.341,"15min":1.419},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.66100000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.91900000000000004},"min":{"1min":0.752,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3200000000000001,"5min":1.5,"15min":1.5},"last":1.016},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85499999999999998,"15min":0.81499999999999995},"min":{"1min":0.70399999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.518},"last":0.92300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.504,"5min":1.599,"15min":2.6640000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.81299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":1.6379999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.181}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.61799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":2.085},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0660000000000001,"15min":1.071},"min":{"1min":0.77100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.252,"5min":1.625,"15min":1.8149999999999999},"last":1.2250000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.95399999999999996,"15min":0.94999999999999996},"min":{"1min":0.68899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1419999999999999,"15min":1.1240000000000001},"min":{"1min":1.02,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.4359999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.59199999999999997},"min":{"1min":0.35999999999999999,"5min":0.27200000000000002,"15min":0.22},"max":{"1min":1.002,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.222},"max":{"1min":0.95699999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.93000000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.33200000000000002,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":0.86799999999999999,"5min":1.425,"15min":1.425},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.441,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.02}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":1.1220000000000001,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.2330000000000001,"5min":1.25,"15min":1.8260000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.89100000000000001},"min":{"1min":0.60399999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1240000000000001,"5min":1.234,"15min":1.234},"last":1.052},{"interface":"front","average":{"1min":1.018,"5min":1.02,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.56599999999999995,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1699999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.94899999999999995,"15min":0.93000000000000005},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.45400000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.96199999999999997},"min":{"1min":0.63700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2050000000000001,"5min":1.2410000000000001,"15min":1.4830000000000001},"last":1.133}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96099999999999997,"15min":0.92000000000000004},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.456},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.505},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0740000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":0.998},"min":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.504},"max":{"1min":1.2849999999999999,"5min":1.508,"15min":1.5660000000000001},"last":1.208},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0109999999999999,"15min":0.97199999999999998},"min":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.51500000000000001},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.389},"last":1.111}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.48699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.042,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66800000000000004,"15min":0.64700000000000002},"min":{"1min":0.57299999999999995,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0680000000000001,"5min":1.075,"15min":1.1990000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61699999999999999,"15min":0.57899999999999996},"min":{"1min":0.57499999999999996,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.96199999999999997,"5min":1.157,"15min":1.4610000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.57699999999999996,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97399999999999998,"5min":1.2,"15min":1.2},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.61699999999999999,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.89600000000000002,"5min":1.048,"15min":1.1399999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.78100000000000003,"15min":0.75800000000000001},"min":{"1min":0.63600000000000001,"5min":0.34799999999999998,"15min":0.28000000000000003},"max":{"1min":1.1499999999999999,"5min":1.1899999999999999,"15min":1.423},"last":0.88100000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.72899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.089,"5min":1.242,"15min":12.698},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.95099999999999996,"15min":1.0129999999999999},"min":{"1min":0.749,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.2170000000000001,"5min":1.2310000000000001,"15min":12.721},"last":1.075}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.84599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.204,"5min":1.2729999999999999,"15min":1.546},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.88900000000000001},"min":{"1min":0.69999999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.2549999999999999,"15min":2.206},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.98299999999999998,"15min":0.95399999999999996},"min":{"1min":0.84699999999999998,"5min":0.65000000000000002,"15min":0.49099999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4610000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0189999999999999,"15min":1.02},"min":{"1min":0.86899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2090000000000001,"5min":1.397,"15min":1.5980000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.95899999999999996,"15min":0.99399999999999999},"min":{"1min":0.77900000000000003,"5min":0.53200000000000003,"15min":0.52000000000000002},"max":{"1min":1.2589999999999999,"5min":1.3100000000000001,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.097,"5min":1.006,"15min":1.026},"min":{"1min":0.92300000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.321,"5min":1.476,"15min":10.509},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193782,"statfs":{"total":200000000,"available":198433320,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.217},"max":{"1min":0.85699999999999998,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.262,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":0.71599999999999997,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.60199999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.44900000000000001,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.024,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.1899999999999999,"5min":1.296,"15min":3.6579999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.86099999999999999},"min":{"1min":0.66500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.024,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.2210000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94499999999999995,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1499999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1850000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0249999999999999,"15min":0.98899999999999999},"min":{"1min":0.70199999999999996,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.619,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0089999999999999,"15min":0.95499999999999996},"min":{"1min":0.77700000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0309999999999999,"15min":1.1719999999999999},"min":{"1min":0.78600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.054,"15min":1.1899999999999999},"min":{"1min":0.73799999999999999,"5min":0.64900000000000002,"15min":0.59799999999999998},"max":{"1min":1.2290000000000001,"5min":1.4159999999999999,"15min":11.622},"last":0.94699999999999995}]}]}],"pool_statfs":[]}} 2023-10-25T16:23:22.215 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:23:22.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/4265662078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 msgr2=0x7fd4580aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 --2- 172.21.15.177:0/4265662078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4580aca30 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fd45806fcd0 tx=0x7fd45001c750 comp rx=0 tx=0).stop 2023-10-25T16:23:22.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/4265662078 shutdown_connections 2023-10-25T16:23:22.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 --2- 172.21.15.177:0/4265662078 >> v2:172.21.15.184:3300/0 conn(0x7fd4580cc720 0x7fd45815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 --2- 172.21.15.177:0/4265662078 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4580aca30 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/4265662078 >> 172.21.15.177:0/4265662078 conn(0x7fd4580cd6b0 msgr2=0x7fd4580cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:22.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/4265662078 shutdown_connections 2023-10-25T16:23:22.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/4265662078 wait complete. 2023-10-25T16:23:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 Processor -- start 2023-10-25T16:23:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- start start 2023-10-25T16:23:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4580cc720 0x7fd45814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4581478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45815bc70 0x7fd45814a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458148970 con 0x7fd45814f1e0 2023-10-25T16:23:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458147e30 con 0x7fd4580cc720 2023-10-25T16:23:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4581480d0 con 0x7fd45815bc70 2023-10-25T16:23:22.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4581478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4581478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37000/0 (socket says 172.21.15.177:37000) 2023-10-25T16:23:22.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 -- 172.21.15.177:0/1717780049 learned_addr learned my addr 172.21.15.177:0/1717780049 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:22.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45c8f3640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4580cc720 0x7fd45814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45d0f4640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45815bc70 0x7fd45814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 -- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45815bc70 msgr2=0x7fd45814a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45815bc70 0x7fd45814a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 -- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4580cc720 msgr2=0x7fd45814cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4580cc720 0x7fd45814cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 -- 172.21.15.177:0/1717780049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009560 con 0x7fd45814f1e0 2023-10-25T16:23:22.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45c8f3640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4580cc720 0x7fd45814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd457fff640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4581478f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fd44c001ec0 tx=0x7fd44c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0054e0 con 0x7fd45814f1e0 2023-10-25T16:23:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd44c003600 con 0x7fd45814f1e0 2023-10-25T16:23:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4581483b0 con 0x7fd45814f1e0 2023-10-25T16:23:22.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c003a10 con 0x7fd45814f1e0 2023-10-25T16:23:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.384+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4580c8b30 con 0x7fd45814f1e0 2023-10-25T16:23:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.388+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4580c8990 con 0x7fd45814f1e0 2023-10-25T16:23:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.388+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd44c003b70 con 0x7fd45814f1e0 2023-10-25T16:23:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.388+0000 7fd4557fa640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd444066470 0x7fd444068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.388+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd44c0835e0 con 0x7fd45814f1e0 2023-10-25T16:23:22.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.388+0000 7fd45c8f3640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd444066470 0x7fd444068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.388+0000 7fd45c8f3640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd444066470 0x7fd444068930 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd4500af000 tx=0x7fd45001af90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:22.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.392+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4580c8990 con 0x7fd45814f1e0 2023-10-25T16:23:22.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.544+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4580c8990 con 0x7fd444066470 2023-10-25T16:23:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.564+0000 7fd4557fa640 1 -- 172.21.15.177:0/1717780049 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282245 (secure 0 0 0) 0x7fd4580c8990 con 0x7fd444066470 2023-10-25T16:23:22.563 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:23:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd444066470 msgr2=0x7fd444068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd444066470 0x7fd444068930 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd4500af000 tx=0x7fd45001af90 comp rx=0 tx=0).stop 2023-10-25T16:23:22.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 msgr2=0x7fd4581478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4581478f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fd44c001ec0 tx=0x7fd44c00c8e0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 shutdown_connections 2023-10-25T16:23:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd444066470 0x7fd444068930 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd45815bc70 0x7fd45814a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd45814f1e0 0x7fd4581478f0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 --2- 172.21.15.177:0/1717780049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4580cc720 0x7fd45814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 >> 172.21.15.177:0/1717780049 conn(0x7fd4580cd6b0 msgr2=0x7fd4580b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 shutdown_connections 2023-10-25T16:23:22.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.568+0000 7fd45eb57640 1 -- 172.21.15.177:0/1717780049 wait complete. 2023-10-25T16:23:22.582 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2023-10-25T16:23:20.823827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8731,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553768,"statfs":{"total":1600000000,"available":1591058732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001219"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179492+0000","last_change":"2023-10-25T16:23:19.179248+0000","last_active":"2023-10-25T16:23:19.179492+0000","last_peered":"2023-10-25T16:23:19.179492+0000","last_clean":"2023-10-25T16:23:19.179492+0000","last_became_active":"2023-10-25T16:23:19.179003+0000","last_became_peered":"2023-10-25T16:23:19.179003+0000","last_unstale":"2023-10-25T16:23:19.179492+0000","last_undegraded":"2023-10-25T16:23:19.179492+0000","last_fullsized":"2023-10-25T16:23:19.179492+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:58.596626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180343+0000","last_change":"2023-10-25T16:23:19.180275+0000","last_active":"2023-10-25T16:23:19.180343+0000","last_peered":"2023-10-25T16:23:19.180343+0000","last_clean":"2023-10-25T16:23:19.180343+0000","last_became_active":"2023-10-25T16:23:19.180044+0000","last_became_peered":"2023-10-25T16:23:19.180044+0000","last_unstale":"2023-10-25T16:23:19.180343+0000","last_undegraded":"2023-10-25T16:23:19.180343+0000","last_fullsized":"2023-10-25T16:23:19.180343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:34:40.100162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193667+0000","last_change":"2023-10-25T16:23:19.193592+0000","last_active":"2023-10-25T16:23:19.193667+0000","last_peered":"2023-10-25T16:23:19.193667+0000","last_clean":"2023-10-25T16:23:19.193667+0000","last_became_active":"2023-10-25T16:23:19.192339+0000","last_became_peered":"2023-10-25T16:23:19.192339+0000","last_unstale":"2023-10-25T16:23:19.193667+0000","last_undegraded":"2023-10-25T16:23:19.193667+0000","last_fullsized":"2023-10-25T16:23:19.193667+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:49.438562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185930+0000","last_change":"2023-10-25T16:23:19.185798+0000","last_active":"2023-10-25T16:23:19.185930+0000","last_peered":"2023-10-25T16:23:19.185930+0000","last_clean":"2023-10-25T16:23:19.185930+0000","last_became_active":"2023-10-25T16:23:19.184621+0000","last_became_peered":"2023-10-25T16:23:19.184621+0000","last_unstale":"2023-10-25T16:23:19.185930+0000","last_undegraded":"2023-10-25T16:23:19.185930+0000","last_fullsized":"2023-10-25T16:23:19.185930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:19:30.964216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191807+0000","last_change":"2023-10-25T16:23:19.191555+0000","last_active":"2023-10-25T16:23:19.191807+0000","last_peered":"2023-10-25T16:23:19.191807+0000","last_clean":"2023-10-25T16:23:19.191807+0000","last_became_active":"2023-10-25T16:23:19.191159+0000","last_became_peered":"2023-10-25T16:23:19.191159+0000","last_unstale":"2023-10-25T16:23:19.191807+0000","last_undegraded":"2023-10-25T16:23:19.191807+0000","last_fullsized":"2023-10-25T16:23:19.191807+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:19.271674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.205515+0000","last_change":"2023-10-25T16:23:19.205378+0000","last_active":"2023-10-25T16:23:19.205515+0000","last_peered":"2023-10-25T16:23:19.205515+0000","last_clean":"2023-10-25T16:23:19.205515+0000","last_became_active":"2023-10-25T16:23:19.202582+0000","last_became_peered":"2023-10-25T16:23:19.202582+0000","last_unstale":"2023-10-25T16:23:19.205515+0000","last_undegraded":"2023-10-25T16:23:19.205515+0000","last_fullsized":"2023-10-25T16:23:19.205515+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:57.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190227+0000","last_change":"2023-10-25T16:23:19.190157+0000","last_active":"2023-10-25T16:23:19.190227+0000","last_peered":"2023-10-25T16:23:19.190227+0000","last_clean":"2023-10-25T16:23:19.190227+0000","last_became_active":"2023-10-25T16:23:19.189923+0000","last_became_peered":"2023-10-25T16:23:19.189923+0000","last_unstale":"2023-10-25T16:23:19.190227+0000","last_undegraded":"2023-10-25T16:23:19.190227+0000","last_fullsized":"2023-10-25T16:23:19.190227+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195713+0000","last_change":"2023-10-25T16:23:19.195649+0000","last_active":"2023-10-25T16:23:19.195713+0000","last_peered":"2023-10-25T16:23:19.195713+0000","last_clean":"2023-10-25T16:23:19.195713+0000","last_became_active":"2023-10-25T16:23:19.195462+0000","last_became_peered":"2023-10-25T16:23:19.195462+0000","last_unstale":"2023-10-25T16:23:19.195713+0000","last_undegraded":"2023-10-25T16:23:19.195713+0000","last_fullsized":"2023-10-25T16:23:19.195713+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:04:05.185753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180467+0000","last_change":"2023-10-25T16:23:19.180227+0000","last_active":"2023-10-25T16:23:19.180467+0000","last_peered":"2023-10-25T16:23:19.180467+0000","last_clean":"2023-10-25T16:23:19.180467+0000","last_became_active":"2023-10-25T16:23:19.179523+0000","last_became_peered":"2023-10-25T16:23:19.179523+0000","last_unstale":"2023-10-25T16:23:19.180467+0000","last_undegraded":"2023-10-25T16:23:19.180467+0000","last_fullsized":"2023-10-25T16:23:19.180467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:09.212133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185765+0000","last_change":"2023-10-25T16:23:19.185690+0000","last_active":"2023-10-25T16:23:19.185765+0000","last_peered":"2023-10-25T16:23:19.185765+0000","last_clean":"2023-10-25T16:23:19.185765+0000","last_became_active":"2023-10-25T16:23:19.185461+0000","last_became_peered":"2023-10-25T16:23:19.185461+0000","last_unstale":"2023-10-25T16:23:19.185765+0000","last_undegraded":"2023-10-25T16:23:19.185765+0000","last_fullsized":"2023-10-25T16:23:19.185765+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:43.458260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204930+0000","last_change":"2023-10-25T16:23:19.204724+0000","last_active":"2023-10-25T16:23:19.204930+0000","last_peered":"2023-10-25T16:23:19.204930+0000","last_clean":"2023-10-25T16:23:19.204930+0000","last_became_active":"2023-10-25T16:23:19.201797+0000","last_became_peered":"2023-10-25T16:23:19.201797+0000","last_unstale":"2023-10-25T16:23:19.204930+0000","last_undegraded":"2023-10-25T16:23:19.204930+0000","last_fullsized":"2023-10-25T16:23:19.204930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:24:15.782352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193383+0000","last_change":"2023-10-25T16:23:19.193268+0000","last_active":"2023-10-25T16:23:19.193383+0000","last_peered":"2023-10-25T16:23:19.193383+0000","last_clean":"2023-10-25T16:23:19.193383+0000","last_became_active":"2023-10-25T16:23:19.193016+0000","last_became_peered":"2023-10-25T16:23:19.193016+0000","last_unstale":"2023-10-25T16:23:19.193383+0000","last_undegraded":"2023-10-25T16:23:19.193383+0000","last_fullsized":"2023-10-25T16:23:19.193383+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:33.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196025+0000","last_change":"2023-10-25T16:23:19.195794+0000","last_active":"2023-10-25T16:23:19.196025+0000","last_peered":"2023-10-25T16:23:19.196025+0000","last_clean":"2023-10-25T16:23:19.196025+0000","last_became_active":"2023-10-25T16:23:19.195408+0000","last_became_peered":"2023-10-25T16:23:19.195408+0000","last_unstale":"2023-10-25T16:23:19.196025+0000","last_undegraded":"2023-10-25T16:23:19.196025+0000","last_fullsized":"2023-10-25T16:23:19.196025+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:32:13.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183344+0000","last_change":"2023-10-25T16:23:19.180964+0000","last_active":"2023-10-25T16:23:19.183344+0000","last_peered":"2023-10-25T16:23:19.183344+0000","last_clean":"2023-10-25T16:23:19.183344+0000","last_became_active":"2023-10-25T16:23:19.180431+0000","last_became_peered":"2023-10-25T16:23:19.180431+0000","last_unstale":"2023-10-25T16:23:19.183344+0000","last_undegraded":"2023-10-25T16:23:19.183344+0000","last_fullsized":"2023-10-25T16:23:19.183344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:16:41.765358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190297+0000","last_change":"2023-10-25T16:23:19.190014+0000","last_active":"2023-10-25T16:23:19.190297+0000","last_peered":"2023-10-25T16:23:19.190297+0000","last_clean":"2023-10-25T16:23:19.190297+0000","last_became_active":"2023-10-25T16:23:19.189493+0000","last_became_peered":"2023-10-25T16:23:19.189493+0000","last_unstale":"2023-10-25T16:23:19.190297+0000","last_undegraded":"2023-10-25T16:23:19.190297+0000","last_fullsized":"2023-10-25T16:23:19.190297+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:02.385681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179509+0000","last_change":"2023-10-25T16:23:19.179324+0000","last_active":"2023-10-25T16:23:19.179509+0000","last_peered":"2023-10-25T16:23:19.179509+0000","last_clean":"2023-10-25T16:23:19.179509+0000","last_became_active":"2023-10-25T16:23:19.179112+0000","last_became_peered":"2023-10-25T16:23:19.179112+0000","last_unstale":"2023-10-25T16:23:19.179509+0000","last_undegraded":"2023-10-25T16:23:19.179509+0000","last_fullsized":"2023-10-25T16:23:19.179509+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193837+0000","last_change":"2023-10-25T16:23:19.193768+0000","last_active":"2023-10-25T16:23:19.193837+0000","last_peered":"2023-10-25T16:23:19.193837+0000","last_clean":"2023-10-25T16:23:19.193837+0000","last_became_active":"2023-10-25T16:23:19.192700+0000","last_became_peered":"2023-10-25T16:23:19.192700+0000","last_unstale":"2023-10-25T16:23:19.193837+0000","last_undegraded":"2023-10-25T16:23:19.193837+0000","last_fullsized":"2023-10-25T16:23:19.193837+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:39.792430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192238+0000","last_change":"2023-10-25T16:23:19.191525+0000","last_active":"2023-10-25T16:23:19.192238+0000","last_peered":"2023-10-25T16:23:19.192238+0000","last_clean":"2023-10-25T16:23:19.192238+0000","last_became_active":"2023-10-25T16:23:19.191250+0000","last_became_peered":"2023-10-25T16:23:19.191250+0000","last_unstale":"2023-10-25T16:23:19.192238+0000","last_undegraded":"2023-10-25T16:23:19.192238+0000","last_fullsized":"2023-10-25T16:23:19.192238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:37:41.183771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179216+0000","last_change":"2023-10-25T16:23:19.179127+0000","last_active":"2023-10-25T16:23:19.179216+0000","last_peered":"2023-10-25T16:23:19.179216+0000","last_clean":"2023-10-25T16:23:19.179216+0000","last_became_active":"2023-10-25T16:23:19.178779+0000","last_became_peered":"2023-10-25T16:23:19.178779+0000","last_unstale":"2023-10-25T16:23:19.179216+0000","last_undegraded":"2023-10-25T16:23:19.179216+0000","last_fullsized":"2023-10-25T16:23:19.179216+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183287+0000","last_change":"2023-10-25T16:23:19.178582+0000","last_active":"2023-10-25T16:23:19.183287+0000","last_peered":"2023-10-25T16:23:19.183287+0000","last_clean":"2023-10-25T16:23:19.183287+0000","last_became_active":"2023-10-25T16:23:19.178119+0000","last_became_peered":"2023-10-25T16:23:19.178119+0000","last_unstale":"2023-10-25T16:23:19.183287+0000","last_undegraded":"2023-10-25T16:23:19.183287+0000","last_fullsized":"2023-10-25T16:23:19.183287+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:09.196519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185634+0000","last_change":"2023-10-25T16:23:19.185562+0000","last_active":"2023-10-25T16:23:19.185634+0000","last_peered":"2023-10-25T16:23:19.185634+0000","last_clean":"2023-10-25T16:23:19.185634+0000","last_became_active":"2023-10-25T16:23:19.184794+0000","last_became_peered":"2023-10-25T16:23:19.184794+0000","last_unstale":"2023-10-25T16:23:19.185634+0000","last_undegraded":"2023-10-25T16:23:19.185634+0000","last_fullsized":"2023-10-25T16:23:19.185634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:51.312017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184140+0000","last_change":"2023-10-25T16:23:19.184065+0000","last_active":"2023-10-25T16:23:19.184140+0000","last_peered":"2023-10-25T16:23:19.184140+0000","last_clean":"2023-10-25T16:23:19.184140+0000","last_became_active":"2023-10-25T16:23:19.183837+0000","last_became_peered":"2023-10-25T16:23:19.183837+0000","last_unstale":"2023-10-25T16:23:19.184140+0000","last_undegraded":"2023-10-25T16:23:19.184140+0000","last_fullsized":"2023-10-25T16:23:19.184140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:25.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204289+0000","last_change":"2023-10-25T16:23:19.204123+0000","last_active":"2023-10-25T16:23:19.204289+0000","last_peered":"2023-10-25T16:23:19.204289+0000","last_clean":"2023-10-25T16:23:19.204289+0000","last_became_active":"2023-10-25T16:23:19.199324+0000","last_became_peered":"2023-10-25T16:23:19.199324+0000","last_unstale":"2023-10-25T16:23:19.204289+0000","last_undegraded":"2023-10-25T16:23:19.204289+0000","last_fullsized":"2023-10-25T16:23:19.204289+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:57.289392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.189186+0000","last_change":"2023-10-25T16:23:19.186729+0000","last_active":"2023-10-25T16:23:19.189186+0000","last_peered":"2023-10-25T16:23:19.189186+0000","last_clean":"2023-10-25T16:23:19.189186+0000","last_became_active":"2023-10-25T16:23:19.186354+0000","last_became_peered":"2023-10-25T16:23:19.186354+0000","last_unstale":"2023-10-25T16:23:19.189186+0000","last_undegraded":"2023-10-25T16:23:19.189186+0000","last_fullsized":"2023-10-25T16:23:19.189186+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190522+0000","last_change":"2023-10-25T16:23:19.190180+0000","last_active":"2023-10-25T16:23:19.190522+0000","last_peered":"2023-10-25T16:23:19.190522+0000","last_clean":"2023-10-25T16:23:19.190522+0000","last_became_active":"2023-10-25T16:23:19.189509+0000","last_became_peered":"2023-10-25T16:23:19.189509+0000","last_unstale":"2023-10-25T16:23:19.190522+0000","last_undegraded":"2023-10-25T16:23:19.190522+0000","last_fullsized":"2023-10-25T16:23:19.190522+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:56:08.244234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184942+0000","last_change":"2023-10-25T16:23:19.184422+0000","last_active":"2023-10-25T16:23:19.184942+0000","last_peered":"2023-10-25T16:23:19.184942+0000","last_clean":"2023-10-25T16:23:19.184942+0000","last_became_active":"2023-10-25T16:23:19.183889+0000","last_became_peered":"2023-10-25T16:23:19.183889+0000","last_unstale":"2023-10-25T16:23:19.184942+0000","last_undegraded":"2023-10-25T16:23:19.184942+0000","last_fullsized":"2023-10-25T16:23:19.184942+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:53:37.207613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196081+0000","last_change":"2023-10-25T16:23:19.195947+0000","last_active":"2023-10-25T16:23:19.196081+0000","last_peered":"2023-10-25T16:23:19.196081+0000","last_clean":"2023-10-25T16:23:19.196081+0000","last_became_active":"2023-10-25T16:23:19.195349+0000","last_became_peered":"2023-10-25T16:23:19.195349+0000","last_unstale":"2023-10-25T16:23:19.196081+0000","last_undegraded":"2023-10-25T16:23:19.196081+0000","last_fullsized":"2023-10-25T16:23:19.196081+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:22.043144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194059+0000","last_change":"2023-10-25T16:23:19.193900+0000","last_active":"2023-10-25T16:23:19.194059+0000","last_peered":"2023-10-25T16:23:19.194059+0000","last_clean":"2023-10-25T16:23:19.194059+0000","last_became_active":"2023-10-25T16:23:19.193551+0000","last_became_peered":"2023-10-25T16:23:19.193551+0000","last_unstale":"2023-10-25T16:23:19.194059+0000","last_undegraded":"2023-10-25T16:23:19.194059+0000","last_fullsized":"2023-10-25T16:23:19.194059+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:47:44.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"173'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185551+0000","last_change":"2023-10-25T16:23:18.159556+0000","last_active":"2023-10-25T16:23:19.185551+0000","last_peered":"2023-10-25T16:23:19.185551+0000","last_clean":"2023-10-25T16:23:19.185551+0000","last_became_active":"2023-10-25T16:23:18.158349+0000","last_became_peered":"2023-10-25T16:23:18.158349+0000","last_unstale":"2023-10-25T16:23:19.185551+0000","last_undegraded":"2023-10-25T16:23:19.185551+0000","last_fullsized":"2023-10-25T16:23:19.185551+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182590+0000","last_change":"2023-10-25T16:23:19.182477+0000","last_active":"2023-10-25T16:23:19.182590+0000","last_peered":"2023-10-25T16:23:19.182590+0000","last_clean":"2023-10-25T16:23:19.182590+0000","last_became_active":"2023-10-25T16:23:19.182166+0000","last_became_peered":"2023-10-25T16:23:19.182166+0000","last_unstale":"2023-10-25T16:23:19.182590+0000","last_undegraded":"2023-10-25T16:23:19.182590+0000","last_fullsized":"2023-10-25T16:23:19.182590+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:43:46.901069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186987+0000","last_change":"2023-10-25T16:23:18.167802+0000","last_active":"2023-10-25T16:23:19.186987+0000","last_peered":"2023-10-25T16:23:19.186987+0000","last_clean":"2023-10-25T16:23:19.186987+0000","last_became_active":"2023-10-25T16:23:18.167507+0000","last_became_peered":"2023-10-25T16:23:18.167507+0000","last_unstale":"2023-10-25T16:23:19.186987+0000","last_undegraded":"2023-10-25T16:23:19.186987+0000","last_fullsized":"2023-10-25T16:23:19.186987+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:24.539701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182953+0000","last_change":"2023-10-25T16:23:19.182770+0000","last_active":"2023-10-25T16:23:19.182953+0000","last_peered":"2023-10-25T16:23:19.182953+0000","last_clean":"2023-10-25T16:23:19.182953+0000","last_became_active":"2023-10-25T16:23:19.182217+0000","last_became_peered":"2023-10-25T16:23:19.182217+0000","last_unstale":"2023-10-25T16:23:19.182953+0000","last_undegraded":"2023-10-25T16:23:19.182953+0000","last_fullsized":"2023-10-25T16:23:19.182953+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:56.039708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191466+0000","last_change":"2023-10-25T16:23:18.169529+0000","last_active":"2023-10-25T16:23:19.191466+0000","last_peered":"2023-10-25T16:23:19.191466+0000","last_clean":"2023-10-25T16:23:19.191466+0000","last_became_active":"2023-10-25T16:23:18.162217+0000","last_became_peered":"2023-10-25T16:23:18.162217+0000","last_unstale":"2023-10-25T16:23:19.191466+0000","last_undegraded":"2023-10-25T16:23:19.191466+0000","last_fullsized":"2023-10-25T16:23:19.191466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:41:25.784664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193525+0000","last_change":"2023-10-25T16:23:19.193435+0000","last_active":"2023-10-25T16:23:19.193525+0000","last_peered":"2023-10-25T16:23:19.193525+0000","last_clean":"2023-10-25T16:23:19.193525+0000","last_became_active":"2023-10-25T16:23:19.193047+0000","last_became_peered":"2023-10-25T16:23:19.193047+0000","last_unstale":"2023-10-25T16:23:19.193525+0000","last_undegraded":"2023-10-25T16:23:19.193525+0000","last_fullsized":"2023-10-25T16:23:19.193525+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198646+0000","last_change":"2023-10-25T16:23:18.159481+0000","last_active":"2023-10-25T16:23:19.198646+0000","last_peered":"2023-10-25T16:23:19.198646+0000","last_clean":"2023-10-25T16:23:19.198646+0000","last_became_active":"2023-10-25T16:23:18.158375+0000","last_became_peered":"2023-10-25T16:23:18.158375+0000","last_unstale":"2023-10-25T16:23:19.198646+0000","last_undegraded":"2023-10-25T16:23:19.198646+0000","last_fullsized":"2023-10-25T16:23:19.198646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:37.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194416+0000","last_change":"2023-10-25T16:23:19.194347+0000","last_active":"2023-10-25T16:23:19.194416+0000","last_peered":"2023-10-25T16:23:19.194416+0000","last_clean":"2023-10-25T16:23:19.194416+0000","last_became_active":"2023-10-25T16:23:19.193313+0000","last_became_peered":"2023-10-25T16:23:19.193313+0000","last_unstale":"2023-10-25T16:23:19.194416+0000","last_undegraded":"2023-10-25T16:23:19.194416+0000","last_fullsized":"2023-10-25T16:23:19.194416+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185592+0000","last_change":"2023-10-25T16:23:19.185493+0000","last_active":"2023-10-25T16:23:19.185592+0000","last_peered":"2023-10-25T16:23:19.185592+0000","last_clean":"2023-10-25T16:23:19.185592+0000","last_became_active":"2023-10-25T16:23:19.184661+0000","last_became_peered":"2023-10-25T16:23:19.184661+0000","last_unstale":"2023-10-25T16:23:19.185592+0000","last_undegraded":"2023-10-25T16:23:19.185592+0000","last_fullsized":"2023-10-25T16:23:19.185592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:41.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195019+0000","last_change":"2023-10-25T16:23:18.158454+0000","last_active":"2023-10-25T16:23:19.195019+0000","last_peered":"2023-10-25T16:23:19.195019+0000","last_clean":"2023-10-25T16:23:19.195019+0000","last_became_active":"2023-10-25T16:23:18.157852+0000","last_became_peered":"2023-10-25T16:23:18.157852+0000","last_unstale":"2023-10-25T16:23:19.195019+0000","last_undegraded":"2023-10-25T16:23:19.195019+0000","last_fullsized":"2023-10-25T16:23:19.195019+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:17.308462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199538+0000","last_change":"2023-10-25T16:23:19.199453+0000","last_active":"2023-10-25T16:23:19.199538+0000","last_peered":"2023-10-25T16:23:19.199538+0000","last_clean":"2023-10-25T16:23:19.199538+0000","last_became_active":"2023-10-25T16:23:19.197416+0000","last_became_peered":"2023-10-25T16:23:19.197416+0000","last_unstale":"2023-10-25T16:23:19.199538+0000","last_undegraded":"2023-10-25T16:23:19.199538+0000","last_fullsized":"2023-10-25T16:23:19.199538+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:03:05.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193467+0000","last_change":"2023-10-25T16:23:19.193398+0000","last_active":"2023-10-25T16:23:19.193467+0000","last_peered":"2023-10-25T16:23:19.193467+0000","last_clean":"2023-10-25T16:23:19.193467+0000","last_became_active":"2023-10-25T16:23:19.193144+0000","last_became_peered":"2023-10-25T16:23:19.193144+0000","last_unstale":"2023-10-25T16:23:19.193467+0000","last_undegraded":"2023-10-25T16:23:19.193467+0000","last_fullsized":"2023-10-25T16:23:19.193467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:15.074684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176047+0000","last_change":"2023-10-25T16:23:18.170217+0000","last_active":"2023-10-25T16:23:19.176047+0000","last_peered":"2023-10-25T16:23:19.176047+0000","last_clean":"2023-10-25T16:23:19.176047+0000","last_became_active":"2023-10-25T16:23:18.164022+0000","last_became_peered":"2023-10-25T16:23:18.164022+0000","last_unstale":"2023-10-25T16:23:19.176047+0000","last_undegraded":"2023-10-25T16:23:19.176047+0000","last_fullsized":"2023-10-25T16:23:19.176047+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:38.919815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.202140+0000","last_change":"2023-10-25T16:23:19.202046+0000","last_active":"2023-10-25T16:23:19.202140+0000","last_peered":"2023-10-25T16:23:19.202140+0000","last_clean":"2023-10-25T16:23:19.202140+0000","last_became_active":"2023-10-25T16:23:19.201736+0000","last_became_peered":"2023-10-25T16:23:19.201736+0000","last_unstale":"2023-10-25T16:23:19.202140+0000","last_undegraded":"2023-10-25T16:23:19.202140+0000","last_fullsized":"2023-10-25T16:23:19.202140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:11.245553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175388+0000","last_change":"2023-10-25T16:23:18.152106+0000","last_active":"2023-10-25T16:23:19.175388+0000","last_peered":"2023-10-25T16:23:19.175388+0000","last_clean":"2023-10-25T16:23:19.175388+0000","last_became_active":"2023-10-25T16:23:18.151874+0000","last_became_peered":"2023-10-25T16:23:18.151874+0000","last_unstale":"2023-10-25T16:23:19.175388+0000","last_undegraded":"2023-10-25T16:23:19.175388+0000","last_fullsized":"2023-10-25T16:23:19.175388+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:25.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174870+0000","last_change":"2023-10-25T16:23:19.174784+0000","last_active":"2023-10-25T16:23:19.174870+0000","last_peered":"2023-10-25T16:23:19.174870+0000","last_clean":"2023-10-25T16:23:19.174870+0000","last_became_active":"2023-10-25T16:23:19.174430+0000","last_became_peered":"2023-10-25T16:23:19.174430+0000","last_unstale":"2023-10-25T16:23:19.174870+0000","last_undegraded":"2023-10-25T16:23:19.174870+0000","last_fullsized":"2023-10-25T16:23:19.174870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:54.951159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177883+0000","last_change":"2023-10-25T16:23:18.173400+0000","last_active":"2023-10-25T16:23:19.177883+0000","last_peered":"2023-10-25T16:23:19.177883+0000","last_clean":"2023-10-25T16:23:19.177883+0000","last_became_active":"2023-10-25T16:23:18.172310+0000","last_became_peered":"2023-10-25T16:23:18.172310+0000","last_unstale":"2023-10-25T16:23:19.177883+0000","last_undegraded":"2023-10-25T16:23:19.177883+0000","last_fullsized":"2023-10-25T16:23:19.177883+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:40.956111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"173'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.207997+0000","last_change":"2023-10-25T16:23:18.154423+0000","last_active":"2023-10-25T16:23:19.207997+0000","last_peered":"2023-10-25T16:23:19.207997+0000","last_clean":"2023-10-25T16:23:19.207997+0000","last_became_active":"2023-10-25T16:23:18.154185+0000","last_became_peered":"2023-10-25T16:23:18.154185+0000","last_unstale":"2023-10-25T16:23:19.207997+0000","last_undegraded":"2023-10-25T16:23:19.207997+0000","last_fullsized":"2023-10-25T16:23:19.207997+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:32.778729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190263+0000","last_change":"2023-10-25T16:23:19.188225+0000","last_active":"2023-10-25T16:23:19.190263+0000","last_peered":"2023-10-25T16:23:19.190263+0000","last_clean":"2023-10-25T16:23:19.190263+0000","last_became_active":"2023-10-25T16:23:19.187882+0000","last_became_peered":"2023-10-25T16:23:19.187882+0000","last_unstale":"2023-10-25T16:23:19.190263+0000","last_undegraded":"2023-10-25T16:23:19.190263+0000","last_fullsized":"2023-10-25T16:23:19.190263+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:16.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190158+0000","last_change":"2023-10-25T16:23:18.161583+0000","last_active":"2023-10-25T16:23:19.190158+0000","last_peered":"2023-10-25T16:23:19.190158+0000","last_clean":"2023-10-25T16:23:19.190158+0000","last_became_active":"2023-10-25T16:23:18.160916+0000","last_became_peered":"2023-10-25T16:23:18.160916+0000","last_unstale":"2023-10-25T16:23:19.190158+0000","last_undegraded":"2023-10-25T16:23:19.190158+0000","last_fullsized":"2023-10-25T16:23:19.190158+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:03.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178373+0000","last_change":"2023-10-25T16:23:19.178044+0000","last_active":"2023-10-25T16:23:19.178373+0000","last_peered":"2023-10-25T16:23:19.178373+0000","last_clean":"2023-10-25T16:23:19.178373+0000","last_became_active":"2023-10-25T16:23:19.177776+0000","last_became_peered":"2023-10-25T16:23:19.177776+0000","last_unstale":"2023-10-25T16:23:19.178373+0000","last_undegraded":"2023-10-25T16:23:19.178373+0000","last_fullsized":"2023-10-25T16:23:19.178373+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:23.165764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187417+0000","last_change":"2023-10-25T16:23:18.166804+0000","last_active":"2023-10-25T16:23:19.187417+0000","last_peered":"2023-10-25T16:23:19.187417+0000","last_clean":"2023-10-25T16:23:19.187417+0000","last_became_active":"2023-10-25T16:23:18.166187+0000","last_became_peered":"2023-10-25T16:23:18.166187+0000","last_unstale":"2023-10-25T16:23:19.187417+0000","last_undegraded":"2023-10-25T16:23:19.187417+0000","last_fullsized":"2023-10-25T16:23:19.187417+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:57.177360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196007+0000","last_change":"2023-10-25T16:23:19.195656+0000","last_active":"2023-10-25T16:23:19.196007+0000","last_peered":"2023-10-25T16:23:19.196007+0000","last_clean":"2023-10-25T16:23:19.196007+0000","last_became_active":"2023-10-25T16:23:19.195225+0000","last_became_peered":"2023-10-25T16:23:19.195225+0000","last_unstale":"2023-10-25T16:23:19.196007+0000","last_undegraded":"2023-10-25T16:23:19.196007+0000","last_fullsized":"2023-10-25T16:23:19.196007+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:51.080489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173863+0000","last_change":"2023-10-25T16:23:18.151003+0000","last_active":"2023-10-25T16:23:19.173863+0000","last_peered":"2023-10-25T16:23:19.173863+0000","last_clean":"2023-10-25T16:23:19.173863+0000","last_became_active":"2023-10-25T16:23:18.150677+0000","last_became_peered":"2023-10-25T16:23:18.150677+0000","last_unstale":"2023-10-25T16:23:19.173863+0000","last_undegraded":"2023-10-25T16:23:19.173863+0000","last_fullsized":"2023-10-25T16:23:19.173863+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:19.475448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.197147+0000","last_change":"2023-10-25T16:23:19.197069+0000","last_active":"2023-10-25T16:23:19.197147+0000","last_peered":"2023-10-25T16:23:19.197147+0000","last_clean":"2023-10-25T16:23:19.197147+0000","last_became_active":"2023-10-25T16:23:19.196772+0000","last_became_peered":"2023-10-25T16:23:19.196772+0000","last_unstale":"2023-10-25T16:23:19.197147+0000","last_undegraded":"2023-10-25T16:23:19.197147+0000","last_fullsized":"2023-10-25T16:23:19.197147+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:42.978913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178825+0000","last_change":"2023-10-25T16:23:19.178741+0000","last_active":"2023-10-25T16:23:19.178825+0000","last_peered":"2023-10-25T16:23:19.178825+0000","last_clean":"2023-10-25T16:23:19.178825+0000","last_became_active":"2023-10-25T16:23:19.178495+0000","last_became_peered":"2023-10-25T16:23:19.178495+0000","last_unstale":"2023-10-25T16:23:19.178825+0000","last_undegraded":"2023-10-25T16:23:19.178825+0000","last_fullsized":"2023-10-25T16:23:19.178825+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191193+0000","last_change":"2023-10-25T16:23:18.150704+0000","last_active":"2023-10-25T16:23:19.191193+0000","last_peered":"2023-10-25T16:23:19.191193+0000","last_clean":"2023-10-25T16:23:19.191193+0000","last_became_active":"2023-10-25T16:23:18.149026+0000","last_became_peered":"2023-10-25T16:23:18.149026+0000","last_unstale":"2023-10-25T16:23:19.191193+0000","last_undegraded":"2023-10-25T16:23:19.191193+0000","last_fullsized":"2023-10-25T16:23:19.191193+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:52.995037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199223+0000","last_change":"2023-10-25T16:23:18.160357+0000","last_active":"2023-10-25T16:23:19.199223+0000","last_peered":"2023-10-25T16:23:19.199223+0000","last_clean":"2023-10-25T16:23:19.199223+0000","last_became_active":"2023-10-25T16:23:18.160114+0000","last_became_peered":"2023-10-25T16:23:18.160114+0000","last_unstale":"2023-10-25T16:23:19.199223+0000","last_undegraded":"2023-10-25T16:23:19.199223+0000","last_fullsized":"2023-10-25T16:23:19.199223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:22:54.207547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190232+0000","last_change":"2023-10-25T16:23:19.186950+0000","last_active":"2023-10-25T16:23:19.190232+0000","last_peered":"2023-10-25T16:23:19.190232+0000","last_clean":"2023-10-25T16:23:19.190232+0000","last_became_active":"2023-10-25T16:23:19.186538+0000","last_became_peered":"2023-10-25T16:23:19.186538+0000","last_unstale":"2023-10-25T16:23:19.190232+0000","last_undegraded":"2023-10-25T16:23:19.190232+0000","last_fullsized":"2023-10-25T16:23:19.190232+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:06.640286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:17.118775+0000","last_change":"2023-10-25T16:23:17.118775+0000","last_active":"2023-10-25T16:23:17.118775+0000","last_peered":"2023-10-25T16:23:17.118775+0000","last_clean":"2023-10-25T16:23:17.118775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:17.118775+0000","last_undegraded":"2023-10-25T16:23:17.118775+0000","last_fullsized":"2023-10-25T16:23:17.118775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.206013+0000","last_change":"2023-10-25T16:23:19.205886+0000","last_active":"2023-10-25T16:23:19.206013+0000","last_peered":"2023-10-25T16:23:19.206013+0000","last_clean":"2023-10-25T16:23:19.206013+0000","last_became_active":"2023-10-25T16:23:19.203366+0000","last_became_peered":"2023-10-25T16:23:19.203366+0000","last_unstale":"2023-10-25T16:23:19.206013+0000","last_undegraded":"2023-10-25T16:23:19.206013+0000","last_fullsized":"2023-10-25T16:23:19.206013+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:24:20.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174344+0000","last_change":"2023-10-25T16:23:18.151835+0000","last_active":"2023-10-25T16:23:19.174344+0000","last_peered":"2023-10-25T16:23:19.174344+0000","last_clean":"2023-10-25T16:23:19.174344+0000","last_became_active":"2023-10-25T16:23:18.151576+0000","last_became_peered":"2023-10-25T16:23:18.151576+0000","last_unstale":"2023-10-25T16:23:19.174344+0000","last_undegraded":"2023-10-25T16:23:19.174344+0000","last_fullsized":"2023-10-25T16:23:19.174344+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:22.254506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183324+0000","last_change":"2023-10-25T16:23:19.180761+0000","last_active":"2023-10-25T16:23:19.183324+0000","last_peered":"2023-10-25T16:23:19.183324+0000","last_clean":"2023-10-25T16:23:19.183324+0000","last_became_active":"2023-10-25T16:23:19.179966+0000","last_became_peered":"2023-10-25T16:23:19.179966+0000","last_unstale":"2023-10-25T16:23:19.183324+0000","last_undegraded":"2023-10-25T16:23:19.183324+0000","last_fullsized":"2023-10-25T16:23:19.183324+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:46.370576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186103+0000","last_change":"2023-10-25T16:23:18.172840+0000","last_active":"2023-10-25T16:23:19.186103+0000","last_peered":"2023-10-25T16:23:19.186103+0000","last_clean":"2023-10-25T16:23:19.186103+0000","last_became_active":"2023-10-25T16:23:18.172410+0000","last_became_peered":"2023-10-25T16:23:18.172410+0000","last_unstale":"2023-10-25T16:23:19.186103+0000","last_undegraded":"2023-10-25T16:23:19.186103+0000","last_fullsized":"2023-10-25T16:23:19.186103+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181485+0000","last_change":"2023-10-25T16:23:19.181417+0000","last_active":"2023-10-25T16:23:19.181485+0000","last_peered":"2023-10-25T16:23:19.181485+0000","last_clean":"2023-10-25T16:23:19.181485+0000","last_became_active":"2023-10-25T16:23:19.181183+0000","last_became_peered":"2023-10-25T16:23:19.181183+0000","last_unstale":"2023-10-25T16:23:19.181485+0000","last_undegraded":"2023-10-25T16:23:19.181485+0000","last_fullsized":"2023-10-25T16:23:19.181485+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:33.754559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.172850+0000","last_change":"2023-10-25T16:23:18.168302+0000","last_active":"2023-10-25T16:23:19.172850+0000","last_peered":"2023-10-25T16:23:19.172850+0000","last_clean":"2023-10-25T16:23:19.172850+0000","last_became_active":"2023-10-25T16:23:18.167104+0000","last_became_peered":"2023-10-25T16:23:18.167104+0000","last_unstale":"2023-10-25T16:23:19.172850+0000","last_undegraded":"2023-10-25T16:23:19.172850+0000","last_fullsized":"2023-10-25T16:23:19.172850+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:14.919507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183360+0000","last_change":"2023-10-25T16:23:19.181928+0000","last_active":"2023-10-25T16:23:19.183360+0000","last_peered":"2023-10-25T16:23:19.183360+0000","last_clean":"2023-10-25T16:23:19.183360+0000","last_became_active":"2023-10-25T16:23:19.181522+0000","last_became_peered":"2023-10-25T16:23:19.181522+0000","last_unstale":"2023-10-25T16:23:19.183360+0000","last_undegraded":"2023-10-25T16:23:19.183360+0000","last_fullsized":"2023-10-25T16:23:19.183360+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:58:58.064499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175066+0000","last_change":"2023-10-25T16:23:18.166147+0000","last_active":"2023-10-25T16:23:19.175066+0000","last_peered":"2023-10-25T16:23:19.175066+0000","last_clean":"2023-10-25T16:23:19.175066+0000","last_became_active":"2023-10-25T16:23:18.165261+0000","last_became_peered":"2023-10-25T16:23:18.165261+0000","last_unstale":"2023-10-25T16:23:19.175066+0000","last_undegraded":"2023-10-25T16:23:19.175066+0000","last_fullsized":"2023-10-25T16:23:19.175066+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:00.551034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181129+0000","last_change":"2023-10-25T16:23:19.180843+0000","last_active":"2023-10-25T16:23:19.181129+0000","last_peered":"2023-10-25T16:23:19.181129+0000","last_clean":"2023-10-25T16:23:19.181129+0000","last_became_active":"2023-10-25T16:23:19.180642+0000","last_became_peered":"2023-10-25T16:23:19.180642+0000","last_unstale":"2023-10-25T16:23:19.181129+0000","last_undegraded":"2023-10-25T16:23:19.181129+0000","last_fullsized":"2023-10-25T16:23:19.181129+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187569+0000","last_change":"2023-10-25T16:23:18.155577+0000","last_active":"2023-10-25T16:23:19.187569+0000","last_peered":"2023-10-25T16:23:19.187569+0000","last_clean":"2023-10-25T16:23:19.187569+0000","last_became_active":"2023-10-25T16:23:18.154738+0000","last_became_peered":"2023-10-25T16:23:18.154738+0000","last_unstale":"2023-10-25T16:23:19.187569+0000","last_undegraded":"2023-10-25T16:23:19.187569+0000","last_fullsized":"2023-10-25T16:23:19.187569+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:19.137605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195579+0000","last_change":"2023-10-25T16:23:19.195535+0000","last_active":"2023-10-25T16:23:19.195579+0000","last_peered":"2023-10-25T16:23:19.195579+0000","last_clean":"2023-10-25T16:23:19.195579+0000","last_became_active":"2023-10-25T16:23:19.194875+0000","last_became_peered":"2023-10-25T16:23:19.194875+0000","last_unstale":"2023-10-25T16:23:19.195579+0000","last_undegraded":"2023-10-25T16:23:19.195579+0000","last_fullsized":"2023-10-25T16:23:19.195579+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:55:46.166735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182724+0000","last_change":"2023-10-25T16:23:18.172760+0000","last_active":"2023-10-25T16:23:19.182724+0000","last_peered":"2023-10-25T16:23:19.182724+0000","last_clean":"2023-10-25T16:23:19.182724+0000","last_became_active":"2023-10-25T16:23:18.170761+0000","last_became_peered":"2023-10-25T16:23:18.170761+0000","last_unstale":"2023-10-25T16:23:19.182724+0000","last_undegraded":"2023-10-25T16:23:19.182724+0000","last_fullsized":"2023-10-25T16:23:19.182724+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:32.740149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190210+0000","last_change":"2023-10-25T16:23:19.186788+0000","last_active":"2023-10-25T16:23:19.190210+0000","last_peered":"2023-10-25T16:23:19.190210+0000","last_clean":"2023-10-25T16:23:19.190210+0000","last_became_active":"2023-10-25T16:23:19.186225+0000","last_became_peered":"2023-10-25T16:23:19.186225+0000","last_unstale":"2023-10-25T16:23:19.190210+0000","last_undegraded":"2023-10-25T16:23:19.190210+0000","last_fullsized":"2023-10-25T16:23:19.190210+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:39.934224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174737+0000","last_change":"2023-10-25T16:23:18.160453+0000","last_active":"2023-10-25T16:23:19.174737+0000","last_peered":"2023-10-25T16:23:19.174737+0000","last_clean":"2023-10-25T16:23:19.174737+0000","last_became_active":"2023-10-25T16:23:18.160242+0000","last_became_peered":"2023-10-25T16:23:18.160242+0000","last_unstale":"2023-10-25T16:23:19.174737+0000","last_undegraded":"2023-10-25T16:23:19.174737+0000","last_fullsized":"2023-10-25T16:23:19.174737+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:30.230996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.188042+0000","last_change":"2023-10-25T16:23:19.187943+0000","last_active":"2023-10-25T16:23:19.188042+0000","last_peered":"2023-10-25T16:23:19.188042+0000","last_clean":"2023-10-25T16:23:19.188042+0000","last_became_active":"2023-10-25T16:23:19.187788+0000","last_became_peered":"2023-10-25T16:23:19.187788+0000","last_unstale":"2023-10-25T16:23:19.188042+0000","last_undegraded":"2023-10-25T16:23:19.188042+0000","last_fullsized":"2023-10-25T16:23:19.188042+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:22:37.089982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173774+0000","last_change":"2023-10-25T16:23:18.154831+0000","last_active":"2023-10-25T16:23:19.173774+0000","last_peered":"2023-10-25T16:23:19.173774+0000","last_clean":"2023-10-25T16:23:19.173774+0000","last_became_active":"2023-10-25T16:23:18.154491+0000","last_became_peered":"2023-10-25T16:23:18.154491+0000","last_unstale":"2023-10-25T16:23:19.173774+0000","last_undegraded":"2023-10-25T16:23:19.173774+0000","last_fullsized":"2023-10-25T16:23:19.173774+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:57.283692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190571+0000","last_change":"2023-10-25T16:23:19.190322+0000","last_active":"2023-10-25T16:23:19.190571+0000","last_peered":"2023-10-25T16:23:19.190571+0000","last_clean":"2023-10-25T16:23:19.190571+0000","last_became_active":"2023-10-25T16:23:19.189841+0000","last_became_peered":"2023-10-25T16:23:19.189841+0000","last_unstale":"2023-10-25T16:23:19.190571+0000","last_undegraded":"2023-10-25T16:23:19.190571+0000","last_fullsized":"2023-10-25T16:23:19.190571+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:40.045282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173739+0000","last_change":"2023-10-25T16:23:18.154686+0000","last_active":"2023-10-25T16:23:19.173739+0000","last_peered":"2023-10-25T16:23:19.173739+0000","last_clean":"2023-10-25T16:23:19.173739+0000","last_became_active":"2023-10-25T16:23:18.154437+0000","last_became_peered":"2023-10-25T16:23:18.154437+0000","last_unstale":"2023-10-25T16:23:19.173739+0000","last_undegraded":"2023-10-25T16:23:19.173739+0000","last_fullsized":"2023-10-25T16:23:19.173739+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:14:28.241432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:23:18.133185+0000","last_change":"2023-10-25T16:23:18.133185+0000","last_active":"2023-10-25T16:23:18.133185+0000","last_peered":"2023-10-25T16:23:18.133185+0000","last_clean":"2023-10-25T16:23:18.133185+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:23:18.133185+0000","last_undegraded":"2023-10-25T16:23:18.133185+0000","last_fullsized":"2023-10-25T16:23:18.133185+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.170440+0000","last_change":"2023-10-25T16:23:18.162041+0000","last_active":"2023-10-25T16:23:19.170440+0000","last_peered":"2023-10-25T16:23:19.170440+0000","last_clean":"2023-10-25T16:23:19.170440+0000","last_became_active":"2023-10-25T16:23:18.161793+0000","last_became_peered":"2023-10-25T16:23:18.161793+0000","last_unstale":"2023-10-25T16:23:19.170440+0000","last_undegraded":"2023-10-25T16:23:19.170440+0000","last_fullsized":"2023-10-25T16:23:19.170440+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:01.371271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192534+0000","last_change":"2023-10-25T16:23:19.192438+0000","last_active":"2023-10-25T16:23:19.192534+0000","last_peered":"2023-10-25T16:23:19.192534+0000","last_clean":"2023-10-25T16:23:19.192534+0000","last_became_active":"2023-10-25T16:23:19.192213+0000","last_became_peered":"2023-10-25T16:23:19.192213+0000","last_unstale":"2023-10-25T16:23:19.192534+0000","last_undegraded":"2023-10-25T16:23:19.192534+0000","last_fullsized":"2023-10-25T16:23:19.192534+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:06.205275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177449+0000","last_change":"2023-10-25T16:23:18.173060+0000","last_active":"2023-10-25T16:23:19.177449+0000","last_peered":"2023-10-25T16:23:19.177449+0000","last_clean":"2023-10-25T16:23:19.177449+0000","last_became_active":"2023-10-25T16:23:18.171579+0000","last_became_peered":"2023-10-25T16:23:18.171579+0000","last_unstale":"2023-10-25T16:23:19.177449+0000","last_undegraded":"2023-10-25T16:23:19.177449+0000","last_fullsized":"2023-10-25T16:23:19.177449+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192391+0000","last_change":"2023-10-25T16:23:19.192244+0000","last_active":"2023-10-25T16:23:19.192391+0000","last_peered":"2023-10-25T16:23:19.192391+0000","last_clean":"2023-10-25T16:23:19.192391+0000","last_became_active":"2023-10-25T16:23:19.191971+0000","last_became_peered":"2023-10-25T16:23:19.191971+0000","last_unstale":"2023-10-25T16:23:19.192391+0000","last_undegraded":"2023-10-25T16:23:19.192391+0000","last_fullsized":"2023-10-25T16:23:19.192391+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:59:12.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182401+0000","last_change":"2023-10-25T16:23:18.169800+0000","last_active":"2023-10-25T16:23:19.182401+0000","last_peered":"2023-10-25T16:23:19.182401+0000","last_clean":"2023-10-25T16:23:19.182401+0000","last_became_active":"2023-10-25T16:23:18.167411+0000","last_became_peered":"2023-10-25T16:23:18.167411+0000","last_unstale":"2023-10-25T16:23:19.182401+0000","last_undegraded":"2023-10-25T16:23:19.182401+0000","last_fullsized":"2023-10-25T16:23:19.182401+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:13:16.298558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198587+0000","last_change":"2023-10-25T16:23:19.198512+0000","last_active":"2023-10-25T16:23:19.198587+0000","last_peered":"2023-10-25T16:23:19.198587+0000","last_clean":"2023-10-25T16:23:19.198587+0000","last_became_active":"2023-10-25T16:23:19.198216+0000","last_became_peered":"2023-10-25T16:23:19.198216+0000","last_unstale":"2023-10-25T16:23:19.198587+0000","last_undegraded":"2023-10-25T16:23:19.198587+0000","last_fullsized":"2023-10-25T16:23:19.198587+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:50:42.583353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176315+0000","last_change":"2023-10-25T16:23:18.167697+0000","last_active":"2023-10-25T16:23:19.176315+0000","last_peered":"2023-10-25T16:23:19.176315+0000","last_clean":"2023-10-25T16:23:19.176315+0000","last_became_active":"2023-10-25T16:23:18.167237+0000","last_became_peered":"2023-10-25T16:23:18.167237+0000","last_unstale":"2023-10-25T16:23:19.176315+0000","last_undegraded":"2023-10-25T16:23:19.176315+0000","last_fullsized":"2023-10-25T16:23:19.176315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191073+0000","last_change":"2023-10-25T16:23:19.191002+0000","last_active":"2023-10-25T16:23:19.191073+0000","last_peered":"2023-10-25T16:23:19.191073+0000","last_clean":"2023-10-25T16:23:19.191073+0000","last_became_active":"2023-10-25T16:23:19.190626+0000","last_became_peered":"2023-10-25T16:23:19.190626+0000","last_unstale":"2023-10-25T16:23:19.191073+0000","last_undegraded":"2023-10-25T16:23:19.191073+0000","last_fullsized":"2023-10-25T16:23:19.191073+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:01.565443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"173'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193332+0000","last_change":"2023-10-25T16:23:18.170261+0000","last_active":"2023-10-25T16:23:19.193332+0000","last_peered":"2023-10-25T16:23:19.193332+0000","last_clean":"2023-10-25T16:23:19.193332+0000","last_became_active":"2023-10-25T16:23:18.168947+0000","last_became_peered":"2023-10-25T16:23:18.168947+0000","last_unstale":"2023-10-25T16:23:19.193332+0000","last_undegraded":"2023-10-25T16:23:19.193332+0000","last_fullsized":"2023-10-25T16:23:19.193332+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:38:37.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-25T16:23:18.162842+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:23:18.162842+0000","last_peered":"2023-10-25T16:23:18.162842+0000","last_clean":"2023-10-25T16:23:18.162842+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:23:18.162842+0000","last_undegraded":"2023-10-25T16:23:18.162842+0000","last_fullsized":"2023-10-25T16:23:18.162842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":56,"acting":56,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":933,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194379,"statfs":{"total":200000000,"available":199044201,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65200000000000002,"15min":0.54800000000000004},"min":{"1min":0.48999999999999999,"5min":0.28799999999999998,"15min":0.23100000000000001},"max":{"1min":1.0329999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.67600000000000005,"15min":0.60299999999999998},"min":{"1min":0.51600000000000001,"5min":0.308,"15min":0.27000000000000002},"max":{"1min":0.97799999999999998,"5min":1.0489999999999999,"15min":1.077},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.67600000000000005,"15min":0.60699999999999998},"min":{"1min":0.59699999999999998,"5min":0.32300000000000001,"15min":0.27000000000000002},"max":{"1min":0.97899999999999998,"5min":1.145,"15min":1.1759999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.73199999999999998,"15min":0.61399999999999999},"min":{"1min":0.60799999999999998,"5min":0.309,"15min":0.26400000000000001},"max":{"1min":1.0389999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78400000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.625},"min":{"1min":0.53000000000000003,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":0.96899999999999997,"5min":1.246,"15min":1.246},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.81299999999999994,"15min":0.68000000000000005},"min":{"1min":0.77700000000000002,"5min":0.35799999999999998,"15min":0.28199999999999997},"max":{"1min":1.111,"5min":1.2729999999999999,"15min":1.345},"last":0.69899999999999995}]},{"osd":4,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.96799999999999997,"15min":0.86599999999999999},"min":{"1min":0.748,"5min":0.55500000000000005,"15min":0.438},"max":{"1min":1.1990000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96499999999999997,"15min":0.88600000000000001},"min":{"1min":0.69999999999999996,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.216,"5min":1.4330000000000001,"15min":1.5760000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90400000000000003,"15min":0.86299999999999999},"min":{"1min":0.76500000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.998,"5min":1.46,"15min":1.4930000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.101,"5min":0.996,"15min":0.94399999999999995},"min":{"1min":1.004,"5min":0.57299999999999995,"15min":0.47899999999999998},"max":{"1min":1.2370000000000001,"5min":1.671,"15min":1.671},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0049999999999999,"15min":0.92400000000000004},"min":{"1min":0.83899999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2010000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.099},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.98499999999999999,"15min":0.94299999999999995},"min":{"1min":0.91600000000000004,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.2070000000000001,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.0349999999999999,"15min":0.95499999999999996},"min":{"1min":0.995,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.2709999999999999,"5min":1.474,"15min":1.677},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.032,"15min":0.98099999999999998},"min":{"1min":0.97299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.177,"5min":1.454,"15min":1.7569999999999999},"last":0.92300000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193790,"statfs":{"total":200000000,"available":198441741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.35899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.256},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83999999999999997},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.534},"last":0.86899999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.42899999999999999},"max":{"1min":1.4259999999999999,"5min":1.647,"15min":1.647},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70899999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89200000000000002,"15min":0.85699999999999998},"min":{"1min":0.55100000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.234,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1879999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.996,"15min":0.98199999999999998},"min":{"1min":0.78900000000000003,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.3360000000000001,"5min":1.51,"15min":1.51},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0249999999999999,"15min":0.97699999999999998},"min":{"1min":0.69099999999999995,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.3600000000000001,"5min":1.548,"15min":1.548},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.262,"5min":1.478,"15min":1.4910000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.61799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.77400000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2909999999999999,"5min":1.696,"15min":1.7370000000000001},"last":0.63},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.0229999999999999},"min":{"1min":0.67700000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.0169999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.496,"5min":1.643,"15min":1.669},"last":1.099},{"interface":"front","average":{"1min":1.125,"5min":1.1060000000000001,"15min":1.117},"min":{"1min":0.77900000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.54,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.876},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.339,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.877},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.998,"15min":0.92400000000000004},"min":{"1min":0.67700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.2529999999999999,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.242}]},{"osd":1,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.624,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.3080000000000001,"5min":10.667,"15min":10.667},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.046,"15min":0.94499999999999995},"min":{"1min":0.65400000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96299999999999997,"15min":0.91200000000000003},"min":{"1min":0.68500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.242,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0600000000000001,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.609,"5min":10.948,"15min":10.948},"last":0.97299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.72499999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.996},{"interface":"front","average":{"1min":1.127,"5min":1.121,"15min":1.069},"min":{"1min":0.84399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4370000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.139}]},{"osd":4,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.052,"15min":0.98199999999999998},"min":{"1min":0.63,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.381,"5min":11.081,"15min":11.081},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.96999999999999997},"min":{"1min":0.64900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.165,"5min":1.444,"15min":1.444},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98299999999999998,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3069999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.087,"5min":1.1100000000000001,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.734,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.022}]},{"osd":7,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.244,"15min":1.1339999999999999},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.6140000000000001,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.179},{"interface":"front","average":{"1min":1.181,"5min":1.151,"15min":1.079},"min":{"1min":0.82399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.1970000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.052}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":1.1279999999999999},"min":{"1min":0.66700000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.224,"5min":2.1429999999999998,"15min":14.843},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":1.1819999999999999},"min":{"1min":0.58699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.111,"5min":2.8450000000000002,"15min":16.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":1.1739999999999999},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.423,"15min":14.630000000000001},"last":1.048},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92700000000000005,"15min":0.89700000000000002},"min":{"1min":0.69599999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2430000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0249999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.95099999999999996},"min":{"1min":0.627,"5min":0.5,"15min":0.5},"max":{"1min":1.22,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.76500000000000001,"5min":0.53800000000000003,"15min":0.48499999999999999},"max":{"1min":1.248,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.97199999999999998,"15min":0.98399999999999999},"min":{"1min":0.80400000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.179,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.302},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.1160000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.321},"min":{"1min":0.56999999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":15.904},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":1.298},"min":{"1min":0.63600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.0840000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.044,"15min":1.288},"min":{"1min":0.69499999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2689999999999999,"5min":4.5970000000000004,"15min":14.567},"last":0.746},{"interface":"front","average":{"1min":1.133,"5min":1.139,"15min":1.4419999999999999},"min":{"1min":0.81299999999999994,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.421,"5min":2.4079999999999999,"15min":15.089},"last":0.84699999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0209999999999999,"15min":1.395},"min":{"1min":0.748,"5min":0.436,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.171,"15min":1.2190000000000001},"min":{"1min":0.81599999999999995,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3220000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.86899999999999999,"15min":0.82699999999999996},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.252,"5min":1.3,"15min":1.47},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.874,"15min":0.83199999999999996},"min":{"1min":0.65800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.274,"5min":1.278,"15min":1.3029999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.873,"15min":0.84299999999999997},"min":{"1min":0.60599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.288},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98399999999999999,"15min":0.96399999999999997},"min":{"1min":0.65600000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.383,"5min":1.47,"15min":1.4990000000000001},"last":0.876}]},{"osd":2,"last update":"Wed Oct 25 16:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88500000000000001,"15min":0.85299999999999998},"min":{"1min":0.72899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1379999999999999,"5min":1.341,"15min":1.419},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.66100000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.91900000000000004},"min":{"1min":0.752,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3200000000000001,"5min":1.5,"15min":1.5},"last":1.016},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85499999999999998,"15min":0.81499999999999995},"min":{"1min":0.70399999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.518},"last":0.92300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.504,"5min":1.599,"15min":2.6640000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.81299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":1.6379999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.181}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.61799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":2.085},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0660000000000001,"15min":1.071},"min":{"1min":0.77100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.252,"5min":1.625,"15min":1.8149999999999999},"last":1.2250000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.95399999999999996,"15min":0.94999999999999996},"min":{"1min":0.68899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1419999999999999,"15min":1.1240000000000001},"min":{"1min":1.02,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.4359999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.59199999999999997},"min":{"1min":0.35999999999999999,"5min":0.27200000000000002,"15min":0.22},"max":{"1min":1.002,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.222},"max":{"1min":0.95699999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.93000000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.33200000000000002,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":0.86799999999999999,"5min":1.425,"15min":1.425},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.441,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.02}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":1.1220000000000001,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.2330000000000001,"5min":1.25,"15min":1.8260000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.89100000000000001},"min":{"1min":0.60399999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1240000000000001,"5min":1.234,"15min":1.234},"last":1.052},{"interface":"front","average":{"1min":1.018,"5min":1.02,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.56599999999999995,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1699999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.94899999999999995,"15min":0.93000000000000005},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.45400000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.96199999999999997},"min":{"1min":0.63700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2050000000000001,"5min":1.2410000000000001,"15min":1.4830000000000001},"last":1.133}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96099999999999997,"15min":0.92000000000000004},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.456},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.505},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0740000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":0.998},"min":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.504},"max":{"1min":1.2849999999999999,"5min":1.508,"15min":1.5660000000000001},"last":1.208},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0109999999999999,"15min":0.97199999999999998},"min":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.51500000000000001},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.389},"last":1.111}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.48699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.042,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66800000000000004,"15min":0.64700000000000002},"min":{"1min":0.57299999999999995,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0680000000000001,"5min":1.075,"15min":1.1990000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61699999999999999,"15min":0.57899999999999996},"min":{"1min":0.57499999999999996,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.96199999999999997,"5min":1.157,"15min":1.4610000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.57699999999999996,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97399999999999998,"5min":1.2,"15min":1.2},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.61699999999999999,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.89600000000000002,"5min":1.048,"15min":1.1399999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.78100000000000003,"15min":0.75800000000000001},"min":{"1min":0.63600000000000001,"5min":0.34799999999999998,"15min":0.28000000000000003},"max":{"1min":1.1499999999999999,"5min":1.1899999999999999,"15min":1.423},"last":0.88100000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.72899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.089,"5min":1.242,"15min":12.698},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.95099999999999996,"15min":1.0129999999999999},"min":{"1min":0.749,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.2170000000000001,"5min":1.2310000000000001,"15min":12.721},"last":1.075}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.84599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.204,"5min":1.2729999999999999,"15min":1.546},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.88900000000000001},"min":{"1min":0.69999999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.2549999999999999,"15min":2.206},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.98299999999999998,"15min":0.95399999999999996},"min":{"1min":0.84699999999999998,"5min":0.65000000000000002,"15min":0.49099999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4610000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0189999999999999,"15min":1.02},"min":{"1min":0.86899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2090000000000001,"5min":1.397,"15min":1.5980000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.95899999999999996,"15min":0.99399999999999999},"min":{"1min":0.77900000000000003,"5min":0.53200000000000003,"15min":0.52000000000000002},"max":{"1min":1.2589999999999999,"5min":1.3100000000000001,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.097,"5min":1.006,"15min":1.026},"min":{"1min":0.92300000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.321,"5min":1.476,"15min":10.509},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193782,"statfs":{"total":200000000,"available":198433320,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.217},"max":{"1min":0.85699999999999998,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.262,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":0.71599999999999997,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.60199999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.44900000000000001,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.024,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.1899999999999999,"5min":1.296,"15min":3.6579999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.86099999999999999},"min":{"1min":0.66500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.024,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.2210000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94499999999999995,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1499999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1850000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0249999999999999,"15min":0.98899999999999999},"min":{"1min":0.70199999999999996,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.619,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0089999999999999,"15min":0.95499999999999996},"min":{"1min":0.77700000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0309999999999999,"15min":1.1719999999999999},"min":{"1min":0.78600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.054,"15min":1.1899999999999999},"min":{"1min":0.73799999999999999,"5min":0.64900000000000002,"15min":0.59799999999999998},"max":{"1min":1.2290000000000001,"5min":1.4159999999999999,"15min":11.622},"last":0.94699999999999995}]}]}],"pool_statfs":[]}} 2023-10-25T16:23:22.589 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:23:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- 172.21.15.177:0/4040632230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d40039b0 msgr2=0x7f97d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 --2- 172.21.15.177:0/4040632230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d40039b0 0x7f97d4003dd0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f97d00016b0 tx=0x7f97d001c750 comp rx=0 tx=0).stop 2023-10-25T16:23:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- 172.21.15.177:0/4040632230 shutdown_connections 2023-10-25T16:23:22.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 --2- 172.21.15.177:0/4040632230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97d40039b0 0x7f97d4003dd0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- 172.21.15.177:0/4040632230 >> 172.21.15.177:0/4040632230 conn(0x7f97e80b2450 msgr2=0x7f97e80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- 172.21.15.177:0/4040632230 shutdown_connections 2023-10-25T16:23:22.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- 172.21.15.177:0/4040632230 wait complete. 2023-10-25T16:23:22.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 Processor -- start 2023-10-25T16:23:22.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- start start 2023-10-25T16:23:22.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d40039b0 0x7f97e812e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 0x7f97e8131050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97e812fc50 0x7f97e8070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e81f2cd0 con 0x7f97e81f2870 2023-10-25T16:23:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e8131590 con 0x7f97e812fc50 2023-10-25T16:23:22.761 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ef288640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e812ebb0 con 0x7f97d40039b0 2023-10-25T16:23:22.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ec823640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 0x7f97e8131050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ec823640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 0x7f97e8131050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37016/0 (socket says 172.21.15.177:37016) 2023-10-25T16:23:22.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ec823640 1 -- 172.21.15.177:0/4243305339 learned_addr learned my addr 172.21.15.177:0/4243305339 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:22.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ed024640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d40039b0 0x7f97e812e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.762 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.760+0000 7f97ed825640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97e812fc50 0x7f97e8070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ec823640 1 -- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d40039b0 msgr2=0x7f97e812e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ec823640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d40039b0 0x7f97e812e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ec823640 1 -- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97e812fc50 msgr2=0x7f97e8070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ec823640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97e812fc50 0x7f97e8070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ec823640 1 -- 172.21.15.177:0/4243305339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e812ee90 con 0x7f97e81f2870 2023-10-25T16:23:22.763 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ed825640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97e812fc50 0x7f97e8070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:22.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ec823640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 0x7f97e8131050 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f97d800e970 tx=0x7f97d800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:22.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800ccb0 con 0x7f97e81f2870 2023-10-25T16:23:22.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f97d8011460 con 0x7f97e81f2870 2023-10-25T16:23:22.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e812f170 con 0x7f97e81f2870 2023-10-25T16:23:22.764 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011870 con 0x7f97e81f2870 2023-10-25T16:23:22.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e812f730 con 0x7f97e81f2870 2023-10-25T16:23:22.765 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e804daf0 con 0x7f97e81f2870 2023-10-25T16:23:22.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f97d80119d0 con 0x7f97e81f2870 2023-10-25T16:23:22.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97e5ffb640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f97c8066470 0x7f97c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:22.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97d8084f80 con 0x7f97e81f2870 2023-10-25T16:23:22.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.764+0000 7f97ed024640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f97c8066470 0x7f97c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:22.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.768+0000 7f97ed024640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f97c8066470 0x7f97c8068930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f97d0001680 tx=0x7f97d00194f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:22.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.768+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97d80523e0 con 0x7f97e81f2870 2023-10-25T16:23:22.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.920+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97e80b0740 con 0x7f97c8066470 2023-10-25T16:23:22.940 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.944+0000 7f97e5ffb640 1 -- 172.21.15.177:0/4243305339 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283753 (secure 0 0 0) 0x7f97d0006120 con 0x7f97c8066470 2023-10-25T16:23:22.943 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:22.944 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:23:22.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f97c8066470 msgr2=0x7f97c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f97c8066470 0x7f97c8068930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f97d0001680 tx=0x7f97d00194f0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 msgr2=0x7f97e8131050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:22.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 0x7f97e8131050 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f97d800e970 tx=0x7f97d800ee30 comp rx=0 tx=0).stop 2023-10-25T16:23:22.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 shutdown_connections 2023-10-25T16:23:22.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f97c8066470 0x7f97c8068930 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97e812fc50 0x7f97e8070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97e81f2870 0x7f97e8131050 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 --2- 172.21.15.177:0/4243305339 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f97d40039b0 0x7f97e812e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:22.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 >> 172.21.15.177:0/4243305339 conn(0x7f97e80b2450 msgr2=0x7f97e8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:22.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 shutdown_connections 2023-10-25T16:23:22.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:22.948+0000 7f97ef288640 1 -- 172.21.15.177:0/4243305339 wait complete. 2023-10-25T16:23:22.962 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2023-10-25T16:23:22.824497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8757,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553742,"statfs":{"total":1600000000,"available":1591031883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.691376"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179492+0000","last_change":"2023-10-25T16:23:19.179248+0000","last_active":"2023-10-25T16:23:19.179492+0000","last_peered":"2023-10-25T16:23:19.179492+0000","last_clean":"2023-10-25T16:23:19.179492+0000","last_became_active":"2023-10-25T16:23:19.179003+0000","last_became_peered":"2023-10-25T16:23:19.179003+0000","last_unstale":"2023-10-25T16:23:19.179492+0000","last_undegraded":"2023-10-25T16:23:19.179492+0000","last_fullsized":"2023-10-25T16:23:19.179492+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:58.596626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180343+0000","last_change":"2023-10-25T16:23:19.180275+0000","last_active":"2023-10-25T16:23:19.180343+0000","last_peered":"2023-10-25T16:23:19.180343+0000","last_clean":"2023-10-25T16:23:19.180343+0000","last_became_active":"2023-10-25T16:23:19.180044+0000","last_became_peered":"2023-10-25T16:23:19.180044+0000","last_unstale":"2023-10-25T16:23:19.180343+0000","last_undegraded":"2023-10-25T16:23:19.180343+0000","last_fullsized":"2023-10-25T16:23:19.180343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:34:40.100162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193667+0000","last_change":"2023-10-25T16:23:19.193592+0000","last_active":"2023-10-25T16:23:19.193667+0000","last_peered":"2023-10-25T16:23:19.193667+0000","last_clean":"2023-10-25T16:23:19.193667+0000","last_became_active":"2023-10-25T16:23:19.192339+0000","last_became_peered":"2023-10-25T16:23:19.192339+0000","last_unstale":"2023-10-25T16:23:19.193667+0000","last_undegraded":"2023-10-25T16:23:19.193667+0000","last_fullsized":"2023-10-25T16:23:19.193667+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:49.438562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185930+0000","last_change":"2023-10-25T16:23:19.185798+0000","last_active":"2023-10-25T16:23:19.185930+0000","last_peered":"2023-10-25T16:23:19.185930+0000","last_clean":"2023-10-25T16:23:19.185930+0000","last_became_active":"2023-10-25T16:23:19.184621+0000","last_became_peered":"2023-10-25T16:23:19.184621+0000","last_unstale":"2023-10-25T16:23:19.185930+0000","last_undegraded":"2023-10-25T16:23:19.185930+0000","last_fullsized":"2023-10-25T16:23:19.185930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:19:30.964216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191807+0000","last_change":"2023-10-25T16:23:19.191555+0000","last_active":"2023-10-25T16:23:19.191807+0000","last_peered":"2023-10-25T16:23:19.191807+0000","last_clean":"2023-10-25T16:23:19.191807+0000","last_became_active":"2023-10-25T16:23:19.191159+0000","last_became_peered":"2023-10-25T16:23:19.191159+0000","last_unstale":"2023-10-25T16:23:19.191807+0000","last_undegraded":"2023-10-25T16:23:19.191807+0000","last_fullsized":"2023-10-25T16:23:19.191807+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:19.271674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.205515+0000","last_change":"2023-10-25T16:23:19.205378+0000","last_active":"2023-10-25T16:23:19.205515+0000","last_peered":"2023-10-25T16:23:19.205515+0000","last_clean":"2023-10-25T16:23:19.205515+0000","last_became_active":"2023-10-25T16:23:19.202582+0000","last_became_peered":"2023-10-25T16:23:19.202582+0000","last_unstale":"2023-10-25T16:23:19.205515+0000","last_undegraded":"2023-10-25T16:23:19.205515+0000","last_fullsized":"2023-10-25T16:23:19.205515+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:57.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190227+0000","last_change":"2023-10-25T16:23:19.190157+0000","last_active":"2023-10-25T16:23:19.190227+0000","last_peered":"2023-10-25T16:23:19.190227+0000","last_clean":"2023-10-25T16:23:19.190227+0000","last_became_active":"2023-10-25T16:23:19.189923+0000","last_became_peered":"2023-10-25T16:23:19.189923+0000","last_unstale":"2023-10-25T16:23:19.190227+0000","last_undegraded":"2023-10-25T16:23:19.190227+0000","last_fullsized":"2023-10-25T16:23:19.190227+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195713+0000","last_change":"2023-10-25T16:23:19.195649+0000","last_active":"2023-10-25T16:23:19.195713+0000","last_peered":"2023-10-25T16:23:19.195713+0000","last_clean":"2023-10-25T16:23:19.195713+0000","last_became_active":"2023-10-25T16:23:19.195462+0000","last_became_peered":"2023-10-25T16:23:19.195462+0000","last_unstale":"2023-10-25T16:23:19.195713+0000","last_undegraded":"2023-10-25T16:23:19.195713+0000","last_fullsized":"2023-10-25T16:23:19.195713+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:04:05.185753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180467+0000","last_change":"2023-10-25T16:23:19.180227+0000","last_active":"2023-10-25T16:23:19.180467+0000","last_peered":"2023-10-25T16:23:19.180467+0000","last_clean":"2023-10-25T16:23:19.180467+0000","last_became_active":"2023-10-25T16:23:19.179523+0000","last_became_peered":"2023-10-25T16:23:19.179523+0000","last_unstale":"2023-10-25T16:23:19.180467+0000","last_undegraded":"2023-10-25T16:23:19.180467+0000","last_fullsized":"2023-10-25T16:23:19.180467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:09.212133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185765+0000","last_change":"2023-10-25T16:23:19.185690+0000","last_active":"2023-10-25T16:23:19.185765+0000","last_peered":"2023-10-25T16:23:19.185765+0000","last_clean":"2023-10-25T16:23:19.185765+0000","last_became_active":"2023-10-25T16:23:19.185461+0000","last_became_peered":"2023-10-25T16:23:19.185461+0000","last_unstale":"2023-10-25T16:23:19.185765+0000","last_undegraded":"2023-10-25T16:23:19.185765+0000","last_fullsized":"2023-10-25T16:23:19.185765+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:43.458260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204930+0000","last_change":"2023-10-25T16:23:19.204724+0000","last_active":"2023-10-25T16:23:19.204930+0000","last_peered":"2023-10-25T16:23:19.204930+0000","last_clean":"2023-10-25T16:23:19.204930+0000","last_became_active":"2023-10-25T16:23:19.201797+0000","last_became_peered":"2023-10-25T16:23:19.201797+0000","last_unstale":"2023-10-25T16:23:19.204930+0000","last_undegraded":"2023-10-25T16:23:19.204930+0000","last_fullsized":"2023-10-25T16:23:19.204930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:24:15.782352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193383+0000","last_change":"2023-10-25T16:23:19.193268+0000","last_active":"2023-10-25T16:23:19.193383+0000","last_peered":"2023-10-25T16:23:19.193383+0000","last_clean":"2023-10-25T16:23:19.193383+0000","last_became_active":"2023-10-25T16:23:19.193016+0000","last_became_peered":"2023-10-25T16:23:19.193016+0000","last_unstale":"2023-10-25T16:23:19.193383+0000","last_undegraded":"2023-10-25T16:23:19.193383+0000","last_fullsized":"2023-10-25T16:23:19.193383+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:33.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196025+0000","last_change":"2023-10-25T16:23:19.195794+0000","last_active":"2023-10-25T16:23:19.196025+0000","last_peered":"2023-10-25T16:23:19.196025+0000","last_clean":"2023-10-25T16:23:19.196025+0000","last_became_active":"2023-10-25T16:23:19.195408+0000","last_became_peered":"2023-10-25T16:23:19.195408+0000","last_unstale":"2023-10-25T16:23:19.196025+0000","last_undegraded":"2023-10-25T16:23:19.196025+0000","last_fullsized":"2023-10-25T16:23:19.196025+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:32:13.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183344+0000","last_change":"2023-10-25T16:23:19.180964+0000","last_active":"2023-10-25T16:23:19.183344+0000","last_peered":"2023-10-25T16:23:19.183344+0000","last_clean":"2023-10-25T16:23:19.183344+0000","last_became_active":"2023-10-25T16:23:19.180431+0000","last_became_peered":"2023-10-25T16:23:19.180431+0000","last_unstale":"2023-10-25T16:23:19.183344+0000","last_undegraded":"2023-10-25T16:23:19.183344+0000","last_fullsized":"2023-10-25T16:23:19.183344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:16:41.765358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190297+0000","last_change":"2023-10-25T16:23:19.190014+0000","last_active":"2023-10-25T16:23:19.190297+0000","last_peered":"2023-10-25T16:23:19.190297+0000","last_clean":"2023-10-25T16:23:19.190297+0000","last_became_active":"2023-10-25T16:23:19.189493+0000","last_became_peered":"2023-10-25T16:23:19.189493+0000","last_unstale":"2023-10-25T16:23:19.190297+0000","last_undegraded":"2023-10-25T16:23:19.190297+0000","last_fullsized":"2023-10-25T16:23:19.190297+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:02.385681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175484+0000","last_change":"2023-10-25T16:23:19.204631+0000","last_active":"2023-10-25T16:23:20.175484+0000","last_peered":"2023-10-25T16:23:20.175484+0000","last_clean":"2023-10-25T16:23:20.175484+0000","last_became_active":"2023-10-25T16:23:19.204213+0000","last_became_peered":"2023-10-25T16:23:19.204213+0000","last_unstale":"2023-10-25T16:23:20.175484+0000","last_undegraded":"2023-10-25T16:23:20.175484+0000","last_fullsized":"2023-10-25T16:23:20.175484+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:07.665323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179509+0000","last_change":"2023-10-25T16:23:19.179324+0000","last_active":"2023-10-25T16:23:19.179509+0000","last_peered":"2023-10-25T16:23:19.179509+0000","last_clean":"2023-10-25T16:23:19.179509+0000","last_became_active":"2023-10-25T16:23:19.179112+0000","last_became_peered":"2023-10-25T16:23:19.179112+0000","last_unstale":"2023-10-25T16:23:19.179509+0000","last_undegraded":"2023-10-25T16:23:19.179509+0000","last_fullsized":"2023-10-25T16:23:19.179509+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193837+0000","last_change":"2023-10-25T16:23:19.193768+0000","last_active":"2023-10-25T16:23:19.193837+0000","last_peered":"2023-10-25T16:23:19.193837+0000","last_clean":"2023-10-25T16:23:19.193837+0000","last_became_active":"2023-10-25T16:23:19.192700+0000","last_became_peered":"2023-10-25T16:23:19.192700+0000","last_unstale":"2023-10-25T16:23:19.193837+0000","last_undegraded":"2023-10-25T16:23:19.193837+0000","last_fullsized":"2023-10-25T16:23:19.193837+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:39.792430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192238+0000","last_change":"2023-10-25T16:23:19.191525+0000","last_active":"2023-10-25T16:23:19.192238+0000","last_peered":"2023-10-25T16:23:19.192238+0000","last_clean":"2023-10-25T16:23:19.192238+0000","last_became_active":"2023-10-25T16:23:19.191250+0000","last_became_peered":"2023-10-25T16:23:19.191250+0000","last_unstale":"2023-10-25T16:23:19.192238+0000","last_undegraded":"2023-10-25T16:23:19.192238+0000","last_fullsized":"2023-10-25T16:23:19.192238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:37:41.183771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175855+0000","last_change":"2023-10-25T16:23:19.198559+0000","last_active":"2023-10-25T16:23:20.175855+0000","last_peered":"2023-10-25T16:23:20.175855+0000","last_clean":"2023-10-25T16:23:20.175855+0000","last_became_active":"2023-10-25T16:23:19.198168+0000","last_became_peered":"2023-10-25T16:23:19.198168+0000","last_unstale":"2023-10-25T16:23:20.175855+0000","last_undegraded":"2023-10-25T16:23:20.175855+0000","last_fullsized":"2023-10-25T16:23:20.175855+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:39:12.799419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179216+0000","last_change":"2023-10-25T16:23:19.179127+0000","last_active":"2023-10-25T16:23:19.179216+0000","last_peered":"2023-10-25T16:23:19.179216+0000","last_clean":"2023-10-25T16:23:19.179216+0000","last_became_active":"2023-10-25T16:23:19.178779+0000","last_became_peered":"2023-10-25T16:23:19.178779+0000","last_unstale":"2023-10-25T16:23:19.179216+0000","last_undegraded":"2023-10-25T16:23:19.179216+0000","last_fullsized":"2023-10-25T16:23:19.179216+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183287+0000","last_change":"2023-10-25T16:23:19.178582+0000","last_active":"2023-10-25T16:23:19.183287+0000","last_peered":"2023-10-25T16:23:19.183287+0000","last_clean":"2023-10-25T16:23:19.183287+0000","last_became_active":"2023-10-25T16:23:19.178119+0000","last_became_peered":"2023-10-25T16:23:19.178119+0000","last_unstale":"2023-10-25T16:23:19.183287+0000","last_undegraded":"2023-10-25T16:23:19.183287+0000","last_fullsized":"2023-10-25T16:23:19.183287+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:09.196519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185634+0000","last_change":"2023-10-25T16:23:19.185562+0000","last_active":"2023-10-25T16:23:19.185634+0000","last_peered":"2023-10-25T16:23:19.185634+0000","last_clean":"2023-10-25T16:23:19.185634+0000","last_became_active":"2023-10-25T16:23:19.184794+0000","last_became_peered":"2023-10-25T16:23:19.184794+0000","last_unstale":"2023-10-25T16:23:19.185634+0000","last_undegraded":"2023-10-25T16:23:19.185634+0000","last_fullsized":"2023-10-25T16:23:19.185634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:51.312017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184140+0000","last_change":"2023-10-25T16:23:19.184065+0000","last_active":"2023-10-25T16:23:19.184140+0000","last_peered":"2023-10-25T16:23:19.184140+0000","last_clean":"2023-10-25T16:23:19.184140+0000","last_became_active":"2023-10-25T16:23:19.183837+0000","last_became_peered":"2023-10-25T16:23:19.183837+0000","last_unstale":"2023-10-25T16:23:19.184140+0000","last_undegraded":"2023-10-25T16:23:19.184140+0000","last_fullsized":"2023-10-25T16:23:19.184140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:25.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176071+0000","last_change":"2023-10-25T16:23:19.198694+0000","last_active":"2023-10-25T16:23:20.176071+0000","last_peered":"2023-10-25T16:23:20.176071+0000","last_clean":"2023-10-25T16:23:20.176071+0000","last_became_active":"2023-10-25T16:23:19.198403+0000","last_became_peered":"2023-10-25T16:23:19.198403+0000","last_unstale":"2023-10-25T16:23:20.176071+0000","last_undegraded":"2023-10-25T16:23:20.176071+0000","last_fullsized":"2023-10-25T16:23:20.176071+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:19.278715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204289+0000","last_change":"2023-10-25T16:23:19.204123+0000","last_active":"2023-10-25T16:23:19.204289+0000","last_peered":"2023-10-25T16:23:19.204289+0000","last_clean":"2023-10-25T16:23:19.204289+0000","last_became_active":"2023-10-25T16:23:19.199324+0000","last_became_peered":"2023-10-25T16:23:19.199324+0000","last_unstale":"2023-10-25T16:23:19.204289+0000","last_undegraded":"2023-10-25T16:23:19.204289+0000","last_fullsized":"2023-10-25T16:23:19.204289+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:57.289392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175784+0000","last_change":"2023-10-25T16:23:19.204278+0000","last_active":"2023-10-25T16:23:20.175784+0000","last_peered":"2023-10-25T16:23:20.175784+0000","last_clean":"2023-10-25T16:23:20.175784+0000","last_became_active":"2023-10-25T16:23:19.202231+0000","last_became_peered":"2023-10-25T16:23:19.202231+0000","last_unstale":"2023-10-25T16:23:20.175784+0000","last_undegraded":"2023-10-25T16:23:20.175784+0000","last_fullsized":"2023-10-25T16:23:20.175784+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:49:14.960973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.189186+0000","last_change":"2023-10-25T16:23:19.186729+0000","last_active":"2023-10-25T16:23:19.189186+0000","last_peered":"2023-10-25T16:23:19.189186+0000","last_clean":"2023-10-25T16:23:19.189186+0000","last_became_active":"2023-10-25T16:23:19.186354+0000","last_became_peered":"2023-10-25T16:23:19.186354+0000","last_unstale":"2023-10-25T16:23:19.189186+0000","last_undegraded":"2023-10-25T16:23:19.189186+0000","last_fullsized":"2023-10-25T16:23:19.189186+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190522+0000","last_change":"2023-10-25T16:23:19.190180+0000","last_active":"2023-10-25T16:23:19.190522+0000","last_peered":"2023-10-25T16:23:19.190522+0000","last_clean":"2023-10-25T16:23:19.190522+0000","last_became_active":"2023-10-25T16:23:19.189509+0000","last_became_peered":"2023-10-25T16:23:19.189509+0000","last_unstale":"2023-10-25T16:23:19.190522+0000","last_undegraded":"2023-10-25T16:23:19.190522+0000","last_fullsized":"2023-10-25T16:23:19.190522+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:56:08.244234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184942+0000","last_change":"2023-10-25T16:23:19.184422+0000","last_active":"2023-10-25T16:23:19.184942+0000","last_peered":"2023-10-25T16:23:19.184942+0000","last_clean":"2023-10-25T16:23:19.184942+0000","last_became_active":"2023-10-25T16:23:19.183889+0000","last_became_peered":"2023-10-25T16:23:19.183889+0000","last_unstale":"2023-10-25T16:23:19.184942+0000","last_undegraded":"2023-10-25T16:23:19.184942+0000","last_fullsized":"2023-10-25T16:23:19.184942+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:53:37.207613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196081+0000","last_change":"2023-10-25T16:23:19.195947+0000","last_active":"2023-10-25T16:23:19.196081+0000","last_peered":"2023-10-25T16:23:19.196081+0000","last_clean":"2023-10-25T16:23:19.196081+0000","last_became_active":"2023-10-25T16:23:19.195349+0000","last_became_peered":"2023-10-25T16:23:19.195349+0000","last_unstale":"2023-10-25T16:23:19.196081+0000","last_undegraded":"2023-10-25T16:23:19.196081+0000","last_fullsized":"2023-10-25T16:23:19.196081+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:22.043144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176088+0000","last_change":"2023-10-25T16:23:19.204749+0000","last_active":"2023-10-25T16:23:20.176088+0000","last_peered":"2023-10-25T16:23:20.176088+0000","last_clean":"2023-10-25T16:23:20.176088+0000","last_became_active":"2023-10-25T16:23:19.203237+0000","last_became_peered":"2023-10-25T16:23:19.203237+0000","last_unstale":"2023-10-25T16:23:20.176088+0000","last_undegraded":"2023-10-25T16:23:20.176088+0000","last_fullsized":"2023-10-25T16:23:20.176088+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:41.659857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194059+0000","last_change":"2023-10-25T16:23:19.193900+0000","last_active":"2023-10-25T16:23:19.194059+0000","last_peered":"2023-10-25T16:23:19.194059+0000","last_clean":"2023-10-25T16:23:19.194059+0000","last_became_active":"2023-10-25T16:23:19.193551+0000","last_became_peered":"2023-10-25T16:23:19.193551+0000","last_unstale":"2023-10-25T16:23:19.194059+0000","last_undegraded":"2023-10-25T16:23:19.194059+0000","last_fullsized":"2023-10-25T16:23:19.194059+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:47:44.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"173'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185551+0000","last_change":"2023-10-25T16:23:18.159556+0000","last_active":"2023-10-25T16:23:19.185551+0000","last_peered":"2023-10-25T16:23:19.185551+0000","last_clean":"2023-10-25T16:23:19.185551+0000","last_became_active":"2023-10-25T16:23:18.158349+0000","last_became_peered":"2023-10-25T16:23:18.158349+0000","last_unstale":"2023-10-25T16:23:19.185551+0000","last_undegraded":"2023-10-25T16:23:19.185551+0000","last_fullsized":"2023-10-25T16:23:19.185551+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182590+0000","last_change":"2023-10-25T16:23:19.182477+0000","last_active":"2023-10-25T16:23:19.182590+0000","last_peered":"2023-10-25T16:23:19.182590+0000","last_clean":"2023-10-25T16:23:19.182590+0000","last_became_active":"2023-10-25T16:23:19.182166+0000","last_became_peered":"2023-10-25T16:23:19.182166+0000","last_unstale":"2023-10-25T16:23:19.182590+0000","last_undegraded":"2023-10-25T16:23:19.182590+0000","last_fullsized":"2023-10-25T16:23:19.182590+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:43:46.901069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186987+0000","last_change":"2023-10-25T16:23:18.167802+0000","last_active":"2023-10-25T16:23:19.186987+0000","last_peered":"2023-10-25T16:23:19.186987+0000","last_clean":"2023-10-25T16:23:19.186987+0000","last_became_active":"2023-10-25T16:23:18.167507+0000","last_became_peered":"2023-10-25T16:23:18.167507+0000","last_unstale":"2023-10-25T16:23:19.186987+0000","last_undegraded":"2023-10-25T16:23:19.186987+0000","last_fullsized":"2023-10-25T16:23:19.186987+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:24.539701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182953+0000","last_change":"2023-10-25T16:23:19.182770+0000","last_active":"2023-10-25T16:23:19.182953+0000","last_peered":"2023-10-25T16:23:19.182953+0000","last_clean":"2023-10-25T16:23:19.182953+0000","last_became_active":"2023-10-25T16:23:19.182217+0000","last_became_peered":"2023-10-25T16:23:19.182217+0000","last_unstale":"2023-10-25T16:23:19.182953+0000","last_undegraded":"2023-10-25T16:23:19.182953+0000","last_fullsized":"2023-10-25T16:23:19.182953+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:56.039708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191466+0000","last_change":"2023-10-25T16:23:18.169529+0000","last_active":"2023-10-25T16:23:19.191466+0000","last_peered":"2023-10-25T16:23:19.191466+0000","last_clean":"2023-10-25T16:23:19.191466+0000","last_became_active":"2023-10-25T16:23:18.162217+0000","last_became_peered":"2023-10-25T16:23:18.162217+0000","last_unstale":"2023-10-25T16:23:19.191466+0000","last_undegraded":"2023-10-25T16:23:19.191466+0000","last_fullsized":"2023-10-25T16:23:19.191466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:41:25.784664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193525+0000","last_change":"2023-10-25T16:23:19.193435+0000","last_active":"2023-10-25T16:23:19.193525+0000","last_peered":"2023-10-25T16:23:19.193525+0000","last_clean":"2023-10-25T16:23:19.193525+0000","last_became_active":"2023-10-25T16:23:19.193047+0000","last_became_peered":"2023-10-25T16:23:19.193047+0000","last_unstale":"2023-10-25T16:23:19.193525+0000","last_undegraded":"2023-10-25T16:23:19.193525+0000","last_fullsized":"2023-10-25T16:23:19.193525+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198646+0000","last_change":"2023-10-25T16:23:18.159481+0000","last_active":"2023-10-25T16:23:19.198646+0000","last_peered":"2023-10-25T16:23:19.198646+0000","last_clean":"2023-10-25T16:23:19.198646+0000","last_became_active":"2023-10-25T16:23:18.158375+0000","last_became_peered":"2023-10-25T16:23:18.158375+0000","last_unstale":"2023-10-25T16:23:19.198646+0000","last_undegraded":"2023-10-25T16:23:19.198646+0000","last_fullsized":"2023-10-25T16:23:19.198646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:37.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194416+0000","last_change":"2023-10-25T16:23:19.194347+0000","last_active":"2023-10-25T16:23:19.194416+0000","last_peered":"2023-10-25T16:23:19.194416+0000","last_clean":"2023-10-25T16:23:19.194416+0000","last_became_active":"2023-10-25T16:23:19.193313+0000","last_became_peered":"2023-10-25T16:23:19.193313+0000","last_unstale":"2023-10-25T16:23:19.194416+0000","last_undegraded":"2023-10-25T16:23:19.194416+0000","last_fullsized":"2023-10-25T16:23:19.194416+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"173'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176733+0000","last_change":"2023-10-25T16:23:18.164917+0000","last_active":"2023-10-25T16:23:20.176733+0000","last_peered":"2023-10-25T16:23:20.176733+0000","last_clean":"2023-10-25T16:23:20.176733+0000","last_became_active":"2023-10-25T16:23:18.164683+0000","last_became_peered":"2023-10-25T16:23:18.164683+0000","last_unstale":"2023-10-25T16:23:20.176733+0000","last_undegraded":"2023-10-25T16:23:20.176733+0000","last_fullsized":"2023-10-25T16:23:20.176733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:04.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185592+0000","last_change":"2023-10-25T16:23:19.185493+0000","last_active":"2023-10-25T16:23:19.185592+0000","last_peered":"2023-10-25T16:23:19.185592+0000","last_clean":"2023-10-25T16:23:19.185592+0000","last_became_active":"2023-10-25T16:23:19.184661+0000","last_became_peered":"2023-10-25T16:23:19.184661+0000","last_unstale":"2023-10-25T16:23:19.185592+0000","last_undegraded":"2023-10-25T16:23:19.185592+0000","last_fullsized":"2023-10-25T16:23:19.185592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:41.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195019+0000","last_change":"2023-10-25T16:23:18.158454+0000","last_active":"2023-10-25T16:23:19.195019+0000","last_peered":"2023-10-25T16:23:19.195019+0000","last_clean":"2023-10-25T16:23:19.195019+0000","last_became_active":"2023-10-25T16:23:18.157852+0000","last_became_peered":"2023-10-25T16:23:18.157852+0000","last_unstale":"2023-10-25T16:23:19.195019+0000","last_undegraded":"2023-10-25T16:23:19.195019+0000","last_fullsized":"2023-10-25T16:23:19.195019+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:17.308462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199538+0000","last_change":"2023-10-25T16:23:19.199453+0000","last_active":"2023-10-25T16:23:19.199538+0000","last_peered":"2023-10-25T16:23:19.199538+0000","last_clean":"2023-10-25T16:23:19.199538+0000","last_became_active":"2023-10-25T16:23:19.197416+0000","last_became_peered":"2023-10-25T16:23:19.197416+0000","last_unstale":"2023-10-25T16:23:19.199538+0000","last_undegraded":"2023-10-25T16:23:19.199538+0000","last_fullsized":"2023-10-25T16:23:19.199538+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:03:05.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175694+0000","last_change":"2023-10-25T16:23:18.155332+0000","last_active":"2023-10-25T16:23:20.175694+0000","last_peered":"2023-10-25T16:23:20.175694+0000","last_clean":"2023-10-25T16:23:20.175694+0000","last_became_active":"2023-10-25T16:23:18.154943+0000","last_became_peered":"2023-10-25T16:23:18.154943+0000","last_unstale":"2023-10-25T16:23:20.175694+0000","last_undegraded":"2023-10-25T16:23:20.175694+0000","last_fullsized":"2023-10-25T16:23:20.175694+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:46.301012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193467+0000","last_change":"2023-10-25T16:23:19.193398+0000","last_active":"2023-10-25T16:23:19.193467+0000","last_peered":"2023-10-25T16:23:19.193467+0000","last_clean":"2023-10-25T16:23:19.193467+0000","last_became_active":"2023-10-25T16:23:19.193144+0000","last_became_peered":"2023-10-25T16:23:19.193144+0000","last_unstale":"2023-10-25T16:23:19.193467+0000","last_undegraded":"2023-10-25T16:23:19.193467+0000","last_fullsized":"2023-10-25T16:23:19.193467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:15.074684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176047+0000","last_change":"2023-10-25T16:23:18.170217+0000","last_active":"2023-10-25T16:23:19.176047+0000","last_peered":"2023-10-25T16:23:19.176047+0000","last_clean":"2023-10-25T16:23:19.176047+0000","last_became_active":"2023-10-25T16:23:18.164022+0000","last_became_peered":"2023-10-25T16:23:18.164022+0000","last_unstale":"2023-10-25T16:23:19.176047+0000","last_undegraded":"2023-10-25T16:23:19.176047+0000","last_fullsized":"2023-10-25T16:23:19.176047+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:38.919815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.202140+0000","last_change":"2023-10-25T16:23:19.202046+0000","last_active":"2023-10-25T16:23:19.202140+0000","last_peered":"2023-10-25T16:23:19.202140+0000","last_clean":"2023-10-25T16:23:19.202140+0000","last_became_active":"2023-10-25T16:23:19.201736+0000","last_became_peered":"2023-10-25T16:23:19.201736+0000","last_unstale":"2023-10-25T16:23:19.202140+0000","last_undegraded":"2023-10-25T16:23:19.202140+0000","last_fullsized":"2023-10-25T16:23:19.202140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:11.245553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175388+0000","last_change":"2023-10-25T16:23:18.152106+0000","last_active":"2023-10-25T16:23:19.175388+0000","last_peered":"2023-10-25T16:23:19.175388+0000","last_clean":"2023-10-25T16:23:19.175388+0000","last_became_active":"2023-10-25T16:23:18.151874+0000","last_became_peered":"2023-10-25T16:23:18.151874+0000","last_unstale":"2023-10-25T16:23:19.175388+0000","last_undegraded":"2023-10-25T16:23:19.175388+0000","last_fullsized":"2023-10-25T16:23:19.175388+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:25.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174870+0000","last_change":"2023-10-25T16:23:19.174784+0000","last_active":"2023-10-25T16:23:19.174870+0000","last_peered":"2023-10-25T16:23:19.174870+0000","last_clean":"2023-10-25T16:23:19.174870+0000","last_became_active":"2023-10-25T16:23:19.174430+0000","last_became_peered":"2023-10-25T16:23:19.174430+0000","last_unstale":"2023-10-25T16:23:19.174870+0000","last_undegraded":"2023-10-25T16:23:19.174870+0000","last_fullsized":"2023-10-25T16:23:19.174870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:54.951159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177883+0000","last_change":"2023-10-25T16:23:18.173400+0000","last_active":"2023-10-25T16:23:19.177883+0000","last_peered":"2023-10-25T16:23:19.177883+0000","last_clean":"2023-10-25T16:23:19.177883+0000","last_became_active":"2023-10-25T16:23:18.172310+0000","last_became_peered":"2023-10-25T16:23:18.172310+0000","last_unstale":"2023-10-25T16:23:19.177883+0000","last_undegraded":"2023-10-25T16:23:19.177883+0000","last_fullsized":"2023-10-25T16:23:19.177883+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:40.956111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175362+0000","last_change":"2023-10-25T16:23:19.200629+0000","last_active":"2023-10-25T16:23:20.175362+0000","last_peered":"2023-10-25T16:23:20.175362+0000","last_clean":"2023-10-25T16:23:20.175362+0000","last_became_active":"2023-10-25T16:23:19.200282+0000","last_became_peered":"2023-10-25T16:23:19.200282+0000","last_unstale":"2023-10-25T16:23:20.175362+0000","last_undegraded":"2023-10-25T16:23:20.175362+0000","last_fullsized":"2023-10-25T16:23:20.175362+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:04.959467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"173'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.207997+0000","last_change":"2023-10-25T16:23:18.154423+0000","last_active":"2023-10-25T16:23:19.207997+0000","last_peered":"2023-10-25T16:23:19.207997+0000","last_clean":"2023-10-25T16:23:19.207997+0000","last_became_active":"2023-10-25T16:23:18.154185+0000","last_became_peered":"2023-10-25T16:23:18.154185+0000","last_unstale":"2023-10-25T16:23:19.207997+0000","last_undegraded":"2023-10-25T16:23:19.207997+0000","last_fullsized":"2023-10-25T16:23:19.207997+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:32.778729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190263+0000","last_change":"2023-10-25T16:23:19.188225+0000","last_active":"2023-10-25T16:23:19.190263+0000","last_peered":"2023-10-25T16:23:19.190263+0000","last_clean":"2023-10-25T16:23:19.190263+0000","last_became_active":"2023-10-25T16:23:19.187882+0000","last_became_peered":"2023-10-25T16:23:19.187882+0000","last_unstale":"2023-10-25T16:23:19.190263+0000","last_undegraded":"2023-10-25T16:23:19.190263+0000","last_fullsized":"2023-10-25T16:23:19.190263+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:16.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190158+0000","last_change":"2023-10-25T16:23:18.161583+0000","last_active":"2023-10-25T16:23:19.190158+0000","last_peered":"2023-10-25T16:23:19.190158+0000","last_clean":"2023-10-25T16:23:19.190158+0000","last_became_active":"2023-10-25T16:23:18.160916+0000","last_became_peered":"2023-10-25T16:23:18.160916+0000","last_unstale":"2023-10-25T16:23:19.190158+0000","last_undegraded":"2023-10-25T16:23:19.190158+0000","last_fullsized":"2023-10-25T16:23:19.190158+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:03.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178373+0000","last_change":"2023-10-25T16:23:19.178044+0000","last_active":"2023-10-25T16:23:19.178373+0000","last_peered":"2023-10-25T16:23:19.178373+0000","last_clean":"2023-10-25T16:23:19.178373+0000","last_became_active":"2023-10-25T16:23:19.177776+0000","last_became_peered":"2023-10-25T16:23:19.177776+0000","last_unstale":"2023-10-25T16:23:19.178373+0000","last_undegraded":"2023-10-25T16:23:19.178373+0000","last_fullsized":"2023-10-25T16:23:19.178373+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:23.165764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187417+0000","last_change":"2023-10-25T16:23:18.166804+0000","last_active":"2023-10-25T16:23:19.187417+0000","last_peered":"2023-10-25T16:23:19.187417+0000","last_clean":"2023-10-25T16:23:19.187417+0000","last_became_active":"2023-10-25T16:23:18.166187+0000","last_became_peered":"2023-10-25T16:23:18.166187+0000","last_unstale":"2023-10-25T16:23:19.187417+0000","last_undegraded":"2023-10-25T16:23:19.187417+0000","last_fullsized":"2023-10-25T16:23:19.187417+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:57.177360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196007+0000","last_change":"2023-10-25T16:23:19.195656+0000","last_active":"2023-10-25T16:23:19.196007+0000","last_peered":"2023-10-25T16:23:19.196007+0000","last_clean":"2023-10-25T16:23:19.196007+0000","last_became_active":"2023-10-25T16:23:19.195225+0000","last_became_peered":"2023-10-25T16:23:19.195225+0000","last_unstale":"2023-10-25T16:23:19.196007+0000","last_undegraded":"2023-10-25T16:23:19.196007+0000","last_fullsized":"2023-10-25T16:23:19.196007+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:51.080489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173863+0000","last_change":"2023-10-25T16:23:18.151003+0000","last_active":"2023-10-25T16:23:19.173863+0000","last_peered":"2023-10-25T16:23:19.173863+0000","last_clean":"2023-10-25T16:23:19.173863+0000","last_became_active":"2023-10-25T16:23:18.150677+0000","last_became_peered":"2023-10-25T16:23:18.150677+0000","last_unstale":"2023-10-25T16:23:19.173863+0000","last_undegraded":"2023-10-25T16:23:19.173863+0000","last_fullsized":"2023-10-25T16:23:19.173863+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:19.475448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.197147+0000","last_change":"2023-10-25T16:23:19.197069+0000","last_active":"2023-10-25T16:23:19.197147+0000","last_peered":"2023-10-25T16:23:19.197147+0000","last_clean":"2023-10-25T16:23:19.197147+0000","last_became_active":"2023-10-25T16:23:19.196772+0000","last_became_peered":"2023-10-25T16:23:19.196772+0000","last_unstale":"2023-10-25T16:23:19.197147+0000","last_undegraded":"2023-10-25T16:23:19.197147+0000","last_fullsized":"2023-10-25T16:23:19.197147+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:42.978913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"173'8","reported_seq":20,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175525+0000","last_change":"2023-10-25T16:23:18.172984+0000","last_active":"2023-10-25T16:23:20.175525+0000","last_peered":"2023-10-25T16:23:20.175525+0000","last_clean":"2023-10-25T16:23:20.175525+0000","last_became_active":"2023-10-25T16:23:18.172629+0000","last_became_peered":"2023-10-25T16:23:18.172629+0000","last_unstale":"2023-10-25T16:23:20.175525+0000","last_undegraded":"2023-10-25T16:23:20.175525+0000","last_fullsized":"2023-10-25T16:23:20.175525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:39.639341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178825+0000","last_change":"2023-10-25T16:23:19.178741+0000","last_active":"2023-10-25T16:23:19.178825+0000","last_peered":"2023-10-25T16:23:19.178825+0000","last_clean":"2023-10-25T16:23:19.178825+0000","last_became_active":"2023-10-25T16:23:19.178495+0000","last_became_peered":"2023-10-25T16:23:19.178495+0000","last_unstale":"2023-10-25T16:23:19.178825+0000","last_undegraded":"2023-10-25T16:23:19.178825+0000","last_fullsized":"2023-10-25T16:23:19.178825+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191193+0000","last_change":"2023-10-25T16:23:18.150704+0000","last_active":"2023-10-25T16:23:19.191193+0000","last_peered":"2023-10-25T16:23:19.191193+0000","last_clean":"2023-10-25T16:23:19.191193+0000","last_became_active":"2023-10-25T16:23:18.149026+0000","last_became_peered":"2023-10-25T16:23:18.149026+0000","last_unstale":"2023-10-25T16:23:19.191193+0000","last_undegraded":"2023-10-25T16:23:19.191193+0000","last_fullsized":"2023-10-25T16:23:19.191193+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:52.995037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175504+0000","last_change":"2023-10-25T16:23:19.200275+0000","last_active":"2023-10-25T16:23:20.175504+0000","last_peered":"2023-10-25T16:23:20.175504+0000","last_clean":"2023-10-25T16:23:20.175504+0000","last_became_active":"2023-10-25T16:23:19.198906+0000","last_became_peered":"2023-10-25T16:23:19.198906+0000","last_unstale":"2023-10-25T16:23:20.175504+0000","last_undegraded":"2023-10-25T16:23:20.175504+0000","last_fullsized":"2023-10-25T16:23:20.175504+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:27:52.391980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199223+0000","last_change":"2023-10-25T16:23:18.160357+0000","last_active":"2023-10-25T16:23:19.199223+0000","last_peered":"2023-10-25T16:23:19.199223+0000","last_clean":"2023-10-25T16:23:19.199223+0000","last_became_active":"2023-10-25T16:23:18.160114+0000","last_became_peered":"2023-10-25T16:23:18.160114+0000","last_unstale":"2023-10-25T16:23:19.199223+0000","last_undegraded":"2023-10-25T16:23:19.199223+0000","last_fullsized":"2023-10-25T16:23:19.199223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:22:54.207547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190232+0000","last_change":"2023-10-25T16:23:19.186950+0000","last_active":"2023-10-25T16:23:19.190232+0000","last_peered":"2023-10-25T16:23:19.190232+0000","last_clean":"2023-10-25T16:23:19.190232+0000","last_became_active":"2023-10-25T16:23:19.186538+0000","last_became_peered":"2023-10-25T16:23:19.186538+0000","last_unstale":"2023-10-25T16:23:19.190232+0000","last_undegraded":"2023-10-25T16:23:19.190232+0000","last_fullsized":"2023-10-25T16:23:19.190232+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:06.640286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"173'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175905+0000","last_change":"2023-10-25T16:23:18.159880+0000","last_active":"2023-10-25T16:23:20.175905+0000","last_peered":"2023-10-25T16:23:20.175905+0000","last_clean":"2023-10-25T16:23:20.175905+0000","last_became_active":"2023-10-25T16:23:18.159655+0000","last_became_peered":"2023-10-25T16:23:18.159655+0000","last_unstale":"2023-10-25T16:23:20.175905+0000","last_undegraded":"2023-10-25T16:23:20.175905+0000","last_fullsized":"2023-10-25T16:23:20.175905+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:23:38.130899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.206013+0000","last_change":"2023-10-25T16:23:19.205886+0000","last_active":"2023-10-25T16:23:19.206013+0000","last_peered":"2023-10-25T16:23:19.206013+0000","last_clean":"2023-10-25T16:23:19.206013+0000","last_became_active":"2023-10-25T16:23:19.203366+0000","last_became_peered":"2023-10-25T16:23:19.203366+0000","last_unstale":"2023-10-25T16:23:19.206013+0000","last_undegraded":"2023-10-25T16:23:19.206013+0000","last_fullsized":"2023-10-25T16:23:19.206013+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:24:20.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174344+0000","last_change":"2023-10-25T16:23:18.151835+0000","last_active":"2023-10-25T16:23:19.174344+0000","last_peered":"2023-10-25T16:23:19.174344+0000","last_clean":"2023-10-25T16:23:19.174344+0000","last_became_active":"2023-10-25T16:23:18.151576+0000","last_became_peered":"2023-10-25T16:23:18.151576+0000","last_unstale":"2023-10-25T16:23:19.174344+0000","last_undegraded":"2023-10-25T16:23:19.174344+0000","last_fullsized":"2023-10-25T16:23:19.174344+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:22.254506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183324+0000","last_change":"2023-10-25T16:23:19.180761+0000","last_active":"2023-10-25T16:23:19.183324+0000","last_peered":"2023-10-25T16:23:19.183324+0000","last_clean":"2023-10-25T16:23:19.183324+0000","last_became_active":"2023-10-25T16:23:19.179966+0000","last_became_peered":"2023-10-25T16:23:19.179966+0000","last_unstale":"2023-10-25T16:23:19.183324+0000","last_undegraded":"2023-10-25T16:23:19.183324+0000","last_fullsized":"2023-10-25T16:23:19.183324+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:46.370576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186103+0000","last_change":"2023-10-25T16:23:18.172840+0000","last_active":"2023-10-25T16:23:19.186103+0000","last_peered":"2023-10-25T16:23:19.186103+0000","last_clean":"2023-10-25T16:23:19.186103+0000","last_became_active":"2023-10-25T16:23:18.172410+0000","last_became_peered":"2023-10-25T16:23:18.172410+0000","last_unstale":"2023-10-25T16:23:19.186103+0000","last_undegraded":"2023-10-25T16:23:19.186103+0000","last_fullsized":"2023-10-25T16:23:19.186103+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181485+0000","last_change":"2023-10-25T16:23:19.181417+0000","last_active":"2023-10-25T16:23:19.181485+0000","last_peered":"2023-10-25T16:23:19.181485+0000","last_clean":"2023-10-25T16:23:19.181485+0000","last_became_active":"2023-10-25T16:23:19.181183+0000","last_became_peered":"2023-10-25T16:23:19.181183+0000","last_unstale":"2023-10-25T16:23:19.181485+0000","last_undegraded":"2023-10-25T16:23:19.181485+0000","last_fullsized":"2023-10-25T16:23:19.181485+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:33.754559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.172850+0000","last_change":"2023-10-25T16:23:18.168302+0000","last_active":"2023-10-25T16:23:19.172850+0000","last_peered":"2023-10-25T16:23:19.172850+0000","last_clean":"2023-10-25T16:23:19.172850+0000","last_became_active":"2023-10-25T16:23:18.167104+0000","last_became_peered":"2023-10-25T16:23:18.167104+0000","last_unstale":"2023-10-25T16:23:19.172850+0000","last_undegraded":"2023-10-25T16:23:19.172850+0000","last_fullsized":"2023-10-25T16:23:19.172850+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:14.919507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183360+0000","last_change":"2023-10-25T16:23:19.181928+0000","last_active":"2023-10-25T16:23:19.183360+0000","last_peered":"2023-10-25T16:23:19.183360+0000","last_clean":"2023-10-25T16:23:19.183360+0000","last_became_active":"2023-10-25T16:23:19.181522+0000","last_became_peered":"2023-10-25T16:23:19.181522+0000","last_unstale":"2023-10-25T16:23:19.183360+0000","last_undegraded":"2023-10-25T16:23:19.183360+0000","last_fullsized":"2023-10-25T16:23:19.183360+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:58:58.064499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175066+0000","last_change":"2023-10-25T16:23:18.166147+0000","last_active":"2023-10-25T16:23:19.175066+0000","last_peered":"2023-10-25T16:23:19.175066+0000","last_clean":"2023-10-25T16:23:19.175066+0000","last_became_active":"2023-10-25T16:23:18.165261+0000","last_became_peered":"2023-10-25T16:23:18.165261+0000","last_unstale":"2023-10-25T16:23:19.175066+0000","last_undegraded":"2023-10-25T16:23:19.175066+0000","last_fullsized":"2023-10-25T16:23:19.175066+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:00.551034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181129+0000","last_change":"2023-10-25T16:23:19.180843+0000","last_active":"2023-10-25T16:23:19.181129+0000","last_peered":"2023-10-25T16:23:19.181129+0000","last_clean":"2023-10-25T16:23:19.181129+0000","last_became_active":"2023-10-25T16:23:19.180642+0000","last_became_peered":"2023-10-25T16:23:19.180642+0000","last_unstale":"2023-10-25T16:23:19.181129+0000","last_undegraded":"2023-10-25T16:23:19.181129+0000","last_fullsized":"2023-10-25T16:23:19.181129+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187569+0000","last_change":"2023-10-25T16:23:18.155577+0000","last_active":"2023-10-25T16:23:19.187569+0000","last_peered":"2023-10-25T16:23:19.187569+0000","last_clean":"2023-10-25T16:23:19.187569+0000","last_became_active":"2023-10-25T16:23:18.154738+0000","last_became_peered":"2023-10-25T16:23:18.154738+0000","last_unstale":"2023-10-25T16:23:19.187569+0000","last_undegraded":"2023-10-25T16:23:19.187569+0000","last_fullsized":"2023-10-25T16:23:19.187569+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:19.137605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195579+0000","last_change":"2023-10-25T16:23:19.195535+0000","last_active":"2023-10-25T16:23:19.195579+0000","last_peered":"2023-10-25T16:23:19.195579+0000","last_clean":"2023-10-25T16:23:19.195579+0000","last_became_active":"2023-10-25T16:23:19.194875+0000","last_became_peered":"2023-10-25T16:23:19.194875+0000","last_unstale":"2023-10-25T16:23:19.195579+0000","last_undegraded":"2023-10-25T16:23:19.195579+0000","last_fullsized":"2023-10-25T16:23:19.195579+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:55:46.166735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182724+0000","last_change":"2023-10-25T16:23:18.172760+0000","last_active":"2023-10-25T16:23:19.182724+0000","last_peered":"2023-10-25T16:23:19.182724+0000","last_clean":"2023-10-25T16:23:19.182724+0000","last_became_active":"2023-10-25T16:23:18.170761+0000","last_became_peered":"2023-10-25T16:23:18.170761+0000","last_unstale":"2023-10-25T16:23:19.182724+0000","last_undegraded":"2023-10-25T16:23:19.182724+0000","last_fullsized":"2023-10-25T16:23:19.182724+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:32.740149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190210+0000","last_change":"2023-10-25T16:23:19.186788+0000","last_active":"2023-10-25T16:23:19.190210+0000","last_peered":"2023-10-25T16:23:19.190210+0000","last_clean":"2023-10-25T16:23:19.190210+0000","last_became_active":"2023-10-25T16:23:19.186225+0000","last_became_peered":"2023-10-25T16:23:19.186225+0000","last_unstale":"2023-10-25T16:23:19.190210+0000","last_undegraded":"2023-10-25T16:23:19.190210+0000","last_fullsized":"2023-10-25T16:23:19.190210+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:39.934224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174737+0000","last_change":"2023-10-25T16:23:18.160453+0000","last_active":"2023-10-25T16:23:19.174737+0000","last_peered":"2023-10-25T16:23:19.174737+0000","last_clean":"2023-10-25T16:23:19.174737+0000","last_became_active":"2023-10-25T16:23:18.160242+0000","last_became_peered":"2023-10-25T16:23:18.160242+0000","last_unstale":"2023-10-25T16:23:19.174737+0000","last_undegraded":"2023-10-25T16:23:19.174737+0000","last_fullsized":"2023-10-25T16:23:19.174737+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:30.230996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.188042+0000","last_change":"2023-10-25T16:23:19.187943+0000","last_active":"2023-10-25T16:23:19.188042+0000","last_peered":"2023-10-25T16:23:19.188042+0000","last_clean":"2023-10-25T16:23:19.188042+0000","last_became_active":"2023-10-25T16:23:19.187788+0000","last_became_peered":"2023-10-25T16:23:19.187788+0000","last_unstale":"2023-10-25T16:23:19.188042+0000","last_undegraded":"2023-10-25T16:23:19.188042+0000","last_fullsized":"2023-10-25T16:23:19.188042+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:22:37.089982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173774+0000","last_change":"2023-10-25T16:23:18.154831+0000","last_active":"2023-10-25T16:23:19.173774+0000","last_peered":"2023-10-25T16:23:19.173774+0000","last_clean":"2023-10-25T16:23:19.173774+0000","last_became_active":"2023-10-25T16:23:18.154491+0000","last_became_peered":"2023-10-25T16:23:18.154491+0000","last_unstale":"2023-10-25T16:23:19.173774+0000","last_undegraded":"2023-10-25T16:23:19.173774+0000","last_fullsized":"2023-10-25T16:23:19.173774+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:57.283692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190571+0000","last_change":"2023-10-25T16:23:19.190322+0000","last_active":"2023-10-25T16:23:19.190571+0000","last_peered":"2023-10-25T16:23:19.190571+0000","last_clean":"2023-10-25T16:23:19.190571+0000","last_became_active":"2023-10-25T16:23:19.189841+0000","last_became_peered":"2023-10-25T16:23:19.189841+0000","last_unstale":"2023-10-25T16:23:19.190571+0000","last_undegraded":"2023-10-25T16:23:19.190571+0000","last_fullsized":"2023-10-25T16:23:19.190571+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:40.045282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173739+0000","last_change":"2023-10-25T16:23:18.154686+0000","last_active":"2023-10-25T16:23:19.173739+0000","last_peered":"2023-10-25T16:23:19.173739+0000","last_clean":"2023-10-25T16:23:19.173739+0000","last_became_active":"2023-10-25T16:23:18.154437+0000","last_became_peered":"2023-10-25T16:23:18.154437+0000","last_unstale":"2023-10-25T16:23:19.173739+0000","last_undegraded":"2023-10-25T16:23:19.173739+0000","last_fullsized":"2023-10-25T16:23:19.173739+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:14:28.241432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176387+0000","last_change":"2023-10-25T16:23:19.202744+0000","last_active":"2023-10-25T16:23:20.176387+0000","last_peered":"2023-10-25T16:23:20.176387+0000","last_clean":"2023-10-25T16:23:20.176387+0000","last_became_active":"2023-10-25T16:23:19.198149+0000","last_became_peered":"2023-10-25T16:23:19.198149+0000","last_unstale":"2023-10-25T16:23:20.176387+0000","last_undegraded":"2023-10-25T16:23:20.176387+0000","last_fullsized":"2023-10-25T16:23:20.176387+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:13:10.662623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.170440+0000","last_change":"2023-10-25T16:23:18.162041+0000","last_active":"2023-10-25T16:23:19.170440+0000","last_peered":"2023-10-25T16:23:19.170440+0000","last_clean":"2023-10-25T16:23:19.170440+0000","last_became_active":"2023-10-25T16:23:18.161793+0000","last_became_peered":"2023-10-25T16:23:18.161793+0000","last_unstale":"2023-10-25T16:23:19.170440+0000","last_undegraded":"2023-10-25T16:23:19.170440+0000","last_fullsized":"2023-10-25T16:23:19.170440+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:01.371271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192534+0000","last_change":"2023-10-25T16:23:19.192438+0000","last_active":"2023-10-25T16:23:19.192534+0000","last_peered":"2023-10-25T16:23:19.192534+0000","last_clean":"2023-10-25T16:23:19.192534+0000","last_became_active":"2023-10-25T16:23:19.192213+0000","last_became_peered":"2023-10-25T16:23:19.192213+0000","last_unstale":"2023-10-25T16:23:19.192534+0000","last_undegraded":"2023-10-25T16:23:19.192534+0000","last_fullsized":"2023-10-25T16:23:19.192534+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:06.205275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177449+0000","last_change":"2023-10-25T16:23:18.173060+0000","last_active":"2023-10-25T16:23:19.177449+0000","last_peered":"2023-10-25T16:23:19.177449+0000","last_clean":"2023-10-25T16:23:19.177449+0000","last_became_active":"2023-10-25T16:23:18.171579+0000","last_became_peered":"2023-10-25T16:23:18.171579+0000","last_unstale":"2023-10-25T16:23:19.177449+0000","last_undegraded":"2023-10-25T16:23:19.177449+0000","last_fullsized":"2023-10-25T16:23:19.177449+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192391+0000","last_change":"2023-10-25T16:23:19.192244+0000","last_active":"2023-10-25T16:23:19.192391+0000","last_peered":"2023-10-25T16:23:19.192391+0000","last_clean":"2023-10-25T16:23:19.192391+0000","last_became_active":"2023-10-25T16:23:19.191971+0000","last_became_peered":"2023-10-25T16:23:19.191971+0000","last_unstale":"2023-10-25T16:23:19.192391+0000","last_undegraded":"2023-10-25T16:23:19.192391+0000","last_fullsized":"2023-10-25T16:23:19.192391+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:59:12.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182401+0000","last_change":"2023-10-25T16:23:18.169800+0000","last_active":"2023-10-25T16:23:19.182401+0000","last_peered":"2023-10-25T16:23:19.182401+0000","last_clean":"2023-10-25T16:23:19.182401+0000","last_became_active":"2023-10-25T16:23:18.167411+0000","last_became_peered":"2023-10-25T16:23:18.167411+0000","last_unstale":"2023-10-25T16:23:19.182401+0000","last_undegraded":"2023-10-25T16:23:19.182401+0000","last_fullsized":"2023-10-25T16:23:19.182401+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:13:16.298558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198587+0000","last_change":"2023-10-25T16:23:19.198512+0000","last_active":"2023-10-25T16:23:19.198587+0000","last_peered":"2023-10-25T16:23:19.198587+0000","last_clean":"2023-10-25T16:23:19.198587+0000","last_became_active":"2023-10-25T16:23:19.198216+0000","last_became_peered":"2023-10-25T16:23:19.198216+0000","last_unstale":"2023-10-25T16:23:19.198587+0000","last_undegraded":"2023-10-25T16:23:19.198587+0000","last_fullsized":"2023-10-25T16:23:19.198587+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:50:42.583353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176315+0000","last_change":"2023-10-25T16:23:18.167697+0000","last_active":"2023-10-25T16:23:19.176315+0000","last_peered":"2023-10-25T16:23:19.176315+0000","last_clean":"2023-10-25T16:23:19.176315+0000","last_became_active":"2023-10-25T16:23:18.167237+0000","last_became_peered":"2023-10-25T16:23:18.167237+0000","last_unstale":"2023-10-25T16:23:19.176315+0000","last_undegraded":"2023-10-25T16:23:19.176315+0000","last_fullsized":"2023-10-25T16:23:19.176315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191073+0000","last_change":"2023-10-25T16:23:19.191002+0000","last_active":"2023-10-25T16:23:19.191073+0000","last_peered":"2023-10-25T16:23:19.191073+0000","last_clean":"2023-10-25T16:23:19.191073+0000","last_became_active":"2023-10-25T16:23:19.190626+0000","last_became_peered":"2023-10-25T16:23:19.190626+0000","last_unstale":"2023-10-25T16:23:19.191073+0000","last_undegraded":"2023-10-25T16:23:19.191073+0000","last_fullsized":"2023-10-25T16:23:19.191073+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:01.565443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"173'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193332+0000","last_change":"2023-10-25T16:23:18.170261+0000","last_active":"2023-10-25T16:23:19.193332+0000","last_peered":"2023-10-25T16:23:19.193332+0000","last_clean":"2023-10-25T16:23:19.193332+0000","last_became_active":"2023-10-25T16:23:18.168947+0000","last_became_peered":"2023-10-25T16:23:18.168947+0000","last_unstale":"2023-10-25T16:23:19.193332+0000","last_undegraded":"2023-10-25T16:23:19.193332+0000","last_fullsized":"2023-10-25T16:23:19.193332+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:38:37.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-25T16:23:18.162842+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:23:18.162842+0000","last_peered":"2023-10-25T16:23:18.162842+0000","last_clean":"2023-10-25T16:23:18.162842+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:23:18.162842+0000","last_undegraded":"2023-10-25T16:23:18.162842+0000","last_fullsized":"2023-10-25T16:23:18.162842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199017352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.55800000000000005},"min":{"1min":0.315,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67700000000000005,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.98399999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.61799999999999999},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.27000000000000002},"max":{"1min":1.0249999999999999,"5min":1.145,"15min":1.1759999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.91500000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66600000000000004,"15min":0.63100000000000001},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.159,"15min":1.246},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.153,"5min":1.2729999999999999,"15min":1.345},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.96899999999999997,"15min":0.879},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.3029999999999999,"5min":1.45,"15min":1.6120000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.95299999999999996,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.91500000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91200000000000003,"15min":0.87},"min":{"1min":0.64400000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.46,"15min":1.4930000000000001},"last":1.107},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.94799999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.3280000000000001,"5min":1.518,"15min":1.671},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.999,"15min":0.93400000000000005},"min":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.29,"5min":1.3440000000000001,"15min":1.5009999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.008,"5min":0.99199999999999999,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.369,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":1.042}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.03,"15min":0.96299999999999997},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.677},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0229999999999999,"15min":0.98499999999999999},"min":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.95999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193790,"statfs":{"total":200000000,"available":198441741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.35899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.256},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83999999999999997},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.534},"last":0.86899999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.42899999999999999},"max":{"1min":1.4259999999999999,"5min":1.647,"15min":1.647},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70899999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89200000000000002,"15min":0.85699999999999998},"min":{"1min":0.55100000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.234,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1879999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.996,"15min":0.98199999999999998},"min":{"1min":0.78900000000000003,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.3360000000000001,"5min":1.51,"15min":1.51},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0249999999999999,"15min":0.97699999999999998},"min":{"1min":0.69099999999999995,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.3600000000000001,"5min":1.548,"15min":1.548},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.262,"5min":1.478,"15min":1.4910000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.61799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.77400000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2909999999999999,"5min":1.696,"15min":1.7370000000000001},"last":0.63},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.0229999999999999},"min":{"1min":0.67700000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.0169999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.496,"5min":1.643,"15min":1.669},"last":1.099},{"interface":"front","average":{"1min":1.125,"5min":1.1060000000000001,"15min":1.117},"min":{"1min":0.77900000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.54,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.876},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.339,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.877},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.998,"15min":0.92400000000000004},"min":{"1min":0.67700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.2529999999999999,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.242}]},{"osd":1,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.624,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.3080000000000001,"5min":10.667,"15min":10.667},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.046,"15min":0.94499999999999995},"min":{"1min":0.65400000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96299999999999997,"15min":0.91200000000000003},"min":{"1min":0.68500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.242,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0600000000000001,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.609,"5min":10.948,"15min":10.948},"last":0.97299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.72499999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.996},{"interface":"front","average":{"1min":1.127,"5min":1.121,"15min":1.069},"min":{"1min":0.84399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4370000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.139}]},{"osd":4,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.052,"15min":0.98199999999999998},"min":{"1min":0.63,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.381,"5min":11.081,"15min":11.081},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.96999999999999997},"min":{"1min":0.64900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.165,"5min":1.444,"15min":1.444},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98299999999999998,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3069999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.087,"5min":1.1100000000000001,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.734,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.022}]},{"osd":7,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.244,"15min":1.1339999999999999},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.6140000000000001,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.179},{"interface":"front","average":{"1min":1.181,"5min":1.151,"15min":1.079},"min":{"1min":0.82399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.1970000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.052}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":1.1279999999999999},"min":{"1min":0.66700000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.224,"5min":2.1429999999999998,"15min":14.843},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":1.1819999999999999},"min":{"1min":0.58699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.111,"5min":2.8450000000000002,"15min":16.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":1.1739999999999999},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.423,"15min":14.630000000000001},"last":1.048},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92700000000000005,"15min":0.89700000000000002},"min":{"1min":0.69599999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2430000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0249999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.95099999999999996},"min":{"1min":0.627,"5min":0.5,"15min":0.5},"max":{"1min":1.22,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.76500000000000001,"5min":0.53800000000000003,"15min":0.48499999999999999},"max":{"1min":1.248,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.97199999999999998,"15min":0.98399999999999999},"min":{"1min":0.80400000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.179,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.302},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.1160000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.321},"min":{"1min":0.56999999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":15.904},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":1.298},"min":{"1min":0.63600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.0840000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.044,"15min":1.288},"min":{"1min":0.69499999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2689999999999999,"5min":4.5970000000000004,"15min":14.567},"last":0.746},{"interface":"front","average":{"1min":1.133,"5min":1.139,"15min":1.4419999999999999},"min":{"1min":0.81299999999999994,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.421,"5min":2.4079999999999999,"15min":15.089},"last":0.84699999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0209999999999999,"15min":1.395},"min":{"1min":0.748,"5min":0.436,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.171,"15min":1.2190000000000001},"min":{"1min":0.81599999999999995,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3220000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.86899999999999999,"15min":0.82699999999999996},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.252,"5min":1.3,"15min":1.47},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.874,"15min":0.83199999999999996},"min":{"1min":0.65800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.274,"5min":1.278,"15min":1.3029999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.873,"15min":0.84299999999999997},"min":{"1min":0.60599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.288},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98399999999999999,"15min":0.96399999999999997},"min":{"1min":0.65600000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.383,"5min":1.47,"15min":1.4990000000000001},"last":0.876}]},{"osd":2,"last update":"Wed Oct 25 16:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88500000000000001,"15min":0.85299999999999998},"min":{"1min":0.72899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1379999999999999,"5min":1.341,"15min":1.419},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.66100000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.91900000000000004},"min":{"1min":0.752,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3200000000000001,"5min":1.5,"15min":1.5},"last":1.016},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85499999999999998,"15min":0.81499999999999995},"min":{"1min":0.70399999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.518},"last":0.92300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.504,"5min":1.599,"15min":2.6640000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.81299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":1.6379999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.181}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.61799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":2.085},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0660000000000001,"15min":1.071},"min":{"1min":0.77100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.252,"5min":1.625,"15min":1.8149999999999999},"last":1.2250000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.95399999999999996,"15min":0.94999999999999996},"min":{"1min":0.68899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1419999999999999,"15min":1.1240000000000001},"min":{"1min":1.02,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.4359999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.59199999999999997},"min":{"1min":0.35999999999999999,"5min":0.27200000000000002,"15min":0.22},"max":{"1min":1.002,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.222},"max":{"1min":0.95699999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.93000000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.33200000000000002,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":0.86799999999999999,"5min":1.425,"15min":1.425},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.441,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.02}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":1.1220000000000001,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.2330000000000001,"5min":1.25,"15min":1.8260000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.89100000000000001},"min":{"1min":0.60399999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1240000000000001,"5min":1.234,"15min":1.234},"last":1.052},{"interface":"front","average":{"1min":1.018,"5min":1.02,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.56599999999999995,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1699999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.94899999999999995,"15min":0.93000000000000005},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.45400000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.96199999999999997},"min":{"1min":0.63700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2050000000000001,"5min":1.2410000000000001,"15min":1.4830000000000001},"last":1.133}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96099999999999997,"15min":0.92000000000000004},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.456},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.505},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0740000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":0.998},"min":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.504},"max":{"1min":1.2849999999999999,"5min":1.508,"15min":1.5660000000000001},"last":1.208},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0109999999999999,"15min":0.97199999999999998},"min":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.51500000000000001},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.389},"last":1.111}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.48699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.042,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66800000000000004,"15min":0.64700000000000002},"min":{"1min":0.57299999999999995,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0680000000000001,"5min":1.075,"15min":1.1990000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61699999999999999,"15min":0.57899999999999996},"min":{"1min":0.57499999999999996,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.96199999999999997,"5min":1.157,"15min":1.4610000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.57699999999999996,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97399999999999998,"5min":1.2,"15min":1.2},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.61699999999999999,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.89600000000000002,"5min":1.048,"15min":1.1399999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.78100000000000003,"15min":0.75800000000000001},"min":{"1min":0.63600000000000001,"5min":0.34799999999999998,"15min":0.28000000000000003},"max":{"1min":1.1499999999999999,"5min":1.1899999999999999,"15min":1.423},"last":0.88100000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.72899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.089,"5min":1.242,"15min":12.698},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.95099999999999996,"15min":1.0129999999999999},"min":{"1min":0.749,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.2170000000000001,"5min":1.2310000000000001,"15min":12.721},"last":1.075}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.84599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.204,"5min":1.2729999999999999,"15min":1.546},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.88900000000000001},"min":{"1min":0.69999999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.2549999999999999,"15min":2.206},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.98299999999999998,"15min":0.95399999999999996},"min":{"1min":0.84699999999999998,"5min":0.65000000000000002,"15min":0.49099999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4610000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0189999999999999,"15min":1.02},"min":{"1min":0.86899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2090000000000001,"5min":1.397,"15min":1.5980000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.95899999999999996,"15min":0.99399999999999999},"min":{"1min":0.77900000000000003,"5min":0.53200000000000003,"15min":0.52000000000000002},"max":{"1min":1.2589999999999999,"5min":1.3100000000000001,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.097,"5min":1.006,"15min":1.026},"min":{"1min":0.92300000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.321,"5min":1.476,"15min":10.509},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193782,"statfs":{"total":200000000,"available":198433320,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.217},"max":{"1min":0.85699999999999998,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.262,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":0.71599999999999997,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.60199999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.44900000000000001,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.024,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.1899999999999999,"5min":1.296,"15min":3.6579999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.86099999999999999},"min":{"1min":0.66500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.024,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.2210000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94499999999999995,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1499999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1850000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0249999999999999,"15min":0.98899999999999999},"min":{"1min":0.70199999999999996,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.619,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0089999999999999,"15min":0.95499999999999996},"min":{"1min":0.77700000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0309999999999999,"15min":1.1719999999999999},"min":{"1min":0.78600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.054,"15min":1.1899999999999999},"min":{"1min":0.73799999999999999,"5min":0.64900000000000002,"15min":0.59799999999999998},"max":{"1min":1.2290000000000001,"5min":1.4159999999999999,"15min":11.622},"last":0.94699999999999995}]}]}],"pool_statfs":[]}} 2023-10-25T16:23:22.968 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:23:23.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 -- 172.21.15.177:0/976643274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0b2120 msgr2=0x7faa4c0d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 --2- 172.21.15.177:0/976643274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0b2120 0x7faa4c0d1bd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0b3ea0 tx=0x7faa4001c750 comp rx=0 tx=0).stop 2023-10-25T16:23:23.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 -- 172.21.15.177:0/976643274 shutdown_connections 2023-10-25T16:23:23.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 --2- 172.21.15.177:0/976643274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0b2120 0x7faa4c0d1bd0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 --2- 172.21.15.177:0/976643274 >> v2:172.21.15.184:3300/0 conn(0x7faa4c15eba0 0x7faa4c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 -- 172.21.15.177:0/976643274 >> 172.21.15.177:0/976643274 conn(0x7faa4c09a5c0 msgr2=0x7faa4c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:23.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 -- 172.21.15.177:0/976643274 shutdown_connections 2023-10-25T16:23:23.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 -- 172.21.15.177:0/976643274 wait complete. 2023-10-25T16:23:23.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 Processor -- start 2023-10-25T16:23:23.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.132+0000 7faa510dc640 1 -- start start 2023-10-25T16:23:23.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0b2120 0x7faa4c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 0x7faa4c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c15eba0 0x7faa4c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0c9740 con 0x7faa4c0cdb10 2023-10-25T16:23:23.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c152700 con 0x7faa4c15eba0 2023-10-25T16:23:23.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c151130 con 0x7faa4c0b2120 2023-10-25T16:23:23.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 0x7faa4c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:23.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 0x7faa4c159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37040/0 (socket says 172.21.15.177:37040) 2023-10-25T16:23:23.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 -- 172.21.15.177:0/215139528 learned_addr learned my addr 172.21.15.177:0/215139528 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:23.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 -- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0b2120 msgr2=0x7faa4c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0b2120 0x7faa4c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 -- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c15eba0 msgr2=0x7faa4c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c15eba0 0x7faa4c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 -- 172.21.15.177:0/215139528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400094a0 con 0x7faa4c0cdb10 2023-10-25T16:23:23.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4a59c640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 0x7faa4c159d70 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7faa40000c10 tx=0x7faa400a6620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:23.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400b5070 con 0x7faa4c0cdb10 2023-10-25T16:23:23.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faa40004030 con 0x7faa4c0cdb10 2023-10-25T16:23:23.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40004440 con 0x7faa4c0cdb10 2023-10-25T16:23:23.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c152140 con 0x7faa4c0cdb10 2023-10-25T16:23:23.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0c9970 con 0x7faa4c0cdb10 2023-10-25T16:23:23.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c04daf0 con 0x7faa4c0cdb10 2023-10-25T16:23:23.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa40005140 con 0x7faa4c0cdb10 2023-10-25T16:23:23.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa337fe640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa38066470 0x7faa38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa4011e030 con 0x7faa4c0cdb10 2023-10-25T16:23:23.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.136+0000 7faa4ad9d640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa38066470 0x7faa38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:23.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.140+0000 7faa4ad9d640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa38066470 0x7faa38068930 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00a910 tx=0x7faa3c005be0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:23.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.140+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa400eb4b0 con 0x7faa4c0cdb10 2023-10-25T16:23:23.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.340+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faa4c0ce930 con 0x7faa4c0cdb10 2023-10-25T16:23:23.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.340+0000 7faa337fe640 1 -- 172.21.15.177:0/215139528 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1088 (secure 0 0 0) 0x7faa400eead0 con 0x7faa4c0cdb10 2023-10-25T16:23:23.339 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:23.339 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":634,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":174,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"unknown","count":12}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592708,"bytes_used":8941268,"bytes_avail":1591058732,"bytes_total":1600000000,"unknown_pgs_ratio":0.12371134012937546,"write_bytes_sec":3326,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":65,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"d","status":"up:active","gid":156116}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-10-25T16:22:02.795870+0000","services":{}},"progress_events":{}} 2023-10-25T16:23:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa38066470 msgr2=0x7faa38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa38066470 0x7faa38068930 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00a910 tx=0x7faa3c005be0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 msgr2=0x7faa4c159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 0x7faa4c159d70 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7faa40000c10 tx=0x7faa400a6620 comp rx=0 tx=0).stop 2023-10-25T16:23:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 shutdown_connections 2023-10-25T16:23:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa38066470 0x7faa38068930 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa4c15eba0 0x7faa4c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa4c0cdb10 0x7faa4c159d70 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 --2- 172.21.15.177:0/215139528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa4c0b2120 0x7faa4c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 >> 172.21.15.177:0/215139528 conn(0x7faa4c09a5c0 msgr2=0x7faa4c072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 shutdown_connections 2023-10-25T16:23:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.344+0000 7faa510dc640 1 -- 172.21.15.177:0/215139528 wait complete. 2023-10-25T16:23:23.356 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:23:23.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:23:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.472+0000 7f1340b6f640 1 -- 172.21.15.177:0/72503027 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0a5de0 con 0x7f133c0cbfa0 2023-10-25T16:23:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/72503027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 msgr2=0x7f133c06b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 --2- 172.21.15.177:0/72503027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 0x7f133c06b9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f132c0098f0 tx=0x7f132c01c8c0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/72503027 shutdown_connections 2023-10-25T16:23:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 --2- 172.21.15.177:0/72503027 >> v2:172.21.15.184:3300/0 conn(0x7f133c0aebc0 0x7f133c0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 --2- 172.21.15.177:0/72503027 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 0x7f133c06b9c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/72503027 >> 172.21.15.177:0/72503027 conn(0x7f133c0b2450 msgr2=0x7f133c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/72503027 shutdown_connections 2023-10-25T16:23:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/72503027 wait complete. 2023-10-25T16:23:23.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 Processor -- start 2023-10-25T16:23:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- start start 2023-10-25T16:23:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 0x7f133c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 0x7f133c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c14e810 0x7f133c1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c14a330 con 0x7f133c0aebc0 2023-10-25T16:23:23.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0b0030 con 0x7f133c14e810 2023-10-25T16:23:23.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c14a5a0 con 0x7f133c0cbfa0 2023-10-25T16:23:23.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 0x7f133c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:23.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 0x7f133c1491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37048/0 (socket says 172.21.15.177:37048) 2023-10-25T16:23:23.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 -- 172.21.15.177:0/4263859478 learned_addr learned my addr 172.21.15.177:0/4263859478 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:23.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341370640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 0x7f133c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:23.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1342372640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c14e810 0x7f133c1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 -- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 msgr2=0x7f133c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 0x7f133c0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 -- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c14e810 msgr2=0x7f133c1455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c14e810 0x7f133c1455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 -- 172.21.15.177:0/4263859478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009500 con 0x7f133c0aebc0 2023-10-25T16:23:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1341b71640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 0x7f133c1491d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f133800c370 tx=0x7f133800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380052d0 con 0x7f133c0aebc0 2023-10-25T16:23:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c14aa30 con 0x7f133c0aebc0 2023-10-25T16:23:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1338007020 con 0x7f133c0aebc0 2023-10-25T16:23:23.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338007430 con 0x7f133c0aebc0 2023-10-25T16:23:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c071410 con 0x7f133c0aebc0 2023-10-25T16:23:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.476+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c04daf0 con 0x7f133c0aebc0 2023-10-25T16:23:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.480+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f13380067e0 con 0x7f133c0aebc0 2023-10-25T16:23:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.480+0000 7f13327fc640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1320066470 0x7f1320068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:23.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.480+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13380832e0 con 0x7f133c0aebc0 2023-10-25T16:23:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.480+0000 7f1341370640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1320066470 0x7f1320068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.480+0000 7f1341370640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1320066470 0x7f1320068930 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f132c0af000 tx=0x7f132c01b100 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:23.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.484+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1338050770 con 0x7f133c0aebc0 2023-10-25T16:23:23.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.624+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f133c0af550 con 0x7f1320066470 2023-10-25T16:23:23.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.644+0000 7f13327fc640 1 -- 172.21.15.177:0/4263859478 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283753 (secure 0 0 0) 0x7f133c0af550 con 0x7f1320066470 2023-10-25T16:23:23.645 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:23.647 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:23:23.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1320066470 msgr2=0x7f1320068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1320066470 0x7f1320068930 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f132c0af000 tx=0x7f132c01b100 comp rx=0 tx=0).stop 2023-10-25T16:23:23.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 msgr2=0x7f133c1491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:23.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 0x7f133c1491d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f133800c370 tx=0x7f133800c830 comp rx=0 tx=0).stop 2023-10-25T16:23:23.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 shutdown_connections 2023-10-25T16:23:23.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1320066470 0x7f1320068930 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c14e810 0x7f133c1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f133c0cbfa0 0x7f133c0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 --2- 172.21.15.177:0/4263859478 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f133c0aebc0 0x7f133c1491d0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:23.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 >> 172.21.15.177:0/4263859478 conn(0x7f133c0b2450 msgr2=0x7f133c14d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:23.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 shutdown_connections 2023-10-25T16:23:23.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:23.648+0000 7f1343dd5640 1 -- 172.21.15.177:0/4263859478 wait complete. 2023-10-25T16:23:23.662 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2023-10-25T16:23:22.824497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8757,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553742,"statfs":{"total":1600000000,"available":1591031883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.691376"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179492+0000","last_change":"2023-10-25T16:23:19.179248+0000","last_active":"2023-10-25T16:23:19.179492+0000","last_peered":"2023-10-25T16:23:19.179492+0000","last_clean":"2023-10-25T16:23:19.179492+0000","last_became_active":"2023-10-25T16:23:19.179003+0000","last_became_peered":"2023-10-25T16:23:19.179003+0000","last_unstale":"2023-10-25T16:23:19.179492+0000","last_undegraded":"2023-10-25T16:23:19.179492+0000","last_fullsized":"2023-10-25T16:23:19.179492+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:00:58.596626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180343+0000","last_change":"2023-10-25T16:23:19.180275+0000","last_active":"2023-10-25T16:23:19.180343+0000","last_peered":"2023-10-25T16:23:19.180343+0000","last_clean":"2023-10-25T16:23:19.180343+0000","last_became_active":"2023-10-25T16:23:19.180044+0000","last_became_peered":"2023-10-25T16:23:19.180044+0000","last_unstale":"2023-10-25T16:23:19.180343+0000","last_undegraded":"2023-10-25T16:23:19.180343+0000","last_fullsized":"2023-10-25T16:23:19.180343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:34:40.100162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193667+0000","last_change":"2023-10-25T16:23:19.193592+0000","last_active":"2023-10-25T16:23:19.193667+0000","last_peered":"2023-10-25T16:23:19.193667+0000","last_clean":"2023-10-25T16:23:19.193667+0000","last_became_active":"2023-10-25T16:23:19.192339+0000","last_became_peered":"2023-10-25T16:23:19.192339+0000","last_unstale":"2023-10-25T16:23:19.193667+0000","last_undegraded":"2023-10-25T16:23:19.193667+0000","last_fullsized":"2023-10-25T16:23:19.193667+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:47:49.438562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185930+0000","last_change":"2023-10-25T16:23:19.185798+0000","last_active":"2023-10-25T16:23:19.185930+0000","last_peered":"2023-10-25T16:23:19.185930+0000","last_clean":"2023-10-25T16:23:19.185930+0000","last_became_active":"2023-10-25T16:23:19.184621+0000","last_became_peered":"2023-10-25T16:23:19.184621+0000","last_unstale":"2023-10-25T16:23:19.185930+0000","last_undegraded":"2023-10-25T16:23:19.185930+0000","last_fullsized":"2023-10-25T16:23:19.185930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:19:30.964216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191807+0000","last_change":"2023-10-25T16:23:19.191555+0000","last_active":"2023-10-25T16:23:19.191807+0000","last_peered":"2023-10-25T16:23:19.191807+0000","last_clean":"2023-10-25T16:23:19.191807+0000","last_became_active":"2023-10-25T16:23:19.191159+0000","last_became_peered":"2023-10-25T16:23:19.191159+0000","last_unstale":"2023-10-25T16:23:19.191807+0000","last_undegraded":"2023-10-25T16:23:19.191807+0000","last_fullsized":"2023-10-25T16:23:19.191807+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:12:19.271674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.205515+0000","last_change":"2023-10-25T16:23:19.205378+0000","last_active":"2023-10-25T16:23:19.205515+0000","last_peered":"2023-10-25T16:23:19.205515+0000","last_clean":"2023-10-25T16:23:19.205515+0000","last_became_active":"2023-10-25T16:23:19.202582+0000","last_became_peered":"2023-10-25T16:23:19.202582+0000","last_unstale":"2023-10-25T16:23:19.205515+0000","last_undegraded":"2023-10-25T16:23:19.205515+0000","last_fullsized":"2023-10-25T16:23:19.205515+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:57.479078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190227+0000","last_change":"2023-10-25T16:23:19.190157+0000","last_active":"2023-10-25T16:23:19.190227+0000","last_peered":"2023-10-25T16:23:19.190227+0000","last_clean":"2023-10-25T16:23:19.190227+0000","last_became_active":"2023-10-25T16:23:19.189923+0000","last_became_peered":"2023-10-25T16:23:19.189923+0000","last_unstale":"2023-10-25T16:23:19.190227+0000","last_undegraded":"2023-10-25T16:23:19.190227+0000","last_fullsized":"2023-10-25T16:23:19.190227+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195713+0000","last_change":"2023-10-25T16:23:19.195649+0000","last_active":"2023-10-25T16:23:19.195713+0000","last_peered":"2023-10-25T16:23:19.195713+0000","last_clean":"2023-10-25T16:23:19.195713+0000","last_became_active":"2023-10-25T16:23:19.195462+0000","last_became_peered":"2023-10-25T16:23:19.195462+0000","last_unstale":"2023-10-25T16:23:19.195713+0000","last_undegraded":"2023-10-25T16:23:19.195713+0000","last_fullsized":"2023-10-25T16:23:19.195713+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:04:05.185753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.180467+0000","last_change":"2023-10-25T16:23:19.180227+0000","last_active":"2023-10-25T16:23:19.180467+0000","last_peered":"2023-10-25T16:23:19.180467+0000","last_clean":"2023-10-25T16:23:19.180467+0000","last_became_active":"2023-10-25T16:23:19.179523+0000","last_became_peered":"2023-10-25T16:23:19.179523+0000","last_unstale":"2023-10-25T16:23:19.180467+0000","last_undegraded":"2023-10-25T16:23:19.180467+0000","last_fullsized":"2023-10-25T16:23:19.180467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:09.212133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185765+0000","last_change":"2023-10-25T16:23:19.185690+0000","last_active":"2023-10-25T16:23:19.185765+0000","last_peered":"2023-10-25T16:23:19.185765+0000","last_clean":"2023-10-25T16:23:19.185765+0000","last_became_active":"2023-10-25T16:23:19.185461+0000","last_became_peered":"2023-10-25T16:23:19.185461+0000","last_unstale":"2023-10-25T16:23:19.185765+0000","last_undegraded":"2023-10-25T16:23:19.185765+0000","last_fullsized":"2023-10-25T16:23:19.185765+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:43.458260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204930+0000","last_change":"2023-10-25T16:23:19.204724+0000","last_active":"2023-10-25T16:23:19.204930+0000","last_peered":"2023-10-25T16:23:19.204930+0000","last_clean":"2023-10-25T16:23:19.204930+0000","last_became_active":"2023-10-25T16:23:19.201797+0000","last_became_peered":"2023-10-25T16:23:19.201797+0000","last_unstale":"2023-10-25T16:23:19.204930+0000","last_undegraded":"2023-10-25T16:23:19.204930+0000","last_fullsized":"2023-10-25T16:23:19.204930+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:24:15.782352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193383+0000","last_change":"2023-10-25T16:23:19.193268+0000","last_active":"2023-10-25T16:23:19.193383+0000","last_peered":"2023-10-25T16:23:19.193383+0000","last_clean":"2023-10-25T16:23:19.193383+0000","last_became_active":"2023-10-25T16:23:19.193016+0000","last_became_peered":"2023-10-25T16:23:19.193016+0000","last_unstale":"2023-10-25T16:23:19.193383+0000","last_undegraded":"2023-10-25T16:23:19.193383+0000","last_fullsized":"2023-10-25T16:23:19.193383+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:33.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196025+0000","last_change":"2023-10-25T16:23:19.195794+0000","last_active":"2023-10-25T16:23:19.196025+0000","last_peered":"2023-10-25T16:23:19.196025+0000","last_clean":"2023-10-25T16:23:19.196025+0000","last_became_active":"2023-10-25T16:23:19.195408+0000","last_became_peered":"2023-10-25T16:23:19.195408+0000","last_unstale":"2023-10-25T16:23:19.196025+0000","last_undegraded":"2023-10-25T16:23:19.196025+0000","last_fullsized":"2023-10-25T16:23:19.196025+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:32:13.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183344+0000","last_change":"2023-10-25T16:23:19.180964+0000","last_active":"2023-10-25T16:23:19.183344+0000","last_peered":"2023-10-25T16:23:19.183344+0000","last_clean":"2023-10-25T16:23:19.183344+0000","last_became_active":"2023-10-25T16:23:19.180431+0000","last_became_peered":"2023-10-25T16:23:19.180431+0000","last_unstale":"2023-10-25T16:23:19.183344+0000","last_undegraded":"2023-10-25T16:23:19.183344+0000","last_fullsized":"2023-10-25T16:23:19.183344+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:16:41.765358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190297+0000","last_change":"2023-10-25T16:23:19.190014+0000","last_active":"2023-10-25T16:23:19.190297+0000","last_peered":"2023-10-25T16:23:19.190297+0000","last_clean":"2023-10-25T16:23:19.190297+0000","last_became_active":"2023-10-25T16:23:19.189493+0000","last_became_peered":"2023-10-25T16:23:19.189493+0000","last_unstale":"2023-10-25T16:23:19.190297+0000","last_undegraded":"2023-10-25T16:23:19.190297+0000","last_fullsized":"2023-10-25T16:23:19.190297+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:02.385681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175484+0000","last_change":"2023-10-25T16:23:19.204631+0000","last_active":"2023-10-25T16:23:20.175484+0000","last_peered":"2023-10-25T16:23:20.175484+0000","last_clean":"2023-10-25T16:23:20.175484+0000","last_became_active":"2023-10-25T16:23:19.204213+0000","last_became_peered":"2023-10-25T16:23:19.204213+0000","last_unstale":"2023-10-25T16:23:20.175484+0000","last_undegraded":"2023-10-25T16:23:20.175484+0000","last_fullsized":"2023-10-25T16:23:20.175484+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:07.665323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179509+0000","last_change":"2023-10-25T16:23:19.179324+0000","last_active":"2023-10-25T16:23:19.179509+0000","last_peered":"2023-10-25T16:23:19.179509+0000","last_clean":"2023-10-25T16:23:19.179509+0000","last_became_active":"2023-10-25T16:23:19.179112+0000","last_became_peered":"2023-10-25T16:23:19.179112+0000","last_unstale":"2023-10-25T16:23:19.179509+0000","last_undegraded":"2023-10-25T16:23:19.179509+0000","last_fullsized":"2023-10-25T16:23:19.179509+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193837+0000","last_change":"2023-10-25T16:23:19.193768+0000","last_active":"2023-10-25T16:23:19.193837+0000","last_peered":"2023-10-25T16:23:19.193837+0000","last_clean":"2023-10-25T16:23:19.193837+0000","last_became_active":"2023-10-25T16:23:19.192700+0000","last_became_peered":"2023-10-25T16:23:19.192700+0000","last_unstale":"2023-10-25T16:23:19.193837+0000","last_undegraded":"2023-10-25T16:23:19.193837+0000","last_fullsized":"2023-10-25T16:23:19.193837+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:39.792430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192238+0000","last_change":"2023-10-25T16:23:19.191525+0000","last_active":"2023-10-25T16:23:19.192238+0000","last_peered":"2023-10-25T16:23:19.192238+0000","last_clean":"2023-10-25T16:23:19.192238+0000","last_became_active":"2023-10-25T16:23:19.191250+0000","last_became_peered":"2023-10-25T16:23:19.191250+0000","last_unstale":"2023-10-25T16:23:19.192238+0000","last_undegraded":"2023-10-25T16:23:19.192238+0000","last_fullsized":"2023-10-25T16:23:19.192238+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:37:41.183771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175855+0000","last_change":"2023-10-25T16:23:19.198559+0000","last_active":"2023-10-25T16:23:20.175855+0000","last_peered":"2023-10-25T16:23:20.175855+0000","last_clean":"2023-10-25T16:23:20.175855+0000","last_became_active":"2023-10-25T16:23:19.198168+0000","last_became_peered":"2023-10-25T16:23:19.198168+0000","last_unstale":"2023-10-25T16:23:20.175855+0000","last_undegraded":"2023-10-25T16:23:20.175855+0000","last_fullsized":"2023-10-25T16:23:20.175855+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:39:12.799419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.179216+0000","last_change":"2023-10-25T16:23:19.179127+0000","last_active":"2023-10-25T16:23:19.179216+0000","last_peered":"2023-10-25T16:23:19.179216+0000","last_clean":"2023-10-25T16:23:19.179216+0000","last_became_active":"2023-10-25T16:23:19.178779+0000","last_became_peered":"2023-10-25T16:23:19.178779+0000","last_unstale":"2023-10-25T16:23:19.179216+0000","last_undegraded":"2023-10-25T16:23:19.179216+0000","last_fullsized":"2023-10-25T16:23:19.179216+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183287+0000","last_change":"2023-10-25T16:23:19.178582+0000","last_active":"2023-10-25T16:23:19.183287+0000","last_peered":"2023-10-25T16:23:19.183287+0000","last_clean":"2023-10-25T16:23:19.183287+0000","last_became_active":"2023-10-25T16:23:19.178119+0000","last_became_peered":"2023-10-25T16:23:19.178119+0000","last_unstale":"2023-10-25T16:23:19.183287+0000","last_undegraded":"2023-10-25T16:23:19.183287+0000","last_fullsized":"2023-10-25T16:23:19.183287+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:09.196519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185634+0000","last_change":"2023-10-25T16:23:19.185562+0000","last_active":"2023-10-25T16:23:19.185634+0000","last_peered":"2023-10-25T16:23:19.185634+0000","last_clean":"2023-10-25T16:23:19.185634+0000","last_became_active":"2023-10-25T16:23:19.184794+0000","last_became_peered":"2023-10-25T16:23:19.184794+0000","last_unstale":"2023-10-25T16:23:19.185634+0000","last_undegraded":"2023-10-25T16:23:19.185634+0000","last_fullsized":"2023-10-25T16:23:19.185634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:28:51.312017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184140+0000","last_change":"2023-10-25T16:23:19.184065+0000","last_active":"2023-10-25T16:23:19.184140+0000","last_peered":"2023-10-25T16:23:19.184140+0000","last_clean":"2023-10-25T16:23:19.184140+0000","last_became_active":"2023-10-25T16:23:19.183837+0000","last_became_peered":"2023-10-25T16:23:19.183837+0000","last_unstale":"2023-10-25T16:23:19.184140+0000","last_undegraded":"2023-10-25T16:23:19.184140+0000","last_fullsized":"2023-10-25T16:23:19.184140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:25.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176071+0000","last_change":"2023-10-25T16:23:19.198694+0000","last_active":"2023-10-25T16:23:20.176071+0000","last_peered":"2023-10-25T16:23:20.176071+0000","last_clean":"2023-10-25T16:23:20.176071+0000","last_became_active":"2023-10-25T16:23:19.198403+0000","last_became_peered":"2023-10-25T16:23:19.198403+0000","last_unstale":"2023-10-25T16:23:20.176071+0000","last_undegraded":"2023-10-25T16:23:20.176071+0000","last_fullsized":"2023-10-25T16:23:20.176071+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:19.278715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.204289+0000","last_change":"2023-10-25T16:23:19.204123+0000","last_active":"2023-10-25T16:23:19.204289+0000","last_peered":"2023-10-25T16:23:19.204289+0000","last_clean":"2023-10-25T16:23:19.204289+0000","last_became_active":"2023-10-25T16:23:19.199324+0000","last_became_peered":"2023-10-25T16:23:19.199324+0000","last_unstale":"2023-10-25T16:23:19.204289+0000","last_undegraded":"2023-10-25T16:23:19.204289+0000","last_fullsized":"2023-10-25T16:23:19.204289+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:57.289392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175784+0000","last_change":"2023-10-25T16:23:19.204278+0000","last_active":"2023-10-25T16:23:20.175784+0000","last_peered":"2023-10-25T16:23:20.175784+0000","last_clean":"2023-10-25T16:23:20.175784+0000","last_became_active":"2023-10-25T16:23:19.202231+0000","last_became_peered":"2023-10-25T16:23:19.202231+0000","last_unstale":"2023-10-25T16:23:20.175784+0000","last_undegraded":"2023-10-25T16:23:20.175784+0000","last_fullsized":"2023-10-25T16:23:20.175784+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:49:14.960973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.189186+0000","last_change":"2023-10-25T16:23:19.186729+0000","last_active":"2023-10-25T16:23:19.189186+0000","last_peered":"2023-10-25T16:23:19.189186+0000","last_clean":"2023-10-25T16:23:19.189186+0000","last_became_active":"2023-10-25T16:23:19.186354+0000","last_became_peered":"2023-10-25T16:23:19.186354+0000","last_unstale":"2023-10-25T16:23:19.189186+0000","last_undegraded":"2023-10-25T16:23:19.189186+0000","last_fullsized":"2023-10-25T16:23:19.189186+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190522+0000","last_change":"2023-10-25T16:23:19.190180+0000","last_active":"2023-10-25T16:23:19.190522+0000","last_peered":"2023-10-25T16:23:19.190522+0000","last_clean":"2023-10-25T16:23:19.190522+0000","last_became_active":"2023-10-25T16:23:19.189509+0000","last_became_peered":"2023-10-25T16:23:19.189509+0000","last_unstale":"2023-10-25T16:23:19.190522+0000","last_undegraded":"2023-10-25T16:23:19.190522+0000","last_fullsized":"2023-10-25T16:23:19.190522+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:56:08.244234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.184942+0000","last_change":"2023-10-25T16:23:19.184422+0000","last_active":"2023-10-25T16:23:19.184942+0000","last_peered":"2023-10-25T16:23:19.184942+0000","last_clean":"2023-10-25T16:23:19.184942+0000","last_became_active":"2023-10-25T16:23:19.183889+0000","last_became_peered":"2023-10-25T16:23:19.183889+0000","last_unstale":"2023-10-25T16:23:19.184942+0000","last_undegraded":"2023-10-25T16:23:19.184942+0000","last_fullsized":"2023-10-25T16:23:19.184942+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:53:37.207613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196081+0000","last_change":"2023-10-25T16:23:19.195947+0000","last_active":"2023-10-25T16:23:19.196081+0000","last_peered":"2023-10-25T16:23:19.196081+0000","last_clean":"2023-10-25T16:23:19.196081+0000","last_became_active":"2023-10-25T16:23:19.195349+0000","last_became_peered":"2023-10-25T16:23:19.195349+0000","last_unstale":"2023-10-25T16:23:19.196081+0000","last_undegraded":"2023-10-25T16:23:19.196081+0000","last_fullsized":"2023-10-25T16:23:19.196081+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:17:22.043144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176088+0000","last_change":"2023-10-25T16:23:19.204749+0000","last_active":"2023-10-25T16:23:20.176088+0000","last_peered":"2023-10-25T16:23:20.176088+0000","last_clean":"2023-10-25T16:23:20.176088+0000","last_became_active":"2023-10-25T16:23:19.203237+0000","last_became_peered":"2023-10-25T16:23:19.203237+0000","last_unstale":"2023-10-25T16:23:20.176088+0000","last_undegraded":"2023-10-25T16:23:20.176088+0000","last_fullsized":"2023-10-25T16:23:20.176088+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:41.659857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194059+0000","last_change":"2023-10-25T16:23:19.193900+0000","last_active":"2023-10-25T16:23:19.194059+0000","last_peered":"2023-10-25T16:23:19.194059+0000","last_clean":"2023-10-25T16:23:19.194059+0000","last_became_active":"2023-10-25T16:23:19.193551+0000","last_became_peered":"2023-10-25T16:23:19.193551+0000","last_unstale":"2023-10-25T16:23:19.194059+0000","last_undegraded":"2023-10-25T16:23:19.194059+0000","last_fullsized":"2023-10-25T16:23:19.194059+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:47:44.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"173'4","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185551+0000","last_change":"2023-10-25T16:23:18.159556+0000","last_active":"2023-10-25T16:23:19.185551+0000","last_peered":"2023-10-25T16:23:19.185551+0000","last_clean":"2023-10-25T16:23:19.185551+0000","last_became_active":"2023-10-25T16:23:18.158349+0000","last_became_peered":"2023-10-25T16:23:18.158349+0000","last_unstale":"2023-10-25T16:23:19.185551+0000","last_undegraded":"2023-10-25T16:23:19.185551+0000","last_fullsized":"2023-10-25T16:23:19.185551+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182590+0000","last_change":"2023-10-25T16:23:19.182477+0000","last_active":"2023-10-25T16:23:19.182590+0000","last_peered":"2023-10-25T16:23:19.182590+0000","last_clean":"2023-10-25T16:23:19.182590+0000","last_became_active":"2023-10-25T16:23:19.182166+0000","last_became_peered":"2023-10-25T16:23:19.182166+0000","last_unstale":"2023-10-25T16:23:19.182590+0000","last_undegraded":"2023-10-25T16:23:19.182590+0000","last_fullsized":"2023-10-25T16:23:19.182590+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:43:46.901069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186987+0000","last_change":"2023-10-25T16:23:18.167802+0000","last_active":"2023-10-25T16:23:19.186987+0000","last_peered":"2023-10-25T16:23:19.186987+0000","last_clean":"2023-10-25T16:23:19.186987+0000","last_became_active":"2023-10-25T16:23:18.167507+0000","last_became_peered":"2023-10-25T16:23:18.167507+0000","last_unstale":"2023-10-25T16:23:19.186987+0000","last_undegraded":"2023-10-25T16:23:19.186987+0000","last_fullsized":"2023-10-25T16:23:19.186987+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:24.539701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182953+0000","last_change":"2023-10-25T16:23:19.182770+0000","last_active":"2023-10-25T16:23:19.182953+0000","last_peered":"2023-10-25T16:23:19.182953+0000","last_clean":"2023-10-25T16:23:19.182953+0000","last_became_active":"2023-10-25T16:23:19.182217+0000","last_became_peered":"2023-10-25T16:23:19.182217+0000","last_unstale":"2023-10-25T16:23:19.182953+0000","last_undegraded":"2023-10-25T16:23:19.182953+0000","last_fullsized":"2023-10-25T16:23:19.182953+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:56.039708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191466+0000","last_change":"2023-10-25T16:23:18.169529+0000","last_active":"2023-10-25T16:23:19.191466+0000","last_peered":"2023-10-25T16:23:19.191466+0000","last_clean":"2023-10-25T16:23:19.191466+0000","last_became_active":"2023-10-25T16:23:18.162217+0000","last_became_peered":"2023-10-25T16:23:18.162217+0000","last_unstale":"2023-10-25T16:23:19.191466+0000","last_undegraded":"2023-10-25T16:23:19.191466+0000","last_fullsized":"2023-10-25T16:23:19.191466+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:41:25.784664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193525+0000","last_change":"2023-10-25T16:23:19.193435+0000","last_active":"2023-10-25T16:23:19.193525+0000","last_peered":"2023-10-25T16:23:19.193525+0000","last_clean":"2023-10-25T16:23:19.193525+0000","last_became_active":"2023-10-25T16:23:19.193047+0000","last_became_peered":"2023-10-25T16:23:19.193047+0000","last_unstale":"2023-10-25T16:23:19.193525+0000","last_undegraded":"2023-10-25T16:23:19.193525+0000","last_fullsized":"2023-10-25T16:23:19.193525+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198646+0000","last_change":"2023-10-25T16:23:18.159481+0000","last_active":"2023-10-25T16:23:19.198646+0000","last_peered":"2023-10-25T16:23:19.198646+0000","last_clean":"2023-10-25T16:23:19.198646+0000","last_became_active":"2023-10-25T16:23:18.158375+0000","last_became_peered":"2023-10-25T16:23:18.158375+0000","last_unstale":"2023-10-25T16:23:19.198646+0000","last_undegraded":"2023-10-25T16:23:19.198646+0000","last_fullsized":"2023-10-25T16:23:19.198646+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:37.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.194416+0000","last_change":"2023-10-25T16:23:19.194347+0000","last_active":"2023-10-25T16:23:19.194416+0000","last_peered":"2023-10-25T16:23:19.194416+0000","last_clean":"2023-10-25T16:23:19.194416+0000","last_became_active":"2023-10-25T16:23:19.193313+0000","last_became_peered":"2023-10-25T16:23:19.193313+0000","last_unstale":"2023-10-25T16:23:19.194416+0000","last_undegraded":"2023-10-25T16:23:19.194416+0000","last_fullsized":"2023-10-25T16:23:19.194416+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:44:50.332873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"173'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176733+0000","last_change":"2023-10-25T16:23:18.164917+0000","last_active":"2023-10-25T16:23:20.176733+0000","last_peered":"2023-10-25T16:23:20.176733+0000","last_clean":"2023-10-25T16:23:20.176733+0000","last_became_active":"2023-10-25T16:23:18.164683+0000","last_became_peered":"2023-10-25T16:23:18.164683+0000","last_unstale":"2023-10-25T16:23:20.176733+0000","last_undegraded":"2023-10-25T16:23:20.176733+0000","last_fullsized":"2023-10-25T16:23:20.176733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:04.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.185592+0000","last_change":"2023-10-25T16:23:19.185493+0000","last_active":"2023-10-25T16:23:19.185592+0000","last_peered":"2023-10-25T16:23:19.185592+0000","last_clean":"2023-10-25T16:23:19.185592+0000","last_became_active":"2023-10-25T16:23:19.184661+0000","last_became_peered":"2023-10-25T16:23:19.184661+0000","last_unstale":"2023-10-25T16:23:19.185592+0000","last_undegraded":"2023-10-25T16:23:19.185592+0000","last_fullsized":"2023-10-25T16:23:19.185592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:48:41.633674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195019+0000","last_change":"2023-10-25T16:23:18.158454+0000","last_active":"2023-10-25T16:23:19.195019+0000","last_peered":"2023-10-25T16:23:19.195019+0000","last_clean":"2023-10-25T16:23:19.195019+0000","last_became_active":"2023-10-25T16:23:18.157852+0000","last_became_peered":"2023-10-25T16:23:18.157852+0000","last_unstale":"2023-10-25T16:23:19.195019+0000","last_undegraded":"2023-10-25T16:23:19.195019+0000","last_fullsized":"2023-10-25T16:23:19.195019+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:17.308462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199538+0000","last_change":"2023-10-25T16:23:19.199453+0000","last_active":"2023-10-25T16:23:19.199538+0000","last_peered":"2023-10-25T16:23:19.199538+0000","last_clean":"2023-10-25T16:23:19.199538+0000","last_became_active":"2023-10-25T16:23:19.197416+0000","last_became_peered":"2023-10-25T16:23:19.197416+0000","last_unstale":"2023-10-25T16:23:19.199538+0000","last_undegraded":"2023-10-25T16:23:19.199538+0000","last_fullsized":"2023-10-25T16:23:19.199538+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:03:05.327394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175694+0000","last_change":"2023-10-25T16:23:18.155332+0000","last_active":"2023-10-25T16:23:20.175694+0000","last_peered":"2023-10-25T16:23:20.175694+0000","last_clean":"2023-10-25T16:23:20.175694+0000","last_became_active":"2023-10-25T16:23:18.154943+0000","last_became_peered":"2023-10-25T16:23:18.154943+0000","last_unstale":"2023-10-25T16:23:20.175694+0000","last_undegraded":"2023-10-25T16:23:20.175694+0000","last_fullsized":"2023-10-25T16:23:20.175694+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:46.301012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193467+0000","last_change":"2023-10-25T16:23:19.193398+0000","last_active":"2023-10-25T16:23:19.193467+0000","last_peered":"2023-10-25T16:23:19.193467+0000","last_clean":"2023-10-25T16:23:19.193467+0000","last_became_active":"2023-10-25T16:23:19.193144+0000","last_became_peered":"2023-10-25T16:23:19.193144+0000","last_unstale":"2023-10-25T16:23:19.193467+0000","last_undegraded":"2023-10-25T16:23:19.193467+0000","last_fullsized":"2023-10-25T16:23:19.193467+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:31:15.074684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176047+0000","last_change":"2023-10-25T16:23:18.170217+0000","last_active":"2023-10-25T16:23:19.176047+0000","last_peered":"2023-10-25T16:23:19.176047+0000","last_clean":"2023-10-25T16:23:19.176047+0000","last_became_active":"2023-10-25T16:23:18.164022+0000","last_became_peered":"2023-10-25T16:23:18.164022+0000","last_unstale":"2023-10-25T16:23:19.176047+0000","last_undegraded":"2023-10-25T16:23:19.176047+0000","last_fullsized":"2023-10-25T16:23:19.176047+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:38.919815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.202140+0000","last_change":"2023-10-25T16:23:19.202046+0000","last_active":"2023-10-25T16:23:19.202140+0000","last_peered":"2023-10-25T16:23:19.202140+0000","last_clean":"2023-10-25T16:23:19.202140+0000","last_became_active":"2023-10-25T16:23:19.201736+0000","last_became_peered":"2023-10-25T16:23:19.201736+0000","last_unstale":"2023-10-25T16:23:19.202140+0000","last_undegraded":"2023-10-25T16:23:19.202140+0000","last_fullsized":"2023-10-25T16:23:19.202140+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:11.245553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175388+0000","last_change":"2023-10-25T16:23:18.152106+0000","last_active":"2023-10-25T16:23:19.175388+0000","last_peered":"2023-10-25T16:23:19.175388+0000","last_clean":"2023-10-25T16:23:19.175388+0000","last_became_active":"2023-10-25T16:23:18.151874+0000","last_became_peered":"2023-10-25T16:23:18.151874+0000","last_unstale":"2023-10-25T16:23:19.175388+0000","last_undegraded":"2023-10-25T16:23:19.175388+0000","last_fullsized":"2023-10-25T16:23:19.175388+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:25.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174870+0000","last_change":"2023-10-25T16:23:19.174784+0000","last_active":"2023-10-25T16:23:19.174870+0000","last_peered":"2023-10-25T16:23:19.174870+0000","last_clean":"2023-10-25T16:23:19.174870+0000","last_became_active":"2023-10-25T16:23:19.174430+0000","last_became_peered":"2023-10-25T16:23:19.174430+0000","last_unstale":"2023-10-25T16:23:19.174870+0000","last_undegraded":"2023-10-25T16:23:19.174870+0000","last_fullsized":"2023-10-25T16:23:19.174870+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:54.951159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177883+0000","last_change":"2023-10-25T16:23:18.173400+0000","last_active":"2023-10-25T16:23:19.177883+0000","last_peered":"2023-10-25T16:23:19.177883+0000","last_clean":"2023-10-25T16:23:19.177883+0000","last_became_active":"2023-10-25T16:23:18.172310+0000","last_became_peered":"2023-10-25T16:23:18.172310+0000","last_unstale":"2023-10-25T16:23:19.177883+0000","last_undegraded":"2023-10-25T16:23:19.177883+0000","last_fullsized":"2023-10-25T16:23:19.177883+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:40.956111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175362+0000","last_change":"2023-10-25T16:23:19.200629+0000","last_active":"2023-10-25T16:23:20.175362+0000","last_peered":"2023-10-25T16:23:20.175362+0000","last_clean":"2023-10-25T16:23:20.175362+0000","last_became_active":"2023-10-25T16:23:19.200282+0000","last_became_peered":"2023-10-25T16:23:19.200282+0000","last_unstale":"2023-10-25T16:23:20.175362+0000","last_undegraded":"2023-10-25T16:23:20.175362+0000","last_fullsized":"2023-10-25T16:23:20.175362+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:04.959467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"173'6","reported_seq":17,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.207997+0000","last_change":"2023-10-25T16:23:18.154423+0000","last_active":"2023-10-25T16:23:19.207997+0000","last_peered":"2023-10-25T16:23:19.207997+0000","last_clean":"2023-10-25T16:23:19.207997+0000","last_became_active":"2023-10-25T16:23:18.154185+0000","last_became_peered":"2023-10-25T16:23:18.154185+0000","last_unstale":"2023-10-25T16:23:19.207997+0000","last_undegraded":"2023-10-25T16:23:19.207997+0000","last_fullsized":"2023-10-25T16:23:19.207997+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:32.778729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190263+0000","last_change":"2023-10-25T16:23:19.188225+0000","last_active":"2023-10-25T16:23:19.190263+0000","last_peered":"2023-10-25T16:23:19.190263+0000","last_clean":"2023-10-25T16:23:19.190263+0000","last_became_active":"2023-10-25T16:23:19.187882+0000","last_became_peered":"2023-10-25T16:23:19.187882+0000","last_unstale":"2023-10-25T16:23:19.190263+0000","last_undegraded":"2023-10-25T16:23:19.190263+0000","last_fullsized":"2023-10-25T16:23:19.190263+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:16.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190158+0000","last_change":"2023-10-25T16:23:18.161583+0000","last_active":"2023-10-25T16:23:19.190158+0000","last_peered":"2023-10-25T16:23:19.190158+0000","last_clean":"2023-10-25T16:23:19.190158+0000","last_became_active":"2023-10-25T16:23:18.160916+0000","last_became_peered":"2023-10-25T16:23:18.160916+0000","last_unstale":"2023-10-25T16:23:19.190158+0000","last_undegraded":"2023-10-25T16:23:19.190158+0000","last_fullsized":"2023-10-25T16:23:19.190158+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:03.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178373+0000","last_change":"2023-10-25T16:23:19.178044+0000","last_active":"2023-10-25T16:23:19.178373+0000","last_peered":"2023-10-25T16:23:19.178373+0000","last_clean":"2023-10-25T16:23:19.178373+0000","last_became_active":"2023-10-25T16:23:19.177776+0000","last_became_peered":"2023-10-25T16:23:19.177776+0000","last_unstale":"2023-10-25T16:23:19.178373+0000","last_undegraded":"2023-10-25T16:23:19.178373+0000","last_fullsized":"2023-10-25T16:23:19.178373+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:23.165764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187417+0000","last_change":"2023-10-25T16:23:18.166804+0000","last_active":"2023-10-25T16:23:19.187417+0000","last_peered":"2023-10-25T16:23:19.187417+0000","last_clean":"2023-10-25T16:23:19.187417+0000","last_became_active":"2023-10-25T16:23:18.166187+0000","last_became_peered":"2023-10-25T16:23:18.166187+0000","last_unstale":"2023-10-25T16:23:19.187417+0000","last_undegraded":"2023-10-25T16:23:19.187417+0000","last_fullsized":"2023-10-25T16:23:19.187417+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:57.177360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.196007+0000","last_change":"2023-10-25T16:23:19.195656+0000","last_active":"2023-10-25T16:23:19.196007+0000","last_peered":"2023-10-25T16:23:19.196007+0000","last_clean":"2023-10-25T16:23:19.196007+0000","last_became_active":"2023-10-25T16:23:19.195225+0000","last_became_peered":"2023-10-25T16:23:19.195225+0000","last_unstale":"2023-10-25T16:23:19.196007+0000","last_undegraded":"2023-10-25T16:23:19.196007+0000","last_fullsized":"2023-10-25T16:23:19.196007+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:51.080489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173863+0000","last_change":"2023-10-25T16:23:18.151003+0000","last_active":"2023-10-25T16:23:19.173863+0000","last_peered":"2023-10-25T16:23:19.173863+0000","last_clean":"2023-10-25T16:23:19.173863+0000","last_became_active":"2023-10-25T16:23:18.150677+0000","last_became_peered":"2023-10-25T16:23:18.150677+0000","last_unstale":"2023-10-25T16:23:19.173863+0000","last_undegraded":"2023-10-25T16:23:19.173863+0000","last_fullsized":"2023-10-25T16:23:19.173863+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:19.475448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.197147+0000","last_change":"2023-10-25T16:23:19.197069+0000","last_active":"2023-10-25T16:23:19.197147+0000","last_peered":"2023-10-25T16:23:19.197147+0000","last_clean":"2023-10-25T16:23:19.197147+0000","last_became_active":"2023-10-25T16:23:19.196772+0000","last_became_peered":"2023-10-25T16:23:19.196772+0000","last_unstale":"2023-10-25T16:23:19.197147+0000","last_undegraded":"2023-10-25T16:23:19.197147+0000","last_fullsized":"2023-10-25T16:23:19.197147+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:42.978913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"173'8","reported_seq":20,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175525+0000","last_change":"2023-10-25T16:23:18.172984+0000","last_active":"2023-10-25T16:23:20.175525+0000","last_peered":"2023-10-25T16:23:20.175525+0000","last_clean":"2023-10-25T16:23:20.175525+0000","last_became_active":"2023-10-25T16:23:18.172629+0000","last_became_peered":"2023-10-25T16:23:18.172629+0000","last_unstale":"2023-10-25T16:23:20.175525+0000","last_undegraded":"2023-10-25T16:23:20.175525+0000","last_fullsized":"2023-10-25T16:23:20.175525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:39.639341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.178825+0000","last_change":"2023-10-25T16:23:19.178741+0000","last_active":"2023-10-25T16:23:19.178825+0000","last_peered":"2023-10-25T16:23:19.178825+0000","last_clean":"2023-10-25T16:23:19.178825+0000","last_became_active":"2023-10-25T16:23:19.178495+0000","last_became_peered":"2023-10-25T16:23:19.178495+0000","last_unstale":"2023-10-25T16:23:19.178825+0000","last_undegraded":"2023-10-25T16:23:19.178825+0000","last_fullsized":"2023-10-25T16:23:19.178825+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:53.695994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"173'1","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191193+0000","last_change":"2023-10-25T16:23:18.150704+0000","last_active":"2023-10-25T16:23:19.191193+0000","last_peered":"2023-10-25T16:23:19.191193+0000","last_clean":"2023-10-25T16:23:19.191193+0000","last_became_active":"2023-10-25T16:23:18.149026+0000","last_became_peered":"2023-10-25T16:23:18.149026+0000","last_unstale":"2023-10-25T16:23:19.191193+0000","last_undegraded":"2023-10-25T16:23:19.191193+0000","last_fullsized":"2023-10-25T16:23:19.191193+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:52.995037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175504+0000","last_change":"2023-10-25T16:23:19.200275+0000","last_active":"2023-10-25T16:23:20.175504+0000","last_peered":"2023-10-25T16:23:20.175504+0000","last_clean":"2023-10-25T16:23:20.175504+0000","last_became_active":"2023-10-25T16:23:19.198906+0000","last_became_peered":"2023-10-25T16:23:19.198906+0000","last_unstale":"2023-10-25T16:23:20.175504+0000","last_undegraded":"2023-10-25T16:23:20.175504+0000","last_fullsized":"2023-10-25T16:23:20.175504+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:27:52.391980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.199223+0000","last_change":"2023-10-25T16:23:18.160357+0000","last_active":"2023-10-25T16:23:19.199223+0000","last_peered":"2023-10-25T16:23:19.199223+0000","last_clean":"2023-10-25T16:23:19.199223+0000","last_became_active":"2023-10-25T16:23:18.160114+0000","last_became_peered":"2023-10-25T16:23:18.160114+0000","last_unstale":"2023-10-25T16:23:19.199223+0000","last_undegraded":"2023-10-25T16:23:19.199223+0000","last_fullsized":"2023-10-25T16:23:19.199223+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:22:54.207547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190232+0000","last_change":"2023-10-25T16:23:19.186950+0000","last_active":"2023-10-25T16:23:19.190232+0000","last_peered":"2023-10-25T16:23:19.190232+0000","last_clean":"2023-10-25T16:23:19.190232+0000","last_became_active":"2023-10-25T16:23:19.186538+0000","last_became_peered":"2023-10-25T16:23:19.186538+0000","last_unstale":"2023-10-25T16:23:19.190232+0000","last_undegraded":"2023-10-25T16:23:19.190232+0000","last_fullsized":"2023-10-25T16:23:19.190232+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:06.640286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"173'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175905+0000","last_change":"2023-10-25T16:23:18.159880+0000","last_active":"2023-10-25T16:23:20.175905+0000","last_peered":"2023-10-25T16:23:20.175905+0000","last_clean":"2023-10-25T16:23:20.175905+0000","last_became_active":"2023-10-25T16:23:18.159655+0000","last_became_peered":"2023-10-25T16:23:18.159655+0000","last_unstale":"2023-10-25T16:23:20.175905+0000","last_undegraded":"2023-10-25T16:23:20.175905+0000","last_fullsized":"2023-10-25T16:23:20.175905+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:23:38.130899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.206013+0000","last_change":"2023-10-25T16:23:19.205886+0000","last_active":"2023-10-25T16:23:19.206013+0000","last_peered":"2023-10-25T16:23:19.206013+0000","last_clean":"2023-10-25T16:23:19.206013+0000","last_became_active":"2023-10-25T16:23:19.203366+0000","last_became_peered":"2023-10-25T16:23:19.203366+0000","last_unstale":"2023-10-25T16:23:19.206013+0000","last_undegraded":"2023-10-25T16:23:19.206013+0000","last_fullsized":"2023-10-25T16:23:19.206013+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:24:20.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174344+0000","last_change":"2023-10-25T16:23:18.151835+0000","last_active":"2023-10-25T16:23:19.174344+0000","last_peered":"2023-10-25T16:23:19.174344+0000","last_clean":"2023-10-25T16:23:19.174344+0000","last_became_active":"2023-10-25T16:23:18.151576+0000","last_became_peered":"2023-10-25T16:23:18.151576+0000","last_unstale":"2023-10-25T16:23:19.174344+0000","last_undegraded":"2023-10-25T16:23:19.174344+0000","last_fullsized":"2023-10-25T16:23:19.174344+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:22.254506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183324+0000","last_change":"2023-10-25T16:23:19.180761+0000","last_active":"2023-10-25T16:23:19.183324+0000","last_peered":"2023-10-25T16:23:19.183324+0000","last_clean":"2023-10-25T16:23:19.183324+0000","last_became_active":"2023-10-25T16:23:19.179966+0000","last_became_peered":"2023-10-25T16:23:19.179966+0000","last_unstale":"2023-10-25T16:23:19.183324+0000","last_undegraded":"2023-10-25T16:23:19.183324+0000","last_fullsized":"2023-10-25T16:23:19.183324+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:03:46.370576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.186103+0000","last_change":"2023-10-25T16:23:18.172840+0000","last_active":"2023-10-25T16:23:19.186103+0000","last_peered":"2023-10-25T16:23:19.186103+0000","last_clean":"2023-10-25T16:23:19.186103+0000","last_became_active":"2023-10-25T16:23:18.172410+0000","last_became_peered":"2023-10-25T16:23:18.172410+0000","last_unstale":"2023-10-25T16:23:19.186103+0000","last_undegraded":"2023-10-25T16:23:19.186103+0000","last_fullsized":"2023-10-25T16:23:19.186103+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181485+0000","last_change":"2023-10-25T16:23:19.181417+0000","last_active":"2023-10-25T16:23:19.181485+0000","last_peered":"2023-10-25T16:23:19.181485+0000","last_clean":"2023-10-25T16:23:19.181485+0000","last_became_active":"2023-10-25T16:23:19.181183+0000","last_became_peered":"2023-10-25T16:23:19.181183+0000","last_unstale":"2023-10-25T16:23:19.181485+0000","last_undegraded":"2023-10-25T16:23:19.181485+0000","last_fullsized":"2023-10-25T16:23:19.181485+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:33.754559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.172850+0000","last_change":"2023-10-25T16:23:18.168302+0000","last_active":"2023-10-25T16:23:19.172850+0000","last_peered":"2023-10-25T16:23:19.172850+0000","last_clean":"2023-10-25T16:23:19.172850+0000","last_became_active":"2023-10-25T16:23:18.167104+0000","last_became_peered":"2023-10-25T16:23:18.167104+0000","last_unstale":"2023-10-25T16:23:19.172850+0000","last_undegraded":"2023-10-25T16:23:19.172850+0000","last_fullsized":"2023-10-25T16:23:19.172850+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:14.919507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.183360+0000","last_change":"2023-10-25T16:23:19.181928+0000","last_active":"2023-10-25T16:23:19.183360+0000","last_peered":"2023-10-25T16:23:19.183360+0000","last_clean":"2023-10-25T16:23:19.183360+0000","last_became_active":"2023-10-25T16:23:19.181522+0000","last_became_peered":"2023-10-25T16:23:19.181522+0000","last_unstale":"2023-10-25T16:23:19.183360+0000","last_undegraded":"2023-10-25T16:23:19.183360+0000","last_fullsized":"2023-10-25T16:23:19.183360+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:58:58.064499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.175066+0000","last_change":"2023-10-25T16:23:18.166147+0000","last_active":"2023-10-25T16:23:19.175066+0000","last_peered":"2023-10-25T16:23:19.175066+0000","last_clean":"2023-10-25T16:23:19.175066+0000","last_became_active":"2023-10-25T16:23:18.165261+0000","last_became_peered":"2023-10-25T16:23:18.165261+0000","last_unstale":"2023-10-25T16:23:19.175066+0000","last_undegraded":"2023-10-25T16:23:19.175066+0000","last_fullsized":"2023-10-25T16:23:19.175066+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:00.551034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.181129+0000","last_change":"2023-10-25T16:23:19.180843+0000","last_active":"2023-10-25T16:23:19.181129+0000","last_peered":"2023-10-25T16:23:19.181129+0000","last_clean":"2023-10-25T16:23:19.181129+0000","last_became_active":"2023-10-25T16:23:19.180642+0000","last_became_peered":"2023-10-25T16:23:19.180642+0000","last_unstale":"2023-10-25T16:23:19.181129+0000","last_undegraded":"2023-10-25T16:23:19.181129+0000","last_fullsized":"2023-10-25T16:23:19.181129+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:08:07.131328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.187569+0000","last_change":"2023-10-25T16:23:18.155577+0000","last_active":"2023-10-25T16:23:19.187569+0000","last_peered":"2023-10-25T16:23:19.187569+0000","last_clean":"2023-10-25T16:23:19.187569+0000","last_became_active":"2023-10-25T16:23:18.154738+0000","last_became_peered":"2023-10-25T16:23:18.154738+0000","last_unstale":"2023-10-25T16:23:19.187569+0000","last_undegraded":"2023-10-25T16:23:19.187569+0000","last_fullsized":"2023-10-25T16:23:19.187569+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:19.137605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.195579+0000","last_change":"2023-10-25T16:23:19.195535+0000","last_active":"2023-10-25T16:23:19.195579+0000","last_peered":"2023-10-25T16:23:19.195579+0000","last_clean":"2023-10-25T16:23:19.195579+0000","last_became_active":"2023-10-25T16:23:19.194875+0000","last_became_peered":"2023-10-25T16:23:19.194875+0000","last_unstale":"2023-10-25T16:23:19.195579+0000","last_undegraded":"2023-10-25T16:23:19.195579+0000","last_fullsized":"2023-10-25T16:23:19.195579+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:55:46.166735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"173'2","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182724+0000","last_change":"2023-10-25T16:23:18.172760+0000","last_active":"2023-10-25T16:23:19.182724+0000","last_peered":"2023-10-25T16:23:19.182724+0000","last_clean":"2023-10-25T16:23:19.182724+0000","last_became_active":"2023-10-25T16:23:18.170761+0000","last_became_peered":"2023-10-25T16:23:18.170761+0000","last_unstale":"2023-10-25T16:23:19.182724+0000","last_undegraded":"2023-10-25T16:23:19.182724+0000","last_fullsized":"2023-10-25T16:23:19.182724+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:32.740149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190210+0000","last_change":"2023-10-25T16:23:19.186788+0000","last_active":"2023-10-25T16:23:19.190210+0000","last_peered":"2023-10-25T16:23:19.190210+0000","last_clean":"2023-10-25T16:23:19.190210+0000","last_became_active":"2023-10-25T16:23:19.186225+0000","last_became_peered":"2023-10-25T16:23:19.186225+0000","last_unstale":"2023-10-25T16:23:19.190210+0000","last_undegraded":"2023-10-25T16:23:19.190210+0000","last_fullsized":"2023-10-25T16:23:19.190210+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:39.934224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.174737+0000","last_change":"2023-10-25T16:23:18.160453+0000","last_active":"2023-10-25T16:23:19.174737+0000","last_peered":"2023-10-25T16:23:19.174737+0000","last_clean":"2023-10-25T16:23:19.174737+0000","last_became_active":"2023-10-25T16:23:18.160242+0000","last_became_peered":"2023-10-25T16:23:18.160242+0000","last_unstale":"2023-10-25T16:23:19.174737+0000","last_undegraded":"2023-10-25T16:23:19.174737+0000","last_fullsized":"2023-10-25T16:23:19.174737+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:30.230996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.188042+0000","last_change":"2023-10-25T16:23:19.187943+0000","last_active":"2023-10-25T16:23:19.188042+0000","last_peered":"2023-10-25T16:23:19.188042+0000","last_clean":"2023-10-25T16:23:19.188042+0000","last_became_active":"2023-10-25T16:23:19.187788+0000","last_became_peered":"2023-10-25T16:23:19.187788+0000","last_unstale":"2023-10-25T16:23:19.188042+0000","last_undegraded":"2023-10-25T16:23:19.188042+0000","last_fullsized":"2023-10-25T16:23:19.188042+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:22:37.089982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173774+0000","last_change":"2023-10-25T16:23:18.154831+0000","last_active":"2023-10-25T16:23:19.173774+0000","last_peered":"2023-10-25T16:23:19.173774+0000","last_clean":"2023-10-25T16:23:19.173774+0000","last_became_active":"2023-10-25T16:23:18.154491+0000","last_became_peered":"2023-10-25T16:23:18.154491+0000","last_unstale":"2023-10-25T16:23:19.173774+0000","last_undegraded":"2023-10-25T16:23:19.173774+0000","last_fullsized":"2023-10-25T16:23:19.173774+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:57.283692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.190571+0000","last_change":"2023-10-25T16:23:19.190322+0000","last_active":"2023-10-25T16:23:19.190571+0000","last_peered":"2023-10-25T16:23:19.190571+0000","last_clean":"2023-10-25T16:23:19.190571+0000","last_became_active":"2023-10-25T16:23:19.189841+0000","last_became_peered":"2023-10-25T16:23:19.189841+0000","last_unstale":"2023-10-25T16:23:19.190571+0000","last_undegraded":"2023-10-25T16:23:19.190571+0000","last_fullsized":"2023-10-25T16:23:19.190571+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:48:40.045282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.173739+0000","last_change":"2023-10-25T16:23:18.154686+0000","last_active":"2023-10-25T16:23:19.173739+0000","last_peered":"2023-10-25T16:23:19.173739+0000","last_clean":"2023-10-25T16:23:19.173739+0000","last_became_active":"2023-10-25T16:23:18.154437+0000","last_became_peered":"2023-10-25T16:23:18.154437+0000","last_unstale":"2023-10-25T16:23:19.173739+0000","last_undegraded":"2023-10-25T16:23:19.173739+0000","last_fullsized":"2023-10-25T16:23:19.173739+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:14:28.241432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176387+0000","last_change":"2023-10-25T16:23:19.202744+0000","last_active":"2023-10-25T16:23:20.176387+0000","last_peered":"2023-10-25T16:23:20.176387+0000","last_clean":"2023-10-25T16:23:20.176387+0000","last_became_active":"2023-10-25T16:23:19.198149+0000","last_became_peered":"2023-10-25T16:23:19.198149+0000","last_unstale":"2023-10-25T16:23:20.176387+0000","last_undegraded":"2023-10-25T16:23:20.176387+0000","last_fullsized":"2023-10-25T16:23:20.176387+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:13:10.662623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.170440+0000","last_change":"2023-10-25T16:23:18.162041+0000","last_active":"2023-10-25T16:23:19.170440+0000","last_peered":"2023-10-25T16:23:19.170440+0000","last_clean":"2023-10-25T16:23:19.170440+0000","last_became_active":"2023-10-25T16:23:18.161793+0000","last_became_peered":"2023-10-25T16:23:18.161793+0000","last_unstale":"2023-10-25T16:23:19.170440+0000","last_undegraded":"2023-10-25T16:23:19.170440+0000","last_fullsized":"2023-10-25T16:23:19.170440+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:01.371271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192534+0000","last_change":"2023-10-25T16:23:19.192438+0000","last_active":"2023-10-25T16:23:19.192534+0000","last_peered":"2023-10-25T16:23:19.192534+0000","last_clean":"2023-10-25T16:23:19.192534+0000","last_became_active":"2023-10-25T16:23:19.192213+0000","last_became_peered":"2023-10-25T16:23:19.192213+0000","last_unstale":"2023-10-25T16:23:19.192534+0000","last_undegraded":"2023-10-25T16:23:19.192534+0000","last_fullsized":"2023-10-25T16:23:19.192534+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:00:06.205275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.177449+0000","last_change":"2023-10-25T16:23:18.173060+0000","last_active":"2023-10-25T16:23:19.177449+0000","last_peered":"2023-10-25T16:23:19.177449+0000","last_clean":"2023-10-25T16:23:19.177449+0000","last_became_active":"2023-10-25T16:23:18.171579+0000","last_became_peered":"2023-10-25T16:23:18.171579+0000","last_unstale":"2023-10-25T16:23:19.177449+0000","last_undegraded":"2023-10-25T16:23:19.177449+0000","last_fullsized":"2023-10-25T16:23:19.177449+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.192391+0000","last_change":"2023-10-25T16:23:19.192244+0000","last_active":"2023-10-25T16:23:19.192391+0000","last_peered":"2023-10-25T16:23:19.192391+0000","last_clean":"2023-10-25T16:23:19.192391+0000","last_became_active":"2023-10-25T16:23:19.191971+0000","last_became_peered":"2023-10-25T16:23:19.191971+0000","last_unstale":"2023-10-25T16:23:19.192391+0000","last_undegraded":"2023-10-25T16:23:19.192391+0000","last_fullsized":"2023-10-25T16:23:19.192391+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:59:12.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.182401+0000","last_change":"2023-10-25T16:23:18.169800+0000","last_active":"2023-10-25T16:23:19.182401+0000","last_peered":"2023-10-25T16:23:19.182401+0000","last_clean":"2023-10-25T16:23:19.182401+0000","last_became_active":"2023-10-25T16:23:18.167411+0000","last_became_peered":"2023-10-25T16:23:18.167411+0000","last_unstale":"2023-10-25T16:23:19.182401+0000","last_undegraded":"2023-10-25T16:23:19.182401+0000","last_fullsized":"2023-10-25T16:23:19.182401+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:13:16.298558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.198587+0000","last_change":"2023-10-25T16:23:19.198512+0000","last_active":"2023-10-25T16:23:19.198587+0000","last_peered":"2023-10-25T16:23:19.198587+0000","last_clean":"2023-10-25T16:23:19.198587+0000","last_became_active":"2023-10-25T16:23:19.198216+0000","last_became_peered":"2023-10-25T16:23:19.198216+0000","last_unstale":"2023-10-25T16:23:19.198587+0000","last_undegraded":"2023-10-25T16:23:19.198587+0000","last_fullsized":"2023-10-25T16:23:19.198587+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:50:42.583353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.176315+0000","last_change":"2023-10-25T16:23:18.167697+0000","last_active":"2023-10-25T16:23:19.176315+0000","last_peered":"2023-10-25T16:23:19.176315+0000","last_clean":"2023-10-25T16:23:19.176315+0000","last_became_active":"2023-10-25T16:23:18.167237+0000","last_became_peered":"2023-10-25T16:23:18.167237+0000","last_unstale":"2023-10-25T16:23:19.176315+0000","last_undegraded":"2023-10-25T16:23:19.176315+0000","last_fullsized":"2023-10-25T16:23:19.176315+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.191073+0000","last_change":"2023-10-25T16:23:19.191002+0000","last_active":"2023-10-25T16:23:19.191073+0000","last_peered":"2023-10-25T16:23:19.191073+0000","last_clean":"2023-10-25T16:23:19.191073+0000","last_became_active":"2023-10-25T16:23:19.190626+0000","last_became_peered":"2023-10-25T16:23:19.190626+0000","last_unstale":"2023-10-25T16:23:19.191073+0000","last_undegraded":"2023-10-25T16:23:19.191073+0000","last_fullsized":"2023-10-25T16:23:19.191073+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:01.565443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"173'3","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.193332+0000","last_change":"2023-10-25T16:23:18.170261+0000","last_active":"2023-10-25T16:23:19.193332+0000","last_peered":"2023-10-25T16:23:19.193332+0000","last_clean":"2023-10-25T16:23:19.193332+0000","last_became_active":"2023-10-25T16:23:18.168947+0000","last_became_peered":"2023-10-25T16:23:18.168947+0000","last_unstale":"2023-10-25T16:23:19.193332+0000","last_undegraded":"2023-10-25T16:23:19.193332+0000","last_fullsized":"2023-10-25T16:23:19.193332+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:38:37.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-25T16:23:18.162842+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:23:18.162842+0000","last_peered":"2023-10-25T16:23:18.162842+0000","last_clean":"2023-10-25T16:23:18.162842+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:23:18.162842+0000","last_undegraded":"2023-10-25T16:23:18.162842+0000","last_fullsized":"2023-10-25T16:23:18.162842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199017352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.55800000000000005},"min":{"1min":0.315,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67700000000000005,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.98399999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.61799999999999999},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.27000000000000002},"max":{"1min":1.0249999999999999,"5min":1.145,"15min":1.1759999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.91500000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66600000000000004,"15min":0.63100000000000001},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.159,"15min":1.246},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.153,"5min":1.2729999999999999,"15min":1.345},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.96899999999999997,"15min":0.879},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.3029999999999999,"5min":1.45,"15min":1.6120000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.95299999999999996,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.91500000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91200000000000003,"15min":0.87},"min":{"1min":0.64400000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.46,"15min":1.4930000000000001},"last":1.107},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.94799999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.3280000000000001,"5min":1.518,"15min":1.671},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.999,"15min":0.93400000000000005},"min":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.29,"5min":1.3440000000000001,"15min":1.5009999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.008,"5min":0.99199999999999999,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.369,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":1.042}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.03,"15min":0.96299999999999997},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.677},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0229999999999999,"15min":0.98499999999999999},"min":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.95999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193790,"statfs":{"total":200000000,"available":198441741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.35899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.256},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83999999999999997},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.534},"last":0.86899999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.42899999999999999},"max":{"1min":1.4259999999999999,"5min":1.647,"15min":1.647},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70899999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.84699999999999998}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89200000000000002,"15min":0.85699999999999998},"min":{"1min":0.55100000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.234,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1879999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.72799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.996,"15min":0.98199999999999998},"min":{"1min":0.78900000000000003,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.3360000000000001,"5min":1.51,"15min":1.51},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0249999999999999,"15min":0.97699999999999998},"min":{"1min":0.69099999999999995,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.3600000000000001,"5min":1.548,"15min":1.548},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.262,"5min":1.478,"15min":1.4910000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.61799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.77400000000000002}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2909999999999999,"5min":1.696,"15min":1.7370000000000001},"last":0.63},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.0229999999999999},"min":{"1min":0.67700000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.0169999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.496,"5min":1.643,"15min":1.669},"last":1.099},{"interface":"front","average":{"1min":1.125,"5min":1.1060000000000001,"15min":1.117},"min":{"1min":0.77900000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.54,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0720000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.876},"min":{"1min":0.55800000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.339,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.877},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.998,"15min":0.92400000000000004},"min":{"1min":0.67700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.2529999999999999,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.242}]},{"osd":1,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.624,"5min":0.53300000000000003,"15min":0.52400000000000002},"max":{"1min":1.3080000000000001,"5min":10.667,"15min":10.667},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.046,"15min":0.94499999999999995},"min":{"1min":0.65400000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96299999999999997,"15min":0.91200000000000003},"min":{"1min":0.68500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.242,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0600000000000001,"15min":0.94899999999999995},"min":{"1min":0.61599999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.609,"5min":10.948,"15min":10.948},"last":0.97299999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.92200000000000004,"15min":0.92400000000000004},"min":{"1min":0.72499999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.996},{"interface":"front","average":{"1min":1.127,"5min":1.121,"15min":1.069},"min":{"1min":0.84399999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4370000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.139}]},{"osd":4,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.052,"15min":0.98199999999999998},"min":{"1min":0.63,"5min":0.48399999999999999,"15min":0.41499999999999998},"max":{"1min":1.381,"5min":11.081,"15min":11.081},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93899999999999995,"15min":0.96999999999999997},"min":{"1min":0.64900000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.165,"5min":1.444,"15min":1.444},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.98299999999999998,"15min":0.97499999999999998},"min":{"1min":0.67900000000000005,"5min":0.45000000000000001,"15min":0.44600000000000001},"max":{"1min":1.3069999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.087,"5min":1.1100000000000001,"15min":1.077},"min":{"1min":0.60599999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.734,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.022}]},{"osd":7,"last update":"Wed Oct 25 16:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.244,"15min":1.1339999999999999},"min":{"1min":0.73599999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.6140000000000001,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.179},{"interface":"front","average":{"1min":1.181,"5min":1.151,"15min":1.079},"min":{"1min":0.82399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":2.1970000000000001,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.052}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":951,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199025312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":1.1279999999999999},"min":{"1min":0.66700000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.224,"5min":2.1429999999999998,"15min":14.843},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":1.1819999999999999},"min":{"1min":0.58699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.111,"5min":2.8450000000000002,"15min":16.439},"last":0.77000000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":1.1739999999999999},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.423,"15min":14.630000000000001},"last":1.048},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92700000000000005,"15min":0.89700000000000002},"min":{"1min":0.69599999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2430000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0249999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.95099999999999996},"min":{"1min":0.627,"5min":0.5,"15min":0.5},"max":{"1min":1.22,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.76500000000000001,"5min":0.53800000000000003,"15min":0.48499999999999999},"max":{"1min":1.248,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.97199999999999998,"15min":0.98399999999999999},"min":{"1min":0.80400000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.179,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.087},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.302},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.1160000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.321},"min":{"1min":0.56999999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":15.904},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":1.298},"min":{"1min":0.63600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.0840000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.044,"15min":1.288},"min":{"1min":0.69499999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2689999999999999,"5min":4.5970000000000004,"15min":14.567},"last":0.746},{"interface":"front","average":{"1min":1.133,"5min":1.139,"15min":1.4419999999999999},"min":{"1min":0.81299999999999994,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.421,"5min":2.4079999999999999,"15min":15.089},"last":0.84699999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0209999999999999,"15min":1.395},"min":{"1min":0.748,"5min":0.436,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.171,"15min":1.2190000000000001},"min":{"1min":0.81599999999999995,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3220000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.86899999999999999,"15min":0.82699999999999996},"min":{"1min":0.61199999999999999,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.252,"5min":1.3,"15min":1.47},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.874,"15min":0.83199999999999996},"min":{"1min":0.65800000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.274,"5min":1.278,"15min":1.3029999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.873,"15min":0.84299999999999997},"min":{"1min":0.60599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.288},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.016,"5min":0.98399999999999999,"15min":0.96399999999999997},"min":{"1min":0.65600000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.383,"5min":1.47,"15min":1.4990000000000001},"last":0.876}]},{"osd":2,"last update":"Wed Oct 25 16:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88500000000000001,"15min":0.85299999999999998},"min":{"1min":0.72899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1379999999999999,"5min":1.341,"15min":1.419},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.66100000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.1160000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.94199999999999995,"15min":0.91900000000000004},"min":{"1min":0.752,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.3200000000000001,"5min":1.5,"15min":1.5},"last":1.016},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.85499999999999998,"15min":0.81499999999999995},"min":{"1min":0.70399999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.518},"last":0.92300000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.94099999999999995},"min":{"1min":0.60499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":1.504,"5min":1.599,"15min":2.6640000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.123,"15min":1.1220000000000001},"min":{"1min":0.81299999999999994,"5min":0.437,"15min":0.437},"max":{"1min":1.6379999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.181}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95999999999999996,"15min":0.97399999999999998},"min":{"1min":0.61799999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":2.085},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0660000000000001,"15min":1.071},"min":{"1min":0.77100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.252,"5min":1.625,"15min":1.8149999999999999},"last":1.2250000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.95399999999999996,"15min":0.94999999999999996},"min":{"1min":0.68899999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1419999999999999,"15min":1.1240000000000001},"min":{"1min":1.02,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.4359999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1539999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":945,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194367,"statfs":{"total":200000000,"available":199032109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.59199999999999997},"min":{"1min":0.35999999999999999,"5min":0.27200000000000002,"15min":0.22},"max":{"1min":1.002,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.222},"max":{"1min":0.95699999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.93000000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.33200000000000002,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":0.86799999999999999,"5min":1.425,"15min":1.425},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.441,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.02}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":1.1220000000000001,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.2330000000000001,"5min":1.25,"15min":1.8260000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.89100000000000001},"min":{"1min":0.60399999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1240000000000001,"5min":1.234,"15min":1.234},"last":1.052},{"interface":"front","average":{"1min":1.018,"5min":1.02,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.56599999999999995,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1699999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.94899999999999995,"15min":0.93000000000000005},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.45400000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.96199999999999997},"min":{"1min":0.63700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2050000000000001,"5min":1.2410000000000001,"15min":1.4830000000000001},"last":1.133}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96099999999999997,"15min":0.92000000000000004},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.456},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.505},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0740000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":0.998},"min":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.504},"max":{"1min":1.2849999999999999,"5min":1.508,"15min":1.5660000000000001},"last":1.208},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0109999999999999,"15min":0.97199999999999998},"min":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.51500000000000001},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.389},"last":1.111}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194360,"statfs":{"total":200000000,"available":199024752,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.48699999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.042,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.66800000000000004,"15min":0.64700000000000002},"min":{"1min":0.57299999999999995,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.0680000000000001,"5min":1.075,"15min":1.1990000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61699999999999999,"15min":0.57899999999999996},"min":{"1min":0.57499999999999996,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.96199999999999997,"5min":1.157,"15min":1.4610000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.57699999999999996,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.97399999999999998,"5min":1.2,"15min":1.2},"last":0.68999999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66600000000000004,"15min":0.64700000000000002},"min":{"1min":0.61699999999999999,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.89600000000000002,"5min":1.048,"15min":1.1399999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.78100000000000003,"15min":0.75800000000000001},"min":{"1min":0.63600000000000001,"5min":0.34799999999999998,"15min":0.28000000000000003},"max":{"1min":1.1499999999999999,"5min":1.1899999999999999,"15min":1.423},"last":0.88100000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.89600000000000002,"15min":0.96199999999999997},"min":{"1min":0.72899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.089,"5min":1.242,"15min":12.698},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.996,"5min":0.95099999999999996,"15min":1.0129999999999999},"min":{"1min":0.749,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.2170000000000001,"5min":1.2310000000000001,"15min":12.721},"last":1.075}]},{"osd":5,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.84599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.204,"5min":1.2729999999999999,"15min":1.546},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.87,"15min":0.88900000000000001},"min":{"1min":0.69999999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.147,"5min":1.2549999999999999,"15min":2.206},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.98299999999999998,"15min":0.95399999999999996},"min":{"1min":0.84699999999999998,"5min":0.65000000000000002,"15min":0.49099999999999999},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.4610000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0189999999999999,"15min":1.02},"min":{"1min":0.86899999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2090000000000001,"5min":1.397,"15min":1.5980000000000001},"last":1.1100000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:22:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.95899999999999996,"15min":0.99399999999999999},"min":{"1min":0.77900000000000003,"5min":0.53200000000000003,"15min":0.52000000000000002},"max":{"1min":1.2589999999999999,"5min":1.3100000000000001,"15min":14.776},"last":1.036},{"interface":"front","average":{"1min":1.097,"5min":1.006,"15min":1.026},"min":{"1min":0.92300000000000004,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.321,"5min":1.476,"15min":10.509},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1529,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193782,"statfs":{"total":200000000,"available":198433320,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.217},"max":{"1min":0.85699999999999998,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.262,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.80300000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":0.71599999999999997,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.60199999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.44900000000000001,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.024,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.1899999999999999,"5min":1.296,"15min":3.6579999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.86099999999999999},"min":{"1min":0.66500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.024,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.2210000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94499999999999995,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1499999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1850000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0249999999999999,"15min":0.98899999999999999},"min":{"1min":0.70199999999999996,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.619,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0089999999999999,"15min":0.95499999999999996},"min":{"1min":0.77700000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0309999999999999,"15min":1.1719999999999999},"min":{"1min":0.78600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.054,"15min":1.1899999999999999},"min":{"1min":0.73799999999999999,"5min":0.64900000000000002,"15min":0.59799999999999998},"max":{"1min":1.2290000000000001,"5min":1.4159999999999999,"15min":11.622},"last":0.94699999999999995}]}]}],"pool_statfs":[]}} 2023-10-25T16:23:26.670 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:23:26.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/1351984547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee940715f0 msgr2=0x7fee94070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:26.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 --2- 172.21.15.177:0/1351984547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee940715f0 0x7fee94070620 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009840 tx=0x7fee7c01c740 comp rx=0 tx=0).stop 2023-10-25T16:23:26.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/1351984547 shutdown_connections 2023-10-25T16:23:26.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 --2- 172.21.15.177:0/1351984547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee940715f0 0x7fee94070620 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:26.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/1351984547 >> 172.21.15.177:0/1351984547 conn(0x7fee940cdf10 msgr2=0x7fee940ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:26.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/1351984547 shutdown_connections 2023-10-25T16:23:26.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/1351984547 wait complete. 2023-10-25T16:23:26.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 Processor -- start 2023-10-25T16:23:26.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- start start 2023-10-25T16:23:26.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee94070b60 0x7fee940cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:26.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee940715f0 0x7fee94142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:26.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 0x7fee940b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:26.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94151710 con 0x7fee941581a0 2023-10-25T16:23:26.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee940ccb60 con 0x7fee940715f0 2023-10-25T16:23:26.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee941f4930 con 0x7fee94070b60 2023-10-25T16:23:26.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 0x7fee940b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:26.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 0x7fee940b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37064/0 (socket says 172.21.15.177:37064) 2023-10-25T16:23:26.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 -- 172.21.15.177:0/989161970 learned_addr learned my addr 172.21.15.177:0/989161970 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:26.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee91d9b640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee940715f0 0x7fee94142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:26.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 -- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee94070b60 msgr2=0x7fee940cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:26.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee9259c640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee94070b60 0x7fee940cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:26.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee94070b60 0x7fee940cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:26.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 -- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee940715f0 msgr2=0x7fee94142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:26.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee940715f0 0x7fee94142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:26.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 -- 172.21.15.177:0/989161970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c0094a0 con 0x7fee941581a0 2023-10-25T16:23:26.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee92d9d640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 0x7fee940b3910 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fee8400c430 tx=0x7fee8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:26.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84005220 con 0x7fee941581a0 2023-10-25T16:23:26.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee84005470 con 0x7fee941581a0 2023-10-25T16:23:26.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee94150b90 con 0x7fee941581a0 2023-10-25T16:23:26.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84007290 con 0x7fee941581a0 2023-10-25T16:23:26.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.812+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee94151150 con 0x7fee941581a0 2023-10-25T16:23:26.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.816+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9404daf0 con 0x7fee941581a0 2023-10-25T16:23:26.817 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.816+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee840073f0 con 0x7fee941581a0 2023-10-25T16:23:26.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.816+0000 7fee8affd640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee74066470 0x7fee74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:26.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.816+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee84083710 con 0x7fee941581a0 2023-10-25T16:23:26.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.816+0000 7fee9259c640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee74066470 0x7fee74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:26.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.816+0000 7fee9259c640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee74066470 0x7fee74068930 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fee8c001570 tx=0x7fee8c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:26.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.820+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee84050b90 con 0x7fee941581a0 2023-10-25T16:23:26.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.972+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee9406dbd0 con 0x7fee74066470 2023-10-25T16:23:26.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.992+0000 7fee8affd640 1 -- 172.21.15.177:0/989161970 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283793 (secure 0 0 0) 0x7fee9406dbd0 con 0x7fee74066470 2023-10-25T16:23:26.994 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:26.996 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:23:26.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee74066470 msgr2=0x7fee74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:26.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee74066470 0x7fee74068930 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fee8c001570 tx=0x7fee8c009040 comp rx=0 tx=0).stop 2023-10-25T16:23:26.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 msgr2=0x7fee940b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:26.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 0x7fee940b3910 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fee8400c430 tx=0x7fee8400c8f0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 shutdown_connections 2023-10-25T16:23:27.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fee74066470 0x7fee74068930 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee941581a0 0x7fee940b3910 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee940715f0 0x7fee94142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 --2- 172.21.15.177:0/989161970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee94070b60 0x7fee940cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 >> 172.21.15.177:0/989161970 conn(0x7fee940cdf10 msgr2=0x7fee940acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:27.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 shutdown_connections 2023-10-25T16:23:27.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:26.996+0000 7fee98b7a640 1 -- 172.21.15.177:0/989161970 wait complete. 2023-10-25T16:23:27.011 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":483,"stamp":"2023-10-25T16:23:26.825742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8821,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553678,"statfs":{"total":1600000000,"available":1590966716,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002636"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.194641+0000","last_change":"2023-10-25T16:23:19.179248+0000","last_active":"2023-10-25T16:23:22.194641+0000","last_peered":"2023-10-25T16:23:22.194641+0000","last_clean":"2023-10-25T16:23:22.194641+0000","last_became_active":"2023-10-25T16:23:19.179003+0000","last_became_peered":"2023-10-25T16:23:19.179003+0000","last_unstale":"2023-10-25T16:23:22.194641+0000","last_undegraded":"2023-10-25T16:23:22.194641+0000","last_fullsized":"2023-10-25T16:23:22.194641+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:38:57.974398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457804+0000","last_change":"2023-10-25T16:23:19.180275+0000","last_active":"2023-10-25T16:23:21.457804+0000","last_peered":"2023-10-25T16:23:21.457804+0000","last_clean":"2023-10-25T16:23:21.457804+0000","last_became_active":"2023-10-25T16:23:19.180044+0000","last_became_peered":"2023-10-25T16:23:19.180044+0000","last_unstale":"2023-10-25T16:23:21.457804+0000","last_undegraded":"2023-10-25T16:23:21.457804+0000","last_fullsized":"2023-10-25T16:23:21.457804+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:22:54.951159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.385728+0000","last_change":"2023-10-25T16:23:19.193592+0000","last_active":"2023-10-25T16:23:21.385728+0000","last_peered":"2023-10-25T16:23:21.385728+0000","last_clean":"2023-10-25T16:23:21.385728+0000","last_became_active":"2023-10-25T16:23:19.192339+0000","last_became_peered":"2023-10-25T16:23:19.192339+0000","last_unstale":"2023-10-25T16:23:21.385728+0000","last_undegraded":"2023-10-25T16:23:21.385728+0000","last_fullsized":"2023-10-25T16:23:21.385728+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:53:35.726995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170190+0000","last_change":"2023-10-25T16:23:19.185798+0000","last_active":"2023-10-25T16:23:20.170190+0000","last_peered":"2023-10-25T16:23:20.170190+0000","last_clean":"2023-10-25T16:23:20.170190+0000","last_became_active":"2023-10-25T16:23:19.184621+0000","last_became_peered":"2023-10-25T16:23:19.184621+0000","last_unstale":"2023-10-25T16:23:20.170190+0000","last_undegraded":"2023-10-25T16:23:20.170190+0000","last_fullsized":"2023-10-25T16:23:20.170190+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:05:39.792430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457317+0000","last_change":"2023-10-25T16:23:19.191555+0000","last_active":"2023-10-25T16:23:21.457317+0000","last_peered":"2023-10-25T16:23:21.457317+0000","last_clean":"2023-10-25T16:23:21.457317+0000","last_became_active":"2023-10-25T16:23:19.191159+0000","last_became_peered":"2023-10-25T16:23:19.191159+0000","last_unstale":"2023-10-25T16:23:21.457317+0000","last_undegraded":"2023-10-25T16:23:21.457317+0000","last_fullsized":"2023-10-25T16:23:21.457317+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:05:24.991551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.194421+0000","last_change":"2023-10-25T16:23:19.205378+0000","last_active":"2023-10-25T16:23:22.194421+0000","last_peered":"2023-10-25T16:23:22.194421+0000","last_clean":"2023-10-25T16:23:22.194421+0000","last_became_active":"2023-10-25T16:23:19.202582+0000","last_became_peered":"2023-10-25T16:23:19.202582+0000","last_unstale":"2023-10-25T16:23:22.194421+0000","last_undegraded":"2023-10-25T16:23:22.194421+0000","last_fullsized":"2023-10-25T16:23:22.194421+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:17:30.364154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457529+0000","last_change":"2023-10-25T16:23:19.190157+0000","last_active":"2023-10-25T16:23:21.457529+0000","last_peered":"2023-10-25T16:23:21.457529+0000","last_clean":"2023-10-25T16:23:21.457529+0000","last_became_active":"2023-10-25T16:23:19.189923+0000","last_became_peered":"2023-10-25T16:23:19.189923+0000","last_unstale":"2023-10-25T16:23:21.457529+0000","last_undegraded":"2023-10-25T16:23:21.457529+0000","last_fullsized":"2023-10-25T16:23:21.457529+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:30.728071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193181+0000","last_change":"2023-10-25T16:23:19.195649+0000","last_active":"2023-10-25T16:23:22.193181+0000","last_peered":"2023-10-25T16:23:22.193181+0000","last_clean":"2023-10-25T16:23:22.193181+0000","last_became_active":"2023-10-25T16:23:19.195462+0000","last_became_peered":"2023-10-25T16:23:19.195462+0000","last_unstale":"2023-10-25T16:23:22.193181+0000","last_undegraded":"2023-10-25T16:23:22.193181+0000","last_fullsized":"2023-10-25T16:23:22.193181+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:32:38.480985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457462+0000","last_change":"2023-10-25T16:23:19.180227+0000","last_active":"2023-10-25T16:23:21.457462+0000","last_peered":"2023-10-25T16:23:21.457462+0000","last_clean":"2023-10-25T16:23:21.457462+0000","last_became_active":"2023-10-25T16:23:19.179523+0000","last_became_peered":"2023-10-25T16:23:19.179523+0000","last_unstale":"2023-10-25T16:23:21.457462+0000","last_undegraded":"2023-10-25T16:23:21.457462+0000","last_fullsized":"2023-10-25T16:23:21.457462+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:47:44.628518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455860+0000","last_change":"2023-10-25T16:23:19.185690+0000","last_active":"2023-10-25T16:23:21.455860+0000","last_peered":"2023-10-25T16:23:21.455860+0000","last_clean":"2023-10-25T16:23:21.455860+0000","last_became_active":"2023-10-25T16:23:19.185461+0000","last_became_peered":"2023-10-25T16:23:19.185461+0000","last_unstale":"2023-10-25T16:23:21.455860+0000","last_undegraded":"2023-10-25T16:23:21.455860+0000","last_fullsized":"2023-10-25T16:23:21.455860+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:14.613228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193327+0000","last_change":"2023-10-25T16:23:19.204724+0000","last_active":"2023-10-25T16:23:22.193327+0000","last_peered":"2023-10-25T16:23:22.193327+0000","last_clean":"2023-10-25T16:23:22.193327+0000","last_became_active":"2023-10-25T16:23:19.201797+0000","last_became_peered":"2023-10-25T16:23:19.201797+0000","last_unstale":"2023-10-25T16:23:22.193327+0000","last_undegraded":"2023-10-25T16:23:22.193327+0000","last_fullsized":"2023-10-25T16:23:22.193327+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:10.122529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456072+0000","last_change":"2023-10-25T16:23:19.193268+0000","last_active":"2023-10-25T16:23:21.456072+0000","last_peered":"2023-10-25T16:23:21.456072+0000","last_clean":"2023-10-25T16:23:21.456072+0000","last_became_active":"2023-10-25T16:23:19.193016+0000","last_became_peered":"2023-10-25T16:23:19.193016+0000","last_unstale":"2023-10-25T16:23:21.456072+0000","last_undegraded":"2023-10-25T16:23:21.456072+0000","last_fullsized":"2023-10-25T16:23:21.456072+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:11:17.461696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455176+0000","last_change":"2023-10-25T16:23:19.195794+0000","last_active":"2023-10-25T16:23:21.455176+0000","last_peered":"2023-10-25T16:23:21.455176+0000","last_clean":"2023-10-25T16:23:21.455176+0000","last_became_active":"2023-10-25T16:23:19.195408+0000","last_became_peered":"2023-10-25T16:23:19.195408+0000","last_unstale":"2023-10-25T16:23:21.455176+0000","last_undegraded":"2023-10-25T16:23:21.455176+0000","last_fullsized":"2023-10-25T16:23:21.455176+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:39:34.797211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170532+0000","last_change":"2023-10-25T16:23:19.180964+0000","last_active":"2023-10-25T16:23:20.170532+0000","last_peered":"2023-10-25T16:23:20.170532+0000","last_clean":"2023-10-25T16:23:20.170532+0000","last_became_active":"2023-10-25T16:23:19.180431+0000","last_became_peered":"2023-10-25T16:23:19.180431+0000","last_unstale":"2023-10-25T16:23:20.170532+0000","last_undegraded":"2023-10-25T16:23:20.170532+0000","last_fullsized":"2023-10-25T16:23:20.170532+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:04.584949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456318+0000","last_change":"2023-10-25T16:23:19.190014+0000","last_active":"2023-10-25T16:23:21.456318+0000","last_peered":"2023-10-25T16:23:21.456318+0000","last_clean":"2023-10-25T16:23:21.456318+0000","last_became_active":"2023-10-25T16:23:19.189493+0000","last_became_peered":"2023-10-25T16:23:19.189493+0000","last_unstale":"2023-10-25T16:23:21.456318+0000","last_undegraded":"2023-10-25T16:23:21.456318+0000","last_fullsized":"2023-10-25T16:23:21.456318+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:22.597407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175484+0000","last_change":"2023-10-25T16:23:19.204631+0000","last_active":"2023-10-25T16:23:20.175484+0000","last_peered":"2023-10-25T16:23:20.175484+0000","last_clean":"2023-10-25T16:23:20.175484+0000","last_became_active":"2023-10-25T16:23:19.204213+0000","last_became_peered":"2023-10-25T16:23:19.204213+0000","last_unstale":"2023-10-25T16:23:20.175484+0000","last_undegraded":"2023-10-25T16:23:20.175484+0000","last_fullsized":"2023-10-25T16:23:20.175484+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:07.665323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456428+0000","last_change":"2023-10-25T16:23:19.179324+0000","last_active":"2023-10-25T16:23:21.456428+0000","last_peered":"2023-10-25T16:23:21.456428+0000","last_clean":"2023-10-25T16:23:21.456428+0000","last_became_active":"2023-10-25T16:23:19.179112+0000","last_became_peered":"2023-10-25T16:23:19.179112+0000","last_unstale":"2023-10-25T16:23:21.456428+0000","last_undegraded":"2023-10-25T16:23:21.456428+0000","last_fullsized":"2023-10-25T16:23:21.456428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:40:54.717448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.385364+0000","last_change":"2023-10-25T16:23:19.193768+0000","last_active":"2023-10-25T16:23:21.385364+0000","last_peered":"2023-10-25T16:23:21.385364+0000","last_clean":"2023-10-25T16:23:21.385364+0000","last_became_active":"2023-10-25T16:23:19.192700+0000","last_became_peered":"2023-10-25T16:23:19.192700+0000","last_unstale":"2023-10-25T16:23:21.385364+0000","last_undegraded":"2023-10-25T16:23:21.385364+0000","last_fullsized":"2023-10-25T16:23:21.385364+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:49:41.398044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193666+0000","last_change":"2023-10-25T16:23:19.191525+0000","last_active":"2023-10-25T16:23:22.193666+0000","last_peered":"2023-10-25T16:23:22.193666+0000","last_clean":"2023-10-25T16:23:22.193666+0000","last_became_active":"2023-10-25T16:23:19.191250+0000","last_became_peered":"2023-10-25T16:23:19.191250+0000","last_unstale":"2023-10-25T16:23:22.193666+0000","last_undegraded":"2023-10-25T16:23:22.193666+0000","last_fullsized":"2023-10-25T16:23:22.193666+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:39:16.980876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175855+0000","last_change":"2023-10-25T16:23:19.198559+0000","last_active":"2023-10-25T16:23:20.175855+0000","last_peered":"2023-10-25T16:23:20.175855+0000","last_clean":"2023-10-25T16:23:20.175855+0000","last_became_active":"2023-10-25T16:23:19.198168+0000","last_became_peered":"2023-10-25T16:23:19.198168+0000","last_unstale":"2023-10-25T16:23:20.175855+0000","last_undegraded":"2023-10-25T16:23:20.175855+0000","last_fullsized":"2023-10-25T16:23:20.175855+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:39:12.799419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455833+0000","last_change":"2023-10-25T16:23:19.179127+0000","last_active":"2023-10-25T16:23:21.455833+0000","last_peered":"2023-10-25T16:23:21.455833+0000","last_clean":"2023-10-25T16:23:21.455833+0000","last_became_active":"2023-10-25T16:23:19.178779+0000","last_became_peered":"2023-10-25T16:23:19.178779+0000","last_unstale":"2023-10-25T16:23:21.455833+0000","last_undegraded":"2023-10-25T16:23:21.455833+0000","last_fullsized":"2023-10-25T16:23:21.455833+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:30.728071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170639+0000","last_change":"2023-10-25T16:23:19.178582+0000","last_active":"2023-10-25T16:23:20.170639+0000","last_peered":"2023-10-25T16:23:20.170639+0000","last_clean":"2023-10-25T16:23:20.170639+0000","last_became_active":"2023-10-25T16:23:19.178119+0000","last_became_peered":"2023-10-25T16:23:19.178119+0000","last_unstale":"2023-10-25T16:23:20.170639+0000","last_undegraded":"2023-10-25T16:23:20.170639+0000","last_fullsized":"2023-10-25T16:23:20.170639+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:38:38.036041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.169963+0000","last_change":"2023-10-25T16:23:19.185562+0000","last_active":"2023-10-25T16:23:20.169963+0000","last_peered":"2023-10-25T16:23:20.169963+0000","last_clean":"2023-10-25T16:23:20.169963+0000","last_became_active":"2023-10-25T16:23:19.184794+0000","last_became_peered":"2023-10-25T16:23:19.184794+0000","last_unstale":"2023-10-25T16:23:20.169963+0000","last_undegraded":"2023-10-25T16:23:20.169963+0000","last_fullsized":"2023-10-25T16:23:20.169963+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:57:06.640286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455415+0000","last_change":"2023-10-25T16:23:19.184065+0000","last_active":"2023-10-25T16:23:21.455415+0000","last_peered":"2023-10-25T16:23:21.455415+0000","last_clean":"2023-10-25T16:23:21.455415+0000","last_became_active":"2023-10-25T16:23:19.183837+0000","last_became_peered":"2023-10-25T16:23:19.183837+0000","last_unstale":"2023-10-25T16:23:21.455415+0000","last_undegraded":"2023-10-25T16:23:21.455415+0000","last_fullsized":"2023-10-25T16:23:21.455415+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:36:57.019418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176071+0000","last_change":"2023-10-25T16:23:19.198694+0000","last_active":"2023-10-25T16:23:20.176071+0000","last_peered":"2023-10-25T16:23:20.176071+0000","last_clean":"2023-10-25T16:23:20.176071+0000","last_became_active":"2023-10-25T16:23:19.198403+0000","last_became_peered":"2023-10-25T16:23:19.198403+0000","last_unstale":"2023-10-25T16:23:20.176071+0000","last_undegraded":"2023-10-25T16:23:20.176071+0000","last_fullsized":"2023-10-25T16:23:20.176071+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:44:19.278715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193588+0000","last_change":"2023-10-25T16:23:19.204123+0000","last_active":"2023-10-25T16:23:22.193588+0000","last_peered":"2023-10-25T16:23:22.193588+0000","last_clean":"2023-10-25T16:23:22.193588+0000","last_became_active":"2023-10-25T16:23:19.199324+0000","last_became_peered":"2023-10-25T16:23:19.199324+0000","last_unstale":"2023-10-25T16:23:22.193588+0000","last_undegraded":"2023-10-25T16:23:22.193588+0000","last_fullsized":"2023-10-25T16:23:22.193588+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:13:01.702380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175784+0000","last_change":"2023-10-25T16:23:19.204278+0000","last_active":"2023-10-25T16:23:20.175784+0000","last_peered":"2023-10-25T16:23:20.175784+0000","last_clean":"2023-10-25T16:23:20.175784+0000","last_became_active":"2023-10-25T16:23:19.202231+0000","last_became_peered":"2023-10-25T16:23:19.202231+0000","last_unstale":"2023-10-25T16:23:20.175784+0000","last_undegraded":"2023-10-25T16:23:20.175784+0000","last_fullsized":"2023-10-25T16:23:20.175784+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:49:14.960973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457620+0000","last_change":"2023-10-25T16:23:19.186729+0000","last_active":"2023-10-25T16:23:21.457620+0000","last_peered":"2023-10-25T16:23:21.457620+0000","last_clean":"2023-10-25T16:23:21.457620+0000","last_became_active":"2023-10-25T16:23:19.186354+0000","last_became_peered":"2023-10-25T16:23:19.186354+0000","last_unstale":"2023-10-25T16:23:21.457620+0000","last_undegraded":"2023-10-25T16:23:21.457620+0000","last_fullsized":"2023-10-25T16:23:21.457620+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:14.613228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193326+0000","last_change":"2023-10-25T16:23:19.190180+0000","last_active":"2023-10-25T16:23:22.193326+0000","last_peered":"2023-10-25T16:23:22.193326+0000","last_clean":"2023-10-25T16:23:22.193326+0000","last_became_active":"2023-10-25T16:23:19.189509+0000","last_became_peered":"2023-10-25T16:23:19.189509+0000","last_unstale":"2023-10-25T16:23:22.193326+0000","last_undegraded":"2023-10-25T16:23:22.193326+0000","last_fullsized":"2023-10-25T16:23:22.193326+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:05:34.432325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170527+0000","last_change":"2023-10-25T16:23:19.184422+0000","last_active":"2023-10-25T16:23:20.170527+0000","last_peered":"2023-10-25T16:23:20.170527+0000","last_clean":"2023-10-25T16:23:20.170527+0000","last_became_active":"2023-10-25T16:23:19.183889+0000","last_became_peered":"2023-10-25T16:23:19.183889+0000","last_unstale":"2023-10-25T16:23:20.170527+0000","last_undegraded":"2023-10-25T16:23:20.170527+0000","last_fullsized":"2023-10-25T16:23:20.170527+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:56:42.978913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.458182+0000","last_change":"2023-10-25T16:23:19.195947+0000","last_active":"2023-10-25T16:23:21.458182+0000","last_peered":"2023-10-25T16:23:21.458182+0000","last_clean":"2023-10-25T16:23:21.458182+0000","last_became_active":"2023-10-25T16:23:19.195349+0000","last_became_peered":"2023-10-25T16:23:19.195349+0000","last_unstale":"2023-10-25T16:23:21.458182+0000","last_undegraded":"2023-10-25T16:23:21.458182+0000","last_fullsized":"2023-10-25T16:23:21.458182+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:59:12.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176088+0000","last_change":"2023-10-25T16:23:19.204749+0000","last_active":"2023-10-25T16:23:20.176088+0000","last_peered":"2023-10-25T16:23:20.176088+0000","last_clean":"2023-10-25T16:23:20.176088+0000","last_became_active":"2023-10-25T16:23:19.203237+0000","last_became_peered":"2023-10-25T16:23:19.203237+0000","last_unstale":"2023-10-25T16:23:20.176088+0000","last_undegraded":"2023-10-25T16:23:20.176088+0000","last_fullsized":"2023-10-25T16:23:20.176088+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:43:41.659857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455773+0000","last_change":"2023-10-25T16:23:19.193900+0000","last_active":"2023-10-25T16:23:21.455773+0000","last_peered":"2023-10-25T16:23:21.455773+0000","last_clean":"2023-10-25T16:23:21.455773+0000","last_became_active":"2023-10-25T16:23:19.193551+0000","last_became_peered":"2023-10-25T16:23:19.193551+0000","last_unstale":"2023-10-25T16:23:21.455773+0000","last_undegraded":"2023-10-25T16:23:21.455773+0000","last_fullsized":"2023-10-25T16:23:21.455773+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:55.494698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"173'4","reported_seq":16,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.857275+0000","last_change":"2023-10-25T16:23:18.159556+0000","last_active":"2023-10-25T16:23:19.857275+0000","last_peered":"2023-10-25T16:23:19.857275+0000","last_clean":"2023-10-25T16:23:19.857275+0000","last_became_active":"2023-10-25T16:23:18.158349+0000","last_became_peered":"2023-10-25T16:23:18.158349+0000","last_unstale":"2023-10-25T16:23:19.857275+0000","last_undegraded":"2023-10-25T16:23:19.857275+0000","last_fullsized":"2023-10-25T16:23:19.857275+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.458337+0000","last_change":"2023-10-25T16:23:19.182477+0000","last_active":"2023-10-25T16:23:21.458337+0000","last_peered":"2023-10-25T16:23:21.458337+0000","last_clean":"2023-10-25T16:23:21.458337+0000","last_became_active":"2023-10-25T16:23:19.182166+0000","last_became_peered":"2023-10-25T16:23:19.182166+0000","last_unstale":"2023-10-25T16:23:21.458337+0000","last_undegraded":"2023-10-25T16:23:21.458337+0000","last_fullsized":"2023-10-25T16:23:21.458337+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:15.933916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"173'1","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844378+0000","last_change":"2023-10-25T16:23:18.167802+0000","last_active":"2023-10-25T16:23:19.844378+0000","last_peered":"2023-10-25T16:23:19.844378+0000","last_clean":"2023-10-25T16:23:19.844378+0000","last_became_active":"2023-10-25T16:23:18.167507+0000","last_became_peered":"2023-10-25T16:23:18.167507+0000","last_unstale":"2023-10-25T16:23:19.844378+0000","last_undegraded":"2023-10-25T16:23:19.844378+0000","last_fullsized":"2023-10-25T16:23:19.844378+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:17:24.539701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193771+0000","last_change":"2023-10-25T16:23:19.182770+0000","last_active":"2023-10-25T16:23:22.193771+0000","last_peered":"2023-10-25T16:23:22.193771+0000","last_clean":"2023-10-25T16:23:22.193771+0000","last_became_active":"2023-10-25T16:23:19.182217+0000","last_became_peered":"2023-10-25T16:23:19.182217+0000","last_unstale":"2023-10-25T16:23:22.193771+0000","last_undegraded":"2023-10-25T16:23:22.193771+0000","last_fullsized":"2023-10-25T16:23:22.193771+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:59:35.735759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"173'2","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.851838+0000","last_change":"2023-10-25T16:23:18.169529+0000","last_active":"2023-10-25T16:23:19.851838+0000","last_peered":"2023-10-25T16:23:19.851838+0000","last_clean":"2023-10-25T16:23:19.851838+0000","last_became_active":"2023-10-25T16:23:18.162217+0000","last_became_peered":"2023-10-25T16:23:18.162217+0000","last_unstale":"2023-10-25T16:23:19.851838+0000","last_undegraded":"2023-10-25T16:23:19.851838+0000","last_fullsized":"2023-10-25T16:23:19.851838+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:41:25.784664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456531+0000","last_change":"2023-10-25T16:23:19.193435+0000","last_active":"2023-10-25T16:23:21.456531+0000","last_peered":"2023-10-25T16:23:21.456531+0000","last_clean":"2023-10-25T16:23:21.456531+0000","last_became_active":"2023-10-25T16:23:19.193047+0000","last_became_peered":"2023-10-25T16:23:19.193047+0000","last_unstale":"2023-10-25T16:23:21.456531+0000","last_undegraded":"2023-10-25T16:23:21.456531+0000","last_fullsized":"2023-10-25T16:23:21.456531+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:59:09.602115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"173'2","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.851785+0000","last_change":"2023-10-25T16:23:18.159481+0000","last_active":"2023-10-25T16:23:19.851785+0000","last_peered":"2023-10-25T16:23:19.851785+0000","last_clean":"2023-10-25T16:23:19.851785+0000","last_became_active":"2023-10-25T16:23:18.158375+0000","last_became_peered":"2023-10-25T16:23:18.158375+0000","last_unstale":"2023-10-25T16:23:19.851785+0000","last_undegraded":"2023-10-25T16:23:19.851785+0000","last_fullsized":"2023-10-25T16:23:19.851785+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:37.345492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.458677+0000","last_change":"2023-10-25T16:23:19.194347+0000","last_active":"2023-10-25T16:23:21.458677+0000","last_peered":"2023-10-25T16:23:21.458677+0000","last_clean":"2023-10-25T16:23:21.458677+0000","last_became_active":"2023-10-25T16:23:19.193313+0000","last_became_peered":"2023-10-25T16:23:19.193313+0000","last_unstale":"2023-10-25T16:23:21.458677+0000","last_undegraded":"2023-10-25T16:23:21.458677+0000","last_fullsized":"2023-10-25T16:23:21.458677+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:33.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"173'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176733+0000","last_change":"2023-10-25T16:23:18.164917+0000","last_active":"2023-10-25T16:23:20.176733+0000","last_peered":"2023-10-25T16:23:20.176733+0000","last_clean":"2023-10-25T16:23:20.176733+0000","last_became_active":"2023-10-25T16:23:18.164683+0000","last_became_peered":"2023-10-25T16:23:18.164683+0000","last_unstale":"2023-10-25T16:23:20.176733+0000","last_undegraded":"2023-10-25T16:23:20.176733+0000","last_fullsized":"2023-10-25T16:23:20.176733+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:04.580075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170997+0000","last_change":"2023-10-25T16:23:19.185493+0000","last_active":"2023-10-25T16:23:20.170997+0000","last_peered":"2023-10-25T16:23:20.170997+0000","last_clean":"2023-10-25T16:23:20.170997+0000","last_became_active":"2023-10-25T16:23:19.184661+0000","last_became_peered":"2023-10-25T16:23:19.184661+0000","last_unstale":"2023-10-25T16:23:20.170997+0000","last_undegraded":"2023-10-25T16:23:20.170997+0000","last_fullsized":"2023-10-25T16:23:20.170997+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:58.191769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"173'1","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.862350+0000","last_change":"2023-10-25T16:23:18.158454+0000","last_active":"2023-10-25T16:23:19.862350+0000","last_peered":"2023-10-25T16:23:19.862350+0000","last_clean":"2023-10-25T16:23:19.862350+0000","last_became_active":"2023-10-25T16:23:18.157852+0000","last_became_peered":"2023-10-25T16:23:18.157852+0000","last_unstale":"2023-10-25T16:23:19.862350+0000","last_undegraded":"2023-10-25T16:23:19.862350+0000","last_fullsized":"2023-10-25T16:23:19.862350+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:28:17.308462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.459179+0000","last_change":"2023-10-25T16:23:19.199453+0000","last_active":"2023-10-25T16:23:21.459179+0000","last_peered":"2023-10-25T16:23:21.459179+0000","last_clean":"2023-10-25T16:23:21.459179+0000","last_became_active":"2023-10-25T16:23:19.197416+0000","last_became_peered":"2023-10-25T16:23:19.197416+0000","last_unstale":"2023-10-25T16:23:21.459179+0000","last_undegraded":"2023-10-25T16:23:21.459179+0000","last_fullsized":"2023-10-25T16:23:21.459179+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:30:08.303989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175694+0000","last_change":"2023-10-25T16:23:18.155332+0000","last_active":"2023-10-25T16:23:20.175694+0000","last_peered":"2023-10-25T16:23:20.175694+0000","last_clean":"2023-10-25T16:23:20.175694+0000","last_became_active":"2023-10-25T16:23:18.154943+0000","last_became_peered":"2023-10-25T16:23:18.154943+0000","last_unstale":"2023-10-25T16:23:20.175694+0000","last_undegraded":"2023-10-25T16:23:20.175694+0000","last_fullsized":"2023-10-25T16:23:20.175694+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:48:46.301012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455415+0000","last_change":"2023-10-25T16:23:19.193398+0000","last_active":"2023-10-25T16:23:21.455415+0000","last_peered":"2023-10-25T16:23:21.455415+0000","last_clean":"2023-10-25T16:23:21.455415+0000","last_became_active":"2023-10-25T16:23:19.193144+0000","last_became_peered":"2023-10-25T16:23:19.193144+0000","last_unstale":"2023-10-25T16:23:21.455415+0000","last_undegraded":"2023-10-25T16:23:21.455415+0000","last_fullsized":"2023-10-25T16:23:21.455415+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:03:59.135112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.851863+0000","last_change":"2023-10-25T16:23:18.170217+0000","last_active":"2023-10-25T16:23:19.851863+0000","last_peered":"2023-10-25T16:23:19.851863+0000","last_clean":"2023-10-25T16:23:19.851863+0000","last_became_active":"2023-10-25T16:23:18.164022+0000","last_became_peered":"2023-10-25T16:23:18.164022+0000","last_unstale":"2023-10-25T16:23:19.851863+0000","last_undegraded":"2023-10-25T16:23:19.851863+0000","last_fullsized":"2023-10-25T16:23:19.851863+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:37:38.919815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457510+0000","last_change":"2023-10-25T16:23:19.202046+0000","last_active":"2023-10-25T16:23:21.457510+0000","last_peered":"2023-10-25T16:23:21.457510+0000","last_clean":"2023-10-25T16:23:21.457510+0000","last_became_active":"2023-10-25T16:23:19.201736+0000","last_became_peered":"2023-10-25T16:23:19.201736+0000","last_unstale":"2023-10-25T16:23:21.457510+0000","last_undegraded":"2023-10-25T16:23:21.457510+0000","last_fullsized":"2023-10-25T16:23:21.457510+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:23:17.851258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844469+0000","last_change":"2023-10-25T16:23:18.152106+0000","last_active":"2023-10-25T16:23:19.844469+0000","last_peered":"2023-10-25T16:23:19.844469+0000","last_clean":"2023-10-25T16:23:19.844469+0000","last_became_active":"2023-10-25T16:23:18.151874+0000","last_became_peered":"2023-10-25T16:23:18.151874+0000","last_unstale":"2023-10-25T16:23:19.844469+0000","last_undegraded":"2023-10-25T16:23:19.844469+0000","last_fullsized":"2023-10-25T16:23:19.844469+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:19:25.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456208+0000","last_change":"2023-10-25T16:23:19.174784+0000","last_active":"2023-10-25T16:23:21.456208+0000","last_peered":"2023-10-25T16:23:21.456208+0000","last_clean":"2023-10-25T16:23:21.456208+0000","last_became_active":"2023-10-25T16:23:19.174430+0000","last_became_peered":"2023-10-25T16:23:19.174430+0000","last_unstale":"2023-10-25T16:23:21.456208+0000","last_undegraded":"2023-10-25T16:23:21.456208+0000","last_fullsized":"2023-10-25T16:23:21.456208+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:05:05.692156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.857393+0000","last_change":"2023-10-25T16:23:18.173400+0000","last_active":"2023-10-25T16:23:19.857393+0000","last_peered":"2023-10-25T16:23:19.857393+0000","last_clean":"2023-10-25T16:23:19.857393+0000","last_became_active":"2023-10-25T16:23:18.172310+0000","last_became_peered":"2023-10-25T16:23:18.172310+0000","last_unstale":"2023-10-25T16:23:19.857393+0000","last_undegraded":"2023-10-25T16:23:19.857393+0000","last_fullsized":"2023-10-25T16:23:19.857393+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:40.956111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175362+0000","last_change":"2023-10-25T16:23:19.200629+0000","last_active":"2023-10-25T16:23:20.175362+0000","last_peered":"2023-10-25T16:23:20.175362+0000","last_clean":"2023-10-25T16:23:20.175362+0000","last_became_active":"2023-10-25T16:23:19.200282+0000","last_became_peered":"2023-10-25T16:23:19.200282+0000","last_unstale":"2023-10-25T16:23:20.175362+0000","last_undegraded":"2023-10-25T16:23:20.175362+0000","last_fullsized":"2023-10-25T16:23:20.175362+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:03:04.959467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"173'6","reported_seq":18,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844833+0000","last_change":"2023-10-25T16:23:18.154423+0000","last_active":"2023-10-25T16:23:19.844833+0000","last_peered":"2023-10-25T16:23:19.844833+0000","last_clean":"2023-10-25T16:23:19.844833+0000","last_became_active":"2023-10-25T16:23:18.154185+0000","last_became_peered":"2023-10-25T16:23:18.154185+0000","last_unstale":"2023-10-25T16:23:19.844833+0000","last_undegraded":"2023-10-25T16:23:19.844833+0000","last_fullsized":"2023-10-25T16:23:19.844833+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:41:32.778729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.385529+0000","last_change":"2023-10-25T16:23:19.188225+0000","last_active":"2023-10-25T16:23:21.385529+0000","last_peered":"2023-10-25T16:23:21.385529+0000","last_clean":"2023-10-25T16:23:21.385529+0000","last_became_active":"2023-10-25T16:23:19.187882+0000","last_became_peered":"2023-10-25T16:23:19.187882+0000","last_unstale":"2023-10-25T16:23:21.385529+0000","last_undegraded":"2023-10-25T16:23:21.385529+0000","last_fullsized":"2023-10-25T16:23:21.385529+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:37:06.890735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"173'2","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.854294+0000","last_change":"2023-10-25T16:23:18.161583+0000","last_active":"2023-10-25T16:23:19.854294+0000","last_peered":"2023-10-25T16:23:19.854294+0000","last_clean":"2023-10-25T16:23:19.854294+0000","last_became_active":"2023-10-25T16:23:18.160916+0000","last_became_peered":"2023-10-25T16:23:18.160916+0000","last_unstale":"2023-10-25T16:23:19.854294+0000","last_undegraded":"2023-10-25T16:23:19.854294+0000","last_fullsized":"2023-10-25T16:23:19.854294+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:03.570540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.458585+0000","last_change":"2023-10-25T16:23:19.178044+0000","last_active":"2023-10-25T16:23:21.458585+0000","last_peered":"2023-10-25T16:23:21.458585+0000","last_clean":"2023-10-25T16:23:21.458585+0000","last_became_active":"2023-10-25T16:23:19.177776+0000","last_became_peered":"2023-10-25T16:23:19.177776+0000","last_unstale":"2023-10-25T16:23:21.458585+0000","last_undegraded":"2023-10-25T16:23:21.458585+0000","last_fullsized":"2023-10-25T16:23:21.458585+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:43.458260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.854242+0000","last_change":"2023-10-25T16:23:18.166804+0000","last_active":"2023-10-25T16:23:19.854242+0000","last_peered":"2023-10-25T16:23:19.854242+0000","last_clean":"2023-10-25T16:23:19.854242+0000","last_became_active":"2023-10-25T16:23:18.166187+0000","last_became_peered":"2023-10-25T16:23:18.166187+0000","last_unstale":"2023-10-25T16:23:19.854242+0000","last_undegraded":"2023-10-25T16:23:19.854242+0000","last_fullsized":"2023-10-25T16:23:19.854242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:57.177360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.455524+0000","last_change":"2023-10-25T16:23:19.195656+0000","last_active":"2023-10-25T16:23:21.455524+0000","last_peered":"2023-10-25T16:23:21.455524+0000","last_clean":"2023-10-25T16:23:21.455524+0000","last_became_active":"2023-10-25T16:23:19.195225+0000","last_became_peered":"2023-10-25T16:23:19.195225+0000","last_unstale":"2023-10-25T16:23:21.455524+0000","last_undegraded":"2023-10-25T16:23:21.455524+0000","last_fullsized":"2023-10-25T16:23:21.455524+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:27:53.968884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.848449+0000","last_change":"2023-10-25T16:23:18.151003+0000","last_active":"2023-10-25T16:23:19.848449+0000","last_peered":"2023-10-25T16:23:19.848449+0000","last_clean":"2023-10-25T16:23:19.848449+0000","last_became_active":"2023-10-25T16:23:18.150677+0000","last_became_peered":"2023-10-25T16:23:18.150677+0000","last_unstale":"2023-10-25T16:23:19.848449+0000","last_undegraded":"2023-10-25T16:23:19.848449+0000","last_fullsized":"2023-10-25T16:23:19.848449+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:15:19.475448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.385438+0000","last_change":"2023-10-25T16:23:19.197069+0000","last_active":"2023-10-25T16:23:21.385438+0000","last_peered":"2023-10-25T16:23:21.385438+0000","last_clean":"2023-10-25T16:23:21.385438+0000","last_became_active":"2023-10-25T16:23:19.196772+0000","last_became_peered":"2023-10-25T16:23:19.196772+0000","last_unstale":"2023-10-25T16:23:21.385438+0000","last_undegraded":"2023-10-25T16:23:21.385438+0000","last_fullsized":"2023-10-25T16:23:21.385438+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:08:10.043630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"173'8","reported_seq":20,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175525+0000","last_change":"2023-10-25T16:23:18.172984+0000","last_active":"2023-10-25T16:23:20.175525+0000","last_peered":"2023-10-25T16:23:20.175525+0000","last_clean":"2023-10-25T16:23:20.175525+0000","last_became_active":"2023-10-25T16:23:18.172629+0000","last_became_peered":"2023-10-25T16:23:18.172629+0000","last_unstale":"2023-10-25T16:23:20.175525+0000","last_undegraded":"2023-10-25T16:23:20.175525+0000","last_fullsized":"2023-10-25T16:23:20.175525+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:02:39.639341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456723+0000","last_change":"2023-10-25T16:23:19.178741+0000","last_active":"2023-10-25T16:23:21.456723+0000","last_peered":"2023-10-25T16:23:21.456723+0000","last_clean":"2023-10-25T16:23:21.456723+0000","last_became_active":"2023-10-25T16:23:19.178495+0000","last_became_peered":"2023-10-25T16:23:19.178495+0000","last_unstale":"2023-10-25T16:23:21.456723+0000","last_undegraded":"2023-10-25T16:23:21.456723+0000","last_fullsized":"2023-10-25T16:23:21.456723+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:51.365291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"173'1","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.862111+0000","last_change":"2023-10-25T16:23:18.150704+0000","last_active":"2023-10-25T16:23:19.862111+0000","last_peered":"2023-10-25T16:23:19.862111+0000","last_clean":"2023-10-25T16:23:19.862111+0000","last_became_active":"2023-10-25T16:23:18.149026+0000","last_became_peered":"2023-10-25T16:23:18.149026+0000","last_unstale":"2023-10-25T16:23:19.862111+0000","last_undegraded":"2023-10-25T16:23:19.862111+0000","last_fullsized":"2023-10-25T16:23:19.862111+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:46:52.995037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175504+0000","last_change":"2023-10-25T16:23:19.200275+0000","last_active":"2023-10-25T16:23:20.175504+0000","last_peered":"2023-10-25T16:23:20.175504+0000","last_clean":"2023-10-25T16:23:20.175504+0000","last_became_active":"2023-10-25T16:23:19.198906+0000","last_became_peered":"2023-10-25T16:23:19.198906+0000","last_unstale":"2023-10-25T16:23:20.175504+0000","last_undegraded":"2023-10-25T16:23:20.175504+0000","last_fullsized":"2023-10-25T16:23:20.175504+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:27:52.391980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"173'2","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844516+0000","last_change":"2023-10-25T16:23:18.160357+0000","last_active":"2023-10-25T16:23:19.844516+0000","last_peered":"2023-10-25T16:23:19.844516+0000","last_clean":"2023-10-25T16:23:19.844516+0000","last_became_active":"2023-10-25T16:23:18.160114+0000","last_became_peered":"2023-10-25T16:23:18.160114+0000","last_unstale":"2023-10-25T16:23:19.844516+0000","last_undegraded":"2023-10-25T16:23:19.844516+0000","last_fullsized":"2023-10-25T16:23:19.844516+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:22:54.207547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.385804+0000","last_change":"2023-10-25T16:23:19.186950+0000","last_active":"2023-10-25T16:23:21.385804+0000","last_peered":"2023-10-25T16:23:21.385804+0000","last_clean":"2023-10-25T16:23:21.385804+0000","last_became_active":"2023-10-25T16:23:19.186538+0000","last_became_peered":"2023-10-25T16:23:19.186538+0000","last_unstale":"2023-10-25T16:23:21.385804+0000","last_undegraded":"2023-10-25T16:23:21.385804+0000","last_fullsized":"2023-10-25T16:23:21.385804+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:34:40.100162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"173'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.175905+0000","last_change":"2023-10-25T16:23:18.159880+0000","last_active":"2023-10-25T16:23:20.175905+0000","last_peered":"2023-10-25T16:23:20.175905+0000","last_clean":"2023-10-25T16:23:20.175905+0000","last_became_active":"2023-10-25T16:23:18.159655+0000","last_became_peered":"2023-10-25T16:23:18.159655+0000","last_unstale":"2023-10-25T16:23:20.175905+0000","last_undegraded":"2023-10-25T16:23:20.175905+0000","last_fullsized":"2023-10-25T16:23:20.175905+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:23:38.130899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.194085+0000","last_change":"2023-10-25T16:23:19.205886+0000","last_active":"2023-10-25T16:23:22.194085+0000","last_peered":"2023-10-25T16:23:22.194085+0000","last_clean":"2023-10-25T16:23:22.194085+0000","last_became_active":"2023-10-25T16:23:19.203366+0000","last_became_peered":"2023-10-25T16:23:19.203366+0000","last_unstale":"2023-10-25T16:23:22.194085+0000","last_undegraded":"2023-10-25T16:23:22.194085+0000","last_fullsized":"2023-10-25T16:23:22.194085+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:12:16.433734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844445+0000","last_change":"2023-10-25T16:23:18.151835+0000","last_active":"2023-10-25T16:23:19.844445+0000","last_peered":"2023-10-25T16:23:19.844445+0000","last_clean":"2023-10-25T16:23:19.844445+0000","last_became_active":"2023-10-25T16:23:18.151576+0000","last_became_peered":"2023-10-25T16:23:18.151576+0000","last_unstale":"2023-10-25T16:23:19.844445+0000","last_undegraded":"2023-10-25T16:23:19.844445+0000","last_fullsized":"2023-10-25T16:23:19.844445+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:22.254506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170865+0000","last_change":"2023-10-25T16:23:19.180761+0000","last_active":"2023-10-25T16:23:20.170865+0000","last_peered":"2023-10-25T16:23:20.170865+0000","last_clean":"2023-10-25T16:23:20.170865+0000","last_became_active":"2023-10-25T16:23:19.179966+0000","last_became_peered":"2023-10-25T16:23:19.179966+0000","last_unstale":"2023-10-25T16:23:20.170865+0000","last_undegraded":"2023-10-25T16:23:20.170865+0000","last_fullsized":"2023-10-25T16:23:20.170865+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:01:16.960524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"173'2","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844892+0000","last_change":"2023-10-25T16:23:18.172840+0000","last_active":"2023-10-25T16:23:19.844892+0000","last_peered":"2023-10-25T16:23:19.844892+0000","last_clean":"2023-10-25T16:23:19.844892+0000","last_became_active":"2023-10-25T16:23:18.172410+0000","last_became_peered":"2023-10-25T16:23:18.172410+0000","last_unstale":"2023-10-25T16:23:19.844892+0000","last_undegraded":"2023-10-25T16:23:19.844892+0000","last_fullsized":"2023-10-25T16:23:19.844892+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457948+0000","last_change":"2023-10-25T16:23:19.181417+0000","last_active":"2023-10-25T16:23:21.457948+0000","last_peered":"2023-10-25T16:23:21.457948+0000","last_clean":"2023-10-25T16:23:21.457948+0000","last_became_active":"2023-10-25T16:23:19.181183+0000","last_became_peered":"2023-10-25T16:23:19.181183+0000","last_unstale":"2023-10-25T16:23:21.457948+0000","last_undegraded":"2023-10-25T16:23:21.457948+0000","last_fullsized":"2023-10-25T16:23:21.457948+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:11:17.461696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.857235+0000","last_change":"2023-10-25T16:23:18.168302+0000","last_active":"2023-10-25T16:23:19.857235+0000","last_peered":"2023-10-25T16:23:19.857235+0000","last_clean":"2023-10-25T16:23:19.857235+0000","last_became_active":"2023-10-25T16:23:18.167104+0000","last_became_peered":"2023-10-25T16:23:18.167104+0000","last_unstale":"2023-10-25T16:23:19.857235+0000","last_undegraded":"2023-10-25T16:23:19.857235+0000","last_fullsized":"2023-10-25T16:23:19.857235+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:12:14.919507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.170743+0000","last_change":"2023-10-25T16:23:19.181928+0000","last_active":"2023-10-25T16:23:20.170743+0000","last_peered":"2023-10-25T16:23:20.170743+0000","last_clean":"2023-10-25T16:23:20.170743+0000","last_became_active":"2023-10-25T16:23:19.181522+0000","last_became_peered":"2023-10-25T16:23:19.181522+0000","last_unstale":"2023-10-25T16:23:20.170743+0000","last_undegraded":"2023-10-25T16:23:20.170743+0000","last_fullsized":"2023-10-25T16:23:20.170743+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:13:17.312967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.857561+0000","last_change":"2023-10-25T16:23:18.166147+0000","last_active":"2023-10-25T16:23:19.857561+0000","last_peered":"2023-10-25T16:23:19.857561+0000","last_clean":"2023-10-25T16:23:19.857561+0000","last_became_active":"2023-10-25T16:23:18.165261+0000","last_became_peered":"2023-10-25T16:23:18.165261+0000","last_unstale":"2023-10-25T16:23:19.857561+0000","last_undegraded":"2023-10-25T16:23:19.857561+0000","last_fullsized":"2023-10-25T16:23:19.857561+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:00.551034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457165+0000","last_change":"2023-10-25T16:23:19.180843+0000","last_active":"2023-10-25T16:23:21.457165+0000","last_peered":"2023-10-25T16:23:21.457165+0000","last_clean":"2023-10-25T16:23:21.457165+0000","last_became_active":"2023-10-25T16:23:19.180642+0000","last_became_peered":"2023-10-25T16:23:19.180642+0000","last_unstale":"2023-10-25T16:23:21.457165+0000","last_undegraded":"2023-10-25T16:23:21.457165+0000","last_fullsized":"2023-10-25T16:23:21.457165+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:55.494698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.854265+0000","last_change":"2023-10-25T16:23:18.155577+0000","last_active":"2023-10-25T16:23:19.854265+0000","last_peered":"2023-10-25T16:23:19.854265+0000","last_clean":"2023-10-25T16:23:19.854265+0000","last_became_active":"2023-10-25T16:23:18.154738+0000","last_became_peered":"2023-10-25T16:23:18.154738+0000","last_unstale":"2023-10-25T16:23:19.854265+0000","last_undegraded":"2023-10-25T16:23:19.854265+0000","last_fullsized":"2023-10-25T16:23:19.854265+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:19.137605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456012+0000","last_change":"2023-10-25T16:23:19.195535+0000","last_active":"2023-10-25T16:23:21.456012+0000","last_peered":"2023-10-25T16:23:21.456012+0000","last_clean":"2023-10-25T16:23:21.456012+0000","last_became_active":"2023-10-25T16:23:19.194875+0000","last_became_peered":"2023-10-25T16:23:19.194875+0000","last_unstale":"2023-10-25T16:23:21.456012+0000","last_undegraded":"2023-10-25T16:23:21.456012+0000","last_fullsized":"2023-10-25T16:23:21.456012+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:39:55.809315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"173'2","reported_seq":14,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.857347+0000","last_change":"2023-10-25T16:23:18.172760+0000","last_active":"2023-10-25T16:23:19.857347+0000","last_peered":"2023-10-25T16:23:19.857347+0000","last_clean":"2023-10-25T16:23:19.857347+0000","last_became_active":"2023-10-25T16:23:18.170761+0000","last_became_peered":"2023-10-25T16:23:18.170761+0000","last_unstale":"2023-10-25T16:23:19.857347+0000","last_undegraded":"2023-10-25T16:23:19.857347+0000","last_fullsized":"2023-10-25T16:23:19.857347+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:10:32.740149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.386127+0000","last_change":"2023-10-25T16:23:19.186788+0000","last_active":"2023-10-25T16:23:21.386127+0000","last_peered":"2023-10-25T16:23:21.386127+0000","last_clean":"2023-10-25T16:23:21.386127+0000","last_became_active":"2023-10-25T16:23:19.186225+0000","last_became_peered":"2023-10-25T16:23:19.186225+0000","last_unstale":"2023-10-25T16:23:21.386127+0000","last_undegraded":"2023-10-25T16:23:21.386127+0000","last_fullsized":"2023-10-25T16:23:21.386127+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:59:23.165764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"174'1","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193273+0000","last_change":"2023-10-25T16:23:18.160453+0000","last_active":"2023-10-25T16:23:22.193273+0000","last_peered":"2023-10-25T16:23:22.193273+0000","last_clean":"2023-10-25T16:23:22.193273+0000","last_became_active":"2023-10-25T16:23:18.160242+0000","last_became_peered":"2023-10-25T16:23:18.160242+0000","last_unstale":"2023-10-25T16:23:22.193273+0000","last_undegraded":"2023-10-25T16:23:22.193273+0000","last_fullsized":"2023-10-25T16:23:22.193273+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:30.230996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.458926+0000","last_change":"2023-10-25T16:23:19.187943+0000","last_active":"2023-10-25T16:23:21.458926+0000","last_peered":"2023-10-25T16:23:21.458926+0000","last_clean":"2023-10-25T16:23:21.458926+0000","last_became_active":"2023-10-25T16:23:19.187788+0000","last_became_peered":"2023-10-25T16:23:19.187788+0000","last_unstale":"2023-10-25T16:23:21.458926+0000","last_undegraded":"2023-10-25T16:23:21.458926+0000","last_fullsized":"2023-10-25T16:23:21.458926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:02.385681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.848408+0000","last_change":"2023-10-25T16:23:18.154831+0000","last_active":"2023-10-25T16:23:19.848408+0000","last_peered":"2023-10-25T16:23:19.848408+0000","last_clean":"2023-10-25T16:23:19.848408+0000","last_became_active":"2023-10-25T16:23:18.154491+0000","last_became_peered":"2023-10-25T16:23:18.154491+0000","last_unstale":"2023-10-25T16:23:19.848408+0000","last_undegraded":"2023-10-25T16:23:19.848408+0000","last_fullsized":"2023-10-25T16:23:19.848408+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:31:57.283692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:22.193468+0000","last_change":"2023-10-25T16:23:19.190322+0000","last_active":"2023-10-25T16:23:22.193468+0000","last_peered":"2023-10-25T16:23:22.193468+0000","last_clean":"2023-10-25T16:23:22.193468+0000","last_became_active":"2023-10-25T16:23:19.189841+0000","last_became_peered":"2023-10-25T16:23:19.189841+0000","last_unstale":"2023-10-25T16:23:22.193468+0000","last_undegraded":"2023-10-25T16:23:22.193468+0000","last_fullsized":"2023-10-25T16:23:22.193468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:59:36.017686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.848535+0000","last_change":"2023-10-25T16:23:18.154686+0000","last_active":"2023-10-25T16:23:19.848535+0000","last_peered":"2023-10-25T16:23:19.848535+0000","last_clean":"2023-10-25T16:23:19.848535+0000","last_became_active":"2023-10-25T16:23:18.154437+0000","last_became_peered":"2023-10-25T16:23:18.154437+0000","last_unstale":"2023-10-25T16:23:19.848535+0000","last_undegraded":"2023-10-25T16:23:19.848535+0000","last_fullsized":"2023-10-25T16:23:19.848535+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:14:28.241432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:20.176387+0000","last_change":"2023-10-25T16:23:19.202744+0000","last_active":"2023-10-25T16:23:20.176387+0000","last_peered":"2023-10-25T16:23:20.176387+0000","last_clean":"2023-10-25T16:23:20.176387+0000","last_became_active":"2023-10-25T16:23:19.198149+0000","last_became_peered":"2023-10-25T16:23:19.198149+0000","last_unstale":"2023-10-25T16:23:20.176387+0000","last_undegraded":"2023-10-25T16:23:20.176387+0000","last_fullsized":"2023-10-25T16:23:20.176387+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:13:10.662623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844916+0000","last_change":"2023-10-25T16:23:18.162041+0000","last_active":"2023-10-25T16:23:19.844916+0000","last_peered":"2023-10-25T16:23:19.844916+0000","last_clean":"2023-10-25T16:23:19.844916+0000","last_became_active":"2023-10-25T16:23:18.161793+0000","last_became_peered":"2023-10-25T16:23:18.161793+0000","last_unstale":"2023-10-25T16:23:19.844916+0000","last_undegraded":"2023-10-25T16:23:19.844916+0000","last_fullsized":"2023-10-25T16:23:19.844916+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:58:01.371271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456599+0000","last_change":"2023-10-25T16:23:19.192438+0000","last_active":"2023-10-25T16:23:21.456599+0000","last_peered":"2023-10-25T16:23:21.456599+0000","last_clean":"2023-10-25T16:23:21.456599+0000","last_became_active":"2023-10-25T16:23:19.192213+0000","last_became_peered":"2023-10-25T16:23:19.192213+0000","last_unstale":"2023-10-25T16:23:21.456599+0000","last_undegraded":"2023-10-25T16:23:21.456599+0000","last_fullsized":"2023-10-25T16:23:21.456599+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:45.403239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.857371+0000","last_change":"2023-10-25T16:23:18.173060+0000","last_active":"2023-10-25T16:23:19.857371+0000","last_peered":"2023-10-25T16:23:19.857371+0000","last_clean":"2023-10-25T16:23:19.857371+0000","last_became_active":"2023-10-25T16:23:18.171579+0000","last_became_peered":"2023-10-25T16:23:18.171579+0000","last_unstale":"2023-10-25T16:23:19.857371+0000","last_undegraded":"2023-10-25T16:23:19.857371+0000","last_fullsized":"2023-10-25T16:23:19.857371+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:15:02.569843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456101+0000","last_change":"2023-10-25T16:23:19.192244+0000","last_active":"2023-10-25T16:23:21.456101+0000","last_peered":"2023-10-25T16:23:21.456101+0000","last_clean":"2023-10-25T16:23:21.456101+0000","last_became_active":"2023-10-25T16:23:19.191971+0000","last_became_peered":"2023-10-25T16:23:19.191971+0000","last_unstale":"2023-10-25T16:23:21.456101+0000","last_undegraded":"2023-10-25T16:23:21.456101+0000","last_fullsized":"2023-10-25T16:23:21.456101+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:41:35.760630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.854129+0000","last_change":"2023-10-25T16:23:18.169800+0000","last_active":"2023-10-25T16:23:19.854129+0000","last_peered":"2023-10-25T16:23:19.854129+0000","last_clean":"2023-10-25T16:23:19.854129+0000","last_became_active":"2023-10-25T16:23:18.167411+0000","last_became_peered":"2023-10-25T16:23:18.167411+0000","last_unstale":"2023-10-25T16:23:19.854129+0000","last_undegraded":"2023-10-25T16:23:19.854129+0000","last_fullsized":"2023-10-25T16:23:19.854129+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:13:16.298558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.456329+0000","last_change":"2023-10-25T16:23:19.198512+0000","last_active":"2023-10-25T16:23:21.456329+0000","last_peered":"2023-10-25T16:23:21.456329+0000","last_clean":"2023-10-25T16:23:21.456329+0000","last_became_active":"2023-10-25T16:23:19.198216+0000","last_became_peered":"2023-10-25T16:23:19.198216+0000","last_unstale":"2023-10-25T16:23:21.456329+0000","last_undegraded":"2023-10-25T16:23:21.456329+0000","last_fullsized":"2023-10-25T16:23:21.456329+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:50:15.669885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.844392+0000","last_change":"2023-10-25T16:23:18.167697+0000","last_active":"2023-10-25T16:23:19.844392+0000","last_peered":"2023-10-25T16:23:19.844392+0000","last_clean":"2023-10-25T16:23:19.844392+0000","last_became_active":"2023-10-25T16:23:18.167237+0000","last_became_peered":"2023-10-25T16:23:18.167237+0000","last_unstale":"2023-10-25T16:23:19.844392+0000","last_undegraded":"2023-10-25T16:23:19.844392+0000","last_fullsized":"2023-10-25T16:23:19.844392+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:04:45.270861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-25T16:23:21.457074+0000","last_change":"2023-10-25T16:23:19.191002+0000","last_active":"2023-10-25T16:23:21.457074+0000","last_peered":"2023-10-25T16:23:21.457074+0000","last_clean":"2023-10-25T16:23:21.457074+0000","last_became_active":"2023-10-25T16:23:19.190626+0000","last_became_peered":"2023-10-25T16:23:19.190626+0000","last_unstale":"2023-10-25T16:23:21.457074+0000","last_undegraded":"2023-10-25T16:23:21.457074+0000","last_fullsized":"2023-10-25T16:23:21.457074+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:18.133185+0000","last_clean_scrub_stamp":"2023-10-25T16:23:18.133185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:36:57.019418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"173'3","reported_seq":15,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.854103+0000","last_change":"2023-10-25T16:23:18.170261+0000","last_active":"2023-10-25T16:23:19.854103+0000","last_peered":"2023-10-25T16:23:19.854103+0000","last_clean":"2023-10-25T16:23:19.854103+0000","last_became_active":"2023-10-25T16:23:18.168947+0000","last_became_peered":"2023-10-25T16:23:18.168947+0000","last_unstale":"2023-10-25T16:23:19.854103+0000","last_undegraded":"2023-10-25T16:23:19.854103+0000","last_fullsized":"2023-10-25T16:23:19.854103+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:23:17.118775+0000","last_clean_scrub_stamp":"2023-10-25T16:23:17.118775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:38:37.021632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":312,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-25T16:23:19.172944+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:23:19.172944+0000","last_peered":"2023-10-25T16:23:19.172944+0000","last_clean":"2023-10-25T16:23:19.172944+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:23:19.172944+0000","last_undegraded":"2023-10-25T16:23:19.172944+0000","last_fullsized":"2023-10-25T16:23:19.172944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":959,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194352,"statfs":{"total":200000000,"available":199017352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.63200000000000001,"15min":0.55800000000000005},"min":{"1min":0.315,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67700000000000005,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.98399999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.61799999999999999},"min":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.27000000000000002},"max":{"1min":1.0249999999999999,"5min":1.145,"15min":1.1759999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":0.91500000000000004,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66600000000000004,"15min":0.63100000000000001},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":1.159,"15min":1.246},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.69899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.153,"5min":1.2729999999999999,"15min":1.345},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.96899999999999997,"15min":0.879},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.3029999999999999,"5min":1.45,"15min":1.6120000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.95299999999999996,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.48099999999999998,"15min":0.47499999999999998},"max":{"1min":1.2729999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.91500000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.91200000000000003,"15min":0.87},"min":{"1min":0.64400000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.2649999999999999,"5min":1.46,"15min":1.4930000000000001},"last":1.107},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.94799999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.3280000000000001,"5min":1.518,"15min":1.671},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.999,"15min":0.93400000000000005},"min":{"1min":0.63400000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.29,"5min":1.3440000000000001,"15min":1.5009999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.008,"5min":0.99199999999999999,"15min":0.94699999999999995},"min":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.369,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":1.042}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.03,"15min":0.96299999999999997},"min":{"1min":0.56899999999999995,"5min":0.55100000000000005,"15min":0.51800000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.677},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0229999999999999,"15min":0.98499999999999999},"min":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.95999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1535,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193777,"statfs":{"total":200000000,"available":198428014,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83699999999999997,"15min":0.78700000000000003},"min":{"1min":0.57799999999999996,"5min":0.51800000000000002,"15min":0.35899999999999999},"max":{"1min":1.24,"5min":1.24,"15min":1.256},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84899999999999998,"15min":0.83999999999999997},"min":{"1min":0.61799999999999999,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.534},"last":0.59899999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96299999999999997,"15min":0.91000000000000003},"min":{"1min":0.51200000000000001,"5min":0.46300000000000002,"15min":0.42899999999999999},"max":{"1min":1.4259999999999999,"5min":1.647,"15min":1.647},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94399999999999995,"15min":0.92200000000000004},"min":{"1min":0.70899999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2030000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89200000000000002,"15min":0.85699999999999998},"min":{"1min":0.55100000000000005,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":1.234,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.873,"15min":0.85199999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1879999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.996,"15min":0.98199999999999998},"min":{"1min":0.78900000000000003,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.3360000000000001,"5min":1.51,"15min":1.51},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0249999999999999,"15min":0.97699999999999998},"min":{"1min":0.69099999999999995,"5min":0.57999999999999996,"15min":0.51500000000000001},"max":{"1min":1.3600000000000001,"5min":1.548,"15min":1.548},"last":0.90200000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.58299999999999996,"5min":0.44,"15min":0.44},"max":{"1min":1.262,"5min":1.478,"15min":1.4910000000000001},"last":1.109},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.93300000000000005,"15min":0.97099999999999997},"min":{"1min":0.61799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.86499999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.96499999999999997,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2909999999999999,"5min":1.696,"15min":1.7370000000000001},"last":1.151},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.998,"15min":1.0229999999999999},"min":{"1min":0.67700000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.234}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.496,"5min":1.643,"15min":1.669},"last":1.206},{"interface":"front","average":{"1min":1.125,"5min":1.1060000000000001,"15min":1.117},"min":{"1min":0.77900000000000003,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.54,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.321}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":958,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194354,"statfs":{"total":200000000,"available":199018888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.56299999999999994,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0309999999999999,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0269999999999999,"15min":0.93500000000000005},"min":{"1min":0.64200000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.3839999999999999,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.96099999999999997,"15min":0.90900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.276,"5min":10.667,"15min":10.667},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.0289999999999999,"15min":0.94699999999999995},"min":{"1min":0.63100000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1699999999999999,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":0.91900000000000004},"min":{"1min":0.67800000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.2350000000000001,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0669999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.238,"5min":10.948,"15min":10.948},"last":1.022}]},{"osd":3,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.93400000000000005,"15min":0.92800000000000005},"min":{"1min":0.68799999999999994,"5min":0.60599999999999998,"15min":0.53600000000000003},"max":{"1min":1.228,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.141,"15min":1.0760000000000001},"min":{"1min":0.88900000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.296,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":0.78800000000000003}]},{"osd":4,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0609999999999999,"15min":0.98599999999999999},"min":{"1min":0.64200000000000002,"5min":0.48699999999999999,"15min":0.41499999999999998},"max":{"1min":1.3919999999999999,"5min":11.081,"15min":11.081},"last":0.876},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.94399999999999995,"15min":0.96799999999999997},"min":{"1min":0.73899999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.008,"15min":0.98599999999999999},"min":{"1min":0.82199999999999995,"5min":0.54600000000000004,"15min":0.44600000000000001},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.1259999999999999,"15min":1.0780000000000001},"min":{"1min":0.79800000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.484,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.121}]},{"osd":7,"last update":"Wed Oct 25 16:23:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.25,"15min":1.141},"min":{"1min":0.84699999999999998,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.4950000000000001,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.091},{"interface":"front","average":{"1min":1.145,"5min":1.151,"15min":1.087},"min":{"1min":0.90900000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.671,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.1619999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":957,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194354,"statfs":{"total":200000000,"available":199019012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.88500000000000001,"15min":1.1279999999999999},"min":{"1min":0.66700000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.224,"5min":2.1429999999999998,"15min":14.843},"last":1.194},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85999999999999999,"15min":1.1819999999999999},"min":{"1min":0.58699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.111,"5min":2.8450000000000002,"15min":16.439},"last":0.93899999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91800000000000004,"15min":1.1739999999999999},"min":{"1min":0.57199999999999995,"5min":0.443,"15min":0.40100000000000002},"max":{"1min":1.1559999999999999,"5min":1.423,"15min":14.630000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.92700000000000005,"15min":0.89700000000000002},"min":{"1min":0.69599999999999995,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2430000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0569999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.95099999999999996},"min":{"1min":0.627,"5min":0.5,"15min":0.5},"max":{"1min":1.22,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.995},{"interface":"front","average":{"1min":0.999,"5min":0.96099999999999997,"15min":0.96899999999999997},"min":{"1min":0.76500000000000001,"5min":0.53800000000000003,"15min":0.48499999999999999},"max":{"1min":1.248,"5min":1.921,"15min":1.921},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.97199999999999998,"15min":0.98399999999999999},"min":{"1min":0.80400000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.179,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.044,"15min":1.302},"min":{"1min":0.68200000000000005,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.2829999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.032,"15min":1.321},"min":{"1min":0.56999999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3029999999999999,"5min":1.9910000000000001,"15min":15.904},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.93899999999999995,"15min":1.298},"min":{"1min":0.63600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.0840000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":1.2450000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.044,"15min":1.288},"min":{"1min":0.69499999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.2689999999999999,"5min":4.5970000000000004,"15min":14.567},"last":0.876},{"interface":"front","average":{"1min":1.133,"5min":1.139,"15min":1.4419999999999999},"min":{"1min":0.81299999999999994,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.421,"5min":2.4079999999999999,"15min":15.089},"last":1.2929999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.0209999999999999,"15min":1.395},"min":{"1min":0.748,"5min":0.436,"15min":0.436},"max":{"1min":1.1679999999999999,"5min":7.8730000000000002,"15min":17.492000000000001},"last":1.085},{"interface":"front","average":{"1min":1.107,"5min":1.171,"15min":1.2190000000000001},"min":{"1min":0.81599999999999995,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3220000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.131}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":957,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194354,"statfs":{"total":200000000,"available":199019034,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.86399999999999999,"15min":0.82899999999999996},"min":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.48399999999999999},"max":{"1min":1.2190000000000001,"5min":1.3,"15min":1.47},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.87,"15min":0.83899999999999997},"min":{"1min":0.46999999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.1539999999999999,"5min":1.274,"15min":1.3029999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.874,"15min":0.84899999999999998},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.0149999999999999,"15min":0.97199999999999998},"min":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.429,"5min":1.47,"15min":1.4990000000000001},"last":1.173}]},{"osd":2,"last update":"Wed Oct 25 16:22:30 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.88500000000000001,"15min":0.85299999999999998},"min":{"1min":0.72899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1379999999999999,"5min":1.341,"15min":1.419},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.66100000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.90000000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93400000000000005,"15min":0.92500000000000004},"min":{"1min":0.64500000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.258,"5min":1.5,"15min":1.5},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.86499999999999999,"15min":0.82599999999999996},"min":{"1min":0.52800000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.24,"5min":1.3140000000000001,"15min":1.518},"last":0.80400000000000005}]},{"osd":5,"last update":"Wed Oct 25 16:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.89700000000000002,"15min":0.93600000000000005},"min":{"1min":0.56799999999999995,"5min":0.313,"15min":0.313},"max":{"1min":1.3899999999999999,"5min":1.599,"15min":2.6640000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.091,"5min":1.115,"15min":1.1200000000000001},"min":{"1min":0.60099999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.508,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.006}]},{"osd":6,"last update":"Wed Oct 25 16:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":0.96999999999999997},"min":{"1min":0.61099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":2.085},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0589999999999999,"15min":1.0700000000000001},"min":{"1min":0.70499999999999996,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.2949999999999999,"5min":1.625,"15min":1.8149999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:23:24 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94499999999999995,"15min":0.94999999999999996},"min":{"1min":0.58599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.357,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.129,"15min":1.123},"min":{"1min":0.71299999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.3009999999999999,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.137}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":958,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194354,"statfs":{"total":200000000,"available":199018944,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.59199999999999997},"min":{"1min":0.35999999999999999,"5min":0.27200000000000002,"15min":0.22},"max":{"1min":1.002,"5min":1.093,"15min":1.093},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.317,"15min":0.222},"max":{"1min":0.95699999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.57799999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70499999999999996,"15min":0.66100000000000003},"min":{"1min":0.33200000000000002,"5min":0.247,"15min":0.19700000000000001},"max":{"1min":0.86799999999999999,"5min":1.425,"15min":1.425},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81699999999999995,"15min":0.745},"min":{"1min":0.441,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.103,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.375}]},{"osd":2,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.433,"5min":0.32800000000000001,"15min":0.28000000000000003},"max":{"1min":1.1220000000000001,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.309},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.2330000000000001,"5min":1.25,"15min":1.8260000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91900000000000004,"15min":0.89100000000000001},"min":{"1min":0.60399999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1240000000000001,"5min":1.234,"15min":1.234},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.018,"5min":1.02,"15min":0.99399999999999999},"min":{"1min":0.71499999999999997,"5min":0.56599999999999995,"15min":0.51300000000000001},"max":{"1min":1.349,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.94899999999999995,"15min":0.93000000000000005},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.45400000000000001},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.99399999999999999,"15min":0.96199999999999997},"min":{"1min":0.63700000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2050000000000001,"5min":1.2410000000000001,"15min":1.4830000000000001},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96099999999999997,"15min":0.92000000000000004},"min":{"1min":0.66000000000000003,"5min":0.56799999999999995,"15min":0.46600000000000003},"max":{"1min":1.1659999999999999,"5min":1.3089999999999999,"15min":1.456},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.016,"15min":1.0009999999999999},"min":{"1min":0.66800000000000004,"5min":0.54700000000000004,"15min":0.505},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":0.61699999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.0429999999999999,"15min":0.998},"min":{"1min":0.66400000000000003,"5min":0.63300000000000001,"15min":0.504},"max":{"1min":1.2849999999999999,"5min":1.508,"15min":1.5660000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0109999999999999,"15min":0.97199999999999998},"min":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.51500000000000001},"max":{"1min":1.226,"5min":1.3480000000000001,"15min":1.389},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":958,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194353,"statfs":{"total":200000000,"available":199018452,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.90900000000000003,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.69099999999999995,"15min":0.65600000000000003},"min":{"1min":0.50800000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.1990000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.622,"15min":0.58599999999999997},"min":{"1min":0.46999999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94599999999999995,"5min":0.98599999999999999,"15min":1.4610000000000001},"last":0.496},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.43099999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.68000000000000005,"15min":0.65400000000000003},"min":{"1min":0.375,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.995,"5min":0.995,"15min":1.1399999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79100000000000004,"15min":0.76100000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.28000000000000003},"max":{"1min":1.0409999999999999,"5min":1.1499999999999999,"15min":1.423},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90200000000000002,"15min":0.95999999999999996},"min":{"1min":0.625,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1200000000000001,"5min":1.242,"15min":12.698},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.03,"5min":0.95999999999999996,"15min":1.016},"min":{"1min":0.80800000000000005,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.1799999999999999,"5min":1.23,"15min":12.721},"last":1.141}]},{"osd":5,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.94199999999999995,"15min":0.92700000000000005},"min":{"1min":0.77500000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.546},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.876,"15min":0.89000000000000001},"min":{"1min":0.63900000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.206,"5min":1.2549999999999999,"15min":2.206},"last":1.206}]},{"osd":6,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1,"15min":0.96299999999999997},"min":{"1min":0.82299999999999995,"5min":0.65000000000000002,"15min":0.49099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.4610000000000001},"last":1.321},{"interface":"front","average":{"1min":1.121,"5min":1.0389999999999999,"15min":1.0269999999999999},"min":{"1min":0.95099999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.5980000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.96499999999999997,"15min":0.997},"min":{"1min":0.72999999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"max":{"1min":1.2270000000000001,"5min":1.3100000000000001,"15min":14.776},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0089999999999999,"15min":1.032},"min":{"1min":0.80500000000000005,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.369,"5min":1.369,"15min":10.509},"last":1.25}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1536,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193776,"statfs":{"total":200000000,"available":198427020,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60299999999999998,"15min":0.64900000000000002},"min":{"1min":0.40600000000000003,"5min":0.248,"15min":0.217},"max":{"1min":0.85699999999999998,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.72099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.262,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.44}]},{"osd":2,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64100000000000001,"15min":0.65800000000000003},"min":{"1min":0.504,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":0.71599999999999997,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.751,"15min":0.72299999999999998},"min":{"1min":0.60199999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.0960000000000001,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.81100000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.44900000000000001,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.024,"5min":4.431,"15min":4.431},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.85899999999999999,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.1899999999999999,"5min":1.296,"15min":3.6579999999999999},"last":0.93200000000000005}]},{"osd":4,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.86099999999999999},"min":{"1min":0.66500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.024,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":1.181},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.2210000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":1.052}]},{"osd":5,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.94499999999999995,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1499999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97999999999999998,"15min":0.95599999999999996},"min":{"1min":0.67800000000000005,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1850000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":1.119}]},{"osd":6,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0249999999999999,"15min":0.98899999999999999},"min":{"1min":0.70199999999999996,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.619,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.028},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0089999999999999,"15min":0.95499999999999996},"min":{"1min":0.77700000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":1.0049999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:23:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0309999999999999,"15min":1.1719999999999999},"min":{"1min":0.78600000000000003,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.054,"15min":1.1899999999999999},"min":{"1min":0.73799999999999999,"5min":0.64900000000000002,"15min":0.59799999999999998},"max":{"1min":1.2290000000000001,"5min":1.4159999999999999,"15min":11.622},"last":0.85399999999999998}]}]}],"pool_statfs":[]}} 2023-10-25T16:23:27.019 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:23:27.020 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:23:27.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.192+0000 7f2f737e7640 1 -- 172.21.15.177:0/2574993135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 msgr2=0x7f2f6c069720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.192+0000 7f2f737e7640 1 --2- 172.21.15.177:0/2574993135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c069720 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0ca9f0 tx=0x7f2f5c01c5e0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/2574993135 shutdown_connections 2023-10-25T16:23:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 --2- 172.21.15.177:0/2574993135 >> v2:172.21.15.184:3300/0 conn(0x7f2f6c069c60 0x7f2f6c06c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 --2- 172.21.15.177:0/2574993135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c069720 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 --2- 172.21.15.177:0/2574993135 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6c15b470 0x7f2f6c15f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/2574993135 >> 172.21.15.177:0/2574993135 conn(0x7f2f6c0afbf0 msgr2=0x7f2f6c0b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/2574993135 shutdown_connections 2023-10-25T16:23:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/2574993135 wait complete. 2023-10-25T16:23:27.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 Processor -- start 2023-10-25T16:23:27.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- start start 2023-10-25T16:23:27.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6c069c60 0x7f2f6c153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6c15b470 0x7f2f6c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c7a50 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c7490 con 0x7f2f6c15b470 2023-10-25T16:23:27.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c7770 con 0x7f2f6c069c60 2023-10-25T16:23:27.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37070/0 (socket says 172.21.15.177:37070) 2023-10-25T16:23:27.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 -- 172.21.15.177:0/1810756462 learned_addr learned my addr 172.21.15.177:0/1810756462 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:27.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f71583640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6c069c60 0x7f2f6c153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f71d84640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6c15b470 0x7f2f6c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 -- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6c069c60 msgr2=0x7f2f6c153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6c069c60 0x7f2f6c153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 -- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6c15b470 msgr2=0x7f2f6c0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6c15b470 0x7f2f6c0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 -- 172.21.15.177:0/1810756462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c009560 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f70d82640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c153fa0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c01ac90 tx=0x7f2f5c0a9480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0b7070 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f5c004040 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c004430 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0ab000 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c147670 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.196+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c04db20 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.200+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f5c005030 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.200+0000 7f2f61ffb640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f50066470 0x7f2f50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.200+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f5c11e420 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.200+0000 7f2f71583640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f50066470 0x7f2f50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.200+0000 7f2f71583640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f50066470 0x7f2f50068930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c1660d0 tx=0x7f2f640091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:27.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.204+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f5c0eb930 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.396+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2f6c0ab4b0 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f61ffb640 1 -- 172.21.15.177:0/1810756462 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v33) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2f5c0ad0b0 con 0x7f2f6c0c2e60 2023-10-25T16:23:27.400 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:23:27.400 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:23:27.400 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:23:27.401 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:23:27.401 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:23:27.402 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:23:27.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f50066470 msgr2=0x7f2f50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f50066470 0x7f2f50068930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c1660d0 tx=0x7f2f640091e0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 msgr2=0x7f2f6c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c153fa0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c01ac90 tx=0x7f2f5c0a9480 comp rx=0 tx=0).stop 2023-10-25T16:23:27.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 shutdown_connections 2023-10-25T16:23:27.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2f50066470 0x7f2f50068930 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6c15b470 0x7f2f6c0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0c2e60 0x7f2f6c153fa0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 --2- 172.21.15.177:0/1810756462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6c069c60 0x7f2f6c153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 >> 172.21.15.177:0/1810756462 conn(0x7f2f6c0afbf0 msgr2=0x7f2f6c1518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:27.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 shutdown_connections 2023-10-25T16:23:27.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.404+0000 7f2f737e7640 1 -- 172.21.15.177:0/1810756462 wait complete. 2023-10-25T16:23:27.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:27.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/3219880309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c0706f0 msgr2=0x7fdb4c070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/3219880309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c070b00 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fdb44009bc0 tx=0x7fdb4401cb50 comp rx=0 tx=0).stop 2023-10-25T16:23:27.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/3219880309 shutdown_connections 2023-10-25T16:23:27.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/3219880309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c070b00 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/3219880309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb4c06b9e0 0x7fdb4c06be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/3219880309 >> 172.21.15.177:0/3219880309 conn(0x7fdb4c0b2450 msgr2=0x7fdb4c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:27.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/3219880309 shutdown_connections 2023-10-25T16:23:27.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/3219880309 wait complete. 2023-10-25T16:23:27.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 Processor -- start 2023-10-25T16:23:27.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- start start 2023-10-25T16:23:27.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb4c06b9e0 0x7fdb4c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 0x7fdb4c146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c14a790 con 0x7fdb4c1500f0 2023-10-25T16:23:27.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b01d0 con 0x7fdb4c0706f0 2023-10-25T16:23:27.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c0b04b0 con 0x7fdb4c06b9e0 2023-10-25T16:23:27.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 0x7fdb4c146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 0x7fdb4c146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37080/0 (socket says 172.21.15.177:37080) 2023-10-25T16:23:27.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 -- 172.21.15.177:0/4246237282 learned_addr learned my addr 172.21.15.177:0/4246237282 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:27.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb49d9b640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 -- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb4c06b9e0 msgr2=0x7fdb4c14fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb4c06b9e0 0x7fdb4c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 -- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb4c0706f0 msgr2=0x7fdb4c144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 -- 172.21.15.177:0/4246237282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009820 con 0x7fdb4c1500f0 2023-10-25T16:23:27.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb49d9b640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:27.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb4ad9d640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 0x7fdb4c146270 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fdb4401c5c0 tx=0x7fdb44009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:27.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44003c40 con 0x7fdb4c1500f0 2023-10-25T16:23:27.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdb44003e90 con 0x7fdb4c1500f0 2023-10-25T16:23:27.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c0b0790 con 0x7fdb4c1500f0 2023-10-25T16:23:27.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440053c0 con 0x7fdb4c1500f0 2023-10-25T16:23:27.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.544+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c1467b0 con 0x7fdb4c1500f0 2023-10-25T16:23:27.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.548+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c04daf0 con 0x7fdb4c1500f0 2023-10-25T16:23:27.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.548+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb440b4040 con 0x7fdb4c1500f0 2023-10-25T16:23:27.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.548+0000 7fdb3affd640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb2c066470 0x7fdb2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:27.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.548+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb4411ee20 con 0x7fdb4c1500f0 2023-10-25T16:23:27.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.548+0000 7fdb4a59c640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb2c066470 0x7fdb2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:27.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.548+0000 7fdb4a59c640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb2c066470 0x7fdb2c068930 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007fd0 tx=0x7fdb3c007920 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:27.550 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.552+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb440ec330 con 0x7fdb4c1500f0 2023-10-25T16:23:27.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb4c0b0c40 con 0x7fdb4c1500f0 2023-10-25T16:23:27.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb3affd640 1 -- 172.21.15.177:0/4246237282 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fdb440b2020 con 0x7fdb4c1500f0 2023-10-25T16:23:27.725 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:27.725 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:23:27.726 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:23:27.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb2c066470 msgr2=0x7fdb2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb2c066470 0x7fdb2c068930 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007fd0 tx=0x7fdb3c007920 comp rx=0 tx=0).stop 2023-10-25T16:23:27.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 msgr2=0x7fdb4c146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:27.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 0x7fdb4c146270 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fdb4401c5c0 tx=0x7fdb44009330 comp rx=0 tx=0).stop 2023-10-25T16:23:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 shutdown_connections 2023-10-25T16:23:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdb2c066470 0x7fdb2c068930 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb4c1500f0 0x7fdb4c146270 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb4c0706f0 0x7fdb4c144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 --2- 172.21.15.177:0/4246237282 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdb4c06b9e0 0x7fdb4c14fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:27.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 >> 172.21.15.177:0/4246237282 conn(0x7fdb4c0b2450 msgr2=0x7fdb4c14d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:27.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 shutdown_connections 2023-10-25T16:23:27.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:27.728+0000 7fdb50e9e640 1 -- 172.21.15.177:0/4246237282 wait complete. 2023-10-25T16:23:28.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:23:18.494020+0000', 'modified': '2023-10-25T16:23:20.527685+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 156116}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_156116': {'gid': 156116, 'name': 'd', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6836/242379515', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 242379515}, {'type': 'v1', 'addr': '172.21.15.184:6836', 'nonce': 242379515}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:23:28.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:23:28.146 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-25T16:23:28.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 -- 172.21.15.177:0/3286211431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7face8005190 msgr2=0x7face800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 --2- 172.21.15.177:0/3286211431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7face8005190 0x7face800b990 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7facf4009e30 tx=0x7facf401d190 comp rx=0 tx=0).stop 2023-10-25T16:23:28.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 -- 172.21.15.177:0/3286211431 shutdown_connections 2023-10-25T16:23:28.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 --2- 172.21.15.177:0/3286211431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7face8005190 0x7face800b990 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 -- 172.21.15.177:0/3286211431 >> 172.21.15.177:0/3286211431 conn(0x7facfc0b2450 msgr2=0x7facfc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 -- 172.21.15.177:0/3286211431 shutdown_connections 2023-10-25T16:23:28.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 -- 172.21.15.177:0/3286211431 wait complete. 2023-10-25T16:23:28.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 Processor -- start 2023-10-25T16:23:28.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.288+0000 7fad04082640 1 -- start start 2023-10-25T16:23:28.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7face8005190 0x7facfc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 0x7facfc1469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facfc146f00 0x7facfc1343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc147fd0 con 0x7facfc144c30 2023-10-25T16:23:28.290 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc1473c0 con 0x7face8005190 2023-10-25T16:23:28.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc1476a0 con 0x7facfc146f00 2023-10-25T16:23:28.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 0x7facfc1469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 0x7facfc1469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37102/0 (socket says 172.21.15.177:37102) 2023-10-25T16:23:28.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 -- 172.21.15.177:0/2312654406 learned_addr learned my addr 172.21.15.177:0/2312654406 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:28.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad01e1e640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7face8005190 0x7facfc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0261f640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facfc146f00 0x7facfc1343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 -- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facfc146f00 msgr2=0x7facfc1343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facfc146f00 0x7facfc1343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 -- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7face8005190 msgr2=0x7facfc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7face8005190 0x7facfc0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 -- 172.21.15.177:0/2312654406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0b2030 con 0x7facfc144c30 2023-10-25T16:23:28.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0261f640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facfc146f00 0x7facfc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:28.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad0161d640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 0x7facfc1469c0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7facec004dc0 tx=0x7facec001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7facf27fc640 1 -- 172.21.15.177:0/2312654406 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0105d0 con 0x7facfc144c30 2023-10-25T16:23:28.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7facf27fc640 1 -- 172.21.15.177:0/2312654406 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7facec010860 con 0x7facfc144c30 2023-10-25T16:23:28.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7facf27fc640 1 -- 172.21.15.177:0/2312654406 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec010c70 con 0x7facfc144c30 2023-10-25T16:23:28.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc147980 con 0x7facfc144c30 2023-10-25T16:23:28.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc148460 con 0x7facfc144c30 2023-10-25T16:23:28.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7facf27fc640 1 -- 172.21.15.177:0/2312654406 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7facec01b460 con 0x7facfc144c30 2023-10-25T16:23:28.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7facf27fc640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7face00664a0 0x7face0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7facf27fc640 1 -- 172.21.15.177:0/2312654406 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facec084850 con 0x7facfc144c30 2023-10-25T16:23:28.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.292+0000 7fad01e1e640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7face00664a0 0x7face0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 Processor -- start 2023-10-25T16:23:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- start start 2023-10-25T16:23:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad01e1e640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7face00664a0 0x7face0068960 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7facf8001280 tx=0x7facf8000ee0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb34da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeaeaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeaeaf80 0x55c7aeaeb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae8dfcc0 con 0x55c7aeb352e0 2023-10-25T16:23:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae942920 con 0x55c7aeb349c0 2023-10-25T16:23:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae93fe50 con 0x55c7aeaeaf80 2023-10-25T16:23:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeaeaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeaeaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37114/0 (socket says 172.21.15.177:37114) 2023-10-25T16:23:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 -- 172.21.15.177:0/1739721223 learned_addr learned my addr 172.21.15.177:0/1739721223 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad01e1e640 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb34da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0261f640 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeaeaf80 0x55c7aeaeb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 -- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeaeaf80 msgr2=0x55c7aeaeb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeaeaf80 0x55c7aeaeb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 -- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 msgr2=0x55c7aeb34da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb34da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 -- 172.21.15.177:0/1739721223 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7ae634890 con 0x55c7aeb352e0 2023-10-25T16:23:28.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad0161d640 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeaeaa40 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7facec082da0 tx=0x7facec055420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37878cfe6a7cf59 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7facdf7fe640 1 -- 172.21.15.177:0/1739721223 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec05dc90 con 0x55c7aeb352e0 2023-10-25T16:23:28.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7facdf7fe640 1 -- 172.21.15.177:0/1739721223 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7facec053ad0 con 0x55c7aeb352e0 2023-10-25T16:23:28.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7facdf7fe640 1 -- 172.21.15.177:0/1739721223 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec06d1c0 con 0x55c7aeb352e0 2023-10-25T16:23:28.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- 172.21.15.177:0/1739721223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 msgr2=0x55c7aeaeaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeaeaa40 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7facec082da0 tx=0x7facec055420 comp rx=0 tx=0).stop 2023-10-25T16:23:28.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- 172.21.15.177:0/1739721223 shutdown_connections 2023-10-25T16:23:28.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeaeaf80 0x55c7aeaeb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeaeaa40 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- 172.21.15.177:0/1739721223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb34da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- 172.21.15.177:0/1739721223 >> 172.21.15.177:0/1739721223 conn(0x55c7aeae22f0 msgr2=0x55c7aeae9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- 172.21.15.177:0/1739721223 shutdown_connections 2023-10-25T16:23:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- 172.21.15.177:0/1739721223 wait complete. 2023-10-25T16:23:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- start start 2023-10-25T16:23:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 Processor -- start 2023-10-25T16:23:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 0x55c7aeaf03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeaf08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeaf6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae93b740 con 0x55c7aeaeaf80 2023-10-25T16:23:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae8fad10 con 0x55c7aeb352e0 2023-10-25T16:23:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae8fa9b0 con 0x55c7aeb349c0 2023-10-25T16:23:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.296+0000 7fad071cc000 10 client.0 _ll_register_callbacks cb 0x55c7aead66c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:23:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 0x55c7aeaf03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 0x55c7aeaf03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37128/0 (socket says 172.21.15.177:37128) 2023-10-25T16:23:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 -- 172.21.15.177:0/3556185119 learned_addr learned my addr 172.21.15.177:0/3556185119 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad0261f640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeaf6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad0161d640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeaf08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 -- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 msgr2=0x55c7aeaf08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeaf08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 -- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 msgr2=0x55c7aeaf6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeaf6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 -- 172.21.15.177:0/3556185119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc148460 con 0x55c7aeaeaf80 2023-10-25T16:23:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad01e1e640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 0x55c7aeaf03b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7facf8010f30 tx=0x7facf8001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd638b044eecdff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:23:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 1 -- 172.21.15.177:0/3556185119 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf801f640 con 0x55c7aeaeaf80 2023-10-25T16:23:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 1 -- 172.21.15.177:0/3556185119 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf8023820 con 0x55c7aeaeaf80 2023-10-25T16:23:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7ae8ef370 con 0x55c7aeaeaf80 2023-10-25T16:23:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 1 -- 172.21.15.177:0/3556185119 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf80239e0 con 0x55c7aeaeaf80 2023-10-25T16:23:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 10 client.9306 fetch_fsmap learned FSMap version 65 2023-10-25T16:23:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55c7ae8fd460 con 0x55c7aeaeaf80 2023-10-25T16:23:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 1 -- 172.21.15.177:0/3556185119 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55c7ae8ef370 con 0x55c7aeaeaf80 2023-10-25T16:23:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 1 -- 172.21.15.177:0/3556185119 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7facf801a070 con 0x55c7aeaeaf80 2023-10-25T16:23:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 10 client.9306 fetch_fsmap finished waiting for FSMap version 65 2023-10-25T16:23:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 10 client.9306 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:23:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 20 client.9306 populate_metadata read hostname 'smithi177' 2023-10-25T16:23:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeaf75f0 0x55c7aeb46a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 4 client.9306 mds_command: new command op to 156116 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:23:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 --> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7ae8d52d0 con 0x55c7aeaf75f0 2023-10-25T16:23:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad0161d640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeaf75f0 0x55c7aeb46a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 10 client.9306 ms_handle_connect on v2:172.21.15.184:6834/242379515 2023-10-25T16:23:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad0161d640 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeaf75f0 0x55c7aeb46a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=871f8a8e33070d31 server_cookie=d4e3cc569b6cbf5d in_seq=0 out_seq=0 2023-10-25T16:23:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 1 -- 172.21.15.177:0/3556185119 <== mds.0 v2:172.21.15.184:6834/242379515 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7ae8d52d0 con 0x55c7aeaf75f0 2023-10-25T16:23:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 10 client.9306 handle_command_reply: tid=0 2023-10-25T16:23:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 client.9306 shutdown 2023-10-25T16:23:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 msgr2=0x55c7aeaf03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 0x55c7aeaf03b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7facf8010f30 tx=0x7facf8001ba0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 shutdown_connections 2023-10-25T16:23:28.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeaf75f0 0x55c7aeb46a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeaf6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7facdcff9640 0 client.9306 ms_handle_reset on v2:172.21.15.184:6834/242379515 2023-10-25T16:23:28.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeaf08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 --2- 172.21.15.177:0/3556185119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeaeaf80 0x55c7aeaf03b0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.300+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 >> 172.21.15.177:0/3556185119 conn(0x55c7aeae22f0 msgr2=0x55c7aeae9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.304+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 shutdown_connections 2023-10-25T16:23:28.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.304+0000 7fad071cc000 1 -- 172.21.15.177:0/3556185119 wait complete. 2023-10-25T16:23:28.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.304+0000 7fad071cc000 20 client.9306 trim_cache size 0 max 16384 2023-10-25T16:23:28.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.316+0000 7fad071cc000 1 Processor -- start 2023-10-25T16:23:28.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.316+0000 7fad071cc000 1 -- start start 2023-10-25T16:23:28.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.316+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeb32bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.316+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeb330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.316+0000 7fad071cc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 0x55c7aeb44e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.316+0000 7fad071cc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae5f5940 con 0x55c7aeb44a60 2023-10-25T16:23:28.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae935a40 con 0x55c7aeb352e0 2023-10-25T16:23:28.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae9370b0 con 0x55c7aeb349c0 2023-10-25T16:23:28.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 0x55c7aeb44e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 0x55c7aeb44e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37140/0 (socket says 172.21.15.177:37140) 2023-10-25T16:23:28.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 -- 172.21.15.177:0/773870670 learned_addr learned my addr 172.21.15.177:0/773870670 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:28.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 -- 172.21.15.177:0/773870670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 msgr2=0x55c7aeb32bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeb32bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 -- 172.21.15.177:0/773870670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 msgr2=0x55c7aeb330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeb330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 -- 172.21.15.177:0/773870670 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7ae8e3760 con 0x55c7aeb44a60 2023-10-25T16:23:28.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0261f640 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 0x55c7aeb44e40 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7facf4009d50 tx=0x7face8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57359e6b25922da1 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdffff640 1 -- 172.21.15.177:0/773870670 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4004c50 con 0x55c7aeb44a60 2023-10-25T16:23:28.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdffff640 1 -- 172.21.15.177:0/773870670 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7facf4003980 con 0x55c7aeb44a60 2023-10-25T16:23:28.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdffff640 1 -- 172.21.15.177:0/773870670 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4004ea0 con 0x55c7aeb44a60 2023-10-25T16:23:28.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/773870670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 msgr2=0x55c7aeb44e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 0x55c7aeb44e40 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7facf4009d50 tx=0x7face8005800 comp rx=0 tx=0).stop 2023-10-25T16:23:28.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/773870670 shutdown_connections 2023-10-25T16:23:28.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb44a60 0x55c7aeb44e40 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb352e0 0x55c7aeb330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- 172.21.15.177:0/773870670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb349c0 0x55c7aeb32bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/773870670 >> 172.21.15.177:0/773870670 conn(0x55c7aeae22f0 msgr2=0x55c7aeb41fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/773870670 shutdown_connections 2023-10-25T16:23:28.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/773870670 wait complete. 2023-10-25T16:23:28.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- start start 2023-10-25T16:23:28.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 Processor -- start 2023-10-25T16:23:28.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb32c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeb4fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb44a60 0x55c7aeb50370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7aeae26d0 con 0x55c7aeb352e0 2023-10-25T16:23:28.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae8d52d0 con 0x55c7aeb349c0 2023-10-25T16:23:28.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7ae8ef370 con 0x55c7aeb44a60 2023-10-25T16:23:28.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 10 client.0 _ll_register_callbacks cb 0x55c7ae939ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:23:28.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeb4fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeb4fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37152/0 (socket says 172.21.15.177:37152) 2023-10-25T16:23:28.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 -- 172.21.15.177:0/926479405 learned_addr learned my addr 172.21.15.177:0/926479405 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:28.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad01e1e640 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb32c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 -- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb44a60 msgr2=0x55c7aeb50370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.331 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb44a60 0x55c7aeb50370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 -- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 msgr2=0x55c7aeb32c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:23:28.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb32c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 -- 172.21.15.177:0/926479405 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face8003530 con 0x55c7aeb352e0 2023-10-25T16:23:28.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad0161d640 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeb4fe30 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7facec055690 tx=0x7facec006df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a34b65fccbc2f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdcff9640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:23:28.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdcff9640 1 -- 172.21.15.177:0/926479405 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec082040 con 0x55c7aeb352e0 2023-10-25T16:23:28.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdcff9640 1 -- 172.21.15.177:0/926479405 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facec053d30 con 0x55c7aeb352e0 2023-10-25T16:23:28.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7aeaed6e0 con 0x55c7aeb352e0 2023-10-25T16:23:28.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdcff9640 1 -- 172.21.15.177:0/926479405 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7facec05dd10 con 0x55c7aeb352e0 2023-10-25T16:23:28.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 10 client.9312 fetch_fsmap learned FSMap version 65 2023-10-25T16:23:28.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55c7ae634cc0 con 0x55c7aeb352e0 2023-10-25T16:23:28.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdcff9640 1 -- 172.21.15.177:0/926479405 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55c7aeaed6e0 con 0x55c7aeb352e0 2023-10-25T16:23:28.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7facdcff9640 1 -- 172.21.15.177:0/926479405 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7facec07a050 con 0x55c7aeb352e0 2023-10-25T16:23:28.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 10 client.9312 fetch_fsmap finished waiting for FSMap version 65 2023-10-25T16:23:28.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 10 client.9312 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:23:28.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 20 client.9312 populate_metadata read hostname 'smithi177' 2023-10-25T16:23:28.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeb93680 0x55c7aeb93a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 4 client.9312 mds_command: new command op to 156116 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:23:28.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.320+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 --> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7ae8d36f0 con 0x55c7aeb93680 2023-10-25T16:23:28.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad01e1e640 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeb93680 0x55c7aeb93a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad01e1e640 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeb93680 0x55c7aeb93a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49c71efe386c41b2 server_cookie=c8aa89f845e92802 in_seq=0 out_seq=0 2023-10-25T16:23:28.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7facdcff9640 10 client.9312 ms_handle_connect on v2:172.21.15.184:6834/242379515 2023-10-25T16:23:28.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7facdcff9640 1 -- 172.21.15.177:0/926479405 <== mds.0 v2:172.21.15.184:6834/242379515 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x55c7ae8d36f0 con 0x55c7aeb93680 2023-10-25T16:23:28.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7facdcff9640 10 client.9312 handle_command_reply: tid=0 2023-10-25T16:23:28.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 client.9312 shutdown 2023-10-25T16:23:28.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 msgr2=0x55c7aeb4fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeb4fe30 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7facec055690 tx=0x7facec006df0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 shutdown_connections 2023-10-25T16:23:28.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:6834/242379515,v1:172.21.15.184:6836/242379515] conn(0x55c7aeb93680 0x55c7aeb93a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55c7aeb44a60 0x55c7aeb50370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c7aeb352e0 0x55c7aeb4fe30 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 --2- 172.21.15.177:0/926479405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7aeb349c0 0x55c7aeb32c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7facdcff9640 0 client.9312 ms_handle_reset on v2:172.21.15.184:6834/242379515 2023-10-25T16:23:28.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 >> 172.21.15.177:0/926479405 conn(0x55c7aeae22f0 msgr2=0x55c7aeb46e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 shutdown_connections 2023-10-25T16:23:28.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 1 -- 172.21.15.177:0/926479405 wait complete. 2023-10-25T16:23:28.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad071cc000 20 client.9312 trim_cache size 0 max 16384 2023-10-25T16:23:28.339 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:23:28.339 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:23:28.339 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:23:28.339 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 156116, 2023-10-25T16:23:28.340 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:23:28.340 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:23:28.340 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:23:28.340 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1561070870000005, 2023-10-25T16:23:28.340 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 65, 2023-10-25T16:23:28.341 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 174, 2023-10-25T16:23:28.341 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 174, 2023-10-25T16:23:28.341 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 13.956329995999999 2023-10-25T16:23:28.341 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:23:28.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7face00664a0 msgr2=0x7face0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7face00664a0 0x7face0068960 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7facf8001280 tx=0x7facf8000ee0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 msgr2=0x7facfc1469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 0x7facfc1469c0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7facec004dc0 tx=0x7facec001630 comp rx=0 tx=0).stop 2023-10-25T16:23:28.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 shutdown_connections 2023-10-25T16:23:28.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7face00664a0 0x7face0068960 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7facfc146f00 0x7facfc1343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facfc144c30 0x7facfc1469c0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 --2- 172.21.15.177:0/2312654406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7face8005190 0x7facfc0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 >> 172.21.15.177:0/2312654406 conn(0x7facfc0b2450 msgr2=0x7facfc0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 shutdown_connections 2023-10-25T16:23:28.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.324+0000 7fad04082640 1 -- 172.21.15.177:0/2312654406 wait complete. 2023-10-25T16:23:28.345 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:23:28.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 -- 172.21.15.177:0/4140529642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12140039d0 msgr2=0x7f1214003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 --2- 172.21.15.177:0/4140529642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12140039d0 0x7f1214003df0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f12200016b0 tx=0x7f122001c7a0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 -- 172.21.15.177:0/4140529642 shutdown_connections 2023-10-25T16:23:28.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 --2- 172.21.15.177:0/4140529642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12140039d0 0x7f1214003df0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 -- 172.21.15.177:0/4140529642 >> 172.21.15.177:0/4140529642 conn(0x7f122809a5c0 msgr2=0x7f12280d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 -- 172.21.15.177:0/4140529642 shutdown_connections 2023-10-25T16:23:28.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.460+0000 7f122f451640 1 -- 172.21.15.177:0/4140529642 wait complete. 2023-10-25T16:23:28.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 Processor -- start 2023-10-25T16:23:28.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- start start 2023-10-25T16:23:28.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12140039d0 0x7f1228155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12281f8c80 0x7f12281530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 0x7f1228153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228153dc0 con 0x7f12281f9100 2023-10-25T16:23:28.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228154060 con 0x7f12281f8c80 2023-10-25T16:23:28.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1228154340 con 0x7f12140039d0 2023-10-25T16:23:28.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 0x7f1228153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 0x7f1228153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37178/0 (socket says 172.21.15.177:37178) 2023-10-25T16:23:28.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 -- 172.21.15.177:0/3284361776 learned_addr learned my addr 172.21.15.177:0/3284361776 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:28.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122c9ec640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12281f8c80 0x7f12281530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d1ed640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12140039d0 0x7f1228155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 -- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12140039d0 msgr2=0x7f1228155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12140039d0 0x7f1228155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 -- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12281f8c80 msgr2=0x7f12281530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12281f8c80 0x7f12281530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 -- 172.21.15.177:0/3284361776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228154620 con 0x7f12281f9100 2023-10-25T16:23:28.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122d9ee640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 0x7f1228153630 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f122808ac30 tx=0x7f122400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400de50 con 0x7f12281f9100 2023-10-25T16:23:28.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1224003b90 con 0x7f12281f9100 2023-10-25T16:23:28.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228154900 con 0x7f12281f9100 2023-10-25T16:23:28.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240050d0 con 0x7f12281f9100 2023-10-25T16:23:28.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228155640 con 0x7f12281f9100 2023-10-25T16:23:28.467 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122804daf0 con 0x7f12281f9100 2023-10-25T16:23:28.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.464+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1224005230 con 0x7f12281f9100 2023-10-25T16:23:28.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.468+0000 7f121dffb640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f120c0664a0 0x7f120c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:28.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.468+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12240837f0 con 0x7f12281f9100 2023-10-25T16:23:28.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.468+0000 7f122d1ed640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f120c0664a0 0x7f120c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:28.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.468+0000 7f122d1ed640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f120c0664a0 0x7f120c068960 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1220001680 tx=0x7f1220019540 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:28.469 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.472+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1224050db0 con 0x7f12281f9100 2023-10-25T16:23:28.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1228154db0 con 0x7f12281f9100 2023-10-25T16:23:28.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f121dffb640 1 -- 172.21.15.177:0/3284361776 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1224018070 con 0x7f12281f9100 2023-10-25T16:23:28.649 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:23:28.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f120c0664a0 msgr2=0x7f120c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f120c0664a0 0x7f120c068960 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1220001680 tx=0x7f1220019540 comp rx=0 tx=0).stop 2023-10-25T16:23:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 msgr2=0x7f1228153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 0x7f1228153630 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f122808ac30 tx=0x7f122400dc00 comp rx=0 tx=0).stop 2023-10-25T16:23:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 shutdown_connections 2023-10-25T16:23:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f120c0664a0 0x7f120c068960 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12281f9100 0x7f1228153630 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12281f8c80 0x7f12281530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 --2- 172.21.15.177:0/3284361776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12140039d0 0x7f1228155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 >> 172.21.15.177:0/3284361776 conn(0x7f122809a5c0 msgr2=0x7f12280b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 shutdown_connections 2023-10-25T16:23:28.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:28.652+0000 7f122f451640 1 -- 172.21.15.177:0/3284361776 wait complete. 2023-10-25T16:23:28.666 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:23:28.666 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:23:28.667 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:23:28.667 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:23:28.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:28.668 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:23:28.668 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:23:28.668 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:23:28.669 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:23:28.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:28.670 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:23:28.676 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:23:28.676 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:23:28.676 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:23:28.676 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.677 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:23:28.677 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.677 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:23:28.677 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:28.677 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:23:28.677 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:23:28.678 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:28.678 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:23:28.678 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:23:28.678 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:28.678 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:23:28.679 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:28.679 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:23:28.679 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 41909sec preferred_lft 41909sec 2023-10-25T16:23:28.679 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:23:28.679 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.680 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:23:28.680 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:28.680 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:23:28.680 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.680 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:23:28.680 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:28.681 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:23:28.681 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.681 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:23:28.681 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.681 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:23:28.682 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:28.682 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:23:28.682 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.683 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:23:28.683 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:28.684 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:23:28.684 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:28.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:28.685 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:23:28.729 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:23:28.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:28.731 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:23:28.778 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:23:28.778 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:23:28.778 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:23:28.778 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:23:28.779 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:23:28.779 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:23:28.779 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:23:28.779 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:23:28.779 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:23:28.780 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:23:28.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:28.781 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:23:28.781 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:23:28.781 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:23:28.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:23:28.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:23:28.782 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:23:28.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:28.848 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:23:28.899 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:23:28.900 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:23:28.900 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:23:28.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:28.901 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:23:28.956 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:23:28.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:23:28.957 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:29.004 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:23:29.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:23:29.005 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:29.051 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:23:29.101 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:23:29.101 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:23:29.101 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:23:29.101 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:23:29.102 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:23:29.102 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:23:29.102 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:23:29.102 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:23:29.102 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:23:29.103 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:23:29.103 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:23:29.103 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:23:29.103 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:23:29.103 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:23:29.104 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:23:29.104 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:23:29.104 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:23:29.104 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:23:29.104 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:23:29.105 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:23:29.105 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:23:29.105 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:23:29.105 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:23:29.105 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:23:29.106 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:23:29.106 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:23:29.106 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:23:29.106 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:23:29.106 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:23:29.106 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:29.107 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:29.107 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:29.107 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:29.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:29.108 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:23:29.156 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:23:29.156 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:23:29.201 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:23:29.207 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:23:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:23:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:23:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:23:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:23:29.209 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:23:29.209 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:23:29.209 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:23:29.209 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:23:29.209 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:23:29.210 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:23:29.210 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:23:29.210 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:23:29.210 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:23:29.211 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:23:29.211 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:23:29.211 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:23:29.211 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:23:29.211 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:23:29.212 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:23:29.212 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:23:29.212 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:23:29.212 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:23:29.212 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:23:29.213 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:23:29.213 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:23:29.213 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:23:29.213 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:23:29.213 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:23:29.214 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:29.214 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:29.214 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:29.214 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:29.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:29.216 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:23:29.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:23:29.284+0000 7f135e208580 -1 init, newargv = 0x56536b112540 newargc=15 2023-10-25T16:23:29.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[53802]: starting ceph client 2023-10-25T16:23:29.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[53802]: starting fuse 2023-10-25T16:23:30.365 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:23:30.375 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:23:30.375 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:23:30.375 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:23:30.375 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:23:30.375 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:23:30.376 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:23:30.376 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:23:30.376 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:23:30.376 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:23:30.376 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:23:30.377 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:23:30.377 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:23:30.377 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:23:30.377 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:23:30.377 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:23:30.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:23:30.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:23:30.378 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:23:30.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:23:30.378 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:23:30.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:23:30.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:23:30.379 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:23:30.379 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:23:30.379 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:23:30.380 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:23:30.380 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:23:30.380 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:23:30.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:23:30.380 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:30.381 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:23:30.381 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:30.381 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:23:30.381 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:30.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:30.383 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:23:30.432 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:23:30.432 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:23:30.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:23:30.433 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:23:30.433 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:23:30.434 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:23:30.434 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:23:30.435 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:30.435 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:23:30.435 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:23:30.436 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:23:30.436 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:23:30.436 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:30.437 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:23:30.437 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:23:30.437 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:23:30.438 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:23:30.438 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:30.439 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:23:30.439 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:23:30.439 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:23:30.440 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:23:30.440 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:23:30.440 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:23:30.441 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:23:30.441 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:23:30.442 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:30.442 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:23:30.442 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:23:30.556 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.53802.asok 2023-10-25T16:23:30.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:30.567 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53802.asok 2023-10-25T16:23:30.568 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:30.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.53802.asok status 2023-10-25T16:23:30.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:30.758 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:23:30.759 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:23:30.759 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:23:30.759 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:23:30.759 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:23:30.759 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:23:30.760 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:23:30.760 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "53802", 2023-10-25T16:23:30.760 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:23:30.760 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:30.760 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:23:30.761 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:23:30.761 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 9324, 2023-10-25T16:23:30.761 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:23:30.761 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:23:30.761 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:23:30.761 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 9324 2023-10-25T16:23:30.762 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:30.762 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:23:30.762 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:23:30.762 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:23:30.763 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 4042864487 2023-10-25T16:23:30.763 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:23:30.763 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:30.763 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:23:30.763 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:23:30.764 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:23:30.764 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 4042864487 2023-10-25T16:23:30.764 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:23:30.764 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.9324 192.168.0.1:0/4042864487", 2023-10-25T16:23:30.764 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/4042864487", 2023-10-25T16:23:30.764 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:23:30.765 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 65, 2023-10-25T16:23:30.765 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 174, 2023-10-25T16:23:30.765 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:23:30.765 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:23:30.765 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:23:30.766 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:23:30.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:30.779 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:30.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:23:30.780 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:30.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:30.829 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:23:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:30.835 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:30.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:30.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:23:30.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:30.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:30.889 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:23:31.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f339dc73640 1 -- 172.21.15.177:0/765020727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33800051e0 msgr2=0x7f338000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:31.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f339dc73640 1 --2- 172.21.15.177:0/765020727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33800051e0 0x7f338000b990 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f339000c590 tx=0x7f339001faa0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f3397fff640 1 -- 172.21.15.177:0/765020727 reap_dead start 2023-10-25T16:23:31.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f339dc73640 1 -- 172.21.15.177:0/765020727 shutdown_connections 2023-10-25T16:23:31.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f339dc73640 1 -- 172.21.15.177:0/765020727 >> 172.21.15.177:0/765020727 conn(0x7f339809a5c0 msgr2=0x7f33980d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:31.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f339dc73640 1 -- 172.21.15.177:0/765020727 shutdown_connections 2023-10-25T16:23:31.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.064+0000 7f339dc73640 1 -- 172.21.15.177:0/765020727 wait complete. 2023-10-25T16:23:31.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 Processor -- start 2023-10-25T16:23:31.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- start start 2023-10-25T16:23:31.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33981f1500 0x7f3398153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:31.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 0x7f33981535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:31.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33981565f0 0x7f3398156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:31.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398152c40 con 0x7f33981f18e0 2023-10-25T16:23:31.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398156fb0 con 0x7f33981f1500 2023-10-25T16:23:31.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398152330 con 0x7f33981565f0 2023-10-25T16:23:31.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 0x7f33981535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:31.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 0x7f33981535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:45586/0 (socket says 172.21.15.177:45586) 2023-10-25T16:23:31.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 -- 172.21.15.177:0/2860961568 learned_addr learned my addr 172.21.15.177:0/2860961568 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:31.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f33977fe640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33981f1500 0x7f3398153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:31.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3397fff640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33981565f0 0x7f3398156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:31.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 -- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33981565f0 msgr2=0x7f3398156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:31.069 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33981565f0 0x7f3398156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 -- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33981f1500 msgr2=0x7f3398153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:31.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33981f1500 0x7f3398153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 -- 172.21.15.177:0/2860961568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980c6b10 con 0x7f33981f18e0 2023-10-25T16:23:31.070 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f33977fe640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33981f1500 0x7f3398153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:23:31.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f3396ffd640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 0x7f33981535a0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f338c00f9b0 tx=0x7f338c00fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:31.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00bc50 con 0x7f33981f18e0 2023-10-25T16:23:31.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f338c00dec0 con 0x7f33981f18e0 2023-10-25T16:23:31.071 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3398152580 con 0x7f33981f18e0 2023-10-25T16:23:31.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00bea0 con 0x7f33981f18e0 2023-10-25T16:23:31.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33980cf560 con 0x7f33981f18e0 2023-10-25T16:23:31.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339804daf0 con 0x7f33981f18e0 2023-10-25T16:23:31.072 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.068+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f338c011680 con 0x7f33981f18e0 2023-10-25T16:23:31.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.072+0000 7f337ffff640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3384066470 0x7f3384068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:31.073 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.072+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f338c0849d0 con 0x7f33981f18e0 2023-10-25T16:23:31.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.072+0000 7f33977fe640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3384066470 0x7f3384068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:31.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.072+0000 7f33977fe640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3384066470 0x7f3384068930 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f33880065f0 tx=0x7f3388006bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:31.074 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.076+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f338c051ee0 con 0x7f33981f18e0 2023-10-25T16:23:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33980ce930 con 0x7f33981f18e0 2023-10-25T16:23:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f337ffff640 1 -- 172.21.15.177:0/2860961568 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f338c055500 con 0x7f33981f18e0 2023-10-25T16:23:31.265 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:23:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3384066470 msgr2=0x7f3384068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3384066470 0x7f3384068930 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f33880065f0 tx=0x7f3388006bd0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 msgr2=0x7f33981535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 0x7f33981535a0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f338c00f9b0 tx=0x7f338c00fe70 comp rx=0 tx=0).stop 2023-10-25T16:23:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 shutdown_connections 2023-10-25T16:23:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3384066470 0x7f3384068930 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33981565f0 0x7f3398156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33981f18e0 0x7f33981535a0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 --2- 172.21.15.177:0/2860961568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33981f1500 0x7f3398153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 >> 172.21.15.177:0/2860961568 conn(0x7f339809a5c0 msgr2=0x7f3398158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:31.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 shutdown_connections 2023-10-25T16:23:31.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:31.268+0000 7f339dc73640 1 -- 172.21.15.177:0/2860961568 wait complete. 2023-10-25T16:23:31.283 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:23:31.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:23:31.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:23:31.285 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:23:31.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:31.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:23:31.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:23:31.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:23:31.286 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:23:31.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.287 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:23:31.294 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:23:31.295 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:23:31.295 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:23:31.295 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.295 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:23:31.295 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.296 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:23:31.296 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:31.296 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:23:31.296 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:23:31.296 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:31.297 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:23:31.297 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:23:31.297 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:31.297 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:23:31.297 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:23:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 41888sec preferred_lft 41888sec 2023-10-25T16:23:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:23:31.298 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.298 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:23:31.299 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:31.299 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:23:31.299 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.299 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:23:31.300 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:23:31.300 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:23:31.300 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.300 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:23:31.300 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.300 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:23:31.301 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:31.301 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:23:31.301 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.301 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:23:31.301 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:31.302 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:23:31.302 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:23:31.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.303 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:23:31.350 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:23:31.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.352 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:23:31.402 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:23:31.403 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:23:31.403 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:23:31.403 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:23:31.403 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:23:31.403 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:23:31.404 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:23:31.404 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:23:31.404 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:23:31.404 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:23:31.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.405 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:23:31.405 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:23:31.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:23:31.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:23:31.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:23:31.407 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:23:31.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.482 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:23:31.535 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:23:31.535 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:23:31.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:23:31.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:23:31.591 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:23:31.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:23:31.592 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:31.639 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:23:31.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:23:31.640 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:31.687 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:23:31.735 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:23:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:23:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:23:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:23:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:23:31.736 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:23:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:23:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:23:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:23:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:23:31.737 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:23:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:23:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:23:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:23:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:23:31.738 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:23:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:23:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:23:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:23:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:23:31.739 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:23:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:23:31.740 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:23:31.741 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:23:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:23:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:23:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:23:31.742 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:23:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:23:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:31.743 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:31.744 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:31.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.746 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:23:31.790 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:23:31.791 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:23:31.839 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:23:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:23:31.846 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:23:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:23:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:23:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:23:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:23:31.847 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:23:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:23:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:23:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:23:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:23:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:23:31.848 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:23:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:23:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:23:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:23:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:23:31.849 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:23:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:23:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:23:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:23:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:23:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:23:31.850 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:23:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:23:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:23:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:23:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:23:31.851 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:23:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:31.852 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:31.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:31.854 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:23:31.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:23:31.925+0000 7f9035a87580 -1 init, newargv = 0x5612949105c0 newargc=15 2023-10-25T16:23:31.922 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35527]: starting ceph client 2023-10-25T16:23:31.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35527]: starting fuse 2023-10-25T16:23:32.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:23:32.656 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:23:32.999 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:23:33.007 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:23:33.007 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:23:33.007 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:23:33.008 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:23:33.008 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:23:33.008 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:23:33.008 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:23:33.008 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:23:33.009 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:23:33.009 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:23:33.009 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:23:33.009 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:23:33.009 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:23:33.010 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:23:33.010 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:23:33.010 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:23:33.010 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:23:33.010 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:23:33.011 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:23:33.011 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:23:33.011 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:23:33.011 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:23:33.011 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:23:33.012 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:23:33.012 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:23:33.012 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:23:33.012 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:23:33.012 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:23:33.013 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:23:33.013 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:33.013 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:23:33.013 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:33.013 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:23:33.013 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:33.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:23:33.015 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:23:33.063 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:23:33.063 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:23:33.063 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:23:33.064 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:23:33.064 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:23:33.065 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:23:33.065 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:23:33.066 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:23:33.067 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:23:33.067 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:23:33.067 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:23:33.068 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:23:33.068 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:23:33.068 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:23:33.069 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:23:33.069 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:23:33.069 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:23:33.070 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:23:33.070 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:23:33.071 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:23:33.071 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:23:33.071 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:23:33.072 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:23:33.072 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:23:33.073 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:23:33.073 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:23:33.073 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:23:33.074 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:23:33.074 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:23:33.186 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.35527.asok 2023-10-25T16:23:33.190 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:33.198 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35527.asok 2023-10-25T16:23:33.199 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:33.199 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.35527.asok status 2023-10-25T16:23:33.292 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:33.396 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:23:33.396 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:23:33.396 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:23:33.396 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:23:33.397 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:23:33.397 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:23:33.397 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:23:33.397 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "35527", 2023-10-25T16:23:33.397 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:23:33.398 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:23:33.398 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:23:33.398 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:23:33.398 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 7051, 2023-10-25T16:23:33.398 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:23:33.399 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:23:33.399 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:23:33.399 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 7051 2023-10-25T16:23:33.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:23:33.399 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:23:33.400 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:23:33.400 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:23:33.400 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 855975918 2023-10-25T16:23:33.400 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:23:33.400 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:23:33.401 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:23:33.401 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:23:33.401 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:23:33.401 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 855975918 2023-10-25T16:23:33.401 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:23:33.401 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.7051 192.168.0.1:0/855975918", 2023-10-25T16:23:33.402 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/855975918", 2023-10-25T16:23:33.402 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:23:33.402 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 65, 2023-10-25T16:23:33.402 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 174, 2023-10-25T16:23:33.402 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:23:33.403 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:23:33.403 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:23:33.403 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:23:33.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:33.416 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:33.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:23:33.417 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:33.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:33.469 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:23:33.469 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:33.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:33.476 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:23:33.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:23:33.520 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:23:33.521 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:23:33.527 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:23:33.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- 172.21.15.177:0/2757629347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47501592c0 msgr2=0x7f47500cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:33.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 --2- 172.21.15.177:0/2757629347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47501592c0 0x7f47500cb390 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f4748009bc0 tx=0x7f474801cb40 comp rx=0 tx=0).stop 2023-10-25T16:23:33.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- 172.21.15.177:0/2757629347 shutdown_connections 2023-10-25T16:23:33.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 --2- 172.21.15.177:0/2757629347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47501592c0 0x7f47500cb390 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- 172.21.15.177:0/2757629347 >> 172.21.15.177:0/2757629347 conn(0x7f4750069d20 msgr2=0x7f475006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:33.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- 172.21.15.177:0/2757629347 shutdown_connections 2023-10-25T16:23:33.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- 172.21.15.177:0/2757629347 wait complete. 2023-10-25T16:23:33.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 Processor -- start 2023-10-25T16:23:33.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- start start 2023-10-25T16:23:33.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47500ce980 0x7f4750146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:33.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 0x7f475006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:33.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47501592c0 0x7f47500af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:33.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750146010 con 0x7f47500ced60 2023-10-25T16:23:33.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750164d90 con 0x7f47500ce980 2023-10-25T16:23:33.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f4756401640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4750148e40 con 0x7f47501592c0 2023-10-25T16:23:33.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 0x7f475006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:33.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 0x7f475006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:45604/0 (socket says 172.21.15.177:45604) 2023-10-25T16:23:33.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 -- 172.21.15.177:0/2029751788 learned_addr learned my addr 172.21.15.177:0/2029751788 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:33.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474ffff640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47500ce980 0x7f4750146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:33.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 -- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47501592c0 msgr2=0x7f47500af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:33.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f475499e640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47501592c0 0x7f47500af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:33.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47501592c0 0x7f47500af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 -- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47500ce980 msgr2=0x7f4750146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:33.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47500ce980 0x7f4750146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 -- 172.21.15.177:0/2029751788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4748009820 con 0x7f47500ced60 2023-10-25T16:23:33.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474ffff640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47500ce980 0x7f4750146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:23:33.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474f7fe640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 0x7f475006c150 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f474400c450 tx=0x7f474400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:33.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.668+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744012830 con 0x7f47500ced60 2023-10-25T16:23:33.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4744012aa0 con 0x7f47500ced60 2023-10-25T16:23:33.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4750145670 con 0x7f47500ced60 2023-10-25T16:23:33.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744011380 con 0x7f47500ced60 2023-10-25T16:23:33.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4750145c30 con 0x7f47500ced60 2023-10-25T16:23:33.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750146150 con 0x7f47500ced60 2023-10-25T16:23:33.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4744007020 con 0x7f47500ced60 2023-10-25T16:23:33.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474cff9640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f473c066470 0x7f473c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:33.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47440847d0 con 0x7f47500ced60 2023-10-25T16:23:33.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474ffff640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f473c066470 0x7f473c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:33.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.672+0000 7f474ffff640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f473c066470 0x7f473c068930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f47400016e0 tx=0x7f4740009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:33.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.676+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4744051dc0 con 0x7f47500ced60 2023-10-25T16:23:33.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.856+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4750146150 con 0x7f47500ced60 2023-10-25T16:23:33.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f474cff9640 1 -- 172.21.15.177:0/2029751788 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f4750146150 con 0x7f47500ced60 2023-10-25T16:23:33.856 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:23:33.856 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:23:33.856 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:23:33.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f473c066470 msgr2=0x7f473c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:33.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f473c066470 0x7f473c068930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f47400016e0 tx=0x7f4740009040 comp rx=0 tx=0).stop 2023-10-25T16:23:33.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 msgr2=0x7f475006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:33.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 0x7f475006c150 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f474400c450 tx=0x7f474400c910 comp rx=0 tx=0).stop 2023-10-25T16:23:33.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 shutdown_connections 2023-10-25T16:23:33.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f473c066470 0x7f473c068930 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47501592c0 0x7f47500af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47500ced60 0x7f475006c150 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 --2- 172.21.15.177:0/2029751788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47500ce980 0x7f4750146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:33.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 >> 172.21.15.177:0/2029751788 conn(0x7f4750069d20 msgr2=0x7f4750156410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:33.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 shutdown_connections 2023-10-25T16:23:33.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:33.860+0000 7f4756401640 1 -- 172.21.15.177:0/2029751788 wait complete. 2023-10-25T16:23:33.872 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:23:34.020 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":156116,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.841995368999999,"mdsmap_epoch":65,"osdmap_epoch":174,"osdmap_epoch_barrier":174,"uptime":19.642217350999999} 2023-10-25T16:23:34.020 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 156116, "mdsmap_epoch": 65, "osdmap_epoch": 174, "osdmap_epoch_barrier": 174, "rank_uptime": 14.841995369, "state": "up:active", "uptime": 19.642217351, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:23:34.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-25T16:23:34.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 -- 172.21.15.177:0/4029725014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f6d0 msgr2=0x7f302806cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:34.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 --2- 172.21.15.177:0/4029725014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f6d0 0x7f302806cf80 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f301c009840 tx=0x7f301c01c7d0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 -- 172.21.15.177:0/4029725014 shutdown_connections 2023-10-25T16:23:34.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 --2- 172.21.15.177:0/4029725014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f302806d4c0 0x7f30280cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 --2- 172.21.15.177:0/4029725014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f6d0 0x7f302806cf80 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 -- 172.21.15.177:0/4029725014 >> 172.21.15.177:0/4029725014 conn(0x7f3028069920 msgr2=0x7f3028069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:34.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 -- 172.21.15.177:0/4029725014 shutdown_connections 2023-10-25T16:23:34.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.156+0000 7f302fe83640 1 -- 172.21.15.177:0/4029725014 wait complete. 2023-10-25T16:23:34.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 Processor -- start 2023-10-25T16:23:34.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- start start 2023-10-25T16:23:34.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f302806d4c0 0x7f3028099620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:34.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 0x7f30280ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f302814e9d0 0x7f30280aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30280ae640 con 0x7f302814f2f0 2023-10-25T16:23:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028099cb0 con 0x7f302814e9d0 2023-10-25T16:23:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3028099f90 con 0x7f302806d4c0 2023-10-25T16:23:34.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 0x7f30280ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 0x7f30280ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:45624/0 (socket says 172.21.15.177:45624) 2023-10-25T16:23:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 -- 172.21.15.177:0/1011829083 learned_addr learned my addr 172.21.15.177:0/1011829083 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:23:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302dc1f640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f302806d4c0 0x7f3028099620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302e420640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f302814e9d0 0x7f30280aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:34.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 -- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f302806d4c0 msgr2=0x7f3028099620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:34.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f302806d4c0 0x7f3028099620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 -- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f302814e9d0 msgr2=0x7f30280aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:34.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f302814e9d0 0x7f30280aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 -- 172.21.15.177:0/1011829083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0094a0 con 0x7f302814f2f0 2023-10-25T16:23:34.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302d41e640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 0x7f30280ae100 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f301c01ccb0 tx=0x7f301c0a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:34.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0bc070 con 0x7f302814f2f0 2023-10-25T16:23:34.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f301c0051b0 con 0x7f302814f2f0 2023-10-25T16:23:34.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30280c6290 con 0x7f302814f2f0 2023-10-25T16:23:34.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0055a0 con 0x7f302814f2f0 2023-10-25T16:23:34.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30280ab300 con 0x7f302814f2f0 2023-10-25T16:23:34.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028073360 con 0x7f302814f2f0 2023-10-25T16:23:34.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f301c0b4040 con 0x7f302814f2f0 2023-10-25T16:23:34.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.160+0000 7f30267fc640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3014066470 0x7f3014068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:23:34.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.164+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f301c11e460 con 0x7f302814f2f0 2023-10-25T16:23:34.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.164+0000 7f302dc1f640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3014066470 0x7f3014068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:23:34.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.164+0000 7f302dc1f640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3014066470 0x7f3014068930 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f30180012f0 tx=0x7f3018009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:23:34.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.168+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f301c0eb970 con 0x7f302814f2f0 2023-10-25T16:23:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.320+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f30280ae800 con 0x7f302814f2f0 2023-10-25T16:23:34.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f30267fc640 1 -- 172.21.15.177:0/1011829083 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v175) v1 ==== 181+0+0 (secure 0 0 0) 0x7f301c0b20c0 con 0x7f302814f2f0 2023-10-25T16:23:34.816 INFO:teuthology.orchestra.run.smithi177.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-25T16:23:34.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3014066470 msgr2=0x7f3014068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:34.818 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3014066470 0x7f3014068930 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f30180012f0 tx=0x7f3018009040 comp rx=0 tx=0).stop 2023-10-25T16:23:34.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 msgr2=0x7f30280ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:23:34.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 0x7f30280ae100 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f301c01ccb0 tx=0x7f301c0a5790 comp rx=0 tx=0).stop 2023-10-25T16:23:34.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 shutdown_connections 2023-10-25T16:23:34.819 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3014066470 0x7f3014068930 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f302814e9d0 0x7f30280aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f302814f2f0 0x7f30280ae100 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 --2- 172.21.15.177:0/1011829083 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f302806d4c0 0x7f3028099620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:23:34.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 >> 172.21.15.177:0/1011829083 conn(0x7f3028069920 msgr2=0x7f30280b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:23:34.820 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 shutdown_connections 2023-10-25T16:23:34.821 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:23:34.820+0000 7f302fe83640 1 -- 172.21.15.177:0/1011829083 wait complete. 2023-10-25T16:23:34.839 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:23:34.973 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:23:34.974 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:23:34.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-10-25T16:23:35.096 INFO:teuthology.orchestra.run.smithi177.stdout:{"mon_tick_interval":"5"} 2023-10-25T16:23:35.096 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-10-25T16:23:35.097 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-10-25T16:23:35.097 DEBUG:teuthology.orchestra.run.smithi177:> stdin-killer -- python3 -c ' 2023-10-25T16:23:35.097 DEBUG:teuthology.orchestra.run.smithi177:> import time 2023-10-25T16:23:35.098 DEBUG:teuthology.orchestra.run.smithi177:> import datetime 2023-10-25T16:23:35.098 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:23:35.098 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:23:35.099 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.099 DEBUG:teuthology.orchestra.run.smithi177:> # Write some buffered data through before going full, all should be well 2023-10-25T16:23:35.099 DEBUG:teuthology.orchestra.run.smithi177:> print("writing some data through which we expect to succeed") 2023-10-25T16:23:35.100 DEBUG:teuthology.orchestra.run.smithi177:> bytes = 0 2023-10-25T16:23:35.100 DEBUG:teuthology.orchestra.run.smithi177:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-10-25T16:23:35.100 DEBUG:teuthology.orchestra.run.smithi177:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-10-25T16:23:35.101 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-10-25T16:23:35.101 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:23:35.101 DEBUG:teuthology.orchestra.run.smithi177:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-10-25T16:23:35.102 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.102 DEBUG:teuthology.orchestra.run.smithi177:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-10-25T16:23:35.103 DEBUG:teuthology.orchestra.run.smithi177:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-10-25T16:23:35.103 DEBUG:teuthology.orchestra.run.smithi177:> # buffered IO, the error should always only appear from fsync and not 2023-10-25T16:23:35.103 DEBUG:teuthology.orchestra.run.smithi177:> # from write 2023-10-25T16:23:35.104 DEBUG:teuthology.orchestra.run.smithi177:> full = False 2023-10-25T16:23:35.104 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.104 DEBUG:teuthology.orchestra.run.smithi177:> for n in range(0, int(32 * 1.1)): 2023-10-25T16:23:35.105 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:23:35.105 DEBUG:teuthology.orchestra.run.smithi177:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-10-25T16:23:35.105 DEBUG:teuthology.orchestra.run.smithi177:> print("wrote bytes via buffered write, moving on to fsync") 2023-10-25T16:23:35.106 DEBUG:teuthology.orchestra.run.smithi177:> except OSError as e: 2023-10-25T16:23:35.106 DEBUG:teuthology.orchestra.run.smithi177:> if True: 2023-10-25T16:23:35.106 DEBUG:teuthology.orchestra.run.smithi177:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-10-25T16:23:35.107 DEBUG:teuthology.orchestra.run.smithi177:> raise 2023-10-25T16:23:35.107 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:23:35.107 DEBUG:teuthology.orchestra.run.smithi177:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-25T16:23:35.108 DEBUG:teuthology.orchestra.run.smithi177:> full = True 2023-10-25T16:23:35.108 DEBUG:teuthology.orchestra.run.smithi177:> break 2023-10-25T16:23:35.109 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.109 DEBUG:teuthology.orchestra.run.smithi177:> try: 2023-10-25T16:23:35.109 DEBUG:teuthology.orchestra.run.smithi177:> os.fsync(f) 2023-10-25T16:23:35.110 DEBUG:teuthology.orchestra.run.smithi177:> print("fsync'"'"'ed successfully") 2023-10-25T16:23:35.110 DEBUG:teuthology.orchestra.run.smithi177:> except OSError as e: 2023-10-25T16:23:35.110 DEBUG:teuthology.orchestra.run.smithi177:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-25T16:23:35.111 DEBUG:teuthology.orchestra.run.smithi177:> full = True 2023-10-25T16:23:35.111 DEBUG:teuthology.orchestra.run.smithi177:> break 2023-10-25T16:23:35.111 DEBUG:teuthology.orchestra.run.smithi177:> else: 2023-10-25T16:23:35.112 DEBUG:teuthology.orchestra.run.smithi177:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-10-25T16:23:35.112 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.112 DEBUG:teuthology.orchestra.run.smithi177:> if n > 32 * 0.9: 2023-10-25T16:23:35.113 DEBUG:teuthology.orchestra.run.smithi177:> # Be cautious in the last region where we expect to hit 2023-10-25T16:23:35.113 DEBUG:teuthology.orchestra.run.smithi177:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-10-25T16:23:35.114 DEBUG:teuthology.orchestra.run.smithi177:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-10-25T16:23:35.114 DEBUG:teuthology.orchestra.run.smithi177:> time.sleep(15.0) 2023-10-25T16:23:35.114 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.115 DEBUG:teuthology.orchestra.run.smithi177:> if not full: 2023-10-25T16:23:35.115 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-10-25T16:23:35.115 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.116 DEBUG:teuthology.orchestra.run.smithi177:> # close() should not raise an error because we already caught it in 2023-10-25T16:23:35.116 DEBUG:teuthology.orchestra.run.smithi177:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-10-25T16:23:35.116 DEBUG:teuthology.orchestra.run.smithi177:> # since then because all IOs got cancelled on the full flag. 2023-10-25T16:23:35.117 DEBUG:teuthology.orchestra.run.smithi177:> print("calling close") 2023-10-25T16:23:35.117 DEBUG:teuthology.orchestra.run.smithi177:> os.close(f) 2023-10-25T16:23:35.117 DEBUG:teuthology.orchestra.run.smithi177:> print("close() did not raise error") 2023-10-25T16:23:35.118 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:23:35.118 DEBUG:teuthology.orchestra.run.smithi177:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-10-25T16:23:35.118 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:24:02.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:24:02.705 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:24:24.767 INFO:teuthology.orchestra.run.smithi177.stdout:writing some data through which we expect to succeed 2023-10-25T16:24:24.768 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-10-25T16:24:24.768 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.768 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 1.00 MB 2023-10-25T16:24:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 2.00 MB 2023-10-25T16:24:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.770 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.770 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 3.00 MB 2023-10-25T16:24:24.770 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.770 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.770 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 4.00 MB 2023-10-25T16:24:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 5.00 MB 2023-10-25T16:24:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.771 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.772 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 6.00 MB 2023-10-25T16:24:24.772 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.772 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.772 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 7.00 MB 2023-10-25T16:24:24.772 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.773 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.773 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 8.00 MB 2023-10-25T16:24:24.773 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.773 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.773 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 9.00 MB 2023-10-25T16:24:24.774 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.774 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.774 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 10.00 MB 2023-10-25T16:24:24.774 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.774 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.775 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 11.00 MB 2023-10-25T16:24:24.775 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.775 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.775 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 12.00 MB 2023-10-25T16:24:24.775 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.776 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.776 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 13.00 MB 2023-10-25T16:24:24.776 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.776 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.776 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 14.00 MB 2023-10-25T16:24:24.776 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.777 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.777 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 15.00 MB 2023-10-25T16:24:24.777 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.777 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.777 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 16.00 MB 2023-10-25T16:24:24.778 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.778 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.778 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 17.00 MB 2023-10-25T16:24:24.778 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.778 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.778 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 18.00 MB 2023-10-25T16:24:24.779 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.779 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.779 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 19.00 MB 2023-10-25T16:24:24.779 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.779 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 20.00 MB 2023-10-25T16:24:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 21.00 MB 2023-10-25T16:24:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.780 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.781 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 22.00 MB 2023-10-25T16:24:24.781 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.781 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.781 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 23.00 MB 2023-10-25T16:24:24.781 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.782 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.782 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 24.00 MB 2023-10-25T16:24:24.782 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.782 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.782 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 25.00 MB 2023-10-25T16:24:24.783 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.783 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.783 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 26.00 MB 2023-10-25T16:24:24.783 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.783 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.784 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 27.00 MB 2023-10-25T16:24:24.784 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.784 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.784 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 28.00 MB 2023-10-25T16:24:24.784 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.785 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.785 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 29.00 MB 2023-10-25T16:24:24.785 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.785 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.785 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 30.00 MB 2023-10-25T16:24:24.785 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:24:24.786 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.786 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.786 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 31.00 MB 2023-10-25T16:24:24.786 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:24:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:fsync'ed successfully 2023-10-25T16:24:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:Not full yet after 32.00 MB 2023-10-25T16:24:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-10-25T16:24:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:wrote bytes via buffered write, moving on to fsync 2023-10-25T16:24:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:Reached fullness after 33.00 MB 2023-10-25T16:24:24.788 INFO:teuthology.orchestra.run.smithi177.stdout:calling close 2023-10-25T16:24:24.788 INFO:teuthology.orchestra.run.smithi177.stdout:close() did not raise error 2023-10-25T16:24:24.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:24.789 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:24:24.790 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:24:24.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:24:24.907 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:24:24.908 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:24:24.908 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:24.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:25.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- 172.21.15.177:0/702257113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9140140e90 msgr2=0x7f91400af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 --2- 172.21.15.177:0/702257113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9140140e90 0x7f91400af580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9128009900 tx=0x7f912801c830 comp rx=0 tx=0).stop 2023-10-25T16:24:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- 172.21.15.177:0/702257113 shutdown_connections 2023-10-25T16:24:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 --2- 172.21.15.177:0/702257113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914006f570 0x7f914006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 --2- 172.21.15.177:0/702257113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9140140e90 0x7f91400af580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- 172.21.15.177:0/702257113 >> 172.21.15.177:0/702257113 conn(0x7f91400b2450 msgr2=0x7f91400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- 172.21.15.177:0/702257113 shutdown_connections 2023-10-25T16:24:25.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- 172.21.15.177:0/702257113 wait complete. 2023-10-25T16:24:25.096 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 Processor -- start 2023-10-25T16:24:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- start start 2023-10-25T16:24:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914006bec0 0x7f91400abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914006f570 0x7f91400ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 0x7f91400adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914015ae00 con 0x7f9140140e90 2023-10-25T16:24:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914015b0e0 con 0x7f914006bec0 2023-10-25T16:24:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.095+0000 7f9145c57640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914015b3c0 con 0x7f914006f570 2023-10-25T16:24:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 0x7f91400adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 0x7f91400adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43014/0 (socket says 172.21.15.177:43014) 2023-10-25T16:24:25.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 -- 172.21.15.177:0/3336425838 learned_addr learned my addr 172.21.15.177:0/3336425838 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f9136ffd640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914006f570 0x7f91400ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913f7fe640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914006bec0 0x7f91400abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 -- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914006f570 msgr2=0x7f91400ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914006f570 0x7f91400ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 -- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914006bec0 msgr2=0x7f91400abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914006bec0 0x7f91400abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 -- 172.21.15.177:0/3336425838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128009560 con 0x7f9140140e90 2023-10-25T16:24:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913f7fe640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914006bec0 0x7f91400abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:24:25.100 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913ffff640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 0x7f91400adfd0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f913800c710 tx=0x7f913800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:25.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138006d60 con 0x7f9140140e90 2023-10-25T16:24:25.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f913800ce20 con 0x7f9140140e90 2023-10-25T16:24:25.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914015b6a0 con 0x7f9140140e90 2023-10-25T16:24:25.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138003be0 con 0x7f9140140e90 2023-10-25T16:24:25.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914015aab0 con 0x7f9140140e90 2023-10-25T16:24:25.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914004daf0 con 0x7f9140140e90 2023-10-25T16:24:25.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9138003d40 con 0x7f9140140e90 2023-10-25T16:24:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9120066470 0x7f9120068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9138083be0 con 0x7f9140140e90 2023-10-25T16:24:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f912006e000 con 0x7f9140140e90 2023-10-25T16:24:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913f7fe640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9120066470 0x7f9120068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.099+0000 7f913f7fe640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9120066470 0x7f9120068930 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f91280ae000 tx=0x7f912801b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:25.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.103+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91380510d0 con 0x7f9140140e90 2023-10-25T16:24:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.259+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f914015bb50 con 0x7f9140140e90 2023-10-25T16:24:25.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.259+0000 7f913cff9640 1 -- 172.21.15.177:0/3336425838 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f91380546f0 con 0x7f9140140e90 2023-10-25T16:24:25.258 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:25.258 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":178,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:12.806054+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:25.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9120066470 msgr2=0x7f9120068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9120066470 0x7f9120068930 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f91280ae000 tx=0x7f912801b070 comp rx=0 tx=0).stop 2023-10-25T16:24:25.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 msgr2=0x7f91400adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 0x7f91400adfd0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f913800c710 tx=0x7f913800cbd0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 shutdown_connections 2023-10-25T16:24:25.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9120066470 0x7f9120068930 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9140140e90 0x7f91400adfd0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f914006f570 0x7f91400ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 --2- 172.21.15.177:0/3336425838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f914006bec0 0x7f91400abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 >> 172.21.15.177:0/3336425838 conn(0x7f91400b2450 msgr2=0x7f91400acc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:25.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 shutdown_connections 2023-10-25T16:24:25.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.263+0000 7f9145c57640 1 -- 172.21.15.177:0/3336425838 wait complete. 2023-10-25T16:24:25.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:23:16.807928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:23:17.493379+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:24:25.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:24:25.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- 172.21.15.177:0/2364641779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60006f570 msgr2=0x7fc60006ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 --2- 172.21.15.177:0/2364641779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60006f570 0x7fc60006ba50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4005fd0 tx=0x7fc5f401c770 comp rx=0 tx=0).stop 2023-10-25T16:24:25.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- 172.21.15.177:0/2364641779 shutdown_connections 2023-10-25T16:24:25.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 --2- 172.21.15.177:0/2364641779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60006f570 0x7fc60006ba50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 --2- 172.21.15.177:0/2364641779 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc600140cf0 0x7fc6000af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- 172.21.15.177:0/2364641779 >> 172.21.15.177:0/2364641779 conn(0x7fc6000b2450 msgr2=0x7fc6000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:25.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- 172.21.15.177:0/2364641779 shutdown_connections 2023-10-25T16:24:25.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- 172.21.15.177:0/2364641779 wait complete. 2023-10-25T16:24:25.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 Processor -- start 2023-10-25T16:24:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- start start 2023-10-25T16:24:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 0x7fc60013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc60006f570 0x7fc600157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc600140cf0 0x7fc60013de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60013d980 con 0x7fc60006bf90 2023-10-25T16:24:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600154450 con 0x7fc600140cf0 2023-10-25T16:24:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc606a70640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001548e0 con 0x7fc60006f570 2023-10-25T16:24:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.411+0000 7fc60480c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 0x7fc60013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 0x7fc60013ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43020/0 (socket says 172.21.15.177:43020) 2023-10-25T16:24:25.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 -- 172.21.15.177:0/4263770835 learned_addr learned my addr 172.21.15.177:0/4263770835 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fffff640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc60006f570 0x7fc600157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60500d640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc600140cf0 0x7fc60013de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 -- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc60006f570 msgr2=0x7fc600157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc60006f570 0x7fc600157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 -- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc600140cf0 msgr2=0x7fc60013de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc600140cf0 0x7fc60013de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 -- 172.21.15.177:0/4263770835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4009450 con 0x7fc60006bf90 2023-10-25T16:24:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc60480c640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 0x7fc60013ff30 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000e7f0 tx=0x7fc5f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00095b0 con 0x7fc60006bf90 2023-10-25T16:24:25.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc5f000cdd0 con 0x7fc60006bf90 2023-10-25T16:24:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0010690 con 0x7fc60006bf90 2023-10-25T16:24:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60013d6a0 con 0x7fc60006bf90 2023-10-25T16:24:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6001540e0 con 0x7fc60006bf90 2023-10-25T16:24:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6000b0fc0 con 0x7fc60006bf90 2023-10-25T16:24:25.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc5f00107f0 con 0x7fc60006bf90 2023-10-25T16:24:25.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5ec066470 0x7fc5ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc5f0014070 con 0x7fc60006bf90 2023-10-25T16:24:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fc5ec06e000 con 0x7fc60006bf90 2023-10-25T16:24:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fffff640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5ec066470 0x7fc5ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.415+0000 7fc5fffff640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5ec066470 0x7fc5ec068930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40ad000 tx=0x7fc5f40a9040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:25.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.419+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5f0051ec0 con 0x7fc60006bf90 2023-10-25T16:24:25.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.571+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc60004daf0 con 0x7fc60006bf90 2023-10-25T16:24:25.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc5fd7fa640 1 -- 172.21.15.177:0/4263770835 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5f00554e0 con 0x7fc60006bf90 2023-10-25T16:24:25.571 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:24:25.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5ec066470 msgr2=0x7fc5ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5ec066470 0x7fc5ec068930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40ad000 tx=0x7fc5f40a9040 comp rx=0 tx=0).stop 2023-10-25T16:24:25.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 msgr2=0x7fc60013ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 0x7fc60013ff30 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000e7f0 tx=0x7fc5f000ecb0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 shutdown_connections 2023-10-25T16:24:25.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc5ec066470 0x7fc5ec068930 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc600140cf0 0x7fc60013de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc60006f570 0x7fc600157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 --2- 172.21.15.177:0/4263770835 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc60006bf90 0x7fc60013ff30 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 >> 172.21.15.177:0/4263770835 conn(0x7fc6000b2450 msgr2=0x7fc6000b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:25.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 shutdown_connections 2023-10-25T16:24:25.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.575+0000 7fc606a70640 1 -- 172.21.15.177:0/4263770835 wait complete. 2023-10-25T16:24:25.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:24:25.716 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 -- 172.21.15.177:0/2830481719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c0047d0 msgr2=0x7fe99c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2830481719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c0047d0 0x7fe99c004c50 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009b50 tx=0x7fe9a001d230 comp rx=0 tx=0).stop 2023-10-25T16:24:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 -- 172.21.15.177:0/2830481719 shutdown_connections 2023-10-25T16:24:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2830481719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe99c0047d0 0x7fe99c004c50 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 -- 172.21.15.177:0/2830481719 >> 172.21.15.177:0/2830481719 conn(0x7fe9b00b2450 msgr2=0x7fe9b00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:25.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 -- 172.21.15.177:0/2830481719 shutdown_connections 2023-10-25T16:24:25.718 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 -- 172.21.15.177:0/2830481719 wait complete. 2023-10-25T16:24:25.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 Processor -- start 2023-10-25T16:24:25.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 -- start start 2023-10-25T16:24:25.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0047d0 0x7fe9b00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.719+0000 7fe9b8535640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b014c200 0x7fe9b00aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 0x7fe9b01f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00c1ea0 con 0x7fe9b01f0a90 2023-10-25T16:24:25.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00c2140 con 0x7fe99c0047d0 2023-10-25T16:24:25.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00ae990 con 0x7fe9b014c200 2023-10-25T16:24:25.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 0x7fe9b01f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 0x7fe9b01f0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43032/0 (socket says 172.21.15.177:43032) 2023-10-25T16:24:25.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 -- 172.21.15.177:0/2679860277 learned_addr learned my addr 172.21.15.177:0/2679860277 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:25.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b5ad0640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b014c200 0x7fe9b00aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b62d1640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0047d0 0x7fe9b00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.722 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 -- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b014c200 msgr2=0x7fe9b00aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b014c200 0x7fe9b00aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 -- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0047d0 msgr2=0x7fe9b00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0047d0 0x7fe9b00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 -- 172.21.15.177:0/2679860277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00aec70 con 0x7fe9b01f0a90 2023-10-25T16:24:25.723 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b6ad2640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 0x7fe9b01f0f10 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000f90 tx=0x7fe9a80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:25.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8011870 con 0x7fe9b01f0a90 2023-10-25T16:24:25.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe9a8011ac0 con 0x7fe9b01f0a90 2023-10-25T16:24:25.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00aef50 con 0x7fe9b01f0a90 2023-10-25T16:24:25.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a80103c0 con 0x7fe9b01f0a90 2023-10-25T16:24:25.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b00af470 con 0x7fe9b01f0a90 2023-10-25T16:24:25.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b00ae7f0 con 0x7fe9b01f0a90 2023-10-25T16:24:25.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9a8010520 con 0x7fe9b01f0a90 2023-10-25T16:24:25.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9940664a0 0x7fe994068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:25.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe9a8084830 con 0x7fe9b01f0a90 2023-10-25T16:24:25.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fe99406e030 con 0x7fe9b01f0a90 2023-10-25T16:24:25.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.723+0000 7fe9b62d1640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9940664a0 0x7fe994068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:25.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.727+0000 7fe9b62d1640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9940664a0 0x7fe994068960 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001060 tx=0x7fe9ac00c040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:25.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.727+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9a8015020 con 0x7fe9b01f0a90 2023-10-25T16:24:25.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.879+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9b004daf0 con 0x7fe9b01f0a90 2023-10-25T16:24:25.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9a6ffd640 1 -- 172.21.15.177:0/2679860277 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9b00ae7f0 con 0x7fe9b01f0a90 2023-10-25T16:24:25.879 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:24:25.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9940664a0 msgr2=0x7fe994068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9940664a0 0x7fe994068960 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001060 tx=0x7fe9ac00c040 comp rx=0 tx=0).stop 2023-10-25T16:24:25.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 msgr2=0x7fe9b01f0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:25.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 0x7fe9b01f0f10 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000f90 tx=0x7fe9a80019c0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 shutdown_connections 2023-10-25T16:24:25.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe9940664a0 0x7fe994068960 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe9b01f0a90 0x7fe9b01f0f10 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9b014c200 0x7fe9b00aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 --2- 172.21.15.177:0/2679860277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c0047d0 0x7fe9b00b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:25.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 >> 172.21.15.177:0/2679860277 conn(0x7fe9b00b2450 msgr2=0x7fe9b015ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:25.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 shutdown_connections 2023-10-25T16:24:25.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:25.883+0000 7fe9b8535640 1 -- 172.21.15.177:0/2679860277 wait complete. 2023-10-25T16:24:25.898 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:24:26.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/3127693135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c81500f0 msgr2=0x7fb2c80c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/3127693135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c81500f0 0x7fb2c80c9910 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fb2c806fac0 tx=0x7fb2b801c7a0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/3127693135 shutdown_connections 2023-10-25T16:24:26.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/3127693135 >> v2:172.21.15.184:3300/0 conn(0x7fb2c806c090 0x7fb2c80706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/3127693135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c81500f0 0x7fb2c80c9910 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/3127693135 >> 172.21.15.177:0/3127693135 conn(0x7fb2c80b2450 msgr2=0x7fb2c80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:26.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/3127693135 shutdown_connections 2023-10-25T16:24:26.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/3127693135 wait complete. 2023-10-25T16:24:26.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 Processor -- start 2023-10-25T16:24:26.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- start start 2023-10-25T16:24:26.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 0x7fb2c8141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c80c9e50 0x7fb2c81431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c81500f0 0x7fb2c8146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c814c0c0 con 0x7fb2c806c090 2023-10-25T16:24:26.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c814c3a0 con 0x7fb2c80c9e50 2023-10-25T16:24:26.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c814c680 con 0x7fb2c81500f0 2023-10-25T16:24:26.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 0x7fb2c8141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 0x7fb2c8141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43046/0 (socket says 172.21.15.177:43046) 2023-10-25T16:24:26.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 -- 172.21.15.177:0/902789343 learned_addr learned my addr 172.21.15.177:0/902789343 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:26.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 -- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c81500f0 msgr2=0x7fb2c8146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c81500f0 0x7fb2c8146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 -- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c80c9e50 msgr2=0x7fb2c81431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c80c9e50 0x7fb2c81431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 -- 172.21.15.177:0/902789343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8009560 con 0x7fb2c806c090 2023-10-25T16:24:26.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2c659c640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 0x7fb2c8141230 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009850 tx=0x7fb2b80a5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:26.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8003800 con 0x7fb2c806c090 2023-10-25T16:24:26.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb2b8003a50 con 0x7fb2c806c090 2023-10-25T16:24:26.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c814c960 con 0x7fb2c806c090 2023-10-25T16:24:26.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8003e60 con 0x7fb2c806c090 2023-10-25T16:24:26.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.023+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c8146c70 con 0x7fb2c806c090 2023-10-25T16:24:26.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c80c9780 con 0x7fb2c806c090 2023-10-25T16:24:26.036 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb2b80b4040 con 0x7fb2c806c090 2023-10-25T16:24:26.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2bf7fe640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2a8066470 0x7fb2a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb2b811e4a0 con 0x7fb2c806c090 2023-10-25T16:24:26.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fb2a806e000 con 0x7fb2c806c090 2023-10-25T16:24:26.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2bdd9b640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2a8066470 0x7fb2a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.027+0000 7fb2bdd9b640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2a8066470 0x7fb2a8068930 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8159f10 tx=0x7fb2b00079f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:26.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.031+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2b80eb910 con 0x7fb2c806c090 2023-10-25T16:24:26.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.179+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2c81f28c0 con 0x7fb2c806c090 2023-10-25T16:24:26.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2bf7fe640 1 -- 172.21.15.177:0/902789343 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2b80b20a0 con 0x7fb2c806c090 2023-10-25T16:24:26.180 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:24:26.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2a8066470 msgr2=0x7fb2a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2a8066470 0x7fb2a8068930 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8159f10 tx=0x7fb2b00079f0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 msgr2=0x7fb2c8141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 0x7fb2c8141230 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009850 tx=0x7fb2b80a5740 comp rx=0 tx=0).stop 2023-10-25T16:24:26.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 shutdown_connections 2023-10-25T16:24:26.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb2a8066470 0x7fb2a8068930 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2c81500f0 0x7fb2c8146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2c80c9e50 0x7fb2c81431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 --2- 172.21.15.177:0/902789343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2c806c090 0x7fb2c8141230 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 >> 172.21.15.177:0/902789343 conn(0x7fb2c80b2450 msgr2=0x7fb2c814d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:26.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 shutdown_connections 2023-10-25T16:24:26.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.183+0000 7fb2cc94d640 1 -- 172.21.15.177:0/902789343 wait complete. 2023-10-25T16:24:26.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:24:26.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 -- 172.21.15.177:0/4272758944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe050140e90 msgr2=0x7fe0500af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 --2- 172.21.15.177:0/4272758944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe050140e90 0x7fe0500af580 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fe048009c80 tx=0x7fe04801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 -- 172.21.15.177:0/4272758944 shutdown_connections 2023-10-25T16:24:26.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 --2- 172.21.15.177:0/4272758944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe05006f570 0x7fe05006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 --2- 172.21.15.177:0/4272758944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe050140e90 0x7fe0500af580 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 -- 172.21.15.177:0/4272758944 >> 172.21.15.177:0/4272758944 conn(0x7fe0500b2450 msgr2=0x7fe0500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:26.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 -- 172.21.15.177:0/4272758944 shutdown_connections 2023-10-25T16:24:26.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 -- 172.21.15.177:0/4272758944 wait complete. 2023-10-25T16:24:26.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 Processor -- start 2023-10-25T16:24:26.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.315+0000 7fe0569c0640 1 -- start start 2023-10-25T16:24:26.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe05006bec0 0x7fe0500ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 0x7fe05013cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe050140e90 0x7fe05013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500aac90 con 0x7fe05006f570 2023-10-25T16:24:26.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05014d4c0 con 0x7fe050140e90 2023-10-25T16:24:26.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05013e7e0 con 0x7fe05006bec0 2023-10-25T16:24:26.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 0x7fe05013cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 0x7fe05013cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43060/0 (socket says 172.21.15.177:43060) 2023-10-25T16:24:26.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 -- 172.21.15.177:0/2740219131 learned_addr learned my addr 172.21.15.177:0/2740219131 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:26.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04ffff640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe05006bec0 0x7fe0500ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe054f5d640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe050140e90 0x7fe05013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 -- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe05006bec0 msgr2=0x7fe0500ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe05006bec0 0x7fe0500ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 -- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe050140e90 msgr2=0x7fe05013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe050140e90 0x7fe05013e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 -- 172.21.15.177:0/2740219131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480098e0 con 0x7fe05006f570 2023-10-25T16:24:26.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe054f5d640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe050140e90 0x7fe05013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:26.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04f7fe640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 0x7fe05013cbb0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c970 tx=0x7fe04400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:26.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044007bb0 con 0x7fe05006f570 2023-10-25T16:24:26.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe044007e00 con 0x7fe05006f570 2023-10-25T16:24:26.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05013d0f0 con 0x7fe05006f570 2023-10-25T16:24:26.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044005290 con 0x7fe05006f570 2023-10-25T16:24:26.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0500ae7e0 con 0x7fe05006f570 2023-10-25T16:24:26.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05004daf0 con 0x7fe05006f570 2023-10-25T16:24:26.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe0440053f0 con 0x7fe05006f570 2023-10-25T16:24:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe03c0664a0 0x7fe03c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe044084390 con 0x7fe05006f570 2023-10-25T16:24:26.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fe03c06e030 con 0x7fe05006f570 2023-10-25T16:24:26.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04ffff640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe03c0664a0 0x7fe03c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.319+0000 7fe04ffff640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe03c0664a0 0x7fe03c068960 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe0480af000 tx=0x7fe04801b530 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:26.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.323+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe04401d020 con 0x7fe05006f570 2023-10-25T16:24:26.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.475+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0500c9d50 con 0x7fe05006f570 2023-10-25T16:24:26.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.475+0000 7fe04cff9640 1 -- 172.21.15.177:0/2740219131 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v178) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe044051880 con 0x7fe05006f570 2023-10-25T16:24:26.475 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:24:26.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe03c0664a0 msgr2=0x7fe03c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe03c0664a0 0x7fe03c068960 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe0480af000 tx=0x7fe04801b530 comp rx=0 tx=0).stop 2023-10-25T16:24:26.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 msgr2=0x7fe05013cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 0x7fe05013cbb0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c970 tx=0x7fe04400ce30 comp rx=0 tx=0).stop 2023-10-25T16:24:26.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 shutdown_connections 2023-10-25T16:24:26.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe03c0664a0 0x7fe03c068960 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe050140e90 0x7fe05013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe05006f570 0x7fe05013cbb0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 --2- 172.21.15.177:0/2740219131 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe05006bec0 0x7fe0500ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 >> 172.21.15.177:0/2740219131 conn(0x7fe0500b2450 msgr2=0x7fe0500aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:26.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 shutdown_connections 2023-10-25T16:24:26.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.479+0000 7fe0569c0640 1 -- 172.21.15.177:0/2740219131 wait complete. 2023-10-25T16:24:26.491 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:24:26.491 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:26.492 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:26.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:26.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[53802]: fuse finished with error 0 and tester_r 0 2023-10-25T16:24:26.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:26.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:24:26.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:26.548 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:24:26.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:24:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:26.561 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:24:26.561 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:26.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:26.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- 172.21.15.177:0/1029689918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 msgr2=0x7fcce815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 --2- 172.21.15.177:0/1029689918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce815c810 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fcce0009cb0 tx=0x7fcce001cd00 comp rx=0 tx=0).stop 2023-10-25T16:24:26.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- 172.21.15.177:0/1029689918 shutdown_connections 2023-10-25T16:24:26.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 --2- 172.21.15.177:0/1029689918 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce815c810 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 --2- 172.21.15.177:0/1029689918 >> v2:172.21.15.184:3300/0 conn(0x7fcce813d8f0 0x7fcce80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- 172.21.15.177:0/1029689918 >> 172.21.15.177:0/1029689918 conn(0x7fcce80b2450 msgr2=0x7fcce80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:26.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- 172.21.15.177:0/1029689918 shutdown_connections 2023-10-25T16:24:26.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- 172.21.15.177:0/1029689918 wait complete. 2023-10-25T16:24:26.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 Processor -- start 2023-10-25T16:24:26.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- start start 2023-10-25T16:24:26.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce813d8f0 0x7fcce813fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcce815b710 0x7fcce806f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce8137a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.731+0000 7fcced8aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce813ae90 con 0x7fcce815c3a0 2023-10-25T16:24:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcced8aa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8154540 con 0x7fcce813d8f0 2023-10-25T16:24:26.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcced8aa640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8140360 con 0x7fcce815b710 2023-10-25T16:24:26.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce8137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce8137a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43080/0 (socket says 172.21.15.177:43080) 2023-10-25T16:24:26.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 -- 172.21.15.177:0/4165492942 learned_addr learned my addr 172.21.15.177:0/4165492942 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:26.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 -- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcce815b710 msgr2=0x7fcce806f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcce815b710 0x7fcce806f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 -- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce813d8f0 msgr2=0x7fcce813fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce6ffd640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce813d8f0 0x7fcce813fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce813d8f0 0x7fcce813fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 -- 172.21.15.177:0/4165492942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00098e0 con 0x7fcce815c3a0 2023-10-25T16:24:26.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce77fe640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce8137a00 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fcce001a930 tx=0x7fcce00a5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:26.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0003d90 con 0x7fcce815c3a0 2023-10-25T16:24:26.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcce0004030 con 0x7fcce815c3a0 2023-10-25T16:24:26.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce8153930 con 0x7fcce815c3a0 2023-10-25T16:24:26.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce0004440 con 0x7fcce815c3a0 2023-10-25T16:24:26.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce8153ef0 con 0x7fcce815c3a0 2023-10-25T16:24:26.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce81546d0 con 0x7fcce815c3a0 2023-10-25T16:24:26.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcce00b4040 con 0x7fcce815c3a0 2023-10-25T16:24:26.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fccc8066470 0x7fccc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:26.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcce011e500 con 0x7fcce815c3a0 2023-10-25T16:24:26.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fccc806e000 con 0x7fcce815c3a0 2023-10-25T16:24:26.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce6ffd640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fccc8066470 0x7fccc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:26.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.735+0000 7fcce6ffd640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fccc8066470 0x7fccc8068930 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fccd8003d60 tx=0x7fccd8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:26.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.739+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcce00eb960 con 0x7fcce815c3a0 2023-10-25T16:24:26.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.895+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce804daf0 con 0x7fcce815c3a0 2023-10-25T16:24:26.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcce4ff9640 1 -- 172.21.15.177:0/4165492942 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16680 (secure 0 0 0) 0x7fcce00b2020 con 0x7fcce815c3a0 2023-10-25T16:24:26.895 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:26.896 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":178,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:12.806054+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:26.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fccc8066470 msgr2=0x7fccc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fccc8066470 0x7fccc8068930 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fccd8003d60 tx=0x7fccd8009040 comp rx=0 tx=0).stop 2023-10-25T16:24:26.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 msgr2=0x7fcce8137a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:26.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce8137a00 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fcce001a930 tx=0x7fcce00a5b40 comp rx=0 tx=0).stop 2023-10-25T16:24:26.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 shutdown_connections 2023-10-25T16:24:26.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fccc8066470 0x7fccc8068930 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcce815c3a0 0x7fcce8137a00 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcce815b710 0x7fcce806f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 --2- 172.21.15.177:0/4165492942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce813d8f0 0x7fcce813fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 >> 172.21.15.177:0/4165492942 conn(0x7fcce80b2450 msgr2=0x7fcce80cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 shutdown_connections 2023-10-25T16:24:26.900 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:26.899+0000 7fcced8aa640 1 -- 172.21.15.177:0/4165492942 wait complete. 2023-10-25T16:24:26.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:23:16.807928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:23:17.493379+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:24:26.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:24:27.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 -- 172.21.15.177:0/3485019922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43006b980 msgr2=0x7fd43006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 --2- 172.21.15.177:0/3485019922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43006b980 0x7fd43006be10 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fd43006c6a0 tx=0x7fd42801ccf0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 -- 172.21.15.177:0/3485019922 shutdown_connections 2023-10-25T16:24:27.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 --2- 172.21.15.177:0/3485019922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd43006b980 0x7fd43006be10 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 --2- 172.21.15.177:0/3485019922 >> v2:172.21.15.184:3300/0 conn(0x7fd430071500 0x7fd430070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 -- 172.21.15.177:0/3485019922 >> 172.21.15.177:0/3485019922 conn(0x7fd4300b2450 msgr2=0x7fd4300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 -- 172.21.15.177:0/3485019922 shutdown_connections 2023-10-25T16:24:27.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 -- 172.21.15.177:0/3485019922 wait complete. 2023-10-25T16:24:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 Processor -- start 2023-10-25T16:24:27.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.039+0000 7fd4375bb640 1 -- start start 2023-10-25T16:24:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd43006b980 0x7fd4300af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 0x7fd4301f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd430159230 0x7fd430147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43014ba30 con 0x7fd430071500 2023-10-25T16:24:27.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301f6510 con 0x7fd43006b980 2023-10-25T16:24:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301f67b0 con 0x7fd430159230 2023-10-25T16:24:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 0x7fd4301f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 0x7fd4301f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43102/0 (socket says 172.21.15.177:43102) 2023-10-25T16:24:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 -- 172.21.15.177:0/1518831482 learned_addr learned my addr 172.21.15.177:0/1518831482 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:27.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd435357640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd43006b980 0x7fd4300af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd435b58640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd430159230 0x7fd430147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 -- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd430159230 msgr2=0x7fd430147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd430159230 0x7fd430147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 -- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd43006b980 msgr2=0x7fd4300af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd43006b980 0x7fd4300af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 -- 172.21.15.177:0/1518831482 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280098e0 con 0x7fd430071500 2023-10-25T16:24:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd435b58640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd430159230 0x7fd430147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd434b56640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 0x7fd4301f5fd0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fd42000b4a0 tx=0x7fd42000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420005a20 con 0x7fd430071500 2023-10-25T16:24:27.045 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd420005c70 con 0x7fd430071500 2023-10-25T16:24:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4301f6a90 con 0x7fd430071500 2023-10-25T16:24:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420010870 con 0x7fd430071500 2023-10-25T16:24:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43014bc80 con 0x7fd430071500 2023-10-25T16:24:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43014bea0 con 0x7fd430071500 2023-10-25T16:24:27.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd420005e60 con 0x7fd430071500 2023-10-25T16:24:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd414066470 0x7fd414068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.047 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd4200839d0 con 0x7fd430071500 2023-10-25T16:24:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fd41406e000 con 0x7fd430071500 2023-10-25T16:24:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.043+0000 7fd435357640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd414066470 0x7fd414068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.047+0000 7fd435357640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd414066470 0x7fd414068930 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b810 tx=0x7fd42c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.048 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.051+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd420014060 con 0x7fd430071500 2023-10-25T16:24:27.189 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.191+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd43004daf0 con 0x7fd430071500 2023-10-25T16:24:27.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.191+0000 7fd425ffb640 1 -- 172.21.15.177:0/1518831482 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd42001d020 con 0x7fd430071500 2023-10-25T16:24:27.190 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:24:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd414066470 msgr2=0x7fd414068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd414066470 0x7fd414068930 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00b810 tx=0x7fd42c008040 comp rx=0 tx=0).stop 2023-10-25T16:24:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 msgr2=0x7fd4301f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 0x7fd4301f5fd0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fd42000b4a0 tx=0x7fd42000b960 comp rx=0 tx=0).stop 2023-10-25T16:24:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 shutdown_connections 2023-10-25T16:24:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd414066470 0x7fd414068930 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd430159230 0x7fd430147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd430071500 0x7fd4301f5fd0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 --2- 172.21.15.177:0/1518831482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd43006b980 0x7fd4300af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 >> 172.21.15.177:0/1518831482 conn(0x7fd4300b2450 msgr2=0x7fd4300cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 shutdown_connections 2023-10-25T16:24:27.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.195+0000 7fd4375bb640 1 -- 172.21.15.177:0/1518831482 wait complete. 2023-10-25T16:24:27.208 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:24:27.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- 172.21.15.177:0/1737911998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 msgr2=0x7faa1c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 --2- 172.21.15.177:0/1737911998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c0cdf80 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7faa1c09f200 tx=0x7faa1401cc90 comp rx=0 tx=0).stop 2023-10-25T16:24:27.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- 172.21.15.177:0/1737911998 shutdown_connections 2023-10-25T16:24:27.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 --2- 172.21.15.177:0/1737911998 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c0cdf80 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 --2- 172.21.15.177:0/1737911998 >> v2:172.21.15.184:3300/0 conn(0x7faa1c0b2120 0x7faa1c0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- 172.21.15.177:0/1737911998 >> 172.21.15.177:0/1737911998 conn(0x7faa1c09a5c0 msgr2=0x7faa1c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- 172.21.15.177:0/1737911998 shutdown_connections 2023-10-25T16:24:27.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- 172.21.15.177:0/1737911998 wait complete. 2023-10-25T16:24:27.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 Processor -- start 2023-10-25T16:24:27.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- start start 2023-10-25T16:24:27.332 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa1c0b2120 0x7faa1c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c13d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa1c15eba0 0x7faa1c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0c5c90 con 0x7faa1c0cdb10 2023-10-25T16:24:27.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0c6c40 con 0x7faa1c0b2120 2023-10-25T16:24:27.333 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa240b6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c153fe0 con 0x7faa1c15eba0 2023-10-25T16:24:27.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa21651640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c13d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa21651640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c13d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43114/0 (socket says 172.21.15.177:43114) 2023-10-25T16:24:27.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.331+0000 7faa21651640 1 -- 172.21.15.177:0/3520478876 learned_addr learned my addr 172.21.15.177:0/3520478876 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:27.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21e52640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa1c0b2120 0x7faa1c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.334 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa22653640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa1c15eba0 0x7faa1c1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21651640 1 -- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa1c15eba0 msgr2=0x7faa1c1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21651640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa1c15eba0 0x7faa1c1578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21651640 1 -- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa1c0b2120 msgr2=0x7faa1c152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21651640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa1c0b2120 0x7faa1c152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21651640 1 -- 172.21.15.177:0/3520478876 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140098e0 con 0x7faa1c0cdb10 2023-10-25T16:24:27.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21e52640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa1c0b2120 0x7faa1c152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:27.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21651640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c13d390 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7faa1800d980 tx=0x7faa1800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18009c30 con 0x7faa1c0cdb10 2023-10-25T16:24:27.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faa18005020 con 0x7faa1c0cdb10 2023-10-25T16:24:27.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c1542c0 con 0x7faa1c0cdb10 2023-10-25T16:24:27.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18005430 con 0x7faa1c0cdb10 2023-10-25T16:24:27.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c152790 con 0x7faa1c0cdb10 2023-10-25T16:24:27.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c0c6aa0 con 0x7faa1c0cdb10 2023-10-25T16:24:27.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa180047b0 con 0x7faa1c0cdb10 2023-10-25T16:24:27.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa00066470 0x7faa00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faa18084140 con 0x7faa1c0cdb10 2023-10-25T16:24:27.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7faa0006e000 con 0x7faa1c0cdb10 2023-10-25T16:24:27.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21e52640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa00066470 0x7faa00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.335+0000 7faa21e52640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa00066470 0x7faa00068930 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00a850 tx=0x7faa0c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.339+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa18017020 con 0x7faa1c0cdb10 2023-10-25T16:24:27.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.479+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa1c04daf0 con 0x7faa1c0cdb10 2023-10-25T16:24:27.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa127fc640 1 -- 172.21.15.177:0/3520478876 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa18020070 con 0x7faa1c0cdb10 2023-10-25T16:24:27.479 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:24:27.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa00066470 msgr2=0x7faa00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa00066470 0x7faa00068930 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00a850 tx=0x7faa0c008040 comp rx=0 tx=0).stop 2023-10-25T16:24:27.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 msgr2=0x7faa1c13d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c13d390 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7faa1800d980 tx=0x7faa1800de40 comp rx=0 tx=0).stop 2023-10-25T16:24:27.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 shutdown_connections 2023-10-25T16:24:27.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7faa00066470 0x7faa00068930 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa1c15eba0 0x7faa1c1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa1c0cdb10 0x7faa1c13d390 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 --2- 172.21.15.177:0/3520478876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa1c0b2120 0x7faa1c152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 >> 172.21.15.177:0/3520478876 conn(0x7faa1c09a5c0 msgr2=0x7faa1c15c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 shutdown_connections 2023-10-25T16:24:27.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.483+0000 7faa240b6640 1 -- 172.21.15.177:0/3520478876 wait complete. 2023-10-25T16:24:27.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:24:27.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 -- 172.21.15.177:0/2106947766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0047d0 msgr2=0x7f4fcc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 --2- 172.21.15.177:0/2106947766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0047d0 0x7f4fcc004c50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009b90 tx=0x7f4fd401d250 comp rx=0 tx=0).stop 2023-10-25T16:24:27.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe359e640 1 -- 172.21.15.177:0/2106947766 reap_dead start 2023-10-25T16:24:27.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 -- 172.21.15.177:0/2106947766 shutdown_connections 2023-10-25T16:24:27.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 -- 172.21.15.177:0/2106947766 >> 172.21.15.177:0/2106947766 conn(0x7f4fe409a5c0 msgr2=0x7f4fe40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 -- 172.21.15.177:0/2106947766 shutdown_connections 2023-10-25T16:24:27.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 -- 172.21.15.177:0/2106947766 wait complete. 2023-10-25T16:24:27.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 Processor -- start 2023-10-25T16:24:27.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.623+0000 7f4fe9163640 1 -- start start 2023-10-25T16:24:27.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fcc0047d0 0x7f4fe4150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4fe4161760 0x7f4fe4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 0x7f4fe41432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe4161f80 con 0x7f4fe40caa60 2023-10-25T16:24:27.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe40ca640 con 0x7f4fcc0047d0 2023-10-25T16:24:27.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe4161ca0 con 0x7f4fe4161760 2023-10-25T16:24:27.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 0x7f4fe41432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 0x7f4fe41432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43126/0 (socket says 172.21.15.177:43126) 2023-10-25T16:24:27.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 -- 172.21.15.177:0/568818885 learned_addr learned my addr 172.21.15.177:0/568818885 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:27.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe2d9d640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fcc0047d0 0x7f4fe4150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe259c640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4fe4161760 0x7f4fe4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 -- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4fe4161760 msgr2=0x7f4fe4142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4fe4161760 0x7f4fe4142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 -- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fcc0047d0 msgr2=0x7f4fe4150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fcc0047d0 0x7f4fe4150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 -- 172.21.15.177:0/568818885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe40c9f80 con 0x7f4fe40caa60 2023-10-25T16:24:27.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe359e640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 0x7f4fe41432c0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40c8310 tx=0x7f4fdc00df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00b960 con 0x7f4fe40caa60 2023-10-25T16:24:27.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4fdc00bb00 con 0x7f4fe40caa60 2023-10-25T16:24:27.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40ca260 con 0x7f4fe40caa60 2023-10-25T16:24:27.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc012420 con 0x7f4fe40caa60 2023-10-25T16:24:27.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe415f090 con 0x7f4fe40caa60 2023-10-25T16:24:27.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe40c9de0 con 0x7f4fe40caa60 2023-10-25T16:24:27.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4fdc01a3b0 con 0x7f4fe40caa60 2023-10-25T16:24:27.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd00664a0 0x7f4fd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4fdc083fd0 con 0x7f4fe40caa60 2023-10-25T16:24:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.627+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f4fd006e030 con 0x7f4fe40caa60 2023-10-25T16:24:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.631+0000 7f4fe2d9d640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd00664a0 0x7f4fd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.631+0000 7f4fe2d9d640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd00664a0 0x7f4fd0068960 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009be0 tx=0x7f4fd80091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.631+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4fe40c9de0 con 0x7f4fe40caa60 2023-10-25T16:24:27.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.779+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4fe40ca780 con 0x7f4fe40caa60 2023-10-25T16:24:27.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fcb7fe640 1 -- 172.21.15.177:0/568818885 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fe40ca780 con 0x7f4fe40caa60 2023-10-25T16:24:27.779 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:24:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd00664a0 msgr2=0x7f4fd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd00664a0 0x7f4fd0068960 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009be0 tx=0x7f4fd80091e0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 msgr2=0x7f4fe41432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 0x7f4fe41432c0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40c8310 tx=0x7f4fdc00df00 comp rx=0 tx=0).stop 2023-10-25T16:24:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 shutdown_connections 2023-10-25T16:24:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4fd00664a0 0x7f4fd0068960 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fe40caa60 0x7f4fe41432c0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4fe4161760 0x7f4fe4142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 --2- 172.21.15.177:0/568818885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fcc0047d0 0x7f4fe4150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 >> 172.21.15.177:0/568818885 conn(0x7f4fe409a5c0 msgr2=0x7f4fe4165930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 shutdown_connections 2023-10-25T16:24:27.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.783+0000 7f4fe9163640 1 -- 172.21.15.177:0/568818885 wait complete. 2023-10-25T16:24:27.797 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:24:27.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 -- 172.21.15.177:0/3156982611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85080cdb10 msgr2=0x7f85080cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.909 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 --2- 172.21.15.177:0/3156982611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85080cdb10 0x7f85080cdfc0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f850806a0e0 tx=0x7f850001ccd0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 -- 172.21.15.177:0/3156982611 shutdown_connections 2023-10-25T16:24:27.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 --2- 172.21.15.177:0/3156982611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85080cdb10 0x7f85080cdfc0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 --2- 172.21.15.177:0/3156982611 >> v2:172.21.15.184:3300/0 conn(0x7f85080b2120 0x7f85080d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 --2- 172.21.15.177:0/3156982611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f850815eba0 0x7f85080b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.910 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 -- 172.21.15.177:0/3156982611 >> 172.21.15.177:0/3156982611 conn(0x7f850809a5c0 msgr2=0x7f85080d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:27.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 -- 172.21.15.177:0/3156982611 shutdown_connections 2023-10-25T16:24:27.911 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 -- 172.21.15.177:0/3156982611 wait complete. 2023-10-25T16:24:27.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 Processor -- start 2023-10-25T16:24:27.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.911+0000 7f850dfaf640 1 -- start start 2023-10-25T16:24:27.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85080b2120 0x7f85080c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85080cdb10 0x7f85080c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 0x7f8508159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850815a790 con 0x7f850815eba0 2023-10-25T16:24:27.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c88c0 con 0x7f85080b2120 2023-10-25T16:24:27.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8508159ef0 con 0x7f85080cdb10 2023-10-25T16:24:27.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 0x7f8508159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 0x7f8508159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43144/0 (socket says 172.21.15.177:43144) 2023-10-25T16:24:27.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 -- 172.21.15.177:0/1416340624 learned_addr learned my addr 172.21.15.177:0/1416340624 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:27.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8506ffd640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85080cdb10 0x7f85080c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f85077fe640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85080b2120 0x7f85080c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 -- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85080cdb10 msgr2=0x7f85080c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85080cdb10 0x7f85080c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 -- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85080b2120 msgr2=0x7f85080c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:27.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85080b2120 0x7f85080c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:27.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 -- 172.21.15.177:0/1416340624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000098e0 con 0x7f850815eba0 2023-10-25T16:24:27.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f8507fff640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 0x7f8508159430 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f850001b380 tx=0x7f8500003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500004e60 con 0x7f850815eba0 2023-10-25T16:24:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8500003fd0 con 0x7f850815eba0 2023-10-25T16:24:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500004360 con 0x7f850815eba0 2023-10-25T16:24:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850815a1d0 con 0x7f850815eba0 2023-10-25T16:24:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8508151ef0 con 0x7f850815eba0 2023-10-25T16:24:27.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8508151d50 con 0x7f850815eba0 2023-10-25T16:24:27.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f85000b4040 con 0x7f850815eba0 2023-10-25T16:24:27.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:27.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f850011e0d0 con 0x7f850815eba0 2023-10-25T16:24:27.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f84f406e000 con 0x7f850815eba0 2023-10-25T16:24:27.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.915+0000 7f85077fe640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:27.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.919+0000 7f85077fe640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f84f80058d0 tx=0x7f84f8005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:27.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:27.923+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f85000bc060 con 0x7f850815eba0 2023-10-25T16:24:28.077 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.079+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8508152130 con 0x7f850815eba0 2023-10-25T16:24:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.079+0000 7f84effff640 1 -- 172.21.15.177:0/1416340624 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v178) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8508152130 con 0x7f850815eba0 2023-10-25T16:24:28.078 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:24:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 msgr2=0x7f84f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f84f80058d0 tx=0x7f84f8005860 comp rx=0 tx=0).stop 2023-10-25T16:24:28.080 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 msgr2=0x7f8508159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 0x7f8508159430 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f850001b380 tx=0x7f8500003f60 comp rx=0 tx=0).stop 2023-10-25T16:24:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 shutdown_connections 2023-10-25T16:24:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f84f4066470 0x7f84f4068930 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850815eba0 0x7f8508159430 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85080cdb10 0x7f85080c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.081 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 --2- 172.21.15.177:0/1416340624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85080b2120 0x7f85080c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 >> 172.21.15.177:0/1416340624 conn(0x7f850809a5c0 msgr2=0x7f85080b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 shutdown_connections 2023-10-25T16:24:28.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.083+0000 7f850dfaf640 1 -- 172.21.15.177:0/1416340624 wait complete. 2023-10-25T16:24:28.096 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:24:28.096 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:28.097 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:28.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:28.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35527]: fuse finished with error 0 and tester_r 0 2023-10-25T16:24:28.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:28.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:24:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:28.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:24:28.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:28.161 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:24:28.168 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:24:28.169 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:28.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:24:28.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:24:28.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:28.175 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:24:28.223 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:24:28.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:24:28.224 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:24:28.225 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:28.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:24:28.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:24:28.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:28.231 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:24:28.278 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:24:28.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:24:28.279 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:28.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/439145522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 msgr2=0x7fa9d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/439145522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9d8003da0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc001d70 tx=0x7fa9dc01cac0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/439145522 shutdown_connections 2023-10-25T16:24:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/439145522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9d8003da0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/439145522 >> 172.21.15.177:0/439145522 conn(0x7fa9ec0b2450 msgr2=0x7fa9ec0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/439145522 shutdown_connections 2023-10-25T16:24:28.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/439145522 wait complete. 2023-10-25T16:24:28.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 Processor -- start 2023-10-25T16:24:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 -- start start 2023-10-25T16:24:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9ec0ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9ec0a86a0 0x7fa9ec0abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.411+0000 7fa9f2fd6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9ec0a8b20 0x7fa9ec159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f2fd6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0aa4d0 con 0x7fa9d8003980 2023-10-25T16:24:28.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f2fd6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0aa7b0 con 0x7fa9ec0a86a0 2023-10-25T16:24:28.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f2fd6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0aaa90 con 0x7fa9ec0a8b20 2023-10-25T16:24:28.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9ec0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9ec0ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43172/0 (socket says 172.21.15.177:43172) 2023-10-25T16:24:28.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 -- 172.21.15.177:0/2378733534 learned_addr learned my addr 172.21.15.177:0/2378733534 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:28.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9ebfff640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9ec0a86a0 0x7fa9ec0abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f1573640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9ec0a8b20 0x7fa9ec159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 -- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9ec0a8b20 msgr2=0x7fa9ec159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9ec0a8b20 0x7fa9ec159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 -- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9ec0a86a0 msgr2=0x7fa9ec0abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9ec0a86a0 0x7fa9ec0abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 -- 172.21.15.177:0/2378733534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0aad70 con 0x7fa9d8003980 2023-10-25T16:24:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9ebfff640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9ec0a86a0 0x7fa9ec0abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f0d72640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9ec0ab290 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc01c8f0 tx=0x7fa9dc0067c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc006c70 con 0x7fa9d8003980 2023-10-25T16:24:28.416 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa9dc003e20 con 0x7fa9d8003980 2023-10-25T16:24:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec0aa180 con 0x7fa9d8003980 2023-10-25T16:24:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc0a58c0 con 0x7fa9d8003980 2023-10-25T16:24:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec0ac040 con 0x7fa9d8003980 2023-10-25T16:24:28.417 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec0ac230 con 0x7fa9d8003980 2023-10-25T16:24:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9dc0b5070 con 0x7fa9d8003980 2023-10-25T16:24:28.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9cc066470 0x7fa9cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa9dc0aa070 con 0x7fa9d8003980 2023-10-25T16:24:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fa9cc06e000 con 0x7fa9d8003980 2023-10-25T16:24:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.415+0000 7fa9ebfff640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9cc066470 0x7fa9cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.419+0000 7fa9ebfff640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9cc066470 0x7fa9cc068930 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0a9d80 tx=0x7fa9d4005ad0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:28.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.419+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9dc0eba50 con 0x7fa9d8003980 2023-10-25T16:24:28.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.591+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9ec0aa610 con 0x7fa9d8003980 2023-10-25T16:24:28.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.591+0000 7fa9e97fa640 1 -- 172.21.15.177:0/2378733534 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fa9ec0aa610 con 0x7fa9d8003980 2023-10-25T16:24:28.589 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:28.589 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:24:28.590 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:24:28.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9cc066470 msgr2=0x7fa9cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9cc066470 0x7fa9cc068930 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0a9d80 tx=0x7fa9d4005ad0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 msgr2=0x7fa9ec0ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.591 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9ec0ab290 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc01c8f0 tx=0x7fa9dc0067c0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 shutdown_connections 2023-10-25T16:24:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9cc066470 0x7fa9cc068930 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9ec0a8b20 0x7fa9ec159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9ec0a86a0 0x7fa9ec0abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.592 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 --2- 172.21.15.177:0/2378733534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9d8003980 0x7fa9ec0ab290 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 >> 172.21.15.177:0/2378733534 conn(0x7fa9ec0b2450 msgr2=0x7fa9ec06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:28.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 shutdown_connections 2023-10-25T16:24:28.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.595+0000 7fa9f2fd6640 1 -- 172.21.15.177:0/2378733534 wait complete. 2023-10-25T16:24:28.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:28.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/2340143735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc0b2120 msgr2=0x7f5ddc0d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 --2- 172.21.15.177:0/2340143735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc0b2120 0x7f5ddc0d1bd0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009900 tx=0x7f5dd001c7f0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/2340143735 shutdown_connections 2023-10-25T16:24:28.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 --2- 172.21.15.177:0/2340143735 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc0b2120 0x7f5ddc0d1bd0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 --2- 172.21.15.177:0/2340143735 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ddc15eba0 0x7f5ddc0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.728 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/2340143735 >> 172.21.15.177:0/2340143735 conn(0x7f5ddc09a5c0 msgr2=0x7f5ddc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:28.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/2340143735 shutdown_connections 2023-10-25T16:24:28.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/2340143735 wait complete. 2023-10-25T16:24:28.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 Processor -- start 2023-10-25T16:24:28.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- start start 2023-10-25T16:24:28.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ddc0b2120 0x7f5ddc152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ddc0cdb10 0x7f5ddc14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 0x7f5ddc15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc14ff60 con 0x7f5ddc15eba0 2023-10-25T16:24:28.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc15adb0 con 0x7f5ddc0cdb10 2023-10-25T16:24:28.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1526e0 con 0x7f5ddc0b2120 2023-10-25T16:24:28.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 0x7f5ddc15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 0x7f5ddc15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43178/0 (socket says 172.21.15.177:43178) 2023-10-25T16:24:28.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 -- 172.21.15.177:0/3437149571 learned_addr learned my addr 172.21.15.177:0/3437149571 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:28.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 -- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ddc0b2120 msgr2=0x7f5ddc152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ddc0b2120 0x7f5ddc152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 -- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ddc0cdb10 msgr2=0x7f5ddc14fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5ddb7fe640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ddc0cdb10 0x7f5ddc14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ddc0cdb10 0x7f5ddc14fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 -- 172.21.15.177:0/3437149571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009560 con 0x7f5ddc15eba0 2023-10-25T16:24:28.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de0c92640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 0x7f5ddc15a870 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400c780 tx=0x7f5dd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:28.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4003d90 con 0x7f5ddc15eba0 2023-10-25T16:24:28.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5dd400ce90 con 0x7f5ddc15eba0 2023-10-25T16:24:28.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc1529c0 con 0x7f5ddc15eba0 2023-10-25T16:24:28.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40052d0 con 0x7f5ddc15eba0 2023-10-25T16:24:28.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.731+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc152f80 con 0x7f5ddc15eba0 2023-10-25T16:24:28.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc04daf0 con 0x7f5ddc15eba0 2023-10-25T16:24:28.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5dd4005430 con 0x7f5ddc15eba0 2023-10-25T16:24:28.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5dd8ff9640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5dc80664a0 0x7f5dc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:28.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5dd40834f0 con 0x7f5ddc15eba0 2023-10-25T16:24:28.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f5dc806e030 con 0x7f5ddc15eba0 2023-10-25T16:24:28.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5ddbfff640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5dc80664a0 0x7f5dc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:28.737 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.735+0000 7f5ddbfff640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5dc80664a0 0x7f5dc8068960 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009690 tx=0x7f5dcc006c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:28.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.739+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5dd4050950 con 0x7f5ddc15eba0 2023-10-25T16:24:28.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.879+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ddc0ce930 con 0x7f5ddc15eba0 2023-10-25T16:24:28.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5dd8ff9640 1 -- 172.21.15.177:0/3437149571 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16680 (secure 0 0 0) 0x7f5dd4017090 con 0x7f5ddc15eba0 2023-10-25T16:24:28.879 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:28.879 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":178,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:12.806054+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:28.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5dc80664a0 msgr2=0x7f5dc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5dc80664a0 0x7f5dc8068960 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009690 tx=0x7f5dcc006c00 comp rx=0 tx=0).stop 2023-10-25T16:24:28.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 msgr2=0x7f5ddc15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:28.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 0x7f5ddc15a870 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400c780 tx=0x7f5dd400cc40 comp rx=0 tx=0).stop 2023-10-25T16:24:28.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 shutdown_connections 2023-10-25T16:24:28.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5dc80664a0 0x7f5dc8068960 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ddc15eba0 0x7f5ddc15a870 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ddc0cdb10 0x7f5ddc14fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 --2- 172.21.15.177:0/3437149571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ddc0b2120 0x7f5ddc152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:28.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 >> 172.21.15.177:0/3437149571 conn(0x7f5ddc09a5c0 msgr2=0x7f5ddc0d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:28.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 shutdown_connections 2023-10-25T16:24:28.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:28.883+0000 7f5de26f5640 1 -- 172.21.15.177:0/3437149571 wait complete. 2023-10-25T16:24:28.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:23:16.807928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:23:17.493379+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:24:28.898 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:24:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 -- 172.21.15.177:0/1083486665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea280af2d0 msgr2=0x7fea28158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 --2- 172.21.15.177:0/1083486665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea280af2d0 0x7fea28158170 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fea20009bc0 tx=0x7fea2001caf0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 -- 172.21.15.177:0/1083486665 shutdown_connections 2023-10-25T16:24:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 --2- 172.21.15.177:0/1083486665 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea280af2d0 0x7fea28158170 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 --2- 172.21.15.177:0/1083486665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea2814e810 0x7fea280cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 -- 172.21.15.177:0/1083486665 >> 172.21.15.177:0/1083486665 conn(0x7fea280b2450 msgr2=0x7fea280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 -- 172.21.15.177:0/1083486665 shutdown_connections 2023-10-25T16:24:29.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.015+0000 7fea2cad0640 1 -- 172.21.15.177:0/1083486665 wait complete. 2023-10-25T16:24:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 Processor -- start 2023-10-25T16:24:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- start start 2023-10-25T16:24:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea280af2d0 0x7fea2815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 0x7fea28160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea2815bdb0 0x7fea2813d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2814ca50 con 0x7fea2814e810 2023-10-25T16:24:29.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2814c1b0 con 0x7fea2815bdb0 2023-10-25T16:24:29.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2814c490 con 0x7fea280af2d0 2023-10-25T16:24:29.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 0x7fea28160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 0x7fea28160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43194/0 (socket says 172.21.15.177:43194) 2023-10-25T16:24:29.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 -- 172.21.15.177:0/2244751368 learned_addr learned my addr 172.21.15.177:0/2244751368 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:29.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea26d9d640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea2815bdb0 0x7fea2813d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2659c640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea280af2d0 0x7fea2815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 -- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea280af2d0 msgr2=0x7fea2815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea280af2d0 0x7fea2815eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 -- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea2815bdb0 msgr2=0x7fea2813d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea2815bdb0 0x7fea2813d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 -- 172.21.15.177:0/2244751368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20009820 con 0x7fea2814e810 2023-10-25T16:24:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea25d9b640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 0x7fea28160bb0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00c3c0 tx=0x7fea1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c0054e0 con 0x7fea2814e810 2023-10-25T16:24:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea1c003600 con 0x7fea2814e810 2023-10-25T16:24:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c003a70 con 0x7fea2814e810 2023-10-25T16:24:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2814c770 con 0x7fea2814e810 2023-10-25T16:24:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2815f4b0 con 0x7fea2814e810 2023-10-25T16:24:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.019+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2804daf0 con 0x7fea2814e810 2023-10-25T16:24:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.023+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea1c003bd0 con 0x7fea2814e810 2023-10-25T16:24:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.023+0000 7fea16ffd640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea08066470 0x7fea08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.023+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fea1c0833b0 con 0x7fea2814e810 2023-10-25T16:24:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.023+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fea0806e000 con 0x7fea2814e810 2023-10-25T16:24:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.023+0000 7fea2659c640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea08066470 0x7fea08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.023+0000 7fea2659c640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea08066470 0x7fea08068930 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a830 tx=0x7fea18008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.027+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea1c017060 con 0x7fea2814e810 2023-10-25T16:24:29.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.167+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea280cc140 con 0x7fea2814e810 2023-10-25T16:24:29.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.167+0000 7fea16ffd640 1 -- 172.21.15.177:0/2244751368 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea1c050950 con 0x7fea2814e810 2023-10-25T16:24:29.166 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:24:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea08066470 msgr2=0x7fea08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea08066470 0x7fea08068930 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a830 tx=0x7fea18008040 comp rx=0 tx=0).stop 2023-10-25T16:24:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 msgr2=0x7fea28160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 0x7fea28160bb0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00c3c0 tx=0x7fea1c00c880 comp rx=0 tx=0).stop 2023-10-25T16:24:29.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 shutdown_connections 2023-10-25T16:24:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fea08066470 0x7fea08068930 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea2815bdb0 0x7fea2813d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2814e810 0x7fea28160bb0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 --2- 172.21.15.177:0/2244751368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea280af2d0 0x7fea2815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 >> 172.21.15.177:0/2244751368 conn(0x7fea280b2450 msgr2=0x7fea2814d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 shutdown_connections 2023-10-25T16:24:29.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.171+0000 7fea2cad0640 1 -- 172.21.15.177:0/2244751368 wait complete. 2023-10-25T16:24:29.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:24:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- 172.21.15.177:0/3131351205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 msgr2=0x7fcb3c0c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- 172.21.15.177:0/3131351205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c0c2b30 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0718b0 tx=0x7fcb2c01c870 comp rx=0 tx=0).stop 2023-10-25T16:24:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- 172.21.15.177:0/3131351205 shutdown_connections 2023-10-25T16:24:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- 172.21.15.177:0/3131351205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c0af110 0x7fcb3c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- 172.21.15.177:0/3131351205 >> v2:172.21.15.184:3300/0 conn(0x7fcb3c0b0a20 0x7fcb3c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- 172.21.15.177:0/3131351205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c0c2b30 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- 172.21.15.177:0/3131351205 >> 172.21.15.177:0/3131351205 conn(0x7fcb3c0cefe0 msgr2=0x7fcb3c0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- 172.21.15.177:0/3131351205 shutdown_connections 2023-10-25T16:24:29.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- 172.21.15.177:0/3131351205 wait complete. 2023-10-25T16:24:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 Processor -- start 2023-10-25T16:24:29.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- start start 2023-10-25T16:24:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c0af110 0x7fcb3c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c0b0a20 0x7fcb3c1520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0b3610 con 0x7fcb3c1591e0 2023-10-25T16:24:29.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0b38b0 con 0x7fcb3c0b0a20 2023-10-25T16:24:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb4246e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0b3b90 con 0x7fcb3c0af110 2023-10-25T16:24:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43216/0 (socket says 172.21.15.177:43216) 2023-10-25T16:24:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 -- 172.21.15.177:0/1344751273 learned_addr learned my addr 172.21.15.177:0/1344751273 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:29.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb3bfff640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c0af110 0x7fcb3c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb3b7fe640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c0b0a20 0x7fcb3c1520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 -- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c0af110 msgr2=0x7fcb3c0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c0af110 0x7fcb3c0b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 -- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c0b0a20 msgr2=0x7fcb3c1520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c0b0a20 0x7fcb3c1520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.299+0000 7fcb40a0b640 1 -- 172.21.15.177:0/1344751273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c009560 con 0x7fcb3c1591e0 2023-10-25T16:24:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb40a0b640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c156200 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400cce0 tx=0x7fcb3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400f450 con 0x7fcb3c1591e0 2023-10-25T16:24:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb3400f6a0 con 0x7fcb3c1591e0 2023-10-25T16:24:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c0b3e70 con 0x7fcb3c1591e0 2023-10-25T16:24:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400fab0 con 0x7fcb3c1591e0 2023-10-25T16:24:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c0b4430 con 0x7fcb3c1591e0 2023-10-25T16:24:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c04daf0 con 0x7fcb3c1591e0 2023-10-25T16:24:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb3400fc10 con 0x7fcb3c1591e0 2023-10-25T16:24:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb28066470 0x7fcb28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcb34084a50 con 0x7fcb3c1591e0 2023-10-25T16:24:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fcb2806e000 con 0x7fcb3c1591e0 2023-10-25T16:24:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb3bfff640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb28066470 0x7fcb28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.303+0000 7fcb3bfff640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb28066470 0x7fcb28068930 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0af000 tx=0x7fcb2c01b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.307+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb34051f60 con 0x7fcb3c1591e0 2023-10-25T16:24:29.445 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.447+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb3c15c280 con 0x7fcb3c1591e0 2023-10-25T16:24:29.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.447+0000 7fcb38ff9640 1 -- 172.21.15.177:0/1344751273 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb34055580 con 0x7fcb3c1591e0 2023-10-25T16:24:29.446 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:24:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb28066470 msgr2=0x7fcb28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb28066470 0x7fcb28068930 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0af000 tx=0x7fcb2c01b0b0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 msgr2=0x7fcb3c156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c156200 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400cce0 tx=0x7fcb3400a620 comp rx=0 tx=0).stop 2023-10-25T16:24:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 shutdown_connections 2023-10-25T16:24:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcb28066470 0x7fcb28068930 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcb3c1591e0 0x7fcb3c156200 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c0b0a20 0x7fcb3c1520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 --2- 172.21.15.177:0/1344751273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c0af110 0x7fcb3c0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 >> 172.21.15.177:0/1344751273 conn(0x7fcb3c0cefe0 msgr2=0x7fcb3c0c3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 shutdown_connections 2023-10-25T16:24:29.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.451+0000 7fcb4246e640 1 -- 172.21.15.177:0/1344751273 wait complete. 2023-10-25T16:24:29.463 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:24:29.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 -- 172.21.15.177:0/1288216923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c0af5d0 msgr2=0x7f7e0c06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 --2- 172.21.15.177:0/1288216923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c06ba70 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009cb0 tx=0x7f7e0401cd40 comp rx=0 tx=0).stop 2023-10-25T16:24:29.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 -- 172.21.15.177:0/1288216923 shutdown_connections 2023-10-25T16:24:29.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 --2- 172.21.15.177:0/1288216923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c06ba70 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 -- 172.21.15.177:0/1288216923 >> 172.21.15.177:0/1288216923 conn(0x7f7e0c0b2450 msgr2=0x7f7e0c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 -- 172.21.15.177:0/1288216923 shutdown_connections 2023-10-25T16:24:29.590 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 -- 172.21.15.177:0/1288216923 wait complete. 2023-10-25T16:24:29.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 Processor -- start 2023-10-25T16:24:29.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.591+0000 7f7e1307a640 1 -- start start 2023-10-25T16:24:29.593 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e0c13d8f0 0x7f7e0c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 0x7f7e0c0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c159090 con 0x7f7e0c15b710 2023-10-25T16:24:29.594 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c15a440 con 0x7f7e0c0af5d0 2023-10-25T16:24:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c158ba0 con 0x7f7e0c13d8f0 2023-10-25T16:24:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 0x7f7e0c0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 0x7f7e0c0aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43234/0 (socket says 172.21.15.177:43234) 2023-10-25T16:24:29.595 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 -- 172.21.15.177:0/3397393875 learned_addr learned my addr 172.21.15.177:0/3397393875 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e10e16640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 -- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e0c13d8f0 msgr2=0x7f7e0c155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e0bfff640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e0c13d8f0 0x7f7e0c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e0c13d8f0 0x7f7e0c155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 -- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e0c0af5d0 msgr2=0x7f7e0c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 -- 172.21.15.177:0/3397393875 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e040098e0 con 0x7f7e0c15b710 2023-10-25T16:24:29.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e10e16640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:29.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e11617640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 0x7f7e0c0aa8b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f7e04019950 tx=0x7f7e040a5a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040ba070 con 0x7f7e0c15b710 2023-10-25T16:24:29.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e04004a50 con 0x7f7e0c15b710 2023-10-25T16:24:29.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c0aca80 con 0x7f7e0c15b710 2023-10-25T16:24:29.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004e20 con 0x7f7e0c15b710 2023-10-25T16:24:29.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c159d80 con 0x7f7e0c15b710 2023-10-25T16:24:29.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c04daf0 con 0x7f7e0c15b710 2023-10-25T16:24:29.599 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e040b4040 con 0x7f7e0c15b710 2023-10-25T16:24:29.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7df8066470 0x7f7df8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7e0411e780 con 0x7f7e0c15b710 2023-10-25T16:24:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f7df806e000 con 0x7f7e0c15b710 2023-10-25T16:24:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.595+0000 7f7e10e16640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7df8066470 0x7f7df8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.599+0000 7f7e10e16640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7df8066470 0x7f7df8068930 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c06be10 tx=0x7f7dfc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.599+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e040b2070 con 0x7f7e0c15b710 2023-10-25T16:24:29.739 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e0c04daf0 con 0x7f7e0c15b710 2023-10-25T16:24:29.740 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e097fa640 1 -- 172.21.15.177:0/3397393875 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e040ebc70 con 0x7f7e0c15b710 2023-10-25T16:24:29.740 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:24:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7df8066470 msgr2=0x7f7df8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7df8066470 0x7f7df8068930 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c06be10 tx=0x7f7dfc009040 comp rx=0 tx=0).stop 2023-10-25T16:24:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 msgr2=0x7f7e0c0aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 0x7f7e0c0aa8b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f7e04019950 tx=0x7f7e040a5a10 comp rx=0 tx=0).stop 2023-10-25T16:24:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 shutdown_connections 2023-10-25T16:24:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7df8066470 0x7f7df8068930 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e0c15b710 0x7f7e0c0aa8b0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e0c13d8f0 0x7f7e0c155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 --2- 172.21.15.177:0/3397393875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e0c0af5d0 0x7f7e0c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 >> 172.21.15.177:0/3397393875 conn(0x7f7e0c0b2450 msgr2=0x7f7e0c0afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 shutdown_connections 2023-10-25T16:24:29.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.743+0000 7f7e1307a640 1 -- 172.21.15.177:0/3397393875 wait complete. 2023-10-25T16:24:29.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:29.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 -- 172.21.15.177:0/3515657657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c006beb0 msgr2=0x7f03c0070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 --2- 172.21.15.177:0/3515657657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c006beb0 0x7f03c0070e00 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009c80 tx=0x7f03b801cbd0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 -- 172.21.15.177:0/3515657657 shutdown_connections 2023-10-25T16:24:29.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 --2- 172.21.15.177:0/3515657657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c006beb0 0x7f03c0070e00 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 -- 172.21.15.177:0/3515657657 >> 172.21.15.177:0/3515657657 conn(0x7f03c00b2450 msgr2=0x7f03c00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:29.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 -- 172.21.15.177:0/3515657657 shutdown_connections 2023-10-25T16:24:29.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.875+0000 7f03c4e72640 1 -- 172.21.15.177:0/3515657657 wait complete. 2023-10-25T16:24:29.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 Processor -- start 2023-10-25T16:24:29.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- start start 2023-10-25T16:24:29.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c006ba00 0x7f03c01eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c006beb0 0x7f03c0143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 0x7f03c0157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01f0460 con 0x7f03c01500f0 2023-10-25T16:24:29.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01511c0 con 0x7f03c006ba00 2023-10-25T16:24:29.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c0151430 con 0x7f03c006beb0 2023-10-25T16:24:29.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 0x7f03c0157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 0x7f03c0157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43244/0 (socket says 172.21.15.177:43244) 2023-10-25T16:24:29.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 -- 172.21.15.177:0/667525497 learned_addr learned my addr 172.21.15.177:0/667525497 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:29.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03be59c640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c006ba00 0x7f03c01eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 -- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c006beb0 msgr2=0x7f03c0143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bdd9b640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c006beb0 0x7f03c0143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c006beb0 0x7f03c0143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 -- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c006ba00 msgr2=0x7f03c01eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:29.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c006ba00 0x7f03c01eff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:29.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 -- 172.21.15.177:0/667525497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80098e0 con 0x7f03c01500f0 2023-10-25T16:24:29.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bdd9b640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c006beb0 0x7f03c0143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:29.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03bed9d640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 0x7f03c0157d40 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009bd0 tx=0x7f03b8005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8005760 con 0x7f03c01500f0 2023-10-25T16:24:29.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f03b80059b0 con 0x7f03c01500f0 2023-10-25T16:24:29.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8003be0 con 0x7f03c01500f0 2023-10-25T16:24:29.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c0151710 con 0x7f03c01500f0 2023-10-25T16:24:29.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c0151cd0 con 0x7f03c01500f0 2023-10-25T16:24:29.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.879+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c0151ec0 con 0x7f03c01500f0 2023-10-25T16:24:29.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.883+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f03b80b4040 con 0x7f03c01500f0 2023-10-25T16:24:29.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.883+0000 7f03aeffd640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03a0066470 0x7f03a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:29.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.883+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f03b811ea60 con 0x7f03c01500f0 2023-10-25T16:24:29.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.883+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f03a006e000 con 0x7f03c01500f0 2023-10-25T16:24:29.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.883+0000 7f03be59c640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03a0066470 0x7f03a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:29.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.883+0000 7f03be59c640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03a0066470 0x7f03a0068930 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f03b4004e30 tx=0x7f03b4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:29.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:29.887+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03b80ba060 con 0x7f03c01500f0 2023-10-25T16:24:30.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03c0151ec0 con 0x7f03c01500f0 2023-10-25T16:24:30.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03aeffd640 1 -- 172.21.15.177:0/667525497 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f03b80b2020 con 0x7f03c01500f0 2023-10-25T16:24:30.064 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:30.064 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:24:30.064 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:24:30.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03a0066470 msgr2=0x7f03a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03a0066470 0x7f03a0068930 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f03b4004e30 tx=0x7f03b4009040 comp rx=0 tx=0).stop 2023-10-25T16:24:30.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 msgr2=0x7f03c0157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 0x7f03c0157d40 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009bd0 tx=0x7f03b8005360 comp rx=0 tx=0).stop 2023-10-25T16:24:30.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 shutdown_connections 2023-10-25T16:24:30.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f03a0066470 0x7f03a0068930 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03c01500f0 0x7f03c0157d40 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03c006beb0 0x7f03c0143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 --2- 172.21.15.177:0/667525497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03c006ba00 0x7f03c01eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 >> 172.21.15.177:0/667525497 conn(0x7f03c00b2450 msgr2=0x7f03c0070660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:30.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 shutdown_connections 2023-10-25T16:24:30.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.067+0000 7f03c4e72640 1 -- 172.21.15.177:0/667525497 wait complete. 2023-10-25T16:24:30.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:30.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1939917240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c003fe0 msgr2=0x7fc92c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1939917240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc92c003fe0 0x7fc92c0047d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc93000bb20 tx=0x7fc93001cd60 comp rx=0 tx=0).stop 2023-10-25T16:24:30.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 -- 172.21.15.177:0/1939917240 reap_dead start 2023-10-25T16:24:30.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1939917240 shutdown_connections 2023-10-25T16:24:30.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1939917240 >> 172.21.15.177:0/1939917240 conn(0x7fc9400b2450 msgr2=0x7fc9400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:30.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1939917240 shutdown_connections 2023-10-25T16:24:30.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1939917240 wait complete. 2023-10-25T16:24:30.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 Processor -- start 2023-10-25T16:24:30.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- start start 2023-10-25T16:24:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc92c003fe0 0x7fc94013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401568e0 0x7fc9401f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 0x7fc940136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401f3590 con 0x7fc9401f3100 2023-10-25T16:24:30.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401f3870 con 0x7fc9401568e0 2023-10-25T16:24:30.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401f3b50 con 0x7fc92c003fe0 2023-10-25T16:24:30.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 0x7fc940136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 0x7fc940136520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43250/0 (socket says 172.21.15.177:43250) 2023-10-25T16:24:30.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 -- 172.21.15.177:0/1656851277 learned_addr learned my addr 172.21.15.177:0/1656851277 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:30.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc945755640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401568e0 0x7fc9401f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc945f56640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc92c003fe0 0x7fc94013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 -- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc92c003fe0 msgr2=0x7fc94013fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc92c003fe0 0x7fc94013fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 -- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401568e0 msgr2=0x7fc9401f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401568e0 0x7fc9401f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 -- 172.21.15.177:0/1656851277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9401f3e30 con 0x7fc9401f3100 2023-10-25T16:24:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc946757640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 0x7fc940136520 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c10 tx=0x7fc93c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011660 con 0x7fc9401f3100 2023-10-25T16:24:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc93c0118d0 con 0x7fc9401f3100 2023-10-25T16:24:30.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9401580d0 con 0x7fc9401f3100 2023-10-25T16:24:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011ce0 con 0x7fc9401f3100 2023-10-25T16:24:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.207+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc940136a60 con 0x7fc9401f3100 2023-10-25T16:24:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94004daf0 con 0x7fc9401f3100 2023-10-25T16:24:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc93c0103c0 con 0x7fc9401f3100 2023-10-25T16:24:30.212 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc9367fc640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc924066470 0x7fc924068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.213 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc93c084540 con 0x7fc9401f3100 2023-10-25T16:24:30.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fc92406e000 con 0x7fc9401f3100 2023-10-25T16:24:30.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc945f56640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc924066470 0x7fc924068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.211+0000 7fc945f56640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc924066470 0x7fc924068930 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc938001590 tx=0x7fc9380014a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:30.214 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.215+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc93c015020 con 0x7fc9401f3100 2023-10-25T16:24:30.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.367+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9400ca670 con 0x7fc9401f3100 2023-10-25T16:24:30.368 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.371+0000 7fc9367fc640 1 -- 172.21.15.177:0/1656851277 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16680 (secure 0 0 0) 0x7fc93c051a30 con 0x7fc9401f3100 2023-10-25T16:24:30.369 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:30.369 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":178,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:12.806054+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:30.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.371+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc924066470 msgr2=0x7fc924068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.371+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc924066470 0x7fc924068930 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc938001590 tx=0x7fc9380014a0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.371+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 msgr2=0x7fc940136520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.371+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 0x7fc940136520 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c10 tx=0x7fc93c001640 comp rx=0 tx=0).stop 2023-10-25T16:24:30.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 shutdown_connections 2023-10-25T16:24:30.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc924066470 0x7fc924068930 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9401f3100 0x7fc940136520 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401568e0 0x7fc9401f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.372 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 --2- 172.21.15.177:0/1656851277 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc92c003fe0 0x7fc94013fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 >> 172.21.15.177:0/1656851277 conn(0x7fc9400b2450 msgr2=0x7fc9400b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:30.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 shutdown_connections 2023-10-25T16:24:30.373 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.375+0000 7fc9481ba640 1 -- 172.21.15.177:0/1656851277 wait complete. 2023-10-25T16:24:30.387 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:24:30.389 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:30.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- 172.21.15.177:0/3860342432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0ec003980 msgr2=0x7fc0ec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 --2- 172.21.15.177:0/3860342432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0ec003980 0x7fc0ec003da0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c260 tx=0x7fc0fc01cfc0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.508 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- 172.21.15.177:0/3860342432 shutdown_connections 2023-10-25T16:24:30.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 --2- 172.21.15.177:0/3860342432 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0ec003980 0x7fc0ec003da0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- 172.21.15.177:0/3860342432 >> 172.21.15.177:0/3860342432 conn(0x7fc10c0b2450 msgr2=0x7fc10c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:30.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- 172.21.15.177:0/3860342432 shutdown_connections 2023-10-25T16:24:30.509 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- 172.21.15.177:0/3860342432 wait complete. 2023-10-25T16:24:30.512 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 Processor -- start 2023-10-25T16:24:30.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- start start 2023-10-25T16:24:30.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0ec003980 0x7fc10c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc10c147ac0 0x7fc10c1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 0x7fc10c146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.513 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c156650 con 0x7fc10c147570 2023-10-25T16:24:30.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c156b80 con 0x7fc0ec003980 2023-10-25T16:24:30.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc111a04640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0acc40 con 0x7fc10c147ac0 2023-10-25T16:24:30.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 0x7fc10c146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 0x7fc10c146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43024/0 (socket says 172.21.15.177:43024) 2023-10-25T16:24:30.514 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 -- 172.21.15.177:0/3919760868 learned_addr learned my addr 172.21.15.177:0/3919760868 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:30.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc1027fc640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc10c147ac0 0x7fc10c1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10affd640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0ec003980 0x7fc10c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 -- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc10c147ac0 msgr2=0x7fc10c1469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc10c147ac0 0x7fc10c1469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.515 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 -- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0ec003980 msgr2=0x7fc10c15b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0ec003980 0x7fc10c15b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.511+0000 7fc10b7fe640 1 -- 172.21.15.177:0/3919760868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c14c600 con 0x7fc10c147570 2023-10-25T16:24:30.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc10b7fe640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 0x7fc10c146f30 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0ca4b0 tx=0x7fc10400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:30.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104003b80 con 0x7fc10c147570 2023-10-25T16:24:30.516 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc104003ce0 con 0x7fc10c147570 2023-10-25T16:24:30.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c1568a0 con 0x7fc10c147570 2023-10-25T16:24:30.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104005330 con 0x7fc10c147570 2023-10-25T16:24:30.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c0ad1c0 con 0x7fc10c147570 2023-10-25T16:24:30.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c0b2d70 con 0x7fc10c147570 2023-10-25T16:24:30.517 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc104005490 con 0x7fc10c147570 2023-10-25T16:24:30.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0f00664a0 0x7fc0f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc104083930 con 0x7fc10c147570 2023-10-25T16:24:30.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fc0f006e030 con 0x7fc10c147570 2023-10-25T16:24:30.518 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc10affd640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0f00664a0 0x7fc0f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.515+0000 7fc10affd640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0f00664a0 0x7fc0f0068960 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0ac000 tx=0x7fc0fc0b0040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:30.519 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.519+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc104050e20 con 0x7fc10c147570 2023-10-25T16:24:30.692 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.695+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc10c0ca850 con 0x7fc10c147570 2023-10-25T16:24:30.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.695+0000 7fc108ff9640 1 -- 172.21.15.177:0/3919760868 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fc104054440 con 0x7fc10c147570 2023-10-25T16:24:30.694 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:24:30.695 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:24:30.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0f00664a0 msgr2=0x7fc0f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0f00664a0 0x7fc0f0068960 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0ac000 tx=0x7fc0fc0b0040 comp rx=0 tx=0).stop 2023-10-25T16:24:30.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 msgr2=0x7fc10c146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 0x7fc10c146f30 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0ca4b0 tx=0x7fc10400c960 comp rx=0 tx=0).stop 2023-10-25T16:24:30.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 shutdown_connections 2023-10-25T16:24:30.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc0f00664a0 0x7fc0f0068960 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc10c147570 0x7fc10c146f30 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc10c147ac0 0x7fc10c1469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 --2- 172.21.15.177:0/3919760868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0ec003980 0x7fc10c15b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 >> 172.21.15.177:0/3919760868 conn(0x7fc10c0b2450 msgr2=0x7fc10c1572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 shutdown_connections 2023-10-25T16:24:30.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.699+0000 7fc111a04640 1 -- 172.21.15.177:0/3919760868 wait complete. 2023-10-25T16:24:30.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:30.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3898408226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc15c3a0 msgr2=0x7f6abc15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3898408226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc15c3a0 0x7f6abc15c810 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009cb0 tx=0x7f6ab401cd10 comp rx=0 tx=0).stop 2023-10-25T16:24:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3898408226 shutdown_connections 2023-10-25T16:24:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3898408226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc15c3a0 0x7f6abc15c810 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3898408226 >> v2:172.21.15.184:3300/0 conn(0x7f6abc15b710 0x7f6abc13d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3898408226 >> 172.21.15.177:0/3898408226 conn(0x7f6abc0b2450 msgr2=0x7f6abc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:30.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3898408226 shutdown_connections 2023-10-25T16:24:30.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3898408226 wait complete. 2023-10-25T16:24:30.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 Processor -- start 2023-10-25T16:24:30.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- start start 2023-10-25T16:24:30.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 0x7f6abc13a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6abc15b710 0x7f6abc13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6abc15c3a0 0x7f6abc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc154600 con 0x7f6abc0af5d0 2023-10-25T16:24:30.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc13a3e0 con 0x7f6abc15b710 2023-10-25T16:24:30.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0ae260 con 0x7f6abc15c3a0 2023-10-25T16:24:30.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 0x7f6abc13a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 0x7f6abc13a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43036/0 (socket says 172.21.15.177:43036) 2023-10-25T16:24:30.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 -- 172.21.15.177:0/3454780531 learned_addr learned my addr 172.21.15.177:0/3454780531 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:30.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 -- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6abc15c3a0 msgr2=0x7f6abc1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6abc15c3a0 0x7f6abc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 -- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6abc15b710 msgr2=0x7f6abc13aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6abc15b710 0x7f6abc13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 -- 172.21.15.177:0/3454780531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40098e0 con 0x7f6abc0af5d0 2023-10-25T16:24:30.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6abb7fe640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 0x7f6abc13a570 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00d950 tx=0x7f6aac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:30.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac009c30 con 0x7f6abc0af5d0 2023-10-25T16:24:30.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6aac009e80 con 0x7f6abc0af5d0 2023-10-25T16:24:30.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0106c0 con 0x7f6abc0af5d0 2023-10-25T16:24:30.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc0ae540 con 0x7f6abc0af5d0 2023-10-25T16:24:30.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc154ac0 con 0x7f6abc0af5d0 2023-10-25T16:24:30.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.827+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc04daf0 con 0x7f6abc0af5d0 2023-10-25T16:24:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.831+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6aac010820 con 0x7f6abc0af5d0 2023-10-25T16:24:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.831+0000 7f6ab3fff640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6a9c066470 0x7f6a9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.831+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6aac0842d0 con 0x7f6abc0af5d0 2023-10-25T16:24:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.831+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7f6a9c06e000 con 0x7f6abc0af5d0 2023-10-25T16:24:30.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.831+0000 7f6abaffd640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6a9c066470 0x7f6a9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:30.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.831+0000 7f6abaffd640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6a9c066470 0x7f6a9c068930 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007fd0 tx=0x7f6aa4007940 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:30.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:30.835+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6aac020060 con 0x7f6abc0af5d0 2023-10-25T16:24:31.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.019+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6abc13c100 con 0x7f6abc0af5d0 2023-10-25T16:24:31.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.019+0000 7f6ab3fff640 1 -- 172.21.15.177:0/3454780531 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f6aac017020 con 0x7f6abc0af5d0 2023-10-25T16:24:31.018 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:31.018 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":65,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:23:18.494020+0000","modified":"2023-10-25T16:23:20.527685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156116},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156116":{"gid":156116,"name":"d","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6836/242379515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":242379515},{"type":"v1","addr":"172.21.15.184:6836","nonce":242379515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-10-25T16:24:31.019 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 65 2023-10-25T16:24:31.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6a9c066470 msgr2=0x7f6a9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6a9c066470 0x7f6a9c068930 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4007fd0 tx=0x7f6aa4007940 comp rx=0 tx=0).stop 2023-10-25T16:24:31.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 msgr2=0x7f6abc13a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 0x7f6abc13a570 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00d950 tx=0x7f6aac00de10 comp rx=0 tx=0).stop 2023-10-25T16:24:31.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 shutdown_connections 2023-10-25T16:24:31.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6a9c066470 0x7f6a9c068930 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6abc15c3a0 0x7f6abc1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6abc15b710 0x7f6abc13aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 --2- 172.21.15.177:0/3454780531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6abc0af5d0 0x7f6abc13a570 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 >> 172.21.15.177:0/3454780531 conn(0x7f6abc0b2450 msgr2=0x7f6abc0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:31.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 shutdown_connections 2023-10-25T16:24:31.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.023+0000 7f6ac20e8640 1 -- 172.21.15.177:0/3454780531 wait complete. 2023-10-25T16:24:31.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:31.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/870496098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe300003980 msgr2=0x7fe300003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 --2- 172.21.15.177:0/870496098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe300003980 0x7fe300003da0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c260 tx=0x7fe30c01cf70 comp rx=0 tx=0).stop 2023-10-25T16:24:31.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3137fe640 1 -- 172.21.15.177:0/870496098 reap_dead start 2023-10-25T16:24:31.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/870496098 shutdown_connections 2023-10-25T16:24:31.148 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/870496098 >> 172.21.15.177:0/870496098 conn(0x7fe3140ce000 msgr2=0x7fe3140ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:31.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/870496098 shutdown_connections 2023-10-25T16:24:31.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/870496098 wait complete. 2023-10-25T16:24:31.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 Processor -- start 2023-10-25T16:24:31.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- start start 2023-10-25T16:24:31.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe300003980 0x7fe31415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 0x7fe314156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3140c7590 0x7fe3141475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415b7f0 con 0x7fe314152610 2023-10-25T16:24:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415b230 con 0x7fe3140c7590 2023-10-25T16:24:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415b510 con 0x7fe300003980 2023-10-25T16:24:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 0x7fe314156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 0x7fe314156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43048/0 (socket says 172.21.15.177:43048) 2023-10-25T16:24:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 -- 172.21.15.177:0/3910100891 learned_addr learned my addr 172.21.15.177:0/3910100891 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe312ffd640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe300003980 0x7fe31415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3137fe640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3140c7590 0x7fe3141475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 -- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe300003980 msgr2=0x7fe31415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe300003980 0x7fe31415ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 -- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3140c7590 msgr2=0x7fe3141475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3140c7590 0x7fe3141475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 -- 172.21.15.177:0/3910100891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314156550 con 0x7fe314152610 2023-10-25T16:24:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe3127fc640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 0x7fe314156d50 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00f9d0 tx=0x7fe2fc00fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00bcb0 con 0x7fe314152610 2023-10-25T16:24:31.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe2fc011440 con 0x7fe314152610 2023-10-25T16:24:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe314156830 con 0x7fe314152610 2023-10-25T16:24:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc011810 con 0x7fe314152610 2023-10-25T16:24:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.151+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe314157290 con 0x7fe314152610 2023-10-25T16:24:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31406fe60 con 0x7fe314152610 2023-10-25T16:24:31.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2fc011970 con 0x7fe314152610 2023-10-25T16:24:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe30bfff640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe2fc084c00 con 0x7fe314152610 2023-10-25T16:24:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fe2f406e000 con 0x7fe314152610 2023-10-25T16:24:31.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe312ffd640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.155+0000 7fe312ffd640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0ac000 tx=0x7fe30c0a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:31.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.159+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2fc08b080 con 0x7fe314152610 2023-10-25T16:24:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.311+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe31404daf0 con 0x7fe314152610 2023-10-25T16:24:31.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe30bfff640 1 -- 172.21.15.177:0/3910100891 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16680 (secure 0 0 0) 0x7fe2fc051fd0 con 0x7fe314152610 2023-10-25T16:24:31.311 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:31.311 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":178,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:12.806054+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:23:16.807928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-25T16:23:17.493379+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:31.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 msgr2=0x7fe2f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0ac000 tx=0x7fe30c0a7040 comp rx=0 tx=0).stop 2023-10-25T16:24:31.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 msgr2=0x7fe314156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 0x7fe314156d50 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00f9d0 tx=0x7fe2fc00fe90 comp rx=0 tx=0).stop 2023-10-25T16:24:31.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 shutdown_connections 2023-10-25T16:24:31.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe2f4066470 0x7fe2f4068930 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3140c7590 0x7fe3141475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe314152610 0x7fe314156d50 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 --2- 172.21.15.177:0/3910100891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe300003980 0x7fe31415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 >> 172.21.15.177:0/3910100891 conn(0x7fe3140ce000 msgr2=0x7fe3140af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:31.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 shutdown_connections 2023-10-25T16:24:31.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.315+0000 7fe31980b640 1 -- 172.21.15.177:0/3910100891 wait complete. 2023-10-25T16:24:31.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:24:31.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 -- 172.21.15.177:0/3665365382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5580047d0 msgr2=0x7fa558004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 --2- 172.21.15.177:0/3665365382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5580047d0 0x7fa558004c50 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fa5540016e0 tx=0x7fa55401c760 comp rx=0 tx=0).stop 2023-10-25T16:24:31.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 -- 172.21.15.177:0/3665365382 shutdown_connections 2023-10-25T16:24:31.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 --2- 172.21.15.177:0/3665365382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5580047d0 0x7fa558004c50 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 -- 172.21.15.177:0/3665365382 >> 172.21.15.177:0/3665365382 conn(0x7fa56c0b2450 msgr2=0x7fa56c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:31.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 -- 172.21.15.177:0/3665365382 shutdown_connections 2023-10-25T16:24:31.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 -- 172.21.15.177:0/3665365382 wait complete. 2023-10-25T16:24:31.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 Processor -- start 2023-10-25T16:24:31.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.451+0000 7fa571a5a640 1 -- start start 2023-10-25T16:24:31.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5580047d0 0x7fa56c146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c144b40 0x7fa56c144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 0x7fa56c0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c145fc0 con 0x7fa56c0aa710 2023-10-25T16:24:31.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c145500 con 0x7fa56c144b40 2023-10-25T16:24:31.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c147040 con 0x7fa5580047d0 2023-10-25T16:24:31.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 0x7fa56c0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 0x7fa56c0aab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43068/0 (socket says 172.21.15.177:43068) 2023-10-25T16:24:31.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 -- 172.21.15.177:0/727880753 learned_addr learned my addr 172.21.15.177:0/727880753 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:31.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56affd640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5580047d0 0x7fa56c146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56a7fc640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c144b40 0x7fa56c144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 -- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5580047d0 msgr2=0x7fa56c146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5580047d0 0x7fa56c146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 -- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c144b40 msgr2=0x7fa56c144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c144b40 0x7fa56c144fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0ab0d0 con 0x7fa56c0aa710 2023-10-25T16:24:31.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56b7fe640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 0x7fa56c0aab90 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa56c06ffa0 tx=0x7fa56400e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:31.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564012640 con 0x7fa56c0aa710 2023-10-25T16:24:31.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa564012890 con 0x7fa56c0aa710 2023-10-25T16:24:31.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564012ca0 con 0x7fa56c0aa710 2023-10-25T16:24:31.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c145720 con 0x7fa56c0aa710 2023-10-25T16:24:31.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c145ce0 con 0x7fa56c0aa710 2023-10-25T16:24:31.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c04daf0 con 0x7fa56c0aa710 2023-10-25T16:24:31.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa56401a400 con 0x7fa56c0aa710 2023-10-25T16:24:31.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa54c0664a0 0x7fa54c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa564087190 con 0x7fa56c0aa710 2023-10-25T16:24:31.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=179}) v3 -- 0x7fa54c06e030 con 0x7fa56c0aa710 2023-10-25T16:24:31.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56affd640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa54c0664a0 0x7fa54c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.463 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.455+0000 7fa56affd640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa54c0664a0 0x7fa54c068960 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa56c063450 tx=0x7fa55c009500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:31.464 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.459+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa56401f020 con 0x7fa56c0aa710 2023-10-25T16:24:31.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.635+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa56c0ca680 con 0x7fa56c0aa710 2023-10-25T16:24:31.632 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:24:31.635+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:24:31.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.639+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa564058110 con 0x7fa56c0aa710 2023-10-25T16:24:31.635 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:24:31.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.639+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(179..179 src has 1..179) v4 ==== 403+0+0 (secure 0 0 0) 0x7fa564058a40 con 0x7fa56c0aa710 2023-10-25T16:24:31.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.639+0000 7fa563fff640 1 -- 172.21.15.177:0/727880753 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fa54c06e9c0 con 0x7fa56c0aa710 2023-10-25T16:24:31.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.639+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa54c0664a0 msgr2=0x7fa54c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.639+0000 7fa571a5a640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa54c0664a0 0x7fa54c068960 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa56c063450 tx=0x7fa55c009500 comp rx=0 tx=0).stop 2023-10-25T16:24:31.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 msgr2=0x7fa56c0aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 0x7fa56c0aab90 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fa56c06ffa0 tx=0x7fa56400e6b0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 shutdown_connections 2023-10-25T16:24:31.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa54c0664a0 0x7fa54c068960 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56c0aa710 0x7fa56c0aab90 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c144b40 0x7fa56c144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 --2- 172.21.15.177:0/727880753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5580047d0 0x7fa56c146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 >> 172.21.15.177:0/727880753 conn(0x7fa56c0b2450 msgr2=0x7fa56c155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:31.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 shutdown_connections 2023-10-25T16:24:31.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.643+0000 7fa571a5a640 1 -- 172.21.15.177:0/727880753 wait complete. 2023-10-25T16:24:31.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:24:31.657 INFO:tasks.ceph.mds.d.smithi184.stderr: -8378> 2023-10-25T16:23:21.125+0000 7fe52c926640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:24:31.711 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:24:31.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 -- 172.21.15.177:0/1509604798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c15eba0 msgr2=0x7fae8c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 --2- 172.21.15.177:0/1509604798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c15eba0 0x7fae8c0ccba0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fae84009bc0 tx=0x7fae8401cb80 comp rx=0 tx=0).stop 2023-10-25T16:24:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 -- 172.21.15.177:0/1509604798 shutdown_connections 2023-10-25T16:24:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 --2- 172.21.15.177:0/1509604798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c0cfe20 0x7fae8c0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 --2- 172.21.15.177:0/1509604798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c15eba0 0x7fae8c0ccba0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 -- 172.21.15.177:0/1509604798 >> 172.21.15.177:0/1509604798 conn(0x7fae8c09a580 msgr2=0x7fae8c0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 -- 172.21.15.177:0/1509604798 shutdown_connections 2023-10-25T16:24:31.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.771+0000 7fae933b8640 1 -- 172.21.15.177:0/1509604798 wait complete. 2023-10-25T16:24:31.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 Processor -- start 2023-10-25T16:24:31.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- start start 2023-10-25T16:24:31.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae8c0b2070 0x7fae8c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 0x7fae8c150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c15eba0 0x7fae8c146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0b5420 con 0x7fae8c0cfe20 2023-10-25T16:24:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c151160 con 0x7fae8c0b2070 2023-10-25T16:24:31.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c151c10 con 0x7fae8c15eba0 2023-10-25T16:24:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 0x7fae8c150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 0x7fae8c150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43082/0 (socket says 172.21.15.177:43082) 2023-10-25T16:24:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 -- 172.21.15.177:0/432682611 learned_addr learned my addr 172.21.15.177:0/432682611 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae91955640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c15eba0 0x7fae8c146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae91154640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae8c0b2070 0x7fae8c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 -- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c15eba0 msgr2=0x7fae8c146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c15eba0 0x7fae8c146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 -- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae8c0b2070 msgr2=0x7fae8c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae8c0b2070 0x7fae8c14ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:31.778 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 -- 172.21.15.177:0/432682611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae84009820 con 0x7fae8c0cfe20 2023-10-25T16:24:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae91955640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c15eba0 0x7fae8c146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae90953640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 0x7fae8c150c20 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c780 tx=0x7fae7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c005270 con 0x7fae8c0cfe20 2023-10-25T16:24:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fae7c0053f0 con 0x7fae8c0cfe20 2023-10-25T16:24:31.779 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c151370 con 0x7fae8c0cfe20 2023-10-25T16:24:31.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00a8a0 con 0x7fae8c0cfe20 2023-10-25T16:24:31.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c151930 con 0x7fae8c0cfe20 2023-10-25T16:24:31.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c0b5560 con 0x7fae8c0cfe20 2023-10-25T16:24:31.780 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.775+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fae7c00aa00 con 0x7fae8c0cfe20 2023-10-25T16:24:31.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.779+0000 7fae81ffb640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae70066470 0x7fae70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:31.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.779+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fae7c083a60 con 0x7fae8c0cfe20 2023-10-25T16:24:31.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.779+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7fae7006e110 con 0x7fae8c0cfe20 2023-10-25T16:24:31.781 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.779+0000 7fae91154640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae70066470 0x7fae70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:31.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.779+0000 7fae91154640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae70066470 0x7fae70068930 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fae840af000 tx=0x7fae8401b3c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:31.782 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.783+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fae8c0b5560 con 0x7fae8c0cfe20 2023-10-25T16:24:31.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:31.955+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fae8c0b5560 con 0x7fae8c0cfe20 2023-10-25T16:24:32.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.639+0000 7fae81ffb640 1 -- 172.21.15.177:0/432682611 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7fae8c0b5560 con 0x7fae8c0cfe20 2023-10-25T16:24:32.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae70066470 msgr2=0x7fae70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:32.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae70066470 0x7fae70068930 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fae840af000 tx=0x7fae8401b3c0 comp rx=0 tx=0).stop 2023-10-25T16:24:32.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 msgr2=0x7fae8c150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:32.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 0x7fae8c150c20 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00c780 tx=0x7fae7c00cc40 comp rx=0 tx=0).stop 2023-10-25T16:24:32.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 shutdown_connections 2023-10-25T16:24:32.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae70066470 0x7fae70068930 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:32.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae8c15eba0 0x7fae8c146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:32.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae8c0cfe20 0x7fae8c150c20 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:32.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 --2- 172.21.15.177:0/432682611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae8c0b2070 0x7fae8c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:32.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 >> 172.21.15.177:0/432682611 conn(0x7fae8c09a580 msgr2=0x7fae8c15c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:32.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 shutdown_connections 2023-10-25T16:24:32.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.643+0000 7fae933b8640 1 -- 172.21.15.177:0/432682611 wait complete. 2023-10-25T16:24:32.663 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:24:32.798 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:24:33.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/299668683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240cefd0 msgr2=0x7f5b240cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:33.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 --2- 172.21.15.177:0/299668683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240cefd0 0x7f5b240cf3b0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f5b24098a80 tx=0x7f5b1401caa0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/299668683 shutdown_connections 2023-10-25T16:24:33.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 --2- 172.21.15.177:0/299668683 >> v2:172.21.15.184:3300/0 conn(0x7f5b240c9d70 0x7f5b240ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 --2- 172.21.15.177:0/299668683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240cefd0 0x7f5b240cf3b0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/299668683 >> 172.21.15.177:0/299668683 conn(0x7f5b24097a40 msgr2=0x7f5b24097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:33.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/299668683 shutdown_connections 2023-10-25T16:24:33.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/299668683 wait complete. 2023-10-25T16:24:33.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 Processor -- start 2023-10-25T16:24:33.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- start start 2023-10-25T16:24:33.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 0x7f5b240c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:33.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b240ccc10 0x7f5b2406c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:33.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b240cefd0 0x7f5b2414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:33.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240c8fd0 con 0x7f5b240c9d70 2023-10-25T16:24:33.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2406ba90 con 0x7f5b240cefd0 2023-10-25T16:24:33.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2406b7b0 con 0x7f5b240ccc10 2023-10-25T16:24:33.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 0x7f5b240c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:33.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 0x7f5b240c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43100/0 (socket says 172.21.15.177:43100) 2023-10-25T16:24:33.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 -- 172.21.15.177:0/411246911 learned_addr learned my addr 172.21.15.177:0/411246911 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:33.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b22d9d640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b240cefd0 0x7f5b2414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:33.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 -- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b240ccc10 msgr2=0x7f5b2406c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:33.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b240ccc10 0x7f5b2406c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 -- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b240cefd0 msgr2=0x7f5b2414d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:33.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b240cefd0 0x7f5b2414d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009820 con 0x7f5b240c9d70 2023-10-25T16:24:33.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b22d9d640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b240cefd0 0x7f5b2414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:33.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b2259c640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 0x7f5b240c8a90 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5b14000f90 tx=0x7f5b140a5a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:33.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14004c50 con 0x7f5b240c9d70 2023-10-25T16:24:33.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b14004db0 con 0x7f5b240c9d70 2023-10-25T16:24:33.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2414c8a0 con 0x7f5b240c9d70 2023-10-25T16:24:33.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14005230 con 0x7f5b240c9d70 2023-10-25T16:24:33.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.803+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2414ce60 con 0x7f5b240c9d70 2023-10-25T16:24:33.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24073360 con 0x7f5b240c9d70 2023-10-25T16:24:33.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b140b4040 con 0x7f5b240c9d70 2023-10-25T16:24:33.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b1affd640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b04066470 0x7f5b04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:33.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f5b140a5e40 con 0x7f5b240c9d70 2023-10-25T16:24:33.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=180}) v3 -- 0x7f5b0406e110 con 0x7f5b240c9d70 2023-10-25T16:24:33.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b1bfff640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b04066470 0x7f5b04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:33.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.807+0000 7f5b1bfff640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b04066470 0x7f5b04068930 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000f70 tx=0x7f5b0c007a40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:33.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.811+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b140b2060 con 0x7f5b240c9d70 2023-10-25T16:24:33.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.815+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 7 ==== osd_map(180..180 src has 1..180) v4 ==== 708+0+0 (secure 0 0 0) 0x7f5b140abe20 con 0x7f5b240c9d70 2023-10-25T16:24:33.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.815+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=181}) v3 -- 0x7f5b0406eb30 con 0x7f5b240c9d70 2023-10-25T16:24:33.330 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:32.975+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b24066f20 con 0x7f5b240c9d70 2023-10-25T16:24:33.332 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:24:33.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.959+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v181) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5b140b2070 con 0x7f5b240c9d70 2023-10-25T16:24:33.956 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:24:33.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.959+0000 7f5b1affd640 1 -- 172.21.15.177:0/411246911 <== mon.0 v2:172.21.15.177:3300/0 9 ==== osd_map(181..181 src has 1..181) v4 ==== 325+0+0 (secure 0 0 0) 0x7f5b140efa00 con 0x7f5b240c9d70 2023-10-25T16:24:33.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.963+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b04066470 msgr2=0x7f5b04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:33.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.963+0000 7f5b28be2640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b04066470 0x7f5b04068930 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000f70 tx=0x7f5b0c007a40 comp rx=0 tx=0).stop 2023-10-25T16:24:33.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.963+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 msgr2=0x7f5b240c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:33.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.963+0000 7f5b28be2640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 0x7f5b240c8a90 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5b14000f90 tx=0x7f5b140a5a60 comp rx=0 tx=0).stop 2023-10-25T16:24:33.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 shutdown_connections 2023-10-25T16:24:33.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5b04066470 0x7f5b04068930 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b240cefd0 0x7f5b2414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5b240ccc10 0x7f5b2406c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 --2- 172.21.15.177:0/411246911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b240c9d70 0x7f5b240c8a90 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:33.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 >> 172.21.15.177:0/411246911 conn(0x7f5b24097a40 msgr2=0x7f5b240ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:33.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 shutdown_connections 2023-10-25T16:24:33.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:33.967+0000 7f5b28be2640 1 -- 172.21.15.177:0/411246911 wait complete. 2023-10-25T16:24:33.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:24:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 -- 172.21.15.177:0/458525383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c0ca260 msgr2=0x7f3e5c0cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/458525383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c0cd110 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009900 tx=0x7f3e5001c720 comp rx=0 tx=0).stop 2023-10-25T16:24:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 -- 172.21.15.177:0/458525383 shutdown_connections 2023-10-25T16:24:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/458525383 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5c0cd650 0x7f3e5c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/458525383 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c0cd110 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 -- 172.21.15.177:0/458525383 >> 172.21.15.177:0/458525383 conn(0x7f3e5c069920 msgr2=0x7f3e5c069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:34.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 -- 172.21.15.177:0/458525383 shutdown_connections 2023-10-25T16:24:34.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 -- 172.21.15.177:0/458525383 wait complete. 2023-10-25T16:24:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 Processor -- start 2023-10-25T16:24:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.115+0000 7f3e61e1b640 1 -- start start 2023-10-25T16:24:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c09a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5c0cd650 0x7f3e5c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 0x7f3e5c150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c151040 con 0x7f3e5c159360 2023-10-25T16:24:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c1508c0 con 0x7f3e5c0ca260 2023-10-25T16:24:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c151680 con 0x7f3e5c0cd650 2023-10-25T16:24:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 0x7f3e5c150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 0x7f3e5c150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43118/0 (socket says 172.21.15.177:43118) 2023-10-25T16:24:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 -- 172.21.15.177:0/2052711148 learned_addr learned my addr 172.21.15.177:0/2052711148 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5b7fe640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c09a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5affd640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5c0cd650 0x7f3e5c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 -- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5c0cd650 msgr2=0x7f3e5c150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5c0cd650 0x7f3e5c150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 -- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c0ca260 msgr2=0x7f3e5c09a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:34.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c09a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 -- 172.21.15.177:0/2052711148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009560 con 0x7f3e5c159360 2023-10-25T16:24:34.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5b7fe640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c09a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:24:34.121 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5bfff640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 0x7f3e5c150380 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00d750 tx=0x7f3e4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:34.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c009c30 con 0x7f3e5c159360 2023-10-25T16:24:34.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e4c009e80 con 0x7f3e5c159360 2023-10-25T16:24:34.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c159950 con 0x7f3e5c159360 2023-10-25T16:24:34.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c005280 con 0x7f3e5c159360 2023-10-25T16:24:34.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c151c40 con 0x7f3e5c159360 2023-10-25T16:24:34.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c073360 con 0x7f3e5c159360 2023-10-25T16:24:34.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e4c0053e0 con 0x7f3e5c159360 2023-10-25T16:24:34.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e43fff640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e48066470 0x7f3e48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:34.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f3e4c083f10 con 0x7f3e5c159360 2023-10-25T16:24:34.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.119+0000 7f3e5b7fe640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e48066470 0x7f3e48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:34.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.123+0000 7f3e5b7fe640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e48066470 0x7f3e48068930 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3e540045c0 tx=0x7f3e54009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:34.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.123+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e4c0514d0 con 0x7f3e5c159360 2023-10-25T16:24:34.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.275+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e5c15ca00 con 0x7f3e5c159360 2023-10-25T16:24:34.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.971+0000 7f3e43fff640 1 -- 172.21.15.177:0/2052711148 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v182) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3e4c017020 con 0x7f3e5c159360 2023-10-25T16:24:34.967 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:24:34.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e48066470 msgr2=0x7f3e48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:34.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e48066470 0x7f3e48068930 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3e540045c0 tx=0x7f3e54009040 comp rx=0 tx=0).stop 2023-10-25T16:24:34.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 msgr2=0x7f3e5c150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:34.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 0x7f3e5c150380 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00d750 tx=0x7f3e4c00dc10 comp rx=0 tx=0).stop 2023-10-25T16:24:34.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 shutdown_connections 2023-10-25T16:24:34.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e48066470 0x7f3e48068930 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e5c159360 0x7f3e5c150380 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5c0cd650 0x7f3e5c150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 --2- 172.21.15.177:0/2052711148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e5c0ca260 0x7f3e5c09a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 >> 172.21.15.177:0/2052711148 conn(0x7f3e5c069920 msgr2=0x7f3e5c15a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 shutdown_connections 2023-10-25T16:24:34.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:34.975+0000 7f3e61e1b640 1 -- 172.21.15.177:0/2052711148 wait complete. 2023-10-25T16:24:34.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:24:35.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 -- 172.21.15.177:0/3349297265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc06c090 msgr2=0x7fa9cc070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 --2- 172.21.15.177:0/3349297265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc06c090 0x7fa9cc070510 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009bc0 tx=0x7fa9c401cb10 comp rx=0 tx=0).stop 2023-10-25T16:24:35.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 -- 172.21.15.177:0/3349297265 shutdown_connections 2023-10-25T16:24:35.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 --2- 172.21.15.177:0/3349297265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc06c090 0x7fa9cc070510 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 -- 172.21.15.177:0/3349297265 >> 172.21.15.177:0/3349297265 conn(0x7fa9cc0b2450 msgr2=0x7fa9cc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:35.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 -- 172.21.15.177:0/3349297265 shutdown_connections 2023-10-25T16:24:35.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 -- 172.21.15.177:0/3349297265 wait complete. 2023-10-25T16:24:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 Processor -- start 2023-10-25T16:24:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.131+0000 7fa9d360b640 1 -- start start 2023-10-25T16:24:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9cc06c090 0x7fa9cc146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 0x7fa9cc142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9cc159230 0x7fa9cc147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc143480 con 0x7fa9cc071500 2023-10-25T16:24:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc151ac0 con 0x7fa9cc06c090 2023-10-25T16:24:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc146e80 con 0x7fa9cc159230 2023-10-25T16:24:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 0x7fa9cc142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 0x7fa9cc142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43140/0 (socket says 172.21.15.177:43140) 2023-10-25T16:24:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 -- 172.21.15.177:0/1676009237 learned_addr learned my addr 172.21.15.177:0/1676009237 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d13a7640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9cc06c090 0x7fa9cc146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 -- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9cc159230 msgr2=0x7fa9cc147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d1ba8640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9cc159230 0x7fa9cc147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9cc159230 0x7fa9cc147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 -- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9cc06c090 msgr2=0x7fa9cc146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9cc06c090 0x7fa9cc146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 -- 172.21.15.177:0/1676009237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4009820 con 0x7fa9cc071500 2023-10-25T16:24:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d13a7640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9cc06c090 0x7fa9cc146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d0ba6640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 0x7fa9cc142f40 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c490 tx=0x7fa9bc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc005480 con 0x7fa9cc071500 2023-10-25T16:24:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa9bc003600 con 0x7fa9cc071500 2023-10-25T16:24:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc003a10 con 0x7fa9cc071500 2023-10-25T16:24:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc147160 con 0x7fa9cc071500 2023-10-25T16:24:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc147720 con 0x7fa9cc071500 2023-10-25T16:24:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc04daf0 con 0x7fa9cc071500 2023-10-25T16:24:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9bc003b70 con 0x7fa9cc071500 2023-10-25T16:24:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9c1ffb640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9b00664a0 0x7fa9b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9bc0833c0 con 0x7fa9cc071500 2023-10-25T16:24:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.135+0000 7fa9d13a7640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9b00664a0 0x7fa9b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.139+0000 7fa9d13a7640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9b00664a0 0x7fa9b0068960 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800a830 tx=0x7fa9c8008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.139+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9bc050ab0 con 0x7fa9cc071500 2023-10-25T16:24:35.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.299+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7fa9cc151ed0 con 0x7fa9cc071500 2023-10-25T16:24:35.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.307+0000 7fa9c1ffb640 1 -- 172.21.15.177:0/1676009237 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v36) v1 ==== 71+0+0 (secure 0 0 0) 0x7fa9bc017070 con 0x7fa9cc071500 2023-10-25T16:24:35.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9b00664a0 msgr2=0x7fa9b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9b00664a0 0x7fa9b0068960 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800a830 tx=0x7fa9c8008040 comp rx=0 tx=0).stop 2023-10-25T16:24:35.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 msgr2=0x7fa9cc142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 0x7fa9cc142f40 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c490 tx=0x7fa9bc00c950 comp rx=0 tx=0).stop 2023-10-25T16:24:35.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 shutdown_connections 2023-10-25T16:24:35.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa9b00664a0 0x7fa9b0068960 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa9cc159230 0x7fa9cc147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9cc071500 0x7fa9cc142f40 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 --2- 172.21.15.177:0/1676009237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9cc06c090 0x7fa9cc146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 >> 172.21.15.177:0/1676009237 conn(0x7fa9cc0b2450 msgr2=0x7fa9cc06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:35.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 shutdown_connections 2023-10-25T16:24:35.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.311+0000 7fa9d360b640 1 -- 172.21.15.177:0/1676009237 wait complete. 2023-10-25T16:24:35.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-10-25T16:24:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 -- 172.21.15.177:0/1105787742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce000c9df0 msgr2=0x7fce0015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 --2- 172.21.15.177:0/1105787742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce000c9df0 0x7fce0015afb0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800ad90 tx=0x7fcdf801db90 comp rx=0 tx=0).stop 2023-10-25T16:24:35.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 -- 172.21.15.177:0/1105787742 shutdown_connections 2023-10-25T16:24:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 --2- 172.21.15.177:0/1105787742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce000c9df0 0x7fce0015afb0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 -- 172.21.15.177:0/1105787742 >> 172.21.15.177:0/1105787742 conn(0x7fce000b2450 msgr2=0x7fce000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 -- 172.21.15.177:0/1105787742 shutdown_connections 2023-10-25T16:24:35.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.451+0000 7fce06194640 1 -- 172.21.15.177:0/1105787742 wait complete. 2023-10-25T16:24:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 Processor -- start 2023-10-25T16:24:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- start start 2023-10-25T16:24:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 0x7fce000ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce000c9df0 0x7fce0014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0015bbe0 0x7fce00159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015adb0 con 0x7fce0006c180 2023-10-25T16:24:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0014e620 con 0x7fce0015bbe0 2023-10-25T16:24:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0014e900 con 0x7fce000c9df0 2023-10-25T16:24:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 0x7fce000ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 0x7fce000ae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43156/0 (socket says 172.21.15.177:43156) 2023-10-25T16:24:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 -- 172.21.15.177:0/2829573757 learned_addr learned my addr 172.21.15.177:0/2829573757 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:35.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdfffff640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0015bbe0 0x7fce00159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdfeffd640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce000c9df0 0x7fce0014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 -- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce000c9df0 msgr2=0x7fce0014c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce000c9df0 0x7fce0014c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 -- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0015bbe0 msgr2=0x7fce00159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0015bbe0 0x7fce00159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 -- 172.21.15.177:0/2829573757 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf800a9f0 con 0x7fce0006c180 2023-10-25T16:24:35.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdfffff640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0015bbe0 0x7fce00159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:35.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcdff7fe640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 0x7fce000ae1e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c3c0 tx=0x7fcdf400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:35.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40052d0 con 0x7fce0006c180 2023-10-25T16:24:35.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcdf4003600 con 0x7fce0006c180 2023-10-25T16:24:35.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0014ebe0 con 0x7fce0006c180 2023-10-25T16:24:35.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4003a10 con 0x7fce0006c180 2023-10-25T16:24:35.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0014ce20 con 0x7fce0006c180 2023-10-25T16:24:35.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.455+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0004daf0 con 0x7fce0006c180 2023-10-25T16:24:35.460 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.459+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcdf4003b90 con 0x7fce0006c180 2023-10-25T16:24:35.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.459+0000 7fcde7fff640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdec066470 0x7fcdec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:35.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.459+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcdf4083290 con 0x7fce0006c180 2023-10-25T16:24:35.461 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.459+0000 7fcdfeffd640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdec066470 0x7fcdec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:35.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.459+0000 7fcdfeffd640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdec066470 0x7fcdec068930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fce00073220 tx=0x7fcdf0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:35.462 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.463+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcdf4050aa0 con 0x7fce0006c180 2023-10-25T16:24:35.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.675+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fce00162ee0 con 0x7fce0006c180 2023-10-25T16:24:35.970 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fcde7fff640 1 -- 172.21.15.177:0/2829573757 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v548) v1 ==== 131+0+0 (secure 0 0 0) 0x7fcdf40540c0 con 0x7fce0006c180 2023-10-25T16:24:35.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdec066470 msgr2=0x7fcdec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdec066470 0x7fcdec068930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fce00073220 tx=0x7fcdf0009040 comp rx=0 tx=0).stop 2023-10-25T16:24:35.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 msgr2=0x7fce000ae1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:35.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 0x7fce000ae1e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c3c0 tx=0x7fcdf400c880 comp rx=0 tx=0).stop 2023-10-25T16:24:35.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 shutdown_connections 2023-10-25T16:24:35.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcdec066470 0x7fcdec068930 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0015bbe0 0x7fce00159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce000c9df0 0x7fce0014c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 --2- 172.21.15.177:0/2829573757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce0006c180 0x7fce000ae1e0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:35.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 >> 172.21.15.177:0/2829573757 conn(0x7fce000b2450 msgr2=0x7fce000cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:35.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 shutdown_connections 2023-10-25T16:24:35.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:35.975+0000 7fce06194640 1 -- 172.21.15.177:0/2829573757 wait complete. 2023-10-25T16:24:35.997 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-10-25T16:24:35.998 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-10-25T16:24:35.998 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:36.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/2644216782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f853c004d10 msgr2=0x7f853c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 --2- 172.21.15.177:0/2644216782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f853c004d10 0x7f853c005190 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f854800c610 tx=0x7f854801fa00 comp rx=0 tx=0).stop 2023-10-25T16:24:36.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 -- 172.21.15.177:0/2644216782 reap_dead start 2023-10-25T16:24:36.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/2644216782 shutdown_connections 2023-10-25T16:24:36.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/2644216782 >> 172.21.15.177:0/2644216782 conn(0x7f85500b2450 msgr2=0x7f85500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:36.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/2644216782 shutdown_connections 2023-10-25T16:24:36.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/2644216782 wait complete. 2023-10-25T16:24:36.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 Processor -- start 2023-10-25T16:24:36.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- start start 2023-10-25T16:24:36.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853c004d10 0x7f85500cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85500cd160 0x7f85500cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 0x7f85501f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500aa950 con 0x7f85501f20a0 2023-10-25T16:24:36.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550144160 con 0x7f853c004d10 2023-10-25T16:24:36.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500cb5d0 con 0x7f85500cd160 2023-10-25T16:24:36.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 0x7f85501f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 0x7f85501f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43184/0 (socket says 172.21.15.177:43184) 2023-10-25T16:24:36.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 -- 172.21.15.177:0/440159837 learned_addr learned my addr 172.21.15.177:0/440159837 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:36.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854f7fe640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853c004d10 0x7f85500cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 -- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85500cd160 msgr2=0x7f85500cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85500cd160 0x7f85500cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 -- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853c004d10 msgr2=0x7f85500cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853c004d10 0x7f85500cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 -- 172.21.15.177:0/440159837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500cb8b0 con 0x7f85501f20a0 2023-10-25T16:24:36.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f854ffff640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 0x7f85501f2550 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f854800c700 tx=0x7f85480012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:36.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480b8070 con 0x7f85501f20a0 2023-10-25T16:24:36.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f85480017c0 con 0x7f85501f20a0 2023-10-25T16:24:36.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85500aabc0 con 0x7f85501f20a0 2023-10-25T16:24:36.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548003be0 con 0x7f85501f20a0 2023-10-25T16:24:36.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.135+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85500cb2c0 con 0x7f85501f20a0 2023-10-25T16:24:36.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.139+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855004daf0 con 0x7f85501f20a0 2023-10-25T16:24:36.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.139+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8548006070 con 0x7f85501f20a0 2023-10-25T16:24:36.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.139+0000 7f8547fff640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f85300664a0 0x7f8530068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.139+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8548120120 con 0x7f85501f20a0 2023-10-25T16:24:36.140 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.139+0000 7f854f7fe640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f85300664a0 0x7f8530068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.139+0000 7f854f7fe640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f85300664a0 0x7f8530068960 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f854000fad0 tx=0x7f854000f4b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:36.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.143+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f85480ed8b0 con 0x7f85501f20a0 2023-10-25T16:24:36.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.299+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85501568e0 con 0x7f85501f20a0 2023-10-25T16:24:36.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.299+0000 7f8547fff640 1 -- 172.21.15.177:0/440159837 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+13021 (secure 0 0 0) 0x7f85480f0ed0 con 0x7f85501f20a0 2023-10-25T16:24:36.299 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:36.299 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":182,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:34.962595+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6836/242379515":"2023-10-26T16:24:31.638728+0000","172.21.15.184:6834/242379515":"2023-10-26T16:24:31.638728+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:36.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f85300664a0 msgr2=0x7f8530068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f85300664a0 0x7f8530068960 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f854000fad0 tx=0x7f854000f4b0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 msgr2=0x7f85501f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 0x7f85501f2550 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f854800c700 tx=0x7f85480012e0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 shutdown_connections 2023-10-25T16:24:36.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f85300664a0 0x7f8530068960 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85501f20a0 0x7f85501f2550 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85500cd160 0x7f85500cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 --2- 172.21.15.177:0/440159837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853c004d10 0x7f85500cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 >> 172.21.15.177:0/440159837 conn(0x7f85500b2450 msgr2=0x7f8550157b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:36.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 shutdown_connections 2023-10-25T16:24:36.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.303+0000 7f8556015640 1 -- 172.21.15.177:0/440159837 wait complete. 2023-10-25T16:24:36.318 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:24:36.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:24:36.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 -- 172.21.15.177:0/200481198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c141d60 msgr2=0x7fb10c1590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 --2- 172.21.15.177:0/200481198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c141d60 0x7fb10c1590d0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fb100009840 tx=0x7fb10001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 -- 172.21.15.177:0/200481198 shutdown_connections 2023-10-25T16:24:36.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 --2- 172.21.15.177:0/200481198 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb10c15bdb0 0x7fb10c0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 --2- 172.21.15.177:0/200481198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c141d60 0x7fb10c1590d0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 -- 172.21.15.177:0/200481198 >> 172.21.15.177:0/200481198 conn(0x7fb10c0b3670 msgr2=0x7fb10c0b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:36.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 -- 172.21.15.177:0/200481198 shutdown_connections 2023-10-25T16:24:36.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 -- 172.21.15.177:0/200481198 wait complete. 2023-10-25T16:24:36.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 Processor -- start 2023-10-25T16:24:36.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.451+0000 7fb1128c4640 1 -- start start 2023-10-25T16:24:36.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb10c0cc060 0x7fb10c137d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb10c141d60 0x7fb10c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 0x7fb10c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c138ac0 con 0x7fb10c15bdb0 2023-10-25T16:24:36.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c138da0 con 0x7fb10c0cc060 2023-10-25T16:24:36.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c139080 con 0x7fb10c141d60 2023-10-25T16:24:36.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 0x7fb10c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 0x7fb10c15af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43196/0 (socket says 172.21.15.177:43196) 2023-10-25T16:24:36.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 -- 172.21.15.177:0/3616082714 learned_addr learned my addr 172.21.15.177:0/3616082714 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:36.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 -- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb10c141d60 msgr2=0x7fb10c15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb10c141d60 0x7fb10c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 -- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb10c0cc060 msgr2=0x7fb10c137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb10c0cc060 0x7fb10c137d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 -- 172.21.15.177:0/3616082714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000094a0 con 0x7fb10c15bdb0 2023-10-25T16:24:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb110e61640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 0x7fb10c15af10 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fb10400b970 tx=0x7fb10400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:36.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10400cb40 con 0x7fb10c15bdb0 2023-10-25T16:24:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb10400cdb0 con 0x7fb10c15bdb0 2023-10-25T16:24:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c139360 con 0x7fb10c15bdb0 2023-10-25T16:24:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040146a0 con 0x7fb10c15bdb0 2023-10-25T16:24:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c138270 con 0x7fb10c15bdb0 2023-10-25T16:24:36.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c04daf0 con 0x7fb10c15bdb0 2023-10-25T16:24:36.457 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb10401d3b0 con 0x7fb10c15bdb0 2023-10-25T16:24:36.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb108ff9640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb0f8066470 0x7fb0f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb104083d80 con 0x7fb10c15bdb0 2023-10-25T16:24:36.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.455+0000 7fb10bfff640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb0f8066470 0x7fb0f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.459+0000 7fb10bfff640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb0f8066470 0x7fb0f8068930 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc007920 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:36.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.459+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb104051500 con 0x7fb10c15bdb0 2023-10-25T16:24:36.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb10c139810 con 0x7fb10c15bdb0 2023-10-25T16:24:36.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb108ff9640 1 -- 172.21.15.177:0/3616082714 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb104019020 con 0x7fb10c15bdb0 2023-10-25T16:24:36.612 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:24:36.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb0f8066470 msgr2=0x7fb0f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb0f8066470 0x7fb0f8068930 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc007920 comp rx=0 tx=0).stop 2023-10-25T16:24:36.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 msgr2=0x7fb10c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 0x7fb10c15af10 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fb10400b970 tx=0x7fb10400be30 comp rx=0 tx=0).stop 2023-10-25T16:24:36.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 shutdown_connections 2023-10-25T16:24:36.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb0f8066470 0x7fb0f8068930 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb10c15bdb0 0x7fb10c15af10 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb10c141d60 0x7fb10c15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 --2- 172.21.15.177:0/3616082714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb10c0cc060 0x7fb10c137d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.615+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 >> 172.21.15.177:0/3616082714 conn(0x7fb10c0b3670 msgr2=0x7fb10c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.619+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 shutdown_connections 2023-10-25T16:24:36.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.619+0000 7fb1128c4640 1 -- 172.21.15.177:0/3616082714 wait complete. 2023-10-25T16:24:36.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-25T16:24:36.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2312949085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5b0004d10 msgr2=0x7fb5b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2312949085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5b0004d10 0x7fb5b0005190 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00c600 tx=0x7fb5bc01d340 comp rx=0 tx=0).stop 2023-10-25T16:24:36.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5c9ee7640 1 -- 172.21.15.177:0/2312949085 reap_dead start 2023-10-25T16:24:36.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2312949085 shutdown_connections 2023-10-25T16:24:36.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2312949085 >> 172.21.15.177:0/2312949085 conn(0x7fb5c40b2450 msgr2=0x7fb5c40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:36.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2312949085 shutdown_connections 2023-10-25T16:24:36.746 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2312949085 wait complete. 2023-10-25T16:24:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 Processor -- start 2023-10-25T16:24:36.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.747+0000 7fb5cb94a640 1 -- start start 2023-10-25T16:24:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5b0004d10 0x7fb5c4156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 0x7fb5c41575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5c4157b30 0x7fb5c41540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40ada70 con 0x7fb5c414cc00 2023-10-25T16:24:36.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4157fb0 con 0x7fb5b0004d10 2023-10-25T16:24:36.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4156fb0 con 0x7fb5c4157b30 2023-10-25T16:24:36.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 0x7fb5c41575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 0x7fb5c41575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43224/0 (socket says 172.21.15.177:43224) 2023-10-25T16:24:36.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 -- 172.21.15.177:0/2224962880 learned_addr learned my addr 172.21.15.177:0/2224962880 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:36.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c96e6640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5b0004d10 0x7fb5c4156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c9ee7640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5c4157b30 0x7fb5c41540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 -- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5c4157b30 msgr2=0x7fb5c41540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5c4157b30 0x7fb5c41540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 -- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5b0004d10 msgr2=0x7fb5c4156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5b0004d10 0x7fb5c4156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 -- 172.21.15.177:0/2224962880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40ade90 con 0x7fb5c414cc00 2023-10-25T16:24:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c9ee7640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5c4157b30 0x7fb5c41540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:36.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c8ee5640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 0x7fb5c41575f0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40109e0 tx=0x7fb5b4010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b400ec50 con 0x7fb5c414cc00 2023-10-25T16:24:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5b400eea0 con 0x7fb5c414cc00 2023-10-25T16:24:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4012690 con 0x7fb5c414cc00 2023-10-25T16:24:36.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c40acb10 con 0x7fb5c414cc00 2023-10-25T16:24:36.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c40ad0d0 con 0x7fb5c414cc00 2023-10-25T16:24:36.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c404daf0 con 0x7fb5c414cc00 2023-10-25T16:24:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb5b40127f0 con 0x7fb5c414cc00 2023-10-25T16:24:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5b9ffb640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5a8066470 0x7fb5a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:36.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5b4016070 con 0x7fb5c414cc00 2023-10-25T16:24:36.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.751+0000 7fb5c96e6640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5a8066470 0x7fb5a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:36.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.755+0000 7fb5c96e6640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5a8066470 0x7fb5a8068930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000eaa0 tx=0x7fb5c000e480 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:36.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.755+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5b4055c00 con 0x7fb5c414cc00 2023-10-25T16:24:36.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.963+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fb5c414d130 con 0x7fb5c414cc00 2023-10-25T16:24:36.981 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.983+0000 7fb5b9ffb640 1 -- 172.21.15.177:0/2224962880 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v549) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb5b4055790 con 0x7fb5c414cc00 2023-10-25T16:24:36.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5a8066470 msgr2=0x7fb5a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5a8066470 0x7fb5a8068930 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000eaa0 tx=0x7fb5c000e480 comp rx=0 tx=0).stop 2023-10-25T16:24:36.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 msgr2=0x7fb5c41575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:36.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 0x7fb5c41575f0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40109e0 tx=0x7fb5b4010ea0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 shutdown_connections 2023-10-25T16:24:36.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5a8066470 0x7fb5a8068930 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb5c4157b30 0x7fb5c41540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c414cc00 0x7fb5c41575f0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 --2- 172.21.15.177:0/2224962880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb5b0004d10 0x7fb5c4156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:36.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 >> 172.21.15.177:0/2224962880 conn(0x7fb5c40b2450 msgr2=0x7fb5c415ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:36.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 shutdown_connections 2023-10-25T16:24:36.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:36.987+0000 7fb5cb94a640 1 -- 172.21.15.177:0/2224962880 wait complete. 2023-10-25T16:24:36.999 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-10-25T16:24:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd93725d640 1 -- 172.21.15.177:0/2467665573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd914004d10 msgr2=0x7fd914005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd93725d640 1 --2- 172.21.15.177:0/2467665573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd914004d10 0x7fd914005190 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fd928009ee0 tx=0x7fd92801d610 comp rx=0 tx=0).stop 2023-10-25T16:24:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd9357fa640 1 -- 172.21.15.177:0/2467665573 reap_dead start 2023-10-25T16:24:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd93725d640 1 -- 172.21.15.177:0/2467665573 shutdown_connections 2023-10-25T16:24:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd93725d640 1 -- 172.21.15.177:0/2467665573 >> 172.21.15.177:0/2467665573 conn(0x7fd930097a40 msgr2=0x7fd930097e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd93725d640 1 -- 172.21.15.177:0/2467665573 shutdown_connections 2023-10-25T16:24:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.119+0000 7fd93725d640 1 -- 172.21.15.177:0/2467665573 wait complete. 2023-10-25T16:24:37.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 Processor -- start 2023-10-25T16:24:37.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- start start 2023-10-25T16:24:37.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd914004d10 0x7fd9300ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 0x7fd930157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9300c4f40 0x7fd930157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd930157c80 con 0x7fd9300c6170 2023-10-25T16:24:37.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300c6670 con 0x7fd9300c4f40 2023-10-25T16:24:37.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300c6950 con 0x7fd914004d10 2023-10-25T16:24:37.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 0x7fd930157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 0x7fd930157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43238/0 (socket says 172.21.15.177:43238) 2023-10-25T16:24:37.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 -- 172.21.15.177:0/2339555285 learned_addr learned my addr 172.21.15.177:0/2339555285 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:37.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd9357fa640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9300c4f40 0x7fd930157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 -- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd914004d10 msgr2=0x7fd9300ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd934ff9640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd914004d10 0x7fd9300ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd914004d10 0x7fd9300ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 -- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9300c4f40 msgr2=0x7fd930157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9300c4f40 0x7fd930157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 -- 172.21.15.177:0/2339555285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9300c6c30 con 0x7fd9300c6170 2023-10-25T16:24:37.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd9357fa640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9300c4f40 0x7fd930157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:37.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd934ff9640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd914004d10 0x7fd9300ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:37.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92ffff640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 0x7fd930157200 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00d730 tx=0x7fd91c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:37.126 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c009a30 con 0x7fd9300c6170 2023-10-25T16:24:37.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd91c009c80 con 0x7fd9300c6170 2023-10-25T16:24:37.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9300c6f10 con 0x7fd9300c6170 2023-10-25T16:24:37.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c004290 con 0x7fd9300c6170 2023-10-25T16:24:37.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9300cb8c0 con 0x7fd9300c6170 2023-10-25T16:24:37.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9300c7150 con 0x7fd9300c6170 2023-10-25T16:24:37.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.123+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd91c003600 con 0x7fd9300c6170 2023-10-25T16:24:37.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.127+0000 7fd92d7fa640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd9180664a0 0x7fd918068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.127+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd91c083c70 con 0x7fd9300c6170 2023-10-25T16:24:37.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.127+0000 7fd934ff9640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd9180664a0 0x7fd918068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.127+0000 7fd934ff9640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd9180664a0 0x7fd918068960 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd9200046e0 tx=0x7fd920001240 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:37.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.127+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9300c7150 con 0x7fd9300c6170 2023-10-25T16:24:37.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.271+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fd93015bd50 con 0x7fd9300c6170 2023-10-25T16:24:37.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.271+0000 7fd92d7fa640 1 -- 172.21.15.177:0/2339555285 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v36) v1 ==== 59+0+1116 (secure 0 0 0) 0x7fd91c054df0 con 0x7fd9300c6170 2023-10-25T16:24:37.269 INFO:teuthology.orchestra.run.smithi177.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-10-25T16:24:37.270 INFO:teuthology.orchestra.run.smithi177.stdout:mon advanced mon_op_complaint_time 120 2023-10-25T16:24:37.270 INFO:teuthology.orchestra.run.smithi177.stdout:osd advanced osd_op_complaint_time 180.000000 2023-10-25T16:24:37.270 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds 20/20 2023-10-25T16:24:37.270 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_mds_balancer 20/20 2023-10-25T16:24:37.271 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced debug_ms 1/1 2023-10-25T16:24:37.272 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_frag true 2023-10-25T16:24:37.272 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_debug_scatterstat true 2023-10-25T16:24:37.272 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced mds_op_complaint_time 180.000000 2023-10-25T16:24:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:mds dev mds_verify_scatter true 2023-10-25T16:24:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced osd_op_complaint_time 180.000000 2023-10-25T16:24:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_mon_op_timeout 900 2023-10-25T16:24:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:mds advanced rados_osd_op_timeout 900 2023-10-25T16:24:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced client_mount_timeout 600 2023-10-25T16:24:37.274 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_client 20/20 2023-10-25T16:24:37.274 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced debug_ms 1/1 2023-10-25T16:24:37.274 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_mon_op_timeout 900 2023-10-25T16:24:37.274 INFO:teuthology.orchestra.run.smithi177.stdout:client advanced rados_osd_op_timeout 900 2023-10-25T16:24:37.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd9180664a0 msgr2=0x7fd918068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd9180664a0 0x7fd918068960 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd9200046e0 tx=0x7fd920001240 comp rx=0 tx=0).stop 2023-10-25T16:24:37.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 msgr2=0x7fd930157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 0x7fd930157200 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00d730 tx=0x7fd91c00dbf0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 shutdown_connections 2023-10-25T16:24:37.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd9180664a0 0x7fd918068960 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9300c4f40 0x7fd930157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd9300c6170 0x7fd930157200 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 --2- 172.21.15.177:0/2339555285 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd914004d10 0x7fd9300ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 >> 172.21.15.177:0/2339555285 conn(0x7fd930097a40 msgr2=0x7fd9300acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:37.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 shutdown_connections 2023-10-25T16:24:37.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.275+0000 7fd93725d640 1 -- 172.21.15.177:0/2339555285 wait complete. 2023-10-25T16:24:37.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-25T16:24:37.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/1910029671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 msgr2=0x7fa5b8005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 --2- 172.21.15.177:0/1910029671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5b8005d60 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00bb20 tx=0x7fa5bc01cd60 comp rx=0 tx=0).stop 2023-10-25T16:24:37.403 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/1910029671 shutdown_connections 2023-10-25T16:24:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 --2- 172.21.15.177:0/1910029671 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5b8005d60 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/1910029671 >> 172.21.15.177:0/1910029671 conn(0x7fa5cc0b2450 msgr2=0x7fa5cc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/1910029671 shutdown_connections 2023-10-25T16:24:37.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/1910029671 wait complete. 2023-10-25T16:24:37.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 Processor -- start 2023-10-25T16:24:37.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- start start 2023-10-25T16:24:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5cc158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.407 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5cc14ee80 0x7fa5cc159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5cc1414c0 0x7fa5cc141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc141e60 con 0x7fa5b80058e0 2023-10-25T16:24:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc14f620 con 0x7fa5cc14ee80 2023-10-25T16:24:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc14f900 con 0x7fa5cc1414c0 2023-10-25T16:24:37.408 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5cc158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5cc158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43256/0 (socket says 172.21.15.177:43256) 2023-10-25T16:24:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 -- 172.21.15.177:0/3535552159 learned_addr learned my addr 172.21.15.177:0/3535552159 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d0ac5640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5cc14ee80 0x7fa5cc159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d1ac7640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5cc1414c0 0x7fa5cc141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.409 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 -- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5cc1414c0 msgr2=0x7fa5cc141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5cc1414c0 0x7fa5cc141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 -- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5cc14ee80 msgr2=0x7fa5cc159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5cc14ee80 0x7fa5cc159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 -- 172.21.15.177:0/3535552159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc14fbe0 con 0x7fa5b80058e0 2023-10-25T16:24:37.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d12c6640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5cc158d40 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800d5b0 tx=0x7fa5c800da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80062e0 con 0x7fa5b80058e0 2023-10-25T16:24:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa5c8003620 con 0x7fa5b80058e0 2023-10-25T16:24:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc14fec0 con 0x7fa5b80058e0 2023-10-25T16:24:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8006530 con 0x7fa5b80058e0 2023-10-25T16:24:37.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.407+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc14f300 con 0x7fa5b80058e0 2023-10-25T16:24:37.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.411+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5cc04daf0 con 0x7fa5b80058e0 2023-10-25T16:24:37.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.411+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5c8003a10 con 0x7fa5b80058e0 2023-10-25T16:24:37.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.411+0000 7fa5c1ffb640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5b0066470 0x7fa5b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.411+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa5c80843b0 con 0x7fa5b80058e0 2023-10-25T16:24:37.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.411+0000 7fa5d0ac5640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5b0066470 0x7fa5b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.411+0000 7fa5d0ac5640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5b0066470 0x7fa5b0068930 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0b0000 tx=0x7fa5bc0a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:37.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.415+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5c8051a90 con 0x7fa5b80058e0 2023-10-25T16:24:37.553 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.555+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa5cc0ae670 con 0x7fa5b80058e0 2023-10-25T16:24:37.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.563+0000 7fa5c1ffb640 1 -- 172.21.15.177:0/3535552159 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v37)=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5c80140c0 con 0x7fa5b80058e0 2023-10-25T16:24:37.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5b0066470 msgr2=0x7fa5b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5b0066470 0x7fa5b0068930 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0b0000 tx=0x7fa5bc0a7040 comp rx=0 tx=0).stop 2023-10-25T16:24:37.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 msgr2=0x7fa5cc158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5cc158d40 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800d5b0 tx=0x7fa5c800da70 comp rx=0 tx=0).stop 2023-10-25T16:24:37.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 shutdown_connections 2023-10-25T16:24:37.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa5b0066470 0x7fa5b0068930 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5cc1414c0 0x7fa5cc141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5cc14ee80 0x7fa5cc159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 --2- 172.21.15.177:0/3535552159 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5b80058e0 0x7fa5cc158d40 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 >> 172.21.15.177:0/3535552159 conn(0x7fa5cc0b2450 msgr2=0x7fa5cc0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:37.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 shutdown_connections 2023-10-25T16:24:37.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.567+0000 7fa5d352a640 1 -- 172.21.15.177:0/3535552159 wait complete. 2023-10-25T16:24:37.579 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:24:37.579 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:24:37.616 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:24:37.664 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:24:37.664 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:24:37.665 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:37.671 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:24:37.671 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:24:37.672 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:37.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:24:37.711 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:24:37.711 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:37.718 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:24:37.719 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:24:37.719 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:37.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:24:37.759 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-25T16:24:37.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- 172.21.15.177:0/3658082069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 msgr2=0x7f2a2c06be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 --2- 172.21.15.177:0/3658082069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 0x7f2a2c06be60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0098f0 tx=0x7f2a1c01c890 comp rx=0 tx=0).stop 2023-10-25T16:24:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- 172.21.15.177:0/3658082069 shutdown_connections 2023-10-25T16:24:37.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 --2- 172.21.15.177:0/3658082069 >> v2:172.21.15.184:3300/0 conn(0x7f2a2c0706f0 0x7f2a2c070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 --2- 172.21.15.177:0/3658082069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 0x7f2a2c06be60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- 172.21.15.177:0/3658082069 >> 172.21.15.177:0/3658082069 conn(0x7f2a2c0b2450 msgr2=0x7f2a2c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:37.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- 172.21.15.177:0/3658082069 shutdown_connections 2023-10-25T16:24:37.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- 172.21.15.177:0/3658082069 wait complete. 2023-10-25T16:24:37.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 Processor -- start 2023-10-25T16:24:37.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- start start 2023-10-25T16:24:37.880 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 0x7f2a2c163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 0x7f2a2c150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c1500f0 0x7f2a2c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1535f0 con 0x7f2a2c0706f0 2023-10-25T16:24:37.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1529e0 con 0x7f2a2c1500f0 2023-10-25T16:24:37.881 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a33f12640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c152cc0 con 0x7f2a2c06b9e0 2023-10-25T16:24:37.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a314ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 0x7f2a2c150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a314ad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 0x7f2a2c150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43264/0 (socket says 172.21.15.177:43264) 2023-10-25T16:24:37.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.879+0000 7f2a314ad640 1 -- 172.21.15.177:0/1780235676 learned_addr learned my addr 172.21.15.177:0/1780235676 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:37.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a31cae640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 0x7f2a2c163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.882 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a314ad640 1 -- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 msgr2=0x7f2a2c163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a314ad640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 0x7f2a2c163720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a324af640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c1500f0 0x7f2a2c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a314ad640 1 -- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c1500f0 msgr2=0x7f2a2c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:37.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a314ad640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c1500f0 0x7f2a2c1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:37.883 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a314ad640 1 -- 172.21.15.177:0/1780235676 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009500 con 0x7f2a2c0706f0 2023-10-25T16:24:37.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a314ad640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 0x7f2a2c150dc0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000c10 tx=0x7f2a1c0a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:37.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0bc070 con 0x7f2a2c0706f0 2023-10-25T16:24:37.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2a1c0051f0 con 0x7f2a2c0706f0 2023-10-25T16:24:37.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c005600 con 0x7f2a2c0706f0 2023-10-25T16:24:37.884 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c152fa0 con 0x7f2a2c0706f0 2023-10-25T16:24:37.885 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c163c60 con 0x7f2a2c0706f0 2023-10-25T16:24:37.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c0b0030 con 0x7f2a2c0706f0 2023-10-25T16:24:37.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2a1c0b4040 con 0x7f2a2c0706f0 2023-10-25T16:24:37.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a227fc640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2a10066470 0x7f2a10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:37.886 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2a1c11dea0 con 0x7f2a2c0706f0 2023-10-25T16:24:37.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a31cae640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2a10066470 0x7f2a10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:37.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.883+0000 7f2a31cae640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2a10066470 0x7f2a10068930 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2a280015e0 tx=0x7f2a28009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:37.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:37.887+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a1c0eb590 con 0x7f2a2c0706f0 2023-10-25T16:24:38.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.063+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a2c04daf0 con 0x7f2a2c0706f0 2023-10-25T16:24:38.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.063+0000 7f2a227fc640 1 -- 172.21.15.177:0/1780235676 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f2a1c0eebb0 con 0x7f2a2c0706f0 2023-10-25T16:24:38.062 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:38.063 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6836/472790744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":472790744},{"type":"v1","addr":"172.21.15.184:6836","nonce":472790744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":9108,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2857801928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2857801928},{"type":"v1","addr":"172.21.15.177:6834","nonce":2857801928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2632729898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2632729898},{"type":"v1","addr":"172.21.15.177:6835","nonce":2632729898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9126,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/346533179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6835","nonce":346533179},{"type":"v1","addr":"172.21.15.184:6837","nonce":346533179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[]} 2023-10-25T16:24:38.063 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 67 2023-10-25T16:24:38.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2a10066470 msgr2=0x7f2a10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:38.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2a10066470 0x7f2a10068930 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2a280015e0 tx=0x7f2a28009040 comp rx=0 tx=0).stop 2023-10-25T16:24:38.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 msgr2=0x7f2a2c150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:38.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 0x7f2a2c150dc0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000c10 tx=0x7f2a1c0a5840 comp rx=0 tx=0).stop 2023-10-25T16:24:38.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 shutdown_connections 2023-10-25T16:24:38.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2a10066470 0x7f2a10068930 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:38.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c1500f0 0x7f2a2c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:38.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a2c0706f0 0x7f2a2c150dc0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:38.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 --2- 172.21.15.177:0/1780235676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c06b9e0 0x7f2a2c163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:38.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 >> 172.21.15.177:0/1780235676 conn(0x7f2a2c0b2450 msgr2=0x7f2a2c148200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:38.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 shutdown_connections 2023-10-25T16:24:38.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.067+0000 7f2a33f12640 1 -- 172.21.15.177:0/1780235676 wait complete. 2023-10-25T16:24:38.080 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T16:24:38.080 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-25T16:24:38.080 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:24:38.081 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:24:38.081 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T16:24:38.081 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-25T16:24:38.082 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:24:38.082 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:24:38.082 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T16:24:38.082 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-25T16:24:38.083 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:24:38.083 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:24:38.083 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T16:24:38.084 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-25T16:24:38.084 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:24:38.084 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:24:38.090 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:24:38.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T16:24:38.097 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:24:38.097 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T16:24:38.098 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:24:38.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T16:24:38.099 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:24:38.100 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T16:24:38.139 INFO:tasks.ceph.mds.a:Started 2023-10-25T16:24:38.140 DEBUG:teuthology.parallel:result is None 2023-10-25T16:24:38.140 INFO:tasks.ceph.mds.c:Started 2023-10-25T16:24:38.141 DEBUG:teuthology.parallel:result is None 2023-10-25T16:24:38.147 INFO:tasks.ceph.mds.d:Started 2023-10-25T16:24:38.147 DEBUG:teuthology.parallel:result is None 2023-10-25T16:24:38.148 INFO:tasks.ceph.mds.b:Started 2023-10-25T16:24:38.148 DEBUG:teuthology.parallel:result is None 2023-10-25T16:24:38.149 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-25T16:24:38.198 INFO:tasks.ceph.mds.c.smithi177.stdout:starting mds.c at 2023-10-25T16:24:38.201 INFO:tasks.ceph.mds.a.smithi177.stdout:starting mds.a at 2023-10-25T16:24:38.219 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-25T16:24:38.221 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:24:38.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/4076461074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfec004d10 msgr2=0x7fdfec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:38.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/4076461074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdfec004d10 0x7fdfec005190 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fdffc009e30 tx=0x7fdffc01d150 comp rx=0 tx=0).stop 2023-10-25T16:24:38.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe008d7e640 1 -- 172.21.15.177:0/4076461074 reap_dead start 2023-10-25T16:24:38.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/4076461074 shutdown_connections 2023-10-25T16:24:38.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/4076461074 >> 172.21.15.177:0/4076461074 conn(0x7fe00409a580 msgr2=0x7fe0040d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:38.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/4076461074 shutdown_connections 2023-10-25T16:24:38.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/4076461074 wait complete. 2023-10-25T16:24:38.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 Processor -- start 2023-10-25T16:24:38.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- start start 2023-10-25T16:24:38.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe004150850 0x7fe0041f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:38.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 0x7fe00406b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:38.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe00406bd70 0x7fe004154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:38.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00406c1f0 con 0x7fe004156cd0 2023-10-25T16:24:38.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004151490 con 0x7fe00406bd70 2023-10-25T16:24:38.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe004156740 con 0x7fe004150850 2023-10-25T16:24:38.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 0x7fe00406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:38.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 0x7fe00406b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43288/0 (socket says 172.21.15.177:43288) 2023-10-25T16:24:38.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 -- 172.21.15.177:0/2031613879 learned_addr learned my addr 172.21.15.177:0/2031613879 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:38.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe003fff640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe004150850 0x7fe0041f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:38.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe008d7e640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe00406bd70 0x7fe004154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:38.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 -- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe004150850 msgr2=0x7fe0041f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:38.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe004150850 0x7fe0041f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:38.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 -- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe00406bd70 msgr2=0x7fe004154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:38.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe00406bd70 0x7fe004154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:38.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 -- 172.21.15.177:0/2031613879 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0041569f0 con 0x7fe004156cd0 2023-10-25T16:24:38.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe008d7e640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe00406bd70 0x7fe004154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:24:38.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe0037fe640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 0x7fe00406b830 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fdff8006fc0 tx=0x7fdff8003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:38.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800f800 con 0x7fe004156cd0 2023-10-25T16:24:38.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdff800f960 con 0x7fe004156cd0 2023-10-25T16:24:38.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe004151120 con 0x7fe004156cd0 2023-10-25T16:24:38.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800fcf0 con 0x7fe004156cd0 2023-10-25T16:24:38.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.267+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe004150e00 con 0x7fe004156cd0 2023-10-25T16:24:38.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.271+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004151640 con 0x7fe004156cd0 2023-10-25T16:24:38.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.271+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdff8011430 con 0x7fe004156cd0 2023-10-25T16:24:38.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.271+0000 7fe000ff9640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdff00664f0 0x7fdff00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:38.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.271+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdff8084720 con 0x7fe004156cd0 2023-10-25T16:24:38.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.271+0000 7fe003fff640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdff00664f0 0x7fdff00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:38.276 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.271+0000 7fe003fff640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdff00664f0 0x7fdff00689b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe0040c7820 tx=0x7fdff4006b40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:38.277 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.275+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe004151640 con 0x7fe004156cd0 2023-10-25T16:24:38.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:38.439+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe0040d2150 con 0x7fe004156cd0 2023-10-25T16:24:39.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe000ff9640 1 -- 172.21.15.177:0/2031613879 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v184) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe0040d2150 con 0x7fe004156cd0 2023-10-25T16:24:39.007 INFO:teuthology.orchestra.run.smithi177.stderr: removed all blocklist entries 2023-10-25T16:24:39.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdff00664f0 msgr2=0x7fdff00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdff00664f0 0x7fdff00689b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe0040c7820 tx=0x7fdff4006b40 comp rx=0 tx=0).stop 2023-10-25T16:24:39.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 msgr2=0x7fe00406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 0x7fe00406b830 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fdff8006fc0 tx=0x7fdff8003ab0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 shutdown_connections 2023-10-25T16:24:39.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fdff00664f0 0x7fdff00689b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe00406bd70 0x7fe004154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe004156cd0 0x7fe00406b830 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 --2- 172.21.15.177:0/2031613879 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe004150850 0x7fe0041f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 >> 172.21.15.177:0/2031613879 conn(0x7fe00409a580 msgr2=0x7fe0040ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 shutdown_connections 2023-10-25T16:24:39.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.011+0000 7fe00a7e1640 1 -- 172.21.15.177:0/2031613879 wait complete. 2023-10-25T16:24:39.031 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-25T16:24:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 -- 172.21.15.177:0/3253968096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801500f0 msgr2=0x7f00800c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3253968096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801500f0 0x7f00800c9910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0070009840 tx=0x7f007001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 -- 172.21.15.177:0/3253968096 shutdown_connections 2023-10-25T16:24:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3253968096 >> v2:172.21.15.184:3300/0 conn(0x7f008006c110 0x7f00800706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3253968096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801500f0 0x7f00800c9910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 -- 172.21.15.177:0/3253968096 >> 172.21.15.177:0/3253968096 conn(0x7f00800b2450 msgr2=0x7f00800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 -- 172.21.15.177:0/3253968096 shutdown_connections 2023-10-25T16:24:39.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.163+0000 7f0084f4c640 1 -- 172.21.15.177:0/3253968096 wait complete. 2023-10-25T16:24:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 Processor -- start 2023-10-25T16:24:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- start start 2023-10-25T16:24:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008006c110 0x7f00800abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 0x7f008014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801403b0 0x7f0080148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800ac370 con 0x7f00800c9e50 2023-10-25T16:24:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008014cce0 con 0x7f008006c110 2023-10-25T16:24:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008014cfc0 con 0x7f00801403b0 2023-10-25T16:24:39.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 0x7f008014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 0x7f008014ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43298/0 (socket says 172.21.15.177:43298) 2023-10-25T16:24:39.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 -- 172.21.15.177:0/3367291993 learned_addr learned my addr 172.21.15.177:0/3367291993 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:39.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007ed9d640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801403b0 0x7f0080148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007e59c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008006c110 0x7f00800abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 -- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801403b0 msgr2=0x7f0080148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801403b0 0x7f0080148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 -- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008006c110 msgr2=0x7f00800abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008006c110 0x7f00800abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 -- 172.21.15.177:0/3367291993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009820 con 0x7f00800c9e50 2023-10-25T16:24:39.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f007dd9b640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 0x7f008014ae30 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f007400c3a0 tx=0x7f007400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:39.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074004230 con 0x7f00800c9e50 2023-10-25T16:24:39.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f00740044a0 con 0x7f00800c9e50 2023-10-25T16:24:39.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00700094a0 con 0x7f00800c9e50 2023-10-25T16:24:39.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00740038b0 con 0x7f00800c9e50 2023-10-25T16:24:39.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00800718c0 con 0x7f00800c9e50 2023-10-25T16:24:39.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.167+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008004daf0 con 0x7f00800c9e50 2023-10-25T16:24:39.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.171+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0074003ad0 con 0x7f00800c9e50 2023-10-25T16:24:39.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.171+0000 7f006effd640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0060066470 0x7f0060068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.171+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0074083190 con 0x7f00800c9e50 2023-10-25T16:24:39.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.171+0000 7f007e59c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0060066470 0x7f0060068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.171+0000 7f007e59c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0060066470 0x7f0060068930 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00700af000 tx=0x7f007001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:39.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.175+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0074050a20 con 0x7f00800c9e50 2023-10-25T16:24:39.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.387+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f008014fe30 con 0x7f00800c9e50 2023-10-25T16:24:39.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.387+0000 7f006effd640 1 -- 172.21.15.177:0/3367291993 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0074054040 con 0x7f00800c9e50 2023-10-25T16:24:39.383 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:39.384 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:24:39.384 INFO:teuthology.orchestra.run.smithi177.stdout: "auth_dump": [ 2023-10-25T16:24:39.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.384 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.a", 2023-10-25T16:24:39.384 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllS+t4OxAA8f0Pzx2+DLJM4bSrqSiOJw==", 2023-10-25T16:24:39.388 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.388 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.388 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:24:39.389 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:24:39.389 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.389 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.390 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.b", 2023-10-25T16:24:39.390 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlly4oIDBAAR65U3PM574mifUnO6wHCnw==", 2023-10-25T16:24:39.390 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.390 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.390 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:24:39.391 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:24:39.391 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.391 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.391 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.392 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.c", 2023-10-25T16:24:39.392 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjll90S6BRAA2AXcIFX08c7GnVGEOCkO9w==", 2023-10-25T16:24:39.392 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.392 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.392 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:24:39.392 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:24:39.393 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.393 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.393 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mds.d", 2023-10-25T16:24:39.394 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllYEA8EhAAH84BjS0HtB8NBMlkEQJsTA==", 2023-10-25T16:24:39.394 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.394 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.394 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:24:39.394 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:24:39.395 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.395 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.395 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.0", 2023-10-25T16:24:39.396 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjll1NvFHRAAMrIc/yQYlrJN757Fo3g7uQ==", 2023-10-25T16:24:39.396 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.396 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.396 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.396 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.397 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.397 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.397 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.1", 2023-10-25T16:24:39.397 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllIuxyJBAAkRyLbHcMvo7+8S+F6mF2Sw==", 2023-10-25T16:24:39.397 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.398 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.398 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.398 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.398 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.399 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.2", 2023-10-25T16:24:39.399 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjlltFCSLRAA8OVA0iTiFqJTK8rJJ/dy4w==", 2023-10-25T16:24:39.399 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.399 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.400 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.400 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.400 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.400 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.400 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.401 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.3", 2023-10-25T16:24:39.401 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBzPjllpafTNxAAW1U7mXxn0YyUEq0hmc10cA==", 2023-10-25T16:24:39.401 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.401 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.401 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.402 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.402 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.402 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.4", 2023-10-25T16:24:39.403 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllIoTDAxAAI1yX282jlEA3PI4jOFQ6Vg==", 2023-10-25T16:24:39.403 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.403 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.403 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.403 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.404 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.404 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.5", 2023-10-25T16:24:39.404 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllLI8HCxAAOu5+Yz84ZJxsOurBUehpWw==", 2023-10-25T16:24:39.405 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.405 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.405 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.405 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.405 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.406 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.406 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.6", 2023-10-25T16:24:39.406 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllWB+AFBAAuIis2ELguyYG+qp+ytITPQ==", 2023-10-25T16:24:39.406 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.406 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.407 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.407 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.407 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.407 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "osd.7", 2023-10-25T16:24:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQB3PjllNRTIHhAAzbCUKxNvJMAOst3tRhQh+w==", 2023-10-25T16:24:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow profile osd", 2023-10-25T16:24:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile osd", 2023-10-25T16:24:39.408 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.409 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.409 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.0", 2023-10-25T16:24:39.409 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg==", 2023-10-25T16:24:39.410 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.410 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.410 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow r", 2023-10-25T16:24:39.410 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-25T16:24:39.410 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.411 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.411 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.1", 2023-10-25T16:24:39.411 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjlljxJtHxAA5jpOy0ugfwZPUMqfKrVQnA==", 2023-10-25T16:24:39.411 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.412 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.412 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:24:39.412 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:24:39.412 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:24:39.412 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.413 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.413 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.2", 2023-10-25T16:24:39.413 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllocemHBAAfBA6qCt8OBiaGUN4ClsBRg==", 2023-10-25T16:24:39.413 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.413 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.414 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:24:39.414 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:24:39.414 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:24:39.414 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.414 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.415 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.415 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.3", 2023-10-25T16:24:39.415 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBwPjllsqx6JBAAxk4pc4QZIQsFhsUxOuIa3Q==", 2023-10-25T16:24:39.415 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.415 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow", 2023-10-25T16:24:39.416 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow r", 2023-10-25T16:24:39.416 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow rw", 2023-10-25T16:24:39.416 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow rwx" 2023-10-25T16:24:39.416 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.417 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "client.admin", 2023-10-25T16:24:39.417 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllU/YoJBAAcOYGm+xxqxmxKENCTFQ8rQ==", 2023-10-25T16:24:39.417 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.417 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:24:39.417 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": "allow *", 2023-10-25T16:24:39.418 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow *", 2023-10-25T16:24:39.418 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.418 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.418 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.419 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.x", 2023-10-25T16:24:39.419 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjll4nvzNxAAXJ8Ay9EchJrzDtCvyLaWug==", 2023-10-25T16:24:39.419 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.419 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:24:39.419 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:24:39.420 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.420 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:39.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:39.420 INFO:teuthology.orchestra.run.smithi177.stdout: "entity": "mgr.y", 2023-10-25T16:24:39.420 INFO:teuthology.orchestra.run.smithi177.stdout: "key": "AQBvPjllWvgaNRAA5kSIi01gUO4orq49wYmDfg==", 2023-10-25T16:24:39.421 INFO:teuthology.orchestra.run.smithi177.stdout: "caps": { 2023-10-25T16:24:39.421 INFO:teuthology.orchestra.run.smithi177.stdout: "mds": "allow *", 2023-10-25T16:24:39.421 INFO:teuthology.orchestra.run.smithi177.stdout: "mon": "allow profile mgr", 2023-10-25T16:24:39.421 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": "allow *" 2023-10-25T16:24:39.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.422 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:39.422 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:39.422 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:24:39.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0060066470 msgr2=0x7f0060068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0060066470 0x7f0060068930 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f00700af000 tx=0x7f007001b010 comp rx=0 tx=0).stop 2023-10-25T16:24:39.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 msgr2=0x7f008014ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 0x7f008014ae30 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f007400c3a0 tx=0x7f007400c860 comp rx=0 tx=0).stop 2023-10-25T16:24:39.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 shutdown_connections 2023-10-25T16:24:39.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0060066470 0x7f0060068930 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00801403b0 0x7f0080148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00800c9e50 0x7f008014ae30 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 --2- 172.21.15.177:0/3367291993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f008006c110 0x7f00800abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.425 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 >> 172.21.15.177:0/3367291993 conn(0x7f00800b2450 msgr2=0x7f00800cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 shutdown_connections 2023-10-25T16:24:39.426 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.391+0000 7f0084f4c640 1 -- 172.21.15.177:0/3367291993 wait complete. 2023-10-25T16:24:39.426 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:39.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/2464985789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39300706f0 msgr2=0x7f3930070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 --2- 172.21.15.177:0/2464985789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39300706f0 0x7f3930070b00 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f3928009c80 tx=0x7f392801cd10 comp rx=0 tx=0).stop 2023-10-25T16:24:39.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/2464985789 shutdown_connections 2023-10-25T16:24:39.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 --2- 172.21.15.177:0/2464985789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39300706f0 0x7f3930070b00 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 --2- 172.21.15.177:0/2464985789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f393006b980 0x7f393006be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/2464985789 >> 172.21.15.177:0/2464985789 conn(0x7f39300b2450 msgr2=0x7f39300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/2464985789 shutdown_connections 2023-10-25T16:24:39.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/2464985789 wait complete. 2023-10-25T16:24:39.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 Processor -- start 2023-10-25T16:24:39.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- start start 2023-10-25T16:24:39.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 0x7f393014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300706f0 0x7f393014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39301500f0 0x7f39300aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.543 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39301485d0 con 0x7f393006b980 2023-10-25T16:24:39.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393014f670 con 0x7f39300706f0 2023-10-25T16:24:39.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3930147f10 con 0x7f39301500f0 2023-10-25T16:24:39.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 0x7f393014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 0x7f393014ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43318/0 (socket says 172.21.15.177:43318) 2023-10-25T16:24:39.544 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 -- 172.21.15.177:0/603661740 learned_addr learned my addr 172.21.15.177:0/603661740 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:39.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 -- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39301500f0 msgr2=0x7f39300aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392ffff640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39301500f0 0x7f39300aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39301500f0 0x7f39300aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3927fff640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300706f0 0x7f393014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.545 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 -- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300706f0 msgr2=0x7f393014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300706f0 0x7f393014e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 -- 172.21.15.177:0/603661740 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280098e0 con 0x7f393006b980 2023-10-25T16:24:39.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392f7fe640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 0x7f393014ef70 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f392000c490 tx=0x7f3920001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:39.546 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920003600 con 0x7f393006b980 2023-10-25T16:24:39.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3920003780 con 0x7f393006b980 2023-10-25T16:24:39.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39301481f0 con 0x7f393006b980 2023-10-25T16:24:39.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920003bd0 con 0x7f393006b980 2023-10-25T16:24:39.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.543+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393014f950 con 0x7f393006b980 2023-10-25T16:24:39.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.547+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3930147d70 con 0x7f393006b980 2023-10-25T16:24:39.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.547+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3920003d30 con 0x7f393006b980 2023-10-25T16:24:39.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.547+0000 7f392cff9640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3910066470 0x7f3910068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.547+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3920083240 con 0x7f393006b980 2023-10-25T16:24:39.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.547+0000 7f3927fff640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3910066470 0x7f3910068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.547+0000 7f3927fff640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3910066470 0x7f3910068930 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f393014cdc0 tx=0x7f3918008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:39.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.551+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3930147d70 con 0x7f393006b980 2023-10-25T16:24:39.691 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.695+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3930147d70 con 0x7f393006b980 2023-10-25T16:24:39.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.695+0000 7f392cff9640 1 -- 172.21.15.177:0/603661740 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+12892 (secure 0 0 0) 0x7f3930147d70 con 0x7f393006b980 2023-10-25T16:24:39.693 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:39.694 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":186,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:39.031084+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:39.697 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3910066470 msgr2=0x7f3910068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3910066470 0x7f3910068930 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f393014cdc0 tx=0x7f3918008040 comp rx=0 tx=0).stop 2023-10-25T16:24:39.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 msgr2=0x7f393014ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.698 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 0x7f393014ef70 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f392000c490 tx=0x7f3920001e80 comp rx=0 tx=0).stop 2023-10-25T16:24:39.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 shutdown_connections 2023-10-25T16:24:39.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3910066470 0x7f3910068930 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39301500f0 0x7f39300aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39300706f0 0x7f393014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 --2- 172.21.15.177:0/603661740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393006b980 0x7f393014ef70 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 >> 172.21.15.177:0/603661740 conn(0x7f39300b2450 msgr2=0x7f3930149870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 shutdown_connections 2023-10-25T16:24:39.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.699+0000 7f3935ec4640 1 -- 172.21.15.177:0/603661740 wait complete. 2023-10-25T16:24:39.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:24:39.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:24:39.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 -- 172.21.15.177:0/69822185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 msgr2=0x7fc88c005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 --2- 172.21.15.177:0/69822185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc88c005d60 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fc88800bb10 tx=0x7fc88801cd80 comp rx=0 tx=0).stop 2023-10-25T16:24:39.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc89f7fe640 1 -- 172.21.15.177:0/69822185 reap_dead start 2023-10-25T16:24:39.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 -- 172.21.15.177:0/69822185 shutdown_connections 2023-10-25T16:24:39.825 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 -- 172.21.15.177:0/69822185 >> 172.21.15.177:0/69822185 conn(0x7fc8a00af5b0 msgr2=0x7fc8a00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 -- 172.21.15.177:0/69822185 shutdown_connections 2023-10-25T16:24:39.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 -- 172.21.15.177:0/69822185 wait complete. 2023-10-25T16:24:39.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 Processor -- start 2023-10-25T16:24:39.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.827+0000 7fc8a573d640 1 -- start start 2023-10-25T16:24:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc8a01431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8a00b06a0 0x7fc8a0149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8a0159f30 0x7fc8a015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0143700 con 0x7fc88c0058e0 2023-10-25T16:24:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a015a8f0 con 0x7fc8a0159f30 2023-10-25T16:24:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b0c40 con 0x7fc8a00b06a0 2023-10-25T16:24:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc8a01431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc8a01431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43336/0 (socket says 172.21.15.177:43336) 2023-10-25T16:24:39.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 -- 172.21.15.177:0/3850090980 learned_addr learned my addr 172.21.15.177:0/3850090980 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89e7fc640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8a00b06a0 0x7fc8a0149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89f7fe640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8a0159f30 0x7fc8a015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 -- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8a00b06a0 msgr2=0x7fc8a0149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8a00b06a0 0x7fc8a0149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 -- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8a0159f30 msgr2=0x7fc8a015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8a0159f30 0x7fc8a015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 -- 172.21.15.177:0/3850090980 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00b0f20 con 0x7fc88c0058e0 2023-10-25T16:24:39.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89e7fc640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8a00b06a0 0x7fc8a0149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:39.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89f7fe640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8a0159f30 0x7fc8a015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:39.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89effd640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc8a01431c0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fc89800f5d0 tx=0x7fc89800fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980118a0 con 0x7fc88c0058e0 2023-10-25T16:24:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc898011af0 con 0x7fc88c0058e0 2023-10-25T16:24:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00b1200 con 0x7fc88c0058e0 2023-10-25T16:24:39.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc898011ea0 con 0x7fc88c0058e0 2023-10-25T16:24:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a00b17c0 con 0x7fc88c0058e0 2023-10-25T16:24:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a004daf0 con 0x7fc88c0058e0 2023-10-25T16:24:39.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc898012470 con 0x7fc88c0058e0 2023-10-25T16:24:39.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8977fe640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc8800664a0 0x7fc880068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:39.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8980872c0 con 0x7fc88c0058e0 2023-10-25T16:24:39.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89e7fc640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc8800664a0 0x7fc880068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:39.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.831+0000 7fc89e7fc640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc8800664a0 0x7fc880068960 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc8880b0000 tx=0x7fc888019b20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:39.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.835+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc898054a90 con 0x7fc88c0058e0 2023-10-25T16:24:39.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.975+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8a00b2df0 con 0x7fc88c0058e0 2023-10-25T16:24:39.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.975+0000 7fc8977fe640 1 -- 172.21.15.177:0/3850090980 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v186) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8980580b0 con 0x7fc88c0058e0 2023-10-25T16:24:39.974 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:24:39.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc8800664a0 msgr2=0x7fc880068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc8800664a0 0x7fc880068960 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc8880b0000 tx=0x7fc888019b20 comp rx=0 tx=0).stop 2023-10-25T16:24:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 msgr2=0x7fc8a01431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc8a01431c0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fc89800f5d0 tx=0x7fc89800fa90 comp rx=0 tx=0).stop 2023-10-25T16:24:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 shutdown_connections 2023-10-25T16:24:39.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc8800664a0 0x7fc880068960 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8a0159f30 0x7fc8a015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8a00b06a0 0x7fc8a0149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 --2- 172.21.15.177:0/3850090980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc88c0058e0 0x7fc8a01431c0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:39.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 >> 172.21.15.177:0/3850090980 conn(0x7fc8a00af5b0 msgr2=0x7fc8a0157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:39.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 shutdown_connections 2023-10-25T16:24:39.980 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:39.979+0000 7fc8a573d640 1 -- 172.21.15.177:0/3850090980 wait complete. 2023-10-25T16:24:39.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T16:24:40.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 -- 172.21.15.177:0/192172150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 msgr2=0x7f6e34005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 --2- 172.21.15.177:0/192172150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e34005190 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009e00 tx=0x7f6e4001d150 comp rx=0 tx=0).stop 2023-10-25T16:24:40.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e4ebcb640 1 -- 172.21.15.177:0/192172150 reap_dead start 2023-10-25T16:24:40.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 -- 172.21.15.177:0/192172150 shutdown_connections 2023-10-25T16:24:40.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 -- 172.21.15.177:0/192172150 >> 172.21.15.177:0/192172150 conn(0x7f6e480b2450 msgr2=0x7f6e480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:40.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 -- 172.21.15.177:0/192172150 shutdown_connections 2023-10-25T16:24:40.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 -- 172.21.15.177:0/192172150 wait complete. 2023-10-25T16:24:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.107+0000 7f6e5062e640 1 Processor -- start 2023-10-25T16:24:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- start start 2023-10-25T16:24:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e4815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e48159d50 0x7f6e481ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e481ed710 0x7f6e480adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4813eb30 con 0x7f6e34004d10 2023-10-25T16:24:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4815ac40 con 0x7f6e481ed710 2023-10-25T16:24:40.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4815af20 con 0x7f6e48159d50 2023-10-25T16:24:40.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e4815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:40.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e4815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43354/0 (socket says 172.21.15.177:43354) 2023-10-25T16:24:40.113 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 -- 172.21.15.177:0/1731841655 learned_addr learned my addr 172.21.15.177:0/1731841655 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4dbc9640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e48159d50 0x7f6e481ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4ebcb640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e481ed710 0x7f6e480adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 -- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e48159d50 msgr2=0x7f6e481ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e48159d50 0x7f6e481ed1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 -- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e481ed710 msgr2=0x7f6e480adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e481ed710 0x7f6e480adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 -- 172.21.15.177:0/1731841655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4815b200 con 0x7f6e34004d10 2023-10-25T16:24:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4e3ca640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e4815a540 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e760 tx=0x7f6e4400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400cc60 con 0x7f6e34004d10 2023-10-25T16:24:40.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6e4400ee70 con 0x7f6e34004d10 2023-10-25T16:24:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4815b4e0 con 0x7f6e34004d10 2023-10-25T16:24:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440116b0 con 0x7f6e34004d10 2023-10-25T16:24:40.116 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e480ae620 con 0x7f6e34004d10 2023-10-25T16:24:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e480ae8a0 con 0x7f6e34004d10 2023-10-25T16:24:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e44011810 con 0x7f6e34004d10 2023-10-25T16:24:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e3effd640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e2c0664a0 0x7f6e2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e44084610 con 0x7f6e34004d10 2023-10-25T16:24:40.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.111+0000 7f6e4dbc9640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e2c0664a0 0x7f6e2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:40.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.115+0000 7f6e4dbc9640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e2c0664a0 0x7f6e2c068960 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6e380018e0 tx=0x7f6e38006ed0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:40.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.115+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e480ae8a0 con 0x7f6e34004d10 2023-10-25T16:24:40.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6e480ae8a0 con 0x7f6e34004d10 2023-10-25T16:24:40.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e3effd640 1 -- 172.21.15.177:0/1731841655 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v186) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6e480ae8a0 con 0x7f6e34004d10 2023-10-25T16:24:40.256 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:40.256 INFO:teuthology.orchestra.run.smithi177.stdout:[ 2023-10-25T16:24:40.257 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:40.257 INFO:teuthology.orchestra.run.smithi177.stdout: "poolnum": 1, 2023-10-25T16:24:40.257 INFO:teuthology.orchestra.run.smithi177.stdout: "poolname": ".mgr" 2023-10-25T16:24:40.257 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:40.257 INFO:teuthology.orchestra.run.smithi177.stdout:] 2023-10-25T16:24:40.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e2c0664a0 msgr2=0x7f6e2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e2c0664a0 0x7f6e2c068960 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6e380018e0 tx=0x7f6e38006ed0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 msgr2=0x7f6e4815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e4815a540 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e760 tx=0x7f6e4400ec20 comp rx=0 tx=0).stop 2023-10-25T16:24:40.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 shutdown_connections 2023-10-25T16:24:40.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6e2c0664a0 0x7f6e2c068960 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e481ed710 0x7f6e480adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6e48159d50 0x7f6e481ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 --2- 172.21.15.177:0/1731841655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e34004d10 0x7f6e4815a540 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 >> 172.21.15.177:0/1731841655 conn(0x7f6e480b2450 msgr2=0x7f6e480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:40.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 shutdown_connections 2023-10-25T16:24:40.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.259+0000 7f6e5062e640 1 -- 172.21.15.177:0/1731841655 wait complete. 2023-10-25T16:24:40.273 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T16:24:40.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T16:24:40.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/504893670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 msgr2=0x7f75400b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 --2- 172.21.15.177:0/504893670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b1a20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f7538009c80 tx=0x7f753801caa0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/504893670 shutdown_connections 2023-10-25T16:24:40.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 --2- 172.21.15.177:0/504893670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b1a20 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 --2- 172.21.15.177:0/504893670 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75400cdba0 0x7f75400ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/504893670 >> 172.21.15.177:0/504893670 conn(0x7f754009a5d0 msgr2=0x7f75400d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:40.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/504893670 shutdown_connections 2023-10-25T16:24:40.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/504893670 wait complete. 2023-10-25T16:24:40.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 Processor -- start 2023-10-25T16:24:40.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- start start 2023-10-25T16:24:40.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75400cdba0 0x7f7540154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75400d1960 0x7f75400c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400b5850 con 0x7f75400b1590 2023-10-25T16:24:40.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400c52c0 con 0x7f75400d1960 2023-10-25T16:24:40.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75400c5800 con 0x7f75400cdba0 2023-10-25T16:24:40.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:40.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:43372/0 (socket says 172.21.15.177:43372) 2023-10-25T16:24:40.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 -- 172.21.15.177:0/1194404639 learned_addr learned my addr 172.21.15.177:0/1194404639 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:40.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 -- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75400cdba0 msgr2=0x7f7540154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.398 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75400cdba0 0x7f7540154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 -- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75400d1960 msgr2=0x7f75400c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:40.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75400d1960 0x7f75400c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:40.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 -- 172.21.15.177:0/1194404639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380098e0 con 0x7f75400b1590 2023-10-25T16:24:40.399 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f753e59c640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b5c70 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f753000c970 tx=0x7f753000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:40.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530007bb0 con 0x7f75400b1590 2023-10-25T16:24:40.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7530007e20 con 0x7f75400b1590 2023-10-25T16:24:40.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75400c5520 con 0x7f75400b1590 2023-10-25T16:24:40.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530005280 con 0x7f75400b1590 2023-10-25T16:24:40.400 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.395+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75400b5470 con 0x7f75400b1590 2023-10-25T16:24:40.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.399+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75400b4ff0 con 0x7f75400b1590 2023-10-25T16:24:40.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.399+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75300053e0 con 0x7f75400b1590 2023-10-25T16:24:40.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.399+0000 7f75377fe640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75200664a0 0x7f7520068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:40.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.399+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7530084460 con 0x7f75400b1590 2023-10-25T16:24:40.401 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.399+0000 7f7535d9b640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75200664a0 0x7f7520068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:40.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.399+0000 7f7535d9b640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75200664a0 0x7f7520068960 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f75400b1d00 tx=0x7f7528006bd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:40.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.403+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75400b4ff0 con 0x7f75400b1590 2023-10-25T16:24:40.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:40.543+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f75400b4ff0 con 0x7f75400b1590 2023-10-25T16:24:41.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.026+0000 7f75377fe640 1 -- 172.21.15.177:0/1194404639 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v187) v1 ==== 138+0+0 (secure 0 0 0) 0x7f75400b4ff0 con 0x7f75400b1590 2023-10-25T16:24:41.024 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' created 2023-10-25T16:24:41.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75200664a0 msgr2=0x7f7520068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:41.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75200664a0 0x7f7520068960 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f75400b1d00 tx=0x7f7528006bd0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 msgr2=0x7f75400b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:41.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b5c70 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f753000c970 tx=0x7f753000ce30 comp rx=0 tx=0).stop 2023-10-25T16:24:41.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 shutdown_connections 2023-10-25T16:24:41.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f75200664a0 0x7f7520068960 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75400d1960 0x7f75400c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75400cdba0 0x7f7540154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 --2- 172.21.15.177:0/1194404639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75400b1590 0x7f75400b5c70 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 >> 172.21.15.177:0/1194404639 conn(0x7f754009a5d0 msgr2=0x7f754006a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:41.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 shutdown_connections 2023-10-25T16:24:41.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.030+0000 7f7544f88640 1 -- 172.21.15.177:0/1194404639 wait complete. 2023-10-25T16:24:41.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T16:24:41.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 -- 172.21.15.177:0/145358173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe0003980 msgr2=0x7fcfe0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:41.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 --2- 172.21.15.177:0/145358173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe0003980 0x7fcfe0003da0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009b60 tx=0x7fcfec01d250 comp rx=0 tx=0).stop 2023-10-25T16:24:41.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 -- 172.21.15.177:0/145358173 shutdown_connections 2023-10-25T16:24:41.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 --2- 172.21.15.177:0/145358173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfe0003980 0x7fcfe0003da0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 -- 172.21.15.177:0/145358173 >> 172.21.15.177:0/145358173 conn(0x7fcff808ac90 msgr2=0x7fcff809a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:41.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 -- 172.21.15.177:0/145358173 shutdown_connections 2023-10-25T16:24:41.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.186+0000 7fcffcecb640 1 -- 172.21.15.177:0/145358173 wait complete. 2023-10-25T16:24:41.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 Processor -- start 2023-10-25T16:24:41.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- start start 2023-10-25T16:24:41.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcfe0003980 0x7fcff814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:41.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff814e220 0x7fcff80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:41.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 0x7fcff81e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:41.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81e8030 con 0x7fcff814e750 2023-10-25T16:24:41.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81e8310 con 0x7fcff814e220 2023-10-25T16:24:41.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81e85f0 con 0x7fcfe0003980 2023-10-25T16:24:41.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 0x7fcff81e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:41.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 0x7fcff81e90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37196/0 (socket says 172.21.15.177:37196) 2023-10-25T16:24:41.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 -- 172.21.15.177:0/2932001888 learned_addr learned my addr 172.21.15.177:0/2932001888 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:41.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff5d9b640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff814e220 0x7fcff80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:41.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff659c640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcfe0003980 0x7fcff814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:41.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 -- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcfe0003980 msgr2=0x7fcff814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:41.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcfe0003980 0x7fcff814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 -- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff814e220 msgr2=0x7fcff80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:41.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff814e220 0x7fcff80b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:41.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 -- 172.21.15.177:0/2932001888 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff81e88d0 con 0x7fcff814e750 2023-10-25T16:24:41.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcff6d9d640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 0x7fcff81e90d0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b3d50 tx=0x7fcff00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:41.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0011870 con 0x7fcff814e750 2023-10-25T16:24:41.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcff0011ae0 con 0x7fcff814e750 2023-10-25T16:24:41.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00020a0 con 0x7fcff814e750 2023-10-25T16:24:41.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff81e8bb0 con 0x7fcff814e750 2023-10-25T16:24:41.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff80cb020 con 0x7fcff814e750 2023-10-25T16:24:41.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff81e8da0 con 0x7fcff814e750 2023-10-25T16:24:41.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.190+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcff0023430 con 0x7fcff814e750 2023-10-25T16:24:41.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.194+0000 7fcfe6ffd640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcfd80664a0 0x7fcfd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:41.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.194+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fcff0084920 con 0x7fcff814e750 2023-10-25T16:24:41.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.194+0000 7fcff659c640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcfd80664a0 0x7fcfd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:41.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.194+0000 7fcff659c640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcfd80664a0 0x7fcfd8068960 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ae000 tx=0x7fcfec019ff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:41.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.198+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcff00520f0 con 0x7fcff814e750 2023-10-25T16:24:41.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:41.354+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcff804db20 con 0x7fcff814e750 2023-10-25T16:24:42.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.030+0000 7fcfe6ffd640 1 -- 172.21.15.177:0/2932001888 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v188) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcff0055710 con 0x7fcff814e750 2023-10-25T16:24:42.031 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' created 2023-10-25T16:24:42.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcfd80664a0 msgr2=0x7fcfd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:42.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcfd80664a0 0x7fcfd8068960 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ae000 tx=0x7fcfec019ff0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 msgr2=0x7fcff81e90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:42.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 0x7fcff81e90d0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b3d50 tx=0x7fcff00019c0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 shutdown_connections 2023-10-25T16:24:42.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fcfd80664a0 0x7fcfd8068960 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.034 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcff814e750 0x7fcff81e90d0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcff814e220 0x7fcff80b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 --2- 172.21.15.177:0/2932001888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcfe0003980 0x7fcff814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 >> 172.21.15.177:0/2932001888 conn(0x7fcff808ac90 msgr2=0x7fcff814ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:42.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 shutdown_connections 2023-10-25T16:24:42.035 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.034+0000 7fcffcecb640 1 -- 172.21.15.177:0/2932001888 wait complete. 2023-10-25T16:24:42.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T16:24:42.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/2270713016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 msgr2=0x7f09e80b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:42.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 --2- 172.21.15.177:0/2270713016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e80b1df0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009cb0 tx=0x7f09e001ccb0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/2270713016 shutdown_connections 2023-10-25T16:24:42.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 --2- 172.21.15.177:0/2270713016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e80b1df0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/2270713016 >> 172.21.15.177:0/2270713016 conn(0x7f09e8065f40 msgr2=0x7f09e809a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:42.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/2270713016 shutdown_connections 2023-10-25T16:24:42.188 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/2270713016 wait complete. 2023-10-25T16:24:42.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 Processor -- start 2023-10-25T16:24:42.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- start start 2023-10-25T16:24:42.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e80b2330 0x7f09e815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:42.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e80d1b30 0x7f09e80bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:42.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:42.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e8151b00 con 0x7f09e815b590 2023-10-25T16:24:42.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e81511f0 con 0x7f09e80b2330 2023-10-25T16:24:42.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80c26b0 con 0x7f09e80d1b30 2023-10-25T16:24:42.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:42.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e815a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37218/0 (socket says 172.21.15.177:37218) 2023-10-25T16:24:42.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 -- 172.21.15.177:0/1670524065 learned_addr learned my addr 172.21.15.177:0/1670524065 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:42.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e6ffd640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e80b2330 0x7f09e815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:42.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e67fc640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e80d1b30 0x7f09e80bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:42.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 -- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e80d1b30 msgr2=0x7f09e80bf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:42.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e80d1b30 0x7f09e80bf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 -- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e80b2330 msgr2=0x7f09e815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:42.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e80b2330 0x7f09e815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:42.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 -- 172.21.15.177:0/1670524065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e00098e0 con 0x7f09e815b590 2023-10-25T16:24:42.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e6ffd640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e80b2330 0x7f09e815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:42.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09e77fe640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e815a6b0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f09d800c400 tx=0x7f09d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:42.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80052d0 con 0x7f09e815b590 2023-10-25T16:24:42.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f09d8003600 con 0x7f09e815b590 2023-10-25T16:24:42.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e815c130 con 0x7f09e815b590 2023-10-25T16:24:42.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d80039d0 con 0x7f09e815b590 2023-10-25T16:24:42.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.190+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e8151720 con 0x7f09e815b590 2023-10-25T16:24:42.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.194+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e8151c40 con 0x7f09e815b590 2023-10-25T16:24:42.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.194+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f09d8003b30 con 0x7f09e815b590 2023-10-25T16:24:42.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.194+0000 7f09dffff640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09c8066470 0x7f09c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:42.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.194+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f09d8083540 con 0x7f09e815b590 2023-10-25T16:24:42.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.194+0000 7f09e6ffd640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09c8066470 0x7f09c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:42.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.194+0000 7f09e6ffd640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09c8066470 0x7f09c8068930 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f09e00af000 tx=0x7f09e001b4f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:42.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.198+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09e8151c40 con 0x7f09e815b590 2023-10-25T16:24:42.371 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:42.374+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f09e8151c40 con 0x7f09e815b590 2023-10-25T16:24:43.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.062+0000 7f09dffff640 1 -- 172.21.15.177:0/1670524065 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7f09e8151c40 con 0x7f09e815b590 2023-10-25T16:24:43.061 INFO:teuthology.orchestra.run.smithi177.stderr:new fs with metadata pool 22 and data pool 23 2023-10-25T16:24:43.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09c8066470 msgr2=0x7f09c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09c8066470 0x7f09c8068930 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f09e00af000 tx=0x7f09e001b4f0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 msgr2=0x7f09e815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e815a6b0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f09d800c400 tx=0x7f09d800c8c0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 shutdown_connections 2023-10-25T16:24:43.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09c8066470 0x7f09c8068930 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09e815b590 0x7f09e815a6b0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09e80d1b30 0x7f09e80bf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 --2- 172.21.15.177:0/1670524065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e80b2330 0x7f09e815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 >> 172.21.15.177:0/1670524065 conn(0x7f09e8065f40 msgr2=0x7f09e80af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:43.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 shutdown_connections 2023-10-25T16:24:43.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.066+0000 7f09ed982640 1 -- 172.21.15.177:0/1670524065 wait complete. 2023-10-25T16:24:43.089 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:43.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 -- 172.21.15.177:0/584663591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0ce220 msgr2=0x7f6acc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/584663591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0ce220 0x7f6acc0b4100 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009840 tx=0x7f6abc01c730 comp rx=0 tx=0).stop 2023-10-25T16:24:43.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 -- 172.21.15.177:0/584663591 shutdown_connections 2023-10-25T16:24:43.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/584663591 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0ce220 0x7f6acc0b4100 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 -- 172.21.15.177:0/584663591 >> 172.21.15.177:0/584663591 conn(0x7f6acc09a5c0 msgr2=0x7f6acc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:43.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 -- 172.21.15.177:0/584663591 shutdown_connections 2023-10-25T16:24:43.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 -- 172.21.15.177:0/584663591 wait complete. 2023-10-25T16:24:43.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.218+0000 7f6ad25b7640 1 Processor -- start 2023-10-25T16:24:43.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- start start 2023-10-25T16:24:43.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 0x7f6acc15c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6acc0ce220 0x7f6acc149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc15eba0 0x7f6acc1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc14c2f0 con 0x7f6acc0b2120 2023-10-25T16:24:43.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0b68d0 con 0x7f6acc15eba0 2023-10-25T16:24:43.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc14b720 con 0x7f6acc0ce220 2023-10-25T16:24:43.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 0x7f6acc15c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 0x7f6acc15c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37224/0 (socket says 172.21.15.177:37224) 2023-10-25T16:24:43.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 -- 172.21.15.177:0/1164042419 learned_addr learned my addr 172.21.15.177:0/1164042419 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:43.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad0b54640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc15eba0 0x7f6acc1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acb7fe640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6acc0ce220 0x7f6acc149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 -- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6acc0ce220 msgr2=0x7f6acc149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6acc0ce220 0x7f6acc149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 -- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc15eba0 msgr2=0x7f6acc1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc15eba0 0x7f6acc1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 -- 172.21.15.177:0/1164042419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0094a0 con 0x7f6acc0b2120 2023-10-25T16:24:43.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad0b54640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc15eba0 0x7f6acc1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:43.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acbfff640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 0x7f6acc15c300 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400ba50 tx=0x7f6ac400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:43.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400cbe0 con 0x7f6acc0b2120 2023-10-25T16:24:43.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc14b9c0 con 0x7f6acc0b2120 2023-10-25T16:24:43.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ac400ce70 con 0x7f6acc0b2120 2023-10-25T16:24:43.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4014680 con 0x7f6acc0b2120 2023-10-25T16:24:43.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc14bf80 con 0x7f6acc0b2120 2023-10-25T16:24:43.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc04daf0 con 0x7f6acc0b2120 2023-10-25T16:24:43.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ac40147e0 con 0x7f6acc0b2120 2023-10-25T16:24:43.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ac8ff9640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ab0066470 0x7f6ab0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ac4084030 con 0x7f6acc0b2120 2023-10-25T16:24:43.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.222+0000 7f6acb7fe640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ab0066470 0x7f6ab0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.226+0000 7f6acb7fe640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ab0066470 0x7f6ab0068930 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6acc15acb0 tx=0x7f6ab4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:43.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.226+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ac40514e0 con 0x7f6acc0b2120 2023-10-25T16:24:43.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.382+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6acc0ce930 con 0x7f6acc0b2120 2023-10-25T16:24:43.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.386+0000 7f6ac8ff9640 1 -- 172.21.15.177:0/1164042419 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f6ac4054b00 con 0x7f6acc0b2120 2023-10-25T16:24:43.385 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:43.385 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":189,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:42.378731+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:43.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ab0066470 msgr2=0x7f6ab0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ab0066470 0x7f6ab0068930 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f6acc15acb0 tx=0x7f6ab4009040 comp rx=0 tx=0).stop 2023-10-25T16:24:43.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 msgr2=0x7f6acc15c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 0x7f6acc15c300 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400ba50 tx=0x7f6ac400bf10 comp rx=0 tx=0).stop 2023-10-25T16:24:43.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 shutdown_connections 2023-10-25T16:24:43.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ab0066470 0x7f6ab0068930 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6acc15eba0 0x7f6acc1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6acc0ce220 0x7f6acc149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 --2- 172.21.15.177:0/1164042419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6acc0b2120 0x7f6acc15c300 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 >> 172.21.15.177:0/1164042419 conn(0x7f6acc09a5c0 msgr2=0x7f6acc153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:43.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 shutdown_connections 2023-10-25T16:24:43.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.390+0000 7f6ad25b7640 1 -- 172.21.15.177:0/1164042419 wait complete. 2023-10-25T16:24:43.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:43.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- 172.21.15.177:0/3419506498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc004d10 msgr2=0x7f57bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/3419506498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57bc004d10 0x7f57bc005190 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009e00 tx=0x7f57cc01d150 comp rx=0 tx=0).stop 2023-10-25T16:24:43.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d3fff640 1 -- 172.21.15.177:0/3419506498 reap_dead start 2023-10-25T16:24:43.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- 172.21.15.177:0/3419506498 shutdown_connections 2023-10-25T16:24:43.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- 172.21.15.177:0/3419506498 >> 172.21.15.177:0/3419506498 conn(0x7f57d40b2450 msgr2=0x7f57d40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:43.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- 172.21.15.177:0/3419506498 shutdown_connections 2023-10-25T16:24:43.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- 172.21.15.177:0/3419506498 wait complete. 2023-10-25T16:24:43.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 Processor -- start 2023-10-25T16:24:43.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- start start 2023-10-25T16:24:43.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d4153050 0x7f57d413c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 0x7f57d40ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d40ad6a0 0x7f57d4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40adb20 con 0x7f57d413c540 2023-10-25T16:24:43.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d413b3b0 con 0x7f57d40ad6a0 2023-10-25T16:24:43.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d9a7b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d413a500 con 0x7f57d4153050 2023-10-25T16:24:43.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 0x7f57d40ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 0x7f57d40ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37232/0 (socket says 172.21.15.177:37232) 2023-10-25T16:24:43.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.530+0000 7f57d2ffd640 1 -- 172.21.15.177:0/4085552802 learned_addr learned my addr 172.21.15.177:0/4085552802 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:43.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d37fe640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d4153050 0x7f57d413c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d3fff640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d40ad6a0 0x7f57d4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d2ffd640 1 -- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d4153050 msgr2=0x7f57d413c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d2ffd640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d4153050 0x7f57d413c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d2ffd640 1 -- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d40ad6a0 msgr2=0x7f57d4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d2ffd640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d40ad6a0 0x7f57d4156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d2ffd640 1 -- 172.21.15.177:0/4085552802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d413a7a0 con 0x7f57d413c540 2023-10-25T16:24:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d3fff640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d40ad6a0 0x7f57d4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d37fe640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d4153050 0x7f57d413c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:43.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d2ffd640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 0x7f57d40ad160 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f57c800e310 tx=0x7f57c800e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8012850 con 0x7f57d413c540 2023-10-25T16:24:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f57c8012aa0 con 0x7f57d413c540 2023-10-25T16:24:43.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d413aa80 con 0x7f57d413c540 2023-10-25T16:24:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c801a400 con 0x7f57d413c540 2023-10-25T16:24:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d413b040 con 0x7f57d413c540 2023-10-25T16:24:43.538 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d413b200 con 0x7f57d413c540 2023-10-25T16:24:43.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57c80113d0 con 0x7f57d413c540 2023-10-25T16:24:43.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57bbfff640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57c00664a0 0x7f57c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57c8087580 con 0x7f57d413c540 2023-10-25T16:24:43.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d37fe640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57c00664a0 0x7f57c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.534+0000 7f57d37fe640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57c00664a0 0x7f57c0068960 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f57d40cc4b0 tx=0x7f57c40094d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:43.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.538+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57c8054ab0 con 0x7f57d413c540 2023-10-25T16:24:43.693 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.694+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57d413b520 con 0x7f57d413c540 2023-10-25T16:24:43.696 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.698+0000 7f57bbfff640 1 -- 172.21.15.177:0/4085552802 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f57c801f090 con 0x7f57d413c540 2023-10-25T16:24:43.696 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:43.696 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":189,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:42.378731+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:43.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.698+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57c00664a0 msgr2=0x7f57c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.698+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57c00664a0 0x7f57c0068960 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f57d40cc4b0 tx=0x7f57c40094d0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.698+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 msgr2=0x7f57d40ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.698+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 0x7f57d40ad160 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f57c800e310 tx=0x7f57c800e7d0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 shutdown_connections 2023-10-25T16:24:43.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57c00664a0 0x7f57c0068960 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d40ad6a0 0x7f57d4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57d413c540 0x7f57d40ad160 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 --2- 172.21.15.177:0/4085552802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d4153050 0x7f57d413c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 >> 172.21.15.177:0/4085552802 conn(0x7f57d40b2450 msgr2=0x7f57d40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:43.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 shutdown_connections 2023-10-25T16:24:43.701 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.702+0000 7f57d9a7b640 1 -- 172.21.15.177:0/4085552802 wait complete. 2023-10-25T16:24:43.716 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T16:24:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/2545692891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 msgr2=0x7fd4640cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 --2- 172.21.15.177:0/2545692891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640cc0d0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fd454009860 tx=0x7fd45401c7b0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/2545692891 shutdown_connections 2023-10-25T16:24:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 --2- 172.21.15.177:0/2545692891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640cc0d0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 --2- 172.21.15.177:0/2545692891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd464159230 0x7fd464071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/2545692891 >> 172.21.15.177:0/2545692891 conn(0x7fd4640b2450 msgr2=0x7fd4640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/2545692891 shutdown_connections 2023-10-25T16:24:43.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/2545692891 wait complete. 2023-10-25T16:24:43.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 Processor -- start 2023-10-25T16:24:43.850 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- start start 2023-10-25T16:24:43.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4640cc610 0x7fd464148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd464159230 0x7fd4640af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.851 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414a7d0 con 0x7fd464070510 2023-10-25T16:24:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414d8f0 con 0x7fd464159230 2023-10-25T16:24:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414dbd0 con 0x7fd4640cc610 2023-10-25T16:24:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37256/0 (socket says 172.21.15.177:37256) 2023-10-25T16:24:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 -- 172.21.15.177:0/3243121318 learned_addr learned my addr 172.21.15.177:0/3243121318 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:43.852 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd45bfff640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4640cc610 0x7fd464148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 -- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4640cc610 msgr2=0x7fd464148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4640cc610 0x7fd464148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd469441640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd464159230 0x7fd4640af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.853 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 -- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd464159230 msgr2=0x7fd4640af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd464159230 0x7fd4640af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 -- 172.21.15.177:0/3243121318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454009440 con 0x7fd464070510 2023-10-25T16:24:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd468c40640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640adb70 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fd46000eaa0 tx=0x7fd46000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46000ce10 con 0x7fd464070510 2023-10-25T16:24:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd460011470 con 0x7fd464070510 2023-10-25T16:24:43.854 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46414deb0 con 0x7fd464070510 2023-10-25T16:24:43.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460011860 con 0x7fd464070510 2023-10-25T16:24:43.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.850+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46414e470 con 0x7fd464070510 2023-10-25T16:24:43.855 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.854+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46404daf0 con 0x7fd464070510 2023-10-25T16:24:43.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.854+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd4600119c0 con 0x7fd464070510 2023-10-25T16:24:43.856 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.854+0000 7fd4597fa640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd450066470 0x7fd450068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.854+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd460084ae0 con 0x7fd464070510 2023-10-25T16:24:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.854+0000 7fd45bfff640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd450066470 0x7fd450068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.854+0000 7fd45bfff640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd450066470 0x7fd450068930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd4540af000 tx=0x7fd45401aff0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:43.857 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:43.858+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd460051ff0 con 0x7fd464070510 2023-10-25T16:24:44.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.046+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd46415a0f0 con 0x7fd464070510 2023-10-25T16:24:44.089 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.090+0000 7fd4597fa640 1 -- 172.21.15.177:0/3243121318 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd46001f020 con 0x7fd464070510 2023-10-25T16:24:44.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd450066470 msgr2=0x7fd450068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:44.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd450066470 0x7fd450068930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd4540af000 tx=0x7fd45401aff0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 msgr2=0x7fd4640adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:44.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640adb70 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fd46000eaa0 tx=0x7fd46000ef60 comp rx=0 tx=0).stop 2023-10-25T16:24:44.092 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 shutdown_connections 2023-10-25T16:24:44.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd450066470 0x7fd450068930 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd464159230 0x7fd4640af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4640cc610 0x7fd464148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 --2- 172.21.15.177:0/3243121318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd464070510 0x7fd4640adb70 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.093 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 >> 172.21.15.177:0/3243121318 conn(0x7fd4640b2450 msgr2=0x7fd4640b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:44.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 shutdown_connections 2023-10-25T16:24:44.094 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.094+0000 7fd46aea4640 1 -- 172.21.15.177:0/3243121318 wait complete. 2023-10-25T16:24:44.108 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T16:24:44.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T16:24:44.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/1757133763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d84097a40 msgr2=0x7f0d84097ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:44.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/1757133763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d84097a40 0x7f0d84097ed0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f0d84070b00 tx=0x7f0d7801c5e0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/1757133763 shutdown_connections 2023-10-25T16:24:44.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/1757133763 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d84098410 0x7f0d8415f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/1757133763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d84097a40 0x7f0d84097ed0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/1757133763 >> v2:172.21.15.184:3300/0 conn(0x7f0d840af630 0x7f0d840afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/1757133763 >> 172.21.15.177:0/1757133763 conn(0x7f0d840b0ae0 msgr2=0x7f0d840b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:44.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/1757133763 shutdown_connections 2023-10-25T16:24:44.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/1757133763 wait complete. 2023-10-25T16:24:44.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 Processor -- start 2023-10-25T16:24:44.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.238+0000 7f0d8b1b1640 1 -- start start 2023-10-25T16:24:44.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d84097a40 0x7f0d84155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:44.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d84098410 0x7f0d840c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:44.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 0x7f0d8415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:44.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d841f5500 con 0x7f0d840af630 2023-10-25T16:24:44.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84159780 con 0x7f0d84097a40 2023-10-25T16:24:44.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84159d40 con 0x7f0d84098410 2023-10-25T16:24:44.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 0x7f0d8415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:44.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 0x7f0d8415b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37270/0 (socket says 172.21.15.177:37270) 2023-10-25T16:24:44.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 -- 172.21.15.177:0/3334852375 learned_addr learned my addr 172.21.15.177:0/3334852375 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:44.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d88f4d640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d84097a40 0x7f0d84155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:44.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d83fff640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d84098410 0x7f0d840c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:44.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 -- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d84098410 msgr2=0x7f0d840c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:44.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d84098410 0x7f0d840c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 -- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d84097a40 msgr2=0x7f0d84155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:44.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d84097a40 0x7f0d84155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:44.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 -- 172.21.15.177:0/3334852375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78009560 con 0x7f0d840af630 2023-10-25T16:24:44.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8974e640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 0x7f0d8415b690 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00ca90 tx=0x7f0d7c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:44.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00ae20 con 0x7f0d840af630 2023-10-25T16:24:44.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d7c004c20 con 0x7f0d840af630 2023-10-25T16:24:44.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c005020 con 0x7f0d840af630 2023-10-25T16:24:44.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84155780 con 0x7f0d840af630 2023-10-25T16:24:44.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d841f5a30 con 0x7f0d840af630 2023-10-25T16:24:44.245 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d841f5c20 con 0x7f0d840af630 2023-10-25T16:24:44.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d7c005180 con 0x7f0d840af630 2023-10-25T16:24:44.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d817fa640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0d70066470 0x7f0d70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:44.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d7c084690 con 0x7f0d840af630 2023-10-25T16:24:44.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.242+0000 7f0d88f4d640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0d70066470 0x7f0d70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:44.247 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.246+0000 7f0d88f4d640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0d70066470 0x7f0d70068930 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0d74005fd0 tx=0x7f0d7400c460 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:44.248 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.246+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d7c051b10 con 0x7f0d840af630 2023-10-25T16:24:44.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:44.438+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0d84159eb0 con 0x7f0d840af630 2023-10-25T16:24:45.017 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-10-25T16:24:45.015+0000 7f88ca06d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:24:45.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.106+0000 7f0d817fa640 1 -- 172.21.15.177:0/3334852375 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d7c01d0c0 con 0x7f0d840af630 2023-10-25T16:24:45.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0d70066470 msgr2=0x7f0d70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0d70066470 0x7f0d70068930 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0d74005fd0 tx=0x7f0d7400c460 comp rx=0 tx=0).stop 2023-10-25T16:24:45.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 msgr2=0x7f0d8415b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 0x7f0d8415b690 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00ca90 tx=0x7f0d7c00cf50 comp rx=0 tx=0).stop 2023-10-25T16:24:45.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 shutdown_connections 2023-10-25T16:24:45.109 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0d70066470 0x7f0d70068930 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840af630 0x7f0d8415b690 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d84098410 0x7f0d840c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 --2- 172.21.15.177:0/3334852375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d84097a40 0x7f0d84155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 >> 172.21.15.177:0/3334852375 conn(0x7f0d840b0ae0 msgr2=0x7f0d8415e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:45.110 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 shutdown_connections 2023-10-25T16:24:45.111 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.110+0000 7f0d8b1b1640 1 -- 172.21.15.177:0/3334852375 wait complete. 2023-10-25T16:24:45.127 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T16:24:45.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:45.252 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 -- 172.21.15.177:0/2529732272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76c003980 msgr2=0x7fe76c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 --2- 172.21.15.177:0/2529732272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe76c003980 0x7fe76c003da0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fe770005fd0 tx=0x7fe77001cd80 comp rx=0 tx=0).stop 2023-10-25T16:24:45.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe77f7fe640 1 -- 172.21.15.177:0/2529732272 reap_dead start 2023-10-25T16:24:45.253 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 -- 172.21.15.177:0/2529732272 shutdown_connections 2023-10-25T16:24:45.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 -- 172.21.15.177:0/2529732272 >> 172.21.15.177:0/2529732272 conn(0x7fe78009a5c0 msgr2=0x7fe7800d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:45.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 -- 172.21.15.177:0/2529732272 shutdown_connections 2023-10-25T16:24:45.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 -- 172.21.15.177:0/2529732272 wait complete. 2023-10-25T16:24:45.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 Processor -- start 2023-10-25T16:24:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.254+0000 7fe785508640 1 -- start start 2023-10-25T16:24:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78015c610 0x7fe78014ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78015c9f0 0x7fe78014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 0x7fe780147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.257 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801587f0 con 0x7fe7801477f0 2023-10-25T16:24:45.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78014fb10 con 0x7fe78015c610 2023-10-25T16:24:45.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801481b0 con 0x7fe78015c9f0 2023-10-25T16:24:45.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 0x7fe780147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 0x7fe780147c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37286/0 (socket says 172.21.15.177:37286) 2023-10-25T16:24:45.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 -- 172.21.15.177:0/2019757314 learned_addr learned my addr 172.21.15.177:0/2019757314 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:45.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe7767fc640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78015c9f0 0x7fe78014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77effd640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78015c610 0x7fe78014ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 -- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78015c9f0 msgr2=0x7fe78014ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78015c9f0 0x7fe78014ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 -- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78015c610 msgr2=0x7fe78014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78015c610 0x7fe78014ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 -- 172.21.15.177:0/2019757314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78014f550 con 0x7fe7801477f0 2023-10-25T16:24:45.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77effd640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78015c610 0x7fe78014ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:45.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77f7fe640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 0x7fe780147c70 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fe78006a0b0 tx=0x7fe77800dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:45.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77800ba10 con 0x7fe7801477f0 2023-10-25T16:24:45.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe77800bc60 con 0x7fe7801477f0 2023-10-25T16:24:45.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78014f830 con 0x7fe7801477f0 2023-10-25T16:24:45.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778010460 con 0x7fe7801477f0 2023-10-25T16:24:45.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78014e1c0 con 0x7fe7801477f0 2023-10-25T16:24:45.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe780158930 con 0x7fe7801477f0 2023-10-25T16:24:45.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7780105e0 con 0x7fe7801477f0 2023-10-25T16:24:45.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe777fff640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe760066470 0x7fe760068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe778083870 con 0x7fe7801477f0 2023-10-25T16:24:45.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.258+0000 7fe77effd640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe760066470 0x7fe760068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.262+0000 7fe77effd640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe760066470 0x7fe760068930 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe7700b0000 tx=0x7fe7700a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:45.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.262+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe780158930 con 0x7fe7801477f0 2023-10-25T16:24:45.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.434+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe780158930 con 0x7fe7801477f0 2023-10-25T16:24:45.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.434+0000 7fe777fff640 1 -- 172.21.15.177:0/2019757314 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fe780158930 con 0x7fe7801477f0 2023-10-25T16:24:45.434 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:45.434 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:24:45.434 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:24:45.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe760066470 msgr2=0x7fe760068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe760066470 0x7fe760068930 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe7700b0000 tx=0x7fe7700a7040 comp rx=0 tx=0).stop 2023-10-25T16:24:45.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 msgr2=0x7fe780147c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 0x7fe780147c70 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7fe78006a0b0 tx=0x7fe77800dc50 comp rx=0 tx=0).stop 2023-10-25T16:24:45.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 shutdown_connections 2023-10-25T16:24:45.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe760066470 0x7fe760068930 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7801477f0 0x7fe780147c70 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe78015c9f0 0x7fe78014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 --2- 172.21.15.177:0/2019757314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe78015c610 0x7fe78014ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 >> 172.21.15.177:0/2019757314 conn(0x7fe78009a5c0 msgr2=0x7fe78015dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:45.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 shutdown_connections 2023-10-25T16:24:45.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.438+0000 7fe785508640 1 -- 172.21.15.177:0/2019757314 wait complete. 2023-10-25T16:24:45.451 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:24:45.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 -- 172.21.15.177:0/2667224461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3640cdb10 msgr2=0x7fa3640cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 --2- 172.21.15.177:0/2667224461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3640cdb10 0x7fa3640cdf80 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7fa36409f200 tx=0x7fa35c01cc90 comp rx=0 tx=0).stop 2023-10-25T16:24:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 -- 172.21.15.177:0/2667224461 shutdown_connections 2023-10-25T16:24:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 --2- 172.21.15.177:0/2667224461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3640cdb10 0x7fa3640cdf80 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 --2- 172.21.15.177:0/2667224461 >> v2:172.21.15.184:3300/0 conn(0x7fa3640b2120 0x7fa3640b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 -- 172.21.15.177:0/2667224461 >> 172.21.15.177:0/2667224461 conn(0x7fa36409a5c0 msgr2=0x7fa3640d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 -- 172.21.15.177:0/2667224461 shutdown_connections 2023-10-25T16:24:45.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.562+0000 7fa368d9a640 1 -- 172.21.15.177:0/2667224461 wait complete. 2023-10-25T16:24:45.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 Processor -- start 2023-10-25T16:24:45.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- start start 2023-10-25T16:24:45.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3640b2120 0x7fa364155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3640cdb10 0x7fa364154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 0x7fa36413f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640c78e0 con 0x7fa36415eba0 2023-10-25T16:24:45.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3640c6a30 con 0x7fa3640cdb10 2023-10-25T16:24:45.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa364155550 con 0x7fa3640b2120 2023-10-25T16:24:45.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 0x7fa36413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 0x7fa36413f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37302/0 (socket says 172.21.15.177:37302) 2023-10-25T16:24:45.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 -- 172.21.15.177:0/1474777746 learned_addr learned my addr 172.21.15.177:0/1474777746 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:45.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa36259c640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3640b2120 0x7fa364155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa361d9b640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3640cdb10 0x7fa364154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 -- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3640b2120 msgr2=0x7fa364155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3640b2120 0x7fa364155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 -- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3640cdb10 msgr2=0x7fa364154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3640cdb10 0x7fa364154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 -- 172.21.15.177:0/1474777746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0098e0 con 0x7fa36415eba0 2023-10-25T16:24:45.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa361d9b640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3640cdb10 0x7fa364154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:45.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa362d9d640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 0x7fa36413f320 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fa35c01a8c0 tx=0x7fa35c0a5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:45.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0bc070 con 0x7fa36415eba0 2023-10-25T16:24:45.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa35c004250 con 0x7fa36415eba0 2023-10-25T16:24:45.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa364154dc0 con 0x7fa36415eba0 2023-10-25T16:24:45.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c004640 con 0x7fa36415eba0 2023-10-25T16:24:45.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3640c6f40 con 0x7fa36415eba0 2023-10-25T16:24:45.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.566+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3640c7a20 con 0x7fa36415eba0 2023-10-25T16:24:45.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.570+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa35c0b4040 con 0x7fa36415eba0 2023-10-25T16:24:45.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.570+0000 7fa352ffd640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa344066470 0x7fa344068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.570+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa35c11ea40 con 0x7fa36415eba0 2023-10-25T16:24:45.574 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.570+0000 7fa36259c640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa344066470 0x7fa344068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.570+0000 7fa36259c640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa344066470 0x7fa344068930 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa35400b810 tx=0x7fa354008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:45.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.574+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3640c7a20 con 0x7fa36415eba0 2023-10-25T16:24:45.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.730+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3640c7a20 con 0x7fa36415eba0 2023-10-25T16:24:45.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.730+0000 7fa352ffd640 1 -- 172.21.15.177:0/1474777746 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16596 (secure 0 0 0) 0x7fa3640c7a20 con 0x7fa36415eba0 2023-10-25T16:24:45.729 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:45.730 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":190,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:24:43.822354+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:24:45.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa344066470 msgr2=0x7fa344068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa344066470 0x7fa344068930 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa35400b810 tx=0x7fa354008040 comp rx=0 tx=0).stop 2023-10-25T16:24:45.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 msgr2=0x7fa36413f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 0x7fa36413f320 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7fa35c01a8c0 tx=0x7fa35c0a5b40 comp rx=0 tx=0).stop 2023-10-25T16:24:45.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 shutdown_connections 2023-10-25T16:24:45.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa344066470 0x7fa344068930 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa36415eba0 0x7fa36413f320 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3640cdb10 0x7fa364154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 --2- 172.21.15.177:0/1474777746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3640b2120 0x7fa364155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 >> 172.21.15.177:0/1474777746 conn(0x7fa36409a5c0 msgr2=0x7fa36415c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:45.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 shutdown_connections 2023-10-25T16:24:45.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.734+0000 7fa368d9a640 1 -- 172.21.15.177:0/1474777746 wait complete. 2023-10-25T16:24:45.749 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T16:24:45.749 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:24:45.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 -- 172.21.15.177:0/1981125898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc00af2d0 msgr2=0x7f1bc0158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 --2- 172.21.15.177:0/1981125898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc00af2d0 0x7f1bc0158170 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009c80 tx=0x7f1bb801cd80 comp rx=0 tx=0).stop 2023-10-25T16:24:45.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 -- 172.21.15.177:0/1981125898 shutdown_connections 2023-10-25T16:24:45.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 --2- 172.21.15.177:0/1981125898 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc00af2d0 0x7f1bc0158170 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 --2- 172.21.15.177:0/1981125898 >> v2:172.21.15.184:3300/0 conn(0x7f1bc014e810 0x7f1bc00cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 -- 172.21.15.177:0/1981125898 >> 172.21.15.177:0/1981125898 conn(0x7f1bc00b2450 msgr2=0x7f1bc00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:45.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 -- 172.21.15.177:0/1981125898 shutdown_connections 2023-10-25T16:24:45.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 -- 172.21.15.177:0/1981125898 wait complete. 2023-10-25T16:24:45.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 Processor -- start 2023-10-25T16:24:45.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.870+0000 7f1bc71af640 1 -- start start 2023-10-25T16:24:45.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc00af2d0 0x7f1bc0150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 0x7f1bc013f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc015bdb0 0x7f1bc00ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00ae9f0 con 0x7f1bc014e810 2023-10-25T16:24:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc013f9b0 con 0x7f1bc00af2d0 2023-10-25T16:24:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00adde0 con 0x7f1bc015bdb0 2023-10-25T16:24:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 0x7f1bc013f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 0x7f1bc013f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37316/0 (socket says 172.21.15.177:37316) 2023-10-25T16:24:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 -- 172.21.15.177:0/2824994497 learned_addr learned my addr 172.21.15.177:0/2824994497 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc574c640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc015bdb0 0x7f1bc00ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc4f4b640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc00af2d0 0x7f1bc0150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 -- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc015bdb0 msgr2=0x7f1bc00ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc015bdb0 0x7f1bc00ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 -- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc00af2d0 msgr2=0x7f1bc0150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:45.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc00af2d0 0x7f1bc0150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:45.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 -- 172.21.15.177:0/2824994497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80098e0 con 0x7f1bc014e810 2023-10-25T16:24:45.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc574c640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc015bdb0 0x7f1bc00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:45.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbffff640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 0x7f1bc013f470 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00c390 tx=0x7f1bac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:45.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0052d0 con 0x7f1bc014e810 2023-10-25T16:24:45.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1bac003600 con 0x7f1bc014e810 2023-10-25T16:24:45.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc00ae0c0 con 0x7f1bc014e810 2023-10-25T16:24:45.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0039f0 con 0x7f1bc014e810 2023-10-25T16:24:45.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc00ae680 con 0x7f1bc014e810 2023-10-25T16:24:45.877 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc004daf0 con 0x7f1bc014e810 2023-10-25T16:24:45.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1bac003b50 con 0x7f1bc014e810 2023-10-25T16:24:45.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbd7fa640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ba4066470 0x7f1ba4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:45.878 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bac083740 con 0x7f1bc014e810 2023-10-25T16:24:45.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.874+0000 7f1bc4f4b640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ba4066470 0x7f1ba4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:45.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.878+0000 7f1bc4f4b640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ba4066470 0x7f1ba4068930 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400ab20 tx=0x7f1bb400a2f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:45.879 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:45.878+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1bac050b20 con 0x7f1bc014e810 2023-10-25T16:24:46.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.026+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bc014c9c0 con 0x7f1ba4066470 2023-10-25T16:24:46.044 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.046+0000 7f1bbd7fa640 1 -- 172.21.15.177:0/2824994497 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275232 (secure 0 0 0) 0x7f1bc014c9c0 con 0x7f1ba4066470 2023-10-25T16:24:46.047 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:46.049 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:24:46.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ba4066470 msgr2=0x7f1ba4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ba4066470 0x7f1ba4068930 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400ab20 tx=0x7f1bb400a2f0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 msgr2=0x7f1bc013f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 0x7f1bc013f470 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00c390 tx=0x7f1bac00c850 comp rx=0 tx=0).stop 2023-10-25T16:24:46.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 shutdown_connections 2023-10-25T16:24:46.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1ba4066470 0x7f1ba4068930 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1bc015bdb0 0x7f1bc00ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc014e810 0x7f1bc013f470 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.051 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 --2- 172.21.15.177:0/2824994497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc00af2d0 0x7f1bc0150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 >> 172.21.15.177:0/2824994497 conn(0x7f1bc00b2450 msgr2=0x7f1bc00b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:46.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 shutdown_connections 2023-10-25T16:24:46.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.050+0000 7f1bc71af640 1 -- 172.21.15.177:0/2824994497 wait complete. 2023-10-25T16:24:46.064 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2023-10-25T16:24:44.853749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553122,"statfs":{"total":1600000000,"available":1590397296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001249"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370995+0000","last_change":"2023-10-25T16:24:42.848819+0000","last_active":"2023-10-25T16:24:44.370995+0000","last_peered":"2023-10-25T16:24:44.370995+0000","last_clean":"2023-10-25T16:24:44.370995+0000","last_became_active":"2023-10-25T16:24:42.847037+0000","last_became_peered":"2023-10-25T16:24:42.847037+0000","last_unstale":"2023-10-25T16:24:44.370995+0000","last_undegraded":"2023-10-25T16:24:44.370995+0000","last_fullsized":"2023-10-25T16:24:44.370995+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370667+0000","last_change":"2023-10-25T16:24:42.844979+0000","last_active":"2023-10-25T16:24:44.370667+0000","last_peered":"2023-10-25T16:24:44.370667+0000","last_clean":"2023-10-25T16:24:44.370667+0000","last_became_active":"2023-10-25T16:24:42.843262+0000","last_became_peered":"2023-10-25T16:24:42.843262+0000","last_unstale":"2023-10-25T16:24:44.370667+0000","last_undegraded":"2023-10-25T16:24:44.370667+0000","last_fullsized":"2023-10-25T16:24:44.370667+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839092+0000","last_change":"2023-10-25T16:24:42.850227+0000","last_active":"2023-10-25T16:24:43.839092+0000","last_peered":"2023-10-25T16:24:43.839092+0000","last_clean":"2023-10-25T16:24:43.839092+0000","last_became_active":"2023-10-25T16:24:42.849610+0000","last_became_peered":"2023-10-25T16:24:42.849610+0000","last_unstale":"2023-10-25T16:24:43.839092+0000","last_undegraded":"2023-10-25T16:24:43.839092+0000","last_fullsized":"2023-10-25T16:24:43.839092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370513+0000","last_change":"2023-10-25T16:24:42.861119+0000","last_active":"2023-10-25T16:24:44.370513+0000","last_peered":"2023-10-25T16:24:44.370513+0000","last_clean":"2023-10-25T16:24:44.370513+0000","last_became_active":"2023-10-25T16:24:42.858569+0000","last_became_peered":"2023-10-25T16:24:42.858569+0000","last_unstale":"2023-10-25T16:24:44.370513+0000","last_undegraded":"2023-10-25T16:24:44.370513+0000","last_fullsized":"2023-10-25T16:24:44.370513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:46:47.363848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838846+0000","last_change":"2023-10-25T16:24:42.847781+0000","last_active":"2023-10-25T16:24:43.838846+0000","last_peered":"2023-10-25T16:24:43.838846+0000","last_clean":"2023-10-25T16:24:43.838846+0000","last_became_active":"2023-10-25T16:24:42.846775+0000","last_became_peered":"2023-10-25T16:24:42.846775+0000","last_unstale":"2023-10-25T16:24:43.838846+0000","last_undegraded":"2023-10-25T16:24:43.838846+0000","last_fullsized":"2023-10-25T16:24:43.838846+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370169+0000","last_change":"2023-10-25T16:24:42.860236+0000","last_active":"2023-10-25T16:24:44.370169+0000","last_peered":"2023-10-25T16:24:44.370169+0000","last_clean":"2023-10-25T16:24:44.370169+0000","last_became_active":"2023-10-25T16:24:42.859552+0000","last_became_peered":"2023-10-25T16:24:42.859552+0000","last_unstale":"2023-10-25T16:24:44.370169+0000","last_undegraded":"2023-10-25T16:24:44.370169+0000","last_fullsized":"2023-10-25T16:24:44.370169+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:32.387989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370308+0000","last_change":"2023-10-25T16:24:42.845248+0000","last_active":"2023-10-25T16:24:44.370308+0000","last_peered":"2023-10-25T16:24:44.370308+0000","last_clean":"2023-10-25T16:24:44.370308+0000","last_became_active":"2023-10-25T16:24:42.844563+0000","last_became_peered":"2023-10-25T16:24:42.844563+0000","last_unstale":"2023-10-25T16:24:44.370308+0000","last_undegraded":"2023-10-25T16:24:44.370308+0000","last_fullsized":"2023-10-25T16:24:44.370308+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:41.791943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370749+0000","last_change":"2023-10-25T16:24:42.051870+0000","last_active":"2023-10-25T16:24:44.370749+0000","last_peered":"2023-10-25T16:24:44.370749+0000","last_clean":"2023-10-25T16:24:44.370749+0000","last_became_active":"2023-10-25T16:24:42.051571+0000","last_became_peered":"2023-10-25T16:24:42.051571+0000","last_unstale":"2023-10-25T16:24:44.370749+0000","last_undegraded":"2023-10-25T16:24:44.370749+0000","last_fullsized":"2023-10-25T16:24:44.370749+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:08.033543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839183+0000","last_change":"2023-10-25T16:24:42.856078+0000","last_active":"2023-10-25T16:24:43.839183+0000","last_peered":"2023-10-25T16:24:43.839183+0000","last_clean":"2023-10-25T16:24:43.839183+0000","last_became_active":"2023-10-25T16:24:42.855407+0000","last_became_peered":"2023-10-25T16:24:42.855407+0000","last_unstale":"2023-10-25T16:24:43.839183+0000","last_undegraded":"2023-10-25T16:24:43.839183+0000","last_fullsized":"2023-10-25T16:24:43.839183+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2023-10-25T16:24:41.041105+0000","last_change":"2023-10-25T16:24:41.041105+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.041105+0000","last_undegraded":"2023-10-25T16:24:41.041105+0000","last_fullsized":"2023-10-25T16:24:41.041105+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840160+0000","last_change":"2023-10-25T16:24:42.861748+0000","last_active":"2023-10-25T16:24:43.840160+0000","last_peered":"2023-10-25T16:24:43.840160+0000","last_clean":"2023-10-25T16:24:43.840160+0000","last_became_active":"2023-10-25T16:24:42.861078+0000","last_became_peered":"2023-10-25T16:24:42.861078+0000","last_unstale":"2023-10-25T16:24:43.840160+0000","last_undegraded":"2023-10-25T16:24:43.840160+0000","last_fullsized":"2023-10-25T16:24:43.840160+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:11.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2023-10-25T16:24:41.040651+0000","last_change":"2023-10-25T16:24:41.040651+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.040651+0000","last_undegraded":"2023-10-25T16:24:41.040651+0000","last_fullsized":"2023-10-25T16:24:41.040651+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839398+0000","last_change":"2023-10-25T16:24:42.846556+0000","last_active":"2023-10-25T16:24:43.839398+0000","last_peered":"2023-10-25T16:24:43.839398+0000","last_clean":"2023-10-25T16:24:43.839398+0000","last_became_active":"2023-10-25T16:24:42.845900+0000","last_became_peered":"2023-10-25T16:24:42.845900+0000","last_unstale":"2023-10-25T16:24:43.839398+0000","last_undegraded":"2023-10-25T16:24:43.839398+0000","last_fullsized":"2023-10-25T16:24:43.839398+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:38:24.488319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370539+0000","last_change":"2023-10-25T16:24:42.858156+0000","last_active":"2023-10-25T16:24:44.370539+0000","last_peered":"2023-10-25T16:24:44.370539+0000","last_clean":"2023-10-25T16:24:44.370539+0000","last_became_active":"2023-10-25T16:24:42.857459+0000","last_became_peered":"2023-10-25T16:24:42.857459+0000","last_unstale":"2023-10-25T16:24:44.370539+0000","last_undegraded":"2023-10-25T16:24:44.370539+0000","last_fullsized":"2023-10-25T16:24:44.370539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839510+0000","last_change":"2023-10-25T16:24:42.049822+0000","last_active":"2023-10-25T16:24:43.839510+0000","last_peered":"2023-10-25T16:24:43.839510+0000","last_clean":"2023-10-25T16:24:43.839510+0000","last_became_active":"2023-10-25T16:24:42.049364+0000","last_became_peered":"2023-10-25T16:24:42.049364+0000","last_unstale":"2023-10-25T16:24:43.839510+0000","last_undegraded":"2023-10-25T16:24:43.839510+0000","last_fullsized":"2023-10-25T16:24:43.839510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:17.596897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839189+0000","last_change":"2023-10-25T16:24:42.848132+0000","last_active":"2023-10-25T16:24:43.839189+0000","last_peered":"2023-10-25T16:24:43.839189+0000","last_clean":"2023-10-25T16:24:43.839189+0000","last_became_active":"2023-10-25T16:24:42.847148+0000","last_became_peered":"2023-10-25T16:24:42.847148+0000","last_unstale":"2023-10-25T16:24:43.839189+0000","last_undegraded":"2023-10-25T16:24:43.839189+0000","last_fullsized":"2023-10-25T16:24:43.839189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370800+0000","last_change":"2023-10-25T16:24:42.845326+0000","last_active":"2023-10-25T16:24:44.370800+0000","last_peered":"2023-10-25T16:24:44.370800+0000","last_clean":"2023-10-25T16:24:44.370800+0000","last_became_active":"2023-10-25T16:24:42.844302+0000","last_became_peered":"2023-10-25T16:24:42.844302+0000","last_unstale":"2023-10-25T16:24:44.370800+0000","last_undegraded":"2023-10-25T16:24:44.370800+0000","last_fullsized":"2023-10-25T16:24:44.370800+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370652+0000","last_change":"2023-10-25T16:24:42.841894+0000","last_active":"2023-10-25T16:24:44.370652+0000","last_peered":"2023-10-25T16:24:44.370652+0000","last_clean":"2023-10-25T16:24:44.370652+0000","last_became_active":"2023-10-25T16:24:42.841237+0000","last_became_peered":"2023-10-25T16:24:42.841237+0000","last_unstale":"2023-10-25T16:24:44.370652+0000","last_undegraded":"2023-10-25T16:24:44.370652+0000","last_fullsized":"2023-10-25T16:24:44.370652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839216+0000","last_change":"2023-10-25T16:24:42.855950+0000","last_active":"2023-10-25T16:24:43.839216+0000","last_peered":"2023-10-25T16:24:43.839216+0000","last_clean":"2023-10-25T16:24:43.839216+0000","last_became_active":"2023-10-25T16:24:42.855233+0000","last_became_peered":"2023-10-25T16:24:42.855233+0000","last_unstale":"2023-10-25T16:24:43.839216+0000","last_undegraded":"2023-10-25T16:24:43.839216+0000","last_fullsized":"2023-10-25T16:24:43.839216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:21.737177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839252+0000","last_change":"2023-10-25T16:24:42.069203+0000","last_active":"2023-10-25T16:24:43.839252+0000","last_peered":"2023-10-25T16:24:43.839252+0000","last_clean":"2023-10-25T16:24:43.839252+0000","last_became_active":"2023-10-25T16:24:42.068980+0000","last_became_peered":"2023-10-25T16:24:42.068980+0000","last_unstale":"2023-10-25T16:24:43.839252+0000","last_undegraded":"2023-10-25T16:24:43.839252+0000","last_fullsized":"2023-10-25T16:24:43.839252+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:57.057165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.371156+0000","last_change":"2023-10-25T16:24:42.863388+0000","last_active":"2023-10-25T16:24:44.371156+0000","last_peered":"2023-10-25T16:24:44.371156+0000","last_clean":"2023-10-25T16:24:44.371156+0000","last_became_active":"2023-10-25T16:24:42.862655+0000","last_became_peered":"2023-10-25T16:24:42.862655+0000","last_unstale":"2023-10-25T16:24:44.371156+0000","last_undegraded":"2023-10-25T16:24:44.371156+0000","last_fullsized":"2023-10-25T16:24:44.371156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839515+0000","last_change":"2023-10-25T16:24:42.838980+0000","last_active":"2023-10-25T16:24:43.839515+0000","last_peered":"2023-10-25T16:24:43.839515+0000","last_clean":"2023-10-25T16:24:43.839515+0000","last_became_active":"2023-10-25T16:24:42.838385+0000","last_became_peered":"2023-10-25T16:24:42.838385+0000","last_unstale":"2023-10-25T16:24:43.839515+0000","last_undegraded":"2023-10-25T16:24:43.839515+0000","last_fullsized":"2023-10-25T16:24:43.839515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:02:09.469182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839401+0000","last_change":"2023-10-25T16:24:42.058131+0000","last_active":"2023-10-25T16:24:43.839401+0000","last_peered":"2023-10-25T16:24:43.839401+0000","last_clean":"2023-10-25T16:24:43.839401+0000","last_became_active":"2023-10-25T16:24:42.057693+0000","last_became_peered":"2023-10-25T16:24:42.057693+0000","last_unstale":"2023-10-25T16:24:43.839401+0000","last_undegraded":"2023-10-25T16:24:43.839401+0000","last_fullsized":"2023-10-25T16:24:43.839401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:09.180705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839110+0000","last_change":"2023-10-25T16:24:42.847394+0000","last_active":"2023-10-25T16:24:43.839110+0000","last_peered":"2023-10-25T16:24:43.839110+0000","last_clean":"2023-10-25T16:24:43.839110+0000","last_became_active":"2023-10-25T16:24:42.845964+0000","last_became_peered":"2023-10-25T16:24:42.845964+0000","last_unstale":"2023-10-25T16:24:43.839110+0000","last_undegraded":"2023-10-25T16:24:43.839110+0000","last_fullsized":"2023-10-25T16:24:43.839110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370488+0000","last_change":"2023-10-25T16:24:42.842647+0000","last_active":"2023-10-25T16:24:44.370488+0000","last_peered":"2023-10-25T16:24:44.370488+0000","last_clean":"2023-10-25T16:24:44.370488+0000","last_became_active":"2023-10-25T16:24:42.841926+0000","last_became_peered":"2023-10-25T16:24:42.841926+0000","last_unstale":"2023-10-25T16:24:44.370488+0000","last_undegraded":"2023-10-25T16:24:44.370488+0000","last_fullsized":"2023-10-25T16:24:44.370488+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:36.093839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838989+0000","last_change":"2023-10-25T16:24:42.856140+0000","last_active":"2023-10-25T16:24:43.838989+0000","last_peered":"2023-10-25T16:24:43.838989+0000","last_clean":"2023-10-25T16:24:43.838989+0000","last_became_active":"2023-10-25T16:24:42.855277+0000","last_became_peered":"2023-10-25T16:24:42.855277+0000","last_unstale":"2023-10-25T16:24:43.838989+0000","last_undegraded":"2023-10-25T16:24:43.838989+0000","last_fullsized":"2023-10-25T16:24:43.838989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":322,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-25T16:24:39.009197+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:24:39.009197+0000","last_peered":"2023-10-25T16:24:39.009197+0000","last_clean":"2023-10-25T16:24:39.009197+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:24:39.009197+0000","last_undegraded":"2023-10-25T16:24:39.009197+0000","last_fullsized":"2023-10-25T16:24:39.009197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":12,"acting":12,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542288,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1031,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.80700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.621},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":1.0209999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":1.105},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":1.155}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":1.131},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":1.0009999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193710,"statfs":{"total":200000000,"available":198359456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.1839999999999999,"5min":1.24,"15min":1.256},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.087,"5min":1.3420000000000001,"15min":1.534},"last":0.99199999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.155,"5min":1.4259999999999999,"15min":1.647},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91200000000000003,"15min":0.86799999999999999},"min":{"1min":0.77100000000000002,"5min":0.54100000000000004,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1599999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.73999999999999999,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":1.51},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":1.0940000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1279999999999999,"5min":1.478,"15min":1.4910000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.72699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.337,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":1.177}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.337,"5min":1.696,"15min":1.7370000000000001},"last":1.151},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.66000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.234,"5min":1.681,"15min":1.681},"last":1.2}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.105,"15min":1.123},"min":{"1min":0.86699999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.2849999999999999,"5min":1.643,"15min":1.669},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":1.0629999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.321,"5min":1.591,"15min":1.7490000000000001},"last":1.371}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1005,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198970208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88300000000000001,"15min":0.876},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.028,"15min":0.93700000000000006},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.298,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1859999999999999,"5min":10.667,"15min":10.667},"last":0.748},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.042,"15min":0.95399999999999996},"min":{"1min":0.66000000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3180000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.92600000000000005},"min":{"1min":0.69999999999999996,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.22,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.079,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":10.948,"15min":10.948},"last":1.1339999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.2709999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.071},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1359999999999999,"15min":1.077},"min":{"1min":0.747,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.4299999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.046,"15min":0.98099999999999998},"min":{"1min":0.63500000000000001,"5min":0.48699999999999999,"15min":0.41499999999999998},"max":{"1min":1.494,"5min":11.081,"15min":11.081},"last":1.296},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.96099999999999997},"min":{"1min":0.67100000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2130000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.54600000000000004,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.1040000000000001,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.371,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.579}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.244,"15min":1.143},"min":{"1min":0.86199999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.5629999999999999,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.522},{"interface":"front","average":{"1min":1.089,"5min":1.151,"15min":1.0920000000000001},"min":{"1min":0.80400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.375,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.3720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91400000000000003,"15min":1.0900000000000001},"min":{"1min":0.624,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2929999999999999,"5min":2.1429999999999998,"15min":14.843},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.097,"5min":2.8450000000000002,"15min":16.439},"last":0.76200000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90400000000000003,"15min":1.127},"min":{"1min":0.67000000000000004,"5min":0.54000000000000004,"15min":0.40100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96199999999999997,"15min":0.91100000000000003},"min":{"1min":0.86199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.282,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0629999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.69899999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.3200000000000001,"5min":1.601,"15min":3.9529999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":0.96899999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.244,"5min":1.921,"15min":1.921},"last":0.90500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.379,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.143},{"interface":"front","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.3069999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.028,"15min":1.2709999999999999},"min":{"1min":0.66700000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2410000000000001,"5min":1.9910000000000001,"15min":15.904},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":1.236},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.2450000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0209999999999999,"15min":1.2430000000000001},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3440000000000001,"5min":4.5970000000000004,"15min":14.567},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1359999999999999,"15min":1.3919999999999999},"min":{"1min":0.73999999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.3440000000000001,"5min":2.4079999999999999,"15min":15.089},"last":1.099}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.01,"15min":1.327},"min":{"1min":0.58599999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.2110000000000001,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.163,"15min":1.208},"min":{"1min":0.877,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.484,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.2310000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1010,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194301,"statfs":{"total":200000000,"available":198965065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.877,"15min":0.83799999999999997},"min":{"1min":0.61899999999999999,"5min":0.54400000000000004,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.194,"5min":1.274,"15min":1.3029999999999999},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.878,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.179,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":0.97799999999999998},"min":{"1min":0.58899999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.429,"15min":1.4990000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":1.0649999999999999},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88100000000000001,"15min":0.83399999999999996},"min":{"1min":0.67600000000000005,"5min":0.51600000000000001,"15min":0.45300000000000001},"max":{"1min":1.099,"5min":1.3140000000000001,"15min":1.518},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.89800000000000002,"15min":0.93400000000000005},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.313},"max":{"1min":1.1539999999999999,"5min":1.504,"15min":2.6640000000000001},"last":1.208},{"interface":"front","average":{"1min":1.109,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.488,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.66200000000000003,"5min":0.61099999999999999,"15min":0.40000000000000002},"max":{"1min":1.2629999999999999,"5min":1.3560000000000001,"15min":2.085},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.5600000000000001,"5min":1.625,"15min":1.8149999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.95199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.125},"min":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.98699999999999999,"5min":1.093,"15min":1.093},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.222},"max":{"1min":0.95999999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.66400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.19700000000000001},"max":{"1min":0.97499999999999998,"5min":1.425,"15min":1.425},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83699999999999997,"15min":0.755},"min":{"1min":0.375,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81200000000000006}]},{"osd":2,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.69299999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.0629999999999999,"5min":1.25,"15min":1.8260000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93200000000000005,"15min":0.89700000000000002},"min":{"1min":0.70799999999999996,"5min":0.60399999999999998,"15min":0.48899999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.036,"15min":0.996},"min":{"1min":0.751,"5min":0.58799999999999997,"15min":0.51300000000000001},"max":{"1min":1.341,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96699999999999997,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.45400000000000001},"max":{"1min":1.266,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47499999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.4830000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.97199999999999998,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.119,"5min":1.3089999999999999,"15min":1.456},"last":1.014},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0289999999999999,"15min":0.999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.25,"5min":1.861,"15min":1.861},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0029999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.508,"15min":1.5660000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.016,"15min":0.97799999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.48299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89100000000000001,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.437},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.71699999999999997,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.29499999999999998,"15min":0.24299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.52400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.97299999999999998,"5min":0.98599999999999999,"15min":1.4610000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73599999999999999,"15min":0.70199999999999996},"min":{"1min":0.60699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.495}]},{"osd":3,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.66100000000000003},"min":{"1min":0.55300000000000005,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.995,"15min":1.1399999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81999999999999995,"15min":0.77300000000000002},"min":{"1min":0.66600000000000004,"5min":0.37,"15min":0.28000000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.96099999999999997},"min":{"1min":0.78300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.109,"5min":1.242,"15min":12.698},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97999999999999998,"15min":1.018},"min":{"1min":0.85699999999999998,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":12.721},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.96499999999999997,"15min":0.93400000000000005},"min":{"1min":0.81499999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.546},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.70399999999999996,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":2.206},"last":0.873}]},{"osd":6,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.49099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.125,"5min":1.0629999999999999,"15min":1.0329999999999999},"min":{"1min":0.92400000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.5980000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.004},"min":{"1min":0.80900000000000005,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":14.776},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.036,"15min":1.0389999999999999},"min":{"1min":0.78000000000000003,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.655,"5min":1.655,"15min":10.509},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198334289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":1.0660000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.44,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0840000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":1.0089999999999999,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.59299999999999997,"5min":0.25,"15min":0.25},"max":{"1min":1.129,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82299999999999995,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.2090000000000001,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.874,"15min":0.84399999999999997},"min":{"1min":0.748,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.085,"5min":1.296,"15min":3.6579999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.86599999999999999},"min":{"1min":0.70099999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.181,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.1160000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83899999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.90100000000000002},"min":{"1min":0.73999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1850000000000001,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98599999999999999,"15min":0.95699999999999996},"min":{"1min":0.72099999999999997,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":1.1120000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.026,"15min":0.99099999999999999},"min":{"1min":0.74099999999999999,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.27,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":0.96399999999999997},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2709999999999999,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0229999999999999,"15min":1.1459999999999999},"min":{"1min":0.67000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3220000000000001,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0580000000000001,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":11.622},"last":0.80500000000000005}]}]}],"pool_statfs":[]}} 2023-10-25T16:24:46.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:24:46.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/721858776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680cde10 msgr2=0x7f0b680ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/721858776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680cde10 0x7f0b680ce280 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b0dd0 tx=0x7f0b5c01c7e0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/721858776 shutdown_connections 2023-10-25T16:24:46.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/721858776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680cde10 0x7f0b680ce280 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/721858776 >> v2:172.21.15.184:3300/0 conn(0x7f0b680712a0 0x7f0b680cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/721858776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b68158030 0x7f0b6815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/721858776 >> 172.21.15.177:0/721858776 conn(0x7f0b6806a830 msgr2=0x7f0b6806ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:46.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/721858776 shutdown_connections 2023-10-25T16:24:46.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/721858776 wait complete. 2023-10-25T16:24:46.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 Processor -- start 2023-10-25T16:24:46.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- start start 2023-10-25T16:24:46.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 0x7f0b681f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b680cde10 0x7f0b6814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68158030 0x7f0b681f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681f6d60 con 0x7f0b680712a0 2023-10-25T16:24:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681532b0 con 0x7f0b68158030 2023-10-25T16:24:46.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6814a3d0 con 0x7f0b680cde10 2023-10-25T16:24:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 0x7f0b681f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 0x7f0b681f6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37324/0 (socket says 172.21.15.177:37324) 2023-10-25T16:24:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 -- 172.21.15.177:0/2712673424 learned_addr learned my addr 172.21.15.177:0/2712673424 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b677fe640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68158030 0x7f0b681f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.233 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b667fc640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b680cde10 0x7f0b6814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 -- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b680cde10 msgr2=0x7f0b6814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b680cde10 0x7f0b6814df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 -- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68158030 msgr2=0x7f0b681f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68158030 0x7f0b681f3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.234 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 -- 172.21.15.177:0/2712673424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c009560 con 0x7f0b680712a0 2023-10-25T16:24:46.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b66ffd640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 0x7f0b681f6820 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c940 tx=0x7f0b6000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:46.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60004220 con 0x7f0b680712a0 2023-10-25T16:24:46.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0b60004470 con 0x7f0b680712a0 2023-10-25T16:24:46.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b681625f0 con 0x7f0b680712a0 2023-10-25T16:24:46.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60007c10 con 0x7f0b680712a0 2023-10-25T16:24:46.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.230+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b68162bb0 con 0x7f0b680712a0 2023-10-25T16:24:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.234+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b680cb360 con 0x7f0b680712a0 2023-10-25T16:24:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.234+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0b60003600 con 0x7f0b680712a0 2023-10-25T16:24:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.234+0000 7f0b4ffff640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b54066470 0x7f0b54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.234+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b60084390 con 0x7f0b680712a0 2023-10-25T16:24:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.234+0000 7f0b667fc640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b54066470 0x7f0b54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.234+0000 7f0b667fc640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b54066470 0x7f0b54068930 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b680cb330 tx=0x7f0b58008230 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:46.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.238+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b60051790 con 0x7f0b680712a0 2023-10-25T16:24:46.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.386+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b6804dad0 con 0x7f0b54066470 2023-10-25T16:24:46.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.406+0000 7f0b4ffff640 1 -- 172.21.15.177:0/2712673424 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275232 (secure 0 0 0) 0x7f0b6804dad0 con 0x7f0b54066470 2023-10-25T16:24:46.408 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:46.409 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:24:46.410 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b54066470 msgr2=0x7f0b54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b54066470 0x7f0b54068930 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0b680cb330 tx=0x7f0b58008230 comp rx=0 tx=0).stop 2023-10-25T16:24:46.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 msgr2=0x7f0b681f6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 0x7f0b681f6820 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c940 tx=0x7f0b6000ce00 comp rx=0 tx=0).stop 2023-10-25T16:24:46.411 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 shutdown_connections 2023-10-25T16:24:46.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0b54066470 0x7f0b54068930 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b68158030 0x7f0b681f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0b680cde10 0x7f0b6814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.412 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 --2- 172.21.15.177:0/2712673424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0b680712a0 0x7f0b681f6820 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 >> 172.21.15.177:0/2712673424 conn(0x7f0b6806a830 msgr2=0x7f0b680aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:46.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 shutdown_connections 2023-10-25T16:24:46.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.410+0000 7f0b6d84b640 1 -- 172.21.15.177:0/2712673424 wait complete. 2023-10-25T16:24:46.426 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2023-10-25T16:24:44.853749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553122,"statfs":{"total":1600000000,"available":1590397296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001249"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370995+0000","last_change":"2023-10-25T16:24:42.848819+0000","last_active":"2023-10-25T16:24:44.370995+0000","last_peered":"2023-10-25T16:24:44.370995+0000","last_clean":"2023-10-25T16:24:44.370995+0000","last_became_active":"2023-10-25T16:24:42.847037+0000","last_became_peered":"2023-10-25T16:24:42.847037+0000","last_unstale":"2023-10-25T16:24:44.370995+0000","last_undegraded":"2023-10-25T16:24:44.370995+0000","last_fullsized":"2023-10-25T16:24:44.370995+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370667+0000","last_change":"2023-10-25T16:24:42.844979+0000","last_active":"2023-10-25T16:24:44.370667+0000","last_peered":"2023-10-25T16:24:44.370667+0000","last_clean":"2023-10-25T16:24:44.370667+0000","last_became_active":"2023-10-25T16:24:42.843262+0000","last_became_peered":"2023-10-25T16:24:42.843262+0000","last_unstale":"2023-10-25T16:24:44.370667+0000","last_undegraded":"2023-10-25T16:24:44.370667+0000","last_fullsized":"2023-10-25T16:24:44.370667+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839092+0000","last_change":"2023-10-25T16:24:42.850227+0000","last_active":"2023-10-25T16:24:43.839092+0000","last_peered":"2023-10-25T16:24:43.839092+0000","last_clean":"2023-10-25T16:24:43.839092+0000","last_became_active":"2023-10-25T16:24:42.849610+0000","last_became_peered":"2023-10-25T16:24:42.849610+0000","last_unstale":"2023-10-25T16:24:43.839092+0000","last_undegraded":"2023-10-25T16:24:43.839092+0000","last_fullsized":"2023-10-25T16:24:43.839092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370513+0000","last_change":"2023-10-25T16:24:42.861119+0000","last_active":"2023-10-25T16:24:44.370513+0000","last_peered":"2023-10-25T16:24:44.370513+0000","last_clean":"2023-10-25T16:24:44.370513+0000","last_became_active":"2023-10-25T16:24:42.858569+0000","last_became_peered":"2023-10-25T16:24:42.858569+0000","last_unstale":"2023-10-25T16:24:44.370513+0000","last_undegraded":"2023-10-25T16:24:44.370513+0000","last_fullsized":"2023-10-25T16:24:44.370513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:46:47.363848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838846+0000","last_change":"2023-10-25T16:24:42.847781+0000","last_active":"2023-10-25T16:24:43.838846+0000","last_peered":"2023-10-25T16:24:43.838846+0000","last_clean":"2023-10-25T16:24:43.838846+0000","last_became_active":"2023-10-25T16:24:42.846775+0000","last_became_peered":"2023-10-25T16:24:42.846775+0000","last_unstale":"2023-10-25T16:24:43.838846+0000","last_undegraded":"2023-10-25T16:24:43.838846+0000","last_fullsized":"2023-10-25T16:24:43.838846+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370169+0000","last_change":"2023-10-25T16:24:42.860236+0000","last_active":"2023-10-25T16:24:44.370169+0000","last_peered":"2023-10-25T16:24:44.370169+0000","last_clean":"2023-10-25T16:24:44.370169+0000","last_became_active":"2023-10-25T16:24:42.859552+0000","last_became_peered":"2023-10-25T16:24:42.859552+0000","last_unstale":"2023-10-25T16:24:44.370169+0000","last_undegraded":"2023-10-25T16:24:44.370169+0000","last_fullsized":"2023-10-25T16:24:44.370169+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:32.387989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370308+0000","last_change":"2023-10-25T16:24:42.845248+0000","last_active":"2023-10-25T16:24:44.370308+0000","last_peered":"2023-10-25T16:24:44.370308+0000","last_clean":"2023-10-25T16:24:44.370308+0000","last_became_active":"2023-10-25T16:24:42.844563+0000","last_became_peered":"2023-10-25T16:24:42.844563+0000","last_unstale":"2023-10-25T16:24:44.370308+0000","last_undegraded":"2023-10-25T16:24:44.370308+0000","last_fullsized":"2023-10-25T16:24:44.370308+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:41.791943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370749+0000","last_change":"2023-10-25T16:24:42.051870+0000","last_active":"2023-10-25T16:24:44.370749+0000","last_peered":"2023-10-25T16:24:44.370749+0000","last_clean":"2023-10-25T16:24:44.370749+0000","last_became_active":"2023-10-25T16:24:42.051571+0000","last_became_peered":"2023-10-25T16:24:42.051571+0000","last_unstale":"2023-10-25T16:24:44.370749+0000","last_undegraded":"2023-10-25T16:24:44.370749+0000","last_fullsized":"2023-10-25T16:24:44.370749+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:08.033543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839183+0000","last_change":"2023-10-25T16:24:42.856078+0000","last_active":"2023-10-25T16:24:43.839183+0000","last_peered":"2023-10-25T16:24:43.839183+0000","last_clean":"2023-10-25T16:24:43.839183+0000","last_became_active":"2023-10-25T16:24:42.855407+0000","last_became_peered":"2023-10-25T16:24:42.855407+0000","last_unstale":"2023-10-25T16:24:43.839183+0000","last_undegraded":"2023-10-25T16:24:43.839183+0000","last_fullsized":"2023-10-25T16:24:43.839183+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2023-10-25T16:24:41.041105+0000","last_change":"2023-10-25T16:24:41.041105+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.041105+0000","last_undegraded":"2023-10-25T16:24:41.041105+0000","last_fullsized":"2023-10-25T16:24:41.041105+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840160+0000","last_change":"2023-10-25T16:24:42.861748+0000","last_active":"2023-10-25T16:24:43.840160+0000","last_peered":"2023-10-25T16:24:43.840160+0000","last_clean":"2023-10-25T16:24:43.840160+0000","last_became_active":"2023-10-25T16:24:42.861078+0000","last_became_peered":"2023-10-25T16:24:42.861078+0000","last_unstale":"2023-10-25T16:24:43.840160+0000","last_undegraded":"2023-10-25T16:24:43.840160+0000","last_fullsized":"2023-10-25T16:24:43.840160+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:11.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2023-10-25T16:24:41.040651+0000","last_change":"2023-10-25T16:24:41.040651+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.040651+0000","last_undegraded":"2023-10-25T16:24:41.040651+0000","last_fullsized":"2023-10-25T16:24:41.040651+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839398+0000","last_change":"2023-10-25T16:24:42.846556+0000","last_active":"2023-10-25T16:24:43.839398+0000","last_peered":"2023-10-25T16:24:43.839398+0000","last_clean":"2023-10-25T16:24:43.839398+0000","last_became_active":"2023-10-25T16:24:42.845900+0000","last_became_peered":"2023-10-25T16:24:42.845900+0000","last_unstale":"2023-10-25T16:24:43.839398+0000","last_undegraded":"2023-10-25T16:24:43.839398+0000","last_fullsized":"2023-10-25T16:24:43.839398+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:38:24.488319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370539+0000","last_change":"2023-10-25T16:24:42.858156+0000","last_active":"2023-10-25T16:24:44.370539+0000","last_peered":"2023-10-25T16:24:44.370539+0000","last_clean":"2023-10-25T16:24:44.370539+0000","last_became_active":"2023-10-25T16:24:42.857459+0000","last_became_peered":"2023-10-25T16:24:42.857459+0000","last_unstale":"2023-10-25T16:24:44.370539+0000","last_undegraded":"2023-10-25T16:24:44.370539+0000","last_fullsized":"2023-10-25T16:24:44.370539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839510+0000","last_change":"2023-10-25T16:24:42.049822+0000","last_active":"2023-10-25T16:24:43.839510+0000","last_peered":"2023-10-25T16:24:43.839510+0000","last_clean":"2023-10-25T16:24:43.839510+0000","last_became_active":"2023-10-25T16:24:42.049364+0000","last_became_peered":"2023-10-25T16:24:42.049364+0000","last_unstale":"2023-10-25T16:24:43.839510+0000","last_undegraded":"2023-10-25T16:24:43.839510+0000","last_fullsized":"2023-10-25T16:24:43.839510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:17.596897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839189+0000","last_change":"2023-10-25T16:24:42.848132+0000","last_active":"2023-10-25T16:24:43.839189+0000","last_peered":"2023-10-25T16:24:43.839189+0000","last_clean":"2023-10-25T16:24:43.839189+0000","last_became_active":"2023-10-25T16:24:42.847148+0000","last_became_peered":"2023-10-25T16:24:42.847148+0000","last_unstale":"2023-10-25T16:24:43.839189+0000","last_undegraded":"2023-10-25T16:24:43.839189+0000","last_fullsized":"2023-10-25T16:24:43.839189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370800+0000","last_change":"2023-10-25T16:24:42.845326+0000","last_active":"2023-10-25T16:24:44.370800+0000","last_peered":"2023-10-25T16:24:44.370800+0000","last_clean":"2023-10-25T16:24:44.370800+0000","last_became_active":"2023-10-25T16:24:42.844302+0000","last_became_peered":"2023-10-25T16:24:42.844302+0000","last_unstale":"2023-10-25T16:24:44.370800+0000","last_undegraded":"2023-10-25T16:24:44.370800+0000","last_fullsized":"2023-10-25T16:24:44.370800+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370652+0000","last_change":"2023-10-25T16:24:42.841894+0000","last_active":"2023-10-25T16:24:44.370652+0000","last_peered":"2023-10-25T16:24:44.370652+0000","last_clean":"2023-10-25T16:24:44.370652+0000","last_became_active":"2023-10-25T16:24:42.841237+0000","last_became_peered":"2023-10-25T16:24:42.841237+0000","last_unstale":"2023-10-25T16:24:44.370652+0000","last_undegraded":"2023-10-25T16:24:44.370652+0000","last_fullsized":"2023-10-25T16:24:44.370652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839216+0000","last_change":"2023-10-25T16:24:42.855950+0000","last_active":"2023-10-25T16:24:43.839216+0000","last_peered":"2023-10-25T16:24:43.839216+0000","last_clean":"2023-10-25T16:24:43.839216+0000","last_became_active":"2023-10-25T16:24:42.855233+0000","last_became_peered":"2023-10-25T16:24:42.855233+0000","last_unstale":"2023-10-25T16:24:43.839216+0000","last_undegraded":"2023-10-25T16:24:43.839216+0000","last_fullsized":"2023-10-25T16:24:43.839216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:21.737177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839252+0000","last_change":"2023-10-25T16:24:42.069203+0000","last_active":"2023-10-25T16:24:43.839252+0000","last_peered":"2023-10-25T16:24:43.839252+0000","last_clean":"2023-10-25T16:24:43.839252+0000","last_became_active":"2023-10-25T16:24:42.068980+0000","last_became_peered":"2023-10-25T16:24:42.068980+0000","last_unstale":"2023-10-25T16:24:43.839252+0000","last_undegraded":"2023-10-25T16:24:43.839252+0000","last_fullsized":"2023-10-25T16:24:43.839252+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:57.057165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.371156+0000","last_change":"2023-10-25T16:24:42.863388+0000","last_active":"2023-10-25T16:24:44.371156+0000","last_peered":"2023-10-25T16:24:44.371156+0000","last_clean":"2023-10-25T16:24:44.371156+0000","last_became_active":"2023-10-25T16:24:42.862655+0000","last_became_peered":"2023-10-25T16:24:42.862655+0000","last_unstale":"2023-10-25T16:24:44.371156+0000","last_undegraded":"2023-10-25T16:24:44.371156+0000","last_fullsized":"2023-10-25T16:24:44.371156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839515+0000","last_change":"2023-10-25T16:24:42.838980+0000","last_active":"2023-10-25T16:24:43.839515+0000","last_peered":"2023-10-25T16:24:43.839515+0000","last_clean":"2023-10-25T16:24:43.839515+0000","last_became_active":"2023-10-25T16:24:42.838385+0000","last_became_peered":"2023-10-25T16:24:42.838385+0000","last_unstale":"2023-10-25T16:24:43.839515+0000","last_undegraded":"2023-10-25T16:24:43.839515+0000","last_fullsized":"2023-10-25T16:24:43.839515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:02:09.469182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839401+0000","last_change":"2023-10-25T16:24:42.058131+0000","last_active":"2023-10-25T16:24:43.839401+0000","last_peered":"2023-10-25T16:24:43.839401+0000","last_clean":"2023-10-25T16:24:43.839401+0000","last_became_active":"2023-10-25T16:24:42.057693+0000","last_became_peered":"2023-10-25T16:24:42.057693+0000","last_unstale":"2023-10-25T16:24:43.839401+0000","last_undegraded":"2023-10-25T16:24:43.839401+0000","last_fullsized":"2023-10-25T16:24:43.839401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:09.180705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839110+0000","last_change":"2023-10-25T16:24:42.847394+0000","last_active":"2023-10-25T16:24:43.839110+0000","last_peered":"2023-10-25T16:24:43.839110+0000","last_clean":"2023-10-25T16:24:43.839110+0000","last_became_active":"2023-10-25T16:24:42.845964+0000","last_became_peered":"2023-10-25T16:24:42.845964+0000","last_unstale":"2023-10-25T16:24:43.839110+0000","last_undegraded":"2023-10-25T16:24:43.839110+0000","last_fullsized":"2023-10-25T16:24:43.839110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370488+0000","last_change":"2023-10-25T16:24:42.842647+0000","last_active":"2023-10-25T16:24:44.370488+0000","last_peered":"2023-10-25T16:24:44.370488+0000","last_clean":"2023-10-25T16:24:44.370488+0000","last_became_active":"2023-10-25T16:24:42.841926+0000","last_became_peered":"2023-10-25T16:24:42.841926+0000","last_unstale":"2023-10-25T16:24:44.370488+0000","last_undegraded":"2023-10-25T16:24:44.370488+0000","last_fullsized":"2023-10-25T16:24:44.370488+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:36.093839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838989+0000","last_change":"2023-10-25T16:24:42.856140+0000","last_active":"2023-10-25T16:24:43.838989+0000","last_peered":"2023-10-25T16:24:43.838989+0000","last_clean":"2023-10-25T16:24:43.838989+0000","last_became_active":"2023-10-25T16:24:42.855277+0000","last_became_peered":"2023-10-25T16:24:42.855277+0000","last_unstale":"2023-10-25T16:24:43.838989+0000","last_undegraded":"2023-10-25T16:24:43.838989+0000","last_fullsized":"2023-10-25T16:24:43.838989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":322,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-25T16:24:39.009197+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:24:39.009197+0000","last_peered":"2023-10-25T16:24:39.009197+0000","last_clean":"2023-10-25T16:24:39.009197+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:24:39.009197+0000","last_undegraded":"2023-10-25T16:24:39.009197+0000","last_fullsized":"2023-10-25T16:24:39.009197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":12,"acting":12,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542288,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1031,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.80700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.621},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":1.0209999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":1.105},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":1.155}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":1.131},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":1.0009999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193710,"statfs":{"total":200000000,"available":198359456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.1839999999999999,"5min":1.24,"15min":1.256},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.087,"5min":1.3420000000000001,"15min":1.534},"last":0.99199999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.155,"5min":1.4259999999999999,"15min":1.647},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91200000000000003,"15min":0.86799999999999999},"min":{"1min":0.77100000000000002,"5min":0.54100000000000004,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1599999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.73999999999999999,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":1.51},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":1.0940000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1279999999999999,"5min":1.478,"15min":1.4910000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.72699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.337,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":1.177}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.337,"5min":1.696,"15min":1.7370000000000001},"last":1.151},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.66000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.234,"5min":1.681,"15min":1.681},"last":1.2}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.105,"15min":1.123},"min":{"1min":0.86699999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.2849999999999999,"5min":1.643,"15min":1.669},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":1.0629999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.321,"5min":1.591,"15min":1.7490000000000001},"last":1.371}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1005,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198970208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88300000000000001,"15min":0.876},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.028,"15min":0.93700000000000006},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.298,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1859999999999999,"5min":10.667,"15min":10.667},"last":0.748},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.042,"15min":0.95399999999999996},"min":{"1min":0.66000000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3180000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.92600000000000005},"min":{"1min":0.69999999999999996,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.22,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.079,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":10.948,"15min":10.948},"last":1.1339999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.2709999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.071},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1359999999999999,"15min":1.077},"min":{"1min":0.747,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.4299999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.046,"15min":0.98099999999999998},"min":{"1min":0.63500000000000001,"5min":0.48699999999999999,"15min":0.41499999999999998},"max":{"1min":1.494,"5min":11.081,"15min":11.081},"last":1.296},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.96099999999999997},"min":{"1min":0.67100000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2130000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.54600000000000004,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.1040000000000001,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.371,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.579}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.244,"15min":1.143},"min":{"1min":0.86199999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.5629999999999999,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.522},{"interface":"front","average":{"1min":1.089,"5min":1.151,"15min":1.0920000000000001},"min":{"1min":0.80400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.375,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.3720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91400000000000003,"15min":1.0900000000000001},"min":{"1min":0.624,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2929999999999999,"5min":2.1429999999999998,"15min":14.843},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.097,"5min":2.8450000000000002,"15min":16.439},"last":0.76200000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90400000000000003,"15min":1.127},"min":{"1min":0.67000000000000004,"5min":0.54000000000000004,"15min":0.40100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96199999999999997,"15min":0.91100000000000003},"min":{"1min":0.86199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.282,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0629999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.69899999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.3200000000000001,"5min":1.601,"15min":3.9529999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":0.96899999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.244,"5min":1.921,"15min":1.921},"last":0.90500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.379,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.143},{"interface":"front","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.3069999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.028,"15min":1.2709999999999999},"min":{"1min":0.66700000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2410000000000001,"5min":1.9910000000000001,"15min":15.904},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":1.236},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.2450000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0209999999999999,"15min":1.2430000000000001},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3440000000000001,"5min":4.5970000000000004,"15min":14.567},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1359999999999999,"15min":1.3919999999999999},"min":{"1min":0.73999999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.3440000000000001,"5min":2.4079999999999999,"15min":15.089},"last":1.099}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.01,"15min":1.327},"min":{"1min":0.58599999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.2110000000000001,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.163,"15min":1.208},"min":{"1min":0.877,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.484,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.2310000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1010,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194301,"statfs":{"total":200000000,"available":198965065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.877,"15min":0.83799999999999997},"min":{"1min":0.61899999999999999,"5min":0.54400000000000004,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.194,"5min":1.274,"15min":1.3029999999999999},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.878,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.179,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":0.97799999999999998},"min":{"1min":0.58899999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.429,"15min":1.4990000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":1.0649999999999999},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88100000000000001,"15min":0.83399999999999996},"min":{"1min":0.67600000000000005,"5min":0.51600000000000001,"15min":0.45300000000000001},"max":{"1min":1.099,"5min":1.3140000000000001,"15min":1.518},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.89800000000000002,"15min":0.93400000000000005},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.313},"max":{"1min":1.1539999999999999,"5min":1.504,"15min":2.6640000000000001},"last":1.208},{"interface":"front","average":{"1min":1.109,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.488,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.66200000000000003,"5min":0.61099999999999999,"15min":0.40000000000000002},"max":{"1min":1.2629999999999999,"5min":1.3560000000000001,"15min":2.085},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.5600000000000001,"5min":1.625,"15min":1.8149999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.95199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.125},"min":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.98699999999999999,"5min":1.093,"15min":1.093},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.222},"max":{"1min":0.95999999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.66400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.19700000000000001},"max":{"1min":0.97499999999999998,"5min":1.425,"15min":1.425},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83699999999999997,"15min":0.755},"min":{"1min":0.375,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81200000000000006}]},{"osd":2,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.69299999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.0629999999999999,"5min":1.25,"15min":1.8260000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93200000000000005,"15min":0.89700000000000002},"min":{"1min":0.70799999999999996,"5min":0.60399999999999998,"15min":0.48899999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.036,"15min":0.996},"min":{"1min":0.751,"5min":0.58799999999999997,"15min":0.51300000000000001},"max":{"1min":1.341,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96699999999999997,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.45400000000000001},"max":{"1min":1.266,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47499999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.4830000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.97199999999999998,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.119,"5min":1.3089999999999999,"15min":1.456},"last":1.014},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0289999999999999,"15min":0.999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.25,"5min":1.861,"15min":1.861},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0029999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.508,"15min":1.5660000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.016,"15min":0.97799999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.48299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89100000000000001,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.437},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.71699999999999997,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.29499999999999998,"15min":0.24299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.52400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.97299999999999998,"5min":0.98599999999999999,"15min":1.4610000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73599999999999999,"15min":0.70199999999999996},"min":{"1min":0.60699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.495}]},{"osd":3,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.66100000000000003},"min":{"1min":0.55300000000000005,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.995,"15min":1.1399999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81999999999999995,"15min":0.77300000000000002},"min":{"1min":0.66600000000000004,"5min":0.37,"15min":0.28000000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.96099999999999997},"min":{"1min":0.78300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.109,"5min":1.242,"15min":12.698},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97999999999999998,"15min":1.018},"min":{"1min":0.85699999999999998,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":12.721},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.96499999999999997,"15min":0.93400000000000005},"min":{"1min":0.81499999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.546},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.70399999999999996,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":2.206},"last":0.873}]},{"osd":6,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.49099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.125,"5min":1.0629999999999999,"15min":1.0329999999999999},"min":{"1min":0.92400000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.5980000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.004},"min":{"1min":0.80900000000000005,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":14.776},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.036,"15min":1.0389999999999999},"min":{"1min":0.78000000000000003,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.655,"5min":1.655,"15min":10.509},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198334289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":1.0660000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.44,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0840000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":1.0089999999999999,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.59299999999999997,"5min":0.25,"15min":0.25},"max":{"1min":1.129,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82299999999999995,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.2090000000000001,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.874,"15min":0.84399999999999997},"min":{"1min":0.748,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.085,"5min":1.296,"15min":3.6579999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.86599999999999999},"min":{"1min":0.70099999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.181,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.1160000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83899999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.90100000000000002},"min":{"1min":0.73999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1850000000000001,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98599999999999999,"15min":0.95699999999999996},"min":{"1min":0.72099999999999997,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":1.1120000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.026,"15min":0.99099999999999999},"min":{"1min":0.74099999999999999,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.27,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":0.96399999999999997},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2709999999999999,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0229999999999999,"15min":1.1459999999999999},"min":{"1min":0.67000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3220000000000001,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0580000000000001,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":11.622},"last":0.80500000000000005}]}]}],"pool_statfs":[]}} 2023-10-25T16:24:46.432 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:24:46.596 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 -- 172.21.15.177:0/2474264577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 msgr2=0x7f92d80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 --2- 172.21.15.177:0/2474264577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 0x7f92d80ce220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009900 tx=0x7f92c001c890 comp rx=0 tx=0).stop 2023-10-25T16:24:46.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 -- 172.21.15.177:0/2474264577 shutdown_connections 2023-10-25T16:24:46.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 --2- 172.21.15.177:0/2474264577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 0x7f92d80ce220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.597 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 --2- 172.21.15.177:0/2474264577 >> v2:172.21.15.184:3300/0 conn(0x7f92d8157e70 0x7f92d815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 -- 172.21.15.177:0/2474264577 >> 172.21.15.177:0/2474264577 conn(0x7f92d806aa00 msgr2=0x7f92d806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:46.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 -- 172.21.15.177:0/2474264577 shutdown_connections 2023-10-25T16:24:46.598 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 -- 172.21.15.177:0/2474264577 wait complete. 2023-10-25T16:24:46.600 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 Processor -- start 2023-10-25T16:24:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.598+0000 7f92de9fb640 1 -- start start 2023-10-25T16:24:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 0x7f92d8162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92d80ce760 0x7f92d8145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 0x7f92d81f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.601 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81f50c0 con 0x7f92d8157e70 2023-10-25T16:24:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81f53a0 con 0x7f92d80ce760 2023-10-25T16:24:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81f5680 con 0x7f92d80b15b0 2023-10-25T16:24:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 0x7f92d81f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 0x7f92d81f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37336/0 (socket says 172.21.15.177:37336) 2023-10-25T16:24:46.602 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 -- 172.21.15.177:0/1539268480 learned_addr learned my addr 172.21.15.177:0/1539268480 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:46.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d7fff640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 0x7f92d8162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d77fe640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92d80ce760 0x7f92d8145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 -- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 msgr2=0x7f92d8162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 0x7f92d8162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.603 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 -- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92d80ce760 msgr2=0x7f92d8145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92d80ce760 0x7f92d8145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 -- 172.21.15.177:0/1539268480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009560 con 0x7f92d8157e70 2023-10-25T16:24:46.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d77fe640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92d80ce760 0x7f92d8145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:46.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92dcf98640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 0x7f92d81f4840 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c430 tx=0x7f92d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:46.604 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0005220 con 0x7f92d8157e70 2023-10-25T16:24:46.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f92d0005470 con 0x7f92d8157e70 2023-10-25T16:24:46.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007290 con 0x7f92d8157e70 2023-10-25T16:24:46.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d81583f0 con 0x7f92d8157e70 2023-10-25T16:24:46.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d81f5960 con 0x7f92d8157e70 2023-10-25T16:24:46.605 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d8066b20 con 0x7f92d8157e70 2023-10-25T16:24:46.606 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92d00073f0 con 0x7f92d8157e70 2023-10-25T16:24:46.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d4ff9640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f92b8066470 0x7f92b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92d0083730 con 0x7f92d8157e70 2023-10-25T16:24:46.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.602+0000 7f92d7fff640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f92b8066470 0x7f92b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.606+0000 7f92d7fff640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f92b8066470 0x7f92b8068930 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009eb0 tx=0x7f92c8009500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:46.607 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.606+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92d0050b90 con 0x7f92d8157e70 2023-10-25T16:24:46.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.746+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92d809c250 con 0x7f92b8066470 2023-10-25T16:24:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92d4ff9640 1 -- 172.21.15.177:0/1539268480 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275232 (secure 0 0 0) 0x7f92d809c250 con 0x7f92b8066470 2023-10-25T16:24:46.768 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:46.770 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:24:46.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f92b8066470 msgr2=0x7f92b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f92b8066470 0x7f92b8068930 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009eb0 tx=0x7f92c8009500 comp rx=0 tx=0).stop 2023-10-25T16:24:46.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 msgr2=0x7f92d81f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 0x7f92d81f4840 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c430 tx=0x7f92d000c8f0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 shutdown_connections 2023-10-25T16:24:46.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f92b8066470 0x7f92b8068930 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92d8157e70 0x7f92d81f4840 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92d80ce760 0x7f92d8145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 --2- 172.21.15.177:0/1539268480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f92d80b15b0 0x7f92d8162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 >> 172.21.15.177:0/1539268480 conn(0x7f92d806aa00 msgr2=0x7f92d806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:46.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 shutdown_connections 2023-10-25T16:24:46.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.770+0000 7f92de9fb640 1 -- 172.21.15.177:0/1539268480 wait complete. 2023-10-25T16:24:46.785 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2023-10-25T16:24:44.853749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553122,"statfs":{"total":1600000000,"available":1590397296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001249"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370995+0000","last_change":"2023-10-25T16:24:42.848819+0000","last_active":"2023-10-25T16:24:44.370995+0000","last_peered":"2023-10-25T16:24:44.370995+0000","last_clean":"2023-10-25T16:24:44.370995+0000","last_became_active":"2023-10-25T16:24:42.847037+0000","last_became_peered":"2023-10-25T16:24:42.847037+0000","last_unstale":"2023-10-25T16:24:44.370995+0000","last_undegraded":"2023-10-25T16:24:44.370995+0000","last_fullsized":"2023-10-25T16:24:44.370995+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370667+0000","last_change":"2023-10-25T16:24:42.844979+0000","last_active":"2023-10-25T16:24:44.370667+0000","last_peered":"2023-10-25T16:24:44.370667+0000","last_clean":"2023-10-25T16:24:44.370667+0000","last_became_active":"2023-10-25T16:24:42.843262+0000","last_became_peered":"2023-10-25T16:24:42.843262+0000","last_unstale":"2023-10-25T16:24:44.370667+0000","last_undegraded":"2023-10-25T16:24:44.370667+0000","last_fullsized":"2023-10-25T16:24:44.370667+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839092+0000","last_change":"2023-10-25T16:24:42.850227+0000","last_active":"2023-10-25T16:24:43.839092+0000","last_peered":"2023-10-25T16:24:43.839092+0000","last_clean":"2023-10-25T16:24:43.839092+0000","last_became_active":"2023-10-25T16:24:42.849610+0000","last_became_peered":"2023-10-25T16:24:42.849610+0000","last_unstale":"2023-10-25T16:24:43.839092+0000","last_undegraded":"2023-10-25T16:24:43.839092+0000","last_fullsized":"2023-10-25T16:24:43.839092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370513+0000","last_change":"2023-10-25T16:24:42.861119+0000","last_active":"2023-10-25T16:24:44.370513+0000","last_peered":"2023-10-25T16:24:44.370513+0000","last_clean":"2023-10-25T16:24:44.370513+0000","last_became_active":"2023-10-25T16:24:42.858569+0000","last_became_peered":"2023-10-25T16:24:42.858569+0000","last_unstale":"2023-10-25T16:24:44.370513+0000","last_undegraded":"2023-10-25T16:24:44.370513+0000","last_fullsized":"2023-10-25T16:24:44.370513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:46:47.363848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838846+0000","last_change":"2023-10-25T16:24:42.847781+0000","last_active":"2023-10-25T16:24:43.838846+0000","last_peered":"2023-10-25T16:24:43.838846+0000","last_clean":"2023-10-25T16:24:43.838846+0000","last_became_active":"2023-10-25T16:24:42.846775+0000","last_became_peered":"2023-10-25T16:24:42.846775+0000","last_unstale":"2023-10-25T16:24:43.838846+0000","last_undegraded":"2023-10-25T16:24:43.838846+0000","last_fullsized":"2023-10-25T16:24:43.838846+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370169+0000","last_change":"2023-10-25T16:24:42.860236+0000","last_active":"2023-10-25T16:24:44.370169+0000","last_peered":"2023-10-25T16:24:44.370169+0000","last_clean":"2023-10-25T16:24:44.370169+0000","last_became_active":"2023-10-25T16:24:42.859552+0000","last_became_peered":"2023-10-25T16:24:42.859552+0000","last_unstale":"2023-10-25T16:24:44.370169+0000","last_undegraded":"2023-10-25T16:24:44.370169+0000","last_fullsized":"2023-10-25T16:24:44.370169+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:32.387989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370308+0000","last_change":"2023-10-25T16:24:42.845248+0000","last_active":"2023-10-25T16:24:44.370308+0000","last_peered":"2023-10-25T16:24:44.370308+0000","last_clean":"2023-10-25T16:24:44.370308+0000","last_became_active":"2023-10-25T16:24:42.844563+0000","last_became_peered":"2023-10-25T16:24:42.844563+0000","last_unstale":"2023-10-25T16:24:44.370308+0000","last_undegraded":"2023-10-25T16:24:44.370308+0000","last_fullsized":"2023-10-25T16:24:44.370308+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:41.791943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370749+0000","last_change":"2023-10-25T16:24:42.051870+0000","last_active":"2023-10-25T16:24:44.370749+0000","last_peered":"2023-10-25T16:24:44.370749+0000","last_clean":"2023-10-25T16:24:44.370749+0000","last_became_active":"2023-10-25T16:24:42.051571+0000","last_became_peered":"2023-10-25T16:24:42.051571+0000","last_unstale":"2023-10-25T16:24:44.370749+0000","last_undegraded":"2023-10-25T16:24:44.370749+0000","last_fullsized":"2023-10-25T16:24:44.370749+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:08.033543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839183+0000","last_change":"2023-10-25T16:24:42.856078+0000","last_active":"2023-10-25T16:24:43.839183+0000","last_peered":"2023-10-25T16:24:43.839183+0000","last_clean":"2023-10-25T16:24:43.839183+0000","last_became_active":"2023-10-25T16:24:42.855407+0000","last_became_peered":"2023-10-25T16:24:42.855407+0000","last_unstale":"2023-10-25T16:24:43.839183+0000","last_undegraded":"2023-10-25T16:24:43.839183+0000","last_fullsized":"2023-10-25T16:24:43.839183+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2023-10-25T16:24:41.041105+0000","last_change":"2023-10-25T16:24:41.041105+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.041105+0000","last_undegraded":"2023-10-25T16:24:41.041105+0000","last_fullsized":"2023-10-25T16:24:41.041105+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840160+0000","last_change":"2023-10-25T16:24:42.861748+0000","last_active":"2023-10-25T16:24:43.840160+0000","last_peered":"2023-10-25T16:24:43.840160+0000","last_clean":"2023-10-25T16:24:43.840160+0000","last_became_active":"2023-10-25T16:24:42.861078+0000","last_became_peered":"2023-10-25T16:24:42.861078+0000","last_unstale":"2023-10-25T16:24:43.840160+0000","last_undegraded":"2023-10-25T16:24:43.840160+0000","last_fullsized":"2023-10-25T16:24:43.840160+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:11.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":187,"state":"creating+peering","last_fresh":"2023-10-25T16:24:41.040651+0000","last_change":"2023-10-25T16:24:41.040651+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.040651+0000","last_undegraded":"2023-10-25T16:24:41.040651+0000","last_fullsized":"2023-10-25T16:24:41.040651+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839398+0000","last_change":"2023-10-25T16:24:42.846556+0000","last_active":"2023-10-25T16:24:43.839398+0000","last_peered":"2023-10-25T16:24:43.839398+0000","last_clean":"2023-10-25T16:24:43.839398+0000","last_became_active":"2023-10-25T16:24:42.845900+0000","last_became_peered":"2023-10-25T16:24:42.845900+0000","last_unstale":"2023-10-25T16:24:43.839398+0000","last_undegraded":"2023-10-25T16:24:43.839398+0000","last_fullsized":"2023-10-25T16:24:43.839398+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:38:24.488319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370539+0000","last_change":"2023-10-25T16:24:42.858156+0000","last_active":"2023-10-25T16:24:44.370539+0000","last_peered":"2023-10-25T16:24:44.370539+0000","last_clean":"2023-10-25T16:24:44.370539+0000","last_became_active":"2023-10-25T16:24:42.857459+0000","last_became_peered":"2023-10-25T16:24:42.857459+0000","last_unstale":"2023-10-25T16:24:44.370539+0000","last_undegraded":"2023-10-25T16:24:44.370539+0000","last_fullsized":"2023-10-25T16:24:44.370539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839510+0000","last_change":"2023-10-25T16:24:42.049822+0000","last_active":"2023-10-25T16:24:43.839510+0000","last_peered":"2023-10-25T16:24:43.839510+0000","last_clean":"2023-10-25T16:24:43.839510+0000","last_became_active":"2023-10-25T16:24:42.049364+0000","last_became_peered":"2023-10-25T16:24:42.049364+0000","last_unstale":"2023-10-25T16:24:43.839510+0000","last_undegraded":"2023-10-25T16:24:43.839510+0000","last_fullsized":"2023-10-25T16:24:43.839510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:17.596897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839189+0000","last_change":"2023-10-25T16:24:42.848132+0000","last_active":"2023-10-25T16:24:43.839189+0000","last_peered":"2023-10-25T16:24:43.839189+0000","last_clean":"2023-10-25T16:24:43.839189+0000","last_became_active":"2023-10-25T16:24:42.847148+0000","last_became_peered":"2023-10-25T16:24:42.847148+0000","last_unstale":"2023-10-25T16:24:43.839189+0000","last_undegraded":"2023-10-25T16:24:43.839189+0000","last_fullsized":"2023-10-25T16:24:43.839189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370800+0000","last_change":"2023-10-25T16:24:42.845326+0000","last_active":"2023-10-25T16:24:44.370800+0000","last_peered":"2023-10-25T16:24:44.370800+0000","last_clean":"2023-10-25T16:24:44.370800+0000","last_became_active":"2023-10-25T16:24:42.844302+0000","last_became_peered":"2023-10-25T16:24:42.844302+0000","last_unstale":"2023-10-25T16:24:44.370800+0000","last_undegraded":"2023-10-25T16:24:44.370800+0000","last_fullsized":"2023-10-25T16:24:44.370800+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370652+0000","last_change":"2023-10-25T16:24:42.841894+0000","last_active":"2023-10-25T16:24:44.370652+0000","last_peered":"2023-10-25T16:24:44.370652+0000","last_clean":"2023-10-25T16:24:44.370652+0000","last_became_active":"2023-10-25T16:24:42.841237+0000","last_became_peered":"2023-10-25T16:24:42.841237+0000","last_unstale":"2023-10-25T16:24:44.370652+0000","last_undegraded":"2023-10-25T16:24:44.370652+0000","last_fullsized":"2023-10-25T16:24:44.370652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839216+0000","last_change":"2023-10-25T16:24:42.855950+0000","last_active":"2023-10-25T16:24:43.839216+0000","last_peered":"2023-10-25T16:24:43.839216+0000","last_clean":"2023-10-25T16:24:43.839216+0000","last_became_active":"2023-10-25T16:24:42.855233+0000","last_became_peered":"2023-10-25T16:24:42.855233+0000","last_unstale":"2023-10-25T16:24:43.839216+0000","last_undegraded":"2023-10-25T16:24:43.839216+0000","last_fullsized":"2023-10-25T16:24:43.839216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:21.737177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839252+0000","last_change":"2023-10-25T16:24:42.069203+0000","last_active":"2023-10-25T16:24:43.839252+0000","last_peered":"2023-10-25T16:24:43.839252+0000","last_clean":"2023-10-25T16:24:43.839252+0000","last_became_active":"2023-10-25T16:24:42.068980+0000","last_became_peered":"2023-10-25T16:24:42.068980+0000","last_unstale":"2023-10-25T16:24:43.839252+0000","last_undegraded":"2023-10-25T16:24:43.839252+0000","last_fullsized":"2023-10-25T16:24:43.839252+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:57.057165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.371156+0000","last_change":"2023-10-25T16:24:42.863388+0000","last_active":"2023-10-25T16:24:44.371156+0000","last_peered":"2023-10-25T16:24:44.371156+0000","last_clean":"2023-10-25T16:24:44.371156+0000","last_became_active":"2023-10-25T16:24:42.862655+0000","last_became_peered":"2023-10-25T16:24:42.862655+0000","last_unstale":"2023-10-25T16:24:44.371156+0000","last_undegraded":"2023-10-25T16:24:44.371156+0000","last_fullsized":"2023-10-25T16:24:44.371156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839515+0000","last_change":"2023-10-25T16:24:42.838980+0000","last_active":"2023-10-25T16:24:43.839515+0000","last_peered":"2023-10-25T16:24:43.839515+0000","last_clean":"2023-10-25T16:24:43.839515+0000","last_became_active":"2023-10-25T16:24:42.838385+0000","last_became_peered":"2023-10-25T16:24:42.838385+0000","last_unstale":"2023-10-25T16:24:43.839515+0000","last_undegraded":"2023-10-25T16:24:43.839515+0000","last_fullsized":"2023-10-25T16:24:43.839515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:02:09.469182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839401+0000","last_change":"2023-10-25T16:24:42.058131+0000","last_active":"2023-10-25T16:24:43.839401+0000","last_peered":"2023-10-25T16:24:43.839401+0000","last_clean":"2023-10-25T16:24:43.839401+0000","last_became_active":"2023-10-25T16:24:42.057693+0000","last_became_peered":"2023-10-25T16:24:42.057693+0000","last_unstale":"2023-10-25T16:24:43.839401+0000","last_undegraded":"2023-10-25T16:24:43.839401+0000","last_fullsized":"2023-10-25T16:24:43.839401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:09.180705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839110+0000","last_change":"2023-10-25T16:24:42.847394+0000","last_active":"2023-10-25T16:24:43.839110+0000","last_peered":"2023-10-25T16:24:43.839110+0000","last_clean":"2023-10-25T16:24:43.839110+0000","last_became_active":"2023-10-25T16:24:42.845964+0000","last_became_peered":"2023-10-25T16:24:42.845964+0000","last_unstale":"2023-10-25T16:24:43.839110+0000","last_undegraded":"2023-10-25T16:24:43.839110+0000","last_fullsized":"2023-10-25T16:24:43.839110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370488+0000","last_change":"2023-10-25T16:24:42.842647+0000","last_active":"2023-10-25T16:24:44.370488+0000","last_peered":"2023-10-25T16:24:44.370488+0000","last_clean":"2023-10-25T16:24:44.370488+0000","last_became_active":"2023-10-25T16:24:42.841926+0000","last_became_peered":"2023-10-25T16:24:42.841926+0000","last_unstale":"2023-10-25T16:24:44.370488+0000","last_undegraded":"2023-10-25T16:24:44.370488+0000","last_fullsized":"2023-10-25T16:24:44.370488+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:36.093839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:42.030305+0000","last_change":"2023-10-25T16:24:42.030305+0000","last_active":"2023-10-25T16:24:42.030305+0000","last_peered":"2023-10-25T16:24:42.030305+0000","last_clean":"2023-10-25T16:24:42.030305+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:42.030305+0000","last_undegraded":"2023-10-25T16:24:42.030305+0000","last_fullsized":"2023-10-25T16:24:42.030305+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838989+0000","last_change":"2023-10-25T16:24:42.856140+0000","last_active":"2023-10-25T16:24:43.838989+0000","last_peered":"2023-10-25T16:24:43.838989+0000","last_clean":"2023-10-25T16:24:43.838989+0000","last_became_active":"2023-10-25T16:24:42.855277+0000","last_became_peered":"2023-10-25T16:24:42.855277+0000","last_unstale":"2023-10-25T16:24:43.838989+0000","last_undegraded":"2023-10-25T16:24:43.838989+0000","last_fullsized":"2023-10-25T16:24:43.838989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-25T16:24:41.015416+0000","last_change":"2023-10-25T16:24:41.015416+0000","last_active":"2023-10-25T16:24:41.015416+0000","last_peered":"2023-10-25T16:24:41.015416+0000","last_clean":"2023-10-25T16:24:41.015416+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-25T16:24:41.015416+0000","last_undegraded":"2023-10-25T16:24:41.015416+0000","last_fullsized":"2023-10-25T16:24:41.015416+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":322,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-25T16:24:39.009197+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:24:39.009197+0000","last_peered":"2023-10-25T16:24:39.009197+0000","last_clean":"2023-10-25T16:24:39.009197+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:24:39.009197+0000","last_undegraded":"2023-10-25T16:24:39.009197+0000","last_fullsized":"2023-10-25T16:24:39.009197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":12,"acting":12,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542288,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1031,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194281,"statfs":{"total":200000000,"available":198944007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.80700000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.621},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":1.0209999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":1.105},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":1.155}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":1.131},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":1.0009999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574991,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193710,"statfs":{"total":200000000,"available":198359456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.1839999999999999,"5min":1.24,"15min":1.256},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.087,"5min":1.3420000000000001,"15min":1.534},"last":0.99199999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.155,"5min":1.4259999999999999,"15min":1.647},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91200000000000003,"15min":0.86799999999999999},"min":{"1min":0.77100000000000002,"5min":0.54100000000000004,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1599999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.73999999999999999,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":1.51},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":1.0940000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1279999999999999,"5min":1.478,"15min":1.4910000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.72699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.337,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":1.177}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.337,"5min":1.696,"15min":1.7370000000000001},"last":1.151},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.66000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.234,"5min":1.681,"15min":1.681},"last":1.2}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.105,"15min":1.123},"min":{"1min":0.86699999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.2849999999999999,"5min":1.643,"15min":1.669},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":1.0629999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.321,"5min":1.591,"15min":1.7490000000000001},"last":1.371}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1005,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194306,"statfs":{"total":200000000,"available":198970208,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88300000000000001,"15min":0.876},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.028,"15min":0.93700000000000006},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.298,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1859999999999999,"5min":10.667,"15min":10.667},"last":0.748},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.042,"15min":0.95399999999999996},"min":{"1min":0.66000000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3180000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.92600000000000005},"min":{"1min":0.69999999999999996,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.22,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.079,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":10.948,"15min":10.948},"last":1.1339999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.2709999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.071},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1359999999999999,"15min":1.077},"min":{"1min":0.747,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.4299999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.046,"15min":0.98099999999999998},"min":{"1min":0.63500000000000001,"5min":0.48699999999999999,"15min":0.41499999999999998},"max":{"1min":1.494,"5min":11.081,"15min":11.081},"last":1.296},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.96099999999999997},"min":{"1min":0.67100000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2130000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.54600000000000004,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.1040000000000001,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.371,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.579}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.244,"15min":1.143},"min":{"1min":0.86199999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.5629999999999999,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.522},{"interface":"front","average":{"1min":1.089,"5min":1.151,"15min":1.0920000000000001},"min":{"1min":0.80400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.375,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.3720000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91400000000000003,"15min":1.0900000000000001},"min":{"1min":0.624,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2929999999999999,"5min":2.1429999999999998,"15min":14.843},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.097,"5min":2.8450000000000002,"15min":16.439},"last":0.76200000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90400000000000003,"15min":1.127},"min":{"1min":0.67000000000000004,"5min":0.54000000000000004,"15min":0.40100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96199999999999997,"15min":0.91100000000000003},"min":{"1min":0.86199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.282,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.0629999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.69899999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.3200000000000001,"5min":1.601,"15min":3.9529999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":0.96899999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.244,"5min":1.921,"15min":1.921},"last":0.90500000000000003}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.379,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.143},{"interface":"front","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.3069999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.028,"15min":1.2709999999999999},"min":{"1min":0.66700000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2410000000000001,"5min":1.9910000000000001,"15min":15.904},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":1.236},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.2450000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0209999999999999,"15min":1.2430000000000001},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3440000000000001,"5min":4.5970000000000004,"15min":14.567},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.1359999999999999,"15min":1.3919999999999999},"min":{"1min":0.73999999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.3440000000000001,"5min":2.4079999999999999,"15min":15.089},"last":1.099}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.01,"15min":1.327},"min":{"1min":0.58599999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.2110000000000001,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.163,"15min":1.208},"min":{"1min":0.877,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.484,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.2310000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1010,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194301,"statfs":{"total":200000000,"available":198965065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.877,"15min":0.83799999999999997},"min":{"1min":0.61899999999999999,"5min":0.54400000000000004,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.194,"5min":1.274,"15min":1.3029999999999999},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.878,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.179,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":0.97799999999999998},"min":{"1min":0.58899999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.429,"15min":1.4990000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":1.0649999999999999},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88100000000000001,"15min":0.83399999999999996},"min":{"1min":0.67600000000000005,"5min":0.51600000000000001,"15min":0.45300000000000001},"max":{"1min":1.099,"5min":1.3140000000000001,"15min":1.518},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.89800000000000002,"15min":0.93400000000000005},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.313},"max":{"1min":1.1539999999999999,"5min":1.504,"15min":2.6640000000000001},"last":1.208},{"interface":"front","average":{"1min":1.109,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.488,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.66200000000000003,"5min":0.61099999999999999,"15min":0.40000000000000002},"max":{"1min":1.2629999999999999,"5min":1.3560000000000001,"15min":2.085},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.5600000000000001,"5min":1.625,"15min":1.8149999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.95199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.125},"min":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.98699999999999999,"5min":1.093,"15min":1.093},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.222},"max":{"1min":0.95999999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.66400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.19700000000000001},"max":{"1min":0.97499999999999998,"5min":1.425,"15min":1.425},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83699999999999997,"15min":0.755},"min":{"1min":0.375,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81200000000000006}]},{"osd":2,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.69299999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.0629999999999999,"5min":1.25,"15min":1.8260000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93200000000000005,"15min":0.89700000000000002},"min":{"1min":0.70799999999999996,"5min":0.60399999999999998,"15min":0.48899999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.036,"15min":0.996},"min":{"1min":0.751,"5min":0.58799999999999997,"15min":0.51300000000000001},"max":{"1min":1.341,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96699999999999997,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.45400000000000001},"max":{"1min":1.266,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47499999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.4830000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.97199999999999998,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.119,"5min":1.3089999999999999,"15min":1.456},"last":1.014},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0289999999999999,"15min":0.999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.25,"5min":1.861,"15min":1.861},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0029999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.508,"15min":1.5660000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.016,"15min":0.97799999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194286,"statfs":{"total":200000000,"available":198949824,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.48299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89100000000000001,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.437},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.71699999999999997,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.29499999999999998,"15min":0.24299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.52400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.97299999999999998,"5min":0.98599999999999999,"15min":1.4610000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73599999999999999,"15min":0.70199999999999996},"min":{"1min":0.60699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.495}]},{"osd":3,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.66100000000000003},"min":{"1min":0.55300000000000005,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.995,"15min":1.1399999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81999999999999995,"15min":0.77300000000000002},"min":{"1min":0.66600000000000004,"5min":0.37,"15min":0.28000000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.96099999999999997},"min":{"1min":0.78300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.109,"5min":1.242,"15min":12.698},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97999999999999998,"15min":1.018},"min":{"1min":0.85699999999999998,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":12.721},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.96499999999999997,"15min":0.93400000000000005},"min":{"1min":0.81499999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.546},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.70399999999999996,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":2.206},"last":0.873}]},{"osd":6,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.49099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.125,"5min":1.0629999999999999,"15min":1.0329999999999999},"min":{"1min":0.92400000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.5980000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.004},"min":{"1min":0.80900000000000005,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":14.776},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.036,"15min":1.0389999999999999},"min":{"1min":0.78000000000000003,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.655,"5min":1.655,"15min":10.509},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198334289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":1.0660000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.44,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0840000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":1.0089999999999999,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.59299999999999997,"5min":0.25,"15min":0.25},"max":{"1min":1.129,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82299999999999995,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.2090000000000001,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.874,"15min":0.84399999999999997},"min":{"1min":0.748,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.085,"5min":1.296,"15min":3.6579999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.86599999999999999},"min":{"1min":0.70099999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.181,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.1160000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83899999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.90100000000000002},"min":{"1min":0.73999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1850000000000001,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98599999999999999,"15min":0.95699999999999996},"min":{"1min":0.72099999999999997,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":1.1120000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.026,"15min":0.99099999999999999},"min":{"1min":0.74099999999999999,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.27,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":0.96399999999999997},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2709999999999999,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0229999999999999,"15min":1.1459999999999999},"min":{"1min":0.67000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3220000000000001,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0580000000000001,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":11.622},"last":0.80500000000000005}]}]}],"pool_statfs":[]}} 2023-10-25T16:24:46.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2023-10-25T16:24:46.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-10-25T16:24:46.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-10-25T16:24:46.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3c is not active+clean 2023-10-25T16:24:46.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-10-25T16:24:46.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3a is not active+clean 2023-10-25T16:24:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-10-25T16:24:46.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-10-25T16:24:46.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-10-25T16:24:46.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-10-25T16:24:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-10-25T16:24:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-10-25T16:24:46.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-10-25T16:24:46.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2023-10-25T16:24:46.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2f is not active+clean 2023-10-25T16:24:46.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2d is not active+clean 2023-10-25T16:24:46.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-10-25T16:24:46.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2b is not active+clean 2023-10-25T16:24:46.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-10-25T16:24:46.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.29 is not active+clean 2023-10-25T16:24:46.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-10-25T16:24:46.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-10-25T16:24:46.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-10-25T16:24:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.24 is not active+clean 2023-10-25T16:24:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-10-25T16:24:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-10-25T16:24:46.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-10-25T16:24:46.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-10-25T16:24:46.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-10-25T16:24:46.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-25T16:24:46.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1c is not active+clean 2023-10-25T16:24:46.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-10-25T16:24:46.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-10-25T16:24:46.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-10-25T16:24:46.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-10-25T16:24:46.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2023-10-25T16:24:46.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-10-25T16:24:46.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2023-10-25T16:24:46.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-10-25T16:24:46.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.19 is not active+clean 2023-10-25T16:24:46.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-10-25T16:24:46.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:24:41.041105+0000', 'last_change': '2023-10-25T16:24:41.041105+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.041105+0000', 'last_undegraded': '2023-10-25T16:24:41.041105+0000', 'last_fullsized': '2023-10-25T16:24:41.041105+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:24:46.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-10-25T16:24:46.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 187, 'state': 'creating+peering', 'last_fresh': '2023-10-25T16:24:41.040651+0000', 'last_change': '2023-10-25T16:24:41.040651+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.040651+0000', 'last_undegraded': '2023-10-25T16:24:41.040651+0000', 'last_fullsized': '2023-10-25T16:24:41.040651+0000', 'mapping_epoch': 187, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 187, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-25T16:24:46.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-10-25T16:24:46.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-25T16:24:46.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-10-25T16:24:46.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2023-10-25T16:24:46.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-10-25T16:24:46.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-10-25T16:24:46.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-25T16:24:46.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2023-10-25T16:24:46.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-10-25T16:24:46.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-10-25T16:24:46.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2023-10-25T16:24:46.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-10-25T16:24:46.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-10-25T16:24:46.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-10-25T16:24:46.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-10-25T16:24:46.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-10-25T16:24:46.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-10-25T16:24:46.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-10-25T16:24:46.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.9 is not active+clean 2023-10-25T16:24:46.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-10-25T16:24:46.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-10-25T16:24:46.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.4 is not active+clean 2023-10-25T16:24:46.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-10-25T16:24:46.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-25T16:24:46.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-10-25T16:24:46.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-10-25T16:24:46.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-10-25T16:24:46.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-10-25T16:24:46.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:42.030305+0000', 'last_change': '2023-10-25T16:24:42.030305+0000', 'last_active': '2023-10-25T16:24:42.030305+0000', 'last_peered': '2023-10-25T16:24:42.030305+0000', 'last_clean': '2023-10-25T16:24:42.030305+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:42.030305+0000', 'last_undegraded': '2023-10-25T16:24:42.030305+0000', 'last_fullsized': '2023-10-25T16:24:42.030305+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:42.030305+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-25T16:24:46.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-25T16:24:46.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-25T16:24:41.015416+0000', 'last_change': '2023-10-25T16:24:41.015416+0000', 'last_active': '2023-10-25T16:24:41.015416+0000', 'last_peered': '2023-10-25T16:24:41.015416+0000', 'last_clean': '2023-10-25T16:24:41.015416+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-25T16:24:41.015416+0000', 'last_undegraded': '2023-10-25T16:24:41.015416+0000', 'last_fullsized': '2023-10-25T16:24:41.015416+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'last_clean_scrub_stamp': '2023-10-25T16:24:41.015416+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-25T16:24:46.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-25T16:24:46.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 -- 172.21.15.177:0/1475292510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 msgr2=0x7fac30071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 --2- 172.21.15.177:0/1475292510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30071500 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fac20009900 tx=0x7fac2001c850 comp rx=0 tx=0).stop 2023-10-25T16:24:46.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 -- 172.21.15.177:0/1475292510 shutdown_connections 2023-10-25T16:24:46.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 --2- 172.21.15.177:0/1475292510 >> v2:172.21.15.184:3300/0 conn(0x7fac300cc610 0x7fac3006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 --2- 172.21.15.177:0/1475292510 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac30070510 0x7fac300cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 --2- 172.21.15.177:0/1475292510 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30071500 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 -- 172.21.15.177:0/1475292510 >> 172.21.15.177:0/1475292510 conn(0x7fac300b2450 msgr2=0x7fac300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:46.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 -- 172.21.15.177:0/1475292510 shutdown_connections 2023-10-25T16:24:46.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.978+0000 7fac36507640 1 -- 172.21.15.177:0/1475292510 wait complete. 2023-10-25T16:24:46.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 Processor -- start 2023-10-25T16:24:46.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- start start 2023-10-25T16:24:46.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac30070510 0x7fac301f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.982 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac300cc610 0x7fac300a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3014d2f0 con 0x7fac30159230 2023-10-25T16:24:46.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30153a50 con 0x7fac300cc610 2023-10-25T16:24:46.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac30151fe0 con 0x7fac30070510 2023-10-25T16:24:46.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37352/0 (socket says 172.21.15.177:37352) 2023-10-25T16:24:46.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 -- 172.21.15.177:0/1754144850 learned_addr learned my addr 172.21.15.177:0/1754144850 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:46.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2ffff640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac30070510 0x7fac301f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 -- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac30070510 msgr2=0x7fac301f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac30070510 0x7fac301f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2f7fe640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac300cc610 0x7fac300a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 -- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac300cc610 msgr2=0x7fac300a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:46.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac300cc610 0x7fac300a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:46.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 -- 172.21.15.177:0/1754144850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009560 con 0x7fac30159230 2023-10-25T16:24:46.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2f7fe640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac300cc610 0x7fac300a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:46.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac34aa4640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30151aa0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fac2800cd10 tx=0x7fac2800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:46.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28004b30 con 0x7fac30159230 2023-10-25T16:24:46.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac28004da0 con 0x7fac30159230 2023-10-25T16:24:46.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac301f6070 con 0x7fac30159230 2023-10-25T16:24:46.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28005280 con 0x7fac30159230 2023-10-25T16:24:46.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac301f6630 con 0x7fac30159230 2023-10-25T16:24:46.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3014d430 con 0x7fac30159230 2023-10-25T16:24:46.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.982+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac280053e0 con 0x7fac30159230 2023-10-25T16:24:46.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.986+0000 7fac2cff9640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac100664a0 0x7fac10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:46.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.986+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac28084630 con 0x7fac30159230 2023-10-25T16:24:46.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.986+0000 7fac2ffff640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac100664a0 0x7fac10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:46.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.986+0000 7fac2ffff640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac100664a0 0x7fac10068960 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fac200af000 tx=0x7fac2001b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:46.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:46.990+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac3014d430 con 0x7fac30159230 2023-10-25T16:24:47.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.182+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fac3014d430 con 0x7fac30159230 2023-10-25T16:24:47.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac2cff9640 1 -- 172.21.15.177:0/1754144850 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7fac2801d410 con 0x7fac30159230 2023-10-25T16:24:47.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:47.183 INFO:teuthology.orchestra.run.smithi177.stdout:{"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":718,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":190,"num_osds":8,"num_up_osds":8,"osd_up_since":1698250375,"num_in_osds":8,"osd_in_since":1698250371,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":9763100,"bytes_avail":1590236900,"bytes_total":1600000000,"write_bytes_sec":2461,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":72,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":156302}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-10-25T16:24:26.848426+0000","services":{}},"progress_events":{}} 2023-10-25T16:24:47.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac100664a0 msgr2=0x7fac10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac100664a0 0x7fac10068960 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fac200af000 tx=0x7fac2001b090 comp rx=0 tx=0).stop 2023-10-25T16:24:47.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 msgr2=0x7fac30151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.185 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30151aa0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fac2800cd10 tx=0x7fac2800a620 comp rx=0 tx=0).stop 2023-10-25T16:24:47.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 shutdown_connections 2023-10-25T16:24:47.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fac100664a0 0x7fac10068960 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac30159230 0x7fac30151aa0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac300cc610 0x7fac300a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 --2- 172.21.15.177:0/1754144850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fac30070510 0x7fac301f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 >> 172.21.15.177:0/1754144850 conn(0x7fac300b2450 msgr2=0x7fac300b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:47.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 shutdown_connections 2023-10-25T16:24:47.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.186+0000 7fac36507640 1 -- 172.21.15.177:0/1754144850 wait complete. 2023-10-25T16:24:47.200 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-25T16:24:47.200 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:24:47.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/2705868995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb7c0047d0 msgr2=0x7ffb7c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/2705868995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb7c0047d0 0x7ffb7c004c50 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00bb10 tx=0x7ffb8c01cd80 comp rx=0 tx=0).stop 2023-10-25T16:24:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/2705868995 shutdown_connections 2023-10-25T16:24:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/2705868995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb7c0047d0 0x7ffb7c004c50 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/2705868995 >> 172.21.15.177:0/2705868995 conn(0x7ffb9009a5c0 msgr2=0x7ffb900d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:47.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/2705868995 shutdown_connections 2023-10-25T16:24:47.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/2705868995 wait complete. 2023-10-25T16:24:47.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 Processor -- start 2023-10-25T16:24:47.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- start start 2023-10-25T16:24:47.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb7c0047d0 0x7ffb901f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:47.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb90156c80 0x7ffb901f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 0x7ffb90154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901f4e00 con 0x7ffb90154910 2023-10-25T16:24:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901552d0 con 0x7ffb7c0047d0 2023-10-25T16:24:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb901f5ea0 con 0x7ffb90156c80 2023-10-25T16:24:47.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 0x7ffb90154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 0x7ffb90154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:37378/0 (socket says 172.21.15.177:37378) 2023-10-25T16:24:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 -- 172.21.15.177:0/1063623961 learned_addr learned my addr 172.21.15.177:0/1063623961 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb95875640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb7c0047d0 0x7ffb901f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb95074640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb90156c80 0x7ffb901f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:47.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 -- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb90156c80 msgr2=0x7ffb901f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb90156c80 0x7ffb901f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 -- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb7c0047d0 msgr2=0x7ffb901f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb7c0047d0 0x7ffb901f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 -- 172.21.15.177:0/1063623961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90158270 con 0x7ffb90154910 2023-10-25T16:24:47.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb95875640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb7c0047d0 0x7ffb901f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb95074640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb90156c80 0x7ffb901f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb96076640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 0x7ffb90154d90 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7ffb9008ac30 tx=0x7ffb8800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88006d20 con 0x7ffb90154910 2023-10-25T16:24:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffb88003980 con 0x7ffb90154910 2023-10-25T16:24:47.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb901571d0 con 0x7ffb90154910 2023-10-25T16:24:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88003d90 con 0x7ffb90154910 2023-10-25T16:24:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.314+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb90157790 con 0x7ffb90154910 2023-10-25T16:24:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.318+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9004daf0 con 0x7ffb90154910 2023-10-25T16:24:47.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.318+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffb88005110 con 0x7ffb90154910 2023-10-25T16:24:47.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.318+0000 7ffb867fc640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb74066470 0x7ffb74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:47.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.318+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb880831a0 con 0x7ffb90154910 2023-10-25T16:24:47.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.318+0000 7ffb95875640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb74066470 0x7ffb74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:47.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.318+0000 7ffb95875640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb74066470 0x7ffb74068930 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffb900b71d0 tx=0x7ffb80009840 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:47.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.322+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb880506b0 con 0x7ffb90154910 2023-10-25T16:24:47.468 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.470+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb900ce930 con 0x7ffb74066470 2023-10-25T16:24:47.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.494+0000 7ffb867fc640 1 -- 172.21.15.177:0/1063623961 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283917 (secure 0 0 0) 0x7ffb900ce930 con 0x7ffb74066470 2023-10-25T16:24:47.492 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:47.494 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:24:47.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb74066470 msgr2=0x7ffb74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb74066470 0x7ffb74068930 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffb900b71d0 tx=0x7ffb80009840 comp rx=0 tx=0).stop 2023-10-25T16:24:47.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 msgr2=0x7ffb90154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:47.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 0x7ffb90154d90 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7ffb9008ac30 tx=0x7ffb8800cb70 comp rx=0 tx=0).stop 2023-10-25T16:24:47.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 shutdown_connections 2023-10-25T16:24:47.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ffb74066470 0x7ffb74068930 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffb90154910 0x7ffb90154d90 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffb90156c80 0x7ffb901f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 --2- 172.21.15.177:0/1063623961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb7c0047d0 0x7ffb901f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:47.497 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 >> 172.21.15.177:0/1063623961 conn(0x7ffb9009a5c0 msgr2=0x7ffb9015dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:47.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 shutdown_connections 2023-10-25T16:24:47.498 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:47.498+0000 7ffb97ad9640 1 -- 172.21.15.177:0/1063623961 wait complete. 2023-10-25T16:24:47.512 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2023-10-25T16:24:46.854430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552965,"statfs":{"total":1600000000,"available":1590236900,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824293"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.852334+0000","last_change":"2023-10-25T16:24:42.852173+0000","last_active":"2023-10-25T16:24:42.852334+0000","last_peered":"2023-10-25T16:24:42.852334+0000","last_clean":"2023-10-25T16:24:42.852334+0000","last_became_active":"2023-10-25T16:24:42.851355+0000","last_became_peered":"2023-10-25T16:24:42.851355+0000","last_unstale":"2023-10-25T16:24:42.852334+0000","last_undegraded":"2023-10-25T16:24:42.852334+0000","last_fullsized":"2023-10-25T16:24:42.852334+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:49:09.241487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001000+0000","last_change":"2023-10-25T16:24:42.858773+0000","last_active":"2023-10-25T16:24:44.001000+0000","last_peered":"2023-10-25T16:24:44.001000+0000","last_clean":"2023-10-25T16:24:44.001000+0000","last_became_active":"2023-10-25T16:24:42.856251+0000","last_became_peered":"2023-10-25T16:24:42.856251+0000","last_unstale":"2023-10-25T16:24:44.001000+0000","last_undegraded":"2023-10-25T16:24:44.001000+0000","last_fullsized":"2023-10-25T16:24:44.001000+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:12:19.931412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840078+0000","last_change":"2023-10-25T16:24:42.861846+0000","last_active":"2023-10-25T16:24:43.840078+0000","last_peered":"2023-10-25T16:24:43.840078+0000","last_clean":"2023-10-25T16:24:43.840078+0000","last_became_active":"2023-10-25T16:24:42.854537+0000","last_became_peered":"2023-10-25T16:24:42.854537+0000","last_unstale":"2023-10-25T16:24:43.840078+0000","last_undegraded":"2023-10-25T16:24:43.840078+0000","last_fullsized":"2023-10-25T16:24:43.840078+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:00.987103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.847730+0000","last_change":"2023-10-25T16:24:42.843047+0000","last_active":"2023-10-25T16:24:42.847730+0000","last_peered":"2023-10-25T16:24:42.847730+0000","last_clean":"2023-10-25T16:24:42.847730+0000","last_became_active":"2023-10-25T16:24:42.842526+0000","last_became_peered":"2023-10-25T16:24:42.842526+0000","last_unstale":"2023-10-25T16:24:42.847730+0000","last_undegraded":"2023-10-25T16:24:42.847730+0000","last_fullsized":"2023-10-25T16:24:42.847730+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:57.651679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.000810+0000","last_change":"2023-10-25T16:24:42.843387+0000","last_active":"2023-10-25T16:24:44.000810+0000","last_peered":"2023-10-25T16:24:44.000810+0000","last_clean":"2023-10-25T16:24:44.000810+0000","last_became_active":"2023-10-25T16:24:42.840194+0000","last_became_peered":"2023-10-25T16:24:42.840194+0000","last_unstale":"2023-10-25T16:24:44.000810+0000","last_undegraded":"2023-10-25T16:24:44.000810+0000","last_fullsized":"2023-10-25T16:24:44.000810+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:35:14.111718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587594+0000","last_change":"2023-10-25T16:24:42.851690+0000","last_active":"2023-10-25T16:24:45.587594+0000","last_peered":"2023-10-25T16:24:45.587594+0000","last_clean":"2023-10-25T16:24:45.587594+0000","last_became_active":"2023-10-25T16:24:42.851061+0000","last_became_peered":"2023-10-25T16:24:42.851061+0000","last_unstale":"2023-10-25T16:24:45.587594+0000","last_undegraded":"2023-10-25T16:24:45.587594+0000","last_fullsized":"2023-10-25T16:24:45.587594+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:36.359256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370995+0000","last_change":"2023-10-25T16:24:42.848819+0000","last_active":"2023-10-25T16:24:44.370995+0000","last_peered":"2023-10-25T16:24:44.370995+0000","last_clean":"2023-10-25T16:24:44.370995+0000","last_became_active":"2023-10-25T16:24:42.847037+0000","last_became_peered":"2023-10-25T16:24:42.847037+0000","last_unstale":"2023-10-25T16:24:44.370995+0000","last_undegraded":"2023-10-25T16:24:44.370995+0000","last_fullsized":"2023-10-25T16:24:44.370995+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.000615+0000","last_change":"2023-10-25T16:24:42.849286+0000","last_active":"2023-10-25T16:24:44.000615+0000","last_peered":"2023-10-25T16:24:44.000615+0000","last_clean":"2023-10-25T16:24:44.000615+0000","last_became_active":"2023-10-25T16:24:42.848499+0000","last_became_peered":"2023-10-25T16:24:42.848499+0000","last_unstale":"2023-10-25T16:24:44.000615+0000","last_undegraded":"2023-10-25T16:24:44.000615+0000","last_fullsized":"2023-10-25T16:24:44.000615+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:32.372441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001304+0000","last_change":"2023-10-25T16:24:42.859369+0000","last_active":"2023-10-25T16:24:44.001304+0000","last_peered":"2023-10-25T16:24:44.001304+0000","last_clean":"2023-10-25T16:24:44.001304+0000","last_became_active":"2023-10-25T16:24:42.857256+0000","last_became_peered":"2023-10-25T16:24:42.857256+0000","last_unstale":"2023-10-25T16:24:44.001304+0000","last_undegraded":"2023-10-25T16:24:44.001304+0000","last_fullsized":"2023-10-25T16:24:44.001304+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:11.400342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001204+0000","last_change":"2023-10-25T16:24:42.848142+0000","last_active":"2023-10-25T16:24:44.001204+0000","last_peered":"2023-10-25T16:24:44.001204+0000","last_clean":"2023-10-25T16:24:44.001204+0000","last_became_active":"2023-10-25T16:24:42.847512+0000","last_became_peered":"2023-10-25T16:24:42.847512+0000","last_unstale":"2023-10-25T16:24:44.001204+0000","last_undegraded":"2023-10-25T16:24:44.001204+0000","last_fullsized":"2023-10-25T16:24:44.001204+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:52:50.695961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001115+0000","last_change":"2023-10-25T16:24:42.842309+0000","last_active":"2023-10-25T16:24:44.001115+0000","last_peered":"2023-10-25T16:24:44.001115+0000","last_clean":"2023-10-25T16:24:44.001115+0000","last_became_active":"2023-10-25T16:24:42.840404+0000","last_became_peered":"2023-10-25T16:24:42.840404+0000","last_unstale":"2023-10-25T16:24:44.001115+0000","last_undegraded":"2023-10-25T16:24:44.001115+0000","last_fullsized":"2023-10-25T16:24:44.001115+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:00:31.815757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001329+0000","last_change":"2023-10-25T16:24:42.858228+0000","last_active":"2023-10-25T16:24:44.001329+0000","last_peered":"2023-10-25T16:24:44.001329+0000","last_clean":"2023-10-25T16:24:44.001329+0000","last_became_active":"2023-10-25T16:24:42.848919+0000","last_became_peered":"2023-10-25T16:24:42.848919+0000","last_unstale":"2023-10-25T16:24:44.001329+0000","last_undegraded":"2023-10-25T16:24:44.001329+0000","last_fullsized":"2023-10-25T16:24:44.001329+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:05.047844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839250+0000","last_change":"2023-10-25T16:24:42.862412+0000","last_active":"2023-10-25T16:24:43.839250+0000","last_peered":"2023-10-25T16:24:43.839250+0000","last_clean":"2023-10-25T16:24:43.839250+0000","last_became_active":"2023-10-25T16:24:42.855977+0000","last_became_peered":"2023-10-25T16:24:42.855977+0000","last_unstale":"2023-10-25T16:24:43.839250+0000","last_undegraded":"2023-10-25T16:24:43.839250+0000","last_fullsized":"2023-10-25T16:24:43.839250+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:09:33.940751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838984+0000","last_change":"2023-10-25T16:24:42.853702+0000","last_active":"2023-10-25T16:24:43.838984+0000","last_peered":"2023-10-25T16:24:43.838984+0000","last_clean":"2023-10-25T16:24:43.838984+0000","last_became_active":"2023-10-25T16:24:42.852854+0000","last_became_peered":"2023-10-25T16:24:42.852854+0000","last_unstale":"2023-10-25T16:24:43.838984+0000","last_undegraded":"2023-10-25T16:24:43.838984+0000","last_fullsized":"2023-10-25T16:24:43.838984+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:44.049135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.838149+0000","last_change":"2023-10-25T16:24:42.837972+0000","last_active":"2023-10-25T16:24:42.838149+0000","last_peered":"2023-10-25T16:24:42.838149+0000","last_clean":"2023-10-25T16:24:42.838149+0000","last_became_active":"2023-10-25T16:24:42.837199+0000","last_became_peered":"2023-10-25T16:24:42.837199+0000","last_unstale":"2023-10-25T16:24:42.838149+0000","last_undegraded":"2023-10-25T16:24:42.838149+0000","last_fullsized":"2023-10-25T16:24:42.838149+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:24:36.766938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370667+0000","last_change":"2023-10-25T16:24:42.844979+0000","last_active":"2023-10-25T16:24:44.370667+0000","last_peered":"2023-10-25T16:24:44.370667+0000","last_clean":"2023-10-25T16:24:44.370667+0000","last_became_active":"2023-10-25T16:24:42.843262+0000","last_became_peered":"2023-10-25T16:24:42.843262+0000","last_unstale":"2023-10-25T16:24:44.370667+0000","last_undegraded":"2023-10-25T16:24:44.370667+0000","last_fullsized":"2023-10-25T16:24:44.370667+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587590+0000","last_change":"2023-10-25T16:24:42.860500+0000","last_active":"2023-10-25T16:24:45.587590+0000","last_peered":"2023-10-25T16:24:45.587590+0000","last_clean":"2023-10-25T16:24:45.587590+0000","last_became_active":"2023-10-25T16:24:42.859882+0000","last_became_peered":"2023-10-25T16:24:42.859882+0000","last_unstale":"2023-10-25T16:24:45.587590+0000","last_undegraded":"2023-10-25T16:24:45.587590+0000","last_fullsized":"2023-10-25T16:24:45.587590+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:54:55.948683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839092+0000","last_change":"2023-10-25T16:24:42.850227+0000","last_active":"2023-10-25T16:24:43.839092+0000","last_peered":"2023-10-25T16:24:43.839092+0000","last_clean":"2023-10-25T16:24:43.839092+0000","last_became_active":"2023-10-25T16:24:42.849610+0000","last_became_peered":"2023-10-25T16:24:42.849610+0000","last_unstale":"2023-10-25T16:24:43.839092+0000","last_undegraded":"2023-10-25T16:24:43.839092+0000","last_fullsized":"2023-10-25T16:24:43.839092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587535+0000","last_change":"2023-10-25T16:24:42.853681+0000","last_active":"2023-10-25T16:24:45.587535+0000","last_peered":"2023-10-25T16:24:45.587535+0000","last_clean":"2023-10-25T16:24:45.587535+0000","last_became_active":"2023-10-25T16:24:42.852938+0000","last_became_peered":"2023-10-25T16:24:42.852938+0000","last_unstale":"2023-10-25T16:24:45.587535+0000","last_undegraded":"2023-10-25T16:24:45.587535+0000","last_fullsized":"2023-10-25T16:24:45.587535+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:31.921921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839133+0000","last_change":"2023-10-25T16:24:42.854510+0000","last_active":"2023-10-25T16:24:43.839133+0000","last_peered":"2023-10-25T16:24:43.839133+0000","last_clean":"2023-10-25T16:24:43.839133+0000","last_became_active":"2023-10-25T16:24:42.852757+0000","last_became_peered":"2023-10-25T16:24:42.852757+0000","last_unstale":"2023-10-25T16:24:43.839133+0000","last_undegraded":"2023-10-25T16:24:43.839133+0000","last_fullsized":"2023-10-25T16:24:43.839133+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:51:05.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587748+0000","last_change":"2023-10-25T16:24:42.861649+0000","last_active":"2023-10-25T16:24:45.587748+0000","last_peered":"2023-10-25T16:24:45.587748+0000","last_clean":"2023-10-25T16:24:45.587748+0000","last_became_active":"2023-10-25T16:24:42.861033+0000","last_became_peered":"2023-10-25T16:24:42.861033+0000","last_unstale":"2023-10-25T16:24:45.587748+0000","last_undegraded":"2023-10-25T16:24:45.587748+0000","last_fullsized":"2023-10-25T16:24:45.587748+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:40:25.199038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001510+0000","last_change":"2023-10-25T16:24:42.859341+0000","last_active":"2023-10-25T16:24:44.001510+0000","last_peered":"2023-10-25T16:24:44.001510+0000","last_clean":"2023-10-25T16:24:44.001510+0000","last_became_active":"2023-10-25T16:24:42.857437+0000","last_became_peered":"2023-10-25T16:24:42.857437+0000","last_unstale":"2023-10-25T16:24:44.001510+0000","last_undegraded":"2023-10-25T16:24:44.001510+0000","last_fullsized":"2023-10-25T16:24:44.001510+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:14.474413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587601+0000","last_change":"2023-10-25T16:24:42.856407+0000","last_active":"2023-10-25T16:24:45.587601+0000","last_peered":"2023-10-25T16:24:45.587601+0000","last_clean":"2023-10-25T16:24:45.587601+0000","last_became_active":"2023-10-25T16:24:42.855666+0000","last_became_peered":"2023-10-25T16:24:42.855666+0000","last_unstale":"2023-10-25T16:24:45.587601+0000","last_undegraded":"2023-10-25T16:24:45.587601+0000","last_fullsized":"2023-10-25T16:24:45.587601+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:12.086838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.000630+0000","last_change":"2023-10-25T16:24:42.861077+0000","last_active":"2023-10-25T16:24:44.000630+0000","last_peered":"2023-10-25T16:24:44.000630+0000","last_clean":"2023-10-25T16:24:44.000630+0000","last_became_active":"2023-10-25T16:24:42.858740+0000","last_became_peered":"2023-10-25T16:24:42.858740+0000","last_unstale":"2023-10-25T16:24:44.000630+0000","last_undegraded":"2023-10-25T16:24:44.000630+0000","last_fullsized":"2023-10-25T16:24:44.000630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:45:27.351555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839450+0000","last_change":"2023-10-25T16:24:42.845872+0000","last_active":"2023-10-25T16:24:43.839450+0000","last_peered":"2023-10-25T16:24:43.839450+0000","last_clean":"2023-10-25T16:24:43.839450+0000","last_became_active":"2023-10-25T16:24:42.845023+0000","last_became_peered":"2023-10-25T16:24:42.845023+0000","last_unstale":"2023-10-25T16:24:43.839450+0000","last_undegraded":"2023-10-25T16:24:43.839450+0000","last_fullsized":"2023-10-25T16:24:43.839450+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:03.997283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370513+0000","last_change":"2023-10-25T16:24:42.861119+0000","last_active":"2023-10-25T16:24:44.370513+0000","last_peered":"2023-10-25T16:24:44.370513+0000","last_clean":"2023-10-25T16:24:44.370513+0000","last_became_active":"2023-10-25T16:24:42.858569+0000","last_became_peered":"2023-10-25T16:24:42.858569+0000","last_unstale":"2023-10-25T16:24:44.370513+0000","last_undegraded":"2023-10-25T16:24:44.370513+0000","last_fullsized":"2023-10-25T16:24:44.370513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:46:47.363848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839063+0000","last_change":"2023-10-25T16:24:42.860654+0000","last_active":"2023-10-25T16:24:43.839063+0000","last_peered":"2023-10-25T16:24:43.839063+0000","last_clean":"2023-10-25T16:24:43.839063+0000","last_became_active":"2023-10-25T16:24:42.859870+0000","last_became_peered":"2023-10-25T16:24:42.859870+0000","last_unstale":"2023-10-25T16:24:43.839063+0000","last_undegraded":"2023-10-25T16:24:43.839063+0000","last_fullsized":"2023-10-25T16:24:43.839063+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:16.869498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.847591+0000","last_change":"2023-10-25T16:24:42.837207+0000","last_active":"2023-10-25T16:24:42.847591+0000","last_peered":"2023-10-25T16:24:42.847591+0000","last_clean":"2023-10-25T16:24:42.847591+0000","last_became_active":"2023-10-25T16:24:42.836579+0000","last_became_peered":"2023-10-25T16:24:42.836579+0000","last_unstale":"2023-10-25T16:24:42.847591+0000","last_undegraded":"2023-10-25T16:24:42.847591+0000","last_fullsized":"2023-10-25T16:24:42.847591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:38:20.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839311+0000","last_change":"2023-10-25T16:24:42.860673+0000","last_active":"2023-10-25T16:24:43.839311+0000","last_peered":"2023-10-25T16:24:43.839311+0000","last_clean":"2023-10-25T16:24:43.839311+0000","last_became_active":"2023-10-25T16:24:42.859812+0000","last_became_peered":"2023-10-25T16:24:42.859812+0000","last_unstale":"2023-10-25T16:24:43.839311+0000","last_undegraded":"2023-10-25T16:24:43.839311+0000","last_fullsized":"2023-10-25T16:24:43.839311+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:38:30.787855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.838906+0000","last_change":"2023-10-25T16:24:42.832357+0000","last_active":"2023-10-25T16:24:42.838906+0000","last_peered":"2023-10-25T16:24:42.838906+0000","last_clean":"2023-10-25T16:24:42.838906+0000","last_became_active":"2023-10-25T16:24:42.831742+0000","last_became_peered":"2023-10-25T16:24:42.831742+0000","last_unstale":"2023-10-25T16:24:42.838906+0000","last_undegraded":"2023-10-25T16:24:42.838906+0000","last_fullsized":"2023-10-25T16:24:42.838906+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:14:40.883143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.845462+0000","last_change":"2023-10-25T16:24:42.843628+0000","last_active":"2023-10-25T16:24:42.845462+0000","last_peered":"2023-10-25T16:24:42.845462+0000","last_clean":"2023-10-25T16:24:42.845462+0000","last_became_active":"2023-10-25T16:24:42.841826+0000","last_became_peered":"2023-10-25T16:24:42.841826+0000","last_unstale":"2023-10-25T16:24:42.845462+0000","last_undegraded":"2023-10-25T16:24:42.845462+0000","last_fullsized":"2023-10-25T16:24:42.845462+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:31.053947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838846+0000","last_change":"2023-10-25T16:24:42.847781+0000","last_active":"2023-10-25T16:24:43.838846+0000","last_peered":"2023-10-25T16:24:43.838846+0000","last_clean":"2023-10-25T16:24:43.838846+0000","last_became_active":"2023-10-25T16:24:42.846775+0000","last_became_peered":"2023-10-25T16:24:42.846775+0000","last_unstale":"2023-10-25T16:24:43.838846+0000","last_undegraded":"2023-10-25T16:24:43.838846+0000","last_fullsized":"2023-10-25T16:24:43.838846+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370169+0000","last_change":"2023-10-25T16:24:42.860236+0000","last_active":"2023-10-25T16:24:44.370169+0000","last_peered":"2023-10-25T16:24:44.370169+0000","last_clean":"2023-10-25T16:24:44.370169+0000","last_became_active":"2023-10-25T16:24:42.859552+0000","last_became_peered":"2023-10-25T16:24:42.859552+0000","last_unstale":"2023-10-25T16:24:44.370169+0000","last_undegraded":"2023-10-25T16:24:44.370169+0000","last_fullsized":"2023-10-25T16:24:44.370169+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:32.387989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"189'4","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.086710+0000","last_change":"2023-10-25T16:24:42.061902+0000","last_active":"2023-10-25T16:24:43.086710+0000","last_peered":"2023-10-25T16:24:43.086710+0000","last_clean":"2023-10-25T16:24:43.086710+0000","last_became_active":"2023-10-25T16:24:42.061199+0000","last_became_peered":"2023-10-25T16:24:42.061199+0000","last_unstale":"2023-10-25T16:24:43.086710+0000","last_undegraded":"2023-10-25T16:24:43.086710+0000","last_fullsized":"2023-10-25T16:24:43.086710+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:32:04.583172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.848337+0000","last_change":"2023-10-25T16:24:42.847852+0000","last_active":"2023-10-25T16:24:42.848337+0000","last_peered":"2023-10-25T16:24:42.848337+0000","last_clean":"2023-10-25T16:24:42.848337+0000","last_became_active":"2023-10-25T16:24:42.846658+0000","last_became_peered":"2023-10-25T16:24:42.846658+0000","last_unstale":"2023-10-25T16:24:42.848337+0000","last_undegraded":"2023-10-25T16:24:42.848337+0000","last_fullsized":"2023-10-25T16:24:42.848337+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:04:21.778225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.082813+0000","last_change":"2023-10-25T16:24:42.070958+0000","last_active":"2023-10-25T16:24:43.082813+0000","last_peered":"2023-10-25T16:24:43.082813+0000","last_clean":"2023-10-25T16:24:43.082813+0000","last_became_active":"2023-10-25T16:24:42.070512+0000","last_became_peered":"2023-10-25T16:24:42.070512+0000","last_unstale":"2023-10-25T16:24:43.082813+0000","last_undegraded":"2023-10-25T16:24:43.082813+0000","last_fullsized":"2023-10-25T16:24:43.082813+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:53:49.147119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587864+0000","last_change":"2023-10-25T16:24:42.856521+0000","last_active":"2023-10-25T16:24:45.587864+0000","last_peered":"2023-10-25T16:24:45.587864+0000","last_clean":"2023-10-25T16:24:45.587864+0000","last_became_active":"2023-10-25T16:24:42.855899+0000","last_became_peered":"2023-10-25T16:24:42.855899+0000","last_unstale":"2023-10-25T16:24:45.587864+0000","last_undegraded":"2023-10-25T16:24:45.587864+0000","last_fullsized":"2023-10-25T16:24:45.587864+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:20:54.861337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.085217+0000","last_change":"2023-10-25T16:24:42.068928+0000","last_active":"2023-10-25T16:24:43.085217+0000","last_peered":"2023-10-25T16:24:43.085217+0000","last_clean":"2023-10-25T16:24:43.085217+0000","last_became_active":"2023-10-25T16:24:42.068607+0000","last_became_peered":"2023-10-25T16:24:42.068607+0000","last_unstale":"2023-10-25T16:24:43.085217+0000","last_undegraded":"2023-10-25T16:24:43.085217+0000","last_fullsized":"2023-10-25T16:24:43.085217+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:39:45.479638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839823+0000","last_change":"2023-10-25T16:24:42.854976+0000","last_active":"2023-10-25T16:24:43.839823+0000","last_peered":"2023-10-25T16:24:43.839823+0000","last_clean":"2023-10-25T16:24:43.839823+0000","last_became_active":"2023-10-25T16:24:42.853857+0000","last_became_peered":"2023-10-25T16:24:42.853857+0000","last_unstale":"2023-10-25T16:24:43.839823+0000","last_undegraded":"2023-10-25T16:24:43.839823+0000","last_fullsized":"2023-10-25T16:24:43.839823+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:47.166036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.089423+0000","last_change":"2023-10-25T16:24:42.055401+0000","last_active":"2023-10-25T16:24:43.089423+0000","last_peered":"2023-10-25T16:24:43.089423+0000","last_clean":"2023-10-25T16:24:43.089423+0000","last_became_active":"2023-10-25T16:24:42.055037+0000","last_became_peered":"2023-10-25T16:24:42.055037+0000","last_unstale":"2023-10-25T16:24:43.089423+0000","last_undegraded":"2023-10-25T16:24:43.089423+0000","last_fullsized":"2023-10-25T16:24:43.089423+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:16:26.466484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370308+0000","last_change":"2023-10-25T16:24:42.845248+0000","last_active":"2023-10-25T16:24:44.370308+0000","last_peered":"2023-10-25T16:24:44.370308+0000","last_clean":"2023-10-25T16:24:44.370308+0000","last_became_active":"2023-10-25T16:24:42.844563+0000","last_became_peered":"2023-10-25T16:24:42.844563+0000","last_unstale":"2023-10-25T16:24:44.370308+0000","last_undegraded":"2023-10-25T16:24:44.370308+0000","last_fullsized":"2023-10-25T16:24:44.370308+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:41.791943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"189'1","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839802+0000","last_change":"2023-10-25T16:24:42.062957+0000","last_active":"2023-10-25T16:24:43.839802+0000","last_peered":"2023-10-25T16:24:43.839802+0000","last_clean":"2023-10-25T16:24:43.839802+0000","last_became_active":"2023-10-25T16:24:42.055041+0000","last_became_peered":"2023-10-25T16:24:42.055041+0000","last_unstale":"2023-10-25T16:24:43.839802+0000","last_undegraded":"2023-10-25T16:24:43.839802+0000","last_fullsized":"2023-10-25T16:24:43.839802+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:02:39.842755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.852344+0000","last_change":"2023-10-25T16:24:42.851788+0000","last_active":"2023-10-25T16:24:42.852344+0000","last_peered":"2023-10-25T16:24:42.852344+0000","last_clean":"2023-10-25T16:24:42.852344+0000","last_became_active":"2023-10-25T16:24:42.850851+0000","last_became_peered":"2023-10-25T16:24:42.850851+0000","last_unstale":"2023-10-25T16:24:42.852344+0000","last_undegraded":"2023-10-25T16:24:42.852344+0000","last_fullsized":"2023-10-25T16:24:42.852344+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:31.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.084531+0000","last_change":"2023-10-25T16:24:42.057677+0000","last_active":"2023-10-25T16:24:43.084531+0000","last_peered":"2023-10-25T16:24:43.084531+0000","last_clean":"2023-10-25T16:24:43.084531+0000","last_became_active":"2023-10-25T16:24:42.054801+0000","last_became_peered":"2023-10-25T16:24:42.054801+0000","last_unstale":"2023-10-25T16:24:43.084531+0000","last_undegraded":"2023-10-25T16:24:43.084531+0000","last_fullsized":"2023-10-25T16:24:43.084531+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:06:53.610302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.847782+0000","last_change":"2023-10-25T16:24:42.843516+0000","last_active":"2023-10-25T16:24:42.847782+0000","last_peered":"2023-10-25T16:24:42.847782+0000","last_clean":"2023-10-25T16:24:42.847782+0000","last_became_active":"2023-10-25T16:24:42.838853+0000","last_became_peered":"2023-10-25T16:24:42.838853+0000","last_unstale":"2023-10-25T16:24:42.847782+0000","last_undegraded":"2023-10-25T16:24:42.847782+0000","last_fullsized":"2023-10-25T16:24:42.847782+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:12:41.358817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001052+0000","last_change":"2023-10-25T16:24:42.071561+0000","last_active":"2023-10-25T16:24:44.001052+0000","last_peered":"2023-10-25T16:24:44.001052+0000","last_clean":"2023-10-25T16:24:44.001052+0000","last_became_active":"2023-10-25T16:24:42.068567+0000","last_became_peered":"2023-10-25T16:24:42.068567+0000","last_unstale":"2023-10-25T16:24:44.001052+0000","last_undegraded":"2023-10-25T16:24:44.001052+0000","last_fullsized":"2023-10-25T16:24:44.001052+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:34.877508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587672+0000","last_change":"2023-10-25T16:24:42.852349+0000","last_active":"2023-10-25T16:24:45.587672+0000","last_peered":"2023-10-25T16:24:45.587672+0000","last_clean":"2023-10-25T16:24:45.587672+0000","last_became_active":"2023-10-25T16:24:42.848521+0000","last_became_peered":"2023-10-25T16:24:42.848521+0000","last_unstale":"2023-10-25T16:24:45.587672+0000","last_undegraded":"2023-10-25T16:24:45.587672+0000","last_fullsized":"2023-10-25T16:24:45.587672+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:46:58.305335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370749+0000","last_change":"2023-10-25T16:24:42.051870+0000","last_active":"2023-10-25T16:24:44.370749+0000","last_peered":"2023-10-25T16:24:44.370749+0000","last_clean":"2023-10-25T16:24:44.370749+0000","last_became_active":"2023-10-25T16:24:42.051571+0000","last_became_peered":"2023-10-25T16:24:42.051571+0000","last_unstale":"2023-10-25T16:24:44.370749+0000","last_undegraded":"2023-10-25T16:24:44.370749+0000","last_fullsized":"2023-10-25T16:24:44.370749+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:08.033543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839183+0000","last_change":"2023-10-25T16:24:42.856078+0000","last_active":"2023-10-25T16:24:43.839183+0000","last_peered":"2023-10-25T16:24:43.839183+0000","last_clean":"2023-10-25T16:24:43.839183+0000","last_became_active":"2023-10-25T16:24:42.855407+0000","last_became_peered":"2023-10-25T16:24:42.855407+0000","last_unstale":"2023-10-25T16:24:43.839183+0000","last_undegraded":"2023-10-25T16:24:43.839183+0000","last_fullsized":"2023-10-25T16:24:43.839183+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.844712+0000","last_change":"2023-10-25T16:24:42.066875+0000","last_active":"2023-10-25T16:24:42.844712+0000","last_peered":"2023-10-25T16:24:42.844712+0000","last_clean":"2023-10-25T16:24:42.844712+0000","last_became_active":"2023-10-25T16:24:42.066693+0000","last_became_peered":"2023-10-25T16:24:42.066693+0000","last_unstale":"2023-10-25T16:24:42.844712+0000","last_undegraded":"2023-10-25T16:24:42.844712+0000","last_fullsized":"2023-10-25T16:24:42.844712+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:01:43.854484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840160+0000","last_change":"2023-10-25T16:24:42.861748+0000","last_active":"2023-10-25T16:24:43.840160+0000","last_peered":"2023-10-25T16:24:43.840160+0000","last_clean":"2023-10-25T16:24:43.840160+0000","last_became_active":"2023-10-25T16:24:42.861078+0000","last_became_peered":"2023-10-25T16:24:42.861078+0000","last_unstale":"2023-10-25T16:24:43.840160+0000","last_undegraded":"2023-10-25T16:24:43.840160+0000","last_fullsized":"2023-10-25T16:24:43.840160+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:11.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"189'3","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.083539+0000","last_change":"2023-10-25T16:24:42.051888+0000","last_active":"2023-10-25T16:24:43.083539+0000","last_peered":"2023-10-25T16:24:43.083539+0000","last_clean":"2023-10-25T16:24:43.083539+0000","last_became_active":"2023-10-25T16:24:42.051446+0000","last_became_peered":"2023-10-25T16:24:42.051446+0000","last_unstale":"2023-10-25T16:24:43.083539+0000","last_undegraded":"2023-10-25T16:24:43.083539+0000","last_fullsized":"2023-10-25T16:24:43.083539+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:30:17.027270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.863516+0000","last_change":"2023-10-25T16:24:42.863347+0000","last_active":"2023-10-25T16:24:42.863516+0000","last_peered":"2023-10-25T16:24:42.863516+0000","last_clean":"2023-10-25T16:24:42.863516+0000","last_became_active":"2023-10-25T16:24:42.862649+0000","last_became_peered":"2023-10-25T16:24:42.862649+0000","last_unstale":"2023-10-25T16:24:42.863516+0000","last_undegraded":"2023-10-25T16:24:42.863516+0000","last_fullsized":"2023-10-25T16:24:42.863516+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:45:41.384771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"189'6","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.084913+0000","last_change":"2023-10-25T16:24:42.053002+0000","last_active":"2023-10-25T16:24:43.084913+0000","last_peered":"2023-10-25T16:24:43.084913+0000","last_clean":"2023-10-25T16:24:43.084913+0000","last_became_active":"2023-10-25T16:24:42.052021+0000","last_became_peered":"2023-10-25T16:24:42.052021+0000","last_unstale":"2023-10-25T16:24:43.084913+0000","last_undegraded":"2023-10-25T16:24:43.084913+0000","last_fullsized":"2023-10-25T16:24:43.084913+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:29:36.510860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839398+0000","last_change":"2023-10-25T16:24:42.846556+0000","last_active":"2023-10-25T16:24:43.839398+0000","last_peered":"2023-10-25T16:24:43.839398+0000","last_clean":"2023-10-25T16:24:43.839398+0000","last_became_active":"2023-10-25T16:24:42.845900+0000","last_became_peered":"2023-10-25T16:24:42.845900+0000","last_unstale":"2023-10-25T16:24:43.839398+0000","last_undegraded":"2023-10-25T16:24:43.839398+0000","last_fullsized":"2023-10-25T16:24:43.839398+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:38:24.488319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.085557+0000","last_change":"2023-10-25T16:24:42.056643+0000","last_active":"2023-10-25T16:24:43.085557+0000","last_peered":"2023-10-25T16:24:43.085557+0000","last_clean":"2023-10-25T16:24:43.085557+0000","last_became_active":"2023-10-25T16:24:42.055970+0000","last_became_peered":"2023-10-25T16:24:42.055970+0000","last_unstale":"2023-10-25T16:24:43.085557+0000","last_undegraded":"2023-10-25T16:24:43.085557+0000","last_fullsized":"2023-10-25T16:24:43.085557+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:42:17.599679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370539+0000","last_change":"2023-10-25T16:24:42.858156+0000","last_active":"2023-10-25T16:24:44.370539+0000","last_peered":"2023-10-25T16:24:44.370539+0000","last_clean":"2023-10-25T16:24:44.370539+0000","last_became_active":"2023-10-25T16:24:42.857459+0000","last_became_peered":"2023-10-25T16:24:42.857459+0000","last_unstale":"2023-10-25T16:24:44.370539+0000","last_undegraded":"2023-10-25T16:24:44.370539+0000","last_fullsized":"2023-10-25T16:24:44.370539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839510+0000","last_change":"2023-10-25T16:24:42.049822+0000","last_active":"2023-10-25T16:24:43.839510+0000","last_peered":"2023-10-25T16:24:43.839510+0000","last_clean":"2023-10-25T16:24:43.839510+0000","last_became_active":"2023-10-25T16:24:42.049364+0000","last_became_peered":"2023-10-25T16:24:42.049364+0000","last_unstale":"2023-10-25T16:24:43.839510+0000","last_undegraded":"2023-10-25T16:24:43.839510+0000","last_fullsized":"2023-10-25T16:24:43.839510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:17.596897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.865888+0000","last_change":"2023-10-25T16:24:42.865754+0000","last_active":"2023-10-25T16:24:42.865888+0000","last_peered":"2023-10-25T16:24:42.865888+0000","last_clean":"2023-10-25T16:24:42.865888+0000","last_became_active":"2023-10-25T16:24:42.865228+0000","last_became_peered":"2023-10-25T16:24:42.865228+0000","last_unstale":"2023-10-25T16:24:42.865888+0000","last_undegraded":"2023-10-25T16:24:42.865888+0000","last_fullsized":"2023-10-25T16:24:42.865888+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:49:25.462564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.829618+0000","last_change":"2023-10-25T16:24:42.071322+0000","last_active":"2023-10-25T16:24:42.829618+0000","last_peered":"2023-10-25T16:24:42.829618+0000","last_clean":"2023-10-25T16:24:42.829618+0000","last_became_active":"2023-10-25T16:24:42.071168+0000","last_became_peered":"2023-10-25T16:24:42.071168+0000","last_unstale":"2023-10-25T16:24:42.829618+0000","last_undegraded":"2023-10-25T16:24:42.829618+0000","last_fullsized":"2023-10-25T16:24:42.829618+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:01:18.376929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839388+0000","last_change":"2023-10-25T16:24:42.855034+0000","last_active":"2023-10-25T16:24:43.839388+0000","last_peered":"2023-10-25T16:24:43.839388+0000","last_clean":"2023-10-25T16:24:43.839388+0000","last_became_active":"2023-10-25T16:24:42.854238+0000","last_became_peered":"2023-10-25T16:24:42.854238+0000","last_unstale":"2023-10-25T16:24:43.839388+0000","last_undegraded":"2023-10-25T16:24:43.839388+0000","last_fullsized":"2023-10-25T16:24:43.839388+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:54:59.624115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"189'8","reported_seq":19,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.083878+0000","last_change":"2023-10-25T16:24:42.057408+0000","last_active":"2023-10-25T16:24:43.083878+0000","last_peered":"2023-10-25T16:24:43.083878+0000","last_clean":"2023-10-25T16:24:43.083878+0000","last_became_active":"2023-10-25T16:24:42.056223+0000","last_became_peered":"2023-10-25T16:24:42.056223+0000","last_unstale":"2023-10-25T16:24:43.083878+0000","last_undegraded":"2023-10-25T16:24:43.083878+0000","last_fullsized":"2023-10-25T16:24:43.083878+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:06:19.037181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.859934+0000","last_change":"2023-10-25T16:24:42.857710+0000","last_active":"2023-10-25T16:24:42.859934+0000","last_peered":"2023-10-25T16:24:42.859934+0000","last_clean":"2023-10-25T16:24:42.859934+0000","last_became_active":"2023-10-25T16:24:42.857124+0000","last_became_peered":"2023-10-25T16:24:42.857124+0000","last_unstale":"2023-10-25T16:24:42.859934+0000","last_undegraded":"2023-10-25T16:24:42.859934+0000","last_fullsized":"2023-10-25T16:24:42.859934+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:06:29.589276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"189'1","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839883+0000","last_change":"2023-10-25T16:24:42.067556+0000","last_active":"2023-10-25T16:24:43.839883+0000","last_peered":"2023-10-25T16:24:43.839883+0000","last_clean":"2023-10-25T16:24:43.839883+0000","last_became_active":"2023-10-25T16:24:42.066946+0000","last_became_peered":"2023-10-25T16:24:42.066946+0000","last_unstale":"2023-10-25T16:24:43.839883+0000","last_undegraded":"2023-10-25T16:24:43.839883+0000","last_fullsized":"2023-10-25T16:24:43.839883+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:05.861144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839189+0000","last_change":"2023-10-25T16:24:42.848132+0000","last_active":"2023-10-25T16:24:43.839189+0000","last_peered":"2023-10-25T16:24:43.839189+0000","last_clean":"2023-10-25T16:24:43.839189+0000","last_became_active":"2023-10-25T16:24:42.847148+0000","last_became_peered":"2023-10-25T16:24:42.847148+0000","last_unstale":"2023-10-25T16:24:43.839189+0000","last_undegraded":"2023-10-25T16:24:43.839189+0000","last_fullsized":"2023-10-25T16:24:43.839189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840171+0000","last_change":"2023-10-25T16:24:42.057510+0000","last_active":"2023-10-25T16:24:43.840171+0000","last_peered":"2023-10-25T16:24:43.840171+0000","last_clean":"2023-10-25T16:24:43.840171+0000","last_became_active":"2023-10-25T16:24:42.040866+0000","last_became_peered":"2023-10-25T16:24:42.040866+0000","last_unstale":"2023-10-25T16:24:43.840171+0000","last_undegraded":"2023-10-25T16:24:43.840171+0000","last_fullsized":"2023-10-25T16:24:43.840171+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:40:00.918272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.852305+0000","last_change":"2023-10-25T16:24:42.851461+0000","last_active":"2023-10-25T16:24:42.852305+0000","last_peered":"2023-10-25T16:24:42.852305+0000","last_clean":"2023-10-25T16:24:42.852305+0000","last_became_active":"2023-10-25T16:24:42.849940+0000","last_became_peered":"2023-10-25T16:24:42.849940+0000","last_unstale":"2023-10-25T16:24:42.852305+0000","last_undegraded":"2023-10-25T16:24:42.852305+0000","last_fullsized":"2023-10-25T16:24:42.852305+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:53:05.867641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.083300+0000","last_change":"2023-10-25T16:24:42.070242+0000","last_active":"2023-10-25T16:24:43.083300+0000","last_peered":"2023-10-25T16:24:43.083300+0000","last_clean":"2023-10-25T16:24:43.083300+0000","last_became_active":"2023-10-25T16:24:42.067930+0000","last_became_peered":"2023-10-25T16:24:42.067930+0000","last_unstale":"2023-10-25T16:24:43.083300+0000","last_undegraded":"2023-10-25T16:24:43.083300+0000","last_fullsized":"2023-10-25T16:24:43.083300+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:30.389535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370800+0000","last_change":"2023-10-25T16:24:42.845326+0000","last_active":"2023-10-25T16:24:44.370800+0000","last_peered":"2023-10-25T16:24:44.370800+0000","last_clean":"2023-10-25T16:24:44.370800+0000","last_became_active":"2023-10-25T16:24:42.844302+0000","last_became_peered":"2023-10-25T16:24:42.844302+0000","last_unstale":"2023-10-25T16:24:44.370800+0000","last_undegraded":"2023-10-25T16:24:44.370800+0000","last_fullsized":"2023-10-25T16:24:44.370800+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.821466+0000","last_change":"2023-10-25T16:24:42.050841+0000","last_active":"2023-10-25T16:24:42.821466+0000","last_peered":"2023-10-25T16:24:42.821466+0000","last_clean":"2023-10-25T16:24:42.821466+0000","last_became_active":"2023-10-25T16:24:42.050228+0000","last_became_peered":"2023-10-25T16:24:42.050228+0000","last_unstale":"2023-10-25T16:24:42.821466+0000","last_undegraded":"2023-10-25T16:24:42.821466+0000","last_fullsized":"2023-10-25T16:24:42.821466+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:25:37.824310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839644+0000","last_change":"2023-10-25T16:24:42.844878+0000","last_active":"2023-10-25T16:24:43.839644+0000","last_peered":"2023-10-25T16:24:43.839644+0000","last_clean":"2023-10-25T16:24:43.839644+0000","last_became_active":"2023-10-25T16:24:42.844168+0000","last_became_peered":"2023-10-25T16:24:42.844168+0000","last_unstale":"2023-10-25T16:24:43.839644+0000","last_undegraded":"2023-10-25T16:24:43.839644+0000","last_fullsized":"2023-10-25T16:24:43.839644+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:47.062885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.085909+0000","last_change":"2023-10-25T16:24:42.071674+0000","last_active":"2023-10-25T16:24:43.085909+0000","last_peered":"2023-10-25T16:24:43.085909+0000","last_clean":"2023-10-25T16:24:43.085909+0000","last_became_active":"2023-10-25T16:24:42.071356+0000","last_became_peered":"2023-10-25T16:24:42.071356+0000","last_unstale":"2023-10-25T16:24:43.085909+0000","last_undegraded":"2023-10-25T16:24:43.085909+0000","last_fullsized":"2023-10-25T16:24:43.085909+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:58.642862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370652+0000","last_change":"2023-10-25T16:24:42.841894+0000","last_active":"2023-10-25T16:24:44.370652+0000","last_peered":"2023-10-25T16:24:44.370652+0000","last_clean":"2023-10-25T16:24:44.370652+0000","last_became_active":"2023-10-25T16:24:42.841237+0000","last_became_peered":"2023-10-25T16:24:42.841237+0000","last_unstale":"2023-10-25T16:24:44.370652+0000","last_undegraded":"2023-10-25T16:24:44.370652+0000","last_fullsized":"2023-10-25T16:24:44.370652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.821596+0000","last_change":"2023-10-25T16:24:42.047262+0000","last_active":"2023-10-25T16:24:42.821596+0000","last_peered":"2023-10-25T16:24:42.821596+0000","last_clean":"2023-10-25T16:24:42.821596+0000","last_became_active":"2023-10-25T16:24:42.046516+0000","last_became_peered":"2023-10-25T16:24:42.046516+0000","last_unstale":"2023-10-25T16:24:42.821596+0000","last_undegraded":"2023-10-25T16:24:42.821596+0000","last_fullsized":"2023-10-25T16:24:42.821596+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:23:33.525279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.839382+0000","last_change":"2023-10-25T16:24:42.839105+0000","last_active":"2023-10-25T16:24:42.839382+0000","last_peered":"2023-10-25T16:24:42.839382+0000","last_clean":"2023-10-25T16:24:42.839382+0000","last_became_active":"2023-10-25T16:24:42.838370+0000","last_became_peered":"2023-10-25T16:24:42.838370+0000","last_unstale":"2023-10-25T16:24:42.839382+0000","last_undegraded":"2023-10-25T16:24:42.839382+0000","last_fullsized":"2023-10-25T16:24:42.839382+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:39.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.831950+0000","last_change":"2023-10-25T16:24:42.065222+0000","last_active":"2023-10-25T16:24:42.831950+0000","last_peered":"2023-10-25T16:24:42.831950+0000","last_clean":"2023-10-25T16:24:42.831950+0000","last_became_active":"2023-10-25T16:24:42.064992+0000","last_became_peered":"2023-10-25T16:24:42.064992+0000","last_unstale":"2023-10-25T16:24:42.831950+0000","last_undegraded":"2023-10-25T16:24:42.831950+0000","last_fullsized":"2023-10-25T16:24:42.831950+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:00:32.484347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587691+0000","last_change":"2023-10-25T16:24:42.857914+0000","last_active":"2023-10-25T16:24:45.587691+0000","last_peered":"2023-10-25T16:24:45.587691+0000","last_clean":"2023-10-25T16:24:45.587691+0000","last_became_active":"2023-10-25T16:24:42.856320+0000","last_became_peered":"2023-10-25T16:24:42.856320+0000","last_unstale":"2023-10-25T16:24:45.587691+0000","last_undegraded":"2023-10-25T16:24:45.587691+0000","last_fullsized":"2023-10-25T16:24:45.587691+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:52:15.515443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.823748+0000","last_change":"2023-10-25T16:24:42.070672+0000","last_active":"2023-10-25T16:24:42.823748+0000","last_peered":"2023-10-25T16:24:42.823748+0000","last_clean":"2023-10-25T16:24:42.823748+0000","last_became_active":"2023-10-25T16:24:42.069485+0000","last_became_peered":"2023-10-25T16:24:42.069485+0000","last_unstale":"2023-10-25T16:24:42.823748+0000","last_undegraded":"2023-10-25T16:24:42.823748+0000","last_fullsized":"2023-10-25T16:24:42.823748+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:42:57.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839216+0000","last_change":"2023-10-25T16:24:42.855950+0000","last_active":"2023-10-25T16:24:43.839216+0000","last_peered":"2023-10-25T16:24:43.839216+0000","last_clean":"2023-10-25T16:24:43.839216+0000","last_became_active":"2023-10-25T16:24:42.855233+0000","last_became_peered":"2023-10-25T16:24:42.855233+0000","last_unstale":"2023-10-25T16:24:43.839216+0000","last_undegraded":"2023-10-25T16:24:43.839216+0000","last_fullsized":"2023-10-25T16:24:43.839216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:21.737177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839252+0000","last_change":"2023-10-25T16:24:42.069203+0000","last_active":"2023-10-25T16:24:43.839252+0000","last_peered":"2023-10-25T16:24:43.839252+0000","last_clean":"2023-10-25T16:24:43.839252+0000","last_became_active":"2023-10-25T16:24:42.068980+0000","last_became_peered":"2023-10-25T16:24:42.068980+0000","last_unstale":"2023-10-25T16:24:43.839252+0000","last_undegraded":"2023-10-25T16:24:43.839252+0000","last_fullsized":"2023-10-25T16:24:43.839252+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:57.057165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.371156+0000","last_change":"2023-10-25T16:24:42.863388+0000","last_active":"2023-10-25T16:24:44.371156+0000","last_peered":"2023-10-25T16:24:44.371156+0000","last_clean":"2023-10-25T16:24:44.371156+0000","last_became_active":"2023-10-25T16:24:42.862655+0000","last_became_peered":"2023-10-25T16:24:42.862655+0000","last_unstale":"2023-10-25T16:24:44.371156+0000","last_undegraded":"2023-10-25T16:24:44.371156+0000","last_fullsized":"2023-10-25T16:24:44.371156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840302+0000","last_change":"2023-10-25T16:24:42.058937+0000","last_active":"2023-10-25T16:24:43.840302+0000","last_peered":"2023-10-25T16:24:43.840302+0000","last_clean":"2023-10-25T16:24:43.840302+0000","last_became_active":"2023-10-25T16:24:42.056529+0000","last_became_peered":"2023-10-25T16:24:42.056529+0000","last_unstale":"2023-10-25T16:24:43.840302+0000","last_undegraded":"2023-10-25T16:24:43.840302+0000","last_fullsized":"2023-10-25T16:24:43.840302+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:21.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587764+0000","last_change":"2023-10-25T16:24:42.858482+0000","last_active":"2023-10-25T16:24:45.587764+0000","last_peered":"2023-10-25T16:24:45.587764+0000","last_clean":"2023-10-25T16:24:45.587764+0000","last_became_active":"2023-10-25T16:24:42.857240+0000","last_became_peered":"2023-10-25T16:24:42.857240+0000","last_unstale":"2023-10-25T16:24:45.587764+0000","last_undegraded":"2023-10-25T16:24:45.587764+0000","last_fullsized":"2023-10-25T16:24:45.587764+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:55.954523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001416+0000","last_change":"2023-10-25T16:24:42.070623+0000","last_active":"2023-10-25T16:24:44.001416+0000","last_peered":"2023-10-25T16:24:44.001416+0000","last_clean":"2023-10-25T16:24:44.001416+0000","last_became_active":"2023-10-25T16:24:42.067533+0000","last_became_peered":"2023-10-25T16:24:42.067533+0000","last_unstale":"2023-10-25T16:24:44.001416+0000","last_undegraded":"2023-10-25T16:24:44.001416+0000","last_fullsized":"2023-10-25T16:24:44.001416+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:27.008175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839515+0000","last_change":"2023-10-25T16:24:42.838980+0000","last_active":"2023-10-25T16:24:43.839515+0000","last_peered":"2023-10-25T16:24:43.839515+0000","last_clean":"2023-10-25T16:24:43.839515+0000","last_became_active":"2023-10-25T16:24:42.838385+0000","last_became_peered":"2023-10-25T16:24:42.838385+0000","last_unstale":"2023-10-25T16:24:43.839515+0000","last_undegraded":"2023-10-25T16:24:43.839515+0000","last_fullsized":"2023-10-25T16:24:43.839515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:02:09.469182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839401+0000","last_change":"2023-10-25T16:24:42.058131+0000","last_active":"2023-10-25T16:24:43.839401+0000","last_peered":"2023-10-25T16:24:43.839401+0000","last_clean":"2023-10-25T16:24:43.839401+0000","last_became_active":"2023-10-25T16:24:42.057693+0000","last_became_peered":"2023-10-25T16:24:42.057693+0000","last_unstale":"2023-10-25T16:24:43.839401+0000","last_undegraded":"2023-10-25T16:24:43.839401+0000","last_fullsized":"2023-10-25T16:24:43.839401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:09.180705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839110+0000","last_change":"2023-10-25T16:24:42.847394+0000","last_active":"2023-10-25T16:24:43.839110+0000","last_peered":"2023-10-25T16:24:43.839110+0000","last_clean":"2023-10-25T16:24:43.839110+0000","last_became_active":"2023-10-25T16:24:42.845964+0000","last_became_peered":"2023-10-25T16:24:42.845964+0000","last_unstale":"2023-10-25T16:24:43.839110+0000","last_undegraded":"2023-10-25T16:24:43.839110+0000","last_fullsized":"2023-10-25T16:24:43.839110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.832007+0000","last_change":"2023-10-25T16:24:42.069388+0000","last_active":"2023-10-25T16:24:42.832007+0000","last_peered":"2023-10-25T16:24:42.832007+0000","last_clean":"2023-10-25T16:24:42.832007+0000","last_became_active":"2023-10-25T16:24:42.065735+0000","last_became_peered":"2023-10-25T16:24:42.065735+0000","last_unstale":"2023-10-25T16:24:42.832007+0000","last_undegraded":"2023-10-25T16:24:42.832007+0000","last_fullsized":"2023-10-25T16:24:42.832007+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:49.646642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.845511+0000","last_change":"2023-10-25T16:24:42.844538+0000","last_active":"2023-10-25T16:24:42.845511+0000","last_peered":"2023-10-25T16:24:42.845511+0000","last_clean":"2023-10-25T16:24:42.845511+0000","last_became_active":"2023-10-25T16:24:42.842817+0000","last_became_peered":"2023-10-25T16:24:42.842817+0000","last_unstale":"2023-10-25T16:24:42.845511+0000","last_undegraded":"2023-10-25T16:24:42.845511+0000","last_fullsized":"2023-10-25T16:24:42.845511+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:29:05.210483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.829961+0000","last_change":"2023-10-25T16:24:42.057892+0000","last_active":"2023-10-25T16:24:42.829961+0000","last_peered":"2023-10-25T16:24:42.829961+0000","last_clean":"2023-10-25T16:24:42.829961+0000","last_became_active":"2023-10-25T16:24:42.057185+0000","last_became_peered":"2023-10-25T16:24:42.057185+0000","last_unstale":"2023-10-25T16:24:42.829961+0000","last_undegraded":"2023-10-25T16:24:42.829961+0000","last_fullsized":"2023-10-25T16:24:42.829961+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:08:37.495459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370488+0000","last_change":"2023-10-25T16:24:42.842647+0000","last_active":"2023-10-25T16:24:44.370488+0000","last_peered":"2023-10-25T16:24:44.370488+0000","last_clean":"2023-10-25T16:24:44.370488+0000","last_became_active":"2023-10-25T16:24:42.841926+0000","last_became_peered":"2023-10-25T16:24:42.841926+0000","last_unstale":"2023-10-25T16:24:44.370488+0000","last_undegraded":"2023-10-25T16:24:44.370488+0000","last_fullsized":"2023-10-25T16:24:44.370488+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:36.093839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001241+0000","last_change":"2023-10-25T16:24:42.066460+0000","last_active":"2023-10-25T16:24:44.001241+0000","last_peered":"2023-10-25T16:24:44.001241+0000","last_clean":"2023-10-25T16:24:44.001241+0000","last_became_active":"2023-10-25T16:24:42.065365+0000","last_became_peered":"2023-10-25T16:24:42.065365+0000","last_unstale":"2023-10-25T16:24:44.001241+0000","last_undegraded":"2023-10-25T16:24:44.001241+0000","last_fullsized":"2023-10-25T16:24:44.001241+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:30.039058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839755+0000","last_change":"2023-10-25T16:24:42.862946+0000","last_active":"2023-10-25T16:24:43.839755+0000","last_peered":"2023-10-25T16:24:43.839755+0000","last_clean":"2023-10-25T16:24:43.839755+0000","last_became_active":"2023-10-25T16:24:42.861024+0000","last_became_peered":"2023-10-25T16:24:42.861024+0000","last_unstale":"2023-10-25T16:24:43.839755+0000","last_undegraded":"2023-10-25T16:24:43.839755+0000","last_fullsized":"2023-10-25T16:24:43.839755+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:22:33.109253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.828443+0000","last_change":"2023-10-25T16:24:42.063433+0000","last_active":"2023-10-25T16:24:42.828443+0000","last_peered":"2023-10-25T16:24:42.828443+0000","last_clean":"2023-10-25T16:24:42.828443+0000","last_became_active":"2023-10-25T16:24:42.062671+0000","last_became_peered":"2023-10-25T16:24:42.062671+0000","last_unstale":"2023-10-25T16:24:42.828443+0000","last_undegraded":"2023-10-25T16:24:42.828443+0000","last_fullsized":"2023-10-25T16:24:42.828443+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:04.807092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838989+0000","last_change":"2023-10-25T16:24:42.856140+0000","last_active":"2023-10-25T16:24:43.838989+0000","last_peered":"2023-10-25T16:24:43.838989+0000","last_clean":"2023-10-25T16:24:43.838989+0000","last_became_active":"2023-10-25T16:24:42.855277+0000","last_became_peered":"2023-10-25T16:24:42.855277+0000","last_unstale":"2023-10-25T16:24:43.838989+0000","last_undegraded":"2023-10-25T16:24:43.838989+0000","last_fullsized":"2023-10-25T16:24:43.838989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.831628+0000","last_change":"2023-10-25T16:24:42.068940+0000","last_active":"2023-10-25T16:24:42.831628+0000","last_peered":"2023-10-25T16:24:42.831628+0000","last_clean":"2023-10-25T16:24:42.831628+0000","last_became_active":"2023-10-25T16:24:42.064691+0000","last_became_peered":"2023-10-25T16:24:42.064691+0000","last_unstale":"2023-10-25T16:24:42.831628+0000","last_undegraded":"2023-10-25T16:24:42.831628+0000","last_fullsized":"2023-10-25T16:24:42.831628+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:55.991276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":325,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.044629+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:24:42.044629+0000","last_peered":"2023-10-25T16:24:42.044629+0000","last_clean":"2023-10-25T16:24:42.044629+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:24:42.044629+0000","last_undegraded":"2023-10-25T16:24:42.044629+0000","last_fullsized":"2023-10-25T16:24:42.044629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542289,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.314},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.375}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.79400000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":0.72599999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.755}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.67900000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193689,"statfs":{"total":200000000,"available":198338235,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.1839999999999999,"5min":1.24,"15min":1.256},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.087,"5min":1.3420000000000001,"15min":1.534},"last":0.88100000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.155,"5min":1.4259999999999999,"15min":1.647},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91200000000000003,"15min":0.86799999999999999},"min":{"1min":0.77100000000000002,"5min":0.54100000000000004,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1599999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.97799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.73999999999999999,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":1.51},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":1.083}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1279999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.72699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.337,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.337,"5min":1.696,"15min":1.7370000000000001},"last":0.748},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.66000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.234,"5min":1.681,"15min":1.681},"last":1.018}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.105,"15min":1.123},"min":{"1min":0.86699999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.2849999999999999,"5min":1.643,"15min":1.669},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":1.0629999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.321,"5min":1.591,"15min":1.7490000000000001},"last":1.107}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194268,"statfs":{"total":200000000,"available":198930935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88300000000000001,"15min":0.876},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.028,"15min":0.93700000000000006},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.298,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1859999999999999,"5min":10.667,"15min":10.667},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.042,"15min":0.95399999999999996},"min":{"1min":0.66000000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3180000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.92600000000000005},"min":{"1min":0.69999999999999996,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.22,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.079,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":10.948,"15min":10.948},"last":1.1879999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.2709999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1359999999999999,"15min":1.077},"min":{"1min":0.747,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.272}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.046,"15min":0.98099999999999998},"min":{"1min":0.63500000000000001,"5min":0.48699999999999999,"15min":0.41499999999999998},"max":{"1min":1.494,"5min":11.081,"15min":11.081},"last":1.3200000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.96099999999999997},"min":{"1min":0.67100000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2130000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.54600000000000004,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.1040000000000001,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.371,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.244,"15min":1.143},"min":{"1min":0.86199999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.5629999999999999,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.151,"15min":1.0920000000000001},"min":{"1min":0.80400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.375,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.3819999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924053,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91400000000000003,"15min":1.0900000000000001},"min":{"1min":0.624,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2929999999999999,"5min":2.1429999999999998,"15min":14.843},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.097,"5min":2.8450000000000002,"15min":16.439},"last":0.628}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90400000000000003,"15min":1.127},"min":{"1min":0.67000000000000004,"5min":0.54000000000000004,"15min":0.40100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96199999999999997,"15min":0.91100000000000003},"min":{"1min":0.86199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.282,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.69899999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.3200000000000001,"5min":1.601,"15min":3.9529999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":0.96899999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.244,"5min":1.921,"15min":1.921},"last":0.79000000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.379,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.3069999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.875}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.028,"15min":1.2709999999999999},"min":{"1min":0.66700000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2410000000000001,"5min":1.9910000000000001,"15min":15.904},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":1.236},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.2450000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0209999999999999,"15min":1.2430000000000001},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3440000000000001,"5min":4.5970000000000004,"15min":14.567},"last":1.028},{"interface":"front","average":{"1min":1.141,"5min":1.1359999999999999,"15min":1.3919999999999999},"min":{"1min":0.73999999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.3440000000000001,"5min":2.4079999999999999,"15min":15.089},"last":1.0620000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.01,"15min":1.327},"min":{"1min":0.58599999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.2110000000000001,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.143,"5min":1.163,"15min":1.208},"min":{"1min":0.877,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.484,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.1100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194266,"statfs":{"total":200000000,"available":198929275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.877,"15min":0.83799999999999997},"min":{"1min":0.61899999999999999,"5min":0.54400000000000004,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.194,"5min":1.274,"15min":1.3029999999999999},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.878,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.179,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":0.97799999999999998},"min":{"1min":0.58899999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.429,"15min":1.4990000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":1.0649999999999999},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88100000000000001,"15min":0.83399999999999996},"min":{"1min":0.67600000000000005,"5min":0.51600000000000001,"15min":0.45300000000000001},"max":{"1min":1.099,"5min":1.3140000000000001,"15min":1.518},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.89800000000000002,"15min":0.93400000000000005},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.313},"max":{"1min":1.1539999999999999,"5min":1.504,"15min":2.6640000000000001},"last":1.208},{"interface":"front","average":{"1min":1.109,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.488,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.66200000000000003,"5min":0.61099999999999999,"15min":0.40000000000000002},"max":{"1min":1.2629999999999999,"5min":1.3560000000000001,"15min":2.085},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.5600000000000001,"5min":1.625,"15min":1.8149999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.95199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.125},"min":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.98699999999999999,"5min":1.093,"15min":1.093},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.222},"max":{"1min":0.95999999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.66400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.19700000000000001},"max":{"1min":0.97499999999999998,"5min":1.425,"15min":1.425},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83699999999999997,"15min":0.755},"min":{"1min":0.375,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81200000000000006}]},{"osd":2,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.69299999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.0629999999999999,"5min":1.25,"15min":1.8260000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93200000000000005,"15min":0.89700000000000002},"min":{"1min":0.70799999999999996,"5min":0.60399999999999998,"15min":0.48899999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.036,"15min":0.996},"min":{"1min":0.751,"5min":0.58799999999999997,"15min":0.51300000000000001},"max":{"1min":1.341,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96699999999999997,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.45400000000000001},"max":{"1min":1.266,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47499999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.4830000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.97199999999999998,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.119,"5min":1.3089999999999999,"15min":1.456},"last":1.014},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0289999999999999,"15min":0.999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.25,"5min":1.861,"15min":1.861},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0029999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.508,"15min":1.5660000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.016,"15min":0.97799999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194268,"statfs":{"total":200000000,"available":198930923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.48299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89100000000000001,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.437},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.71699999999999997,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.29499999999999998,"15min":0.24299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.52400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.97299999999999998,"5min":0.98599999999999999,"15min":1.4610000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73599999999999999,"15min":0.70199999999999996},"min":{"1min":0.60699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.495}]},{"osd":3,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.66100000000000003},"min":{"1min":0.55300000000000005,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.995,"15min":1.1399999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81999999999999995,"15min":0.77300000000000002},"min":{"1min":0.66600000000000004,"5min":0.37,"15min":0.28000000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.96099999999999997},"min":{"1min":0.78300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.109,"5min":1.242,"15min":12.698},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97999999999999998,"15min":1.018},"min":{"1min":0.85699999999999998,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":12.721},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.96499999999999997,"15min":0.93400000000000005},"min":{"1min":0.81499999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.546},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.70399999999999996,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":2.206},"last":0.873}]},{"osd":6,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.49099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.125,"5min":1.0629999999999999,"15min":1.0329999999999999},"min":{"1min":0.92400000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.5980000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.004},"min":{"1min":0.80900000000000005,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":14.776},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.036,"15min":1.0389999999999999},"min":{"1min":0.78000000000000003,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.655,"5min":1.655,"15min":10.509},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198334289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":1.0660000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.44,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0840000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":1.0089999999999999,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.59299999999999997,"5min":0.25,"15min":0.25},"max":{"1min":1.129,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82299999999999995,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.2090000000000001,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.874,"15min":0.84399999999999997},"min":{"1min":0.748,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.085,"5min":1.296,"15min":3.6579999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.86599999999999999},"min":{"1min":0.70099999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.181,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.1160000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83899999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.90100000000000002},"min":{"1min":0.73999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1850000000000001,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98599999999999999,"15min":0.95699999999999996},"min":{"1min":0.72099999999999997,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":1.1120000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.026,"15min":0.99099999999999999},"min":{"1min":0.74099999999999999,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.27,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":0.96399999999999997},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2709999999999999,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0229999999999999,"15min":1.1459999999999999},"min":{"1min":0.67000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3220000000000001,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0580000000000001,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":11.622},"last":0.80500000000000005}]}]}],"pool_statfs":[]}} 2023-10-25T16:24:50.519 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:24:50.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 -- 172.21.15.177:0/1809572012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc15eba0 msgr2=0x7f04fc0b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:50.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 --2- 172.21.15.177:0/1809572012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc15eba0 0x7f04fc0b4100 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009900 tx=0x7f04ec01c830 comp rx=0 tx=0).stop 2023-10-25T16:24:50.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 -- 172.21.15.177:0/1809572012 shutdown_connections 2023-10-25T16:24:50.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 --2- 172.21.15.177:0/1809572012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04fc0cdb10 0x7f04fc0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 --2- 172.21.15.177:0/1809572012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc15eba0 0x7f04fc0b4100 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 -- 172.21.15.177:0/1809572012 >> 172.21.15.177:0/1809572012 conn(0x7f04fc09a5c0 msgr2=0x7f04fc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:50.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 -- 172.21.15.177:0/1809572012 shutdown_connections 2023-10-25T16:24:50.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.662+0000 7f05028b0640 1 -- 172.21.15.177:0/1809572012 wait complete. 2023-10-25T16:24:50.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 Processor -- start 2023-10-25T16:24:50.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- start start 2023-10-25T16:24:50.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04fc0b2120 0x7f04fc142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:50.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 0x7f04fc0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:50.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04fc15eba0 0x7f04fc0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:50.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0c8b60 con 0x7f04fc0cdb10 2023-10-25T16:24:50.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0cb360 con 0x7f04fc0b2120 2023-10-25T16:24:50.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0c8880 con 0x7f04fc15eba0 2023-10-25T16:24:50.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 0x7f04fc0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:50.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 0x7f04fc0c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:49994/0 (socket says 172.21.15.177:49994) 2023-10-25T16:24:50.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 -- 172.21.15.177:0/1826898681 learned_addr learned my addr 172.21.15.177:0/1826898681 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:50.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fbfff640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04fc0b2120 0x7f04fc142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:50.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f0500e4d640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04fc15eba0 0x7f04fc0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:50.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 -- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04fc15eba0 msgr2=0x7f04fc0c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:50.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04fc15eba0 0x7f04fc0c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 -- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04fc0b2120 msgr2=0x7f04fc142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:50.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04fc0b2120 0x7f04fc142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 -- 172.21.15.177:0/1826898681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec009560 con 0x7f04fc0cdb10 2023-10-25T16:24:50.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fbfff640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04fc0b2120 0x7f04fc142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:24:50.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04fb7fe640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 0x7f04fc0c75a0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c7c0 tx=0x7f04e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:50.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4006d60 con 0x7f04fc0cdb10 2023-10-25T16:24:50.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f04e4003980 con 0x7f04fc0cdb10 2023-10-25T16:24:50.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc0caca0 con 0x7f04fc0cdb10 2023-10-25T16:24:50.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e4003d90 con 0x7f04fc0cdb10 2023-10-25T16:24:50.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc0c7ae0 con 0x7f04fc0cdb10 2023-10-25T16:24:50.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.666+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc0cab00 con 0x7f04fc0cdb10 2023-10-25T16:24:50.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.670+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f04e400a850 con 0x7f04fc0cdb10 2023-10-25T16:24:50.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.670+0000 7f04f8ff9640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04dc066470 0x7f04dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:50.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.670+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04e4083d00 con 0x7f04fc0cdb10 2023-10-25T16:24:50.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.670+0000 7f04fbfff640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04dc066470 0x7f04dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:50.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.670+0000 7f04fbfff640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04dc066470 0x7f04dc068930 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0af000 tx=0x7f04ec01b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:50.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.674+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f04fc0cab00 con 0x7f04fc0cdb10 2023-10-25T16:24:50.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.826+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04fc0cb4a0 con 0x7f04dc066470 2023-10-25T16:24:50.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.850+0000 7f04f8ff9640 1 -- 172.21.15.177:0/1826898681 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283917 (secure 0 0 0) 0x7f04fc0cb4a0 con 0x7f04dc066470 2023-10-25T16:24:50.853 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:50.856 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:24:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04dc066470 msgr2=0x7f04dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:50.858 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04dc066470 0x7f04dc068930 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0af000 tx=0x7f04ec01b070 comp rx=0 tx=0).stop 2023-10-25T16:24:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 msgr2=0x7f04fc0c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 0x7f04fc0c75a0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f04e400c7c0 tx=0x7f04e400cc80 comp rx=0 tx=0).stop 2023-10-25T16:24:50.859 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 shutdown_connections 2023-10-25T16:24:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04dc066470 0x7f04dc068930 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.860 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04fc15eba0 0x7f04fc0c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04fc0cdb10 0x7f04fc0c75a0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 --2- 172.21.15.177:0/1826898681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04fc0b2120 0x7f04fc142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:50.861 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 >> 172.21.15.177:0/1826898681 conn(0x7f04fc09a5c0 msgr2=0x7f04fc0b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:50.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 shutdown_connections 2023-10-25T16:24:50.862 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:50.854+0000 7f05028b0640 1 -- 172.21.15.177:0/1826898681 wait complete. 2023-10-25T16:24:50.871 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2023-10-25T16:24:48.855208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552965,"statfs":{"total":1600000000,"available":1590236900,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.819390"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.852334+0000","last_change":"2023-10-25T16:24:42.852173+0000","last_active":"2023-10-25T16:24:42.852334+0000","last_peered":"2023-10-25T16:24:42.852334+0000","last_clean":"2023-10-25T16:24:42.852334+0000","last_became_active":"2023-10-25T16:24:42.851355+0000","last_became_peered":"2023-10-25T16:24:42.851355+0000","last_unstale":"2023-10-25T16:24:42.852334+0000","last_undegraded":"2023-10-25T16:24:42.852334+0000","last_fullsized":"2023-10-25T16:24:42.852334+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:49:09.241487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001000+0000","last_change":"2023-10-25T16:24:42.858773+0000","last_active":"2023-10-25T16:24:44.001000+0000","last_peered":"2023-10-25T16:24:44.001000+0000","last_clean":"2023-10-25T16:24:44.001000+0000","last_became_active":"2023-10-25T16:24:42.856251+0000","last_became_peered":"2023-10-25T16:24:42.856251+0000","last_unstale":"2023-10-25T16:24:44.001000+0000","last_undegraded":"2023-10-25T16:24:44.001000+0000","last_fullsized":"2023-10-25T16:24:44.001000+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:12:19.931412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840078+0000","last_change":"2023-10-25T16:24:42.861846+0000","last_active":"2023-10-25T16:24:43.840078+0000","last_peered":"2023-10-25T16:24:43.840078+0000","last_clean":"2023-10-25T16:24:43.840078+0000","last_became_active":"2023-10-25T16:24:42.854537+0000","last_became_peered":"2023-10-25T16:24:42.854537+0000","last_unstale":"2023-10-25T16:24:43.840078+0000","last_undegraded":"2023-10-25T16:24:43.840078+0000","last_fullsized":"2023-10-25T16:24:43.840078+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:00.987103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.847730+0000","last_change":"2023-10-25T16:24:42.843047+0000","last_active":"2023-10-25T16:24:42.847730+0000","last_peered":"2023-10-25T16:24:42.847730+0000","last_clean":"2023-10-25T16:24:42.847730+0000","last_became_active":"2023-10-25T16:24:42.842526+0000","last_became_peered":"2023-10-25T16:24:42.842526+0000","last_unstale":"2023-10-25T16:24:42.847730+0000","last_undegraded":"2023-10-25T16:24:42.847730+0000","last_fullsized":"2023-10-25T16:24:42.847730+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:11:57.651679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.000810+0000","last_change":"2023-10-25T16:24:42.843387+0000","last_active":"2023-10-25T16:24:44.000810+0000","last_peered":"2023-10-25T16:24:44.000810+0000","last_clean":"2023-10-25T16:24:44.000810+0000","last_became_active":"2023-10-25T16:24:42.840194+0000","last_became_peered":"2023-10-25T16:24:42.840194+0000","last_unstale":"2023-10-25T16:24:44.000810+0000","last_undegraded":"2023-10-25T16:24:44.000810+0000","last_fullsized":"2023-10-25T16:24:44.000810+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:35:14.111718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587594+0000","last_change":"2023-10-25T16:24:42.851690+0000","last_active":"2023-10-25T16:24:45.587594+0000","last_peered":"2023-10-25T16:24:45.587594+0000","last_clean":"2023-10-25T16:24:45.587594+0000","last_became_active":"2023-10-25T16:24:42.851061+0000","last_became_peered":"2023-10-25T16:24:42.851061+0000","last_unstale":"2023-10-25T16:24:45.587594+0000","last_undegraded":"2023-10-25T16:24:45.587594+0000","last_fullsized":"2023-10-25T16:24:45.587594+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:36.359256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370995+0000","last_change":"2023-10-25T16:24:42.848819+0000","last_active":"2023-10-25T16:24:44.370995+0000","last_peered":"2023-10-25T16:24:44.370995+0000","last_clean":"2023-10-25T16:24:44.370995+0000","last_became_active":"2023-10-25T16:24:42.847037+0000","last_became_peered":"2023-10-25T16:24:42.847037+0000","last_unstale":"2023-10-25T16:24:44.370995+0000","last_undegraded":"2023-10-25T16:24:44.370995+0000","last_fullsized":"2023-10-25T16:24:44.370995+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.000615+0000","last_change":"2023-10-25T16:24:42.849286+0000","last_active":"2023-10-25T16:24:44.000615+0000","last_peered":"2023-10-25T16:24:44.000615+0000","last_clean":"2023-10-25T16:24:44.000615+0000","last_became_active":"2023-10-25T16:24:42.848499+0000","last_became_peered":"2023-10-25T16:24:42.848499+0000","last_unstale":"2023-10-25T16:24:44.000615+0000","last_undegraded":"2023-10-25T16:24:44.000615+0000","last_fullsized":"2023-10-25T16:24:44.000615+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:30:32.372441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001304+0000","last_change":"2023-10-25T16:24:42.859369+0000","last_active":"2023-10-25T16:24:44.001304+0000","last_peered":"2023-10-25T16:24:44.001304+0000","last_clean":"2023-10-25T16:24:44.001304+0000","last_became_active":"2023-10-25T16:24:42.857256+0000","last_became_peered":"2023-10-25T16:24:42.857256+0000","last_unstale":"2023-10-25T16:24:44.001304+0000","last_undegraded":"2023-10-25T16:24:44.001304+0000","last_fullsized":"2023-10-25T16:24:44.001304+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:48:11.400342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001204+0000","last_change":"2023-10-25T16:24:42.848142+0000","last_active":"2023-10-25T16:24:44.001204+0000","last_peered":"2023-10-25T16:24:44.001204+0000","last_clean":"2023-10-25T16:24:44.001204+0000","last_became_active":"2023-10-25T16:24:42.847512+0000","last_became_peered":"2023-10-25T16:24:42.847512+0000","last_unstale":"2023-10-25T16:24:44.001204+0000","last_undegraded":"2023-10-25T16:24:44.001204+0000","last_fullsized":"2023-10-25T16:24:44.001204+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:52:50.695961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001115+0000","last_change":"2023-10-25T16:24:42.842309+0000","last_active":"2023-10-25T16:24:44.001115+0000","last_peered":"2023-10-25T16:24:44.001115+0000","last_clean":"2023-10-25T16:24:44.001115+0000","last_became_active":"2023-10-25T16:24:42.840404+0000","last_became_peered":"2023-10-25T16:24:42.840404+0000","last_unstale":"2023-10-25T16:24:44.001115+0000","last_undegraded":"2023-10-25T16:24:44.001115+0000","last_fullsized":"2023-10-25T16:24:44.001115+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:00:31.815757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001329+0000","last_change":"2023-10-25T16:24:42.858228+0000","last_active":"2023-10-25T16:24:44.001329+0000","last_peered":"2023-10-25T16:24:44.001329+0000","last_clean":"2023-10-25T16:24:44.001329+0000","last_became_active":"2023-10-25T16:24:42.848919+0000","last_became_peered":"2023-10-25T16:24:42.848919+0000","last_unstale":"2023-10-25T16:24:44.001329+0000","last_undegraded":"2023-10-25T16:24:44.001329+0000","last_fullsized":"2023-10-25T16:24:44.001329+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:36:05.047844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839250+0000","last_change":"2023-10-25T16:24:42.862412+0000","last_active":"2023-10-25T16:24:43.839250+0000","last_peered":"2023-10-25T16:24:43.839250+0000","last_clean":"2023-10-25T16:24:43.839250+0000","last_became_active":"2023-10-25T16:24:42.855977+0000","last_became_peered":"2023-10-25T16:24:42.855977+0000","last_unstale":"2023-10-25T16:24:43.839250+0000","last_undegraded":"2023-10-25T16:24:43.839250+0000","last_fullsized":"2023-10-25T16:24:43.839250+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:09:33.940751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838984+0000","last_change":"2023-10-25T16:24:42.853702+0000","last_active":"2023-10-25T16:24:43.838984+0000","last_peered":"2023-10-25T16:24:43.838984+0000","last_clean":"2023-10-25T16:24:43.838984+0000","last_became_active":"2023-10-25T16:24:42.852854+0000","last_became_peered":"2023-10-25T16:24:42.852854+0000","last_unstale":"2023-10-25T16:24:43.838984+0000","last_undegraded":"2023-10-25T16:24:43.838984+0000","last_fullsized":"2023-10-25T16:24:43.838984+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:44.049135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.838149+0000","last_change":"2023-10-25T16:24:42.837972+0000","last_active":"2023-10-25T16:24:42.838149+0000","last_peered":"2023-10-25T16:24:42.838149+0000","last_clean":"2023-10-25T16:24:42.838149+0000","last_became_active":"2023-10-25T16:24:42.837199+0000","last_became_peered":"2023-10-25T16:24:42.837199+0000","last_unstale":"2023-10-25T16:24:42.838149+0000","last_undegraded":"2023-10-25T16:24:42.838149+0000","last_fullsized":"2023-10-25T16:24:42.838149+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:24:36.766938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370667+0000","last_change":"2023-10-25T16:24:42.844979+0000","last_active":"2023-10-25T16:24:44.370667+0000","last_peered":"2023-10-25T16:24:44.370667+0000","last_clean":"2023-10-25T16:24:44.370667+0000","last_became_active":"2023-10-25T16:24:42.843262+0000","last_became_peered":"2023-10-25T16:24:42.843262+0000","last_unstale":"2023-10-25T16:24:44.370667+0000","last_undegraded":"2023-10-25T16:24:44.370667+0000","last_fullsized":"2023-10-25T16:24:44.370667+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587590+0000","last_change":"2023-10-25T16:24:42.860500+0000","last_active":"2023-10-25T16:24:45.587590+0000","last_peered":"2023-10-25T16:24:45.587590+0000","last_clean":"2023-10-25T16:24:45.587590+0000","last_became_active":"2023-10-25T16:24:42.859882+0000","last_became_peered":"2023-10-25T16:24:42.859882+0000","last_unstale":"2023-10-25T16:24:45.587590+0000","last_undegraded":"2023-10-25T16:24:45.587590+0000","last_fullsized":"2023-10-25T16:24:45.587590+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:54:55.948683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839092+0000","last_change":"2023-10-25T16:24:42.850227+0000","last_active":"2023-10-25T16:24:43.839092+0000","last_peered":"2023-10-25T16:24:43.839092+0000","last_clean":"2023-10-25T16:24:43.839092+0000","last_became_active":"2023-10-25T16:24:42.849610+0000","last_became_peered":"2023-10-25T16:24:42.849610+0000","last_unstale":"2023-10-25T16:24:43.839092+0000","last_undegraded":"2023-10-25T16:24:43.839092+0000","last_fullsized":"2023-10-25T16:24:43.839092+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:08:41.225941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587535+0000","last_change":"2023-10-25T16:24:42.853681+0000","last_active":"2023-10-25T16:24:45.587535+0000","last_peered":"2023-10-25T16:24:45.587535+0000","last_clean":"2023-10-25T16:24:45.587535+0000","last_became_active":"2023-10-25T16:24:42.852938+0000","last_became_peered":"2023-10-25T16:24:42.852938+0000","last_unstale":"2023-10-25T16:24:45.587535+0000","last_undegraded":"2023-10-25T16:24:45.587535+0000","last_fullsized":"2023-10-25T16:24:45.587535+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:31.921921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839133+0000","last_change":"2023-10-25T16:24:42.854510+0000","last_active":"2023-10-25T16:24:43.839133+0000","last_peered":"2023-10-25T16:24:43.839133+0000","last_clean":"2023-10-25T16:24:43.839133+0000","last_became_active":"2023-10-25T16:24:42.852757+0000","last_became_peered":"2023-10-25T16:24:42.852757+0000","last_unstale":"2023-10-25T16:24:43.839133+0000","last_undegraded":"2023-10-25T16:24:43.839133+0000","last_fullsized":"2023-10-25T16:24:43.839133+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:51:05.295164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587748+0000","last_change":"2023-10-25T16:24:42.861649+0000","last_active":"2023-10-25T16:24:45.587748+0000","last_peered":"2023-10-25T16:24:45.587748+0000","last_clean":"2023-10-25T16:24:45.587748+0000","last_became_active":"2023-10-25T16:24:42.861033+0000","last_became_peered":"2023-10-25T16:24:42.861033+0000","last_unstale":"2023-10-25T16:24:45.587748+0000","last_undegraded":"2023-10-25T16:24:45.587748+0000","last_fullsized":"2023-10-25T16:24:45.587748+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:40:25.199038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001510+0000","last_change":"2023-10-25T16:24:42.859341+0000","last_active":"2023-10-25T16:24:44.001510+0000","last_peered":"2023-10-25T16:24:44.001510+0000","last_clean":"2023-10-25T16:24:44.001510+0000","last_became_active":"2023-10-25T16:24:42.857437+0000","last_became_peered":"2023-10-25T16:24:42.857437+0000","last_unstale":"2023-10-25T16:24:44.001510+0000","last_undegraded":"2023-10-25T16:24:44.001510+0000","last_fullsized":"2023-10-25T16:24:44.001510+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:50:14.474413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587601+0000","last_change":"2023-10-25T16:24:42.856407+0000","last_active":"2023-10-25T16:24:45.587601+0000","last_peered":"2023-10-25T16:24:45.587601+0000","last_clean":"2023-10-25T16:24:45.587601+0000","last_became_active":"2023-10-25T16:24:42.855666+0000","last_became_peered":"2023-10-25T16:24:42.855666+0000","last_unstale":"2023-10-25T16:24:45.587601+0000","last_undegraded":"2023-10-25T16:24:45.587601+0000","last_fullsized":"2023-10-25T16:24:45.587601+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:51:12.086838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.000630+0000","last_change":"2023-10-25T16:24:42.861077+0000","last_active":"2023-10-25T16:24:44.000630+0000","last_peered":"2023-10-25T16:24:44.000630+0000","last_clean":"2023-10-25T16:24:44.000630+0000","last_became_active":"2023-10-25T16:24:42.858740+0000","last_became_peered":"2023-10-25T16:24:42.858740+0000","last_unstale":"2023-10-25T16:24:44.000630+0000","last_undegraded":"2023-10-25T16:24:44.000630+0000","last_fullsized":"2023-10-25T16:24:44.000630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:45:27.351555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839450+0000","last_change":"2023-10-25T16:24:42.845872+0000","last_active":"2023-10-25T16:24:43.839450+0000","last_peered":"2023-10-25T16:24:43.839450+0000","last_clean":"2023-10-25T16:24:43.839450+0000","last_became_active":"2023-10-25T16:24:42.845023+0000","last_became_peered":"2023-10-25T16:24:42.845023+0000","last_unstale":"2023-10-25T16:24:43.839450+0000","last_undegraded":"2023-10-25T16:24:43.839450+0000","last_fullsized":"2023-10-25T16:24:43.839450+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:36:03.997283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370513+0000","last_change":"2023-10-25T16:24:42.861119+0000","last_active":"2023-10-25T16:24:44.370513+0000","last_peered":"2023-10-25T16:24:44.370513+0000","last_clean":"2023-10-25T16:24:44.370513+0000","last_became_active":"2023-10-25T16:24:42.858569+0000","last_became_peered":"2023-10-25T16:24:42.858569+0000","last_unstale":"2023-10-25T16:24:44.370513+0000","last_undegraded":"2023-10-25T16:24:44.370513+0000","last_fullsized":"2023-10-25T16:24:44.370513+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:46:47.363848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839063+0000","last_change":"2023-10-25T16:24:42.860654+0000","last_active":"2023-10-25T16:24:43.839063+0000","last_peered":"2023-10-25T16:24:43.839063+0000","last_clean":"2023-10-25T16:24:43.839063+0000","last_became_active":"2023-10-25T16:24:42.859870+0000","last_became_peered":"2023-10-25T16:24:42.859870+0000","last_unstale":"2023-10-25T16:24:43.839063+0000","last_undegraded":"2023-10-25T16:24:43.839063+0000","last_fullsized":"2023-10-25T16:24:43.839063+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:08:16.869498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.847591+0000","last_change":"2023-10-25T16:24:42.837207+0000","last_active":"2023-10-25T16:24:42.847591+0000","last_peered":"2023-10-25T16:24:42.847591+0000","last_clean":"2023-10-25T16:24:42.847591+0000","last_became_active":"2023-10-25T16:24:42.836579+0000","last_became_peered":"2023-10-25T16:24:42.836579+0000","last_unstale":"2023-10-25T16:24:42.847591+0000","last_undegraded":"2023-10-25T16:24:42.847591+0000","last_fullsized":"2023-10-25T16:24:42.847591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:38:20.916538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839311+0000","last_change":"2023-10-25T16:24:42.860673+0000","last_active":"2023-10-25T16:24:43.839311+0000","last_peered":"2023-10-25T16:24:43.839311+0000","last_clean":"2023-10-25T16:24:43.839311+0000","last_became_active":"2023-10-25T16:24:42.859812+0000","last_became_peered":"2023-10-25T16:24:42.859812+0000","last_unstale":"2023-10-25T16:24:43.839311+0000","last_undegraded":"2023-10-25T16:24:43.839311+0000","last_fullsized":"2023-10-25T16:24:43.839311+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:38:30.787855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.838906+0000","last_change":"2023-10-25T16:24:42.832357+0000","last_active":"2023-10-25T16:24:42.838906+0000","last_peered":"2023-10-25T16:24:42.838906+0000","last_clean":"2023-10-25T16:24:42.838906+0000","last_became_active":"2023-10-25T16:24:42.831742+0000","last_became_peered":"2023-10-25T16:24:42.831742+0000","last_unstale":"2023-10-25T16:24:42.838906+0000","last_undegraded":"2023-10-25T16:24:42.838906+0000","last_fullsized":"2023-10-25T16:24:42.838906+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:14:40.883143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.845462+0000","last_change":"2023-10-25T16:24:42.843628+0000","last_active":"2023-10-25T16:24:42.845462+0000","last_peered":"2023-10-25T16:24:42.845462+0000","last_clean":"2023-10-25T16:24:42.845462+0000","last_became_active":"2023-10-25T16:24:42.841826+0000","last_became_peered":"2023-10-25T16:24:42.841826+0000","last_unstale":"2023-10-25T16:24:42.845462+0000","last_undegraded":"2023-10-25T16:24:42.845462+0000","last_fullsized":"2023-10-25T16:24:42.845462+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:31.053947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838846+0000","last_change":"2023-10-25T16:24:42.847781+0000","last_active":"2023-10-25T16:24:43.838846+0000","last_peered":"2023-10-25T16:24:43.838846+0000","last_clean":"2023-10-25T16:24:43.838846+0000","last_became_active":"2023-10-25T16:24:42.846775+0000","last_became_peered":"2023-10-25T16:24:42.846775+0000","last_unstale":"2023-10-25T16:24:43.838846+0000","last_undegraded":"2023-10-25T16:24:43.838846+0000","last_fullsized":"2023-10-25T16:24:43.838846+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370169+0000","last_change":"2023-10-25T16:24:42.860236+0000","last_active":"2023-10-25T16:24:44.370169+0000","last_peered":"2023-10-25T16:24:44.370169+0000","last_clean":"2023-10-25T16:24:44.370169+0000","last_became_active":"2023-10-25T16:24:42.859552+0000","last_became_peered":"2023-10-25T16:24:42.859552+0000","last_unstale":"2023-10-25T16:24:44.370169+0000","last_undegraded":"2023-10-25T16:24:44.370169+0000","last_fullsized":"2023-10-25T16:24:44.370169+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:32.387989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"189'4","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.086710+0000","last_change":"2023-10-25T16:24:42.061902+0000","last_active":"2023-10-25T16:24:43.086710+0000","last_peered":"2023-10-25T16:24:43.086710+0000","last_clean":"2023-10-25T16:24:43.086710+0000","last_became_active":"2023-10-25T16:24:42.061199+0000","last_became_peered":"2023-10-25T16:24:42.061199+0000","last_unstale":"2023-10-25T16:24:43.086710+0000","last_undegraded":"2023-10-25T16:24:43.086710+0000","last_fullsized":"2023-10-25T16:24:43.086710+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:32:04.583172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.848337+0000","last_change":"2023-10-25T16:24:42.847852+0000","last_active":"2023-10-25T16:24:42.848337+0000","last_peered":"2023-10-25T16:24:42.848337+0000","last_clean":"2023-10-25T16:24:42.848337+0000","last_became_active":"2023-10-25T16:24:42.846658+0000","last_became_peered":"2023-10-25T16:24:42.846658+0000","last_unstale":"2023-10-25T16:24:42.848337+0000","last_undegraded":"2023-10-25T16:24:42.848337+0000","last_fullsized":"2023-10-25T16:24:42.848337+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:04:21.778225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.082813+0000","last_change":"2023-10-25T16:24:42.070958+0000","last_active":"2023-10-25T16:24:43.082813+0000","last_peered":"2023-10-25T16:24:43.082813+0000","last_clean":"2023-10-25T16:24:43.082813+0000","last_became_active":"2023-10-25T16:24:42.070512+0000","last_became_peered":"2023-10-25T16:24:42.070512+0000","last_unstale":"2023-10-25T16:24:43.082813+0000","last_undegraded":"2023-10-25T16:24:43.082813+0000","last_fullsized":"2023-10-25T16:24:43.082813+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:53:49.147119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587864+0000","last_change":"2023-10-25T16:24:42.856521+0000","last_active":"2023-10-25T16:24:45.587864+0000","last_peered":"2023-10-25T16:24:45.587864+0000","last_clean":"2023-10-25T16:24:45.587864+0000","last_became_active":"2023-10-25T16:24:42.855899+0000","last_became_peered":"2023-10-25T16:24:42.855899+0000","last_unstale":"2023-10-25T16:24:45.587864+0000","last_undegraded":"2023-10-25T16:24:45.587864+0000","last_fullsized":"2023-10-25T16:24:45.587864+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:20:54.861337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.085217+0000","last_change":"2023-10-25T16:24:42.068928+0000","last_active":"2023-10-25T16:24:43.085217+0000","last_peered":"2023-10-25T16:24:43.085217+0000","last_clean":"2023-10-25T16:24:43.085217+0000","last_became_active":"2023-10-25T16:24:42.068607+0000","last_became_peered":"2023-10-25T16:24:42.068607+0000","last_unstale":"2023-10-25T16:24:43.085217+0000","last_undegraded":"2023-10-25T16:24:43.085217+0000","last_fullsized":"2023-10-25T16:24:43.085217+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:39:45.479638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839823+0000","last_change":"2023-10-25T16:24:42.854976+0000","last_active":"2023-10-25T16:24:43.839823+0000","last_peered":"2023-10-25T16:24:43.839823+0000","last_clean":"2023-10-25T16:24:43.839823+0000","last_became_active":"2023-10-25T16:24:42.853857+0000","last_became_peered":"2023-10-25T16:24:42.853857+0000","last_unstale":"2023-10-25T16:24:43.839823+0000","last_undegraded":"2023-10-25T16:24:43.839823+0000","last_fullsized":"2023-10-25T16:24:43.839823+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:51:47.166036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.089423+0000","last_change":"2023-10-25T16:24:42.055401+0000","last_active":"2023-10-25T16:24:43.089423+0000","last_peered":"2023-10-25T16:24:43.089423+0000","last_clean":"2023-10-25T16:24:43.089423+0000","last_became_active":"2023-10-25T16:24:42.055037+0000","last_became_peered":"2023-10-25T16:24:42.055037+0000","last_unstale":"2023-10-25T16:24:43.089423+0000","last_undegraded":"2023-10-25T16:24:43.089423+0000","last_fullsized":"2023-10-25T16:24:43.089423+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:16:26.466484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370308+0000","last_change":"2023-10-25T16:24:42.845248+0000","last_active":"2023-10-25T16:24:44.370308+0000","last_peered":"2023-10-25T16:24:44.370308+0000","last_clean":"2023-10-25T16:24:44.370308+0000","last_became_active":"2023-10-25T16:24:42.844563+0000","last_became_peered":"2023-10-25T16:24:42.844563+0000","last_unstale":"2023-10-25T16:24:44.370308+0000","last_undegraded":"2023-10-25T16:24:44.370308+0000","last_fullsized":"2023-10-25T16:24:44.370308+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:41.791943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"189'1","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839802+0000","last_change":"2023-10-25T16:24:42.062957+0000","last_active":"2023-10-25T16:24:43.839802+0000","last_peered":"2023-10-25T16:24:43.839802+0000","last_clean":"2023-10-25T16:24:43.839802+0000","last_became_active":"2023-10-25T16:24:42.055041+0000","last_became_peered":"2023-10-25T16:24:42.055041+0000","last_unstale":"2023-10-25T16:24:43.839802+0000","last_undegraded":"2023-10-25T16:24:43.839802+0000","last_fullsized":"2023-10-25T16:24:43.839802+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:02:39.842755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.852344+0000","last_change":"2023-10-25T16:24:42.851788+0000","last_active":"2023-10-25T16:24:42.852344+0000","last_peered":"2023-10-25T16:24:42.852344+0000","last_clean":"2023-10-25T16:24:42.852344+0000","last_became_active":"2023-10-25T16:24:42.850851+0000","last_became_peered":"2023-10-25T16:24:42.850851+0000","last_unstale":"2023-10-25T16:24:42.852344+0000","last_undegraded":"2023-10-25T16:24:42.852344+0000","last_fullsized":"2023-10-25T16:24:42.852344+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:09:31.028448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.084531+0000","last_change":"2023-10-25T16:24:42.057677+0000","last_active":"2023-10-25T16:24:43.084531+0000","last_peered":"2023-10-25T16:24:43.084531+0000","last_clean":"2023-10-25T16:24:43.084531+0000","last_became_active":"2023-10-25T16:24:42.054801+0000","last_became_peered":"2023-10-25T16:24:42.054801+0000","last_unstale":"2023-10-25T16:24:43.084531+0000","last_undegraded":"2023-10-25T16:24:43.084531+0000","last_fullsized":"2023-10-25T16:24:43.084531+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:06:53.610302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.847782+0000","last_change":"2023-10-25T16:24:42.843516+0000","last_active":"2023-10-25T16:24:42.847782+0000","last_peered":"2023-10-25T16:24:42.847782+0000","last_clean":"2023-10-25T16:24:42.847782+0000","last_became_active":"2023-10-25T16:24:42.838853+0000","last_became_peered":"2023-10-25T16:24:42.838853+0000","last_unstale":"2023-10-25T16:24:42.847782+0000","last_undegraded":"2023-10-25T16:24:42.847782+0000","last_fullsized":"2023-10-25T16:24:42.847782+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:12:41.358817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001052+0000","last_change":"2023-10-25T16:24:42.071561+0000","last_active":"2023-10-25T16:24:44.001052+0000","last_peered":"2023-10-25T16:24:44.001052+0000","last_clean":"2023-10-25T16:24:44.001052+0000","last_became_active":"2023-10-25T16:24:42.068567+0000","last_became_peered":"2023-10-25T16:24:42.068567+0000","last_unstale":"2023-10-25T16:24:44.001052+0000","last_undegraded":"2023-10-25T16:24:44.001052+0000","last_fullsized":"2023-10-25T16:24:44.001052+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:46:34.877508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587672+0000","last_change":"2023-10-25T16:24:42.852349+0000","last_active":"2023-10-25T16:24:45.587672+0000","last_peered":"2023-10-25T16:24:45.587672+0000","last_clean":"2023-10-25T16:24:45.587672+0000","last_became_active":"2023-10-25T16:24:42.848521+0000","last_became_peered":"2023-10-25T16:24:42.848521+0000","last_unstale":"2023-10-25T16:24:45.587672+0000","last_undegraded":"2023-10-25T16:24:45.587672+0000","last_fullsized":"2023-10-25T16:24:45.587672+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:46:58.305335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370749+0000","last_change":"2023-10-25T16:24:42.051870+0000","last_active":"2023-10-25T16:24:44.370749+0000","last_peered":"2023-10-25T16:24:44.370749+0000","last_clean":"2023-10-25T16:24:44.370749+0000","last_became_active":"2023-10-25T16:24:42.051571+0000","last_became_peered":"2023-10-25T16:24:42.051571+0000","last_unstale":"2023-10-25T16:24:44.370749+0000","last_undegraded":"2023-10-25T16:24:44.370749+0000","last_fullsized":"2023-10-25T16:24:44.370749+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:47:08.033543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839183+0000","last_change":"2023-10-25T16:24:42.856078+0000","last_active":"2023-10-25T16:24:43.839183+0000","last_peered":"2023-10-25T16:24:43.839183+0000","last_clean":"2023-10-25T16:24:43.839183+0000","last_became_active":"2023-10-25T16:24:42.855407+0000","last_became_peered":"2023-10-25T16:24:42.855407+0000","last_unstale":"2023-10-25T16:24:43.839183+0000","last_undegraded":"2023-10-25T16:24:43.839183+0000","last_fullsized":"2023-10-25T16:24:43.839183+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:27:52.406906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.844712+0000","last_change":"2023-10-25T16:24:42.066875+0000","last_active":"2023-10-25T16:24:42.844712+0000","last_peered":"2023-10-25T16:24:42.844712+0000","last_clean":"2023-10-25T16:24:42.844712+0000","last_became_active":"2023-10-25T16:24:42.066693+0000","last_became_peered":"2023-10-25T16:24:42.066693+0000","last_unstale":"2023-10-25T16:24:42.844712+0000","last_undegraded":"2023-10-25T16:24:42.844712+0000","last_fullsized":"2023-10-25T16:24:42.844712+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:01:43.854484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840160+0000","last_change":"2023-10-25T16:24:42.861748+0000","last_active":"2023-10-25T16:24:43.840160+0000","last_peered":"2023-10-25T16:24:43.840160+0000","last_clean":"2023-10-25T16:24:43.840160+0000","last_became_active":"2023-10-25T16:24:42.861078+0000","last_became_peered":"2023-10-25T16:24:42.861078+0000","last_unstale":"2023-10-25T16:24:43.840160+0000","last_undegraded":"2023-10-25T16:24:43.840160+0000","last_fullsized":"2023-10-25T16:24:43.840160+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:12:11.522629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"189'3","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.083539+0000","last_change":"2023-10-25T16:24:42.051888+0000","last_active":"2023-10-25T16:24:43.083539+0000","last_peered":"2023-10-25T16:24:43.083539+0000","last_clean":"2023-10-25T16:24:43.083539+0000","last_became_active":"2023-10-25T16:24:42.051446+0000","last_became_peered":"2023-10-25T16:24:42.051446+0000","last_unstale":"2023-10-25T16:24:43.083539+0000","last_undegraded":"2023-10-25T16:24:43.083539+0000","last_fullsized":"2023-10-25T16:24:43.083539+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:30:17.027270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.863516+0000","last_change":"2023-10-25T16:24:42.863347+0000","last_active":"2023-10-25T16:24:42.863516+0000","last_peered":"2023-10-25T16:24:42.863516+0000","last_clean":"2023-10-25T16:24:42.863516+0000","last_became_active":"2023-10-25T16:24:42.862649+0000","last_became_peered":"2023-10-25T16:24:42.862649+0000","last_unstale":"2023-10-25T16:24:42.863516+0000","last_undegraded":"2023-10-25T16:24:42.863516+0000","last_fullsized":"2023-10-25T16:24:42.863516+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:45:41.384771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"189'6","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.084913+0000","last_change":"2023-10-25T16:24:42.053002+0000","last_active":"2023-10-25T16:24:43.084913+0000","last_peered":"2023-10-25T16:24:43.084913+0000","last_clean":"2023-10-25T16:24:43.084913+0000","last_became_active":"2023-10-25T16:24:42.052021+0000","last_became_peered":"2023-10-25T16:24:42.052021+0000","last_unstale":"2023-10-25T16:24:43.084913+0000","last_undegraded":"2023-10-25T16:24:43.084913+0000","last_fullsized":"2023-10-25T16:24:43.084913+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:29:36.510860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839398+0000","last_change":"2023-10-25T16:24:42.846556+0000","last_active":"2023-10-25T16:24:43.839398+0000","last_peered":"2023-10-25T16:24:43.839398+0000","last_clean":"2023-10-25T16:24:43.839398+0000","last_became_active":"2023-10-25T16:24:42.845900+0000","last_became_peered":"2023-10-25T16:24:42.845900+0000","last_unstale":"2023-10-25T16:24:43.839398+0000","last_undegraded":"2023-10-25T16:24:43.839398+0000","last_fullsized":"2023-10-25T16:24:43.839398+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:38:24.488319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.085557+0000","last_change":"2023-10-25T16:24:42.056643+0000","last_active":"2023-10-25T16:24:43.085557+0000","last_peered":"2023-10-25T16:24:43.085557+0000","last_clean":"2023-10-25T16:24:43.085557+0000","last_became_active":"2023-10-25T16:24:42.055970+0000","last_became_peered":"2023-10-25T16:24:42.055970+0000","last_unstale":"2023-10-25T16:24:43.085557+0000","last_undegraded":"2023-10-25T16:24:43.085557+0000","last_fullsized":"2023-10-25T16:24:43.085557+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:42:17.599679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370539+0000","last_change":"2023-10-25T16:24:42.858156+0000","last_active":"2023-10-25T16:24:44.370539+0000","last_peered":"2023-10-25T16:24:44.370539+0000","last_clean":"2023-10-25T16:24:44.370539+0000","last_became_active":"2023-10-25T16:24:42.857459+0000","last_became_peered":"2023-10-25T16:24:42.857459+0000","last_unstale":"2023-10-25T16:24:44.370539+0000","last_undegraded":"2023-10-25T16:24:44.370539+0000","last_fullsized":"2023-10-25T16:24:44.370539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:42:50.423189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839510+0000","last_change":"2023-10-25T16:24:42.049822+0000","last_active":"2023-10-25T16:24:43.839510+0000","last_peered":"2023-10-25T16:24:43.839510+0000","last_clean":"2023-10-25T16:24:43.839510+0000","last_became_active":"2023-10-25T16:24:42.049364+0000","last_became_peered":"2023-10-25T16:24:42.049364+0000","last_unstale":"2023-10-25T16:24:43.839510+0000","last_undegraded":"2023-10-25T16:24:43.839510+0000","last_fullsized":"2023-10-25T16:24:43.839510+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:17.596897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.865888+0000","last_change":"2023-10-25T16:24:42.865754+0000","last_active":"2023-10-25T16:24:42.865888+0000","last_peered":"2023-10-25T16:24:42.865888+0000","last_clean":"2023-10-25T16:24:42.865888+0000","last_became_active":"2023-10-25T16:24:42.865228+0000","last_became_peered":"2023-10-25T16:24:42.865228+0000","last_unstale":"2023-10-25T16:24:42.865888+0000","last_undegraded":"2023-10-25T16:24:42.865888+0000","last_fullsized":"2023-10-25T16:24:42.865888+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:49:25.462564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.829618+0000","last_change":"2023-10-25T16:24:42.071322+0000","last_active":"2023-10-25T16:24:42.829618+0000","last_peered":"2023-10-25T16:24:42.829618+0000","last_clean":"2023-10-25T16:24:42.829618+0000","last_became_active":"2023-10-25T16:24:42.071168+0000","last_became_peered":"2023-10-25T16:24:42.071168+0000","last_unstale":"2023-10-25T16:24:42.829618+0000","last_undegraded":"2023-10-25T16:24:42.829618+0000","last_fullsized":"2023-10-25T16:24:42.829618+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:01:18.376929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839388+0000","last_change":"2023-10-25T16:24:42.855034+0000","last_active":"2023-10-25T16:24:43.839388+0000","last_peered":"2023-10-25T16:24:43.839388+0000","last_clean":"2023-10-25T16:24:43.839388+0000","last_became_active":"2023-10-25T16:24:42.854238+0000","last_became_peered":"2023-10-25T16:24:42.854238+0000","last_unstale":"2023-10-25T16:24:43.839388+0000","last_undegraded":"2023-10-25T16:24:43.839388+0000","last_fullsized":"2023-10-25T16:24:43.839388+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:54:59.624115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"189'8","reported_seq":19,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.083878+0000","last_change":"2023-10-25T16:24:42.057408+0000","last_active":"2023-10-25T16:24:43.083878+0000","last_peered":"2023-10-25T16:24:43.083878+0000","last_clean":"2023-10-25T16:24:43.083878+0000","last_became_active":"2023-10-25T16:24:42.056223+0000","last_became_peered":"2023-10-25T16:24:42.056223+0000","last_unstale":"2023-10-25T16:24:43.083878+0000","last_undegraded":"2023-10-25T16:24:43.083878+0000","last_fullsized":"2023-10-25T16:24:43.083878+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:06:19.037181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.859934+0000","last_change":"2023-10-25T16:24:42.857710+0000","last_active":"2023-10-25T16:24:42.859934+0000","last_peered":"2023-10-25T16:24:42.859934+0000","last_clean":"2023-10-25T16:24:42.859934+0000","last_became_active":"2023-10-25T16:24:42.857124+0000","last_became_peered":"2023-10-25T16:24:42.857124+0000","last_unstale":"2023-10-25T16:24:42.859934+0000","last_undegraded":"2023-10-25T16:24:42.859934+0000","last_fullsized":"2023-10-25T16:24:42.859934+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:06:29.589276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"189'1","reported_seq":13,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839883+0000","last_change":"2023-10-25T16:24:42.067556+0000","last_active":"2023-10-25T16:24:43.839883+0000","last_peered":"2023-10-25T16:24:43.839883+0000","last_clean":"2023-10-25T16:24:43.839883+0000","last_became_active":"2023-10-25T16:24:42.066946+0000","last_became_peered":"2023-10-25T16:24:42.066946+0000","last_unstale":"2023-10-25T16:24:43.839883+0000","last_undegraded":"2023-10-25T16:24:43.839883+0000","last_fullsized":"2023-10-25T16:24:43.839883+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:58:05.861144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839189+0000","last_change":"2023-10-25T16:24:42.848132+0000","last_active":"2023-10-25T16:24:43.839189+0000","last_peered":"2023-10-25T16:24:43.839189+0000","last_clean":"2023-10-25T16:24:43.839189+0000","last_became_active":"2023-10-25T16:24:42.847148+0000","last_became_peered":"2023-10-25T16:24:42.847148+0000","last_unstale":"2023-10-25T16:24:43.839189+0000","last_undegraded":"2023-10-25T16:24:43.839189+0000","last_fullsized":"2023-10-25T16:24:43.839189+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840171+0000","last_change":"2023-10-25T16:24:42.057510+0000","last_active":"2023-10-25T16:24:43.840171+0000","last_peered":"2023-10-25T16:24:43.840171+0000","last_clean":"2023-10-25T16:24:43.840171+0000","last_became_active":"2023-10-25T16:24:42.040866+0000","last_became_peered":"2023-10-25T16:24:42.040866+0000","last_unstale":"2023-10-25T16:24:43.840171+0000","last_undegraded":"2023-10-25T16:24:43.840171+0000","last_fullsized":"2023-10-25T16:24:43.840171+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:40:00.918272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.852305+0000","last_change":"2023-10-25T16:24:42.851461+0000","last_active":"2023-10-25T16:24:42.852305+0000","last_peered":"2023-10-25T16:24:42.852305+0000","last_clean":"2023-10-25T16:24:42.852305+0000","last_became_active":"2023-10-25T16:24:42.849940+0000","last_became_peered":"2023-10-25T16:24:42.849940+0000","last_unstale":"2023-10-25T16:24:42.852305+0000","last_undegraded":"2023-10-25T16:24:42.852305+0000","last_fullsized":"2023-10-25T16:24:42.852305+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:53:05.867641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"189'1","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.083300+0000","last_change":"2023-10-25T16:24:42.070242+0000","last_active":"2023-10-25T16:24:43.083300+0000","last_peered":"2023-10-25T16:24:43.083300+0000","last_clean":"2023-10-25T16:24:43.083300+0000","last_became_active":"2023-10-25T16:24:42.067930+0000","last_became_peered":"2023-10-25T16:24:42.067930+0000","last_unstale":"2023-10-25T16:24:43.083300+0000","last_undegraded":"2023-10-25T16:24:43.083300+0000","last_fullsized":"2023-10-25T16:24:43.083300+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:40:30.389535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370800+0000","last_change":"2023-10-25T16:24:42.845326+0000","last_active":"2023-10-25T16:24:44.370800+0000","last_peered":"2023-10-25T16:24:44.370800+0000","last_clean":"2023-10-25T16:24:44.370800+0000","last_became_active":"2023-10-25T16:24:42.844302+0000","last_became_peered":"2023-10-25T16:24:42.844302+0000","last_unstale":"2023-10-25T16:24:44.370800+0000","last_undegraded":"2023-10-25T16:24:44.370800+0000","last_fullsized":"2023-10-25T16:24:44.370800+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.821466+0000","last_change":"2023-10-25T16:24:42.050841+0000","last_active":"2023-10-25T16:24:42.821466+0000","last_peered":"2023-10-25T16:24:42.821466+0000","last_clean":"2023-10-25T16:24:42.821466+0000","last_became_active":"2023-10-25T16:24:42.050228+0000","last_became_peered":"2023-10-25T16:24:42.050228+0000","last_unstale":"2023-10-25T16:24:42.821466+0000","last_undegraded":"2023-10-25T16:24:42.821466+0000","last_fullsized":"2023-10-25T16:24:42.821466+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:25:37.824310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839644+0000","last_change":"2023-10-25T16:24:42.844878+0000","last_active":"2023-10-25T16:24:43.839644+0000","last_peered":"2023-10-25T16:24:43.839644+0000","last_clean":"2023-10-25T16:24:43.839644+0000","last_became_active":"2023-10-25T16:24:42.844168+0000","last_became_peered":"2023-10-25T16:24:42.844168+0000","last_unstale":"2023-10-25T16:24:43.839644+0000","last_undegraded":"2023-10-25T16:24:43.839644+0000","last_fullsized":"2023-10-25T16:24:43.839644+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:00:47.062885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"189'2","reported_seq":13,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.085909+0000","last_change":"2023-10-25T16:24:42.071674+0000","last_active":"2023-10-25T16:24:43.085909+0000","last_peered":"2023-10-25T16:24:43.085909+0000","last_clean":"2023-10-25T16:24:43.085909+0000","last_became_active":"2023-10-25T16:24:42.071356+0000","last_became_peered":"2023-10-25T16:24:42.071356+0000","last_unstale":"2023-10-25T16:24:43.085909+0000","last_undegraded":"2023-10-25T16:24:43.085909+0000","last_fullsized":"2023-10-25T16:24:43.085909+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:42:58.642862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370652+0000","last_change":"2023-10-25T16:24:42.841894+0000","last_active":"2023-10-25T16:24:44.370652+0000","last_peered":"2023-10-25T16:24:44.370652+0000","last_clean":"2023-10-25T16:24:44.370652+0000","last_became_active":"2023-10-25T16:24:42.841237+0000","last_became_peered":"2023-10-25T16:24:42.841237+0000","last_unstale":"2023-10-25T16:24:44.370652+0000","last_undegraded":"2023-10-25T16:24:44.370652+0000","last_fullsized":"2023-10-25T16:24:44.370652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.821596+0000","last_change":"2023-10-25T16:24:42.047262+0000","last_active":"2023-10-25T16:24:42.821596+0000","last_peered":"2023-10-25T16:24:42.821596+0000","last_clean":"2023-10-25T16:24:42.821596+0000","last_became_active":"2023-10-25T16:24:42.046516+0000","last_became_peered":"2023-10-25T16:24:42.046516+0000","last_unstale":"2023-10-25T16:24:42.821596+0000","last_undegraded":"2023-10-25T16:24:42.821596+0000","last_fullsized":"2023-10-25T16:24:42.821596+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:23:33.525279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.839382+0000","last_change":"2023-10-25T16:24:42.839105+0000","last_active":"2023-10-25T16:24:42.839382+0000","last_peered":"2023-10-25T16:24:42.839382+0000","last_clean":"2023-10-25T16:24:42.839382+0000","last_became_active":"2023-10-25T16:24:42.838370+0000","last_became_peered":"2023-10-25T16:24:42.838370+0000","last_unstale":"2023-10-25T16:24:42.839382+0000","last_undegraded":"2023-10-25T16:24:42.839382+0000","last_fullsized":"2023-10-25T16:24:42.839382+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:06:39.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.831950+0000","last_change":"2023-10-25T16:24:42.065222+0000","last_active":"2023-10-25T16:24:42.831950+0000","last_peered":"2023-10-25T16:24:42.831950+0000","last_clean":"2023-10-25T16:24:42.831950+0000","last_became_active":"2023-10-25T16:24:42.064992+0000","last_became_peered":"2023-10-25T16:24:42.064992+0000","last_unstale":"2023-10-25T16:24:42.831950+0000","last_undegraded":"2023-10-25T16:24:42.831950+0000","last_fullsized":"2023-10-25T16:24:42.831950+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:00:32.484347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587691+0000","last_change":"2023-10-25T16:24:42.857914+0000","last_active":"2023-10-25T16:24:45.587691+0000","last_peered":"2023-10-25T16:24:45.587691+0000","last_clean":"2023-10-25T16:24:45.587691+0000","last_became_active":"2023-10-25T16:24:42.856320+0000","last_became_peered":"2023-10-25T16:24:42.856320+0000","last_unstale":"2023-10-25T16:24:45.587691+0000","last_undegraded":"2023-10-25T16:24:45.587691+0000","last_fullsized":"2023-10-25T16:24:45.587691+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:52:15.515443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.823748+0000","last_change":"2023-10-25T16:24:42.070672+0000","last_active":"2023-10-25T16:24:42.823748+0000","last_peered":"2023-10-25T16:24:42.823748+0000","last_clean":"2023-10-25T16:24:42.823748+0000","last_became_active":"2023-10-25T16:24:42.069485+0000","last_became_peered":"2023-10-25T16:24:42.069485+0000","last_unstale":"2023-10-25T16:24:42.823748+0000","last_undegraded":"2023-10-25T16:24:42.823748+0000","last_fullsized":"2023-10-25T16:24:42.823748+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:42:57.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839216+0000","last_change":"2023-10-25T16:24:42.855950+0000","last_active":"2023-10-25T16:24:43.839216+0000","last_peered":"2023-10-25T16:24:43.839216+0000","last_clean":"2023-10-25T16:24:43.839216+0000","last_became_active":"2023-10-25T16:24:42.855233+0000","last_became_peered":"2023-10-25T16:24:42.855233+0000","last_unstale":"2023-10-25T16:24:43.839216+0000","last_undegraded":"2023-10-25T16:24:43.839216+0000","last_fullsized":"2023-10-25T16:24:43.839216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T19:36:21.737177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"189'2","reported_seq":14,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839252+0000","last_change":"2023-10-25T16:24:42.069203+0000","last_active":"2023-10-25T16:24:43.839252+0000","last_peered":"2023-10-25T16:24:43.839252+0000","last_clean":"2023-10-25T16:24:43.839252+0000","last_became_active":"2023-10-25T16:24:42.068980+0000","last_became_peered":"2023-10-25T16:24:42.068980+0000","last_unstale":"2023-10-25T16:24:43.839252+0000","last_undegraded":"2023-10-25T16:24:43.839252+0000","last_fullsized":"2023-10-25T16:24:43.839252+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:43:57.057165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.371156+0000","last_change":"2023-10-25T16:24:42.863388+0000","last_active":"2023-10-25T16:24:44.371156+0000","last_peered":"2023-10-25T16:24:44.371156+0000","last_clean":"2023-10-25T16:24:44.371156+0000","last_became_active":"2023-10-25T16:24:42.862655+0000","last_became_peered":"2023-10-25T16:24:42.862655+0000","last_unstale":"2023-10-25T16:24:44.371156+0000","last_undegraded":"2023-10-25T16:24:44.371156+0000","last_fullsized":"2023-10-25T16:24:44.371156+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:14:31.568076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.840302+0000","last_change":"2023-10-25T16:24:42.058937+0000","last_active":"2023-10-25T16:24:43.840302+0000","last_peered":"2023-10-25T16:24:43.840302+0000","last_clean":"2023-10-25T16:24:43.840302+0000","last_became_active":"2023-10-25T16:24:42.056529+0000","last_became_peered":"2023-10-25T16:24:42.056529+0000","last_unstale":"2023-10-25T16:24:43.840302+0000","last_undegraded":"2023-10-25T16:24:43.840302+0000","last_fullsized":"2023-10-25T16:24:43.840302+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:38:21.074001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:45.587764+0000","last_change":"2023-10-25T16:24:42.858482+0000","last_active":"2023-10-25T16:24:45.587764+0000","last_peered":"2023-10-25T16:24:45.587764+0000","last_clean":"2023-10-25T16:24:45.587764+0000","last_became_active":"2023-10-25T16:24:42.857240+0000","last_became_peered":"2023-10-25T16:24:42.857240+0000","last_unstale":"2023-10-25T16:24:45.587764+0000","last_undegraded":"2023-10-25T16:24:45.587764+0000","last_fullsized":"2023-10-25T16:24:45.587764+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T20:47:55.954523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001416+0000","last_change":"2023-10-25T16:24:42.070623+0000","last_active":"2023-10-25T16:24:44.001416+0000","last_peered":"2023-10-25T16:24:44.001416+0000","last_clean":"2023-10-25T16:24:44.001416+0000","last_became_active":"2023-10-25T16:24:42.067533+0000","last_became_peered":"2023-10-25T16:24:42.067533+0000","last_unstale":"2023-10-25T16:24:44.001416+0000","last_undegraded":"2023-10-25T16:24:44.001416+0000","last_fullsized":"2023-10-25T16:24:44.001416+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T21:57:27.008175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839515+0000","last_change":"2023-10-25T16:24:42.838980+0000","last_active":"2023-10-25T16:24:43.839515+0000","last_peered":"2023-10-25T16:24:43.839515+0000","last_clean":"2023-10-25T16:24:43.839515+0000","last_became_active":"2023-10-25T16:24:42.838385+0000","last_became_peered":"2023-10-25T16:24:42.838385+0000","last_unstale":"2023-10-25T16:24:43.839515+0000","last_undegraded":"2023-10-25T16:24:43.839515+0000","last_fullsized":"2023-10-25T16:24:43.839515+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:02:09.469182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839401+0000","last_change":"2023-10-25T16:24:42.058131+0000","last_active":"2023-10-25T16:24:43.839401+0000","last_peered":"2023-10-25T16:24:43.839401+0000","last_clean":"2023-10-25T16:24:43.839401+0000","last_became_active":"2023-10-25T16:24:42.057693+0000","last_became_peered":"2023-10-25T16:24:42.057693+0000","last_unstale":"2023-10-25T16:24:43.839401+0000","last_undegraded":"2023-10-25T16:24:43.839401+0000","last_fullsized":"2023-10-25T16:24:43.839401+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:57:09.180705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839110+0000","last_change":"2023-10-25T16:24:42.847394+0000","last_active":"2023-10-25T16:24:43.839110+0000","last_peered":"2023-10-25T16:24:43.839110+0000","last_clean":"2023-10-25T16:24:43.839110+0000","last_became_active":"2023-10-25T16:24:42.845964+0000","last_became_peered":"2023-10-25T16:24:42.845964+0000","last_unstale":"2023-10-25T16:24:43.839110+0000","last_undegraded":"2023-10-25T16:24:43.839110+0000","last_fullsized":"2023-10-25T16:24:43.839110+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:15:36.415947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.832007+0000","last_change":"2023-10-25T16:24:42.069388+0000","last_active":"2023-10-25T16:24:42.832007+0000","last_peered":"2023-10-25T16:24:42.832007+0000","last_clean":"2023-10-25T16:24:42.832007+0000","last_became_active":"2023-10-25T16:24:42.065735+0000","last_became_peered":"2023-10-25T16:24:42.065735+0000","last_unstale":"2023-10-25T16:24:42.832007+0000","last_undegraded":"2023-10-25T16:24:42.832007+0000","last_fullsized":"2023-10-25T16:24:42.832007+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:20:49.646642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.845511+0000","last_change":"2023-10-25T16:24:42.844538+0000","last_active":"2023-10-25T16:24:42.845511+0000","last_peered":"2023-10-25T16:24:42.845511+0000","last_clean":"2023-10-25T16:24:42.845511+0000","last_became_active":"2023-10-25T16:24:42.842817+0000","last_became_peered":"2023-10-25T16:24:42.842817+0000","last_unstale":"2023-10-25T16:24:42.845511+0000","last_undegraded":"2023-10-25T16:24:42.845511+0000","last_fullsized":"2023-10-25T16:24:42.845511+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:29:05.210483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.829961+0000","last_change":"2023-10-25T16:24:42.057892+0000","last_active":"2023-10-25T16:24:42.829961+0000","last_peered":"2023-10-25T16:24:42.829961+0000","last_clean":"2023-10-25T16:24:42.829961+0000","last_became_active":"2023-10-25T16:24:42.057185+0000","last_became_peered":"2023-10-25T16:24:42.057185+0000","last_unstale":"2023-10-25T16:24:42.829961+0000","last_undegraded":"2023-10-25T16:24:42.829961+0000","last_fullsized":"2023-10-25T16:24:42.829961+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:08:37.495459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.370488+0000","last_change":"2023-10-25T16:24:42.842647+0000","last_active":"2023-10-25T16:24:44.370488+0000","last_peered":"2023-10-25T16:24:44.370488+0000","last_clean":"2023-10-25T16:24:44.370488+0000","last_became_active":"2023-10-25T16:24:42.841926+0000","last_became_peered":"2023-10-25T16:24:42.841926+0000","last_unstale":"2023-10-25T16:24:44.370488+0000","last_undegraded":"2023-10-25T16:24:44.370488+0000","last_fullsized":"2023-10-25T16:24:44.370488+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T18:25:36.093839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:44.001241+0000","last_change":"2023-10-25T16:24:42.066460+0000","last_active":"2023-10-25T16:24:44.001241+0000","last_peered":"2023-10-25T16:24:44.001241+0000","last_clean":"2023-10-25T16:24:44.001241+0000","last_became_active":"2023-10-25T16:24:42.065365+0000","last_became_peered":"2023-10-25T16:24:42.065365+0000","last_unstale":"2023-10-25T16:24:44.001241+0000","last_undegraded":"2023-10-25T16:24:44.001241+0000","last_fullsized":"2023-10-25T16:24:44.001241+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:21:30.039058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.839755+0000","last_change":"2023-10-25T16:24:42.862946+0000","last_active":"2023-10-25T16:24:43.839755+0000","last_peered":"2023-10-25T16:24:43.839755+0000","last_clean":"2023-10-25T16:24:43.839755+0000","last_became_active":"2023-10-25T16:24:42.861024+0000","last_became_peered":"2023-10-25T16:24:42.861024+0000","last_unstale":"2023-10-25T16:24:43.839755+0000","last_undegraded":"2023-10-25T16:24:43.839755+0000","last_fullsized":"2023-10-25T16:24:43.839755+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:22:33.109253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.828443+0000","last_change":"2023-10-25T16:24:42.063433+0000","last_active":"2023-10-25T16:24:42.828443+0000","last_peered":"2023-10-25T16:24:42.828443+0000","last_clean":"2023-10-25T16:24:42.828443+0000","last_became_active":"2023-10-25T16:24:42.062671+0000","last_became_peered":"2023-10-25T16:24:42.062671+0000","last_unstale":"2023-10-25T16:24:42.828443+0000","last_undegraded":"2023-10-25T16:24:42.828443+0000","last_fullsized":"2023-10-25T16:24:42.828443+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:12:04.807092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":11,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-10-25T16:24:43.838989+0000","last_change":"2023-10-25T16:24:42.856140+0000","last_active":"2023-10-25T16:24:43.838989+0000","last_peered":"2023-10-25T16:24:43.838989+0000","last_clean":"2023-10-25T16:24:43.838989+0000","last_became_active":"2023-10-25T16:24:42.855277+0000","last_became_peered":"2023-10-25T16:24:42.855277+0000","last_unstale":"2023-10-25T16:24:43.838989+0000","last_undegraded":"2023-10-25T16:24:43.838989+0000","last_fullsized":"2023-10-25T16:24:43.838989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:42.030305+0000","last_clean_scrub_stamp":"2023-10-25T16:24:42.030305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T16:35:37.952920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.831628+0000","last_change":"2023-10-25T16:24:42.068940+0000","last_active":"2023-10-25T16:24:42.831628+0000","last_peered":"2023-10-25T16:24:42.831628+0000","last_clean":"2023-10-25T16:24:42.831628+0000","last_became_active":"2023-10-25T16:24:42.064691+0000","last_became_peered":"2023-10-25T16:24:42.064691+0000","last_unstale":"2023-10-25T16:24:42.831628+0000","last_undegraded":"2023-10-25T16:24:42.831628+0000","last_fullsized":"2023-10-25T16:24:42.831628+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:24:41.015416+0000","last_clean_scrub_stamp":"2023-10-25T16:24:41.015416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T17:32:55.991276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":325,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-10-25T16:24:42.044629+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:24:42.044629+0000","last_peered":"2023-10-25T16:24:42.044629+0000","last_clean":"2023-10-25T16:24:42.044629+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:24:42.044629+0000","last_undegraded":"2023-10-25T16:24:42.044629+0000","last_fullsized":"2023-10-25T16:24:42.044629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542289,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924567,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.314},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.375}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.79400000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":0.72599999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.755}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.67900000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1622,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193689,"statfs":{"total":200000000,"available":198338235,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.79300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.1839999999999999,"5min":1.24,"15min":1.256},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.44800000000000001},"max":{"1min":1.087,"5min":1.3420000000000001,"15min":1.534},"last":0.88100000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":0.91200000000000003},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.155,"5min":1.4259999999999999,"15min":1.647},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.94699999999999995,"15min":0.92900000000000005},"min":{"1min":0.59999999999999998,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3759999999999999},"last":0.95199999999999996}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91200000000000003,"15min":0.86799999999999999},"min":{"1min":0.77100000000000002,"5min":0.54100000000000004,"15min":0.45500000000000002},"max":{"1min":1.2609999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.88100000000000001,"15min":0.85699999999999998},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.1599999999999999,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.97799999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.73999999999999999,"5min":0.58999999999999997,"15min":0.505},"max":{"1min":1.2989999999999999,"5min":1.51,"15min":1.51},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.238,"5min":1.548,"15min":1.548},"last":1.083}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.85999999999999999,"15min":0.86299999999999999},"min":{"1min":0.64000000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.1279999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93799999999999994,"15min":0.96799999999999997},"min":{"1min":0.72699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.337,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.84499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.337,"5min":1.696,"15min":1.7370000000000001},"last":0.748},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.024},"min":{"1min":0.66000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.234,"5min":1.681,"15min":1.681},"last":1.018}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.105,"15min":1.123},"min":{"1min":0.86699999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.2849999999999999,"5min":1.643,"15min":1.669},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.1140000000000001,"15min":1.1180000000000001},"min":{"1min":1.0629999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.321,"5min":1.591,"15min":1.7490000000000001},"last":1.107}]}]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194268,"statfs":{"total":200000000,"available":198930935,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88300000000000001,"15min":0.876},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2210000000000001,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.028,"15min":0.93700000000000006},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.298,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.91100000000000003},"min":{"1min":0.60799999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1859999999999999,"5min":10.667,"15min":10.667},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.042,"15min":0.95399999999999996},"min":{"1min":0.66000000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3180000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.98199999999999998,"15min":0.92600000000000005},"min":{"1min":0.69999999999999996,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.22,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.079,"15min":0.96799999999999997},"min":{"1min":0.76200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.4330000000000001,"5min":10.948,"15min":10.948},"last":1.1879999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.94199999999999995,"15min":0.92900000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.2709999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1359999999999999,"15min":1.077},"min":{"1min":0.747,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3260000000000001,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.272}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.046,"15min":0.98099999999999998},"min":{"1min":0.63500000000000001,"5min":0.48699999999999999,"15min":0.41499999999999998},"max":{"1min":1.494,"5min":11.081,"15min":11.081},"last":1.3200000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.96099999999999997},"min":{"1min":0.67100000000000004,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2130000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.98399999999999999},"min":{"1min":0.73499999999999999,"5min":0.54600000000000004,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.1040000000000001,"15min":1.075},"min":{"1min":0.56899999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.371,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":1.1439999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.244,"15min":1.143},"min":{"1min":0.86199999999999999,"5min":0.57999999999999996,"15min":0.46700000000000003},"max":{"1min":1.5629999999999999,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.151,"15min":1.0920000000000001},"min":{"1min":0.80400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.375,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.3819999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924053,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91400000000000003,"15min":1.0900000000000001},"min":{"1min":0.624,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2929999999999999,"5min":2.1429999999999998,"15min":14.843},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88,"15min":1.1299999999999999},"min":{"1min":0.65000000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.097,"5min":2.8450000000000002,"15min":16.439},"last":0.628}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90400000000000003,"15min":1.127},"min":{"1min":0.67000000000000004,"5min":0.54000000000000004,"15min":0.40100000000000002},"max":{"1min":1.1399999999999999,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.96199999999999997,"15min":0.91100000000000003},"min":{"1min":0.86199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.282,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96499999999999997,"15min":0.95599999999999996},"min":{"1min":0.69899999999999995,"5min":0.5,"15min":0.5},"max":{"1min":1.3200000000000001,"5min":1.601,"15min":3.9529999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":0.96899999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.244,"5min":1.921,"15min":1.921},"last":0.79000000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.96299999999999997,"15min":0.97899999999999998},"min":{"1min":0.59599999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.379,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.097,"5min":1.0669999999999999,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.3069999999999999,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.875}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.028,"15min":1.2709999999999999},"min":{"1min":0.66700000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2410000000000001,"5min":1.9910000000000001,"15min":15.904},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.93600000000000005,"15min":1.236},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.2450000000000001,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0209999999999999,"15min":1.2430000000000001},"min":{"1min":0.63100000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.3440000000000001,"5min":4.5970000000000004,"15min":14.567},"last":1.028},{"interface":"front","average":{"1min":1.141,"5min":1.1359999999999999,"15min":1.3919999999999999},"min":{"1min":0.73999999999999999,"5min":0.58499999999999996,"15min":0.56699999999999995},"max":{"1min":1.3440000000000001,"5min":2.4079999999999999,"15min":15.089},"last":1.0620000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.01,"15min":1.327},"min":{"1min":0.58599999999999997,"5min":0.436,"15min":0.436},"max":{"1min":1.2110000000000001,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.143,"5min":1.163,"15min":1.208},"min":{"1min":0.877,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.484,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.1100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1045,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194266,"statfs":{"total":200000000,"available":198929275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.877,"15min":0.83799999999999997},"min":{"1min":0.61899999999999999,"5min":0.54400000000000004,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.292,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.194,"5min":1.274,"15min":1.3029999999999999},"last":0.95299999999999996}]},{"osd":1,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.878,"15min":0.84999999999999998},"min":{"1min":0.59399999999999997,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.179,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.012,"15min":0.97799999999999998},"min":{"1min":0.58899999999999997,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.429,"15min":1.4990000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":1.0649999999999999},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.95799999999999996,"15min":0.93300000000000005},"min":{"1min":0.80400000000000005,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.5},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88100000000000001,"15min":0.83399999999999996},"min":{"1min":0.67600000000000005,"5min":0.51600000000000001,"15min":0.45300000000000001},"max":{"1min":1.099,"5min":1.3140000000000001,"15min":1.518},"last":1.0149999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.89800000000000002,"15min":0.93400000000000005},"min":{"1min":0.52700000000000002,"5min":0.48799999999999999,"15min":0.313},"max":{"1min":1.1539999999999999,"5min":1.504,"15min":2.6640000000000001},"last":1.208},{"interface":"front","average":{"1min":1.109,"5min":1.1160000000000001,"15min":1.119},"min":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.488,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":0.93000000000000005}]},{"osd":6,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.66200000000000003,"5min":0.61099999999999999,"15min":0.40000000000000002},"max":{"1min":1.2629999999999999,"5min":1.3560000000000001,"15min":2.085},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.093,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.5600000000000001,"5min":1.625,"15min":1.8149999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.96899999999999997,"15min":0.95199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.4490000000000001,"15min":1.5029999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.125},"min":{"1min":0.78700000000000003,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.3740000000000001,"5min":1.5369999999999999,"15min":1.6220000000000001},"last":1.1639999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194262,"statfs":{"total":200000000,"available":198924623,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66700000000000004,"15min":0.60299999999999998},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.98699999999999999,"5min":1.093,"15min":1.093},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73099999999999998,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.222},"max":{"1min":0.95999999999999996,"5min":1.0529999999999999,"15min":1.083},"last":0.71099999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.66400000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.19700000000000001},"max":{"1min":0.97499999999999998,"5min":1.425,"15min":1.425},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83699999999999997,"15min":0.755},"min":{"1min":0.375,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.155,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81200000000000006}]},{"osd":2,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.69299999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0249999999999999,"5min":1.1359999999999999,"15min":1.3560000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.748,"15min":0.70599999999999996},"min":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.0629999999999999,"5min":1.25,"15min":1.8260000000000001},"last":1.054}]},{"osd":4,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.93200000000000005,"15min":0.89700000000000002},"min":{"1min":0.70799999999999996,"5min":0.60399999999999998,"15min":0.48899999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.036,"15min":0.996},"min":{"1min":0.751,"5min":0.58799999999999997,"15min":0.51300000000000001},"max":{"1min":1.341,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.96699999999999997,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.64600000000000002,"15min":0.45400000000000001},"max":{"1min":1.266,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.64600000000000002,"5min":0.58899999999999997,"15min":0.47499999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.4830000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.97199999999999998,"15min":0.92400000000000004},"min":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.119,"5min":1.3089999999999999,"15min":1.456},"last":1.014},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.0289999999999999,"15min":0.999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.25,"5min":1.861,"15min":1.861},"last":1.1299999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:24:21 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.0529999999999999,"15min":1.0029999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3260000000000001,"5min":1.508,"15min":1.5660000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.012,"5min":1.016,"15min":0.97799999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.306,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1044,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194268,"statfs":{"total":200000000,"available":198930923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61899999999999999,"15min":0.58899999999999997},"min":{"1min":0.48299999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.89100000000000001,"5min":1.0800000000000001,"15min":1.4610000000000001},"last":0.437},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.71699999999999997,"15min":0.66800000000000004},"min":{"1min":0.54100000000000004,"5min":0.29499999999999998,"15min":0.24299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65200000000000002,"15min":0.59699999999999998},"min":{"1min":0.52400000000000002,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.97299999999999998,"5min":0.98599999999999999,"15min":1.4610000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73599999999999999,"15min":0.70199999999999996},"min":{"1min":0.60699999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.495}]},{"osd":3,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70199999999999996,"15min":0.66100000000000003},"min":{"1min":0.55300000000000005,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.86799999999999999,"5min":0.995,"15min":1.1399999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.81999999999999995,"15min":0.77300000000000002},"min":{"1min":0.66600000000000004,"5min":0.37,"15min":0.28000000000000003},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92000000000000004,"15min":0.96099999999999997},"min":{"1min":0.78300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.109,"5min":1.242,"15min":12.698},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.97999999999999998,"15min":1.018},"min":{"1min":0.85699999999999998,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":12.721},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.96499999999999997,"15min":0.93400000000000005},"min":{"1min":0.81499999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.546},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.90200000000000002,"15min":0.89600000000000002},"min":{"1min":0.70399999999999996,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":2.206},"last":0.873}]},{"osd":6,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.024,"15min":0.96999999999999997},"min":{"1min":0.69999999999999996,"5min":0.68600000000000005,"15min":0.49099999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.125,"5min":1.0629999999999999,"15min":1.0329999999999999},"min":{"1min":0.92400000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.49,"15min":1.5980000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:24:23 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.99099999999999999,"15min":1.004},"min":{"1min":0.80900000000000005,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":14.776},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.093,"5min":1.036,"15min":1.0389999999999999},"min":{"1min":0.78000000000000003,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.655,"5min":1.655,"15min":10.509},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198334289,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60599999999999998,"15min":0.64200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":1.0660000000000001,"5min":1.9610000000000001,"15min":5.1029999999999998},"last":0.498},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.44,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0840000000000001,"5min":2.5880000000000001,"15min":4.9980000000000002},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.45500000000000002,"5min":0.30099999999999999,"15min":0.23499999999999999},"max":{"1min":1.0089999999999999,"5min":4.1920000000000002,"15min":4.2320000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75800000000000001,"15min":0.72499999999999998},"min":{"1min":0.59299999999999997,"5min":0.25,"15min":0.25},"max":{"1min":1.129,"5min":3.3919999999999999,"15min":3.3919999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.82299999999999995,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.35299999999999998,"15min":0.28699999999999998},"max":{"1min":1.2090000000000001,"5min":4.431,"15min":4.431},"last":0.998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.874,"15min":0.84399999999999997},"min":{"1min":0.748,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":1.085,"5min":1.296,"15min":3.6579999999999999},"last":0.97099999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.89700000000000002,"15min":0.86599999999999999},"min":{"1min":0.70099999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"max":{"1min":1.181,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95199999999999996,"15min":0.93100000000000005},"min":{"1min":0.70499999999999996,"5min":0.50800000000000001,"15min":0.47699999999999998},"max":{"1min":1.1160000000000001,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.83899999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.90100000000000002},"min":{"1min":0.73999999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1850000000000001,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98599999999999999,"15min":0.95699999999999996},"min":{"1min":0.72099999999999997,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":5.2880000000000003,"15min":5.2880000000000003},"last":1.1120000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.026,"15min":0.99099999999999999},"min":{"1min":0.74099999999999999,"5min":0.60199999999999998,"15min":0.55900000000000005},"max":{"1min":1.27,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0129999999999999,"15min":0.96399999999999997},"min":{"1min":0.77000000000000002,"5min":0.59299999999999997,"15min":0.54400000000000004},"max":{"1min":1.2709999999999999,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:24:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.0229999999999999,"15min":1.1459999999999999},"min":{"1min":0.67000000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.3220000000000001,"5min":1.6799999999999999,"15min":11.891999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0580000000000001,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":11.622},"last":0.80500000000000005}]}]}],"pool_statfs":[]}} 2023-10-25T16:24:50.881 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T16:24:50.882 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-25T16:24:51.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- 172.21.15.177:0/1413691704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 msgr2=0x7f57f80aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 --2- 172.21.15.177:0/1413691704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f80aef70 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f57f806c0c0 tx=0x7f57f401c830 comp rx=0 tx=0).stop 2023-10-25T16:24:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- 172.21.15.177:0/1413691704 shutdown_connections 2023-10-25T16:24:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 --2- 172.21.15.177:0/1413691704 >> v2:172.21.15.184:3300/0 conn(0x7f57f80af4b0 0x7f57f80b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 --2- 172.21.15.177:0/1413691704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f80aef70 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- 172.21.15.177:0/1413691704 >> 172.21.15.177:0/1413691704 conn(0x7f57f80698f0 msgr2=0x7f57f8069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- 172.21.15.177:0/1413691704 shutdown_connections 2023-10-25T16:24:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- 172.21.15.177:0/1413691704 wait complete. 2023-10-25T16:24:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 Processor -- start 2023-10-25T16:24:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- start start 2023-10-25T16:24:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57f80af4b0 0x7f57f8163250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f80aff30 0x7f57f81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f8142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f815a390 con 0x7f57f81573e0 2023-10-25T16:24:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8159dd0 con 0x7f57f80aff30 2023-10-25T16:24:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f5800115640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f815a0b0 con 0x7f57f80af4b0 2023-10-25T16:24:51.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f57fe6b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f8142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f57fe6b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f8142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50012/0 (socket says 172.21.15.177:50012) 2023-10-25T16:24:51.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f57fe6b2640 1 -- 172.21.15.177:0/2091981721 learned_addr learned my addr 172.21.15.177:0/2091981721 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:51.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.058+0000 7f57fdeb1640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57f80af4b0 0x7f57f8163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fd6b0640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f80aff30 0x7f57f81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fe6b2640 1 -- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57f80af4b0 msgr2=0x7f57f8163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fe6b2640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57f80af4b0 0x7f57f8163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fe6b2640 1 -- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f80aff30 msgr2=0x7f57f81583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fe6b2640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f80aff30 0x7f57f81583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fe6b2640 1 -- 172.21.15.177:0/2091981721 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4009560 con 0x7f57f81573e0 2023-10-25T16:24:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fe6b2640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f8142940 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c780 tx=0x7f57f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f0003d90 con 0x7f57f81573e0 2023-10-25T16:24:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f57f000ce90 con 0x7f57f81573e0 2023-10-25T16:24:51.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f8157bd0 con 0x7f57f81573e0 2023-10-25T16:24:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00052d0 con 0x7f57f81573e0 2023-10-25T16:24:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f8143b70 con 0x7f57f81573e0 2023-10-25T16:24:51.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f804db20 con 0x7f57f81573e0 2023-10-25T16:24:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57f0005430 con 0x7f57f81573e0 2023-10-25T16:24:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57ee7fc640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57dc066470 0x7f57dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57f00838f0 con 0x7f57f81573e0 2023-10-25T16:24:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fdeb1640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57dc066470 0x7f57dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.062+0000 7f57fdeb1640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57dc066470 0x7f57dc068930 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f57f40af000 tx=0x7f57f401b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:51.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.066+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57f0050e00 con 0x7f57f81573e0 2023-10-25T16:24:51.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.278+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f57f8158080 con 0x7f57f81573e0 2023-10-25T16:24:51.280 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.282+0000 7f57ee7fc640 1 -- 172.21.15.177:0/2091981721 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v35) v1 ==== 190+0+147 (secure 0 0 0) 0x7f57f0017070 con 0x7f57f81573e0 2023-10-25T16:24:51.280 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-25T16:24:51.281 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwPjlllEa1FxAA99t5+ImXh7+mwMZUiQQzTg== 2023-10-25T16:24:51.281 INFO:teuthology.orchestra.run.smithi177.stdout: caps mds = "allow" 2023-10-25T16:24:51.281 INFO:teuthology.orchestra.run.smithi177.stdout: caps mon = "allow r" 2023-10-25T16:24:51.281 INFO:teuthology.orchestra.run.smithi177.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-25T16:24:51.282 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.0 2023-10-25T16:24:51.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.282+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57dc066470 msgr2=0x7f57dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.282+0000 7f5800115640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57dc066470 0x7f57dc068930 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f57f40af000 tx=0x7f57f401b070 comp rx=0 tx=0).stop 2023-10-25T16:24:51.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.282+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 msgr2=0x7f57f8142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f8142940 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f57f000c780 tx=0x7f57f000cc40 comp rx=0 tx=0).stop 2023-10-25T16:24:51.283 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 shutdown_connections 2023-10-25T16:24:51.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f57dc066470 0x7f57dc068930 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57f81573e0 0x7f57f8142940 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57f80aff30 0x7f57f81583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 --2- 172.21.15.177:0/2091981721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57f80af4b0 0x7f57f8163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 >> 172.21.15.177:0/2091981721 conn(0x7f57f80698f0 msgr2=0x7f57f81548c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:51.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 shutdown_connections 2023-10-25T16:24:51.285 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.286+0000 7f5800115640 1 -- 172.21.15.177:0/2091981721 wait complete. 2023-10-25T16:24:51.300 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:51.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 -- 172.21.15.177:0/3843018892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806f570 msgr2=0x7f0ef806ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 --2- 172.21.15.177:0/3843018892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806f570 0x7f0ef806ba50 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005fd0 tx=0x7f0ee001c770 comp rx=0 tx=0).stop 2023-10-25T16:24:51.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 -- 172.21.15.177:0/3843018892 shutdown_connections 2023-10-25T16:24:51.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 --2- 172.21.15.177:0/3843018892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806f570 0x7f0ef806ba50 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 --2- 172.21.15.177:0/3843018892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 0x7f0ef80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 -- 172.21.15.177:0/3843018892 >> 172.21.15.177:0/3843018892 conn(0x7f0ef80b2450 msgr2=0x7f0ef80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:51.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 -- 172.21.15.177:0/3843018892 shutdown_connections 2023-10-25T16:24:51.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 -- 172.21.15.177:0/3843018892 wait complete. 2023-10-25T16:24:51.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 Processor -- start 2023-10-25T16:24:51.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.430+0000 7f0efd847640 1 -- start start 2023-10-25T16:24:51.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 0x7f0ef80af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef806f570 0x7f0ef80a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 0x7f0ef8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80af950 con 0x7f0ef806bf90 2023-10-25T16:24:51.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef813e420 con 0x7f0ef806f570 2023-10-25T16:24:51.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef813e700 con 0x7f0ef8140cf0 2023-10-25T16:24:51.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 0x7f0ef80af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 0x7f0ef80af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50024/0 (socket says 172.21.15.177:50024) 2023-10-25T16:24:51.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 -- 172.21.15.177:0/147829151 learned_addr learned my addr 172.21.15.177:0/147829151 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:51.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef77fe640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 0x7f0ef8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0eee7fc640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef806f570 0x7f0ef80a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 -- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 msgr2=0x7f0ef8157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 0x7f0ef8157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 -- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef806f570 msgr2=0x7f0ef80a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef806f570 0x7f0ef80a86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 -- 172.21.15.177:0/147829151 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009450 con 0x7f0ef806bf90 2023-10-25T16:24:51.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef77fe640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 0x7f0ef8157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:51.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef6ffd640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 0x7f0ef80af410 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800c9f0 tx=0x7f0ee800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:51.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8007bb0 con 0x7f0ef806bf90 2023-10-25T16:24:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ee8007e00 con 0x7f0ef806bf90 2023-10-25T16:24:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef813e9e0 con 0x7f0ef806bf90 2023-10-25T16:24:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800f6b0 con 0x7f0ef806bf90 2023-10-25T16:24:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef813efa0 con 0x7f0ef806bf90 2023-10-25T16:24:51.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef813f190 con 0x7f0ef806bf90 2023-10-25T16:24:51.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ee8005020 con 0x7f0ef806bf90 2023-10-25T16:24:51.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef4ff9640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ed80664a0 0x7f0ed8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:51.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee8084a60 con 0x7f0ef806bf90 2023-10-25T16:24:51.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.434+0000 7f0eee7fc640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ed80664a0 0x7f0ed8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:51.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.438+0000 7f0eee7fc640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ed80664a0 0x7f0ed8068960 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00ad000 tx=0x7f0ee00a9040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:51.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.438+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ee8051fc0 con 0x7f0ef806bf90 2023-10-25T16:24:51.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.614+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ef804daf0 con 0x7f0ef806bf90 2023-10-25T16:24:51.613 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.614+0000 7f0ef4ff9640 1 -- 172.21.15.177:0/147829151 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f0ee80555e0 con 0x7f0ef806bf90 2023-10-25T16:24:51.613 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:51.614 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:24:51.614 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:24:51.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ed80664a0 msgr2=0x7f0ed8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ed80664a0 0x7f0ed8068960 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00ad000 tx=0x7f0ee00a9040 comp rx=0 tx=0).stop 2023-10-25T16:24:51.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 msgr2=0x7f0ef80af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:51.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 0x7f0ef80af410 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800c9f0 tx=0x7f0ee800ceb0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 shutdown_connections 2023-10-25T16:24:51.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f0ed80664a0 0x7f0ed8068960 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ef8140cf0 0x7f0ef8157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ef806f570 0x7f0ef80a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 --2- 172.21.15.177:0/147829151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ef806bf90 0x7f0ef80af410 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:51.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 >> 172.21.15.177:0/147829151 conn(0x7f0ef80b2450 msgr2=0x7f0ef806fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:51.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 shutdown_connections 2023-10-25T16:24:51.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:51.618+0000 7f0efd847640 1 -- 172.21.15.177:0/147829151 wait complete. 2023-10-25T16:24:52.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T16:24:42.379643+0000', 'modified': '2023-10-25T16:24:44.443678+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 156302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_156302': {'gid': 156302, 'name': 'd', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6837/532461169', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 532461169}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 532461169}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T16:24:52.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T16:24:52.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-25T16:24:52.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- 172.21.15.177:0/2993608426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 msgr2=0x7f0218004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 --2- 172.21.15.177:0/2993608426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f0218004c50 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f0224006fb0 tx=0x7f022401f720 comp rx=0 tx=0).stop 2023-10-25T16:24:52.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- 172.21.15.177:0/2993608426 shutdown_connections 2023-10-25T16:24:52.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 --2- 172.21.15.177:0/2993608426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f0218004c50 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- 172.21.15.177:0/2993608426 >> 172.21.15.177:0/2993608426 conn(0x7f02300b2450 msgr2=0x7f02300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- 172.21.15.177:0/2993608426 shutdown_connections 2023-10-25T16:24:52.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- 172.21.15.177:0/2993608426 wait complete. 2023-10-25T16:24:52.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 Processor -- start 2023-10-25T16:24:52.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- start start 2023-10-25T16:24:52.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f023015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f023013dc60 0x7f0230159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0230159dd0 0x7f023015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230157c60 con 0x7f02180047d0 2023-10-25T16:24:52.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023013e190 con 0x7f0230159dd0 2023-10-25T16:24:52.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f0236c05640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023013e470 con 0x7f023013dc60 2023-10-25T16:24:52.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f023015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f023015abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50042/0 (socket says 172.21.15.177:50042) 2023-10-25T16:24:52.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.178+0000 7f02349a1640 1 -- 172.21.15.177:0/4218214150 learned_addr learned my addr 172.21.15.177:0/4218214150 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:52.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022ffff640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f023013dc60 0x7f0230159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02349a1640 1 -- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f023013dc60 msgr2=0x7f0230159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02351a2640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0230159dd0 0x7f023015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02349a1640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f023013dc60 0x7f0230159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.182 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02349a1640 1 -- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0230159dd0 msgr2=0x7f023015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02349a1640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0230159dd0 0x7f023015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02349a1640 1 -- 172.21.15.177:0/4218214150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023013e750 con 0x7f02180047d0 2023-10-25T16:24:52.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02351a2640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0230159dd0 0x7f023015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:52.183 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f02349a1640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f023015abb0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f0220010960 tx=0x7f0220010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022d7fa640 1 -- 172.21.15.177:0/4218214150 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220009730 con 0x7f02180047d0 2023-10-25T16:24:52.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022d7fa640 1 -- 172.21.15.177:0/4218214150 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f022000eda0 con 0x7f02180047d0 2023-10-25T16:24:52.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023013ea30 con 0x7f02180047d0 2023-10-25T16:24:52.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022d7fa640 1 -- 172.21.15.177:0/4218214150 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220005280 con 0x7f02180047d0 2023-10-25T16:24:52.184 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023015b0f0 con 0x7f02180047d0 2023-10-25T16:24:52.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022d7fa640 1 -- 172.21.15.177:0/4218214150 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02200053e0 con 0x7f02180047d0 2023-10-25T16:24:52.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022d7fa640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022d7fa640 1 -- 172.21.15.177:0/4218214150 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0220016070 con 0x7f02180047d0 2023-10-25T16:24:52.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022ffff640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f0239d4f000 1 Processor -- start 2023-10-25T16:24:52.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f0239d4f000 1 -- start start 2023-10-25T16:24:52.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.182+0000 7f022ffff640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f02240b0000 tx=0x7f022401c4c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 0x5595e3bc5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b7ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3b7bf80 0x5595e3b7c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e3970cc0 con 0x5595e3bc59c0 2023-10-25T16:24:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e39d3920 con 0x5595e3b7bf80 2023-10-25T16:24:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e39d0e50 con 0x5595e3bc62e0 2023-10-25T16:24:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 0x5595e3bc5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 0x5595e3bc5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50058/0 (socket says 172.21.15.177:50058) 2023-10-25T16:24:52.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/1968272773 learned_addr learned my addr 172.21.15.177:0/1968272773 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:52.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f022ffff640 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b7ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 msgr2=0x5595e3b7ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b7ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02351a2640 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3b7bf80 0x5595e3b7c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3b7bf80 msgr2=0x5595e3b7c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3b7bf80 0x5595e3b7c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/1968272773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595e36c5890 con 0x5595e3bc59c0 2023-10-25T16:24:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 0x5595e3bc5da0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f0220083210 tx=0x7f022005c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7aa98b0c39df3d server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02167fc640 1 -- 172.21.15.177:0/1968272773 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220058040 con 0x5595e3bc59c0 2023-10-25T16:24:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02167fc640 1 -- 172.21.15.177:0/1968272773 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0220059f50 con 0x5595e3bc59c0 2023-10-25T16:24:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02167fc640 1 -- 172.21.15.177:0/1968272773 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022005e100 con 0x5595e3bc59c0 2023-10-25T16:24:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- 172.21.15.177:0/1968272773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 msgr2=0x5595e3bc5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 0x5595e3bc5da0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f0220083210 tx=0x7f022005c190 comp rx=0 tx=0).stop 2023-10-25T16:24:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- 172.21.15.177:0/1968272773 shutdown_connections 2023-10-25T16:24:52.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3b7bf80 0x5595e3b7c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b7ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- 172.21.15.177:0/1968272773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3bc59c0 0x5595e3bc5da0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.197 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- 172.21.15.177:0/1968272773 >> 172.21.15.177:0/1968272773 conn(0x5595e3b732f0 msgr2=0x5595e3b7a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- 172.21.15.177:0/1968272773 shutdown_connections 2023-10-25T16:24:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- 172.21.15.177:0/1968272773 wait complete. 2023-10-25T16:24:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- start start 2023-10-25T16:24:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 Processor -- start 2023-10-25T16:24:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3b813b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3b818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b87be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e39cc740 con 0x5595e3b7bf80 2023-10-25T16:24:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e398bd10 con 0x5595e3bc59c0 2023-10-25T16:24:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e398b9b0 con 0x5595e3bc62e0 2023-10-25T16:24:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f0239d4f000 10 client.0 _ll_register_callbacks cb 0x5595e3b676c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:24:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3b813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3b813b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50064/0 (socket says 172.21.15.177:50064) 2023-10-25T16:24:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/3314771008 learned_addr learned my addr 172.21.15.177:0/3314771008 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f022ffff640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3b818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02351a2640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b87be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 msgr2=0x5595e3b87be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b87be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 msgr2=0x5595e3b818f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3b818f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02349a1640 1 -- 172.21.15.177:0/3314771008 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023015b0f0 con 0x5595e3b7bf80 2023-10-25T16:24:52.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f022ffff640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3b818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:52.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.186+0000 7f02351a2640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b87be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:52.202 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f02349a1640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3b813b0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f0220052300 tx=0x7f0220055ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e633f18b204382 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:24:52.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 1 -- 172.21.15.177:0/3314771008 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220058040 con 0x5595e3b7bf80 2023-10-25T16:24:52.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 1 -- 172.21.15.177:0/3314771008 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0220073030 con 0x5595e3b7bf80 2023-10-25T16:24:52.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595e3980370 con 0x5595e3b7bf80 2023-10-25T16:24:52.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 1 -- 172.21.15.177:0/3314771008 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0220059f50 con 0x5595e3b7bf80 2023-10-25T16:24:52.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 10 client.9744 fetch_fsmap learned FSMap version 72 2023-10-25T16:24:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5595e398e460 con 0x5595e3b7bf80 2023-10-25T16:24:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 1 -- 172.21.15.177:0/3314771008 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0220063020 con 0x5595e3b7bf80 2023-10-25T16:24:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 1 -- 172.21.15.177:0/3314771008 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0220081020 con 0x5595e3b7bf80 2023-10-25T16:24:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 10 client.9744 fetch_fsmap finished waiting for FSMap version 72 2023-10-25T16:24:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 10 client.9744 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:24:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 20 client.9744 populate_metadata read hostname 'smithi177' 2023-10-25T16:24:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3b885f0 0x5595e3bd7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 4 client.9744 mds_command: new command op to 156302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T16:24:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 --> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595e39662d0 con 0x5595e3b885f0 2023-10-25T16:24:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f022ffff640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3b885f0 0x5595e3bd7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 10 client.9744 ms_handle_connect on v2:172.21.15.184:6836/532461169 2023-10-25T16:24:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f022ffff640 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3b885f0 0x5595e3bd7a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a9d91a45341497 server_cookie=8cf013461744c058 in_seq=0 out_seq=0 2023-10-25T16:24:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 1 -- 172.21.15.177:0/3314771008 <== mds.0 v2:172.21.15.184:6836/532461169 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5595e39662d0 con 0x5595e3b885f0 2023-10-25T16:24:52.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 10 client.9744 handle_command_reply: tid=0 2023-10-25T16:24:52.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 client.9744 shutdown 2023-10-25T16:24:52.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 msgr2=0x5595e3b813b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3b813b0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f0220052300 tx=0x7f0220055ec0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 shutdown_connections 2023-10-25T16:24:52.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3b885f0 0x5595e3bd7a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3b87be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3b818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f020f7fe640 0 client.9744 ms_handle_reset on v2:172.21.15.184:6836/532461169 2023-10-25T16:24:52.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 --2- 172.21.15.177:0/3314771008 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3b813b0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 >> 172.21.15.177:0/3314771008 conn(0x5595e3b732f0 msgr2=0x5595e3b7aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 shutdown_connections 2023-10-25T16:24:52.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 1 -- 172.21.15.177:0/3314771008 wait complete. 2023-10-25T16:24:52.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.190+0000 7f0239d4f000 20 client.9744 trim_cache size 0 max 16384 2023-10-25T16:24:52.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 Processor -- start 2023-10-25T16:24:52.215 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 -- start start 2023-10-25T16:24:52.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bc42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc59c0 0x5595e3bc4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc62e0 0x5595e3bd5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e3686940 con 0x5595e3b7bf80 2023-10-25T16:24:52.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e39cf2a0 con 0x5595e3bc62e0 2023-10-25T16:24:52.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e398bd10 con 0x5595e3bc59c0 2023-10-25T16:24:52.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bc42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bc42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50066/0 (socket says 172.21.15.177:50066) 2023-10-25T16:24:52.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 -- 172.21.15.177:0/410033054 learned_addr learned my addr 172.21.15.177:0/410033054 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:52.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f022ffff640 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc59c0 0x5595e3bc4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 -- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc59c0 msgr2=0x5595e3bc4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc59c0 0x5595e3bc4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 -- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc62e0 msgr2=0x5595e3bd5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02351a2640 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc62e0 0x5595e3bd5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.206+0000 7f02349a1640 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc62e0 0x5595e3bd5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 -- 172.21.15.177:0/410033054 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595e3974760 con 0x5595e3b7bf80 2023-10-25T16:24:52.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bc42c0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f022005e2c0 tx=0x7f022005c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3248871726188886 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0216ffd640 1 -- 172.21.15.177:0/410033054 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220058070 con 0x5595e3b7bf80 2023-10-25T16:24:52.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0216ffd640 1 -- 172.21.15.177:0/410033054 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0220063030 con 0x5595e3b7bf80 2023-10-25T16:24:52.219 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0216ffd640 1 -- 172.21.15.177:0/410033054 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220055510 con 0x5595e3b7bf80 2023-10-25T16:24:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/410033054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 msgr2=0x5595e3bc42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bc42c0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f022005e2c0 tx=0x7f022005c190 comp rx=0 tx=0).stop 2023-10-25T16:24:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/410033054 shutdown_connections 2023-10-25T16:24:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc62e0 0x5595e3bd5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc59c0 0x5595e3bc4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- 172.21.15.177:0/410033054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bc42c0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/410033054 >> 172.21.15.177:0/410033054 conn(0x5595e3b732f0 msgr2=0x5595e3bc2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/410033054 shutdown_connections 2023-10-25T16:24:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/410033054 wait complete. 2023-10-25T16:24:52.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- start start 2023-10-25T16:24:52.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 Processor -- start 2023-10-25T16:24:52.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bd86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3bd8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3be0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e39d0740 con 0x5595e3b7bf80 2023-10-25T16:24:52.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e3995720 con 0x5595e3bc59c0 2023-10-25T16:24:52.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e39cb5d0 con 0x5595e3bc62e0 2023-10-25T16:24:52.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 10 client.0 _ll_register_callbacks cb 0x5595e39caea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T16:24:52.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bd86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bd86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50072/0 (socket says 172.21.15.177:50072) 2023-10-25T16:24:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 -- 172.21.15.177:0/2935766522 learned_addr learned my addr 172.21.15.177:0/2935766522 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f022ffff640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3bd8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02351a2640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3be0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 -- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 msgr2=0x5595e3be0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3be0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 -- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 msgr2=0x5595e3bd8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T16:24:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3bd8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 -- 172.21.15.177:0/2935766522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595e398e460 con 0x5595e3b7bf80 2023-10-25T16:24:52.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f022ffff640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3bd8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f02349a1640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bd86f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f0220052300 tx=0x7f022005dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb50963d622fb39b server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f020f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2023-10-25T16:24:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f020f7fe640 1 -- 172.21.15.177:0/2935766522 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220058070 con 0x5595e3b7bf80 2023-10-25T16:24:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f020f7fe640 1 -- 172.21.15.177:0/2935766522 <== mon.0 v2:172.21.15.177:3300/0 2 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0220073070 con 0x5595e3b7bf80 2023-10-25T16:24:52.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595e3bd2e90 con 0x5595e3b7bf80 2023-10-25T16:24:52.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f020f7fe640 1 -- 172.21.15.177:0/2935766522 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0220055940 con 0x5595e3b7bf80 2023-10-25T16:24:52.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 10 client.9750 fetch_fsmap learned FSMap version 72 2023-10-25T16:24:52.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5595e36c5cc0 con 0x5595e3b7bf80 2023-10-25T16:24:52.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f020f7fe640 1 -- 172.21.15.177:0/2935766522 <== mon.0 v2:172.21.15.177:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5595e3bd2e90 con 0x5595e3b7bf80 2023-10-25T16:24:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f020f7fe640 1 -- 172.21.15.177:0/2935766522 <== mon.0 v2:172.21.15.177:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0220081070 con 0x5595e3b7bf80 2023-10-25T16:24:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 10 client.9750 fetch_fsmap finished waiting for FSMap version 72 2023-10-25T16:24:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 10 client.9750 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-25T16:24:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 20 client.9750 populate_metadata read hostname 'smithi177' 2023-10-25T16:24:52.228 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3be1790 0x5595e3c2c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 4 client.9750 mds_command: new command op to 156302 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T16:24:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 --> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5595e39646f0 con 0x5595e3be1790 2023-10-25T16:24:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.210+0000 7f022ffff640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3be1790 0x5595e3c2c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f022ffff640 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3be1790 0x5595e3c2c2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f2cc0cde9b57ae server_cookie=887e874e33d25e19 in_seq=0 out_seq=0 2023-10-25T16:24:52.229 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f020f7fe640 10 client.9750 ms_handle_connect on v2:172.21.15.184:6836/532461169 2023-10-25T16:24:52.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f020f7fe640 1 -- 172.21.15.177:0/2935766522 <== mds.0 v2:172.21.15.184:6836/532461169 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x5595e39646f0 con 0x5595e3be1790 2023-10-25T16:24:52.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f020f7fe640 10 client.9750 handle_command_reply: tid=0 2023-10-25T16:24:52.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 client.9750 shutdown 2023-10-25T16:24:52.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 msgr2=0x5595e3bd86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.230 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bd86f0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f0220052300 tx=0x7f022005dea0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 shutdown_connections 2023-10-25T16:24:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:6836/532461169,v1:172.21.15.184:6837/532461169] conn(0x5595e3be1790 0x5595e3c2c2a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x5595e3bc62e0 0x5595e3be0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595e3bc59c0 0x5595e3bd8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.231 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f020f7fe640 0 client.9750 ms_handle_reset on v2:172.21.15.184:6836/532461169 2023-10-25T16:24:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 --2- 172.21.15.177:0/2935766522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5595e3b7bf80 0x5595e3bd86f0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 >> 172.21.15.177:0/2935766522 conn(0x5595e3b732f0 msgr2=0x5595e3bc2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 shutdown_connections 2023-10-25T16:24:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 1 -- 172.21.15.177:0/2935766522 wait complete. 2023-10-25T16:24:52.232 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0239d4f000 20 client.9750 trim_cache size 0 max 16384 2023-10-25T16:24:52.233 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:24:52.233 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:24:52.233 INFO:teuthology.orchestra.run.smithi177.stdout: "whoami": 0, 2023-10-25T16:24:52.233 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 156302, 2023-10-25T16:24:52.234 INFO:teuthology.orchestra.run.smithi177.stdout: "want_state": "up:active", 2023-10-25T16:24:52.234 INFO:teuthology.orchestra.run.smithi177.stdout: "state": "up:active", 2023-10-25T16:24:52.234 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs", 2023-10-25T16:24:52.234 INFO:teuthology.orchestra.run.smithi177.stdout: "rank_uptime": 9.1480721579999997, 2023-10-25T16:24:52.234 INFO:teuthology.orchestra.run.smithi177.stdout: "mdsmap_epoch": 72, 2023-10-25T16:24:52.235 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch": 190, 2023-10-25T16:24:52.235 INFO:teuthology.orchestra.run.smithi177.stdout: "osdmap_epoch_barrier": 190, 2023-10-25T16:24:52.235 INFO:teuthology.orchestra.run.smithi177.stdout: "uptime": 13.987826425 2023-10-25T16:24:52.235 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:24:52.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f021c0664a0 msgr2=0x7f021c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f021c0664a0 0x7f021c068960 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f02240b0000 tx=0x7f022401c4c0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 msgr2=0x7f023015abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f023015abb0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f0220010960 tx=0x7f0220010e20 comp rx=0 tx=0).stop 2023-10-25T16:24:52.237 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 shutdown_connections 2023-10-25T16:24:52.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f021c0664a0 0x7f021c068960 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0230159dd0 0x7f023015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f023013dc60 0x7f0230159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 --2- 172.21.15.177:0/4218214150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02180047d0 0x7f023015abb0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 >> 172.21.15.177:0/4218214150 conn(0x7f02300b2450 msgr2=0x7f023013c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 shutdown_connections 2023-10-25T16:24:52.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.214+0000 7f0236c05640 1 -- 172.21.15.177:0/4218214150 wait complete. 2023-10-25T16:24:52.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:24:52.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/3632195763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 msgr2=0x7ff49815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/3632195763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49815afb0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff488009920 tx=0x7ff48801c7e0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/3632195763 shutdown_connections 2023-10-25T16:24:52.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/3632195763 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 0x7ff4980aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/3632195763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49815afb0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/3632195763 >> 172.21.15.177:0/3632195763 conn(0x7ff4980b2450 msgr2=0x7ff4980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/3632195763 shutdown_connections 2023-10-25T16:24:52.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/3632195763 wait complete. 2023-10-25T16:24:52.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 Processor -- start 2023-10-25T16:24:52.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- start start 2023-10-25T16:24:52.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 0x7ff49814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49815bbe0 0x7ff498155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498155640 con 0x7ff49806c180 2023-10-25T16:24:52.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff498156f00 con 0x7ff49815bbe0 2023-10-25T16:24:52.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4981571e0 con 0x7ff4980c9df0 2023-10-25T16:24:52.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50094/0 (socket says 172.21.15.177:50094) 2023-10-25T16:24:52.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 -- 172.21.15.177:0/1524253145 learned_addr learned my addr 172.21.15.177:0/1524253145 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:52.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff497fff640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49815bbe0 0x7ff498155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff48ffff640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 0x7ff49814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 -- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 msgr2=0x7ff49814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 0x7ff49814e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 -- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49815bbe0 msgr2=0x7ff498155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49815bbe0 0x7ff498155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 -- 172.21.15.177:0/1524253145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009500 con 0x7ff49806c180 2023-10-25T16:24:52.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff497fff640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49815bbe0 0x7ff498155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:52.362 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff48ffff640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 0x7ff49814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:52.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff4977fe640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49814f2e0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c3c0 tx=0x7ff48000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800052d0 con 0x7ff49806c180 2023-10-25T16:24:52.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff480003600 con 0x7ff49806c180 2023-10-25T16:24:52.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4981558e0 con 0x7ff49806c180 2023-10-25T16:24:52.363 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480003a10 con 0x7ff49806c180 2023-10-25T16:24:52.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.358+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981574c0 con 0x7ff49806c180 2023-10-25T16:24:52.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.362+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff498155b20 con 0x7ff49806c180 2023-10-25T16:24:52.364 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.362+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff480003b70 con 0x7ff49806c180 2023-10-25T16:24:52.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.362+0000 7ff494ff9640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4780664a0 0x7ff478068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:52.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.362+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff480083600 con 0x7ff49806c180 2023-10-25T16:24:52.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.362+0000 7ff48ffff640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4780664a0 0x7ff478068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:52.365 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.362+0000 7ff48ffff640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4780664a0 0x7ff478068960 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff4880af000 tx=0x7ff48801b020 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:52.366 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.366+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff498155b20 con 0x7ff49806c180 2023-10-25T16:24:52.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.538+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff49804daf0 con 0x7ff49806c180 2023-10-25T16:24:52.537 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.538+0000 7ff494ff9640 1 -- 172.21.15.177:0/1524253145 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff480050a80 con 0x7ff49806c180 2023-10-25T16:24:52.538 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:24:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4780664a0 msgr2=0x7ff478068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4780664a0 0x7ff478068960 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff4880af000 tx=0x7ff48801b020 comp rx=0 tx=0).stop 2023-10-25T16:24:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 msgr2=0x7ff49814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49814f2e0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff48000c3c0 tx=0x7ff48000c880 comp rx=0 tx=0).stop 2023-10-25T16:24:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 shutdown_connections 2023-10-25T16:24:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4780664a0 0x7ff478068960 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff49815bbe0 0x7ff498155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4980c9df0 0x7ff49814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 --2- 172.21.15.177:0/1524253145 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff49806c180 0x7ff49814f2e0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 >> 172.21.15.177:0/1524253145 conn(0x7ff4980b2450 msgr2=0x7ff4980cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:52.541 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 shutdown_connections 2023-10-25T16:24:52.542 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:52.542+0000 7ff49e1ba640 1 -- 172.21.15.177:0/1524253145 wait complete. 2023-10-25T16:24:52.554 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:24:52.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:24:52.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-25T16:24:52.555 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T16:24:52.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:52.556 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:24:52.556 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:24:52.557 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:24:52.557 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:24:52.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:52.558 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-25T16:24:52.564 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:24:52.564 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:24:52.564 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:24:52.564 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.565 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-25T16:24:52.565 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.565 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:24:52.565 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:52.565 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-25T16:24:52.566 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:24:52.566 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:52.566 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-25T16:24:52.566 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:24:52.566 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:52.567 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:24:52.567 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:52.567 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:24:52.567 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 41825sec preferred_lft 41825sec 2023-10-25T16:24:52.567 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-25T16:24:52.568 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.568 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:24:52.568 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:dc:41:52:e9 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:52.568 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:24:52.568 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.568 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:24:52.569 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:52.569 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:24:52.569 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.569 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:24:52.569 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.570 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:24:52.570 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:52.570 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:24:52.570 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.570 INFO:teuthology.orchestra.run.smithi177.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:24:52.571 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:52.571 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:24:52.571 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:52.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:52.572 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:24:52.616 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-25T16:24:52.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:52.618 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-25T16:24:52.670 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-25T16:24:52.670 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:24:52.670 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:24:52.671 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:24:52.671 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:24:52.671 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:24:52.671 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:24:52.671 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:24:52.672 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:24:52.672 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:24:52.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:52.673 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-25T16:24:52.673 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-25T16:24:52.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:24:52.674 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:24:52.674 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:24:52.675 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-25T16:24:52.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:52.746 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:24:52.791 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:24:52.791 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:24:52.791 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:24:52.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:52.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-25T16:24:52.851 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-25T16:24:52.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:24:52.852 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:52.899 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T16:24:52.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:24:52.900 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:52.946 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:24:52.996 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:24:52.996 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:24:52.996 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:24:52.996 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:24:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:24:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:24:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:24:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:24:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:24:52.997 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:24:52.998 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:24:52.998 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:24:52.998 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:24:52.998 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:24:52.998 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:24:52.999 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:24:52.999 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:24:52.999 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:24:52.999 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:24:52.999 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:24:53.000 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:24:53.000 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:24:53.000 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:24:53.000 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:24:53.000 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:24:53.000 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:24:53.001 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:24:53.001 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:24:53.001 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:24:53.001 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:53.001 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:53.002 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:53.002 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:53.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:53.003 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:24:53.050 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:24:53.051 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-25T16:24:53.096 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:24:53.102 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:24:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:24:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:24:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:24:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:24:53.103 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:24:53.104 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:24:53.104 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:24:53.104 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:24:53.104 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:24:53.104 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:24:53.105 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:24:53.105 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:24:53.105 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:24:53.105 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:24:53.106 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:24:53.106 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:24:53.106 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:24:53.106 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:24:53.106 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:24:53.107 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:24:53.107 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:24:53.107 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:24:53.107 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:24:53.107 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:24:53.107 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:24:53.108 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:24:53.108 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:24:53.108 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:24:53.108 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:53.108 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:53.109 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:53.109 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:53.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:53.110 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:24:53.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:24:53.182+0000 7f07e0442580 -1 init, newargv = 0x55c5cccaa150 newargc=15 2023-10-25T16:24:53.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[55533]: starting ceph client 2023-10-25T16:24:53.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[55533]: starting fuse 2023-10-25T16:24:54.259 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:24:54.267 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-25T16:24:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-25T16:24:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-25T16:24:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-25T16:24:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-25T16:24:54.268 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-25T16:24:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-25T16:24:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-25T16:24:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:/run/lock 2023-10-25T16:24:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-25T16:24:54.269 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-25T16:24:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/bpf 2023-10-25T16:24:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:24:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-25T16:24:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-25T16:24:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-25T16:24:54.270 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-25T16:24:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/fs/nfsd 2023-10-25T16:24:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-25T16:24:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-25T16:24:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:24:54.271 INFO:teuthology.orchestra.run.smithi177.stdout:/run/rpc_pipefs 2023-10-25T16:24:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-25T16:24:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-25T16:24:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-0 2023-10-25T16:24:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-1 2023-10-25T16:24:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-2 2023-10-25T16:24:54.272 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-3 2023-10-25T16:24:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-25T16:24:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:24:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:24:54.273 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:54.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:54.275 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-25T16:24:54.322 INFO:teuthology.orchestra.run.smithi177.stdout:45 2023-10-25T16:24:54.323 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:24:54.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:24:54.324 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-25T16:24:54.324 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-25T16:24:54.324 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-25T16:24:54.325 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-25T16:24:54.325 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:24:54.325 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-25T16:24:54.326 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-25T16:24:54.326 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-25T16:24:54.326 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-25T16:24:54.327 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:24:54.327 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-25T16:24:54.327 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-25T16:24:54.328 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-25T16:24:54.328 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-25T16:24:54.328 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:24:54.329 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-25T16:24:54.329 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:24:54.330 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:24:54.330 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:24:54.330 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-25T16:24:54.331 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-25T16:24:54.331 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-25T16:24:54.331 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:24:54.332 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-25T16:24:54.332 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.0")) 2023-10-25T16:24:54.333 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-25T16:24:54.447 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.0.55533.asok 2023-10-25T16:24:54.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:54.459 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55533.asok 2023-10-25T16:24:54.459 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:54.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.55533.asok status 2023-10-25T16:24:54.548 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:54.650 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:24:54.650 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-25T16:24:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:24:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:24:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "0", 2023-10-25T16:24:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-25T16:24:54.651 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-25T16:24:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "55533", 2023-10-25T16:24:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-25T16:24:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-25T16:24:54.652 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-25T16:24:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 9765, 2023-10-25T16:24:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-25T16:24:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-25T16:24:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-25T16:24:54.653 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 9765 2023-10-25T16:24:54.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:54.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:24:54.654 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:54.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:24:54.654 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1537898282 2023-10-25T16:24:54.655 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:54.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:54.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-25T16:24:54.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:54.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:24:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1537898282 2023-10-25T16:24:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.9765 192.168.0.1:0/1537898282", 2023-10-25T16:24:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/1537898282", 2023-10-25T16:24:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-25T16:24:54.656 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 72, 2023-10-25T16:24:54.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 190, 2023-10-25T16:24:54.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:24:54.657 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-25T16:24:54.657 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-25T16:24:54.657 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:24:54.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:54.670 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:54.670 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:24:54.671 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:54.717 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:54.719 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-25T16:24:54.719 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:54.726 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:54.726 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:54.726 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T16:24:54.768 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:54.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:54.777 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T16:24:54.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/3617458878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c06c0f0 msgr2=0x7f7e9c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:54.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/3617458878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c06c0f0 0x7f7e9c0706f0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0ccde0 tx=0x7f7e9401caa0 comp rx=0 tx=0).stop 2023-10-25T16:24:54.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/3617458878 shutdown_connections 2023-10-25T16:24:54.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/3617458878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c06c0f0 0x7f7e9c0706f0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:54.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/3617458878 >> v2:172.21.15.184:3300/0 conn(0x7f7e9c1500f0 0x7f7e9c0c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:54.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/3617458878 >> 172.21.15.177:0/3617458878 conn(0x7f7e9c0b2450 msgr2=0x7f7e9c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:54.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/3617458878 shutdown_connections 2023-10-25T16:24:54.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/3617458878 wait complete. 2023-10-25T16:24:54.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 Processor -- start 2023-10-25T16:24:54.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- start start 2023-10-25T16:24:54.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c06c0f0 0x7f7e9c151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:54.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 0x7f7e9c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:54.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c1500f0 0x7f7e9c0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:54.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c0b1030 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.947 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c151b50 con 0x7f7e9c06c0f0 2023-10-25T16:24:54.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c146f70 con 0x7f7e9c1500f0 2023-10-25T16:24:54.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 0x7f7e9c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:54.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 0x7f7e9c146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50118/0 (socket says 172.21.15.177:50118) 2023-10-25T16:24:54.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 -- 172.21.15.177:0/1035989442 learned_addr learned my addr 172.21.15.177:0/1035989442 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:54.948 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea09d8640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c06c0f0 0x7f7e9c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:54.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 -- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c1500f0 msgr2=0x7f7e9c0b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:54.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c1500f0 0x7f7e9c0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:54.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 -- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c06c0f0 msgr2=0x7f7e9c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:54.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c06c0f0 0x7f7e9c151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:54.949 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 -- 172.21.15.177:0/1035989442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94009820 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e9bfff640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 0x7f7e9c146a30 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c3a0 tx=0x7f7e8400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:54.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840054e0 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e84003600 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c0718c0 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.950 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c0b09e0 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.946+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84003a90 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.951 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.950+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c0b11e0 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.950+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e84003bf0 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.950+0000 7f7e997fa640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e7c066470 0x7f7e7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:54.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.950+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e840834d0 con 0x7f7e9c0c9e50 2023-10-25T16:24:54.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.950+0000 7f7ea09d8640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e7c066470 0x7f7e7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:54.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.950+0000 7f7ea09d8640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e7c066470 0x7f7e7c068930 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0058d0 tx=0x7f7e8c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:54.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:54.954+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e84050a00 con 0x7f7e9c0c9e50 2023-10-25T16:24:55.141 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.142+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7e9c04daf0 con 0x7f7e9c0c9e50 2023-10-25T16:24:55.142 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.142+0000 7f7e997fa640 1 -- 172.21.15.177:0/1035989442 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7e84017070 con 0x7f7e9c0c9e50 2023-10-25T16:24:55.142 INFO:teuthology.orchestra.run.smithi177.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T16:24:55.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e7c066470 msgr2=0x7f7e7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:55.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e7c066470 0x7f7e7c068930 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0058d0 tx=0x7f7e8c005860 comp rx=0 tx=0).stop 2023-10-25T16:24:55.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 msgr2=0x7f7e9c146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:55.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 0x7f7e9c146a30 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c3a0 tx=0x7f7e8400c860 comp rx=0 tx=0).stop 2023-10-25T16:24:55.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 shutdown_connections 2023-10-25T16:24:55.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f7e7c066470 0x7f7e7c068930 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c1500f0 0x7f7e9c0b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e9c0c9e50 0x7f7e9c146a30 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 --2- 172.21.15.177:0/1035989442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c06c0f0 0x7f7e9c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 >> 172.21.15.177:0/1035989442 conn(0x7f7e9c0b2450 msgr2=0x7f7e9c0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:55.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 shutdown_connections 2023-10-25T16:24:55.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:55.146+0000 7f7ea2c3c640 1 -- 172.21.15.177:0/1035989442 wait complete. 2023-10-25T16:24:55.161 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T16:24:55.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T16:24:55.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-25T16:24:55.162 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-25T16:24:55.162 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:55.162 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T16:24:55.163 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T16:24:55.163 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T16:24:55.163 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:24:55.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.164 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-25T16:24:55.171 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T16:24:55.172 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T16:24:55.172 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T16:24:55.172 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.172 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-25T16:24:55.173 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.173 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:24:55.173 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:55.173 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-25T16:24:55.173 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:24:55.174 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:55.174 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-25T16:24:55.174 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-25T16:24:55.174 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:55.174 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T16:24:55.175 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:55.175 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-25T16:24:55.175 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 41804sec preferred_lft 41804sec 2023-10-25T16:24:55.175 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-25T16:24:55.175 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.176 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-25T16:24:55.176 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:6d:59:b0:5a brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:55.176 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-25T16:24:55.176 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.176 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-25T16:24:55.176 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-10-25T16:24:55.177 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-25T16:24:55.177 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.177 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-10-25T16:24:55.177 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.177 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:24:55.178 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:55.178 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-10-25T16:24:55.178 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.178 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-25T16:24:55.178 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:55.179 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-10-25T16:24:55.179 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-25T16:24:55.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.179 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T16:24:55.225 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-25T16:24:55.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.227 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-25T16:24:55.278 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-25T16:24:55.278 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T16:24:55.278 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-25T16:24:55.279 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T16:24:55.279 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-25T16:24:55.279 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T16:24:55.279 INFO:teuthology.orchestra.run.smithi184.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:24:55.279 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:24:55.280 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-25T16:24:55.280 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T16:24:55.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.281 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-25T16:24:55.281 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-25T16:24:55.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T16:24:55.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T16:24:55.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T16:24:55.283 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-25T16:24:55.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.355 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:24:55.403 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:24:55.403 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:24:55.403 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:24:55.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-25T16:24:55.462 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-25T16:24:55.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:24:55.463 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:55.510 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-25T16:24:55.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T16:24:55.511 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:55.557 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:24:55.607 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:24:55.607 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:24:55.607 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:24:55.608 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:24:55.608 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:24:55.608 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:24:55.608 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:24:55.608 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:24:55.609 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:24:55.609 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:24:55.609 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:24:55.609 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:24:55.609 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:24:55.610 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:24:55.610 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:24:55.610 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:24:55.610 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:24:55.611 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:24:55.611 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:24:55.611 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:24:55.611 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:24:55.611 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:24:55.612 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:24:55.612 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:24:55.612 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:24:55.612 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:24:55.612 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:24:55.613 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:24:55.613 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:24:55.613 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:55.613 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:55.613 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:55.614 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:55.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.615 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:24:55.662 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-25T16:24:55.662 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-25T16:24:55.707 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:24:55.714 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:24:55.715 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:24:55.715 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:24:55.715 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:24:55.715 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:24:55.715 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:24:55.716 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:24:55.716 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:24:55.716 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:24:55.716 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:24:55.716 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:24:55.717 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:24:55.717 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:24:55.717 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:24:55.717 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:24:55.717 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:24:55.718 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:24:55.718 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:24:55.718 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:24:55.718 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:24:55.718 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:24:55.718 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:24:55.719 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:24:55.719 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:24:55.719 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:24:55.719 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:24:55.719 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:24:55.719 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:24:55.720 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:24:55.720 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:55.720 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:55.720 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:55.720 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:55.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:55.722 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:24:55.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:24:55.787+0000 7f9f5e64a580 -1 init, newargv = 0x55d34959b2c0 newargc=15 2023-10-25T16:24:55.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35716]: starting ceph client 2023-10-25T16:24:55.792 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35716]: starting fuse 2023-10-25T16:24:56.872 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2023-10-25T16:24:56.881 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2023-10-25T16:24:56.881 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2023-10-25T16:24:56.881 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2023-10-25T16:24:56.881 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2023-10-25T16:24:56.882 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2023-10-25T16:24:56.882 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2023-10-25T16:24:56.882 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2023-10-25T16:24:56.882 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2023-10-25T16:24:56.882 INFO:teuthology.orchestra.run.smithi184.stdout:/run/lock 2023-10-25T16:24:56.883 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2023-10-25T16:24:56.883 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2023-10-25T16:24:56.883 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2023-10-25T16:24:56.883 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2023-10-25T16:24:56.883 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2023-10-25T16:24:56.883 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2023-10-25T16:24:56.884 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2023-10-25T16:24:56.884 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2023-10-25T16:24:56.884 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/fs/nfsd 2023-10-25T16:24:56.884 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2023-10-25T16:24:56.884 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2023-10-25T16:24:56.885 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysusers.service 2023-10-25T16:24:56.885 INFO:teuthology.orchestra.run.smithi184.stdout:/run/rpc_pipefs 2023-10-25T16:24:56.885 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2023-10-25T16:24:56.885 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2023-10-25T16:24:56.885 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-4 2023-10-25T16:24:56.886 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-5 2023-10-25T16:24:56.886 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-6 2023-10-25T16:24:56.886 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph/osd/ceph-7 2023-10-25T16:24:56.886 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2023-10-25T16:24:56.886 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:56.887 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:24:56.887 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:56.887 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:24:56.887 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:56.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:56.888 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2023-10-25T16:24:56.935 INFO:teuthology.orchestra.run.smithi184.stdout:45 2023-10-25T16:24:56.935 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-10-25T16:24:56.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2023-10-25T16:24:56.936 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2023-10-25T16:24:56.936 DEBUG:teuthology.orchestra.run.smithi184:> import re 2023-10-25T16:24:56.937 DEBUG:teuthology.orchestra.run.smithi184:> import os 2023-10-25T16:24:56.937 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2023-10-25T16:24:56.937 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:24:56.938 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2023-10-25T16:24:56.938 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-25T16:24:56.938 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2023-10-25T16:24:56.939 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-25T16:24:56.939 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:24:56.940 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2023-10-25T16:24:56.940 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2023-10-25T16:24:56.940 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2023-10-25T16:24:56.941 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2023-10-25T16:24:56.941 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:24:56.941 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2023-10-25T16:24:56.942 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-25T16:24:56.942 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-25T16:24:56.943 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-25T16:24:56.943 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2023-10-25T16:24:56.943 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2023-10-25T16:24:56.944 DEBUG:teuthology.orchestra.run.smithi184:> return f 2023-10-25T16:24:56.944 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-25T16:24:56.945 DEBUG:teuthology.orchestra.run.smithi184:> 2023-10-25T16:24:56.945 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2023-10-25T16:24:56.945 DEBUG:teuthology.orchestra.run.smithi184:> ' 2023-10-25T16:24:57.059 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.35716.asok 2023-10-25T16:24:57.063 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:57.071 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35716.asok 2023-10-25T16:24:57.073 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:57.074 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.35716.asok status 2023-10-25T16:24:57.159 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:57.260 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-10-25T16:24:57.260 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2023-10-25T16:24:57.260 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "384993681abceb8cb8affea10538d607052db4b4", 2023-10-25T16:24:57.261 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-6863-g38499368 (384993681abceb8cb8affea10538d607052db4b4) reef (dev)", 2023-10-25T16:24:57.261 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2023-10-25T16:24:57.261 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2023-10-25T16:24:57.261 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-25T16:24:57.261 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "35716", 2023-10-25T16:24:57.262 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2023-10-25T16:24:57.262 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:24:57.262 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2023-10-25T16:24:57.262 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2023-10-25T16:24:57.262 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 7267, 2023-10-25T16:24:57.262 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2023-10-25T16:24:57.263 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2023-10-25T16:24:57.263 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2023-10-25T16:24:57.263 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 7267 2023-10-25T16:24:57.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:24:57.263 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:24:57.264 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:24:57.264 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:24:57.264 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1516143510 2023-10-25T16:24:57.264 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-10-25T16:24:57.264 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:24:57.265 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2023-10-25T16:24:57.265 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2023-10-25T16:24:57.265 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2023-10-25T16:24:57.265 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 1516143510 2023-10-25T16:24:57.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-10-25T16:24:57.266 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.7267 192.168.0.1:0/1516143510", 2023-10-25T16:24:57.266 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/1516143510", 2023-10-25T16:24:57.266 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2023-10-25T16:24:57.266 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 72, 2023-10-25T16:24:57.266 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 190, 2023-10-25T16:24:57.267 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2023-10-25T16:24:57.267 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2023-10-25T16:24:57.267 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2023-10-25T16:24:57.267 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-10-25T16:24:57.272 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:57.279 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:57.280 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-10-25T16:24:57.280 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:57.325 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:57.326 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2023-10-25T16:24:57.326 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:57.333 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:57.333 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:24:57.333 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-25T16:24:57.420 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:24:57.420 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:24:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:24:57.427 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:24:57.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/3325243723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff08c005190 msgr2=0x7ff08c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:57.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 --2- 172.21.15.177:0/3325243723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff08c005190 0x7ff08c00b990 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009e30 tx=0x7ff09c01d190 comp rx=0 tx=0).stop 2023-10-25T16:24:57.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/3325243723 shutdown_connections 2023-10-25T16:24:57.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 --2- 172.21.15.177:0/3325243723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff08c005190 0x7ff08c00b990 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/3325243723 >> 172.21.15.177:0/3325243723 conn(0x7ff0a40b2450 msgr2=0x7ff0a40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:57.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/3325243723 shutdown_connections 2023-10-25T16:24:57.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/3325243723 wait complete. 2023-10-25T16:24:57.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 Processor -- start 2023-10-25T16:24:57.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- start start 2023-10-25T16:24:57.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff08c005190 0x7ff0a40abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:57.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 0x7ff0a41eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:57.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0a41ef120 0x7ff0a41f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:57.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ac470 con 0x7ff0a40abff0 2023-10-25T16:24:57.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4142de0 con 0x7ff08c005190 2023-10-25T16:24:57.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40ae620 con 0x7ff0a41ef120 2023-10-25T16:24:57.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 0x7ff0a41eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:57.568 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 0x7ff0a41eebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50132/0 (socket says 172.21.15.177:50132) 2023-10-25T16:24:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 -- 172.21.15.177:0/249005702 learned_addr learned my addr 172.21.15.177:0/249005702 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a2ffd640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff08c005190 0x7ff0a40abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a37fe640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0a41ef120 0x7ff0a41f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 -- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0a41ef120 msgr2=0x7ff0a41f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:57.569 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0a41ef120 0x7ff0a41f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 -- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff08c005190 msgr2=0x7ff0a40abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff08c005190 0x7ff0a40abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 -- 172.21.15.177:0/249005702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40ae900 con 0x7ff0a40abff0 2023-10-25T16:24:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a2ffd640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff08c005190 0x7ff0a40abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:24:57.570 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a27fc640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 0x7ff0a41eebe0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7ff098004d20 tx=0x7ff098001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:57.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098016030 con 0x7ff0a40abff0 2023-10-25T16:24:57.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff0980108c0 con 0x7ff0a40abff0 2023-10-25T16:24:57.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a4142790 con 0x7ff0a40abff0 2023-10-25T16:24:57.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098010c90 con 0x7ff0a40abff0 2023-10-25T16:24:57.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.566+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a41ef5a0 con 0x7ff0a40abff0 2023-10-25T16:24:57.571 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.570+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a40c9780 con 0x7ff0a40abff0 2023-10-25T16:24:57.572 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.570+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff098019070 con 0x7ff0a40abff0 2023-10-25T16:24:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.570+0000 7ff08b7fe640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff0900664a0 0x7ff090068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.570+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff098017070 con 0x7ff0a40abff0 2023-10-25T16:24:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.570+0000 7ff0a2ffd640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff0900664a0 0x7ff090068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.570+0000 7ff0a2ffd640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff0900664a0 0x7ff090068960 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff094001060 tx=0x7ff094000fd0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:57.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.574+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff098051a10 con 0x7ff0a40abff0 2023-10-25T16:24:57.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.754+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0a4142f90 con 0x7ff0a40abff0 2023-10-25T16:24:57.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.754+0000 7ff08b7fe640 1 -- 172.21.15.177:0/249005702 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7ff0a4142f90 con 0x7ff0a40abff0 2023-10-25T16:24:57.752 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:57.753 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:24:57.753 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:24:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.754+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff0900664a0 msgr2=0x7ff090068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:57.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.754+0000 7ff0a927d640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff0900664a0 0x7ff090068960 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff094001060 tx=0x7ff094000fd0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.754+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 msgr2=0x7ff0a41eebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.754+0000 7ff0a927d640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 0x7ff0a41eebe0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7ff098004d20 tx=0x7ff098001630 comp rx=0 tx=0).stop 2023-10-25T16:24:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 shutdown_connections 2023-10-25T16:24:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff0900664a0 0x7ff090068960 secure :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff094001060 tx=0x7ff094000fd0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff0a41ef120 0x7ff0a41f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0a40abff0 0x7ff0a41eebe0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 --2- 172.21.15.177:0/249005702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff08c005190 0x7ff0a40abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 >> 172.21.15.177:0/249005702 conn(0x7ff0a40b2450 msgr2=0x7ff0a40b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 shutdown_connections 2023-10-25T16:24:57.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:57.758+0000 7ff0a927d640 1 -- 172.21.15.177:0/249005702 wait complete. 2023-10-25T16:24:57.770 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:24:57.917 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":156302,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.840187238,"mdsmap_epoch":72,"osdmap_epoch":190,"osdmap_epoch_barrier":190,"uptime":19.679928191999998} 2023-10-25T16:24:57.917 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 156302, "mdsmap_epoch": 72, "osdmap_epoch": 190, "osdmap_epoch_barrier": 190, "rank_uptime": 14.840187238, "state": "up:active", "uptime": 19.679928192, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:24:57.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-10-25T16:24:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/2553742294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f6d0 msgr2=0x7f2ba006cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:58.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/2553742294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f6d0 0x7f2ba006cf80 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0070ec0 tx=0x7f2b9401c830 comp rx=0 tx=0).stop 2023-10-25T16:24:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/2553742294 shutdown_connections 2023-10-25T16:24:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/2553742294 >> v2:172.21.15.184:3300/0 conn(0x7f2ba006d4c0 0x7f2ba00cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/2553742294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f6d0 0x7f2ba006cf80 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/2553742294 >> 172.21.15.177:0/2553742294 conn(0x7f2ba0069920 msgr2=0x7f2ba0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/2553742294 shutdown_connections 2023-10-25T16:24:58.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.054+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/2553742294 wait complete. 2023-10-25T16:24:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 Processor -- start 2023-10-25T16:24:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- start start 2023-10-25T16:24:58.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ba006d4c0 0x7f2ba00adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 0x7f2ba0147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ba00ab820 0x7f2ba00abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00ae210 con 0x7f2ba014f2f0 2023-10-25T16:24:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00acc30 con 0x7f2ba006d4c0 2023-10-25T16:24:58.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00acf10 con 0x7f2ba00ab820 2023-10-25T16:24:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 0x7f2ba0147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 0x7f2ba0147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50162/0 (socket says 172.21.15.177:50162) 2023-10-25T16:24:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 -- 172.21.15.177:0/751066569 learned_addr learned my addr 172.21.15.177:0/751066569 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9ffff640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ba00ab820 0x7f2ba00abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:58.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9f7fe640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ba006d4c0 0x7f2ba00adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 -- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ba00ab820 msgr2=0x7f2ba00abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ba00ab820 0x7f2ba00abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 -- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ba006d4c0 msgr2=0x7f2ba00adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ba006d4c0 0x7f2ba00adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 -- 172.21.15.177:0/751066569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009560 con 0x7f2ba014f2f0 2023-10-25T16:24:58.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b9effd640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 0x7f2ba0147480 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f2b940b0040 tx=0x7f2b940a5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:58.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b940042c0 con 0x7f2ba014f2f0 2023-10-25T16:24:58.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b94004510 con 0x7f2ba014f2f0 2023-10-25T16:24:58.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba00ad1f0 con 0x7f2ba014f2f0 2023-10-25T16:24:58.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94005270 con 0x7f2ba014f2f0 2023-10-25T16:24:58.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00ad7b0 con 0x7f2ba014f2f0 2023-10-25T16:24:58.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba00ad9d0 con 0x7f2ba014f2f0 2023-10-25T16:24:58.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b940b4070 con 0x7f2ba014f2f0 2023-10-25T16:24:58.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b87fff640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b8c066470 0x7f2b8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:58.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.058+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b9411df50 con 0x7f2ba014f2f0 2023-10-25T16:24:58.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.062+0000 7f2b9f7fe640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b8c066470 0x7f2b8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:58.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.062+0000 7f2b9f7fe640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b8c066470 0x7f2b8c068930 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2b90003d60 tx=0x7f2b90009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:58.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.066+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b940eb3e0 con 0x7f2ba014f2f0 2023-10-25T16:24:58.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.218+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f2ba00ad9d0 con 0x7f2ba014f2f0 2023-10-25T16:24:58.939 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.942+0000 7f2b87fff640 1 -- 172.21.15.177:0/751066569 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v191) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2b940eea00 con 0x7f2ba014f2f0 2023-10-25T16:24:58.940 INFO:teuthology.orchestra.run.smithi177.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-10-25T16:24:58.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b8c066470 msgr2=0x7f2b8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:58.943 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b8c066470 0x7f2b8c068930 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2b90003d60 tx=0x7f2b90009040 comp rx=0 tx=0).stop 2023-10-25T16:24:58.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 msgr2=0x7f2ba0147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:58.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 0x7f2ba0147480 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f2b940b0040 tx=0x7f2b940a5760 comp rx=0 tx=0).stop 2023-10-25T16:24:58.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 shutdown_connections 2023-10-25T16:24:58.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2b8c066470 0x7f2b8c068930 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.944 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ba00ab820 0x7f2ba00abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba014f2f0 0x7f2ba0147480 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 --2- 172.21.15.177:0/751066569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ba006d4c0 0x7f2ba00adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:58.945 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 >> 172.21.15.177:0/751066569 conn(0x7f2ba0069920 msgr2=0x7f2ba015a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:58.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 shutdown_connections 2023-10-25T16:24:58.946 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:58.946+0000 7f2ba5e9c640 1 -- 172.21.15.177:0/751066569 wait complete. 2023-10-25T16:24:58.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-10-25T16:24:59.101 INFO:teuthology.orchestra.run.smithi177.stdout:{"osd_mon_report_interval":"5"} 2023-10-25T16:24:59.101 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-10-25T16:24:59.101 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-10-25T16:24:59.102 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:24:59.102 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:59.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:59.108 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-10-25T16:24:59.295 INFO:teuthology.orchestra.run.smithi177.stderr:16+0 records in 2023-10-25T16:24:59.296 INFO:teuthology.orchestra.run.smithi177.stderr:16+0 records out 2023-10-25T16:24:59.296 INFO:teuthology.orchestra.run.smithi177.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.132966 s, 126 MB/s 2023-10-25T16:24:59.297 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:24:59.297 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:24:59.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:24:59.304 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-10-25T16:24:59.527 INFO:teuthology.orchestra.run.smithi177.stderr:17+0 records in 2023-10-25T16:24:59.528 INFO:teuthology.orchestra.run.smithi177.stderr:17+0 records out 2023-10-25T16:24:59.528 INFO:teuthology.orchestra.run.smithi177.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.169338 s, 105 MB/s 2023-10-25T16:24:59.529 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-10-25T16:24:59.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:24:59.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/596592739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 msgr2=0x7fb9840b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:59.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- 172.21.15.177:0/596592739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb9840b1cd0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fb98415efa0 tx=0x7fb97401c870 comp rx=0 tx=0).stop 2023-10-25T16:24:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/596592739 shutdown_connections 2023-10-25T16:24:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- 172.21.15.177:0/596592739 >> v2:172.21.15.184:3300/0 conn(0x7fb9840ab8f0 0x7fb9840abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- 172.21.15.177:0/596592739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9840af5d0 0x7fb98406bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- 172.21.15.177:0/596592739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb9840b1cd0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:59.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/596592739 >> 172.21.15.177:0/596592739 conn(0x7fb9840b2450 msgr2=0x7fb9840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:24:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/596592739 shutdown_connections 2023-10-25T16:24:59.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/596592739 wait complete. 2023-10-25T16:24:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 Processor -- start 2023-10-25T16:24:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- start start 2023-10-25T16:24:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb984142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:59.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9840ab8f0 0x7fb9841484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9840af5d0 0x7fb9840ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98415c470 con 0x7fb98406b980 2023-10-25T16:24:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9841431e0 con 0x7fb9840af5d0 2023-10-25T16:24:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb984070540 con 0x7fb9840ab8f0 2023-10-25T16:24:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb984142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:59.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb984142ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50190/0 (socket says 172.21.15.177:50190) 2023-10-25T16:24:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 -- 172.21.15.177:0/414116148 learned_addr learned my addr 172.21.15.177:0/414116148 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:24:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 -- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9840ab8f0 msgr2=0x7fb9841484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9840ab8f0 0x7fb9841484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 -- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9840af5d0 msgr2=0x7fb9840ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:24:59.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9840af5d0 0x7fb9840ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:24:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 -- 172.21.15.177:0/414116148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974009560 con 0x7fb98406b980 2023-10-25T16:24:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb989316640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb984142ca0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb97401af20 tx=0x7fb9740a5870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740043c0 con 0x7fb98406b980 2023-10-25T16:24:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb974005020 con 0x7fb98406b980 2023-10-25T16:24:59.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98415b9b0 con 0x7fb98406b980 2023-10-25T16:24:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740053f0 con 0x7fb98406b980 2023-10-25T16:24:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.662+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb984070b00 con 0x7fb98406b980 2023-10-25T16:24:59.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.666+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98415c240 con 0x7fb98406b980 2023-10-25T16:24:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.666+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9740b4040 con 0x7fb98406b980 2023-10-25T16:24:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.666+0000 7fb979ffb640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb968066470 0x7fb968068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:24:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.666+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb97411ded0 con 0x7fb98406b980 2023-10-25T16:24:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.666+0000 7fb988b15640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb968066470 0x7fb968068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:24:59.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.666+0000 7fb988b15640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb968066470 0x7fb968068930 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb9840acea0 tx=0x7fb980006bf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:24:59.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.670+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb98415c240 con 0x7fb98406b980 2023-10-25T16:24:59.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.826+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb98415c240 con 0x7fb98406b980 2023-10-25T16:24:59.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb979ffb640 1 -- 172.21.15.177:0/414116148 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) v1 ==== 81+0+34038 (secure 0 0 0) 0x7fb98415c240 con 0x7fb98406b980 2023-10-25T16:24:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:24:59.828 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:24:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 191, 2023-10-25T16:24:59.828 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:24:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:24:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:24:58.933772+0000", 2023-10-25T16:24:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:24:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:24:59.829 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:24:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:24:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:24:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:24:59.830 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:24:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:24:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:24:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:24:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:24:59.831 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:24:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:24:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:24:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:24:59.832 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:24:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:24:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:24:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:24:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:24:59.833 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:24:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:24:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:24:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:24:59.834 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:24:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:24:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:24:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:24:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:24:59.835 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:24:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:24:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:24:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:24:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:24:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:24:59.836 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:24:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:24:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:24:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:24:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:24:59.837 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:24:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:24:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:24:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:24:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:24:59.838 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:24:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:24:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:24:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:24:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.839 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:24:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:24:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:24:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:24:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:24:59.840 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:24:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:24:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:24:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:24:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:24:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:24:59.841 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:24:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:24:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:24:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:24:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:24:59.842 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:24:59.843 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:24:59.843 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:24:59.843 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:24:59.843 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:24:59.843 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:24:59.844 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:24:59.844 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:24:59.844 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:24:59.844 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:24:59.844 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:24:59.844 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.845 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:24:59.845 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:24:59.845 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:24:59.845 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:24:59.845 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:24:59.846 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:24:59.846 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:24:59.846 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:24:59.846 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:24:59.846 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:24:59.847 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:24:59.847 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:24:59.847 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:24:59.847 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:24:59.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.848 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:24:59.848 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:24:59.848 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.848 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:24:59.848 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:24:59.849 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:24:59.849 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:24:59.849 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:24:59.849 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:24:59.849 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:24:59.850 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:24:59.850 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:24:59.850 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.850 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.850 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.850 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:24:59.851 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:24:59.851 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:24:59.851 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:24:59.851 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:24:59.851 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:24:59.852 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:24:59.852 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:24:59.852 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:24:59.852 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:24:59.852 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:24:59.853 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:24:59.853 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:24:59.853 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:24:59.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:24:59.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:24:59.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:24:59.854 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:24:59.854 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:24:59.854 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:24:59.854 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:24:59.854 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:24:59.854 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:24:59.855 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:24:59.855 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:24:59.855 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:24:59.855 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:24:59.855 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.856 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:24:59.856 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:24:59.856 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:24:59.856 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:24:59.856 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:24:59.857 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:24:59.857 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:24:59.857 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:24:59.857 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:24:59.857 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:24:59.857 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:24:59.858 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:24:59.858 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:24:59.858 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:24:59.858 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:24:59.858 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:24:59.859 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:24:59.859 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:24:59.859 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:24:59.859 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:24:59.859 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:24:59.859 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:24:59.860 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:24:59.860 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:24:59.860 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:24:59.860 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:24:59.860 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:24:59.860 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.861 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:24:59.861 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:24:59.861 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:24:59.861 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:24:59.861 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:24:59.862 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:24:59.862 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:24:59.862 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:24:59.862 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:24:59.862 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:24:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:24:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:24:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:24:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:24:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:24:59.863 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.864 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:24:59.864 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:24:59.864 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:24:59.864 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.864 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.865 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:24:59.865 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:24:59.865 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:24:59.865 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:24:59.865 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:24:59.866 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:24:59.866 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:24:59.866 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:24:59.866 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:24:59.866 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.867 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.867 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:24:59.867 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:24:59.867 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:24:59.867 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:24:59.868 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:24:59.868 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:24:59.868 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:24:59.868 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:24:59.868 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:24:59.869 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:24:59.869 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:24:59.869 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:24:59.869 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:24:59.869 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:24:59.870 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:24:59.870 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:24:59.870 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:24:59.870 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:24:59.870 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:24:59.871 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:24:59.871 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:24:59.871 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:24:59.871 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:24:59.871 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:24:59.871 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:24:59.872 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:24:59.872 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:24:59.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.872 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "191", 2023-10-25T16:24:59.872 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:24:59.873 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:24:59.873 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:24:59.873 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:24:59.873 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:24:59.873 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:24:59.874 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:24:59.874 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:24:59.874 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:24:59.874 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:24:59.874 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:24:59.875 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:24:59.875 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:24:59.875 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:24:59.875 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:24:59.875 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:24:59.876 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:24:59.876 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:24:59.876 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:24:59.876 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:24:59.876 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:24:59.877 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:24:59.877 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:24:59.877 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:24:59.877 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:24:59.877 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:24:59.877 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.878 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:24:59.878 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:24:59.878 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:24:59.878 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:24:59.878 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:24:59.879 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:24:59.879 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:24:59.879 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:24:59.879 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:24:59.879 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:24:59.880 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:24:59.880 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:24:59.880 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:24:59.880 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:24:59.880 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.881 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:24:59.881 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:24:59.881 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:24:59.881 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.881 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.881 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:24:59.882 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:24:59.882 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:24:59.882 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:24:59.882 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:24:59.882 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:24:59.882 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:24:59.883 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:24:59.883 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:24:59.883 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.883 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.883 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:24:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:24:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:24:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.884 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.885 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.885 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.885 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.885 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.885 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.885 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.886 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.886 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.886 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.886 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.886 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.887 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.887 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:24:59.887 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.887 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.888 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.888 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:24:59.888 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.888 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.888 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.889 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.889 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.889 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.889 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.889 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:24:59.890 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.890 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.890 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.890 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.890 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:24:59.891 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.891 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.891 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.891 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.891 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.891 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.892 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.892 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.892 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:24:59.892 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.892 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.893 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.893 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.893 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:24:59.893 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.893 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.893 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.894 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.894 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.894 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.894 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.895 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:24:59.895 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.895 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.895 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.895 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:24:59.896 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:24:59.896 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.896 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.896 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.896 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:24:59.897 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:24:59.897 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:24:59.897 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:24:59.897 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.897 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.898 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.898 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.898 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.898 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:24:59.898 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.899 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.899 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.899 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.899 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.899 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.899 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.900 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.900 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.900 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.900 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.900 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:24:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.902 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.902 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:24:59.902 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.902 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.903 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.903 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.903 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.903 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.904 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.904 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:24:59.904 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.904 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.904 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.905 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.905 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:24:59.905 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.905 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.905 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.906 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.906 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.906 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.906 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.906 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:24:59.907 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.907 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.907 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.907 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.907 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:24:59.908 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.908 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.908 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.908 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.909 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.909 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.909 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:24:59.909 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.910 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.910 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:24:59.910 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:24:59.911 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.911 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.911 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:24:59.911 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:24:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:24:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:24:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.912 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.913 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.913 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:24:59.913 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.913 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.913 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.914 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.914 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.914 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.914 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.914 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:24:59.915 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.915 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.915 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.915 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.915 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.916 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.916 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:24:59.916 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.917 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.917 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:24:59.917 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.917 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.917 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.918 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.918 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.918 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.918 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.919 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:24:59.919 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.919 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.920 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:24:59.920 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.920 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.920 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.920 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.921 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.921 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.921 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.921 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:24:59.922 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.922 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.922 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.922 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:24:59.923 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.923 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.923 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.923 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.923 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.924 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.924 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:24:59.924 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.925 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.925 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:24:59.925 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:24:59.925 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.926 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.926 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:24:59.926 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:24:59.926 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:24:59.926 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:24:59.927 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.927 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.927 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.927 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:24:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.928 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.929 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.929 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.929 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.929 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.929 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.930 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.930 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.930 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.930 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.931 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.931 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:24:59.931 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:24:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.933 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.933 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.933 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.933 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:24:59.934 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.934 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.934 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:24:59.935 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.935 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.935 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.935 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.935 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:24:59.936 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:24:59.937 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.938 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:24:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.939 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.940 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.940 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.940 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:24:59.940 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:24:59.940 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.941 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.941 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.941 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:24:59.941 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:24:59.941 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:24:59.942 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:24:59.942 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.942 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.942 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.942 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.942 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.943 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.943 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:24:59.943 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.943 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.944 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.944 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.944 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.944 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.944 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.944 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.945 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.945 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.945 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.945 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.945 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.946 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.946 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.946 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:24:59.946 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.946 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.946 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.947 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.947 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:24:59.947 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.947 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.947 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.948 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.948 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.948 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.948 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.948 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:24:59.949 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.949 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.949 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.949 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.949 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:24:59.950 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.950 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.950 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.950 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.950 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.951 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.951 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.951 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.951 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:24:59.951 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.952 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.952 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.952 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:24:59.952 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.953 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:24:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.954 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.955 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.955 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:24:59.955 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:24:59.955 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.955 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.956 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:24:59.956 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:24:59.956 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:24:59.956 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:24:59.956 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.957 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.957 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.957 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.957 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.957 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.958 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:24:59.958 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.958 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.958 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.958 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.959 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.959 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.959 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.959 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.959 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.960 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.960 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.960 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.960 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.960 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.961 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.961 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:24:59.961 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.961 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:24:59.962 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.962 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.962 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.963 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.963 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.963 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:24:59.964 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.964 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.964 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.964 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:24:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.965 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.966 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.966 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.966 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:24:59.966 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.966 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.967 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.967 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.967 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:24:59.967 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.967 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.968 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.968 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.968 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.969 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:24:59.969 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.969 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.970 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.970 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:24:59.970 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:24:59.970 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.970 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.971 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.972 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.972 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.972 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:24:59.972 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.972 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.973 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.973 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.973 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.973 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.973 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.973 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.974 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.974 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.974 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.974 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.975 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.975 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:24:59.975 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.975 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.976 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:24:59.976 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.976 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.976 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.976 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.977 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.977 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:24:59.977 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.978 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.978 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.978 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.978 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:24:59.978 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:24:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:24:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.982 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.982 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.982 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.982 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:24:59.983 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.983 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.983 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.984 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:24:59.984 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:24:59.984 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.984 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.984 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:24:59.985 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:24:59.985 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:24:59.985 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:24:59.985 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.985 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.985 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.986 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.986 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.986 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:24:59.986 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:24:59.986 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:24:59.987 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:24:59.987 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:24:59.987 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:24:59.987 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:24:59.987 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:24:59.987 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:24:59.988 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:24:59.988 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:24:59.988 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:24:59.988 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:24:59.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:24:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.989 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.990 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:24:59.990 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.990 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.990 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.990 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:24:59.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.991 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.991 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:24:59.991 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.992 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.992 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.992 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.992 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:24:59.992 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.993 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.993 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.993 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:24:59.993 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.994 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.994 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:24:59.994 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.994 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.994 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.995 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.995 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:24:59.995 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.995 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.995 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.995 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.996 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:24:59.996 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:24:59.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:24:59.996 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:24:59.997 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:24:59.997 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:24:59.997 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:24:59.997 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:24:59.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:24:59.998 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:24:59.998 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:24:59.998 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:24:59.998 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:24:59.999 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:24:59.999 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:24:59.999 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:24:59.999 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:24:59.999 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:24:59.999 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:00.000 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:00.000 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:00.000 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.000 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:00.000 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.001 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.001 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.001 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.001 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.001 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.002 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.003 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.003 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.003 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.003 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:00.003 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.004 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:00.004 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.004 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.005 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.005 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.005 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.005 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:00.005 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.005 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.006 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.006 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:00.006 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.006 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.006 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.007 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.007 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.007 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:00.007 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.007 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.008 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:00.008 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.008 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.008 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.008 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.009 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.009 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:00.009 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.009 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.010 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:00.010 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.010 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.010 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.010 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.011 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.011 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:00.011 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.011 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.011 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:00.012 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.012 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.012 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.012 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.012 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.012 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:00.013 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.013 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:00.013 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:00.013 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:00.014 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:00.014 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:00.014 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:00.014 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:00.014 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:00.014 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:00.015 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:00.015 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:00.015 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:00.015 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:00.015 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:00.015 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:00.016 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:00.016 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:00.016 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:00.016 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:00.016 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:00.017 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:00.017 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:00.017 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:00.017 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:00.017 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:00.017 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:00.018 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:00.018 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:00.018 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:00.018 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:00.018 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:00.019 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:00.019 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:00.019 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:00.019 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:00.020 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:00.020 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:00.020 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:00.020 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:00.020 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:00.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb968066470 msgr2=0x7fb968068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:00.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb968066470 0x7fb968068930 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb9840acea0 tx=0x7fb980006bf0 comp rx=0 tx=0).stop 2023-10-25T16:25:00.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 msgr2=0x7fb984142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:00.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb984142ca0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fb97401af20 tx=0x7fb9740a5870 comp rx=0 tx=0).stop 2023-10-25T16:25:00.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 shutdown_connections 2023-10-25T16:25:00.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb968066470 0x7fb968068930 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:00.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9840af5d0 0x7fb9840ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:00.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9840ab8f0 0x7fb9841484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:00.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 --2- 172.21.15.177:0/414116148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb98406b980 0x7fb984142ca0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:00.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 >> 172.21.15.177:0/414116148 conn(0x7fb9840b2450 msgr2=0x7fb984159450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:00.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 shutdown_connections 2023-10-25T16:25:00.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:24:59.830+0000 7fb98b57a640 1 -- 172.21.15.177:0/414116148 wait complete. 2023-10-25T16:25:00.025 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:25:03.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:25:03.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:25:05.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:25:05.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- 172.21.15.177:0/644841097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 msgr2=0x7ff4380d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:05.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/644841097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380d1bd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7ff4380cb990 tx=0x7ff42c01c810 comp rx=0 tx=0).stop 2023-10-25T16:25:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- 172.21.15.177:0/644841097 shutdown_connections 2023-10-25T16:25:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/644841097 >> v2:172.21.15.184:3300/0 conn(0x7ff4380cdb10 0x7ff4380cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/644841097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380d1bd0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/644841097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff43815eba0 0x7ff4380b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- 172.21.15.177:0/644841097 >> 172.21.15.177:0/644841097 conn(0x7ff43809a5c0 msgr2=0x7ff4380d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- 172.21.15.177:0/644841097 shutdown_connections 2023-10-25T16:25:05.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- 172.21.15.177:0/644841097 wait complete. 2023-10-25T16:25:05.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 Processor -- start 2023-10-25T16:25:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- start start 2023-10-25T16:25:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4380cdb10 0x7ff438153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43815eba0 0x7ff438154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:05.169 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380cb210 con 0x7ff4380b2120 2023-10-25T16:25:05.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380b61a0 con 0x7ff43815eba0 2023-10-25T16:25:05.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff43e0ae640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380b66d0 con 0x7ff4380cdb10 2023-10-25T16:25:05.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.166+0000 7ff4377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:05.170 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58526/0 (socket says 172.21.15.177:58526) 2023-10-25T16:25:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 -- 172.21.15.177:0/86789460 learned_addr learned my addr 172.21.15.177:0/86789460 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff436ffd640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4380cdb10 0x7ff438153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 -- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4380cdb10 msgr2=0x7ff438153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4380cdb10 0x7ff438153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 -- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43815eba0 msgr2=0x7ff438154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:05.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff437fff640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43815eba0 0x7ff438154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:05.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43815eba0 0x7ff438154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 -- 172.21.15.177:0/86789460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c009560 con 0x7ff4380b2120 2023-10-25T16:25:05.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff4377fe640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380cacd0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c940 tx=0x7ff42800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:05.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428004220 con 0x7ff4380b2120 2023-10-25T16:25:05.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff428004470 con 0x7ff4380b2120 2023-10-25T16:25:05.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4380c4ff0 con 0x7ff4380b2120 2023-10-25T16:25:05.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428007bf0 con 0x7ff4380b2120 2023-10-25T16:25:05.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4380c6810 con 0x7ff4380b2120 2023-10-25T16:25:05.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4380c6670 con 0x7ff4380b2120 2023-10-25T16:25:05.173 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff428007d50 con 0x7ff4380b2120 2023-10-25T16:25:05.174 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff41ffff640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff424066470 0x7ff424068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:05.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff428084330 con 0x7ff4380b2120 2023-10-25T16:25:05.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff436ffd640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff424066470 0x7ff424068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:05.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.170+0000 7ff436ffd640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff424066470 0x7ff424068930 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0ae000 tx=0x7ff42c01b050 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:05.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.174+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4380c6670 con 0x7ff4380b2120 2023-10-25T16:25:05.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.322+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff4380c6670 con 0x7ff4380b2120 2023-10-25T16:25:05.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff41ffff640 1 -- 172.21.15.177:0/86789460 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v191) v1 ==== 81+0+34038 (secure 0 0 0) 0x7ff4380c6670 con 0x7ff4380b2120 2023-10-25T16:25:05.325 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:05.325 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:05.325 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 191, 2023-10-25T16:25:05.326 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:25:05.326 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:25:05.326 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:24:58.933772+0000", 2023-10-25T16:25:05.326 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:25:05.327 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:25:05.327 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:25:05.327 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:25:05.327 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:25:05.327 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:25:05.328 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:25:05.328 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:25:05.328 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:25:05.328 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:05.329 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:25:05.329 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:25:05.329 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:25:05.329 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:25:05.329 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:25:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:25:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:25:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:25:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:25:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:25:05.330 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:25:05.331 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:25:05.331 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.331 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:25:05.331 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:25:05.331 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:25:05.332 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:05.332 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:05.332 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:05.332 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:05.332 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:05.333 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:05.333 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:05.333 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:05.333 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:05.333 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:05.333 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:05.334 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:05.334 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:25:05.334 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:25:05.334 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:25:05.334 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:25:05.335 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:25:05.335 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:05.335 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:05.335 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:05.335 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:05.336 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:05.336 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:05.336 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:05.336 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.336 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:25:05.337 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:05.337 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:05.337 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:05.337 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:05.338 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:05.338 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:05.338 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:05.338 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:05.338 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:05.338 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:05.339 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:05.339 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:05.339 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:05.339 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:05.339 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:05.340 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:05.340 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:05.340 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:05.340 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:05.340 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:05.341 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:05.341 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:05.341 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:05.341 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:05.341 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:05.342 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:05.342 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.342 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:05.342 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:05.342 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:05.343 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:05.343 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:05.343 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:05.343 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:05.343 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:05.344 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:05.344 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:05.344 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:05.344 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:05.344 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:25:05.344 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:25:05.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.345 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:05.345 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:25:05.345 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.345 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:05.346 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:25:05.346 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:25:05.346 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:25:05.346 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:05.346 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:05.347 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:05.347 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:05.347 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:05.347 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.347 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.348 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.348 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:25:05.348 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:25:05.348 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:25:05.348 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:05.349 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:05.349 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:05.349 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:05.349 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:05.349 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:05.350 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:05.350 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:05.350 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:05.350 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:05.350 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:05.350 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:05.351 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:25:05.351 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:25:05.351 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:25:05.351 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:25:05.351 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:25:05.352 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:05.352 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:05.352 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:05.352 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:05.352 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:05.353 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:05.353 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:05.353 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.353 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:25:05.353 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:05.353 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:05.354 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:05.354 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:05.354 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:05.354 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:05.354 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:05.355 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:05.355 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:05.355 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:05.355 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:05.355 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:05.356 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:05.356 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:05.356 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:05.356 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:05.356 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:05.357 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:05.357 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:05.357 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:05.357 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:05.357 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:05.357 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:05.358 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:05.358 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:05.358 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:05.358 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.358 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:05.359 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:05.359 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:05.359 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:05.359 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:05.359 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:05.360 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:05.360 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:05.360 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:05.360 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:05.360 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:05.361 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:05.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:25:05.361 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:25:05.361 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:25:05.361 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.362 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:05.362 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:05.362 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:25:05.362 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.362 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.363 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:05.363 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:25:05.363 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:25:05.363 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:05.363 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:05.364 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:05.364 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:05.364 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:05.364 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:05.364 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.364 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.365 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.365 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:25:05.365 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:25:05.365 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:25:05.366 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:05.366 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:05.366 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:05.366 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:05.366 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:05.367 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:05.367 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:05.367 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:05.367 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:05.367 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:05.368 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:05.368 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:05.368 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:25:05.368 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:25:05.368 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:25:05.369 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:25:05.369 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:25:05.369 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:05.369 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:05.369 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:05.370 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:05.370 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:05.370 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:05.370 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:05.370 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.371 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "191", 2023-10-25T16:25:05.371 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:05.371 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:05.371 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:05.372 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:05.372 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:05.372 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:05.372 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:05.372 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:05.372 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:05.373 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:25:05.373 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:05.373 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:05.373 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:05.373 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:05.374 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:05.374 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:05.374 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:05.374 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:05.374 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:05.375 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:05.375 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:05.375 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:05.375 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:05.375 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:05.376 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:05.376 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:05.376 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.376 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:05.376 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:05.377 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:05.377 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:05.377 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:05.377 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:05.377 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:05.378 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:05.378 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:05.378 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:05.378 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:05.378 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:05.379 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:25:05.379 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:25:05.379 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.379 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:05.379 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:05.380 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:25:05.380 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.380 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.380 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:05.380 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:25:05.380 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:25:05.381 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:05.381 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:25:05.381 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:25:05.382 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:05.382 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:05.382 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:05.383 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.383 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.383 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:05.383 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:25:05.384 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.384 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:05.384 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.384 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.384 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.385 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.385 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.385 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.385 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.385 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.385 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.386 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.386 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.386 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.386 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.387 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.387 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:25:05.387 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.387 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.387 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.388 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.388 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:25:05.388 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.388 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.388 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.389 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.389 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.389 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.389 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.389 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.389 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:25:05.390 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.390 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.390 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.390 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.390 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:25:05.391 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.391 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.391 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.391 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.391 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.392 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.392 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.392 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.392 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:25:05.392 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.393 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.393 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.393 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.393 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:25:05.393 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.394 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.394 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.394 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.394 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.394 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.395 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.395 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:25:05.395 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.395 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.395 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.396 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.396 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:25:05.396 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:05.396 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.396 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.397 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.397 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:25:05.397 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:25:05.397 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:25:05.397 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:25:05.398 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.398 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.398 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.398 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.398 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.399 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.399 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:05.399 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.399 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.399 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.400 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.400 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.400 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.400 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.400 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.401 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.401 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.401 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.401 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.401 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.402 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.402 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.402 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:25:05.402 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.402 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.403 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.403 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.403 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:25:05.403 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.403 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.404 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.404 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.404 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.404 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.404 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.405 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.405 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:25:05.405 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.405 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.405 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.405 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.406 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:25:05.406 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.406 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.406 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.406 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.407 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.407 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.407 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.407 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.407 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:25:05.408 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.408 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.408 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.408 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.408 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:25:05.409 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.409 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.409 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.409 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.409 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.409 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.410 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.410 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.410 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:25:05.410 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.410 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.411 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.411 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.411 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:25:05.411 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:05.411 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.411 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.412 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.412 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:25:05.412 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:25:05.412 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:25:05.412 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:25:05.413 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.413 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.413 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.413 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.413 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.414 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.415 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.415 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.415 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.415 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.415 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:25:05.415 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.416 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.416 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.416 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.416 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.416 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.417 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.417 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:25:05.417 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.417 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.417 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.417 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.418 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:25:05.418 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.418 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.418 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.419 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.419 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.419 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:25:05.420 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.420 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.420 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.420 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:25:05.420 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.421 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.421 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.421 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.421 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.421 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.422 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.422 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.422 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:25:05.422 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.423 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.423 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.423 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.423 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:25:05.423 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.424 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.424 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.424 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.424 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.424 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.425 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.425 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.425 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:25:05.425 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.425 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.426 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.426 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.426 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:25:05.426 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:05.426 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.427 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.427 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.427 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:25:05.427 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:25:05.427 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:25:05.427 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:25:05.428 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.428 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.428 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.428 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.428 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.429 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.429 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:05.429 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.429 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.429 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.429 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.430 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.430 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.430 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.430 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.430 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.431 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.431 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.431 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.431 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.431 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.432 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.432 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:25:05.432 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.432 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.432 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.433 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.433 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:25:05.433 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.433 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.433 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.434 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.434 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.434 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.434 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.434 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.435 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:25:05.435 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.435 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.435 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.435 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.436 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:25:05.436 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.436 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.436 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.436 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.436 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.437 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.437 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.437 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:25:05.437 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.438 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.438 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.438 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.438 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:25:05.438 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.439 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.439 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.439 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.439 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.439 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.440 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.440 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:25:05.440 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.440 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.440 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.441 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.441 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:25:05.441 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:05.441 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.441 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.442 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.442 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:25:05.442 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:25:05.442 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:25:05.442 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:25:05.443 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.443 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.443 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.443 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.443 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.444 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.444 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:05.444 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.444 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.444 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.444 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.445 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.445 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.445 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.445 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.445 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.446 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.446 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.446 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.446 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.446 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.447 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.447 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:25:05.447 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.447 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.447 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.448 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.448 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:25:05.448 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.448 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.449 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.449 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.449 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.449 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.449 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.450 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:25:05.450 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.450 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.450 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.450 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.451 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:25:05.451 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.451 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.451 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.451 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.452 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.452 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.452 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.452 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:25:05.453 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.453 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.453 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.453 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.453 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:25:05.453 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.454 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.454 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.454 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.454 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.454 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.455 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.455 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:25:05.455 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.455 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.455 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.456 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.456 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:25:05.456 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:05.456 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.456 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.457 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.457 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:25:05.457 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:25:05.457 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:25:05.457 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:25:05.458 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.458 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.458 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.458 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.458 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.458 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.459 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:05.459 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.459 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.459 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.459 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.460 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.460 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.460 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.460 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.460 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.460 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.461 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.461 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.461 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.461 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.461 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.462 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:25:05.462 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.462 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.462 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.462 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.463 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:25:05.463 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.463 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.463 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.463 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.463 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.464 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.464 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.464 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.464 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:25:05.464 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:25:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.465 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.466 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:25:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.467 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:25:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.468 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.469 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:25:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.470 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:25:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.471 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:25:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:25:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:25:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:25:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.472 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:05.473 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.474 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.475 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.476 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:25:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.477 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:25:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.478 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:25:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.479 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:25:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:25:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.482 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:25:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.483 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.484 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:25:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.485 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:25:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.486 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:25:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:25:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:25:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:25:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.487 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.488 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:05.489 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:05.490 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.491 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:25:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.492 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:25:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:05.493 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:25:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:25:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.495 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.496 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:25:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.497 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:25:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.498 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:25:05.499 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:25:05.500 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:25:05.501 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:25:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:25:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:25:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:05.502 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.503 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.504 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.505 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:05.506 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.507 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.508 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.509 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.511 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.512 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.513 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.514 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.515 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.516 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:05.517 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:05.518 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:05.519 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:05.520 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.521 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:05.522 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:05.523 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:05.524 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:05.524 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:05.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff424066470 msgr2=0x7ff424068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:05.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff424066470 0x7ff424068930 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0ae000 tx=0x7ff42c01b050 comp rx=0 tx=0).stop 2023-10-25T16:25:05.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 msgr2=0x7ff4380cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:05.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380cacd0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7ff42800c940 tx=0x7ff42800ce00 comp rx=0 tx=0).stop 2023-10-25T16:25:05.526 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 shutdown_connections 2023-10-25T16:25:05.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff424066470 0x7ff424068930 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43815eba0 0x7ff438154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4380cdb10 0x7ff438153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.527 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 --2- 172.21.15.177:0/86789460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4380b2120 0x7ff4380cacd0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:05.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 >> 172.21.15.177:0/86789460 conn(0x7ff43809a5c0 msgr2=0x7ff43815d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:05.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 shutdown_connections 2023-10-25T16:25:05.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:05.326+0000 7ff43e0ae640 1 -- 172.21.15.177:0/86789460 wait complete. 2023-10-25T16:25:05.529 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:25:10.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:25:10.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- 172.21.15.177:0/4033711744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 msgr2=0x7f16280cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:10.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 --2- 172.21.15.177:0/4033711744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f16280cbfa0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f162806c7b0 tx=0x7f162401c860 comp rx=0 tx=0).stop 2023-10-25T16:25:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- 172.21.15.177:0/4033711744 shutdown_connections 2023-10-25T16:25:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 --2- 172.21.15.177:0/4033711744 >> v2:172.21.15.184:3300/0 conn(0x7f16280af2d0 0x7f1628158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 --2- 172.21.15.177:0/4033711744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f16280cbfa0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- 172.21.15.177:0/4033711744 >> 172.21.15.177:0/4033711744 conn(0x7f16280b2450 msgr2=0x7f16280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:10.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- 172.21.15.177:0/4033711744 shutdown_connections 2023-10-25T16:25:10.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- 172.21.15.177:0/4033711744 wait complete. 2023-10-25T16:25:10.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 Processor -- start 2023-10-25T16:25:10.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- start start 2023-10-25T16:25:10.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16280af2d0 0x7f16280ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:10.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f162813a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:10.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f162815bdb0 0x7f16280acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:10.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280aebd0 con 0x7f162814e810 2023-10-25T16:25:10.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280ae200 con 0x7f162815bdb0 2023-10-25T16:25:10.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f1630088640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280ad5f0 con 0x7f16280af2d0 2023-10-25T16:25:10.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.670+0000 7f162d623640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f162813a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:10.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f162813a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50134/0 (socket says 172.21.15.177:50134) 2023-10-25T16:25:10.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 -- 172.21.15.177:0/4031523092 learned_addr learned my addr 172.21.15.177:0/4031523092 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:10.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162e625640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f162815bdb0 0x7f16280acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:10.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162de24640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16280af2d0 0x7f16280ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:10.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 -- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16280af2d0 msgr2=0x7f16280ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:10.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16280af2d0 0x7f16280ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:10.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 -- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f162815bdb0 msgr2=0x7f16280acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:10.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f162815bdb0 0x7f16280acba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:10.674 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 -- 172.21.15.177:0/4031523092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009560 con 0x7f162814e810 2023-10-25T16:25:10.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162e625640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f162815bdb0 0x7f16280acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:10.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162de24640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16280af2d0 0x7f16280ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:10.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162d623640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f162813a7e0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f161800c490 tx=0x7f161800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:10.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618003600 con 0x7f162814e810 2023-10-25T16:25:10.675 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1618003780 con 0x7f162814e810 2023-10-25T16:25:10.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280ad8d0 con 0x7f162814e810 2023-10-25T16:25:10.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618003b90 con 0x7f162814e810 2023-10-25T16:25:10.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280ade90 con 0x7f162814e810 2023-10-25T16:25:10.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16280ae020 con 0x7f162814e810 2023-10-25T16:25:10.677 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1618003cf0 con 0x7f162814e810 2023-10-25T16:25:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f160c066470 0x7f160c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16180831a0 con 0x7f162814e810 2023-10-25T16:25:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f160c06dfa0 con 0x7f162814e810 2023-10-25T16:25:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162de24640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f160c066470 0x7f160c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:10.678 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.674+0000 7f162de24640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f160c066470 0x7f160c068930 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f16240af000 tx=0x7f162401b0a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:10.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.678+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1618017060 con 0x7f162814e810 2023-10-25T16:25:10.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.834+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f162804daf0 con 0x7f162814e810 2023-10-25T16:25:10.834 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.834+0000 7f161e7fc640 1 -- 172.21.15.177:0/4031523092 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+34057 (secure 0 0 0) 0x7f16180506b0 con 0x7f162814e810 2023-10-25T16:25:10.835 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:10.835 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:10.836 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 192, 2023-10-25T16:25:10.836 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:25:10.836 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:25:10.836 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:25:07.828081+0000", 2023-10-25T16:25:10.836 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:25:10.837 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:25:10.837 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:25:10.837 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:25:10.837 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:25:10.837 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:25:10.837 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:25:10.838 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:25:10.838 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:25:10.838 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:10.838 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:25:10.838 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:25:10.839 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:25:10.839 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:25:10.839 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:25:10.839 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:25:10.839 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:25:10.839 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:25:10.840 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:25:10.840 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:25:10.840 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:25:10.840 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:25:10.840 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.840 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:25:10.841 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:25:10.841 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:25:10.841 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:10.841 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:10.841 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:10.842 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:10.842 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:10.842 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:10.842 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:10.842 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:10.842 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:10.843 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:10.843 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:10.843 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:10.843 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:25:10.843 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:25:10.844 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:25:10.844 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:25:10.844 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:25:10.844 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:10.844 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:10.845 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:10.845 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:10.845 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:10.845 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:10.845 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:10.846 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.846 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:25:10.846 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:10.846 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:10.846 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:10.846 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:10.847 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:10.847 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:10.847 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:10.847 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:10.847 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:10.848 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:10.848 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:10.848 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:10.848 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:10.848 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:10.849 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:10.849 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:10.849 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:10.849 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:10.849 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:10.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:10.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:10.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:10.850 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:10.850 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:10.850 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:10.851 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:10.851 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.851 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:10.851 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:10.851 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:10.852 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:10.852 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:10.852 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:10.852 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:10.852 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:10.853 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:10.853 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:10.853 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:10.853 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:10.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:25:10.853 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:25:10.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.854 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:10.854 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:25:10.854 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.854 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:10.855 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:25:10.855 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:25:10.855 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:25:10.855 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:10.855 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:10.856 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:10.856 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:10.856 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:10.856 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.856 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.857 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.857 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:25:10.857 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:25:10.857 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:25:10.857 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:10.858 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:10.858 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:10.858 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:10.858 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:10.858 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:10.859 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:10.859 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:10.859 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:10.859 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:10.859 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:10.859 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:10.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:25:10.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:25:10.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:25:10.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:25:10.860 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:25:10.860 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:10.861 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:10.861 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:10.861 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:10.861 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:10.861 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:10.862 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:10.862 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:25:10.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:10.862 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:10.863 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:10.863 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:10.863 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:10.863 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:10.863 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:10.863 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:10.864 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:10.864 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:10.864 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:10.864 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:10.864 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:10.864 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:10.865 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:10.865 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:10.865 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:10.865 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:10.865 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:10.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:10.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:10.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:10.866 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:10.866 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:10.866 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:10.867 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:10.867 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.867 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:10.867 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:10.867 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:10.867 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:10.868 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:10.868 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:10.868 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:10.868 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:10.868 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:10.868 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:10.869 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:10.869 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:10.869 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:25:10.869 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:25:10.869 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:25:10.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.870 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:10.870 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:10.870 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:25:10.870 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.870 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.871 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:10.871 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:25:10.871 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:25:10.871 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:10.871 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:10.871 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:10.872 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:10.872 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:10.872 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:10.872 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.872 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.873 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.873 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:25:10.873 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:25:10.873 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:25:10.873 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:25:10.874 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:25:10.874 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:10.874 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:10.874 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:10.874 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:10.874 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:10.875 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:10.875 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:10.875 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:10.875 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:10.876 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:10.876 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:25:10.876 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:25:10.876 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:25:10.876 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:25:10.877 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:25:10.877 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:10.877 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:10.877 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:10.878 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:10.878 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:10.878 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:10.878 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:10.878 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.879 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "192", 2023-10-25T16:25:10.879 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:10.879 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:10.879 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:10.880 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:10.880 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:10.880 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:10.880 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:10.880 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:10.881 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:10.881 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:25:10.881 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:10.881 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:10.881 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:10.882 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:10.882 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:10.882 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:10.882 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:10.882 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:10.883 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:10.883 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:10.883 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:10.883 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:10.883 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:10.883 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:10.884 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:10.884 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:10.884 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.884 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:10.884 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:10.884 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:10.885 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:10.885 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:10.885 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:10.885 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:10.885 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:10.886 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:10.886 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:10.886 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:10.886 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:10.886 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:25:10.886 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:25:10.887 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.887 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:10.887 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:10.887 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:25:10.887 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.888 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.888 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:10.888 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:25:10.888 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:25:10.888 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:10.889 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:25:10.889 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:25:10.889 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:10.889 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:10.889 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:10.890 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.890 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.890 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:10.890 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:25:10.890 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.891 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:10.891 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.891 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.891 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.891 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.892 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.892 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.892 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.892 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.892 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.893 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.893 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.893 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.893 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.893 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.894 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.894 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:25:10.894 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.894 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.894 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.894 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.895 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:25:10.895 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.895 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.895 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.895 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.896 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.896 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.896 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.896 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.896 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:25:10.896 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.897 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.897 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.897 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.897 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:25:10.897 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.898 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.898 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.898 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.898 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.898 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.899 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.899 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.899 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:25:10.899 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.899 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:25:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.900 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.901 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:25:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.902 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:25:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.903 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:25:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:25:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:25:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:25:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.904 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.905 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.906 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.907 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:25:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.908 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:25:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.909 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.910 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:25:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.911 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:25:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.912 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:25:10.913 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.914 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.914 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.914 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.914 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:25:10.914 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.915 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.915 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.915 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.915 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.915 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.915 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.916 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.916 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:25:10.916 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.916 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.916 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.917 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.917 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:25:10.917 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:10.917 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.917 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.918 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.918 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:25:10.918 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:25:10.918 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:25:10.918 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:25:10.919 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.919 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.919 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.919 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.919 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.919 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.920 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:10.920 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.920 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.920 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.920 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.920 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.921 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.921 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.921 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:25:10.921 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.921 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.922 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.922 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.922 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.922 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.922 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.923 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:25:10.923 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.923 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.923 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.923 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.924 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:25:10.924 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.924 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.924 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.924 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.924 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.925 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.925 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.925 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.925 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:25:10.925 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:25:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:25:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.929 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:25:10.929 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.929 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.929 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.929 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.929 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.930 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.930 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.930 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:25:10.930 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.931 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.931 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.931 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.931 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:25:10.931 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:10.932 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.932 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.932 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.932 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:25:10.932 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:25:10.933 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:25:10.933 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:25:10.933 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.933 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.933 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.934 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.934 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.934 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.934 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:10.934 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.935 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.935 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.935 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.935 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.935 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.936 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.936 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.936 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.936 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.936 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.937 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.937 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.937 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.937 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:25:10.937 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.938 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.938 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.938 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.938 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:25:10.938 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.939 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.939 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.939 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.939 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.939 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.939 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.940 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.940 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:25:10.940 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.940 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.940 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.941 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.941 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:25:10.941 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.941 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.941 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.941 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.942 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.942 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.942 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.942 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.942 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:25:10.943 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.943 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.943 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.943 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.943 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:25:10.943 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.944 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.944 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.944 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.944 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.944 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.945 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.945 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.945 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:25:10.945 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.945 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.946 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.946 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.946 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:25:10.946 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:10.946 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.947 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.947 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.947 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:25:10.947 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:25:10.947 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:25:10.948 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:25:10.948 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.948 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.948 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.948 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.949 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.949 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.949 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:10.949 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.949 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.949 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.950 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.950 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.950 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.950 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.950 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.950 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.951 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.951 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.951 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.951 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.951 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.952 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.952 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:25:10.952 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.952 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.952 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.952 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.953 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:25:10.953 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.953 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.953 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.953 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.954 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.954 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.954 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.954 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:25:10.955 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.955 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.955 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.955 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.955 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:25:10.956 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.956 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.956 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.956 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.956 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.956 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.957 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.957 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.957 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:25:10.957 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.957 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.957 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.958 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.958 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:25:10.958 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.958 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.958 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.959 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.961 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.961 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.961 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.962 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.962 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:25:10.962 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.962 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.962 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.963 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.963 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:25:10.963 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:10.963 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.963 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.964 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.964 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:25:10.964 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:25:10.964 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:25:10.964 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:25:10.964 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.965 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.965 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.965 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.965 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.965 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.965 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:10.966 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.966 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.966 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.966 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.966 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.966 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.967 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.967 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.967 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.967 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.967 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.967 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.968 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.968 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.968 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:25:10.968 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.968 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.969 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.969 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.969 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:25:10.969 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.969 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.970 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.970 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.970 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.970 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.970 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.971 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.971 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:25:10.971 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.971 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.971 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.971 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.972 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:25:10.972 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.972 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.972 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.972 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.973 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.973 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.973 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.973 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.973 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:25:10.974 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.974 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.974 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.974 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.974 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:25:10.974 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.975 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.975 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.975 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.975 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.975 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.975 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.976 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.976 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:25:10.976 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.976 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.976 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.976 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.977 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:25:10.977 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:10.977 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.977 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.977 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.977 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:25:10.978 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:25:10.978 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:25:10.978 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:25:10.978 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.978 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.979 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.980 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.980 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.980 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.980 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.980 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.981 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.981 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.981 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.981 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.981 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.981 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.982 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.982 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.982 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:25:10.982 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.982 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.983 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.983 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.983 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:25:10.983 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.983 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.984 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.984 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.984 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.984 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.984 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.984 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.985 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:25:10.985 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.985 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.985 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.985 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.985 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:25:10.986 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.986 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.986 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.986 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.986 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:10.987 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.987 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.987 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.987 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:25:10.987 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.988 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.988 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.988 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.988 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:25:10.988 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.988 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.989 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.989 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.989 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:10.989 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.989 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.990 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.990 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:25:10.990 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.990 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.990 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.990 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.991 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:25:10.991 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:10.991 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.991 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.991 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.992 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:25:10.992 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:25:10.992 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:25:10.992 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:25:10.992 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:10.993 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:10.993 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:10.993 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.993 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.993 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.994 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:10.994 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:10.994 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:10.994 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:10.994 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:10.995 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:10.995 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:10.995 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:10.995 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:10.995 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:10.995 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:10.996 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:10.996 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:10.996 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.996 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.996 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.997 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:25:10.997 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:10.997 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.997 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.997 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:10.997 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:25:10.998 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:10.998 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:10.998 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:10.998 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.998 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:10.998 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:25:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:10.999 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.000 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.000 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:25:11.000 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.000 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.000 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.001 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.001 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.001 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.001 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.001 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.001 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:25:11.002 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.002 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.002 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.002 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.002 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:25:11.003 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.003 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.003 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.003 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.003 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:25:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.004 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.005 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.005 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.005 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:25:11.005 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.005 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.006 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.006 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.006 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:25:11.006 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:25:11.006 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:25:11.006 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:25:11.007 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.007 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.007 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.007 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.007 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.007 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:11.008 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:11.008 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.008 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:11.008 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.008 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.009 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.009 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.009 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.009 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:11.009 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.009 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.010 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.010 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:11.010 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.010 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.010 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.011 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.011 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.011 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:11.011 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.011 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.012 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.012 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:11.012 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.012 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.012 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.013 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.013 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.013 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:11.013 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.013 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.014 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.014 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:11.014 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.014 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.014 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.014 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.015 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.015 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:11.015 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.015 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.015 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.016 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:11.016 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.016 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.016 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.016 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.017 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.017 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:11.017 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.017 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.017 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.017 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:11.018 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.018 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.018 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.018 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.018 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.019 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:11.019 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.019 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.019 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.019 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:11.019 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.020 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.020 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.020 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.020 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.020 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:11.021 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.021 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.021 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.021 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:11.021 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.022 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.022 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.022 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.022 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.022 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:11.022 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.023 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.023 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:11.023 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:11.023 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:11.023 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:11.024 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:11.024 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:11.024 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:11.024 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:11.024 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:11.024 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:11.025 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:11.025 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:11.025 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:11.025 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:11.025 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:11.026 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.026 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.026 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:11.026 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:11.026 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:11.026 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:11.027 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:11.027 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:11.027 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:11.027 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:11.027 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:11.028 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:11.028 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:11.028 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.028 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f160c066470 msgr2=0x7f160c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f160c066470 0x7f160c068930 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f16240af000 tx=0x7f162401b0a0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 msgr2=0x7f162813a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f162813a7e0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f161800c490 tx=0x7f161800c950 comp rx=0 tx=0).stop 2023-10-25T16:25:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 shutdown_connections 2023-10-25T16:25:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f160c066470 0x7f160c068930 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f162815bdb0 0x7f16280acba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f162814e810 0x7f162813a7e0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 --2- 172.21.15.177:0/4031523092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f16280af2d0 0x7f16280ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 >> 172.21.15.177:0/4031523092 conn(0x7f16280b2450 msgr2=0x7f16280afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:11.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 shutdown_connections 2023-10-25T16:25:11.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:10.838+0000 7f1630088640 1 -- 172.21.15.177:0/4031523092 wait complete. 2023-10-25T16:25:11.032 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-10-25T16:25:11.033 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:25:11.034 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:11.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:11.041 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-10-25T16:25:11.163 INFO:teuthology.orchestra.run.smithi177.stderr:dd: error writing 'large_file_b': No space left on device 2023-10-25T16:25:11.163 INFO:teuthology.orchestra.run.smithi177.stderr:dd: closing output file 'large_file_b': No space left on device 2023-10-25T16:25:11.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:25:11.165 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:25:11.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 -- 172.21.15.177:0/3724149631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0960140cf0 msgr2=0x7f09600af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 --2- 172.21.15.177:0/3724149631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0960140cf0 0x7f09600af5d0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f0950009900 tx=0x7f095001c830 comp rx=0 tx=0).stop 2023-10-25T16:25:11.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 -- 172.21.15.177:0/3724149631 shutdown_connections 2023-10-25T16:25:11.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 --2- 172.21.15.177:0/3724149631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f096006c160 0x7f09600cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 --2- 172.21.15.177:0/3724149631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0960140cf0 0x7f09600af5d0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 -- 172.21.15.177:0/3724149631 >> 172.21.15.177:0/3724149631 conn(0x7f09600b2450 msgr2=0x7f09600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:11.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 -- 172.21.15.177:0/3724149631 shutdown_connections 2023-10-25T16:25:11.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.298+0000 7f096507d640 1 -- 172.21.15.177:0/3724149631 wait complete. 2023-10-25T16:25:11.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 Processor -- start 2023-10-25T16:25:11.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- start start 2023-10-25T16:25:11.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f096006c160 0x7f09601349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 0x7f0960135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960140cf0 0x7f0960135780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09601613c0 con 0x7f096006f570 2023-10-25T16:25:11.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09601616a0 con 0x7f0960140cf0 2023-10-25T16:25:11.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960161980 con 0x7f096006c160 2023-10-25T16:25:11.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 0x7f0960135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 0x7f0960135240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50148/0 (socket says 172.21.15.177:50148) 2023-10-25T16:25:11.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 -- 172.21.15.177:0/3842764217 learned_addr learned my addr 172.21.15.177:0/3842764217 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:11.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095ed9d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f096006c160 0x7f09601349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095f59e640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960140cf0 0x7f0960135780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 -- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f096006c160 msgr2=0x7f09601349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f096006c160 0x7f09601349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 -- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960140cf0 msgr2=0x7f0960135780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960140cf0 0x7f0960135780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 -- 172.21.15.177:0/3842764217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009560 con 0x7f096006f570 2023-10-25T16:25:11.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095f59e640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960140cf0 0x7f0960135780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:11.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f095e59c640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 0x7f0960135240 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f095400c4a0 tx=0x7f095400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:11.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954005480 con 0x7f096006f570 2023-10-25T16:25:11.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0954003710 con 0x7f096006f570 2023-10-25T16:25:11.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0960161c60 con 0x7f096006f570 2023-10-25T16:25:11.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954003b20 con 0x7f096006f570 2023-10-25T16:25:11.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0960134ee0 con 0x7f096006f570 2023-10-25T16:25:11.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.302+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09600c9780 con 0x7f096006f570 2023-10-25T16:25:11.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.306+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0954003c80 con 0x7f096006f570 2023-10-25T16:25:11.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.306+0000 7f09477fe640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f094c066470 0x7f094c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.306+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0954083750 con 0x7f096006f570 2023-10-25T16:25:11.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.306+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f094c06dfa0 con 0x7f096006f570 2023-10-25T16:25:11.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.306+0000 7f095ed9d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f094c066470 0x7f094c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.306+0000 7f095ed9d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f094c066470 0x7f094c068930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f09500af000 tx=0x7f095001b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:11.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.310+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0954017020 con 0x7f096006f570 2023-10-25T16:25:11.465 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.466+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f096004daf0 con 0x7f096006f570 2023-10-25T16:25:11.466 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f09477fe640 1 -- 172.21.15.177:0/3842764217 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+34057 (secure 0 0 0) 0x7f0954050b50 con 0x7f096006f570 2023-10-25T16:25:11.467 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:11.467 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:11.467 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 192, 2023-10-25T16:25:11.468 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:25:11.468 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:25:11.468 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:25:07.828081+0000", 2023-10-25T16:25:11.468 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:25:11.468 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:25:11.469 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:25:11.469 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:25:11.469 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:25:11.469 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:25:11.469 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:25:11.469 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:25:11.470 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:25:11.470 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:11.470 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:25:11.470 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:25:11.470 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:25:11.471 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:25:11.471 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:25:11.471 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:25:11.471 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:25:11.471 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:25:11.472 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:25:11.472 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:25:11.472 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:25:11.472 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:25:11.472 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.472 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:25:11.473 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:25:11.473 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:25:11.473 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:11.473 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:11.473 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:11.474 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:11.474 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:11.474 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:11.474 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:11.474 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:11.475 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:11.475 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:11.475 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:11.475 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:11.475 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:25:11.476 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:25:11.476 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:25:11.476 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:25:11.476 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:25:11.476 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:11.476 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:11.477 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:11.477 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:11.477 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:11.477 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:11.477 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:11.478 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.478 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:25:11.478 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:11.478 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:11.478 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:11.479 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:11.480 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:11.481 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:11.482 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:11.483 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:11.484 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:25:11.485 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:25:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:25:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.486 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:25:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:25:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:25:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:11.487 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.488 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:25:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:25:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:25:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:11.489 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:11.490 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:11.491 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:25:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:25:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:25:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:25:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:25:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:11.492 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:11.493 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:25:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:11.494 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:11.495 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:11.496 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:11.497 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:11.498 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:11.499 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:11.500 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:25:11.501 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:25:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:25:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:11.502 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:25:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:25:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:25:11.503 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:11.504 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:25:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:25:11.505 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:25:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:25:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:25:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:11.506 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:11.507 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:25:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:25:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:25:11.508 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:25:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:25:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:11.509 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "192", 2023-10-25T16:25:11.510 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:11.511 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:25:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:11.512 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:11.513 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:11.514 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.515 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:11.516 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:11.517 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:25:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:25:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:11.518 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:25:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:11.519 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:25:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:25:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:25:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:25:11.520 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:11.521 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:25:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.522 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.523 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.524 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:25:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.525 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:25:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.526 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:25:11.527 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:25:11.528 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.529 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:25:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.530 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:25:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.531 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.532 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:25:11.533 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.533 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.533 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.533 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.533 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:25:11.534 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:11.534 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.534 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.534 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.534 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:25:11.534 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:25:11.535 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:25:11.535 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:25:11.535 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.535 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.535 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.536 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.536 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.536 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.536 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:11.536 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.537 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.537 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.537 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.537 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.537 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.537 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.538 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.538 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.538 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.538 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.538 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.539 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.539 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.539 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.539 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:25:11.539 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.539 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.540 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.540 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.540 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:25:11.540 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.540 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.541 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.541 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.541 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.541 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.541 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.542 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.542 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:25:11.542 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.542 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.542 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.543 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.543 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:25:11.543 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.543 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.543 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.543 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.544 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.544 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.544 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.544 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.544 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:25:11.545 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.545 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.545 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.545 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.545 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:25:11.545 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.546 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.546 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.546 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.546 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.546 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:25:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.547 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.548 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.548 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:25:11.548 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:11.548 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.548 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.549 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.549 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:25:11.549 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:25:11.549 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:25:11.549 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:25:11.549 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.550 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.550 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.550 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.550 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.550 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.551 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:11.551 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.551 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.551 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.551 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.552 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.552 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.552 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.552 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:25:11.552 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.552 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.553 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.553 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.553 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.553 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.553 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.554 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:25:11.554 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.554 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.554 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.554 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.555 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:25:11.555 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.555 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.555 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.555 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.555 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.556 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.556 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.556 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.556 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:25:11.556 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.557 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.557 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.557 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:25:11.557 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.558 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.558 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.558 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.558 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.558 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.558 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.559 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.559 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:25:11.559 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.560 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.560 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:25:11.560 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.560 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.560 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.561 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.561 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.561 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.561 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.561 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:25:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.562 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:25:11.563 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:11.563 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.563 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.563 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.563 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:25:11.564 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:25:11.564 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:25:11.564 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:25:11.564 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.564 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:11.565 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.566 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.566 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.566 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.566 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.566 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.567 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.567 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.567 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.567 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.567 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.568 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.568 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.568 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.568 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.568 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:25:11.568 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.569 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.569 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.569 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:25:11.569 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.570 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.570 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.570 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.570 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.570 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.571 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.571 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:25:11.571 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.572 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.572 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:25:11.572 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.572 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.572 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.572 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.573 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:25:11.574 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.574 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.574 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.574 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:25:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.575 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.576 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.576 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:25:11.576 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.577 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.577 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:25:11.577 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:11.577 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.577 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.578 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.578 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:25:11.578 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:25:11.578 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:25:11.578 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:25:11.579 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.579 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.579 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.579 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.579 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.579 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.580 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:11.580 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.580 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.580 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.580 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.581 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.581 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.581 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.581 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.581 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.582 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.582 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.582 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.582 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.582 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.583 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.583 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:25:11.583 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.583 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.583 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.584 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.584 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:25:11.584 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.584 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.584 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.584 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.585 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.585 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.585 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.585 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.585 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:25:11.586 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.586 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.586 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.586 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:25:11.586 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.587 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.587 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.587 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.587 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.587 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.588 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.588 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:25:11.588 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.589 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.589 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:25:11.589 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.589 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.589 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.590 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.590 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.590 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.590 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:25:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:25:11.591 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:25:11.592 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:25:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:25:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:25:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.593 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.594 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.595 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.597 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.597 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:25:11.597 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.597 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.597 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.598 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:25:11.598 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.598 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.598 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.599 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.599 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.599 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.599 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:25:11.599 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.600 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.600 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.600 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:25:11.600 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.600 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.601 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.602 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:25:11.602 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.602 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.603 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:25:11.603 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.603 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.603 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.603 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.604 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.604 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.604 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:25:11.604 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.605 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.605 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.605 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:25:11.605 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:11.605 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.606 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.606 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.606 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:25:11.606 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:25:11.606 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:25:11.606 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:25:11.607 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.607 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.607 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.607 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.608 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:11.608 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.608 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.608 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.608 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.608 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.609 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.609 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.609 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.609 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.609 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:25:11.611 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.611 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.611 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:25:11.611 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.612 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.612 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.612 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.613 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.613 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:25:11.613 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.614 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.614 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:25:11.614 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.614 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.614 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.615 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.615 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.615 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.615 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:25:11.616 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.616 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.616 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:25:11.616 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.617 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.617 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.617 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.617 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.618 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.618 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:25:11.618 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.619 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.619 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:25:11.619 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:11.619 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.619 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.620 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:25:11.620 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:25:11.620 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:25:11.620 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:25:11.620 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.620 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.621 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.621 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.621 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.621 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.621 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:11.622 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:11.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:11.622 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:11.622 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:11.622 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:11.622 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:11.623 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:11.623 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:11.623 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:11.623 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:11.623 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:11.624 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:11.624 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.624 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:25:11.624 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.625 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:25:11.625 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.625 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.626 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.626 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:11.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.627 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.627 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:25:11.627 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.627 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.628 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:25:11.628 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.628 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.628 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.628 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:11.629 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.629 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.629 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:25:11.629 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.630 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.630 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:25:11.630 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.631 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.631 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:11.631 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:11.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.631 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:25:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:11.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:25:11.633 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:11.633 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.633 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.633 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:25:11.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:25:11.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:25:11.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:25:11.634 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:11.634 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:11.635 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:11.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:11.635 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.635 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:11.635 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:11.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.636 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:11.636 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.636 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.636 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.636 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.636 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.637 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:11.637 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.637 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.637 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.637 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:11.638 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.638 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.638 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.638 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.638 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.638 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:11.639 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.639 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:11.639 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.639 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.640 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.640 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.640 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.640 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:11.640 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.641 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:11.641 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.641 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.641 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.642 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.642 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.642 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:11.642 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.643 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:11.643 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.643 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.643 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.644 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.644 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.644 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:11.644 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.645 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:11.645 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.645 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.645 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.645 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.646 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:11.647 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.647 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.647 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.647 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.647 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.648 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:11.648 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.648 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:11.648 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:11.648 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:11.649 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:11.649 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:11.649 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:11.649 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:11.649 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:11.650 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:11.650 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.650 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:11.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:11.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:11.650 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:11.651 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:11.651 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:11.651 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:11.651 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:11.651 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:11.652 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:11.652 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:11.652 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:11.652 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:11.652 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:11.652 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:11.653 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:11.653 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:11.653 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:11.653 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:11.654 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:11.654 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:11.654 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:11.654 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:11.654 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:11.654 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:11.655 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:11.655 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:11.655 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f094c066470 msgr2=0x7f094c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f094c066470 0x7f094c068930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f09500af000 tx=0x7f095001b070 comp rx=0 tx=0).stop 2023-10-25T16:25:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 msgr2=0x7f0960135240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 0x7f0960135240 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f095400c4a0 tx=0x7f095400c960 comp rx=0 tx=0).stop 2023-10-25T16:25:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 shutdown_connections 2023-10-25T16:25:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f094c066470 0x7f094c068930 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960140cf0 0x7f0960135780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f096006f570 0x7f0960135240 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 --2- 172.21.15.177:0/3842764217 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f096006c160 0x7f09601349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 >> 172.21.15.177:0/3842764217 conn(0x7f09600b2450 msgr2=0x7f096006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 shutdown_connections 2023-10-25T16:25:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.470+0000 7f096507d640 1 -- 172.21.15.177:0/3842764217 wait complete. 2023-10-25T16:25:11.659 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- 172.21.15.177:0/399417030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0b2120 msgr2=0x7faffc0d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 --2- 172.21.15.177:0/399417030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0b2120 0x7faffc0d1bd0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7faffc0b3ea0 tx=0x7faff001c810 comp rx=0 tx=0).stop 2023-10-25T16:25:11.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- 172.21.15.177:0/399417030 shutdown_connections 2023-10-25T16:25:11.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 --2- 172.21.15.177:0/399417030 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0b2120 0x7faffc0d1bd0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 --2- 172.21.15.177:0/399417030 >> v2:172.21.15.184:3300/0 conn(0x7faffc15eba0 0x7faffc0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- 172.21.15.177:0/399417030 >> 172.21.15.177:0/399417030 conn(0x7faffc09a5c0 msgr2=0x7faffc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:11.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- 172.21.15.177:0/399417030 shutdown_connections 2023-10-25T16:25:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- 172.21.15.177:0/399417030 wait complete. 2023-10-25T16:25:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 Processor -- start 2023-10-25T16:25:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- start start 2023-10-25T16:25:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faffc0b2120 0x7faffc158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 0x7faffc0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faffc15eba0 0x7faffc15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0c6b20 con 0x7faffc0cdb10 2023-10-25T16:25:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc158c30 con 0x7faffc15eba0 2023-10-25T16:25:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7fb00165f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0c6d30 con 0x7faffc0b2120 2023-10-25T16:25:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7faffa7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 0x7faffc0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7faffa7fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 0x7faffc0c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50172/0 (socket says 172.21.15.177:50172) 2023-10-25T16:25:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7faffa7fc640 1 -- 172.21.15.177:0/139283092 learned_addr learned my addr 172.21.15.177:0/139283092 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.794+0000 7faffb7fe640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faffc15eba0 0x7faffc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffaffd640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faffc0b2120 0x7faffc158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffa7fc640 1 -- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faffc0b2120 msgr2=0x7faffc158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffa7fc640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faffc0b2120 0x7faffc158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffa7fc640 1 -- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faffc15eba0 msgr2=0x7faffc15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffa7fc640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faffc15eba0 0x7faffc15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffa7fc640 1 -- 172.21.15.177:0/139283092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff0009560 con 0x7faffc0cdb10 2023-10-25T16:25:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffa7fc640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 0x7faffc0c65e0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7faff00b0040 tx=0x7faff00a6750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00be070 con 0x7faffc0cdb10 2023-10-25T16:25:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faff0004230 con 0x7faffc0cdb10 2023-10-25T16:25:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc0c7010 con 0x7faffc0cdb10 2023-10-25T16:25:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00043e0 con 0x7faffc0cdb10 2023-10-25T16:25:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc15ac90 con 0x7faffc0cdb10 2023-10-25T16:25:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc04daf0 con 0x7faffc0cdb10 2023-10-25T16:25:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faff0003600 con 0x7faffc0cdb10 2023-10-25T16:25:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fafe8066470 0x7fafe8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faff00aa070 con 0x7faffc0cdb10 2023-10-25T16:25:11.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fafe806dfa0 con 0x7faffc0cdb10 2023-10-25T16:25:11.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffaffd640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fafe8066470 0x7fafe8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:11.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.798+0000 7faffaffd640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fafe8066470 0x7fafe8068930 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fafec005fd0 tx=0x7fafec00c460 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:11.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.802+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faff00ec0c0 con 0x7faffc0cdb10 2023-10-25T16:25:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.974+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faffc0b26f0 con 0x7faffc0cdb10 2023-10-25T16:25:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fafe37fe640 1 -- 172.21.15.177:0/139283092 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7faff00ef6e0 con 0x7faffc0cdb10 2023-10-25T16:25:11.975 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:11.975 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:25:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:25:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fafe8066470 msgr2=0x7fafe8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fafe8066470 0x7fafe8068930 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fafec005fd0 tx=0x7fafec00c460 comp rx=0 tx=0).stop 2023-10-25T16:25:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 msgr2=0x7faffc0c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 0x7faffc0c65e0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7faff00b0040 tx=0x7faff00a6750 comp rx=0 tx=0).stop 2023-10-25T16:25:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 shutdown_connections 2023-10-25T16:25:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fafe8066470 0x7fafe8068930 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faffc15eba0 0x7faffc15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faffc0cdb10 0x7faffc0c65e0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 --2- 172.21.15.177:0/139283092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faffc0b2120 0x7faffc158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 >> 172.21.15.177:0/139283092 conn(0x7faffc09a5c0 msgr2=0x7faffc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:11.978 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 shutdown_connections 2023-10-25T16:25:11.979 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:11.978+0000 7fb00165f640 1 -- 172.21.15.177:0/139283092 wait complete. 2023-10-25T16:25:11.994 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:25:12.141 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":156302,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.06414702,"mdsmap_epoch":72,"osdmap_epoch":192,"osdmap_epoch_barrier":190,"uptime":33.903885801000001} 2023-10-25T16:25:12.141 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 156302, "mdsmap_epoch": 72, "osdmap_epoch": 192, "osdmap_epoch_barrier": 190, "rank_uptime": 29.06414702, "state": "up:active", "uptime": 33.903885801, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:25:12.142 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:25:12.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:12.142 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-10-25T16:25:12.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:12.153 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-10-25T16:25:12.208 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:25:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- 172.21.15.177:0/750940375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6440047d0 msgr2=0x7fa644004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 --2- 172.21.15.177:0/750940375 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6440047d0 0x7fa644004c50 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c290 tx=0x7fa65001d000 comp rx=0 tx=0).stop 2023-10-25T16:25:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa65bfff640 1 -- 172.21.15.177:0/750940375 reap_dead start 2023-10-25T16:25:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- 172.21.15.177:0/750940375 shutdown_connections 2023-10-25T16:25:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- 172.21.15.177:0/750940375 >> 172.21.15.177:0/750940375 conn(0x7fa65c09a5c0 msgr2=0x7fa65c0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- 172.21.15.177:0/750940375 shutdown_connections 2023-10-25T16:25:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- 172.21.15.177:0/750940375 wait complete. 2023-10-25T16:25:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 Processor -- start 2023-10-25T16:25:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- start start 2023-10-25T16:25:12.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6440047d0 0x7fa65c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:12.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa65c153c30 0x7fa65c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:12.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 0x7fa65c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:12.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0c5c80 con 0x7fa65c15a660 2023-10-25T16:25:12.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c14fb30 con 0x7fa6440047d0 2023-10-25T16:25:12.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa661d7f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0ca8d0 con 0x7fa65c153c30 2023-10-25T16:25:12.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 0x7fa65c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:12.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa65bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 0x7fa65c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50180/0 (socket says 172.21.15.177:50180) 2023-10-25T16:25:12.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa65bfff640 1 -- 172.21.15.177:0/3724419792 learned_addr learned my addr 172.21.15.177:0/3724419792 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:12.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa65affd640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa65c153c30 0x7fa65c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:12.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.386+0000 7fa65b7fe640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6440047d0 0x7fa65c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:12.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65bfff640 1 -- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa65c153c30 msgr2=0x7fa65c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:12.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65bfff640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa65c153c30 0x7fa65c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:12.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65bfff640 1 -- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6440047d0 msgr2=0x7fa65c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:12.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65bfff640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6440047d0 0x7fa65c14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:12.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65bfff640 1 -- 172.21.15.177:0/3724419792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0cabb0 con 0x7fa65c15a660 2023-10-25T16:25:12.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65bfff640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 0x7fa65c0c9620 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fa65c08a9b0 tx=0x7fa654009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:12.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654017070 con 0x7fa65c15a660 2023-10-25T16:25:12.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa654004c20 con 0x7fa65c15a660 2023-10-25T16:25:12.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c0cae90 con 0x7fa65c15a660 2023-10-25T16:25:12.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400e700 con 0x7fa65c15a660 2023-10-25T16:25:12.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c15aae0 con 0x7fa65c15a660 2023-10-25T16:25:12.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c0c6110 con 0x7fa65c15a660 2023-10-25T16:25:12.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa65400e860 con 0x7fa65c15a660 2023-10-25T16:25:12.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6480664a0 0x7fa648068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:12.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa654083fb0 con 0x7fa65c15a660 2023-10-25T16:25:12.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7fa64806dfd0 con 0x7fa65c15a660 2023-10-25T16:25:12.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65b7fe640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6480664a0 0x7fa648068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:12.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.390+0000 7fa65b7fe640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6480664a0 0x7fa648068960 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0058d0 tx=0x7fa64c005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:12.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.394+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa65c0c6110 con 0x7fa65c15a660 2023-10-25T16:25:12.547 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.550+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa65c0c6110 con 0x7fa65c15a660 2023-10-25T16:25:12.549 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.550+0000 7fa643fff640 1 -- 172.21.15.177:0/3724419792 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v192) v1 ==== 81+0+34057 (secure 0 0 0) 0x7fa65c0c6110 con 0x7fa65c15a660 2023-10-25T16:25:12.550 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:12.550 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:12.550 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 192, 2023-10-25T16:25:12.550 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:25:12.550 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:25:12.551 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:25:07.828081+0000", 2023-10-25T16:25:12.551 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:25:12.551 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:25:12.551 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:25:12.551 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:25:12.552 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:25:12.552 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:25:12.552 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:25:12.552 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:25:12.552 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:25:12.552 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:12.553 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:25:12.553 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:25:12.553 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:25:12.553 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:25:12.554 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:25:12.554 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:25:12.554 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:25:12.554 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:25:12.554 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:25:12.555 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:25:12.555 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:25:12.555 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:25:12.555 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.555 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:25:12.555 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:25:12.556 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:25:12.556 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:12.556 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:12.556 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:12.556 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:12.556 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:12.557 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:12.557 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:12.557 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:12.557 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:12.557 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:12.558 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:12.558 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:12.558 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:25:12.558 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:25:12.558 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:25:12.559 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:25:12.559 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:25:12.559 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:12.559 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:12.559 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:12.559 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:12.560 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:12.560 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:12.560 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:12.560 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.561 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:25:12.561 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:12.561 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:12.561 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:12.561 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:12.561 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:12.562 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:12.562 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:12.562 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:12.562 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:12.562 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:12.563 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:12.563 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:12.563 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:12.563 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:12.563 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:12.564 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:12.564 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:12.564 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:12.564 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:12.564 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:12.564 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:12.565 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:12.565 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:12.565 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:12.565 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:12.565 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:12.566 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.566 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:12.566 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:12.566 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:12.566 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:12.566 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:12.567 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:12.567 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:12.567 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:12.567 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:12.567 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:12.568 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:12.568 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:12.568 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:25:12.568 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:25:12.568 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.568 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:12.569 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:25:12.569 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.569 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:12.569 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:25:12.569 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:25:12.570 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:25:12.570 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:12.570 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:12.570 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:12.570 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:12.571 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:12.571 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.571 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.571 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.571 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:25:12.571 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:25:12.572 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:25:12.572 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:12.572 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:12.572 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:12.572 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:12.572 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:12.573 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:12.573 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:12.573 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:12.573 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:12.574 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:12.574 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:12.574 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:12.574 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:25:12.574 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:25:12.575 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:25:12.575 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:25:12.575 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:25:12.575 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:12.575 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:12.575 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:12.576 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:12.576 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:12.576 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:12.576 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:12.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.577 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:25:12.577 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:12.577 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:12.577 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:12.577 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:12.577 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:12.578 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:12.578 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:12.578 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:12.578 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:12.579 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:12.579 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:12.579 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:12.579 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:12.579 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:12.579 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:12.580 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:12.580 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:12.580 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:12.580 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:12.580 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:12.581 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:12.581 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:12.582 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:12.582 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:12.582 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:12.582 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:12.582 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.583 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:12.583 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:12.583 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:12.583 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:12.583 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:12.584 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:12.584 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:12.584 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:12.584 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:12.584 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:12.584 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:12.585 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:12.585 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:25:12.585 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:25:12.585 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:25:12.585 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.585 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:12.586 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:12.586 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:25:12.586 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.586 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:12.587 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:25:12.587 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:25:12.587 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:12.587 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:12.587 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:12.587 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:12.588 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:12.588 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:12.588 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.588 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.588 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.588 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:25:12.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:25:12.590 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:25:12.590 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1027, 2023-10-25T16:25:12.590 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool,full,full_quota", 2023-10-25T16:25:12.590 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:12.590 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:12.591 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:12.591 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:12.591 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:12.591 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:12.591 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:12.592 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:12.592 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:12.592 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:12.592 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:25:12.592 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:25:12.592 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:25:12.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:25:12.593 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:25:12.593 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:12.593 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:12.593 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:12.594 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:12.594 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:12.594 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:12.594 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:12.594 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "192", 2023-10-25T16:25:12.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:12.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:12.595 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:12.595 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:12.596 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:12.596 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:12.596 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:12.596 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:12.596 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:12.596 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:25:12.597 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:12.597 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:12.597 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:12.597 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:12.597 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:12.597 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:12.598 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:12.598 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:12.598 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:12.598 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:12.598 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:12.599 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:12.599 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:12.599 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:12.599 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:12.599 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:12.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.600 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:12.600 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:12.600 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:12.600 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:12.601 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:12.601 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:12.601 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:12.601 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:12.601 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:12.601 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:12.602 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:12.602 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:12.602 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:25:12.602 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:25:12.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:25:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.604 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:12.604 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:25:12.604 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:25:12.604 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:12.604 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:25:12.605 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:25:12.605 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:12.605 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:12.605 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:12.605 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.605 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.606 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:12.606 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:25:12.606 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.606 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:12.606 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.606 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.607 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.607 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.607 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.607 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.608 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.608 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.608 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.608 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.608 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.608 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.609 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.609 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.609 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:25:12.609 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.609 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:25:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.611 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.611 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.611 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.612 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:25:12.612 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.612 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.612 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.613 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:25:12.613 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.613 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.613 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.613 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.613 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.614 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.614 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.614 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:25:12.614 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.615 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.615 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.615 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:25:12.615 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.616 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.616 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.616 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.616 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.617 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.617 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:25:12.617 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.617 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.618 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.618 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:25:12.618 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:12.618 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.618 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.619 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:25:12.619 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:25:12.619 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:25:12.619 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:25:12.620 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.620 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.620 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.620 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.620 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.621 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:12.621 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.621 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.621 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.621 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.622 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.622 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.622 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.623 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.623 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.623 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.623 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.623 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.624 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:25:12.624 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.624 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.624 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.624 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:25:12.625 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.625 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.625 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.625 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.626 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.626 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:25:12.626 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.627 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.627 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.627 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:25:12.627 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.628 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.628 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.628 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.628 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.629 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.629 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:25:12.629 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.629 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.630 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.630 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:25:12.630 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.630 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.631 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.631 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.631 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.631 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:25:12.632 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.632 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.632 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:25:12.633 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:12.633 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.633 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.633 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.633 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:25:12.634 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:25:12.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:25:12.634 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:25:12.634 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.634 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.634 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.635 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.635 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:12.635 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.636 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.636 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.636 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.636 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.636 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.636 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.637 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:25:12.637 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.637 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.637 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.637 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.638 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.638 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.638 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.638 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:25:12.638 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.639 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.639 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.639 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:25:12.639 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.639 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.640 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.640 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.640 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.640 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.641 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:25:12.641 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.641 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.641 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.642 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:25:12.642 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.642 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.642 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.643 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.643 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.643 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.643 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:25:12.644 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.644 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.644 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:25:12.645 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.645 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.645 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.645 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.646 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.646 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.646 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.646 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:25:12.646 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.647 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.647 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.647 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:25:12.647 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:12.647 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.647 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.648 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:25:12.648 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:25:12.648 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:25:12.648 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:25:12.649 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.649 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.649 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.649 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.649 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.650 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:12.650 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.650 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.650 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.650 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.651 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.651 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.651 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.651 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.651 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.651 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.652 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.652 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.652 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.652 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.652 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.652 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:25:12.653 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.653 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.653 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.653 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:25:12.654 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.654 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.654 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.654 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.655 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:25:12.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.656 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:25:12.656 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.656 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.657 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.657 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.657 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.657 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.657 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.658 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:25:12.658 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.658 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.658 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.658 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.659 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:25:12.659 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.659 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.659 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.659 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.659 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.660 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.660 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.660 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:25:12.660 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.661 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.661 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.661 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:25:12.661 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:12.661 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.662 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.662 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:25:12.662 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:25:12.662 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:25:12.663 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:25:12.663 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.663 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.663 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.663 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.664 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.664 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:12.664 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.664 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.664 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.665 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.665 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.665 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.665 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.665 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.665 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.666 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.666 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.666 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.666 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.666 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:25:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.667 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:25:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.668 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:25:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:25:12.670 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.671 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.671 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.671 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.671 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.671 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.672 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:25:12.672 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.673 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.673 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:25:12.673 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.673 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.673 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.674 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.674 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.674 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.674 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.674 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:25:12.675 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.675 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:25:12.676 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:12.676 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.676 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.676 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:25:12.676 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:25:12.677 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:25:12.677 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:25:12.677 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.677 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.677 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.677 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.678 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.678 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:12.678 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.678 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.679 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.679 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.679 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.679 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.679 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.680 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.680 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.680 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.680 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.680 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.680 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.681 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.681 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:25:12.681 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.681 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.682 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.682 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:25:12.682 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.682 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.682 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.683 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.683 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.683 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.683 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.683 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:25:12.684 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.684 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:25:12.685 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.685 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.685 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.685 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.685 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.685 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.686 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.686 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:25:12.686 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:25:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.687 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:25:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:25:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:25:12.690 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:25:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:25:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:25:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.691 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.692 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.693 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.694 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:25:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.695 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:25:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.696 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.697 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:25:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.698 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:25:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.699 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:25:12.700 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:25:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.701 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:25:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.703 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:25:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:25:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:25:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:25:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:25:12.705 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.706 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:12.707 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:25:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.710 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:25:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:12.711 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:25:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.712 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:25:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.713 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.714 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:25:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.715 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:25:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.716 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:25:12.717 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:25:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:12.718 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:25:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:25:12.719 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:25:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:25:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:12.720 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:12.721 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.722 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:12.723 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:12.724 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.725 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.726 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.727 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.728 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.729 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.730 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.731 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:12.732 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:12.733 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:12.734 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:12.735 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:12.736 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:12.737 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:12.738 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:12.739 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:12.740 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:12.741 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:12.741 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:12.742 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6480664a0 msgr2=0x7fa648068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:12.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6480664a0 0x7fa648068960 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0058d0 tx=0x7fa64c005860 comp rx=0 tx=0).stop 2023-10-25T16:25:12.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 msgr2=0x7fa65c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:12.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 0x7fa65c0c9620 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fa65c08a9b0 tx=0x7fa654009b00 comp rx=0 tx=0).stop 2023-10-25T16:25:12.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 shutdown_connections 2023-10-25T16:25:12.743 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa6480664a0 0x7fa648068960 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa65c15a660 0x7fa65c0c9620 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa65c153c30 0x7fa65c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 --2- 172.21.15.177:0/3724419792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6440047d0 0x7fa65c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 >> 172.21.15.177:0/3724419792 conn(0x7fa65c09a5c0 msgr2=0x7fa65c1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 shutdown_connections 2023-10-25T16:25:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:12.554+0000 7fa661d7f640 1 -- 172.21.15.177:0/3724419792 wait complete. 2023-10-25T16:25:12.745 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-10-25T16:25:17.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:25:17.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/174644456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 msgr2=0x7f33b00af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:17.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/174644456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b00af5a0 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f33a00098f0 tx=0x7f33a001c850 comp rx=0 tx=0).stop 2023-10-25T16:25:17.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/174644456 shutdown_connections 2023-10-25T16:25:17.887 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/174644456 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33b00cb530 0x7f33b00cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/174644456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b00af5a0 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/174644456 >> 172.21.15.177:0/174644456 conn(0x7f33b00b2450 msgr2=0x7f33b00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/174644456 shutdown_connections 2023-10-25T16:25:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/174644456 wait complete. 2023-10-25T16:25:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 Processor -- start 2023-10-25T16:25:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- start start 2023-10-25T16:25:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b013ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33b00cb530 0x7f33b01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33b0140db0 0x7f33b013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b013bf50 con 0x7f33b006c110 2023-10-25T16:25:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b013a9b0 con 0x7f33b0140db0 2023-10-25T16:25:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b013ac50 con 0x7f33b00cb530 2023-10-25T16:25:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b013ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b013ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50206/0 (socket says 172.21.15.177:50206) 2023-10-25T16:25:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 -- 172.21.15.177:0/3532628657 learned_addr learned my addr 172.21.15.177:0/3532628657 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5053640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33b00cb530 0x7f33b01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b6055640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33b0140db0 0x7f33b013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 -- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33b00cb530 msgr2=0x7f33b01572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33b00cb530 0x7f33b01572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 -- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33b0140db0 msgr2=0x7f33b013f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33b0140db0 0x7f33b013f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 -- 172.21.15.177:0/3532628657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009500 con 0x7f33b006c110 2023-10-25T16:25:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b6055640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33b0140db0 0x7f33b013f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T16:25:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b5854640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b013ba10 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00b410 tx=0x7f33ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac004020 con 0x7f33b006c110 2023-10-25T16:25:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f33ac004270 con 0x7f33b006c110 2023-10-25T16:25:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b013af30 con 0x7f33b006c110 2023-10-25T16:25:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011890 con 0x7f33b006c110 2023-10-25T16:25:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.890+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b013b4f0 con 0x7f33b006c110 2023-10-25T16:25:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.894+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b013b6e0 con 0x7f33b006c110 2023-10-25T16:25:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.894+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f33ac003600 con 0x7f33b006c110 2023-10-25T16:25:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.894+0000 7f33a67fc640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33940664a0 0x7f3394068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.894+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33ac083e50 con 0x7f33b006c110 2023-10-25T16:25:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.894+0000 7f33b5053640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33940664a0 0x7f3394068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.894+0000 7f33b5053640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33940664a0 0x7f3394068960 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f33a00af000 tx=0x7f33a001b090 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:17.898+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33ac0512e0 con 0x7f33b006c110 2023-10-25T16:25:18.052 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.054+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f33b004daf0 con 0x7f33b006c110 2023-10-25T16:25:18.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.058+0000 7f33a67fc640 1 -- 172.21.15.177:0/3532628657 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+34038 (secure 0 0 0) 0x7f33ac054900 con 0x7f33b006c110 2023-10-25T16:25:18.057 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:18.057 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:18.057 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 193, 2023-10-25T16:25:18.057 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:25:18.058 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:25:18.058 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:25:17.832256+0000", 2023-10-25T16:25:18.058 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:25:18.058 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:25:18.058 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:25:18.059 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:25:18.059 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:25:18.059 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:25:18.059 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:25:18.059 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:25:18.060 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:25:18.060 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.060 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:25:18.060 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:25:18.060 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:25:18.060 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:25:18.061 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:25:18.061 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:25:18.061 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:25:18.061 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:25:18.062 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:25:18.062 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:25:18.062 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:25:18.063 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:25:18.063 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.063 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:25:18.063 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:25:18.063 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:25:18.064 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:18.064 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:18.064 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:18.064 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:18.064 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:18.064 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:18.065 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:18.065 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:18.065 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:18.065 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:18.065 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:18.065 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:18.066 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:25:18.066 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:25:18.066 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:25:18.066 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:25:18.066 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:25:18.067 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:18.067 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:18.067 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:18.067 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:18.067 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:18.067 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:18.068 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:18.068 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.068 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:25:18.068 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:18.068 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:18.069 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:18.069 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:18.069 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:18.069 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:18.069 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:18.070 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:18.070 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:18.070 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:18.070 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:18.070 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:18.071 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:18.071 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:18.071 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:18.071 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:18.072 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:18.072 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:18.072 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:18.072 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:18.073 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:18.073 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:18.073 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:18.073 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:18.073 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:18.074 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:18.074 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.074 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:18.074 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:18.075 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:18.075 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:18.075 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:18.075 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:18.075 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:18.076 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:25:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:25:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:25:18.077 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:25:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:25:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:25:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:18.079 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:18.079 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:18.079 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:18.079 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:18.079 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.079 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.080 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.080 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:25:18.080 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:25:18.080 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:25:18.080 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:18.081 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:18.081 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:18.081 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:18.081 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:18.081 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:18.082 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:18.082 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:18.082 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:18.082 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:18.082 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:18.082 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:18.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:25:18.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:25:18.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:25:18.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:25:18.083 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:25:18.084 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:18.084 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:18.084 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:18.084 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:18.084 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:18.085 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:18.085 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:18.085 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:25:18.085 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:18.086 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:18.087 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:18.087 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:18.087 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:18.087 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:18.087 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:18.088 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:18.088 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:18.088 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:18.088 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:18.088 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:18.088 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:18.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:18.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:18.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:18.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:18.089 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:18.090 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:18.090 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:18.090 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:18.090 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.090 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:18.091 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:18.091 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:18.091 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:18.091 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:18.091 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:18.091 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:18.092 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:18.092 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:18.092 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:18.092 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:18.092 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:18.093 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:25:18.093 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:25:18.093 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:25:18.093 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.093 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:18.093 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:18.094 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:25:18.094 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.094 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.094 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:18.094 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:25:18.095 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:25:18.095 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:18.095 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:18.095 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:18.095 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:18.096 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:18.096 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:18.096 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.096 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.096 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.096 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:25:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:25:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:25:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:18.097 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:18.098 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:25:18.099 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:25:18.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:25:18.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:25:18.100 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:25:18.100 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:18.100 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:18.101 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:18.101 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:18.101 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:18.101 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:18.101 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:18.102 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "193", 2023-10-25T16:25:18.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:18.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:18.102 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:18.102 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:18.103 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:18.103 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:18.103 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:18.103 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:18.103 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:18.104 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:25:18.104 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:18.104 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:18.104 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:18.104 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:18.104 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:18.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:18.105 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:18.105 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:18.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:18.105 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:18.106 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:18.106 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:18.106 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:18.106 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:18.106 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:18.107 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:18.108 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:18.108 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:18.108 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:18.108 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:18.108 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:18.109 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:18.109 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:18.109 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:18.109 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:25:18.109 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:25:18.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.110 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:18.110 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:18.110 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:25:18.110 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.110 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.111 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:18.111 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:25:18.111 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:25:18.111 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:18.111 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:25:18.112 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:25:18.112 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:18.112 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:18.112 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:18.112 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.113 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.113 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.113 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:25:18.113 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.113 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:18.114 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.114 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.114 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.114 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.114 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.114 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.115 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.115 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.115 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.115 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.115 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.116 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.116 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.116 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.116 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.116 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:25:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:25:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.118 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.119 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.119 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:25:18.119 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.119 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.119 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.120 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.120 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:25:18.120 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.120 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.120 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.121 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.121 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.121 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.121 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.121 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:25:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.122 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:25:18.123 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.123 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.123 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.123 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.123 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.124 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.124 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.124 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.124 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:25:18.124 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.125 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.125 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.125 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.125 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:25:18.125 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.125 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.126 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.126 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.126 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:25:18.126 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:25:18.126 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:25:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:25:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.127 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.128 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.128 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:18.128 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.128 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.128 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.129 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.129 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.129 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.129 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.129 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.129 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.130 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.130 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.130 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.130 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.130 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.131 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.131 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:25:18.131 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.131 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.131 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.132 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.132 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:25:18.132 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.132 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.132 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.132 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.133 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.133 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.133 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.133 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.133 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:25:18.134 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.134 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.134 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.134 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.134 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:25:18.135 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.135 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.135 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.135 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.135 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.135 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.136 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.136 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.136 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:25:18.136 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.136 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.137 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.137 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.137 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:25:18.137 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.137 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.137 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.138 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.138 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.138 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.138 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.138 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:25:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.139 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:25:18.140 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.140 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.140 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.140 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.140 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:25:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:25:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:25:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:25:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.141 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.142 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.142 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.142 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.142 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:18.142 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.143 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.143 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.143 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.143 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.143 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.143 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.144 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:25:18.144 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.144 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.144 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.144 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.145 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.145 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.145 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.145 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:25:18.145 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.146 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.146 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.146 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.146 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:25:18.146 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.146 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.147 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.147 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.147 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.147 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.147 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.148 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.148 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:25:18.148 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.148 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.148 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.149 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.149 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:25:18.149 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.149 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.149 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.149 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.150 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.150 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.150 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.150 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.150 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:25:18.151 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.151 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.151 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.151 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.151 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:25:18.151 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.152 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.152 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.152 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.152 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.152 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.153 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.153 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.153 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:25:18.153 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.153 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.154 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.154 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.154 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:25:18.154 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.154 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.155 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.155 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.155 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:25:18.155 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:25:18.155 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:25:18.155 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:25:18.156 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.156 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.156 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.156 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.156 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.157 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.157 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:18.157 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.157 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.157 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.158 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.158 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.158 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.158 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.158 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.158 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.159 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:25:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.160 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.161 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.161 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:25:18.161 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.161 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.161 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.161 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.162 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.162 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.162 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.162 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.162 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:25:18.163 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.163 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.163 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.163 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.163 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:25:18.164 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.164 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.164 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.164 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.164 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.164 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.165 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.165 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.165 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:25:18.165 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.165 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.166 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.166 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.166 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:25:18.166 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.166 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.167 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.167 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.167 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.167 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.167 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.167 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.168 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:25:18.168 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.168 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.168 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.168 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.169 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:25:18.169 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.169 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.169 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.169 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.170 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:25:18.170 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:25:18.170 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:25:18.170 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:25:18.170 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.171 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.171 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.171 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.171 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.171 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.171 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:18.172 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.172 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.172 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.172 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.172 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.173 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.174 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.174 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.174 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.174 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.174 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:25:18.175 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.175 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.175 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.175 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.175 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:25:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:25:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:25:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:25:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:25:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:25:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:25:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:25:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:25:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:25:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:25:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.187 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.187 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.187 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.187 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.187 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.187 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.188 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.188 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.188 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.188 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.188 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.189 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.189 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:25:18.189 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.189 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.189 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.190 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.190 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:25:18.190 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.190 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.190 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.191 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.191 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.191 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.191 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.191 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.191 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:25:18.192 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.192 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.192 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.192 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.192 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:25:18.193 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.193 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.193 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.193 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.193 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.193 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.194 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.194 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.194 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:25:18.194 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.194 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:25:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.195 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.196 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.196 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.196 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.196 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.196 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.197 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:25:18.197 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.197 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.197 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.197 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.198 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:25:18.198 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.198 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.198 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.198 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.198 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:25:18.199 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:25:18.199 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:25:18.199 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:25:18.199 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.199 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.200 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.200 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.200 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.200 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.200 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.201 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.202 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.202 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.202 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.202 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.202 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.203 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.203 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.203 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.203 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:25:18.206 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.206 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.206 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.207 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.207 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:25:18.207 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.207 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.207 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.207 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.208 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.208 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.208 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.208 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:25:18.209 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.209 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.209 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.209 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.209 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:25:18.210 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.210 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.210 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.210 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.210 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.211 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.211 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.211 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.211 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:25:18.211 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.212 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.212 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.212 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.212 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:25:18.212 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.212 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.213 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.213 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.213 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.213 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.213 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.214 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.214 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:25:18.214 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.214 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.214 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.215 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.215 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:25:18.215 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.215 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.215 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.215 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.216 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:25:18.216 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:25:18.216 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:25:18.216 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:25:18.216 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.217 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.217 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.217 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.217 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.217 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.218 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:18.218 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.218 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.218 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.218 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.218 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.219 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.219 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.219 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.219 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.219 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.220 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.220 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.220 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.220 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.220 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:25:18.221 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.221 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.221 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.221 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.221 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:25:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.222 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.223 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.223 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.223 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:25:18.223 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.224 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.224 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.224 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.224 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:25:18.224 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.225 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.225 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.225 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.225 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.225 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.225 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.226 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.226 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:25:18.226 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.226 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.226 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.227 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.227 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:25:18.227 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.227 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.227 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.227 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.228 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.228 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.228 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.228 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.228 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:25:18.229 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.229 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.229 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.229 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.229 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:25:18.229 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.230 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.230 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.230 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.230 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:25:18.230 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:25:18.231 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:25:18.231 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:25:18.231 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.231 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.231 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:18.233 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.233 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.233 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.233 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.233 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.234 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:18.234 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.234 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.234 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.234 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:18.235 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.235 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.235 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.235 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.235 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.235 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:18.236 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.236 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.236 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.236 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:18.236 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.237 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.237 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.237 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.237 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.237 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:18.237 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.238 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.238 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.238 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:18.238 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.238 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.239 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.239 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.239 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.239 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:18.239 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.240 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.240 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.240 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:18.240 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.240 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.240 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.241 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.241 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.241 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:18.241 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.241 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.242 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.243 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.244 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.245 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.245 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:18.245 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.245 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.245 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.245 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:18.246 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.246 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.246 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.246 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.246 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.247 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:18.247 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.247 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.247 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.247 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:18.248 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:18.248 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:18.248 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:18.248 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:18.248 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:18.248 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:18.249 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:18.250 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:18.250 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.250 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.250 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:18.250 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:18.251 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:18.251 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:18.251 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:18.251 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:18.251 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:18.252 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:18.252 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:18.252 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:18.252 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:18.252 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.252 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33940664a0 msgr2=0x7f3394068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.254 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33940664a0 0x7f3394068960 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f33a00af000 tx=0x7f33a001b090 comp rx=0 tx=0).stop 2023-10-25T16:25:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 msgr2=0x7f33b013ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b013ba10 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00b410 tx=0x7f33ac00b8d0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 shutdown_connections 2023-10-25T16:25:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f33940664a0 0x7f3394068960 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.255 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33b0140db0 0x7f33b013f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33b00cb530 0x7f33b01572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 --2- 172.21.15.177:0/3532628657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33b006c110 0x7f33b013ba10 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 >> 172.21.15.177:0/3532628657 conn(0x7f33b00b2450 msgr2=0x7f33b0072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 shutdown_connections 2023-10-25T16:25:18.256 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.062+0000 7f33b7ab8640 1 -- 172.21.15.177:0/3532628657 wait complete. 2023-10-25T16:25:18.257 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-25T16:25:18.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-10-25T16:25:18.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/2803243975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c9415eb90 msgr2=0x7f2c940cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/2803243975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c9415eb90 0x7f2c940cf940 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009840 tx=0x7f2c9001c770 comp rx=0 tx=0).stop 2023-10-25T16:25:18.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/2803243975 shutdown_connections 2023-10-25T16:25:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/2803243975 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c940ca930 0x7f2c940cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/2803243975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c9415eb90 0x7f2c940cf940 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/2803243975 >> 172.21.15.177:0/2803243975 conn(0x7f2c940983a0 msgr2=0x7f2c940cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/2803243975 shutdown_connections 2023-10-25T16:25:18.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/2803243975 wait complete. 2023-10-25T16:25:18.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 Processor -- start 2023-10-25T16:25:18.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- start start 2023-10-25T16:25:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c940ca930 0x7f2c94156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 0x7f2c9415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c9415eb90 0x7f2c941517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9414e060 con 0x7f2c940cbf40 2023-10-25T16:25:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94156b60 con 0x7f2c9415eb90 2023-10-25T16:25:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94156e40 con 0x7f2c940ca930 2023-10-25T16:25:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 0x7f2c9415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 0x7f2c9415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50232/0 (socket says 172.21.15.177:50232) 2023-10-25T16:25:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 -- 172.21.15.177:0/3408230153 learned_addr learned my addr 172.21.15.177:0/3408230153 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9a308640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c940ca930 0x7f2c94156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 -- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c940ca930 msgr2=0x7f2c94156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c940ca930 0x7f2c94156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 -- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c9415eb90 msgr2=0x7f2c941517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9ab09640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c9415eb90 0x7f2c941517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c9415eb90 0x7f2c941517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 -- 172.21.15.177:0/3408230153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c940cbf40 2023-10-25T16:25:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9ab09640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c9415eb90 0x7f2c941517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c99b07640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 0x7f2c9415a6b0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c970 tx=0x7f2c8400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84007c70 con 0x7f2c940cbf40 2023-10-25T16:25:18.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2c8400f450 con 0x7f2c940cbf40 2023-10-25T16:25:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c94157120 con 0x7f2c940cbf40 2023-10-25T16:25:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400f860 con 0x7f2c940cbf40 2023-10-25T16:25:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.386+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c941576e0 con 0x7f2c940cbf40 2023-10-25T16:25:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.390+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9404daf0 con 0x7f2c940cbf40 2023-10-25T16:25:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.390+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2c8400f9c0 con 0x7f2c940cbf40 2023-10-25T16:25:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.390+0000 7f2c8affd640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c78066470 0x7f2c78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.390+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c84084700 con 0x7f2c940cbf40 2023-10-25T16:25:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.390+0000 7f2c9a308640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c78066470 0x7f2c78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.390+0000 7f2c9a308640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c78066470 0x7f2c78068930 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2c900ae000 tx=0x7f2c9001afb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.394+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c84051c10 con 0x7f2c940cbf40 2023-10-25T16:25:18.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.534+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2c94066230 con 0x7f2c940cbf40 2023-10-25T16:25:18.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.538+0000 7f2c8affd640 1 -- 172.21.15.177:0/3408230153 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v193) v1 ==== 81+0+34038 (secure 0 0 0) 0x7f2c84055230 con 0x7f2c940cbf40 2023-10-25T16:25:18.537 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:18.537 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:18.538 INFO:teuthology.orchestra.run.smithi177.stdout: "epoch": 193, 2023-10-25T16:25:18.538 INFO:teuthology.orchestra.run.smithi177.stdout: "fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", 2023-10-25T16:25:18.538 INFO:teuthology.orchestra.run.smithi177.stdout: "created": "2023-10-25T16:12:47.819243+0000", 2023-10-25T16:25:18.538 INFO:teuthology.orchestra.run.smithi177.stdout: "modified": "2023-10-25T16:25:17.832256+0000", 2023-10-25T16:25:18.539 INFO:teuthology.orchestra.run.smithi177.stdout: "last_up_change": "2023-10-25T16:12:55.753030+0000", 2023-10-25T16:25:18.539 INFO:teuthology.orchestra.run.smithi177.stdout: "last_in_change": "2023-10-25T16:12:51.738823+0000", 2023-10-25T16:25:18.539 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-25T16:25:18.539 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_num": 5799936, 2023-10-25T16:25:18.539 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_set": [ 2023-10-25T16:25:18.539 INFO:teuthology.orchestra.run.smithi177.stdout: "pglog_hardlimit", 2023-10-25T16:25:18.540 INFO:teuthology.orchestra.run.smithi177.stdout: "purged_snapdirs", 2023-10-25T16:25:18.540 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_deletes", 2023-10-25T16:25:18.540 INFO:teuthology.orchestra.run.smithi177.stdout: "sortbitwise" 2023-10-25T16:25:18.540 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.540 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_version": 4, 2023-10-25T16:25:18.541 INFO:teuthology.orchestra.run.smithi177.stdout: "full_ratio": 0.69999998807907104, 2023-10-25T16:25:18.541 INFO:teuthology.orchestra.run.smithi177.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-10-25T16:25:18.541 INFO:teuthology.orchestra.run.smithi177.stdout: "nearfull_ratio": 0.60000002384185791, 2023-10-25T16:25:18.541 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_snapshot": "", 2023-10-25T16:25:18.541 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_max": 23, 2023-10-25T16:25:18.541 INFO:teuthology.orchestra.run.smithi177.stdout: "max_osd": 8, 2023-10-25T16:25:18.542 INFO:teuthology.orchestra.run.smithi177.stdout: "require_min_compat_client": "luminous", 2023-10-25T16:25:18.542 INFO:teuthology.orchestra.run.smithi177.stdout: "min_compat_client": "jewel", 2023-10-25T16:25:18.542 INFO:teuthology.orchestra.run.smithi177.stdout: "require_osd_release": "reef", 2023-10-25T16:25:18.542 INFO:teuthology.orchestra.run.smithi177.stdout: "allow_crimson": false, 2023-10-25T16:25:18.542 INFO:teuthology.orchestra.run.smithi177.stdout: "pools": [ 2023-10-25T16:25:18.543 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.543 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 1, 2023-10-25T16:25:18.543 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": ".mgr", 2023-10-25T16:25:18.543 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:12:56.669215+0000", 2023-10-25T16:25:18.543 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:18.544 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:18.544 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:18.544 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:18.544 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:18.544 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:18.544 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:18.545 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:18.545 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:18.545 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:18.545 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:18.545 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:18.546 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 1, 2023-10-25T16:25:18.546 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 1, 2023-10-25T16:25:18.546 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 1, 2023-10-25T16:25:18.546 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 1, 2023-10-25T16:25:18.546 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 1, 2023-10-25T16:25:18.546 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:18.547 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:18.547 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:18.547 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:18.547 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:18.547 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:18.548 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:18.548 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.548 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "115", 2023-10-25T16:25:18.548 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:18.548 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:18.549 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:18.549 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:18.549 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:18.549 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:18.549 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:18.549 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:18.550 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:18.550 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:18.550 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:18.550 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:18.551 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:18.551 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:18.551 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:18.551 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:18.551 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:18.552 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:18.552 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:18.552 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:18.552 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:18.552 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:18.552 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:18.553 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:18.553 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:18.553 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:18.553 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.553 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:18.554 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:18.554 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:18.554 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:18.554 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:18.554 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:18.555 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:18.556 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:18.556 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_max": 32, 2023-10-25T16:25:18.556 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 1 2023-10-25T16:25:18.556 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.556 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:18.557 INFO:teuthology.orchestra.run.smithi177.stdout: "mgr": {} 2023-10-25T16:25:18.557 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.557 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:18.557 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 8, 2023-10-25T16:25:18.557 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 8, 2023-10-25T16:25:18.557 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 0.25, 2023-10-25T16:25:18.558 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:18.558 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:18.558 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:18.558 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:18.558 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:18.559 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.559 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.559 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.559 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 22, 2023-10-25T16:25:18.559 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_metadata", 2023-10-25T16:25:18.559 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:40.583783+0000", 2023-10-25T16:25:18.560 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:18.560 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:18.560 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:18.560 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:18.560 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:18.561 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:18.561 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:18.561 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:18.561 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:18.561 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:18.562 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:18.562 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:18.562 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 32, 2023-10-25T16:25:18.562 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 32, 2023-10-25T16:25:18.562 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 32, 2023-10-25T16:25:18.563 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 32, 2023-10-25T16:25:18.563 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 32, 2023-10-25T16:25:18.563 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:18.563 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:18.563 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:18.563 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:18.564 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:18.564 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:18.564 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:18.564 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.564 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "189", 2023-10-25T16:25:18.565 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:18.565 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:18.565 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:18.565 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:18.565 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:18.566 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:18.566 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:18.566 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:18.566 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:18.566 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 0, 2023-10-25T16:25:18.567 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:18.567 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:18.567 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:18.567 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:18.567 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:18.568 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:18.568 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:18.568 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:18.568 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:18.568 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:18.568 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:18.569 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:18.569 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:18.569 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:18.569 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:18.569 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:18.570 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.570 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:18.570 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:18.570 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:18.570 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:18.571 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:18.571 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:18.571 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:18.571 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:18.571 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:18.572 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:18.572 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:18.572 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:18.572 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_bias": 4, 2023-10-25T16:25:18.572 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 16, 2023-10-25T16:25:18.572 INFO:teuthology.orchestra.run.smithi177.stdout: "recovery_priority": 5 2023-10-25T16:25:18.573 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.573 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:18.573 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:18.573 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": "cephfs" 2023-10-25T16:25:18.573 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.574 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.574 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:18.574 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 2, 2023-10-25T16:25:18.574 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 2, 2023-10-25T16:25:18.574 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:18.575 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 2, 2023-10-25T16:25:18.575 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 2, 2023-10-25T16:25:18.575 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:18.575 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:18.575 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:18.575 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.576 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.576 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.576 INFO:teuthology.orchestra.run.smithi177.stdout: "pool": 23, 2023-10-25T16:25:18.576 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_name": "cephfs_data", 2023-10-25T16:25:18.576 INFO:teuthology.orchestra.run.smithi177.stdout: "create_time": "2023-10-25T16:24:41.397821+0000", 2023-10-25T16:25:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "flags": 1, 2023-10-25T16:25:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "flags_names": "hashpspool", 2023-10-25T16:25:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "type": 1, 2023-10-25T16:25:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "size": 2, 2023-10-25T16:25:18.577 INFO:teuthology.orchestra.run.smithi177.stdout: "min_size": 1, 2023-10-25T16:25:18.578 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_rule": 0, 2023-10-25T16:25:18.578 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_count": 0, 2023-10-25T16:25:18.578 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_target": 0, 2023-10-25T16:25:18.578 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_barrier": 0, 2023-10-25T16:25:18.578 INFO:teuthology.orchestra.run.smithi177.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-25T16:25:18.579 INFO:teuthology.orchestra.run.smithi177.stdout: "object_hash": 2, 2023-10-25T16:25:18.579 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_autoscale_mode": "off", 2023-10-25T16:25:18.579 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num": 64, 2023-10-25T16:25:18.579 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num": 64, 2023-10-25T16:25:18.579 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_placement_num_target": 64, 2023-10-25T16:25:18.579 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_target": 64, 2023-10-25T16:25:18.580 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_pending": 64, 2023-10-25T16:25:18.580 INFO:teuthology.orchestra.run.smithi177.stdout: "last_pg_merge_meta": { 2023-10-25T16:25:18.580 INFO:teuthology.orchestra.run.smithi177.stdout: "source_pgid": "0.0", 2023-10-25T16:25:18.580 INFO:teuthology.orchestra.run.smithi177.stdout: "ready_epoch": 0, 2023-10-25T16:25:18.580 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_started": 0, 2023-10-25T16:25:18.581 INFO:teuthology.orchestra.run.smithi177.stdout: "last_epoch_clean": 0, 2023-10-25T16:25:18.581 INFO:teuthology.orchestra.run.smithi177.stdout: "source_version": "0'0", 2023-10-25T16:25:18.581 INFO:teuthology.orchestra.run.smithi177.stdout: "target_version": "0'0" 2023-10-25T16:25:18.581 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.581 INFO:teuthology.orchestra.run.smithi177.stdout: "last_change": "193", 2023-10-25T16:25:18.582 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend": "0", 2023-10-25T16:25:18.582 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-25T16:25:18.582 INFO:teuthology.orchestra.run.smithi177.stdout: "last_force_op_resend_preluminous": "0", 2023-10-25T16:25:18.582 INFO:teuthology.orchestra.run.smithi177.stdout: "auid": 0, 2023-10-25T16:25:18.582 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_mode": "selfmanaged", 2023-10-25T16:25:18.583 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_seq": 0, 2023-10-25T16:25:18.583 INFO:teuthology.orchestra.run.smithi177.stdout: "snap_epoch": 0, 2023-10-25T16:25:18.583 INFO:teuthology.orchestra.run.smithi177.stdout: "pool_snaps": [], 2023-10-25T16:25:18.583 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps": "[]", 2023-10-25T16:25:18.583 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_bytes": 33554432, 2023-10-25T16:25:18.584 INFO:teuthology.orchestra.run.smithi177.stdout: "quota_max_objects": 0, 2023-10-25T16:25:18.584 INFO:teuthology.orchestra.run.smithi177.stdout: "tiers": [], 2023-10-25T16:25:18.584 INFO:teuthology.orchestra.run.smithi177.stdout: "tier_of": -1, 2023-10-25T16:25:18.584 INFO:teuthology.orchestra.run.smithi177.stdout: "read_tier": -1, 2023-10-25T16:25:18.584 INFO:teuthology.orchestra.run.smithi177.stdout: "write_tier": -1, 2023-10-25T16:25:18.584 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_mode": "none", 2023-10-25T16:25:18.585 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_bytes": 0, 2023-10-25T16:25:18.585 INFO:teuthology.orchestra.run.smithi177.stdout: "target_max_objects": 0, 2023-10-25T16:25:18.585 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-25T16:25:18.585 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-25T16:25:18.585 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-25T16:25:18.585 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_flush_age": 0, 2023-10-25T16:25:18.586 INFO:teuthology.orchestra.run.smithi177.stdout: "cache_min_evict_age": 0, 2023-10-25T16:25:18.586 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profile": "", 2023-10-25T16:25:18.586 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_params": { 2023-10-25T16:25:18.586 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "none" 2023-10-25T16:25:18.586 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.587 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_period": 0, 2023-10-25T16:25:18.587 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_count": 0, 2023-10-25T16:25:18.587 INFO:teuthology.orchestra.run.smithi177.stdout: "use_gmt_hitset": true, 2023-10-25T16:25:18.587 INFO:teuthology.orchestra.run.smithi177.stdout: "min_read_recency_for_promote": 0, 2023-10-25T16:25:18.587 INFO:teuthology.orchestra.run.smithi177.stdout: "min_write_recency_for_promote": 0, 2023-10-25T16:25:18.588 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_grade_decay_rate": 0, 2023-10-25T16:25:18.588 INFO:teuthology.orchestra.run.smithi177.stdout: "hit_set_search_last_n": 0, 2023-10-25T16:25:18.588 INFO:teuthology.orchestra.run.smithi177.stdout: "grade_table": [], 2023-10-25T16:25:18.588 INFO:teuthology.orchestra.run.smithi177.stdout: "stripe_width": 0, 2023-10-25T16:25:18.588 INFO:teuthology.orchestra.run.smithi177.stdout: "expected_num_objects": 0, 2023-10-25T16:25:18.589 INFO:teuthology.orchestra.run.smithi177.stdout: "fast_read": false, 2023-10-25T16:25:18.589 INFO:teuthology.orchestra.run.smithi177.stdout: "options": { 2023-10-25T16:25:18.589 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_num_min": 64, 2023-10-25T16:25:18.589 INFO:teuthology.orchestra.run.smithi177.stdout: "target_size_ratio": 0.89999997615814209 2023-10-25T16:25:18.589 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.590 INFO:teuthology.orchestra.run.smithi177.stdout: "application_metadata": { 2023-10-25T16:25:18.590 INFO:teuthology.orchestra.run.smithi177.stdout: "cephfs": { 2023-10-25T16:25:18.590 INFO:teuthology.orchestra.run.smithi177.stdout: "data": "cephfs" 2023-10-25T16:25:18.590 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.590 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.591 INFO:teuthology.orchestra.run.smithi177.stdout: "read_balance": { 2023-10-25T16:25:18.591 INFO:teuthology.orchestra.run.smithi177.stdout: "score_acting": 1.3799999952316284, 2023-10-25T16:25:18.591 INFO:teuthology.orchestra.run.smithi177.stdout: "score_stable": 1.3799999952316284, 2023-10-25T16:25:18.591 INFO:teuthology.orchestra.run.smithi177.stdout: "optimal_score": 1, 2023-10-25T16:25:18.591 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_acting": 1.3799999952316284, 2023-10-25T16:25:18.592 INFO:teuthology.orchestra.run.smithi177.stdout: "raw_score_stable": 1.3799999952316284, 2023-10-25T16:25:18.592 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity_weighted": 1, 2023-10-25T16:25:18.592 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity": 1, 2023-10-25T16:25:18.592 INFO:teuthology.orchestra.run.smithi177.stdout: "average_primary_affinity_weighted": 1 2023-10-25T16:25:18.592 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.593 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.593 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.593 INFO:teuthology.orchestra.run.smithi177.stdout: "osds": [ 2023-10-25T16:25:18.593 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.593 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:18.593 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.594 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.594 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.594 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.594 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.594 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.594 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.595 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.595 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.595 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.595 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.595 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.596 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.596 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.596 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.596 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6800", 2023-10-25T16:25:18.596 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.596 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6801", 2023-10-25T16:25:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.597 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.598 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.599 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6802", 2023-10-25T16:25:18.599 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.599 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.599 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.599 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.600 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6803", 2023-10-25T16:25:18.600 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.600 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.600 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.600 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.601 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.601 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.601 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.601 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.601 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6806", 2023-10-25T16:25:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6807", 2023-10-25T16:25:18.602 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.603 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.603 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.603 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.603 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.603 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.604 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.604 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6804", 2023-10-25T16:25:18.604 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.604 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.604 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.605 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.605 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6805", 2023-10-25T16:25:18.605 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1702384414 2023-10-25T16:25:18.605 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.605 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.605 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.606 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6801/1702384414", 2023-10-25T16:25:18.606 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6803/1702384414", 2023-10-25T16:25:18.606 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6807/1702384414", 2023-10-25T16:25:18.606 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6805/1702384414", 2023-10-25T16:25:18.606 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.607 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.607 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.607 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.607 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.607 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.608 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:18.608 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.608 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.608 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.608 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.609 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.609 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.609 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.609 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.609 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.609 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.610 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.610 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.610 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.610 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.610 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.611 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6808", 2023-10-25T16:25:18.611 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.611 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.611 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.611 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.612 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6809", 2023-10-25T16:25:18.612 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.612 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.612 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.612 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.613 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.613 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.613 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.613 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.613 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6810", 2023-10-25T16:25:18.613 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.614 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.614 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.614 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.614 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6811", 2023-10-25T16:25:18.614 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.615 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.615 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.615 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.615 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.615 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.616 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.616 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.616 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6815", 2023-10-25T16:25:18.616 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.616 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.617 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.617 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.617 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6817", 2023-10-25T16:25:18.617 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.617 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.617 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.618 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.619 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6812", 2023-10-25T16:25:18.619 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.619 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.619 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.619 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.619 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6814", 2023-10-25T16:25:18.620 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 890639561 2023-10-25T16:25:18.620 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.620 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.620 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.620 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6809/890639561", 2023-10-25T16:25:18.621 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6811/890639561", 2023-10-25T16:25:18.621 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6817/890639561", 2023-10-25T16:25:18.621 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6814/890639561", 2023-10-25T16:25:18.621 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.621 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.622 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.622 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.622 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.622 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.622 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:18.623 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.623 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.623 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.623 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.623 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.623 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.624 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.624 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 14, 2023-10-25T16:25:18.624 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.624 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.624 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.625 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.625 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.625 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.625 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6813", 2023-10-25T16:25:18.626 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.626 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.626 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.626 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.626 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6816", 2023-10-25T16:25:18.626 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.627 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.627 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.627 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.627 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.627 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.628 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.628 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.628 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6818", 2023-10-25T16:25:18.628 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.628 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6819", 2023-10-25T16:25:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.629 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.630 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.630 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.630 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.630 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.630 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.631 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6822", 2023-10-25T16:25:18.631 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.631 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.631 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.631 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.632 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6823", 2023-10-25T16:25:18.632 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.632 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.632 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.632 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.632 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.633 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.633 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.633 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.633 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6820", 2023-10-25T16:25:18.633 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.634 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.634 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.634 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.634 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6821", 2023-10-25T16:25:18.634 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 1075656412 2023-10-25T16:25:18.634 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.635 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.635 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.635 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6816/1075656412", 2023-10-25T16:25:18.635 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6819/1075656412", 2023-10-25T16:25:18.635 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6823/1075656412", 2023-10-25T16:25:18.635 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6821/1075656412", 2023-10-25T16:25:18.636 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.636 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.636 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.636 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.636 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.636 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.637 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:18.637 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.637 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.637 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.637 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.637 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.638 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.638 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.638 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.638 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.638 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.638 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.639 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6824", 2023-10-25T16:25:18.640 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.640 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.640 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.640 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.640 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6825", 2023-10-25T16:25:18.640 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.641 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.641 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.641 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.641 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.641 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.642 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.642 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.642 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6826", 2023-10-25T16:25:18.642 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.642 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.643 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.643 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.643 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6827", 2023-10-25T16:25:18.643 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.643 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.643 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.644 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.644 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.644 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.644 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.644 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.645 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6830", 2023-10-25T16:25:18.645 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.645 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.645 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.645 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.646 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6831", 2023-10-25T16:25:18.646 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.646 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.646 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.646 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.646 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.647 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.647 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.647 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.647 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6828", 2023-10-25T16:25:18.647 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.177:6829", 2023-10-25T16:25:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3697255096 2023-10-25T16:25:18.648 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.649 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.649 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.649 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.177:6825/3697255096", 2023-10-25T16:25:18.649 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.177:6827/3697255096", 2023-10-25T16:25:18.649 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.177:6831/3697255096", 2023-10-25T16:25:18.649 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.177:6829/3697255096", 2023-10-25T16:25:18.650 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.650 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.650 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.650 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.651 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.651 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.651 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:18.651 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.651 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.652 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.652 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.652 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.652 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.652 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.653 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.654 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6824", 2023-10-25T16:25:18.654 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.654 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.654 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6825", 2023-10-25T16:25:18.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.655 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.655 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.656 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.656 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.656 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6826", 2023-10-25T16:25:18.657 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.657 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.657 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.657 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.657 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6827", 2023-10-25T16:25:18.658 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.658 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.658 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.658 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.658 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6830", 2023-10-25T16:25:18.659 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6831", 2023-10-25T16:25:18.660 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.661 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.661 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.661 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.661 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.661 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.662 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.662 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.662 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6828", 2023-10-25T16:25:18.662 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.662 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.663 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.663 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.663 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6829", 2023-10-25T16:25:18.663 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3302258236 2023-10-25T16:25:18.663 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.664 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.664 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.664 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6825/3302258236", 2023-10-25T16:25:18.664 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6827/3302258236", 2023-10-25T16:25:18.664 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6831/3302258236", 2023-10-25T16:25:18.665 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6829/3302258236", 2023-10-25T16:25:18.665 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.665 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.665 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.665 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.665 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.666 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.666 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:18.666 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.666 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.666 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.667 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.667 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.667 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.667 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.667 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.668 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.668 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.668 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.668 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.668 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.669 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.669 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6816", 2023-10-25T16:25:18.669 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.669 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.669 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.670 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.670 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6817", 2023-10-25T16:25:18.670 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.670 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.670 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.671 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.671 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.671 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.671 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.671 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6818", 2023-10-25T16:25:18.672 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.672 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.672 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.672 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.672 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6819", 2023-10-25T16:25:18.673 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.673 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.673 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.673 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.673 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.674 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.674 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.674 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.674 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6822", 2023-10-25T16:25:18.674 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.675 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.675 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.675 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.675 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6823", 2023-10-25T16:25:18.675 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.676 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.676 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.676 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.676 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.677 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.677 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.677 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.677 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6820", 2023-10-25T16:25:18.677 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.677 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.678 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.678 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.678 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6821", 2023-10-25T16:25:18.678 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 748323378 2023-10-25T16:25:18.678 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.679 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.679 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.679 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6817/748323378", 2023-10-25T16:25:18.679 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6819/748323378", 2023-10-25T16:25:18.679 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6823/748323378", 2023-10-25T16:25:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6821/748323378", 2023-10-25T16:25:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.680 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.681 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.681 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:18.681 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.681 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.681 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.682 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.682 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.682 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.682 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.682 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.683 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.684 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.684 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6800", 2023-10-25T16:25:18.684 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.684 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.684 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.685 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.685 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6801", 2023-10-25T16:25:18.685 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.685 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.685 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.686 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.686 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.686 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.686 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.686 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.687 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6802", 2023-10-25T16:25:18.687 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.687 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.687 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.687 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.688 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6803", 2023-10-25T16:25:18.688 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.688 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.688 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.688 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.688 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.689 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.689 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.689 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6806", 2023-10-25T16:25:18.689 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.690 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.690 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.690 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.690 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6807", 2023-10-25T16:25:18.690 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.691 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.691 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.691 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.691 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.692 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.692 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.692 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.692 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6804", 2023-10-25T16:25:18.692 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.692 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.693 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.693 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.693 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6805", 2023-10-25T16:25:18.693 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 3199176706 2023-10-25T16:25:18.693 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.694 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.694 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.694 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6801/3199176706", 2023-10-25T16:25:18.694 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6803/3199176706", 2023-10-25T16:25:18.695 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6807/3199176706", 2023-10-25T16:25:18.695 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6805/3199176706", 2023-10-25T16:25:18.695 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.695 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.695 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.696 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.696 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.696 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.696 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:18.696 INFO:teuthology.orchestra.run.smithi177.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-10-25T16:25:18.697 INFO:teuthology.orchestra.run.smithi177.stdout: "up": 1, 2023-10-25T16:25:18.697 INFO:teuthology.orchestra.run.smithi177.stdout: "in": 1, 2023-10-25T16:25:18.697 INFO:teuthology.orchestra.run.smithi177.stdout: "weight": 1, 2023-10-25T16:25:18.697 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_affinity": 1, 2023-10-25T16:25:18.697 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_begin": 0, 2023-10-25T16:25:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: "last_clean_end": 0, 2023-10-25T16:25:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: "up_from": 13, 2023-10-25T16:25:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: "up_thru": 188, 2023-10-25T16:25:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: "down_at": 0, 2023-10-25T16:25:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: "lost_at": 0, 2023-10-25T16:25:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addrs": { 2023-10-25T16:25:18.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.699 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.699 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.699 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6808", 2023-10-25T16:25:18.699 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.700 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.700 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.700 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.700 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6809", 2023-10-25T16:25:18.700 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addrs": { 2023-10-25T16:25:18.701 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.702 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.702 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.702 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6810", 2023-10-25T16:25:18.702 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.702 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.703 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.703 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.703 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6811", 2023-10-25T16:25:18.703 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.703 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.704 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.704 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.704 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addrs": { 2023-10-25T16:25:18.704 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.704 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.705 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.705 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6814", 2023-10-25T16:25:18.705 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.705 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.705 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.706 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.706 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6815", 2023-10-25T16:25:18.706 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.706 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.706 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.707 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.707 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addrs": { 2023-10-25T16:25:18.707 INFO:teuthology.orchestra.run.smithi177.stdout: "addrvec": [ 2023-10-25T16:25:18.707 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.707 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v2", 2023-10-25T16:25:18.708 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6812", 2023-10-25T16:25:18.708 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.708 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.708 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.708 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-25T16:25:18.709 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "172.21.15.184:6813", 2023-10-25T16:25:18.709 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 435860171 2023-10-25T16:25:18.709 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.709 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.709 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.709 INFO:teuthology.orchestra.run.smithi177.stdout: "public_addr": "172.21.15.184:6809/435860171", 2023-10-25T16:25:18.710 INFO:teuthology.orchestra.run.smithi177.stdout: "cluster_addr": "172.21.15.184:6811/435860171", 2023-10-25T16:25:18.710 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_back_addr": "172.21.15.184:6815/435860171", 2023-10-25T16:25:18.710 INFO:teuthology.orchestra.run.smithi177.stdout: "heartbeat_front_addr": "172.21.15.184:6813/435860171", 2023-10-25T16:25:18.710 INFO:teuthology.orchestra.run.smithi177.stdout: "state": [ 2023-10-25T16:25:18.710 INFO:teuthology.orchestra.run.smithi177.stdout: "exists", 2023-10-25T16:25:18.711 INFO:teuthology.orchestra.run.smithi177.stdout: "up" 2023-10-25T16:25:18.711 INFO:teuthology.orchestra.run.smithi177.stdout: ] 2023-10-25T16:25:18.711 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.711 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.711 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_xinfo": [ 2023-10-25T16:25:18.712 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.712 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 0, 2023-10-25T16:25:18.712 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.712 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.712 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.713 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.713 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.713 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.860211+0000", 2023-10-25T16:25:18.713 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.713 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.714 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.714 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 1, 2023-10-25T16:25:18.714 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.714 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.714 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.715 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.715 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.715 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.885647+0000", 2023-10-25T16:25:18.715 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.715 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.716 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.716 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 2, 2023-10-25T16:25:18.716 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.716 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.716 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.717 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.717 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.717 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.897245+0000", 2023-10-25T16:25:18.717 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.717 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.718 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.718 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 3, 2023-10-25T16:25:18.718 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.718 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.718 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.718 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.719 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.719 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.917273+0000", 2023-10-25T16:25:18.719 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.719 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.719 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.719 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 4, 2023-10-25T16:25:18.720 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.720 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.720 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.720 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.720 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.721 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.858040+0000", 2023-10-25T16:25:18.721 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.721 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.721 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.721 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 5, 2023-10-25T16:25:18.721 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.903189+0000", 2023-10-25T16:25:18.722 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.723 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.723 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.723 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 6, 2023-10-25T16:25:18.723 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.723 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.724 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.724 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.724 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.724 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.823214+0000", 2023-10-25T16:25:18.724 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.725 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.725 INFO:teuthology.orchestra.run.smithi177.stdout: { 2023-10-25T16:25:18.725 INFO:teuthology.orchestra.run.smithi177.stdout: "osd": 7, 2023-10-25T16:25:18.725 INFO:teuthology.orchestra.run.smithi177.stdout: "down_stamp": "0.000000", 2023-10-25T16:25:18.725 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_probability": 0, 2023-10-25T16:25:18.725 INFO:teuthology.orchestra.run.smithi177.stdout: "laggy_interval": 0, 2023-10-25T16:25:18.726 INFO:teuthology.orchestra.run.smithi177.stdout: "features": 4540138322906710015, 2023-10-25T16:25:18.726 INFO:teuthology.orchestra.run.smithi177.stdout: "old_weight": 0, 2023-10-25T16:25:18.726 INFO:teuthology.orchestra.run.smithi177.stdout: "last_purged_snaps_scrub": "2023-10-25T16:12:52.827212+0000", 2023-10-25T16:25:18.726 INFO:teuthology.orchestra.run.smithi177.stdout: "dead_epoch": 0 2023-10-25T16:25:18.726 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.727 INFO:teuthology.orchestra.run.smithi177.stdout: ], 2023-10-25T16:25:18.727 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap": [], 2023-10-25T16:25:18.727 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_items": [], 2023-10-25T16:25:18.727 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_upmap_primaries": [], 2023-10-25T16:25:18.727 INFO:teuthology.orchestra.run.smithi177.stdout: "pg_temp": [], 2023-10-25T16:25:18.728 INFO:teuthology.orchestra.run.smithi177.stdout: "primary_temp": [], 2023-10-25T16:25:18.728 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklist": {}, 2023-10-25T16:25:18.728 INFO:teuthology.orchestra.run.smithi177.stdout: "range_blocklist": {}, 2023-10-25T16:25:18.728 INFO:teuthology.orchestra.run.smithi177.stdout: "erasure_code_profiles": { 2023-10-25T16:25:18.728 INFO:teuthology.orchestra.run.smithi177.stdout: "default": { 2023-10-25T16:25:18.728 INFO:teuthology.orchestra.run.smithi177.stdout: "crush-failure-domain": "osd", 2023-10-25T16:25:18.729 INFO:teuthology.orchestra.run.smithi177.stdout: "k": "2", 2023-10-25T16:25:18.729 INFO:teuthology.orchestra.run.smithi177.stdout: "m": "1", 2023-10-25T16:25:18.729 INFO:teuthology.orchestra.run.smithi177.stdout: "plugin": "jerasure", 2023-10-25T16:25:18.729 INFO:teuthology.orchestra.run.smithi177.stdout: "technique": "reed_sol_van" 2023-10-25T16:25:18.729 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.730 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-25T16:25:18.730 INFO:teuthology.orchestra.run.smithi177.stdout: "removed_snaps_queue": [], 2023-10-25T16:25:18.730 INFO:teuthology.orchestra.run.smithi177.stdout: "new_removed_snaps": [], 2023-10-25T16:25:18.730 INFO:teuthology.orchestra.run.smithi177.stdout: "new_purged_snaps": [], 2023-10-25T16:25:18.730 INFO:teuthology.orchestra.run.smithi177.stdout: "crush_node_flags": {}, 2023-10-25T16:25:18.731 INFO:teuthology.orchestra.run.smithi177.stdout: "device_class_flags": {}, 2023-10-25T16:25:18.731 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode": { 2023-10-25T16:25:18.731 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_enabled": false, 2023-10-25T16:25:18.731 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_bucket_count": 0, 2023-10-25T16:25:18.731 INFO:teuthology.orchestra.run.smithi177.stdout: "degraded_stretch_mode": 0, 2023-10-25T16:25:18.732 INFO:teuthology.orchestra.run.smithi177.stdout: "recovering_stretch_mode": 0, 2023-10-25T16:25:18.732 INFO:teuthology.orchestra.run.smithi177.stdout: "stretch_mode_bucket": 0 2023-10-25T16:25:18.732 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-25T16:25:18.732 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:18.733 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c78066470 msgr2=0x7f2c78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c78066470 0x7f2c78068930 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2c900ae000 tx=0x7f2c9001afb0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 msgr2=0x7f2c9415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 0x7f2c9415a6b0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c970 tx=0x7f2c8400ce30 comp rx=0 tx=0).stop 2023-10-25T16:25:18.734 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 shutdown_connections 2023-10-25T16:25:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2c78066470 0x7f2c78068930 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c9415eb90 0x7f2c941517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c940cbf40 0x7f2c9415a6b0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 --2- 172.21.15.177:0/3408230153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c940ca930 0x7f2c94156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 >> 172.21.15.177:0/3408230153 conn(0x7f2c940983a0 msgr2=0x7f2c9415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:18.735 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 shutdown_connections 2023-10-25T16:25:18.736 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.542+0000 7f2c9c56c640 1 -- 172.21.15.177:0/3408230153 wait complete. 2023-10-25T16:25:18.736 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:18.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 -- 172.21.15.177:0/3509862996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e40047d0 msgr2=0x7f37e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 --2- 172.21.15.177:0/3509862996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e40047d0 0x7f37e4004c50 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f37f0006ee0 tx=0x7f37f001cec0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 -- 172.21.15.177:0/3509862996 shutdown_connections 2023-10-25T16:25:18.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 --2- 172.21.15.177:0/3509862996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37e40047d0 0x7f37e4004c50 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 -- 172.21.15.177:0/3509862996 >> 172.21.15.177:0/3509862996 conn(0x7f37fc09a5c0 msgr2=0x7f37fc0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:18.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 -- 172.21.15.177:0/3509862996 shutdown_connections 2023-10-25T16:25:18.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 -- 172.21.15.177:0/3509862996 wait complete. 2023-10-25T16:25:18.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 Processor -- start 2023-10-25T16:25:18.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.866+0000 7f380222a640 1 -- start start 2023-10-25T16:25:18.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e40047d0 0x7f37fc158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37fc14c3b0 0x7f37fc0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 0x7f37fc0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc14a360 con 0x7f37fc0b5f00 2023-10-25T16:25:18.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc14cbb0 con 0x7f37e40047d0 2023-10-25T16:25:18.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc14ce90 con 0x7f37fc14c3b0 2023-10-25T16:25:18.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 0x7f37fc0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 0x7f37fc0b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50256/0 (socket says 172.21.15.177:50256) 2023-10-25T16:25:18.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 -- 172.21.15.177:0/3524763859 learned_addr learned my addr 172.21.15.177:0/3524763859 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:18.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 -- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37fc14c3b0 msgr2=0x7f37fc0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37fc14c3b0 0x7f37fc0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 -- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e40047d0 msgr2=0x7f37fc158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:18.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fb7fe640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e40047d0 0x7f37fc158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e40047d0 0x7f37fc158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:18.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 -- 172.21.15.177:0/3524763859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc14d170 con 0x7f37fc0b5f00 2023-10-25T16:25:18.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fbfff640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 0x7f37fc0b1440 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f37fc08ac30 tx=0x7f37f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:18.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4006d60 con 0x7f37fc0b5f00 2023-10-25T16:25:18.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f37f4003980 con 0x7f37fc0b5f00 2023-10-25T16:25:18.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37fc14a570 con 0x7f37fc0b5f00 2023-10-25T16:25:18.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4003dd0 con 0x7f37fc0b5f00 2023-10-25T16:25:18.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37fc0b1980 con 0x7f37fc0b5f00 2023-10-25T16:25:18.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37fc14a7b0 con 0x7f37fc0b5f00 2023-10-25T16:25:18.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37f40050d0 con 0x7f37fc0b5f00 2023-10-25T16:25:18.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37e3fff640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37e8066470 0x7f37e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:18.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37f4083330 con 0x7f37fc0b5f00 2023-10-25T16:25:18.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.870+0000 7f37fb7fe640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37e8066470 0x7f37e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:18.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.874+0000 7f37fb7fe640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37e8066470 0x7f37e8068930 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f37fc15dd30 tx=0x7f37ec0091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:18.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:18.874+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f37fc14a7b0 con 0x7f37fc0b5f00 2023-10-25T16:25:19.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.054+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37fc14a7b0 con 0x7f37fc0b5f00 2023-10-25T16:25:19.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.054+0000 7f37e3fff640 1 -- 172.21.15.177:0/3524763859 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f37fc14a7b0 con 0x7f37fc0b5f00 2023-10-25T16:25:19.054 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:19.055 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:25:19.056 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:25:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37e8066470 msgr2=0x7f37e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37e8066470 0x7f37e8068930 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f37fc15dd30 tx=0x7f37ec0091e0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 msgr2=0x7f37fc0b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:19.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 0x7f37fc0b1440 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f37fc08ac30 tx=0x7f37f400c940 comp rx=0 tx=0).stop 2023-10-25T16:25:19.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 shutdown_connections 2023-10-25T16:25:19.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f37e8066470 0x7f37e8068930 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37fc0b5f00 0x7f37fc0b1440 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37fc14c3b0 0x7f37fc0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 --2- 172.21.15.177:0/3524763859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e40047d0 0x7f37fc158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 >> 172.21.15.177:0/3524763859 conn(0x7f37fc09a5c0 msgr2=0x7f37fc15d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 shutdown_connections 2023-10-25T16:25:19.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.058+0000 7f380222a640 1 -- 172.21.15.177:0/3524763859 wait complete. 2023-10-25T16:25:19.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-10-25T16:25:19.219 INFO:teuthology.orchestra.run.smithi184.stdout:{"cluster_fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","whoami":0,"id":156302,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":36.141288742,"mdsmap_epoch":72,"osdmap_epoch":193,"osdmap_epoch_barrier":192,"uptime":40.981029556000003} 2023-10-25T16:25:19.219 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "da778784-be7e-4dcd-bc5a-18ed17fb00e4", "fs_name": "cephfs", "id": 156302, "mdsmap_epoch": 72, "osdmap_epoch": 193, "osdmap_epoch_barrier": 192, "rank_uptime": 36.141288742, "state": "up:active", "uptime": 40.981029556, "want_state": "up:active", "whoami": 0 } 2023-10-25T16:25:19.220 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-25T16:25:19.220 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:25:19.221 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:19.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:19.227 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-10-25T16:25:19.728 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records in 2023-10-25T16:25:19.728 INFO:teuthology.orchestra.run.smithi177.stderr:50+0 records out 2023-10-25T16:25:19.728 INFO:teuthology.orchestra.run.smithi177.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.448097 s, 117 MB/s 2023-10-25T16:25:19.729 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-25T16:25:19.730 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:25:19.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-25T16:25:19.815 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-25T16:25:19.816 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:25:19.816 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:19.821 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:25:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- 172.21.15.177:0/161716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df81591e0 msgr2=0x7f2df80c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 --2- 172.21.15.177:0/161716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df81591e0 0x7f2df80c2b30 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009840 tx=0x7f2dec01c800 comp rx=0 tx=0).stop 2023-10-25T16:25:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- 172.21.15.177:0/161716035 shutdown_connections 2023-10-25T16:25:19.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 --2- 172.21.15.177:0/161716035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2df80b0a20 0x7f2df80b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 --2- 172.21.15.177:0/161716035 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df81591e0 0x7f2df80c2b30 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- 172.21.15.177:0/161716035 >> 172.21.15.177:0/161716035 conn(0x7f2df80cefe0 msgr2=0x7f2df80cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- 172.21.15.177:0/161716035 shutdown_connections 2023-10-25T16:25:19.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- 172.21.15.177:0/161716035 wait complete. 2023-10-25T16:25:19.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 Processor -- start 2023-10-25T16:25:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- start start 2023-10-25T16:25:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2df80af110 0x7f2df80ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 0x7f2df806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df81591e0 0x7f2df806c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:19.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81585a0 con 0x7f2df80b0a20 2023-10-25T16:25:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8157990 con 0x7f2df81591e0 2023-10-25T16:25:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dffeca640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8157c70 con 0x7f2df80af110 2023-10-25T16:25:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dfd465640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 0x7f2df806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dfd465640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 0x7f2df806bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50264/0 (socket says 172.21.15.177:50264) 2023-10-25T16:25:20.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dfd465640 1 -- 172.21.15.177:0/995277732 learned_addr learned my addr 172.21.15.177:0/995277732 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dfe467640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df81591e0 0x7f2df806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:19.998+0000 7f2dfdc66640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2df80af110 0x7f2df80ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfd465640 1 -- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2df80af110 msgr2=0x7f2df80ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfd465640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2df80af110 0x7f2df80ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfd465640 1 -- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df81591e0 msgr2=0x7f2df806c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfd465640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df81591e0 0x7f2df806c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfd465640 1 -- 172.21.15.177:0/995277732 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0094a0 con 0x7f2df80b0a20 2023-10-25T16:25:20.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfd465640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 0x7f2df806bb00 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f2df400b550 tx=0x7f2df400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4010870 con 0x7f2df80b0a20 2023-10-25T16:25:20.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2df4010ae0 con 0x7f2df80b0a20 2023-10-25T16:25:20.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df8157f50 con 0x7f2df80b0a20 2023-10-25T16:25:20.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400f3c0 con 0x7f2df80b0a20 2023-10-25T16:25:20.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df81576a0 con 0x7f2df80b0a20 2023-10-25T16:25:20.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df804daf0 con 0x7f2df80b0a20 2023-10-25T16:25:20.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2df400f520 con 0x7f2df80b0a20 2023-10-25T16:25:20.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dea7fc640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ddc066470 0x7f2ddc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2df4084090 con 0x7f2df80b0a20 2023-10-25T16:25:20.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfdc66640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ddc066470 0x7f2ddc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.002+0000 7f2dfdc66640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ddc066470 0x7f2ddc068930 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0af000 tx=0x7f2dec01b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.006+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2df40515a0 con 0x7f2df80b0a20 2023-10-25T16:25:20.158 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.162+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df806f240 con 0x7f2df80b0a20 2023-10-25T16:25:20.161 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.162+0000 7f2dea7fc640 1 -- 172.21.15.177:0/995277732 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16603 (secure 0 0 0) 0x7f2df4014090 con 0x7f2df80b0a20 2023-10-25T16:25:20.162 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:20.162 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":193,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:25:17.832256+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:25:20.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ddc066470 msgr2=0x7f2ddc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ddc066470 0x7f2ddc068930 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0af000 tx=0x7f2dec01b040 comp rx=0 tx=0).stop 2023-10-25T16:25:20.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 msgr2=0x7f2df806bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 0x7f2df806bb00 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f2df400b550 tx=0x7f2df400ba10 comp rx=0 tx=0).stop 2023-10-25T16:25:20.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 shutdown_connections 2023-10-25T16:25:20.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2ddc066470 0x7f2ddc068930 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.165 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2df81591e0 0x7f2df806c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2df80b0a20 0x7f2df806bb00 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 --2- 172.21.15.177:0/995277732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2df80af110 0x7f2df80ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.166 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 >> 172.21.15.177:0/995277732 conn(0x7f2df80cefe0 msgr2=0x7f2df8152820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:20.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 shutdown_connections 2023-10-25T16:25:20.167 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.166+0000 7f2dffeca640 1 -- 172.21.15.177:0/995277732 wait complete. 2023-10-25T16:25:20.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:24:40.583783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:24:41.397821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:25:20.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:25:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- 172.21.15.177:0/1821507041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05080b02c0 msgr2=0x7f05080cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 --2- 172.21.15.177:0/1821507041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05080b02c0 0x7f05080cf600 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009840 tx=0x7f04f001ef10 comp rx=0 tx=0).stop 2023-10-25T16:25:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- 172.21.15.177:0/1821507041 shutdown_connections 2023-10-25T16:25:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 --2- 172.21.15.177:0/1821507041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05080b02c0 0x7f05080cf600 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 --2- 172.21.15.177:0/1821507041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f050815edf0 0x7f05080b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- 172.21.15.177:0/1821507041 >> 172.21.15.177:0/1821507041 conn(0x7f050809a640 msgr2=0x7f05080d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:20.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- 172.21.15.177:0/1821507041 shutdown_connections 2023-10-25T16:25:20.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- 172.21.15.177:0/1821507041 wait complete. 2023-10-25T16:25:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 Processor -- start 2023-10-25T16:25:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- start start 2023-10-25T16:25:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05080b02c0 0x7f05080b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05080b2980 0x7f05081520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 0x7f05080c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c90e0 con 0x7f050815edf0 2023-10-25T16:25:20.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080b45a0 con 0x7f05080b2980 2023-10-25T16:25:20.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f050d48a640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c84d0 con 0x7f05080b02c0 2023-10-25T16:25:20.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 0x7f05080c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 0x7f05080c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:50292/0 (socket says 172.21.15.177:50292) 2023-10-25T16:25:20.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 -- 172.21.15.177:0/180637642 learned_addr learned my addr 172.21.15.177:0/180637642 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:20.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f04fffff640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05080b2980 0x7f05081520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f0506ffd640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05080b02c0 0x7f05080b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 -- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05080b02c0 msgr2=0x7f05080b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05080b02c0 0x7f05080b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 -- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05080b2980 msgr2=0x7f05081520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05080b2980 0x7f05081520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 -- 172.21.15.177:0/180637642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00094a0 con 0x7f050815edf0 2023-10-25T16:25:20.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.314+0000 7f05077fe640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 0x7f05080c6790 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f050000cc30 tx=0x7f050000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000aa50 con 0x7f050815edf0 2023-10-25T16:25:20.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f050000acc0 con 0x7f050815edf0 2023-10-25T16:25:20.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080c87b0 con 0x7f050815edf0 2023-10-25T16:25:20.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500012680 con 0x7f050815edf0 2023-10-25T16:25:20.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080c8d70 con 0x7f050815edf0 2023-10-25T16:25:20.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05080c9250 con 0x7f050815edf0 2023-10-25T16:25:20.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05000127e0 con 0x7f050815edf0 2023-10-25T16:25:20.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f04ff7fe640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04ec066470 0x7f04ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0500084730 con 0x7f050815edf0 2023-10-25T16:25:20.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f0506ffd640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04ec066470 0x7f04ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.318+0000 7f0506ffd640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04ec066470 0x7f04ec068930 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f04f80058d0 tx=0x7f04f8005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.322+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0500051c40 con 0x7f050815edf0 2023-10-25T16:25:20.472 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.474+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f050804daf0 con 0x7f050815edf0 2023-10-25T16:25:20.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.474+0000 7f04ff7fe640 1 -- 172.21.15.177:0/180637642 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05000160a0 con 0x7f050815edf0 2023-10-25T16:25:20.473 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:25:20.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04ec066470 msgr2=0x7f04ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04ec066470 0x7f04ec068930 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f04f80058d0 tx=0x7f04f8005860 comp rx=0 tx=0).stop 2023-10-25T16:25:20.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 msgr2=0x7f05080c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 0x7f05080c6790 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f050000cc30 tx=0x7f050000cd20 comp rx=0 tx=0).stop 2023-10-25T16:25:20.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 shutdown_connections 2023-10-25T16:25:20.476 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f04ec066470 0x7f04ec068930 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f050815edf0 0x7f05080c6790 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05080b2980 0x7f05081520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 --2- 172.21.15.177:0/180637642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05080b02c0 0x7f05080b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 >> 172.21.15.177:0/180637642 conn(0x7f050809a640 msgr2=0x7f05080b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:20.477 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 shutdown_connections 2023-10-25T16:25:20.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.478+0000 7f050d48a640 1 -- 172.21.15.177:0/180637642 wait complete. 2023-10-25T16:25:20.492 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:25:20.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- 172.21.15.177:0/3298881916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5200b2120 msgr2=0x7fa5200b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3298881916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5200b2120 0x7fa5200b4100 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009900 tx=0x7fa51c01c7f0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- 172.21.15.177:0/3298881916 shutdown_connections 2023-10-25T16:25:20.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3298881916 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 0x7fa5200cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3298881916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5200b2120 0x7fa5200b4100 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- 172.21.15.177:0/3298881916 >> 172.21.15.177:0/3298881916 conn(0x7fa52009a5c0 msgr2=0x7fa5200d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:20.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- 172.21.15.177:0/3298881916 shutdown_connections 2023-10-25T16:25:20.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- 172.21.15.177:0/3298881916 wait complete. 2023-10-25T16:25:20.623 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 Processor -- start 2023-10-25T16:25:20.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- start start 2023-10-25T16:25:20.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5200b2120 0x7fa520159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 0x7fa520150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.624 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 0x7fa520157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520158ba0 con 0x7fa52015eba0 2023-10-25T16:25:20.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520158e80 con 0x7fa5200b2120 2023-10-25T16:25:20.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa5279e9640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa520159160 con 0x7fa5200cdb10 2023-10-25T16:25:20.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 0x7fa520157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.625 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 0x7fa520157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58876/0 (socket says 172.21.15.177:58876) 2023-10-25T16:25:20.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 -- 172.21.15.177:0/3770406996 learned_addr learned my addr 172.21.15.177:0/3770406996 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:20.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525785640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5200b2120 0x7fa520159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa524f84640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 0x7fa520150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 -- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 msgr2=0x7fa520150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.626 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 0x7fa520150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 -- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5200b2120 msgr2=0x7fa520159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5200b2120 0x7fa520159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa525f86640 1 -- 172.21.15.177:0/3770406996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c009560 con 0x7fa52015eba0 2023-10-25T16:25:20.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.622+0000 7fa524f84640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 0x7fa520150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:20.627 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa525f86640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 0x7fa520157570 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fa51800cce0 tx=0x7fa51800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800f450 con 0x7fa52015eba0 2023-10-25T16:25:20.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa51800f6c0 con 0x7fa52015eba0 2023-10-25T16:25:20.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51800fad0 con 0x7fa52015eba0 2023-10-25T16:25:20.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa520159440 con 0x7fa52015eba0 2023-10-25T16:25:20.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52015a180 con 0x7fa52015eba0 2023-10-25T16:25:20.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52004daf0 con 0x7fa52015eba0 2023-10-25T16:25:20.629 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa51800fc30 con 0x7fa52015eba0 2023-10-25T16:25:20.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa515ffb640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa504066470 0x7fa504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa518084ad0 con 0x7fa52015eba0 2023-10-25T16:25:20.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa525785640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa504066470 0x7fa504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.626+0000 7fa525785640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa504066470 0x7fa504068930 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa5201552e0 tx=0x7fa510008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.630+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa518051fe0 con 0x7fa52015eba0 2023-10-25T16:25:20.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.770+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5201598f0 con 0x7fa52015eba0 2023-10-25T16:25:20.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.770+0000 7fa515ffb640 1 -- 172.21.15.177:0/3770406996 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa51801d0a0 con 0x7fa52015eba0 2023-10-25T16:25:20.770 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:25:20.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa504066470 msgr2=0x7fa504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa504066470 0x7fa504068930 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa5201552e0 tx=0x7fa510008040 comp rx=0 tx=0).stop 2023-10-25T16:25:20.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 msgr2=0x7fa520157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 0x7fa520157570 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fa51800cce0 tx=0x7fa51800a620 comp rx=0 tx=0).stop 2023-10-25T16:25:20.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 shutdown_connections 2023-10-25T16:25:20.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa504066470 0x7fa504068930 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa52015eba0 0x7fa520157570 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa5200cdb10 0x7fa520150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 --2- 172.21.15.177:0/3770406996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5200b2120 0x7fa520159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 >> 172.21.15.177:0/3770406996 conn(0x7fa52009a5c0 msgr2=0x7fa520158360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:20.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 shutdown_connections 2023-10-25T16:25:20.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.774+0000 7fa5279e9640 1 -- 172.21.15.177:0/3770406996 wait complete. 2023-10-25T16:25:20.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:25:20.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 -- 172.21.15.177:0/3492194490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe52015b4c0 msgr2=0x7fe5200d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 --2- 172.21.15.177:0/3492194490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe52015b4c0 0x7fe5200d0f20 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fe5200b3dc0 tx=0x7fe51c01c5b0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 -- 172.21.15.177:0/3492194490 shutdown_connections 2023-10-25T16:25:20.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 --2- 172.21.15.177:0/3492194490 >> v2:172.21.15.184:3300/0 conn(0x7fe5200ccf40 0x7fe5200cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 --2- 172.21.15.177:0/3492194490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe5200d1460 0x7fe5200cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 --2- 172.21.15.177:0/3492194490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe52015b4c0 0x7fe5200d0f20 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 -- 172.21.15.177:0/3492194490 >> 172.21.15.177:0/3492194490 conn(0x7fe52008acb0 msgr2=0x7fe52009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:20.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 -- 172.21.15.177:0/3492194490 shutdown_connections 2023-10-25T16:25:20.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 -- 172.21.15.177:0/3492194490 wait complete. 2023-10-25T16:25:20.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 Processor -- start 2023-10-25T16:25:20.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.918+0000 7fe52808c640 1 -- start start 2023-10-25T16:25:20.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200ccf40 0x7fe5200b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 0x7fe5200b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe52015b4c0 0x7fe5200b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b6a30 con 0x7fe5200d1460 2023-10-25T16:25:20.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b10c0 con 0x7fe5200ccf40 2023-10-25T16:25:20.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b32d0 con 0x7fe52015b4c0 2023-10-25T16:25:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 0x7fe5200b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 0x7fe5200b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58888/0 (socket says 172.21.15.177:58888) 2023-10-25T16:25:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 -- 172.21.15.177:0/1491394303 learned_addr learned my addr 172.21.15.177:0/1491394303 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525e28640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200ccf40 0x7fe5200b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe526629640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe52015b4c0 0x7fe5200b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 -- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe52015b4c0 msgr2=0x7fe5200b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe52015b4c0 0x7fe5200b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 -- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200ccf40 msgr2=0x7fe5200b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200ccf40 0x7fe5200b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:20.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 -- 172.21.15.177:0/1491394303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c009560 con 0x7fe5200d1460 2023-10-25T16:25:20.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe526629640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe52015b4c0 0x7fe5200b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:20.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525627640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 0x7fe5200b2d90 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fe51000d980 tx=0x7fe51000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510009c30 con 0x7fe5200d1460 2023-10-25T16:25:20.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe510005020 con 0x7fe5200d1460 2023-10-25T16:25:20.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5200b6c60 con 0x7fe5200d1460 2023-10-25T16:25:20.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510005430 con 0x7fe5200d1460 2023-10-25T16:25:20.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5200b0a70 con 0x7fe5200d1460 2023-10-25T16:25:20.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52009f240 con 0x7fe5200d1460 2023-10-25T16:25:20.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe5100047b0 con 0x7fe5200d1460 2023-10-25T16:25:20.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe5167fc640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe504066470 0x7fe504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:20.926 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe510083fe0 con 0x7fe5200d1460 2023-10-25T16:25:20.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525e28640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe504066470 0x7fe504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:20.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.922+0000 7fe525e28640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe504066470 0x7fe504068930 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe51c0af000 tx=0x7fe51c01adf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:20.927 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:20.926+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5100514f0 con 0x7fe5200d1460 2023-10-25T16:25:21.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5200b0850 con 0x7fe5200d1460 2023-10-25T16:25:21.082 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe5167fc640 1 -- 172.21.15.177:0/1491394303 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5100170a0 con 0x7fe5200d1460 2023-10-25T16:25:21.083 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:25:21.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe504066470 msgr2=0x7fe504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe504066470 0x7fe504068930 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe51c0af000 tx=0x7fe51c01adf0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 msgr2=0x7fe5200b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 0x7fe5200b2d90 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fe51000d980 tx=0x7fe51000de40 comp rx=0 tx=0).stop 2023-10-25T16:25:21.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 shutdown_connections 2023-10-25T16:25:21.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe504066470 0x7fe504068930 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe52015b4c0 0x7fe5200b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.086 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5200d1460 0x7fe5200b2d90 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 --2- 172.21.15.177:0/1491394303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5200ccf40 0x7fe5200b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 >> 172.21.15.177:0/1491394303 conn(0x7fe52008acb0 msgr2=0x7fe5200caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:21.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 shutdown_connections 2023-10-25T16:25:21.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.086+0000 7fe52808c640 1 -- 172.21.15.177:0/1491394303 wait complete. 2023-10-25T16:25:21.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:25:21.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- 172.21.15.177:0/1108835532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43780c9e50 msgr2=0x7f437806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 --2- 172.21.15.177:0/1108835532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43780c9e50 0x7f437806b9e0 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f43600098f0 tx=0x7f436001c850 comp rx=0 tx=0).stop 2023-10-25T16:25:21.216 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- 172.21.15.177:0/1108835532 shutdown_connections 2023-10-25T16:25:21.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 --2- 172.21.15.177:0/1108835532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43780c9e50 0x7f437806b9e0 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 --2- 172.21.15.177:0/1108835532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43781500f0 0x7f43780c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- 172.21.15.177:0/1108835532 >> 172.21.15.177:0/1108835532 conn(0x7f43780b2450 msgr2=0x7f43780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:21.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- 172.21.15.177:0/1108835532 shutdown_connections 2023-10-25T16:25:21.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- 172.21.15.177:0/1108835532 wait complete. 2023-10-25T16:25:21.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 Processor -- start 2023-10-25T16:25:21.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- start start 2023-10-25T16:25:21.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f437806bf20 0x7f437814b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780c9e50 0x7f4378149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 0x7f43780acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43781489a0 con 0x7f43781500f0 2023-10-25T16:25:21.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4378149800 con 0x7f437806bf20 2023-10-25T16:25:21.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437c838640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4378151ba0 con 0x7f43780c9e50 2023-10-25T16:25:21.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f4376d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 0x7f43780acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f4376d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 0x7f43780acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58906/0 (socket says 172.21.15.177:58906) 2023-10-25T16:25:21.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f4376d9d640 1 -- 172.21.15.177:0/3474012599 learned_addr learned my addr 172.21.15.177:0/3474012599 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:21.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f437659c640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f437806bf20 0x7f437814b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.218+0000 7f4375d9b640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780c9e50 0x7f4378149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f4376d9d640 1 -- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780c9e50 msgr2=0x7f4378149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f4376d9d640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780c9e50 0x7f4378149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f4376d9d640 1 -- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f437806bf20 msgr2=0x7f437814b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f4376d9d640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f437806bf20 0x7f437814b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f4376d9d640 1 -- 172.21.15.177:0/3474012599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360009500 con 0x7f43781500f0 2023-10-25T16:25:21.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f4376d9d640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 0x7f43780acb10 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f437000b9a0 tx=0x7f437000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:21.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000cba0 con 0x7f43781500f0 2023-10-25T16:25:21.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437814b920 con 0x7f43781500f0 2023-10-25T16:25:21.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f437000cdf0 con 0x7f43781500f0 2023-10-25T16:25:21.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43700146a0 con 0x7f43781500f0 2023-10-25T16:25:21.224 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43781491b0 con 0x7f43781500f0 2023-10-25T16:25:21.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43780cc1d0 con 0x7f43781500f0 2023-10-25T16:25:21.225 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f437001e440 con 0x7f43781500f0 2023-10-25T16:25:21.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f436effd640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4358066470 0x7f4358068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4370083fd0 con 0x7f43781500f0 2023-10-25T16:25:21.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f437659c640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4358066470 0x7f4358068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.226 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.222+0000 7f437659c640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4358066470 0x7f4358068930 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4368005fd0 tx=0x7f4368005db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:21.227 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.226+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43700513d0 con 0x7f43781500f0 2023-10-25T16:25:21.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f437804daf0 con 0x7f43781500f0 2023-10-25T16:25:21.391 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f436effd640 1 -- 172.21.15.177:0/3474012599 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v193) v1 ==== 80+0+0 (secure 0 0 0) 0x7f43700549f0 con 0x7f43781500f0 2023-10-25T16:25:21.392 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:25:21.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4358066470 msgr2=0x7f4358068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4358066470 0x7f4358068930 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4368005fd0 tx=0x7f4368005db0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 msgr2=0x7f43780acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 0x7f43780acb10 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f437000b9a0 tx=0x7f437000be60 comp rx=0 tx=0).stop 2023-10-25T16:25:21.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 shutdown_connections 2023-10-25T16:25:21.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4358066470 0x7f4358068930 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43781500f0 0x7f43780acb10 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.395 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43780c9e50 0x7f4378149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 --2- 172.21.15.177:0/3474012599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f437806bf20 0x7f437814b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 >> 172.21.15.177:0/3474012599 conn(0x7f43780b2450 msgr2=0x7f43780cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:21.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 shutdown_connections 2023-10-25T16:25:21.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.394+0000 7f437c838640 1 -- 172.21.15.177:0/3474012599 wait complete. 2023-10-25T16:25:21.410 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-25T16:25:21.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:25:21.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-25T16:25:21.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:25:21.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:ceph-fuse[55533]: fuse finished with error 0 and tester_r 0 2023-10-25T16:25:21.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:25:21.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:25:21.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:21.467 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T16:25:21.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi177.stderr:2023-10-25T16:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:25:21.536 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:25:21.537 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:21.543 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:25:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 -- 172.21.15.177:0/2319191995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c06beb0 msgr2=0x7f783c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 --2- 172.21.15.177:0/2319191995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c06beb0 0x7f783c070e00 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f7834009bc0 tx=0x7f783401cb10 comp rx=0 tx=0).stop 2023-10-25T16:25:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 -- 172.21.15.177:0/2319191995 shutdown_connections 2023-10-25T16:25:21.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 --2- 172.21.15.177:0/2319191995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c06beb0 0x7f783c070e00 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 -- 172.21.15.177:0/2319191995 >> 172.21.15.177:0/2319191995 conn(0x7f783c0b2450 msgr2=0x7f783c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 -- 172.21.15.177:0/2319191995 shutdown_connections 2023-10-25T16:25:21.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.650+0000 7f7844317640 1 -- 172.21.15.177:0/2319191995 wait complete. 2023-10-25T16:25:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 Processor -- start 2023-10-25T16:25:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- start start 2023-10-25T16:25:21.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f783c06ba00 0x7f783c1424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f783c06beb0 0x7f783c151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 0x7f783c147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c14ff60 con 0x7f783c1500f0 2023-10-25T16:25:21.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1532c0 con 0x7f783c06ba00 2023-10-25T16:25:21.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1526f0 con 0x7f783c06beb0 2023-10-25T16:25:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 0x7f783c147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 0x7f783c147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58924/0 (socket says 172.21.15.177:58924) 2023-10-25T16:25:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 -- 172.21.15.177:0/697673706 learned_addr learned my addr 172.21.15.177:0/697673706 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 -- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f783c06beb0 msgr2=0x7f783c151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f783c06beb0 0x7f783c151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 -- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f783c06ba00 msgr2=0x7f783c1424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f783c06ba00 0x7f783c1424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 -- 172.21.15.177:0/697673706 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009820 con 0x7f783c1500f0 2023-10-25T16:25:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f78428b4640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 0x7f783c147680 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f7834009b10 tx=0x7f78340a5af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:21.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78340ba070 con 0x7f783c1500f0 2023-10-25T16:25:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7834003b30 con 0x7f783c1500f0 2023-10-25T16:25:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c152990 con 0x7f783c1500f0 2023-10-25T16:25:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834004030 con 0x7f783c1500f0 2023-10-25T16:25:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c152f50 con 0x7f783c1500f0 2023-10-25T16:25:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c0afa20 con 0x7f783c1500f0 2023-10-25T16:25:21.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f78340b4040 con 0x7f783c1500f0 2023-10-25T16:25:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.654+0000 7f783affd640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f781c066470 0x7f781c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.658+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f783411e5d0 con 0x7f783c1500f0 2023-10-25T16:25:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.658+0000 7f78420b3640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f781c066470 0x7f781c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.658+0000 7f78420b3640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f781c066470 0x7f781c068930 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7824007fd0 tx=0x7f7824007920 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.662+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78340eba50 con 0x7f783c1500f0 2023-10-25T16:25:21.806 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.810+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f783c0afa20 con 0x7f783c1500f0 2023-10-25T16:25:21.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.810+0000 7f783affd640 1 -- 172.21.15.177:0/697673706 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+16603 (secure 0 0 0) 0x7f78340b2090 con 0x7f783c1500f0 2023-10-25T16:25:21.810 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:21.810 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":193,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:25:17.832256+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:25:21.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f781c066470 msgr2=0x7f781c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f781c066470 0x7f781c068930 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7824007fd0 tx=0x7f7824007920 comp rx=0 tx=0).stop 2023-10-25T16:25:21.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 msgr2=0x7f783c147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 0x7f783c147680 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f7834009b10 tx=0x7f78340a5af0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 shutdown_connections 2023-10-25T16:25:21.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f781c066470 0x7f781c068930 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c1500f0 0x7f783c147680 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f783c06beb0 0x7f783c151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 --2- 172.21.15.177:0/697673706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f783c06ba00 0x7f783c1424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 >> 172.21.15.177:0/697673706 conn(0x7f783c0b2450 msgr2=0x7f783c15b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 shutdown_connections 2023-10-25T16:25:21.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.814+0000 7f7844317640 1 -- 172.21.15.177:0/697673706 wait complete. 2023-10-25T16:25:21.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:24:40.583783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:24:41.397821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:25:21.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:25:21.954 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/1213113464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 msgr2=0x7feb3c0cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 --2- 172.21.15.177:0/1213113464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c0cb5c0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0ca1f0 tx=0x7feb3401cad0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/1213113464 shutdown_connections 2023-10-25T16:25:21.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 --2- 172.21.15.177:0/1213113464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c0cb5c0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 --2- 172.21.15.177:0/1213113464 >> v2:172.21.15.184:3300/0 conn(0x7feb3c140cf0 0x7feb3c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/1213113464 >> 172.21.15.177:0/1213113464 conn(0x7feb3c0b2450 msgr2=0x7feb3c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:21.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/1213113464 shutdown_connections 2023-10-25T16:25:21.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/1213113464 wait complete. 2023-10-25T16:25:21.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 Processor -- start 2023-10-25T16:25:21.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- start start 2023-10-25T16:25:21.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb3c06f570 0x7feb3c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb3c140cf0 0x7feb3c1622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c158820 con 0x7feb3c06c160 2023-10-25T16:25:21.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c158b00 con 0x7feb3c140cf0 2023-10-25T16:25:21.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c137c80 con 0x7feb3c06f570 2023-10-25T16:25:21.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c137430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58942/0 (socket says 172.21.15.177:58942) 2023-10-25T16:25:21.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 -- 172.21.15.177:0/148707921 learned_addr learned my addr 172.21.15.177:0/148707921 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:21.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb41c4f640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb3c06f570 0x7feb3c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.960 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42c51640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb3c140cf0 0x7feb3c1622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 -- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb3c06f570 msgr2=0x7feb3c156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb3c06f570 0x7feb3c156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 -- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb3c140cf0 msgr2=0x7feb3c1622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:21.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb3c140cf0 0x7feb3c1622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:21.961 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 -- 172.21.15.177:0/148707921 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34009820 con 0x7feb3c06c160 2023-10-25T16:25:21.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb42450640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c137430 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c9f0 tx=0x7feb3800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:21.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38007bb0 con 0x7feb3c06c160 2023-10-25T16:25:21.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb38007e00 con 0x7feb3c06c160 2023-10-25T16:25:21.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c137f60 con 0x7feb3c06c160 2023-10-25T16:25:21.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3800f6b0 con 0x7feb3c06c160 2023-10-25T16:25:21.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.958+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c137970 con 0x7feb3c06c160 2023-10-25T16:25:21.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.962+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c04daf0 con 0x7feb3c06c160 2023-10-25T16:25:21.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.962+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feb3800f810 con 0x7feb3c06c160 2023-10-25T16:25:21.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.962+0000 7feb32ffd640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb200664a0 0x7feb20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:21.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.962+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb38084680 con 0x7feb3c06c160 2023-10-25T16:25:21.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.962+0000 7feb41c4f640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb200664a0 0x7feb20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:21.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.962+0000 7feb41c4f640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb200664a0 0x7feb20068960 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007fd0 tx=0x7feb2c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:21.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:21.966+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb38051b00 con 0x7feb3c06c160 2023-10-25T16:25:22.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.122+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb3c066e30 con 0x7feb3c06c160 2023-10-25T16:25:22.120 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.122+0000 7feb32ffd640 1 -- 172.21.15.177:0/148707921 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb38055120 con 0x7feb3c06c160 2023-10-25T16:25:22.120 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:25:22.122 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb200664a0 msgr2=0x7feb20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb200664a0 0x7feb20068960 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007fd0 tx=0x7feb2c009040 comp rx=0 tx=0).stop 2023-10-25T16:25:22.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 msgr2=0x7feb3c137430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c137430 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c9f0 tx=0x7feb3800ceb0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 shutdown_connections 2023-10-25T16:25:22.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7feb200664a0 0x7feb20068960 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb3c140cf0 0x7feb3c1622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb3c06f570 0x7feb3c156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 --2- 172.21.15.177:0/148707921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb3c06c160 0x7feb3c137430 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 >> 172.21.15.177:0/148707921 conn(0x7feb3c0b2450 msgr2=0x7feb3c161300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:22.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 shutdown_connections 2023-10-25T16:25:22.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.126+0000 7feb446b4640 1 -- 172.21.15.177:0/148707921 wait complete. 2023-10-25T16:25:22.139 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:25:22.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 -- 172.21.15.177:0/3419599941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 msgr2=0x7f39380af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 --2- 172.21.15.177:0/3419599941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f39380af5d0 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f39380b0f60 tx=0x7f393401c7d0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 -- 172.21.15.177:0/3419599941 shutdown_connections 2023-10-25T16:25:22.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 --2- 172.21.15.177:0/3419599941 >> v2:172.21.15.184:3300/0 conn(0x7f393806c160 0x7f39380cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 --2- 172.21.15.177:0/3419599941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f39380af5d0 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 -- 172.21.15.177:0/3419599941 >> 172.21.15.177:0/3419599941 conn(0x7f39380b2450 msgr2=0x7f39380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:22.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 -- 172.21.15.177:0/3419599941 shutdown_connections 2023-10-25T16:25:22.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 -- 172.21.15.177:0/3419599941 wait complete. 2023-10-25T16:25:22.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 Processor -- start 2023-10-25T16:25:22.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.266+0000 7f393f415640 1 -- start start 2023-10-25T16:25:22.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f393806c160 0x7f393813a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f393806f570 0x7f393813e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f3938157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938159c20 con 0x7f3938140cf0 2023-10-25T16:25:22.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393813ec60 con 0x7f393806f570 2023-10-25T16:25:22.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393813eec0 con 0x7f393806c160 2023-10-25T16:25:22.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f3938157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f3938157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58960/0 (socket says 172.21.15.177:58960) 2023-10-25T16:25:22.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 -- 172.21.15.177:0/4145944068 learned_addr learned my addr 172.21.15.177:0/4145944068 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:22.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 -- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f393806c160 msgr2=0x7f393813a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d1b1640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f393806c160 0x7f393813a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f393806c160 0x7f393813a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 -- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f393806f570 msgr2=0x7f393813e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393c9b0640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f393806f570 0x7f393813e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f393806f570 0x7f393813e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 -- 172.21.15.177:0/4145944068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009560 con 0x7f3938140cf0 2023-10-25T16:25:22.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d9b2640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f3938157a40 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f393000b9e0 tx=0x7f393000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:22.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cb20 con 0x7f3938140cf0 2023-10-25T16:25:22.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f393000cd70 con 0x7f3938140cf0 2023-10-25T16:25:22.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393813f1a0 con 0x7f3938140cf0 2023-10-25T16:25:22.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39300146a0 con 0x7f3938140cf0 2023-10-25T16:25:22.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39381598b0 con 0x7f3938140cf0 2023-10-25T16:25:22.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39380c9780 con 0x7f3938140cf0 2023-10-25T16:25:22.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f393001d3b0 con 0x7f3938140cf0 2023-10-25T16:25:22.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f392dffb640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f391c066470 0x7f391c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3930084040 con 0x7f3938140cf0 2023-10-25T16:25:22.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.270+0000 7f393d1b1640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f391c066470 0x7f391c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.274+0000 7f393d1b1640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f391c066470 0x7f391c068930 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f39340ae000 tx=0x7f393401b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:22.275 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.274+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39300514c0 con 0x7f3938140cf0 2023-10-25T16:25:22.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.418+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f393804daf0 con 0x7f3938140cf0 2023-10-25T16:25:22.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.418+0000 7f392dffb640 1 -- 172.21.15.177:0/4145944068 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3930019020 con 0x7f3938140cf0 2023-10-25T16:25:22.415 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:25:22.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f391c066470 msgr2=0x7f391c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f391c066470 0x7f391c068930 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f39340ae000 tx=0x7f393401b010 comp rx=0 tx=0).stop 2023-10-25T16:25:22.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 msgr2=0x7f3938157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f3938157a40 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f393000b9e0 tx=0x7f393000bea0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 shutdown_connections 2023-10-25T16:25:22.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f391c066470 0x7f391c068930 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3938140cf0 0x7f3938157a40 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f393806f570 0x7f393813e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 --2- 172.21.15.177:0/4145944068 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f393806c160 0x7f393813a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 >> 172.21.15.177:0/4145944068 conn(0x7f39380b2450 msgr2=0x7f39380cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:22.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 shutdown_connections 2023-10-25T16:25:22.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.422+0000 7f393f415640 1 -- 172.21.15.177:0/4145944068 wait complete. 2023-10-25T16:25:22.434 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:25:22.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 -- 172.21.15.177:0/300584961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d81584e0 msgr2=0x7f12d80b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 --2- 172.21.15.177:0/300584961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d81584e0 0x7f12d80b1280 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009bc0 tx=0x7f12d001cb40 comp rx=0 tx=0).stop 2023-10-25T16:25:22.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 -- 172.21.15.177:0/300584961 shutdown_connections 2023-10-25T16:25:22.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 --2- 172.21.15.177:0/300584961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d81584e0 0x7f12d80b1280 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 -- 172.21.15.177:0/300584961 >> 172.21.15.177:0/300584961 conn(0x7f12d80aee60 msgr2=0x7f12d80af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 -- 172.21.15.177:0/300584961 shutdown_connections 2023-10-25T16:25:22.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 -- 172.21.15.177:0/300584961 wait complete. 2023-10-25T16:25:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 Processor -- start 2023-10-25T16:25:22.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.558+0000 7f12dc87d640 1 -- start start 2023-10-25T16:25:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12d8072090 0x7f12d80952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 0x7f12d814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d81584e0 0x7f12d8149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80969b0 con 0x7f12d8158100 2023-10-25T16:25:22.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8095830 con 0x7f12d81584e0 2023-10-25T16:25:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8095da0 con 0x7f12d8072090 2023-10-25T16:25:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 0x7f12d814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 0x7f12d814a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:58980/0 (socket says 172.21.15.177:58980) 2023-10-25T16:25:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 -- 172.21.15.177:0/3323834769 learned_addr learned my addr 172.21.15.177:0/3323834769 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:22.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12d659c640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12d8072090 0x7f12d80952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12d6d9d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d81584e0 0x7f12d8149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 -- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12d8072090 msgr2=0x7f12d80952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12d8072090 0x7f12d80952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 -- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d81584e0 msgr2=0x7f12d8149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d81584e0 0x7f12d8149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 -- 172.21.15.177:0/3323834769 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d0009820 con 0x7f12d8158100 2023-10-25T16:25:22.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12d659c640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12d8072090 0x7f12d80952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:22.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12cffff640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 0x7f12d814a1e0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f12c800c3a0 tx=0x7f12c800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:22.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8011790 con 0x7f12d8158100 2023-10-25T16:25:22.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f12c8011a00 con 0x7f12d8158100 2023-10-25T16:25:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d8096080 con 0x7f12d8158100 2023-10-25T16:25:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8011e10 con 0x7f12d8158100 2023-10-25T16:25:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d8096640 con 0x7f12d8158100 2023-10-25T16:25:22.564 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d804daf0 con 0x7f12d8158100 2023-10-25T16:25:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f12c801c460 con 0x7f12d8158100 2023-10-25T16:25:22.565 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12ceffd640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f12b8066470 0x7f12b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c8083f40 con 0x7f12d8158100 2023-10-25T16:25:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12d659c640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f12b8066470 0x7f12b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.562+0000 7f12d659c640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f12b8066470 0x7f12b8068930 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f12c0003e40 tx=0x7f12c0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:22.566 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.566+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12c80513c0 con 0x7f12d8158100 2023-10-25T16:25:22.720 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.722+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12d8066a90 con 0x7f12d8158100 2023-10-25T16:25:22.721 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.722+0000 7f12ceffd640 1 -- 172.21.15.177:0/3323834769 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12c80549e0 con 0x7f12d8158100 2023-10-25T16:25:22.721 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:25:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f12b8066470 msgr2=0x7f12b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f12b8066470 0x7f12b8068930 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f12c0003e40 tx=0x7f12c0009040 comp rx=0 tx=0).stop 2023-10-25T16:25:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 msgr2=0x7f12d814a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 0x7f12d814a1e0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f12c800c3a0 tx=0x7f12c800c860 comp rx=0 tx=0).stop 2023-10-25T16:25:22.724 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 shutdown_connections 2023-10-25T16:25:22.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f12b8066470 0x7f12b8068930 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f12d81584e0 0x7f12d8149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12d8158100 0x7f12d814a1e0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 --2- 172.21.15.177:0/3323834769 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f12d8072090 0x7f12d80952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.725 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 >> 172.21.15.177:0/3323834769 conn(0x7f12d80aee60 msgr2=0x7f12d80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:22.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 shutdown_connections 2023-10-25T16:25:22.726 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.726+0000 7f12dc87d640 1 -- 172.21.15.177:0/3323834769 wait complete. 2023-10-25T16:25:22.741 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T16:25:22.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/3398827985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 msgr2=0x7f26780cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 --2- 172.21.15.177:0/3398827985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26780cdfc0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f2670009c80 tx=0x7f267001ccb0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/3398827985 shutdown_connections 2023-10-25T16:25:22.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 --2- 172.21.15.177:0/3398827985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26780cdfc0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 --2- 172.21.15.177:0/3398827985 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26780b2120 0x7f26780b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/3398827985 >> 172.21.15.177:0/3398827985 conn(0x7f267809a5c0 msgr2=0x7f26780d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:22.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/3398827985 shutdown_connections 2023-10-25T16:25:22.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/3398827985 wait complete. 2023-10-25T16:25:22.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 Processor -- start 2023-10-25T16:25:22.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- start start 2023-10-25T16:25:22.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26780b2120 0x7f2678151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26781563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f267815eba0 0x7f2678156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267806aff0 con 0x7f26780cdb10 2023-10-25T16:25:22.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26781589a0 con 0x7f26780b2120 2023-10-25T16:25:22.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26780cb390 con 0x7f267815eba0 2023-10-25T16:25:22.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26781563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26781563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59002/0 (socket says 172.21.15.177:59002) 2023-10-25T16:25:22.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 -- 172.21.15.177:0/290699147 learned_addr learned my addr 172.21.15.177:0/290699147 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:22.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267c812640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26780b2120 0x7f2678151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267d013640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f267815eba0 0x7f2678156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 -- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f267815eba0 msgr2=0x7f2678156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f267815eba0 0x7f2678156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 -- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26780b2120 msgr2=0x7f2678151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:22.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26780b2120 0x7f2678151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:22.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 -- 172.21.15.177:0/290699147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700098e0 con 0x7f26780cdb10 2023-10-25T16:25:22.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f2677fff640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26781563d0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f266400d980 tx=0x7f266400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:22.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664009c30 con 0x7f26780cdb10 2023-10-25T16:25:22.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2664005020 con 0x7f26780cdb10 2023-10-25T16:25:22.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267806b240 con 0x7f26780cdb10 2023-10-25T16:25:22.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664005430 con 0x7f26780cdb10 2023-10-25T16:25:22.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.866+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26781520a0 con 0x7f26780cdb10 2023-10-25T16:25:22.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267804daf0 con 0x7f26780cdb10 2023-10-25T16:25:22.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f26640047b0 con 0x7f26780cdb10 2023-10-25T16:25:22.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f26757fa640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f265c066470 0x7f265c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:22.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26640840a0 con 0x7f26780cdb10 2023-10-25T16:25:22.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f265c06dfa0 con 0x7f26780cdb10 2023-10-25T16:25:22.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f267c812640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f265c066470 0x7f265c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:22.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.870+0000 7f267c812640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f265c066470 0x7f265c068930 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f266c00b810 tx=0x7f266c008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:22.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:22.874+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2664017060 con 0x7f26780cdb10 2023-10-25T16:25:23.038 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f267808b370 con 0x7f26780cdb10 2023-10-25T16:25:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f26757fa640 1 -- 172.21.15.177:0/290699147 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v194) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2664020070 con 0x7f26780cdb10 2023-10-25T16:25:23.039 INFO:teuthology.orchestra.run.smithi177.stderr:listed 0 entries 2023-10-25T16:25:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f265c066470 msgr2=0x7f265c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f265c066470 0x7f265c068930 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f266c00b810 tx=0x7f266c008040 comp rx=0 tx=0).stop 2023-10-25T16:25:23.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 msgr2=0x7f26781563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26781563d0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f266400d980 tx=0x7f266400de40 comp rx=0 tx=0).stop 2023-10-25T16:25:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 shutdown_connections 2023-10-25T16:25:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f265c066470 0x7f265c068930 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.042 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f267815eba0 0x7f2678156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f26780cdb10 0x7f26781563d0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 --2- 172.21.15.177:0/290699147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26780b2120 0x7f2678151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 >> 172.21.15.177:0/290699147 conn(0x7f267809a5c0 msgr2=0x7f267815b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 shutdown_connections 2023-10-25T16:25:23.043 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.042+0000 7f267ea76640 1 -- 172.21.15.177:0/290699147 wait complete. 2023-10-25T16:25:23.058 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi184.front.sepia.ceph.com... 2023-10-25T16:25:23.058 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-25T16:25:23.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-25T16:25:23.114 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:25:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-10-25T16:25:23.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[35716]: fuse finished with error 0 and tester_r 0 2023-10-25T16:25:23.115 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-25T16:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:25:23.121 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2023-10-25T16:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-25T16:25:23.123 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:25:23.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:23.124 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-25T16:25:23.131 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:25:23.131 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:23.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:25:23.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:25:23.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:23.139 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-25T16:25:23.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:25:23.189 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-25T16:25:23.189 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:25:23.190 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:23.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:25:23.196 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:25:23.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:23.197 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-25T16:25:23.241 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-25T16:25:23.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:25:23.243 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/2252963988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f908015cdd0 msgr2=0x7f908015a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 --2- 172.21.15.177:0/2252963988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f908015cdd0 0x7f908015a260 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f9070005fd0 tx=0x7f907001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/2252963988 shutdown_connections 2023-10-25T16:25:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 --2- 172.21.15.177:0/2252963988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f908015cdd0 0x7f908015a260 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 --2- 172.21.15.177:0/2252963988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90801537d0 0x7f90800caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/2252963988 >> 172.21.15.177:0/2252963988 conn(0x7f90800b2450 msgr2=0x7f90800b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/2252963988 shutdown_connections 2023-10-25T16:25:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/2252963988 wait complete. 2023-10-25T16:25:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 Processor -- start 2023-10-25T16:25:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- start start 2023-10-25T16:25:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908006b9e0 0x7f908013c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.378 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 0x7f9080150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f908015cdd0 0x7f908014b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908013ce60 con 0x7f90801537d0 2023-10-25T16:25:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800ad860 con 0x7f908006b9e0 2023-10-25T16:25:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90801f5c60 con 0x7f908015cdd0 2023-10-25T16:25:23.379 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 0x7f9080150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 0x7f9080150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59022/0 (socket says 172.21.15.177:59022) 2023-10-25T16:25:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 -- 172.21.15.177:0/1053327325 learned_addr learned my addr 172.21.15.177:0/1053327325 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9085920640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908006b9e0 0x7f908013c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 -- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f908015cdd0 msgr2=0x7f908014b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9086121640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f908015cdd0 0x7f908014b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f908015cdd0 0x7f908014b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 -- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908006b9e0 msgr2=0x7f908013c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908006b9e0 0x7f908013c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 -- 172.21.15.177:0/1053327325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009450 con 0x7f90801537d0 2023-10-25T16:25:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9085920640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908006b9e0 0x7f908013c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f908511f640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 0x7f9080150d20 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f907001a400 tx=0x7f9070005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700bc070 con 0x7f90801537d0 2023-10-25T16:25:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90700041e0 con 0x7f90801537d0 2023-10-25T16:25:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90801f5980 con 0x7f90801537d0 2023-10-25T16:25:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700048d0 con 0x7f90801537d0 2023-10-25T16:25:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.378+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800add70 con 0x7f90801537d0 2023-10-25T16:25:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908004daf0 con 0x7f90801537d0 2023-10-25T16:25:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9070004a30 con 0x7f90801537d0 2023-10-25T16:25:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f90767fc640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f907011eb20 con 0x7f90801537d0 2023-10-25T16:25:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f906406dfa0 con 0x7f90801537d0 2023-10-25T16:25:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f9085920640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.382+0000 7f9085920640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f907c005fd0 tx=0x7f907c005da0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:23.385 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.386+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90700ec0a0 con 0x7f90801537d0 2023-10-25T16:25:23.556 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.558+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90800cd990 con 0x7f90801537d0 2023-10-25T16:25:23.557 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.558+0000 7f90767fc640 1 -- 172.21.15.177:0/1053327325 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f90700ef6c0 con 0x7f90801537d0 2023-10-25T16:25:23.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:23.557 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:25:23.558 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:25:23.559 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 msgr2=0x7f9064068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f907c005fd0 tx=0x7f907c005da0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 msgr2=0x7f9080150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 0x7f9080150d20 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f907001a400 tx=0x7f9070005780 comp rx=0 tx=0).stop 2023-10-25T16:25:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 shutdown_connections 2023-10-25T16:25:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f9064066470 0x7f9064068930 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f908015cdd0 0x7f908014b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90801537d0 0x7f9080150d20 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 --2- 172.21.15.177:0/1053327325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f908006b9e0 0x7f908013c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 >> 172.21.15.177:0/1053327325 conn(0x7f90800b2450 msgr2=0x7f908014c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 shutdown_connections 2023-10-25T16:25:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.562+0000 7f9087b84640 1 -- 172.21.15.177:0/1053327325 wait complete. 2023-10-25T16:25:23.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:25:23.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/1630466600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb78015eba0 msgr2=0x7fb7800b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 --2- 172.21.15.177:0/1630466600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb78015eba0 0x7fb7800b4100 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009900 tx=0x7fb77c01c830 comp rx=0 tx=0).stop 2023-10-25T16:25:23.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/1630466600 shutdown_connections 2023-10-25T16:25:23.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 --2- 172.21.15.177:0/1630466600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7800b2120 0x7fb7800d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.699 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 --2- 172.21.15.177:0/1630466600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb78015eba0 0x7fb7800b4100 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/1630466600 >> 172.21.15.177:0/1630466600 conn(0x7fb78009a5c0 msgr2=0x7fb7800d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:23.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/1630466600 shutdown_connections 2023-10-25T16:25:23.700 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/1630466600 wait complete. 2023-10-25T16:25:23.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 Processor -- start 2023-10-25T16:25:23.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- start start 2023-10-25T16:25:23.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7800b2120 0x7fb78015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7800cdb10 0x7fb7800c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 0x7fb78013f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800c8ce0 con 0x7fb78015eba0 2023-10-25T16:25:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78015d2c0 con 0x7fb7800b2120 2023-10-25T16:25:23.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78015d5a0 con 0x7fb7800cdb10 2023-10-25T16:25:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 0x7fb78013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 0x7fb78013f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59036/0 (socket says 172.21.15.177:59036) 2023-10-25T16:25:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 -- 172.21.15.177:0/2335621320 learned_addr learned my addr 172.21.15.177:0/2335621320 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:23.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb785d07640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7800b2120 0x7fb78015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb785506640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7800cdb10 0x7fb7800c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 -- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7800cdb10 msgr2=0x7fb7800c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7800cdb10 0x7fb7800c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 -- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7800b2120 msgr2=0x7fb78015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7800b2120 0x7fb78015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.705 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 -- 172.21.15.177:0/2335621320 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700094a0 con 0x7fb78015eba0 2023-10-25T16:25:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb786508640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 0x7fb78013f320 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c770 tx=0x7fb77800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778003b80 con 0x7fb78015eba0 2023-10-25T16:25:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb778003ce0 con 0x7fb78015eba0 2023-10-25T16:25:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c009560 con 0x7fb78015eba0 2023-10-25T16:25:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800aab0 con 0x7fb78015eba0 2023-10-25T16:25:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.702+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78015db60 con 0x7fb78015eba0 2023-10-25T16:25:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78004daf0 con 0x7fb78015eba0 2023-10-25T16:25:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb77800ac10 con 0x7fb78015eba0 2023-10-25T16:25:23.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb7767fc640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7640664a0 0x7fb764068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb778083e10 con 0x7fb78015eba0 2023-10-25T16:25:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fb76406dfd0 con 0x7fb78015eba0 2023-10-25T16:25:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb785d07640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7640664a0 0x7fb764068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.706+0000 7fb785d07640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7640664a0 0x7fb764068960 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0af000 tx=0x7fb77c01b070 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.710+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb778051290 con 0x7fb78015eba0 2023-10-25T16:25:23.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.866+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb78015ade0 con 0x7fb78015eba0 2023-10-25T16:25:23.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb7767fc640 1 -- 172.21.15.177:0/2335621320 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16622 (secure 0 0 0) 0x7fb7780548b0 con 0x7fb78015eba0 2023-10-25T16:25:23.866 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:23.867 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":194,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:25:22.834369+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:25:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7640664a0 msgr2=0x7fb764068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7640664a0 0x7fb764068960 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0af000 tx=0x7fb77c01b070 comp rx=0 tx=0).stop 2023-10-25T16:25:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 msgr2=0x7fb78013f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 0x7fb78013f320 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c770 tx=0x7fb77800cc30 comp rx=0 tx=0).stop 2023-10-25T16:25:23.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 shutdown_connections 2023-10-25T16:25:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb7640664a0 0x7fb764068960 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb78015eba0 0x7fb78013f320 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7800cdb10 0x7fb7800c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 --2- 172.21.15.177:0/2335621320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7800b2120 0x7fb78015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:23.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 >> 172.21.15.177:0/2335621320 conn(0x7fb78009a5c0 msgr2=0x7fb78006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:23.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 shutdown_connections 2023-10-25T16:25:23.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:23.870+0000 7fb787f6b640 1 -- 172.21.15.177:0/2335621320 wait complete. 2023-10-25T16:25:23.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T16:12:56.669215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T16:24:40.583783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T16:24:41.397821+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T16:25:23.887 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T16:25:24.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/2064927970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 msgr2=0x7f4d6c06be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 --2- 172.21.15.177:0/2064927970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c06be90 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0cd910 tx=0x7f4d5401c810 comp rx=0 tx=0).stop 2023-10-25T16:25:24.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/2064927970 shutdown_connections 2023-10-25T16:25:24.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 --2- 172.21.15.177:0/2064927970 >> v2:172.21.15.184:3300/0 conn(0x7f4d6c0706f0 0x7f4d6c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 --2- 172.21.15.177:0/2064927970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c06be90 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/2064927970 >> 172.21.15.177:0/2064927970 conn(0x7f4d6c0b2450 msgr2=0x7f4d6c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/2064927970 shutdown_connections 2023-10-25T16:25:24.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/2064927970 wait complete. 2023-10-25T16:25:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 Processor -- start 2023-10-25T16:25:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- start start 2023-10-25T16:25:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c0aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0706f0 0x7f4d6c141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c1500f0 0x7f4d6c1476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0ac1a0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0ab100 con 0x7f4d6c0706f0 2023-10-25T16:25:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0ab3e0 con 0x7f4d6c1500f0 2023-10-25T16:25:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c0aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c0aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59060/0 (socket says 172.21.15.177:59060) 2023-10-25T16:25:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 -- 172.21.15.177:0/1224442060 learned_addr learned my addr 172.21.15.177:0/1224442060 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 -- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c1500f0 msgr2=0x7f4d6c1476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6b7fe640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c1500f0 0x7f4d6c1476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c1500f0 0x7f4d6c1476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d63fff640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0706f0 0x7f4d6c141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 -- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0706f0 msgr2=0x7f4d6c141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0706f0 0x7f4d6c141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 -- 172.21.15.177:0/1224442060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54009500 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d6affd640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c0aa8b0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c450 tx=0x7f4d5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c012830 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d5c012aa0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c0ab6c0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c011380 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.006+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c0abc80 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c0abe70 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d5c0114e0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d68ff9640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d5c084020 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f4d5006dfa0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d63fff640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.010+0000 7f4d63fff640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d50066470 0x7f4d50068930 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4d540af000 tx=0x7f4d5401b050 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.014+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d5c0514a0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.162+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d6c04daf0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.160 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.162+0000 7f4d68ff9640 1 -- 172.21.15.177:0/1224442060 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d5c054ac0 con 0x7f4d6c06b9e0 2023-10-25T16:25:24.160 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 1 2023-10-25T16:25:24.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.162+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d50066470 msgr2=0x7f4d50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.162+0000 7f4d7181d640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d50066470 0x7f4d50068930 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4d540af000 tx=0x7f4d5401b050 comp rx=0 tx=0).stop 2023-10-25T16:25:24.162 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.162+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 msgr2=0x7f4d6c0aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.162+0000 7f4d7181d640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c0aa8b0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c450 tx=0x7f4d5c00c910 comp rx=0 tx=0).stop 2023-10-25T16:25:24.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 shutdown_connections 2023-10-25T16:25:24.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d6c1500f0 0x7f4d6c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.163 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d6c0706f0 0x7f4d6c141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 --2- 172.21.15.177:0/1224442060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d6c06b9e0 0x7f4d6c0aa8b0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 >> 172.21.15.177:0/1224442060 conn(0x7f4d6c0b2450 msgr2=0x7f4d6c146980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 shutdown_connections 2023-10-25T16:25:24.164 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.166+0000 7f4d7181d640 1 -- 172.21.15.177:0/1224442060 wait complete. 2023-10-25T16:25:24.178 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T16:25:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.294+0000 7fb1922c0640 1 -- 172.21.15.177:0/2199573923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c156e60 msgr2=0x7fb18c0cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.294+0000 7fb1922c0640 1 --2- 172.21.15.177:0/2199573923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c156e60 0x7fb18c0cb7e0 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fb18c15e0d0 tx=0x7fb17c01c5e0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/2199573923 shutdown_connections 2023-10-25T16:25:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 --2- 172.21.15.177:0/2199573923 >> v2:172.21.15.184:3300/0 conn(0x7fb18c0c9dc0 0x7fb18c15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 --2- 172.21.15.177:0/2199573923 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb18c0cbd20 0x7fb18c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 --2- 172.21.15.177:0/2199573923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c156e60 0x7fb18c0cb7e0 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/2199573923 >> 172.21.15.177:0/2199573923 conn(0x7fb18c0b0de0 msgr2=0x7fb18c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/2199573923 shutdown_connections 2023-10-25T16:25:24.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/2199573923 wait complete. 2023-10-25T16:25:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 Processor -- start 2023-10-25T16:25:24.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- start start 2023-10-25T16:25:24.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb18c0c9dc0 0x7fb18c148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 0x7fb18c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb18c156e60 0x7fb18c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c148e40 con 0x7fb18c0cbd20 2023-10-25T16:25:24.300 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0b24f0 con 0x7fb18c156e60 2023-10-25T16:25:24.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0ce060 con 0x7fb18c0c9dc0 2023-10-25T16:25:24.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 0x7fb18c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 0x7fb18c0cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59076/0 (socket says 172.21.15.177:59076) 2023-10-25T16:25:24.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 -- 172.21.15.177:0/1054352092 learned_addr learned my addr 172.21.15.177:0/1054352092 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:24.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb18bfff640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb18c0c9dc0 0x7fb18c148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 -- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb18c0c9dc0 msgr2=0x7fb18c148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb18c0c9dc0 0x7fb18c148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 -- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb18c156e60 msgr2=0x7fb18c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb19085d640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb18c156e60 0x7fb18c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb18c156e60 0x7fb18c0b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 -- 172.21.15.177:0/1054352092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009560 con 0x7fb18c0cbd20 2023-10-25T16:25:24.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb183fff640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 0x7fb18c0cf100 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fb17400d950 tx=0x7fb17400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174009c30 con 0x7fb18c0cbd20 2023-10-25T16:25:24.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb174009e80 con 0x7fb18c0cbd20 2023-10-25T16:25:24.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c0ce340 con 0x7fb18c0cbd20 2023-10-25T16:25:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740106c0 con 0x7fb18c0cbd20 2023-10-25T16:25:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0ce900 con 0x7fb18c0cbd20 2023-10-25T16:25:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.298+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c04daf0 con 0x7fb18c0cbd20 2023-10-25T16:25:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.302+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb174010820 con 0x7fb18c0cbd20 2023-10-25T16:25:24.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.302+0000 7fb1897fa640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb16c0664a0 0x7fb16c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.302+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb174084200 con 0x7fb18c0cbd20 2023-10-25T16:25:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.302+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fb16c06dfd0 con 0x7fb18c0cbd20 2023-10-25T16:25:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.302+0000 7fb18bfff640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb16c0664a0 0x7fb16c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.302+0000 7fb18bfff640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb16c0664a0 0x7fb16c068960 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0af000 tx=0x7fb17c01ae20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.306+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb174020060 con 0x7fb18c0cbd20 2023-10-25T16:25:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb18c0af920 con 0x7fb18c0cbd20 2023-10-25T16:25:24.443 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1897fa640 1 -- 172.21.15.177:0/1054352092 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v194) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1740170a0 con 0x7fb18c0cbd20 2023-10-25T16:25:24.444 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 32 2023-10-25T16:25:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb16c0664a0 msgr2=0x7fb16c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb16c0664a0 0x7fb16c068960 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0af000 tx=0x7fb17c01ae20 comp rx=0 tx=0).stop 2023-10-25T16:25:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 msgr2=0x7fb18c0cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 0x7fb18c0cf100 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fb17400d950 tx=0x7fb17400de10 comp rx=0 tx=0).stop 2023-10-25T16:25:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 shutdown_connections 2023-10-25T16:25:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb16c0664a0 0x7fb16c068960 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb18c156e60 0x7fb18c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0cbd20 0x7fb18c0cf100 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 --2- 172.21.15.177:0/1054352092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb18c0c9dc0 0x7fb18c148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.446+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 >> 172.21.15.177:0/1054352092 conn(0x7fb18c0b0de0 msgr2=0x7fb18c0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.450+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 shutdown_connections 2023-10-25T16:25:24.449 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.450+0000 7fb1922c0640 1 -- 172.21.15.177:0/1054352092 wait complete. 2023-10-25T16:25:24.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T16:25:24.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.578+0000 7f6ee640b640 1 -- 172.21.15.177:0/3344183547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00cdb10 msgr2=0x7f6ee00cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.578 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.578+0000 7f6ee640b640 1 --2- 172.21.15.177:0/3344183547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00cdb10 0x7f6ee00cdfc0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00b3ea0 tx=0x7f6ed801ccd0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.578+0000 7f6ee640b640 1 -- 172.21.15.177:0/3344183547 shutdown_connections 2023-10-25T16:25:24.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.578+0000 7f6ee640b640 1 --2- 172.21.15.177:0/3344183547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00cdb10 0x7f6ee00cdfc0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 --2- 172.21.15.177:0/3344183547 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee00b2120 0x7f6ee00d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 --2- 172.21.15.177:0/3344183547 >> v2:172.21.15.184:3300/0 conn(0x7f6ee015eba0 0x7f6ee00b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- 172.21.15.177:0/3344183547 >> 172.21.15.177:0/3344183547 conn(0x7f6ee009a5c0 msgr2=0x7f6ee00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.579 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- 172.21.15.177:0/3344183547 shutdown_connections 2023-10-25T16:25:24.580 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- 172.21.15.177:0/3344183547 wait complete. 2023-10-25T16:25:24.582 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 Processor -- start 2023-10-25T16:25:24.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- start start 2023-10-25T16:25:24.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 0x7f6ee00c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee00cdb10 0x7f6ee015a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee015eba0 0x7f6ee0151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.583 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00c8380 con 0x7f6ee00b2120 2023-10-25T16:25:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0140a70 con 0x7f6ee015eba0 2023-10-25T16:25:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00c88b0 con 0x7f6ee00cdb10 2023-10-25T16:25:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 0x7f6ee00c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 0x7f6ee00c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59104/0 (socket says 172.21.15.177:59104) 2023-10-25T16:25:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 -- 172.21.15.177:0/999484988 learned_addr learned my addr 172.21.15.177:0/999484988 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ed77fe640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee00cdb10 0x7f6ee015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee49a8640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee015eba0 0x7f6ee0151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 -- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee00cdb10 msgr2=0x7f6ee015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee00cdb10 0x7f6ee015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 -- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee015eba0 msgr2=0x7f6ee0151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee015eba0 0x7f6ee0151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 -- 172.21.15.177:0/999484988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80098e0 con 0x7f6ee00b2120 2023-10-25T16:25:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edffff640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 0x7f6ee00c7860 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c940 tx=0x7f6ed000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0004220 con 0x7f6ee00b2120 2023-10-25T16:25:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ed0004470 con 0x7f6ee00b2120 2023-10-25T16:25:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee00c85d0 con 0x7f6ee00b2120 2023-10-25T16:25:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0007bf0 con 0x7f6ee00b2120 2023-10-25T16:25:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.582+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee00c9d50 con 0x7f6ee00b2120 2023-10-25T16:25:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee01408d0 con 0x7f6ee00b2120 2023-10-25T16:25:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ed0007d50 con 0x7f6ee00b2120 2023-10-25T16:25:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6edd7fa640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec0066470 0x7f6ec0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ed0084340 con 0x7f6ee00b2120 2023-10-25T16:25:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f6ec006dfa0 con 0x7f6ee00b2120 2023-10-25T16:25:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6ed77fe640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec0066470 0x7f6ec0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.586+0000 7f6ed77fe640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec0066470 0x7f6ec0068930 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00c4ae0 tx=0x7f6ec8005db0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.590+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ed001d020 con 0x7f6ee00b2120 2023-10-25T16:25:24.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ee004daf0 con 0x7f6ee00b2120 2023-10-25T16:25:24.727 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6edd7fa640 1 -- 172.21.15.177:0/999484988 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v194) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ee01408d0 con 0x7f6ee00b2120 2023-10-25T16:25:24.728 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 64 2023-10-25T16:25:24.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec0066470 msgr2=0x7f6ec0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec0066470 0x7f6ec0068930 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00c4ae0 tx=0x7f6ec8005db0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 msgr2=0x7f6ee00c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 0x7f6ee00c7860 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000c940 tx=0x7f6ed000ce00 comp rx=0 tx=0).stop 2023-10-25T16:25:24.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 shutdown_connections 2023-10-25T16:25:24.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6ec0066470 0x7f6ec0068930 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ee015eba0 0x7f6ee0151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ee00cdb10 0x7f6ee015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 --2- 172.21.15.177:0/999484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ee00b2120 0x7f6ee00c7860 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.730+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 >> 172.21.15.177:0/999484988 conn(0x7f6ee009a5c0 msgr2=0x7f6ee01567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.734+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 shutdown_connections 2023-10-25T16:25:24.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.734+0000 7f6ee640b640 1 -- 172.21.15.177:0/999484988 wait complete. 2023-10-25T16:25:24.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:24.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fff59640 1 -- 172.21.15.177:0/2900283005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4e4003980 msgr2=0x7ff4e4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2900283005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4e4003980 0x7ff4e4003da0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400bbe0 tx=0x7ff4f401ce60 comp rx=0 tx=0).stop 2023-10-25T16:25:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fe4f6640 1 -- 172.21.15.177:0/2900283005 reap_dead start 2023-10-25T16:25:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fff59640 1 -- 172.21.15.177:0/2900283005 shutdown_connections 2023-10-25T16:25:24.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fff59640 1 -- 172.21.15.177:0/2900283005 >> 172.21.15.177:0/2900283005 conn(0x7ff4f80b0de0 msgr2=0x7ff4f80b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fff59640 1 -- 172.21.15.177:0/2900283005 shutdown_connections 2023-10-25T16:25:24.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.866+0000 7ff4fff59640 1 -- 172.21.15.177:0/2900283005 wait complete. 2023-10-25T16:25:24.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 Processor -- start 2023-10-25T16:25:24.869 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- start start 2023-10-25T16:25:24.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4e4003980 0x7ff4f81f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4f81f3870 0x7ff4f8153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 0x7ff4f80c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8153e50 con 0x7ff4f81539c0 2023-10-25T16:25:24.870 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f62a0 con 0x7ff4e4003980 2023-10-25T16:25:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f6540 con 0x7ff4f81f3870 2023-10-25T16:25:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 0x7ff4f80c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 0x7ff4f80c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59120/0 (socket says 172.21.15.177:59120) 2023-10-25T16:25:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 -- 172.21.15.177:0/2395999762 learned_addr learned my addr 172.21.15.177:0/2395999762 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:24.871 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fdcf5640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4e4003980 0x7ff4f81f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 -- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4f81f3870 msgr2=0x7ff4f8153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fd4f4640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4f81f3870 0x7ff4f8153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4f81f3870 0x7ff4f8153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 -- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4e4003980 msgr2=0x7ff4f81f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:24.872 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4e4003980 0x7ff4f81f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 -- 172.21.15.177:0/2395999762 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f81f6820 con 0x7ff4f81539c0 2023-10-25T16:25:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fdcf5640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4e4003980 0x7ff4f81f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fe4f6640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 0x7ff4f80c8fe0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815e0d0 tx=0x7ff4f000fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0003e50 con 0x7ff4f81539c0 2023-10-25T16:25:24.873 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4f0004c20 con 0x7ff4f81539c0 2023-10-25T16:25:24.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81f6b00 con 0x7ff4f81539c0 2023-10-25T16:25:24.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000d8d0 con 0x7ff4f81539c0 2023-10-25T16:25:24.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f81f7000 con 0x7ff4f81539c0 2023-10-25T16:25:24.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f804daf0 con 0x7ff4f81539c0 2023-10-25T16:25:24.874 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.870+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4f0019070 con 0x7ff4f81539c0 2023-10-25T16:25:24.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.874+0000 7ff4ee7fc640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:24.875 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.874+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4f00844a0 con 0x7ff4f81539c0 2023-10-25T16:25:24.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.874+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7ff4dc06dfa0 con 0x7ff4f81539c0 2023-10-25T16:25:24.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.874+0000 7ff4fdcf5640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:24.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.874+0000 7ff4fdcf5640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40b0000 tx=0x7ff4f4019c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:24.876 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:24.878+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4f00519d0 con 0x7ff4f81539c0 2023-10-25T16:25:25.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.050+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4f8158df0 con 0x7ff4f81539c0 2023-10-25T16:25:25.050 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4ee7fc640 1 -- 172.21.15.177:0/2395999762 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7ff4f0020030 con 0x7ff4f81539c0 2023-10-25T16:25:25.051 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:25.051 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:25:25.051 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:25:25.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 msgr2=0x7ff4dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40b0000 tx=0x7ff4f4019c00 comp rx=0 tx=0).stop 2023-10-25T16:25:25.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 msgr2=0x7ff4f80c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 0x7ff4f80c8fe0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815e0d0 tx=0x7ff4f000fe00 comp rx=0 tx=0).stop 2023-10-25T16:25:25.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 shutdown_connections 2023-10-25T16:25:25.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7ff4dc066470 0x7ff4dc068930 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4f81539c0 0x7ff4f80c8fe0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4f81f3870 0x7ff4f8153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.054 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 --2- 172.21.15.177:0/2395999762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4e4003980 0x7ff4f81f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 >> 172.21.15.177:0/2395999762 conn(0x7ff4f80b0de0 msgr2=0x7ff4f815c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 shutdown_connections 2023-10-25T16:25:25.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.054+0000 7ff4fff59640 1 -- 172.21.15.177:0/2395999762 wait complete. 2023-10-25T16:25:25.069 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:25:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.186+0000 7fdefb024640 1 -- 172.21.15.177:0/1144776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef4153980 msgr2=0x7fdef406cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.186+0000 7fdefb024640 1 --2- 172.21.15.177:0/1144776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef4153980 0x7fdef406cc60 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009bf0 tx=0x7fdeec01cb40 comp rx=0 tx=0).stop 2023-10-25T16:25:25.186 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1144776245 shutdown_connections 2023-10-25T16:25:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 --2- 172.21.15.177:0/1144776245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef4153980 0x7fdef406cc60 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1144776245 >> 172.21.15.177:0/1144776245 conn(0x7fdef40aea20 msgr2=0x7fdef40aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1144776245 shutdown_connections 2023-10-25T16:25:25.187 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1144776245 wait complete. 2023-10-25T16:25:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 Processor -- start 2023-10-25T16:25:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- start start 2023-10-25T16:25:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 0x7fdef4146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef40ac570 0x7fdef414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef4153980 0x7fdef414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4138e20 con 0x7fdef40abc30 2023-10-25T16:25:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef4146950 con 0x7fdef4153980 2023-10-25T16:25:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef41531b0 con 0x7fdef40ac570 2023-10-25T16:25:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 0x7fdef4146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.191 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 0x7fdef4146410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59140/0 (socket says 172.21.15.177:59140) 2023-10-25T16:25:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 -- 172.21.15.177:0/1522182499 learned_addr learned my addr 172.21.15.177:0/1522182499 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa823640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef4153980 0x7fdef414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 -- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef40ac570 msgr2=0x7fdef414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef40ac570 0x7fdef414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.192 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 -- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef4153980 msgr2=0x7fdef414fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef4153980 0x7fdef414fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 -- 172.21.15.177:0/1522182499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec009820 con 0x7fdef40abc30 2023-10-25T16:25:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefa022640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 0x7fdef4146410 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fdef000c430 tx=0x7fdef000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0004230 con 0x7fdef40abc30 2023-10-25T16:25:25.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdef00044a0 con 0x7fdef40abc30 2023-10-25T16:25:25.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0003840 con 0x7fdef40abc30 2023-10-25T16:25:25.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef4152630 con 0x7fdef40abc30 2023-10-25T16:25:25.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef4152bf0 con 0x7fdef40abc30 2023-10-25T16:25:25.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.190+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef4066b20 con 0x7fdef40abc30 2023-10-25T16:25:25.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.194+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdef00039a0 con 0x7fdef40abc30 2023-10-25T16:25:25.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.194+0000 7fdeeaffd640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fded8066470 0x7fded8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.194+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdef0083650 con 0x7fdef40abc30 2023-10-25T16:25:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.194+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fded806dfa0 con 0x7fdef40abc30 2023-10-25T16:25:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.194+0000 7fdef9821640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fded8066470 0x7fded8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.194+0000 7fdef9821640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fded8066470 0x7fded8068930 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdef415b090 tx=0x7fdee40079c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:25.196 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.198+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdef0017060 con 0x7fdef40abc30 2023-10-25T16:25:25.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.350+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdef404da80 con 0x7fdef40abc30 2023-10-25T16:25:25.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdeeaffd640 1 -- 172.21.15.177:0/1522182499 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16622 (secure 0 0 0) 0x7fdef00545f0 con 0x7fdef40abc30 2023-10-25T16:25:25.350 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:25.350 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":194,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:25:22.834369+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:25:25.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fded8066470 msgr2=0x7fded8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fded8066470 0x7fded8068930 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fdef415b090 tx=0x7fdee40079c0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 msgr2=0x7fdef4146410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 0x7fdef4146410 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fdef000c430 tx=0x7fdef000c8f0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 shutdown_connections 2023-10-25T16:25:25.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fded8066470 0x7fded8068930 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdef4153980 0x7fdef414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdef40ac570 0x7fdef414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 --2- 172.21.15.177:0/1522182499 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdef40abc30 0x7fdef4146410 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 >> 172.21.15.177:0/1522182499 conn(0x7fdef40aea20 msgr2=0x7fdef40aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 shutdown_connections 2023-10-25T16:25:25.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.354+0000 7fdefb024640 1 -- 172.21.15.177:0/1522182499 wait complete. 2023-10-25T16:25:25.370 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:25:25.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:25.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 -- 172.21.15.177:0/1427298572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 msgr2=0x7fca8c0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 --2- 172.21.15.177:0/1427298572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0b0380 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0c9d10 tx=0x7fca7c01c870 comp rx=0 tx=0).stop 2023-10-25T16:25:25.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 -- 172.21.15.177:0/1427298572 shutdown_connections 2023-10-25T16:25:25.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 --2- 172.21.15.177:0/1427298572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0b0380 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 --2- 172.21.15.177:0/1427298572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca8c06ba00 0x7fca8c06be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 --2- 172.21.15.177:0/1427298572 >> v2:172.21.15.184:3300/0 conn(0x7fca8c140db0 0x7fca8c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 -- 172.21.15.177:0/1427298572 >> 172.21.15.177:0/1427298572 conn(0x7fca8c0b2450 msgr2=0x7fca8c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 -- 172.21.15.177:0/1427298572 shutdown_connections 2023-10-25T16:25:25.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 -- 172.21.15.177:0/1427298572 wait complete. 2023-10-25T16:25:25.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 Processor -- start 2023-10-25T16:25:25.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.486+0000 7fca92a41640 1 -- start start 2023-10-25T16:25:25.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca8c06ba00 0x7fca8c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca8c140db0 0x7fca8c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c13e690 con 0x7fca8c0aff30 2023-10-25T16:25:25.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c13e970 con 0x7fca8c06ba00 2023-10-25T16:25:25.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c13ec50 con 0x7fca8c140db0 2023-10-25T16:25:25.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0c1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59162/0 (socket says 172.21.15.177:59162) 2023-10-25T16:25:25.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 -- 172.21.15.177:0/1688128999 learned_addr learned my addr 172.21.15.177:0/1688128999 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:25.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8bfff640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca8c06ba00 0x7fca8c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca90fde640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca8c140db0 0x7fca8c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 -- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca8c140db0 msgr2=0x7fca8c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca8c140db0 0x7fca8c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 -- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca8c06ba00 msgr2=0x7fca8c157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca8c06ba00 0x7fca8c157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 -- 172.21.15.177:0/1688128999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009560 con 0x7fca8c0aff30 2023-10-25T16:25:25.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8b7fe640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0c1ea0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fca800058f0 tx=0x7fca8000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:25.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80007bb0 con 0x7fca8c0aff30 2023-10-25T16:25:25.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca80007e00 con 0x7fca8c0aff30 2023-10-25T16:25:25.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c13ef30 con 0x7fca8c0aff30 2023-10-25T16:25:25.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80005290 con 0x7fca8c0aff30 2023-10-25T16:25:25.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c158440 con 0x7fca8c0aff30 2023-10-25T16:25:25.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c0c9780 con 0x7fca8c0aff30 2023-10-25T16:25:25.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca800053f0 con 0x7fca8c0aff30 2023-10-25T16:25:25.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca800843f0 con 0x7fca8c0aff30 2023-10-25T16:25:25.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7fca7806dfa0 con 0x7fca8c0aff30 2023-10-25T16:25:25.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8bfff640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.490+0000 7fca8bfff640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca8c140570 tx=0x7fca8400a780 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:25.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.494+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca8001d020 con 0x7fca8c0aff30 2023-10-25T16:25:25.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.670+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca8c13f450 con 0x7fca8c0aff30 2023-10-25T16:25:25.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.670+0000 7fca88ff9640 1 -- 172.21.15.177:0/1688128999 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7fca80051870 con 0x7fca8c0aff30 2023-10-25T16:25:25.669 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:25.669 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:25:25.669 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:25:25.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 msgr2=0x7fca78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca8c140570 tx=0x7fca8400a780 comp rx=0 tx=0).stop 2023-10-25T16:25:25.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 msgr2=0x7fca8c0c1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0c1ea0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fca800058f0 tx=0x7fca8000cd60 comp rx=0 tx=0).stop 2023-10-25T16:25:25.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 shutdown_connections 2023-10-25T16:25:25.671 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fca78066470 0x7fca78068930 secure :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca8c140570 tx=0x7fca8400a780 comp rx=0 tx=0).stop 2023-10-25T16:25:25.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca8c140db0 0x7fca8c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca8c0aff30 0x7fca8c0c1ea0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 --2- 172.21.15.177:0/1688128999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca8c06ba00 0x7fca8c157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 >> 172.21.15.177:0/1688128999 conn(0x7fca8c0b2450 msgr2=0x7fca8c139bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.672 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 shutdown_connections 2023-10-25T16:25:25.673 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.674+0000 7fca92a41640 1 -- 172.21.15.177:0/1688128999 wait complete. 2023-10-25T16:25:25.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:25.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- 172.21.15.177:0/3446338980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff015eba0 msgr2=0x7f5ff00b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/3446338980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff015eba0 0x7f5ff00b4100 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cb890 tx=0x7f5fe001c7d0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- 172.21.15.177:0/3446338980 shutdown_connections 2023-10-25T16:25:25.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/3446338980 >> v2:172.21.15.184:3300/0 conn(0x7f5ff00cdb10 0x7f5ff00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/3446338980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff015eba0 0x7f5ff00b4100 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- 172.21.15.177:0/3446338980 >> 172.21.15.177:0/3446338980 conn(0x7f5ff009a5c0 msgr2=0x7f5ff00d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- 172.21.15.177:0/3446338980 shutdown_connections 2023-10-25T16:25:25.805 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- 172.21.15.177:0/3446338980 wait complete. 2023-10-25T16:25:25.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 Processor -- start 2023-10-25T16:25:25.808 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- start start 2023-10-25T16:25:25.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00b2120 0x7f5ff0158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 0x7f5ff00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff015eba0 0x7f5ff01532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00c9030 con 0x7f5ff00cdb10 2023-10-25T16:25:25.809 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0159100 con 0x7f5ff00b2120 2023-10-25T16:25:25.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff77e0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff01593e0 con 0x7f5ff015eba0 2023-10-25T16:25:25.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff4d7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 0x7f5ff00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff4d7b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 0x7f5ff00c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59186/0 (socket says 172.21.15.177:59186) 2023-10-25T16:25:25.810 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.806+0000 7f5ff4d7b640 1 -- 172.21.15.177:0/711589323 learned_addr learned my addr 172.21.15.177:0/711589323 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:25.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff5d7d640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff015eba0 0x7f5ff01532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff557c640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00b2120 0x7f5ff0158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff4d7b640 1 -- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff015eba0 msgr2=0x7f5ff01532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff4d7b640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff015eba0 0x7f5ff01532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.811 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff4d7b640 1 -- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00b2120 msgr2=0x7f5ff0158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff4d7b640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00b2120 0x7f5ff0158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff4d7b640 1 -- 172.21.15.177:0/711589323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009560 con 0x7f5ff00cdb10 2023-10-25T16:25:25.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff5d7d640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff015eba0 0x7f5ff01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:25.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff557c640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00b2120 0x7f5ff0158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:25.812 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff4d7b640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 0x7f5ff00c6c40 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c450 tx=0x7f5fec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:25.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec012830 con 0x7f5ff00cdb10 2023-10-25T16:25:25.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5fec012aa0 con 0x7f5ff00cdb10 2023-10-25T16:25:25.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff01596c0 con 0x7f5ff00cdb10 2023-10-25T16:25:25.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec011380 con 0x7f5ff00cdb10 2023-10-25T16:25:25.813 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0153810 con 0x7f5ff00cdb10 2023-10-25T16:25:25.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff004daf0 con 0x7f5ff00cdb10 2023-10-25T16:25:25.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5fec0114e0 con 0x7f5ff00cdb10 2023-10-25T16:25:25.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5fd4066470 0x7f5fd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:25.814 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fec083fa0 con 0x7f5ff00cdb10 2023-10-25T16:25:25.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f5fd406dfa0 con 0x7f5ff00cdb10 2023-10-25T16:25:25.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff557c640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5fd4066470 0x7f5fd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:25.815 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.810+0000 7f5ff557c640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5fd4066470 0x7f5fd4068930 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ae000 tx=0x7f5fe001b010 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:25.816 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.814+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5fec0b5090 con 0x7f5ff00cdb10 2023-10-25T16:25:25.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ff00c8e00 con 0x7f5ff00cdb10 2023-10-25T16:25:25.984 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5fe5ffb640 1 -- 172.21.15.177:0/711589323 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4932 (secure 0 0 0) 0x7f5fec051420 con 0x7f5ff00cdb10 2023-10-25T16:25:25.984 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:25.984 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":72,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T16:24:42.379643+0000","modified":"2023-10-25T16:24:44.443678+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":156302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_156302":{"gid":156302,"name":"d","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6837/532461169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":532461169},{"type":"v1","addr":"172.21.15.184:6837","nonce":532461169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-10-25T16:25:25.985 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 72 2023-10-25T16:25:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5fd4066470 msgr2=0x7f5fd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5fd4066470 0x7f5fd4068930 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ae000 tx=0x7f5fe001b010 comp rx=0 tx=0).stop 2023-10-25T16:25:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 msgr2=0x7f5ff00c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:25.986 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 0x7f5ff00c6c40 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00c450 tx=0x7f5fec00c910 comp rx=0 tx=0).stop 2023-10-25T16:25:25.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 shutdown_connections 2023-10-25T16:25:25.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5fd4066470 0x7f5fd4068930 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.986+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ff015eba0 0x7f5ff01532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.990+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ff00cdb10 0x7f5ff00c6c40 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.990+0000 7f5ff77e0640 1 --2- 172.21.15.177:0/711589323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00b2120 0x7f5ff0158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:25.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.990+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 >> 172.21.15.177:0/711589323 conn(0x7f5ff009a5c0 msgr2=0x7f5ff00b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:25.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.990+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 shutdown_connections 2023-10-25T16:25:25.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:25.990+0000 7f5ff77e0640 1 -- 172.21.15.177:0/711589323 wait complete. 2023-10-25T16:25:26.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:25:26.123 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- 172.21.15.177:0/558035771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a140b2120 msgr2=0x7f0a140d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- 172.21.15.177:0/558035771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a140b2120 0x7f0a140d1bd0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f0a140cb990 tx=0x7f0a0401c810 comp rx=0 tx=0).stop 2023-10-25T16:25:26.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- 172.21.15.177:0/558035771 shutdown_connections 2023-10-25T16:25:26.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- 172.21.15.177:0/558035771 >> v2:172.21.15.184:3300/0 conn(0x7f0a140cdb10 0x7f0a140cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- 172.21.15.177:0/558035771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a140b2120 0x7f0a140d1bd0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.124 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- 172.21.15.177:0/558035771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a1415eba0 0x7f0a140b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- 172.21.15.177:0/558035771 >> 172.21.15.177:0/558035771 conn(0x7f0a1409a5c0 msgr2=0x7f0a140d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:26.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- 172.21.15.177:0/558035771 shutdown_connections 2023-10-25T16:25:26.125 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- 172.21.15.177:0/558035771 wait complete. 2023-10-25T16:25:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 Processor -- start 2023-10-25T16:25:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- start start 2023-10-25T16:25:26.127 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a140b2120 0x7f0a140c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a140cdb10 0x7f0a1414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 0x7f0a1414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1414b5a0 con 0x7f0a1415eba0 2023-10-25T16:25:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a14155fc0 con 0x7f0a140b2120 2023-10-25T16:25:26.128 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a199d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1414aaa0 con 0x7f0a140cdb10 2023-10-25T16:25:26.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 0x7f0a1414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 0x7f0a1414a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59210/0 (socket says 172.21.15.177:59210) 2023-10-25T16:25:26.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a137fe640 1 -- 172.21.15.177:0/67856491 learned_addr learned my addr 172.21.15.177:0/67856491 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:26.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a12ffd640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a140b2120 0x7f0a140c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.126+0000 7f0a127fc640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a140cdb10 0x7f0a1414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a137fe640 1 -- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a140cdb10 msgr2=0x7f0a1414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a137fe640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a140cdb10 0x7f0a1414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a137fe640 1 -- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a140b2120 msgr2=0x7f0a140c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a137fe640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a140b2120 0x7f0a140c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a137fe640 1 -- 172.21.15.177:0/67856491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009560 con 0x7f0a1415eba0 2023-10-25T16:25:26.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a137fe640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 0x7f0a1414a560 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00ccb0 tx=0x7f0a0c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:26.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00f450 con 0x7f0a1415eba0 2023-10-25T16:25:26.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0a0c00f6c0 con 0x7f0a1415eba0 2023-10-25T16:25:26.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a14156230 con 0x7f0a1415eba0 2023-10-25T16:25:26.131 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00fad0 con 0x7f0a1415eba0 2023-10-25T16:25:26.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a141567f0 con 0x7f0a1415eba0 2023-10-25T16:25:26.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a141569e0 con 0x7f0a1415eba0 2023-10-25T16:25:26.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0a0c00fc30 con 0x7f0a1415eba0 2023-10-25T16:25:26.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09f40664a0 0x7f09f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a0c0849e0 con 0x7f0a1415eba0 2023-10-25T16:25:26.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f09f406dfd0 con 0x7f0a1415eba0 2023-10-25T16:25:26.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a12ffd640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09f40664a0 0x7f09f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.130+0000 7f0a12ffd640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09f40664a0 0x7f09f4068960 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f09fc005fd0 tx=0x7f09fc005d10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:26.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.134+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0a0c01d060 con 0x7f0a1415eba0 2023-10-25T16:25:26.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.290+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a1404daf0 con 0x7f0a1415eba0 2023-10-25T16:25:26.289 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.290+0000 7f0a0bfff640 1 -- 172.21.15.177:0/67856491 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+16622 (secure 0 0 0) 0x7f0a0c01d070 con 0x7f0a1415eba0 2023-10-25T16:25:26.290 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:26.290 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":194,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:25:22.834369+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-25T16:24:40.583783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-25T16:24:41.397821+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:25:26.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09f40664a0 msgr2=0x7f09f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09f40664a0 0x7f09f4068960 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f09fc005fd0 tx=0x7f09fc005d10 comp rx=0 tx=0).stop 2023-10-25T16:25:26.292 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 msgr2=0x7f0a1414a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 0x7f0a1414a560 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00ccb0 tx=0x7f0a0c00a620 comp rx=0 tx=0).stop 2023-10-25T16:25:26.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 shutdown_connections 2023-10-25T16:25:26.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f09f40664a0 0x7f09f4068960 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a1415eba0 0x7f0a1414a560 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.293 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a140cdb10 0x7f0a1414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 --2- 172.21.15.177:0/67856491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a140b2120 0x7f0a140c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 >> 172.21.15.177:0/67856491 conn(0x7f0a1409a5c0 msgr2=0x7f0a14158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:26.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 shutdown_connections 2023-10-25T16:25:26.294 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.294+0000 7f0a199d5640 1 -- 172.21.15.177:0/67856491 wait complete. 2023-10-25T16:25:26.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T16:25:26.428 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e3205e640 1 -- 172.21.15.177:0/2088236953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e180039b0 msgr2=0x7f8e18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e3205e640 1 --2- 172.21.15.177:0/2088236953 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e180039b0 0x7f8e18003dd0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400c260 tx=0x7f8e2401cfc0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e2bfff640 1 -- 172.21.15.177:0/2088236953 reap_dead start 2023-10-25T16:25:26.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e3205e640 1 -- 172.21.15.177:0/2088236953 shutdown_connections 2023-10-25T16:25:26.429 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e3205e640 1 -- 172.21.15.177:0/2088236953 >> 172.21.15.177:0/2088236953 conn(0x7f8e2c0b2450 msgr2=0x7f8e2c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:26.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e3205e640 1 -- 172.21.15.177:0/2088236953 shutdown_connections 2023-10-25T16:25:26.430 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.430+0000 7f8e3205e640 1 -- 172.21.15.177:0/2088236953 wait complete. 2023-10-25T16:25:26.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 Processor -- start 2023-10-25T16:25:26.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- start start 2023-10-25T16:25:26.432 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e180039b0 0x7f8e2c13c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e2c162720 0x7f8e2c163d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 0x7f8e2c0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c14a460 con 0x7f8e2c0acb80 2023-10-25T16:25:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0ad550 con 0x7f8e180039b0 2023-10-25T16:25:26.433 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c162bb0 con 0x7f8e2c162720 2023-10-25T16:25:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 0x7f8e2c0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 0x7f8e2c0ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59226/0 (socket says 172.21.15.177:59226) 2023-10-25T16:25:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 -- 172.21.15.177:0/338244840 learned_addr learned my addr 172.21.15.177:0/338244840 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2b7fe640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e180039b0 0x7f8e2c13c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.434 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2affd640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e2c162720 0x7f8e2c163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 -- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e2c162720 msgr2=0x7f8e2c163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e2c162720 0x7f8e2c163d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 -- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e180039b0 msgr2=0x7f8e2c13c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e180039b0 0x7f8e2c13c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.435 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c0cc500 con 0x7f8e2c0acb80 2023-10-25T16:25:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e2bfff640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 0x7f8e2c0ad010 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06d9e0 tx=0x7f8e1c00e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00c070 con 0x7f8e2c0acb80 2023-10-25T16:25:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e1c0135f0 con 0x7f8e2c0acb80 2023-10-25T16:25:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c162e90 con 0x7f8e2c0acb80 2023-10-25T16:25:26.436 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c013a40 con 0x7f8e2c0acb80 2023-10-25T16:25:26.437 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c163450 con 0x7f8e2c0acb80 2023-10-25T16:25:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c14ee20 con 0x7f8e2c0acb80 2023-10-25T16:25:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e1c01c3b0 con 0x7f8e2c0acb80 2023-10-25T16:25:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e23fff640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e0c066470 0x7f8e0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.438 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.434+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e1c083270 con 0x7f8e2c0acb80 2023-10-25T16:25:26.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.438+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=195}) v3 -- 0x7f8e0c06dfa0 con 0x7f8e2c0acb80 2023-10-25T16:25:26.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.438+0000 7f8e2b7fe640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e0c066470 0x7f8e0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.438+0000 7f8e2b7fe640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e0c066470 0x7f8e0c068930 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8e240ac000 tx=0x7f8e240a7040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:26.439 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.438+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e2c14ee20 con 0x7f8e2c0acb80 2023-10-25T16:25:26.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.614+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8e2c14ee20 con 0x7f8e2c0acb80 2023-10-25T16:25:26.613 INFO:tasks.ceph.mon.a.smithi177.stderr:2023-10-25T16:25:26.614+0000 7fdcb0040640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-25T16:25:26.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.618+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8e2c14ee20 con 0x7f8e2c0acb80 2023-10-25T16:25:26.617 INFO:teuthology.orchestra.run.smithi177.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T16:25:26.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.618+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(195..195 src has 1..195) v4 ==== 374+0+0 (secure 0 0 0) 0x7f8e1c054b40 con 0x7f8e2c0acb80 2023-10-25T16:25:26.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e23fff640 1 -- 172.21.15.177:0/338244840 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f8e0c06e930 con 0x7f8e2c0acb80 2023-10-25T16:25:26.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e0c066470 msgr2=0x7f8e0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e0c066470 0x7f8e0c068930 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8e240ac000 tx=0x7f8e240a7040 comp rx=0 tx=0).stop 2023-10-25T16:25:26.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 msgr2=0x7f8e2c0ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 0x7f8e2c0ad010 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06d9e0 tx=0x7f8e1c00e9d0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 shutdown_connections 2023-10-25T16:25:26.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8e0c066470 0x7f8e0c068930 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e2c0acb80 0x7f8e2c0ad010 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e2c162720 0x7f8e2c163d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 --2- 172.21.15.177:0/338244840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e180039b0 0x7f8e2c13c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 >> 172.21.15.177:0/338244840 conn(0x7f8e2c0b2450 msgr2=0x7f8e2c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:26.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 shutdown_connections 2023-10-25T16:25:26.622 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.622+0000 7f8e3205e640 1 -- 172.21.15.177:0/338244840 wait complete. 2023-10-25T16:25:26.637 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T16:25:26.638 INFO:tasks.ceph.mds.d.smithi184.stderr: -7971> 2023-10-25T16:24:45.015+0000 7f88ca06d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T16:25:26.708 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-25T16:25:26.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 -- 172.21.15.177:0/104144609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e5406b9e0 msgr2=0x7f2e5406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.749 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 --2- 172.21.15.177:0/104144609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e5406b9e0 0x7f2e5406be90 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f2e440098f0 tx=0x7f2e4401c890 comp rx=0 tx=0).stop 2023-10-25T16:25:26.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 -- 172.21.15.177:0/104144609 shutdown_connections 2023-10-25T16:25:26.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 --2- 172.21.15.177:0/104144609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540706f0 0x7f2e54070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 --2- 172.21.15.177:0/104144609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e5406b9e0 0x7f2e5406be90 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 -- 172.21.15.177:0/104144609 >> 172.21.15.177:0/104144609 conn(0x7f2e540b2450 msgr2=0x7f2e540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:26.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 -- 172.21.15.177:0/104144609 shutdown_connections 2023-10-25T16:25:26.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.750+0000 7f2e5c335640 1 -- 172.21.15.177:0/104144609 wait complete. 2023-10-25T16:25:26.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 Processor -- start 2023-10-25T16:25:26.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- start start 2023-10-25T16:25:26.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5406b9e0 0x7f2e54148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540706f0 0x7f2e54147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 0x7f2e5414c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5414bb20 con 0x7f2e541500f0 2023-10-25T16:25:26.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54149470 con 0x7f2e5406b9e0 2023-10-25T16:25:26.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541477a0 con 0x7f2e540706f0 2023-10-25T16:25:26.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 0x7f2e5414c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 0x7f2e5414c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59248/0 (socket says 172.21.15.177:59248) 2023-10-25T16:25:26.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 -- 172.21.15.177:0/606164917 learned_addr learned my addr 172.21.15.177:0/606164917 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:26.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e598d0640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540706f0 0x7f2e54147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.755 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a0d1640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5406b9e0 0x7f2e54148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 -- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540706f0 msgr2=0x7f2e54147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540706f0 0x7f2e54147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 -- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5406b9e0 msgr2=0x7f2e54148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:26.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5406b9e0 0x7f2e54148f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:26.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 -- 172.21.15.177:0/606164917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44009500 con 0x7f2e541500f0 2023-10-25T16:25:26.756 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5a8d2640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 0x7f2e5414c030 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00b9a0 tx=0x7f2e4c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:26.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00cb40 con 0x7f2e541500f0 2023-10-25T16:25:26.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e4c00cdb0 con 0x7f2e541500f0 2023-10-25T16:25:26.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0146a0 con 0x7f2e541500f0 2023-10-25T16:25:26.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5414b560 con 0x7f2e541500f0 2023-10-25T16:25:26.757 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54151c30 con 0x7f2e541500f0 2023-10-25T16:25:26.758 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e54151a70 con 0x7f2e541500f0 2023-10-25T16:25:26.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.754+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2e4c01d3b0 con 0x7f2e541500f0 2023-10-25T16:25:26.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.758+0000 7f2e4affd640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e38066470 0x7f2e38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:26.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.758+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2e4c083f80 con 0x7f2e541500f0 2023-10-25T16:25:26.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.758+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f2e3806e0b0 con 0x7f2e541500f0 2023-10-25T16:25:26.759 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.758+0000 7f2e5a0d1640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e38066470 0x7f2e38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:26.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.758+0000 7f2e5a0d1640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e38066470 0x7f2e38068930 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2e50000f70 tx=0x7f2e50009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:26.760 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.762+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2e4c0b5090 con 0x7f2e541500f0 2023-10-25T16:25:26.942 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:26.946+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e5404daf0 con 0x7f2e541500f0 2023-10-25T16:25:27.628 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.630+0000 7f2e4affd640 1 -- 172.21.15.177:0/606164917 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e4c019060 con 0x7f2e541500f0 2023-10-25T16:25:27.630 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e38066470 msgr2=0x7f2e38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e38066470 0x7f2e38068930 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2e50000f70 tx=0x7f2e50009040 comp rx=0 tx=0).stop 2023-10-25T16:25:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 msgr2=0x7f2e5414c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 0x7f2e5414c030 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00b9a0 tx=0x7f2e4c00be60 comp rx=0 tx=0).stop 2023-10-25T16:25:27.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 shutdown_connections 2023-10-25T16:25:27.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2e38066470 0x7f2e38068930 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e541500f0 0x7f2e5414c030 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540706f0 0x7f2e54147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 --2- 172.21.15.177:0/606164917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e5406b9e0 0x7f2e54148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 >> 172.21.15.177:0/606164917 conn(0x7f2e540b2450 msgr2=0x7f2e5414d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:27.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 shutdown_connections 2023-10-25T16:25:27.633 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.634+0000 7f2e5c335640 1 -- 172.21.15.177:0/606164917 wait complete. 2023-10-25T16:25:27.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T16:25:27.785 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e98db2640 1 -- 172.21.15.177:0/2588062497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e7c003980 msgr2=0x7f3e7c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e98db2640 1 --2- 172.21.15.177:0/2588062497 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e7c003980 0x7f3e7c003da0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f3e940670a0 tx=0x7f3e8c01cbb0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e92d9d640 1 -- 172.21.15.177:0/2588062497 reap_dead start 2023-10-25T16:25:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e98db2640 1 -- 172.21.15.177:0/2588062497 shutdown_connections 2023-10-25T16:25:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e98db2640 1 -- 172.21.15.177:0/2588062497 >> 172.21.15.177:0/2588062497 conn(0x7f3e940caa40 msgr2=0x7f3e940cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:27.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e98db2640 1 -- 172.21.15.177:0/2588062497 shutdown_connections 2023-10-25T16:25:27.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.786+0000 7f3e98db2640 1 -- 172.21.15.177:0/2588062497 wait complete. 2023-10-25T16:25:27.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 Processor -- start 2023-10-25T16:25:27.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- start start 2023-10-25T16:25:27.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 0x7f3e9415d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:27.789 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e9415dec0 0x7f3e94158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e94159040 0x7f3e940aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940ae000 con 0x7f3e9414ede0 2023-10-25T16:25:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e941594c0 con 0x7f3e94159040 2023-10-25T16:25:27.790 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940aee90 con 0x7f3e9415dec0 2023-10-25T16:25:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 0x7f3e9415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 0x7f3e9415d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59272/0 (socket says 172.21.15.177:59272) 2023-10-25T16:25:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 -- 172.21.15.177:0/800872421 learned_addr learned my addr 172.21.15.177:0/800872421 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e91d9b640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e9415dec0 0x7f3e94158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:27.791 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e92d9d640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e94159040 0x7f3e940aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 -- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e9415dec0 msgr2=0x7f3e94158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e9415dec0 0x7f3e94158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 -- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e94159040 msgr2=0x7f3e940aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e94159040 0x7f3e940aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9415e860 con 0x7f3e9414ede0 2023-10-25T16:25:27.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e9259c640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 0x7f3e9415d980 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c001ec0 tx=0x7f3e8c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0054f0 con 0x7f3e9414ede0 2023-10-25T16:25:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e8c0046d0 con 0x7f3e9414ede0 2023-10-25T16:25:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940ae210 con 0x7f3e9414ede0 2023-10-25T16:25:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004aa0 con 0x7f3e9414ede0 2023-10-25T16:25:27.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e940ae7d0 con 0x7f3e9414ede0 2023-10-25T16:25:27.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94073360 con 0x7f3e9414ede0 2023-10-25T16:25:27.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e8c004c00 con 0x7f3e9414ede0 2023-10-25T16:25:27.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e82ffd640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e74066470 0x7f3e74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:27.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.790+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3e8c11eea0 con 0x7f3e9414ede0 2023-10-25T16:25:27.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.794+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=196}) v3 -- 0x7f3e7406e0b0 con 0x7f3e9414ede0 2023-10-25T16:25:27.795 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.794+0000 7f3e91d9b640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e74066470 0x7f3e74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:27.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.794+0000 7f3e91d9b640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e74066470 0x7f3e74068930 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3e940c4870 tx=0x7f3e880091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:27.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.794+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e8c0ab060 con 0x7f3e9414ede0 2023-10-25T16:25:27.937 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:27.938+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3e940b3f40 con 0x7f3e9414ede0 2023-10-25T16:25:28.835 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.838+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v196) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3e8c0bd020 con 0x7f3e9414ede0 2023-10-25T16:25:28.836 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_metadata' removed 2023-10-25T16:25:28.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.838+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(196..196 src has 1..196) v4 ==== 296+0+0 (secure 0 0 0) 0x7f3e8c0b8e20 con 0x7f3e9414ede0 2023-10-25T16:25:28.836 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.838+0000 7f3e82ffd640 1 -- 172.21.15.177:0/800872421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7f3e7406c4e0 con 0x7f3e9414ede0 2023-10-25T16:25:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.842+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e74066470 msgr2=0x7f3e74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.842+0000 7f3e98db2640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e74066470 0x7f3e74068930 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3e940c4870 tx=0x7f3e880091e0 comp rx=0 tx=0).stop 2023-10-25T16:25:28.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.842+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 msgr2=0x7f3e9415d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:28.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.842+0000 7f3e98db2640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 0x7f3e9415d980 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c001ec0 tx=0x7f3e8c005040 comp rx=0 tx=0).stop 2023-10-25T16:25:28.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 shutdown_connections 2023-10-25T16:25:28.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3e74066470 0x7f3e74068930 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:28.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e94159040 0x7f3e940aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:28.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e9415dec0 0x7f3e94158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:28.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 --2- 172.21.15.177:0/800872421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e9414ede0 0x7f3e9415d980 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:28.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 >> 172.21.15.177:0/800872421 conn(0x7f3e940caa40 msgr2=0x7f3e9415a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:28.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 shutdown_connections 2023-10-25T16:25:28.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.846+0000 7f3e98db2640 1 -- 172.21.15.177:0/800872421 wait complete. 2023-10-25T16:25:28.864 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T16:25:28.995 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- 172.21.15.177:0/1803324089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2841595d0 msgr2=0x7fd2840abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:28.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 --2- 172.21.15.177:0/1803324089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2841595d0 0x7fd2840abfe0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fd274009900 tx=0x7fd2840ad440 comp rx=0 tx=0).stop 2023-10-25T16:25:28.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- 172.21.15.177:0/1803324089 shutdown_connections 2023-10-25T16:25:28.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 --2- 172.21.15.177:0/1803324089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2841595d0 0x7fd2840abfe0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:28.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- 172.21.15.177:0/1803324089 >> 172.21.15.177:0/1803324089 conn(0x7fd2840cf010 msgr2=0x7fd2840cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:28.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- 172.21.15.177:0/1803324089 shutdown_connections 2023-10-25T16:25:28.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- 172.21.15.177:0/1803324089 wait complete. 2023-10-25T16:25:29.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 Processor -- start 2023-10-25T16:25:29.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- start start 2023-10-25T16:25:29.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 0x7fd28406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:29.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2840cd5f0 0x7fd284151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:29.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2841595d0 0x7fd28406de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:29.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28406c880 con 0x7fd2840cc050 2023-10-25T16:25:29.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28415a490 con 0x7fd2841595d0 2023-10-25T16:25:29.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd289275640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28415a770 con 0x7fd2840cd5f0 2023-10-25T16:25:29.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 0x7fd28406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:29.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd282ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 0x7fd28406c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59292/0 (socket says 172.21.15.177:59292) 2023-10-25T16:25:29.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:28.998+0000 7fd282ffd640 1 -- 172.21.15.177:0/3725576079 learned_addr learned my addr 172.21.15.177:0/3725576079 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:29.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd2827fc640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2840cd5f0 0x7fd284151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:29.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd2837fe640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2841595d0 0x7fd28406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:29.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd282ffd640 1 -- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2840cd5f0 msgr2=0x7fd284151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:29.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd282ffd640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2840cd5f0 0x7fd284151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd282ffd640 1 -- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2841595d0 msgr2=0x7fd28406de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:29.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd282ffd640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2841595d0 0x7fd28406de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.003 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd282ffd640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009560 con 0x7fd2840cc050 2023-10-25T16:25:29.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd282ffd640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 0x7fd28406c340 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fd27800c800 tx=0x7fd27800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:29.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278005270 con 0x7fd2840cc050 2023-10-25T16:25:29.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd27800a640 con 0x7fd2840cc050 2023-10-25T16:25:29.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28415aa50 con 0x7fd2840cc050 2023-10-25T16:25:29.004 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780054e0 con 0x7fd2840cc050 2023-10-25T16:25:29.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28415b010 con 0x7fd2840cc050 2023-10-25T16:25:29.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd284073360 con 0x7fd2840cc050 2023-10-25T16:25:29.005 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd27800aa50 con 0x7fd2840cc050 2023-10-25T16:25:29.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd270066470 0x7fd270068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:29.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fd278083730 con 0x7fd2840cc050 2023-10-25T16:25:29.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=197}) v3 -- 0x7fd27006d240 con 0x7fd2840cc050 2023-10-25T16:25:29.006 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd2827fc640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd270066470 0x7fd270068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:29.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.002+0000 7fd2827fc640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd270066470 0x7fd270068930 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd2740af000 tx=0x7fd27401aec0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:29.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.006+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd278017070 con 0x7fd2840cc050 2023-10-25T16:25:29.159 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.162+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd2840b1730 con 0x7fd2840cc050 2023-10-25T16:25:29.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.850+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v197) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd278050d10 con 0x7fd2840cc050 2023-10-25T16:25:29.848 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'cephfs_data' removed 2023-10-25T16:25:29.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.850+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 <== mon.0 v2:172.21.15.177:3300/0 8 ==== osd_map(197..197 src has 1..197) v4 ==== 296+0+0 (secure 0 0 0) 0x7fd2780550d0 con 0x7fd2840cc050 2023-10-25T16:25:29.849 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.850+0000 7fd26b7fe640 1 -- 172.21.15.177:0/3725576079 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=198}) v3 -- 0x7fd27006bfd0 con 0x7fd2840cc050 2023-10-25T16:25:29.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd270066470 msgr2=0x7fd270068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:29.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd270066470 0x7fd270068930 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd2740af000 tx=0x7fd27401aec0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 msgr2=0x7fd28406c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:29.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 0x7fd28406c340 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fd27800c800 tx=0x7fd27800ccc0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 shutdown_connections 2023-10-25T16:25:29.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd270066470 0x7fd270068930 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2841595d0 0x7fd28406de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2840cd5f0 0x7fd284151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 --2- 172.21.15.177:0/3725576079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2840cc050 0x7fd28406c340 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:29.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 >> 172.21.15.177:0/3725576079 conn(0x7fd2840cf010 msgr2=0x7fd28406efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:29.865 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 shutdown_connections 2023-10-25T16:25:29.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:29.866+0000 7fd289275640 1 -- 172.21.15.177:0/3725576079 wait complete. 2023-10-25T16:25:29.887 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 18 2023-10-25T16:25:30.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.014+0000 7fd0cc904640 1 -- 172.21.15.177:0/2942303793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c815eba0 msgr2=0x7fd0c80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.014+0000 7fd0cc904640 1 --2- 172.21.15.177:0/2942303793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c815eba0 0x7fd0c80b4100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009900 tx=0x7fd0b801c830 comp rx=0 tx=0).stop 2023-10-25T16:25:30.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.014+0000 7fd0cc904640 1 -- 172.21.15.177:0/2942303793 shutdown_connections 2023-10-25T16:25:30.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.014+0000 7fd0cc904640 1 --2- 172.21.15.177:0/2942303793 >> v2:172.21.15.184:3300/0 conn(0x7fd0c80b2120 0x7fd0c80d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.014+0000 7fd0cc904640 1 --2- 172.21.15.177:0/2942303793 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c815eba0 0x7fd0c80b4100 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- 172.21.15.177:0/2942303793 >> 172.21.15.177:0/2942303793 conn(0x7fd0c809a5c0 msgr2=0x7fd0c80d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:30.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- 172.21.15.177:0/2942303793 shutdown_connections 2023-10-25T16:25:30.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- 172.21.15.177:0/2942303793 wait complete. 2023-10-25T16:25:30.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 Processor -- start 2023-10-25T16:25:30.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- start start 2023-10-25T16:25:30.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 0x7fd0c814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c80cdb10 0x7fd0c815a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0c815eba0 0x7fd0c815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80ca650 con 0x7fd0c80b2120 2023-10-25T16:25:30.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80c9d80 con 0x7fd0c815eba0 2023-10-25T16:25:30.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8159780 con 0x7fd0c80cdb10 2023-10-25T16:25:30.019 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 0x7fd0c814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 0x7fd0c814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59296/0 (socket says 172.21.15.177:59296) 2023-10-25T16:25:30.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 -- 172.21.15.177:0/512426934 learned_addr learned my addr 172.21.15.177:0/512426934 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:30.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0bdd9b640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c80cdb10 0x7fd0c815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c6d9d640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0c815eba0 0x7fd0c815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 -- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c80cdb10 msgr2=0x7fd0c815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c80cdb10 0x7fd0c815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 -- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0c815eba0 msgr2=0x7fd0c815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0c815eba0 0x7fd0c815a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 -- 172.21.15.177:0/512426934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8009560 con 0x7fd0c80b2120 2023-10-25T16:25:30.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0c659c640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 0x7fd0c814f8b0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009850 tx=0x7fd0b80a66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:30.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8004240 con 0x7fd0c80b2120 2023-10-25T16:25:30.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0b8004490 con 0x7fd0c80b2120 2023-10-25T16:25:30.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c80c9f90 con 0x7fd0c80b2120 2023-10-25T16:25:30.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8005290 con 0x7fd0c80b2120 2023-10-25T16:25:30.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.018+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c814fdf0 con 0x7fd0c80b2120 2023-10-25T16:25:30.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.022+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c804daf0 con 0x7fd0c80b2120 2023-10-25T16:25:30.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.022+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0b80053f0 con 0x7fd0c80b2120 2023-10-25T16:25:30.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.022+0000 7fd0bf7fe640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0a8066470 0x7fd0a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.022+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd0b80aa070 con 0x7fd0c80b2120 2023-10-25T16:25:30.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.022+0000 7fd0bdd9b640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0a8066470 0x7fd0a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.022+0000 7fd0bdd9b640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0a8066470 0x7fd0a8068930 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd0c81663b0 tx=0x7fd0b00091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:30.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.026+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0b80eb7e0 con 0x7fd0c80b2120 2023-10-25T16:25:30.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.182+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config reset", "num": 18} v 0) v1 -- 0x7fd0c80ce930 con 0x7fd0c80b2120 2023-10-25T16:25:30.190 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0bf7fe640 1 -- 172.21.15.177:0/512426934 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 18}]=0 v38) v1 ==== 71+0+0 (secure 0 0 0) 0x7fd0b80eee00 con 0x7fd0c80b2120 2023-10-25T16:25:30.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0a8066470 msgr2=0x7fd0a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.193 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0a8066470 0x7fd0a8068930 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd0c81663b0 tx=0x7fd0b00091e0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 msgr2=0x7fd0c814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 0x7fd0c814f8b0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009850 tx=0x7fd0b80a66e0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 shutdown_connections 2023-10-25T16:25:30.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd0a8066470 0x7fd0a8068930 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.194 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0c815eba0 0x7fd0c815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd0c80cdb10 0x7fd0c815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 --2- 172.21.15.177:0/512426934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c80b2120 0x7fd0c814f8b0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 >> 172.21.15.177:0/512426934 conn(0x7fd0c809a5c0 msgr2=0x7fd0c80b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:30.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 shutdown_connections 2023-10-25T16:25:30.195 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.194+0000 7fd0cc904640 1 -- 172.21.15.177:0/512426934 wait complete. 2023-10-25T16:25:30.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-10-25T16:25:30.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- 172.21.15.177:0/2752252831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 msgr2=0x7f31c806fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.335 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 --2- 172.21.15.177:0/2752252831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c806fe30 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009900 tx=0x7f31b001c880 comp rx=0 tx=0).stop 2023-10-25T16:25:30.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- 172.21.15.177:0/2752252831 shutdown_connections 2023-10-25T16:25:30.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 --2- 172.21.15.177:0/2752252831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c806fe30 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 --2- 172.21.15.177:0/2752252831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31c8157a70 0x7f31c80ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- 172.21.15.177:0/2752252831 >> 172.21.15.177:0/2752252831 conn(0x7f31c80aeb00 msgr2=0x7f31c80aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:30.336 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- 172.21.15.177:0/2752252831 shutdown_connections 2023-10-25T16:25:30.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- 172.21.15.177:0/2752252831 wait complete. 2023-10-25T16:25:30.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 Processor -- start 2023-10-25T16:25:30.339 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- start start 2023-10-25T16:25:30.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c813e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c8070370 0x7f31c80ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31c8157a70 0x7f31c80ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80cb470 con 0x7f31c806f4c0 2023-10-25T16:25:30.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8097f10 con 0x7f31c8070370 2023-10-25T16:25:30.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cf225640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8097be0 con 0x7f31c8157a70 2023-10-25T16:25:30.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c813e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c813e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59312/0 (socket says 172.21.15.177:59312) 2023-10-25T16:25:30.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 -- 172.21.15.177:0/1232428230 learned_addr learned my addr 172.21.15.177:0/1232428230 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:30.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31cd7c2640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31c8157a70 0x7f31c80ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31c7fff640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c8070370 0x7f31c80ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 -- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31c8157a70 msgr2=0x7f31c80ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31c8157a70 0x7f31c80ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 -- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c8070370 msgr2=0x7f31c80ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c8070370 0x7f31c80ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 -- 172.21.15.177:0/1232428230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009560 con 0x7f31c806f4c0 2023-10-25T16:25:30.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31c7fff640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c8070370 0x7f31c80ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:30.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.338+0000 7f31ccfc1640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c813e900 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f31b800d950 tx=0x7f31b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:30.343 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8009c30 con 0x7f31c806f4c0 2023-10-25T16:25:30.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f31b8009e80 con 0x7f31c806f4c0 2023-10-25T16:25:30.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80106a0 con 0x7f31c806f4c0 2023-10-25T16:25:30.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c80caeb0 con 0x7f31c806f4c0 2023-10-25T16:25:30.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c814cd40 con 0x7f31c806f4c0 2023-10-25T16:25:30.344 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c8097a40 con 0x7f31c806f4c0 2023-10-25T16:25:30.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f31b8010800 con 0x7f31c806f4c0 2023-10-25T16:25:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c57fa640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31a8066470 0x7f31a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31b8084070 con 0x7f31c806f4c0 2023-10-25T16:25:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c7fff640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31a8066470 0x7f31a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.342+0000 7f31c7fff640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31a8066470 0x7f31a8068930 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f31b00af000 tx=0x7f31b001b0c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:30.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.346+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31c8097a40 con 0x7f31c806f4c0 2023-10-25T16:25:30.555 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.558+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f31c8097a40 con 0x7f31c806f4c0 2023-10-25T16:25:30.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.842+0000 7f31c57fa640 1 -- 172.21.15.177:0/1232428230 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v591) v1 ==== 135+0+0 (secure 0 0 0) 0x7f31c8097a40 con 0x7f31c806f4c0 2023-10-25T16:25:30.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31a8066470 msgr2=0x7f31a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31a8066470 0x7f31a8068930 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f31b00af000 tx=0x7f31b001b0c0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 msgr2=0x7f31c813e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:30.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c813e900 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f31b800d950 tx=0x7f31b800de10 comp rx=0 tx=0).stop 2023-10-25T16:25:30.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 shutdown_connections 2023-10-25T16:25:30.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f31a8066470 0x7f31a8068930 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31c8157a70 0x7f31c80ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31c8070370 0x7f31c80ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 --2- 172.21.15.177:0/1232428230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31c806f4c0 0x7f31c813e900 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:30.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 >> 172.21.15.177:0/1232428230 conn(0x7f31c80aeb00 msgr2=0x7f31c815a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:30.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 shutdown_connections 2023-10-25T16:25:30.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:30.846+0000 7f31cf225640 1 -- 172.21.15.177:0/1232428230 wait complete. 2023-10-25T16:25:30.864 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-10-25T16:25:30.864 INFO:tasks.cephfs_test_runner: 2023-10-25T16:25:30.865 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-25T16:25:30.865 INFO:tasks.cephfs_test_runner:Ran 10 tests in 709.669s 2023-10-25T16:25:30.865 INFO:tasks.cephfs_test_runner: 2023-10-25T16:25:30.866 INFO:tasks.cephfs_test_runner:OK 2023-10-25T16:25:30.866 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-25T16:25:30.876 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-25T16:25:30.939 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-25T16:25:30.940 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:25:30.940 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:30.947 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:25:30.947 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-25T16:25:30.947 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:30.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18216 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-25T16:25:30.995 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:25:30.996 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:31.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:25:31.003 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-25T16:25:31.003 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T16:25:31.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336576k,nr_inodes=4084144,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20914 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-25T16:25:31.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.051 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-25T16:25:31.098 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-25T16:25:31.098 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-25T16:25:31.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.099 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-25T16:25:31.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-25T16:25:31.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.234 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-25T16:25:31.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.376 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-25T16:25:31.383 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-25T16:25:31.383 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T16:25:31.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.384 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-25T16:25:31.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T16:25:31.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T16:25:31.503 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-10-25T16:25:31.680 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-25T16:25:31.689 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-25T16:25:31.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:25:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- 172.21.15.177:0/444412027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa63815fb80 msgr2=0x7fa6380cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 --2- 172.21.15.177:0/444412027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa63815fb80 0x7fa6380cdf20 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fa628009840 tx=0x7fa62801c700 comp rx=0 tx=0).stop 2023-10-25T16:25:31.823 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- 172.21.15.177:0/444412027 shutdown_connections 2023-10-25T16:25:31.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 --2- 172.21.15.177:0/444412027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa63815fb80 0x7fa6380cdf20 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- 172.21.15.177:0/444412027 >> 172.21.15.177:0/444412027 conn(0x7fa63806a830 msgr2=0x7fa63806ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:31.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- 172.21.15.177:0/444412027 shutdown_connections 2023-10-25T16:25:31.824 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- 172.21.15.177:0/444412027 wait complete. 2023-10-25T16:25:31.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 Processor -- start 2023-10-25T16:25:31.826 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- start start 2023-10-25T16:25:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6381448b0 0x7fa6381402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 0x7fa6380afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa63815fb80 0x7fa6380afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63813c080 con 0x7fa638144e20 2023-10-25T16:25:31.827 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380b0530 con 0x7fa63815fb80 2023-10-25T16:25:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa63e628640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63813bda0 con 0x7fa6381448b0 2023-10-25T16:25:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 0x7fa6380afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 0x7fa6380afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34226/0 (socket says 172.21.15.177:34226) 2023-10-25T16:25:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 -- 172.21.15.177:0/2872199597 learned_addr learned my addr 172.21.15.177:0/2872199597 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:31.828 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 -- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6381448b0 msgr2=0x7fa6381402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6381448b0 0x7fa6381402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 -- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa63815fb80 msgr2=0x7fa6380afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa63815fb80 0x7fa6380afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 -- 172.21.15.177:0/2872199597 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280094a0 con 0x7fa638144e20 2023-10-25T16:25:31.829 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.826+0000 7fa6377fe640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 0x7fa6380afab0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b0040 tx=0x7fa6280a6770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280be070 con 0x7fa638144e20 2023-10-25T16:25:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa6280042b0 con 0x7fa638144e20 2023-10-25T16:25:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628004460 con 0x7fa638144e20 2023-10-25T16:25:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6381377f0 con 0x7fa638144e20 2023-10-25T16:25:31.830 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa638137db0 con 0x7fa638144e20 2023-10-25T16:25:31.831 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa638137fa0 con 0x7fa638144e20 2023-10-25T16:25:31.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa628003600 con 0x7fa638144e20 2023-10-25T16:25:31.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa634ff9640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa618066470 0x7fa618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:31.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6280aa070 con 0x7fa638144e20 2023-10-25T16:25:31.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa637fff640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa618066470 0x7fa618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:31.832 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.830+0000 7fa637fff640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa618066470 0x7fa618068930 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa620001c90 tx=0x7fa620007d20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:31.833 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.834+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa6280ebb40 con 0x7fa638144e20 2023-10-25T16:25:31.983 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.986+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa63804daf0 con 0x7fa618066470 2023-10-25T16:25:31.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.990+0000 7fa634ff9640 1 -- 172.21.15.177:0/2872199597 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48843 (secure 0 0 0) 0x7fa63804daf0 con 0x7fa618066470 2023-10-25T16:25:31.990 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:31.990 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:25:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa618066470 msgr2=0x7fa618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa618066470 0x7fa618068930 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa620001c90 tx=0x7fa620007d20 comp rx=0 tx=0).stop 2023-10-25T16:25:31.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 msgr2=0x7fa6380afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 0x7fa6380afab0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b0040 tx=0x7fa6280a6770 comp rx=0 tx=0).stop 2023-10-25T16:25:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 shutdown_connections 2023-10-25T16:25:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fa618066470 0x7fa618068930 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa63815fb80 0x7fa6380afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa638144e20 0x7fa6380afab0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 --2- 172.21.15.177:0/2872199597 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6381448b0 0x7fa6381402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:31.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 >> 172.21.15.177:0/2872199597 conn(0x7fa63806a830 msgr2=0x7fa63806d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:31.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 shutdown_connections 2023-10-25T16:25:31.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:31.994+0000 7fa63e628640 1 -- 172.21.15.177:0/2872199597 wait complete. 2023-10-25T16:25:32.008 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2023-10-25T16:25:30.870168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450266,"statfs":{"total":1600000000,"available":1485072642,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487222,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-122,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001878"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-10-25T16:25:28.844599+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:25:28.844599+0000","last_peered":"2023-10-25T16:25:28.844599+0000","last_clean":"2023-10-25T16:25:28.844599+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:25:28.844599+0000","last_undegraded":"2023-10-25T16:25:28.844599+0000","last_fullsized":"2023-10-25T16:25:28.844599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542297,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":0.35099999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":0.59299999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.58199999999999996}]}]},{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185457,"statfs":{"total":200000000,"available":189908397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.79600000000000004},"min":{"1min":0.499,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.24,"15min":1.256},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44800000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.534},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.1359999999999999,"5min":1.4259999999999999,"15min":1.647},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96699999999999997,"15min":0.93400000000000005},"min":{"1min":0.57599999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93300000000000005,"15min":0.873},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45500000000000002},"max":{"1min":1.4239999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.425,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.014,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.505},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.054},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.04,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64400000000000002,"5min":0.52000000000000002,"15min":0.44},"max":{"1min":1.2989999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.96599999999999997},"min":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.46300000000000002},"max":{"1min":1.397,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97599999999999998,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61899999999999999,"15min":0.55000000000000004},"max":{"1min":1.3360000000000001,"5min":1.696,"15min":1.7370000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.032,"15min":1.024},"min":{"1min":0.77200000000000002,"5min":0.66000000000000003,"15min":0.48899999999999999},"max":{"1min":1.288,"5min":1.681,"15min":1.681},"last":0.86399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.107,"15min":1.119},"min":{"1min":0.81699999999999995,"5min":0.70699999999999996,"15min":0.503},"max":{"1min":1.552,"5min":1.643,"15min":1.669},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1359999999999999,"15min":1.119},"min":{"1min":0.93999999999999995,"5min":0.68500000000000005,"15min":0.57099999999999995},"max":{"1min":1.3979999999999999,"5min":1.591,"15min":1.7490000000000001},"last":1.028}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19518,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175793,"statfs":{"total":200000000,"available":180013005,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.58599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2769999999999999,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":0.93700000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3660000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.91400000000000003},"min":{"1min":0.73999999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":10.667,"15min":10.667},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.026,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47999999999999998},"max":{"1min":1.181,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.075}]},{"osd":2,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.004,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.181,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":1.181},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0680000000000001,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1879999999999999,"5min":10.948,"15min":10.948},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.262,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1499999999999999,"15min":1.0800000000000001},"min":{"1min":0.76500000000000001,"5min":0.73699999999999999,"15min":0.54700000000000004},"max":{"1min":1.4299999999999999,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":0.97699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41499999999999998},"max":{"1min":1.3200000000000001,"5min":11.081,"15min":11.081},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.016,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44600000000000001},"max":{"1min":1.4910000000000001,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.139,"15min":1.083},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46899999999999997},"max":{"1min":1.579,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":0.90000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2609999999999999,"15min":1.147},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.46700000000000003},"max":{"1min":1.522,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.194,"5min":1.1819999999999999,"15min":1.103},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.45000000000000001},"max":{"1min":1.9259999999999999,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21566,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173745,"statfs":{"total":200000000,"available":177915853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":1.0489999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":2.1429999999999998,"15min":14.843},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88900000000000001,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.35499999999999998},"max":{"1min":1.117,"5min":2.8450000000000002,"15min":16.439},"last":0.91000000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91800000000000004,"15min":1.081},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.40100000000000002},"max":{"1min":1.389,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":0.91500000000000004},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.38200000000000001},"max":{"1min":1.175,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.88}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.95499999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.5},"max":{"1min":1.272,"5min":1.601,"15min":3.9529999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.1859999999999999,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.45400000000000001},"max":{"1min":1.24,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.083,"15min":1.226},"min":{"1min":0.70499999999999996,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.452,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0309999999999999,"15min":1.222},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.40999999999999998},"max":{"1min":1.302,"5min":1.9910000000000001,"15min":15.904},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.173},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.31},"max":{"1min":1.2909999999999999,"5min":7.9610000000000003,"15min":17.219999999999999},"last":1.101}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0349999999999999,"15min":1.196},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.52200000000000002},"max":{"1min":1.1910000000000001,"5min":4.5970000000000004,"15min":14.567},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.1519999999999999,"15min":1.343},"min":{"1min":0.77100000000000002,"5min":0.69499999999999995,"15min":0.56699999999999995},"max":{"1min":1.51,"5min":2.4079999999999999,"15min":15.089},"last":1.1180000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0189999999999999,"15min":1.2589999999999999},"min":{"1min":0.74099999999999999,"5min":0.48499999999999999,"15min":0.436},"max":{"1min":1.101,"5min":7.8730000000000002,"15min":17.492000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.70499999999999996,"5min":0.59499999999999997,"15min":0.36599999999999999},"max":{"1min":1.3560000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.01}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188081,"statfs":{"total":200000000,"available":192595917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.871,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48399999999999999},"max":{"1min":1.1299999999999999,"5min":1.292,"15min":1.47},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90700000000000003,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0009999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.875,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.1839999999999999,"5min":1.429,"15min":1.4990000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":0.92300000000000004},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.96399999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96299999999999997,"15min":0.93799999999999994},"min":{"1min":0.60699999999999998,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.2270000000000001,"5min":1.4219999999999999,"15min":1.5},"last":1.04},{"interface":"front","average":{"1min":0.872,"5min":0.89200000000000002,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.3140000000000001,"15min":1.518},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.58899999999999997,"5min":0.52700000000000002,"15min":0.313},"max":{"1min":1.716,"5min":1.716,"15min":2.6640000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.76500000000000001,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.373,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.95699999999999996,"15min":0.96699999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.40000000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.085},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.298,"5min":1.5600000000000001,"15min":1.8149999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.0780000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9278,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186033,"statfs":{"total":200000000,"available":190498765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.96799999999999997,"5min":1.093,"15min":1.093},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.67900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.222},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.67400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.19700000000000001},"max":{"1min":1.3109999999999999,"5min":1.425,"15min":1.425},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.76400000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.0649999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.747}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0429999999999999,"5min":1.1220000000000001,"15min":1.3560000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.054,"5min":1.2330000000000001,"15min":1.8260000000000001},"last":1.2}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.169},{"interface":"front","average":{"1min":1.014,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":1.2450000000000001,"5min":1.349,"15min":1.4710000000000001},"last":1.363}]},{"osd":5,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.93600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.45400000000000001},"max":{"1min":1.6060000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0049999999999999,"15min":0.97199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.278,"5min":1.278,"15min":1.4830000000000001},"last":1.131}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.92600000000000005},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.456},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.032,"15min":1.0009999999999999},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.5209999999999999,"5min":1.861,"15min":1.861},"last":1.3180000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0449999999999999,"15min":1.0089999999999999},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5660000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0269999999999999,"15min":0.98399999999999999},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181937,"statfs":{"total":200000000,"available":186304461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.4610000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.24299999999999999},"max":{"1min":1.0329999999999999,"5min":1.304,"15min":1.304},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.97299999999999998,"15min":1.4610000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75,"15min":0.70399999999999996},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.194,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70599999999999996,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.1399999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28000000000000003},"max":{"1min":1.0389999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1200000000000001,"15min":12.698},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0149999999999999},"min":{"1min":0.66900000000000004,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.252,"5min":1.4139999999999999,"15min":12.721},"last":0.875}]},{"osd":5,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2709999999999999,"5min":1.4530000000000001,"15min":1.546},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.28,"5min":1.325,"15min":2.206},"last":0.85999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":0.97099999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.49099999999999999},"max":{"1min":1.1890000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.997,"5min":1.0680000000000001,"15min":1.0309999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"max":{"1min":1.3680000000000001,"5min":1.49,"15min":1.5980000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.996,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.339,"5min":1.3839999999999999,"15min":14.776},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.042},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.3819999999999999,"5min":1.655,"15min":10.509},"last":0.78000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185457,"statfs":{"total":200000000,"available":189908397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":0.90600000000000003,"5min":1.0660000000000001,"15min":5.1029999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":4.9980000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60099999999999998,"15min":0.64300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23499999999999999},"max":{"1min":0.85899999999999999,"5min":1.032,"15min":4.2320000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25},"max":{"1min":1.0780000000000001,"5min":1.2949999999999999,"15min":3.3919999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3420000000000001,"15min":4.431},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.153,"5min":1.296,"15min":3.6579999999999999},"last":0.749}]},{"osd":4,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.2150000000000001,"15min":2.2970000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.91000000000000003,"15min":0.92400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.47699999999999998},"max":{"1min":1.0549999999999999,"5min":1.2210000000000001,"15min":4.5860000000000003},"last":0.85199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91200000000000003,"15min":0.90000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.2629999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94399999999999995,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1120000000000001,"5min":1.2130000000000001,"15min":5.2880000000000003},"last":0.97599999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":3.5649999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54400000000000004},"max":{"1min":1.117,"5min":1.3899999999999999,"15min":3.8340000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.113},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51500000000000001},"max":{"1min":1.6419999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.1359999999999999},"min":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.194,"5min":1.3680000000000001,"15min":11.622},"last":0.96599999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:25:32.009 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:25:32.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 -- 172.21.15.177:0/649299218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580af100 msgr2=0x7fbe58158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/649299218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580af100 0x7fbe58158170 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009840 tx=0x7fbe5001c800 comp rx=0 tx=0).stop 2023-10-25T16:25:32.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 -- 172.21.15.177:0/649299218 shutdown_connections 2023-10-25T16:25:32.129 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/649299218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580af100 0x7fbe58158170 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/649299218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe580cbfa0 0x7fbe580aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 -- 172.21.15.177:0/649299218 >> 172.21.15.177:0/649299218 conn(0x7fbe580b2450 msgr2=0x7fbe580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:32.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 -- 172.21.15.177:0/649299218 shutdown_connections 2023-10-25T16:25:32.130 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.130+0000 7fbe5eefa640 1 -- 172.21.15.177:0/649299218 wait complete. 2023-10-25T16:25:32.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 Processor -- start 2023-10-25T16:25:32.132 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- start start 2023-10-25T16:25:32.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe580af100 0x7fbe5814c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580cbfa0 0x7fbe58143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 0x7fbe58143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580ac140 con 0x7fbe5814e810 2023-10-25T16:25:32.133 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58144190 con 0x7fbe580cbfa0 2023-10-25T16:25:32.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580ad060 con 0x7fbe580af100 2023-10-25T16:25:32.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 0x7fbe58143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 0x7fbe58143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34228/0 (socket says 172.21.15.177:34228) 2023-10-25T16:25:32.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 -- 172.21.15.177:0/2656240281 learned_addr learned my addr 172.21.15.177:0/2656240281 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:32.134 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5cc96640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe580af100 0x7fbe5814c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe57fff640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580cbfa0 0x7fbe58143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 -- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe580af100 msgr2=0x7fbe5814c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe580af100 0x7fbe5814c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 -- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580cbfa0 msgr2=0x7fbe58143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.135 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580cbfa0 0x7fbe58143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 -- 172.21.15.177:0/2656240281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500094a0 con 0x7fbe5814e810 2023-10-25T16:25:32.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5d497640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 0x7fbe58143c50 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fbe5001d0a0 tx=0x7fbe500a6450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:32.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500b6070 con 0x7fbe5814e810 2023-10-25T16:25:32.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbe500a6640 con 0x7fbe5814e810 2023-10-25T16:25:32.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe580ab620 con 0x7fbe5814e810 2023-10-25T16:25:32.136 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50004290 con 0x7fbe5814e810 2023-10-25T16:25:32.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe580abb80 con 0x7fbe5814e810 2023-10-25T16:25:32.137 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe580ad220 con 0x7fbe5814e810 2023-10-25T16:25:32.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe50005040 con 0x7fbe5814e810 2023-10-25T16:25:32.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.134+0000 7fbe557fa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe38066470 0x7fbe38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.138+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbe5011e240 con 0x7fbe5814e810 2023-10-25T16:25:32.138 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.138+0000 7fbe5cc96640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe38066470 0x7fbe38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.138+0000 7fbe5cc96640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe38066470 0x7fbe38068930 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbe48002080 tx=0x7fbe48009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:32.139 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.142+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe500eb920 con 0x7fbe5814e810 2023-10-25T16:25:32.278 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.278+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe5804daf0 con 0x7fbe38066470 2023-10-25T16:25:32.284 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe557fa640 1 -- 172.21.15.177:0/2656240281 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48843 (secure 0 0 0) 0x7fbe5804daf0 con 0x7fbe38066470 2023-10-25T16:25:32.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:32.285 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:25:32.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe38066470 msgr2=0x7fbe38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe38066470 0x7fbe38068930 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbe48002080 tx=0x7fbe48009040 comp rx=0 tx=0).stop 2023-10-25T16:25:32.286 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 msgr2=0x7fbe58143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 0x7fbe58143c50 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fbe5001d0a0 tx=0x7fbe500a6450 comp rx=0 tx=0).stop 2023-10-25T16:25:32.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 shutdown_connections 2023-10-25T16:25:32.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbe38066470 0x7fbe38068930 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe5814e810 0x7fbe58143c50 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe580cbfa0 0x7fbe58143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 --2- 172.21.15.177:0/2656240281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe580af100 0x7fbe5814c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 >> 172.21.15.177:0/2656240281 conn(0x7fbe580b2450 msgr2=0x7fbe580b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:32.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 shutdown_connections 2023-10-25T16:25:32.288 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.290+0000 7fbe5eefa640 1 -- 172.21.15.177:0/2656240281 wait complete. 2023-10-25T16:25:32.302 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2023-10-25T16:25:30.870168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450266,"statfs":{"total":1600000000,"available":1485072642,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487222,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-122,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001878"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-10-25T16:25:28.844599+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:25:28.844599+0000","last_peered":"2023-10-25T16:25:28.844599+0000","last_clean":"2023-10-25T16:25:28.844599+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:25:28.844599+0000","last_undegraded":"2023-10-25T16:25:28.844599+0000","last_fullsized":"2023-10-25T16:25:28.844599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542297,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":0.35099999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":0.59299999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.58199999999999996}]}]},{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185457,"statfs":{"total":200000000,"available":189908397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.79600000000000004},"min":{"1min":0.499,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.24,"15min":1.256},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44800000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.534},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.1359999999999999,"5min":1.4259999999999999,"15min":1.647},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96699999999999997,"15min":0.93400000000000005},"min":{"1min":0.57599999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93300000000000005,"15min":0.873},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45500000000000002},"max":{"1min":1.4239999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.425,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.014,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.505},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.054},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.04,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64400000000000002,"5min":0.52000000000000002,"15min":0.44},"max":{"1min":1.2989999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.96599999999999997},"min":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.46300000000000002},"max":{"1min":1.397,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97599999999999998,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61899999999999999,"15min":0.55000000000000004},"max":{"1min":1.3360000000000001,"5min":1.696,"15min":1.7370000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.032,"15min":1.024},"min":{"1min":0.77200000000000002,"5min":0.66000000000000003,"15min":0.48899999999999999},"max":{"1min":1.288,"5min":1.681,"15min":1.681},"last":0.86399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.107,"15min":1.119},"min":{"1min":0.81699999999999995,"5min":0.70699999999999996,"15min":0.503},"max":{"1min":1.552,"5min":1.643,"15min":1.669},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1359999999999999,"15min":1.119},"min":{"1min":0.93999999999999995,"5min":0.68500000000000005,"15min":0.57099999999999995},"max":{"1min":1.3979999999999999,"5min":1.591,"15min":1.7490000000000001},"last":1.028}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19518,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175793,"statfs":{"total":200000000,"available":180013005,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.58599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2769999999999999,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":0.93700000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3660000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.91400000000000003},"min":{"1min":0.73999999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":10.667,"15min":10.667},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.026,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47999999999999998},"max":{"1min":1.181,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.075}]},{"osd":2,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.004,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.181,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":1.181},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0680000000000001,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1879999999999999,"5min":10.948,"15min":10.948},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.262,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1499999999999999,"15min":1.0800000000000001},"min":{"1min":0.76500000000000001,"5min":0.73699999999999999,"15min":0.54700000000000004},"max":{"1min":1.4299999999999999,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":0.97699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41499999999999998},"max":{"1min":1.3200000000000001,"5min":11.081,"15min":11.081},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.016,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44600000000000001},"max":{"1min":1.4910000000000001,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.139,"15min":1.083},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46899999999999997},"max":{"1min":1.579,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":0.90000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2609999999999999,"15min":1.147},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.46700000000000003},"max":{"1min":1.522,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.194,"5min":1.1819999999999999,"15min":1.103},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.45000000000000001},"max":{"1min":1.9259999999999999,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21566,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173745,"statfs":{"total":200000000,"available":177915853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":1.0489999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":2.1429999999999998,"15min":14.843},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88900000000000001,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.35499999999999998},"max":{"1min":1.117,"5min":2.8450000000000002,"15min":16.439},"last":0.91000000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91800000000000004,"15min":1.081},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.40100000000000002},"max":{"1min":1.389,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":0.91500000000000004},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.38200000000000001},"max":{"1min":1.175,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.88}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.95499999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.5},"max":{"1min":1.272,"5min":1.601,"15min":3.9529999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.1859999999999999,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.45400000000000001},"max":{"1min":1.24,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.083,"15min":1.226},"min":{"1min":0.70499999999999996,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.452,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0309999999999999,"15min":1.222},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.40999999999999998},"max":{"1min":1.302,"5min":1.9910000000000001,"15min":15.904},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.173},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.31},"max":{"1min":1.2909999999999999,"5min":7.9610000000000003,"15min":17.219999999999999},"last":1.101}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0349999999999999,"15min":1.196},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.52200000000000002},"max":{"1min":1.1910000000000001,"5min":4.5970000000000004,"15min":14.567},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.1519999999999999,"15min":1.343},"min":{"1min":0.77100000000000002,"5min":0.69499999999999995,"15min":0.56699999999999995},"max":{"1min":1.51,"5min":2.4079999999999999,"15min":15.089},"last":1.1180000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0189999999999999,"15min":1.2589999999999999},"min":{"1min":0.74099999999999999,"5min":0.48499999999999999,"15min":0.436},"max":{"1min":1.101,"5min":7.8730000000000002,"15min":17.492000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.70499999999999996,"5min":0.59499999999999997,"15min":0.36599999999999999},"max":{"1min":1.3560000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.01}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188081,"statfs":{"total":200000000,"available":192595917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.871,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48399999999999999},"max":{"1min":1.1299999999999999,"5min":1.292,"15min":1.47},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90700000000000003,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0009999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.875,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.1839999999999999,"5min":1.429,"15min":1.4990000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":0.92300000000000004},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.96399999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96299999999999997,"15min":0.93799999999999994},"min":{"1min":0.60699999999999998,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.2270000000000001,"5min":1.4219999999999999,"15min":1.5},"last":1.04},{"interface":"front","average":{"1min":0.872,"5min":0.89200000000000002,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.3140000000000001,"15min":1.518},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.58899999999999997,"5min":0.52700000000000002,"15min":0.313},"max":{"1min":1.716,"5min":1.716,"15min":2.6640000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.76500000000000001,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.373,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.95699999999999996,"15min":0.96699999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.40000000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.085},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.298,"5min":1.5600000000000001,"15min":1.8149999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.0780000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9278,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186033,"statfs":{"total":200000000,"available":190498765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.96799999999999997,"5min":1.093,"15min":1.093},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.67900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.222},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.67400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.19700000000000001},"max":{"1min":1.3109999999999999,"5min":1.425,"15min":1.425},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.76400000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.0649999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.747}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0429999999999999,"5min":1.1220000000000001,"15min":1.3560000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.054,"5min":1.2330000000000001,"15min":1.8260000000000001},"last":1.2}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.169},{"interface":"front","average":{"1min":1.014,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":1.2450000000000001,"5min":1.349,"15min":1.4710000000000001},"last":1.363}]},{"osd":5,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.93600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.45400000000000001},"max":{"1min":1.6060000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0049999999999999,"15min":0.97199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.278,"5min":1.278,"15min":1.4830000000000001},"last":1.131}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.92600000000000005},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.456},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.032,"15min":1.0009999999999999},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.5209999999999999,"5min":1.861,"15min":1.861},"last":1.3180000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0449999999999999,"15min":1.0089999999999999},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5660000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0269999999999999,"15min":0.98399999999999999},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181937,"statfs":{"total":200000000,"available":186304461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.4610000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.24299999999999999},"max":{"1min":1.0329999999999999,"5min":1.304,"15min":1.304},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.97299999999999998,"15min":1.4610000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75,"15min":0.70399999999999996},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.194,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70599999999999996,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.1399999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28000000000000003},"max":{"1min":1.0389999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1200000000000001,"15min":12.698},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0149999999999999},"min":{"1min":0.66900000000000004,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.252,"5min":1.4139999999999999,"15min":12.721},"last":0.875}]},{"osd":5,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2709999999999999,"5min":1.4530000000000001,"15min":1.546},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.28,"5min":1.325,"15min":2.206},"last":0.85999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":0.97099999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.49099999999999999},"max":{"1min":1.1890000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.997,"5min":1.0680000000000001,"15min":1.0309999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"max":{"1min":1.3680000000000001,"5min":1.49,"15min":1.5980000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.996,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.339,"5min":1.3839999999999999,"15min":14.776},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.042},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.3819999999999999,"5min":1.655,"15min":10.509},"last":0.78000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185457,"statfs":{"total":200000000,"available":189908397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":0.90600000000000003,"5min":1.0660000000000001,"15min":5.1029999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":4.9980000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60099999999999998,"15min":0.64300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23499999999999999},"max":{"1min":0.85899999999999999,"5min":1.032,"15min":4.2320000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25},"max":{"1min":1.0780000000000001,"5min":1.2949999999999999,"15min":3.3919999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3420000000000001,"15min":4.431},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.153,"5min":1.296,"15min":3.6579999999999999},"last":0.749}]},{"osd":4,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.2150000000000001,"15min":2.2970000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.91000000000000003,"15min":0.92400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.47699999999999998},"max":{"1min":1.0549999999999999,"5min":1.2210000000000001,"15min":4.5860000000000003},"last":0.85199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91200000000000003,"15min":0.90000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.2629999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94399999999999995,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1120000000000001,"5min":1.2130000000000001,"15min":5.2880000000000003},"last":0.97599999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":3.5649999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54400000000000004},"max":{"1min":1.117,"5min":1.3899999999999999,"15min":3.8340000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.113},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51500000000000001},"max":{"1min":1.6419999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.1359999999999999},"min":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.194,"5min":1.3680000000000001,"15min":11.622},"last":0.96599999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:25:32.304 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-25T16:25:32.304 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:25:32.413 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 -- 172.21.15.177:0/2345589512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462015eba0 msgr2=0x7f46200b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 --2- 172.21.15.177:0/2345589512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462015eba0 0x7f46200b4100 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f46200cb990 tx=0x7f461401c810 comp rx=0 tx=0).stop 2023-10-25T16:25:32.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 -- 172.21.15.177:0/2345589512 shutdown_connections 2023-10-25T16:25:32.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 --2- 172.21.15.177:0/2345589512 >> v2:172.21.15.184:3300/0 conn(0x7f46200cdb10 0x7f46200cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.414 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 --2- 172.21.15.177:0/2345589512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46200b2120 0x7f46200d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 --2- 172.21.15.177:0/2345589512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462015eba0 0x7f46200b4100 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 -- 172.21.15.177:0/2345589512 >> 172.21.15.177:0/2345589512 conn(0x7f462009a5c0 msgr2=0x7f46200d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:32.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 -- 172.21.15.177:0/2345589512 shutdown_connections 2023-10-25T16:25:32.415 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.414+0000 7f4625772640 1 -- 172.21.15.177:0/2345589512 wait complete. 2023-10-25T16:25:32.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 Processor -- start 2023-10-25T16:25:32.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- start start 2023-10-25T16:25:32.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 0x7f4620159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.418 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46200cdb10 0x7f4620152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462015eba0 0x7f462015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462006a680 con 0x7f46200b2120 2023-10-25T16:25:32.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462015a1f0 con 0x7f462015eba0 2023-10-25T16:25:32.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46200c9e80 con 0x7f46200cdb10 2023-10-25T16:25:32.419 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 0x7f4620159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 0x7f4620159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34254/0 (socket says 172.21.15.177:34254) 2023-10-25T16:25:32.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 -- 172.21.15.177:0/3048760180 learned_addr learned my addr 172.21.15.177:0/3048760180 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:32.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 -- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46200cdb10 msgr2=0x7f4620152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46200cdb10 0x7f4620152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.420 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 -- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462015eba0 msgr2=0x7f462015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462015eba0 0x7f462015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 -- 172.21.15.177:0/3048760180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009560 con 0x7f46200b2120 2023-10-25T16:25:32.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f461effd640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 0x7f4620159cb0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f4614009850 tx=0x7f46140a6730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:32.421 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46140053c0 con 0x7f46200b2120 2023-10-25T16:25:32.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4614005610 con 0x7f46200b2120 2023-10-25T16:25:32.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46200ca160 con 0x7f46200b2120 2023-10-25T16:25:32.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614004290 con 0x7f46200b2120 2023-10-25T16:25:32.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46200ca720 con 0x7f46200b2120 2023-10-25T16:25:32.422 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462004daf0 con 0x7f46200b2120 2023-10-25T16:25:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46140046d0 con 0x7f46200b2120 2023-10-25T16:25:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.418+0000 7f46077fe640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f460c066470 0x7f460c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.422+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f461411e320 con 0x7f46200b2120 2023-10-25T16:25:32.423 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.422+0000 7f461e7fc640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f460c066470 0x7f460c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.422+0000 7f461e7fc640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f460c066470 0x7f460c068930 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4620157520 tx=0x7f4610005b70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:32.424 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.422+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46140eba10 con 0x7f46200b2120 2023-10-25T16:25:32.567 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.570+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46200ce930 con 0x7f460c066470 2023-10-25T16:25:32.573 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.574+0000 7f46077fe640 1 -- 172.21.15.177:0/3048760180 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48843 (secure 0 0 0) 0x7f46200ce930 con 0x7f460c066470 2023-10-25T16:25:32.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:32.574 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:25:32.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f460c066470 msgr2=0x7f460c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.575 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f460c066470 0x7f460c068930 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4620157520 tx=0x7f4610005b70 comp rx=0 tx=0).stop 2023-10-25T16:25:32.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 msgr2=0x7f4620159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 0x7f4620159cb0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f4614009850 tx=0x7f46140a6730 comp rx=0 tx=0).stop 2023-10-25T16:25:32.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 shutdown_connections 2023-10-25T16:25:32.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f460c066470 0x7f460c068930 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.576 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f462015eba0 0x7f462015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46200cdb10 0x7f4620152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 --2- 172.21.15.177:0/3048760180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46200b2120 0x7f4620159cb0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 >> 172.21.15.177:0/3048760180 conn(0x7f462009a5c0 msgr2=0x7f46200d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:32.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 shutdown_connections 2023-10-25T16:25:32.577 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.578+0000 7f4625772640 1 -- 172.21.15.177:0/3048760180 wait complete. 2023-10-25T16:25:32.590 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2023-10-25T16:25:30.870168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112233,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450266,"statfs":{"total":1600000000,"available":1485072642,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487222,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-122,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001878"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-10-25T16:25:28.844599+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:25:28.844599+0000","last_peered":"2023-10-25T16:25:28.844599+0000","last_clean":"2023-10-25T16:25:28.844599+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:25:28.844599+0000","last_undegraded":"2023-10-25T16:25:28.844599+0000","last_fullsized":"2023-10-25T16:25:28.844599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542297,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21554,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173757,"statfs":{"total":200000000,"available":177927847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.63600000000000001,"15min":0.57299999999999995},"min":{"1min":0.52500000000000002,"5min":0.314,"15min":0.23100000000000001},"max":{"1min":0.95899999999999996,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.62},"min":{"1min":0.52200000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.86699999999999999,"5min":1.0489999999999999,"15min":1.077},"last":0.36399999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.63400000000000001},"min":{"1min":0.504,"5min":0.372,"15min":0.27000000000000002},"max":{"1min":1.0940000000000001,"5min":1.145,"15min":1.1759999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.64300000000000002},"min":{"1min":0.57399999999999995,"5min":0.33200000000000002,"15min":0.26400000000000001},"max":{"1min":1.0800000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.69099999999999995,"15min":0.64900000000000002},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.29599999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.246},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84099999999999997,"15min":0.72099999999999997},"min":{"1min":0.64500000000000002,"5min":0.36299999999999999,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.2729999999999999,"15min":1.345},"last":0.35099999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.89100000000000001},"min":{"1min":0.76100000000000001,"5min":0.59999999999999998,"15min":0.438},"max":{"1min":1.194,"5min":1.45,"15min":1.6120000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.96099999999999997,"15min":0.90500000000000003},"min":{"1min":0.84299999999999997,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.1439999999999999,"5min":1.3160000000000001,"15min":1.5760000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.91000000000000003,"15min":0.877},"min":{"1min":0.73599999999999999,"5min":0.499,"15min":0.499},"max":{"1min":1.135,"5min":1.46,"15min":1.4930000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.006,"15min":0.95599999999999996},"min":{"1min":0.85599999999999998,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.236,"5min":1.518,"15min":1.671},"last":0.59299999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0009999999999999,"15min":0.94299999999999995},"min":{"1min":0.78100000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.294,"5min":1.3029999999999999,"15min":1.5009999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.069,"5min":1.0109999999999999,"15min":0.95599999999999996},"min":{"1min":0.749,"5min":0.55900000000000005,"15min":0.53000000000000003},"max":{"1min":1.345,"5min":1.6639999999999999,"15min":1.8400000000000001},"last":0.63300000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:24:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0349999999999999,"15min":0.97299999999999998},"min":{"1min":0.83399999999999996,"5min":0.56899999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.3029999999999999,"15min":1.677},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.097,"5min":1.0369999999999999,"15min":0.99399999999999999},"min":{"1min":0.83899999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.284,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.58199999999999996}]}]},{"osd":7,"up_from":13,"seq":55834575001,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185457,"statfs":{"total":200000000,"available":189908397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.79600000000000004},"min":{"1min":0.499,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.24,"15min":1.256},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44800000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.534},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.1359999999999999,"5min":1.4259999999999999,"15min":1.647},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96699999999999997,"15min":0.93400000000000005},"min":{"1min":0.57599999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.92100000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93300000000000005,"15min":0.873},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45500000000000002},"max":{"1min":1.4239999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.006},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.425,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":1.0800000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.014,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.505},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.054},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.04,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64400000000000002,"5min":0.52000000000000002,"15min":0.44},"max":{"1min":1.2989999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.96599999999999997},"min":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.46300000000000002},"max":{"1min":1.397,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.75900000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97599999999999998,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61899999999999999,"15min":0.55000000000000004},"max":{"1min":1.3360000000000001,"5min":1.696,"15min":1.7370000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.032,"15min":1.024},"min":{"1min":0.77200000000000002,"5min":0.66000000000000003,"15min":0.48899999999999999},"max":{"1min":1.288,"5min":1.681,"15min":1.681},"last":0.86399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.107,"15min":1.119},"min":{"1min":0.81699999999999995,"5min":0.70699999999999996,"15min":0.503},"max":{"1min":1.552,"5min":1.643,"15min":1.669},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1359999999999999,"15min":1.119},"min":{"1min":0.93999999999999995,"5min":0.68500000000000005,"15min":0.57099999999999995},"max":{"1min":1.3979999999999999,"5min":1.591,"15min":1.7490000000000001},"last":1.028}]}]},{"osd":6,"up_from":13,"seq":55834575001,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19518,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175793,"statfs":{"total":200000000,"available":180013005,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.58599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2769999999999999,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":0.93700000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3660000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.91400000000000003},"min":{"1min":0.73999999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":10.667,"15min":10.667},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.026,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47999999999999998},"max":{"1min":1.181,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.075}]},{"osd":2,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.004,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.181,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":1.181},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0680000000000001,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1879999999999999,"5min":10.948,"15min":10.948},"last":1.0149999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.262,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.091,"5min":1.1499999999999999,"15min":1.0800000000000001},"min":{"1min":0.76500000000000001,"5min":0.73699999999999999,"15min":0.54700000000000004},"max":{"1min":1.4299999999999999,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.1020000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":0.97699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41499999999999998},"max":{"1min":1.3200000000000001,"5min":11.081,"15min":11.081},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0409999999999999}]},{"osd":5,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.016,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44600000000000001},"max":{"1min":1.4910000000000001,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.139,"15min":1.083},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46899999999999997},"max":{"1min":1.579,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":0.90000000000000002}]},{"osd":7,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2609999999999999,"15min":1.147},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.46700000000000003},"max":{"1min":1.522,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.194,"5min":1.1819999999999999,"15min":1.103},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.45000000000000001},"max":{"1min":1.9259999999999999,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21566,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173745,"statfs":{"total":200000000,"available":177915853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":1.0489999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":2.1429999999999998,"15min":14.843},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88900000000000001,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.35499999999999998},"max":{"1min":1.117,"5min":2.8450000000000002,"15min":16.439},"last":0.91000000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91800000000000004,"15min":1.081},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.40100000000000002},"max":{"1min":1.389,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":0.91500000000000004},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.38200000000000001},"max":{"1min":1.175,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.88}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.95499999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.5},"max":{"1min":1.272,"5min":1.601,"15min":3.9529999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.1859999999999999,"5min":1.921,"15min":1.921},"last":0.96899999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.45400000000000001},"max":{"1min":1.24,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.083,"15min":1.226},"min":{"1min":0.70499999999999996,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.452,"5min":1.8320000000000001,"15min":14.954000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0309999999999999,"15min":1.222},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.40999999999999998},"max":{"1min":1.302,"5min":1.9910000000000001,"15min":15.904},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.173},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.31},"max":{"1min":1.2909999999999999,"5min":7.9610000000000003,"15min":17.219999999999999},"last":1.101}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0349999999999999,"15min":1.196},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.52200000000000002},"max":{"1min":1.1910000000000001,"5min":4.5970000000000004,"15min":14.567},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.153,"5min":1.1519999999999999,"15min":1.343},"min":{"1min":0.77100000000000002,"5min":0.69499999999999995,"15min":0.56699999999999995},"max":{"1min":1.51,"5min":2.4079999999999999,"15min":15.089},"last":1.1180000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0189999999999999,"15min":1.2589999999999999},"min":{"1min":0.74099999999999999,"5min":0.48499999999999999,"15min":0.436},"max":{"1min":1.101,"5min":7.8730000000000002,"15min":17.492000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.70499999999999996,"5min":0.59499999999999997,"15min":0.36599999999999999},"max":{"1min":1.3560000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.01}]}]},{"osd":4,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7230,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188081,"statfs":{"total":200000000,"available":192595917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.871,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48399999999999999},"max":{"1min":1.1299999999999999,"5min":1.292,"15min":1.47},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90700000000000003,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0009999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.875,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.1839999999999999,"5min":1.429,"15min":1.4990000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":0.92300000000000004},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":0.96399999999999997}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96299999999999997,"15min":0.93799999999999994},"min":{"1min":0.60699999999999998,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.2270000000000001,"5min":1.4219999999999999,"15min":1.5},"last":1.04},{"interface":"front","average":{"1min":0.872,"5min":0.89200000000000002,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.3140000000000001,"15min":1.518},"last":0.94499999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.58899999999999997,"5min":0.52700000000000002,"15min":0.313},"max":{"1min":1.716,"5min":1.716,"15min":2.6640000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.76500000000000001,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.373,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":1.1830000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.95699999999999996,"15min":0.96699999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.40000000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.085},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.298,"5min":1.5600000000000001,"15min":1.8149999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.0780000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9278,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186033,"statfs":{"total":200000000,"available":190498765,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.96799999999999997,"5min":1.093,"15min":1.093},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.67900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.222},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.67400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.19700000000000001},"max":{"1min":1.3109999999999999,"5min":1.425,"15min":1.425},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.76400000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.0649999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.747}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0429999999999999,"5min":1.1220000000000001,"15min":1.3560000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.054,"5min":1.2330000000000001,"15min":1.8260000000000001},"last":1.2}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.169},{"interface":"front","average":{"1min":1.014,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":1.2450000000000001,"5min":1.349,"15min":1.4710000000000001},"last":1.363}]},{"osd":5,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.93600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.45400000000000001},"max":{"1min":1.6060000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.0049999999999999,"15min":0.97199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.278,"5min":1.278,"15min":1.4830000000000001},"last":1.131}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.92600000000000005},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.456},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.032,"15min":1.0009999999999999},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.5209999999999999,"5min":1.861,"15min":1.861},"last":1.3180000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0449999999999999,"15min":1.0089999999999999},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5660000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.028,"5min":1.0269999999999999,"15min":0.98399999999999999},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.389},"last":1.095}]}]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13374,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181937,"statfs":{"total":200000000,"available":186304461,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.4610000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.24299999999999999},"max":{"1min":1.0329999999999999,"5min":1.304,"15min":1.304},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.97299999999999998,"15min":1.4610000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75,"15min":0.70399999999999996},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.194,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70599999999999996,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.1399999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28000000000000003},"max":{"1min":1.0389999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.38200000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1200000000000001,"15min":12.698},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0149999999999999},"min":{"1min":0.66900000000000004,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.252,"5min":1.4139999999999999,"15min":12.721},"last":0.875}]},{"osd":5,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2709999999999999,"5min":1.4530000000000001,"15min":1.546},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.28,"5min":1.325,"15min":2.206},"last":0.85999999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":0.97099999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.49099999999999999},"max":{"1min":1.1890000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.997,"5min":1.0680000000000001,"15min":1.0309999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"max":{"1min":1.3680000000000001,"5min":1.49,"15min":1.5980000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.996,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.339,"5min":1.3839999999999999,"15min":14.776},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.042},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.3819999999999999,"5min":1.655,"15min":10.509},"last":0.78000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575001,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9855,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185457,"statfs":{"total":200000000,"available":189908397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":0.90600000000000003,"5min":1.0660000000000001,"15min":5.1029999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":4.9980000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60099999999999998,"15min":0.64300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23499999999999999},"max":{"1min":0.85899999999999999,"5min":1.032,"15min":4.2320000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25},"max":{"1min":1.0780000000000001,"5min":1.2949999999999999,"15min":3.3919999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3420000000000001,"15min":4.431},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.153,"5min":1.296,"15min":3.6579999999999999},"last":0.749}]},{"osd":4,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.2150000000000001,"15min":2.2970000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.91000000000000003,"15min":0.92400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.47699999999999998},"max":{"1min":1.0549999999999999,"5min":1.2210000000000001,"15min":4.5860000000000003},"last":0.85199999999999998}]},{"osd":5,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91200000000000003,"15min":0.90000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.2629999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94399999999999995,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1120000000000001,"5min":1.2130000000000001,"15min":5.2880000000000003},"last":0.97599999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":3.5649999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54400000000000004},"max":{"1min":1.117,"5min":1.3899999999999999,"15min":3.8340000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.113},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51500000000000001},"max":{"1min":1.6419999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.1359999999999999},"min":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.194,"5min":1.3680000000000001,"15min":11.622},"last":0.96599999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:25:32.592 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T16:25:32.702 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/273934335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc06b9e0 msgr2=0x7f4dfc06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 --2- 172.21.15.177:0/273934335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc06b9e0 0x7f4dfc06bdf0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0cd6c0 tx=0x7f4df401ccf0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/273934335 shutdown_connections 2023-10-25T16:25:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 --2- 172.21.15.177:0/273934335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc06b9e0 0x7f4dfc06bdf0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.703 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 --2- 172.21.15.177:0/273934335 >> v2:172.21.15.184:3300/0 conn(0x7f4dfc15cdd0 0x7f4dfc0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/273934335 >> 172.21.15.177:0/273934335 conn(0x7f4dfc0b2450 msgr2=0x7f4dfc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/273934335 shutdown_connections 2023-10-25T16:25:32.704 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/273934335 wait complete. 2023-10-25T16:25:32.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 Processor -- start 2023-10-25T16:25:32.706 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- start start 2023-10-25T16:25:32.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4dfc06b9e0 0x7f4dfc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 0x7f4dfc15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dfc15cdd0 0x7f4dfc15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0ab2c0 con 0x7f4dfc1537d0 2023-10-25T16:25:32.707 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc14a520 con 0x7f4dfc15cdd0 2023-10-25T16:25:32.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc14bfa0 con 0x7f4dfc06b9e0 2023-10-25T16:25:32.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 0x7f4dfc15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 0x7f4dfc15abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34260/0 (socket says 172.21.15.177:34260) 2023-10-25T16:25:32.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 -- 172.21.15.177:0/2633788869 learned_addr learned my addr 172.21.15.177:0/2633788869 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:32.708 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfb7fe640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4dfc06b9e0 0x7f4dfc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfbfff640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dfc15cdd0 0x7f4dfc15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 -- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4dfc06b9e0 msgr2=0x7f4dfc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4dfc06b9e0 0x7f4dfc0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 -- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dfc15cdd0 msgr2=0x7f4dfc15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.709 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dfc15cdd0 0x7f4dfc15b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 -- 172.21.15.177:0/2633788869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df40098e0 con 0x7f4dfc1537d0 2023-10-25T16:25:32.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfbfff640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dfc15cdd0 0x7f4dfc15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:32.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4dfaffd640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 0x7f4dfc15abc0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f4df000b410 tx=0x7f4df000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:32.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0005980 con 0x7f4dfc1537d0 2023-10-25T16:25:32.710 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4df0005bf0 con 0x7f4dfc1537d0 2023-10-25T16:25:32.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc14c280 con 0x7f4dfc1537d0 2023-10-25T16:25:32.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0006020 con 0x7f4dfc1537d0 2023-10-25T16:25:32.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.706+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc0ab7f0 con 0x7f4dfc1537d0 2023-10-25T16:25:32.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.710+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc0aba10 con 0x7f4dfc1537d0 2023-10-25T16:25:32.711 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.710+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4df0006180 con 0x7f4dfc1537d0 2023-10-25T16:25:32.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.710+0000 7f4de3fff640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4de8066470 0x7f4de8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:32.712 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.710+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4df0083b50 con 0x7f4dfc1537d0 2023-10-25T16:25:32.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.710+0000 7f4dfb7fe640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4de8066470 0x7f4de8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:32.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.710+0000 7f4dfb7fe640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4de8066470 0x7f4de8068930 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0016c0 tx=0x7f4dec009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:32.713 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.714+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4df00512e0 con 0x7f4dfc1537d0 2023-10-25T16:25:32.863 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.866+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dfc0ac3c0 con 0x7f4dfc1537d0 2023-10-25T16:25:32.864 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.866+0000 7f4de3fff640 1 -- 172.21.15.177:0/2633788869 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+13021 (secure 0 0 0) 0x7f4df0054900 con 0x7f4dfc1537d0 2023-10-25T16:25:32.864 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:32.865 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":197,"fsid":"da778784-be7e-4dcd-bc5a-18ed17fb00e4","created":"2023-10-25T16:12:47.819243+0000","modified":"2023-10-25T16:25:29.842945+0000","last_up_change":"2023-10-25T16:12:55.753030+0000","last_in_change":"2023-10-25T16:12:51.738823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T16:12:56.669215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6801","nonce":1702384414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6803","nonce":1702384414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6807","nonce":1702384414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":1702384414},{"type":"v1","addr":"172.21.15.177:6805","nonce":1702384414}]},"public_addr":"172.21.15.177:6801/1702384414","cluster_addr":"172.21.15.177:6803/1702384414","heartbeat_back_addr":"172.21.15.177:6807/1702384414","heartbeat_front_addr":"172.21.15.177:6805/1702384414","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6809","nonce":890639561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6811","nonce":890639561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6815","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6817","nonce":890639561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":890639561},{"type":"v1","addr":"172.21.15.177:6814","nonce":890639561}]},"public_addr":"172.21.15.177:6809/890639561","cluster_addr":"172.21.15.177:6811/890639561","heartbeat_back_addr":"172.21.15.177:6817/890639561","heartbeat_front_addr":"172.21.15.177:6814/890639561","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6816","nonce":1075656412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6819","nonce":1075656412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6823","nonce":1075656412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":1075656412},{"type":"v1","addr":"172.21.15.177:6821","nonce":1075656412}]},"public_addr":"172.21.15.177:6816/1075656412","cluster_addr":"172.21.15.177:6819/1075656412","heartbeat_back_addr":"172.21.15.177:6823/1075656412","heartbeat_front_addr":"172.21.15.177:6821/1075656412","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6825","nonce":3697255096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6827","nonce":3697255096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6831","nonce":3697255096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":3697255096},{"type":"v1","addr":"172.21.15.177:6829","nonce":3697255096}]},"public_addr":"172.21.15.177:6825/3697255096","cluster_addr":"172.21.15.177:6827/3697255096","heartbeat_back_addr":"172.21.15.177:6831/3697255096","heartbeat_front_addr":"172.21.15.177:6829/3697255096","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6825","nonce":3302258236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6827","nonce":3302258236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6831","nonce":3302258236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3302258236},{"type":"v1","addr":"172.21.15.184:6829","nonce":3302258236}]},"public_addr":"172.21.15.184:6825/3302258236","cluster_addr":"172.21.15.184:6827/3302258236","heartbeat_back_addr":"172.21.15.184:6831/3302258236","heartbeat_front_addr":"172.21.15.184:6829/3302258236","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6817","nonce":748323378}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6819","nonce":748323378}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6823","nonce":748323378}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":748323378},{"type":"v1","addr":"172.21.15.184:6821","nonce":748323378}]},"public_addr":"172.21.15.184:6817/748323378","cluster_addr":"172.21.15.184:6819/748323378","heartbeat_back_addr":"172.21.15.184:6823/748323378","heartbeat_front_addr":"172.21.15.184:6821/748323378","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6801","nonce":3199176706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6803","nonce":3199176706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6807","nonce":3199176706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3199176706},{"type":"v1","addr":"172.21.15.184:6805","nonce":3199176706}]},"public_addr":"172.21.15.184:6801/3199176706","cluster_addr":"172.21.15.184:6803/3199176706","heartbeat_back_addr":"172.21.15.184:6807/3199176706","heartbeat_front_addr":"172.21.15.184:6805/3199176706","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6809","nonce":435860171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6811","nonce":435860171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6815","nonce":435860171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":435860171},{"type":"v1","addr":"172.21.15.184:6813","nonce":435860171}]},"public_addr":"172.21.15.184:6809/435860171","cluster_addr":"172.21.15.184:6811/435860171","heartbeat_back_addr":"172.21.15.184:6815/435860171","heartbeat_front_addr":"172.21.15.184:6813/435860171","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.860211+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.885647+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.897245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.917273+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.858040+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.903189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.823214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T16:12:52.827212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6837/532461169":"2023-10-26T16:25:26.620082+0000","172.21.15.184:6836/532461169":"2023-10-26T16:25:26.620082+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T16:25:32.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4de8066470 msgr2=0x7f4de8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.866 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4de8066470 0x7f4de8068930 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0016c0 tx=0x7f4dec009040 comp rx=0 tx=0).stop 2023-10-25T16:25:32.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 msgr2=0x7f4dfc15abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:32.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 0x7f4dfc15abc0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f4df000b410 tx=0x7f4df000b8d0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 shutdown_connections 2023-10-25T16:25:32.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f4de8066470 0x7f4de8068930 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.867 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4dfc15cdd0 0x7f4dfc15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4dfc1537d0 0x7f4dfc15abc0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 --2- 172.21.15.177:0/2633788869 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4dfc06b9e0 0x7f4dfc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:32.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 >> 172.21.15.177:0/2633788869 conn(0x7f4dfc0b2450 msgr2=0x7f4dfc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:32.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 shutdown_connections 2023-10-25T16:25:32.868 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:32.870+0000 7f4e01af4640 1 -- 172.21.15.177:0/2633788869 wait complete. 2023-10-25T16:25:33.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:25:33.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:25:33.882 INFO:tasks.ceph:Scrubbing osd.0 2023-10-25T16:25:33.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 -- 172.21.15.177:0/2575558864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51780cd970 msgr2=0x7f51780ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 --2- 172.21.15.177:0/2575558864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51780cd970 0x7f51780ca960 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f5178071360 tx=0x7f516c01c7b0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 -- 172.21.15.177:0/2575558864 shutdown_connections 2023-10-25T16:25:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 --2- 172.21.15.177:0/2575558864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51780cd970 0x7f51780ca960 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 --2- 172.21.15.177:0/2575558864 >> v2:172.21.15.184:3300/0 conn(0x7f5178159690 0x7f51780b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 -- 172.21.15.177:0/2575558864 >> 172.21.15.177:0/2575558864 conn(0x7f51780b0b50 msgr2=0x7f51780b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 -- 172.21.15.177:0/2575558864 shutdown_connections 2023-10-25T16:25:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.022+0000 7f517c935640 1 -- 172.21.15.177:0/2575558864 wait complete. 2023-10-25T16:25:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 Processor -- start 2023-10-25T16:25:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- start start 2023-10-25T16:25:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51780caea0 0x7f51780c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5178159690 0x7f517814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f517814ec80 0x7f51780c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517814dc70 con 0x7f5178159690 2023-10-25T16:25:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517814e7f0 con 0x7f51780caea0 2023-10-25T16:25:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517814dec0 con 0x7f517814ec80 2023-10-25T16:25:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5178159690 0x7f517814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5178159690 0x7f517814d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34278/0 (socket says 172.21.15.177:34278) 2023-10-25T16:25:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 -- 172.21.15.177:0/4291054150 learned_addr learned my addr 172.21.15.177:0/4291054150 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 -- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f517814ec80 msgr2=0x7f51780c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f517814ec80 0x7f51780c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 -- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51780caea0 msgr2=0x7f51780c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517659c640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51780caea0 0x7f51780c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51780caea0 0x7f51780c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 -- 172.21.15.177:0/4291054150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0094a0 con 0x7f5178159690 2023-10-25T16:25:34.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5175d9b640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5178159690 0x7f517814d4d0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f516c000c10 tx=0x7f516c005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c004230 con 0x7f5178159690 2023-10-25T16:25:34.028 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f516c0044a0 con 0x7f5178159690 2023-10-25T16:25:34.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51780ae470 con 0x7f5178159690 2023-10-25T16:25:34.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c004930 con 0x7f5178159690 2023-10-25T16:25:34.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517814e480 con 0x7f5178159690 2023-10-25T16:25:34.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5178166570 con 0x7f5178159690 2023-10-25T16:25:34.029 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f516c0a57b0 con 0x7f5178159690 2023-10-25T16:25:34.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5158066470 0x7f5158068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f516c11f570 con 0x7f5178159690 2023-10-25T16:25:34.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f515806c2d0 0x7f515806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.031 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 --> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f515806eda0 con 0x7f515806c2d0 2023-10-25T16:25:34.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f516c11f9c0 con 0x7f5178159690 2023-10-25T16:25:34.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.026+0000 7f5176d9d640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f515806c2d0 0x7f515806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.030+0000 7f517659c640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5158066470 0x7f5158068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.030+0000 7f5176d9d640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f515806c2d0 0x7f515806e6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.032 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.030+0000 7f517659c640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5158066470 0x7f5158068930 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f51680058d0 tx=0x7f5168005860 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.030+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== osd.0 v2:172.21.15.177:6800/1702384414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f515806eda0 con 0x7f515806c2d0 2023-10-25T16:25:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.038+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 --> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f517814e960 con 0x7f515806c2d0 2023-10-25T16:25:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.038+0000 7f5166ffd640 1 -- 172.21.15.177:0/4291054150 <== osd.0 v2:172.21.15.177:6800/1702384414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f517814e960 con 0x7f515806c2d0 2023-10-25T16:25:34.038 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:34.038 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:34.038 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:34.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.038+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f515806c2d0 msgr2=0x7f515806e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.039 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.038+0000 7f517c935640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:6800/1702384414,v1:172.21.15.177:6801/1702384414] conn(0x7f515806c2d0 0x7f515806e6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5158066470 msgr2=0x7f5158068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f5158066470 0x7f5158068930 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f51680058d0 tx=0x7f5168005860 comp rx=0 tx=0).stop 2023-10-25T16:25:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5178159690 msgr2=0x7f517814d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 --2- 172.21.15.177:0/4291054150 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5178159690 0x7f517814d4d0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f516c000c10 tx=0x7f516c005730 comp rx=0 tx=0).stop 2023-10-25T16:25:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f5176d9d640 1 -- 172.21.15.177:0/4291054150 reap_dead start 2023-10-25T16:25:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 shutdown_connections 2023-10-25T16:25:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 >> 172.21.15.177:0/4291054150 conn(0x7f51780b0b50 msgr2=0x7f51780af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 shutdown_connections 2023-10-25T16:25:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.042+0000 7f517c935640 1 -- 172.21.15.177:0/4291054150 wait complete. 2023-10-25T16:25:34.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-25T16:25:34.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/1242599033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740c9ab0 msgr2=0x7f2d740cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 --2- 172.21.15.177:0/1242599033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740c9ab0 0x7f2d740cd150 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009840 tx=0x7f2d6801c740 comp rx=0 tx=0).stop 2023-10-25T16:25:34.171 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/1242599033 shutdown_connections 2023-10-25T16:25:34.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 --2- 172.21.15.177:0/1242599033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d740cd690 0x7f2d7415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 --2- 172.21.15.177:0/1242599033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740c9ab0 0x7f2d740cd150 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/1242599033 >> 172.21.15.177:0/1242599033 conn(0x7f2d740cf040 msgr2=0x7f2d740cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/1242599033 shutdown_connections 2023-10-25T16:25:34.172 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/1242599033 wait complete. 2023-10-25T16:25:34.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 Processor -- start 2023-10-25T16:25:34.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- start start 2023-10-25T16:25:34.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d740c9ab0 0x7f2d740adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 0x7f2d7406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.175 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159420 0x7f2d7406e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7414fd70 con 0x7f2d740cd690 2023-10-25T16:25:34.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741f2980 con 0x7f2d740c9ab0 2023-10-25T16:25:34.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d741f2c60 con 0x7f2d74159420 2023-10-25T16:25:34.176 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 0x7f2d7406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 0x7f2d7406e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34300/0 (socket says 172.21.15.177:34300) 2023-10-25T16:25:34.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 -- 172.21.15.177:0/237784897 learned_addr learned my addr 172.21.15.177:0/237784897 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:34.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d72d9d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d740c9ab0 0x7f2d740adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7359e640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159420 0x7f2d7406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.177 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 -- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159420 msgr2=0x7f2d7406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159420 0x7f2d7406e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 -- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d740c9ab0 msgr2=0x7f2d740adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d740c9ab0 0x7f2d740adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 -- 172.21.15.177:0/237784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680094a0 con 0x7f2d740cd690 2023-10-25T16:25:34.178 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7259c640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 0x7f2d7406e030 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009790 tx=0x7f2d68004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d680044f0 con 0x7f2d740cd690 2023-10-25T16:25:34.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2d68005030 con 0x7f2d740cd690 2023-10-25T16:25:34.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68005420 con 0x7f2d740cd690 2023-10-25T16:25:34.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d741f2f40 con 0x7f2d740cd690 2023-10-25T16:25:34.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.174+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7414d9a0 con 0x7f2d740cd690 2023-10-25T16:25:34.179 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.178+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d741568d0 con 0x7f2d740cd690 2023-10-25T16:25:34.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.178+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d680b4040 con 0x7f2d740cd690 2023-10-25T16:25:34.180 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.178+0000 7f2d5b7fe640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d600664a0 0x7f2d60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.178+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2d6811e1a0 con 0x7f2d740cd690 2023-10-25T16:25:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.178+0000 7f2d72d9d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d600664a0 0x7f2d60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.178+0000 7f2d72d9d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d600664a0 0x7f2d60068960 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2d64000f70 tx=0x7f2d64009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.182+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d680eb910 con 0x7f2d740cd690 2023-10-25T16:25:34.337 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.338+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d741f2af0 con 0x7f2d600664a0 2023-10-25T16:25:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d5b7fe640 1 -- 172.21.15.177:0/237784897 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2d741f2af0 con 0x7f2d600664a0 2023-10-25T16:25:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 0 to deep-scrub 2023-10-25T16:25:34.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d600664a0 msgr2=0x7f2d60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d600664a0 0x7f2d60068960 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2d64000f70 tx=0x7f2d64009040 comp rx=0 tx=0).stop 2023-10-25T16:25:34.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 msgr2=0x7f2d7406e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 0x7f2d7406e030 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009790 tx=0x7f2d68004040 comp rx=0 tx=0).stop 2023-10-25T16:25:34.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 shutdown_connections 2023-10-25T16:25:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2d600664a0 0x7f2d60068960 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d74159420 0x7f2d7406e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d740cd690 0x7f2d7406e030 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 --2- 172.21.15.177:0/237784897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d740c9ab0 0x7f2d740adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 >> 172.21.15.177:0/237784897 conn(0x7f2d740cf040 msgr2=0x7f2d7406eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 shutdown_connections 2023-10-25T16:25:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.342+0000 7f2d7917d640 1 -- 172.21.15.177:0/237784897 wait complete. 2023-10-25T16:25:34.356 INFO:tasks.ceph:Scrubbing osd.1 2023-10-25T16:25:34.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:34.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 -- 172.21.15.177:0/2189878620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 msgr2=0x7f256815fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 --2- 172.21.15.177:0/2189878620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256815fc60 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f256815f100 tx=0x7f256401c870 comp rx=0 tx=0).stop 2023-10-25T16:25:34.473 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 -- 172.21.15.177:0/2189878620 shutdown_connections 2023-10-25T16:25:34.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 --2- 172.21.15.177:0/2189878620 >> v2:172.21.15.184:3300/0 conn(0x7f25680cf830 0x7f25680cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 --2- 172.21.15.177:0/2189878620 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25680ccf00 0x7f25680d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 --2- 172.21.15.177:0/2189878620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256815fc60 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.474 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 -- 172.21.15.177:0/2189878620 >> 172.21.15.177:0/2189878620 conn(0x7f256809a5b0 msgr2=0x7f25680d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 -- 172.21.15.177:0/2189878620 shutdown_connections 2023-10-25T16:25:34.475 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.474+0000 7f256f0a3640 1 -- 172.21.15.177:0/2189878620 wait complete. 2023-10-25T16:25:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 Processor -- start 2023-10-25T16:25:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- start start 2023-10-25T16:25:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25680ccf00 0x7f256814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25680cf830 0x7f256814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.478 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256814e0b0 con 0x7f256815b6f0 2023-10-25T16:25:34.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256814d780 con 0x7f25680ccf00 2023-10-25T16:25:34.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256814da60 con 0x7f25680cf830 2023-10-25T16:25:34.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.479 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256814fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34324/0 (socket says 172.21.15.177:34324) 2023-10-25T16:25:34.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 -- 172.21.15.177:0/4174445110 learned_addr learned my addr 172.21.15.177:0/4174445110 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:34.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256ce3f640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25680ccf00 0x7f256814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255ffff640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25680cf830 0x7f256814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 -- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25680cf830 msgr2=0x7f256814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25680cf830 0x7f256814f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 -- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25680ccf00 msgr2=0x7f256814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25680ccf00 0x7f256814e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 -- 172.21.15.177:0/4174445110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564009560 con 0x7f256815b6f0 2023-10-25T16:25:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256ce3f640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25680ccf00 0x7f256814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256d640640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256814fad0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f256000ccb0 tx=0x7f256000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560004b30 con 0x7f256815b6f0 2023-10-25T16:25:34.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2560004da0 con 0x7f256815b6f0 2023-10-25T16:25:34.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256814dd40 con 0x7f256815b6f0 2023-10-25T16:25:34.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560005280 con 0x7f256815b6f0 2023-10-25T16:25:34.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2568153b70 con 0x7f256815b6f0 2023-10-25T16:25:34.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2568073360 con 0x7f256815b6f0 2023-10-25T16:25:34.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25600053e0 con 0x7f256815b6f0 2023-10-25T16:25:34.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2554066470 0x7f2554068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2560084900 con 0x7f256815b6f0 2023-10-25T16:25:34.483 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f255406c2d0 0x7f255406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 --> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f255406eda0 con 0x7f255406c2d0 2023-10-25T16:25:34.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.478+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2560084d50 con 0x7f256815b6f0 2023-10-25T16:25:34.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.482+0000 7f256ce3f640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2554066470 0x7f2554068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.482+0000 7f255ffff640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f255406c2d0 0x7f255406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.482+0000 7f255ffff640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f255406c2d0 0x7f255406e6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.482+0000 7f256ce3f640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2554066470 0x7f2554068930 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f25640af000 tx=0x7f256401b0b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.482+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== osd.1 v2:172.21.15.177:6808/890639561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f255406eda0 con 0x7f255406c2d0 2023-10-25T16:25:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 --> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f256814e1f0 con 0x7f255406c2d0 2023-10-25T16:25:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f255d7fa640 1 -- 172.21.15.177:0/4174445110 <== osd.1 v2:172.21.15.177:6808/890639561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f256814e1f0 con 0x7f255406c2d0 2023-10-25T16:25:34.489 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:34.490 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:34.490 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:34.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f255406c2d0 msgr2=0x7f255406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:6808/890639561,v1:172.21.15.177:6809/890639561] conn(0x7f255406c2d0 0x7f255406e6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2554066470 msgr2=0x7f2554068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f2554066470 0x7f2554068930 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f25640af000 tx=0x7f256401b0b0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 msgr2=0x7f256814fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 --2- 172.21.15.177:0/4174445110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f256815b6f0 0x7f256814fad0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f256000ccb0 tx=0x7f256000a620 comp rx=0 tx=0).stop 2023-10-25T16:25:34.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256d640640 1 -- 172.21.15.177:0/4174445110 reap_dead start 2023-10-25T16:25:34.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 shutdown_connections 2023-10-25T16:25:34.492 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 >> 172.21.15.177:0/4174445110 conn(0x7f256809a5b0 msgr2=0x7f256815e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 shutdown_connections 2023-10-25T16:25:34.493 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.490+0000 7f256f0a3640 1 -- 172.21.15.177:0/4174445110 wait complete. 2023-10-25T16:25:34.504 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-25T16:25:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/4289264324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440cdb10 msgr2=0x7f8d440cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/4289264324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440cdb10 0x7f8d440cdfc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009bc0 tx=0x7f8d3c01caf0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/4289264324 shutdown_connections 2023-10-25T16:25:34.611 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/4289264324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440cdb10 0x7f8d440cdfc0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/4289264324 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d4415eba0 0x7f8d440b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/4289264324 >> 172.21.15.177:0/4289264324 conn(0x7f8d4409a5c0 msgr2=0x7f8d440d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/4289264324 shutdown_connections 2023-10-25T16:25:34.612 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/4289264324 wait complete. 2023-10-25T16:25:34.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 Processor -- start 2023-10-25T16:25:34.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- start start 2023-10-25T16:25:34.614 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440b2120 0x7f8d440c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 0x7f8d44158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d4415eba0 0x7f8d440b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4415a330 con 0x7f8d440cdb10 2023-10-25T16:25:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440c6150 con 0x7f8d440b2120 2023-10-25T16:25:34.615 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d44159410 con 0x7f8d4415eba0 2023-10-25T16:25:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 0x7f8d44158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 0x7f8d44158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34334/0 (socket says 172.21.15.177:34334) 2023-10-25T16:25:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 -- 172.21.15.177:0/637773808 learned_addr learned my addr 172.21.15.177:0/637773808 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4918c640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440b2120 0x7f8d440c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.616 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4998d640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d4415eba0 0x7f8d440b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 -- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d4415eba0 msgr2=0x7f8d440b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d4415eba0 0x7f8d440b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 -- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440b2120 msgr2=0x7f8d440c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440b2120 0x7f8d440c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.617 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 -- 172.21.15.177:0/637773808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c009820 con 0x7f8d440cdb10 2023-10-25T16:25:34.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4898b640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 0x7f8d44158ed0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c480 tx=0x7f8d4000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40012830 con 0x7f8d440cdb10 2023-10-25T16:25:34.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8d40012a80 con 0x7f8d440cdb10 2023-10-25T16:25:34.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d441596b0 con 0x7f8d440cdb10 2023-10-25T16:25:34.618 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40011380 con 0x7f8d440cdb10 2023-10-25T16:25:34.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.614+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d44159c70 con 0x7f8d440cdb10 2023-10-25T16:25:34.619 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.618+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4415a470 con 0x7f8d440cdb10 2023-10-25T16:25:34.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.618+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d400114e0 con 0x7f8d440cdb10 2023-10-25T16:25:34.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.618+0000 7f8d39ffb640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d28066470 0x7f8d28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.618+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d40083cf0 con 0x7f8d440cdb10 2023-10-25T16:25:34.620 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.618+0000 7f8d4918c640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d28066470 0x7f8d28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.618+0000 7f8d4918c640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d28066470 0x7f8d28068930 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009ad0 tx=0x7f8d340091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.621 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.622+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d4415a470 con 0x7f8d440cdb10 2023-10-25T16:25:34.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.770+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d4415a470 con 0x7f8d28066470 2023-10-25T16:25:34.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.770+0000 7f8d39ffb640 1 -- 172.21.15.177:0/637773808 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8d4415a470 con 0x7f8d28066470 2023-10-25T16:25:34.770 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 1 to deep-scrub 2023-10-25T16:25:34.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d28066470 msgr2=0x7f8d28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d28066470 0x7f8d28068930 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009ad0 tx=0x7f8d340091e0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 msgr2=0x7f8d44158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 0x7f8d44158ed0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c480 tx=0x7f8d4000c940 comp rx=0 tx=0).stop 2023-10-25T16:25:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 shutdown_connections 2023-10-25T16:25:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f8d28066470 0x7f8d28068930 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d4415eba0 0x7f8d440b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d440cdb10 0x7f8d44158ed0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 --2- 172.21.15.177:0/637773808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d440b2120 0x7f8d440c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 >> 172.21.15.177:0/637773808 conn(0x7f8d4409a5c0 msgr2=0x7f8d440d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 shutdown_connections 2023-10-25T16:25:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.774+0000 7f8d4b3f0640 1 -- 172.21.15.177:0/637773808 wait complete. 2023-10-25T16:25:34.786 INFO:tasks.ceph:Scrubbing osd.2 2023-10-25T16:25:34.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:34.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- 172.21.15.177:0/19033836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100ac130 msgr2=0x7fb6100cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 --2- 172.21.15.177:0/19033836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100ac130 0x7fb6100cd130 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fb604009960 tx=0x7fb60401c750 comp rx=0 tx=0).stop 2023-10-25T16:25:34.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- 172.21.15.177:0/19033836 shutdown_connections 2023-10-25T16:25:34.912 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 --2- 172.21.15.177:0/19033836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6100cd670 0x7fb6100a9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 --2- 172.21.15.177:0/19033836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100ac130 0x7fb6100cd130 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- 172.21.15.177:0/19033836 >> 172.21.15.177:0/19033836 conn(0x7fb610069920 msgr2=0x7fb610069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- 172.21.15.177:0/19033836 shutdown_connections 2023-10-25T16:25:34.913 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- 172.21.15.177:0/19033836 wait complete. 2023-10-25T16:25:34.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 Processor -- start 2023-10-25T16:25:34.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- start start 2023-10-25T16:25:34.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6100ac130 0x7fb6101514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.916 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100cd670 0x7fb61006cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb610159390 0x7fb61014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb610158ff0 con 0x7fb6100cd670 2023-10-25T16:25:34.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61006b520 con 0x7fb610159390 2023-10-25T16:25:34.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb615207640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61006b770 con 0x7fb6100ac130 2023-10-25T16:25:34.917 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.914+0000 7fb60e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100cd670 0x7fb61006cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100cd670 0x7fb61006cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34348/0 (socket says 172.21.15.177:34348) 2023-10-25T16:25:34.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 -- 172.21.15.177:0/638022138 learned_addr learned my addr 172.21.15.177:0/638022138 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:34.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60ed9d640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6100ac130 0x7fb6101514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60f59e640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb610159390 0x7fb61014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 -- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6100ac130 msgr2=0x7fb6101514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6100ac130 0x7fb6101514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 -- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb610159390 msgr2=0x7fb61014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb610159390 0x7fb61014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 -- 172.21.15.177:0/638022138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604009560 con 0x7fb6100cd670 2023-10-25T16:25:34.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60ed9d640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6100ac130 0x7fb6101514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:34.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60f59e640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb610159390 0x7fb61014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:34.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60e59c640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100cd670 0x7fb61006cb50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fb60401cc30 tx=0x7fb6040a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604004380 con 0x7fb6100cd670 2023-10-25T16:25:34.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb604003600 con 0x7fb6100cd670 2023-10-25T16:25:34.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61006ba50 con 0x7fb6100cd670 2023-10-25T16:25:34.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040039f0 con 0x7fb6100cd670 2023-10-25T16:25:34.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61006c010 con 0x7fb6100cd670 2023-10-25T16:25:34.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb610168670 con 0x7fb6100cd670 2023-10-25T16:25:34.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6040b4040 con 0x7fb6100cd670 2023-10-25T16:25:34.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5fc066470 0x7fb5fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb60411e480 con 0x7fb6100cd670 2023-10-25T16:25:34.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7fb5fc06c2d0 0x7fb5fc06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:34.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 --> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5fc06eda0 con 0x7fb5fc06c2d0 2023-10-25T16:25:34.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6041209e0 con 0x7fb6100cd670 2023-10-25T16:25:34.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60f59e640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7fb5fc06c2d0 0x7fb5fc06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60ed9d640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5fc066470 0x7fb5fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:34.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60f59e640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7fb5fc06c2d0 0x7fb5fc06e6f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb60ed9d640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5fc066470 0x7fb5fc068930 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb600007fd0 tx=0x7fb600009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:34.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.918+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== osd.2 v2:172.21.15.177:6813/1075656412 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fb5fc06eda0 con 0x7fb5fc06c2d0 2023-10-25T16:25:34.929 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.930+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 --> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb610073360 con 0x7fb5fc06c2d0 2023-10-25T16:25:34.930 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb5f77fe640 1 -- 172.21.15.177:0/638022138 <== osd.2 v2:172.21.15.177:6813/1075656412 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7fb610073360 con 0x7fb5fc06c2d0 2023-10-25T16:25:34.930 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:34.931 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:34.931 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:34.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7fb5fc06c2d0 msgr2=0x7fb5fc06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:6813/1075656412,v1:172.21.15.177:6816/1075656412] conn(0x7fb5fc06c2d0 0x7fb5fc06e6f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5fc066470 msgr2=0x7fb5fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.932 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fb5fc066470 0x7fb5fc068930 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb600007fd0 tx=0x7fb600009040 comp rx=0 tx=0).stop 2023-10-25T16:25:34.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100cd670 msgr2=0x7fb61006cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:34.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 --2- 172.21.15.177:0/638022138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb6100cd670 0x7fb61006cb50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fb60401cc30 tx=0x7fb6040a57d0 comp rx=0 tx=0).stop 2023-10-25T16:25:34.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb60f59e640 1 -- 172.21.15.177:0/638022138 reap_dead start 2023-10-25T16:25:34.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 shutdown_connections 2023-10-25T16:25:34.933 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 >> 172.21.15.177:0/638022138 conn(0x7fb610069920 msgr2=0x7fb61015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:34.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 shutdown_connections 2023-10-25T16:25:34.934 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:34.934+0000 7fb615207640 1 -- 172.21.15.177:0/638022138 wait complete. 2023-10-25T16:25:34.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-25T16:25:35.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- 172.21.15.177:0/256320007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cb770 msgr2=0x7f46e015bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 --2- 172.21.15.177:0/256320007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cb770 0x7f46e015bce0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f46e00716a0 tx=0x7f46c801c830 comp rx=0 tx=0).stop 2023-10-25T16:25:35.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- 172.21.15.177:0/256320007 shutdown_connections 2023-10-25T16:25:35.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 --2- 172.21.15.177:0/256320007 >> v2:172.21.15.184:3300/0 conn(0x7f46e015c220 0x7f46e00b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 --2- 172.21.15.177:0/256320007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e00cb770 0x7f46e015bce0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- 172.21.15.177:0/256320007 >> 172.21.15.177:0/256320007 conn(0x7f46e00afc40 msgr2=0x7f46e00b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- 172.21.15.177:0/256320007 shutdown_connections 2023-10-25T16:25:35.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- 172.21.15.177:0/256320007 wait complete. 2023-10-25T16:25:35.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 Processor -- start 2023-10-25T16:25:35.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- start start 2023-10-25T16:25:35.058 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00cb770 0x7f46e0138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e0141b50 0x7f46e0152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 0x7f46e01372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0156120 con 0x7f46e015c220 2023-10-25T16:25:35.059 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0139860 con 0x7f46e0141b50 2023-10-25T16:25:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0139b40 con 0x7f46e00cb770 2023-10-25T16:25:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 0x7f46e01372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 0x7f46e01372e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34370/0 (socket says 172.21.15.177:34370) 2023-10-25T16:25:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 -- 172.21.15.177:0/4167484595 learned_addr learned my addr 172.21.15.177:0/4167484595 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46d7fff640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e0141b50 0x7f46e0152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.060 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46ded9d640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00cb770 0x7f46e0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 -- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00cb770 msgr2=0x7f46e0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00cb770 0x7f46e0138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 -- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e0141b50 msgr2=0x7f46e0152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e0141b50 0x7f46e0152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.061 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 -- 172.21.15.177:0/4167484595 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c8009560 con 0x7f46e015c220 2023-10-25T16:25:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46d7fff640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e0141b50 0x7f46e0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46df59e640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 0x7f46e01372e0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f46d800b970 tx=0x7f46d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800cb40 con 0x7f46e015c220 2023-10-25T16:25:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f46d800cdb0 con 0x7f46e015c220 2023-10-25T16:25:35.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e0139e20 con 0x7f46e015c220 2023-10-25T16:25:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.058+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80146a0 con 0x7f46e015c220 2023-10-25T16:25:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e013f8b0 con 0x7f46e015c220 2023-10-25T16:25:35.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e0066b20 con 0x7f46e015c220 2023-10-25T16:25:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46d801d3b0 con 0x7f46e015c220 2023-10-25T16:25:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46d77fe640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46c0066470 0x7f46c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.064 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f46d8083c80 con 0x7f46e015c220 2023-10-25T16:25:35.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46ded9d640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46c0066470 0x7f46c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.062+0000 7f46ded9d640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46c0066470 0x7f46c0068930 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f46d0001600 tx=0x7f46d0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.066+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46d8051490 con 0x7f46e015c220 2023-10-25T16:25:35.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.206+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f46e00b3190 con 0x7f46c0066470 2023-10-25T16:25:35.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.206+0000 7f46d77fe640 1 -- 172.21.15.177:0/4167484595 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46d00050d0 con 0x7f46c0066470 2023-10-25T16:25:35.205 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 2 to deep-scrub 2023-10-25T16:25:35.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46c0066470 msgr2=0x7f46c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46c0066470 0x7f46c0068930 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f46d0001600 tx=0x7f46d0009040 comp rx=0 tx=0).stop 2023-10-25T16:25:35.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 msgr2=0x7f46e01372e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 0x7f46e01372e0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f46d800b970 tx=0x7f46d800be30 comp rx=0 tx=0).stop 2023-10-25T16:25:35.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 shutdown_connections 2023-10-25T16:25:35.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f46c0066470 0x7f46c0068930 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e015c220 0x7f46e01372e0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46e0141b50 0x7f46e0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 --2- 172.21.15.177:0/4167484595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f46e00cb770 0x7f46e0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 >> 172.21.15.177:0/4167484595 conn(0x7f46e00afc40 msgr2=0x7f46e00cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 shutdown_connections 2023-10-25T16:25:35.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.210+0000 7f46e509f640 1 -- 172.21.15.177:0/4167484595 wait complete. 2023-10-25T16:25:35.222 INFO:tasks.ceph:Scrubbing osd.3 2023-10-25T16:25:35.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:35.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 -- 172.21.15.177:0/1615821850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 msgr2=0x7fc1a0071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.340 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 --2- 172.21.15.177:0/1615821850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a0071110 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fc19000a950 tx=0x7fc19001db20 comp rx=0 tx=0).stop 2023-10-25T16:25:35.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 -- 172.21.15.177:0/1615821850 shutdown_connections 2023-10-25T16:25:35.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 --2- 172.21.15.177:0/1615821850 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1a00c9f40 0x7fc1a00afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 --2- 172.21.15.177:0/1615821850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a0071110 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 -- 172.21.15.177:0/1615821850 >> 172.21.15.177:0/1615821850 conn(0x7fc1a0069920 msgr2=0x7fc1a0069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 -- 172.21.15.177:0/1615821850 shutdown_connections 2023-10-25T16:25:35.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 -- 172.21.15.177:0/1615821850 wait complete. 2023-10-25T16:25:35.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 Processor -- start 2023-10-25T16:25:35.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.342+0000 7fc1a66fa640 1 -- start start 2023-10-25T16:25:35.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1a006c3a0 0x7fc1a0151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1a00c9f40 0x7fc1a0139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a00b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0147200 con 0x7fc1a0157a80 2023-10-25T16:25:35.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a014e070 con 0x7fc1a006c3a0 2023-10-25T16:25:35.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a014e350 con 0x7fc1a00c9f40 2023-10-25T16:25:35.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a00b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a00b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34390/0 (socket says 172.21.15.177:34390) 2023-10-25T16:25:35.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 -- 172.21.15.177:0/2673498643 learned_addr learned my addr 172.21.15.177:0/2673498643 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:35.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1977fe640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1a00c9f40 0x7fc1a0139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19ffff640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1a006c3a0 0x7fc1a0151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 -- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1a00c9f40 msgr2=0x7fc1a0139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1a00c9f40 0x7fc1a0139670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 -- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1a006c3a0 msgr2=0x7fc1a0151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1a006c3a0 0x7fc1a0151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 -- 172.21.15.177:0/2673498643 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19000a5b0 con 0x7fc1a0157a80 2023-10-25T16:25:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a4c97640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a00b10d0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fc19800e9f0 tx=0x7fc19800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800cd80 con 0x7fc1a0157a80 2023-10-25T16:25:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc198004b30 con 0x7fc1a0157a80 2023-10-25T16:25:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a014e630 con 0x7fc1a0157a80 2023-10-25T16:25:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198005020 con 0x7fc1a0157a80 2023-10-25T16:25:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a014ebf0 con 0x7fc1a0157a80 2023-10-25T16:25:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1a0073360 con 0x7fc1a0157a80 2023-10-25T16:25:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc198005180 con 0x7fc1a0157a80 2023-10-25T16:25:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc180066470 0x7fc180068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc198084b30 con 0x7fc1a0157a80 2023-10-25T16:25:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fc18006c2d0 0x7fc18006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 --> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc18006eda0 con 0x7fc18006c2d0 2023-10-25T16:25:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc198084f80 con 0x7fc1a0157a80 2023-10-25T16:25:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19ffff640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc180066470 0x7fc180068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1977fe640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fc18006c2d0 0x7fc18006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc1977fe640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fc18006c2d0 0x7fc18006e6f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.346+0000 7fc19ffff640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc180066470 0x7fc180068930 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc1900b0000 tx=0x7fc19001c360 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.350+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== osd.3 v2:172.21.15.177:6824/3697255096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fc18006eda0 con 0x7fc18006c2d0 2023-10-25T16:25:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 --> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc1a014ed80 con 0x7fc18006c2d0 2023-10-25T16:25:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc19d7fa640 1 -- 172.21.15.177:0/2673498643 <== osd.3 v2:172.21.15.177:6824/3697255096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7fc1a014ed80 con 0x7fc18006c2d0 2023-10-25T16:25:35.357 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:35.357 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:35.357 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fc18006c2d0 msgr2=0x7fc18006e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:6824/3697255096,v1:172.21.15.177:6825/3697255096] conn(0x7fc18006c2d0 0x7fc18006e6f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc180066470 msgr2=0x7fc180068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fc180066470 0x7fc180068930 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc1900b0000 tx=0x7fc19001c360 comp rx=0 tx=0).stop 2023-10-25T16:25:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 msgr2=0x7fc1a00b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 --2- 172.21.15.177:0/2673498643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1a0157a80 0x7fc1a00b10d0 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fc19800e9f0 tx=0x7fc19800eeb0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a4c97640 1 -- 172.21.15.177:0/2673498643 reap_dead start 2023-10-25T16:25:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 shutdown_connections 2023-10-25T16:25:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 >> 172.21.15.177:0/2673498643 conn(0x7fc1a0069920 msgr2=0x7fc1a006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 shutdown_connections 2023-10-25T16:25:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.358+0000 7fc1a66fa640 1 -- 172.21.15.177:0/2673498643 wait complete. 2023-10-25T16:25:35.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-25T16:25:35.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 -- 172.21.15.177:0/2873505653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 msgr2=0x7f77c0070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.480 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2873505653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0070620 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f77c006c4f0 tx=0x7f77b401c720 comp rx=0 tx=0).stop 2023-10-25T16:25:35.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 -- 172.21.15.177:0/2873505653 shutdown_connections 2023-10-25T16:25:35.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2873505653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0070620 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2873505653 >> v2:172.21.15.184:3300/0 conn(0x7f77c01581a0 0x7f77c00cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 -- 172.21.15.177:0/2873505653 >> 172.21.15.177:0/2873505653 conn(0x7f77c00cdf10 msgr2=0x7f77c00ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.481 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 -- 172.21.15.177:0/2873505653 shutdown_connections 2023-10-25T16:25:35.482 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 -- 172.21.15.177:0/2873505653 wait complete. 2023-10-25T16:25:35.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 Processor -- start 2023-10-25T16:25:35.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.482+0000 7f77c4da6640 1 -- start start 2023-10-25T16:25:35.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77c0070b60 0x7f77c014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.484 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c01581a0 0x7f77c014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c014d4c0 con 0x7f77c00715f0 2023-10-25T16:25:35.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c014e950 con 0x7f77c01581a0 2023-10-25T16:25:35.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c014ec30 con 0x7f77c0070b60 2023-10-25T16:25:35.485 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34410/0 (socket says 172.21.15.177:34410) 2023-10-25T16:25:35.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 -- 172.21.15.177:0/2805105496 learned_addr learned my addr 172.21.15.177:0/2805105496 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:35.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 -- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77c0070b60 msgr2=0x7f77c014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77c0070b60 0x7f77c014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.486 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 -- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c01581a0 msgr2=0x7f77c014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c01581a0 0x7f77c014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 -- 172.21.15.177:0/2805105496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40094a0 con 0x7f77c00715f0 2023-10-25T16:25:35.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77bdd9b640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0148fb0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000c10 tx=0x7f77b40a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4004400 con 0x7f77c00715f0 2023-10-25T16:25:35.487 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77b4005030 con 0x7f77c00715f0 2023-10-25T16:25:35.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c014ef10 con 0x7f77c00715f0 2023-10-25T16:25:35.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40053a0 con 0x7f77c00715f0 2023-10-25T16:25:35.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c01494f0 con 0x7f77c00715f0 2023-10-25T16:25:35.488 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c014ed70 con 0x7f77c00715f0 2023-10-25T16:25:35.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77b40b4040 con 0x7f77c00715f0 2023-10-25T16:25:35.489 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77aeffd640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77a0066470 0x7f77a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f77b411dc80 con 0x7f77c00715f0 2023-10-25T16:25:35.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.486+0000 7f77be59c640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77a0066470 0x7f77a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.490+0000 7f77be59c640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77a0066470 0x7f77a0068930 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009690 tx=0x7f77b0006c00 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.490 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.490+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77c014ed70 con 0x7f77c00715f0 2023-10-25T16:25:35.631 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.634+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f77c014eac0 con 0x7f77a0066470 2023-10-25T16:25:35.632 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.634+0000 7f77aeffd640 1 -- 172.21.15.177:0/2805105496 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f77c014eac0 con 0x7f77a0066470 2023-10-25T16:25:35.632 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 3 to deep-scrub 2023-10-25T16:25:35.634 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77a0066470 msgr2=0x7f77a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77a0066470 0x7f77a0068930 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009690 tx=0x7f77b0006c00 comp rx=0 tx=0).stop 2023-10-25T16:25:35.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 msgr2=0x7f77c0148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0148fb0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000c10 tx=0x7f77b40a5810 comp rx=0 tx=0).stop 2023-10-25T16:25:35.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 shutdown_connections 2023-10-25T16:25:35.635 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f77a0066470 0x7f77a0068930 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77c01581a0 0x7f77c014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77c00715f0 0x7f77c0148fb0 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 --2- 172.21.15.177:0/2805105496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77c0070b60 0x7f77c014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 >> 172.21.15.177:0/2805105496 conn(0x7f77c00cdf10 msgr2=0x7f77c0151740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.636 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 shutdown_connections 2023-10-25T16:25:35.637 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.638+0000 7f77c4da6640 1 -- 172.21.15.177:0/2805105496 wait complete. 2023-10-25T16:25:35.649 INFO:tasks.ceph:Scrubbing osd.4 2023-10-25T16:25:35.650 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:35.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.766+0000 7f618b6b1640 1 -- 172.21.15.177:0/2486602325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 msgr2=0x7f617000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.766+0000 7f618b6b1640 1 --2- 172.21.15.177:0/2486602325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f617000b990 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f617c001d70 tx=0x7f617c01cae0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2486602325 shutdown_connections 2023-10-25T16:25:35.766 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 --2- 172.21.15.177:0/2486602325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f617000b990 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2486602325 >> 172.21.15.177:0/2486602325 conn(0x7f618409a5b0 msgr2=0x7f61840d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2486602325 shutdown_connections 2023-10-25T16:25:35.767 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2486602325 wait complete. 2023-10-25T16:25:35.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 Processor -- start 2023-10-25T16:25:35.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- start start 2023-10-25T16:25:35.769 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f61840c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61840b1180 0x7f61841f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61841f5130 0x7f61840b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840b57e0 con 0x7f6170005190 2023-10-25T16:25:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841f5640 con 0x7f61840b1180 2023-10-25T16:25:35.770 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61841f5920 con 0x7f61841f5130 2023-10-25T16:25:35.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f61840c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f61840c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34430/0 (socket says 172.21.15.177:34430) 2023-10-25T16:25:35.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 -- 172.21.15.177:0/2998940537 learned_addr learned my addr 172.21.15.177:0/2998940537 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:35.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f6189c4e640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61841f5130 0x7f61840b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.771 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f6188c4c640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61840b1180 0x7f61841f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 -- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61841f5130 msgr2=0x7f61840b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f61841f5130 0x7f61840b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 -- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61840b1180 msgr2=0x7f61841f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61840b1180 0x7f61841f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.772 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 -- 172.21.15.177:0/2998940537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840b5a60 con 0x7f6170005190 2023-10-25T16:25:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f6188c4c640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61840b1180 0x7f61841f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618944d640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f61840c6d50 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f6180011820 tx=0x7f6180011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618000fd50 con 0x7f6170005190 2023-10-25T16:25:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6180012450 con 0x7f6170005190 2023-10-25T16:25:35.773 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61840b5d40 con 0x7f6170005190 2023-10-25T16:25:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180012820 con 0x7f6170005190 2023-10-25T16:25:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61840c7290 con 0x7f6170005190 2023-10-25T16:25:35.774 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.770+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61840cf830 con 0x7f6170005190 2023-10-25T16:25:35.775 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6180012980 con 0x7f6170005190 2023-10-25T16:25:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61680664a0 0x7f6168068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6180085540 con 0x7f6170005190 2023-10-25T16:25:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7f616806c300 0x7f616806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 --> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f616806edd0 con 0x7f616806c300 2023-10-25T16:25:35.776 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6180085990 con 0x7f6170005190 2023-10-25T16:25:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6188c4c640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61680664a0 0x7f6168068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6189c4e640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7f616806c300 0x7f616806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6188c4c640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61680664a0 0x7f6168068960 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f61840cb4b0 tx=0x7f6174001440 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6189c4e640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7f616806c300 0x7f616806e720 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.777 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.774+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== osd.4 v2:172.21.15.184:6824/3302258236 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f616806edd0 con 0x7f616806c300 2023-10-25T16:25:35.783 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 --> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f61841f5b40 con 0x7f616806c300 2023-10-25T16:25:35.784 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f6179ffb640 1 -- 172.21.15.177:0/2998940537 <== osd.4 v2:172.21.15.184:6824/3302258236 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f61841f5b40 con 0x7f616806c300 2023-10-25T16:25:35.784 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:35.785 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:35.785 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:35.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7f616806c300 msgr2=0x7f616806e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6824/3302258236,v1:172.21.15.184:6825/3302258236] conn(0x7f616806c300 0x7f616806e720 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61680664a0 msgr2=0x7f6168068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f61680664a0 0x7f6168068960 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f61840cb4b0 tx=0x7f6174001440 comp rx=0 tx=0).stop 2023-10-25T16:25:35.786 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 msgr2=0x7f61840c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 --2- 172.21.15.177:0/2998940537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6170005190 0x7f61840c6d50 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f6180011820 tx=0x7f6180011ce0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f6189c4e640 1 -- 172.21.15.177:0/2998940537 reap_dead start 2023-10-25T16:25:35.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 shutdown_connections 2023-10-25T16:25:35.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 >> 172.21.15.177:0/2998940537 conn(0x7f618409a5b0 msgr2=0x7f618415a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.787 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 shutdown_connections 2023-10-25T16:25:35.788 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.786+0000 7f618b6b1640 1 -- 172.21.15.177:0/2998940537 wait complete. 2023-10-25T16:25:35.799 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-25T16:25:35.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.914+0000 7f3a6c04b640 1 -- 172.21.15.177:0/1997341868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a50004d10 msgr2=0x7f3a50005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.914+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/1997341868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a50004d10 0x7f3a50005190 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009f10 tx=0x7f3a5c01d5b0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.914 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.914+0000 7f3a6a5e8640 1 -- 172.21.15.177:0/1997341868 reap_dead start 2023-10-25T16:25:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.914+0000 7f3a6c04b640 1 -- 172.21.15.177:0/1997341868 shutdown_connections 2023-10-25T16:25:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.914+0000 7f3a6c04b640 1 -- 172.21.15.177:0/1997341868 >> 172.21.15.177:0/1997341868 conn(0x7f3a6409a5c0 msgr2=0x7f3a640d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- 172.21.15.177:0/1997341868 shutdown_connections 2023-10-25T16:25:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- 172.21.15.177:0/1997341868 wait complete. 2023-10-25T16:25:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 Processor -- start 2023-10-25T16:25:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- start start 2023-10-25T16:25:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6414fa10 0x7f3a641e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a640c4cd0 0x7f3a640b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 0x7f3a6415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b68a0 con 0x7f3a640b6420 2023-10-25T16:25:35.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a641e4f00 con 0x7f3a6414fa10 2023-10-25T16:25:35.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a641e51e0 con 0x7f3a640c4cd0 2023-10-25T16:25:35.919 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 0x7f3a6415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 0x7f3a6415c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34450/0 (socket says 172.21.15.177:34450) 2023-10-25T16:25:35.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 -- 172.21.15.177:0/413517057 learned_addr learned my addr 172.21.15.177:0/413517057 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:35.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a69de7640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6414fa10 0x7f3a641e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 -- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a640c4cd0 msgr2=0x7f3a640b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.920 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a640c4cd0 0x7f3a640b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 -- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6414fa10 msgr2=0x7f3a641e5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:35.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6414fa10 0x7f3a641e5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:35.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 -- 172.21.15.177:0/413517057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a641e54c0 con 0x7f3a640b6420 2023-10-25T16:25:35.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a69de7640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6414fa10 0x7f3a641e5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:35.921 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6a5e8640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 0x7f3a6415c0c0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009f10 tx=0x7f3a5c004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b6070 con 0x7f3a640b6420 2023-10-25T16:25:35.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3a5c009200 con 0x7f3a640b6420 2023-10-25T16:25:35.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a641e57a0 con 0x7f3a640b6420 2023-10-25T16:25:35.922 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a94f0 con 0x7f3a640b6420 2023-10-25T16:25:35.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a641e4bf0 con 0x7f3a640b6420 2023-10-25T16:25:35.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.918+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a640c68c0 con 0x7f3a640b6420 2023-10-25T16:25:35.923 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.922+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a5c0a97c0 con 0x7f3a640b6420 2023-10-25T16:25:35.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.922+0000 7f3a5a7fc640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a480664a0 0x7f3a48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:35.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.922+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3a5c11eba0 con 0x7f3a640b6420 2023-10-25T16:25:35.924 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.922+0000 7f3a69de7640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a480664a0 0x7f3a48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:35.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.922+0000 7f3a69de7640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a480664a0 0x7f3a48068960 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f3a600017b0 tx=0x7f3a60001e20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:35.925 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:35.926+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a640c68c0 con 0x7f3a640b6420 2023-10-25T16:25:36.062 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a640b68a0 con 0x7f3a480664a0 2023-10-25T16:25:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a5a7fc640 1 -- 172.21.15.177:0/413517057 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a640b68a0 con 0x7f3a480664a0 2023-10-25T16:25:36.063 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 4 to deep-scrub 2023-10-25T16:25:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a480664a0 msgr2=0x7f3a48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.065 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a480664a0 0x7f3a48068960 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f3a600017b0 tx=0x7f3a60001e20 comp rx=0 tx=0).stop 2023-10-25T16:25:36.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 msgr2=0x7f3a6415c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 0x7f3a6415c0c0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009f10 tx=0x7f3a5c004f10 comp rx=0 tx=0).stop 2023-10-25T16:25:36.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 shutdown_connections 2023-10-25T16:25:36.066 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f3a480664a0 0x7f3a48068960 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a640b6420 0x7f3a6415c0c0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3a640c4cd0 0x7f3a640b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 --2- 172.21.15.177:0/413517057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a6414fa10 0x7f3a641e5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 >> 172.21.15.177:0/413517057 conn(0x7f3a6409a5c0 msgr2=0x7f3a6415a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.067 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 shutdown_connections 2023-10-25T16:25:36.068 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.066+0000 7f3a6c04b640 1 -- 172.21.15.177:0/413517057 wait complete. 2023-10-25T16:25:36.080 INFO:tasks.ceph:Scrubbing osd.5 2023-10-25T16:25:36.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- 172.21.15.177:0/2286350394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 msgr2=0x7fabb4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 --2- 172.21.15.177:0/2286350394 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 0x7fabb4004c50 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fabb8001060 tx=0x7fabb801f700 comp rx=0 tx=0).stop 2023-10-25T16:25:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcd8a5640 1 -- 172.21.15.177:0/2286350394 reap_dead start 2023-10-25T16:25:36.200 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- 172.21.15.177:0/2286350394 shutdown_connections 2023-10-25T16:25:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- 172.21.15.177:0/2286350394 >> 172.21.15.177:0/2286350394 conn(0x7fabc80b0b50 msgr2=0x7fabc80b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- 172.21.15.177:0/2286350394 shutdown_connections 2023-10-25T16:25:36.201 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- 172.21.15.177:0/2286350394 wait complete. 2023-10-25T16:25:36.203 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 Processor -- start 2023-10-25T16:25:36.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- start start 2023-10-25T16:25:36.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 0x7fabc80c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabc81eff00 0x7fabc8153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.204 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabc806eb60 0x7fabc806f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc806f550 con 0x7fabb40047d0 2023-10-25T16:25:36.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc806d990 con 0x7fabc806eb60 2023-10-25T16:25:36.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.202+0000 7fabcf308640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81edb40 con 0x7fabc81eff00 2023-10-25T16:25:36.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 0x7fabc80c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 0x7fabc80c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34480/0 (socket says 172.21.15.177:34480) 2023-10-25T16:25:36.205 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 -- 172.21.15.177:0/3860000110 learned_addr learned my addr 172.21.15.177:0/3860000110 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:36.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcc8a3640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabc81eff00 0x7fabc8153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 -- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabc81eff00 msgr2=0x7fabc8153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabc81eff00 0x7fabc8153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 -- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabc806eb60 msgr2=0x7fabc806f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.206 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabc806eb60 0x7fabc806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 -- 172.21.15.177:0/3860000110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc81edde0 con 0x7fabb40047d0 2023-10-25T16:25:36.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd0a4640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 0x7fabc80c4f20 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fabc400e990 tx=0x7fabc400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400cb80 con 0x7fabb40047d0 2023-10-25T16:25:36.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fabc400cdd0 con 0x7fabb40047d0 2023-10-25T16:25:36.207 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc81f06c0 con 0x7fabb40047d0 2023-10-25T16:25:36.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc4005280 con 0x7fabb40047d0 2023-10-25T16:25:36.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc81f0c80 con 0x7fabb40047d0 2023-10-25T16:25:36.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabc8159a70 con 0x7fabb40047d0 2023-10-25T16:25:36.208 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fabc40053e0 con 0x7fabb40047d0 2023-10-25T16:25:36.209 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fabac0664a0 0x7fabac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fabc4084970 con 0x7fabb40047d0 2023-10-25T16:25:36.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7fabac06c300 0x7fabac06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 --> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fabac06edd0 con 0x7fabac06c300 2023-10-25T16:25:36.210 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabc4084dc0 con 0x7fabb40047d0 2023-10-25T16:25:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcc8a3640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fabac0664a0 0x7fabac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd8a5640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7fabac06c300 0x7fabac06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcc8a3640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fabac0664a0 0x7fabac068960 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fabb80b0000 tx=0x7fabb801c4a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.206+0000 7fabcd8a5640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7fabac06c300 0x7fabac06e720 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.211 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.210+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== osd.5 v2:172.21.15.184:6816/748323378 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fabac06edd0 con 0x7fabac06c300 2023-10-25T16:25:36.217 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 --> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fabc81f0ea0 con 0x7fabac06c300 2023-10-25T16:25:36.218 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabbdffb640 1 -- 172.21.15.177:0/3860000110 <== osd.5 v2:172.21.15.184:6816/748323378 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7fabc81f0ea0 con 0x7fabac06c300 2023-10-25T16:25:36.219 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:36.219 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:36.219 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:36.220 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7fabac06c300 msgr2=0x7fabac06e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6816/748323378,v1:172.21.15.184:6817/748323378] conn(0x7fabac06c300 0x7fabac06e720 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fabac0664a0 msgr2=0x7fabac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fabac0664a0 0x7fabac068960 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fabb80b0000 tx=0x7fabb801c4a0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 msgr2=0x7fabc80c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.221 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 --2- 172.21.15.177:0/3860000110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb40047d0 0x7fabc80c4f20 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fabc400e990 tx=0x7fabc400ee50 comp rx=0 tx=0).stop 2023-10-25T16:25:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcd8a5640 1 -- 172.21.15.177:0/3860000110 reap_dead start 2023-10-25T16:25:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 shutdown_connections 2023-10-25T16:25:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 >> 172.21.15.177:0/3860000110 conn(0x7fabc80b0b50 msgr2=0x7fabc80afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.222 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 shutdown_connections 2023-10-25T16:25:36.223 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.222+0000 7fabcf308640 1 -- 172.21.15.177:0/3860000110 wait complete. 2023-10-25T16:25:36.233 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-25T16:25:36.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3761496570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae640039b0 msgr2=0x7fae64003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3761496570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae640039b0 0x7fae64003db0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c730 tx=0x7fae6801c5f0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae77fff640 1 -- 172.21.15.177:0/3761496570 reap_dead start 2023-10-25T16:25:36.341 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3761496570 shutdown_connections 2023-10-25T16:25:36.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3761496570 >> 172.21.15.177:0/3761496570 conn(0x7fae780b2450 msgr2=0x7fae780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3761496570 shutdown_connections 2023-10-25T16:25:36.342 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.342+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3761496570 wait complete. 2023-10-25T16:25:36.345 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 Processor -- start 2023-10-25T16:25:36.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- start start 2023-10-25T16:25:36.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae640039b0 0x7fae78151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae781f6f60 0x7fae7815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 0x7fae78070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.346 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae781f73e0 con 0x7fae78070b00 2023-10-25T16:25:36.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780714c0 con 0x7fae640039b0 2023-10-25T16:25:36.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae78152c50 con 0x7fae781f6f60 2023-10-25T16:25:36.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 0x7fae78070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 0x7fae78070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34496/0 (socket says 172.21.15.177:34496) 2023-10-25T16:25:36.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 -- 172.21.15.177:0/3528527138 learned_addr learned my addr 172.21.15.177:0/3528527138 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:36.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae777fe640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae640039b0 0x7fae78151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae6ffff640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae781f6f60 0x7fae7815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 -- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae781f6f60 msgr2=0x7fae7815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae781f6f60 0x7fae7815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.348 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 -- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae640039b0 msgr2=0x7fae78151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae640039b0 0x7fae78151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 -- 172.21.15.177:0/3528527138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78152ea0 con 0x7fae78070b00 2023-10-25T16:25:36.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae6ffff640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae781f6f60 0x7fae7815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:36.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae77fff640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 0x7fae78070f80 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fae780acb50 tx=0x7fae7000fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.349 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70004d30 con 0x7fae78070b00 2023-10-25T16:25:36.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fae7000d860 con 0x7fae78070b00 2023-10-25T16:25:36.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae78153180 con 0x7fae78070b00 2023-10-25T16:25:36.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7000dc70 con 0x7fae78070b00 2023-10-25T16:25:36.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae78153740 con 0x7fae78070b00 2023-10-25T16:25:36.350 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7804daf0 con 0x7fae78070b00 2023-10-25T16:25:36.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fae70011440 con 0x7fae78070b00 2023-10-25T16:25:36.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae74ff9640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae580664a0 0x7fae58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fae70015070 con 0x7fae78070b00 2023-10-25T16:25:36.351 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.346+0000 7fae777fe640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae580664a0 0x7fae58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.350+0000 7fae777fe640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae580664a0 0x7fae58068960 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c700 tx=0x7fae68019390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.352 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.350+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fae70051df0 con 0x7fae78070b00 2023-10-25T16:25:36.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.494+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fae780b04e0 con 0x7fae580664a0 2023-10-25T16:25:36.491 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.494+0000 7fae74ff9640 1 -- 172.21.15.177:0/3528527138 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fae780b04e0 con 0x7fae580664a0 2023-10-25T16:25:36.492 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 5 to deep-scrub 2023-10-25T16:25:36.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.494+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae580664a0 msgr2=0x7fae58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae580664a0 0x7fae58068960 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fae6800c700 tx=0x7fae68019390 comp rx=0 tx=0).stop 2023-10-25T16:25:36.494 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 msgr2=0x7fae78070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 0x7fae78070f80 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fae780acb50 tx=0x7fae7000fbe0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 shutdown_connections 2023-10-25T16:25:36.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fae580664a0 0x7fae58068960 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.495 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae78070b00 0x7fae78070f80 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae781f6f60 0x7fae7815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 --2- 172.21.15.177:0/3528527138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae640039b0 0x7fae78151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 >> 172.21.15.177:0/3528527138 conn(0x7fae780b2450 msgr2=0x7fae780acb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 shutdown_connections 2023-10-25T16:25:36.496 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.498+0000 7fae7dc4f640 1 -- 172.21.15.177:0/3528527138 wait complete. 2023-10-25T16:25:36.509 INFO:tasks.ceph:Scrubbing osd.6 2023-10-25T16:25:36.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:36.638 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.638+0000 7f69e9867640 1 -- 172.21.15.177:0/145069777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 msgr2=0x7f69e415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.638+0000 7f69e9867640 1 --2- 172.21.15.177:0/145069777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e415b800 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f69e4071e10 tx=0x7f69d401dba0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.638+0000 7f69e9867640 1 -- 172.21.15.177:0/145069777 shutdown_connections 2023-10-25T16:25:36.639 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.638+0000 7f69e9867640 1 --2- 172.21.15.177:0/145069777 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e415c280 0x7f69e4158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.638+0000 7f69e9867640 1 --2- 172.21.15.177:0/145069777 >> v2:172.21.15.184:3300/0 conn(0x7f69e40b1d70 0x7f69e415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.640 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 --2- 172.21.15.177:0/145069777 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e415b800 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- 172.21.15.177:0/145069777 >> 172.21.15.177:0/145069777 conn(0x7f69e40aea90 msgr2=0x7f69e40aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- 172.21.15.177:0/145069777 shutdown_connections 2023-10-25T16:25:36.641 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- 172.21.15.177:0/145069777 wait complete. 2023-10-25T16:25:36.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 Processor -- start 2023-10-25T16:25:36.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- start start 2023-10-25T16:25:36.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e40b1d70 0x7f69e4149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e41530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.649 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e415c280 0x7f69e4149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4153630 con 0x7f69e4157db0 2023-10-25T16:25:36.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41f6240 con 0x7f69e415c280 2023-10-25T16:25:36.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e41f5370 con 0x7f69e40b1d70 2023-10-25T16:25:36.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e41530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e41530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34508/0 (socket says 172.21.15.177:34508) 2023-10-25T16:25:36.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 -- 172.21.15.177:0/2421687296 learned_addr learned my addr 172.21.15.177:0/2421687296 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:36.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e37fe640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e415c280 0x7f69e4149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e2ffd640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e40b1d70 0x7f69e4149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 -- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e40b1d70 msgr2=0x7f69e4149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69e40b1d70 0x7f69e4149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 -- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e415c280 msgr2=0x7f69e4149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e415c280 0x7f69e4149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 -- 172.21.15.177:0/2421687296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d400a670 con 0x7f69e4157db0 2023-10-25T16:25:36.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e37fe640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69e415c280 0x7f69e4149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:36.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e27fc640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e41530f0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00c940 tx=0x7f69cc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc004230 con 0x7f69e4157db0 2023-10-25T16:25:36.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f69cc004480 con 0x7f69e4157db0 2023-10-25T16:25:36.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e41f5630 con 0x7f69e4157db0 2023-10-25T16:25:36.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc007c10 con 0x7f69e4157db0 2023-10-25T16:25:36.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e41f5bf0 con 0x7f69e4157db0 2023-10-25T16:25:36.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.642+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69e4066480 con 0x7f69e4157db0 2023-10-25T16:25:36.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f69cc003600 con 0x7f69e4157db0 2023-10-25T16:25:36.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69c4066470 0x7f69c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f69cc084610 con 0x7f69e4157db0 2023-10-25T16:25:36.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f69c406c2d0 0x7f69c406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 --> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69c406eda0 con 0x7f69c406c2d0 2023-10-25T16:25:36.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69cc084a60 con 0x7f69e4157db0 2023-10-25T16:25:36.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69e2ffd640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69c4066470 0x7f69c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69e37fe640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f69c406c2d0 0x7f69c406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69e2ffd640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69c4066470 0x7f69c4068930 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f69d40b0000 tx=0x7f69d401c3e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69e37fe640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f69c406c2d0 0x7f69c406e6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.646+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== osd.6 v2:172.21.15.184:6800/3199176706 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7f69c406eda0 con 0x7f69c406c2d0 2023-10-25T16:25:36.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.658+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 --> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f69e409b0f0 con 0x7f69c406c2d0 2023-10-25T16:25:36.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.658+0000 7f69dbfff640 1 -- 172.21.15.177:0/2421687296 <== osd.6 v2:172.21.15.184:6800/3199176706 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f69e409b0f0 con 0x7f69c406c2d0 2023-10-25T16:25:36.664 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:36.664 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:36.664 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:36.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.658+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f69c406c2d0 msgr2=0x7f69c406e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6800/3199176706,v1:172.21.15.184:6801/3199176706] conn(0x7f69c406c2d0 0x7f69c406e6f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69c4066470 msgr2=0x7f69c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f69c4066470 0x7f69c4068930 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f69d40b0000 tx=0x7f69d401c3e0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 msgr2=0x7f69e41530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 --2- 172.21.15.177:0/2421687296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69e4157db0 0x7f69e41530f0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00c940 tx=0x7f69cc00ce00 comp rx=0 tx=0).stop 2023-10-25T16:25:36.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e37fe640 1 -- 172.21.15.177:0/2421687296 reap_dead start 2023-10-25T16:25:36.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 shutdown_connections 2023-10-25T16:25:36.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 >> 172.21.15.177:0/2421687296 conn(0x7f69e40aea90 msgr2=0x7f69e41537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 shutdown_connections 2023-10-25T16:25:36.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.662+0000 7f69e9867640 1 -- 172.21.15.177:0/2421687296 wait complete. 2023-10-25T16:25:36.674 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-25T16:25:36.792 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 -- 172.21.15.177:0/2494977911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8004d10 msgr2=0x7f1be8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 --2- 172.21.15.177:0/2494977911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1be8004d10 0x7f1be8005190 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f1c000cbb60 tx=0x7f1bf801d570 comp rx=0 tx=0).stop 2023-10-25T16:25:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c04f58640 1 -- 172.21.15.177:0/2494977911 reap_dead start 2023-10-25T16:25:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 -- 172.21.15.177:0/2494977911 shutdown_connections 2023-10-25T16:25:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 -- 172.21.15.177:0/2494977911 >> 172.21.15.177:0/2494977911 conn(0x7f1c0009a5a0 msgr2=0x7f1c000d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.793 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 -- 172.21.15.177:0/2494977911 shutdown_connections 2023-10-25T16:25:36.794 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 -- 172.21.15.177:0/2494977911 wait complete. 2023-10-25T16:25:36.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 Processor -- start 2023-10-25T16:25:36.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.794+0000 7f1c069bb640 1 -- start start 2023-10-25T16:25:36.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c00158620 0x7f1c001f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.796 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c00158a00 0x7f1c0015c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 0x7f1c000cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0015d730 con 0x7f1c0015bd30 2023-10-25T16:25:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001f1bb0 con 0x7f1c00158a00 2023-10-25T16:25:36.797 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001f15c0 con 0x7f1c00158620 2023-10-25T16:25:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 0x7f1c000cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 0x7f1c000cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34528/0 (socket says 172.21.15.177:34528) 2023-10-25T16:25:36.798 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 -- 172.21.15.177:0/1620475516 learned_addr learned my addr 172.21.15.177:0/1620475516 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bff7fe640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c00158a00 0x7f1c0015c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfffff640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c00158620 0x7f1c001f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.799 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 -- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c00158620 msgr2=0x7f1c001f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c00158620 0x7f1c001f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 -- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c00158a00 msgr2=0x7f1c0015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c00158a00 0x7f1c0015c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 -- 172.21.15.177:0/1620475516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c001f2580 con 0x7f1c0015bd30 2023-10-25T16:25:36.800 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfffff640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c00158620 0x7f1c001f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:36.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c04f58640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 0x7f1c000cd5c0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f1bf801cfe0 tx=0x7f1bf80abef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80b6070 con 0x7f1c0015bd30 2023-10-25T16:25:36.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1bf8009200 con 0x7f1c0015bd30 2023-10-25T16:25:36.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0015d170 con 0x7f1c0015bd30 2023-10-25T16:25:36.801 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8004b30 con 0x7f1c0015bd30 2023-10-25T16:25:36.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c001f1840 con 0x7f1c0015bd30 2023-10-25T16:25:36.802 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0015d690 con 0x7f1c0015bd30 2023-10-25T16:25:36.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1bf8004cb0 con 0x7f1c0015bd30 2023-10-25T16:25:36.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfcff9640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1bec066470 0x7f1bec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:36.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1bf811e890 con 0x7f1c0015bd30 2023-10-25T16:25:36.803 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.798+0000 7f1bfffff640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1bec066470 0x7f1bec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:36.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.802+0000 7f1bfffff640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1bec066470 0x7f1bec068930 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009b00 tx=0x7f1bf00091e0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:36.804 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.802+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1bf80ec0c0 con 0x7f1c0015bd30 2023-10-25T16:25:36.952 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.954+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c0004daf0 con 0x7f1bec066470 2023-10-25T16:25:36.953 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.954+0000 7f1bfcff9640 1 -- 172.21.15.177:0/1620475516 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c0004daf0 con 0x7f1bec066470 2023-10-25T16:25:36.953 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 6 to deep-scrub 2023-10-25T16:25:36.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1bec066470 msgr2=0x7f1bec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1bec066470 0x7f1bec068930 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009b00 tx=0x7f1bf00091e0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 msgr2=0x7f1c000cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:36.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 0x7f1c000cd5c0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f1bf801cfe0 tx=0x7f1bf80abef0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 shutdown_connections 2023-10-25T16:25:36.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f1bec066470 0x7f1bec068930 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c0015bd30 0x7f1c000cd5c0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c00158a00 0x7f1c0015c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 --2- 172.21.15.177:0/1620475516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c00158620 0x7f1c001f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:36.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 >> 172.21.15.177:0/1620475516 conn(0x7f1c0009a5a0 msgr2=0x7f1c0006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:36.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 shutdown_connections 2023-10-25T16:25:36.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:36.958+0000 7f1c069bb640 1 -- 172.21.15.177:0/1620475516 wait complete. 2023-10-25T16:25:36.971 INFO:tasks.ceph:Scrubbing osd.7 2023-10-25T16:25:36.971 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-25T16:25:37.097 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 -- 172.21.15.177:0/2982004506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb5806c3d0 msgr2=0x7fbb580c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 --2- 172.21.15.177:0/2982004506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb5806c3d0 0x7fbb580c9a60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009840 tx=0x7fbb4801c7d0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 -- 172.21.15.177:0/2982004506 shutdown_connections 2023-10-25T16:25:37.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 --2- 172.21.15.177:0/2982004506 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb5806c3d0 0x7fbb580c9a60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 --2- 172.21.15.177:0/2982004506 >> v2:172.21.15.184:3300/0 conn(0x7fbb580c9680 0x7fbb58071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 -- 172.21.15.177:0/2982004506 >> 172.21.15.177:0/2982004506 conn(0x7fbb58069920 msgr2=0x7fbb58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:37.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 -- 172.21.15.177:0/2982004506 shutdown_connections 2023-10-25T16:25:37.099 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.098+0000 7fbb602d5640 1 -- 172.21.15.177:0/2982004506 wait complete. 2023-10-25T16:25:37.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 Processor -- start 2023-10-25T16:25:37.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- start start 2023-10-25T16:25:37.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5806c3d0 0x7fbb58159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb580c9680 0x7fbb58157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.101 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb580cad40 0x7fbb580989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581588a0 con 0x7fbb580c9680 2023-10-25T16:25:37.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58159700 con 0x7fbb5806c3d0 2023-10-25T16:25:37.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5815a0d0 con 0x7fbb580cad40 2023-10-25T16:25:37.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb580c9680 0x7fbb58157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.102 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb580c9680 0x7fbb58157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34536/0 (socket says 172.21.15.177:34536) 2023-10-25T16:25:37.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 -- 172.21.15.177:0/449019638 learned_addr learned my addr 172.21.15.177:0/449019638 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:37.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5e872640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb580cad40 0x7fbb580989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5e071640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5806c3d0 0x7fbb58159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 -- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb580cad40 msgr2=0x7fbb580989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.103 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb580cad40 0x7fbb580989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 -- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5806c3d0 msgr2=0x7fbb58159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5806c3d0 0x7fbb58159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 -- 172.21.15.177:0/449019638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480094a0 con 0x7fbb580c9680 2023-10-25T16:25:37.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb5d870640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb580c9680 0x7fbb58157ca0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fbb48000c10 tx=0x7fbb480056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb480bc070 con 0x7fbb580c9680 2023-10-25T16:25:37.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb480a5810 con 0x7fbb580c9680 2023-10-25T16:25:37.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58158af0 con 0x7fbb580c9680 2023-10-25T16:25:37.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48004910 con 0x7fbb580c9680 2023-10-25T16:25:37.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb581590b0 con 0x7fbb580c9680 2023-10-25T16:25:37.105 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb58073360 con 0x7fbb580c9680 2023-10-25T16:25:37.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.102+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbb480b4040 con 0x7fbb580c9680 2023-10-25T16:25:37.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb4effd640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb3c066470 0x7fbb3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbb4811e4d0 con 0x7fbb580c9680 2023-10-25T16:25:37.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb4effd640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7fbb3c06c2d0 0x7fbb3c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 --> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb3c06eda0 con 0x7fbb3c06c2d0 2023-10-25T16:25:37.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb48120b90 con 0x7fbb580c9680 2023-10-25T16:25:37.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb5e071640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb3c066470 0x7fbb3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb5e872640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7fbb3c06c2d0 0x7fbb3c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb5e872640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7fbb3c06c2d0 0x7fbb3c06e6f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb5e071640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb3c066470 0x7fbb3c068930 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009f50 tx=0x7fbb54009500 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.106+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== osd.7 v2:172.21.15.184:6808/435860171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23595 (crc 0 0 0) 0x7fbb3c06eda0 con 0x7fbb3c06c2d0 2023-10-25T16:25:37.114 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 --> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbb58159870 con 0x7fbb3c06c2d0 2023-10-25T16:25:37.115 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb4effd640 1 -- 172.21.15.177:0/449019638 <== osd.7 v2:172.21.15.184:6808/435860171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7fbb58159870 con 0x7fbb3c06c2d0 2023-10-25T16:25:37.116 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-25T16:25:37.116 INFO:teuthology.orchestra.run.smithi177.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2023-10-25T16:25:37.116 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-25T16:25:37.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7fbb3c06c2d0 msgr2=0x7fbb3c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6808/435860171,v1:172.21.15.184:6809/435860171] conn(0x7fbb3c06c2d0 0x7fbb3c06e6f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.117 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb3c066470 msgr2=0x7fbb3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fbb3c066470 0x7fbb3c068930 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009f50 tx=0x7fbb54009500 comp rx=0 tx=0).stop 2023-10-25T16:25:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb580c9680 msgr2=0x7fbb58157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 --2- 172.21.15.177:0/449019638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb580c9680 0x7fbb58157ca0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fbb48000c10 tx=0x7fbb480056d0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.118 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb5e872640 1 -- 172.21.15.177:0/449019638 reap_dead start 2023-10-25T16:25:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 shutdown_connections 2023-10-25T16:25:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 >> 172.21.15.177:0/449019638 conn(0x7fbb58069920 msgr2=0x7fbb58156300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 shutdown_connections 2023-10-25T16:25:37.119 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.118+0000 7fbb602d5640 1 -- 172.21.15.177:0/449019638 wait complete. 2023-10-25T16:25:37.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-25T16:25:37.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/3293256439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c0003fc0 msgr2=0x7fe8c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 --2- 172.21.15.177:0/3293256439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8c0003fc0 0x7fe8c00047d0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c730 tx=0x7fe8bc01c6e0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.235 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d37fe640 1 -- 172.21.15.177:0/3293256439 reap_dead start 2023-10-25T16:25:37.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/3293256439 shutdown_connections 2023-10-25T16:25:37.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/3293256439 >> 172.21.15.177:0/3293256439 conn(0x7fe8d409a5c0 msgr2=0x7fe8d40d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:37.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/3293256439 shutdown_connections 2023-10-25T16:25:37.236 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/3293256439 wait complete. 2023-10-25T16:25:37.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 Processor -- start 2023-10-25T16:25:37.238 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- start start 2023-10-25T16:25:37.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 0x7fe8d41526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8d4152be0 0x7fe8d40c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d40c9b30 0x7fe8d41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4153060 con 0x7fe8d414f790 2023-10-25T16:25:37.239 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40c9030 con 0x7fe8d40c9b30 2023-10-25T16:25:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40c8420 con 0x7fe8d4152be0 2023-10-25T16:25:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 0x7fe8d41526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 0x7fe8d41526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34544/0 (socket says 172.21.15.177:34544) 2023-10-25T16:25:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 -- 172.21.15.177:0/2994981248 learned_addr learned my addr 172.21.15.177:0/2994981248 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8cbfff640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8d4152be0 0x7fe8d40c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.240 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 -- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8d4152be0 msgr2=0x7fe8d40c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8d4152be0 0x7fe8d40c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 -- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d40c9b30 msgr2=0x7fe8d41543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d40c9b30 0x7fe8d41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 -- 172.21.15.177:0/2994981248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40c8700 con 0x7fe8d414f790 2023-10-25T16:25:37.241 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d2ffd640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 0x7fe8d41526a0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400e9c0 tx=0x7fe8c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400cc00 con 0x7fe8d414f790 2023-10-25T16:25:37.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe8c400ce50 con 0x7fe8d414f790 2023-10-25T16:25:37.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d40c89e0 con 0x7fe8d414f790 2023-10-25T16:25:37.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4005280 con 0x7fe8d414f790 2023-10-25T16:25:37.242 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.238+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d414fb70 con 0x7fe8d414f790 2023-10-25T16:25:37.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.242+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d404daf0 con 0x7fe8d414f790 2023-10-25T16:25:37.243 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.242+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8c40053e0 con 0x7fe8d414f790 2023-10-25T16:25:37.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.242+0000 7fe8cb7fe640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8b40664a0 0x7fe8b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.242+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe8c40844c0 con 0x7fe8d414f790 2023-10-25T16:25:37.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.242+0000 7fe8cbfff640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8b40664a0 0x7fe8b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.242+0000 7fe8cbfff640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8b40664a0 0x7fe8b4068960 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c700 tx=0x7fe8bc019480 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.244 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.246+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8c4051bb0 con 0x7fe8d414f790 2023-10-25T16:25:37.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.386+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8d4167c70 con 0x7fe8b40664a0 2023-10-25T16:25:37.384 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.386+0000 7fe8cb7fe640 1 -- 172.21.15.177:0/2994981248 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe8bc0b0070 con 0x7fe8b40664a0 2023-10-25T16:25:37.384 INFO:teuthology.orchestra.run.smithi177.stderr:instructed osd(s) 7 to deep-scrub 2023-10-25T16:25:37.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8b40664a0 msgr2=0x7fe8b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8b40664a0 0x7fe8b4068960 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c700 tx=0x7fe8bc019480 comp rx=0 tx=0).stop 2023-10-25T16:25:37.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 msgr2=0x7fe8d41526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 0x7fe8d41526a0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400e9c0 tx=0x7fe8c400ee80 comp rx=0 tx=0).stop 2023-10-25T16:25:37.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 shutdown_connections 2023-10-25T16:25:37.387 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fe8b40664a0 0x7fe8b4068960 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8d40c9b30 0x7fe8d41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe8d4152be0 0x7fe8d40c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 --2- 172.21.15.177:0/2994981248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8d414f790 0x7fe8d41526a0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 >> 172.21.15.177:0/2994981248 conn(0x7fe8d409a5c0 msgr2=0x7fe8d40cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:37.388 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 shutdown_connections 2023-10-25T16:25:37.389 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.390+0000 7fe8d9743640 1 -- 172.21.15.177:0/2994981248 wait complete. 2023-10-25T16:25:37.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:25:37.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 -- 172.21.15.177:0/2771924221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461006b9e0 msgr2=0x7f461006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 --2- 172.21.15.177:0/2771924221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461006b9e0 0x7f461006be30 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f4608009bc0 tx=0x7f460801ca70 comp rx=0 tx=0).stop 2023-10-25T16:25:37.528 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 -- 172.21.15.177:0/2771924221 shutdown_connections 2023-10-25T16:25:37.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 --2- 172.21.15.177:0/2771924221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f461006b9e0 0x7f461006be30 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 --2- 172.21.15.177:0/2771924221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f461015cdd0 0x7f46100caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 -- 172.21.15.177:0/2771924221 >> 172.21.15.177:0/2771924221 conn(0x7f46100b2450 msgr2=0x7f46100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:37.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 -- 172.21.15.177:0/2771924221 shutdown_connections 2023-10-25T16:25:37.529 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.526+0000 7f4615714640 1 -- 172.21.15.177:0/2771924221 wait complete. 2023-10-25T16:25:37.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 Processor -- start 2023-10-25T16:25:37.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- start start 2023-10-25T16:25:37.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f461006b9e0 0x7f4610148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 0x7f461014dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.530 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f461015cdd0 0x7f461014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610154d80 con 0x7f46101537d0 2023-10-25T16:25:37.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461014f150 con 0x7f461006b9e0 2023-10-25T16:25:37.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4610148f70 con 0x7f461015cdd0 2023-10-25T16:25:37.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 0x7f461014dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 0x7f461014dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:34562/0 (socket says 172.21.15.177:34562) 2023-10-25T16:25:37.531 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 -- 172.21.15.177:0/2285092067 learned_addr learned my addr 172.21.15.177:0/2285092067 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:37.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 -- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f461015cdd0 msgr2=0x7f461014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f461015cdd0 0x7f461014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 -- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f461006b9e0 msgr2=0x7f4610148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f461006b9e0 0x7f4610148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.532 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 -- 172.21.15.177:0/2285092067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608009820 con 0x7f46101537d0 2023-10-25T16:25:37.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f46067fc640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 0x7f461014dfc0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f45f800d780 tx=0x7f45f800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8004220 con 0x7f46101537d0 2023-10-25T16:25:37.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45f8004470 con 0x7f46101537d0 2023-10-25T16:25:37.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4610154a30 con 0x7f46101537d0 2023-10-25T16:25:37.533 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8009c30 con 0x7f46101537d0 2023-10-25T16:25:37.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461014ee70 con 0x7f46101537d0 2023-10-25T16:25:37.534 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46100ac9a0 con 0x7f46101537d0 2023-10-25T16:25:37.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f45f8005030 con 0x7f46101537d0 2023-10-25T16:25:37.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4607fff640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f0066470 0x7f45f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:37.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f45f80841b0 con 0x7f46101537d0 2023-10-25T16:25:37.535 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.530+0000 7f460effd640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f0066470 0x7f45f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:37.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.534+0000 7f460effd640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f0066470 0x7f45f0068930 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f46000011f0 tx=0x7f4600001a70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:37.536 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.534+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45f80519c0 con 0x7f46101537d0 2023-10-25T16:25:37.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.674+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46101548b0 con 0x7f45f0066470 2023-10-25T16:25:37.676 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.678+0000 7f4607fff640 1 -- 172.21.15.177:0/2285092067 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48702 (secure 0 0 0) 0x7f4600001460 con 0x7f45f0066470 2023-10-25T16:25:37.677 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:37.678 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:25:37.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f0066470 msgr2=0x7f45f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f0066470 0x7f45f0068930 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f46000011f0 tx=0x7f4600001a70 comp rx=0 tx=0).stop 2023-10-25T16:25:37.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 msgr2=0x7f461014dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:37.679 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 0x7f461014dfc0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f45f800d780 tx=0x7f45f800dc40 comp rx=0 tx=0).stop 2023-10-25T16:25:37.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 shutdown_connections 2023-10-25T16:25:37.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f45f0066470 0x7f45f0068930 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f461015cdd0 0x7f461014e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46101537d0 0x7f461014dfc0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.680 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 --2- 172.21.15.177:0/2285092067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f461006b9e0 0x7f4610148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:37.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 >> 172.21.15.177:0/2285092067 conn(0x7f46100b2450 msgr2=0x7f461015af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:37.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 shutdown_connections 2023-10-25T16:25:37.681 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:37.682+0000 7f4615714640 1 -- 172.21.15.177:0/2285092067 wait complete. 2023-10-25T16:25:37.694 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":571,"stamp":"2023-10-25T16:25:36.871962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552611,"statfs":{"total":1600000000,"available":1589873728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.029739"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-10-25T16:25:28.844599+0000","last_change":"2023-10-25T16:12:57.796791+0000","last_active":"2023-10-25T16:25:28.844599+0000","last_peered":"2023-10-25T16:25:28.844599+0000","last_clean":"2023-10-25T16:25:28.844599+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:25:28.844599+0000","last_undegraded":"2023-10-25T16:25:28.844599+0000","last_fullsized":"2023-10-25T16:25:28.844599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T16:12:56.769211+0000","last_clean_scrub_stamp":"2023-10-25T16:12:56.769211+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:20:36.169505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61499999999999999,"15min":0.57899999999999996},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.93400000000000005,"5min":1.0329999999999999,"15min":1.1950000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.67900000000000005,"15min":0.625},"min":{"1min":0.34000000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.93400000000000005,"5min":1.0489999999999999,"15min":1.077},"last":0.40600000000000003}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70299999999999996,"15min":0.64100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27000000000000002},"max":{"1min":1.0920000000000001,"5min":1.0940000000000001,"15min":1.1759999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73399999999999999,"15min":0.65500000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":1.169,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.625}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.68100000000000005,"15min":0.65200000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81699999999999995,"5min":1.2290000000000001,"15min":1.246},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.82699999999999996,"15min":0.73199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":1.0209999999999999,"5min":1.153,"15min":1.345},"last":0.79400000000000004}]},{"osd":4,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.95499999999999996,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.438},"max":{"1min":1.105,"5min":1.3520000000000001,"15min":1.6120000000000001},"last":0.875},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.91300000000000003},"min":{"1min":0.67400000000000004,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.198,"5min":1.2729999999999999,"15min":1.5760000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.2370000000000001,"5min":1.46,"15min":1.4930000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.998,"15min":0.95899999999999996},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.4339999999999999,"15min":1.671},"last":0.996}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98499999999999999,"15min":0.94699999999999995},"min":{"1min":0.60599999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.5009999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.95599999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.2,"5min":1.3959999999999999,"15min":1.8400000000000001},"last":0.92800000000000005}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0289999999999999,"15min":0.97699999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51800000000000002},"max":{"1min":1.218,"5min":1.3029999999999999,"15min":1.677},"last":1.032},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0169999999999999,"15min":0.99199999999999999},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.214,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":0.72799999999999998}]}]},{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193643,"statfs":{"total":200000000,"available":198291440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.79600000000000004},"min":{"1min":0.499,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.24,"15min":1.256},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44800000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.534},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.1359999999999999,"5min":1.4259999999999999,"15min":1.647},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96699999999999997,"15min":0.93400000000000005},"min":{"1min":0.57599999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93300000000000005,"15min":0.873},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45500000000000002},"max":{"1min":1.4239999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.425,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":0.752}]},{"osd":3,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.014,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.505},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.04,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.84099999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64400000000000002,"5min":0.52000000000000002,"15min":0.44},"max":{"1min":1.2989999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.96599999999999997},"min":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.46300000000000002},"max":{"1min":1.397,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":0.71199999999999997}]},{"osd":5,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97599999999999998,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61899999999999999,"15min":0.55000000000000004},"max":{"1min":1.3360000000000001,"5min":1.696,"15min":1.7370000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.032,"15min":1.024},"min":{"1min":0.77200000000000002,"5min":0.66000000000000003,"15min":0.48899999999999999},"max":{"1min":1.288,"5min":1.681,"15min":1.681},"last":0.89300000000000002}]},{"osd":6,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.107,"15min":1.119},"min":{"1min":0.81699999999999995,"5min":0.70699999999999996,"15min":0.503},"max":{"1min":1.552,"5min":1.643,"15min":1.669},"last":1.103},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1359999999999999,"15min":1.119},"min":{"1min":0.93999999999999995,"5min":0.68500000000000005,"15min":0.57099999999999995},"max":{"1min":1.3979999999999999,"5min":1.591,"15min":1.7490000000000001},"last":0.98199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.58599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2769999999999999,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":0.93700000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3660000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":0.92200000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.91400000000000003},"min":{"1min":0.73999999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":10.667,"15min":10.667},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.026,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47999999999999998},"max":{"1min":1.181,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.004,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.181,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0680000000000001,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1879999999999999,"5min":10.948,"15min":10.948},"last":0.80500000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.262,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.997},{"interface":"front","average":{"1min":1.091,"5min":1.1499999999999999,"15min":1.0800000000000001},"min":{"1min":0.76500000000000001,"5min":0.73699999999999999,"15min":0.54700000000000004},"max":{"1min":1.4299999999999999,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":1.0649999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":0.97699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41499999999999998},"max":{"1min":1.3200000000000001,"5min":11.081,"15min":11.081},"last":1.024},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.752}]},{"osd":5,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.016,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44600000000000001},"max":{"1min":1.4910000000000001,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":0.879},{"interface":"front","average":{"1min":1.163,"5min":1.139,"15min":1.083},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46899999999999997},"max":{"1min":1.579,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":0.84299999999999997}]},{"osd":7,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2609999999999999,"15min":1.147},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.46700000000000003},"max":{"1min":1.522,"5min":16.704999999999998,"15min":16.704999999999998},"last":1.109},{"interface":"front","average":{"1min":1.194,"5min":1.1819999999999999,"15min":1.103},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.45000000000000001},"max":{"1min":1.9259999999999999,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.093}]}]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":1.0489999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":2.1429999999999998,"15min":14.843},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88900000000000001,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.35499999999999998},"max":{"1min":1.117,"5min":2.8450000000000002,"15min":16.439},"last":0.60499999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91800000000000004,"15min":1.081},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.40100000000000002},"max":{"1min":1.389,"5min":1.4039999999999999,"15min":14.630000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":0.91500000000000004},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.38200000000000001},"max":{"1min":1.175,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.93899999999999995}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.95499999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.5},"max":{"1min":1.272,"5min":1.601,"15min":3.9529999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.1859999999999999,"5min":1.921,"15min":1.921},"last":0.85199999999999998}]},{"osd":3,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.45400000000000001},"max":{"1min":1.24,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.113},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.083,"15min":1.226},"min":{"1min":0.70499999999999996,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.452,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0309999999999999,"15min":1.222},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.40999999999999998},"max":{"1min":1.302,"5min":1.9910000000000001,"15min":15.904},"last":0.998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.173},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.31},"max":{"1min":1.2909999999999999,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.78700000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0349999999999999,"15min":1.196},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.52200000000000002},"max":{"1min":1.1910000000000001,"5min":4.5970000000000004,"15min":14.567},"last":1.163},{"interface":"front","average":{"1min":1.153,"5min":1.1519999999999999,"15min":1.343},"min":{"1min":0.77100000000000002,"5min":0.69499999999999995,"15min":0.56699999999999995},"max":{"1min":1.51,"5min":2.4079999999999999,"15min":15.089},"last":1.087}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0189999999999999,"15min":1.2589999999999999},"min":{"1min":0.74099999999999999,"5min":0.48499999999999999,"15min":0.436},"max":{"1min":1.101,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.70499999999999996,"5min":0.59499999999999997,"15min":0.36599999999999999},"max":{"1min":1.3560000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":1.2130000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.871,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48399999999999999},"max":{"1min":1.1299999999999999,"5min":1.292,"15min":1.47},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90700000000000003,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0609999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.875,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.1839999999999999,"5min":1.429,"15min":1.4990000000000001},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed Oct 25 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.878,"15min":0.86099999999999999},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.46700000000000003},"max":{"1min":1.1910000000000001,"5min":1.288,"15min":1.419},"last":0.83599999999999997},{"interface":"front","average":{"1min":1,"5min":0.98599999999999999,"15min":0.92800000000000005},"min":{"1min":0.60499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.3120000000000001,"5min":1.476,"15min":1.476},"last":1.157}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96299999999999997,"15min":0.93799999999999994},"min":{"1min":0.60699999999999998,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.2270000000000001,"5min":1.4219999999999999,"15min":1.5},"last":1},{"interface":"front","average":{"1min":0.872,"5min":0.89200000000000002,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.3140000000000001,"15min":1.518},"last":0.93999999999999995}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.58899999999999997,"5min":0.52700000000000002,"15min":0.313},"max":{"1min":1.716,"5min":1.716,"15min":2.6640000000000001},"last":1.23},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.76500000000000001,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.373,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.95699999999999996,"15min":0.96699999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.40000000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.085},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.298,"5min":1.5600000000000001,"15min":1.8149999999999999},"last":1.3320000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.278},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.421}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.96799999999999997,"5min":1.093,"15min":1.093},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.67900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.222},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.58999999999999997}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.67400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.19700000000000001},"max":{"1min":1.3109999999999999,"5min":1.425,"15min":1.425},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.76400000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.0649999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.73599999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0429999999999999,"5min":1.1220000000000001,"15min":1.3560000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.054,"5min":1.2330000000000001,"15min":1.8260000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.002},{"interface":"front","average":{"1min":1.014,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":1.2450000000000001,"5min":1.349,"15min":1.4710000000000001},"last":1.1180000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.93600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.45400000000000001},"max":{"1min":1.6060000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.016,"5min":1.0049999999999999,"15min":0.97199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.278,"5min":1.278,"15min":1.4830000000000001},"last":0.95499999999999996}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.92600000000000005},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.456},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.032,"15min":1.0009999999999999},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.5209999999999999,"5min":1.861,"15min":1.861},"last":1.028}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0449999999999999,"15min":1.0089999999999999},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5660000000000001},"last":1.196},{"interface":"front","average":{"1min":1.028,"5min":1.0269999999999999,"15min":0.98399999999999999},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.389},"last":1.087}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.4610000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.24299999999999999},"max":{"1min":1.0329999999999999,"5min":1.304,"15min":1.304},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.97299999999999998,"15min":1.4610000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75,"15min":0.70399999999999996},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.194,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.92200000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70599999999999996,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.1399999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28000000000000003},"max":{"1min":1.0389999999999999,"5min":1.1579999999999999,"15min":1.423},"last":1.1000000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1200000000000001,"15min":12.698},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0149999999999999},"min":{"1min":0.66900000000000004,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.252,"5min":1.4139999999999999,"15min":12.721},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2709999999999999,"5min":1.4530000000000001,"15min":1.546},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.28,"5min":1.325,"15min":2.206},"last":0.98799999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":0.97099999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.49099999999999999},"max":{"1min":1.1890000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.997,"5min":1.0680000000000001,"15min":1.0309999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"max":{"1min":1.3680000000000001,"5min":1.49,"15min":1.5980000000000001},"last":1.1679999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.996,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.339,"5min":1.3839999999999999,"15min":14.776},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.042},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.3819999999999999,"5min":1.655,"15min":10.509},"last":1.026}]}]},{"osd":0,"up_from":13,"seq":55834575002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193643,"statfs":{"total":200000000,"available":198291440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":0.90600000000000003,"5min":1.0660000000000001,"15min":5.1029999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":4.9980000000000002},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60099999999999998,"15min":0.64300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23499999999999999},"max":{"1min":0.85899999999999999,"5min":1.032,"15min":4.2320000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25},"max":{"1min":1.0780000000000001,"5min":1.2949999999999999,"15min":3.3919999999999999},"last":0.80500000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3420000000000001,"15min":4.431},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.153,"5min":1.296,"15min":3.6579999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.2150000000000001,"15min":2.2970000000000002},"last":1.105},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.91000000000000003,"15min":0.92400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.47699999999999998},"max":{"1min":1.0549999999999999,"5min":1.2210000000000001,"15min":4.5860000000000003},"last":0.91700000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91200000000000003,"15min":0.90000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.2629999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94399999999999995,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1120000000000001,"5min":1.2130000000000001,"15min":5.2880000000000003},"last":0.86399999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":3.5649999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54400000000000004},"max":{"1min":1.117,"5min":1.3899999999999999,"15min":3.8340000000000001},"last":1.3340000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.113},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51500000000000001},"max":{"1min":1.6419999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":1.03},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.1359999999999999},"min":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.194,"5min":1.3680000000000001,"15min":11.622},"last":1.3819999999999999}]}]}],"pool_statfs":[]}} 2023-10-25T16:25:37.698 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-25T16:12:56.769211+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=16, tm_min=12, tm_sec=56, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=16, tm_min=25, tm_sec=32, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T16:25:37.698 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-25T16:25:57.700 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T16:25:57.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.837+0000 7f3501a75640 1 -- 172.21.15.177:0/3954922857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0d1160 msgr2=0x7f34fc0d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:57.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.837+0000 7f3501a75640 1 --2- 172.21.15.177:0/3954922857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0d1160 0x7f34fc0d15f0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009c80 tx=0x7f34f401f580 comp rx=0 tx=0).stop 2023-10-25T16:25:57.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- 172.21.15.177:0/3954922857 shutdown_connections 2023-10-25T16:25:57.838 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 --2- 172.21.15.177:0/3954922857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0d1160 0x7f34fc0d15f0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:57.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 --2- 172.21.15.177:0/3954922857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc15b700 0x7f34fc0cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:57.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- 172.21.15.177:0/3954922857 >> 172.21.15.177:0/3954922857 conn(0x7f34fc08ac30 msgr2=0x7f34fc09a550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:57.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- 172.21.15.177:0/3954922857 shutdown_connections 2023-10-25T16:25:57.839 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- 172.21.15.177:0/3954922857 wait complete. 2023-10-25T16:25:57.841 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 Processor -- start 2023-10-25T16:25:57.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- start start 2023-10-25T16:25:57.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 0x7f34fc159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:57.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc0d1160 0x7f34fc1e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:57.842 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc15b700 0x7f34fc0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:57.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1e5780 con 0x7f34fc0ade40 2023-10-25T16:25:57.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1e5a60 con 0x7f34fc15b700 2023-10-25T16:25:57.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1e5d40 con 0x7f34fc0d1160 2023-10-25T16:25:57.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 0x7f34fc159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:57.843 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 0x7f34fc159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55010/0 (socket says 172.21.15.177:55010) 2023-10-25T16:25:57.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 -- 172.21.15.177:0/758427565 learned_addr learned my addr 172.21.15.177:0/758427565 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:57.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 -- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc0d1160 msgr2=0x7f34fc1e50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:57.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34faffd640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc0d1160 0x7f34fc1e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:57.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc0d1160 0x7f34fc1e50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:57.844 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 -- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc15b700 msgr2=0x7f34fc0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:57.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc15b700 0x7f34fc0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:57.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 -- 172.21.15.177:0/758427565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40098e0 con 0x7f34fc0ade40 2023-10-25T16:25:57.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34fb7fe640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 0x7f34fc159440 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00c940 tx=0x7f34ec00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:57.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec004220 con 0x7f34fc0ade40 2023-10-25T16:25:57.845 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34ec004470 con 0x7f34fc0ade40 2023-10-25T16:25:57.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec007bf0 con 0x7f34fc0ade40 2023-10-25T16:25:57.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc1e6020 con 0x7f34fc0ade40 2023-10-25T16:25:57.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.841+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc0c87e0 con 0x7f34fc0ade40 2023-10-25T16:25:57.846 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.845+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc09f1c0 con 0x7f34fc0ade40 2023-10-25T16:25:57.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.845+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34ec007d50 con 0x7f34fc0ade40 2023-10-25T16:25:57.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.845+0000 7f34f3fff640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34dc066470 0x7f34dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:57.847 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.845+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f34ec084450 con 0x7f34fc0ade40 2023-10-25T16:25:57.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.849+0000 7f34faffd640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34dc066470 0x7f34dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:57.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.849+0000 7f34faffd640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34dc066470 0x7f34dc068930 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f34fc15a110 tx=0x7f34e4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:57.848 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:57.849+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34ec051c30 con 0x7f34fc0ade40 2023-10-25T16:25:58.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.001+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 --> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34fc1e5bd0 con 0x7f34dc066470 2023-10-25T16:25:58.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f34f3fff640 1 -- 172.21.15.177:0/758427565 <== mgr.4138 v2:172.21.15.184:6832/1169577116 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48686 (secure 0 0 0) 0x7f34fc1e5bd0 con 0x7f34dc066470 2023-10-25T16:25:58.008 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:58.008 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2023-10-25T16:25:58.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34dc066470 msgr2=0x7f34dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34dc066470 0x7f34dc068930 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f34fc15a110 tx=0x7f34e4009040 comp rx=0 tx=0).stop 2023-10-25T16:25:58.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 msgr2=0x7f34fc159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 0x7f34fc159440 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00c940 tx=0x7f34ec00ce00 comp rx=0 tx=0).stop 2023-10-25T16:25:58.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 shutdown_connections 2023-10-25T16:25:58.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f34dc066470 0x7f34dc068930 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34fc15b700 0x7f34fc0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f34fc0d1160 0x7f34fc1e50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 --2- 172.21.15.177:0/758427565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34fc0ade40 0x7f34fc159440 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.009+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 >> 172.21.15.177:0/758427565 conn(0x7f34fc08ac30 msgr2=0x7f34fc15a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:58.011 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.013+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 shutdown_connections 2023-10-25T16:25:58.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.013+0000 7f3501a75640 1 -- 172.21.15.177:0/758427565 wait complete. 2023-10-25T16:25:58.026 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":581,"stamp":"2023-10-25T16:25:56.877070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552611,"statfs":{"total":1600000000,"available":1589873728,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002999"},"pg_stats":[{"pgid":"1.0","version":"197'119","reported_seq":345,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-25T16:25:37.405500+0000","last_change":"2023-10-25T16:25:37.405602+0000","last_active":"2023-10-25T16:25:37.405500+0000","last_peered":"2023-10-25T16:25:37.405500+0000","last_clean":"2023-10-25T16:25:37.405500+0000","last_became_active":"2023-10-25T16:12:57.796242+0000","last_became_peered":"2023-10-25T16:12:57.796242+0000","last_unstale":"2023-10-25T16:25:37.405500+0000","last_undegraded":"2023-10-25T16:25:37.405500+0000","last_fullsized":"2023-10-25T16:25:37.405500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"197'119","last_scrub_stamp":"2023-10-25T16:25:37.405405+0000","last_deep_scrub":"197'119","last_deep_scrub_stamp":"2023-10-25T16:25:37.405405+0000","last_clean_scrub_stamp":"2023-10-25T16:25:37.405405+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T22:28:16.119562+0000","scrub_duration":0.0044110019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":2,"up_from":14,"seq":60129542303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61499999999999999,"15min":0.57899999999999996},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.93400000000000005,"5min":1.0329999999999999,"15min":1.1950000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.67900000000000005,"15min":0.625},"min":{"1min":0.34000000000000002,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.93400000000000005,"5min":1.0489999999999999,"15min":1.077},"last":0.81599999999999995}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.70299999999999996,"15min":0.64100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.27000000000000002},"max":{"1min":1.0920000000000001,"5min":1.0940000000000001,"15min":1.1759999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73399999999999999,"15min":0.65500000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.26400000000000001},"max":{"1min":1.169,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.1000000000000001}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.68100000000000005,"15min":0.65200000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.81699999999999995,"5min":1.2290000000000001,"15min":1.246},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.82699999999999996,"15min":0.73199999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":1.0209999999999999,"5min":1.153,"15min":1.345},"last":0.99099999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.95499999999999996,"15min":0.89700000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.438},"max":{"1min":1.105,"5min":1.3520000000000001,"15min":1.6120000000000001},"last":1.075},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.95399999999999996,"15min":0.91300000000000003},"min":{"1min":0.67400000000000004,"5min":0.53800000000000003,"15min":0.47499999999999998},"max":{"1min":1.198,"5min":1.2729999999999999,"15min":1.5760000000000001},"last":1.155}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.90300000000000002,"15min":0.88100000000000001},"min":{"1min":0.53200000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.2370000000000001,"5min":1.46,"15min":1.4930000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.998,"15min":0.95899999999999996},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.47899999999999998},"max":{"1min":1.238,"5min":1.4339999999999999,"15min":1.671},"last":0.91400000000000003}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98499999999999999,"15min":0.94699999999999995},"min":{"1min":0.60599999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2609999999999999,"5min":1.294,"15min":1.5009999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":0.95599999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.2,"5min":1.3959999999999999,"15min":1.8400000000000001},"last":0.873}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.0289999999999999,"15min":0.97699999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51800000000000002},"max":{"1min":1.218,"5min":1.3029999999999999,"15min":1.677},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0169999999999999,"15min":0.99199999999999999},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.214,"5min":1.4510000000000001,"15min":1.7569999999999999},"last":1.038}]}]},{"osd":7,"up_from":13,"seq":55834575006,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193643,"statfs":{"total":200000000,"available":198291440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.79600000000000004},"min":{"1min":0.499,"5min":0.442,"15min":0.35899999999999999},"max":{"1min":1.179,"5min":1.24,"15min":1.256},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83099999999999996,"15min":0.83799999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.44800000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.534},"last":0.72299999999999998}]},{"osd":1,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.92500000000000004,"15min":0.90900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51200000000000001,"15min":0.42899999999999999},"max":{"1min":1.1359999999999999,"5min":1.4259999999999999,"15min":1.647},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96699999999999997,"15min":0.93400000000000005},"min":{"1min":0.57599999999999996,"5min":0.51300000000000001,"15min":0.48799999999999999},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.0089999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.93300000000000005,"15min":0.873},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45500000000000002},"max":{"1min":1.4239999999999999,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.51800000000000002},"max":{"1min":1.425,"5min":1.4370000000000001,"15min":1.4550000000000001},"last":1.0369999999999999}]},{"osd":3,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.014,"15min":0.98599999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.505},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.04,"15min":0.98999999999999999},"min":{"1min":0.67000000000000004,"5min":0.55800000000000005,"15min":0.51500000000000001},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.85999999999999999}]},{"osd":4,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64400000000000002,"5min":0.52000000000000002,"15min":0.44},"max":{"1min":1.2989999999999999,"5min":1.478,"15min":1.4910000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.94699999999999995,"15min":0.96599999999999997},"min":{"1min":0.67700000000000005,"5min":0.61799999999999999,"15min":0.46300000000000002},"max":{"1min":1.397,"5min":1.4039999999999999,"15min":1.5900000000000001},"last":1.123}]},{"osd":5,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.97599999999999998,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61899999999999999,"15min":0.55000000000000004},"max":{"1min":1.3360000000000001,"5min":1.696,"15min":1.7370000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.032,"15min":1.024},"min":{"1min":0.77200000000000002,"5min":0.66000000000000003,"15min":0.48899999999999999},"max":{"1min":1.288,"5min":1.681,"15min":1.681},"last":1.1659999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:26 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.107,"15min":1.119},"min":{"1min":0.81699999999999995,"5min":0.70699999999999996,"15min":0.503},"max":{"1min":1.552,"5min":1.643,"15min":1.669},"last":1.149},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1359999999999999,"15min":1.119},"min":{"1min":0.93999999999999995,"5min":0.68500000000000005,"15min":0.57099999999999995},"max":{"1min":1.3979999999999999,"5min":1.591,"15min":1.7490000000000001},"last":1.2170000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89900000000000002,"15min":0.88100000000000001},"min":{"1min":0.58599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.2769999999999999,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.0309999999999999,"15min":0.93700000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3660000000000001,"5min":11.016999999999999,"15min":11.016999999999999},"last":1.046}]},{"osd":1,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":0.91400000000000003},"min":{"1min":0.73999999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2070000000000001,"5min":10.667,"15min":10.667},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":1.026,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.47999999999999998},"max":{"1min":1.181,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.004,"15min":0.93400000000000005},"min":{"1min":0.66700000000000004,"5min":0.55100000000000005,"15min":0.496},"max":{"1min":1.181,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0680000000000001,"15min":0.97199999999999998},"min":{"1min":0.63200000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1879999999999999,"5min":10.948,"15min":10.948},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.95399999999999996,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.53600000000000003},"max":{"1min":1.262,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.1499999999999999,"15min":1.0800000000000001},"min":{"1min":0.76500000000000001,"5min":0.73699999999999999,"15min":0.54700000000000004},"max":{"1min":1.4299999999999999,"5min":6.5629999999999997,"15min":6.5629999999999997},"last":0.872}]},{"osd":4,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.028,"15min":0.97699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41499999999999998},"max":{"1min":1.3200000000000001,"5min":11.081,"15min":11.081},"last":1.099},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39500000000000002},"max":{"1min":1.3380000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.079}]},{"osd":5,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.016,"15min":0.98999999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.44600000000000001},"max":{"1min":1.4910000000000001,"5min":1.6259999999999999,"15min":1.7629999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.163,"5min":1.139,"15min":1.083},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.46899999999999997},"max":{"1min":1.579,"5min":6.7539999999999996,"15min":6.7539999999999996},"last":0.97399999999999998}]},{"osd":7,"last update":"Wed Oct 25 16:25:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2609999999999999,"15min":1.147},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.46700000000000003},"max":{"1min":1.522,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.194,"5min":1.1819999999999999,"15min":1.103},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.45000000000000001},"max":{"1min":1.9259999999999999,"5min":6.8419999999999996,"15min":6.8419999999999996},"last":1.1200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.91500000000000004,"15min":1.0489999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.40200000000000002},"max":{"1min":1.2190000000000001,"5min":2.1429999999999998,"15min":14.843},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88900000000000001,"15min":1.0720000000000001},"min":{"1min":0.628,"5min":0.52600000000000002,"15min":0.35499999999999998},"max":{"1min":1.117,"5min":2.8450000000000002,"15min":16.439},"last":0.88700000000000001}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.91800000000000004,"15min":1.081},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.40100000000000002},"max":{"1min":1.389,"5min":1.4039999999999999,"15min":14.630000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.97199999999999998,"15min":0.91500000000000004},"min":{"1min":0.55600000000000005,"5min":0.53800000000000003,"15min":0.38200000000000001},"max":{"1min":1.175,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.161}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98499999999999999,"15min":0.95499999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.5},"max":{"1min":1.272,"5min":1.601,"15min":3.9529999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":1.0009999999999999,"15min":0.96699999999999997},"min":{"1min":0.68600000000000005,"5min":0.51100000000000001,"15min":0.48499999999999999},"max":{"1min":1.1859999999999999,"5min":1.921,"15min":1.921},"last":1.194}]},{"osd":3,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96899999999999997,"15min":0.97699999999999998},"min":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.45400000000000001},"max":{"1min":1.24,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.083},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.083,"15min":1.226},"min":{"1min":0.70499999999999996,"5min":0.58999999999999997,"15min":0.52900000000000003},"max":{"1min":1.452,"5min":1.8320000000000001,"15min":14.954000000000001},"last":0.85499999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0309999999999999,"15min":1.222},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.40999999999999998},"max":{"1min":1.302,"5min":1.9910000000000001,"15min":15.904},"last":1.2450000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.95399999999999996,"15min":1.173},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.31},"max":{"1min":1.2909999999999999,"5min":7.9610000000000003,"15min":17.219999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0349999999999999,"15min":1.196},"min":{"1min":0.73099999999999998,"5min":0.63100000000000001,"15min":0.52200000000000002},"max":{"1min":1.1910000000000001,"5min":4.5970000000000004,"15min":14.567},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.1519999999999999,"15min":1.343},"min":{"1min":0.77100000000000002,"5min":0.69499999999999995,"15min":0.56699999999999995},"max":{"1min":1.51,"5min":2.4079999999999999,"15min":15.089},"last":1.1200000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.0189999999999999,"15min":1.2589999999999999},"min":{"1min":0.74099999999999999,"5min":0.48499999999999999,"15min":0.436},"max":{"1min":1.101,"5min":7.8730000000000002,"15min":17.492000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1930000000000001},"min":{"1min":0.70499999999999996,"5min":0.59499999999999997,"15min":0.36599999999999999},"max":{"1min":1.3560000000000001,"5min":8.6920000000000002,"15min":8.6920000000000002},"last":0.995}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.871,"15min":0.83899999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.48399999999999999},"max":{"1min":1.1299999999999999,"5min":1.292,"15min":1.47},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.90700000000000003,"15min":0.85399999999999998},"min":{"1min":0.55800000000000005,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.0329999999999999}]},{"osd":1,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.875,"15min":0.85399999999999998},"min":{"1min":0.54900000000000004,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":1.0189999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.998,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.498,"15min":0.48399999999999999},"max":{"1min":1.1839999999999999,"5min":1.429,"15min":1.4990000000000001},"last":1.0649999999999999}]},{"osd":2,"last update":"Wed Oct 25 16:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.88700000000000001,"15min":0.86599999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.46700000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.419},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.98199999999999998,"15min":0.93200000000000005},"min":{"1min":0.54600000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.228,"5min":1.476,"15min":1.476},"last":0.91700000000000004}]},{"osd":3,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96299999999999997,"15min":0.93799999999999994},"min":{"1min":0.60699999999999998,"5min":0.54700000000000004,"15min":0.38900000000000001},"max":{"1min":1.2270000000000001,"5min":1.4219999999999999,"15min":1.5},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.89200000000000002,"15min":0.84099999999999997},"min":{"1min":0.63400000000000001,"5min":0.52800000000000002,"15min":0.45300000000000001},"max":{"1min":1.091,"5min":1.3140000000000001,"15min":1.518},"last":0.76600000000000001}]},{"osd":5,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.58899999999999997,"5min":0.52700000000000002,"15min":0.313},"max":{"1min":1.716,"5min":1.716,"15min":2.6640000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1020000000000001,"15min":1.1180000000000001},"min":{"1min":0.76500000000000001,"5min":0.60099999999999998,"15min":0.437},"max":{"1min":1.373,"5min":1.6379999999999999,"15min":1.8300000000000001},"last":1.149}]},{"osd":6,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.95699999999999996,"15min":0.96699999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.40000000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":2.085},"last":0.874},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.34399999999999997},"max":{"1min":1.298,"5min":1.5600000000000001,"15min":1.8149999999999999},"last":0.624}]},{"osd":7,"last update":"Wed Oct 25 16:25:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.68200000000000005,"5min":0.57799999999999996,"15min":0.47799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.141,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.71299999999999997,"15min":0.48399999999999999},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":1.1140000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.61299999999999999},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.22},"max":{"1min":0.96799999999999997,"5min":1.093,"15min":1.093},"last":0.621},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72999999999999998,"15min":0.67900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.222},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.67300000000000004}]},{"osd":1,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71999999999999997,"15min":0.67400000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.19700000000000001},"max":{"1min":1.3109999999999999,"5min":1.425,"15min":1.425},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83399999999999996,"15min":0.76400000000000001},"min":{"1min":0.441,"5min":0.375,"15min":0.30299999999999999},"max":{"1min":1.0649999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.42199999999999999,"5min":0.309,"15min":0.28000000000000003},"max":{"1min":1.0429999999999999,"5min":1.1220000000000001,"15min":1.3560000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.749,"15min":0.71099999999999997},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.28899999999999998},"max":{"1min":1.054,"5min":1.2330000000000001,"15min":1.8260000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.90000000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.014,"5min":1.0249999999999999,"15min":0.998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51300000000000001},"max":{"1min":1.2450000000000001,"5min":1.349,"15min":1.4710000000000001},"last":1.091}]},{"osd":5,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.98599999999999999,"15min":0.93600000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.45400000000000001},"max":{"1min":1.6060000000000001,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.016,"5min":1.0049999999999999,"15min":0.97199999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47499999999999998},"max":{"1min":1.278,"5min":1.278,"15min":1.4830000000000001},"last":1.1319999999999999}]},{"osd":6,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.92600000000000005},"min":{"1min":0.68700000000000006,"5min":0.61299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2310000000000001,"5min":1.3089999999999999,"15min":1.456},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.032,"15min":1.0009999999999999},"min":{"1min":0.622,"5min":0.61699999999999999,"15min":0.505},"max":{"1min":1.5209999999999999,"5min":1.861,"15min":1.861},"last":1.022}]},{"osd":7,"last update":"Wed Oct 25 16:25:23 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0449999999999999,"15min":1.0089999999999999},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.504},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.5660000000000001},"last":1.05},{"interface":"front","average":{"1min":1.028,"5min":1.0269999999999999,"15min":0.98399999999999999},"min":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.51500000000000001},"max":{"1min":1.292,"5min":1.3240000000000001,"15min":1.389},"last":0.998}]}]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1091,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194220,"statfs":{"total":200000000,"available":198881808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61399999999999999,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.97099999999999997,"5min":1.042,"15min":1.4610000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.24299999999999999},"max":{"1min":1.0329999999999999,"5min":1.304,"15min":1.304},"last":0.78100000000000003}]},{"osd":2,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64500000000000002,"15min":0.59899999999999998},"min":{"1min":0.30299999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.97299999999999998,"15min":1.4610000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75,"15min":0.70399999999999996},"min":{"1min":0.371,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.194,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70599999999999996,"15min":0.66100000000000003},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":1.1399999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.77100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.28000000000000003},"max":{"1min":1.0389999999999999,"5min":1.1579999999999999,"15min":1.423},"last":0.85499999999999998}]},{"osd":4,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92400000000000004,"15min":0.95699999999999996},"min":{"1min":0.624,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1200000000000001,"15min":12.698},"last":1.081},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0149999999999999},"min":{"1min":0.66900000000000004,"5min":0.58399999999999996,"15min":0.54800000000000004},"max":{"1min":1.252,"5min":1.4139999999999999,"15min":12.721},"last":1.222}]},{"osd":5,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.98099999999999998,"15min":0.93500000000000005},"min":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2709999999999999,"5min":1.4530000000000001,"15min":1.546},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91200000000000003,"15min":0.89800000000000002},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":1.28,"5min":1.325,"15min":2.206},"last":1.002}]},{"osd":6,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":0.97099999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.49099999999999999},"max":{"1min":1.1890000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.997,"5min":1.0680000000000001,"15min":1.0309999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.52500000000000002},"max":{"1min":1.3680000000000001,"5min":1.49,"15min":1.5980000000000001},"last":1.0549999999999999}]},{"osd":7,"last update":"Wed Oct 25 16:25:25 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.996,"15min":1.0069999999999999},"min":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.52000000000000002},"max":{"1min":1.339,"5min":1.3839999999999999,"15min":14.776},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.0569999999999999,"15min":1.042},"min":{"1min":0.58599999999999997,"5min":0.56399999999999995,"15min":0.55500000000000005},"max":{"1min":1.3819999999999999,"5min":1.655,"15min":10.509},"last":1.1779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575006,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1668,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193643,"statfs":{"total":200000000,"available":198291440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59199999999999997,"15min":0.628},"min":{"1min":0.28899999999999998,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":0.90600000000000003,"5min":1.0660000000000001,"15min":5.1029999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.70599999999999996},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25700000000000001},"max":{"1min":1.0880000000000001,"5min":1.262,"15min":4.9980000000000002},"last":0.71999999999999997}]},{"osd":2,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60099999999999998,"15min":0.64300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.23499999999999999},"max":{"1min":0.85899999999999999,"5min":1.032,"15min":4.2320000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.25},"max":{"1min":1.0780000000000001,"5min":1.2949999999999999,"15min":3.3919999999999999},"last":0.872}]},{"osd":3,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.78900000000000003,"15min":0.78200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3420000000000001,"15min":4.431},"last":1.02},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.84299999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.28599999999999998},"max":{"1min":1.153,"5min":1.296,"15min":3.6579999999999999},"last":1.2030000000000001}]},{"osd":4,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86699999999999999,"15min":0.86099999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.2150000000000001,"15min":2.2970000000000002},"last":1.165},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.91000000000000003,"15min":0.92400000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.47699999999999998},"max":{"1min":1.0549999999999999,"5min":1.2210000000000001,"15min":4.5860000000000003},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.91200000000000003,"15min":0.90000000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.2629999999999999},"last":1.242},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94399999999999995,"15min":0.95299999999999996},"min":{"1min":0.61799999999999999,"5min":0.53500000000000003,"15min":0.53300000000000003},"max":{"1min":1.1120000000000001,"5min":1.2130000000000001,"15min":5.2880000000000003},"last":0.85399999999999998}]},{"osd":6,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":3.5649999999999999},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.97199999999999998,"15min":0.96199999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54400000000000004},"max":{"1min":1.117,"5min":1.3899999999999999,"15min":3.8340000000000001},"last":1.0820000000000001}]},{"osd":7,"last update":"Wed Oct 25 16:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.113},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51500000000000001},"max":{"1min":1.6419999999999999,"5min":1.6799999999999999,"15min":11.891999999999999},"last":1.125},{"interface":"front","average":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.1359999999999999},"min":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.59799999999999998},"max":{"1min":1.194,"5min":1.3680000000000001,"15min":11.622},"last":0.96599999999999997}]}]}],"pool_statfs":[]}} 2023-10-25T16:25:58.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-25T16:25:58.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 -- 172.21.15.177:0/2145533696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 msgr2=0x7f6c4c0cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2145533696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 0x7f6c4c0cb7e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009840 tx=0x7f6c4401c800 comp rx=0 tx=0).stop 2023-10-25T16:25:58.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 -- 172.21.15.177:0/2145533696 shutdown_connections 2023-10-25T16:25:58.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2145533696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 0x7f6c4c15b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2145533696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 0x7f6c4c0cb7e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 -- 172.21.15.177:0/2145533696 >> 172.21.15.177:0/2145533696 conn(0x7f6c4c0b0de0 msgr2=0x7f6c4c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:58.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 -- 172.21.15.177:0/2145533696 shutdown_connections 2023-10-25T16:25:58.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.145+0000 7f6c50d22640 1 -- 172.21.15.177:0/2145533696 wait complete. 2023-10-25T16:25:58.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 Processor -- start 2023-10-25T16:25:58.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- start start 2023-10-25T16:25:58.149 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 0x7f6c4c1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 0x7f6c4c0c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 0x7f6c4c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1528d0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c152bb0 con 0x7f6c4c156e60 2023-10-25T16:25:58.150 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c152e90 con 0x7f6c4c0c9f90 2023-10-25T16:25:58.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 0x7f6c4c0c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 0x7f6c4c0c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55026/0 (socket says 172.21.15.177:55026) 2023-10-25T16:25:58.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 -- 172.21.15.177:0/2341459944 learned_addr learned my addr 172.21.15.177:0/2341459944 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:58.151 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c4a59c640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 0x7f6c4c1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 -- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 msgr2=0x7f6c4c1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 0x7f6c4c1522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 -- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 msgr2=0x7f6c4c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 0x7f6c4c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.152 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 -- 172.21.15.177:0/2341459944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440094a0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c4a59c640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 0x7f6c4c1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T16:25:58.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c49d9b640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 0x7f6c4c0c5000 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400cbc0 tx=0x7f6c3400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:58.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400aa50 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c3400aca0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.153 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c153170 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34012680 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.154 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c0c5540 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.149+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c04daf0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.155 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.153+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c3401a3b0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.153+0000 7f6c42ffd640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c2c066470 0x7f6c2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.153+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c34084000 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.156 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.153+0000 7f6c4a59c640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c2c066470 0x7f6c2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.153+0000 7f6c4a59c640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c2c066470 0x7f6c2c068930 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6c440af000 tx=0x7f6c4401b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:58.157 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.157+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c34051790 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.301+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f6c4c065cf0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.305+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v39)=0 v39) v1 ==== 123+0+0 (secure 0 0 0) 0x7f6c34054db0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c42ffd640 1 -- 172.21.15.177:0/2341459944 <== mon.0 v2:172.21.15.177:3300/0 8 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6c34001cb0 con 0x7f6c4c0cbd20 2023-10-25T16:25:58.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c2c066470 msgr2=0x7f6c2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c2c066470 0x7f6c2c068930 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6c440af000 tx=0x7f6c4401b040 comp rx=0 tx=0).stop 2023-10-25T16:25:58.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 msgr2=0x7f6c4c0c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 0x7f6c4c0c5000 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400cbc0 tx=0x7f6c3400ccb0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 shutdown_connections 2023-10-25T16:25:58.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7f6c2c066470 0x7f6c2c068930 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c4c156e60 0x7f6c4c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c4c0cbd20 0x7f6c4c0c5000 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 --2- 172.21.15.177:0/2341459944 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c4c0c9f90 0x7f6c4c1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 >> 172.21.15.177:0/2341459944 conn(0x7f6c4c0b0de0 msgr2=0x7f6c4c158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:58.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 shutdown_connections 2023-10-25T16:25:58.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.309+0000 7f6c50d22640 1 -- 172.21.15.177:0/2341459944 wait complete. 2023-10-25T16:25:58.324 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T16:25:58.324 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T16:25:58.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/730445834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015bcc0 msgr2=0x7fd93015c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- 172.21.15.177:0/730445834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015bcc0 0x7fd93015c0e0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fd9300b3990 tx=0x7fd92401c520 comp rx=0 tx=0).stop 2023-10-25T16:25:58.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/730445834 shutdown_connections 2023-10-25T16:25:58.446 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- 172.21.15.177:0/730445834 >> v2:172.21.15.184:3300/0 conn(0x7fd93015c620 0x7fd9300cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- 172.21.15.177:0/730445834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015bcc0 0x7fd93015c0e0 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- 172.21.15.177:0/730445834 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd930158260 0x7fd9300654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/730445834 >> 172.21.15.177:0/730445834 conn(0x7fd9300cd6c0 msgr2=0x7fd9300cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:58.447 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/730445834 shutdown_connections 2023-10-25T16:25:58.448 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/730445834 wait complete. 2023-10-25T16:25:58.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 Processor -- start 2023-10-25T16:25:58.450 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- start start 2023-10-25T16:25:58.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd930158260 0x7fd9300ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd93015bcc0 0x7fd930154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 0x7fd930152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.451 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300ad060 con 0x7fd93015c620 2023-10-25T16:25:58.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd930154860 con 0x7fd93015bcc0 2023-10-25T16:25:58.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93013dbb0 con 0x7fd930158260 2023-10-25T16:25:58.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 0x7fd930152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 0x7fd930152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:55042/0 (socket says 172.21.15.177:55042) 2023-10-25T16:25:58.452 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 -- 172.21.15.177:0/2602659620 learned_addr learned my addr 172.21.15.177:0/2602659620 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-25T16:25:58.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd92f7fe640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd93015bcc0 0x7fd930154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd92ffff640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd930158260 0x7fd9300ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 -- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd930158260 msgr2=0x7fd9300ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd930158260 0x7fd9300ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 -- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd93015bcc0 msgr2=0x7fd930154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd93015bcc0 0x7fd930154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 -- 172.21.15.177:0/2602659620 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd924009560 con 0x7fd93015c620 2023-10-25T16:25:58.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd9348f3640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 0x7fd930152800 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b970 tx=0x7fd92800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:58.454 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800cb40 con 0x7fd93015c620 2023-10-25T16:25:58.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd92800ccc0 con 0x7fd93015c620 2023-10-25T16:25:58.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd930154ab0 con 0x7fd93015c620 2023-10-25T16:25:58.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280146a0 con 0x7fd93015c620 2023-10-25T16:25:58.455 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.449+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd930155070 con 0x7fd93015c620 2023-10-25T16:25:58.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.453+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93004daf0 con 0x7fd93015c620 2023-10-25T16:25:58.456 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.453+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd92801d3b0 con 0x7fd93015c620 2023-10-25T16:25:58.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.453+0000 7fd92cff9640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd91c066470 0x7fd91c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T16:25:58.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.453+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd928083d50 con 0x7fd93015c620 2023-10-25T16:25:58.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.453+0000 7fd92ffff640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd91c066470 0x7fd91c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T16:25:58.458 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.453+0000 7fd92ffff640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd91c066470 0x7fd91c068930 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd920006fd0 tx=0x7fd920008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T16:25:58.459 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.457+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd928051430 con 0x7fd93015c620 2023-10-25T16:25:58.642 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd930066a90 con 0x7fd93015c620 2023-10-25T16:25:58.643 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd92cff9640 1 -- 172.21.15.177:0/2602659620 <== mon.0 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+3708 (secure 0 0 0) 0x7fd928019090 con 0x7fd93015c620 2023-10-25T16:25:58.643 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-25T16:25:58.643 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":74,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1380308982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1380308982},{"type":"v1","addr":"172.21.15.184:6835","nonce":1380308982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":7345,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/657256215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":657256215},{"type":"v1","addr":"172.21.15.184:6837","nonce":657256215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":9576,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/2266446820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2266446820},{"type":"v1","addr":"172.21.15.177:6833","nonce":2266446820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2540527849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":2540527849},{"type":"v1","addr":"172.21.15.177:6835","nonce":2540527849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[]} 2023-10-25T16:25:58.644 INFO:teuthology.orchestra.run.smithi177.stderr:dumped fsmap epoch 74 2023-10-25T16:25:58.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd91c066470 msgr2=0x7fd91c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.645 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd91c066470 0x7fd91c068930 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd920006fd0 tx=0x7fd920008040 comp rx=0 tx=0).stop 2023-10-25T16:25:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 msgr2=0x7fd930152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T16:25:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 0x7fd930152800 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b970 tx=0x7fd92800be30 comp rx=0 tx=0).stop 2023-10-25T16:25:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 shutdown_connections 2023-10-25T16:25:58.646 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:6832/1169577116,v1:172.21.15.184:6833/1169577116] conn(0x7fd91c066470 0x7fd91c068930 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd93015c620 0x7fd930152800 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd93015bcc0 0x7fd930154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 --2- 172.21.15.177:0/2602659620 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd930158260 0x7fd9300ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T16:25:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 >> 172.21.15.177:0/2602659620 conn(0x7fd9300cd6c0 msgr2=0x7fd9300cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T16:25:58.647 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 shutdown_connections 2023-10-25T16:25:58.648 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-25T16:25:58.645+0000 7fd936356640 1 -- 172.21.15.177:0/2602659620 wait complete. 2023-10-25T16:25:58.662 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-25T16:25:58.662 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-25T16:25:58.663 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T16:25:58.663 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.671 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T16:25:58.672 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T16:25:58.672 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.729 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T16:25:58.729 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T16:25:58.729 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.745 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T16:25:58.745 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T16:25:58.745 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.804 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T16:25:58.804 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-25T16:25:58.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-25T16:25:58.805 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.831 INFO:tasks.ceph.osd.0:Stopped 2023-10-25T16:25:58.831 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-25T16:25:58.831 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.927 INFO:tasks.ceph.osd.1:Stopped 2023-10-25T16:25:58.928 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-25T16:25:58.928 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:58.988 INFO:tasks.ceph.osd.2:Stopped 2023-10-25T16:25:58.988 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-25T16:25:58.989 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.015 INFO:tasks.ceph.osd.3:Stopped 2023-10-25T16:25:59.016 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-25T16:25:59.016 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.064 INFO:tasks.ceph.osd.4:Stopped 2023-10-25T16:25:59.064 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-25T16:25:59.064 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.099 INFO:tasks.ceph.osd.5:Stopped 2023-10-25T16:25:59.100 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-25T16:25:59.100 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.174 INFO:tasks.ceph.osd.6:Stopped 2023-10-25T16:25:59.174 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-25T16:25:59.175 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.263 INFO:tasks.ceph.osd.7:Stopped 2023-10-25T16:25:59.263 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-25T16:25:59.264 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-25T16:25:59.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.293 INFO:tasks.ceph.mgr.y:Stopped 2023-10-25T16:25:59.294 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-25T16:25:59.294 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.323 INFO:tasks.ceph.mgr.x:Stopped 2023-10-25T16:25:59.323 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-25T16:25:59.323 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-25T16:25:59.324 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.357 INFO:tasks.ceph.mon.a:Stopped 2023-10-25T16:25:59.357 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-25T16:25:59.358 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.389 INFO:tasks.ceph.mon.b:Stopped 2023-10-25T16:25:59.389 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-25T16:25:59.389 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T16:25:59.446 INFO:tasks.ceph.mon.c:Stopped 2023-10-25T16:25:59.447 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-25T16:25:59.447 DEBUG:teuthology.orchestra.run.smithi177:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-25T16:25:59.465 INFO:teuthology.orchestra.run.smithi177.stdout:2023-10-25T16:12:53.778517+0000 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 127893.352632 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-25T16:25:59.466 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-25T16:25:59.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-25T16:25:59.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-25T16:25:59.581 DEBUG:teuthology.orchestra.run.smithi177:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-10-25T16:25:59.636 INFO:teuthology.orchestra.run.smithi177.stdout:2023-10-25T16:12:53.778517+0000 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 127893.352632 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-10-25T16:25:59.637 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:25:59.637 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-25T16:26:00.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:26:00.054 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-25T16:26:00.259 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:26:00.260 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-25T16:26:00.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:26:00.449 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-25T16:26:00.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:26:00.609 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-25T16:26:00.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:26:00.938 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-25T16:26:01.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:26:01.156 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-25T16:26:01.339 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:26:01.339 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-25T16:26:01.505 INFO:tasks.ceph:Archiving mon data... 2023-10-25T16:26:01.506 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/data/mon.a.tgz 2023-10-25T16:26:01.507 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2023-10-25T16:26:01.513 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.gwF22Hfeea 2023-10-25T16:26:01.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gwF22Hfeea 2023-10-25T16:26:01.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.gwF22Hfeea 2023-10-25T16:26:01.734 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.gwF22Hfeea is 462KB 2023-10-25T16:26:01.799 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.gwF22Hfeea 2023-10-25T16:26:01.805 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/data/mon.b.tgz 2023-10-25T16:26:01.805 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-25T16:26:01.811 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.bnlbukPMtY 2023-10-25T16:26:01.812 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.bnlbukPMtY 2023-10-25T16:26:01.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.bnlbukPMtY 2023-10-25T16:26:02.033 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.bnlbukPMtY is 479KB 2023-10-25T16:26:02.096 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.bnlbukPMtY 2023-10-25T16:26:02.101 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/data/mon.c.tgz 2023-10-25T16:26:02.102 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-25T16:26:02.149 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.gihOCs4Hs1 2023-10-25T16:26:02.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gihOCs4Hs1 2023-10-25T16:26:02.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.gihOCs4Hs1 2023-10-25T16:26:02.369 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.gihOCs4Hs1 is 480KB 2023-10-25T16:26:02.432 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.gihOCs4Hs1 2023-10-25T16:26:02.437 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-25T16:26:02.438 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-25T16:26:02.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-25T16:26:02.493 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-25T16:26:02.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-25T16:26:02.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-25T16:26:02.520 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-25T16:26:02.563 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-25T16:26:02.566 INFO:tasks.ceph:Archiving crash dumps... 2023-10-25T16:26:02.568 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/remote/smithi177/crash 2023-10-25T16:26:02.569 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-25T16:26:02.583 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/remote/smithi184/crash 2023-10-25T16:26:02.584 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-25T16:26:02.621 INFO:tasks.ceph:Shutting down logrotate 2023-10-25T16:26:02.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:26:02.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T16:26:02.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-25T16:26:02.716 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-25T16:26:02.748 INFO:tasks.ceph:Compressing logs... 2023-10-25T16:26:02.749 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-25T16:26:02.759 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-25T16:26:02.775 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36392.log 2023-10-25T16:26:02.776 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37719.log 2023-10-25T16:26:02.776 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56924.log 2023-10-25T16:26:02.776 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36392.log.gz 2023-10-25T16:26:02.782 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56065.log 2023-10-25T16:26:02.782 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37719.log.gz 2023-10-25T16:26:02.782 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38577.log 2023-10-25T16:26:02.783 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56924.log: /var/log/ceph/ceph-client.admin.56065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45128.log 2023-10-25T16:26:02.783 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2%/var/log/ceph/ceph-client.admin.38577.log: -- replaced with /var/log/ceph/ceph-client.admin.56065.log.gz 2023-10-25T16:26:02.783 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54643.log 2023-10-25T16:26:02.783 INFO:teuthology.orchestra.run.smithi177.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38577.log.gz 2023-10-25T16:26:02.783 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2023-10-25T16:26:02.784 INFO:teuthology.orchestra.run.smithi177.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56924.log.gz 2023-10-25T16:26:02.784 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45128.log.gz 2023-10-25T16:26:02.784 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50939.log 2023-10-25T16:26:02.784 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47745.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54643.log.gz 2023-10-25T16:26:02.784 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35395.log 2023-10-25T16:26:02.785 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2023-10-25T16:26:02.785 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51043.log 2023-10-25T16:26:02.785 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47903.log 2023-10-25T16:26:02.785 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35395.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50939.log.gz 2023-10-25T16:26:02.785 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41804.log 2023-10-25T16:26:02.786 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51043.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35395.log.gz 2023-10-25T16:26:02.786 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51043.log.gz 2023-10-25T16:26:02.786 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47029.log 2023-10-25T16:26:02.786 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47903.log.gz 2023-10-25T16:26:02.786 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43161.log 2023-10-25T16:26:02.787 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49435.log 2023-10-25T16:26:02.787 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47029.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41804.log.gz 2023-10-25T16:26:02.787 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35134.log 2023-10-25T16:26:02.787 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47029.log.gz 2023-10-25T16:26:02.787 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43161.log.gz 2023-10-25T16:26:02.787 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48333.log 2023-10-25T16:26:02.788 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49435.log.gz 2023-10-25T16:26:02.788 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39299.log 2023-10-25T16:26:02.788 INFO:teuthology.orchestra.run.smithi177.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35134.log.gz 2023-10-25T16:26:02.788 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50991.log 2023-10-25T16:26:02.813 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48333.log: /var/log/ceph/ceph-client.admin.39299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2023-10-25T16:26:02.814 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48333.log.gz 2023-10-25T16:26:02.814 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39299.log.gz 2023-10-25T16:26:02.814 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54511.log 2023-10-25T16:26:02.814 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50991.log.gz 2023-10-25T16:26:02.815 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54277.log 2023-10-25T16:26:02.815 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log 2023-10-25T16:26:02.815 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43375.log 2023-10-25T16:26:02.815 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54511.log.gz 2023-10-25T16:26:02.815 INFO:teuthology.orchestra.run.smithi177.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2023-10-25T16:26:02.816 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54277.log.gz 2023-10-25T16:26:02.816 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2023-10-25T16:26:02.816 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45865.log.gz 2023-10-25T16:26:02.816 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2023-10-25T16:26:02.817 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43375.log.gz 2023-10-25T16:26:02.817 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36826.log 2023-10-25T16:26:02.817 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40721.log: /var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45573.log 2023-10-25T16:26:02.817 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2023-10-25T16:26:02.817 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2023-10-25T16:26:02.818 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36826.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz 2023-10-25T16:26:02.818 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45573.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36826.log.gz 2023-10-25T16:26:02.818 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46462.log 2023-10-25T16:26:02.818 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45573.log.gz 2023-10-25T16:26:02.818 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log 2023-10-25T16:26:02.819 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2023-10-25T16:26:02.819 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43524.log 2023-10-25T16:26:02.819 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46462.log.gz 2023-10-25T16:26:02.819 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55533.log 2023-10-25T16:26:02.819 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48421.log: /var/log/ceph/ceph-client.admin.43524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2023-10-25T16:26:02.820 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2023-10-25T16:26:02.820 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43524.log.gz 2023-10-25T16:26:02.820 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51310.log 2023-10-25T16:26:02.820 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.55533.log: /var/log/ceph/ceph-client.admin.41778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2023-10-25T16:26:02.820 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2023-10-25T16:26:02.820 INFO:teuthology.orchestra.run.smithi177.stderr:gzip/var/log/ceph/ceph-client.admin.51310.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-25T16:26:02.821 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46021.log 2023-10-25T16:26:02.821 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51310.log.gz 2023-10-25T16:26:02.821 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2023-10-25T16:26:02.821 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2023-10-25T16:26:02.821 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46923.log 2023-10-25T16:26:02.822 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42199.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46021.log.gz 2023-10-25T16:26:02.822 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53646.log 2023-10-25T16:26:02.822 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2023-10-25T16:26:02.822 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43401.log 2023-10-25T16:26:02.822 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46923.log: /var/log/ceph/ceph-client.admin.53646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2023-10-25T16:26:02.823 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46923.log.gz 2023-10-25T16:26:02.823 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43401.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53646.log.gz 2023-10-25T16:26:02.823 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37511.log 2023-10-25T16:26:02.823 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43401.log.gz 2023-10-25T16:26:02.823 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41596.log 2023-10-25T16:26:02.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39055.log: /var/log/ceph/ceph-client.admin.37511.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2023-10-25T16:26:02.824 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36366.log 2023-10-25T16:26:02.824 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37511.log.gz 2023-10-25T16:26:02.824 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34945.log 2023-10-25T16:26:02.824 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41596.log: /var/log/ceph/ceph-client.admin.36366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2023-10-25T16:26:02.825 INFO:teuthology.orchestra.run.smithi177.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41596.log.gz 2023-10-25T16:26:02.825 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34945.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36366.log.gz 2023-10-25T16:26:02.825 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2023-10-25T16:26:02.825 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34945.log.gz 2023-10-25T16:26:02.825 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54695.log 2023-10-25T16:26:02.826 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2023-10-25T16:26:02.826 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40112.log 2023-10-25T16:26:02.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45917.log: gzip/var/log/ceph/ceph-client.admin.54695.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2023-10-25T16:26:02.826 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2023-10-25T16:26:02.826 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40112.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54695.log.gz 2023-10-25T16:26:02.827 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35838.log 2023-10-25T16:26:02.827 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40112.log.gz 2023-10-25T16:26:02.827 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2023-10-25T16:26:02.827 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44134.log: /var/log/ceph/ceph-client.2.35838.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2023-10-25T16:26:02.827 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44002.log 2023-10-25T16:26:02.828 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52361.log 2023-10-25T16:26:02.828 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46347.log: 91.4% -- replaced with /var/log/ceph/ceph-client.2.35838.log.gz 2023-10-25T16:26:02.828 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2023-10-25T16:26:02.828 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2023-10-25T16:26:02.829 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46283.log 2023-10-25T16:26:02.829 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44002.log.gz 2023-10-25T16:26:02.829 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52361.log: /var/log/ceph/ceph-client.admin.48269.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52361.log.gz 2023-10-25T16:26:02.829 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 94.6% --verbose -- -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-25T16:26:02.829 INFO:teuthology.orchestra.run.smithi177.stderr: /var/log/ceph/ceph-client.admin.50728.log 2023-10-25T16:26:02.829 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2023-10-25T16:26:02.830 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38759.log 2023-10-25T16:26:02.830 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46283.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50728.log: /var/log/ceph/ceph-client.admin.44785.log 2023-10-25T16:26:02.830 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46283.log.gz 2023-10-25T16:26:02.830 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38759.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50728.log.gz 2023-10-25T16:26:02.830 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41333.log 2023-10-25T16:26:02.831 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2023-10-25T16:26:02.831 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38759.log.gz 2023-10-25T16:26:02.831 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2023-10-25T16:26:02.831 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53956.log 2023-10-25T16:26:02.832 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41333.log.gz 2023-10-25T16:26:02.832 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41544.log 2023-10-25T16:26:02.832 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2023-10-25T16:26:02.832 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54225.log 2023-10-25T16:26:02.832 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53956.log.gz 2023-10-25T16:26:02.832 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2023-10-25T16:26:02.833 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41544.log: /var/log/ceph/ceph-client.admin.54225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39273.log 2023-10-25T16:26:02.833 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41544.log.gz 2023-10-25T16:26:02.833 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54225.log.gz 2023-10-25T16:26:02.833 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51882.log 2023-10-25T16:26:02.833 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2023-10-25T16:26:02.834 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2023-10-25T16:26:02.834 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39273.log: /var/log/ceph/ceph-client.admin.51882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45336.log 2023-10-25T16:26:02.834 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39273.log.gz 2023-10-25T16:26:02.834 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51882.log.gz 2023-10-25T16:26:02.834 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55090.log 2023-10-25T16:26:02.835 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2023-10-25T16:26:02.835 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34120.log 2023-10-25T16:26:02.835 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45336.log: /var/log/ceph/ceph-client.admin.55090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2023-10-25T16:26:02.835 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45336.log.gz 2023-10-25T16:26:02.835 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55090.log.gz 2023-10-25T16:26:02.836 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48685.log 2023-10-25T16:26:02.836 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34120.log.gz 2023-10-25T16:26:02.836 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55981.log 2023-10-25T16:26:02.836 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46738.log: /var/log/ceph/ceph-client.admin.48685.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.54303.log -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2023-10-25T16:26:02.836 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:02.837 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48685.log.gz 2023-10-25T16:26:02.837 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37771.log 2023-10-25T16:26:02.837 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55981.log.gz 2023-10-25T16:26:02.837 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38287.log 2023-10-25T16:26:02.837 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54303.log: /var/log/ceph/ceph-client.admin.37771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55478.log 2023-10-25T16:26:02.837 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54303.log.gz 2023-10-25T16:26:02.838 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37771.log.gz 2023-10-25T16:26:02.838 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2023-10-25T16:26:02.838 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38287.log.gz 2023-10-25T16:26:02.838 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50260.log 2023-10-25T16:26:02.838 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55478.log: /var/log/ceph/ceph-client.admin.46949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57158.log 2023-10-25T16:26:02.839 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55478.log.gz 2023-10-25T16:26:02.839 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2023-10-25T16:26:02.839 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40771.log 2023-10-25T16:26:02.839 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50260.log.gz 2023-10-25T16:26:02.839 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-25T16:26:02.839 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57158.log: /var/log/ceph/ceph-client.admin.40771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2023-10-25T16:26:02.840 INFO:teuthology.orchestra.run.smithi177.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57158.log.gz 2023-10-25T16:26:02.840 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40771.log.gz 2023-10-25T16:26:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50171.log 2023-10-25T16:26:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2023-10-25T16:26:02.840 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45284.log: /var/log/ceph/ceph-client.admin.50171.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2023-10-25T16:26:02.841 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53883.log 2023-10-25T16:26:02.841 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50171.log.gz 2023-10-25T16:26:02.841 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48659.log 2023-10-25T16:26:02.841 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2023-10-25T16:26:02.841 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53883.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2023-10-25T16:26:02.841 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48659.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53883.log.gz 2023-10-25T16:26:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2023-10-25T16:26:02.842 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48659.log.gz 2023-10-25T16:26:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40940.log 2023-10-25T16:26:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34302.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2023-10-25T16:26:02.842 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33168.log 2023-10-25T16:26:02.843 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2023-10-25T16:26:02.843 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49097.log 2023-10-25T16:26:02.843 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40940.log.gz 2023-10-25T16:26:02.843 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2023-10-25T16:26:02.843 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33168.log: /var/log/ceph/ceph-client.admin.49097.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.33168.log.gz 2023-10-25T16:26:02.843 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47551.log 2023-10-25T16:26:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49097.log.gz 2023-10-25T16:26:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54812.log 2023-10-25T16:26:02.844 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2023-10-25T16:26:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37875.log 2023-10-25T16:26:02.844 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54812.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47551.log.gz 2023-10-25T16:26:02.845 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54812.log.gz 2023-10-25T16:26:02.845 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34040.log 2023-10-25T16:26:02.845 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49648.log 2023-10-25T16:26:02.845 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37875.log: /var/log/ceph/ceph-client.admin.34040.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37875.log.gz 2023-10-25T16:26:02.845 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46402.log 2023-10-25T16:26:02.845 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34040.log.gz 2023-10-25T16:26:02.846 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40060.log 2023-10-25T16:26:02.864 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33858.log 2023-10-25T16:26:02.864 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35332.log 2023-10-25T16:26:02.864 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.3.33858.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-25T16:26:02.864 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.35332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35527.log 2023-10-25T16:26:02.865 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-25T16:26:02.865 INFO:teuthology.orchestra.run.smithi184.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.3.33858.log.gz 2023-10-25T16:26:02.865 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.35527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34238.log 2023-10-25T16:26:02.865 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2023-10-25T16:26:02.866 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.34238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33148.log 2023-10-25T16:26:02.866 INFO:teuthology.orchestra.run.smithi184.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.1.35527.log.gz 2023-10-25T16:26:02.866 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34423.log 2023-10-25T16:26:02.866 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33148.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2023-10-25T16:26:02.866 INFO:teuthology.orchestra.run.smithi184.stderr: 95.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34784.log 2023-10-25T16:26:02.867 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.1.35332.log.gz 2023-10-25T16:26:02.867 INFO:teuthology.orchestra.run.smithi184.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33148.log.gz 2023-10-25T16:26:02.867 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.34423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33124.log 2023-10-25T16:26:02.867 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.34784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2023-10-25T16:26:02.867 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.1.34238.log.gz 2023-10-25T16:26:02.868 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33748.log 2023-10-25T16:26:02.868 INFO:teuthology.orchestra.run.smithi184.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33124.log.gz 2023-10-25T16:26:02.868 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33172.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-25T16:26:02.868 INFO:teuthology.orchestra.run.smithi184.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2023-10-25T16:26:02.868 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.33748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35716.log 2023-10-25T16:26:02.868 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.1.34784.log.gz 2023-10-25T16:26:02.869 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35136.log 2023-10-25T16:26:02.869 INFO:teuthology.orchestra.run.smithi184.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.1.34423.log.gz 2023-10-25T16:26:02.869 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.35716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34972.log 2023-10-25T16:26:02.869 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.35136.log: gzip 90.5% -- replaced with /var/log/ceph/ceph-client.1.33748.log.gz 2023-10-25T16:26:02.870 INFO:teuthology.orchestra.run.smithi184.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-25T16:26:02.870 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.34972.log: 91.3% -- replaced with /var/log/ceph/ceph-client.1.35716.log.gz 2023-10-25T16:26:02.870 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-25T16:26:02.870 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33100.log 2023-10-25T16:26:02.870 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: 91.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34045.log 2023-10-25T16:26:02.871 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.1.35136.log.gz 2023-10-25T16:26:02.871 INFO:teuthology.orchestra.run.smithi184.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.1.34972.log.gz 2023-10-25T16:26:02.871 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33100.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-25T16:26:02.871 INFO:teuthology.orchestra.run.smithi184.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33100.log.gz 2023-10-25T16:26:02.871 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.34045.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-25T16:26:02.872 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-25T16:26:02.872 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: 89.2% -- replaced with /var/log/ceph/ceph-client.1.34045.log.gz 2023-10-25T16:26:02.872 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33069.log 2023-10-25T16:26:02.872 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.d.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-25T16:26:02.872 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2023-10-25T16:26:02.873 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33069.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33069.log.gz 2023-10-25T16:26:02.873 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-25T16:26:02.873 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33045.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz 2023-10-25T16:26:02.873 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34597.log 2023-10-25T16:26:02.873 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.b.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-25T16:26:02.873 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-25T16:26:02.874 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.34597.log: 91.6% -- replaced with /var/log/ceph/ceph-client.1.34597.log.gz 2023-10-25T16:26:02.874 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-25T16:26:02.874 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2023-10-25T16:26:02.877 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.33220.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2023-10-25T16:26:02.975 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46402.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49648.log.gz 2023-10-25T16:26:02.975 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50346.log 2023-10-25T16:26:02.976 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46402.log.gz 2023-10-25T16:26:02.976 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40878.log 2023-10-25T16:26:02.976 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4%/var/log/ceph/ceph-client.admin.50346.log: -- replaced with /var/log/ceph/ceph-client.admin.40060.log.gz 2023-10-25T16:26:02.977 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40560.log 2023-10-25T16:26:02.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40878.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50346.log.gz 2023-10-25T16:26:02.977 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36080.log 2023-10-25T16:26:02.977 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40878.log.gz 2023-10-25T16:26:02.977 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2023-10-25T16:26:02.978 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36080.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40560.log.gz 2023-10-25T16:26:02.978 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2023-10-25T16:26:02.978 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36080.log.gz 2023-10-25T16:26:02.978 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42499.log 2023-10-25T16:26:02.979 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2023-10-25T16:26:02.979 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52572.log 2023-10-25T16:26:02.979 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2023-10-25T16:26:02.979 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54008.log 2023-10-25T16:26:02.980 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52572.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42499.log.gz 2023-10-25T16:26:02.980 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44471.log 2023-10-25T16:26:02.980 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52572.log.gz 2023-10-25T16:26:02.980 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40378.log 2023-10-25T16:26:02.980 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54008.log.gz 2023-10-25T16:26:02.981 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38655.log 2023-10-25T16:26:02.981 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz 2023-10-25T16:26:02.981 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45995.log 2023-10-25T16:26:02.981 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38655.log: gzip 87.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40378.log.gz -- 2023-10-25T16:26:02.981 INFO:teuthology.orchestra.run.smithi177.stderr: /var/log/ceph/ceph-client.admin.53251.log 2023-10-25T16:26:02.982 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45995.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38655.log.gz 2023-10-25T16:26:02.982 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55272.log 2023-10-25T16:26:02.982 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2023-10-25T16:26:02.982 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56251.log 2023-10-25T16:26:02.983 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55272.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53251.log.gz 2023-10-25T16:26:02.983 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2023-10-25T16:26:02.983 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55272.log.gz 2023-10-25T16:26:02.983 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34432.log 2023-10-25T16:26:02.983 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56251.log.gz 2023-10-25T16:26:02.984 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54929.log 2023-10-25T16:26:02.984 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 2023-10-25T16:26:02.984 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48361.log 2023-10-25T16:26:02.984 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34432.log.gz 2023-10-25T16:26:02.984 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44290.log 2023-10-25T16:26:02.985 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54929.log.gz 2023-10-25T16:26:02.985 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37667.log 2023-10-25T16:26:02.985 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44290.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.48361.log.gz /var/log/ceph/ceph-client.admin.55760.log 2023-10-25T16:26:02.985 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:02.986 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44290.log.gz 2023-10-25T16:26:02.986 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2023-10-25T16:26:02.986 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37667.log.gz 2023-10-25T16:26:02.986 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53515.log 2023-10-25T16:26:02.986 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55760.log.gz 2023-10-25T16:26:02.987 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2023-10-25T16:26:02.987 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2023-10-25T16:26:02.987 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2023-10-25T16:26:02.987 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53515.log: /var/log/ceph/ceph-client.admin.52858.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.53515.log.gz 2023-10-25T16:26:02.987 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45258.log 2023-10-25T16:26:02.988 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2023-10-25T16:26:02.988 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49910.log 2023-10-25T16:26:02.988 INFO:teuthology.orchestra.run.smithi177.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2023-10-25T16:26:02.988 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49514.log 2023-10-25T16:26:02.988 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45258.log.gz 2023-10-25T16:26:02.989 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54485.log 2023-10-25T16:26:02.989 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49514.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49910.log.gz 2023-10-25T16:26:02.989 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2023-10-25T16:26:02.989 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49514.log.gz 2023-10-25T16:26:02.990 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56407.log 2023-10-25T16:26:02.990 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54485.log.gz 2023-10-25T16:26:02.990 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37192.log 2023-10-25T16:26:02.990 INFO:teuthology.orchestra.run.smithi177.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2023-10-25T16:26:02.990 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34250.log 2023-10-25T16:26:02.991 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2023-10-25T16:26:02.991 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56407.log.gz 2023-10-25T16:26:02.991 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34250.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37192.log.gz 2023-10-25T16:26:02.991 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37693.log 2023-10-25T16:26:02.992 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34250.log.gz 2023-10-25T16:26:02.992 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40140.log 2023-10-25T16:26:02.992 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37693.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2023-10-25T16:26:02.992 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2023-10-25T16:26:02.992 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37693.log.gz 2023-10-25T16:26:02.993 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56381.log 2023-10-25T16:26:02.993 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42281.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40140.log.gz 2023-10-25T16:26:02.993 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56768.log 2023-10-25T16:26:02.993 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2023-10-25T16:26:02.993 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2023-10-25T16:26:02.994 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56381.log.gz 2023-10-25T16:26:02.994 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39930.log 2023-10-25T16:26:02.994 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56768.log.gz 2023-10-25T16:26:02.995 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2023-10-25T16:26:02.995 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40456.log 2023-10-25T16:26:02.995 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39930.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2023-10-25T16:26:02.995 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43772.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39930.log.gz 2023-10-25T16:26:02.995 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37060.log 2023-10-25T16:26:02.996 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2023-10-25T16:26:02.996 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50290.log 2023-10-25T16:26:02.996 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37060.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40456.log.gz 2023-10-25T16:26:02.996 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34484.log 2023-10-25T16:26:02.997 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37060.log.gz 2023-10-25T16:26:02.997 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42945.log 2023-10-25T16:26:02.997 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34484.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50290.log.gz 2023-10-25T16:26:02.997 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56688.log 2023-10-25T16:26:02.997 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34484.log.gz 2023-10-25T16:26:02.998 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47657.log 2023-10-25T16:26:02.998 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40640.log 2023-10-25T16:26:02.998 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56688.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42945.log.gz 2023-10-25T16:26:02.998 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2023-10-25T16:26:02.999 INFO:teuthology.orchestra.run.smithi177.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56688.log.gz 2023-10-25T16:26:02.999 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47657.log.gz 2023-10-25T16:26:02.999 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2023-10-25T16:26:03.000 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32989.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40640.log.gz 2023-10-25T16:26:03.000 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52169.log 2023-10-25T16:26:03.000 INFO:teuthology.orchestra.run.smithi177.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2023-10-25T16:26:03.000 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2023-10-25T16:26:03.001 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49674.log 2023-10-25T16:26:03.001 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52169.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2023-10-25T16:26:03.001 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50012.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52169.log.gz 2023-10-25T16:26:03.001 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49542.log 2023-10-25T16:26:03.002 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2023-10-25T16:26:03.002 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50067.log 2023-10-25T16:26:03.002 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49542.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2023-10-25T16:26:03.002 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2023-10-25T16:26:03.003 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49542.log.gz 2023-10-25T16:26:03.003 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.50067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2023-10-25T16:26:03.003 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50676.log 2023-10-25T16:26:03.003 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2023-10-25T16:26:03.004 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2023-10-25T16:26:03.004 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36184.log: /var/log/ceph/ceph-client.admin.50676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37034.log 2023-10-25T16:26:03.004 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2023-10-25T16:26:03.004 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50676.log.gz 2023-10-25T16:26:03.005 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39904.log 2023-10-25T16:26:03.005 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37034.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2023-10-25T16:26:03.005 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50426.log 2023-10-25T16:26:03.005 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37034.log.gz 2023-10-25T16:26:03.006 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55168.log 2023-10-25T16:26:03.006 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50426.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39904.log.gz 2023-10-25T16:26:03.006 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45024.log 2023-10-25T16:26:03.006 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50426.log.gz 2023-10-25T16:26:03.007 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2023-10-25T16:26:03.007 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45024.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55168.log.gz 2023-10-25T16:26:03.007 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52465.log 2023-10-25T16:26:03.007 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45024.log.gz 2023-10-25T16:26:03.007 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51173.log 2023-10-25T16:26:03.007 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2023-10-25T16:26:03.008 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49830.log 2023-10-25T16:26:03.008 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52465.log: /var/log/ceph/ceph-client.admin.51173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48008.log 2023-10-25T16:26:03.008 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52465.log.gz 2023-10-25T16:26:03.008 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51173.log.gz 2023-10-25T16:26:03.008 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52439.log 2023-10-25T16:26:03.009 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49830.log.gz 2023-10-25T16:26:03.009 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39241.log 2023-10-25T16:26:03.009 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48008.log.gz 2023-10-25T16:26:03.009 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47629.log 2023-10-25T16:26:03.009 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52439.log: /var/log/ceph/ceph-client.admin.39241.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52439.log.gz 2023-10-25T16:26:03.009 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46488.log 2023-10-25T16:26:03.010 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39241.log.gz 2023-10-25T16:26:03.010 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41385.log 2023-10-25T16:26:03.010 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47629.log: /var/log/ceph/ceph-client.admin.46488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2023-10-25T16:26:03.010 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% 95.0% -- replaced with /var/log/ceph/ceph-client.admin.47629.log.gz -- replaced with /var/log/ceph/ceph-client.0.55533.log.gz 2023-10-25T16:26:03.010 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.011 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46488.log.gz 2023-10-25T16:26:03.011 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2023-10-25T16:26:03.011 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45599.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.41385.log.gz 2023-10-25T16:26:03.011 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56976.log 2023-10-25T16:26:03.011 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2023-10-25T16:26:03.012 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44972.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-25T16:26:03.012 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2023-10-25T16:26:03.012 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2023-10-25T16:26:03.012 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.2.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56976.log.gz 2023-10-25T16:26:03.012 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39351.log 2023-10-25T16:26:03.013 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52275.log 2023-10-25T16:26:03.013 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2023-10-25T16:26:03.013 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5/var/log/ceph/ceph-client.admin.39351.log: --verbose -- /var/log/ceph/ceph-client.admin.37008.log 2023-10-25T16:26:03.013 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52275.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39351.log.gz 2023-10-25T16:26:03.013 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32616.log 2023-10-25T16:26:03.014 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52275.log.gz 2023-10-25T16:26:03.014 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2023-10-25T16:26:03.014 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37008.log: /var/log/ceph/ceph.tmp-client.admin.32616.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph.tmp-client.admin.32616.log.gz --verbose 2023-10-25T16:26:03.014 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-client.admin.53463.log 2023-10-25T16:26:03.014 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37008.log.gz 2023-10-25T16:26:03.015 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2023-10-25T16:26:03.015 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42971.log: /var/log/ceph/ceph-client.admin.53463.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2023-10-25T16:26:03.015 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2023-10-25T16:26:03.015 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53463.log.gz 2023-10-25T16:26:03.016 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2023-10-25T16:26:03.016 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38525.log: /var/log/ceph/ceph-client.admin.36585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56459.log 2023-10-25T16:26:03.016 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2023-10-25T16:26:03.016 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz 2023-10-25T16:26:03.016 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51225.log 2023-10-25T16:26:03.017 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2023-10-25T16:26:03.017 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2023-10-25T16:26:03.017 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51225.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56459.log.gz 2023-10-25T16:26:03.017 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2023-10-25T16:26:03.017 INFO:teuthology.orchestra.run.smithi177.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51225.log.gz 2023-10-25T16:26:03.018 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2023-10-25T16:26:03.018 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2023-10-25T16:26:03.018 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2023-10-25T16:26:03.018 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gz 2023-10-25T16:26:03.018 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45761.log 2023-10-25T16:26:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33024.log: /var/log/ceph/ceph-client.admin.51594.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gzgzip 2023-10-25T16:26:03.019 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2023-10-25T16:26:03.019 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2023-10-25T16:26:03.019 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37166.log 2023-10-25T16:26:03.019 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45761.log.gzgzip 2023-10-25T16:26:03.019 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55064.log 2023-10-25T16:26:03.020 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49726.log: /var/log/ceph/ceph-client.admin.37166.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz -5 2023-10-25T16:26:03.020 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55350.log 2023-10-25T16:26:03.020 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37166.log.gz 2023-10-25T16:26:03.020 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42341.log 2023-10-25T16:26:03.020 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55064.log.gz 2023-10-25T16:26:03.021 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log 2023-10-25T16:26:03.021 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34746.log 2023-10-25T16:26:03.021 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42341.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55350.log.gz 2023-10-25T16:26:03.021 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35886.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.42341.log.gz 2023-10-25T16:26:03.021 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33855.log 2023-10-25T16:26:03.022 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2023-10-25T16:26:03.022 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log 2023-10-25T16:26:03.022 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34746.log.gz 2023-10-25T16:26:03.022 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2023-10-25T16:26:03.022 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33855.log: /var/log/ceph/ceph-client.admin.36340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54780.log 2023-10-25T16:26:03.023 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33855.log.gz 2023-10-25T16:26:03.023 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2023-10-25T16:26:03.023 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56537.log 2023-10-25T16:26:03.023 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.54780.log: /var/log/ceph/ceph-client.admin.56872.log 2023-10-25T16:26:03.024 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56537.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54780.log.gz 2023-10-25T16:26:03.024 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2023-10-25T16:26:03.024 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2023-10-25T16:26:03.024 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56537.log.gz 2023-10-25T16:26:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40222.log 2023-10-25T16:26:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42473.log 2023-10-25T16:26:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51960.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56872.log.gz 2023-10-25T16:26:03.025 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34926.log 2023-10-25T16:26:03.025 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6%/var/log/ceph/ceph-client.admin.42473.log: gzip 91.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz --verbose 2023-10-25T16:26:03.026 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-client.admin.44108.log 2023-10-25T16:26:03.026 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40222.log.gz 2023-10-25T16:26:03.026 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42473.log.gz 2023-10-25T16:26:03.026 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55324.log 2023-10-25T16:26:03.027 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34926.log.gz 2023-10-25T16:26:03.027 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45206.log 2023-10-25T16:26:03.027 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2023-10-25T16:26:03.027 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55324.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-25T16:26:03.027 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5%/var/log/ceph/ceph-client.admin.45206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38209.log 2023-10-25T16:26:03.028 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55324.log.gz 2023-10-25T16:26:03.028 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45206.log.gz 2023-10-25T16:26:03.028 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56091.log 2023-10-25T16:26:03.028 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46706.log 2023-10-25T16:26:03.029 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38209.log: /var/log/ceph/ceph-client.admin.56091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2023-10-25T16:26:03.029 INFO:teuthology.orchestra.run.smithi177.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38209.log.gz 2023-10-25T16:26:03.029 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56091.log.gz 2023-10-25T16:26:03.029 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49570.log 2023-10-25T16:26:03.029 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41908.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46706.log.gz 2023-10-25T16:26:03.030 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2023-10-25T16:26:03.030 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2023-10-25T16:26:03.030 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57132.log 2023-10-25T16:26:03.030 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36210.log 2023-10-25T16:26:03.031 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35525.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49570.log.gz 2023-10-25T16:26:03.031 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55611.log 2023-10-25T16:26:03.031 INFO:teuthology.orchestra.run.smithi177.stderr: 86.6%/var/log/ceph/ceph-client.admin.36210.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57132.log.gz 2023-10-25T16:26:03.031 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2023-10-25T16:26:03.032 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.032 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36210.log.gz 2023-10-25T16:26:03.032 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55611.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55611.log.gz 2023-10-25T16:26:03.032 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39377.log 2023-10-25T16:26:03.032 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48974.log 2023-10-25T16:26:03.033 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39377.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2023-10-25T16:26:03.033 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37114.log 2023-10-25T16:26:03.033 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39377.log.gz 2023-10-25T16:26:03.033 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42840.log 2023-10-25T16:26:03.034 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48974.log.gz 2023-10-25T16:26:03.034 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34938.log 2023-10-25T16:26:03.034 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37114.log.gz 2023-10-25T16:26:03.034 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48766.log 2023-10-25T16:26:03.035 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42840.log.gz 2023-10-25T16:26:03.035 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54092.log 2023-10-25T16:26:03.035 INFO:teuthology.orchestra.run.smithi177.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34938.log.gz 2023-10-25T16:26:03.035 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56170.log 2023-10-25T16:26:03.035 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48766.log.gz 2023-10-25T16:26:03.036 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2023-10-25T16:26:03.036 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54092.log.gz 2023-10-25T16:26:03.036 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38157.log 2023-10-25T16:26:03.036 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56170.log.gz 2023-10-25T16:26:03.037 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2023-10-25T16:26:03.037 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2023-10-25T16:26:03.037 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37563.log 2023-10-25T16:26:03.037 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38157.log.gz 2023-10-25T16:26:03.037 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35580.log 2023-10-25T16:26:03.038 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37563.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2023-10-25T16:26:03.038 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37355.log 2023-10-25T16:26:03.038 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37563.log.gz 2023-10-25T16:26:03.039 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54877.log 2023-10-25T16:26:03.039 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35580.log.gz 2023-10-25T16:26:03.039 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56820.log 2023-10-25T16:26:03.039 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37355.log.gz 2023-10-25T16:26:03.040 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45388.log 2023-10-25T16:26:03.040 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54877.log.gz 2023-10-25T16:26:03.040 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37537.log 2023-10-25T16:26:03.040 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56820.log.gz 2023-10-25T16:26:03.040 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40326.log 2023-10-25T16:26:03.041 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45388.log.gz 2023-10-25T16:26:03.041 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39163.log 2023-10-25T16:26:03.041 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37537.log.gz 2023-10-25T16:26:03.041 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43738.log 2023-10-25T16:26:03.042 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40326.log.gz 2023-10-25T16:26:03.042 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2023-10-25T16:26:03.042 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39163.log.gz 2023-10-25T16:26:03.043 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2023-10-25T16:26:03.043 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54537.log 2023-10-25T16:26:03.043 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43738.log.gz 2023-10-25T16:26:03.043 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41411.log 2023-10-25T16:26:03.043 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2023-10-25T16:26:03.044 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2023-10-25T16:26:03.044 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45943.log 2023-10-25T16:26:03.044 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53225.log 2023-10-25T16:26:03.044 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54537.log.gz 2023-10-25T16:26:03.044 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41411.log: /var/log/ceph/ceph-client.admin.45943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51802.log 2023-10-25T16:26:03.045 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% 86.7% -- replaced with /var/log/ceph/ceph-client.admin.45943.log.gz 2023-10-25T16:26:03.045 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36158.log 2023-10-25T16:26:03.045 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41411.log.gz 2023-10-25T16:26:03.045 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53225.log.gz 2023-10-25T16:26:03.045 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43974.log 2023-10-25T16:26:03.046 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36158.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51802.log.gz 2023-10-25T16:26:03.046 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51672.log 2023-10-25T16:26:03.046 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36158.log.gz 2023-10-25T16:26:03.046 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33155.log 2023-10-25T16:26:03.046 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51934.log 2023-10-25T16:26:03.047 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43974.log.gz 2023-10-25T16:26:03.047 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51672.log: /var/log/ceph/ceph-client.admin.33155.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51672.log.gz 2023-10-25T16:26:03.047 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34734.log 2023-10-25T16:26:03.047 INFO:teuthology.orchestra.run.smithi177.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.33155.log.gz 2023-10-25T16:26:03.047 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42683.log 2023-10-25T16:26:03.047 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51934.log: /var/log/ceph/ceph-client.admin.34734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56303.log 2023-10-25T16:26:03.048 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51934.log.gz 2023-10-25T16:26:03.048 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34734.log.gz 2023-10-25T16:26:03.048 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39562.log 2023-10-25T16:26:03.048 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42683.log: /var/log/ceph/ceph-client.admin.56303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50757.log 2023-10-25T16:26:03.048 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7%/var/log/ceph/ceph-client.admin.39562.log: -- replaced with /var/log/ceph/ceph-client.admin.56303.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42683.log.gz 2023-10-25T16:26:03.049 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38707.log 2023-10-25T16:26:03.049 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39562.log.gz 2023-10-25T16:26:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34094.log 2023-10-25T16:26:03.049 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50757.log: /var/log/ceph/ceph-client.admin.38707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51620.log 2023-10-25T16:26:03.049 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4%/var/log/ceph/ceph-client.admin.34094.log: -- replaced with /var/log/ceph/ceph-client.admin.38707.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33790.log 2023-10-25T16:26:03.050 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.050 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50757.log.gz 2023-10-25T16:26:03.050 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34094.log.gz 2023-10-25T16:26:03.050 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33132.log 2023-10-25T16:26:03.050 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51620.log.gz 2023-10-25T16:26:03.051 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2023-10-25T16:26:03.051 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33790.log.gz 2023-10-25T16:26:03.051 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55194.log 2023-10-25T16:26:03.051 INFO:teuthology.orchestra.run.smithi177.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.33132.log.gz 2023-10-25T16:26:03.051 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52223.log 2023-10-25T16:26:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43630.log: /var/log/ceph/ceph-client.admin.55194.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40825.log 2023-10-25T16:26:03.052 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2023-10-25T16:26:03.052 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55194.log.gz 2023-10-25T16:26:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40086.log 2023-10-25T16:26:03.052 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52223.log.gz 2023-10-25T16:26:03.052 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2023-10-25T16:26:03.053 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.40825.log: /var/log/ceph/ceph-client.admin.40086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48844.log 2023-10-25T16:26:03.053 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8%/var/log/ceph/ceph-client.admin.42577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37797.log 2023-10-25T16:26:03.053 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40086.log.gz 2023-10-25T16:26:03.053 INFO:teuthology.orchestra.run.smithi177.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2023-10-25T16:26:03.053 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48844.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48844.log.gz 2023-10-25T16:26:03.053 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56794.log 2023-10-25T16:26:03.054 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2023-10-25T16:26:03.054 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56794.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37797.log.gz 2023-10-25T16:26:03.054 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44343.log 2023-10-25T16:26:03.054 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34743.log 2023-10-25T16:26:03.054 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56794.log.gz 2023-10-25T16:26:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43453.log: /var/log/ceph/ceph-client.admin.44343.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2023-10-25T16:26:03.055 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44343.log.gz 2023-10-25T16:26:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45891.log 2023-10-25T16:26:03.055 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log 2023-10-25T16:26:03.055 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4%/var/log/ceph/ceph-client.admin.45891.log: -- replaced with /var/log/ceph/ceph-client.admin.34743.log.gzgzip 2023-10-25T16:26:03.055 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40274.log 2023-10-25T16:26:03.056 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45891.log.gz 2023-10-25T16:26:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43712.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2023-10-25T16:26:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2023-10-25T16:26:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52676.log 2023-10-25T16:26:03.056 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40274.log: /var/log/ceph/ceph-client.admin.38551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34521.log 2023-10-25T16:26:03.056 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz/var/log/ceph/ceph-client.admin.52676.log: 2023-10-25T16:26:03.057 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2023-10-25T16:26:03.057 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52676.log.gz 2023-10-25T16:26:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2023-10-25T16:26:03.057 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40508.log 2023-10-25T16:26:03.058 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34521.log: /var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47799.log 2023-10-25T16:26:03.058 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40508.log: 87.2% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34521.log.gz 2023-10-25T16:26:03.058 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2023-10-25T16:26:03.058 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40508.log.gz 2023-10-25T16:26:03.058 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2023-10-25T16:26:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50145.log 2023-10-25T16:26:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47799.log: /var/log/ceph/ceph-client.admin.47851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45653.log 2023-10-25T16:26:03.059 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50145.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2023-10-25T16:26:03.059 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47799.log.gz 2023-10-25T16:26:03.059 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50145.log.gz 2023-10-25T16:26:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42225.log 2023-10-25T16:26:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56511.log 2023-10-25T16:26:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45653.log: /var/log/ceph/ceph-client.admin.42225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37987.log 2023-10-25T16:26:03.060 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56511.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45653.log.gz 2023-10-25T16:26:03.060 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42225.log.gz 2023-10-25T16:26:03.061 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53909.log 2023-10-25T16:26:03.061 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56511.log.gz 2023-10-25T16:26:03.061 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37987.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37987.log.gz 2023-10-25T16:26:03.061 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43271.log 2023-10-25T16:26:03.061 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37140.log 2023-10-25T16:26:03.062 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53909.log: /var/log/ceph/ceph-client.admin.43271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54565.log 2023-10-25T16:26:03.062 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4%/var/log/ceph/ceph-client.admin.37140.log: -- replaced with /var/log/ceph/ceph-client.admin.53909.log.gz 2023-10-25T16:26:03.062 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43271.log.gz 2023-10-25T16:26:03.062 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37140.log.gz 2023-10-25T16:26:03.063 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39325.log 2023-10-25T16:26:03.063 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2023-10-25T16:26:03.063 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35264.log 2023-10-25T16:26:03.063 INFO:teuthology.orchestra.run.smithi177.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.0.50067.log.gz 2023-10-25T16:26:03.064 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54565.log.gz 2023-10-25T16:26:03.064 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4%/var/log/ceph/ceph-client.admin.36500.log: -- replaced with /var/log/ceph/ceph-client.admin.39325.log.gz 2023-10-25T16:26:03.064 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35703.log 2023-10-25T16:26:03.064 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2023-10-25T16:26:03.064 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37589.log 2023-10-25T16:26:03.065 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 87.8% 2023-10-25T16:26:03.065 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35264.log.gz 2023-10-25T16:26:03.065 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.35703.log: /var/log/ceph/ceph-client.admin.37589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2023-10-25T16:26:03.066 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37589.log.gz/var/log/ceph/ceph-client.admin.34380.log: 2023-10-25T16:26:03.066 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2023-10-25T16:26:03.066 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2023-10-25T16:26:03.066 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44606.log: 91.0% 87.3% -- replaced with /var/log/ceph/ceph-client.0.35703.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2023-10-25T16:26:03.067 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2023-10-25T16:26:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2023-10-25T16:26:03.067 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2023-10-25T16:26:03.067 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2023-10-25T16:26:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gz -5 2023-10-25T16:26:03.068 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2023-10-25T16:26:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36956.log: /var/log/ceph/ceph-client.admin.47001.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2023-10-25T16:26:03.068 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2023-10-25T16:26:03.069 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45509.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2023-10-25T16:26:03.069 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48190.log 2023-10-25T16:26:03.069 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2023-10-25T16:26:03.069 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50624.log 2023-10-25T16:26:03.069 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42395.log 2023-10-25T16:26:03.070 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.48190.log: -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz 2023-10-25T16:26:03.070 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2023-10-25T16:26:03.070 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42395.log: /var/log/ceph/ceph-client.admin.50624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35421.log 2023-10-25T16:26:03.070 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50624.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42395.log.gz 2023-10-25T16:26:03.070 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.071 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42551.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2023-10-25T16:26:03.071 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53672.log 2023-10-25T16:26:03.071 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33095.log 2023-10-25T16:26:03.071 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53672.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35421.log.gz 2023-10-25T16:26:03.071 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56589.log 2023-10-25T16:26:03.072 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48190.log.gz 2023-10-25T16:26:03.072 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53672.log.gz 2023-10-25T16:26:03.072 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33095.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.33095.log.gz 2023-10-25T16:26:03.072 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52413.log 2023-10-25T16:26:03.073 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33121.log 2023-10-25T16:26:03.073 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7%/var/log/ceph/ceph-client.admin.52413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35473.log 2023-10-25T16:26:03.073 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56589.log.gz 2023-10-25T16:26:03.073 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52413.log.gz 2023-10-25T16:26:03.073 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45232.log 2023-10-25T16:26:03.074 INFO:teuthology.orchestra.run.smithi177.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.33121.log.gz 2023-10-25T16:26:03.074 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50965.log 2023-10-25T16:26:03.074 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35473.log: /var/log/ceph/ceph-client.admin.45232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36690.log 2023-10-25T16:26:03.074 INFO:teuthology.orchestra.run.smithi177.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35473.log.gz 2023-10-25T16:26:03.075 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45232.log.gz 2023-10-25T16:26:03.075 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55868.log 2023-10-25T16:26:03.075 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50965.log.gz 2023-10-25T16:26:03.075 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56563.log 2023-10-25T16:26:03.075 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36690.log.gz 2023-10-25T16:26:03.076 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50887.log 2023-10-25T16:26:03.076 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55868.log.gz 2023-10-25T16:26:03.076 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52780.log 2023-10-25T16:26:03.076 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56563.log.gz 2023-10-25T16:26:03.076 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39718.log 2023-10-25T16:26:03.076 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50887.log.gz 2023-10-25T16:26:03.077 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40692.log 2023-10-25T16:26:03.077 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52780.log.gz 2023-10-25T16:26:03.077 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36132.log 2023-10-25T16:26:03.077 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39718.log.gz 2023-10-25T16:26:03.077 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50809.log 2023-10-25T16:26:03.078 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40692.log.gz 2023-10-25T16:26:03.078 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34406.log 2023-10-25T16:26:03.078 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36132.log.gz 2023-10-25T16:26:03.078 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2023-10-25T16:26:03.078 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50809.log.gz 2023-10-25T16:26:03.079 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34406.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-25T16:26:03.079 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34406.log.gz 2023-10-25T16:26:03.079 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39744.log 2023-10-25T16:26:03.079 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.3.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2023-10-25T16:26:03.079 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2023-10-25T16:26:03.080 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40404.log 2023-10-25T16:26:03.080 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39744.log.gz 2023-10-25T16:26:03.080 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46126.log 2023-10-25T16:26:03.080 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50650.log: /var/log/ceph/ceph-client.admin.40404.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2023-10-25T16:26:03.080 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40404.log.gz 2023-10-25T16:26:03.081 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33084.log 2023-10-25T16:26:03.081 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2023-10-25T16:26:03.081 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2023-10-25T16:26:03.081 INFO:teuthology.orchestra.run.smithi177.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.33084.log.gz 2023-10-25T16:26:03.081 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46126.log.gz 2023-10-25T16:26:03.082 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49884.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2023-10-25T16:26:03.082 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49344.log 2023-10-25T16:26:03.082 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53279.log 2023-10-25T16:26:03.082 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3%/var/log/ceph/ceph-client.admin.49344.log: -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz 2023-10-25T16:26:03.082 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41055.log 2023-10-25T16:26:03.083 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49344.log.gz 2023-10-25T16:26:03.083 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53279.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53279.log.gz 2023-10-25T16:26:03.083 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45787.log 2023-10-25T16:26:03.083 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48471.log 2023-10-25T16:26:03.083 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7%/var/log/ceph/ceph-client.admin.45787.log: -- replaced with /var/log/ceph/ceph-client.admin.41055.log.gz 2023-10-25T16:26:03.084 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50592.log 2023-10-25T16:26:03.084 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45787.log.gz 2023-10-25T16:26:03.084 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48471.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48471.log.gz 2023-10-25T16:26:03.084 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39588.log 2023-10-25T16:26:03.084 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39137.log 2023-10-25T16:26:03.085 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5%/var/log/ceph/ceph-client.admin.39588.log: -- replaced with /var/log/ceph/ceph-client.admin.50592.log.gz 2023-10-25T16:26:03.085 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55705.log 2023-10-25T16:26:03.085 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39588.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54118.log 2023-10-25T16:26:03.085 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.085 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39137.log: /var/log/ceph/ceph-client.admin.55705.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39137.log.gz 2023-10-25T16:26:03.086 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55705.log.gz 2023-10-25T16:26:03.086 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54170.log 2023-10-25T16:26:03.086 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51828.log 2023-10-25T16:26:03.086 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7%/var/log/ceph/ceph-client.admin.54170.log: -- replaced with /var/log/ceph/ceph-client.admin.54118.log.gz 2023-10-25T16:26:03.086 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36768.log 2023-10-25T16:26:03.087 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54170.log.gz 2023-10-25T16:26:03.087 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51828.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51828.log.gz 2023-10-25T16:26:03.087 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38395.log 2023-10-25T16:26:03.087 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55894.log 2023-10-25T16:26:03.087 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6%/var/log/ceph/ceph-client.admin.38395.log: -- replaced with /var/log/ceph/ceph-client.admin.36768.log.gz 2023-10-25T16:26:03.088 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40586.log 2023-10-25T16:26:03.088 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38395.log.gz 2023-10-25T16:26:03.088 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55894.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55894.log.gz 2023-10-25T16:26:03.088 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53146.log 2023-10-25T16:26:03.089 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38809.log 2023-10-25T16:26:03.089 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40586.log.gz/var/log/ceph/ceph-client.admin.53146.log: 2023-10-25T16:26:03.089 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47290.log 2023-10-25T16:26:03.089 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53146.log.gz 2023-10-25T16:26:03.089 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38809.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38809.log.gz 2023-10-25T16:26:03.090 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45310.log 2023-10-25T16:26:03.090 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38499.log 2023-10-25T16:26:03.090 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8%/var/log/ceph/ceph-client.admin.45310.log: -- replaced with /var/log/ceph/ceph-client.admin.47290.log.gz 2023-10-25T16:26:03.090 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55376.log 2023-10-25T16:26:03.091 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45310.log.gz 2023-10-25T16:26:03.091 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38499.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38499.log.gz 2023-10-25T16:26:03.091 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42421.log 2023-10-25T16:26:03.091 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40300.log 2023-10-25T16:26:03.091 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2%/var/log/ceph/ceph-client.admin.42421.log: -- replaced with /var/log/ceph/ceph-client.admin.55376.log.gz 2023-10-25T16:26:03.092 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36470.log 2023-10-25T16:26:03.092 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42421.log.gz 2023-10-25T16:26:03.092 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40300.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40300.log.gz 2023-10-25T16:26:03.092 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55142.log 2023-10-25T16:26:03.092 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39215.log 2023-10-25T16:26:03.093 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36470.log.gz/var/log/ceph/ceph-client.admin.55142.log: 2023-10-25T16:26:03.093 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38261.log 2023-10-25T16:26:03.093 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55142.log.gz 2023-10-25T16:26:03.093 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39215.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39215.log.gz 2023-10-25T16:26:03.093 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2023-10-25T16:26:03.093 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44264.log 2023-10-25T16:26:03.094 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7%/var/log/ceph/ceph-client.admin.40904.log: -- replaced with /var/log/ceph/ceph-client.admin.38261.log.gz 2023-10-25T16:26:03.094 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46567.log 2023-10-25T16:26:03.094 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gz 2023-10-25T16:26:03.094 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44264.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44264.log.gz 2023-10-25T16:26:03.094 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34328.log 2023-10-25T16:26:03.095 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49778.log 2023-10-25T16:26:03.095 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6%/var/log/ceph/ceph-client.admin.34328.log: -- replaced with /var/log/ceph/ceph-client.admin.46567.log.gz 2023-10-25T16:26:03.095 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2023-10-25T16:26:03.095 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52143.log 2023-10-25T16:26:03.095 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34328.log.gz 2023-10-25T16:26:03.096 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49778.log: /var/log/ceph/ceph-client.admin.46048.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49778.log.gz 2023-10-25T16:26:03.096 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2023-10-25T16:26:03.096 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2023-10-25T16:26:03.096 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2023-10-25T16:26:03.096 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6%/var/log/ceph/ceph-client.admin.43552.log: -- replaced with /var/log/ceph/ceph-client.admin.52143.log.gz 2023-10-25T16:26:03.096 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42253.log 2023-10-25T16:26:03.097 INFO:teuthology.orchestra.run.smithi177.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2023-10-25T16:26:03.097 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44837.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2023-10-25T16:26:03.097 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2023-10-25T16:26:03.097 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52520.log 2023-10-25T16:26:03.097 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4%/var/log/ceph/ceph-client.admin.38131.log: -- replaced with /var/log/ceph/ceph-client.admin.42253.log.gz 2023-10-25T16:26:03.098 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51251.log 2023-10-25T16:26:03.098 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz 2023-10-25T16:26:03.098 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52520.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52520.log.gz 2023-10-25T16:26:03.098 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51342.log 2023-10-25T16:26:03.098 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2023-10-25T16:26:03.099 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5%/var/log/ceph/ceph-client.admin.51342.log: -- replaced with /var/log/ceph/ceph-client.admin.51251.log.gz 2023-10-25T16:26:03.099 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41700.log 2023-10-25T16:26:03.099 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51342.log.gz 2023-10-25T16:26:03.099 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2023-10-25T16:26:03.100 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49700.log: /var/log/ceph/ceph-client.admin.41700.log: 87.4% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41700.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2023-10-25T16:26:03.100 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.100 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-25T16:26:03.100 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56485.log 2023-10-25T16:26:03.100 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2023-10-25T16:26:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36028.log 2023-10-25T16:26:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56485.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56485.log.gz 2023-10-25T16:26:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49175.log 2023-10-25T16:26:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2023-10-25T16:26:03.101 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36028.log: /var/log/ceph/ceph-client.admin.49175.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36028.log.gz 2023-10-25T16:26:03.102 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49175.log.gz 2023-10-25T16:26:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54196.log 2023-10-25T16:26:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41301.log 2023-10-25T16:26:03.102 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36314.log: /var/log/ceph/ceph-client.admin.54196.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2023-10-25T16:26:03.103 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54196.log.gz 2023-10-25T16:26:03.103 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44056.log 2023-10-25T16:26:03.103 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41301.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41301.log.gz 2023-10-25T16:26:03.103 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2023-10-25T16:26:03.103 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41437.log 2023-10-25T16:26:03.104 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44056.log: /var/log/ceph/ceph-client.admin.55842.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44056.log.gz 2023-10-25T16:26:03.104 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56433.log 2023-10-25T16:26:03.104 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.104 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41437.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41437.log.gz 2023-10-25T16:26:03.104 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2023-10-25T16:26:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37901.log 2023-10-25T16:26:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56433.log: /var/log/ceph/ceph-client.admin.47316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56433.log.gz 2023-10-25T16:26:03.105 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2023-10-25T16:26:03.105 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2023-10-25T16:26:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41934.log 2023-10-25T16:26:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37901.log: /var/log/ceph/ceph-client.admin.46897.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37901.log.gz 2023-10-25T16:26:03.106 INFO:teuthology.orchestra.run.smithi177.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2023-10-25T16:26:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55786.log 2023-10-25T16:26:03.106 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44212.log 2023-10-25T16:26:03.107 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41934.log: /var/log/ceph/ceph-client.admin.55786.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41934.log.gz 2023-10-25T16:26:03.107 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55786.log.gz 2023-10-25T16:26:03.107 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43081.log 2023-10-25T16:26:03.107 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57208.log 2023-10-25T16:26:03.107 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44212.log: /var/log/ceph/ceph-client.admin.43081.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44212.log.gz 2023-10-25T16:26:03.108 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43081.log.gz 2023-10-25T16:26:03.108 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41162.log 2023-10-25T16:26:03.108 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57208.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57208.log.gz 2023-10-25T16:26:03.108 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37929.log 2023-10-25T16:26:03.108 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50316.log 2023-10-25T16:26:03.109 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41162.log: /var/log/ceph/ceph-client.admin.37929.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41162.log.gz 2023-10-25T16:26:03.109 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37929.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37297.log 2023-10-25T16:26:03.109 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.109 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50316.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50316.log.gz 2023-10-25T16:26:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35976.log 2023-10-25T16:26:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2023-10-25T16:26:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37297.log: /var/log/ceph/ceph-client.admin.35976.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37297.log.gz 2023-10-25T16:26:03.110 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35976.log.gz 2023-10-25T16:26:03.110 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53081.log 2023-10-25T16:26:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57234.log 2023-10-25T16:26:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43349.log: /var/log/ceph/ceph-client.admin.53081.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2023-10-25T16:26:03.111 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53081.log.gz 2023-10-25T16:26:03.111 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2023-10-25T16:26:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52249.log 2023-10-25T16:26:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57234.log: /var/log/ceph/ceph-client.admin.38917.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57234.log.gz 2023-10-25T16:26:03.112 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2023-10-25T16:26:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49856.log 2023-10-25T16:26:03.112 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50488.log 2023-10-25T16:26:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52249.log: /var/log/ceph/ceph-client.admin.49856.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52249.log.gz 2023-10-25T16:26:03.113 INFO:teuthology.orchestra.run.smithi177.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49856.log.gz 2023-10-25T16:26:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53802.log 2023-10-25T16:26:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39432.log 2023-10-25T16:26:03.113 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50488.log: /var/log/ceph/ceph-client.0.53802.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50488.log.gz 2023-10-25T16:26:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2023-10-25T16:26:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39432.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39432.log.gz 2023-10-25T16:26:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2023-10-25T16:26:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44082.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2023-10-25T16:26:03.114 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48870.log 2023-10-25T16:26:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2023-10-25T16:26:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51908.log 2023-10-25T16:26:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48870.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48870.log.gz 2023-10-25T16:26:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41882.log 2023-10-25T16:26:03.115 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51908.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51908.log.gz 2023-10-25T16:26:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38341.log 2023-10-25T16:26:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41882.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41882.log.gz 2023-10-25T16:26:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51486.log 2023-10-25T16:26:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38341.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38341.log.gz 2023-10-25T16:26:03.116 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39848.log 2023-10-25T16:26:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51486.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51486.log.gz 2023-10-25T16:26:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2023-10-25T16:26:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39848.log.gz 2023-10-25T16:26:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49752.log 2023-10-25T16:26:03.117 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50207.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2023-10-25T16:26:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34537.log 2023-10-25T16:26:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49752.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49752.log.gz 2023-10-25T16:26:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55428.log 2023-10-25T16:26:03.118 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34537.log.gz 2023-10-25T16:26:03.119 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52936.log 2023-10-25T16:26:03.119 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55428.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.55428.log.gz 2023-10-25T16:26:03.119 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52387.log 2023-10-25T16:26:03.119 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52936.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52936.log.gz 2023-10-25T16:26:03.121 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-25T16:26:03.121 INFO:teuthology.orchestra.run.smithi184.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-25T16:26:03.164 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-25T16:26:03.189 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45102.log 2023-10-25T16:26:03.189 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52387.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52387.log.gz 2023-10-25T16:26:03.189 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51724.log 2023-10-25T16:26:03.190 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45102.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45102.log.gz 2023-10-25T16:26:03.190 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35238.log 2023-10-25T16:26:03.190 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51724.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51724.log.gz 2023-10-25T16:26:03.190 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37381.log 2023-10-25T16:26:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35238.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35238.log.gz 2023-10-25T16:26:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35342.log 2023-10-25T16:26:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37381.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37381.log.gz 2023-10-25T16:26:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50835.log 2023-10-25T16:26:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35342.log.gz 2023-10-25T16:26:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56355.log 2023-10-25T16:26:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50835.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50835.log.gz 2023-10-25T16:26:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47081.log 2023-10-25T16:26:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56355.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56355.log.gz 2023-10-25T16:26:03.192 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2023-10-25T16:26:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47081.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47081.log.gz 2023-10-25T16:26:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37433.log 2023-10-25T16:26:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47238.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2023-10-25T16:26:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2023-10-25T16:26:03.193 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37433.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37433.log.gz 2023-10-25T16:26:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45969.log 2023-10-25T16:26:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34354.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gz 2023-10-25T16:26:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2023-10-25T16:26:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45969.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45969.log.gz 2023-10-25T16:26:03.194 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55816.log 2023-10-25T16:26:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38733.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2023-10-25T16:26:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52301.log 2023-10-25T16:26:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55816.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55816.log.gz 2023-10-25T16:26:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47685.log 2023-10-25T16:26:03.195 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52301.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52301.log.gz 2023-10-25T16:26:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2023-10-25T16:26:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47685.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47685.log.gz 2023-10-25T16:26:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2023-10-25T16:26:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53437.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz 2023-10-25T16:26:03.196 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38369.log 2023-10-25T16:26:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42447.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2023-10-25T16:26:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49026.log 2023-10-25T16:26:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38369.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38369.log.gz 2023-10-25T16:26:03.197 INFO:teuthology.orchestra.run.smithi177.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.53802.log.gz 2023-10-25T16:26:03.197 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38864.log 2023-10-25T16:26:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49026.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49026.log.gz 2023-10-25T16:26:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2023-10-25T16:26:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53568.log 2023-10-25T16:26:03.198 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.38864.log: /var/log/ceph/ceph-client.admin.44811.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2023-10-25T16:26:03.198 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.38864.log.gz 2023-10-25T16:26:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35499.log 2023-10-25T16:26:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2023-10-25T16:26:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53568.log: /var/log/ceph/ceph-client.admin.35499.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53568.log.gz 2023-10-25T16:26:03.199 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35499.log.gz 2023-10-25T16:26:03.199 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43193.log 2023-10-25T16:26:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40966.log 2023-10-25T16:26:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38473.log: /var/log/ceph/ceph-client.admin.43193.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2023-10-25T16:26:03.200 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43193.log.gz 2023-10-25T16:26:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46842.log 2023-10-25T16:26:03.200 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36716.log 2023-10-25T16:26:03.201 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40966.log: /var/log/ceph/ceph-client.admin.46842.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40966.log.gz 2023-10-25T16:26:03.201 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46842.log.gz 2023-10-25T16:26:03.201 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38421.log 2023-10-25T16:26:03.201 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57054.log 2023-10-25T16:26:03.201 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36716.log: /var/log/ceph/ceph-client.admin.38421.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36716.log.gz 2023-10-25T16:26:03.202 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38421.log.gz 2023-10-25T16:26:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39796.log 2023-10-25T16:26:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57054.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57054.log.gz 2023-10-25T16:26:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2023-10-25T16:26:03.202 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2023-10-25T16:26:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39796.log: /var/log/ceph/ceph-client.admin.48633.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39796.log.gz 2023-10-25T16:26:03.203 INFO:teuthology.orchestra.run.smithi177.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2023-10-25T16:26:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37823.log 2023-10-25T16:26:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47186.log 2023-10-25T16:26:03.203 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43578.log: /var/log/ceph/ceph-client.admin.37823.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2023-10-25T16:26:03.204 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37823.log.gz 2023-10-25T16:26:03.204 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57002.log 2023-10-25T16:26:03.204 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2023-10-25T16:26:03.204 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47186.log: /var/log/ceph/ceph-client.admin.57002.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47186.log.gz 2023-10-25T16:26:03.204 INFO:teuthology.orchestra.run.smithi177.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57002.log.gz 2023-10-25T16:26:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50783.log 2023-10-25T16:26:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35369.log 2023-10-25T16:26:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45050.log: /var/log/ceph/ceph-client.admin.50783.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2023-10-25T16:26:03.205 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2023-10-25T16:26:03.205 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33476.log 2023-10-25T16:26:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2023-10-25T16:26:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35369.log: /var/log/ceph/ceph-client.admin.33476.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35369.log.gz 2023-10-25T16:26:03.206 INFO:teuthology.orchestra.run.smithi177.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33476.log.gz 2023-10-25T16:26:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2023-10-25T16:26:03.206 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40666.log 2023-10-25T16:26:03.207 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50372.log: /var/log/ceph/ceph-client.admin.47427.log: 87.6% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2023-10-25T16:26:03.207 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.207 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2023-10-25T16:26:03.207 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2023-10-25T16:26:03.207 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40666.log: /var/log/ceph/ceph-client.admin.43682.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40666.log.gz 2023-10-25T16:26:03.208 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz 2023-10-25T16:26:03.208 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44525.log 2023-10-25T16:26:03.208 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-25T16:26:03.208 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40430.log: /var/log/ceph/ceph-client.0.44525.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2023-10-25T16:26:03.208 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2023-10-25T16:26:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.log: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-25T16:26:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49622.log 2023-10-25T16:26:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33986.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz 2023-10-25T16:26:03.209 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35212.log 2023-10-25T16:26:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49622.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49622.log.gz 2023-10-25T16:26:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48711.log 2023-10-25T16:26:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35212.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35212.log.gz 2023-10-25T16:26:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2023-10-25T16:26:03.210 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48711.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48711.log.gz 2023-10-25T16:26:03.211 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52598.log 2023-10-25T16:26:03.211 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49488.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2023-10-25T16:26:03.211 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53982.log 2023-10-25T16:26:03.211 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52598.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2023-10-25T16:26:03.211 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2023-10-25T16:26:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53982.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53982.log.gz 2023-10-25T16:26:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46541.log 2023-10-25T16:26:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53172.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz 2023-10-25T16:26:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53014.log 2023-10-25T16:26:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46541.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46541.log.gz 2023-10-25T16:26:03.212 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2023-10-25T16:26:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53014.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53014.log.gz 2023-10-25T16:26:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55246.log 2023-10-25T16:26:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51121.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2023-10-25T16:26:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52327.log 2023-10-25T16:26:03.213 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55246.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55246.log.gz 2023-10-25T16:26:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2023-10-25T16:26:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52327.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52327.log.gz 2023-10-25T16:26:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43804.log 2023-10-25T16:26:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46975.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2023-10-25T16:26:03.214 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41726.log 2023-10-25T16:26:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43804.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43804.log.gz 2023-10-25T16:26:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39964.log 2023-10-25T16:26:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41726.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41726.log.gz 2023-10-25T16:26:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56277.log 2023-10-25T16:26:03.215 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39964.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39964.log.gz 2023-10-25T16:26:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2023-10-25T16:26:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56277.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56277.log.gz 2023-10-25T16:26:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39510.log 2023-10-25T16:26:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41990.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2023-10-25T16:26:03.216 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2023-10-25T16:26:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39510.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39510.log.gz 2023-10-25T16:26:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39406.log 2023-10-25T16:26:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44186.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2023-10-25T16:26:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41518.log 2023-10-25T16:26:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39406.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39406.log.gz 2023-10-25T16:26:03.217 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42631.log 2023-10-25T16:26:03.218 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41518.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41518.log.gz 2023-10-25T16:26:03.218 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2023-10-25T16:26:03.218 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42631.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42631.log.gz 2023-10-25T16:26:03.218 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2023-10-25T16:26:03.218 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44675.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2023-10-25T16:26:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44753.log 2023-10-25T16:26:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39640.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2023-10-25T16:26:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50514.log 2023-10-25T16:26:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44753.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44753.log.gz 2023-10-25T16:26:03.219 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33072.log 2023-10-25T16:26:03.220 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50514.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50514.log.gz 2023-10-25T16:26:03.220 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42315.log 2023-10-25T16:26:03.220 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33072.log: 76.4% -- replaced with /var/log/ceph/ceph-client.admin.33072.log.gz 2023-10-25T16:26:03.220 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37485.log 2023-10-25T16:26:03.220 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42315.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42315.log.gz 2023-10-25T16:26:03.221 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51147.log 2023-10-25T16:26:03.221 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37485.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37485.log.gz 2023-10-25T16:26:03.221 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39996.log 2023-10-25T16:26:03.221 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51147.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51147.log.gz 2023-10-25T16:26:03.221 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52832.log 2023-10-25T16:26:03.222 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39996.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39996.log.gz 2023-10-25T16:26:03.222 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2023-10-25T16:26:03.222 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52832.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52832.log.gz 2023-10-25T16:26:03.222 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42919.log 2023-10-25T16:26:03.222 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46816.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2023-10-25T16:26:03.223 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44918.log 2023-10-25T16:26:03.223 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42919.log.gz 2023-10-25T16:26:03.223 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2023-10-25T16:26:03.223 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44918.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44918.log.gz 2023-10-25T16:26:03.223 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33048.log 2023-10-25T16:26:03.224 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33960.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2023-10-25T16:26:03.224 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34525.log 2023-10-25T16:26:03.224 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33048.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.33048.log.gz 2023-10-25T16:26:03.224 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45625.log 2023-10-25T16:26:03.224 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34525.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34525.log.gz 2023-10-25T16:26:03.225 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34198.log 2023-10-25T16:26:03.225 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45625.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45625.log.gz 2023-10-25T16:26:03.225 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33035.log 2023-10-25T16:26:03.225 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34198.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34198.log.gz 2023-10-25T16:26:03.225 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46790.log 2023-10-25T16:26:03.226 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33035.log: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.33035.log.gz 2023-10-25T16:26:03.226 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55298.log 2023-10-25T16:26:03.226 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46790.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46790.log.gz 2023-10-25T16:26:03.226 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49123.log 2023-10-25T16:26:03.226 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55298.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55298.log.gz 2023-10-25T16:26:03.227 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41752.log 2023-10-25T16:26:03.227 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49123.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49123.log.gz 2023-10-25T16:26:03.227 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2023-10-25T16:26:03.227 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41752.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2023-10-25T16:26:03.227 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54982.log 2023-10-25T16:26:03.227 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48740.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2023-10-25T16:26:03.228 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2023-10-25T16:26:03.228 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54982.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54982.log.gz 2023-10-25T16:26:03.228 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52546.log 2023-10-25T16:26:03.228 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47055.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2023-10-25T16:26:03.228 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57028.log 2023-10-25T16:26:03.229 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52546.log.gz 2023-10-25T16:26:03.229 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41110.log 2023-10-25T16:26:03.229 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57028.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57028.log.gz 2023-10-25T16:26:03.229 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44160.log 2023-10-25T16:26:03.230 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41110.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41110.log.gz 2023-10-25T16:26:03.230 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53542.log 2023-10-25T16:26:03.230 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44160.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44160.log.gz 2023-10-25T16:26:03.230 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2023-10-25T16:26:03.230 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53542.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53542.log.gz 2023-10-25T16:26:03.231 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46871.log 2023-10-25T16:26:03.231 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41964.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2023-10-25T16:26:03.231 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35186.log 2023-10-25T16:26:03.231 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46871.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46871.log.gz 2023-10-25T16:26:03.231 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34538.log 2023-10-25T16:26:03.232 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35186.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35186.log.gz 2023-10-25T16:26:03.232 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36444.log 2023-10-25T16:26:03.232 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34538.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34538.log.gz 2023-10-25T16:26:03.232 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2023-10-25T16:26:03.232 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36444.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36444.log.gz 2023-10-25T16:26:03.233 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53333.log 2023-10-25T16:26:03.233 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48607.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2023-10-25T16:26:03.233 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36663.log 2023-10-25T16:26:03.233 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53333.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53333.log.gz 2023-10-25T16:26:03.233 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34458.log 2023-10-25T16:26:03.234 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36663.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36663.log.gz 2023-10-25T16:26:03.234 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56225.log 2023-10-25T16:26:03.234 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34458.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34458.log.gz 2023-10-25T16:26:03.234 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2023-10-25T16:26:03.235 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56225.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56225.log.gz 2023-10-25T16:26:03.235 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2023-10-25T16:26:03.235 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46100.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2023-10-25T16:26:03.235 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2023-10-25T16:26:03.235 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49596.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2023-10-25T16:26:03.236 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2023-10-25T16:26:03.236 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46515.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2023-10-25T16:26:03.236 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33012.log 2023-10-25T16:26:03.236 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2023-10-25T16:26:03.236 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2023-10-25T16:26:03.236 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33012.log: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.33012.log.gz 2023-10-25T16:26:03.237 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55116.log 2023-10-25T16:26:03.237 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47368.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2023-10-25T16:26:03.237 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2023-10-25T16:26:03.237 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55116.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55116.log.gz 2023-10-25T16:26:03.237 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2023-10-25T16:26:03.238 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48387.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2023-10-25T16:26:03.238 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50540.log 2023-10-25T16:26:03.238 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38447.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2023-10-25T16:26:03.238 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51017.log 2023-10-25T16:26:03.238 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50540.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50540.log.gz 2023-10-25T16:26:03.239 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41466.log 2023-10-25T16:26:03.239 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51017.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51017.log.gz 2023-10-25T16:26:03.239 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2023-10-25T16:26:03.239 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41466.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41466.log.gz 2023-10-25T16:26:03.239 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39666.log 2023-10-25T16:26:03.240 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33908.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2023-10-25T16:26:03.240 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54144.log 2023-10-25T16:26:03.240 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39666.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39666.log.gz 2023-10-25T16:26:03.240 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37615.log 2023-10-25T16:26:03.240 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54144.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54144.log.gz 2023-10-25T16:26:03.241 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34068.log 2023-10-25T16:26:03.241 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37615.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37615.log.gz 2023-10-25T16:26:03.241 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34944.log 2023-10-25T16:26:03.241 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34068.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34068.log.gz 2023-10-25T16:26:03.241 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2023-10-25T16:26:03.241 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34944.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34944.log.gz 2023-10-25T16:26:03.242 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55731.log 2023-10-25T16:26:03.242 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33934.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2023-10-25T16:26:03.242 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41492.log 2023-10-25T16:26:03.242 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55731.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55731.log.gz 2023-10-25T16:26:03.242 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42055.log 2023-10-25T16:26:03.243 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41492.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41492.log.gz 2023-10-25T16:26:03.243 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2023-10-25T16:26:03.243 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42055.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42055.log.gz 2023-10-25T16:26:03.243 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36982.log 2023-10-25T16:26:03.243 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36559.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2023-10-25T16:26:03.244 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2023-10-25T16:26:03.244 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36982.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36982.log.gz 2023-10-25T16:26:03.244 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34535.log 2023-10-25T16:26:03.244 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35748.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2023-10-25T16:26:03.244 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36852.log 2023-10-25T16:26:03.245 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34535.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34535.log.gz 2023-10-25T16:26:03.245 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39770.log 2023-10-25T16:26:03.245 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36852.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36852.log.gz 2023-10-25T16:26:03.245 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43245.log 2023-10-25T16:26:03.245 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39770.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39770.log.gz 2023-10-25T16:26:03.245 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54060.log 2023-10-25T16:26:03.246 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43245.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43245.log.gz 2023-10-25T16:26:03.246 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48136.log 2023-10-25T16:26:03.246 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54060.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54060.log.gz 2023-10-25T16:26:03.246 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52806.log 2023-10-25T16:26:03.246 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48136.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48136.log.gz 2023-10-25T16:26:03.247 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2023-10-25T16:26:03.247 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52806.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52806.log.gz 2023-10-25T16:26:03.247 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2023-10-25T16:26:03.247 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36794.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2023-10-25T16:26:03.247 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38681.log 2023-10-25T16:26:03.248 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47981.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2023-10-25T16:26:03.248 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2023-10-25T16:26:03.248 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38681.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38681.log.gz 2023-10-25T16:26:03.248 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35160.log 2023-10-25T16:26:03.249 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51406.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gz 2023-10-25T16:26:03.249 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56634.log 2023-10-25T16:26:03.249 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35160.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35160.log.gz 2023-10-25T16:26:03.249 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45813.log 2023-10-25T16:26:03.249 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56634.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.56634.log.gz 2023-10-25T16:26:03.250 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55220.log 2023-10-25T16:26:03.250 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45813.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2023-10-25T16:26:03.250 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48523.log 2023-10-25T16:26:03.250 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55220.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55220.log.gz 2023-10-25T16:26:03.250 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34224.log 2023-10-25T16:26:03.250 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48523.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48523.log.gz 2023-10-25T16:26:03.251 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56007.log 2023-10-25T16:26:03.251 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34224.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34224.log.gz 2023-10-25T16:26:03.251 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2023-10-25T16:26:03.251 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56007.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56007.log.gz 2023-10-25T16:26:03.251 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56033.log 2023-10-25T16:26:03.252 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48549.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2023-10-25T16:26:03.252 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38603.log 2023-10-25T16:26:03.252 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56033.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56033.log.gz 2023-10-25T16:26:03.252 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2023-10-25T16:26:03.252 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38603.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38603.log.gz 2023-10-25T16:26:03.253 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37219.log 2023-10-25T16:26:03.253 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44998.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2023-10-25T16:26:03.253 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34952.log 2023-10-25T16:26:03.253 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37219.log.gz 2023-10-25T16:26:03.253 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47394.log 2023-10-25T16:26:03.254 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34952.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34952.log.gz 2023-10-25T16:26:03.254 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34534.log 2023-10-25T16:26:03.254 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47394.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47394.log.gz 2023-10-25T16:26:03.254 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48922.log 2023-10-25T16:26:03.254 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34534.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34534.log.gz 2023-10-25T16:26:03.254 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35950.log 2023-10-25T16:26:03.255 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48922.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48922.log.gz 2023-10-25T16:26:03.255 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-25T16:26:03.255 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35950.log.gz 2023-10-25T16:26:03.255 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49804.log 2023-10-25T16:26:03.255 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-25T16:26:03.256 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-25T16:26:03.256 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49804.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49804.log.gz 2023-10-25T16:26:03.256 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50861.log 2023-10-25T16:26:03.256 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47212.log 2023-10-25T16:26:03.256 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50861.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50861.log.gz 2023-10-25T16:26:03.276 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-25T16:26:03.285 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55955.log 2023-10-25T16:26:03.285 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47212.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47212.log.gz 2023-10-25T16:26:03.285 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48792.log 2023-10-25T16:26:03.285 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55955.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55955.log.gz 2023-10-25T16:26:03.285 INFO:teuthology.orchestra.run.smithi177.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.0.40825.log.gz 2023-10-25T16:26:03.286 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54329.log 2023-10-25T16:26:03.286 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48792.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48792.log.gz 2023-10-25T16:26:03.286 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38629.log 2023-10-25T16:26:03.286 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54329.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54329.log.gz 2023-10-25T16:26:03.286 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-25T16:26:03.287 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38629.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38629.log.gz 2023-10-25T16:26:03.287 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2023-10-25T16:26:03.287 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.a.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-25T16:26:03.287 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54747.log 2023-10-25T16:26:03.287 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47825.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2023-10-25T16:26:03.288 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41022.log 2023-10-25T16:26:03.288 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54747.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54747.log.gz 2023-10-25T16:26:03.288 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2023-10-25T16:26:03.288 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41022.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41022.log.gz 2023-10-25T16:26:03.288 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2023-10-25T16:26:03.289 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50400.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2023-10-25T16:26:03.289 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2023-10-25T16:26:03.289 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43427.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2023-10-25T16:26:03.289 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56742.log 2023-10-25T16:26:03.289 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56117.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2023-10-25T16:26:03.290 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49071.log 2023-10-25T16:26:03.290 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56742.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56742.log.gz 2023-10-25T16:26:03.290 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42733.log 2023-10-25T16:26:03.290 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49071.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49071.log.gz 2023-10-25T16:26:03.290 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52754.log 2023-10-25T16:26:03.290 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42733.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42733.log.gz 2023-10-25T16:26:03.291 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2023-10-25T16:26:03.291 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52754.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52754.log.gz 2023-10-25T16:26:03.291 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56143.log 2023-10-25T16:26:03.291 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41197.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2023-10-25T16:26:03.291 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52884.log 2023-10-25T16:26:03.292 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56143.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56143.log.gz 2023-10-25T16:26:03.292 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42023.log 2023-10-25T16:26:03.292 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52884.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52884.log.gz 2023-10-25T16:26:03.292 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40166.log 2023-10-25T16:26:03.292 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42023.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42023.log.gz 2023-10-25T16:26:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40996.log 2023-10-25T16:26:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40166.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40166.log.gz 2023-10-25T16:26:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47459.log 2023-10-25T16:26:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40996.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz 2023-10-25T16:26:03.293 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49149.log 2023-10-25T16:26:03.294 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47459.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47459.log.gz 2023-10-25T16:26:03.294 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39614.log 2023-10-25T16:26:03.294 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49149.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49149.log.gz 2023-10-25T16:26:03.294 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39003.log 2023-10-25T16:26:03.294 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39614.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39614.log.gz 2023-10-25T16:26:03.295 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49201.log 2023-10-25T16:26:03.295 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39003.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39003.log.gz 2023-10-25T16:26:03.295 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2023-10-25T16:26:03.295 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49201.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49201.log.gz 2023-10-25T16:26:03.295 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44701.log 2023-10-25T16:26:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41082.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gz 2023-10-25T16:26:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51199.log 2023-10-25T16:26:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44701.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44701.log.gz 2023-10-25T16:26:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49227.log 2023-10-25T16:26:03.296 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51199.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51199.log.gz 2023-10-25T16:26:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50119.log 2023-10-25T16:26:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49227.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49227.log.gz 2023-10-25T16:26:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45477.log 2023-10-25T16:26:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50119.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50119.log.gz 2023-10-25T16:26:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49962.log 2023-10-25T16:26:03.297 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45477.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45477.log.gz 2023-10-25T16:26:03.298 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2023-10-25T16:26:03.298 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49962.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49962.log.gz 2023-10-25T16:26:03.298 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2023-10-25T16:26:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39536.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gz 2023-10-25T16:26:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2023-10-25T16:26:03.301 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49409.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2023-10-25T16:26:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2023-10-25T16:26:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44944.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2023-10-25T16:26:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54034.log 2023-10-25T16:26:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46680.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2023-10-25T16:26:03.302 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48034.log 2023-10-25T16:26:03.303 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54034.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54034.log.gz 2023-10-25T16:26:03.303 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2023-10-25T16:26:03.303 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48034.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48034.log.gz 2023-10-25T16:26:03.303 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32999.log 2023-10-25T16:26:03.303 INFO:teuthology.orchestra.run.smithi177.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-25T16:26:03.304 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47264.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2023-10-25T16:26:03.304 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2023-10-25T16:26:03.304 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2023-10-25T16:26:03.304 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32999.log: /var/log/ceph/ceph-client.admin.50702.log: 74.6% -- replaced with /var/log/ceph/ceph-client.admin.32999.log.gz 2023-10-25T16:26:03.304 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48243.log 2023-10-25T16:26:03.304 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2023-10-25T16:26:03.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51432.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2023-10-25T16:26:03.305 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55585.log 2023-10-25T16:26:03.305 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53489.log 2023-10-25T16:26:03.305 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48243.log: /var/log/ceph/ceph-client.admin.55585.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48243.log.gz 2023-10-25T16:26:03.305 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55585.log.gz 2023-10-25T16:26:03.306 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49279.log 2023-10-25T16:26:03.306 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2023-10-25T16:26:03.306 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53489.log: /var/log/ceph/ceph-client.admin.49279.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53489.log.gz 2023-10-25T16:26:03.306 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz 2023-10-25T16:26:03.306 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39874.log 2023-10-25T16:26:03.307 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53748.log 2023-10-25T16:26:03.307 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43219.log: /var/log/ceph/ceph-client.admin.39874.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz 2023-10-25T16:26:03.307 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39874.log.gz 2023-10-25T16:26:03.307 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52728.log 2023-10-25T16:26:03.307 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36930.log 2023-10-25T16:26:03.308 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53748.log: /var/log/ceph/ceph-client.admin.52728.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53748.log.gz 2023-10-25T16:26:03.308 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52728.log.gz 2023-10-25T16:26:03.308 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52988.log 2023-10-25T16:26:03.308 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35290.log 2023-10-25T16:26:03.308 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36930.log: /var/log/ceph/ceph-client.admin.52988.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36930.log.gz 2023-10-25T16:26:03.309 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45418.log 2023-10-25T16:26:03.309 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52988.log.gz 2023-10-25T16:26:03.309 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35290.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35290.log.gz 2023-10-25T16:26:03.309 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42657.log 2023-10-25T16:26:03.309 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39484.log 2023-10-25T16:26:03.310 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45418.log: /var/log/ceph/ceph-client.admin.42657.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45418.log.gz 2023-10-25T16:26:03.310 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42657.log.gz 2023-10-25T16:26:03.310 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36637.log 2023-10-25T16:26:03.310 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57080.log 2023-10-25T16:26:03.310 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39484.log: /var/log/ceph/ceph-client.admin.36637.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36637.log.gz 2023-10-25T16:26:03.311 INFO:teuthology.orchestra.run.smithi177.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39484.log.gz 2023-10-25T16:26:03.311 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2023-10-25T16:26:03.311 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2023-10-25T16:26:03.311 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57080.log: /var/log/ceph/ceph-client.admin.36106.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57080.log.gz 2023-10-25T16:26:03.311 INFO:teuthology.orchestra.run.smithi177.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2023-10-25T16:26:03.312 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54355.log 2023-10-25T16:26:03.312 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44369.log 2023-10-25T16:26:03.312 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46428.log: /var/log/ceph/ceph-client.admin.54355.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2023-10-25T16:26:03.312 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54355.log.gz 2023-10-25T16:26:03.312 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51646.log 2023-10-25T16:26:03.312 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54459.log 2023-10-25T16:26:03.313 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44369.log: /var/log/ceph/ceph-client.admin.51646.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44369.log.gz 2023-10-25T16:26:03.313 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51646.log.gz 2023-10-25T16:26:03.313 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42787.log 2023-10-25T16:26:03.313 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2023-10-25T16:26:03.313 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54459.log: /var/log/ceph/ceph-client.0.42787.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54459.log.gz 2023-10-25T16:26:03.314 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2023-10-25T16:26:03.314 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36418.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2023-10-25T16:26:03.314 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52910.log 2023-10-25T16:26:03.314 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36288.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2023-10-25T16:26:03.314 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34742.log 2023-10-25T16:26:03.330 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52910.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52910.log.gz 2023-10-25T16:26:03.330 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54591.log 2023-10-25T16:26:03.330 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34742.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34742.log.gz 2023-10-25T16:26:03.330 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38183.log 2023-10-25T16:26:03.331 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54591.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54591.log.gz 2023-10-25T16:26:03.331 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2023-10-25T16:26:03.331 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38183.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38183.log.gz 2023-10-25T16:26:03.331 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2023-10-25T16:26:03.332 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49936.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2023-10-25T16:26:03.332 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54381.log 2023-10-25T16:26:03.332 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44727.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2023-10-25T16:26:03.332 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52702.log 2023-10-25T16:26:03.332 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54381.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54381.log.gz 2023-10-25T16:26:03.333 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47107.log 2023-10-25T16:26:03.333 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52702.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52702.log.gz 2023-10-25T16:26:03.333 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53307.log 2023-10-25T16:26:03.333 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47107.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47107.log.gz 2023-10-25T16:26:03.333 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33723.log 2023-10-25T16:26:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53307.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53307.log.gz 2023-10-25T16:26:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43135.log 2023-10-25T16:26:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33723.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33723.log.gz 2023-10-25T16:26:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2023-10-25T16:26:03.334 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43135.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43135.log.gz 2023-10-25T16:26:03.335 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44889.log 2023-10-25T16:26:03.335 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53594.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2023-10-25T16:26:03.335 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41275.log 2023-10-25T16:26:03.335 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44889.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2023-10-25T16:26:03.335 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56329.log 2023-10-25T16:26:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41275.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41275.log.gz 2023-10-25T16:26:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2023-10-25T16:26:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56329.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56329.log.gz 2023-10-25T16:26:03.336 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41570.log 2023-10-25T16:26:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48299.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2023-10-25T16:26:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56898.log 2023-10-25T16:26:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41570.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41570.log.gz 2023-10-25T16:26:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2023-10-25T16:26:03.337 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56898.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56898.log.gz 2023-10-25T16:26:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45707.log 2023-10-25T16:26:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51854.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2023-10-25T16:26:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36236.log 2023-10-25T16:26:03.338 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45707.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45707.log.gz 2023-10-25T16:26:03.339 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2023-10-25T16:26:03.339 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36236.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36236.log.gz 2023-10-25T16:26:03.339 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2023-10-25T16:26:03.339 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46309.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2023-10-25T16:26:03.339 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39692.log 2023-10-25T16:26:03.340 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43922.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2023-10-25T16:26:03.340 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56662.log 2023-10-25T16:26:03.340 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39692.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39692.log.gz 2023-10-25T16:26:03.340 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55402.log 2023-10-25T16:26:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56662.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56662.log.gz 2023-10-25T16:26:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36878.log 2023-10-25T16:26:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55402.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55402.log.gz 2023-10-25T16:26:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45154.log 2023-10-25T16:26:03.341 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36878.log.gz 2023-10-25T16:26:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41622.log 2023-10-25T16:26:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45154.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45154.log.gz 2023-10-25T16:26:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39822.log 2023-10-25T16:26:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41622.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41622.log.gz 2023-10-25T16:26:03.342 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49461.log 2023-10-25T16:26:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39822.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39822.log.gz 2023-10-25T16:26:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2023-10-25T16:26:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49461.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49461.log.gz 2023-10-25T16:26:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42525.log 2023-10-25T16:26:03.343 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2023-10-25T16:26:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57106.log 2023-10-25T16:26:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42525.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42525.log.gz 2023-10-25T16:26:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2023-10-25T16:26:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57106.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57106.log.gz 2023-10-25T16:26:03.344 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50566.log 2023-10-25T16:26:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47955.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2023-10-25T16:26:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52624.log 2023-10-25T16:26:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50566.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50566.log.gz 2023-10-25T16:26:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45362.log 2023-10-25T16:26:03.345 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52624.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52624.log.gz 2023-10-25T16:26:03.346 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37745.log 2023-10-25T16:26:03.346 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45362.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45362.log.gz 2023-10-25T16:26:03.346 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52010.log 2023-10-25T16:26:03.346 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37745.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37745.log.gz 2023-10-25T16:26:03.346 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2023-10-25T16:26:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52010.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52010.log.gz 2023-10-25T16:26:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2023-10-25T16:26:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42603.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2023-10-25T16:26:03.347 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52117.log 2023-10-25T16:26:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37088.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2023-10-25T16:26:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51698.log 2023-10-25T16:26:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52117.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52117.log.gz 2023-10-25T16:26:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56199.log 2023-10-25T16:26:03.348 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51698.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51698.log.gz 2023-10-25T16:26:03.349 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2023-10-25T16:26:03.356 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56199.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56199.log.gz 2023-10-25T16:26:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34954.log 2023-10-25T16:26:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41136.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2023-10-25T16:26:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2023-10-25T16:26:03.357 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34954.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34954.log.gz 2023-10-25T16:26:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46628.log 2023-10-25T16:26:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53385.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2023-10-25T16:26:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log 2023-10-25T16:26:03.358 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46628.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46628.log.gz 2023-10-25T16:26:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36904.log 2023-10-25T16:26:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54617.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54617.log.gz 2023-10-25T16:26:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34727.log 2023-10-25T16:26:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36904.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36904.log.gz 2023-10-25T16:26:03.359 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45076.log 2023-10-25T16:26:03.360 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34727.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34727.log.gz 2023-10-25T16:26:03.360 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51512.log 2023-10-25T16:26:03.360 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45076.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45076.log.gz 2023-10-25T16:26:03.360 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37955.log 2023-10-25T16:26:03.360 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51512.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51512.log.gz 2023-10-25T16:26:03.361 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2023-10-25T16:26:03.361 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37955.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37955.log.gz 2023-10-25T16:26:03.361 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33059.log 2023-10-25T16:26:03.361 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44395.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2023-10-25T16:26:03.361 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43109.log 2023-10-25T16:26:03.362 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33059.log: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.33059.log.gz 2023-10-25T16:26:03.362 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36054.log 2023-10-25T16:26:03.362 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43109.log.gz 2023-10-25T16:26:03.362 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38969.log 2023-10-25T16:26:03.362 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36054.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36054.log.gz 2023-10-25T16:26:03.363 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2023-10-25T16:26:03.363 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38969.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38969.log.gz 2023-10-25T16:26:03.363 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45444.log 2023-10-25T16:26:03.363 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48896.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2023-10-25T16:26:03.363 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41249.log 2023-10-25T16:26:03.364 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45444.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45444.log.gz 2023-10-25T16:26:03.364 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38079.log 2023-10-25T16:26:03.364 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41249.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41249.log.gz 2023-10-25T16:26:03.364 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2023-10-25T16:26:03.364 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38079.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38079.log.gz 2023-10-25T16:26:03.364 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2023-10-25T16:26:03.365 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47877.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2023-10-25T16:26:03.365 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52065.log 2023-10-25T16:26:03.365 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.45839.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz 2023-10-25T16:26:03.365 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2023-10-25T16:26:03.366 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.52065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40248.log 2023-10-25T16:26:03.366 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51095.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gz 2023-10-25T16:26:03.380 INFO:teuthology.orchestra.run.smithi177.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.52065.log.gz 2023-10-25T16:26:03.381 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2023-10-25T16:26:03.382 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40248.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40248.log.gz 2023-10-25T16:26:03.382 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54669.log 2023-10-25T16:26:03.383 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51069.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2023-10-25T16:26:03.383 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2023-10-25T16:26:03.384 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54669.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54669.log.gz 2023-10-25T16:26:03.384 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2023-10-25T16:26:03.385 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55038.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2023-10-25T16:26:03.386 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51458.log 2023-10-25T16:26:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47577.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2023-10-25T16:26:03.387 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2023-10-25T16:26:03.388 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51458.log.gz 2023-10-25T16:26:03.388 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37641.log 2023-10-25T16:26:03.389 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42147.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2023-10-25T16:26:03.389 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2023-10-25T16:26:03.390 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37641.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37641.log.gz 2023-10-25T16:26:03.390 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2023-10-25T16:26:03.391 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44649.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2023-10-25T16:26:03.391 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50233.log 2023-10-25T16:26:03.392 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37407.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2023-10-25T16:26:03.393 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33757.log 2023-10-25T16:26:03.393 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50233.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50233.log.gz 2023-10-25T16:26:03.394 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39029.log 2023-10-25T16:26:03.395 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33757.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33757.log.gz 2023-10-25T16:26:03.395 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47342.log 2023-10-25T16:26:03.396 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39029.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39029.log.gz 2023-10-25T16:26:03.396 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44238.log 2023-10-25T16:26:03.397 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47342.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47342.log.gz 2023-10-25T16:26:03.398 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2023-10-25T16:26:03.398 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44238.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44238.log.gz 2023-10-25T16:26:03.399 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2023-10-25T16:26:03.400 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43896.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2023-10-25T16:26:03.400 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2023-10-25T16:26:03.401 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53359.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2023-10-25T16:26:03.401 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2023-10-25T16:26:03.402 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.52494.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz 2023-10-25T16:26:03.402 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2023-10-25T16:26:03.403 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48575.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2023-10-25T16:26:03.404 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54251.log 2023-10-25T16:26:03.405 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43055.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2023-10-25T16:26:03.405 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42997.log 2023-10-25T16:26:03.406 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54251.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54251.log.gz 2023-10-25T16:26:03.406 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47719.log 2023-10-25T16:26:03.407 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42997.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42997.log.gz 2023-10-25T16:26:03.407 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56846.log 2023-10-25T16:26:03.408 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47719.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47719.log.gz 2023-10-25T16:26:03.408 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41830.log 2023-10-25T16:26:03.409 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56846.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56846.log.gz 2023-10-25T16:26:03.410 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2023-10-25T16:26:03.410 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41830.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41830.log.gz 2023-10-25T16:26:03.411 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34527.log 2023-10-25T16:26:03.412 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37323.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2023-10-25T16:26:03.412 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2023-10-25T16:26:03.413 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34527.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34527.log.gz 2023-10-25T16:26:03.413 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46230.log 2023-10-25T16:26:03.414 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43023.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 2023-10-25T16:26:03.415 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2023-10-25T16:26:03.420 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.46230.log: 93.9% -- replaced with /var/log/ceph/ceph-client.0.44525.log.gz 2023-10-25T16:26:03.425 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54721.log 2023-10-25T16:26:03.427 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.51750.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2023-10-25T16:26:03.427 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38053.log 2023-10-25T16:26:03.428 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54721.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54721.log.gz 2023-10-25T16:26:03.428 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56950.log 2023-10-25T16:26:03.429 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38053.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38053.log.gz 2023-10-25T16:26:03.429 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37271.log 2023-10-25T16:26:03.430 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56950.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56950.log.gz 2023-10-25T16:26:03.430 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41223.log 2023-10-25T16:26:03.431 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37271.log.gz 2023-10-25T16:26:03.432 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36002.log 2023-10-25T16:26:03.433 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41223.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41223.log.gz 2023-10-25T16:26:03.433 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2023-10-25T16:26:03.434 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36002.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36002.log.gz 2023-10-25T16:26:03.434 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34276.log 2023-10-25T16:26:03.435 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47771.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2023-10-25T16:26:03.435 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2023-10-25T16:26:03.436 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34276.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34276.log.gz 2023-10-25T16:26:03.436 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2023-10-25T16:26:03.437 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53198.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2023-10-25T16:26:03.437 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55637.log 2023-10-25T16:26:03.438 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33422.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2023-10-25T16:26:03.439 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34536.log 2023-10-25T16:26:03.439 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55637.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55637.log.gz 2023-10-25T16:26:03.440 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2023-10-25T16:26:03.441 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34536.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34536.log.gz 2023-10-25T16:26:03.441 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54407.log 2023-10-25T16:26:03.442 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34012.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2023-10-25T16:26:03.442 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37849.log 2023-10-25T16:26:03.443 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54407.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54407.log.gz 2023-10-25T16:26:03.443 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2023-10-25T16:26:03.444 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37849.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37849.log.gz 2023-10-25T16:26:03.444 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56714.log 2023-10-25T16:26:03.445 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43870.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2023-10-25T16:26:03.446 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2023-10-25T16:26:03.447 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.56714.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56714.log.gz 2023-10-25T16:26:03.447 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57184.log 2023-10-25T16:26:03.447 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-25T16:26:03.449 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34146.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2023-10-25T16:26:03.449 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39089.log 2023-10-25T16:26:03.449 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.57184.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57184.log.gz 2023-10-25T16:26:03.449 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33881.log 2023-10-25T16:26:03.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39089.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39089.log.gz 2023-10-25T16:26:03.451 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47525.log 2023-10-25T16:26:03.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33881.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33881.log.gz 2023-10-25T16:26:03.452 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55010.log 2023-10-25T16:26:03.452 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47525.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47525.log.gz 2023-10-25T16:26:03.453 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54955.log 2023-10-25T16:26:03.454 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55010.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55010.log.gz 2023-10-25T16:26:03.454 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55929.log 2023-10-25T16:26:03.455 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54955.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54955.log.gz 2023-10-25T16:26:03.455 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33107.log 2023-10-25T16:26:03.456 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55929.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55929.log.gz 2023-10-25T16:26:03.457 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38105.log 2023-10-25T16:26:03.457 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.33107.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33107.log.gz 2023-10-25T16:26:03.458 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41856.log 2023-10-25T16:26:03.458 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.38105.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38105.log.gz 2023-10-25T16:26:03.458 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37459.log 2023-10-25T16:26:03.459 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41856.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41856.log.gz 2023-10-25T16:26:03.460 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2023-10-25T16:26:03.461 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37459.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37459.log.gz 2023-10-25T16:26:03.461 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2023-10-25T16:26:03.462 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44030.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2023-10-25T16:26:03.462 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2023-10-25T16:26:03.463 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47159.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2023-10-25T16:26:03.463 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50452.log 2023-10-25T16:26:03.464 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47929.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2023-10-25T16:26:03.464 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53411.log 2023-10-25T16:26:03.465 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50452.log.gz 2023-10-25T16:26:03.465 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2023-10-25T16:26:03.466 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53411.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53411.log.gz 2023-10-25T16:26:03.467 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35447.log 2023-10-25T16:26:03.468 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48060.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2023-10-25T16:26:03.468 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44578.log 2023-10-25T16:26:03.469 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35447.log.gz 2023-10-25T16:26:03.469 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40482.log 2023-10-25T16:26:03.470 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44578.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44578.log.gz 2023-10-25T16:26:03.470 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2023-10-25T16:26:03.471 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40482.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40482.log.gz 2023-10-25T16:26:03.472 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47603.log 2023-10-25T16:26:03.472 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36611.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2023-10-25T16:26:03.473 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2023-10-25T16:26:03.473 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47603.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47603.log.gz 2023-10-25T16:26:03.474 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50913.log 2023-10-25T16:26:03.475 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40612.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2023-10-25T16:26:03.475 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42173.log 2023-10-25T16:26:03.475 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.50913.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50913.log.gz 2023-10-25T16:26:03.476 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43604.log 2023-10-25T16:26:03.477 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.42173.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42173.log.gz 2023-10-25T16:26:03.477 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2023-10-25T16:26:03.478 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43604.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43604.log.gz 2023-10-25T16:26:03.478 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55674.log 2023-10-25T16:26:03.479 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36262.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2023-10-25T16:26:03.479 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39189.log 2023-10-25T16:26:03.480 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.55674.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55674.log.gz 2023-10-25T16:26:03.481 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2023-10-25T16:26:03.481 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.39189.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39189.log.gz 2023-10-25T16:26:03.482 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2023-10-25T16:26:03.482 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48086.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2023-10-25T16:26:03.483 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53049.log 2023-10-25T16:26:03.484 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.44863.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2023-10-25T16:26:03.484 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43297.log 2023-10-25T16:26:03.485 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.53049.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53049.log.gz 2023-10-25T16:26:03.485 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2023-10-25T16:26:03.486 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43297.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43297.log.gz 2023-10-25T16:26:03.487 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2023-10-25T16:26:03.487 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.47133.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2023-10-25T16:26:03.488 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48818.log 2023-10-25T16:26:03.488 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32948.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2023-10-25T16:26:03.489 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2023-10-25T16:26:03.490 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.48818.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48818.log.gz 2023-10-25T16:26:03.490 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2023-10-25T16:26:03.491 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49312.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2023-10-25T16:26:03.491 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2023-10-25T16:26:03.492 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49253.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2023-10-25T16:26:03.492 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2023-10-25T16:26:03.493 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.49000.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2023-10-25T16:26:03.493 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54433.log 2023-10-25T16:26:03.494 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.46176.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gz 2023-10-25T16:26:03.495 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43323.log 2023-10-25T16:26:03.495 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54433.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54433.log.gz 2023-10-25T16:26:03.496 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41359.log 2023-10-25T16:26:03.497 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.43323.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43323.log.gz 2023-10-25T16:26:03.497 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41674.log 2023-10-25T16:26:03.498 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41359.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41359.log.gz 2023-10-25T16:26:03.498 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40352.log 2023-10-25T16:26:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41674.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41674.log.gz 2023-10-25T16:26:03.499 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41648.log 2023-10-25T16:26:03.500 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.40352.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40352.log.gz 2023-10-25T16:26:03.500 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34745.log 2023-10-25T16:26:03.501 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.41648.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41648.log.gz 2023-10-25T16:26:03.501 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54903.log 2023-10-25T16:26:03.502 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.34745.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34745.log.gz 2023-10-25T16:26:03.503 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35316.log 2023-10-25T16:26:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.54903.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54903.log.gz 2023-10-25T16:26:03.504 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.35316.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35316.log.gz 2023-10-25T16:26:03.575 INFO:teuthology.orchestra.run.smithi177.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.0.42787.log.gz 2023-10-25T16:26:03.641 INFO:teuthology.orchestra.run.smithi184.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-25T16:26:03.676 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-25T16:26:03.697 INFO:teuthology.orchestra.run.smithi184.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-25T16:26:03.745 INFO:teuthology.orchestra.run.smithi184.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-25T16:26:03.746 INFO:teuthology.orchestra.run.smithi184.stderr: 2023-10-25T16:26:03.746 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m0.947s 2023-10-25T16:26:03.746 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m4.965s 2023-10-25T16:26:03.746 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.239s 2023-10-25T16:26:03.747 INFO:teuthology.orchestra.run.smithi177.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.46230.log.gz 2023-10-25T16:26:03.795 INFO:teuthology.orchestra.run.smithi177.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-25T16:26:03.901 INFO:teuthology.orchestra.run.smithi177.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-25T16:26:03.903 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-25T16:26:03.915 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-25T16:26:03.934 INFO:teuthology.orchestra.run.smithi177.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-25T16:26:03.935 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-25T16:26:03.936 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m1.175s 2023-10-25T16:26:03.936 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m7.178s 2023-10-25T16:26:03.936 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.479s 2023-10-25T16:26:03.937 INFO:tasks.ceph:Archiving logs... 2023-10-25T16:26:03.937 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/remote/smithi177/log 2023-10-25T16:26:03.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-25T16:26:05.234 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/remote/smithi184/log 2023-10-25T16:26:05.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-25T16:26:05.804 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-25T16:26:05.816 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-25T16:26:05.816 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-25T16:26:05.819 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-25T16:26:05.900 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-25T16:26:05.909 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-25T16:26:05.910 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T16:26:05.912 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T16:26:05.922 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2023-10-25T16:26:05.922 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2023-10-25T16:26:05.923 INFO:teuthology.orchestra.run.smithi177.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 377 0.080 -8.520 1.835 2023-10-25T16:26:05.923 INFO:teuthology.orchestra.run.smithi177.stdout:+hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.089 -3.740 2.007 2023-10-25T16:26:05.923 INFO:teuthology.orchestra.run.smithi177.stdout:+hv03.front.sepi 74.6.168.72 3 u 48 64 377 0.106 -8.367 2.493 2023-10-25T16:26:05.923 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-10-25T16:26:05.925 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2023-10-25T16:26:05.926 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2023-10-25T16:26:05.926 INFO:teuthology.orchestra.run.smithi184.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 377 0.060 -6.981 0.294 2023-10-25T16:26:05.926 INFO:teuthology.orchestra.run.smithi184.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.117 -3.350 0.271 2023-10-25T16:26:05.926 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.065 -5.332 0.370 2023-10-25T16:26:05.926 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-10-25T16:26:05.927 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-25T16:26:05.947 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-25T16:26:05.947 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-25T16:26:05.996 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-25T16:26:06.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-25T16:26:06.097 INFO:teuthology.task.internal:Duration was 1440.897738 seconds 2023-10-25T16:26:06.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-25T16:26:06.144 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-25T16:26:06.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-25T16:26:06.148 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-25T16:26:06.212 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-25T16:26:06.212 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2023-10-25T16:26:06.212 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-25T16:26:06.222 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-10-25T16:26:06.223 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-25T16:26:06.232 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-25T16:26:06.232 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-25T16:26:06.267 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-25T16:26:06.293 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-25T16:26:06.294 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-25T16:26:06.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-25T16:26:06.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-25T16:26:06.417 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-25T16:26:06.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-25T16:26:06.429 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-25T16:26:06.443 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-25T16:26:06.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-25T16:26:06.479 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-25T16:26:06.488 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2023-10-25T16:26:06.495 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-10-25T16:26:06.507 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-25T16:26:06.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:26:06.545 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-25T16:26:06.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T16:26:06.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-25T16:26:06.563 INFO:teuthology.task.internal:Transferring archived files... 2023-10-25T16:26:06.564 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/remote/smithi177 2023-10-25T16:26:06.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-25T16:26:06.608 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235/remote/smithi184 2023-10-25T16:26:06.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-25T16:26:06.627 INFO:teuthology.task.internal:Removing archive directory... 2023-10-25T16:26:06.627 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-25T16:26:06.647 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-25T16:26:06.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-25T16:26:06.680 INFO:teuthology.task.internal:Not uploading archives. 2023-10-25T16:26:06.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-25T16:26:06.713 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-25T16:26:06.713 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-25T16:26:06.715 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-25T16:26:06.718 INFO:teuthology.orchestra.run.smithi177.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 25 16:26 /home/ubuntu/cephtest 2023-10-25T16:26:06.721 INFO:teuthology.orchestra.run.smithi184.stdout: 655476 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 25 16:26 /home/ubuntu/cephtest 2023-10-25T16:26:06.722 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-25T16:26:06.763 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-25T16:26:06.865 INFO:teuthology.nuke:Checking targets against current locks 2023-10-25T16:26:06.892 DEBUG:teuthology.nuke:shortname: smithi177 2023-10-25T16:26:06.892 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T16:26:06.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 15:53:38.701574', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMA7OsvM43FbQ7tmP9uXbzxtHcjG+Lv7PEIn6ndC3+2O3Hw/UIV4nU4KQRcld9CBTZXOjqdzrMvR4CnhWnxonYo='} 2023-10-25T16:26:06.921 DEBUG:teuthology.nuke:shortname: smithi184 2023-10-25T16:26:06.921 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T16:26:06.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436235', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 15:53:38.699784', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNq8bOfXnbynahfr4oiAsMkeZb4xAanGNQEOrecAResV89sIVyaEHaPUb2SU+0TZJWc7gzGae345vkj+FRuRfQ='} 2023-10-25T16:26:06.968 INFO:teuthology.orchestra.console.smithi177:Power off 2023-10-25T16:26:06.969 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T16:26:07.003 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2023-10-25T16:26:07.003 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:07.017 INFO:teuthology.orchestra.console.smithi184:Power off 2023-10-25T16:26:07.018 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T16:26:07.029 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-25T16:26:07.040 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-10-25T16:26:07.040 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:07.064 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-25T16:26:11.030 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:11.065 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:11.141 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-25T16:26:11.175 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-25T16:26:15.147 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:15.177 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:15.257 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2023-10-25T16:26:15.286 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-25T16:26:19.262 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:19.287 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T16:26:19.372 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2023-10-25T16:26:19.396 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-10-25T16:26:19.473 INFO:teuthology.orchestra.console.smithi177:Power off completed 2023-10-25T16:26:19.497 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-10-25T16:26:19.602 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1440.8977377414703 failure_reason: '"2023-10-25T16:12:53.778517+0000 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 127893.352632 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.3. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2023-10-25T16:26:19.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T16:26:19.683 INFO:teuthology.run:FAIL